2024-09-17T07:00:19.577 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-17T07:00:19.600 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-17T07:00:19.674 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-16_22:08:02-orch-reef-distro-default-smithi/7908149 branch: reef description: orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7908149' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/quincy ' name: teuthology-2024-09-16_22:08:02-orch-reef-distro-default-smithi no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: reef ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - OSD_DOWN - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: reef sha1: 1cbdc9211df088cccbd94423c7cf3a2b85fe432b owner: scheduled_teuthology@teuthology priority: 930 repo: https://git.ceph.com/ceph.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 5234 sha1: 19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 sleep_before_teardown: 0 subset: 46/64 suite: orch suite_branch: reef suite_path: /home/teuthworker/src/git.ceph.com_ceph_1cbdc9211df088cccbd94423c7cf3a2b85fe432b/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 1cbdc9211df088cccbd94423c7cf3a2b85fe432b targets: smithi087.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA/bA5Yk6NRg7DOL5QB00mdUZjqv19r6GPzDSy65dC2pJsX63Xi5GXu1pZhaVup4+qqY065zh+sNeY/wbzn6sRQ= smithi139.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFRltBGOfxZA68hAL7p3nOo/fD58ak3zvT86iEK2D1DzLBY4YdtyQ1fo2KN0rXX/PuVDFB0A3E1YSAV809Qilvs= tasks: - install: branch: quincy exclude_packages: - ceph-volume - print: '**** done install task...' - cephadm: cephadm_branch: quincy cephadm_git_url: https://github.com/ceph/ceph conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.ceph.io/ceph-ci/ceph:quincy roleless: true - print: '**** done end installing quincy cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 2 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay true - cephadm.shell: host.a: - ceph fs set cephfs inline_data true --yes-i-really-really-mean-it - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - ceph-fuse: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: - /home/teuthology/src/git.ceph.com_ceph_reef/qa/suites/orch/cephadm/mds_upgrade_sequence/tasks/3-upgrade-mgr-staggered.yaml meta: {} postmerge: [] variables: fail_fs: false teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-16_22:08:02 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs false || true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-09-17T07:00:19.674 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_1cbdc9211df088cccbd94423c7cf3a2b85fe432b/qa; will attempt to use it 2024-09-17T07:00:19.675 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_1cbdc9211df088cccbd94423c7cf3a2b85fe432b/qa/tasks 2024-09-17T07:00:19.675 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-17T07:00:19.676 INFO:teuthology.task.internal:Checking packages... 2024-09-17T07:00:19.698 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '19e2a2beb6f41a3ab62650e38614eb29b59dcbb9' 2024-09-17T07:00:19.698 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-17T07:00:19.698 INFO:teuthology.packaging:ref: None 2024-09-17T07:00:19.698 INFO:teuthology.packaging:tag: None 2024-09-17T07:00:19.698 INFO:teuthology.packaging:branch: reef 2024-09-17T07:00:19.698 INFO:teuthology.packaging:sha1: 19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 2024-09-17T07:00:19.698 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=reef 2024-09-17T07:00:19.944 INFO:teuthology.task.internal:Found packages for ceph version 18.2.4-855.g19e2a2be 2024-09-17T07:00:19.946 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-17T07:00:19.953 INFO:teuthology.task.internal:no buildpackages task found 2024-09-17T07:00:19.953 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-17T07:00:19.960 INFO:teuthology.task.internal:Saving configuration 2024-09-17T07:00:19.977 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-17T07:00:19.984 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-17T07:00:20.009 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi087.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-16_22:08:02-orch-reef-distro-default-smithi/7908149', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-17 06:55:21.787061', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA/bA5Yk6NRg7DOL5QB00mdUZjqv19r6GPzDSy65dC2pJsX63Xi5GXu1pZhaVup4+qqY065zh+sNeY/wbzn6sRQ='} 2024-09-17T07:00:20.027 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi139.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-16_22:08:02-orch-reef-distro-default-smithi/7908149', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-17 06:55:21.785094', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFRltBGOfxZA68hAL7p3nOo/fD58ak3zvT86iEK2D1DzLBY4YdtyQ1fo2KN0rXX/PuVDFB0A3E1YSAV809Qilvs='} 2024-09-17T07:00:20.027 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-17T07:00:20.033 INFO:teuthology.task.internal:roles: ubuntu@smithi087.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-09-17T07:00:20.033 INFO:teuthology.task.internal:roles: ubuntu@smithi139.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-09-17T07:00:20.034 INFO:teuthology.run_tasks:Running task console_log... 2024-09-17T07:00:20.093 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fecb709bac0>, signals=[15]) 2024-09-17T07:00:20.093 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-17T07:00:20.099 INFO:teuthology.task.internal:Opening connections... 2024-09-17T07:00:20.100 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi087.front.sepia.ceph.com 2024-09-17T07:00:20.101 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T07:00:20.176 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi139.front.sepia.ceph.com 2024-09-17T07:00:20.176 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T07:00:20.250 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-17T07:00:20.257 DEBUG:teuthology.orchestra.run.smithi087:> uname -m 2024-09-17T07:00:20.275 INFO:teuthology.orchestra.run.smithi087.stdout:x86_64 2024-09-17T07:00:20.275 DEBUG:teuthology.orchestra.run.smithi087:> cat /etc/os-release 2024-09-17T07:00:20.333 INFO:teuthology.orchestra.run.smithi087.stdout:NAME="CentOS Stream" 2024-09-17T07:00:20.333 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION="9" 2024-09-17T07:00:20.333 INFO:teuthology.orchestra.run.smithi087.stdout:ID="centos" 2024-09-17T07:00:20.333 INFO:teuthology.orchestra.run.smithi087.stdout:ID_LIKE="rhel fedora" 2024-09-17T07:00:20.333 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION_ID="9" 2024-09-17T07:00:20.334 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM_ID="platform:el9" 2024-09-17T07:00:20.334 INFO:teuthology.orchestra.run.smithi087.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-17T07:00:20.334 INFO:teuthology.orchestra.run.smithi087.stdout:ANSI_COLOR="0;31" 2024-09-17T07:00:20.334 INFO:teuthology.orchestra.run.smithi087.stdout:LOGO="fedora-logo-icon" 2024-09-17T07:00:20.334 INFO:teuthology.orchestra.run.smithi087.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-17T07:00:20.334 INFO:teuthology.orchestra.run.smithi087.stdout:HOME_URL="https://centos.org/" 2024-09-17T07:00:20.334 INFO:teuthology.orchestra.run.smithi087.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-17T07:00:20.334 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-17T07:00:20.334 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-17T07:00:20.335 INFO:teuthology.lock.ops:Updating smithi087.front.sepia.ceph.com on lock server 2024-09-17T07:00:20.355 DEBUG:teuthology.orchestra.run.smithi139:> uname -m 2024-09-17T07:00:20.374 INFO:teuthology.orchestra.run.smithi139.stdout:x86_64 2024-09-17T07:00:20.374 DEBUG:teuthology.orchestra.run.smithi139:> cat /etc/os-release 2024-09-17T07:00:20.432 INFO:teuthology.orchestra.run.smithi139.stdout:NAME="CentOS Stream" 2024-09-17T07:00:20.432 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION="9" 2024-09-17T07:00:20.432 INFO:teuthology.orchestra.run.smithi139.stdout:ID="centos" 2024-09-17T07:00:20.432 INFO:teuthology.orchestra.run.smithi139.stdout:ID_LIKE="rhel fedora" 2024-09-17T07:00:20.432 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_ID="9" 2024-09-17T07:00:20.433 INFO:teuthology.orchestra.run.smithi139.stdout:PLATFORM_ID="platform:el9" 2024-09-17T07:00:20.433 INFO:teuthology.orchestra.run.smithi139.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-17T07:00:20.433 INFO:teuthology.orchestra.run.smithi139.stdout:ANSI_COLOR="0;31" 2024-09-17T07:00:20.433 INFO:teuthology.orchestra.run.smithi139.stdout:LOGO="fedora-logo-icon" 2024-09-17T07:00:20.433 INFO:teuthology.orchestra.run.smithi139.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-17T07:00:20.433 INFO:teuthology.orchestra.run.smithi139.stdout:HOME_URL="https://centos.org/" 2024-09-17T07:00:20.433 INFO:teuthology.orchestra.run.smithi139.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-17T07:00:20.433 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-17T07:00:20.433 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-17T07:00:20.433 INFO:teuthology.lock.ops:Updating smithi139.front.sepia.ceph.com on lock server 2024-09-17T07:00:20.455 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-17T07:00:20.464 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-17T07:00:20.469 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-17T07:00:20.470 DEBUG:teuthology.orchestra.run.smithi087:> test '!' -e /home/ubuntu/cephtest 2024-09-17T07:00:20.472 DEBUG:teuthology.orchestra.run.smithi139:> test '!' -e /home/ubuntu/cephtest 2024-09-17T07:00:20.489 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-17T07:00:20.495 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-17T07:00:20.495 DEBUG:teuthology.orchestra.run.smithi087:> test -z $(ls -A /var/lib/ceph) 2024-09-17T07:00:20.530 DEBUG:teuthology.orchestra.run.smithi139:> test -z $(ls -A /var/lib/ceph) 2024-09-17T07:00:20.630 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-17T07:00:20.685 INFO:teuthology.run_tasks:Running task kernel... 2024-09-17T07:00:20.710 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-17T07:00:20.710 INFO:teuthology.task.kernel:config {'host.a': {'kdb': 1, 'sha1': 'distro'}, 'host.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-17T07:00:20.711 DEBUG:teuthology.orchestra.run.smithi087:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-17T07:00:20.711 DEBUG:teuthology.orchestra.run.smithi139:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-17T07:00:20.728 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T07:00:20.728 DEBUG:teuthology.orchestra.run.smithi139:> uname -r 2024-09-17T07:00:20.729 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T07:00:20.729 DEBUG:teuthology.orchestra.run.smithi087:> uname -r 2024-09-17T07:00:20.784 INFO:teuthology.orchestra.run.smithi139.stdout:5.14.0-503.el9.x86_64 2024-09-17T07:00:20.785 INFO:teuthology.task.kernel:Running kernel on smithi139: 5.14.0-503.el9.x86_64 2024-09-17T07:00:20.785 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum install -y kernel 2024-09-17T07:00:20.787 INFO:teuthology.orchestra.run.smithi087.stdout:5.14.0-503.el9.x86_64 2024-09-17T07:00:20.787 INFO:teuthology.task.kernel:Running kernel on smithi087: 5.14.0-503.el9.x86_64 2024-09-17T07:00:20.787 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum install -y kernel 2024-09-17T07:00:24.478 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS Stream 9 - BaseOS 4.4 MB/s | 8.3 MB 00:01 2024-09-17T07:00:26.100 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - BaseOS 2.4 MB/s | 8.3 MB 00:03 2024-09-17T07:00:27.754 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS Stream 9 - AppStream 9.2 MB/s | 20 MB 00:02 2024-09-17T07:00:33.712 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS Stream 9 - CRB 3.0 MB/s | 6.5 MB 00:02 2024-09-17T07:00:35.363 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS Stream 9 - Extras packages 43 kB/s | 19 kB 00:00 2024-09-17T07:00:36.484 INFO:teuthology.orchestra.run.smithi139.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:00 2024-09-17T07:00:41.881 INFO:teuthology.orchestra.run.smithi139.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-17T07:00:43.779 INFO:teuthology.orchestra.run.smithi139.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-17T07:00:43.779 INFO:teuthology.orchestra.run.smithi139.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-17T07:00:43.863 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-17T07:00:43.871 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-17T07:00:43.872 INFO:teuthology.orchestra.run.smithi139.stdout: Package Architecture Version Repository Size 2024-09-17T07:00:43.872 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-17T07:00:43.872 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2024-09-17T07:00:43.872 INFO:teuthology.orchestra.run.smithi139.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-17T07:00:43.872 INFO:teuthology.orchestra.run.smithi139.stdout:Installing dependencies: 2024-09-17T07:00:43.872 INFO:teuthology.orchestra.run.smithi139.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-17T07:00:43.872 INFO:teuthology.orchestra.run.smithi139.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-17T07:00:43.872 INFO:teuthology.orchestra.run.smithi139.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-17T07:00:43.872 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:00:43.872 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2024-09-17T07:00:43.872 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-17T07:00:43.872 INFO:teuthology.orchestra.run.smithi139.stdout:Install 4 Packages 2024-09-17T07:00:43.873 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:00:43.873 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 79 M 2024-09-17T07:00:43.873 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 126 M 2024-09-17T07:00:43.873 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2024-09-17T07:00:44.182 INFO:teuthology.orchestra.run.smithi139.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 125 kB/s | 36 kB 00:00 2024-09-17T07:00:45.449 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - AppStream 1.1 MB/s | 20 MB 00:18 2024-09-17T07:00:47.116 INFO:teuthology.orchestra.run.smithi139.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 4.9 MB/s | 16 MB 00:03 2024-09-17T07:00:50.775 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - CRB 4.3 MB/s | 6.5 MB 00:01 2024-09-17T07:00:53.025 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - Extras packages 18 kB/s | 19 kB 00:01 2024-09-17T07:00:54.138 INFO:teuthology.orchestra.run.smithi087.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:00 2024-09-17T07:00:59.519 INFO:teuthology.orchestra.run.smithi087.stdout:lab-extras 22 kB/s | 1.7 kB 00:00 2024-09-17T07:01:01.426 INFO:teuthology.orchestra.run.smithi087.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-17T07:01:01.426 INFO:teuthology.orchestra.run.smithi087.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-17T07:01:01.527 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-09-17T07:01:01.534 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-09-17T07:01:01.534 INFO:teuthology.orchestra.run.smithi087.stdout: Package Architecture Version Repository Size 2024-09-17T07:01:01.534 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-09-17T07:01:01.534 INFO:teuthology.orchestra.run.smithi087.stdout:Installing: 2024-09-17T07:01:01.535 INFO:teuthology.orchestra.run.smithi087.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-17T07:01:01.535 INFO:teuthology.orchestra.run.smithi087.stdout:Installing dependencies: 2024-09-17T07:01:01.535 INFO:teuthology.orchestra.run.smithi087.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-17T07:01:01.535 INFO:teuthology.orchestra.run.smithi087.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-17T07:01:01.535 INFO:teuthology.orchestra.run.smithi087.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-17T07:01:01.535 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:01:01.535 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction Summary 2024-09-17T07:01:01.535 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-09-17T07:01:01.535 INFO:teuthology.orchestra.run.smithi087.stdout:Install 4 Packages 2024-09-17T07:01:01.535 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:01:01.536 INFO:teuthology.orchestra.run.smithi087.stdout:Total download size: 79 M 2024-09-17T07:01:01.536 INFO:teuthology.orchestra.run.smithi087.stdout:Installed size: 126 M 2024-09-17T07:01:01.536 INFO:teuthology.orchestra.run.smithi087.stdout:Downloading Packages: 2024-09-17T07:01:01.771 INFO:teuthology.orchestra.run.smithi087.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 356 kB/s | 36 kB 00:00 2024-09-17T07:01:02.171 INFO:teuthology.orchestra.run.smithi087.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 31 MB/s | 16 MB 00:00 2024-09-17T07:01:02.546 INFO:teuthology.orchestra.run.smithi087.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 37 MB/s | 29 MB 00:00 2024-09-17T07:01:02.855 INFO:teuthology.orchestra.run.smithi087.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 29 MB/s | 35 MB 00:01 2024-09-17T07:01:02.855 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2024-09-17T07:01:02.855 INFO:teuthology.orchestra.run.smithi087.stdout:Total 60 MB/s | 79 MB 00:01 2024-09-17T07:01:03.538 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction check 2024-09-17T07:01:03.891 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction check succeeded. 2024-09-17T07:01:03.891 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction test 2024-09-17T07:01:04.863 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction test succeeded. 2024-09-17T07:01:04.863 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction 2024-09-17T07:01:07.297 INFO:teuthology.orchestra.run.smithi087.stdout: Preparing : 1/1 2024-09-17T07:01:07.943 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-17T07:01:08.049 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T07:01:10.827 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T07:01:10.976 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T07:01:15.796 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T07:01:15.843 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T07:01:19.303 INFO:teuthology.orchestra.run.smithi139.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 833 kB/s | 29 MB 00:35 2024-09-17T07:01:20.718 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T07:01:22.303 INFO:teuthology.orchestra.run.smithi139.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 921 kB/s | 35 MB 00:38 2024-09-17T07:01:22.303 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2024-09-17T07:01:22.303 INFO:teuthology.orchestra.run.smithi139.stdout:Total 2.1 MB/s | 79 MB 00:38 2024-09-17T07:01:22.978 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2024-09-17T07:01:23.344 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2024-09-17T07:01:23.344 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2024-09-17T07:01:24.297 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2024-09-17T07:01:24.297 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2024-09-17T07:01:26.737 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2024-09-17T07:01:27.423 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-17T07:01:27.511 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T07:01:30.252 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T07:01:30.389 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T07:01:35.218 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T07:01:35.314 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T07:01:40.170 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T07:01:59.057 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T07:01:59.096 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-17T07:01:59.406 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T07:01:59.407 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-17T07:01:59.407 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T07:01:59.407 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T07:02:00.208 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T07:02:00.208 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:02:00.208 INFO:teuthology.orchestra.run.smithi087.stdout:Installed: 2024-09-17T07:02:00.208 INFO:teuthology.orchestra.run.smithi087.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-17T07:02:00.208 INFO:teuthology.orchestra.run.smithi087.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-17T07:02:00.209 INFO:teuthology.orchestra.run.smithi087.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-17T07:02:00.209 INFO:teuthology.orchestra.run.smithi087.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-17T07:02:00.209 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:02:00.209 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-09-17T07:02:00.578 DEBUG:teuthology.orchestra.run.smithi087:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T07:02:00.668 INFO:teuthology.orchestra.run.smithi087.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T07:02:00.668 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T07:02:00.668 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-17T07:02:00.668 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-17T07:02:00.668 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-17T07:02:00.669 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2024-09-17T07:02:00.669 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi087.front.sepia.ceph.com, path=None, version=distro) 2024-09-17T07:02:00.669 DEBUG:teuthology.orchestra.run.smithi087:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T07:02:00.728 INFO:teuthology.orchestra.run.smithi087.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T07:02:00.728 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T07:02:00.729 DEBUG:teuthology.orchestra.run.smithi087:> sudo rpm -qi grub2-tools 2024-09-17T07:02:00.769 INFO:teuthology.orchestra.run.smithi087.stdout:Name : grub2-tools 2024-09-17T07:02:00.769 INFO:teuthology.orchestra.run.smithi087.stdout:Epoch : 1 2024-09-17T07:02:00.770 INFO:teuthology.orchestra.run.smithi087.stdout:Version : 2.06 2024-09-17T07:02:00.770 INFO:teuthology.orchestra.run.smithi087.stdout:Release : 82.el9 2024-09-17T07:02:00.770 INFO:teuthology.orchestra.run.smithi087.stdout:Architecture: x86_64 2024-09-17T07:02:00.770 INFO:teuthology.orchestra.run.smithi087.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-17T07:02:00.770 INFO:teuthology.orchestra.run.smithi087.stdout:Group : Unspecified 2024-09-17T07:02:00.770 INFO:teuthology.orchestra.run.smithi087.stdout:Size : 8274670 2024-09-17T07:02:00.770 INFO:teuthology.orchestra.run.smithi087.stdout:License : GPLv3+ 2024-09-17T07:02:00.771 INFO:teuthology.orchestra.run.smithi087.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-17T07:02:00.771 INFO:teuthology.orchestra.run.smithi087.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-17T07:02:00.771 INFO:teuthology.orchestra.run.smithi087.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-17T07:02:00.771 INFO:teuthology.orchestra.run.smithi087.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-17T07:02:00.771 INFO:teuthology.orchestra.run.smithi087.stdout:Packager : builder@centos.org 2024-09-17T07:02:00.771 INFO:teuthology.orchestra.run.smithi087.stdout:Vendor : CentOS 2024-09-17T07:02:00.771 INFO:teuthology.orchestra.run.smithi087.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-17T07:02:00.771 INFO:teuthology.orchestra.run.smithi087.stdout:Summary : Support tools for GRUB. 2024-09-17T07:02:00.771 INFO:teuthology.orchestra.run.smithi087.stdout:Description : 2024-09-17T07:02:00.771 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:02:00.771 INFO:teuthology.orchestra.run.smithi087.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-17T07:02:00.771 INFO:teuthology.orchestra.run.smithi087.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-17T07:02:00.771 INFO:teuthology.orchestra.run.smithi087.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-17T07:02:00.771 INFO:teuthology.orchestra.run.smithi087.stdout:hardware devices. 2024-09-17T07:02:00.772 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:02:00.772 INFO:teuthology.orchestra.run.smithi087.stdout:This subpackage provides tools for support of all platforms. 2024-09-17T07:02:00.772 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-17T07:02:00.773 INFO:teuthology.task.kernel:Updating grub on smithi087 to boot 5.14.0-508.el9.x86_64 2024-09-17T07:02:00.773 DEBUG:teuthology.orchestra.run.smithi087:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-17T07:02:01.386 INFO:teuthology.orchestra.run.smithi087.stderr:Generating grub configuration file ... 2024-09-17T07:02:02.731 INFO:teuthology.orchestra.run.smithi087.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-17T07:02:02.766 INFO:teuthology.orchestra.run.smithi087.stderr:done 2024-09-17T07:02:02.768 DEBUG:teuthology.orchestra.run.smithi087:> mktemp 2024-09-17T07:02:02.783 INFO:teuthology.orchestra.run.smithi087.stdout:/tmp/tmp.mwfgwhhT5F 2024-09-17T07:02:02.783 DEBUG:teuthology.orchestra.run.smithi087:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.mwfgwhhT5F 2024-09-17T07:02:02.849 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 0666 /tmp/tmp.mwfgwhhT5F 2024-09-17T07:02:02.997 DEBUG:teuthology.orchestra.remote:smithi087:/tmp/tmp.mwfgwhhT5F is 6KB 2024-09-17T07:02:03.046 DEBUG:teuthology.orchestra.run.smithi087:> rm -fr /tmp/tmp.mwfgwhhT5F 2024-09-17T07:02:03.060 DEBUG:teuthology.orchestra.run.smithi087:> sudo /bin/ls /boot/loader/entries || true 2024-09-17T07:02:03.128 INFO:teuthology.orchestra.run.smithi087.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-17T07:02:03.128 INFO:teuthology.orchestra.run.smithi087.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-17T07:02:03.128 INFO:teuthology.orchestra.run.smithi087.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-17T07:02:03.128 INFO:teuthology.orchestra.run.smithi087.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-17T07:02:03.130 DEBUG:teuthology.orchestra.run.smithi087:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-17T07:02:03.287 DEBUG:teuthology.orchestra.run.smithi087:> sudo shutdown -r now 2024-09-17T07:02:18.412 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T07:02:18.450 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-17T07:02:18.744 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T07:02:18.744 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-17T07:02:18.744 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T07:02:18.745 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T07:02:19.567 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T07:02:19.567 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:02:19.568 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2024-09-17T07:02:19.568 INFO:teuthology.orchestra.run.smithi139.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-17T07:02:19.568 INFO:teuthology.orchestra.run.smithi139.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-17T07:02:19.568 INFO:teuthology.orchestra.run.smithi139.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-17T07:02:19.568 INFO:teuthology.orchestra.run.smithi139.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-17T07:02:19.568 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:02:19.568 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-17T07:02:19.922 DEBUG:teuthology.orchestra.run.smithi139:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T07:02:20.012 INFO:teuthology.orchestra.run.smithi139.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T07:02:20.012 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T07:02:20.012 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-17T07:02:20.013 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-17T07:02:20.013 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-17T07:02:20.013 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2024-09-17T07:02:20.013 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi139.front.sepia.ceph.com, path=None, version=distro) 2024-09-17T07:02:20.013 DEBUG:teuthology.orchestra.run.smithi139:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T07:02:20.073 INFO:teuthology.orchestra.run.smithi139.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T07:02:20.073 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T07:02:20.073 DEBUG:teuthology.orchestra.run.smithi139:> sudo rpm -qi grub2-tools 2024-09-17T07:02:20.105 INFO:teuthology.orchestra.run.smithi139.stdout:Name : grub2-tools 2024-09-17T07:02:20.105 INFO:teuthology.orchestra.run.smithi139.stdout:Epoch : 1 2024-09-17T07:02:20.105 INFO:teuthology.orchestra.run.smithi139.stdout:Version : 2.06 2024-09-17T07:02:20.105 INFO:teuthology.orchestra.run.smithi139.stdout:Release : 82.el9 2024-09-17T07:02:20.105 INFO:teuthology.orchestra.run.smithi139.stdout:Architecture: x86_64 2024-09-17T07:02:20.105 INFO:teuthology.orchestra.run.smithi139.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-17T07:02:20.106 INFO:teuthology.orchestra.run.smithi139.stdout:Group : Unspecified 2024-09-17T07:02:20.106 INFO:teuthology.orchestra.run.smithi139.stdout:Size : 8274670 2024-09-17T07:02:20.106 INFO:teuthology.orchestra.run.smithi139.stdout:License : GPLv3+ 2024-09-17T07:02:20.106 INFO:teuthology.orchestra.run.smithi139.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-17T07:02:20.106 INFO:teuthology.orchestra.run.smithi139.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-17T07:02:20.106 INFO:teuthology.orchestra.run.smithi139.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-17T07:02:20.106 INFO:teuthology.orchestra.run.smithi139.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-17T07:02:20.106 INFO:teuthology.orchestra.run.smithi139.stdout:Packager : builder@centos.org 2024-09-17T07:02:20.106 INFO:teuthology.orchestra.run.smithi139.stdout:Vendor : CentOS 2024-09-17T07:02:20.106 INFO:teuthology.orchestra.run.smithi139.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-17T07:02:20.106 INFO:teuthology.orchestra.run.smithi139.stdout:Summary : Support tools for GRUB. 2024-09-17T07:02:20.106 INFO:teuthology.orchestra.run.smithi139.stdout:Description : 2024-09-17T07:02:20.106 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:02:20.106 INFO:teuthology.orchestra.run.smithi139.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-17T07:02:20.107 INFO:teuthology.orchestra.run.smithi139.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-17T07:02:20.107 INFO:teuthology.orchestra.run.smithi139.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-17T07:02:20.107 INFO:teuthology.orchestra.run.smithi139.stdout:hardware devices. 2024-09-17T07:02:20.107 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:02:20.107 INFO:teuthology.orchestra.run.smithi139.stdout:This subpackage provides tools for support of all platforms. 2024-09-17T07:02:20.108 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-17T07:02:20.108 INFO:teuthology.task.kernel:Updating grub on smithi139 to boot 5.14.0-508.el9.x86_64 2024-09-17T07:02:20.108 DEBUG:teuthology.orchestra.run.smithi139:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-17T07:02:20.757 INFO:teuthology.orchestra.run.smithi139.stderr:Generating grub configuration file ... 2024-09-17T07:02:22.029 INFO:teuthology.orchestra.run.smithi139.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-17T07:02:22.060 INFO:teuthology.orchestra.run.smithi139.stderr:done 2024-09-17T07:02:22.062 DEBUG:teuthology.orchestra.run.smithi139:> mktemp 2024-09-17T07:02:22.078 INFO:teuthology.orchestra.run.smithi139.stdout:/tmp/tmp.IoRLbUOSzn 2024-09-17T07:02:22.078 DEBUG:teuthology.orchestra.run.smithi139:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.IoRLbUOSzn 2024-09-17T07:02:22.144 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod 0666 /tmp/tmp.IoRLbUOSzn 2024-09-17T07:02:22.279 DEBUG:teuthology.orchestra.remote:smithi139:/tmp/tmp.IoRLbUOSzn is 6KB 2024-09-17T07:02:22.328 DEBUG:teuthology.orchestra.run.smithi139:> rm -fr /tmp/tmp.IoRLbUOSzn 2024-09-17T07:02:22.343 DEBUG:teuthology.orchestra.run.smithi139:> sudo /bin/ls /boot/loader/entries || true 2024-09-17T07:02:22.405 INFO:teuthology.orchestra.run.smithi139.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-17T07:02:22.405 INFO:teuthology.orchestra.run.smithi139.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-17T07:02:22.406 INFO:teuthology.orchestra.run.smithi139.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-17T07:02:22.406 INFO:teuthology.orchestra.run.smithi139.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-17T07:02:22.407 DEBUG:teuthology.orchestra.run.smithi139:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-17T07:02:22.554 DEBUG:teuthology.orchestra.run.smithi139:> sudo shutdown -r now 2024-09-17T07:02:33.301 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-09-17T07:02:33.301 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-09-17T07:02:33.302 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T07:02:52.573 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-09-17T07:02:52.573 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com' 2024-09-17T07:02:52.574 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T07:03:33.345 DEBUG:teuthology.orchestra.remote:timed out 2024-09-17T07:03:42.354 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-09-17T07:03:42.356 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T07:03:42.713 DEBUG:teuthology.orchestra.run.smithi087:> true 2024-09-17T07:03:43.171 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-09-17T07:03:43.171 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "5.14.0-508.el9.x86_64"... 2024-09-17T07:03:43.172 DEBUG:teuthology.orchestra.run.smithi087:> uname -r 2024-09-17T07:03:43.186 INFO:teuthology.orchestra.run.smithi087.stdout:5.14.0-508.el9.x86_64 2024-09-17T07:03:43.186 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-17T07:03:43.186 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-17T07:03:43.186 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-17T07:03:44.188 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-09-17T07:03:44.188 DEBUG:teuthology.orchestra.run.smithi087:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-17T07:03:44.296 INFO:teuthology.orchestra.run.smithi087.stdout:ttyS1 2024-09-17T07:03:44.320 DEBUG:teuthology.parallel:result is None 2024-09-17T07:03:52.577 DEBUG:teuthology.orchestra.remote:timed out 2024-09-17T07:04:01.578 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com' 2024-09-17T07:04:01.579 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T07:04:01.935 DEBUG:teuthology.orchestra.run.smithi139:> true 2024-09-17T07:04:02.361 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi139.front.sepia.ceph.com' 2024-09-17T07:04:02.361 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "5.14.0-508.el9.x86_64"... 2024-09-17T07:04:02.361 DEBUG:teuthology.orchestra.run.smithi139:> uname -r 2024-09-17T07:04:02.379 INFO:teuthology.orchestra.run.smithi139.stdout:5.14.0-508.el9.x86_64 2024-09-17T07:04:02.380 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-17T07:04:02.380 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-17T07:04:02.380 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-17T07:04:03.381 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-09-17T07:04:03.381 DEBUG:teuthology.orchestra.run.smithi139:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-17T07:04:03.471 INFO:teuthology.orchestra.run.smithi139.stdout:ttyS1 2024-09-17T07:04:03.500 DEBUG:teuthology.parallel:result is None 2024-09-17T07:04:03.500 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-17T07:04:03.507 INFO:teuthology.task.internal:Creating test directory... 2024-09-17T07:04:03.507 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-17T07:04:03.510 DEBUG:teuthology.orchestra.run.smithi139:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-17T07:04:03.528 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-17T07:04:03.534 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-17T07:04:03.548 INFO:teuthology.task.internal:Creating archive directory... 2024-09-17T07:04:03.548 DEBUG:teuthology.orchestra.run.smithi087:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-17T07:04:03.570 DEBUG:teuthology.orchestra.run.smithi139:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-17T07:04:03.818 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-17T07:04:03.824 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-17T07:04:03.824 DEBUG:teuthology.orchestra.run.smithi087:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-17T07:04:03.827 DEBUG:teuthology.orchestra.run.smithi139:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-17T07:04:03.857 INFO:teuthology.orchestra.run.smithi087.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T07:04:03.858 INFO:teuthology.orchestra.run.smithi139.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T07:04:03.868 INFO:teuthology.orchestra.run.smithi139.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T07:04:03.869 INFO:teuthology.orchestra.run.smithi087.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T07:04:03.871 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-17T07:04:03.877 INFO:teuthology.task.internal:Configuring sudo... 2024-09-17T07:04:03.877 DEBUG:teuthology.orchestra.run.smithi087:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-17T07:04:03.913 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-17T07:04:03.938 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-17T07:04:03.951 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-17T07:04:03.952 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-17T07:04:03.981 DEBUG:teuthology.orchestra.run.smithi139:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-17T07:04:03.996 DEBUG:teuthology.orchestra.run.smithi087:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T07:04:04.079 DEBUG:teuthology.orchestra.run.smithi087:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T07:04:04.130 DEBUG:teuthology.orchestra.run.smithi087:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T07:04:04.215 DEBUG:teuthology.orchestra.run.smithi087:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T07:04:04.256 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-17T07:04:04.256 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-17T07:04:04.323 DEBUG:teuthology.orchestra.run.smithi139:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T07:04:04.366 DEBUG:teuthology.orchestra.run.smithi139:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T07:04:04.408 DEBUG:teuthology.orchestra.run.smithi139:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T07:04:04.490 DEBUG:teuthology.orchestra.run.smithi139:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T07:04:04.530 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-17T07:04:04.530 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-17T07:04:04.596 DEBUG:teuthology.orchestra.run.smithi087:> sudo service rsyslog restart 2024-09-17T07:04:04.598 DEBUG:teuthology.orchestra.run.smithi139:> sudo service rsyslog restart 2024-09-17T07:04:04.662 INFO:teuthology.orchestra.run.smithi087.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T07:04:04.690 INFO:teuthology.orchestra.run.smithi139.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T07:04:05.159 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-17T07:04:05.167 INFO:teuthology.task.internal:Starting timer... 2024-09-17T07:04:05.167 INFO:teuthology.run_tasks:Running task pcp... 2024-09-17T07:04:05.188 INFO:teuthology.run_tasks:Running task selinux... 2024-09-17T07:04:05.196 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-09-17T07:04:05.196 DEBUG:teuthology.orchestra.run.smithi087:> sudo service auditd rotate 2024-09-17T07:04:05.255 INFO:teuthology.orchestra.run.smithi087.stdout:Rotating logs: 2024-09-17T07:04:05.258 DEBUG:teuthology.orchestra.run.smithi139:> sudo service auditd rotate 2024-09-17T07:04:05.321 INFO:teuthology.orchestra.run.smithi139.stdout:Rotating logs: 2024-09-17T07:04:05.322 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-17T07:04:05.323 DEBUG:teuthology.orchestra.run.smithi087:> /usr/sbin/getenforce 2024-09-17T07:04:05.345 INFO:teuthology.orchestra.run.smithi087.stdout:Permissive 2024-09-17T07:04:05.345 DEBUG:teuthology.orchestra.run.smithi139:> /usr/sbin/getenforce 2024-09-17T07:04:05.369 INFO:teuthology.orchestra.run.smithi139.stdout:Permissive 2024-09-17T07:04:05.369 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi087.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi139.front.sepia.ceph.com': 'permissive'} 2024-09-17T07:04:05.369 DEBUG:teuthology.orchestra.run.smithi087:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-17T07:04:05.412 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T07:04:05.412 DEBUG:teuthology.orchestra.run.smithi139:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-17T07:04:05.441 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T07:04:05.441 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-17T07:04:05.442 DEBUG:teuthology.orchestra.run.smithi087:> sudo /usr/sbin/setenforce permissive 2024-09-17T07:04:05.489 DEBUG:teuthology.orchestra.run.smithi139:> sudo /usr/sbin/setenforce permissive 2024-09-17T07:04:05.523 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-17T07:04:05.532 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-17T07:04:05.543 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-17T07:04:05.544 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi087.front.sepia.ceph.com,smithi139.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-17T07:07:49.188 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi087.front.sepia.ceph.com'), Remote(name='ubuntu@smithi139.front.sepia.ceph.com')] 2024-09-17T07:07:49.189 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-09-17T07:07:49.191 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T07:07:49.277 DEBUG:teuthology.orchestra.run.smithi087:> true 2024-09-17T07:07:49.364 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-09-17T07:07:49.364 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com' 2024-09-17T07:07:49.365 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T07:07:49.449 DEBUG:teuthology.orchestra.run.smithi139:> true 2024-09-17T07:07:49.528 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi139.front.sepia.ceph.com' 2024-09-17T07:07:49.529 INFO:teuthology.run_tasks:Running task clock... 2024-09-17T07:07:49.542 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-17T07:07:49.542 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-17T07:07:49.543 DEBUG:teuthology.orchestra.run.smithi087:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T07:07:49.545 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-17T07:07:49.546 DEBUG:teuthology.orchestra.run.smithi139:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T07:07:49.572 INFO:teuthology.orchestra.run.smithi087.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-17T07:07:49.586 INFO:teuthology.orchestra.run.smithi087.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-17T07:07:49.598 INFO:teuthology.orchestra.run.smithi139.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-17T07:07:49.610 INFO:teuthology.orchestra.run.smithi087.stderr:sudo: ntpd: command not found 2024-09-17T07:07:49.613 INFO:teuthology.orchestra.run.smithi139.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-17T07:07:49.621 INFO:teuthology.orchestra.run.smithi087.stdout:506 Cannot talk to daemon 2024-09-17T07:07:49.635 INFO:teuthology.orchestra.run.smithi087.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-17T07:07:49.638 INFO:teuthology.orchestra.run.smithi139.stderr:sudo: ntpd: command not found 2024-09-17T07:07:49.648 INFO:teuthology.orchestra.run.smithi139.stdout:506 Cannot talk to daemon 2024-09-17T07:07:49.649 INFO:teuthology.orchestra.run.smithi087.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-17T07:07:49.663 INFO:teuthology.orchestra.run.smithi139.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-17T07:07:49.677 INFO:teuthology.orchestra.run.smithi139.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-17T07:07:49.709 INFO:teuthology.orchestra.run.smithi087.stderr:bash: line 1: ntpq: command not found 2024-09-17T07:07:49.714 INFO:teuthology.orchestra.run.smithi087.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T07:07:49.714 INFO:teuthology.orchestra.run.smithi087.stdout:=============================================================================== 2024-09-17T07:07:49.714 INFO:teuthology.orchestra.run.smithi087.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T07:07:49.714 INFO:teuthology.orchestra.run.smithi087.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T07:07:49.714 INFO:teuthology.orchestra.run.smithi087.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T07:07:49.714 INFO:teuthology.orchestra.run.smithi087.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T07:07:49.733 INFO:teuthology.orchestra.run.smithi139.stderr:bash: line 1: ntpq: command not found 2024-09-17T07:07:49.737 INFO:teuthology.orchestra.run.smithi139.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T07:07:49.737 INFO:teuthology.orchestra.run.smithi139.stdout:=============================================================================== 2024-09-17T07:07:49.737 INFO:teuthology.orchestra.run.smithi139.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T07:07:49.737 INFO:teuthology.orchestra.run.smithi139.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T07:07:49.737 INFO:teuthology.orchestra.run.smithi139.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T07:07:49.737 INFO:teuthology.orchestra.run.smithi139.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T07:07:49.738 INFO:teuthology.run_tasks:Running task install... 2024-09-17T07:07:49.747 DEBUG:teuthology.task.install:project ceph 2024-09-17T07:07:49.747 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '19e2a2beb6f41a3ab62650e38614eb29b59dcbb9'}} 2024-09-17T07:07:49.747 DEBUG:teuthology.task.install:config {'branch': 'quincy', 'exclude_packages': ['ceph-volume'], 'flavor': 'default', 'sha1': '19e2a2beb6f41a3ab62650e38614eb29b59dcbb9'} 2024-09-17T07:07:49.747 INFO:teuthology.task.install:Using flavor: default 2024-09-17T07:07:49.753 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-17T07:07:49.753 INFO:teuthology.task.install:extra packages: [] 2024-09-17T07:07:49.753 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '19e2a2beb6f41a3ab62650e38614eb29b59dcbb9', 'tag': None, 'wait_for_package': False} 2024-09-17T07:07:49.754 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-17T07:07:49.754 INFO:teuthology.packaging:ref: None 2024-09-17T07:07:49.754 INFO:teuthology.packaging:tag: None 2024-09-17T07:07:49.754 INFO:teuthology.packaging:branch: quincy 2024-09-17T07:07:49.754 INFO:teuthology.packaging:sha1: 19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 2024-09-17T07:07:49.755 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-09-17T07:07:49.757 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '19e2a2beb6f41a3ab62650e38614eb29b59dcbb9', 'tag': None, 'wait_for_package': False} 2024-09-17T07:07:49.757 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-17T07:07:49.757 INFO:teuthology.packaging:ref: None 2024-09-17T07:07:49.757 INFO:teuthology.packaging:tag: None 2024-09-17T07:07:49.757 INFO:teuthology.packaging:branch: quincy 2024-09-17T07:07:49.757 INFO:teuthology.packaging:sha1: 19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 2024-09-17T07:07:49.757 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-09-17T07:07:49.980 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/quincy/4a704134aa895fa24b75bb03cb263f1e3316004e/centos/9/flavors/default/ 2024-09-17T07:07:49.980 INFO:teuthology.task.install.rpm:Package version is 17.2.7-1635.g4a704134 2024-09-17T07:07:49.995 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/quincy/4a704134aa895fa24b75bb03cb263f1e3316004e/centos/9/flavors/default/ 2024-09-17T07:07:49.996 INFO:teuthology.task.install.rpm:Package version is 17.2.7-1635.g4a704134 2024-09-17T07:07:50.089 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/quincy/4a704134aa895fa24b75bb03cb263f1e3316004e/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/quincy/4a704134aa895fa24b75bb03cb263f1e3316004e/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/quincy/4a704134aa895fa24b75bb03cb263f1e3316004e/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-17T07:07:50.089 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-17T07:07:50.089 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-17T07:07:50.104 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/quincy/4a704134aa895fa24b75bb03cb263f1e3316004e/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/quincy/4a704134aa895fa24b75bb03cb263f1e3316004e/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/quincy/4a704134aa895fa24b75bb03cb263f1e3316004e/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-17T07:07:50.104 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-17T07:07:50.104 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-17T07:07:50.115 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-17T07:07:50.115 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-17T07:07:50.115 INFO:teuthology.packaging:ref: None 2024-09-17T07:07:50.115 INFO:teuthology.packaging:tag: None 2024-09-17T07:07:50.116 INFO:teuthology.packaging:branch: quincy 2024-09-17T07:07:50.116 INFO:teuthology.packaging:sha1: 19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 2024-09-17T07:07:50.116 DEBUG:teuthology.orchestra.run.smithi139:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-17T07:07:50.130 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-17T07:07:50.130 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-17T07:07:50.130 INFO:teuthology.packaging:ref: None 2024-09-17T07:07:50.131 INFO:teuthology.packaging:tag: None 2024-09-17T07:07:50.131 INFO:teuthology.packaging:branch: quincy 2024-09-17T07:07:50.131 INFO:teuthology.packaging:sha1: 19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 2024-09-17T07:07:50.131 DEBUG:teuthology.orchestra.run.smithi087:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-17T07:07:50.182 DEBUG:teuthology.orchestra.run.smithi139:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-17T07:07:50.197 DEBUG:teuthology.orchestra.run.smithi087:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-17T07:07:50.257 DEBUG:teuthology.orchestra.run.smithi139:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-17T07:07:50.272 DEBUG:teuthology.orchestra.run.smithi087:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-17T07:07:50.322 INFO:teuthology.orchestra.run.smithi139.stdout:check_obsoletes = 1 2024-09-17T07:07:50.323 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum clean all 2024-09-17T07:07:50.336 INFO:teuthology.orchestra.run.smithi087.stdout:check_obsoletes = 1 2024-09-17T07:07:50.338 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum clean all 2024-09-17T07:07:50.550 INFO:teuthology.orchestra.run.smithi139.stdout:45 files removed 2024-09-17T07:07:50.567 INFO:teuthology.orchestra.run.smithi087.stdout:45 files removed 2024-09-17T07:07:50.577 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install ceph-radosgw 2024-09-17T07:07:50.594 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install ceph-radosgw 2024-09-17T07:07:51.126 INFO:teuthology.orchestra.run.smithi139.stdout:ceph packages for x86_64 292 kB/s | 77 kB 00:00 2024-09-17T07:07:51.149 INFO:teuthology.orchestra.run.smithi087.stdout:ceph packages for x86_64 284 kB/s | 77 kB 00:00 2024-09-17T07:07:51.410 INFO:teuthology.orchestra.run.smithi139.stdout:ceph noarch packages 45 kB/s | 11 kB 00:00 2024-09-17T07:07:51.425 INFO:teuthology.orchestra.run.smithi087.stdout:ceph noarch packages 46 kB/s | 11 kB 00:00 2024-09-17T07:07:51.685 INFO:teuthology.orchestra.run.smithi139.stdout:ceph source packages 7.5 kB/s | 1.8 kB 00:00 2024-09-17T07:07:51.701 INFO:teuthology.orchestra.run.smithi087.stdout:ceph source packages 7.5 kB/s | 1.8 kB 00:00 2024-09-17T07:07:52.576 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - BaseOS 9.8 MB/s | 8.3 MB 00:00 2024-09-17T07:07:53.369 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS Stream 9 - BaseOS 5.0 MB/s | 8.3 MB 00:01 2024-09-17T07:07:54.277 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - AppStream 33 MB/s | 20 MB 00:00 2024-09-17T07:07:56.772 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS Stream 9 - AppStream 8.8 MB/s | 20 MB 00:02 2024-09-17T07:07:59.828 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - CRB 3.9 MB/s | 6.5 MB 00:01 2024-09-17T07:08:01.254 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS Stream 9 - CRB 9.3 MB/s | 6.5 MB 00:00 2024-09-17T07:08:01.387 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - Extras packages 67 kB/s | 19 kB 00:00 2024-09-17T07:08:02.366 INFO:teuthology.orchestra.run.smithi087.stdout:Extra Packages for Enterprise Linux 26 MB/s | 23 MB 00:00 2024-09-17T07:08:02.629 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS Stream 9 - Extras packages 130 kB/s | 19 kB 00:00 2024-09-17T07:08:03.392 INFO:teuthology.orchestra.run.smithi139.stdout:Extra Packages for Enterprise Linux 35 MB/s | 23 MB 00:00 2024-09-17T07:08:07.980 INFO:teuthology.orchestra.run.smithi087.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-17T07:08:08.756 INFO:teuthology.orchestra.run.smithi139.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-17T07:08:10.198 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-09-17T07:08:10.211 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-09-17T07:08:10.211 INFO:teuthology.orchestra.run.smithi087.stdout: Package Arch Version Repository Size 2024-09-17T07:08:10.211 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-09-17T07:08:10.212 INFO:teuthology.orchestra.run.smithi087.stdout:Installing: 2024-09-17T07:08:10.212 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-radosgw x86_64 2:17.2.7-1635.g4a704134.el9 ceph 14 M 2024-09-17T07:08:10.212 INFO:teuthology.orchestra.run.smithi087.stdout:Upgrading: 2024-09-17T07:08:10.212 INFO:teuthology.orchestra.run.smithi087.stdout: librados2 x86_64 2:17.2.7-1635.g4a704134.el9 ceph 3.1 M 2024-09-17T07:08:10.212 INFO:teuthology.orchestra.run.smithi087.stdout: librbd1 x86_64 2:17.2.7-1635.g4a704134.el9 ceph 2.9 M 2024-09-17T07:08:10.212 INFO:teuthology.orchestra.run.smithi087.stdout:Installing dependencies: 2024-09-17T07:08:10.212 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-base x86_64 2:17.2.7-1635.g4a704134.el9 ceph 5.0 M 2024-09-17T07:08:10.212 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-common x86_64 2:17.2.7-1635.g4a704134.el9 ceph 22 M 2024-09-17T07:08:10.212 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-selinux x86_64 2:17.2.7-1635.g4a704134.el9 ceph 25 k 2024-09-17T07:08:10.212 INFO:teuthology.orchestra.run.smithi087.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-17T07:08:10.212 INFO:teuthology.orchestra.run.smithi087.stdout: libcephfs2 x86_64 2:17.2.7-1635.g4a704134.el9 ceph 637 k 2024-09-17T07:08:10.212 INFO:teuthology.orchestra.run.smithi087.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-17T07:08:10.213 INFO:teuthology.orchestra.run.smithi087.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-17T07:08:10.213 INFO:teuthology.orchestra.run.smithi087.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-17T07:08:10.213 INFO:teuthology.orchestra.run.smithi087.stdout: libradosstriper1 x86_64 2:17.2.7-1635.g4a704134.el9 ceph 457 k 2024-09-17T07:08:10.213 INFO:teuthology.orchestra.run.smithi087.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-17T07:08:10.213 INFO:teuthology.orchestra.run.smithi087.stdout: librgw2 x86_64 2:17.2.7-1635.g4a704134.el9 ceph 4.9 M 2024-09-17T07:08:10.213 INFO:teuthology.orchestra.run.smithi087.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-17T07:08:10.213 INFO:teuthology.orchestra.run.smithi087.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-17T07:08:10.213 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ceph-argparse x86_64 2:17.2.7-1635.g4a704134.el9 ceph 45 k 2024-09-17T07:08:10.213 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ceph-common x86_64 2:17.2.7-1635.g4a704134.el9 ceph 120 k 2024-09-17T07:08:10.213 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cephfs x86_64 2:17.2.7-1635.g4a704134.el9 ceph 156 k 2024-09-17T07:08:10.213 INFO:teuthology.orchestra.run.smithi087.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-17T07:08:10.213 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rados x86_64 2:17.2.7-1635.g4a704134.el9 ceph 320 k 2024-09-17T07:08:10.213 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rbd x86_64 2:17.2.7-1635.g4a704134.el9 ceph 295 k 2024-09-17T07:08:10.214 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rgw x86_64 2:17.2.7-1635.g4a704134.el9 ceph 99 k 2024-09-17T07:08:10.214 INFO:teuthology.orchestra.run.smithi087.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-17T07:08:10.214 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:08:10.214 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction Summary 2024-09-17T07:08:10.214 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-09-17T07:08:10.214 INFO:teuthology.orchestra.run.smithi087.stdout:Install 22 Packages 2024-09-17T07:08:10.214 INFO:teuthology.orchestra.run.smithi087.stdout:Upgrade 2 Packages 2024-09-17T07:08:10.214 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:08:10.214 INFO:teuthology.orchestra.run.smithi087.stdout:Total download size: 58 M 2024-09-17T07:08:10.215 INFO:teuthology.orchestra.run.smithi087.stdout:Downloading Packages: 2024-09-17T07:08:10.881 INFO:teuthology.orchestra.run.smithi087.stdout:(1/24): ceph-base-17.2.7-1635.g4a704134.el9.x86 12 MB/s | 5.0 MB 00:00 2024-09-17T07:08:10.972 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-17T07:08:10.973 INFO:teuthology.orchestra.run.smithi087.stdout:(2/24): ceph-selinux-17.2.7-1635.g4a704134.el9. 275 kB/s | 25 kB 00:00 2024-09-17T07:08:11.010 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-17T07:08:11.010 INFO:teuthology.orchestra.run.smithi139.stdout: Package Arch Version Repository Size 2024-09-17T07:08:11.010 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-17T07:08:11.010 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2024-09-17T07:08:11.010 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-radosgw x86_64 2:17.2.7-1635.g4a704134.el9 ceph 14 M 2024-09-17T07:08:11.010 INFO:teuthology.orchestra.run.smithi139.stdout:Upgrading: 2024-09-17T07:08:11.011 INFO:teuthology.orchestra.run.smithi139.stdout: librados2 x86_64 2:17.2.7-1635.g4a704134.el9 ceph 3.1 M 2024-09-17T07:08:11.011 INFO:teuthology.orchestra.run.smithi139.stdout: librbd1 x86_64 2:17.2.7-1635.g4a704134.el9 ceph 2.9 M 2024-09-17T07:08:11.011 INFO:teuthology.orchestra.run.smithi139.stdout:Installing dependencies: 2024-09-17T07:08:11.011 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-base x86_64 2:17.2.7-1635.g4a704134.el9 ceph 5.0 M 2024-09-17T07:08:11.011 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-common x86_64 2:17.2.7-1635.g4a704134.el9 ceph 22 M 2024-09-17T07:08:11.011 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-selinux x86_64 2:17.2.7-1635.g4a704134.el9 ceph 25 k 2024-09-17T07:08:11.011 INFO:teuthology.orchestra.run.smithi139.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-17T07:08:11.011 INFO:teuthology.orchestra.run.smithi139.stdout: libcephfs2 x86_64 2:17.2.7-1635.g4a704134.el9 ceph 637 k 2024-09-17T07:08:11.011 INFO:teuthology.orchestra.run.smithi139.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-17T07:08:11.011 INFO:teuthology.orchestra.run.smithi139.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-17T07:08:11.011 INFO:teuthology.orchestra.run.smithi139.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-17T07:08:11.011 INFO:teuthology.orchestra.run.smithi139.stdout: libradosstriper1 x86_64 2:17.2.7-1635.g4a704134.el9 ceph 457 k 2024-09-17T07:08:11.011 INFO:teuthology.orchestra.run.smithi139.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-17T07:08:11.012 INFO:teuthology.orchestra.run.smithi139.stdout: librgw2 x86_64 2:17.2.7-1635.g4a704134.el9 ceph 4.9 M 2024-09-17T07:08:11.012 INFO:teuthology.orchestra.run.smithi139.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-17T07:08:11.012 INFO:teuthology.orchestra.run.smithi139.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-17T07:08:11.012 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ceph-argparse x86_64 2:17.2.7-1635.g4a704134.el9 ceph 45 k 2024-09-17T07:08:11.012 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ceph-common x86_64 2:17.2.7-1635.g4a704134.el9 ceph 120 k 2024-09-17T07:08:11.012 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cephfs x86_64 2:17.2.7-1635.g4a704134.el9 ceph 156 k 2024-09-17T07:08:11.012 INFO:teuthology.orchestra.run.smithi139.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-17T07:08:11.012 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rados x86_64 2:17.2.7-1635.g4a704134.el9 ceph 320 k 2024-09-17T07:08:11.012 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rbd x86_64 2:17.2.7-1635.g4a704134.el9 ceph 295 k 2024-09-17T07:08:11.012 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rgw x86_64 2:17.2.7-1635.g4a704134.el9 ceph 99 k 2024-09-17T07:08:11.012 INFO:teuthology.orchestra.run.smithi139.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-17T07:08:11.012 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:08:11.012 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2024-09-17T07:08:11.012 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-17T07:08:11.013 INFO:teuthology.orchestra.run.smithi139.stdout:Install 22 Packages 2024-09-17T07:08:11.013 INFO:teuthology.orchestra.run.smithi139.stdout:Upgrade 2 Packages 2024-09-17T07:08:11.013 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:08:11.013 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 58 M 2024-09-17T07:08:11.013 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2024-09-17T07:08:11.065 INFO:teuthology.orchestra.run.smithi087.stdout:(3/24): libcephfs2-17.2.7-1635.g4a704134.el9.x8 6.8 MB/s | 637 kB 00:00 2024-09-17T07:08:11.148 INFO:teuthology.orchestra.run.smithi087.stdout:(4/24): libradosstriper1-17.2.7-1635.g4a704134. 5.4 MB/s | 457 kB 00:00 2024-09-17T07:08:11.465 INFO:teuthology.orchestra.run.smithi087.stdout:(5/24): librgw2-17.2.7-1635.g4a704134.el9.x86_6 16 MB/s | 4.9 MB 00:00 2024-09-17T07:08:11.691 INFO:teuthology.orchestra.run.smithi087.stdout:(6/24): ceph-common-17.2.7-1635.g4a704134.el9.x 18 MB/s | 22 MB 00:01 2024-09-17T07:08:11.724 INFO:teuthology.orchestra.run.smithi087.stdout:(7/24): python3-ceph-argparse-17.2.7-1635.g4a70 174 kB/s | 45 kB 00:00 2024-09-17T07:08:11.799 INFO:teuthology.orchestra.run.smithi087.stdout:(8/24): python3-ceph-common-17.2.7-1635.g4a7041 1.1 MB/s | 120 kB 00:00 2024-09-17T07:08:11.825 INFO:teuthology.orchestra.run.smithi087.stdout:(9/24): python3-cephfs-17.2.7-1635.g4a704134.el 1.5 MB/s | 156 kB 00:00 2024-09-17T07:08:11.865 INFO:teuthology.orchestra.run.smithi139.stdout:(1/24): ceph-base-17.2.7-1635.g4a704134.el9.x86 9.4 MB/s | 5.0 MB 00:00 2024-09-17T07:08:11.941 INFO:teuthology.orchestra.run.smithi139.stdout:(2/24): ceph-selinux-17.2.7-1635.g4a704134.el9. 336 kB/s | 25 kB 00:00 2024-09-17T07:08:11.958 INFO:teuthology.orchestra.run.smithi087.stdout:(10/24): python3-rados-17.2.7-1635.g4a704134.el 2.0 MB/s | 320 kB 00:00 2024-09-17T07:08:11.983 INFO:teuthology.orchestra.run.smithi087.stdout:(11/24): python3-rbd-17.2.7-1635.g4a704134.el9. 1.8 MB/s | 295 kB 00:00 2024-09-17T07:08:12.024 INFO:teuthology.orchestra.run.smithi139.stdout:(3/24): libcephfs2-17.2.7-1635.g4a704134.el9.x8 7.5 MB/s | 637 kB 00:00 2024-09-17T07:08:12.101 INFO:teuthology.orchestra.run.smithi139.stdout:(4/24): libradosstriper1-17.2.7-1635.g4a704134. 6.0 MB/s | 457 kB 00:00 2024-09-17T07:08:12.134 INFO:teuthology.orchestra.run.smithi087.stdout:(12/24): ceph-radosgw-17.2.7-1635.g4a704134.el9 8.6 MB/s | 14 MB 00:01 2024-09-17T07:08:12.159 INFO:teuthology.orchestra.run.smithi087.stdout:(13/24): python3-rgw-17.2.7-1635.g4a704134.el9. 496 kB/s | 99 kB 00:00 2024-09-17T07:08:12.251 INFO:teuthology.orchestra.run.smithi087.stdout:(14/24): librabbitmq-0.11.0-7.el9.x86_64.rpm 388 kB/s | 45 kB 00:00 2024-09-17T07:08:12.268 INFO:teuthology.orchestra.run.smithi087.stdout:(15/24): libpmemobj-1.12.1-1.el9.x86_64.rpm 564 kB/s | 160 kB 00:00 2024-09-17T07:08:12.318 INFO:teuthology.orchestra.run.smithi087.stdout:(16/24): python3-prettytable-0.7.2-27.el9.noarc 844 kB/s | 42 kB 00:00 2024-09-17T07:08:12.368 INFO:teuthology.orchestra.run.smithi087.stdout:(17/24): gperftools-libs-2.9.1-3.el9.x86_64.rpm 6.0 MB/s | 308 kB 00:00 2024-09-17T07:08:12.374 INFO:teuthology.orchestra.run.smithi139.stdout:(5/24): librgw2-17.2.7-1635.g4a704134.el9.x86_6 18 MB/s | 4.9 MB 00:00 2024-09-17T07:08:12.394 INFO:teuthology.orchestra.run.smithi087.stdout:(18/24): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.0 MB/s | 292 kB 00:00 2024-09-17T07:08:12.419 INFO:teuthology.orchestra.run.smithi087.stdout:(19/24): liboath-2.6.7-2.el9.x86_64.rpm 969 kB/s | 49 kB 00:00 2024-09-17T07:08:12.461 INFO:teuthology.orchestra.run.smithi087.stdout:(20/24): libunwind-1.6.2-1.el9.x86_64.rpm 1.0 MB/s | 67 kB 00:00 2024-09-17T07:08:12.486 INFO:teuthology.orchestra.run.smithi087.stdout:(21/24): librdkafka-1.6.1-102.el9.x86_64.rpm 2.0 MB/s | 662 kB 00:00 2024-09-17T07:08:12.519 INFO:teuthology.orchestra.run.smithi087.stdout:(22/24): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-09-17T07:08:12.533 INFO:teuthology.orchestra.run.smithi139.stdout:(6/24): ceph-radosgw-17.2.7-1635.g4a704134.el9. 12 MB/s | 14 MB 00:01 2024-09-17T07:08:12.558 INFO:teuthology.orchestra.run.smithi139.stdout:(7/24): python3-ceph-argparse-17.2.7-1635.g4a70 246 kB/s | 45 kB 00:00 2024-09-17T07:08:12.584 INFO:teuthology.orchestra.run.smithi139.stdout:(8/24): python3-ceph-common-17.2.7-1635.g4a7041 2.4 MB/s | 120 kB 00:00 2024-09-17T07:08:12.603 INFO:teuthology.orchestra.run.smithi087.stdout:(23/24): librados2-17.2.7-1635.g4a704134.el9.x8 22 MB/s | 3.1 MB 00:00 2024-09-17T07:08:12.609 INFO:teuthology.orchestra.run.smithi139.stdout:(9/24): python3-cephfs-17.2.7-1635.g4a704134.el 3.0 MB/s | 156 kB 00:00 2024-09-17T07:08:12.634 INFO:teuthology.orchestra.run.smithi139.stdout:(10/24): python3-rados-17.2.7-1635.g4a704134.el 6.2 MB/s | 320 kB 00:00 2024-09-17T07:08:12.659 INFO:teuthology.orchestra.run.smithi139.stdout:(11/24): python3-rbd-17.2.7-1635.g4a704134.el9. 5.8 MB/s | 295 kB 00:00 2024-09-17T07:08:12.685 INFO:teuthology.orchestra.run.smithi139.stdout:(12/24): python3-rgw-17.2.7-1635.g4a704134.el9. 1.9 MB/s | 99 kB 00:00 2024-09-17T07:08:12.720 INFO:teuthology.orchestra.run.smithi087.stdout:(24/24): librbd1-17.2.7-1635.g4a704134.el9.x86_ 13 MB/s | 2.9 MB 00:00 2024-09-17T07:08:12.724 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2024-09-17T07:08:12.724 INFO:teuthology.orchestra.run.smithi087.stdout:Total 23 MB/s | 58 MB 00:02 2024-09-17T07:08:12.789 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction check 2024-09-17T07:08:12.823 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction check succeeded. 2024-09-17T07:08:12.824 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction test 2024-09-17T07:08:12.952 INFO:teuthology.orchestra.run.smithi139.stdout:(13/24): ceph-common-17.2.7-1635.g4a704134.el9. 14 MB/s | 22 MB 00:01 2024-09-17T07:08:12.969 INFO:teuthology.orchestra.run.smithi139.stdout:(14/24): librabbitmq-0.11.0-7.el9.x86_64.rpm 160 kB/s | 45 kB 00:00 2024-09-17T07:08:13.027 INFO:teuthology.orchestra.run.smithi139.stdout:(15/24): libpmemobj-1.12.1-1.el9.x86_64.rpm 436 kB/s | 160 kB 00:00 2024-09-17T07:08:13.069 INFO:teuthology.orchestra.run.smithi139.stdout:(16/24): python3-prettytable-0.7.2-27.el9.noarc 1.0 MB/s | 42 kB 00:00 2024-09-17T07:08:13.120 INFO:teuthology.orchestra.run.smithi139.stdout:(17/24): gperftools-libs-2.9.1-3.el9.x86_64.rpm 6.0 MB/s | 308 kB 00:00 2024-09-17T07:08:13.136 INFO:teuthology.orchestra.run.smithi139.stdout:(18/24): liboath-2.6.7-2.el9.x86_64.rpm 2.9 MB/s | 49 kB 00:00 2024-09-17T07:08:13.162 INFO:teuthology.orchestra.run.smithi139.stdout:(19/24): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.5 MB/s | 292 kB 00:00 2024-09-17T07:08:13.187 INFO:teuthology.orchestra.run.smithi139.stdout:(20/24): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-17T07:08:13.246 INFO:teuthology.orchestra.run.smithi139.stdout:(21/24): librdkafka-1.6.1-102.el9.x86_64.rpm 2.2 MB/s | 662 kB 00:00 2024-09-17T07:08:13.296 INFO:teuthology.orchestra.run.smithi139.stdout:(22/24): thrift-0.15.0-2.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-09-17T07:08:13.380 INFO:teuthology.orchestra.run.smithi139.stdout:(23/24): librados2-17.2.7-1635.g4a704134.el9.x8 17 MB/s | 3.1 MB 00:00 2024-09-17T07:08:13.451 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction test succeeded. 2024-09-17T07:08:13.452 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction 2024-09-17T07:08:13.454 INFO:teuthology.orchestra.run.smithi139.stdout:(24/24): librbd1-17.2.7-1635.g4a704134.el9.x86_ 14 MB/s | 2.9 MB 00:00 2024-09-17T07:08:13.460 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2024-09-17T07:08:13.460 INFO:teuthology.orchestra.run.smithi139.stdout:Total 24 MB/s | 58 MB 00:02 2024-09-17T07:08:13.524 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2024-09-17T07:08:13.557 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2024-09-17T07:08:13.557 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2024-09-17T07:08:14.239 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2024-09-17T07:08:14.239 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2024-09-17T07:08:14.688 INFO:teuthology.orchestra.run.smithi087.stdout: Preparing : 1/1 2024-09-17T07:08:15.069 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/26 2024-09-17T07:08:15.139 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : librados2-2:17.2.7-1635.g4a704134.el9.x86_64 2/26 2024-09-17T07:08:15.223 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librados2-2:17.2.7-1635.g4a704134.el9.x86_64 2/26 2024-09-17T07:08:15.300 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-rados-2:17.2.7-1635.g4a704134.el9.x86_64 3/26 2024-09-17T07:08:15.332 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libcephfs2-2:17.2.7-1635.g4a704134.el9.x86_64 4/26 2024-09-17T07:08:15.404 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: libcephfs2-2:17.2.7-1635.g4a704134.el9.x86_64 4/26 2024-09-17T07:08:15.449 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/26 2024-09-17T07:08:15.478 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/26 2024-09-17T07:08:15.496 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2024-09-17T07:08:15.844 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/26 2024-09-17T07:08:15.916 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/26 2024-09-17T07:08:15.949 INFO:teuthology.orchestra.run.smithi139.stdout: Upgrading : librados2-2:17.2.7-1635.g4a704134.el9.x86_64 2/26 2024-09-17T07:08:15.960 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : librgw2-2:17.2.7-1635.g4a704134.el9.x86_64 8/26 2024-09-17T07:08:16.023 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librgw2-2:17.2.7-1635.g4a704134.el9.x86_64 8/26 2024-09-17T07:08:16.040 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: librados2-2:17.2.7-1635.g4a704134.el9.x86_64 2/26 2024-09-17T07:08:16.059 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : liboath-2.6.7-2.el9.x86_64 9/26 2024-09-17T07:08:16.094 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-ceph-argparse-2:17.2.7-1635.g4a704134.el9. 10/26 2024-09-17T07:08:16.121 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-rados-2:17.2.7-1635.g4a704134.el9.x86_64 3/26 2024-09-17T07:08:16.131 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cephfs-2:17.2.7-1635.g4a704134.el9.x86_64 11/26 2024-09-17T07:08:16.150 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libcephfs2-2:17.2.7-1635.g4a704134.el9.x86_64 4/26 2024-09-17T07:08:16.193 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-rgw-2:17.2.7-1635.g4a704134.el9.x86_64 12/26 2024-09-17T07:08:16.221 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libradosstriper1-2:17.2.7-1635.g4a704134.el9.x86_6 13/26 2024-09-17T07:08:16.238 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: libcephfs2-2:17.2.7-1635.g4a704134.el9.x86_64 4/26 2024-09-17T07:08:16.287 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: libradosstriper1-2:17.2.7-1635.g4a704134.el9.x86_6 13/26 2024-09-17T07:08:16.291 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/26 2024-09-17T07:08:16.321 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/26 2024-09-17T07:08:16.341 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/26 2024-09-17T07:08:16.379 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/26 2024-09-17T07:08:16.412 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 16/26 2024-09-17T07:08:16.704 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/26 2024-09-17T07:08:16.750 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : librbd1-2:17.2.7-1635.g4a704134.el9.x86_64 18/26 2024-09-17T07:08:16.759 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/26 2024-09-17T07:08:16.794 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : librgw2-2:17.2.7-1635.g4a704134.el9.x86_64 8/26 2024-09-17T07:08:16.839 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librbd1-2:17.2.7-1635.g4a704134.el9.x86_64 18/26 2024-09-17T07:08:16.857 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: librgw2-2:17.2.7-1635.g4a704134.el9.x86_64 8/26 2024-09-17T07:08:16.902 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : liboath-2.6.7-2.el9.x86_64 9/26 2024-09-17T07:08:16.912 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-rbd-2:17.2.7-1635.g4a704134.el9.x86_64 19/26 2024-09-17T07:08:16.943 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-ceph-common-2:17.2.7-1635.g4a704134.el9.x8 20/26 2024-09-17T07:08:16.961 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-ceph-argparse-2:17.2.7-1635.g4a704134.el9. 10/26 2024-09-17T07:08:16.999 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cephfs-2:17.2.7-1635.g4a704134.el9.x86_64 11/26 2024-09-17T07:08:17.061 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-rgw-2:17.2.7-1635.g4a704134.el9.x86_64 12/26 2024-09-17T07:08:17.088 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libradosstriper1-2:17.2.7-1635.g4a704134.el9.x86_6 13/26 2024-09-17T07:08:17.146 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: libradosstriper1-2:17.2.7-1635.g4a704134.el9.x86_6 13/26 2024-09-17T07:08:17.198 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/26 2024-09-17T07:08:17.239 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/26 2024-09-17T07:08:17.280 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 16/26 2024-09-17T07:08:17.573 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/26 2024-09-17T07:08:17.609 INFO:teuthology.orchestra.run.smithi139.stdout: Upgrading : librbd1-2:17.2.7-1635.g4a704134.el9.x86_64 18/26 2024-09-17T07:08:17.706 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: librbd1-2:17.2.7-1635.g4a704134.el9.x86_64 18/26 2024-09-17T07:08:17.780 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-rbd-2:17.2.7-1635.g4a704134.el9.x86_64 19/26 2024-09-17T07:08:17.811 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-ceph-common-2:17.2.7-1635.g4a704134.el9.x8 20/26 2024-09-17T07:08:19.418 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-common-2:17.2.7-1635.g4a704134.el9.x86_64 21/26 2024-09-17T07:08:19.464 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-common-2:17.2.7-1635.g4a704134.el9.x86_64 21/26 2024-09-17T07:08:19.990 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-common-2:17.2.7-1635.g4a704134.el9.x86_64 21/26 2024-09-17T07:08:20.026 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-base-2:17.2.7-1635.g4a704134.el9.x86_64 22/26 2024-09-17T07:08:20.119 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-base-2:17.2.7-1635.g4a704134.el9.x86_64 22/26 2024-09-17T07:08:20.119 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-17T07:08:20.120 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-17T07:08:20.120 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:08:20.152 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-selinux-2:17.2.7-1635.g4a704134.el9.x86_64 23/26 2024-09-17T07:08:20.162 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-common-2:17.2.7-1635.g4a704134.el9.x86_64 21/26 2024-09-17T07:08:20.208 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-common-2:17.2.7-1635.g4a704134.el9.x86_64 21/26 2024-09-17T07:08:20.724 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-common-2:17.2.7-1635.g4a704134.el9.x86_64 21/26 2024-09-17T07:08:20.761 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-base-2:17.2.7-1635.g4a704134.el9.x86_64 22/26 2024-09-17T07:08:20.847 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-base-2:17.2.7-1635.g4a704134.el9.x86_64 22/26 2024-09-17T07:08:20.848 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-17T07:08:20.848 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-17T07:08:20.848 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:08:20.878 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-selinux-2:17.2.7-1635.g4a704134.el9.x86_64 23/26 2024-09-17T07:08:30.072 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-selinux-2:17.2.7-1635.g4a704134.el9.x86_64 23/26 2024-09-17T07:08:30.072 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /sys 2024-09-17T07:08:30.072 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /proc 2024-09-17T07:08:30.072 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /mnt 2024-09-17T07:08:30.072 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /var/tmp 2024-09-17T07:08:30.072 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /home 2024-09-17T07:08:30.072 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /root 2024-09-17T07:08:30.073 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /tmp 2024-09-17T07:08:30.073 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:08:30.677 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-selinux-2:17.2.7-1635.g4a704134.el9.x86_64 23/26 2024-09-17T07:08:30.677 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /sys 2024-09-17T07:08:30.677 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /proc 2024-09-17T07:08:30.677 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /mnt 2024-09-17T07:08:30.677 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /var/tmp 2024-09-17T07:08:30.677 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /home 2024-09-17T07:08:30.677 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /root 2024-09-17T07:08:30.677 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /tmp 2024-09-17T07:08:30.678 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:08:31.409 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-radosgw-2:17.2.7-1635.g4a704134.el9.x86_64 24/26 2024-09-17T07:08:31.486 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-1635.g4a704134.el9.x86_64 24/26 2024-09-17T07:08:31.487 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T07:08:31.487 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-17T07:08:31.487 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T07:08:31.487 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T07:08:31.487 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:08:31.489 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-09-17T07:08:31.586 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-09-17T07:08:31.586 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 26/26 2024-09-17T07:08:32.010 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-radosgw-2:17.2.7-1635.g4a704134.el9.x86_64 24/26 2024-09-17T07:08:32.089 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-1635.g4a704134.el9.x86_64 24/26 2024-09-17T07:08:32.089 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T07:08:32.089 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-17T07:08:32.089 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T07:08:32.089 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T07:08:32.089 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:08:32.091 INFO:teuthology.orchestra.run.smithi139.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-09-17T07:08:32.180 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-09-17T07:08:32.180 INFO:teuthology.orchestra.run.smithi139.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 26/26 2024-09-17T07:08:32.876 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 26/26 2024-09-17T07:08:32.876 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-base-2:17.2.7-1635.g4a704134.el9.x86_64 1/26 2024-09-17T07:08:32.876 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-common-2:17.2.7-1635.g4a704134.el9.x86_64 2/26 2024-09-17T07:08:32.876 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-radosgw-2:17.2.7-1635.g4a704134.el9.x86_64 3/26 2024-09-17T07:08:32.877 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-selinux-2:17.2.7-1635.g4a704134.el9.x86_64 4/26 2024-09-17T07:08:32.877 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libcephfs2-2:17.2.7-1635.g4a704134.el9.x86_64 5/26 2024-09-17T07:08:32.877 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libradosstriper1-2:17.2.7-1635.g4a704134.el9.x86_6 6/26 2024-09-17T07:08:32.877 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librgw2-2:17.2.7-1635.g4a704134.el9.x86_64 7/26 2024-09-17T07:08:32.877 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-ceph-argparse-2:17.2.7-1635.g4a704134.el9. 8/26 2024-09-17T07:08:32.877 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-ceph-common-2:17.2.7-1635.g4a704134.el9.x8 9/26 2024-09-17T07:08:32.877 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cephfs-2:17.2.7-1635.g4a704134.el9.x86_64 10/26 2024-09-17T07:08:32.877 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-rados-2:17.2.7-1635.g4a704134.el9.x86_64 11/26 2024-09-17T07:08:32.877 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-rbd-2:17.2.7-1635.g4a704134.el9.x86_64 12/26 2024-09-17T07:08:32.877 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-rgw-2:17.2.7-1635.g4a704134.el9.x86_64 13/26 2024-09-17T07:08:32.877 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 14/26 2024-09-17T07:08:32.877 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 15/26 2024-09-17T07:08:32.878 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/26 2024-09-17T07:08:32.878 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/26 2024-09-17T07:08:32.878 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/26 2024-09-17T07:08:32.878 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 19/26 2024-09-17T07:08:32.878 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 20/26 2024-09-17T07:08:32.878 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 21/26 2024-09-17T07:08:32.878 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 22/26 2024-09-17T07:08:32.878 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librados2-2:17.2.7-1635.g4a704134.el9.x86_64 23/26 2024-09-17T07:08:32.878 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 24/26 2024-09-17T07:08:32.878 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librbd1-2:17.2.7-1635.g4a704134.el9.x86_64 25/26 2024-09-17T07:08:33.392 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 26/26 2024-09-17T07:08:33.392 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-base-2:17.2.7-1635.g4a704134.el9.x86_64 1/26 2024-09-17T07:08:33.392 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-common-2:17.2.7-1635.g4a704134.el9.x86_64 2/26 2024-09-17T07:08:33.392 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-radosgw-2:17.2.7-1635.g4a704134.el9.x86_64 3/26 2024-09-17T07:08:33.392 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-selinux-2:17.2.7-1635.g4a704134.el9.x86_64 4/26 2024-09-17T07:08:33.392 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libcephfs2-2:17.2.7-1635.g4a704134.el9.x86_64 5/26 2024-09-17T07:08:33.392 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libradosstriper1-2:17.2.7-1635.g4a704134.el9.x86_6 6/26 2024-09-17T07:08:33.392 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librgw2-2:17.2.7-1635.g4a704134.el9.x86_64 7/26 2024-09-17T07:08:33.392 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-ceph-argparse-2:17.2.7-1635.g4a704134.el9. 8/26 2024-09-17T07:08:33.392 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-ceph-common-2:17.2.7-1635.g4a704134.el9.x8 9/26 2024-09-17T07:08:33.393 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cephfs-2:17.2.7-1635.g4a704134.el9.x86_64 10/26 2024-09-17T07:08:33.393 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-rados-2:17.2.7-1635.g4a704134.el9.x86_64 11/26 2024-09-17T07:08:33.393 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-rbd-2:17.2.7-1635.g4a704134.el9.x86_64 12/26 2024-09-17T07:08:33.393 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-rgw-2:17.2.7-1635.g4a704134.el9.x86_64 13/26 2024-09-17T07:08:33.393 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 14/26 2024-09-17T07:08:33.393 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 15/26 2024-09-17T07:08:33.393 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/26 2024-09-17T07:08:33.393 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/26 2024-09-17T07:08:33.393 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/26 2024-09-17T07:08:33.393 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 19/26 2024-09-17T07:08:33.393 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 20/26 2024-09-17T07:08:33.393 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 21/26 2024-09-17T07:08:33.393 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 22/26 2024-09-17T07:08:33.393 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librados2-2:17.2.7-1635.g4a704134.el9.x86_64 23/26 2024-09-17T07:08:33.394 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 24/26 2024-09-17T07:08:33.394 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librbd1-2:17.2.7-1635.g4a704134.el9.x86_64 25/26 2024-09-17T07:08:33.841 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 26/26 2024-09-17T07:08:33.841 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:08:33.841 INFO:teuthology.orchestra.run.smithi087.stdout:Upgraded: 2024-09-17T07:08:33.842 INFO:teuthology.orchestra.run.smithi087.stdout: librados2-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T07:08:33.842 INFO:teuthology.orchestra.run.smithi087.stdout: librbd1-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T07:08:33.842 INFO:teuthology.orchestra.run.smithi087.stdout:Installed: 2024-09-17T07:08:33.842 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-base-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T07:08:33.842 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-common-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T07:08:33.842 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-radosgw-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T07:08:33.842 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-selinux-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T07:08:33.842 INFO:teuthology.orchestra.run.smithi087.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-17T07:08:33.842 INFO:teuthology.orchestra.run.smithi087.stdout: libcephfs2-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T07:08:33.842 INFO:teuthology.orchestra.run.smithi087.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-17T07:08:33.842 INFO:teuthology.orchestra.run.smithi087.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-17T07:08:33.842 INFO:teuthology.orchestra.run.smithi087.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-17T07:08:33.842 INFO:teuthology.orchestra.run.smithi087.stdout: libradosstriper1-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T07:08:33.843 INFO:teuthology.orchestra.run.smithi087.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-17T07:08:33.843 INFO:teuthology.orchestra.run.smithi087.stdout: librgw2-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T07:08:33.843 INFO:teuthology.orchestra.run.smithi087.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-17T07:08:33.843 INFO:teuthology.orchestra.run.smithi087.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-17T07:08:33.843 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ceph-argparse-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T07:08:33.843 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ceph-common-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T07:08:33.843 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cephfs-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T07:08:33.843 INFO:teuthology.orchestra.run.smithi087.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-17T07:08:33.843 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rados-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T07:08:33.843 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rbd-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T07:08:33.843 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rgw-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T07:08:33.843 INFO:teuthology.orchestra.run.smithi087.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-17T07:08:33.843 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:08:33.844 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-09-17T07:08:34.196 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install ceph-test 2024-09-17T07:08:34.445 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 26/26 2024-09-17T07:08:34.445 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:08:34.445 INFO:teuthology.orchestra.run.smithi139.stdout:Upgraded: 2024-09-17T07:08:34.445 INFO:teuthology.orchestra.run.smithi139.stdout: librados2-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T07:08:34.445 INFO:teuthology.orchestra.run.smithi139.stdout: librbd1-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T07:08:34.445 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2024-09-17T07:08:34.445 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-base-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T07:08:34.445 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-common-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T07:08:34.446 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-radosgw-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T07:08:34.446 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-selinux-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T07:08:34.446 INFO:teuthology.orchestra.run.smithi139.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-17T07:08:34.446 INFO:teuthology.orchestra.run.smithi139.stdout: libcephfs2-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T07:08:34.446 INFO:teuthology.orchestra.run.smithi139.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-17T07:08:34.446 INFO:teuthology.orchestra.run.smithi139.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-17T07:08:34.446 INFO:teuthology.orchestra.run.smithi139.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-17T07:08:34.446 INFO:teuthology.orchestra.run.smithi139.stdout: libradosstriper1-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T07:08:34.446 INFO:teuthology.orchestra.run.smithi139.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-17T07:08:34.446 INFO:teuthology.orchestra.run.smithi139.stdout: librgw2-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T07:08:34.446 INFO:teuthology.orchestra.run.smithi139.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-17T07:08:34.446 INFO:teuthology.orchestra.run.smithi139.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-17T07:08:34.446 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ceph-argparse-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T07:08:34.446 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ceph-common-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T07:08:34.447 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cephfs-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T07:08:34.447 INFO:teuthology.orchestra.run.smithi139.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-17T07:08:34.447 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rados-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T07:08:34.447 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rbd-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T07:08:34.447 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rgw-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T07:08:34.447 INFO:teuthology.orchestra.run.smithi139.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-17T07:08:34.447 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:08:34.447 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-17T07:08:34.776 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:00:27 ago on Tue 17 Sep 2024 07:08:07 AM UTC. 2024-09-17T07:08:34.802 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install ceph-test 2024-09-17T07:08:34.910 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-09-17T07:08:34.911 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-09-17T07:08:34.911 INFO:teuthology.orchestra.run.smithi087.stdout: Package Arch Version Repository Size 2024-09-17T07:08:34.911 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-09-17T07:08:34.911 INFO:teuthology.orchestra.run.smithi087.stdout:Installing: 2024-09-17T07:08:34.911 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-test x86_64 2:17.2.7-1635.g4a704134.el9 ceph 48 M 2024-09-17T07:08:34.911 INFO:teuthology.orchestra.run.smithi087.stdout:Installing dependencies: 2024-09-17T07:08:34.911 INFO:teuthology.orchestra.run.smithi087.stdout: libcephsqlite x86_64 2:17.2.7-1635.g4a704134.el9 ceph 163 k 2024-09-17T07:08:34.912 INFO:teuthology.orchestra.run.smithi087.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-17T07:08:34.912 INFO:teuthology.orchestra.run.smithi087.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-17T07:08:34.912 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:08:34.912 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction Summary 2024-09-17T07:08:34.912 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-09-17T07:08:34.912 INFO:teuthology.orchestra.run.smithi087.stdout:Install 4 Packages 2024-09-17T07:08:34.912 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:08:34.913 INFO:teuthology.orchestra.run.smithi087.stdout:Total download size: 48 M 2024-09-17T07:08:34.913 INFO:teuthology.orchestra.run.smithi087.stdout:Installed size: 193 M 2024-09-17T07:08:34.913 INFO:teuthology.orchestra.run.smithi087.stdout:Downloading Packages: 2024-09-17T07:08:35.141 INFO:teuthology.orchestra.run.smithi087.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.4 MB/s | 304 kB 00:00 2024-09-17T07:08:35.191 INFO:teuthology.orchestra.run.smithi087.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-17T07:08:35.247 INFO:teuthology.orchestra.run.smithi087.stdout:(3/4): libcephsqlite-17.2.7-1635.g4a704134.el9. 520 kB/s | 163 kB 00:00 2024-09-17T07:08:35.382 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:00:27 ago on Tue 17 Sep 2024 07:08:08 AM UTC. 2024-09-17T07:08:35.513 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-17T07:08:35.513 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-17T07:08:35.513 INFO:teuthology.orchestra.run.smithi139.stdout: Package Arch Version Repository Size 2024-09-17T07:08:35.513 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-17T07:08:35.514 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2024-09-17T07:08:35.514 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-test x86_64 2:17.2.7-1635.g4a704134.el9 ceph 48 M 2024-09-17T07:08:35.514 INFO:teuthology.orchestra.run.smithi139.stdout:Installing dependencies: 2024-09-17T07:08:35.514 INFO:teuthology.orchestra.run.smithi139.stdout: libcephsqlite x86_64 2:17.2.7-1635.g4a704134.el9 ceph 163 k 2024-09-17T07:08:35.514 INFO:teuthology.orchestra.run.smithi139.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-17T07:08:35.514 INFO:teuthology.orchestra.run.smithi139.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-17T07:08:35.514 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:08:35.514 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2024-09-17T07:08:35.514 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-17T07:08:35.514 INFO:teuthology.orchestra.run.smithi139.stdout:Install 4 Packages 2024-09-17T07:08:35.514 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:08:35.515 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 48 M 2024-09-17T07:08:35.515 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 193 M 2024-09-17T07:08:35.515 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2024-09-17T07:08:35.710 INFO:teuthology.orchestra.run.smithi139.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 2.1 MB/s | 304 kB 00:00 2024-09-17T07:08:35.744 INFO:teuthology.orchestra.run.smithi139.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.9 MB/s | 64 kB 00:00 2024-09-17T07:08:35.802 INFO:teuthology.orchestra.run.smithi139.stdout:(3/4): libcephsqlite-17.2.7-1635.g4a704134.el9. 691 kB/s | 163 kB 00:00 2024-09-17T07:08:37.300 INFO:teuthology.orchestra.run.smithi087.stdout:(4/4): ceph-test-17.2.7-1635.g4a704134.el9.x86_ 20 MB/s | 48 MB 00:02 2024-09-17T07:08:37.302 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2024-09-17T07:08:37.302 INFO:teuthology.orchestra.run.smithi087.stdout:Total 20 MB/s | 48 MB 00:02 2024-09-17T07:08:37.330 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction check 2024-09-17T07:08:37.349 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction check succeeded. 2024-09-17T07:08:37.349 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction test 2024-09-17T07:08:37.553 INFO:teuthology.orchestra.run.smithi139.stdout:(4/4): ceph-test-17.2.7-1635.g4a704134.el9.x86_ 24 MB/s | 48 MB 00:01 2024-09-17T07:08:37.555 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2024-09-17T07:08:37.555 INFO:teuthology.orchestra.run.smithi139.stdout:Total 24 MB/s | 48 MB 00:02 2024-09-17T07:08:37.583 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2024-09-17T07:08:37.602 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2024-09-17T07:08:37.602 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2024-09-17T07:08:37.723 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction test succeeded. 2024-09-17T07:08:37.723 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction 2024-09-17T07:08:37.977 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2024-09-17T07:08:37.977 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2024-09-17T07:08:38.357 INFO:teuthology.orchestra.run.smithi087.stdout: Preparing : 1/1 2024-09-17T07:08:38.435 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-17T07:08:38.474 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-17T07:08:38.497 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2024-09-17T07:08:38.501 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libcephsqlite-2:17.2.7-1635.g4a704134.el9.x86_64 3/4 2024-09-17T07:08:38.588 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-17T07:08:38.626 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-17T07:08:38.654 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libcephsqlite-2:17.2.7-1635.g4a704134.el9.x86_64 3/4 2024-09-17T07:08:42.901 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: libcephsqlite-2:17.2.7-1635.g4a704134.el9.x86_64 3/4 2024-09-17T07:08:42.977 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-test-2:17.2.7-1635.g4a704134.el9.x86_64 4/4 2024-09-17T07:08:43.049 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: libcephsqlite-2:17.2.7-1635.g4a704134.el9.x86_64 3/4 2024-09-17T07:08:43.118 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-test-2:17.2.7-1635.g4a704134.el9.x86_64 4/4 2024-09-17T07:08:45.190 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-test-2:17.2.7-1635.g4a704134.el9.x86_64 4/4 2024-09-17T07:08:45.191 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-test-2:17.2.7-1635.g4a704134.el9.x86_64 1/4 2024-09-17T07:08:45.191 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libcephsqlite-2:17.2.7-1635.g4a704134.el9.x86_64 2/4 2024-09-17T07:08:45.191 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-17T07:08:45.301 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-test-2:17.2.7-1635.g4a704134.el9.x86_64 4/4 2024-09-17T07:08:45.302 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-test-2:17.2.7-1635.g4a704134.el9.x86_64 1/4 2024-09-17T07:08:45.302 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libcephsqlite-2:17.2.7-1635.g4a704134.el9.x86_64 2/4 2024-09-17T07:08:45.302 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-17T07:08:45.498 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-17T07:08:45.499 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:08:45.499 INFO:teuthology.orchestra.run.smithi087.stdout:Installed: 2024-09-17T07:08:45.499 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-test-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T07:08:45.499 INFO:teuthology.orchestra.run.smithi087.stdout: libcephsqlite-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T07:08:45.499 INFO:teuthology.orchestra.run.smithi087.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-17T07:08:45.499 INFO:teuthology.orchestra.run.smithi087.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-17T07:08:45.499 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:08:45.499 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-09-17T07:08:45.616 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-17T07:08:45.616 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:08:45.616 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2024-09-17T07:08:45.616 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-test-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T07:08:45.616 INFO:teuthology.orchestra.run.smithi139.stdout: libcephsqlite-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T07:08:45.616 INFO:teuthology.orchestra.run.smithi139.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-17T07:08:45.616 INFO:teuthology.orchestra.run.smithi139.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-17T07:08:45.616 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:08:45.617 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-17T07:08:45.794 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install ceph 2024-09-17T07:08:45.891 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install ceph 2024-09-17T07:08:46.376 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:00:39 ago on Tue 17 Sep 2024 07:08:07 AM UTC. 2024-09-17T07:08:46.476 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:00:38 ago on Tue 17 Sep 2024 07:08:08 AM UTC. 2024-09-17T07:08:46.512 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-09-17T07:08:46.512 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-09-17T07:08:46.513 INFO:teuthology.orchestra.run.smithi087.stdout: Package Arch Version Repository Size 2024-09-17T07:08:46.513 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-09-17T07:08:46.513 INFO:teuthology.orchestra.run.smithi087.stdout:Installing: 2024-09-17T07:08:46.513 INFO:teuthology.orchestra.run.smithi087.stdout: ceph x86_64 2:17.2.7-1635.g4a704134.el9 ceph 6.5 k 2024-09-17T07:08:46.513 INFO:teuthology.orchestra.run.smithi087.stdout:Installing dependencies: 2024-09-17T07:08:46.513 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mds x86_64 2:17.2.7-1635.g4a704134.el9 ceph 2.1 M 2024-09-17T07:08:46.513 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr x86_64 2:17.2.7-1635.g4a704134.el9 ceph 1.4 M 2024-09-17T07:08:46.513 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-modules-core noarch 2:17.2.7-1635.g4a704134.el9 ceph-noarch 240 k 2024-09-17T07:08:46.513 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mon x86_64 2:17.2.7-1635.g4a704134.el9 ceph 3.9 M 2024-09-17T07:08:46.513 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-osd x86_64 2:17.2.7-1635.g4a704134.el9 ceph 15 M 2024-09-17T07:08:46.513 INFO:teuthology.orchestra.run.smithi087.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-17T07:08:46.513 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-17T07:08:46.514 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-17T07:08:46.514 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-17T07:08:46.514 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-17T07:08:46.514 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-17T07:08:46.514 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-17T07:08:46.514 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-collections 2024-09-17T07:08:46.514 INFO:teuthology.orchestra.run.smithi087.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-17T07:08:46.514 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-17T07:08:46.514 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-17T07:08:46.514 INFO:teuthology.orchestra.run.smithi087.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-17T07:08:46.514 INFO:teuthology.orchestra.run.smithi087.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-17T07:08:46.514 INFO:teuthology.orchestra.run.smithi087.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-17T07:08:46.514 INFO:teuthology.orchestra.run.smithi087.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-17T07:08:46.515 INFO:teuthology.orchestra.run.smithi087.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-17T07:08:46.515 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-17T07:08:46.515 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-17T07:08:46.515 INFO:teuthology.orchestra.run.smithi087.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-17T07:08:46.515 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-17T07:08:46.515 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-17T07:08:46.515 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-17T07:08:46.515 INFO:teuthology.orchestra.run.smithi087.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-17T07:08:46.515 INFO:teuthology.orchestra.run.smithi087.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-17T07:08:46.515 INFO:teuthology.orchestra.run.smithi087.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-17T07:08:46.515 INFO:teuthology.orchestra.run.smithi087.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-17T07:08:46.515 INFO:teuthology.orchestra.run.smithi087.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-17T07:08:46.515 INFO:teuthology.orchestra.run.smithi087.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-17T07:08:46.516 INFO:teuthology.orchestra.run.smithi087.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-17T07:08:46.516 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:08:46.516 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction Summary 2024-09-17T07:08:46.516 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-09-17T07:08:46.516 INFO:teuthology.orchestra.run.smithi087.stdout:Install 34 Packages 2024-09-17T07:08:46.516 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:08:46.516 INFO:teuthology.orchestra.run.smithi087.stdout:Total download size: 27 M 2024-09-17T07:08:46.517 INFO:teuthology.orchestra.run.smithi087.stdout:Installed size: 96 M 2024-09-17T07:08:46.517 INFO:teuthology.orchestra.run.smithi087.stdout:Downloading Packages: 2024-09-17T07:08:46.611 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-17T07:08:46.613 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-17T07:08:46.613 INFO:teuthology.orchestra.run.smithi139.stdout: Package Arch Version Repository Size 2024-09-17T07:08:46.614 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-17T07:08:46.614 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2024-09-17T07:08:46.614 INFO:teuthology.orchestra.run.smithi139.stdout: ceph x86_64 2:17.2.7-1635.g4a704134.el9 ceph 6.5 k 2024-09-17T07:08:46.614 INFO:teuthology.orchestra.run.smithi139.stdout:Installing dependencies: 2024-09-17T07:08:46.614 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mds x86_64 2:17.2.7-1635.g4a704134.el9 ceph 2.1 M 2024-09-17T07:08:46.614 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr x86_64 2:17.2.7-1635.g4a704134.el9 ceph 1.4 M 2024-09-17T07:08:46.614 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-modules-core noarch 2:17.2.7-1635.g4a704134.el9 ceph-noarch 240 k 2024-09-17T07:08:46.614 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mon x86_64 2:17.2.7-1635.g4a704134.el9 ceph 3.9 M 2024-09-17T07:08:46.614 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-osd x86_64 2:17.2.7-1635.g4a704134.el9 ceph 15 M 2024-09-17T07:08:46.614 INFO:teuthology.orchestra.run.smithi139.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-17T07:08:46.614 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-17T07:08:46.615 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-17T07:08:46.615 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-17T07:08:46.615 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-17T07:08:46.615 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-17T07:08:46.615 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-17T07:08:46.615 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-collections 2024-09-17T07:08:46.615 INFO:teuthology.orchestra.run.smithi139.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-17T07:08:46.615 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-17T07:08:46.615 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-17T07:08:46.615 INFO:teuthology.orchestra.run.smithi139.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-17T07:08:46.615 INFO:teuthology.orchestra.run.smithi139.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-17T07:08:46.615 INFO:teuthology.orchestra.run.smithi139.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-17T07:08:46.615 INFO:teuthology.orchestra.run.smithi139.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-17T07:08:46.615 INFO:teuthology.orchestra.run.smithi139.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-17T07:08:46.616 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-17T07:08:46.616 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-17T07:08:46.616 INFO:teuthology.orchestra.run.smithi139.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-17T07:08:46.616 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-17T07:08:46.616 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-17T07:08:46.616 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-17T07:08:46.616 INFO:teuthology.orchestra.run.smithi139.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-17T07:08:46.616 INFO:teuthology.orchestra.run.smithi139.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-17T07:08:46.616 INFO:teuthology.orchestra.run.smithi139.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-17T07:08:46.616 INFO:teuthology.orchestra.run.smithi139.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-17T07:08:46.616 INFO:teuthology.orchestra.run.smithi139.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-17T07:08:46.616 INFO:teuthology.orchestra.run.smithi139.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-17T07:08:46.616 INFO:teuthology.orchestra.run.smithi139.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-17T07:08:46.617 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:08:46.617 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2024-09-17T07:08:46.617 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-17T07:08:46.617 INFO:teuthology.orchestra.run.smithi139.stdout:Install 34 Packages 2024-09-17T07:08:46.617 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:08:46.617 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 27 M 2024-09-17T07:08:46.618 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 96 M 2024-09-17T07:08:46.618 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2024-09-17T07:08:47.042 INFO:teuthology.orchestra.run.smithi087.stdout:(1/34): ceph-17.2.7-1635.g4a704134.el9.x86_64.r 47 kB/s | 6.5 kB 00:00 2024-09-17T07:08:47.242 INFO:teuthology.orchestra.run.smithi087.stdout:(2/34): ceph-mds-17.2.7-1635.g4a704134.el9.x86_ 6.1 MB/s | 2.1 MB 00:00 2024-09-17T07:08:47.300 INFO:teuthology.orchestra.run.smithi087.stdout:(3/34): ceph-mgr-17.2.7-1635.g4a704134.el9.x86_ 3.6 MB/s | 1.4 MB 00:00 2024-09-17T07:08:47.401 INFO:teuthology.orchestra.run.smithi087.stdout:(4/34): ceph-mon-17.2.7-1635.g4a704134.el9.x86_ 11 MB/s | 3.9 MB 00:00 2024-09-17T07:08:47.426 INFO:teuthology.orchestra.run.smithi087.stdout:(5/34): ceph-mgr-modules-core-17.2.7-1635.g4a70 1.9 MB/s | 240 kB 00:00 2024-09-17T07:08:47.477 INFO:teuthology.orchestra.run.smithi139.stdout:(1/34): ceph-17.2.7-1635.g4a704134.el9.x86_64.r 37 kB/s | 6.5 kB 00:00 2024-09-17T07:08:47.526 INFO:teuthology.orchestra.run.smithi087.stdout:(6/34): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.0 MB/s | 253 kB 00:00 2024-09-17T07:08:47.568 INFO:teuthology.orchestra.run.smithi087.stdout:(7/34): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-09-17T07:08:47.618 INFO:teuthology.orchestra.run.smithi087.stdout:(8/34): python3-cryptography-36.0.1-4.el9.x86_6 6.4 MB/s | 1.2 MB 00:00 2024-09-17T07:08:47.643 INFO:teuthology.orchestra.run.smithi087.stdout:(9/34): python3-pycparser-2.20-6.el9.noarch.rpm 1.8 MB/s | 135 kB 00:00 2024-09-17T07:08:47.668 INFO:teuthology.orchestra.run.smithi087.stdout:(10/34): python3-requests-2.25.1-8.el9.noarch.r 2.4 MB/s | 125 kB 00:00 2024-09-17T07:08:47.685 INFO:teuthology.orchestra.run.smithi087.stdout:(11/34): python3-urllib3-1.26.5-6.el9.noarch.rp 5.0 MB/s | 215 kB 00:00 2024-09-17T07:08:47.836 INFO:teuthology.orchestra.run.smithi139.stdout:(2/34): ceph-mgr-17.2.7-1635.g4a704134.el9.x86_ 2.6 MB/s | 1.4 MB 00:00 2024-09-17T07:08:47.844 INFO:teuthology.orchestra.run.smithi087.stdout:(12/34): ceph-osd-17.2.7-1635.g4a704134.el9.x86 25 MB/s | 15 MB 00:00 2024-09-17T07:08:48.036 INFO:teuthology.orchestra.run.smithi087.stdout:(13/34): python3-markupsafe-1.1.1-12.el9.x86_64 99 kB/s | 35 kB 00:00 2024-09-17T07:08:48.111 INFO:teuthology.orchestra.run.smithi139.stdout:(3/34): ceph-mds-17.2.7-1635.g4a704134.el9.x86_ 2.6 MB/s | 2.1 MB 00:00 2024-09-17T07:08:48.186 INFO:teuthology.orchestra.run.smithi139.stdout:(4/34): ceph-mon-17.2.7-1635.g4a704134.el9.x86_ 5.5 MB/s | 3.9 MB 00:00 2024-09-17T07:08:48.220 INFO:teuthology.orchestra.run.smithi139.stdout:(5/34): ceph-mgr-modules-core-17.2.7-1635.g4a70 2.2 MB/s | 240 kB 00:00 2024-09-17T07:08:48.228 INFO:teuthology.orchestra.run.smithi087.stdout:(14/34): python3-pytz-2021.1-5.el9.noarch.rpm 266 kB/s | 51 kB 00:00 2024-09-17T07:08:48.303 INFO:teuthology.orchestra.run.smithi087.stdout:(15/34): python3-packaging-20.9-5.el9.noarch.rp 168 kB/s | 77 kB 00:00 2024-09-17T07:08:48.328 INFO:teuthology.orchestra.run.smithi087.stdout:(16/34): python3-mako-1.1.4-6.el9.noarch.rpm 261 kB/s | 172 kB 00:00 2024-09-17T07:08:48.345 INFO:teuthology.orchestra.run.smithi087.stdout:(17/34): python3-toml-0.10.2-6.el9.noarch.rpm 356 kB/s | 42 kB 00:00 2024-09-17T07:08:48.387 INFO:teuthology.orchestra.run.smithi087.stdout:(18/34): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 520 kB/s | 43 kB 00:00 2024-09-17T07:08:48.413 INFO:teuthology.orchestra.run.smithi087.stdout:(19/34): python3-jaraco-8.2.1-3.el9.noarch.rpm 460 kB/s | 11 kB 00:00 2024-09-17T07:08:48.438 INFO:teuthology.orchestra.run.smithi087.stdout:(20/34): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.5 MB/s | 172 kB 00:00 2024-09-17T07:08:48.463 INFO:teuthology.orchestra.run.smithi087.stdout:(21/34): python3-jaraco-classes-3.2.1-5.el9.noa 353 kB/s | 18 kB 00:00 2024-09-17T07:08:48.488 INFO:teuthology.orchestra.run.smithi087.stdout:(22/34): python3-jaraco-collections-3.0.0-8.el9 462 kB/s | 23 kB 00:00 2024-09-17T07:08:48.513 INFO:teuthology.orchestra.run.smithi087.stdout:(23/34): python3-jaraco-functools-3.5.0-2.el9.n 387 kB/s | 19 kB 00:00 2024-09-17T07:08:48.539 INFO:teuthology.orchestra.run.smithi087.stdout:(24/34): python3-jaraco-text-3.2.0-6.el9.noarch 393 kB/s | 20 kB 00:00 2024-09-17T07:08:48.564 INFO:teuthology.orchestra.run.smithi087.stdout:(25/34): python3-logutils-0.3.5-21.el9.noarch.r 924 kB/s | 46 kB 00:00 2024-09-17T07:08:48.581 INFO:teuthology.orchestra.run.smithi087.stdout:(26/34): python3-more-itertools-8.12.0-2.el9.no 1.8 MB/s | 79 kB 00:00 2024-09-17T07:08:48.606 INFO:teuthology.orchestra.run.smithi087.stdout:(27/34): python3-cherrypy-18.6.1-2.el9.noarch.r 1.4 MB/s | 358 kB 00:00 2024-09-17T07:08:48.632 INFO:teuthology.orchestra.run.smithi087.stdout:(28/34): python3-portend-3.1.0-2.el9.noarch.rpm 325 kB/s | 16 kB 00:00 2024-09-17T07:08:48.648 INFO:teuthology.orchestra.run.smithi087.stdout:(29/34): python3-pyOpenSSL-21.0.0-1.el9.noarch. 2.1 MB/s | 90 kB 00:00 2024-09-17T07:08:48.673 INFO:teuthology.orchestra.run.smithi087.stdout:(30/34): python3-tempora-5.0.0-2.el9.noarch.rpm 860 kB/s | 36 kB 00:00 2024-09-17T07:08:48.699 INFO:teuthology.orchestra.run.smithi087.stdout:(31/34): python3-pecan-1.4.2-3.el9.noarch.rpm 2.0 MB/s | 272 kB 00:00 2024-09-17T07:08:48.749 INFO:teuthology.orchestra.run.smithi087.stdout:(32/34): python3-werkzeug-2.0.3-3.el9.1.noarch. 5.6 MB/s | 427 kB 00:00 2024-09-17T07:08:48.774 INFO:teuthology.orchestra.run.smithi087.stdout:(33/34): python3-zc-lockfile-2.0-10.el9.noarch. 273 kB/s | 20 kB 00:00 2024-09-17T07:08:48.799 INFO:teuthology.orchestra.run.smithi087.stdout:(34/34): python3-webob-1.8.8-2.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-09-17T07:08:48.804 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2024-09-17T07:08:48.804 INFO:teuthology.orchestra.run.smithi087.stdout:Total 12 MB/s | 27 MB 00:02 2024-09-17T07:08:48.820 INFO:teuthology.orchestra.run.smithi139.stdout:(6/34): ceph-osd-17.2.7-1635.g4a704134.el9.x86_ 16 MB/s | 15 MB 00:00 2024-09-17T07:08:48.863 INFO:teuthology.orchestra.run.smithi139.stdout:(7/34): python3-cffi-1.14.5-5.el9.x86_64.rpm 375 kB/s | 253 kB 00:00 2024-09-17T07:08:48.940 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction check 2024-09-17T07:08:48.977 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction check succeeded. 2024-09-17T07:08:48.977 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction test 2024-09-17T07:08:48.979 INFO:teuthology.orchestra.run.smithi139.stdout:(8/34): python3-pycparser-2.20-6.el9.noarch.rpm 1.1 MB/s | 135 kB 00:00 2024-09-17T07:08:49.105 INFO:teuthology.orchestra.run.smithi139.stdout:(9/34): python3-requests-2.25.1-8.el9.noarch.rp 997 kB/s | 125 kB 00:00 2024-09-17T07:08:49.222 INFO:teuthology.orchestra.run.smithi139.stdout:(10/34): python3-urllib3-1.26.5-6.el9.noarch.rp 1.8 MB/s | 215 kB 00:00 2024-09-17T07:08:49.280 INFO:teuthology.orchestra.run.smithi139.stdout:(11/34): python3-cryptography-36.0.1-4.el9.x86_ 1.2 MB/s | 1.2 MB 00:01 2024-09-17T07:08:49.330 INFO:teuthology.orchestra.run.smithi139.stdout:(12/34): python3-ply-3.11-14.el9.noarch.rpm 209 kB/s | 106 kB 00:00 2024-09-17T07:08:49.372 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction test succeeded. 2024-09-17T07:08:49.373 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction 2024-09-17T07:08:49.439 INFO:teuthology.orchestra.run.smithi139.stdout:(13/34): python3-markupsafe-1.1.1-12.el9.x86_64 219 kB/s | 35 kB 00:00 2024-09-17T07:08:49.473 INFO:teuthology.orchestra.run.smithi139.stdout:(14/34): python3-mako-1.1.4-6.el9.noarch.rpm 687 kB/s | 172 kB 00:00 2024-09-17T07:08:49.506 INFO:teuthology.orchestra.run.smithi139.stdout:(15/34): python3-packaging-20.9-5.el9.noarch.rp 440 kB/s | 77 kB 00:00 2024-09-17T07:08:49.540 INFO:teuthology.orchestra.run.smithi139.stdout:(16/34): python3-pytz-2021.1-5.el9.noarch.rpm 507 kB/s | 51 kB 00:00 2024-09-17T07:08:49.565 INFO:teuthology.orchestra.run.smithi139.stdout:(17/34): python3-toml-0.10.2-6.el9.noarch.rpm 452 kB/s | 42 kB 00:00 2024-09-17T07:08:49.607 INFO:teuthology.orchestra.run.smithi139.stdout:(18/34): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 433 kB/s | 43 kB 00:00 2024-09-17T07:08:49.632 INFO:teuthology.orchestra.run.smithi139.stdout:(19/34): python3-jaraco-8.2.1-3.el9.noarch.rpm 462 kB/s | 11 kB 00:00 2024-09-17T07:08:49.657 INFO:teuthology.orchestra.run.smithi139.stdout:(20/34): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.9 MB/s | 172 kB 00:00 2024-09-17T07:08:49.683 INFO:teuthology.orchestra.run.smithi139.stdout:(21/34): python3-jaraco-classes-3.2.1-5.el9.noa 352 kB/s | 18 kB 00:00 2024-09-17T07:08:49.708 INFO:teuthology.orchestra.run.smithi139.stdout:(22/34): python3-jaraco-collections-3.0.0-8.el9 461 kB/s | 23 kB 00:00 2024-09-17T07:08:49.733 INFO:teuthology.orchestra.run.smithi139.stdout:(23/34): python3-jaraco-functools-3.5.0-2.el9.n 387 kB/s | 19 kB 00:00 2024-09-17T07:08:49.758 INFO:teuthology.orchestra.run.smithi139.stdout:(24/34): python3-jaraco-text-3.2.0-6.el9.noarch 391 kB/s | 20 kB 00:00 2024-09-17T07:08:49.784 INFO:teuthology.orchestra.run.smithi139.stdout:(25/34): python3-logutils-0.3.5-21.el9.noarch.r 922 kB/s | 46 kB 00:00 2024-09-17T07:08:49.809 INFO:teuthology.orchestra.run.smithi139.stdout:(26/34): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-17T07:08:49.834 INFO:teuthology.orchestra.run.smithi139.stdout:(27/34): python3-cherrypy-18.6.1-2.el9.noarch.r 1.3 MB/s | 358 kB 00:00 2024-09-17T07:08:49.860 INFO:teuthology.orchestra.run.smithi139.stdout:(28/34): python3-portend-3.1.0-2.el9.noarch.rpm 327 kB/s | 16 kB 00:00 2024-09-17T07:08:49.897 INFO:teuthology.orchestra.run.smithi139.stdout:(29/34): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.4 MB/s | 90 kB 00:00 2024-09-17T07:08:49.922 INFO:teuthology.orchestra.run.smithi139.stdout:(30/34): python3-tempora-5.0.0-2.el9.noarch.rpm 577 kB/s | 36 kB 00:00 2024-09-17T07:08:49.947 INFO:teuthology.orchestra.run.smithi139.stdout:(31/34): python3-pecan-1.4.2-3.el9.noarch.rpm 1.6 MB/s | 272 kB 00:00 2024-09-17T07:08:49.973 INFO:teuthology.orchestra.run.smithi139.stdout:(32/34): python3-zc-lockfile-2.0-10.el9.noarch. 805 kB/s | 20 kB 00:00 2024-09-17T07:08:49.998 INFO:teuthology.orchestra.run.smithi139.stdout:(33/34): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-17T07:08:50.031 INFO:teuthology.orchestra.run.smithi139.stdout:(34/34): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.8 MB/s | 427 kB 00:00 2024-09-17T07:08:50.036 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2024-09-17T07:08:50.036 INFO:teuthology.orchestra.run.smithi139.stdout:Total 8.0 MB/s | 27 MB 00:03 2024-09-17T07:08:50.171 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2024-09-17T07:08:50.208 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2024-09-17T07:08:50.208 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2024-09-17T07:08:50.597 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2024-09-17T07:08:50.597 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2024-09-17T07:08:50.650 INFO:teuthology.orchestra.run.smithi087.stdout: Preparing : 1/1 2024-09-17T07:08:50.714 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/34 2024-09-17T07:08:50.746 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/34 2024-09-17T07:08:50.779 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/34 2024-09-17T07:08:50.871 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/34 2024-09-17T07:08:50.949 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/34 2024-09-17T07:08:50.990 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 6/34 2024-09-17T07:08:51.042 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/34 2024-09-17T07:08:51.072 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/34 2024-09-17T07:08:51.106 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/34 2024-09-17T07:08:51.139 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/34 2024-09-17T07:08:51.188 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/34 2024-09-17T07:08:51.232 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/34 2024-09-17T07:08:51.266 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/34 2024-09-17T07:08:51.314 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/34 2024-09-17T07:08:51.355 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-packaging-20.9-5.el9.noarch 15/34 2024-09-17T07:08:51.427 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 16/34 2024-09-17T07:08:51.574 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 17/34 2024-09-17T07:08:51.654 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 18/34 2024-09-17T07:08:51.707 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 19/34 2024-09-17T07:08:51.745 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 20/34 2024-09-17T07:08:51.794 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-ply-3.11-14.el9.noarch 21/34 2024-09-17T07:08:51.850 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 22/34 2024-09-17T07:08:51.882 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2024-09-17T07:08:51.943 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/34 2024-09-17T07:08:51.975 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/34 2024-09-17T07:08:52.008 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/34 2024-09-17T07:08:52.044 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 23/34 2024-09-17T07:08:52.100 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 24/34 2024-09-17T07:08:52.100 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/34 2024-09-17T07:08:52.177 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/34 2024-09-17T07:08:52.178 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 25/34 2024-09-17T07:08:52.218 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 6/34 2024-09-17T07:08:52.254 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/34 2024-09-17T07:08:52.272 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 26/34 2024-09-17T07:08:52.292 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/34 2024-09-17T07:08:52.323 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 27/34 2024-09-17T07:08:52.334 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/34 2024-09-17T07:08:52.376 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/34 2024-09-17T07:08:52.417 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/34 2024-09-17T07:08:52.437 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 28/34 2024-09-17T07:08:52.452 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/34 2024-09-17T07:08:52.486 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/34 2024-09-17T07:08:52.535 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/34 2024-09-17T07:08:52.577 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-packaging-20.9-5.el9.noarch 15/34 2024-09-17T07:08:52.604 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-1635.g4a704134.el9. 29/34 2024-09-17T07:08:52.633 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-2:17.2.7-1635.g4a704134.el9.x86_64 30/34 2024-09-17T07:08:52.656 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 16/34 2024-09-17T07:08:52.659 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mgr-2:17.2.7-1635.g4a704134.el9.x86_64 30/34 2024-09-17T07:08:52.659 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T07:08:52.659 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-17T07:08:52.660 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T07:08:52.660 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T07:08:52.660 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:08:52.795 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 17/34 2024-09-17T07:08:52.891 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 18/34 2024-09-17T07:08:52.944 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 19/34 2024-09-17T07:08:52.982 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 20/34 2024-09-17T07:08:53.031 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-ply-3.11-14.el9.noarch 21/34 2024-09-17T07:08:53.086 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 22/34 2024-09-17T07:08:53.273 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 23/34 2024-09-17T07:08:53.328 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 24/34 2024-09-17T07:08:53.422 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 25/34 2024-09-17T07:08:53.510 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 26/34 2024-09-17T07:08:53.554 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 27/34 2024-09-17T07:08:53.676 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 28/34 2024-09-17T07:08:53.834 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-1635.g4a704134.el9. 29/34 2024-09-17T07:08:53.873 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-2:17.2.7-1635.g4a704134.el9.x86_64 30/34 2024-09-17T07:08:53.896 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mgr-2:17.2.7-1635.g4a704134.el9.x86_64 30/34 2024-09-17T07:08:53.897 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T07:08:53.897 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-17T07:08:53.897 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T07:08:53.897 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T07:08:53.897 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:08:53.969 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-osd-2:17.2.7-1635.g4a704134.el9.x86_64 31/34 2024-09-17T07:08:53.996 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-osd-2:17.2.7-1635.g4a704134.el9.x86_64 31/34 2024-09-17T07:08:53.996 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T07:08:53.996 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-17T07:08:53.996 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T07:08:53.996 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T07:08:53.996 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:08:54.369 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mon-2:17.2.7-1635.g4a704134.el9.x86_64 32/34 2024-09-17T07:08:54.394 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mon-2:17.2.7-1635.g4a704134.el9.x86_64 32/34 2024-09-17T07:08:54.394 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T07:08:54.394 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-17T07:08:54.394 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T07:08:54.394 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T07:08:54.394 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:08:54.595 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mds-2:17.2.7-1635.g4a704134.el9.x86_64 33/34 2024-09-17T07:08:54.619 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mds-2:17.2.7-1635.g4a704134.el9.x86_64 33/34 2024-09-17T07:08:54.619 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T07:08:54.619 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-17T07:08:54.620 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T07:08:54.620 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T07:08:54.620 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:08:54.684 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-2:17.2.7-1635.g4a704134.el9.x86_64 34/34 2024-09-17T07:08:55.204 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-osd-2:17.2.7-1635.g4a704134.el9.x86_64 31/34 2024-09-17T07:08:55.231 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-osd-2:17.2.7-1635.g4a704134.el9.x86_64 31/34 2024-09-17T07:08:55.232 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T07:08:55.232 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-17T07:08:55.232 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T07:08:55.232 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T07:08:55.232 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:08:55.605 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mon-2:17.2.7-1635.g4a704134.el9.x86_64 32/34 2024-09-17T07:08:55.629 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mon-2:17.2.7-1635.g4a704134.el9.x86_64 32/34 2024-09-17T07:08:55.629 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T07:08:55.629 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-17T07:08:55.630 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T07:08:55.630 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T07:08:55.630 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:08:55.830 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mds-2:17.2.7-1635.g4a704134.el9.x86_64 33/34 2024-09-17T07:08:55.854 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mds-2:17.2.7-1635.g4a704134.el9.x86_64 33/34 2024-09-17T07:08:55.854 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T07:08:55.855 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-17T07:08:55.855 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T07:08:55.855 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T07:08:55.855 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:08:55.918 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-2:17.2.7-1635.g4a704134.el9.x86_64 34/34 2024-09-17T07:08:56.444 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-2:17.2.7-1635.g4a704134.el9.x86_64 34/34 2024-09-17T07:08:56.444 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-2:17.2.7-1635.g4a704134.el9.x86_64 1/34 2024-09-17T07:08:56.444 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mds-2:17.2.7-1635.g4a704134.el9.x86_64 2/34 2024-09-17T07:08:56.444 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-2:17.2.7-1635.g4a704134.el9.x86_64 3/34 2024-09-17T07:08:56.444 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mon-2:17.2.7-1635.g4a704134.el9.x86_64 4/34 2024-09-17T07:08:56.444 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-osd-2:17.2.7-1635.g4a704134.el9.x86_64 5/34 2024-09-17T07:08:56.444 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-1635.g4a704134.el9. 6/34 2024-09-17T07:08:56.445 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/34 2024-09-17T07:08:56.445 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/34 2024-09-17T07:08:56.445 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/34 2024-09-17T07:08:56.445 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/34 2024-09-17T07:08:56.445 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/34 2024-09-17T07:08:56.445 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/34 2024-09-17T07:08:56.445 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/34 2024-09-17T07:08:56.445 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/34 2024-09-17T07:08:56.445 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 15/34 2024-09-17T07:08:56.445 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/34 2024-09-17T07:08:56.445 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 17/34 2024-09-17T07:08:56.445 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 18/34 2024-09-17T07:08:56.445 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 19/34 2024-09-17T07:08:56.446 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 20/34 2024-09-17T07:08:56.446 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 21/34 2024-09-17T07:08:56.446 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 22/34 2024-09-17T07:08:56.446 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 23/34 2024-09-17T07:08:56.446 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 24/34 2024-09-17T07:08:56.446 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 25/34 2024-09-17T07:08:56.447 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 26/34 2024-09-17T07:08:56.447 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 27/34 2024-09-17T07:08:56.447 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 28/34 2024-09-17T07:08:56.447 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 29/34 2024-09-17T07:08:56.447 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 30/34 2024-09-17T07:08:56.447 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 31/34 2024-09-17T07:08:56.447 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 32/34 2024-09-17T07:08:56.447 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 33/34 2024-09-17T07:08:57.511 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 34/34 2024-09-17T07:08:57.511 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:08:57.511 INFO:teuthology.orchestra.run.smithi087.stdout:Installed: 2024-09-17T07:08:57.511 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T07:08:57.511 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mds-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T07:08:57.511 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T07:08:57.511 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-modules-core-2:17.2.7-1635.g4a704134.el9.noarch 2024-09-17T07:08:57.511 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mon-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T07:08:57.512 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-osd-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T07:08:57.512 INFO:teuthology.orchestra.run.smithi087.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-17T07:08:57.512 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-17T07:08:57.512 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-17T07:08:57.512 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-17T07:08:57.512 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-17T07:08:57.512 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-17T07:08:57.512 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-17T07:08:57.512 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-17T07:08:57.512 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-17T07:08:57.512 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-17T07:08:57.512 INFO:teuthology.orchestra.run.smithi087.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-17T07:08:57.512 INFO:teuthology.orchestra.run.smithi087.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-17T07:08:57.513 INFO:teuthology.orchestra.run.smithi087.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-17T07:08:57.513 INFO:teuthology.orchestra.run.smithi087.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-17T07:08:57.513 INFO:teuthology.orchestra.run.smithi087.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-17T07:08:57.513 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-17T07:08:57.513 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ply-3.11-14.el9.noarch 2024-09-17T07:08:57.513 INFO:teuthology.orchestra.run.smithi087.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-17T07:08:57.513 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-17T07:08:57.513 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-17T07:08:57.513 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-17T07:08:57.513 INFO:teuthology.orchestra.run.smithi087.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-17T07:08:57.513 INFO:teuthology.orchestra.run.smithi087.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-17T07:08:57.513 INFO:teuthology.orchestra.run.smithi087.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-17T07:08:57.513 INFO:teuthology.orchestra.run.smithi087.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-17T07:08:57.514 INFO:teuthology.orchestra.run.smithi087.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-17T07:08:57.514 INFO:teuthology.orchestra.run.smithi087.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-17T07:08:57.514 INFO:teuthology.orchestra.run.smithi087.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-17T07:08:57.514 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:08:57.514 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-09-17T07:08:57.633 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-2:17.2.7-1635.g4a704134.el9.x86_64 34/34 2024-09-17T07:08:57.633 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-2:17.2.7-1635.g4a704134.el9.x86_64 1/34 2024-09-17T07:08:57.633 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mds-2:17.2.7-1635.g4a704134.el9.x86_64 2/34 2024-09-17T07:08:57.633 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-2:17.2.7-1635.g4a704134.el9.x86_64 3/34 2024-09-17T07:08:57.633 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mon-2:17.2.7-1635.g4a704134.el9.x86_64 4/34 2024-09-17T07:08:57.633 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-osd-2:17.2.7-1635.g4a704134.el9.x86_64 5/34 2024-09-17T07:08:57.633 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-1635.g4a704134.el9. 6/34 2024-09-17T07:08:57.633 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/34 2024-09-17T07:08:57.633 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/34 2024-09-17T07:08:57.633 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/34 2024-09-17T07:08:57.634 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/34 2024-09-17T07:08:57.634 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/34 2024-09-17T07:08:57.634 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/34 2024-09-17T07:08:57.634 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/34 2024-09-17T07:08:57.634 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/34 2024-09-17T07:08:57.634 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 15/34 2024-09-17T07:08:57.634 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/34 2024-09-17T07:08:57.634 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 17/34 2024-09-17T07:08:57.634 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 18/34 2024-09-17T07:08:57.634 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 19/34 2024-09-17T07:08:57.634 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 20/34 2024-09-17T07:08:57.635 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 21/34 2024-09-17T07:08:57.635 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 22/34 2024-09-17T07:08:57.635 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 23/34 2024-09-17T07:08:57.635 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 24/34 2024-09-17T07:08:57.635 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 25/34 2024-09-17T07:08:57.635 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 26/34 2024-09-17T07:08:57.635 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 27/34 2024-09-17T07:08:57.635 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 28/34 2024-09-17T07:08:57.635 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 29/34 2024-09-17T07:08:57.635 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 30/34 2024-09-17T07:08:57.635 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 31/34 2024-09-17T07:08:57.635 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 32/34 2024-09-17T07:08:57.635 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 33/34 2024-09-17T07:08:57.890 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install ceph-base 2024-09-17T07:08:58.477 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:00:51 ago on Tue 17 Sep 2024 07:08:07 AM UTC. 2024-09-17T07:08:58.566 INFO:teuthology.orchestra.run.smithi087.stdout:Package ceph-base-2:17.2.7-1635.g4a704134.el9.x86_64 is already installed. 2024-09-17T07:08:58.606 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 34/34 2024-09-17T07:08:58.606 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:08:58.606 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2024-09-17T07:08:58.606 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T07:08:58.606 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mds-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T07:08:58.607 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T07:08:58.607 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-modules-core-2:17.2.7-1635.g4a704134.el9.noarch 2024-09-17T07:08:58.607 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mon-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T07:08:58.607 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-osd-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T07:08:58.607 INFO:teuthology.orchestra.run.smithi139.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-17T07:08:58.607 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-17T07:08:58.607 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-17T07:08:58.607 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-17T07:08:58.607 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-17T07:08:58.607 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-17T07:08:58.607 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-17T07:08:58.607 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-17T07:08:58.607 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-17T07:08:58.607 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-17T07:08:58.608 INFO:teuthology.orchestra.run.smithi139.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-17T07:08:58.608 INFO:teuthology.orchestra.run.smithi139.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-17T07:08:58.608 INFO:teuthology.orchestra.run.smithi139.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-17T07:08:58.608 INFO:teuthology.orchestra.run.smithi139.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-17T07:08:58.608 INFO:teuthology.orchestra.run.smithi139.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-17T07:08:58.608 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-17T07:08:58.608 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ply-3.11-14.el9.noarch 2024-09-17T07:08:58.608 INFO:teuthology.orchestra.run.smithi139.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-17T07:08:58.608 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-17T07:08:58.608 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-17T07:08:58.608 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-17T07:08:58.608 INFO:teuthology.orchestra.run.smithi139.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-17T07:08:58.608 INFO:teuthology.orchestra.run.smithi139.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-17T07:08:58.608 INFO:teuthology.orchestra.run.smithi139.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-17T07:08:58.609 INFO:teuthology.orchestra.run.smithi139.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-17T07:08:58.609 INFO:teuthology.orchestra.run.smithi139.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-17T07:08:58.609 INFO:teuthology.orchestra.run.smithi139.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-17T07:08:58.609 INFO:teuthology.orchestra.run.smithi139.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-17T07:08:58.609 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:08:58.609 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-17T07:08:58.609 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-09-17T07:08:58.610 INFO:teuthology.orchestra.run.smithi087.stdout:Nothing to do. 2024-09-17T07:08:58.610 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-09-17T07:08:58.676 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install cephadm 2024-09-17T07:08:58.983 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install ceph-base 2024-09-17T07:08:59.251 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:00:52 ago on Tue 17 Sep 2024 07:08:07 AM UTC. 2024-09-17T07:08:59.382 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-09-17T07:08:59.382 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-09-17T07:08:59.383 INFO:teuthology.orchestra.run.smithi087.stdout: Package Arch Version Repository Size 2024-09-17T07:08:59.383 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-09-17T07:08:59.383 INFO:teuthology.orchestra.run.smithi087.stdout:Installing: 2024-09-17T07:08:59.383 INFO:teuthology.orchestra.run.smithi087.stdout: cephadm noarch 2:17.2.7-1635.g4a704134.el9 ceph-noarch 83 k 2024-09-17T07:08:59.383 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:08:59.383 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction Summary 2024-09-17T07:08:59.383 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-09-17T07:08:59.383 INFO:teuthology.orchestra.run.smithi087.stdout:Install 1 Package 2024-09-17T07:08:59.383 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:08:59.383 INFO:teuthology.orchestra.run.smithi087.stdout:Total download size: 83 k 2024-09-17T07:08:59.383 INFO:teuthology.orchestra.run.smithi087.stdout:Installed size: 375 k 2024-09-17T07:08:59.383 INFO:teuthology.orchestra.run.smithi087.stdout:Downloading Packages: 2024-09-17T07:08:59.569 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:00:51 ago on Tue 17 Sep 2024 07:08:08 AM UTC. 2024-09-17T07:08:59.593 INFO:teuthology.orchestra.run.smithi087.stdout:cephadm-17.2.7-1635.g4a704134.el9.noarch.rpm 394 kB/s | 83 kB 00:00 2024-09-17T07:08:59.597 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2024-09-17T07:08:59.597 INFO:teuthology.orchestra.run.smithi087.stdout:Total 391 kB/s | 83 kB 00:00 2024-09-17T07:08:59.597 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction check 2024-09-17T07:08:59.599 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction check succeeded. 2024-09-17T07:08:59.599 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction test 2024-09-17T07:08:59.601 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction test succeeded. 2024-09-17T07:08:59.601 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction 2024-09-17T07:08:59.659 INFO:teuthology.orchestra.run.smithi139.stdout:Package ceph-base-2:17.2.7-1635.g4a704134.el9.x86_64 is already installed. 2024-09-17T07:08:59.671 INFO:teuthology.orchestra.run.smithi087.stdout: Preparing : 1/1 2024-09-17T07:08:59.700 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-17T07:08:59.701 INFO:teuthology.orchestra.run.smithi139.stdout:Nothing to do. 2024-09-17T07:08:59.701 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-17T07:08:59.765 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install cephadm 2024-09-17T07:09:00.118 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: cephadm-2:17.2.7-1635.g4a704134.el9.noarch 1/1 2024-09-17T07:09:00.196 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : cephadm-2:17.2.7-1635.g4a704134.el9.noarch 1/1 2024-09-17T07:09:00.344 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:00:52 ago on Tue 17 Sep 2024 07:08:08 AM UTC. 2024-09-17T07:09:00.475 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-17T07:09:00.476 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-17T07:09:00.476 INFO:teuthology.orchestra.run.smithi139.stdout: Package Arch Version Repository Size 2024-09-17T07:09:00.476 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-17T07:09:00.476 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2024-09-17T07:09:00.476 INFO:teuthology.orchestra.run.smithi139.stdout: cephadm noarch 2:17.2.7-1635.g4a704134.el9 ceph-noarch 83 k 2024-09-17T07:09:00.476 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:09:00.476 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2024-09-17T07:09:00.476 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-17T07:09:00.476 INFO:teuthology.orchestra.run.smithi139.stdout:Install 1 Package 2024-09-17T07:09:00.476 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:09:00.476 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 83 k 2024-09-17T07:09:00.476 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 375 k 2024-09-17T07:09:00.477 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2024-09-17T07:09:00.570 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: cephadm-2:17.2.7-1635.g4a704134.el9.noarch 1/1 2024-09-17T07:09:00.671 INFO:teuthology.orchestra.run.smithi139.stdout:cephadm-17.2.7-1635.g4a704134.el9.noarch.rpm 427 kB/s | 83 kB 00:00 2024-09-17T07:09:00.671 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2024-09-17T07:09:00.672 INFO:teuthology.orchestra.run.smithi139.stdout:Total 423 kB/s | 83 kB 00:00 2024-09-17T07:09:00.672 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2024-09-17T07:09:00.677 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2024-09-17T07:09:00.677 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2024-09-17T07:09:00.679 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2024-09-17T07:09:00.679 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2024-09-17T07:09:00.747 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2024-09-17T07:09:00.814 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : cephadm-2:17.2.7-1635.g4a704134.el9.noarch 1/1 2024-09-17T07:09:00.814 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:09:00.814 INFO:teuthology.orchestra.run.smithi087.stdout:Installed: 2024-09-17T07:09:00.815 INFO:teuthology.orchestra.run.smithi087.stdout: cephadm-2:17.2.7-1635.g4a704134.el9.noarch 2024-09-17T07:09:00.815 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:09:00.815 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-09-17T07:09:01.036 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install ceph-immutable-object-cache 2024-09-17T07:09:01.211 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: cephadm-2:17.2.7-1635.g4a704134.el9.noarch 1/1 2024-09-17T07:09:01.299 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : cephadm-2:17.2.7-1635.g4a704134.el9.noarch 1/1 2024-09-17T07:09:01.620 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:00:54 ago on Tue 17 Sep 2024 07:08:07 AM UTC. 2024-09-17T07:09:01.712 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: cephadm-2:17.2.7-1635.g4a704134.el9.noarch 1/1 2024-09-17T07:09:01.755 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-09-17T07:09:01.756 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-09-17T07:09:01.756 INFO:teuthology.orchestra.run.smithi087.stdout: Package Arch Version Repo Size 2024-09-17T07:09:01.756 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-09-17T07:09:01.756 INFO:teuthology.orchestra.run.smithi087.stdout:Installing: 2024-09-17T07:09:01.756 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-1635.g4a704134.el9 ceph 137 k 2024-09-17T07:09:01.756 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:09:01.756 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction Summary 2024-09-17T07:09:01.756 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-09-17T07:09:01.756 INFO:teuthology.orchestra.run.smithi087.stdout:Install 1 Package 2024-09-17T07:09:01.756 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:09:01.756 INFO:teuthology.orchestra.run.smithi087.stdout:Total download size: 137 k 2024-09-17T07:09:01.757 INFO:teuthology.orchestra.run.smithi087.stdout:Installed size: 379 k 2024-09-17T07:09:01.757 INFO:teuthology.orchestra.run.smithi087.stdout:Downloading Packages: 2024-09-17T07:09:01.965 INFO:teuthology.orchestra.run.smithi087.stdout:ceph-immutable-object-cache-17.2.7-1635.g4a7041 660 kB/s | 137 kB 00:00 2024-09-17T07:09:01.965 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2024-09-17T07:09:01.966 INFO:teuthology.orchestra.run.smithi087.stdout:Total 655 kB/s | 137 kB 00:00 2024-09-17T07:09:01.966 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction check 2024-09-17T07:09:01.973 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction check succeeded. 2024-09-17T07:09:01.973 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction test 2024-09-17T07:09:01.973 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : cephadm-2:17.2.7-1635.g4a704134.el9.noarch 1/1 2024-09-17T07:09:01.974 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:09:01.974 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2024-09-17T07:09:01.974 INFO:teuthology.orchestra.run.smithi139.stdout: cephadm-2:17.2.7-1635.g4a704134.el9.noarch 2024-09-17T07:09:01.974 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:09:01.974 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-17T07:09:02.029 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction test succeeded. 2024-09-17T07:09:02.029 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction 2024-09-17T07:09:02.174 INFO:teuthology.orchestra.run.smithi087.stdout: Preparing : 1/1 2024-09-17T07:09:02.217 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install ceph-immutable-object-cache 2024-09-17T07:09:02.249 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-1635.g4a704134. 1/1 2024-09-17T07:09:02.274 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-1635.g4a704134. 1/1 2024-09-17T07:09:02.274 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T07:09:02.275 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-17T07:09:02.275 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:09:02.807 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:00:54 ago on Tue 17 Sep 2024 07:08:08 AM UTC. 2024-09-17T07:09:02.941 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-17T07:09:02.942 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-17T07:09:02.942 INFO:teuthology.orchestra.run.smithi139.stdout: Package Arch Version Repo Size 2024-09-17T07:09:02.942 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-17T07:09:02.942 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2024-09-17T07:09:02.942 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-1635.g4a704134.el9 ceph 137 k 2024-09-17T07:09:02.942 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:09:02.942 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2024-09-17T07:09:02.942 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-17T07:09:02.943 INFO:teuthology.orchestra.run.smithi139.stdout:Install 1 Package 2024-09-17T07:09:02.943 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:09:02.943 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 137 k 2024-09-17T07:09:02.943 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 379 k 2024-09-17T07:09:02.943 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2024-09-17T07:09:03.127 INFO:teuthology.orchestra.run.smithi139.stdout:ceph-immutable-object-cache-17.2.7-1635.g4a7041 748 kB/s | 137 kB 00:00 2024-09-17T07:09:03.127 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2024-09-17T07:09:03.127 INFO:teuthology.orchestra.run.smithi139.stdout:Total 742 kB/s | 137 kB 00:00 2024-09-17T07:09:03.128 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2024-09-17T07:09:03.135 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2024-09-17T07:09:03.135 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2024-09-17T07:09:03.191 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2024-09-17T07:09:03.192 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2024-09-17T07:09:03.272 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-1635.g4a704134. 1/1 2024-09-17T07:09:03.272 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:09:03.273 INFO:teuthology.orchestra.run.smithi087.stdout:Installed: 2024-09-17T07:09:03.273 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-immutable-object-cache-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T07:09:03.273 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:09:03.273 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-09-17T07:09:03.334 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2024-09-17T07:09:03.403 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-1635.g4a704134. 1/1 2024-09-17T07:09:03.429 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-1635.g4a704134. 1/1 2024-09-17T07:09:03.429 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T07:09:03.429 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-17T07:09:03.429 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:09:03.472 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install ceph-mgr 2024-09-17T07:09:04.053 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:00:57 ago on Tue 17 Sep 2024 07:08:07 AM UTC. 2024-09-17T07:09:04.142 INFO:teuthology.orchestra.run.smithi087.stdout:Package ceph-mgr-2:17.2.7-1635.g4a704134.el9.x86_64 is already installed. 2024-09-17T07:09:04.183 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-09-17T07:09:04.184 INFO:teuthology.orchestra.run.smithi087.stdout:Nothing to do. 2024-09-17T07:09:04.185 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-09-17T07:09:04.247 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install ceph-mgr-dashboard 2024-09-17T07:09:04.339 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-1635.g4a704134. 1/1 2024-09-17T07:09:04.339 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:09:04.339 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2024-09-17T07:09:04.339 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-immutable-object-cache-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T07:09:04.339 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:09:04.340 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-17T07:09:04.531 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install ceph-mgr 2024-09-17T07:09:04.818 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:00:57 ago on Tue 17 Sep 2024 07:08:07 AM UTC. 2024-09-17T07:09:04.950 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-09-17T07:09:04.951 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-09-17T07:09:04.951 INFO:teuthology.orchestra.run.smithi087.stdout: Package Arch Version Repository Size 2024-09-17T07:09:04.951 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-09-17T07:09:04.951 INFO:teuthology.orchestra.run.smithi087.stdout:Installing: 2024-09-17T07:09:04.951 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-dashboard noarch 2:17.2.7-1635.g4a704134.el9 ceph-noarch 3.4 M 2024-09-17T07:09:04.951 INFO:teuthology.orchestra.run.smithi087.stdout:Installing dependencies: 2024-09-17T07:09:04.952 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-grafana-dashboards noarch 2:17.2.7-1635.g4a704134.el9 ceph-noarch 24 k 2024-09-17T07:09:04.952 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-prometheus-alerts noarch 2:17.2.7-1635.g4a704134.el9 ceph-noarch 15 k 2024-09-17T07:09:04.952 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-09-17T07:09:04.952 INFO:teuthology.orchestra.run.smithi087.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-17T07:09:04.952 INFO:teuthology.orchestra.run.smithi087.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-17T07:09:04.952 INFO:teuthology.orchestra.run.smithi087.stdout:Installing weak dependencies: 2024-09-17T07:09:04.952 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-09-17T07:09:04.952 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:09:04.952 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction Summary 2024-09-17T07:09:04.952 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-09-17T07:09:04.952 INFO:teuthology.orchestra.run.smithi087.stdout:Install 7 Packages 2024-09-17T07:09:04.952 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:09:04.953 INFO:teuthology.orchestra.run.smithi087.stdout:Total download size: 3.7 M 2024-09-17T07:09:04.953 INFO:teuthology.orchestra.run.smithi087.stdout:Installed size: 80 M 2024-09-17T07:09:04.953 INFO:teuthology.orchestra.run.smithi087.stdout:Downloading Packages: 2024-09-17T07:09:05.128 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:00:57 ago on Tue 17 Sep 2024 07:08:08 AM UTC. 2024-09-17T07:09:05.219 INFO:teuthology.orchestra.run.smithi139.stdout:Package ceph-mgr-2:17.2.7-1635.g4a704134.el9.x86_64 is already installed. 2024-09-17T07:09:05.243 INFO:teuthology.orchestra.run.smithi087.stdout:(1/7): ceph-grafana-dashboards-17.2.7-1635.g4a7 168 kB/s | 24 kB 00:00 2024-09-17T07:09:05.261 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-17T07:09:05.262 INFO:teuthology.orchestra.run.smithi139.stdout:Nothing to do. 2024-09-17T07:09:05.262 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-17T07:09:05.276 INFO:teuthology.orchestra.run.smithi087.stdout:(2/7): ceph-prometheus-alerts-17.2.7-1635.g4a70 81 kB/s | 15 kB 00:00 2024-09-17T07:09:05.327 INFO:teuthology.orchestra.run.smithi087.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 108 kB/s | 9.0 kB 00:00 2024-09-17T07:09:05.333 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install ceph-mgr-dashboard 2024-09-17T07:09:05.352 INFO:teuthology.orchestra.run.smithi087.stdout:(4/7): python3-jwt-2.4.0-1.el9.noarch.rpm 543 kB/s | 41 kB 00:00 2024-09-17T07:09:05.377 INFO:teuthology.orchestra.run.smithi087.stdout:(5/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 615 kB/s | 31 kB 00:00 2024-09-17T07:09:05.402 INFO:teuthology.orchestra.run.smithi087.stdout:(6/7): python3-routes-2.5.1-5.el9.noarch.rpm 3.7 MB/s | 188 kB 00:00 2024-09-17T07:09:05.494 INFO:teuthology.orchestra.run.smithi087.stdout:(7/7): ceph-mgr-dashboard-17.2.7-1635.g4a704134 8.4 MB/s | 3.4 MB 00:00 2024-09-17T07:09:05.498 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2024-09-17T07:09:05.498 INFO:teuthology.orchestra.run.smithi087.stdout:Total 6.7 MB/s | 3.7 MB 00:00 2024-09-17T07:09:05.498 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction check 2024-09-17T07:09:05.507 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction check succeeded. 2024-09-17T07:09:05.507 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction test 2024-09-17T07:09:05.586 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction test succeeded. 2024-09-17T07:09:05.586 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction 2024-09-17T07:09:05.900 INFO:teuthology.orchestra.run.smithi087.stdout: Preparing : 1/1 2024-09-17T07:09:05.908 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:00:57 ago on Tue 17 Sep 2024 07:08:08 AM UTC. 2024-09-17T07:09:05.971 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-09-17T07:09:06.005 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-09-17T07:09:06.040 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-17T07:09:06.041 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-17T07:09:06.041 INFO:teuthology.orchestra.run.smithi139.stdout: Package Arch Version Repository Size 2024-09-17T07:09:06.041 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-17T07:09:06.041 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2024-09-17T07:09:06.041 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-dashboard noarch 2:17.2.7-1635.g4a704134.el9 ceph-noarch 3.4 M 2024-09-17T07:09:06.041 INFO:teuthology.orchestra.run.smithi139.stdout:Installing dependencies: 2024-09-17T07:09:06.041 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-grafana-dashboards noarch 2:17.2.7-1635.g4a704134.el9 ceph-noarch 24 k 2024-09-17T07:09:06.041 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-prometheus-alerts noarch 2:17.2.7-1635.g4a704134.el9 ceph-noarch 15 k 2024-09-17T07:09:06.041 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-09-17T07:09:06.041 INFO:teuthology.orchestra.run.smithi139.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-17T07:09:06.042 INFO:teuthology.orchestra.run.smithi139.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-17T07:09:06.042 INFO:teuthology.orchestra.run.smithi139.stdout:Installing weak dependencies: 2024-09-17T07:09:06.042 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-09-17T07:09:06.042 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:09:06.042 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2024-09-17T07:09:06.042 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-17T07:09:06.042 INFO:teuthology.orchestra.run.smithi139.stdout:Install 7 Packages 2024-09-17T07:09:06.042 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:09:06.043 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 3.7 M 2024-09-17T07:09:06.043 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 80 M 2024-09-17T07:09:06.043 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2024-09-17T07:09:06.052 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-09-17T07:09:06.083 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-09-17T07:09:06.112 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-1635.g4a704134.el9.n 5/7 2024-09-17T07:09:06.549 INFO:teuthology.orchestra.run.smithi139.stdout:(1/7): ceph-prometheus-alerts-17.2.7-1635.g4a70 90 kB/s | 15 kB 00:00 2024-09-17T07:09:06.574 INFO:teuthology.orchestra.run.smithi139.stdout:(2/7): ceph-grafana-dashboards-17.2.7-1635.g4a7 129 kB/s | 24 kB 00:00 2024-09-17T07:09:06.616 INFO:teuthology.orchestra.run.smithi139.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 135 kB/s | 9.0 kB 00:00 2024-09-17T07:09:06.650 INFO:teuthology.orchestra.run.smithi139.stdout:(4/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 977 kB/s | 31 kB 00:00 2024-09-17T07:09:06.675 INFO:teuthology.orchestra.run.smithi139.stdout:(5/7): python3-jwt-2.4.0-1.el9.noarch.rpm 407 kB/s | 41 kB 00:00 2024-09-17T07:09:06.700 INFO:teuthology.orchestra.run.smithi139.stdout:(6/7): python3-routes-2.5.1-5.el9.noarch.rpm 3.7 MB/s | 188 kB 00:00 2024-09-17T07:09:06.759 INFO:teuthology.orchestra.run.smithi139.stdout:(7/7): ceph-mgr-dashboard-17.2.7-1635.g4a704134 9.0 MB/s | 3.4 MB 00:00 2024-09-17T07:09:06.763 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2024-09-17T07:09:06.763 INFO:teuthology.orchestra.run.smithi139.stdout:Total 5.1 MB/s | 3.7 MB 00:00 2024-09-17T07:09:06.763 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2024-09-17T07:09:06.771 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2024-09-17T07:09:06.771 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2024-09-17T07:09:06.869 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2024-09-17T07:09:06.869 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2024-09-17T07:09:07.113 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-1635.g4a704134.el9. 6/7 2024-09-17T07:09:07.149 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-1635.g4a704134.el9.noarc 7/7 2024-09-17T07:09:07.170 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2024-09-17T07:09:07.243 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-09-17T07:09:07.286 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-09-17T07:09:07.341 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-09-17T07:09:07.372 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-09-17T07:09:07.401 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-1635.g4a704134.el9.n 5/7 2024-09-17T07:09:08.182 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-1635.g4a704134.el9.noarc 7/7 2024-09-17T07:09:08.182 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-1635.g4a704134.el9. 1/7 2024-09-17T07:09:08.182 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-1635.g4a704134.el9.noarc 2/7 2024-09-17T07:09:08.182 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-1635.g4a704134.el9.n 3/7 2024-09-17T07:09:08.182 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-09-17T07:09:08.182 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-09-17T07:09:08.182 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-09-17T07:09:08.402 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-1635.g4a704134.el9. 6/7 2024-09-17T07:09:08.446 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-1635.g4a704134.el9.noarc 7/7 2024-09-17T07:09:08.453 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-09-17T07:09:08.453 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:09:08.453 INFO:teuthology.orchestra.run.smithi087.stdout:Installed: 2024-09-17T07:09:08.454 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-grafana-dashboards-2:17.2.7-1635.g4a704134.el9.noarch 2024-09-17T07:09:08.454 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-dashboard-2:17.2.7-1635.g4a704134.el9.noarch 2024-09-17T07:09:08.454 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-prometheus-alerts-2:17.2.7-1635.g4a704134.el9.noarch 2024-09-17T07:09:08.454 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-09-17T07:09:08.454 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-09-17T07:09:08.454 INFO:teuthology.orchestra.run.smithi087.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-17T07:09:08.454 INFO:teuthology.orchestra.run.smithi087.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-17T07:09:08.454 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:09:08.454 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-09-17T07:09:08.680 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-17T07:09:09.258 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:01:02 ago on Tue 17 Sep 2024 07:08:07 AM UTC. 2024-09-17T07:09:09.391 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-09-17T07:09:09.392 INFO:teuthology.orchestra.run.smithi087.stdout:======================================================================================= 2024-09-17T07:09:09.393 INFO:teuthology.orchestra.run.smithi087.stdout: Package Arch Version Repository Size 2024-09-17T07:09:09.393 INFO:teuthology.orchestra.run.smithi087.stdout:======================================================================================= 2024-09-17T07:09:09.393 INFO:teuthology.orchestra.run.smithi087.stdout:Installing: 2024-09-17T07:09:09.393 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-1635.g4a704134.el9 ceph-noarch 7.4 M 2024-09-17T07:09:09.393 INFO:teuthology.orchestra.run.smithi087.stdout:Installing dependencies: 2024-09-17T07:09:09.393 INFO:teuthology.orchestra.run.smithi087.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-17T07:09:09.393 INFO:teuthology.orchestra.run.smithi087.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-17T07:09:09.393 INFO:teuthology.orchestra.run.smithi087.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-17T07:09:09.393 INFO:teuthology.orchestra.run.smithi087.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-17T07:09:09.393 INFO:teuthology.orchestra.run.smithi087.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-17T07:09:09.393 INFO:teuthology.orchestra.run.smithi087.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-17T07:09:09.393 INFO:teuthology.orchestra.run.smithi087.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-17T07:09:09.393 INFO:teuthology.orchestra.run.smithi087.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-17T07:09:09.394 INFO:teuthology.orchestra.run.smithi087.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-17T07:09:09.394 INFO:teuthology.orchestra.run.smithi087.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-17T07:09:09.394 INFO:teuthology.orchestra.run.smithi087.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-17T07:09:09.394 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:09:09.394 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction Summary 2024-09-17T07:09:09.394 INFO:teuthology.orchestra.run.smithi087.stdout:======================================================================================= 2024-09-17T07:09:09.394 INFO:teuthology.orchestra.run.smithi087.stdout:Install 12 Packages 2024-09-17T07:09:09.394 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:09:09.395 INFO:teuthology.orchestra.run.smithi087.stdout:Total download size: 38 M 2024-09-17T07:09:09.395 INFO:teuthology.orchestra.run.smithi087.stdout:Installed size: 212 M 2024-09-17T07:09:09.395 INFO:teuthology.orchestra.run.smithi087.stdout:Downloading Packages: 2024-09-17T07:09:09.500 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-1635.g4a704134.el9.noarc 7/7 2024-09-17T07:09:09.500 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-1635.g4a704134.el9. 1/7 2024-09-17T07:09:09.500 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-1635.g4a704134.el9.noarc 2/7 2024-09-17T07:09:09.500 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-1635.g4a704134.el9.n 3/7 2024-09-17T07:09:09.501 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-09-17T07:09:09.501 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-09-17T07:09:09.501 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-09-17T07:09:09.789 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-09-17T07:09:09.789 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:09:09.789 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2024-09-17T07:09:09.789 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-grafana-dashboards-2:17.2.7-1635.g4a704134.el9.noarch 2024-09-17T07:09:09.789 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-dashboard-2:17.2.7-1635.g4a704134.el9.noarch 2024-09-17T07:09:09.789 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-prometheus-alerts-2:17.2.7-1635.g4a704134.el9.noarch 2024-09-17T07:09:09.789 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-09-17T07:09:09.789 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-09-17T07:09:09.790 INFO:teuthology.orchestra.run.smithi139.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-17T07:09:09.790 INFO:teuthology.orchestra.run.smithi139.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-17T07:09:09.790 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:09:09.790 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-17T07:09:09.996 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-17T07:09:10.086 INFO:teuthology.orchestra.run.smithi087.stdout:(1/12): ceph-mgr-diskprediction-local-17.2.7-16 17 MB/s | 7.4 MB 00:00 2024-09-17T07:09:10.369 INFO:teuthology.orchestra.run.smithi087.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 116 kB/s | 33 kB 00:00 2024-09-17T07:09:10.444 INFO:teuthology.orchestra.run.smithi087.stdout:(3/12): libquadmath-11.5.0-2.el9.x86_64.rpm 237 kB/s | 191 kB 00:00 2024-09-17T07:09:10.575 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:01:02 ago on Tue 17 Sep 2024 07:08:08 AM UTC. 2024-09-17T07:09:10.620 INFO:teuthology.orchestra.run.smithi087.stdout:(4/12): libgfortran-11.5.0-2.el9.x86_64.rpm 817 kB/s | 801 kB 00:00 2024-09-17T07:09:10.709 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-17T07:09:10.710 INFO:teuthology.orchestra.run.smithi139.stdout:======================================================================================= 2024-09-17T07:09:10.710 INFO:teuthology.orchestra.run.smithi139.stdout: Package Arch Version Repository Size 2024-09-17T07:09:10.711 INFO:teuthology.orchestra.run.smithi139.stdout:======================================================================================= 2024-09-17T07:09:10.711 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2024-09-17T07:09:10.711 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-1635.g4a704134.el9 ceph-noarch 7.4 M 2024-09-17T07:09:10.711 INFO:teuthology.orchestra.run.smithi139.stdout:Installing dependencies: 2024-09-17T07:09:10.711 INFO:teuthology.orchestra.run.smithi139.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-17T07:09:10.711 INFO:teuthology.orchestra.run.smithi139.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-17T07:09:10.711 INFO:teuthology.orchestra.run.smithi139.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-17T07:09:10.711 INFO:teuthology.orchestra.run.smithi139.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-17T07:09:10.711 INFO:teuthology.orchestra.run.smithi139.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-17T07:09:10.711 INFO:teuthology.orchestra.run.smithi139.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-17T07:09:10.712 INFO:teuthology.orchestra.run.smithi139.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-17T07:09:10.712 INFO:teuthology.orchestra.run.smithi139.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-17T07:09:10.712 INFO:teuthology.orchestra.run.smithi139.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-17T07:09:10.712 INFO:teuthology.orchestra.run.smithi139.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-17T07:09:10.712 INFO:teuthology.orchestra.run.smithi139.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-17T07:09:10.712 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:09:10.712 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2024-09-17T07:09:10.712 INFO:teuthology.orchestra.run.smithi139.stdout:======================================================================================= 2024-09-17T07:09:10.712 INFO:teuthology.orchestra.run.smithi139.stdout:Install 12 Packages 2024-09-17T07:09:10.712 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:09:10.713 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 38 M 2024-09-17T07:09:10.713 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 212 M 2024-09-17T07:09:10.713 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2024-09-17T07:09:10.736 INFO:teuthology.orchestra.run.smithi087.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 62 kB/s | 18 kB 00:00 2024-09-17T07:09:10.912 INFO:teuthology.orchestra.run.smithi087.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 132 kB/s | 38 kB 00:00 2024-09-17T07:09:11.200 INFO:teuthology.orchestra.run.smithi139.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 896 kB/s | 191 kB 00:00 2024-09-17T07:09:11.204 INFO:teuthology.orchestra.run.smithi087.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 839 kB/s | 245 kB 00:00 2024-09-17T07:09:11.300 INFO:teuthology.orchestra.run.smithi139.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 327 kB/s | 33 kB 00:00 2024-09-17T07:09:11.334 INFO:teuthology.orchestra.run.smithi139.stdout:(3/12): libgfortran-11.5.0-2.el9.x86_64.rpm 2.3 MB/s | 801 kB 00:00 2024-09-17T07:09:11.404 INFO:teuthology.orchestra.run.smithi087.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 2.9 MB/s | 3.0 MB 00:01 2024-09-17T07:09:11.425 INFO:teuthology.orchestra.run.smithi139.stdout:(4/12): ceph-mgr-diskprediction-local-17.2.7-16 17 MB/s | 7.4 MB 00:00 2024-09-17T07:09:11.476 INFO:teuthology.orchestra.run.smithi139.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 128 kB/s | 18 kB 00:00 2024-09-17T07:09:11.501 INFO:teuthology.orchestra.run.smithi139.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 512 kB/s | 38 kB 00:00 2024-09-17T07:09:11.529 INFO:teuthology.orchestra.run.smithi087.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.0 MB/s | 250 kB 00:00 2024-09-17T07:09:11.576 INFO:teuthology.orchestra.run.smithi139.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 3.2 MB/s | 245 kB 00:00 2024-09-17T07:09:11.746 INFO:teuthology.orchestra.run.smithi087.stdout:(10/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 4.9 MB/s | 4.9 MB 00:01 2024-09-17T07:09:11.802 INFO:teuthology.orchestra.run.smithi139.stdout:(8/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 15 MB/s | 4.9 MB 00:00 2024-09-17T07:09:11.843 INFO:teuthology.orchestra.run.smithi139.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 5.9 MB/s | 250 kB 00:00 2024-09-17T07:09:11.871 INFO:teuthology.orchestra.run.smithi087.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 7.6 MB/s | 5.1 MB 00:00 2024-09-17T07:09:11.935 INFO:teuthology.orchestra.run.smithi139.stdout:(10/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rp 4.7 MB/s | 3.0 MB 00:00 2024-09-17T07:09:12.069 INFO:teuthology.orchestra.run.smithi139.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 10 MB/s | 5.1 MB 00:00 2024-09-17T07:09:12.386 INFO:teuthology.orchestra.run.smithi139.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 30 MB/s | 16 MB 00:00 2024-09-17T07:09:12.387 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2024-09-17T07:09:12.387 INFO:teuthology.orchestra.run.smithi139.stdout:Total 23 MB/s | 38 MB 00:01 2024-09-17T07:09:12.740 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2024-09-17T07:09:12.767 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2024-09-17T07:09:12.767 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2024-09-17T07:09:12.863 INFO:teuthology.orchestra.run.smithi087.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 12 MB/s | 16 MB 00:01 2024-09-17T07:09:12.864 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2024-09-17T07:09:12.865 INFO:teuthology.orchestra.run.smithi087.stdout:Total 11 MB/s | 38 MB 00:03 2024-09-17T07:09:13.222 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction check 2024-09-17T07:09:13.249 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction check succeeded. 2024-09-17T07:09:13.249 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction test 2024-09-17T07:09:13.285 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2024-09-17T07:09:13.285 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2024-09-17T07:09:13.750 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction test succeeded. 2024-09-17T07:09:13.750 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction 2024-09-17T07:09:14.043 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2024-09-17T07:09:14.131 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-17T07:09:14.185 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-17T07:09:14.284 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-17T07:09:14.327 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-17T07:09:14.512 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-17T07:09:14.550 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-17T07:09:14.551 INFO:teuthology.orchestra.run.smithi087.stdout: Preparing : 1/1 2024-09-17T07:09:14.628 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-17T07:09:14.640 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-17T07:09:14.678 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-17T07:09:14.784 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-17T07:09:14.820 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-17T07:09:15.006 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-17T07:09:15.036 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-17T07:09:15.113 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-17T07:09:15.302 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-17T07:09:15.422 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-17T07:09:15.796 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-17T07:09:15.914 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-17T07:09:16.688 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-17T07:09:17.163 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-17T07:09:17.717 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-17T07:09:17.741 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-1635.g4a704 12/12 2024-09-17T07:09:18.195 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-17T07:09:18.229 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-1635.g4a704 12/12 2024-09-17T07:09:20.284 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-1635.g4a704 12/12 2024-09-17T07:09:20.284 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-1635.g4a704 1/12 2024-09-17T07:09:20.285 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-17T07:09:20.285 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-17T07:09:20.285 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-17T07:09:20.285 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-17T07:09:20.285 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-17T07:09:20.285 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-17T07:09:20.285 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-17T07:09:20.286 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-17T07:09:20.286 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-17T07:09:20.286 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-17T07:09:20.667 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-1635.g4a704 12/12 2024-09-17T07:09:20.667 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-1635.g4a704 1/12 2024-09-17T07:09:20.667 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-17T07:09:20.668 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-17T07:09:20.668 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-17T07:09:20.668 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-17T07:09:20.668 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-17T07:09:20.668 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-17T07:09:20.668 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-17T07:09:20.668 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-17T07:09:20.668 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-17T07:09:20.668 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-17T07:09:20.677 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-17T07:09:20.677 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:09:20.677 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2024-09-17T07:09:20.677 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-diskprediction-local-2:17.2.7-1635.g4a704134.el9.noarch 2024-09-17T07:09:20.677 INFO:teuthology.orchestra.run.smithi139.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-17T07:09:20.677 INFO:teuthology.orchestra.run.smithi139.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-17T07:09:20.677 INFO:teuthology.orchestra.run.smithi139.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-17T07:09:20.677 INFO:teuthology.orchestra.run.smithi139.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-17T07:09:20.677 INFO:teuthology.orchestra.run.smithi139.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-17T07:09:20.678 INFO:teuthology.orchestra.run.smithi139.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-17T07:09:20.678 INFO:teuthology.orchestra.run.smithi139.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-17T07:09:20.678 INFO:teuthology.orchestra.run.smithi139.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-17T07:09:20.678 INFO:teuthology.orchestra.run.smithi139.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-17T07:09:20.678 INFO:teuthology.orchestra.run.smithi139.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-17T07:09:20.678 INFO:teuthology.orchestra.run.smithi139.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-17T07:09:20.678 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:09:20.678 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-17T07:09:21.050 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install ceph-mgr-rook 2024-09-17T07:09:21.069 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-17T07:09:21.069 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:09:21.069 INFO:teuthology.orchestra.run.smithi087.stdout:Installed: 2024-09-17T07:09:21.069 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-diskprediction-local-2:17.2.7-1635.g4a704134.el9.noarch 2024-09-17T07:09:21.069 INFO:teuthology.orchestra.run.smithi087.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-17T07:09:21.069 INFO:teuthology.orchestra.run.smithi087.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-17T07:09:21.069 INFO:teuthology.orchestra.run.smithi087.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-17T07:09:21.069 INFO:teuthology.orchestra.run.smithi087.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-17T07:09:21.069 INFO:teuthology.orchestra.run.smithi087.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-17T07:09:21.069 INFO:teuthology.orchestra.run.smithi087.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-17T07:09:21.069 INFO:teuthology.orchestra.run.smithi087.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-17T07:09:21.070 INFO:teuthology.orchestra.run.smithi087.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-17T07:09:21.070 INFO:teuthology.orchestra.run.smithi087.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-17T07:09:21.070 INFO:teuthology.orchestra.run.smithi087.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-17T07:09:21.070 INFO:teuthology.orchestra.run.smithi087.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-17T07:09:21.070 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:09:21.070 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-09-17T07:09:21.433 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install ceph-mgr-rook 2024-09-17T07:09:21.656 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:01:13 ago on Tue 17 Sep 2024 07:08:08 AM UTC. 2024-09-17T07:09:21.800 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-17T07:09:21.801 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-17T07:09:21.801 INFO:teuthology.orchestra.run.smithi139.stdout: Package Arch Version Repository Size 2024-09-17T07:09:21.801 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-17T07:09:21.802 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2024-09-17T07:09:21.802 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-rook noarch 2:17.2.7-1635.g4a704134.el9 ceph-noarch 47 k 2024-09-17T07:09:21.802 INFO:teuthology.orchestra.run.smithi139.stdout:Installing dependencies: 2024-09-17T07:09:21.802 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-17T07:09:21.802 INFO:teuthology.orchestra.run.smithi139.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-17T07:09:21.802 INFO:teuthology.orchestra.run.smithi139.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-17T07:09:21.802 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-17T07:09:21.802 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-17T07:09:21.802 INFO:teuthology.orchestra.run.smithi139.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-17T07:09:21.802 INFO:teuthology.orchestra.run.smithi139.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-17T07:09:21.802 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-17T07:09:21.802 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-17T07:09:21.803 INFO:teuthology.orchestra.run.smithi139.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-17T07:09:21.803 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-17T07:09:21.803 INFO:teuthology.orchestra.run.smithi139.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-17T07:09:21.803 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:09:21.803 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2024-09-17T07:09:21.803 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-17T07:09:21.803 INFO:teuthology.orchestra.run.smithi139.stdout:Install 13 Packages 2024-09-17T07:09:21.803 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:09:21.804 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 2.2 M 2024-09-17T07:09:21.804 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 26 M 2024-09-17T07:09:21.804 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2024-09-17T07:09:22.041 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:01:15 ago on Tue 17 Sep 2024 07:08:07 AM UTC. 2024-09-17T07:09:22.176 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-09-17T07:09:22.177 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-09-17T07:09:22.177 INFO:teuthology.orchestra.run.smithi087.stdout: Package Arch Version Repository Size 2024-09-17T07:09:22.177 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-09-17T07:09:22.177 INFO:teuthology.orchestra.run.smithi087.stdout:Installing: 2024-09-17T07:09:22.177 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-rook noarch 2:17.2.7-1635.g4a704134.el9 ceph-noarch 47 k 2024-09-17T07:09:22.177 INFO:teuthology.orchestra.run.smithi087.stdout:Installing dependencies: 2024-09-17T07:09:22.177 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-17T07:09:22.177 INFO:teuthology.orchestra.run.smithi087.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-17T07:09:22.178 INFO:teuthology.orchestra.run.smithi087.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-17T07:09:22.178 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-17T07:09:22.178 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-17T07:09:22.178 INFO:teuthology.orchestra.run.smithi087.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-17T07:09:22.178 INFO:teuthology.orchestra.run.smithi087.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-17T07:09:22.178 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-17T07:09:22.178 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-17T07:09:22.178 INFO:teuthology.orchestra.run.smithi087.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-17T07:09:22.178 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-17T07:09:22.178 INFO:teuthology.orchestra.run.smithi087.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-17T07:09:22.178 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:09:22.178 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction Summary 2024-09-17T07:09:22.178 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-09-17T07:09:22.178 INFO:teuthology.orchestra.run.smithi087.stdout:Install 13 Packages 2024-09-17T07:09:22.179 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:09:22.179 INFO:teuthology.orchestra.run.smithi087.stdout:Total download size: 2.2 M 2024-09-17T07:09:22.179 INFO:teuthology.orchestra.run.smithi087.stdout:Installed size: 26 M 2024-09-17T07:09:22.179 INFO:teuthology.orchestra.run.smithi087.stdout:Downloading Packages: 2024-09-17T07:09:22.208 INFO:teuthology.orchestra.run.smithi139.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 204 kB/s | 19 kB 00:00 2024-09-17T07:09:22.233 INFO:teuthology.orchestra.run.smithi139.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 215 kB/s | 26 kB 00:00 2024-09-17T07:09:22.266 INFO:teuthology.orchestra.run.smithi139.stdout:(3/13): ceph-mgr-rook-17.2.7-1635.g4a704134.el9 311 kB/s | 47 kB 00:00 2024-09-17T07:09:22.367 INFO:teuthology.orchestra.run.smithi139.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.4 MB/s | 222 kB 00:00 2024-09-17T07:09:22.384 INFO:teuthology.orchestra.run.smithi087.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 255 kB/s | 19 kB 00:00 2024-09-17T07:09:22.392 INFO:teuthology.orchestra.run.smithi139.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 999 kB/s | 159 kB 00:00 2024-09-17T07:09:22.409 INFO:teuthology.orchestra.run.smithi087.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 255 kB/s | 26 kB 00:00 2024-09-17T07:09:22.417 INFO:teuthology.orchestra.run.smithi139.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 54 kB 00:00 2024-09-17T07:09:22.459 INFO:teuthology.orchestra.run.smithi139.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.4 MB/s | 279 kB 00:00 2024-09-17T07:09:22.467 INFO:teuthology.orchestra.run.smithi087.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.6 MB/s | 222 kB 00:00 2024-09-17T07:09:22.484 INFO:teuthology.orchestra.run.smithi139.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 349 kB/s | 32 kB 00:00 2024-09-17T07:09:22.493 INFO:teuthology.orchestra.run.smithi087.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.9 MB/s | 159 kB 00:00 2024-09-17T07:09:22.518 INFO:teuthology.orchestra.run.smithi139.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 140 kB/s | 14 kB 00:00 2024-09-17T07:09:22.519 INFO:teuthology.orchestra.run.smithi087.stdout:(5/13): ceph-mgr-rook-17.2.7-1635.g4a704134.el9 226 kB/s | 47 kB 00:00 2024-09-17T07:09:22.543 INFO:teuthology.orchestra.run.smithi087.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 54 kB 00:00 2024-09-17T07:09:22.552 INFO:teuthology.orchestra.run.smithi139.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 1.8 MB/s | 59 kB 00:00 2024-09-17T07:09:22.568 INFO:teuthology.orchestra.run.smithi087.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 2.7 MB/s | 279 kB 00:00 2024-09-17T07:09:22.577 INFO:teuthology.orchestra.run.smithi139.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 3.5 MB/s | 90 kB 00:00 2024-09-17T07:09:22.602 INFO:teuthology.orchestra.run.smithi139.stdout:(12/13): python3-google-auth-2.34.0-1.el9.noarc 1.5 MB/s | 220 kB 00:00 2024-09-17T07:09:22.619 INFO:teuthology.orchestra.run.smithi087.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 320 kB/s | 32 kB 00:00 2024-09-17T07:09:22.636 INFO:teuthology.orchestra.run.smithi139.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 7.1 MB/s | 1.0 MB 00:00 2024-09-17T07:09:22.638 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2024-09-17T07:09:22.639 INFO:teuthology.orchestra.run.smithi139.stdout:Total 2.6 MB/s | 2.2 MB 00:00 2024-09-17T07:09:22.644 INFO:teuthology.orchestra.run.smithi087.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 140 kB/s | 14 kB 00:00 2024-09-17T07:09:22.669 INFO:teuthology.orchestra.run.smithi087.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 2.4 MB/s | 59 kB 00:00 2024-09-17T07:09:22.695 INFO:teuthology.orchestra.run.smithi087.stdout:(11/13): python3-google-auth-2.34.0-1.el9.noarc 1.9 MB/s | 220 kB 00:00 2024-09-17T07:09:22.702 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2024-09-17T07:09:22.717 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2024-09-17T07:09:22.717 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2024-09-17T07:09:22.720 INFO:teuthology.orchestra.run.smithi087.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.7 MB/s | 90 kB 00:00 2024-09-17T07:09:22.753 INFO:teuthology.orchestra.run.smithi087.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 7.7 MB/s | 1.0 MB 00:00 2024-09-17T07:09:22.756 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2024-09-17T07:09:22.756 INFO:teuthology.orchestra.run.smithi087.stdout:Total 3.8 MB/s | 2.2 MB 00:00 2024-09-17T07:09:22.808 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2024-09-17T07:09:22.810 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2024-09-17T07:09:22.815 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction check 2024-09-17T07:09:22.830 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction check succeeded. 2024-09-17T07:09:22.830 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction test 2024-09-17T07:09:22.920 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction test succeeded. 2024-09-17T07:09:22.921 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction 2024-09-17T07:09:23.320 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2024-09-17T07:09:23.429 INFO:teuthology.orchestra.run.smithi087.stdout: Preparing : 1/1 2024-09-17T07:09:23.483 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-17T07:09:23.545 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-17T07:09:23.598 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-17T07:09:23.600 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-17T07:09:23.638 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-17T07:09:23.662 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-17T07:09:23.679 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-17T07:09:23.717 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-17T07:09:23.763 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-17T07:09:23.789 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-17T07:09:23.804 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-17T07:09:23.899 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-17T07:09:23.907 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-17T07:09:23.947 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-17T07:09:24.006 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-17T07:09:24.056 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-17T07:09:24.659 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-17T07:09:24.719 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-17T07:09:24.753 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-17T07:09:24.766 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-17T07:09:24.799 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-17T07:09:24.820 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-17T07:09:24.823 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-rook-2:17.2.7-1635.g4a704134.el9.noarch 13/13 2024-09-17T07:09:24.853 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-17T07:09:24.899 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-17T07:09:24.932 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-rook-2:17.2.7-1635.g4a704134.el9.noarch 13/13 2024-09-17T07:09:25.637 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-1635.g4a704134.el9.noarch 13/13 2024-09-17T07:09:25.637 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-rook-2:17.2.7-1635.g4a704134.el9.noarch 1/13 2024-09-17T07:09:25.638 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-17T07:09:25.638 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-17T07:09:25.638 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-17T07:09:25.638 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-17T07:09:25.638 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-17T07:09:25.638 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-17T07:09:25.638 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-17T07:09:25.638 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-17T07:09:25.638 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-17T07:09:25.638 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-17T07:09:25.638 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-17T07:09:25.762 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-1635.g4a704134.el9.noarch 13/13 2024-09-17T07:09:25.762 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-rook-2:17.2.7-1635.g4a704134.el9.noarch 1/13 2024-09-17T07:09:25.762 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-17T07:09:25.762 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-17T07:09:25.762 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-17T07:09:25.762 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-17T07:09:25.763 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-17T07:09:25.763 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-17T07:09:25.763 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-17T07:09:25.763 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-17T07:09:25.763 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-17T07:09:25.763 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-17T07:09:25.763 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-17T07:09:26.003 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-17T07:09:26.003 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:09:26.003 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2024-09-17T07:09:26.003 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-rook-2:17.2.7-1635.g4a704134.el9.noarch 2024-09-17T07:09:26.003 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-17T07:09:26.003 INFO:teuthology.orchestra.run.smithi139.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-17T07:09:26.003 INFO:teuthology.orchestra.run.smithi139.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-17T07:09:26.003 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-17T07:09:26.004 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-17T07:09:26.004 INFO:teuthology.orchestra.run.smithi139.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-17T07:09:26.004 INFO:teuthology.orchestra.run.smithi139.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-17T07:09:26.004 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-17T07:09:26.004 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-17T07:09:26.004 INFO:teuthology.orchestra.run.smithi139.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-17T07:09:26.004 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-17T07:09:26.004 INFO:teuthology.orchestra.run.smithi139.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-17T07:09:26.004 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:09:26.004 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-17T07:09:26.095 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-17T07:09:26.095 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:09:26.095 INFO:teuthology.orchestra.run.smithi087.stdout:Installed: 2024-09-17T07:09:26.095 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-rook-2:17.2.7-1635.g4a704134.el9.noarch 2024-09-17T07:09:26.095 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-17T07:09:26.095 INFO:teuthology.orchestra.run.smithi087.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-17T07:09:26.095 INFO:teuthology.orchestra.run.smithi087.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-17T07:09:26.096 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-17T07:09:26.096 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-17T07:09:26.096 INFO:teuthology.orchestra.run.smithi087.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-17T07:09:26.096 INFO:teuthology.orchestra.run.smithi087.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-17T07:09:26.096 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-17T07:09:26.096 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-17T07:09:26.096 INFO:teuthology.orchestra.run.smithi087.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-17T07:09:26.096 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-17T07:09:26.096 INFO:teuthology.orchestra.run.smithi087.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-17T07:09:26.096 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:09:26.096 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-09-17T07:09:26.274 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install ceph-mgr-cephadm 2024-09-17T07:09:26.341 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install ceph-mgr-cephadm 2024-09-17T07:09:26.857 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:01:18 ago on Tue 17 Sep 2024 07:08:08 AM UTC. 2024-09-17T07:09:26.920 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:01:19 ago on Tue 17 Sep 2024 07:08:07 AM UTC. 2024-09-17T07:09:26.990 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-17T07:09:26.990 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-17T07:09:26.991 INFO:teuthology.orchestra.run.smithi139.stdout: Package Arch Version Repository Size 2024-09-17T07:09:26.991 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-17T07:09:26.991 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2024-09-17T07:09:26.991 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-cephadm noarch 2:17.2.7-1635.g4a704134.el9 ceph-noarch 124 k 2024-09-17T07:09:26.991 INFO:teuthology.orchestra.run.smithi139.stdout:Installing dependencies: 2024-09-17T07:09:26.991 INFO:teuthology.orchestra.run.smithi139.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-17T07:09:26.991 INFO:teuthology.orchestra.run.smithi139.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-17T07:09:26.991 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-17T07:09:26.991 INFO:teuthology.orchestra.run.smithi139.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-17T07:09:26.991 INFO:teuthology.orchestra.run.smithi139.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-17T07:09:26.991 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:09:26.991 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2024-09-17T07:09:26.991 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-17T07:09:26.992 INFO:teuthology.orchestra.run.smithi139.stdout:Install 6 Packages 2024-09-17T07:09:26.992 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:09:26.992 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 7.0 M 2024-09-17T07:09:26.992 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 33 M 2024-09-17T07:09:26.992 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2024-09-17T07:09:27.053 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-09-17T07:09:27.054 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-09-17T07:09:27.054 INFO:teuthology.orchestra.run.smithi087.stdout: Package Arch Version Repository Size 2024-09-17T07:09:27.054 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-09-17T07:09:27.054 INFO:teuthology.orchestra.run.smithi087.stdout:Installing: 2024-09-17T07:09:27.054 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-cephadm noarch 2:17.2.7-1635.g4a704134.el9 ceph-noarch 124 k 2024-09-17T07:09:27.054 INFO:teuthology.orchestra.run.smithi087.stdout:Installing dependencies: 2024-09-17T07:09:27.054 INFO:teuthology.orchestra.run.smithi087.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-17T07:09:27.054 INFO:teuthology.orchestra.run.smithi087.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-17T07:09:27.054 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-17T07:09:27.054 INFO:teuthology.orchestra.run.smithi087.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-17T07:09:27.055 INFO:teuthology.orchestra.run.smithi087.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-17T07:09:27.055 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:09:27.055 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction Summary 2024-09-17T07:09:27.055 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-09-17T07:09:27.055 INFO:teuthology.orchestra.run.smithi087.stdout:Install 6 Packages 2024-09-17T07:09:27.055 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:09:27.055 INFO:teuthology.orchestra.run.smithi087.stdout:Total download size: 7.0 M 2024-09-17T07:09:27.055 INFO:teuthology.orchestra.run.smithi087.stdout:Installed size: 33 M 2024-09-17T07:09:27.056 INFO:teuthology.orchestra.run.smithi087.stdout:Downloading Packages: 2024-09-17T07:09:27.704 INFO:teuthology.orchestra.run.smithi087.stdout:(1/6): ceph-mgr-cephadm-17.2.7-1635.g4a704134.e 564 kB/s | 124 kB 00:00 2024-09-17T07:09:27.788 INFO:teuthology.orchestra.run.smithi087.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 7.8 MB/s | 548 kB 00:00 2024-09-17T07:09:27.795 INFO:teuthology.orchestra.run.smithi139.stdout:(1/6): ceph-mgr-cephadm-17.2.7-1635.g4a704134.e 587 kB/s | 124 kB 00:00 2024-09-17T07:09:27.837 INFO:teuthology.orchestra.run.smithi087.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 1.1 MB/s | 58 kB 00:00 2024-09-17T07:09:27.857 INFO:teuthology.orchestra.run.smithi139.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 9.2 MB/s | 548 kB 00:00 2024-09-17T07:09:27.863 INFO:teuthology.orchestra.run.smithi087.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 3.0 MB/s | 74 kB 00:00 2024-09-17T07:09:27.879 INFO:teuthology.orchestra.run.smithi139.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 2.3 MB/s | 58 kB 00:00 2024-09-17T07:09:27.904 INFO:teuthology.orchestra.run.smithi139.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 3.0 MB/s | 74 kB 00:00 2024-09-17T07:09:28.338 INFO:teuthology.orchestra.run.smithi087.stdout:(5/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 291 kB/s | 248 kB 00:00 2024-09-17T07:09:28.413 INFO:teuthology.orchestra.run.smithi139.stdout:(5/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 300 kB/s | 248 kB 00:00 2024-09-17T07:09:28.630 INFO:teuthology.orchestra.run.smithi087.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 5.2 MB/s | 6.0 MB 00:01 2024-09-17T07:09:28.633 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2024-09-17T07:09:28.633 INFO:teuthology.orchestra.run.smithi087.stdout:Total 4.4 MB/s | 7.0 MB 00:01 2024-09-17T07:09:28.707 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction check 2024-09-17T07:09:28.719 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction check succeeded. 2024-09-17T07:09:28.719 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction test 2024-09-17T07:09:28.738 INFO:teuthology.orchestra.run.smithi139.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 5.2 MB/s | 6.0 MB 00:01 2024-09-17T07:09:28.740 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2024-09-17T07:09:28.741 INFO:teuthology.orchestra.run.smithi139.stdout:Total 4.0 MB/s | 7.0 MB 00:01 2024-09-17T07:09:28.814 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2024-09-17T07:09:28.819 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction test succeeded. 2024-09-17T07:09:28.820 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction 2024-09-17T07:09:28.826 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2024-09-17T07:09:28.826 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2024-09-17T07:09:28.926 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2024-09-17T07:09:28.926 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2024-09-17T07:09:29.123 INFO:teuthology.orchestra.run.smithi087.stdout: Preparing : 1/1 2024-09-17T07:09:29.238 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2024-09-17T07:09:29.296 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-17T07:09:29.357 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-17T07:09:29.420 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-17T07:09:29.473 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-17T07:09:29.886 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-17T07:09:29.977 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-17T07:09:30.004 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-17T07:09:30.032 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-17T07:09:30.060 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-1635.g4a704134.el9.noarch 6/6 2024-09-17T07:09:30.084 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-17T07:09:30.140 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-17T07:09:30.177 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-1635.g4a704134.el9.noarch 6/6 2024-09-17T07:09:30.860 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-1635.g4a704134.el9.noarch 6/6 2024-09-17T07:09:30.860 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-1635.g4a704134.el9.noarch 1/6 2024-09-17T07:09:30.860 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-17T07:09:30.860 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-17T07:09:30.860 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-17T07:09:30.860 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-17T07:09:30.955 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-1635.g4a704134.el9.noarch 6/6 2024-09-17T07:09:30.955 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-1635.g4a704134.el9.noarch 1/6 2024-09-17T07:09:30.955 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-17T07:09:30.955 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-17T07:09:30.955 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-17T07:09:30.955 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-17T07:09:31.126 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-17T07:09:31.126 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:09:31.126 INFO:teuthology.orchestra.run.smithi087.stdout:Installed: 2024-09-17T07:09:31.127 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-cephadm-2:17.2.7-1635.g4a704134.el9.noarch 2024-09-17T07:09:31.127 INFO:teuthology.orchestra.run.smithi087.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-17T07:09:31.127 INFO:teuthology.orchestra.run.smithi087.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-17T07:09:31.127 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-17T07:09:31.127 INFO:teuthology.orchestra.run.smithi087.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-17T07:09:31.127 INFO:teuthology.orchestra.run.smithi087.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-17T07:09:31.127 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:09:31.127 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-09-17T07:09:31.226 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-17T07:09:31.226 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:09:31.226 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2024-09-17T07:09:31.226 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-cephadm-2:17.2.7-1635.g4a704134.el9.noarch 2024-09-17T07:09:31.226 INFO:teuthology.orchestra.run.smithi139.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-17T07:09:31.226 INFO:teuthology.orchestra.run.smithi139.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-17T07:09:31.226 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-17T07:09:31.227 INFO:teuthology.orchestra.run.smithi139.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-17T07:09:31.227 INFO:teuthology.orchestra.run.smithi139.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-17T07:09:31.227 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:09:31.227 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-17T07:09:31.339 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install ceph-fuse 2024-09-17T07:09:31.476 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install ceph-fuse 2024-09-17T07:09:31.915 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:01:24 ago on Tue 17 Sep 2024 07:08:07 AM UTC. 2024-09-17T07:09:32.046 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-09-17T07:09:32.047 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-09-17T07:09:32.047 INFO:teuthology.orchestra.run.smithi087.stdout: Package Arch Version Repository Size 2024-09-17T07:09:32.047 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-09-17T07:09:32.047 INFO:teuthology.orchestra.run.smithi087.stdout:Installing: 2024-09-17T07:09:32.047 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-fuse x86_64 2:17.2.7-1635.g4a704134.el9 ceph 813 k 2024-09-17T07:09:32.047 INFO:teuthology.orchestra.run.smithi087.stdout:Installing dependencies: 2024-09-17T07:09:32.047 INFO:teuthology.orchestra.run.smithi087.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-17T07:09:32.047 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:09:32.047 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction Summary 2024-09-17T07:09:32.048 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-09-17T07:09:32.048 INFO:teuthology.orchestra.run.smithi087.stdout:Install 2 Packages 2024-09-17T07:09:32.048 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:09:32.048 INFO:teuthology.orchestra.run.smithi087.stdout:Total download size: 893 k 2024-09-17T07:09:32.048 INFO:teuthology.orchestra.run.smithi087.stdout:Installed size: 2.6 M 2024-09-17T07:09:32.048 INFO:teuthology.orchestra.run.smithi087.stdout:Downloading Packages: 2024-09-17T07:09:32.064 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:01:24 ago on Tue 17 Sep 2024 07:08:08 AM UTC. 2024-09-17T07:09:32.198 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-17T07:09:32.199 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-17T07:09:32.199 INFO:teuthology.orchestra.run.smithi139.stdout: Package Arch Version Repository Size 2024-09-17T07:09:32.199 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-17T07:09:32.199 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2024-09-17T07:09:32.199 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-fuse x86_64 2:17.2.7-1635.g4a704134.el9 ceph 813 k 2024-09-17T07:09:32.200 INFO:teuthology.orchestra.run.smithi139.stdout:Installing dependencies: 2024-09-17T07:09:32.200 INFO:teuthology.orchestra.run.smithi139.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-17T07:09:32.200 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:09:32.200 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2024-09-17T07:09:32.200 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-17T07:09:32.200 INFO:teuthology.orchestra.run.smithi139.stdout:Install 2 Packages 2024-09-17T07:09:32.200 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:09:32.200 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 893 k 2024-09-17T07:09:32.200 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 2.6 M 2024-09-17T07:09:32.200 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2024-09-17T07:09:32.373 INFO:teuthology.orchestra.run.smithi087.stdout:(1/2): ceph-fuse-17.2.7-1635.g4a704134.el9.x86_ 2.6 MB/s | 813 kB 00:00 2024-09-17T07:09:32.548 INFO:teuthology.orchestra.run.smithi087.stdout:(2/2): fuse-2.9.9-16.el9.x86_64.rpm 167 kB/s | 80 kB 00:00 2024-09-17T07:09:32.548 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2024-09-17T07:09:32.549 INFO:teuthology.orchestra.run.smithi087.stdout:Total 1.7 MB/s | 893 kB 00:00 2024-09-17T07:09:32.561 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction check 2024-09-17T07:09:32.583 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction check succeeded. 2024-09-17T07:09:32.584 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction test 2024-09-17T07:09:32.631 INFO:teuthology.orchestra.run.smithi139.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 458 kB/s | 80 kB 00:00 2024-09-17T07:09:32.665 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction test succeeded. 2024-09-17T07:09:32.665 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction 2024-09-17T07:09:32.723 INFO:teuthology.orchestra.run.smithi139.stdout:(2/2): ceph-fuse-17.2.7-1635.g4a704134.el9.x86_ 3.0 MB/s | 813 kB 00:00 2024-09-17T07:09:32.724 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2024-09-17T07:09:32.724 INFO:teuthology.orchestra.run.smithi139.stdout:Total 1.7 MB/s | 893 kB 00:00 2024-09-17T07:09:32.736 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2024-09-17T07:09:32.758 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2024-09-17T07:09:32.758 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2024-09-17T07:09:32.837 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2024-09-17T07:09:32.838 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2024-09-17T07:09:32.846 INFO:teuthology.orchestra.run.smithi087.stdout: Preparing : 1/1 2024-09-17T07:09:32.984 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-17T07:09:33.029 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2024-09-17T07:09:33.054 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-fuse-2:17.2.7-1635.g4a704134.el9.x86_64 2/2 2024-09-17T07:09:33.177 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-17T07:09:33.237 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-fuse-2:17.2.7-1635.g4a704134.el9.x86_64 2/2 2024-09-17T07:09:33.755 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-fuse-2:17.2.7-1635.g4a704134.el9.x86_64 2/2 2024-09-17T07:09:33.755 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-fuse-2:17.2.7-1635.g4a704134.el9.x86_64 1/2 2024-09-17T07:09:33.961 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-fuse-2:17.2.7-1635.g4a704134.el9.x86_64 2/2 2024-09-17T07:09:33.961 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-fuse-2:17.2.7-1635.g4a704134.el9.x86_64 1/2 2024-09-17T07:09:34.010 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-17T07:09:34.011 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:09:34.011 INFO:teuthology.orchestra.run.smithi087.stdout:Installed: 2024-09-17T07:09:34.011 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-fuse-2:17.2.7-1635.g4a704134.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-17T07:09:34.011 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:09:34.011 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-09-17T07:09:34.244 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-17T07:09:34.245 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:09:34.245 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2024-09-17T07:09:34.245 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-fuse-2:17.2.7-1635.g4a704134.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-17T07:09:34.245 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:09:34.245 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-17T07:09:34.258 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install librados-devel 2024-09-17T07:09:34.537 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install librados-devel 2024-09-17T07:09:34.857 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:01:27 ago on Tue 17 Sep 2024 07:08:07 AM UTC. 2024-09-17T07:09:34.992 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-09-17T07:09:34.993 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-09-17T07:09:34.993 INFO:teuthology.orchestra.run.smithi087.stdout: Package Arch Version Repo Size 2024-09-17T07:09:34.993 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-09-17T07:09:34.993 INFO:teuthology.orchestra.run.smithi087.stdout:Installing: 2024-09-17T07:09:34.993 INFO:teuthology.orchestra.run.smithi087.stdout: librados-devel x86_64 2:17.2.7-1635.g4a704134.el9 ceph 126 k 2024-09-17T07:09:34.993 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:09:34.993 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction Summary 2024-09-17T07:09:34.993 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-09-17T07:09:34.994 INFO:teuthology.orchestra.run.smithi087.stdout:Install 1 Package 2024-09-17T07:09:34.994 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:09:34.994 INFO:teuthology.orchestra.run.smithi087.stdout:Total download size: 126 k 2024-09-17T07:09:34.994 INFO:teuthology.orchestra.run.smithi087.stdout:Installed size: 448 k 2024-09-17T07:09:34.994 INFO:teuthology.orchestra.run.smithi087.stdout:Downloading Packages: 2024-09-17T07:09:35.134 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:01:27 ago on Tue 17 Sep 2024 07:08:08 AM UTC. 2024-09-17T07:09:35.252 INFO:teuthology.orchestra.run.smithi087.stdout:librados-devel-17.2.7-1635.g4a704134.el9.x86_64 490 kB/s | 126 kB 00:00 2024-09-17T07:09:35.252 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2024-09-17T07:09:35.253 INFO:teuthology.orchestra.run.smithi087.stdout:Total 487 kB/s | 126 kB 00:00 2024-09-17T07:09:35.253 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction check 2024-09-17T07:09:35.258 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction check succeeded. 2024-09-17T07:09:35.258 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction test 2024-09-17T07:09:35.269 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-17T07:09:35.270 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-17T07:09:35.270 INFO:teuthology.orchestra.run.smithi139.stdout: Package Arch Version Repo Size 2024-09-17T07:09:35.270 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-17T07:09:35.270 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2024-09-17T07:09:35.270 INFO:teuthology.orchestra.run.smithi139.stdout: librados-devel x86_64 2:17.2.7-1635.g4a704134.el9 ceph 126 k 2024-09-17T07:09:35.270 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:09:35.270 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2024-09-17T07:09:35.270 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-17T07:09:35.271 INFO:teuthology.orchestra.run.smithi139.stdout:Install 1 Package 2024-09-17T07:09:35.271 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:09:35.271 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 126 k 2024-09-17T07:09:35.271 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 448 k 2024-09-17T07:09:35.271 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2024-09-17T07:09:35.322 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction test succeeded. 2024-09-17T07:09:35.322 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction 2024-09-17T07:09:35.477 INFO:teuthology.orchestra.run.smithi139.stdout:librados-devel-17.2.7-1635.g4a704134.el9.x86_64 612 kB/s | 126 kB 00:00 2024-09-17T07:09:35.478 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2024-09-17T07:09:35.478 INFO:teuthology.orchestra.run.smithi139.stdout:Total 607 kB/s | 126 kB 00:00 2024-09-17T07:09:35.478 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2024-09-17T07:09:35.483 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2024-09-17T07:09:35.483 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2024-09-17T07:09:35.488 INFO:teuthology.orchestra.run.smithi087.stdout: Preparing : 1/1 2024-09-17T07:09:35.546 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2024-09-17T07:09:35.547 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2024-09-17T07:09:35.591 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : librados-devel-2:17.2.7-1635.g4a704134.el9.x86_64 1/1 2024-09-17T07:09:35.699 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2024-09-17T07:09:35.807 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : librados-devel-2:17.2.7-1635.g4a704134.el9.x86_64 1/1 2024-09-17T07:09:36.015 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librados-devel-2:17.2.7-1635.g4a704134.el9.x86_64 1/1 2024-09-17T07:09:36.202 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: librados-devel-2:17.2.7-1635.g4a704134.el9.x86_64 1/1 2024-09-17T07:09:36.260 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librados-devel-2:17.2.7-1635.g4a704134.el9.x86_64 1/1 2024-09-17T07:09:36.260 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:09:36.260 INFO:teuthology.orchestra.run.smithi087.stdout:Installed: 2024-09-17T07:09:36.260 INFO:teuthology.orchestra.run.smithi087.stdout: librados-devel-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T07:09:36.260 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:09:36.261 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-09-17T07:09:36.459 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librados-devel-2:17.2.7-1635.g4a704134.el9.x86_64 1/1 2024-09-17T07:09:36.459 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:09:36.460 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2024-09-17T07:09:36.460 INFO:teuthology.orchestra.run.smithi139.stdout: librados-devel-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T07:09:36.460 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:09:36.460 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-17T07:09:36.494 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install libcephfs2 2024-09-17T07:09:36.721 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install libcephfs2 2024-09-17T07:09:37.078 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:01:30 ago on Tue 17 Sep 2024 07:08:07 AM UTC. 2024-09-17T07:09:37.167 INFO:teuthology.orchestra.run.smithi087.stdout:Package libcephfs2-2:17.2.7-1635.g4a704134.el9.x86_64 is already installed. 2024-09-17T07:09:37.212 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-09-17T07:09:37.213 INFO:teuthology.orchestra.run.smithi087.stdout:Nothing to do. 2024-09-17T07:09:37.214 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-09-17T07:09:37.276 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install libcephfs-devel 2024-09-17T07:09:37.318 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:01:29 ago on Tue 17 Sep 2024 07:08:08 AM UTC. 2024-09-17T07:09:37.413 INFO:teuthology.orchestra.run.smithi139.stdout:Package libcephfs2-2:17.2.7-1635.g4a704134.el9.x86_64 is already installed. 2024-09-17T07:09:37.457 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-17T07:09:37.458 INFO:teuthology.orchestra.run.smithi139.stdout:Nothing to do. 2024-09-17T07:09:37.458 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-17T07:09:37.530 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install libcephfs-devel 2024-09-17T07:09:37.857 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:01:30 ago on Tue 17 Sep 2024 07:08:07 AM UTC. 2024-09-17T07:09:37.990 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-09-17T07:09:37.991 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-09-17T07:09:37.991 INFO:teuthology.orchestra.run.smithi087.stdout: Package Arch Version Repo Size 2024-09-17T07:09:37.991 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-09-17T07:09:37.991 INFO:teuthology.orchestra.run.smithi087.stdout:Installing: 2024-09-17T07:09:37.991 INFO:teuthology.orchestra.run.smithi087.stdout: libcephfs-devel x86_64 2:17.2.7-1635.g4a704134.el9 ceph 25 k 2024-09-17T07:09:37.991 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:09:37.991 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction Summary 2024-09-17T07:09:37.991 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-09-17T07:09:37.991 INFO:teuthology.orchestra.run.smithi087.stdout:Install 1 Package 2024-09-17T07:09:37.991 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:09:37.992 INFO:teuthology.orchestra.run.smithi087.stdout:Total download size: 25 k 2024-09-17T07:09:37.992 INFO:teuthology.orchestra.run.smithi087.stdout:Installed size: 110 k 2024-09-17T07:09:37.992 INFO:teuthology.orchestra.run.smithi087.stdout:Downloading Packages: 2024-09-17T07:09:38.109 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:01:30 ago on Tue 17 Sep 2024 07:08:08 AM UTC. 2024-09-17T07:09:38.146 INFO:teuthology.orchestra.run.smithi087.stdout:libcephfs-devel-17.2.7-1635.g4a704134.el9.x86_6 161 kB/s | 25 kB 00:00 2024-09-17T07:09:38.147 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2024-09-17T07:09:38.147 INFO:teuthology.orchestra.run.smithi087.stdout:Total 160 kB/s | 25 kB 00:00 2024-09-17T07:09:38.147 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction check 2024-09-17T07:09:38.150 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction check succeeded. 2024-09-17T07:09:38.151 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction test 2024-09-17T07:09:38.152 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction test succeeded. 2024-09-17T07:09:38.152 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction 2024-09-17T07:09:38.234 INFO:teuthology.orchestra.run.smithi087.stdout: Preparing : 1/1 2024-09-17T07:09:38.240 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-17T07:09:38.241 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-17T07:09:38.241 INFO:teuthology.orchestra.run.smithi139.stdout: Package Arch Version Repo Size 2024-09-17T07:09:38.241 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-17T07:09:38.241 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2024-09-17T07:09:38.241 INFO:teuthology.orchestra.run.smithi139.stdout: libcephfs-devel x86_64 2:17.2.7-1635.g4a704134.el9 ceph 25 k 2024-09-17T07:09:38.242 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:09:38.242 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2024-09-17T07:09:38.242 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-17T07:09:38.242 INFO:teuthology.orchestra.run.smithi139.stdout:Install 1 Package 2024-09-17T07:09:38.242 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:09:38.242 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 25 k 2024-09-17T07:09:38.243 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 110 k 2024-09-17T07:09:38.243 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2024-09-17T07:09:38.334 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libcephfs-devel-2:17.2.7-1635.g4a704134.el9.x86_64 1/1 2024-09-17T07:09:38.388 INFO:teuthology.orchestra.run.smithi139.stdout:libcephfs-devel-17.2.7-1635.g4a704134.el9.x86_6 171 kB/s | 25 kB 00:00 2024-09-17T07:09:38.389 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2024-09-17T07:09:38.389 INFO:teuthology.orchestra.run.smithi139.stdout:Total 169 kB/s | 25 kB 00:00 2024-09-17T07:09:38.389 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2024-09-17T07:09:38.393 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2024-09-17T07:09:38.393 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2024-09-17T07:09:38.394 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2024-09-17T07:09:38.395 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2024-09-17T07:09:38.482 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2024-09-17T07:09:38.593 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libcephfs-devel-2:17.2.7-1635.g4a704134.el9.x86_64 1/1 2024-09-17T07:09:38.728 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-1635.g4a704134.el9.x86_64 1/1 2024-09-17T07:09:38.960 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-1635.g4a704134.el9.x86_64 1/1 2024-09-17T07:09:38.967 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libcephfs-devel-2:17.2.7-1635.g4a704134.el9.x86_64 1/1 2024-09-17T07:09:38.967 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:09:38.968 INFO:teuthology.orchestra.run.smithi087.stdout:Installed: 2024-09-17T07:09:38.968 INFO:teuthology.orchestra.run.smithi087.stdout: libcephfs-devel-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T07:09:38.968 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:09:38.968 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-09-17T07:09:39.134 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install librados2 2024-09-17T07:09:39.191 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libcephfs-devel-2:17.2.7-1635.g4a704134.el9.x86_64 1/1 2024-09-17T07:09:39.191 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:09:39.191 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2024-09-17T07:09:39.192 INFO:teuthology.orchestra.run.smithi139.stdout: libcephfs-devel-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T07:09:39.192 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:09:39.192 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-17T07:09:39.378 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install librados2 2024-09-17T07:09:39.713 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:01:32 ago on Tue 17 Sep 2024 07:08:07 AM UTC. 2024-09-17T07:09:39.802 INFO:teuthology.orchestra.run.smithi087.stdout:Package librados2-2:17.2.7-1635.g4a704134.el9.x86_64 is already installed. 2024-09-17T07:09:39.844 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-09-17T07:09:39.845 INFO:teuthology.orchestra.run.smithi087.stdout:Nothing to do. 2024-09-17T07:09:39.845 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-09-17T07:09:39.916 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install librbd1 2024-09-17T07:09:39.955 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:01:31 ago on Tue 17 Sep 2024 07:08:08 AM UTC. 2024-09-17T07:09:40.044 INFO:teuthology.orchestra.run.smithi139.stdout:Package librados2-2:17.2.7-1635.g4a704134.el9.x86_64 is already installed. 2024-09-17T07:09:40.086 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-17T07:09:40.087 INFO:teuthology.orchestra.run.smithi139.stdout:Nothing to do. 2024-09-17T07:09:40.087 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-17T07:09:40.156 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install librbd1 2024-09-17T07:09:40.497 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:01:33 ago on Tue 17 Sep 2024 07:08:07 AM UTC. 2024-09-17T07:09:40.587 INFO:teuthology.orchestra.run.smithi087.stdout:Package librbd1-2:17.2.7-1635.g4a704134.el9.x86_64 is already installed. 2024-09-17T07:09:40.629 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-09-17T07:09:40.630 INFO:teuthology.orchestra.run.smithi087.stdout:Nothing to do. 2024-09-17T07:09:40.630 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-09-17T07:09:40.693 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install python3-rados 2024-09-17T07:09:40.738 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:01:32 ago on Tue 17 Sep 2024 07:08:08 AM UTC. 2024-09-17T07:09:40.829 INFO:teuthology.orchestra.run.smithi139.stdout:Package librbd1-2:17.2.7-1635.g4a704134.el9.x86_64 is already installed. 2024-09-17T07:09:40.873 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-17T07:09:40.874 INFO:teuthology.orchestra.run.smithi139.stdout:Nothing to do. 2024-09-17T07:09:40.874 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-17T07:09:40.942 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install python3-rados 2024-09-17T07:09:41.269 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:01:34 ago on Tue 17 Sep 2024 07:08:07 AM UTC. 2024-09-17T07:09:41.358 INFO:teuthology.orchestra.run.smithi087.stdout:Package python3-rados-2:17.2.7-1635.g4a704134.el9.x86_64 is already installed. 2024-09-17T07:09:41.401 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-09-17T07:09:41.402 INFO:teuthology.orchestra.run.smithi087.stdout:Nothing to do. 2024-09-17T07:09:41.402 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-09-17T07:09:41.468 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install python3-rgw 2024-09-17T07:09:41.522 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:01:33 ago on Tue 17 Sep 2024 07:08:08 AM UTC. 2024-09-17T07:09:41.612 INFO:teuthology.orchestra.run.smithi139.stdout:Package python3-rados-2:17.2.7-1635.g4a704134.el9.x86_64 is already installed. 2024-09-17T07:09:41.655 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-17T07:09:41.656 INFO:teuthology.orchestra.run.smithi139.stdout:Nothing to do. 2024-09-17T07:09:41.656 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-17T07:09:41.725 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install python3-rgw 2024-09-17T07:09:42.045 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:01:35 ago on Tue 17 Sep 2024 07:08:07 AM UTC. 2024-09-17T07:09:42.134 INFO:teuthology.orchestra.run.smithi087.stdout:Package python3-rgw-2:17.2.7-1635.g4a704134.el9.x86_64 is already installed. 2024-09-17T07:09:42.178 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-09-17T07:09:42.179 INFO:teuthology.orchestra.run.smithi087.stdout:Nothing to do. 2024-09-17T07:09:42.179 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-09-17T07:09:42.255 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install python3-cephfs 2024-09-17T07:09:42.304 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:01:34 ago on Tue 17 Sep 2024 07:08:08 AM UTC. 2024-09-17T07:09:42.393 INFO:teuthology.orchestra.run.smithi139.stdout:Package python3-rgw-2:17.2.7-1635.g4a704134.el9.x86_64 is already installed. 2024-09-17T07:09:42.437 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-17T07:09:42.437 INFO:teuthology.orchestra.run.smithi139.stdout:Nothing to do. 2024-09-17T07:09:42.438 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-17T07:09:42.506 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install python3-cephfs 2024-09-17T07:09:42.832 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:01:35 ago on Tue 17 Sep 2024 07:08:07 AM UTC. 2024-09-17T07:09:42.921 INFO:teuthology.orchestra.run.smithi087.stdout:Package python3-cephfs-2:17.2.7-1635.g4a704134.el9.x86_64 is already installed. 2024-09-17T07:09:42.964 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-09-17T07:09:42.965 INFO:teuthology.orchestra.run.smithi087.stdout:Nothing to do. 2024-09-17T07:09:42.965 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-09-17T07:09:43.029 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install python3-rbd 2024-09-17T07:09:43.084 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:01:35 ago on Tue 17 Sep 2024 07:08:08 AM UTC. 2024-09-17T07:09:43.174 INFO:teuthology.orchestra.run.smithi139.stdout:Package python3-cephfs-2:17.2.7-1635.g4a704134.el9.x86_64 is already installed. 2024-09-17T07:09:43.217 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-17T07:09:43.220 INFO:teuthology.orchestra.run.smithi139.stdout:Nothing to do. 2024-09-17T07:09:43.220 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-17T07:09:43.291 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install python3-rbd 2024-09-17T07:09:43.609 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:01:36 ago on Tue 17 Sep 2024 07:08:07 AM UTC. 2024-09-17T07:09:43.699 INFO:teuthology.orchestra.run.smithi087.stdout:Package python3-rbd-2:17.2.7-1635.g4a704134.el9.x86_64 is already installed. 2024-09-17T07:09:43.741 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-09-17T07:09:43.742 INFO:teuthology.orchestra.run.smithi087.stdout:Nothing to do. 2024-09-17T07:09:43.742 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-09-17T07:09:43.811 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install rbd-fuse 2024-09-17T07:09:43.868 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:01:35 ago on Tue 17 Sep 2024 07:08:08 AM UTC. 2024-09-17T07:09:43.958 INFO:teuthology.orchestra.run.smithi139.stdout:Package python3-rbd-2:17.2.7-1635.g4a704134.el9.x86_64 is already installed. 2024-09-17T07:09:44.000 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-17T07:09:44.001 INFO:teuthology.orchestra.run.smithi139.stdout:Nothing to do. 2024-09-17T07:09:44.001 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-17T07:09:44.077 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install rbd-fuse 2024-09-17T07:09:44.389 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:01:37 ago on Tue 17 Sep 2024 07:08:07 AM UTC. 2024-09-17T07:09:44.521 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-09-17T07:09:44.521 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-09-17T07:09:44.522 INFO:teuthology.orchestra.run.smithi087.stdout: Package Architecture Version Repository Size 2024-09-17T07:09:44.522 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-09-17T07:09:44.522 INFO:teuthology.orchestra.run.smithi087.stdout:Installing: 2024-09-17T07:09:44.522 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-fuse x86_64 2:17.2.7-1635.g4a704134.el9 ceph 82 k 2024-09-17T07:09:44.522 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:09:44.522 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction Summary 2024-09-17T07:09:44.522 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-09-17T07:09:44.522 INFO:teuthology.orchestra.run.smithi087.stdout:Install 1 Package 2024-09-17T07:09:44.522 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:09:44.522 INFO:teuthology.orchestra.run.smithi087.stdout:Total download size: 82 k 2024-09-17T07:09:44.522 INFO:teuthology.orchestra.run.smithi087.stdout:Installed size: 222 k 2024-09-17T07:09:44.522 INFO:teuthology.orchestra.run.smithi087.stdout:Downloading Packages: 2024-09-17T07:09:44.660 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:01:36 ago on Tue 17 Sep 2024 07:08:08 AM UTC. 2024-09-17T07:09:44.741 INFO:teuthology.orchestra.run.smithi087.stdout:rbd-fuse-17.2.7-1635.g4a704134.el9.x86_64.rpm 376 kB/s | 82 kB 00:00 2024-09-17T07:09:44.741 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2024-09-17T07:09:44.741 INFO:teuthology.orchestra.run.smithi087.stdout:Total 373 kB/s | 82 kB 00:00 2024-09-17T07:09:44.742 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction check 2024-09-17T07:09:44.748 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction check succeeded. 2024-09-17T07:09:44.748 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction test 2024-09-17T07:09:44.792 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-17T07:09:44.793 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-17T07:09:44.793 INFO:teuthology.orchestra.run.smithi139.stdout: Package Architecture Version Repository Size 2024-09-17T07:09:44.793 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-17T07:09:44.793 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2024-09-17T07:09:44.793 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-fuse x86_64 2:17.2.7-1635.g4a704134.el9 ceph 82 k 2024-09-17T07:09:44.793 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:09:44.793 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2024-09-17T07:09:44.793 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-17T07:09:44.793 INFO:teuthology.orchestra.run.smithi139.stdout:Install 1 Package 2024-09-17T07:09:44.793 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:09:44.794 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 82 k 2024-09-17T07:09:44.794 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 222 k 2024-09-17T07:09:44.794 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2024-09-17T07:09:44.811 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction test succeeded. 2024-09-17T07:09:44.811 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction 2024-09-17T07:09:44.959 INFO:teuthology.orchestra.run.smithi087.stdout: Preparing : 1/1 2024-09-17T07:09:44.983 INFO:teuthology.orchestra.run.smithi139.stdout:rbd-fuse-17.2.7-1635.g4a704134.el9.x86_64.rpm 433 kB/s | 82 kB 00:00 2024-09-17T07:09:44.984 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2024-09-17T07:09:44.984 INFO:teuthology.orchestra.run.smithi139.stdout:Total 430 kB/s | 82 kB 00:00 2024-09-17T07:09:44.984 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2024-09-17T07:09:44.990 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2024-09-17T07:09:44.990 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2024-09-17T07:09:45.054 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : rbd-fuse-2:17.2.7-1635.g4a704134.el9.x86_64 1/1 2024-09-17T07:09:45.054 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2024-09-17T07:09:45.054 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2024-09-17T07:09:45.213 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2024-09-17T07:09:45.313 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : rbd-fuse-2:17.2.7-1635.g4a704134.el9.x86_64 1/1 2024-09-17T07:09:45.414 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: rbd-fuse-2:17.2.7-1635.g4a704134.el9.x86_64 1/1 2024-09-17T07:09:45.663 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : rbd-fuse-2:17.2.7-1635.g4a704134.el9.x86_64 1/1 2024-09-17T07:09:45.663 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:09:45.663 INFO:teuthology.orchestra.run.smithi087.stdout:Installed: 2024-09-17T07:09:45.664 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-fuse-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T07:09:45.664 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:09:45.664 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-09-17T07:09:45.683 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: rbd-fuse-2:17.2.7-1635.g4a704134.el9.x86_64 1/1 2024-09-17T07:09:45.901 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install rbd-mirror 2024-09-17T07:09:45.931 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : rbd-fuse-2:17.2.7-1635.g4a704134.el9.x86_64 1/1 2024-09-17T07:09:45.931 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:09:45.931 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2024-09-17T07:09:45.931 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-fuse-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T07:09:45.931 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:09:45.931 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-17T07:09:46.157 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install rbd-mirror 2024-09-17T07:09:46.493 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:01:39 ago on Tue 17 Sep 2024 07:08:07 AM UTC. 2024-09-17T07:09:46.630 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-09-17T07:09:46.630 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-09-17T07:09:46.630 INFO:teuthology.orchestra.run.smithi087.stdout: Package Arch Version Repo Size 2024-09-17T07:09:46.631 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-09-17T07:09:46.631 INFO:teuthology.orchestra.run.smithi087.stdout:Installing: 2024-09-17T07:09:46.631 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-mirror x86_64 2:17.2.7-1635.g4a704134.el9 ceph 2.9 M 2024-09-17T07:09:46.631 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:09:46.631 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction Summary 2024-09-17T07:09:46.631 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-09-17T07:09:46.631 INFO:teuthology.orchestra.run.smithi087.stdout:Install 1 Package 2024-09-17T07:09:46.631 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:09:46.631 INFO:teuthology.orchestra.run.smithi087.stdout:Total download size: 2.9 M 2024-09-17T07:09:46.631 INFO:teuthology.orchestra.run.smithi087.stdout:Installed size: 12 M 2024-09-17T07:09:46.631 INFO:teuthology.orchestra.run.smithi087.stdout:Downloading Packages: 2024-09-17T07:09:46.748 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:01:38 ago on Tue 17 Sep 2024 07:08:08 AM UTC. 2024-09-17T07:09:46.885 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-17T07:09:46.885 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-17T07:09:46.885 INFO:teuthology.orchestra.run.smithi139.stdout: Package Arch Version Repo Size 2024-09-17T07:09:46.885 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-17T07:09:46.886 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2024-09-17T07:09:46.886 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-mirror x86_64 2:17.2.7-1635.g4a704134.el9 ceph 2.9 M 2024-09-17T07:09:46.886 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:09:46.886 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2024-09-17T07:09:46.886 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-17T07:09:46.886 INFO:teuthology.orchestra.run.smithi139.stdout:Install 1 Package 2024-09-17T07:09:46.886 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:09:46.886 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 2.9 M 2024-09-17T07:09:46.886 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 12 M 2024-09-17T07:09:46.886 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2024-09-17T07:09:46.977 INFO:teuthology.orchestra.run.smithi087.stdout:rbd-mirror-17.2.7-1635.g4a704134.el9.x86_64.rpm 8.5 MB/s | 2.9 MB 00:00 2024-09-17T07:09:46.977 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2024-09-17T07:09:46.978 INFO:teuthology.orchestra.run.smithi087.stdout:Total 8.5 MB/s | 2.9 MB 00:00 2024-09-17T07:09:46.978 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction check 2024-09-17T07:09:46.987 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction check succeeded. 2024-09-17T07:09:46.987 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction test 2024-09-17T07:09:47.070 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction test succeeded. 2024-09-17T07:09:47.070 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction 2024-09-17T07:09:47.227 INFO:teuthology.orchestra.run.smithi139.stdout:rbd-mirror-17.2.7-1635.g4a704134.el9.x86_64.rpm 8.6 MB/s | 2.9 MB 00:00 2024-09-17T07:09:47.227 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2024-09-17T07:09:47.228 INFO:teuthology.orchestra.run.smithi139.stdout:Total 8.6 MB/s | 2.9 MB 00:00 2024-09-17T07:09:47.228 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2024-09-17T07:09:47.237 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2024-09-17T07:09:47.237 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2024-09-17T07:09:47.317 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2024-09-17T07:09:47.317 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2024-09-17T07:09:47.490 INFO:teuthology.orchestra.run.smithi087.stdout: Preparing : 1/1 2024-09-17T07:09:47.553 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : rbd-mirror-2:17.2.7-1635.g4a704134.el9.x86_64 1/1 2024-09-17T07:09:47.578 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: rbd-mirror-2:17.2.7-1635.g4a704134.el9.x86_64 1/1 2024-09-17T07:09:47.578 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T07:09:47.578 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-17T07:09:47.578 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T07:09:47.578 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T07:09:47.579 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:09:47.725 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2024-09-17T07:09:47.794 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : rbd-mirror-2:17.2.7-1635.g4a704134.el9.x86_64 1/1 2024-09-17T07:09:47.819 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: rbd-mirror-2:17.2.7-1635.g4a704134.el9.x86_64 1/1 2024-09-17T07:09:47.819 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T07:09:47.819 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-17T07:09:47.819 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T07:09:47.819 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T07:09:47.819 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:09:48.763 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : rbd-mirror-2:17.2.7-1635.g4a704134.el9.x86_64 1/1 2024-09-17T07:09:48.763 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:09:48.763 INFO:teuthology.orchestra.run.smithi087.stdout:Installed: 2024-09-17T07:09:48.763 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-mirror-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T07:09:48.763 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:09:48.763 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-09-17T07:09:48.912 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : rbd-mirror-2:17.2.7-1635.g4a704134.el9.x86_64 1/1 2024-09-17T07:09:48.912 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:09:48.912 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2024-09-17T07:09:48.912 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-mirror-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T07:09:48.912 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:09:48.912 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-17T07:09:49.031 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install rbd-nbd 2024-09-17T07:09:49.231 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install rbd-nbd 2024-09-17T07:09:49.622 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:01:42 ago on Tue 17 Sep 2024 07:08:07 AM UTC. 2024-09-17T07:09:49.754 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-09-17T07:09:49.755 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-09-17T07:09:49.755 INFO:teuthology.orchestra.run.smithi087.stdout: Package Architecture Version Repository Size 2024-09-17T07:09:49.755 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-09-17T07:09:49.755 INFO:teuthology.orchestra.run.smithi087.stdout:Installing: 2024-09-17T07:09:49.755 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-nbd x86_64 2:17.2.7-1635.g4a704134.el9 ceph 165 k 2024-09-17T07:09:49.755 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:09:49.755 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction Summary 2024-09-17T07:09:49.756 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-09-17T07:09:49.756 INFO:teuthology.orchestra.run.smithi087.stdout:Install 1 Package 2024-09-17T07:09:49.756 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:09:49.756 INFO:teuthology.orchestra.run.smithi087.stdout:Total download size: 165 k 2024-09-17T07:09:49.756 INFO:teuthology.orchestra.run.smithi087.stdout:Installed size: 477 k 2024-09-17T07:09:49.756 INFO:teuthology.orchestra.run.smithi087.stdout:Downloading Packages: 2024-09-17T07:09:49.837 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:01:41 ago on Tue 17 Sep 2024 07:08:08 AM UTC. 2024-09-17T07:09:49.970 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-17T07:09:49.971 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-17T07:09:49.971 INFO:teuthology.orchestra.run.smithi139.stdout: Package Architecture Version Repository Size 2024-09-17T07:09:49.971 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-17T07:09:49.971 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2024-09-17T07:09:49.971 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-nbd x86_64 2:17.2.7-1635.g4a704134.el9 ceph 165 k 2024-09-17T07:09:49.971 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:09:49.971 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2024-09-17T07:09:49.972 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-17T07:09:49.972 INFO:teuthology.orchestra.run.smithi139.stdout:Install 1 Package 2024-09-17T07:09:49.972 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:09:49.972 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 165 k 2024-09-17T07:09:49.972 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 477 k 2024-09-17T07:09:49.972 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2024-09-17T07:09:49.989 INFO:teuthology.orchestra.run.smithi087.stdout:rbd-nbd-17.2.7-1635.g4a704134.el9.x86_64.rpm 710 kB/s | 165 kB 00:00 2024-09-17T07:09:49.989 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2024-09-17T07:09:49.989 INFO:teuthology.orchestra.run.smithi087.stdout:Total 706 kB/s | 165 kB 00:00 2024-09-17T07:09:49.989 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction check 2024-09-17T07:09:49.997 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction check succeeded. 2024-09-17T07:09:49.997 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction test 2024-09-17T07:09:50.060 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction test succeeded. 2024-09-17T07:09:50.060 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction 2024-09-17T07:09:50.181 INFO:teuthology.orchestra.run.smithi139.stdout:rbd-nbd-17.2.7-1635.g4a704134.el9.x86_64.rpm 792 kB/s | 165 kB 00:00 2024-09-17T07:09:50.181 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2024-09-17T07:09:50.181 INFO:teuthology.orchestra.run.smithi139.stdout:Total 787 kB/s | 165 kB 00:00 2024-09-17T07:09:50.181 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2024-09-17T07:09:50.189 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2024-09-17T07:09:50.189 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2024-09-17T07:09:50.214 INFO:teuthology.orchestra.run.smithi087.stdout: Preparing : 1/1 2024-09-17T07:09:50.252 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2024-09-17T07:09:50.252 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2024-09-17T07:09:50.310 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : rbd-nbd-2:17.2.7-1635.g4a704134.el9.x86_64 1/1 2024-09-17T07:09:50.406 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2024-09-17T07:09:50.511 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : rbd-nbd-2:17.2.7-1635.g4a704134.el9.x86_64 1/1 2024-09-17T07:09:50.736 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: rbd-nbd-2:17.2.7-1635.g4a704134.el9.x86_64 1/1 2024-09-17T07:09:50.919 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: rbd-nbd-2:17.2.7-1635.g4a704134.el9.x86_64 1/1 2024-09-17T07:09:50.985 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : rbd-nbd-2:17.2.7-1635.g4a704134.el9.x86_64 1/1 2024-09-17T07:09:50.985 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:09:50.985 INFO:teuthology.orchestra.run.smithi087.stdout:Installed: 2024-09-17T07:09:50.985 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-nbd-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T07:09:50.986 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:09:50.986 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-09-17T07:09:51.185 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : rbd-nbd-2:17.2.7-1635.g4a704134.el9.x86_64 1/1 2024-09-17T07:09:51.186 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:09:51.186 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2024-09-17T07:09:51.186 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-nbd-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T07:09:51.186 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:09:51.186 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-17T07:09:51.226 DEBUG:teuthology.parallel:result is None 2024-09-17T07:09:51.450 DEBUG:teuthology.parallel:result is None 2024-09-17T07:09:51.451 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-17T07:09:51.451 INFO:teuthology.packaging:ref: None 2024-09-17T07:09:51.451 INFO:teuthology.packaging:tag: None 2024-09-17T07:09:51.451 INFO:teuthology.packaging:branch: quincy 2024-09-17T07:09:51.451 INFO:teuthology.packaging:sha1: 19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 2024-09-17T07:09:51.452 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-09-17T07:09:51.684 DEBUG:teuthology.orchestra.run.smithi087:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-17T07:09:51.706 INFO:teuthology.orchestra.run.smithi087.stdout:17.2.7-1635.g4a704134.el9 2024-09-17T07:09:51.707 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1635.g4a704134.el9 2024-09-17T07:09:51.707 INFO:teuthology.task.install:The correct ceph version 17.2.7-1635.g4a704134 is installed. 2024-09-17T07:09:51.709 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-17T07:09:51.709 INFO:teuthology.packaging:ref: None 2024-09-17T07:09:51.709 INFO:teuthology.packaging:tag: None 2024-09-17T07:09:51.709 INFO:teuthology.packaging:branch: quincy 2024-09-17T07:09:51.709 INFO:teuthology.packaging:sha1: 19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 2024-09-17T07:09:51.709 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-09-17T07:09:51.943 DEBUG:teuthology.orchestra.run.smithi139:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-17T07:09:51.965 INFO:teuthology.orchestra.run.smithi139.stdout:17.2.7-1635.g4a704134.el9 2024-09-17T07:09:51.965 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1635.g4a704134.el9 2024-09-17T07:09:51.965 INFO:teuthology.task.install:The correct ceph version 17.2.7-1635.g4a704134 is installed. 2024-09-17T07:09:51.967 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-17T07:09:51.968 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-17T07:09:51.968 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-17T07:09:51.995 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-17T07:09:51.995 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-17T07:09:52.031 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-17T07:09:52.032 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-17T07:09:52.032 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/usr/bin/daemon-helper 2024-09-17T07:09:52.061 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-17T07:09:52.127 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-17T07:09:52.128 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/usr/bin/daemon-helper 2024-09-17T07:09:52.152 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-17T07:09:52.240 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-17T07:09:52.240 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-17T07:09:52.240 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-17T07:09:52.265 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-17T07:09:52.331 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-17T07:09:52.331 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-17T07:09:52.356 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-17T07:09:52.420 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-17T07:09:52.421 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-17T07:09:52.421 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/usr/bin/stdin-killer 2024-09-17T07:09:52.445 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-17T07:09:52.510 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-17T07:09:52.511 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/usr/bin/stdin-killer 2024-09-17T07:09:52.535 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-17T07:09:52.600 INFO:teuthology.run_tasks:Running task print... 2024-09-17T07:09:52.610 INFO:teuthology.task.print:**** done install task... 2024-09-17T07:09:52.610 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-17T07:09:52.717 INFO:tasks.cephadm:Config: {'cephadm_branch': 'quincy', 'cephadm_git_url': 'https://github.com/ceph/ceph', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on pool no app': False}}, 'image': 'quay.ceph.io/ceph-ci/ceph:quincy', 'roleless': True, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'OSD_DOWN', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '19e2a2beb6f41a3ab62650e38614eb29b59dcbb9'} 2024-09-17T07:09:52.717 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:quincy 2024-09-17T07:09:52.718 INFO:tasks.cephadm:Cluster fsid is d5dbf8d6-74c3-11ef-bceb-c7b262605968 2024-09-17T07:09:52.718 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-17T07:09:52.718 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-09-17T07:09:52.718 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi087': '172.21.15.87', 'mon.smithi139': '172.21.15.139'} 2024-09-17T07:09:52.718 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-17T07:09:52.719 DEBUG:teuthology.orchestra.run.smithi087:> sudo hostname $(hostname -s) 2024-09-17T07:09:52.745 DEBUG:teuthology.orchestra.run.smithi139:> sudo hostname $(hostname -s) 2024-09-17T07:09:52.770 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph ref quincy)... 2024-09-17T07:09:52.770 DEBUG:teuthology.orchestra.run.smithi087:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-17T07:09:53.015 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r--. 1 ubuntu ubuntu 378585 Sep 17 07:09 /home/ubuntu/cephtest/cephadm 2024-09-17T07:09:53.015 DEBUG:teuthology.orchestra.run.smithi139:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-17T07:09:53.151 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r--. 1 ubuntu ubuntu 378585 Sep 17 07:09 /home/ubuntu/cephtest/cephadm 2024-09-17T07:09:53.151 DEBUG:teuthology.orchestra.run.smithi087:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-17T07:09:53.167 DEBUG:teuthology.orchestra.run.smithi139:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-17T07:09:53.193 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:quincy on all hosts... 2024-09-17T07:09:53.193 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2024-09-17T07:09:53.210 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2024-09-17T07:09:54.845 INFO:teuthology.orchestra.run.smithi139.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-09-17T07:09:54.877 INFO:teuthology.orchestra.run.smithi087.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-09-17T07:10:23.598 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-17T07:10:23.599 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_version": "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)", 2024-09-17T07:10:23.599 INFO:teuthology.orchestra.run.smithi139.stdout: "image_id": "f22ead590badffde0cfa54f24f421cfc85eb73db2472525e9773349cda0adf30", 2024-09-17T07:10:23.599 INFO:teuthology.orchestra.run.smithi139.stdout: "repo_digests": [ 2024-09-17T07:10:23.599 INFO:teuthology.orchestra.run.smithi139.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:c5428a59091f5674ce6e26540d9db0f28844a507e2a324b8305a00f1687ce028" 2024-09-17T07:10:23.599 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-17T07:10:23.599 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-17T07:10:26.589 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T07:10:26.589 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_version": "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)", 2024-09-17T07:10:26.589 INFO:teuthology.orchestra.run.smithi087.stdout: "image_id": "f22ead590badffde0cfa54f24f421cfc85eb73db2472525e9773349cda0adf30", 2024-09-17T07:10:26.589 INFO:teuthology.orchestra.run.smithi087.stdout: "repo_digests": [ 2024-09-17T07:10:26.589 INFO:teuthology.orchestra.run.smithi087.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:c5428a59091f5674ce6e26540d9db0f28844a507e2a324b8305a00f1687ce028" 2024-09-17T07:10:26.589 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-09-17T07:10:26.589 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T07:10:26.612 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /etc/ceph 2024-09-17T07:10:26.664 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /etc/ceph 2024-09-17T07:10:26.697 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 777 /etc/ceph 2024-09-17T07:10:26.724 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod 777 /etc/ceph 2024-09-17T07:10:26.767 INFO:tasks.cephadm:Writing seed config... 2024-09-17T07:10:26.769 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-09-17T07:10:26.769 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-09-17T07:10:26.769 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-09-17T07:10:26.770 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-09-17T07:10:26.770 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-09-17T07:10:26.770 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-17T07:10:26.770 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-17T07:10:26.770 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-09-17T07:10:26.771 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-09-17T07:10:26.771 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-17T07:10:26.771 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-17T07:10:26.771 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-09-17T07:10:26.772 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-17T07:10:26.772 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-17T07:10:26.772 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-17T07:10:26.772 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-17T07:10:26.772 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-17T07:10:26.773 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-17T07:10:26.773 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-17T07:10:26.773 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-17T07:10:26.773 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-17T07:10:26.773 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-17T07:10:26.774 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-17T07:10:26.774 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-09-17T07:10:26.774 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-17T07:10:26.774 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-17T07:10:26.774 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-17T07:10:26.774 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-17T07:10:26.775 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-17T07:10:26.775 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-17T07:10:26.775 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-17T07:10:26.775 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-17T07:10:26.775 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-17T07:10:26.775 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-17T07:10:26.776 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-17T07:10:26.776 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-17T07:10:26.776 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-17T07:10:26.776 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-17T07:10:26.776 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-17T07:10:26.777 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-17T07:10:26.777 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-17T07:10:26.777 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-17T07:10:26.778 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-17T07:10:26.779 DEBUG:teuthology.orchestra.run.smithi087:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-17T07:10:26.796 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = d5dbf8d6-74c3-11ef-bceb-c7b262605968 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-17T07:10:26.797 DEBUG:teuthology.orchestra.run.smithi087:mon.smithi087> sudo journalctl -f -n 0 -u ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968@mon.smithi087.service 2024-09-17T07:10:26.839 INFO:tasks.cephadm:Bootstrapping... 2024-09-17T07:10:26.839 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy -v bootstrap --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.87 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-17T07:10:27.039 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2024-09-17T07:10:27.039 INFO:teuthology.orchestra.run.smithi087.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:quincy', '-v', 'bootstrap', '--fsid', 'd5dbf8d6-74c3-11ef-bceb-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.87', '--skip-admin-label'] 2024-09-17T07:10:27.062 INFO:teuthology.orchestra.run.smithi087.stdout:/bin/podman: stdout 5.2.2 2024-09-17T07:10:27.063 INFO:teuthology.orchestra.run.smithi087.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-17T07:10:27.063 INFO:teuthology.orchestra.run.smithi087.stdout:Verifying podman|docker is present... 2024-09-17T07:10:27.096 INFO:teuthology.orchestra.run.smithi087.stdout:/bin/podman: stdout 5.2.2 2024-09-17T07:10:27.097 INFO:teuthology.orchestra.run.smithi087.stdout:Verifying lvm2 is present... 2024-09-17T07:10:27.097 INFO:teuthology.orchestra.run.smithi087.stdout:Verifying time synchronization is in place... 2024-09-17T07:10:27.105 INFO:teuthology.orchestra.run.smithi087.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-17T07:10:27.105 INFO:teuthology.orchestra.run.smithi087.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-17T07:10:27.111 INFO:teuthology.orchestra.run.smithi087.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-17T07:10:27.111 INFO:teuthology.orchestra.run.smithi087.stdout:systemctl: stdout inactive 2024-09-17T07:10:27.118 INFO:teuthology.orchestra.run.smithi087.stdout:systemctl: stdout enabled 2024-09-17T07:10:27.125 INFO:teuthology.orchestra.run.smithi087.stdout:systemctl: stdout active 2024-09-17T07:10:27.125 INFO:teuthology.orchestra.run.smithi087.stdout:Unit chronyd.service is enabled and running 2024-09-17T07:10:27.125 INFO:teuthology.orchestra.run.smithi087.stdout:Repeating the final host check... 2024-09-17T07:10:27.147 INFO:teuthology.orchestra.run.smithi087.stdout:/bin/podman: stdout 5.2.2 2024-09-17T07:10:27.147 INFO:teuthology.orchestra.run.smithi087.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-17T07:10:27.147 INFO:teuthology.orchestra.run.smithi087.stdout:systemctl is present 2024-09-17T07:10:27.147 INFO:teuthology.orchestra.run.smithi087.stdout:lvcreate is present 2024-09-17T07:10:27.153 INFO:teuthology.orchestra.run.smithi087.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-17T07:10:27.154 INFO:teuthology.orchestra.run.smithi087.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-17T07:10:27.160 INFO:teuthology.orchestra.run.smithi087.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-17T07:10:27.160 INFO:teuthology.orchestra.run.smithi087.stdout:systemctl: stdout inactive 2024-09-17T07:10:27.167 INFO:teuthology.orchestra.run.smithi087.stdout:systemctl: stdout enabled 2024-09-17T07:10:27.174 INFO:teuthology.orchestra.run.smithi087.stdout:systemctl: stdout active 2024-09-17T07:10:27.174 INFO:teuthology.orchestra.run.smithi087.stdout:Unit chronyd.service is enabled and running 2024-09-17T07:10:27.174 INFO:teuthology.orchestra.run.smithi087.stdout:Host looks OK 2024-09-17T07:10:27.174 INFO:teuthology.orchestra.run.smithi087.stdout:Cluster fsid: d5dbf8d6-74c3-11ef-bceb-c7b262605968 2024-09-17T07:10:27.174 INFO:teuthology.orchestra.run.smithi087.stdout:Acquiring lock 140184556208480 on /run/cephadm/d5dbf8d6-74c3-11ef-bceb-c7b262605968.lock 2024-09-17T07:10:27.174 INFO:teuthology.orchestra.run.smithi087.stdout:Lock 140184556208480 acquired on /run/cephadm/d5dbf8d6-74c3-11ef-bceb-c7b262605968.lock 2024-09-17T07:10:27.175 INFO:teuthology.orchestra.run.smithi087.stdout:Verifying IP 172.21.15.87 port 3300 ... 2024-09-17T07:10:27.175 INFO:teuthology.orchestra.run.smithi087.stdout:Verifying IP 172.21.15.87 port 6789 ... 2024-09-17T07:10:27.175 INFO:teuthology.orchestra.run.smithi087.stdout:Base mon IP(s) is [172.21.15.87:3300, 172.21.15.87:6789], mon addrv is [v2:172.21.15.87:3300,v1:172.21.15.87:6789] 2024-09-17T07:10:27.179 INFO:teuthology.orchestra.run.smithi087.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.87 metric 100 2024-09-17T07:10:27.179 INFO:teuthology.orchestra.run.smithi087.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.87 metric 100 2024-09-17T07:10:27.182 INFO:teuthology.orchestra.run.smithi087.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-17T07:10:27.182 INFO:teuthology.orchestra.run.smithi087.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-09-17T07:10:27.182 INFO:teuthology.orchestra.run.smithi087.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-09-17T07:10:27.185 INFO:teuthology.orchestra.run.smithi087.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-17T07:10:27.185 INFO:teuthology.orchestra.run.smithi087.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-17T07:10:27.185 INFO:teuthology.orchestra.run.smithi087.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-17T07:10:27.185 INFO:teuthology.orchestra.run.smithi087.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-09-17T07:10:27.185 INFO:teuthology.orchestra.run.smithi087.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:d5f5/64 scope link noprefixroute 2024-09-17T07:10:27.185 INFO:teuthology.orchestra.run.smithi087.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-17T07:10:27.185 INFO:teuthology.orchestra.run.smithi087.stdout:Mon IP `172.21.15.87` is in CIDR network `172.21.0.0/20` 2024-09-17T07:10:27.186 INFO:teuthology.orchestra.run.smithi087.stdout:Mon IP `172.21.15.87` is in CIDR network `172.21.0.0/20` 2024-09-17T07:10:27.186 INFO:teuthology.orchestra.run.smithi087.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-17T07:10:27.186 INFO:teuthology.orchestra.run.smithi087.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-17T07:10:27.186 INFO:teuthology.orchestra.run.smithi087.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-09-17T07:10:27.662 INFO:teuthology.orchestra.run.smithi087.stdout:/bin/podman: stdout f22ead590badffde0cfa54f24f421cfc85eb73db2472525e9773349cda0adf30 2024-09-17T07:10:27.663 INFO:teuthology.orchestra.run.smithi087.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:quincy... 2024-09-17T07:10:27.663 INFO:teuthology.orchestra.run.smithi087.stdout:/bin/podman: stderr Getting image source signatures 2024-09-17T07:10:27.663 INFO:teuthology.orchestra.run.smithi087.stdout:/bin/podman: stderr Copying blob sha256:afc1ef11d118e12ca6c3c802d7e4e9c8308fe940f6e297f4487b945b23e4c9f6 2024-09-17T07:10:27.663 INFO:teuthology.orchestra.run.smithi087.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-17T07:10:27.663 INFO:teuthology.orchestra.run.smithi087.stdout:/bin/podman: stderr Copying config sha256:f22ead590badffde0cfa54f24f421cfc85eb73db2472525e9773349cda0adf30 2024-09-17T07:10:27.663 INFO:teuthology.orchestra.run.smithi087.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-17T07:10:28.593 INFO:teuthology.orchestra.run.smithi087.stdout:ceph: stdout ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable) 2024-09-17T07:10:28.593 INFO:teuthology.orchestra.run.smithi087.stdout:Ceph version: ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable) 2024-09-17T07:10:28.593 INFO:teuthology.orchestra.run.smithi087.stdout:Extracting ceph user uid/gid from container image... 2024-09-17T07:10:29.448 INFO:teuthology.orchestra.run.smithi087.stdout:stat: stdout 167 167 2024-09-17T07:10:29.449 INFO:teuthology.orchestra.run.smithi087.stdout:Creating initial keys... 2024-09-17T07:10:30.403 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph-authtool: stdout AQBlK+lmuF12LhAAnJT2a79wiw/zHwmoxf0pjg== 2024-09-17T07:10:31.376 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph-authtool: stdout AQBmK+lm/N9GLRAAFE/1DpcsqqUm1qRyAyX4KA== 2024-09-17T07:10:32.332 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph-authtool: stdout AQBnK+lmVBOmKBAAvZxV15FAbF08UXW2HBtEww== 2024-09-17T07:10:32.333 INFO:teuthology.orchestra.run.smithi087.stdout:Creating initial monmap... 2024-09-17T07:10:33.230 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-17T07:10:33.230 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = octopus 2024-09-17T07:10:33.230 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to d5dbf8d6-74c3-11ef-bceb-c7b262605968 2024-09-17T07:10:33.230 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-17T07:10:33.230 INFO:teuthology.orchestra.run.smithi087.stdout:monmaptool for smithi087 [v2:172.21.15.87:3300,v1:172.21.15.87:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-17T07:10:33.230 INFO:teuthology.orchestra.run.smithi087.stdout:setting min_mon_release = octopus 2024-09-17T07:10:33.230 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/monmaptool: set fsid to d5dbf8d6-74c3-11ef-bceb-c7b262605968 2024-09-17T07:10:33.230 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-17T07:10:33.230 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:10:33.230 INFO:teuthology.orchestra.run.smithi087.stdout:Creating mon... 2024-09-17T07:10:34.143 INFO:teuthology.orchestra.run.smithi087.stdout:create mon.smithi087 on 2024-09-17T07:10:34.355 INFO:teuthology.orchestra.run.smithi087.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-17T07:10:34.516 INFO:teuthology.orchestra.run.smithi087.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-17T07:10:34.673 INFO:teuthology.orchestra.run.smithi087.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968.target. 2024-09-17T07:10:34.673 INFO:teuthology.orchestra.run.smithi087.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968.target. 2024-09-17T07:10:34.971 INFO:teuthology.orchestra.run.smithi087.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968@mon.smithi087 2024-09-17T07:10:34.971 INFO:teuthology.orchestra.run.smithi087.stdout:systemctl: stderr Failed to reset failed state of unit ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968@mon.smithi087.service: Unit ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968@mon.smithi087.service not loaded. 2024-09-17T07:10:35.179 INFO:teuthology.orchestra.run.smithi087.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968.target.wants/ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968@mon.smithi087.service → /etc/systemd/system/ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968@.service. 2024-09-17T07:10:35.751 INFO:teuthology.orchestra.run.smithi087.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-17T07:10:35.751 INFO:teuthology.orchestra.run.smithi087.stdout:systemctl: stdout disabled 2024-09-17T07:10:35.758 INFO:teuthology.orchestra.run.smithi087.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-17T07:10:35.758 INFO:teuthology.orchestra.run.smithi087.stdout:systemctl: stdout inactive 2024-09-17T07:10:35.758 INFO:teuthology.orchestra.run.smithi087.stdout:firewalld.service is not enabled 2024-09-17T07:10:35.758 INFO:teuthology.orchestra.run.smithi087.stdout:Not possible to enable service . firewalld.service is not available 2024-09-17T07:10:35.759 INFO:teuthology.orchestra.run.smithi087.stdout:Waiting for mon to start... 2024-09-17T07:10:35.759 INFO:teuthology.orchestra.run.smithi087.stdout:Waiting for mon... 2024-09-17T07:10:36.788 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout cluster: 2024-09-17T07:10:36.788 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout id: d5dbf8d6-74c3-11ef-bceb-c7b262605968 2024-09-17T07:10:36.788 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-17T07:10:36.788 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout 2024-09-17T07:10:36.788 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout services: 2024-09-17T07:10:36.788 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi087 (age 0.532355s) 2024-09-17T07:10:36.788 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-17T07:10:36.788 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-17T07:10:36.788 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout 2024-09-17T07:10:36.788 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout data: 2024-09-17T07:10:36.788 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-17T07:10:36.789 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-17T07:10:36.789 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-17T07:10:36.789 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout pgs: 2024-09-17T07:10:36.789 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout 2024-09-17T07:10:36.789 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:36.138+0000 7f69c6842640 1 Processor -- start 2024-09-17T07:10:36.789 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:36.138+0000 7f69c6842640 1 -- start start 2024-09-17T07:10:36.789 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:36.138+0000 7f69c6842640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69c0078aa0 0x7f69c00771b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:10:36.789 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:36.138+0000 7f69c6842640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69c0078f40 con 0x7f69c0078aa0 2024-09-17T07:10:36.789 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:36.138+0000 7f69bffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69c0078aa0 0x7f69c00771b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:10:36.789 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:36.138+0000 7f69bffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69c0078aa0 0x7f69c00771b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49024/0 (socket says 172.21.15.87:49024) 2024-09-17T07:10:36.789 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:36.138+0000 7f69bffff640 1 -- 172.21.15.87:0/3224541232 learned_addr learned my addr 172.21.15.87:0/3224541232 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:10:36.789 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:36.139+0000 7f69bffff640 1 -- 172.21.15.87:0/3224541232 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69c0079080 con 0x7f69c0078aa0 2024-09-17T07:10:36.790 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:36.140+0000 7f69bffff640 1 --2- 172.21.15.87:0/3224541232 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69c0078aa0 0x7f69c00771b0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f69b0009840 tx=0x7f69b00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ac94b52ffbbfe97 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:10:36.790 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:36.141+0000 7f69beffd640 1 -- 172.21.15.87:0/3224541232 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f69b0032440 con 0x7f69c0078aa0 2024-09-17T07:10:36.790 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:36.141+0000 7f69beffd640 1 -- 172.21.15.87:0/3224541232 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69b00325a0 con 0x7f69c0078aa0 2024-09-17T07:10:36.790 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:36.141+0000 7f69beffd640 1 -- 172.21.15.87:0/3224541232 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f69b00328d0 con 0x7f69c0078aa0 2024-09-17T07:10:36.790 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:36.141+0000 7f69c6842640 1 -- 172.21.15.87:0/3224541232 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69c0078aa0 msgr2=0x7f69c00771b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:10:36.790 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:36.141+0000 7f69c6842640 1 --2- 172.21.15.87:0/3224541232 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69c0078aa0 0x7f69c00771b0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f69b0009840 tx=0x7f69b00091d0 comp rx=0 tx=0).stop 2024-09-17T07:10:36.790 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:36.141+0000 7f69c6842640 1 -- 172.21.15.87:0/3224541232 shutdown_connections 2024-09-17T07:10:36.790 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:36.141+0000 7f69c6842640 1 --2- 172.21.15.87:0/3224541232 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69c0078aa0 0x7f69c00771b0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:10:36.790 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:36.141+0000 7f69c6842640 1 -- 172.21.15.87:0/3224541232 >> 172.21.15.87:0/3224541232 conn(0x7f69c00fd680 msgr2=0x7f69c00ffab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:10:36.790 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:36.141+0000 7f69c6842640 1 -- 172.21.15.87:0/3224541232 shutdown_connections 2024-09-17T07:10:36.790 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:36.141+0000 7f69c6842640 1 -- 172.21.15.87:0/3224541232 wait complete. 2024-09-17T07:10:36.790 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:36.142+0000 7f69c6842640 1 Processor -- start 2024-09-17T07:10:36.790 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:36.142+0000 7f69c6842640 1 -- start start 2024-09-17T07:10:36.791 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:36.142+0000 7f69c6842640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69c0078aa0 0x7f69c01124d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:10:36.791 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:36.142+0000 7f69c6842640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69c0112a10 con 0x7f69c0078aa0 2024-09-17T07:10:36.791 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:36.142+0000 7f69bffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69c0078aa0 0x7f69c01124d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:10:36.791 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:36.142+0000 7f69bffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69c0078aa0 0x7f69c01124d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49030/0 (socket says 172.21.15.87:49030) 2024-09-17T07:10:36.791 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:36.142+0000 7f69bffff640 1 -- 172.21.15.87:0/3371542533 learned_addr learned my addr 172.21.15.87:0/3371542533 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:10:36.791 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:36.143+0000 7f69bffff640 1 -- 172.21.15.87:0/3371542533 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69b0009450 con 0x7f69c0078aa0 2024-09-17T07:10:36.791 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:36.143+0000 7f69bffff640 1 --2- 172.21.15.87:0/3371542533 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69c0078aa0 0x7f69c01124d0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f69b002a700 tx=0x7f69b0032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:10:36.791 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:36.143+0000 7f69bcff9640 1 -- 172.21.15.87:0/3371542533 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f69b0031be0 con 0x7f69c0078aa0 2024-09-17T07:10:36.791 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:36.143+0000 7f69bcff9640 1 -- 172.21.15.87:0/3371542533 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69b0031d40 con 0x7f69c0078aa0 2024-09-17T07:10:36.791 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:36.143+0000 7f69c6842640 1 -- 172.21.15.87:0/3371542533 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69c0112c10 con 0x7f69c0078aa0 2024-09-17T07:10:36.791 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:36.143+0000 7f69bcff9640 1 -- 172.21.15.87:0/3371542533 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f69b003b5a0 con 0x7f69c0078aa0 2024-09-17T07:10:36.791 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:36.143+0000 7f69c6842640 1 -- 172.21.15.87:0/3371542533 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69c01137a0 con 0x7f69c0078aa0 2024-09-17T07:10:36.792 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:36.143+0000 7f69bcff9640 1 -- 172.21.15.87:0/3371542533 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f69b0039040 con 0x7f69c0078aa0 2024-09-17T07:10:36.792 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:36.143+0000 7f69bcff9640 1 -- 172.21.15.87:0/3371542533 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f69b0041070 con 0x7f69c0078aa0 2024-09-17T07:10:36.792 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:36.144+0000 7f69c6842640 1 -- 172.21.15.87:0/3371542533 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69c005ed70 con 0x7f69c0078aa0 2024-09-17T07:10:36.792 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:36.146+0000 7f69bcff9640 1 -- 172.21.15.87:0/3371542533 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f69b0037070 con 0x7f69c0078aa0 2024-09-17T07:10:36.792 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:36.204+0000 7f69c6842640 1 -- 172.21.15.87:0/3371542533 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f69c01141d0 con 0x7f69c0078aa0 2024-09-17T07:10:36.792 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:36.204+0000 7f69bcff9640 1 -- 172.21.15.87:0/3371542533 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+325 (secure 0 0 0) 0x7f69b00457c0 con 0x7f69c0078aa0 2024-09-17T07:10:36.792 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:36.205+0000 7f69c6842640 1 -- 172.21.15.87:0/3371542533 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69c0078aa0 msgr2=0x7f69c01124d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:10:36.792 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:36.205+0000 7f69c6842640 1 --2- 172.21.15.87:0/3371542533 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69c0078aa0 0x7f69c01124d0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f69b002a700 tx=0x7f69b0032000 comp rx=0 tx=0).stop 2024-09-17T07:10:36.792 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:36.205+0000 7f69c6842640 1 -- 172.21.15.87:0/3371542533 shutdown_connections 2024-09-17T07:10:36.792 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:36.205+0000 7f69c6842640 1 --2- 172.21.15.87:0/3371542533 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69c0078aa0 0x7f69c01124d0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:10:36.792 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:36.205+0000 7f69c6842640 1 -- 172.21.15.87:0/3371542533 >> 172.21.15.87:0/3371542533 conn(0x7f69c00fd680 msgr2=0x7f69c0109350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:10:36.792 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:36.205+0000 7f69c6842640 1 -- 172.21.15.87:0/3371542533 shutdown_connections 2024-09-17T07:10:36.793 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:36.205+0000 7f69c6842640 1 -- 172.21.15.87:0/3371542533 wait complete. 2024-09-17T07:10:36.793 INFO:teuthology.orchestra.run.smithi087.stdout:mon is available 2024-09-17T07:10:36.793 INFO:teuthology.orchestra.run.smithi087.stdout:Assimilating anything we can from ceph.conf... 2024-09-17T07:10:37.775 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:37 smithi087 ceph-mon[27268]: from='client.? 172.21.15.87:0/653993567' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-17T07:10:37.784 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout 2024-09-17T07:10:37.784 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout [global] 2024-09-17T07:10:37.784 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout fsid = d5dbf8d6-74c3-11ef-bceb-c7b262605968 2024-09-17T07:10:37.784 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-17T07:10:37.785 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.87:3300,v1:172.21.15.87:6789] 2024-09-17T07:10:37.785 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-17T07:10:37.785 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-17T07:10:37.785 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-17T07:10:37.785 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-17T07:10:37.785 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout 2024-09-17T07:10:37.785 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-17T07:10:37.785 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-17T07:10:37.785 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout 2024-09-17T07:10:37.785 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout [osd] 2024-09-17T07:10:37.785 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-17T07:10:37.786 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-17T07:10:37.786 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-17T07:10:37.786 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-17T07:10:37.786 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-17T07:10:37.786 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:37.126+0000 7f96fd774640 1 Processor -- start 2024-09-17T07:10:37.786 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:37.126+0000 7f96fd774640 1 -- start start 2024-09-17T07:10:37.786 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:37.126+0000 7f96fd774640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96f81028f0 0x7f96f8104cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:10:37.786 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:37.126+0000 7f96fd774640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96f8070ac0 con 0x7f96f81028f0 2024-09-17T07:10:37.786 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:37.127+0000 7f96f6ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96f81028f0 0x7f96f8104cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:10:37.786 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:37.127+0000 7f96f6ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96f81028f0 0x7f96f8104cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49042/0 (socket says 172.21.15.87:49042) 2024-09-17T07:10:37.787 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:37.127+0000 7f96f6ffd640 1 -- 172.21.15.87:0/784615175 learned_addr learned my addr 172.21.15.87:0/784615175 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:10:37.787 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:37.127+0000 7f96f6ffd640 1 -- 172.21.15.87:0/784615175 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96f8070c00 con 0x7f96f81028f0 2024-09-17T07:10:37.787 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:37.128+0000 7f96f6ffd640 1 --2- 172.21.15.87:0/784615175 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96f81028f0 0x7f96f8104cd0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f96e8009e50 tx=0x7f96e8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46917d785943fbab server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:10:37.787 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:37.128+0000 7f96f5ffb640 1 -- 172.21.15.87:0/784615175 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f96e8031560 con 0x7f96f81028f0 2024-09-17T07:10:37.787 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:37.128+0000 7f96f5ffb640 1 -- 172.21.15.87:0/784615175 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96e802d050 con 0x7f96f81028f0 2024-09-17T07:10:37.787 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:37.128+0000 7f96f5ffb640 1 -- 172.21.15.87:0/784615175 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f96e8031880 con 0x7f96f81028f0 2024-09-17T07:10:37.787 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:37.128+0000 7f96fd774640 1 -- 172.21.15.87:0/784615175 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96f81028f0 msgr2=0x7f96f8104cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:10:37.787 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:37.128+0000 7f96fd774640 1 --2- 172.21.15.87:0/784615175 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96f81028f0 0x7f96f8104cd0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f96e8009e50 tx=0x7f96e8009840 comp rx=0 tx=0).stop 2024-09-17T07:10:37.787 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:37.128+0000 7f96fd774640 1 -- 172.21.15.87:0/784615175 shutdown_connections 2024-09-17T07:10:37.787 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:37.128+0000 7f96fd774640 1 --2- 172.21.15.87:0/784615175 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96f81028f0 0x7f96f8104cd0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:10:37.788 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:37.128+0000 7f96fd774640 1 -- 172.21.15.87:0/784615175 >> 172.21.15.87:0/784615175 conn(0x7f96f80fc390 msgr2=0x7f96f80fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:10:37.788 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:37.128+0000 7f96fd774640 1 -- 172.21.15.87:0/784615175 shutdown_connections 2024-09-17T07:10:37.788 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:37.128+0000 7f96fd774640 1 -- 172.21.15.87:0/784615175 wait complete. 2024-09-17T07:10:37.788 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:37.129+0000 7f96fd774640 1 Processor -- start 2024-09-17T07:10:37.788 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:37.129+0000 7f96fd774640 1 -- start start 2024-09-17T07:10:37.788 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:37.129+0000 7f96fd774640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96f81028f0 0x7f96f81102d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:10:37.788 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:37.129+0000 7f96fd774640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96f8110810 con 0x7f96f81028f0 2024-09-17T07:10:37.788 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:37.129+0000 7f96f6ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96f81028f0 0x7f96f81102d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:10:37.788 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:37.129+0000 7f96f6ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96f81028f0 0x7f96f81102d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49046/0 (socket says 172.21.15.87:49046) 2024-09-17T07:10:37.788 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:37.129+0000 7f96f6ffd640 1 -- 172.21.15.87:0/653993567 learned_addr learned my addr 172.21.15.87:0/653993567 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:10:37.789 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:37.130+0000 7f96f6ffd640 1 -- 172.21.15.87:0/653993567 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e8009ae0 con 0x7f96f81028f0 2024-09-17T07:10:37.789 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:37.130+0000 7f96f6ffd640 1 --2- 172.21.15.87:0/653993567 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96f81028f0 0x7f96f81102d0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f96e8000f80 tx=0x7f96e8036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:10:37.789 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:37.130+0000 7f96ef7fe640 1 -- 172.21.15.87:0/653993567 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f96e8007a10 con 0x7f96f81028f0 2024-09-17T07:10:37.789 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:37.130+0000 7f96ef7fe640 1 -- 172.21.15.87:0/653993567 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96e8007b70 con 0x7f96f81028f0 2024-09-17T07:10:37.789 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:37.130+0000 7f96ef7fe640 1 -- 172.21.15.87:0/653993567 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f96e8007e60 con 0x7f96f81028f0 2024-09-17T07:10:37.789 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:37.130+0000 7f96fd774640 1 -- 172.21.15.87:0/653993567 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96f8110a10 con 0x7f96f81028f0 2024-09-17T07:10:37.789 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:37.130+0000 7f96fd774640 1 -- 172.21.15.87:0/653993567 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96f81115a0 con 0x7f96f81028f0 2024-09-17T07:10:37.789 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:37.130+0000 7f96ef7fe640 1 -- 172.21.15.87:0/653993567 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f96e8038070 con 0x7f96f81028f0 2024-09-17T07:10:37.789 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:37.130+0000 7f96ef7fe640 1 -- 172.21.15.87:0/653993567 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f96e8045c40 con 0x7f96f81028f0 2024-09-17T07:10:37.789 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:37.131+0000 7f96fd774640 1 -- 172.21.15.87:0/653993567 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96f8110ee0 con 0x7f96f81028f0 2024-09-17T07:10:37.789 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:37.133+0000 7f96ef7fe640 1 -- 172.21.15.87:0/653993567 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f96e80647a0 con 0x7f96f81028f0 2024-09-17T07:10:37.789 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:37.188+0000 7f96fd774640 1 -- 172.21.15.87:0/653993567 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f96f805ed70 con 0x7f96f81028f0 2024-09-17T07:10:37.790 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:37.191+0000 7f96ef7fe640 1 -- 172.21.15.87:0/653993567 <== mon.0 v2:172.21.15.87:3300/0 7 ==== config(25 keys) v1 ==== 970+0+0 (secure 0 0 0) 0x7f96e8045460 con 0x7f96f81028f0 2024-09-17T07:10:37.790 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:37.191+0000 7f96ef7fe640 1 -- 172.21.15.87:0/653993567 <== mon.0 v2:172.21.15.87:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+465 (secure 0 0 0) 0x7f96e8053020 con 0x7f96f81028f0 2024-09-17T07:10:37.790 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:37.192+0000 7f96fd774640 1 -- 172.21.15.87:0/653993567 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96f81028f0 msgr2=0x7f96f81102d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:10:37.790 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:37.192+0000 7f96fd774640 1 --2- 172.21.15.87:0/653993567 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96f81028f0 0x7f96f81102d0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f96e8000f80 tx=0x7f96e8036000 comp rx=0 tx=0).stop 2024-09-17T07:10:37.790 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:37.192+0000 7f96fd774640 1 -- 172.21.15.87:0/653993567 shutdown_connections 2024-09-17T07:10:37.790 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:37.192+0000 7f96fd774640 1 --2- 172.21.15.87:0/653993567 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96f81028f0 0x7f96f81102d0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:10:37.790 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:37.192+0000 7f96fd774640 1 -- 172.21.15.87:0/653993567 >> 172.21.15.87:0/653993567 conn(0x7f96f80fc390 msgr2=0x7f96f80fc760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:10:37.790 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:37.192+0000 7f96fd774640 1 -- 172.21.15.87:0/653993567 shutdown_connections 2024-09-17T07:10:37.790 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:37.192+0000 7f96fd774640 1 -- 172.21.15.87:0/653993567 wait complete. 2024-09-17T07:10:37.790 INFO:teuthology.orchestra.run.smithi087.stdout:Generating new minimal ceph.conf... 2024-09-17T07:10:38.839 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:38.207+0000 7f0bb4cde640 1 Processor -- start 2024-09-17T07:10:38.839 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:38.207+0000 7f0bb4cde640 1 -- start start 2024-09-17T07:10:38.839 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:38.207+0000 7f0bb4cde640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0bb0101ec0 0x7f0bb01022d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:10:38.839 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:38.207+0000 7f0bb4cde640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb01028a0 con 0x7f0bb0101ec0 2024-09-17T07:10:38.839 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:38.207+0000 7f0bae59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0bb0101ec0 0x7f0bb01022d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:10:38.840 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:38.207+0000 7f0bae59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0bb0101ec0 0x7f0bb01022d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49058/0 (socket says 172.21.15.87:49058) 2024-09-17T07:10:38.840 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:38.207+0000 7f0bae59c640 1 -- 172.21.15.87:0/977870820 learned_addr learned my addr 172.21.15.87:0/977870820 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:10:38.840 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:38.207+0000 7f0bae59c640 1 -- 172.21.15.87:0/977870820 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bb01029e0 con 0x7f0bb0101ec0 2024-09-17T07:10:38.840 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:38.208+0000 7f0bae59c640 1 --2- 172.21.15.87:0/977870820 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0bb0101ec0 0x7f0bb01022d0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f0ba0009840 tx=0x7f0ba00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb5085de59cb61bd server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:10:38.840 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:38.208+0000 7f0bad59a640 1 -- 172.21.15.87:0/977870820 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0ba0032440 con 0x7f0bb0101ec0 2024-09-17T07:10:38.840 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:38.208+0000 7f0bad59a640 1 -- 172.21.15.87:0/977870820 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 970+0+0 (secure 0 0 0) 0x7f0ba00329e0 con 0x7f0bb0101ec0 2024-09-17T07:10:38.840 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:38.208+0000 7f0bad59a640 1 -- 172.21.15.87:0/977870820 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0ba0031930 con 0x7f0bb0101ec0 2024-09-17T07:10:38.841 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:38.209+0000 7f0bb4cde640 1 -- 172.21.15.87:0/977870820 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0bb0101ec0 msgr2=0x7f0bb01022d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:10:38.841 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:38.209+0000 7f0bb4cde640 1 --2- 172.21.15.87:0/977870820 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0bb0101ec0 0x7f0bb01022d0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f0ba0009840 tx=0x7f0ba00091d0 comp rx=0 tx=0).stop 2024-09-17T07:10:38.841 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:38.209+0000 7f0bb4cde640 1 -- 172.21.15.87:0/977870820 shutdown_connections 2024-09-17T07:10:38.841 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:38.209+0000 7f0bb4cde640 1 --2- 172.21.15.87:0/977870820 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0bb0101ec0 0x7f0bb01022d0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:10:38.841 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:38.209+0000 7f0bb4cde640 1 -- 172.21.15.87:0/977870820 >> 172.21.15.87:0/977870820 conn(0x7f0bb00fd680 msgr2=0x7f0bb00ffab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:10:38.841 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:38.209+0000 7f0bb4cde640 1 -- 172.21.15.87:0/977870820 shutdown_connections 2024-09-17T07:10:38.842 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:38.209+0000 7f0bb4cde640 1 -- 172.21.15.87:0/977870820 wait complete. 2024-09-17T07:10:38.842 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:38.209+0000 7f0bb4cde640 1 Processor -- start 2024-09-17T07:10:38.842 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:38.209+0000 7f0bb4cde640 1 -- start start 2024-09-17T07:10:38.842 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:38.209+0000 7f0bb4cde640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0bb0101ec0 0x7f0bb0078bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:10:38.842 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:38.209+0000 7f0bb4cde640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb0079100 con 0x7f0bb0101ec0 2024-09-17T07:10:38.842 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:38.210+0000 7f0bae59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0bb0101ec0 0x7f0bb0078bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:10:38.842 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:38.210+0000 7f0bae59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0bb0101ec0 0x7f0bb0078bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49070/0 (socket says 172.21.15.87:49070) 2024-09-17T07:10:38.842 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:38.210+0000 7f0bae59c640 1 -- 172.21.15.87:0/3221248458 learned_addr learned my addr 172.21.15.87:0/3221248458 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:10:38.842 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:38.210+0000 7f0bae59c640 1 -- 172.21.15.87:0/3221248458 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ba0009450 con 0x7f0bb0101ec0 2024-09-17T07:10:38.842 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:38.210+0000 7f0bae59c640 1 --2- 172.21.15.87:0/3221248458 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0bb0101ec0 0x7f0bb0078bc0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0ba002a7a0 tx=0x7f0ba0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:10:38.843 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:38.210+0000 7f0b9effd640 1 -- 172.21.15.87:0/3221248458 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0ba00327b0 con 0x7f0bb0101ec0 2024-09-17T07:10:38.843 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:38.210+0000 7f0b9effd640 1 -- 172.21.15.87:0/3221248458 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 970+0+0 (secure 0 0 0) 0x7f0ba003b8b0 con 0x7f0bb0101ec0 2024-09-17T07:10:38.843 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:38.210+0000 7f0bb4cde640 1 -- 172.21.15.87:0/3221248458 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bb0077190 con 0x7f0bb0101ec0 2024-09-17T07:10:38.843 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:38.210+0000 7f0b9effd640 1 -- 172.21.15.87:0/3221248458 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0ba003a680 con 0x7f0bb0101ec0 2024-09-17T07:10:38.843 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:38.210+0000 7f0bb4cde640 1 -- 172.21.15.87:0/3221248458 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bb0077600 con 0x7f0bb0101ec0 2024-09-17T07:10:38.843 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:38.210+0000 7f0b9effd640 1 -- 172.21.15.87:0/3221248458 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f0ba003ab80 con 0x7f0bb0101ec0 2024-09-17T07:10:38.843 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:38.210+0000 7f0b9effd640 1 -- 172.21.15.87:0/3221248458 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f0ba00443c0 con 0x7f0bb0101ec0 2024-09-17T07:10:38.843 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:38.211+0000 7f0bb4cde640 1 -- 172.21.15.87:0/3221248458 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bb0103b50 con 0x7f0bb0101ec0 2024-09-17T07:10:38.843 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:38.213+0000 7f0b9effd640 1 -- 172.21.15.87:0/3221248458 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f0ba0037070 con 0x7f0bb0101ec0 2024-09-17T07:10:38.843 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:38.268+0000 7f0bb4cde640 1 -- 172.21.15.87:0/3221248458 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f0bb0077840 con 0x7f0bb0101ec0 2024-09-17T07:10:38.843 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:38.268+0000 7f0b9effd640 1 -- 172.21.15.87:0/3221248458 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7f0ba003ba20 con 0x7f0bb0101ec0 2024-09-17T07:10:38.843 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:38.269+0000 7f0bb4cde640 1 -- 172.21.15.87:0/3221248458 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0bb0101ec0 msgr2=0x7f0bb0078bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:10:38.844 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:38.269+0000 7f0bb4cde640 1 --2- 172.21.15.87:0/3221248458 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0bb0101ec0 0x7f0bb0078bc0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0ba002a7a0 tx=0x7f0ba0008040 comp rx=0 tx=0).stop 2024-09-17T07:10:38.844 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:38.269+0000 7f0bb4cde640 1 -- 172.21.15.87:0/3221248458 shutdown_connections 2024-09-17T07:10:38.844 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:38.269+0000 7f0bb4cde640 1 --2- 172.21.15.87:0/3221248458 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0bb0101ec0 0x7f0bb0078bc0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:10:38.844 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:38.269+0000 7f0bb4cde640 1 -- 172.21.15.87:0/3221248458 >> 172.21.15.87:0/3221248458 conn(0x7f0bb00fd680 msgr2=0x7f0bb00fe230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:10:38.844 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:38.269+0000 7f0bb4cde640 1 -- 172.21.15.87:0/3221248458 shutdown_connections 2024-09-17T07:10:38.844 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:38.269+0000 7f0bb4cde640 1 -- 172.21.15.87:0/3221248458 wait complete. 2024-09-17T07:10:38.844 INFO:teuthology.orchestra.run.smithi087.stdout:Restarting the monitor... 2024-09-17T07:10:38.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:38 smithi087 ceph-mon[27268]: from='client.? 172.21.15.87:0/3221248458' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:10:38.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:38 smithi087 systemd[1]: Stopping Ceph mon.smithi087 for d5dbf8d6-74c3-11ef-bceb-c7b262605968... 2024-09-17T07:10:39.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:39 smithi087 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-mon-smithi087[27264]: 2024-09-17T07:10:39.092+0000 7f022c256640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi087 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T07:10:39.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:39 smithi087 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-mon-smithi087[27264]: 2024-09-17T07:10:39.092+0000 7f022c256640 -1 mon.smithi087@0(leader) e1 *** Got Signal Terminated *** 2024-09-17T07:10:39.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:39 smithi087 podman[27512]: 2024-09-17 07:10:39.114515881 +0000 UTC m=+0.122141914 container died 63dfc15875d4ff713c4d851c96355723cf3b9003dba75c5512f41ff35ad0a99b (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-mon-smithi087, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, RELEASE=quincy-4a70413, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-17T07:10:39.728 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:39 smithi087 podman[27512]: 2024-09-17 07:10:39.460280329 +0000 UTC m=+0.467906352 container cleanup 63dfc15875d4ff713c4d851c96355723cf3b9003dba75c5512f41ff35ad0a99b (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-mon-smithi087, RELEASE=quincy-4a70413, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-17T07:10:39.728 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:39 smithi087 bash[27512]: ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-mon-smithi087 2024-09-17T07:10:40.062 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:39 smithi087 podman[27525]: 2024-09-17 07:10:39.728268246 +0000 UTC m=+0.613383874 container remove 63dfc15875d4ff713c4d851c96355723cf3b9003dba75c5512f41ff35ad0a99b (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-mon-smithi087, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=quincy-4a70413, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T07:10:40.062 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:39 smithi087 systemd[1]: ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968@mon.smithi087.service: Deactivated successfully. 2024-09-17T07:10:40.062 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:39 smithi087 systemd[1]: Stopped Ceph mon.smithi087 for d5dbf8d6-74c3-11ef-bceb-c7b262605968. 2024-09-17T07:10:40.062 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:39 smithi087 systemd[1]: Starting Ceph mon.smithi087 for d5dbf8d6-74c3-11ef-bceb-c7b262605968... 2024-09-17T07:10:40.348 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 podman[27618]: 2024-09-17 07:10:40.062342132 +0000 UTC m=+0.091772172 container create 175785e1fb86e331535b3cbce3f96947927893ecbe509fc4a0fe912e080a9ae1 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-mon-smithi087, RELEASE=quincy-4a70413, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-17T07:10:40.348 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 podman[27618]: 2024-09-17 07:10:39.985710567 +0000 UTC m=+0.015140619 image pull f22ead590badffde0cfa54f24f421cfc85eb73db2472525e9773349cda0adf30 quay.ceph.io/ceph-ci/ceph:quincy 2024-09-17T07:10:40.348 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 podman[27618]: 2024-09-17 07:10:40.264674958 +0000 UTC m=+0.294105006 container init 175785e1fb86e331535b3cbce3f96947927893ecbe509fc4a0fe912e080a9ae1 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-mon-smithi087, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-4a70413, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=) 2024-09-17T07:10:40.349 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 podman[27618]: 2024-09-17 07:10:40.267759834 +0000 UTC m=+0.297189877 container start 175785e1fb86e331535b3cbce3f96947927893ecbe509fc4a0fe912e080a9ae1 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-mon-smithi087, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=quincy-4a70413, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-17T07:10:40.349 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: set uid:gid to 167:167 (ceph:ceph) 2024-09-17T07:10:40.349 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable), process ceph-mon, pid 2 2024-09-17T07:10:40.349 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: pidfile_write: ignore empty --pid-file 2024-09-17T07:10:40.349 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: load: jerasure load: lrc 2024-09-17T07:10:40.349 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: RocksDB version: 6.15.5 2024-09-17T07:10:40.349 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-09-17T07:10:40.349 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Compile date Sep 16 2024 2024-09-17T07:10:40.349 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: DB SUMMARY 2024-09-17T07:10:40.349 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: DB Session ID: L4O8KYU07WIHE3W67I35 2024-09-17T07:10:40.349 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: CURRENT file: CURRENT 2024-09-17T07:10:40.350 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: IDENTITY file: IDENTITY 2024-09-17T07:10:40.350 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: MANIFEST file: MANIFEST-000009 size: 131 Bytes 2024-09-17T07:10:40.350 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi087/store.db dir, Total Num: 1, files: 000008.sst 2024-09-17T07:10:40.350 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi087/store.db: 000010.log size: 97142 ; 2024-09-17T07:10:40.350 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.error_if_exists: 0 2024-09-17T07:10:40.350 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.create_if_missing: 0 2024-09-17T07:10:40.350 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.paranoid_checks: 1 2024-09-17T07:10:40.350 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-17T07:10:40.350 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.env: 0x55e9dd63e440 2024-09-17T07:10:40.350 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.fs: Posix File System 2024-09-17T07:10:40.350 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.info_log: 0x55e9dfa390c0 2024-09-17T07:10:40.350 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.max_file_opening_threads: 16 2024-09-17T07:10:40.350 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.statistics: (nil) 2024-09-17T07:10:40.350 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.use_fsync: 0 2024-09-17T07:10:40.351 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.max_log_file_size: 0 2024-09-17T07:10:40.351 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-17T07:10:40.351 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-17T07:10:40.351 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.keep_log_file_num: 1000 2024-09-17T07:10:40.351 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.recycle_log_file_num: 0 2024-09-17T07:10:40.351 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.allow_fallocate: 1 2024-09-17T07:10:40.351 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.allow_mmap_reads: 0 2024-09-17T07:10:40.351 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.allow_mmap_writes: 0 2024-09-17T07:10:40.351 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.use_direct_reads: 0 2024-09-17T07:10:40.351 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-17T07:10:40.351 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.create_missing_column_families: 0 2024-09-17T07:10:40.351 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.db_log_dir: 2024-09-17T07:10:40.351 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi087/store.db 2024-09-17T07:10:40.351 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-17T07:10:40.352 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-17T07:10:40.352 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-17T07:10:40.352 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-17T07:10:40.352 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-17T07:10:40.352 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-17T07:10:40.352 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.advise_random_on_open: 1 2024-09-17T07:10:40.352 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.db_write_buffer_size: 0 2024-09-17T07:10:40.352 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.write_buffer_manager: 0x55e9dfaf6870 2024-09-17T07:10:40.352 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-17T07:10:40.352 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-09-17T07:10:40.352 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-17T07:10:40.352 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-17T07:10:40.352 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.rate_limiter: (nil) 2024-09-17T07:10:40.352 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-17T07:10:40.353 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.wal_recovery_mode: 2 2024-09-17T07:10:40.353 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.enable_thread_tracking: 0 2024-09-17T07:10:40.353 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.enable_pipelined_write: 0 2024-09-17T07:10:40.354 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.unordered_write: 0 2024-09-17T07:10:40.354 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-17T07:10:40.354 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-17T07:10:40.354 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-17T07:10:40.355 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-17T07:10:40.355 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.row_cache: None 2024-09-17T07:10:40.355 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.wal_filter: None 2024-09-17T07:10:40.355 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-17T07:10:40.355 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.allow_ingest_behind: 0 2024-09-17T07:10:40.355 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.preserve_deletes: 0 2024-09-17T07:10:40.355 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.two_write_queues: 0 2024-09-17T07:10:40.355 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.manual_wal_flush: 0 2024-09-17T07:10:40.355 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.atomic_flush: 0 2024-09-17T07:10:40.355 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-17T07:10:40.355 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-17T07:10:40.355 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-17T07:10:40.355 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.log_readahead_size: 0 2024-09-17T07:10:40.355 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-17T07:10:40.356 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.best_efforts_recovery: 0 2024-09-17T07:10:40.356 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-17T07:10:40.356 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-17T07:10:40.356 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.allow_data_in_errors: 0 2024-09-17T07:10:40.356 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.db_host_id: __hostname__ 2024-09-17T07:10:40.356 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.max_background_jobs: 2 2024-09-17T07:10:40.356 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.max_background_compactions: -1 2024-09-17T07:10:40.356 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.max_subcompactions: 1 2024-09-17T07:10:40.356 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-17T07:10:40.356 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-17T07:10:40.356 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-17T07:10:40.356 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.max_total_wal_size: 0 2024-09-17T07:10:40.356 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-17T07:10:40.357 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-17T07:10:40.357 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-17T07:10:40.357 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-17T07:10:40.357 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.max_open_files: -1 2024-09-17T07:10:40.357 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.bytes_per_sync: 0 2024-09-17T07:10:40.357 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-17T07:10:40.357 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-17T07:10:40.357 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.compaction_readahead_size: 0 2024-09-17T07:10:40.357 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.max_background_flushes: -1 2024-09-17T07:10:40.357 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Compression algorithms supported: 2024-09-17T07:10:40.357 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: kZSTD supported: 0 2024-09-17T07:10:40.357 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: kXpressCompression supported: 0 2024-09-17T07:10:40.357 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: kBZip2Compression supported: 0 2024-09-17T07:10:40.358 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-17T07:10:40.358 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: kLZ4Compression supported: 1 2024-09-17T07:10:40.358 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: kZlibCompression supported: 1 2024-09-17T07:10:40.358 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: kLZ4HCCompression supported: 1 2024-09-17T07:10:40.358 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: kSnappyCompression supported: 1 2024-09-17T07:10:40.358 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-17T07:10:40.358 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi087/store.db/MANIFEST-000009 2024-09-17T07:10:40.358 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2024-09-17T07:10:40.358 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-17T07:10:40.358 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.merge_operator: 2024-09-17T07:10:40.358 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.compaction_filter: None 2024-09-17T07:10:40.358 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.compaction_filter_factory: None 2024-09-17T07:10:40.358 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.sst_partitioner_factory: None 2024-09-17T07:10:40.358 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-17T07:10:40.359 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-17T07:10:40.359 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55e9df9dfa38) 2024-09-17T07:10:40.359 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: cache_index_and_filter_blocks: 1 2024-09-17T07:10:40.359 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-17T07:10:40.359 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-17T07:10:40.359 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: pin_top_level_index_and_filter: 1 2024-09-17T07:10:40.359 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: index_type: 0 2024-09-17T07:10:40.359 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: data_block_index_type: 0 2024-09-17T07:10:40.359 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: index_shortening: 1 2024-09-17T07:10:40.359 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-17T07:10:40.359 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: hash_index_allow_collision: 1 2024-09-17T07:10:40.359 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: checksum: 1 2024-09-17T07:10:40.359 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: no_block_cache: 0 2024-09-17T07:10:40.359 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: block_cache: 0x55e9dfa151f0 2024-09-17T07:10:40.360 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: block_cache_name: BinnedLRUCache 2024-09-17T07:10:40.360 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: block_cache_options: 2024-09-17T07:10:40.360 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: capacity : 536870912 2024-09-17T07:10:40.360 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: num_shard_bits : 4 2024-09-17T07:10:40.360 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: strict_capacity_limit : 0 2024-09-17T07:10:40.360 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: high_pri_pool_ratio: 0.000 2024-09-17T07:10:40.360 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: block_cache_compressed: (nil) 2024-09-17T07:10:40.360 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: persistent_cache: (nil) 2024-09-17T07:10:40.360 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: block_size: 4096 2024-09-17T07:10:40.360 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: block_size_deviation: 10 2024-09-17T07:10:40.360 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: block_restart_interval: 16 2024-09-17T07:10:40.360 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: index_block_restart_interval: 1 2024-09-17T07:10:40.360 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: metadata_block_size: 4096 2024-09-17T07:10:40.361 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: partition_filters: 0 2024-09-17T07:10:40.361 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: use_delta_encoding: 1 2024-09-17T07:10:40.361 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2024-09-17T07:10:40.361 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: whole_key_filtering: 1 2024-09-17T07:10:40.361 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: verify_compression: 0 2024-09-17T07:10:40.361 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: read_amp_bytes_per_bit: 0 2024-09-17T07:10:40.361 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: format_version: 4 2024-09-17T07:10:40.361 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: enable_index_compression: 1 2024-09-17T07:10:40.361 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: block_align: 0 2024-09-17T07:10:40.361 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.write_buffer_size: 33554432 2024-09-17T07:10:40.361 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.max_write_buffer_number: 2 2024-09-17T07:10:40.361 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.compression: NoCompression 2024-09-17T07:10:40.361 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.bottommost_compression: Disabled 2024-09-17T07:10:40.362 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.prefix_extractor: nullptr 2024-09-17T07:10:40.362 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-17T07:10:40.362 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.num_levels: 7 2024-09-17T07:10:40.362 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-17T07:10:40.362 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-17T07:10:40.362 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-17T07:10:40.362 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-17T07:10:40.362 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-17T07:10:40.362 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-17T07:10:40.362 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-17T07:10:40.362 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-17T07:10:40.362 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-17T07:10:40.362 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-17T07:10:40.362 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-17T07:10:40.363 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.compression_opts.level: 32767 2024-09-17T07:10:40.363 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.compression_opts.strategy: 0 2024-09-17T07:10:40.363 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-17T07:10:40.363 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-17T07:10:40.363 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-17T07:10:40.363 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.compression_opts.enabled: false 2024-09-17T07:10:40.363 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-17T07:10:40.363 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-17T07:10:40.363 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-17T07:10:40.363 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.target_file_size_base: 67108864 2024-09-17T07:10:40.363 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-17T07:10:40.363 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-17T07:10:40.363 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-17T07:10:40.363 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-17T07:10:40.363 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-17T07:10:40.364 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-17T07:10:40.364 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-17T07:10:40.364 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-17T07:10:40.364 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-17T07:10:40.364 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-17T07:10:40.364 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-17T07:10:40.364 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-17T07:10:40.364 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-17T07:10:40.364 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.arena_block_size: 4194304 2024-09-17T07:10:40.364 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-17T07:10:40.364 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-17T07:10:40.364 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-09-17T07:10:40.364 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.disable_auto_compactions: 0 2024-09-17T07:10:40.365 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-17T07:10:40.365 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-17T07:10:40.365 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-17T07:10:40.365 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-17T07:10:40.365 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-17T07:10:40.365 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-17T07:10:40.365 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-17T07:10:40.365 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-17T07:10:40.365 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-17T07:10:40.365 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-17T07:10:40.365 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-17T07:10:40.365 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.inplace_update_support: 0 2024-09-17T07:10:40.365 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-17T07:10:40.366 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-17T07:10:40.366 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-17T07:10:40.366 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-17T07:10:40.366 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.bloom_locality: 0 2024-09-17T07:10:40.366 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.max_successive_merges: 0 2024-09-17T07:10:40.366 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-17T07:10:40.366 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.paranoid_file_checks: 0 2024-09-17T07:10:40.366 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.force_consistency_checks: 1 2024-09-17T07:10:40.366 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.report_bg_io_stats: 0 2024-09-17T07:10:40.366 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.ttl: 2592000 2024-09-17T07:10:40.366 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-17T07:10:40.366 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.enable_blob_files: false 2024-09-17T07:10:40.366 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.min_blob_size: 0 2024-09-17T07:10:40.366 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.blob_file_size: 268435456 2024-09-17T07:10:40.367 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-17T07:10:40.367 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-17T07:10:40.367 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-17T07:10:40.367 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi087/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 11, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-17T07:10:40.367 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 5 2024-09-17T07:10:40.367 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: [db/version_set.cc:4082] Creating manifest 13 2024-09-17T07:10:40.367 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726557040290715, "job": 1, "event": "recovery_started", "wal_files": [10]} 2024-09-17T07:10:40.367 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #10 mode 2 2024-09-17T07:10:40.367 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-09-17T07:10:40.367 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726557040291603, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 14, "file_size": 92491, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 90560, "index_size": 265, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13316, "raw_average_key_size": 49, "raw_value_size": 83264, "raw_average_value_size": 309, "num_data_blocks": 11, "num_entries": 269, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1726557040, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "959c34fc-1edc-4e4c-b911-38d18c38c915", "db_session_id": "L4O8KYU07WIHE3W67I35"}} 2024-09-17T07:10:40.367 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: [db/version_set.cc:4082] Creating manifest 15 2024-09-17T07:10:40.367 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726557040292005, "job": 1, "event": "recovery_finished"} 2024-09-17T07:10:40.367 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-smithi087/store.db/000010.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-17T07:10:40.368 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x55e9dfa48700 2024-09-17T07:10:40.368 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: DB pointer 0x55e9dfa18000 2024-09-17T07:10:40.368 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2024-09-17T07:10:40.368 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: rocksdb: [db/db_impl/db_impl.cc:903] 2024-09-17T07:10:40.368 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: ** DB Stats ** 2024-09-17T07:10:40.368 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-17T07:10:40.368 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-17T07:10:40.368 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-17T07:10:40.368 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-17T07:10:40.368 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-17T07:10:40.368 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-09-17T07:10:40.368 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-17T07:10:40.369 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: 2024-09-17T07:10:40.369 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: ** Compaction Stats [default] ** 2024-09-17T07:10:40.369 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-17T07:10:40.369 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-17T07:10:40.369 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: L0 2/0 92.15 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 141.6 0.00 0.00 1 0.001 0 0 2024-09-17T07:10:40.369 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Sum 2/0 92.15 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 141.6 0.00 0.00 1 0.001 0 0 2024-09-17T07:10:40.369 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 141.6 0.00 0.00 1 0.001 0 0 2024-09-17T07:10:40.369 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: 2024-09-17T07:10:40.369 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: ** Compaction Stats [default] ** 2024-09-17T07:10:40.369 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-17T07:10:40.369 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-17T07:10:40.369 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 141.6 0.00 0.00 1 0.001 0 0 2024-09-17T07:10:40.369 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-17T07:10:40.370 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-17T07:10:40.370 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-17T07:10:40.370 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-17T07:10:40.370 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-17T07:10:40.370 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-17T07:10:40.370 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Cumulative compaction: 0.00 GB write, 26.96 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-17T07:10:40.370 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Interval compaction: 0.00 GB write, 26.96 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-17T07:10:40.370 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-17T07:10:40.370 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: 2024-09-17T07:10:40.370 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-17T07:10:40.370 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: 2024-09-17T07:10:40.370 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: ** Compaction Stats [default] ** 2024-09-17T07:10:40.370 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-17T07:10:40.371 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-17T07:10:40.371 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: L0 2/0 92.15 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 141.6 0.00 0.00 1 0.001 0 0 2024-09-17T07:10:40.371 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Sum 2/0 92.15 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 141.6 0.00 0.00 1 0.001 0 0 2024-09-17T07:10:40.371 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-09-17T07:10:40.371 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: 2024-09-17T07:10:40.371 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: ** Compaction Stats [default] ** 2024-09-17T07:10:40.371 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-17T07:10:40.371 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-17T07:10:40.371 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 141.6 0.00 0.00 1 0.001 0 0 2024-09-17T07:10:40.371 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-17T07:10:40.371 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-17T07:10:40.371 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-17T07:10:40.371 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-17T07:10:40.371 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-17T07:10:40.371 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-17T07:10:40.372 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Cumulative compaction: 0.00 GB write, 26.70 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-17T07:10:40.372 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-17T07:10:40.372 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-17T07:10:40.372 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: 2024-09-17T07:10:40.372 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-17T07:10:40.372 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: starting mon.smithi087 rank 0 at public addrs [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] at bind addrs [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi087 fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 2024-09-17T07:10:40.372 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: mon.smithi087@-1(???) e1 preinit fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 2024-09-17T07:10:40.372 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: mon.smithi087@-1(???).mds e1 new map 2024-09-17T07:10:40.372 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: mon.smithi087@-1(???).mds e1 print_map 2024-09-17T07:10:40.372 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: e1 2024-09-17T07:10:40.372 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T07:10:40.372 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T07:10:40.372 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: legacy client fscid: -1 2024-09-17T07:10:40.373 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: 2024-09-17T07:10:40.373 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: No filesystems configured 2024-09-17T07:10:40.373 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: mon.smithi087@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-17T07:10:40.373 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: mon.smithi087@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-17T07:10:40.373 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: mon.smithi087@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-17T07:10:40.373 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: mon.smithi087@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-17T07:10:40.373 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: mon.smithi087@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-17T07:10:40.373 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 bash[27618]: 175785e1fb86e331535b3cbce3f96947927893ecbe509fc4a0fe912e080a9ae1 2024-09-17T07:10:40.373 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 systemd[1]: Started Ceph mon.smithi087 for d5dbf8d6-74c3-11ef-bceb-c7b262605968. 2024-09-17T07:10:40.373 INFO:teuthology.orchestra.run.smithi087.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-17T07:10:40.659 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: mon.smithi087 is new leader, mons smithi087 in quorum (ranks 0) 2024-09-17T07:10:40.659 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: monmap e1: 1 mons at {smithi087=[v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-17T07:10:40.659 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: fsmap 2024-09-17T07:10:40.659 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: osdmap e1: 0 total, 0 up, 0 in 2024-09-17T07:10:40.659 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:40 smithi087 ceph-mon[27636]: mgrmap e1: no daemons active 2024-09-17T07:10:41.398 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:40.736+0000 7f4e74b5a640 1 Processor -- start 2024-09-17T07:10:41.403 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:40.736+0000 7f4e74b5a640 1 -- start start 2024-09-17T07:10:41.403 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:40.736+0000 7f4e74b5a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e70101ec0 0x7f4e701022d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:10:41.403 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:40.736+0000 7f4e74b5a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e70102810 con 0x7f4e70101ec0 2024-09-17T07:10:41.403 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:40.737+0000 7f4e6e59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e70101ec0 0x7f4e701022d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:10:41.403 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:40.737+0000 7f4e6e59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e70101ec0 0x7f4e701022d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49080/0 (socket says 172.21.15.87:49080) 2024-09-17T07:10:41.403 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:40.737+0000 7f4e6e59c640 1 -- 172.21.15.87:0/4153099362 learned_addr learned my addr 172.21.15.87:0/4153099362 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:10:41.403 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:40.737+0000 7f4e6e59c640 1 -- 172.21.15.87:0/4153099362 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e70102950 con 0x7f4e70101ec0 2024-09-17T07:10:41.403 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:40.739+0000 7f4e6e59c640 1 --2- 172.21.15.87:0/4153099362 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e70101ec0 0x7f4e701022d0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f4e60009840 tx=0x7f4e600091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acb14f89a6f71893 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:10:41.403 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:40.739+0000 7f4e6d59a640 1 -- 172.21.15.87:0/4153099362 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4e60032440 con 0x7f4e70101ec0 2024-09-17T07:10:41.404 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:40.739+0000 7f4e6d59a640 1 -- 172.21.15.87:0/4153099362 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 970+0+0 (secure 0 0 0) 0x7f4e600329e0 con 0x7f4e70101ec0 2024-09-17T07:10:41.404 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:40.739+0000 7f4e6d59a640 1 -- 172.21.15.87:0/4153099362 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4e60031930 con 0x7f4e70101ec0 2024-09-17T07:10:41.404 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:40.739+0000 7f4e74b5a640 1 -- 172.21.15.87:0/4153099362 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e70101ec0 msgr2=0x7f4e701022d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:10:41.404 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:40.739+0000 7f4e74b5a640 1 --2- 172.21.15.87:0/4153099362 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e70101ec0 0x7f4e701022d0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f4e60009840 tx=0x7f4e600091d0 comp rx=0 tx=0).stop 2024-09-17T07:10:41.404 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:40.740+0000 7f4e74b5a640 1 -- 172.21.15.87:0/4153099362 shutdown_connections 2024-09-17T07:10:41.404 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:40.740+0000 7f4e74b5a640 1 --2- 172.21.15.87:0/4153099362 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e70101ec0 0x7f4e701022d0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:10:41.404 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:40.740+0000 7f4e74b5a640 1 -- 172.21.15.87:0/4153099362 >> 172.21.15.87:0/4153099362 conn(0x7f4e700fd5e0 msgr2=0x7f4e700ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:10:41.404 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:40.740+0000 7f4e74b5a640 1 -- 172.21.15.87:0/4153099362 shutdown_connections 2024-09-17T07:10:41.404 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:40.740+0000 7f4e74b5a640 1 -- 172.21.15.87:0/4153099362 wait complete. 2024-09-17T07:10:41.404 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:40.740+0000 7f4e74b5a640 1 Processor -- start 2024-09-17T07:10:41.404 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:40.740+0000 7f4e74b5a640 1 -- start start 2024-09-17T07:10:41.404 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:40.740+0000 7f4e74b5a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e70101ec0 0x7f4e70110b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:10:41.404 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:40.740+0000 7f4e74b5a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e70111050 con 0x7f4e70101ec0 2024-09-17T07:10:41.405 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:40.740+0000 7f4e6e59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e70101ec0 0x7f4e70110b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:10:41.405 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:40.740+0000 7f4e6e59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e70101ec0 0x7f4e70110b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49084/0 (socket says 172.21.15.87:49084) 2024-09-17T07:10:41.405 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:40.740+0000 7f4e6e59c640 1 -- 172.21.15.87:0/425023742 learned_addr learned my addr 172.21.15.87:0/425023742 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:10:41.405 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:40.741+0000 7f4e6e59c640 1 -- 172.21.15.87:0/425023742 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e60009450 con 0x7f4e70101ec0 2024-09-17T07:10:41.405 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:40.741+0000 7f4e6e59c640 1 --2- 172.21.15.87:0/425023742 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e70101ec0 0x7f4e70110b10 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f4e600098a0 tx=0x7f4e60008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:10:41.405 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:40.741+0000 7f4e5effd640 1 -- 172.21.15.87:0/425023742 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4e600327b0 con 0x7f4e70101ec0 2024-09-17T07:10:41.405 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:40.741+0000 7f4e5effd640 1 -- 172.21.15.87:0/425023742 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 970+0+0 (secure 0 0 0) 0x7f4e6003d890 con 0x7f4e70101ec0 2024-09-17T07:10:41.405 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:40.741+0000 7f4e74b5a640 1 -- 172.21.15.87:0/425023742 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e70111250 con 0x7f4e70101ec0 2024-09-17T07:10:41.405 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:40.741+0000 7f4e5effd640 1 -- 172.21.15.87:0/425023742 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4e6003b780 con 0x7f4e70101ec0 2024-09-17T07:10:41.405 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:40.741+0000 7f4e74b5a640 1 -- 172.21.15.87:0/425023742 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e701116c0 con 0x7f4e70101ec0 2024-09-17T07:10:41.405 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:40.741+0000 7f4e5effd640 1 -- 172.21.15.87:0/425023742 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f4e60039070 con 0x7f4e70101ec0 2024-09-17T07:10:41.405 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:40.741+0000 7f4e5effd640 1 -- 172.21.15.87:0/425023742 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f4e60046670 con 0x7f4e70101ec0 2024-09-17T07:10:41.405 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:40.742+0000 7f4e74b5a640 1 -- 172.21.15.87:0/425023742 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e7004b720 con 0x7f4e70101ec0 2024-09-17T07:10:41.405 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:40.744+0000 7f4e5effd640 1 -- 172.21.15.87:0/425023742 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f4e600657a0 con 0x7f4e70101ec0 2024-09-17T07:10:41.406 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:40.800+0000 7f4e74b5a640 1 -- 172.21.15.87:0/425023742 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7f4e70103b40 con 0x7f4e70101ec0 2024-09-17T07:10:41.406 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:40.805+0000 7f4e5effd640 1 -- 172.21.15.87:0/425023742 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7f4e60054020 con 0x7f4e70101ec0 2024-09-17T07:10:41.406 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:40.806+0000 7f4e74b5a640 1 -- 172.21.15.87:0/425023742 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e70101ec0 msgr2=0x7f4e70110b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:10:41.406 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:40.806+0000 7f4e74b5a640 1 --2- 172.21.15.87:0/425023742 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e70101ec0 0x7f4e70110b10 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f4e600098a0 tx=0x7f4e60008040 comp rx=0 tx=0).stop 2024-09-17T07:10:41.406 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:40.806+0000 7f4e74b5a640 1 -- 172.21.15.87:0/425023742 shutdown_connections 2024-09-17T07:10:41.406 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:40.806+0000 7f4e74b5a640 1 --2- 172.21.15.87:0/425023742 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e70101ec0 0x7f4e70110b10 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:10:41.406 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:40.806+0000 7f4e74b5a640 1 -- 172.21.15.87:0/425023742 >> 172.21.15.87:0/425023742 conn(0x7f4e700fd5e0 msgr2=0x7f4e700fe190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:10:41.406 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:40.806+0000 7f4e74b5a640 1 -- 172.21.15.87:0/425023742 shutdown_connections 2024-09-17T07:10:41.406 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:40.806+0000 7f4e74b5a640 1 -- 172.21.15.87:0/425023742 wait complete. 2024-09-17T07:10:41.406 INFO:teuthology.orchestra.run.smithi087.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-17T07:10:41.406 INFO:teuthology.orchestra.run.smithi087.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-17T07:10:41.406 INFO:teuthology.orchestra.run.smithi087.stdout:Creating mgr... 2024-09-17T07:10:41.406 INFO:teuthology.orchestra.run.smithi087.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-17T07:10:41.406 INFO:teuthology.orchestra.run.smithi087.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-17T07:10:41.407 INFO:teuthology.orchestra.run.smithi087.stdout:Verifying port 0.0.0.0:8443 ... 2024-09-17T07:10:41.575 INFO:teuthology.orchestra.run.smithi087.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968@mgr.smithi087.vuvjer 2024-09-17T07:10:41.576 INFO:teuthology.orchestra.run.smithi087.stdout:systemctl: stderr Failed to reset failed state of unit ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968@mgr.smithi087.vuvjer.service: Unit ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968@mgr.smithi087.vuvjer.service not loaded. 2024-09-17T07:10:41.726 INFO:teuthology.orchestra.run.smithi087.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968.target.wants/ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968@mgr.smithi087.vuvjer.service → /etc/systemd/system/ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968@.service. 2024-09-17T07:10:42.032 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:41 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/425023742' entity='client.admin' 2024-09-17T07:10:42.238 INFO:teuthology.orchestra.run.smithi087.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-17T07:10:42.238 INFO:teuthology.orchestra.run.smithi087.stdout:systemctl: stdout disabled 2024-09-17T07:10:42.246 INFO:teuthology.orchestra.run.smithi087.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-17T07:10:42.246 INFO:teuthology.orchestra.run.smithi087.stdout:systemctl: stdout inactive 2024-09-17T07:10:42.246 INFO:teuthology.orchestra.run.smithi087.stdout:firewalld.service is not enabled 2024-09-17T07:10:42.246 INFO:teuthology.orchestra.run.smithi087.stdout:Not possible to enable service . firewalld.service is not available 2024-09-17T07:10:42.255 INFO:teuthology.orchestra.run.smithi087.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-17T07:10:42.255 INFO:teuthology.orchestra.run.smithi087.stdout:systemctl: stdout disabled 2024-09-17T07:10:42.263 INFO:teuthology.orchestra.run.smithi087.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-17T07:10:42.263 INFO:teuthology.orchestra.run.smithi087.stdout:systemctl: stdout inactive 2024-09-17T07:10:42.263 INFO:teuthology.orchestra.run.smithi087.stdout:firewalld.service is not enabled 2024-09-17T07:10:42.263 INFO:teuthology.orchestra.run.smithi087.stdout:Not possible to open ports <[9283, 8765, 8443]>. firewalld.service is not available 2024-09-17T07:10:42.263 INFO:teuthology.orchestra.run.smithi087.stdout:Waiting for mgr to start... 2024-09-17T07:10:42.263 INFO:teuthology.orchestra.run.smithi087.stdout:Waiting for mgr... 2024-09-17T07:10:42.911 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:42 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/1730727825' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-17T07:10:43.270 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout 2024-09-17T07:10:43.270 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout { 2024-09-17T07:10:43.270 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "fsid": "d5dbf8d6-74c3-11ef-bceb-c7b262605968", 2024-09-17T07:10:43.270 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "health": { 2024-09-17T07:10:43.270 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-17T07:10:43.270 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-17T07:10:43.270 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-17T07:10:43.271 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout }, 2024-09-17T07:10:43.271 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-17T07:10:43.271 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-17T07:10:43.271 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout 0 2024-09-17T07:10:43.271 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout ], 2024-09-17T07:10:43.271 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-17T07:10:43.271 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "smithi087" 2024-09-17T07:10:43.271 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout ], 2024-09-17T07:10:43.271 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-17T07:10:43.271 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-17T07:10:43.271 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T07:10:43.271 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-09-17T07:10:43.271 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-17T07:10:43.271 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout }, 2024-09-17T07:10:43.272 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-17T07:10:43.272 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T07:10:43.272 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-17T07:10:43.272 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-17T07:10:43.272 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-17T07:10:43.272 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-17T07:10:43.272 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-17T07:10:43.272 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-17T07:10:43.272 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout }, 2024-09-17T07:10:43.272 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-17T07:10:43.272 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-17T07:10:43.272 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-17T07:10:43.272 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-17T07:10:43.273 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-17T07:10:43.273 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-17T07:10:43.273 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-17T07:10:43.273 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-17T07:10:43.273 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-17T07:10:43.273 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout }, 2024-09-17T07:10:43.273 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-17T07:10:43.273 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T07:10:43.273 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-17T07:10:43.273 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-17T07:10:43.273 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout }, 2024-09-17T07:10:43.273 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-17T07:10:43.273 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-17T07:10:43.273 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-17T07:10:43.273 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-17T07:10:43.274 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-17T07:10:43.274 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-17T07:10:43.274 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "restful" 2024-09-17T07:10:43.274 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout ], 2024-09-17T07:10:43.274 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-17T07:10:43.274 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout }, 2024-09-17T07:10:43.274 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-17T07:10:43.274 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T07:10:43.274 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "modified": "2024-09-17T07:10:35.674713+0000", 2024-09-17T07:10:43.274 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-17T07:10:43.274 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout }, 2024-09-17T07:10:43.274 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-17T07:10:43.275 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout } 2024-09-17T07:10:43.275 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:42.668+0000 7fa39a62f640 1 Processor -- start 2024-09-17T07:10:43.275 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:42.668+0000 7fa39a62f640 1 -- start start 2024-09-17T07:10:43.275 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:42.668+0000 7fa39a62f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa394076c20 0x7fa394104900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:10:43.275 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:42.668+0000 7fa39a62f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa394104e40 con 0x7fa394076c20 2024-09-17T07:10:43.275 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:42.669+0000 7fa393fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa394076c20 0x7fa394104900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:10:43.275 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:42.669+0000 7fa393fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa394076c20 0x7fa394104900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49104/0 (socket says 172.21.15.87:49104) 2024-09-17T07:10:43.275 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:42.669+0000 7fa393fff640 1 -- 172.21.15.87:0/3301528614 learned_addr learned my addr 172.21.15.87:0/3301528614 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:10:43.275 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:42.669+0000 7fa393fff640 1 -- 172.21.15.87:0/3301528614 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa394104f80 con 0x7fa394076c20 2024-09-17T07:10:43.275 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:42.670+0000 7fa393fff640 1 --2- 172.21.15.87:0/3301528614 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa394076c20 0x7fa394104900 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fa384009840 tx=0x7fa3840091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82682a747fd8347c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:10:43.275 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:42.670+0000 7fa3937fe640 1 -- 172.21.15.87:0/3301528614 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa384032440 con 0x7fa394076c20 2024-09-17T07:10:43.275 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:42.670+0000 7fa3937fe640 1 -- 172.21.15.87:0/3301528614 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 970+0+0 (secure 0 0 0) 0x7fa3840329e0 con 0x7fa394076c20 2024-09-17T07:10:43.275 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:42.670+0000 7fa3937fe640 1 -- 172.21.15.87:0/3301528614 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa384031930 con 0x7fa394076c20 2024-09-17T07:10:43.275 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:42.671+0000 7fa39a62f640 1 -- 172.21.15.87:0/3301528614 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa394076c20 msgr2=0x7fa394104900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:10:43.276 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:42.671+0000 7fa39a62f640 1 --2- 172.21.15.87:0/3301528614 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa394076c20 0x7fa394104900 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fa384009840 tx=0x7fa3840091d0 comp rx=0 tx=0).stop 2024-09-17T07:10:43.276 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:42.671+0000 7fa39a62f640 1 -- 172.21.15.87:0/3301528614 shutdown_connections 2024-09-17T07:10:43.276 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:42.671+0000 7fa39a62f640 1 --2- 172.21.15.87:0/3301528614 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa394076c20 0x7fa394104900 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:10:43.276 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:42.671+0000 7fa39a62f640 1 -- 172.21.15.87:0/3301528614 >> 172.21.15.87:0/3301528614 conn(0x7fa3940fc430 msgr2=0x7fa3940fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:10:43.276 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:42.671+0000 7fa39a62f640 1 -- 172.21.15.87:0/3301528614 shutdown_connections 2024-09-17T07:10:43.276 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:42.671+0000 7fa39a62f640 1 -- 172.21.15.87:0/3301528614 wait complete. 2024-09-17T07:10:43.276 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:42.671+0000 7fa39a62f640 1 Processor -- start 2024-09-17T07:10:43.276 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:42.671+0000 7fa39a62f640 1 -- start start 2024-09-17T07:10:43.276 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:42.671+0000 7fa39a62f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa394076c20 0x7fa394110ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:10:43.276 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:42.671+0000 7fa39a62f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa394111000 con 0x7fa394076c20 2024-09-17T07:10:43.276 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:42.672+0000 7fa393fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa394076c20 0x7fa394110ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:10:43.276 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:42.672+0000 7fa393fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa394076c20 0x7fa394110ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49120/0 (socket says 172.21.15.87:49120) 2024-09-17T07:10:43.276 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:42.672+0000 7fa393fff640 1 -- 172.21.15.87:0/1730727825 learned_addr learned my addr 172.21.15.87:0/1730727825 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:10:43.277 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:42.672+0000 7fa393fff640 1 -- 172.21.15.87:0/1730727825 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa384009450 con 0x7fa394076c20 2024-09-17T07:10:43.277 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:42.672+0000 7fa393fff640 1 --2- 172.21.15.87:0/1730727825 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa394076c20 0x7fa394110ac0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa384031610 tx=0x7fa384008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:10:43.277 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:42.672+0000 7fa3917fa640 1 -- 172.21.15.87:0/1730727825 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa384032880 con 0x7fa394076c20 2024-09-17T07:10:43.277 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:42.672+0000 7fa39a62f640 1 -- 172.21.15.87:0/1730727825 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa394111200 con 0x7fa394076c20 2024-09-17T07:10:43.277 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:42.672+0000 7fa3917fa640 1 -- 172.21.15.87:0/1730727825 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 970+0+0 (secure 0 0 0) 0x7fa38403d890 con 0x7fa394076c20 2024-09-17T07:10:43.277 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:42.672+0000 7fa3917fa640 1 -- 172.21.15.87:0/1730727825 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa38403b7f0 con 0x7fa394076c20 2024-09-17T07:10:43.277 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:42.672+0000 7fa39a62f640 1 -- 172.21.15.87:0/1730727825 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa394111670 con 0x7fa394076c20 2024-09-17T07:10:43.277 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:42.673+0000 7fa3917fa640 1 -- 172.21.15.87:0/1730727825 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fa384039070 con 0x7fa394076c20 2024-09-17T07:10:43.277 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:42.673+0000 7fa3917fa640 1 -- 172.21.15.87:0/1730727825 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fa384046610 con 0x7fa394076c20 2024-09-17T07:10:43.277 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:42.673+0000 7fa39a62f640 1 -- 172.21.15.87:0/1730727825 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa39404b720 con 0x7fa394076c20 2024-09-17T07:10:43.277 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:42.675+0000 7fa3917fa640 1 -- 172.21.15.87:0/1730727825 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fa3840657a0 con 0x7fa394076c20 2024-09-17T07:10:43.277 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:42.734+0000 7fa39a62f640 1 -- 172.21.15.87:0/1730727825 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fa394111d90 con 0x7fa394076c20 2024-09-17T07:10:43.277 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:42.734+0000 7fa3917fa640 1 -- 172.21.15.87:0/1730727825 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7fa384054020 con 0x7fa394076c20 2024-09-17T07:10:43.278 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:42.735+0000 7fa39a62f640 1 -- 172.21.15.87:0/1730727825 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa394076c20 msgr2=0x7fa394110ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:10:43.278 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:42.735+0000 7fa39a62f640 1 --2- 172.21.15.87:0/1730727825 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa394076c20 0x7fa394110ac0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa384031610 tx=0x7fa384008040 comp rx=0 tx=0).stop 2024-09-17T07:10:43.278 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:42.735+0000 7fa39a62f640 1 -- 172.21.15.87:0/1730727825 shutdown_connections 2024-09-17T07:10:43.278 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:42.735+0000 7fa39a62f640 1 --2- 172.21.15.87:0/1730727825 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa394076c20 0x7fa394110ac0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:10:43.278 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:42.735+0000 7fa39a62f640 1 -- 172.21.15.87:0/1730727825 >> 172.21.15.87:0/1730727825 conn(0x7fa3940fc430 msgr2=0x7fa3940fcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:10:43.278 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:42.735+0000 7fa39a62f640 1 -- 172.21.15.87:0/1730727825 shutdown_connections 2024-09-17T07:10:43.278 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:42.735+0000 7fa39a62f640 1 -- 172.21.15.87:0/1730727825 wait complete. 2024-09-17T07:10:43.278 INFO:teuthology.orchestra.run.smithi087.stdout:mgr not available, waiting (1/15)... 2024-09-17T07:10:46.146 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:45 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/28672382' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-17T07:10:46.400 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout 2024-09-17T07:10:46.401 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout { 2024-09-17T07:10:46.401 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "fsid": "d5dbf8d6-74c3-11ef-bceb-c7b262605968", 2024-09-17T07:10:46.401 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "health": { 2024-09-17T07:10:46.401 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-17T07:10:46.401 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-17T07:10:46.401 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-17T07:10:46.401 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout }, 2024-09-17T07:10:46.401 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-17T07:10:46.401 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-17T07:10:46.401 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout 0 2024-09-17T07:10:46.401 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout ], 2024-09-17T07:10:46.401 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-17T07:10:46.401 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "smithi087" 2024-09-17T07:10:46.401 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout ], 2024-09-17T07:10:46.402 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-09-17T07:10:46.402 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-17T07:10:46.402 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T07:10:46.402 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-09-17T07:10:46.402 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-17T07:10:46.402 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout }, 2024-09-17T07:10:46.402 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-17T07:10:46.402 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T07:10:46.402 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-17T07:10:46.402 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-17T07:10:46.402 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-17T07:10:46.410 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-17T07:10:46.410 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-17T07:10:46.410 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-17T07:10:46.410 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout }, 2024-09-17T07:10:46.410 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-17T07:10:46.410 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-17T07:10:46.411 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-17T07:10:46.411 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-17T07:10:46.411 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-17T07:10:46.411 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-17T07:10:46.411 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-17T07:10:46.411 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-17T07:10:46.411 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-17T07:10:46.411 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout }, 2024-09-17T07:10:46.411 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-17T07:10:46.411 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T07:10:46.411 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-17T07:10:46.411 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-17T07:10:46.411 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout }, 2024-09-17T07:10:46.411 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-17T07:10:46.412 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-17T07:10:46.412 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-17T07:10:46.412 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-17T07:10:46.412 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-17T07:10:46.412 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-17T07:10:46.412 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "restful" 2024-09-17T07:10:46.412 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout ], 2024-09-17T07:10:46.412 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-17T07:10:46.412 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout }, 2024-09-17T07:10:46.412 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-17T07:10:46.412 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T07:10:46.412 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "modified": "2024-09-17T07:10:35.674713+0000", 2024-09-17T07:10:46.412 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-17T07:10:46.412 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout }, 2024-09-17T07:10:46.413 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-17T07:10:46.413 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout } 2024-09-17T07:10:46.413 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:45.725+0000 7f86f7643640 1 Processor -- start 2024-09-17T07:10:46.413 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:45.725+0000 7f86f7643640 1 -- start start 2024-09-17T07:10:46.413 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:45.725+0000 7f86f7643640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86f0100090 0x7f86f01004a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:10:46.413 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:45.725+0000 7f86f7643640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f01009e0 con 0x7f86f0100090 2024-09-17T07:10:46.413 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:45.725+0000 7f86f53df640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86f0100090 0x7f86f01004a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:10:46.413 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:45.725+0000 7f86f53df640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86f0100090 0x7f86f01004a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44752/0 (socket says 172.21.15.87:44752) 2024-09-17T07:10:46.413 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:45.725+0000 7f86f53df640 1 -- 172.21.15.87:0/3777601368 learned_addr learned my addr 172.21.15.87:0/3777601368 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:10:46.413 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:45.726+0000 7f86f53df640 1 -- 172.21.15.87:0/3777601368 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86f0100b20 con 0x7f86f0100090 2024-09-17T07:10:46.413 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:45.726+0000 7f86f53df640 1 --2- 172.21.15.87:0/3777601368 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86f0100090 0x7f86f01004a0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f86ec009840 tx=0x7f86ec0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42f9fde3c930198f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:10:46.413 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:45.726+0000 7f86e7fff640 1 -- 172.21.15.87:0/3777601368 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f86ec032440 con 0x7f86f0100090 2024-09-17T07:10:46.414 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:45.727+0000 7f86e7fff640 1 -- 172.21.15.87:0/3777601368 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 970+0+0 (secure 0 0 0) 0x7f86ec0329e0 con 0x7f86f0100090 2024-09-17T07:10:46.414 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:45.727+0000 7f86e7fff640 1 -- 172.21.15.87:0/3777601368 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f86ec031930 con 0x7f86f0100090 2024-09-17T07:10:46.414 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:45.727+0000 7f86f7643640 1 -- 172.21.15.87:0/3777601368 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86f0100090 msgr2=0x7f86f01004a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:10:46.414 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:45.727+0000 7f86f7643640 1 --2- 172.21.15.87:0/3777601368 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86f0100090 0x7f86f01004a0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f86ec009840 tx=0x7f86ec0091d0 comp rx=0 tx=0).stop 2024-09-17T07:10:46.414 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:45.728+0000 7f86f7643640 1 -- 172.21.15.87:0/3777601368 shutdown_connections 2024-09-17T07:10:46.414 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:45.728+0000 7f86f7643640 1 --2- 172.21.15.87:0/3777601368 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86f0100090 0x7f86f01004a0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:10:46.414 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:45.728+0000 7f86f7643640 1 -- 172.21.15.87:0/3777601368 >> 172.21.15.87:0/3777601368 conn(0x7f86f00fbb70 msgr2=0x7f86f00fdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:10:46.414 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:45.728+0000 7f86f7643640 1 -- 172.21.15.87:0/3777601368 shutdown_connections 2024-09-17T07:10:46.414 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:45.728+0000 7f86f7643640 1 -- 172.21.15.87:0/3777601368 wait complete. 2024-09-17T07:10:46.414 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:45.728+0000 7f86f7643640 1 Processor -- start 2024-09-17T07:10:46.414 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:45.729+0000 7f86f7643640 1 -- start start 2024-09-17T07:10:46.414 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:45.729+0000 7f86f7643640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86f0100090 0x7f86f0110b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:10:46.414 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:45.729+0000 7f86f7643640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f01110b0 con 0x7f86f0100090 2024-09-17T07:10:46.414 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:45.729+0000 7f86f53df640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86f0100090 0x7f86f0110b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:10:46.415 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:45.729+0000 7f86f53df640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86f0100090 0x7f86f0110b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44768/0 (socket says 172.21.15.87:44768) 2024-09-17T07:10:46.415 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:45.729+0000 7f86f53df640 1 -- 172.21.15.87:0/28672382 learned_addr learned my addr 172.21.15.87:0/28672382 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:10:46.415 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:45.729+0000 7f86f53df640 1 -- 172.21.15.87:0/28672382 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86ec009450 con 0x7f86f0100090 2024-09-17T07:10:46.415 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:45.729+0000 7f86f53df640 1 --2- 172.21.15.87:0/28672382 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86f0100090 0x7f86f0110b70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f86ec0098a0 tx=0x7f86ec008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:10:46.415 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:45.729+0000 7f86e5ffb640 1 -- 172.21.15.87:0/28672382 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f86ec0327b0 con 0x7f86f0100090 2024-09-17T07:10:46.415 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:45.729+0000 7f86e5ffb640 1 -- 172.21.15.87:0/28672382 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 970+0+0 (secure 0 0 0) 0x7f86ec03d890 con 0x7f86f0100090 2024-09-17T07:10:46.415 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:45.730+0000 7f86e5ffb640 1 -- 172.21.15.87:0/28672382 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f86ec03b6f0 con 0x7f86f0100090 2024-09-17T07:10:46.415 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:45.730+0000 7f86f7643640 1 -- 172.21.15.87:0/28672382 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86f01112b0 con 0x7f86f0100090 2024-09-17T07:10:46.415 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:45.730+0000 7f86f7643640 1 -- 172.21.15.87:0/28672382 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86f0111720 con 0x7f86f0100090 2024-09-17T07:10:46.415 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:45.730+0000 7f86e5ffb640 1 -- 172.21.15.87:0/28672382 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f86ec039070 con 0x7f86f0100090 2024-09-17T07:10:46.415 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:45.730+0000 7f86e5ffb640 1 -- 172.21.15.87:0/28672382 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f86ec0465c0 con 0x7f86f0100090 2024-09-17T07:10:46.415 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:45.731+0000 7f86f7643640 1 -- 172.21.15.87:0/28672382 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86f0103c20 con 0x7f86f0100090 2024-09-17T07:10:46.415 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:45.733+0000 7f86e5ffb640 1 -- 172.21.15.87:0/28672382 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f86ec0657a0 con 0x7f86f0100090 2024-09-17T07:10:46.416 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:45.793+0000 7f86f7643640 1 -- 172.21.15.87:0/28672382 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f86f004b720 con 0x7f86f0100090 2024-09-17T07:10:46.416 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:45.793+0000 7f86e5ffb640 1 -- 172.21.15.87:0/28672382 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7f86ec054020 con 0x7f86f0100090 2024-09-17T07:10:46.416 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:45.795+0000 7f86f7643640 1 -- 172.21.15.87:0/28672382 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86f0100090 msgr2=0x7f86f0110b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:10:46.416 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:45.795+0000 7f86f7643640 1 --2- 172.21.15.87:0/28672382 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86f0100090 0x7f86f0110b70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f86ec0098a0 tx=0x7f86ec008040 comp rx=0 tx=0).stop 2024-09-17T07:10:46.416 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:45.795+0000 7f86f7643640 1 -- 172.21.15.87:0/28672382 shutdown_connections 2024-09-17T07:10:46.416 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:45.795+0000 7f86f7643640 1 --2- 172.21.15.87:0/28672382 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86f0100090 0x7f86f0110b70 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:10:46.416 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:45.795+0000 7f86f7643640 1 -- 172.21.15.87:0/28672382 >> 172.21.15.87:0/28672382 conn(0x7f86f00fbb70 msgr2=0x7f86f00fc720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:10:46.416 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:45.795+0000 7f86f7643640 1 -- 172.21.15.87:0/28672382 shutdown_connections 2024-09-17T07:10:46.416 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:45.795+0000 7f86f7643640 1 -- 172.21.15.87:0/28672382 wait complete. 2024-09-17T07:10:46.416 INFO:teuthology.orchestra.run.smithi087.stdout:mgr not available, waiting (2/15)... 2024-09-17T07:10:47.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:46 smithi087 ceph-mon[27636]: Activating manager daemon smithi087.vuvjer 2024-09-17T07:10:47.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:46 smithi087 ceph-mon[27636]: mgrmap e2: smithi087.vuvjer(active, starting, since 0.00315908s) 2024-09-17T07:10:47.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:46 smithi087 ceph-mon[27636]: from='mgr.14100 172.21.15.87:0/3010408719' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T07:10:47.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:46 smithi087 ceph-mon[27636]: from='mgr.14100 172.21.15.87:0/3010408719' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T07:10:47.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:46 smithi087 ceph-mon[27636]: from='mgr.14100 172.21.15.87:0/3010408719' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T07:10:47.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:46 smithi087 ceph-mon[27636]: from='mgr.14100 172.21.15.87:0/3010408719' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mon metadata", "id": "smithi087"}]: dispatch 2024-09-17T07:10:47.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:46 smithi087 ceph-mon[27636]: from='mgr.14100 172.21.15.87:0/3010408719' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mgr metadata", "who": "smithi087.vuvjer", "id": "smithi087.vuvjer"}]: dispatch 2024-09-17T07:10:47.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:46 smithi087 ceph-mon[27636]: Manager daemon smithi087.vuvjer is now available 2024-09-17T07:10:47.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:46 smithi087 ceph-mon[27636]: from='mgr.14100 172.21.15.87:0/3010408719' entity='mgr.smithi087.vuvjer' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi087.vuvjer/mirror_snapshot_schedule"}]: dispatch 2024-09-17T07:10:47.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:46 smithi087 ceph-mon[27636]: from='mgr.14100 172.21.15.87:0/3010408719' entity='mgr.smithi087.vuvjer' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi087.vuvjer/trash_purge_schedule"}]: dispatch 2024-09-17T07:10:47.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:46 smithi087 ceph-mon[27636]: from='mgr.14100 172.21.15.87:0/3010408719' entity='mgr.smithi087.vuvjer' 2024-09-17T07:10:47.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:46 smithi087 ceph-mon[27636]: from='mgr.14100 172.21.15.87:0/3010408719' entity='mgr.smithi087.vuvjer' 2024-09-17T07:10:47.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:46 smithi087 ceph-mon[27636]: from='mgr.14100 172.21.15.87:0/3010408719' entity='mgr.smithi087.vuvjer' 2024-09-17T07:10:48.798 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:48 smithi087 ceph-mon[27636]: mgrmap e3: smithi087.vuvjer(active, since 1.00673s) 2024-09-17T07:10:49.606 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout 2024-09-17T07:10:49.606 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout { 2024-09-17T07:10:49.606 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "fsid": "d5dbf8d6-74c3-11ef-bceb-c7b262605968", 2024-09-17T07:10:49.606 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "health": { 2024-09-17T07:10:49.606 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-17T07:10:49.606 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-17T07:10:49.607 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-17T07:10:49.607 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout }, 2024-09-17T07:10:49.607 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-17T07:10:49.607 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-17T07:10:49.607 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout 0 2024-09-17T07:10:49.607 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout ], 2024-09-17T07:10:49.607 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-17T07:10:49.607 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "smithi087" 2024-09-17T07:10:49.607 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout ], 2024-09-17T07:10:49.607 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2024-09-17T07:10:49.607 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-17T07:10:49.607 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T07:10:49.607 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-09-17T07:10:49.607 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-17T07:10:49.608 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout }, 2024-09-17T07:10:49.608 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-17T07:10:49.608 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T07:10:49.608 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-17T07:10:49.608 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-17T07:10:49.608 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-17T07:10:49.616 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-17T07:10:49.616 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-17T07:10:49.616 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-17T07:10:49.616 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout }, 2024-09-17T07:10:49.616 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-17T07:10:49.616 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-17T07:10:49.616 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-17T07:10:49.616 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-17T07:10:49.616 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-17T07:10:49.616 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-17T07:10:49.616 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-17T07:10:49.617 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-17T07:10:49.617 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-17T07:10:49.617 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout }, 2024-09-17T07:10:49.617 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-17T07:10:49.617 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T07:10:49.617 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-17T07:10:49.617 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-17T07:10:49.617 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout }, 2024-09-17T07:10:49.617 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-17T07:10:49.617 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-17T07:10:49.617 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-17T07:10:49.618 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-17T07:10:49.618 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-17T07:10:49.618 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-17T07:10:49.618 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "restful" 2024-09-17T07:10:49.618 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout ], 2024-09-17T07:10:49.618 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-17T07:10:49.618 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout }, 2024-09-17T07:10:49.618 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-17T07:10:49.618 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T07:10:49.618 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "modified": "2024-09-17T07:10:35.674713+0000", 2024-09-17T07:10:49.618 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-17T07:10:49.618 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout }, 2024-09-17T07:10:49.618 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-17T07:10:49.618 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout } 2024-09-17T07:10:49.619 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:48.800+0000 7f0627a90640 1 Processor -- start 2024-09-17T07:10:49.619 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:48.801+0000 7f0627a90640 1 -- start start 2024-09-17T07:10:49.619 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:48.801+0000 7f0627a90640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0620100c40 0x7f0620101050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:10:49.619 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:48.801+0000 7f0627a90640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0620101590 con 0x7f0620100c40 2024-09-17T07:10:49.619 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:48.801+0000 7f062582c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0620100c40 0x7f0620101050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:10:49.619 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:48.801+0000 7f062582c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0620100c40 0x7f0620101050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44866/0 (socket says 172.21.15.87:44866) 2024-09-17T07:10:49.619 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:48.801+0000 7f062582c640 1 -- 172.21.15.87:0/952300004 learned_addr learned my addr 172.21.15.87:0/952300004 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:10:49.619 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:48.801+0000 7f062582c640 1 -- 172.21.15.87:0/952300004 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06201016d0 con 0x7f0620100c40 2024-09-17T07:10:49.619 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:48.802+0000 7f062582c640 1 --2- 172.21.15.87:0/952300004 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0620100c40 0x7f0620101050 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0610009840 tx=0x7f06100091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a053e40945f3373f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:10:49.619 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:48.802+0000 7f062482a640 1 -- 172.21.15.87:0/952300004 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0610032440 con 0x7f0620100c40 2024-09-17T07:10:49.619 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:48.802+0000 7f062482a640 1 -- 172.21.15.87:0/952300004 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 970+0+0 (secure 0 0 0) 0x7f06100329e0 con 0x7f0620100c40 2024-09-17T07:10:49.619 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:48.802+0000 7f062482a640 1 -- 172.21.15.87:0/952300004 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0610031930 con 0x7f0620100c40 2024-09-17T07:10:49.619 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:48.803+0000 7f0627a90640 1 -- 172.21.15.87:0/952300004 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0620100c40 msgr2=0x7f0620101050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:10:49.619 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:48.803+0000 7f0627a90640 1 --2- 172.21.15.87:0/952300004 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0620100c40 0x7f0620101050 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0610009840 tx=0x7f06100091d0 comp rx=0 tx=0).stop 2024-09-17T07:10:49.619 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:48.803+0000 7f0627a90640 1 -- 172.21.15.87:0/952300004 shutdown_connections 2024-09-17T07:10:49.620 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:48.803+0000 7f0627a90640 1 --2- 172.21.15.87:0/952300004 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0620100c40 0x7f0620101050 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:10:49.620 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:48.803+0000 7f0627a90640 1 -- 172.21.15.87:0/952300004 >> 172.21.15.87:0/952300004 conn(0x7f06200fc4a0 msgr2=0x7f06200fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:10:49.620 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:48.803+0000 7f0627a90640 1 -- 172.21.15.87:0/952300004 shutdown_connections 2024-09-17T07:10:49.620 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:48.803+0000 7f0627a90640 1 -- 172.21.15.87:0/952300004 wait complete. 2024-09-17T07:10:49.620 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:48.804+0000 7f0627a90640 1 Processor -- start 2024-09-17T07:10:49.620 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:48.804+0000 7f0627a90640 1 -- start start 2024-09-17T07:10:49.620 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:48.804+0000 7f0627a90640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0620100c40 0x7f062010fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:10:49.620 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:48.804+0000 7f0627a90640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f062010ff70 con 0x7f0620100c40 2024-09-17T07:10:49.620 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:48.804+0000 7f062582c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0620100c40 0x7f062010fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:10:49.620 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:48.804+0000 7f062582c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0620100c40 0x7f062010fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44878/0 (socket says 172.21.15.87:44878) 2024-09-17T07:10:49.620 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:48.804+0000 7f062582c640 1 -- 172.21.15.87:0/3276807166 learned_addr learned my addr 172.21.15.87:0/3276807166 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:10:49.620 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:48.804+0000 7f062582c640 1 -- 172.21.15.87:0/3276807166 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0610009450 con 0x7f0620100c40 2024-09-17T07:10:49.620 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:48.804+0000 7f062582c640 1 --2- 172.21.15.87:0/3276807166 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0620100c40 0x7f062010fa30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0610031920 tx=0x7f0610008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:10:49.621 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:48.805+0000 7f06167fc640 1 -- 172.21.15.87:0/3276807166 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0610031f10 con 0x7f0620100c40 2024-09-17T07:10:49.621 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:48.805+0000 7f06167fc640 1 -- 172.21.15.87:0/3276807166 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 970+0+0 (secure 0 0 0) 0x7f061003d890 con 0x7f0620100c40 2024-09-17T07:10:49.621 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:48.805+0000 7f0627a90640 1 -- 172.21.15.87:0/3276807166 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0620110170 con 0x7f0620100c40 2024-09-17T07:10:49.621 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:48.805+0000 7f06167fc640 1 -- 172.21.15.87:0/3276807166 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f061003b7a0 con 0x7f0620100c40 2024-09-17T07:10:49.621 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:48.805+0000 7f0627a90640 1 -- 172.21.15.87:0/3276807166 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06201105e0 con 0x7f0620100c40 2024-09-17T07:10:49.621 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:48.806+0000 7f06167fc640 1 -- 172.21.15.87:0/3276807166 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 4) v1 ==== 45496+0+0 (secure 0 0 0) 0x7f0610039070 con 0x7f0620100c40 2024-09-17T07:10:49.621 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:48.806+0000 7f0627a90640 1 -- 172.21.15.87:0/3276807166 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0604005240 con 0x7f0620100c40 2024-09-17T07:10:49.621 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:48.806+0000 7f06167fc640 1 --2- 172.21.15.87:0/3276807166 >> [v2:172.21.15.87:6800/2633029569,v1:172.21.15.87:6801/2633029569] conn(0x7f060c039490 0x7f060c03b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:10:49.621 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:48.806+0000 7f06167fc640 1 -- 172.21.15.87:0/3276807166 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f061006cc80 con 0x7f0620100c40 2024-09-17T07:10:49.621 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:48.806+0000 7f062502b640 1 --2- 172.21.15.87:0/3276807166 >> [v2:172.21.15.87:6800/2633029569,v1:172.21.15.87:6801/2633029569] conn(0x7f060c039490 0x7f060c03b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:10:49.621 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:48.806+0000 7f062502b640 1 --2- 172.21.15.87:0/3276807166 >> [v2:172.21.15.87:6800/2633029569,v1:172.21.15.87:6801/2633029569] conn(0x7f060c039490 0x7f060c03b940 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f061c006fd0 tx=0x7f061c006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:10:49.621 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:48.811+0000 7f06167fc640 1 -- 172.21.15.87:0/3276807166 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f061003d450 con 0x7f0620100c40 2024-09-17T07:10:49.621 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:49.023+0000 7f0627a90640 1 -- 172.21.15.87:0/3276807166 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f06040054f0 con 0x7f0620100c40 2024-09-17T07:10:49.621 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:49.023+0000 7f06167fc640 1 -- 172.21.15.87:0/3276807166 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1247 (secure 0 0 0) 0x7f0610041070 con 0x7f0620100c40 2024-09-17T07:10:49.622 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:49.026+0000 7f0627a90640 1 -- 172.21.15.87:0/3276807166 >> [v2:172.21.15.87:6800/2633029569,v1:172.21.15.87:6801/2633029569] conn(0x7f060c039490 msgr2=0x7f060c03b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:10:49.622 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:49.026+0000 7f0627a90640 1 --2- 172.21.15.87:0/3276807166 >> [v2:172.21.15.87:6800/2633029569,v1:172.21.15.87:6801/2633029569] conn(0x7f060c039490 0x7f060c03b940 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f061c006fd0 tx=0x7f061c006db0 comp rx=0 tx=0).stop 2024-09-17T07:10:49.622 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:49.026+0000 7f0627a90640 1 -- 172.21.15.87:0/3276807166 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0620100c40 msgr2=0x7f062010fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:10:49.622 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:49.026+0000 7f0627a90640 1 --2- 172.21.15.87:0/3276807166 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0620100c40 0x7f062010fa30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0610031920 tx=0x7f0610008040 comp rx=0 tx=0).stop 2024-09-17T07:10:49.622 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:49.026+0000 7f0627a90640 1 -- 172.21.15.87:0/3276807166 shutdown_connections 2024-09-17T07:10:49.622 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:49.026+0000 7f0627a90640 1 --2- 172.21.15.87:0/3276807166 >> [v2:172.21.15.87:6800/2633029569,v1:172.21.15.87:6801/2633029569] conn(0x7f060c039490 0x7f060c03b940 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:10:49.622 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:49.026+0000 7f0627a90640 1 --2- 172.21.15.87:0/3276807166 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0620100c40 0x7f062010fa30 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:10:49.622 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:49.026+0000 7f0627a90640 1 -- 172.21.15.87:0/3276807166 >> 172.21.15.87:0/3276807166 conn(0x7f06200fc4a0 msgr2=0x7f06200fd040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:10:49.622 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:49.027+0000 7f0627a90640 1 -- 172.21.15.87:0/3276807166 shutdown_connections 2024-09-17T07:10:49.622 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:49.027+0000 7f0627a90640 1 -- 172.21.15.87:0/3276807166 wait complete. 2024-09-17T07:10:49.622 INFO:teuthology.orchestra.run.smithi087.stdout:mgr is available 2024-09-17T07:10:49.803 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:49 smithi087 ceph-mon[27636]: mgrmap e4: smithi087.vuvjer(active, since 2s) 2024-09-17T07:10:49.803 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:49 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/3276807166' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-17T07:10:50.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:50 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/522490308' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-17T07:10:55.814 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout 2024-09-17T07:10:55.814 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout [global] 2024-09-17T07:10:55.814 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout fsid = d5dbf8d6-74c3-11ef-bceb-c7b262605968 2024-09-17T07:10:55.814 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-17T07:10:55.814 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-17T07:10:55.814 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-17T07:10:55.815 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-17T07:10:55.815 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-17T07:10:55.815 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout 2024-09-17T07:10:55.815 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-17T07:10:55.815 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-17T07:10:55.815 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout 2024-09-17T07:10:55.815 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout [osd] 2024-09-17T07:10:55.815 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-17T07:10:55.815 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-17T07:10:55.815 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-17T07:10:55.815 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-17T07:10:55.815 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-17T07:10:55.815 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:49.963+0000 7f626753b640 1 Processor -- start 2024-09-17T07:10:55.815 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:49.963+0000 7f626753b640 1 -- start start 2024-09-17T07:10:55.816 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:49.963+0000 7f626753b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6260101ec0 0x7f62601022d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:10:55.816 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:49.963+0000 7f626753b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62601028a0 con 0x7f6260101ec0 2024-09-17T07:10:55.816 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:49.963+0000 7f62652d7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6260101ec0 0x7f62601022d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:10:55.816 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:49.963+0000 7f62652d7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6260101ec0 0x7f62601022d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44884/0 (socket says 172.21.15.87:44884) 2024-09-17T07:10:55.816 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:49.963+0000 7f62652d7640 1 -- 172.21.15.87:0/3763485407 learned_addr learned my addr 172.21.15.87:0/3763485407 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:10:55.816 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:49.964+0000 7f62652d7640 1 -- 172.21.15.87:0/3763485407 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62601029e0 con 0x7f6260101ec0 2024-09-17T07:10:55.816 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:49.964+0000 7f62652d7640 1 --2- 172.21.15.87:0/3763485407 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6260101ec0 0x7f62601022d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f625c009840 tx=0x7f625c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14ef2617ed9fa210 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:10:55.816 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:49.964+0000 7f6257fff640 1 -- 172.21.15.87:0/3763485407 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f625c032440 con 0x7f6260101ec0 2024-09-17T07:10:55.816 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:49.964+0000 7f6257fff640 1 -- 172.21.15.87:0/3763485407 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 970+0+0 (secure 0 0 0) 0x7f625c0329e0 con 0x7f6260101ec0 2024-09-17T07:10:55.816 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:49.964+0000 7f6257fff640 1 -- 172.21.15.87:0/3763485407 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f625c031930 con 0x7f6260101ec0 2024-09-17T07:10:55.816 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:49.965+0000 7f626753b640 1 -- 172.21.15.87:0/3763485407 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6260101ec0 msgr2=0x7f62601022d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:10:55.816 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:49.965+0000 7f626753b640 1 --2- 172.21.15.87:0/3763485407 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6260101ec0 0x7f62601022d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f625c009840 tx=0x7f625c0091d0 comp rx=0 tx=0).stop 2024-09-17T07:10:55.816 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:49.965+0000 7f626753b640 1 -- 172.21.15.87:0/3763485407 shutdown_connections 2024-09-17T07:10:55.817 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:49.965+0000 7f626753b640 1 --2- 172.21.15.87:0/3763485407 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6260101ec0 0x7f62601022d0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:10:55.817 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:49.965+0000 7f626753b640 1 -- 172.21.15.87:0/3763485407 >> 172.21.15.87:0/3763485407 conn(0x7f62600fd680 msgr2=0x7f62600ffab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:10:55.817 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:49.965+0000 7f626753b640 1 -- 172.21.15.87:0/3763485407 shutdown_connections 2024-09-17T07:10:55.817 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:49.965+0000 7f626753b640 1 -- 172.21.15.87:0/3763485407 wait complete. 2024-09-17T07:10:55.817 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:49.966+0000 7f626753b640 1 Processor -- start 2024-09-17T07:10:55.817 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:49.966+0000 7f626753b640 1 -- start start 2024-09-17T07:10:55.817 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:49.966+0000 7f626753b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6260101ec0 0x7f6260110b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:10:55.817 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:49.966+0000 7f626753b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6260111070 con 0x7f6260101ec0 2024-09-17T07:10:55.817 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:49.966+0000 7f62652d7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6260101ec0 0x7f6260110b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:10:55.817 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:49.966+0000 7f62652d7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6260101ec0 0x7f6260110b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44888/0 (socket says 172.21.15.87:44888) 2024-09-17T07:10:55.817 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:49.966+0000 7f62652d7640 1 -- 172.21.15.87:0/522490308 learned_addr learned my addr 172.21.15.87:0/522490308 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:10:55.817 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:49.966+0000 7f62652d7640 1 -- 172.21.15.87:0/522490308 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f625c009450 con 0x7f6260101ec0 2024-09-17T07:10:55.817 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:49.966+0000 7f62652d7640 1 --2- 172.21.15.87:0/522490308 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6260101ec0 0x7f6260110b30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f625c02a7a0 tx=0x7f625c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:10:55.818 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:49.966+0000 7f6255ffb640 1 -- 172.21.15.87:0/522490308 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f625c0327b0 con 0x7f6260101ec0 2024-09-17T07:10:55.818 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:49.966+0000 7f6255ffb640 1 -- 172.21.15.87:0/522490308 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 970+0+0 (secure 0 0 0) 0x7f625c03b8b0 con 0x7f6260101ec0 2024-09-17T07:10:55.818 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:49.966+0000 7f626753b640 1 -- 172.21.15.87:0/522490308 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6260111270 con 0x7f6260101ec0 2024-09-17T07:10:55.818 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:49.966+0000 7f6255ffb640 1 -- 172.21.15.87:0/522490308 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f625c03a680 con 0x7f6260101ec0 2024-09-17T07:10:55.818 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:49.967+0000 7f626753b640 1 -- 172.21.15.87:0/522490308 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62601116e0 con 0x7f6260101ec0 2024-09-17T07:10:55.818 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:49.967+0000 7f6255ffb640 1 -- 172.21.15.87:0/522490308 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 4) v1 ==== 45496+0+0 (secure 0 0 0) 0x7f625c03a940 con 0x7f6260101ec0 2024-09-17T07:10:55.818 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:49.968+0000 7f6255ffb640 1 --2- 172.21.15.87:0/522490308 >> [v2:172.21.15.87:6800/2633029569,v1:172.21.15.87:6801/2633029569] conn(0x7f624c039450 0x7f624c03b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:10:55.818 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:49.968+0000 7f6255ffb640 1 -- 172.21.15.87:0/522490308 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f625c06cb80 con 0x7f6260101ec0 2024-09-17T07:10:55.818 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:49.968+0000 7f626753b640 1 -- 172.21.15.87:0/522490308 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f626005ed70 con 0x7f6260101ec0 2024-09-17T07:10:55.818 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:49.968+0000 7f6264ad6640 1 --2- 172.21.15.87:0/522490308 >> [v2:172.21.15.87:6800/2633029569,v1:172.21.15.87:6801/2633029569] conn(0x7f624c039450 0x7f624c03b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:10:55.818 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:49.968+0000 7f6264ad6640 1 --2- 172.21.15.87:0/522490308 >> [v2:172.21.15.87:6800/2633029569,v1:172.21.15.87:6801/2633029569] conn(0x7f624c039450 0x7f624c03b900 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6250006fd0 tx=0x7f6250006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:10:55.818 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:49.972+0000 7f6255ffb640 1 -- 172.21.15.87:0/522490308 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f625c037030 con 0x7f6260101ec0 2024-09-17T07:10:55.818 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:50.130+0000 7f626753b640 1 -- 172.21.15.87:0/522490308 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f6260103b50 con 0x7f6260101ec0 2024-09-17T07:10:55.818 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:50.131+0000 7f6255ffb640 1 -- 172.21.15.87:0/522490308 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+409 (secure 0 0 0) 0x7f625c030990 con 0x7f6260101ec0 2024-09-17T07:10:55.819 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:50.133+0000 7f626753b640 1 -- 172.21.15.87:0/522490308 >> [v2:172.21.15.87:6800/2633029569,v1:172.21.15.87:6801/2633029569] conn(0x7f624c039450 msgr2=0x7f624c03b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:10:55.819 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:50.133+0000 7f626753b640 1 --2- 172.21.15.87:0/522490308 >> [v2:172.21.15.87:6800/2633029569,v1:172.21.15.87:6801/2633029569] conn(0x7f624c039450 0x7f624c03b900 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6250006fd0 tx=0x7f6250006db0 comp rx=0 tx=0).stop 2024-09-17T07:10:55.819 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:50.133+0000 7f626753b640 1 -- 172.21.15.87:0/522490308 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6260101ec0 msgr2=0x7f6260110b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:10:55.819 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:50.133+0000 7f626753b640 1 --2- 172.21.15.87:0/522490308 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6260101ec0 0x7f6260110b30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f625c02a7a0 tx=0x7f625c008040 comp rx=0 tx=0).stop 2024-09-17T07:10:55.819 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:50.133+0000 7f626753b640 1 -- 172.21.15.87:0/522490308 shutdown_connections 2024-09-17T07:10:55.819 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:50.133+0000 7f626753b640 1 --2- 172.21.15.87:0/522490308 >> [v2:172.21.15.87:6800/2633029569,v1:172.21.15.87:6801/2633029569] conn(0x7f624c039450 0x7f624c03b900 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:10:55.819 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:50.133+0000 7f626753b640 1 --2- 172.21.15.87:0/522490308 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6260101ec0 0x7f6260110b30 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:10:55.819 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:50.133+0000 7f626753b640 1 -- 172.21.15.87:0/522490308 >> 172.21.15.87:0/522490308 conn(0x7f62600fd680 msgr2=0x7f62600fe230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:10:55.819 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:50.134+0000 7f626753b640 1 -- 172.21.15.87:0/522490308 shutdown_connections 2024-09-17T07:10:55.819 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:50.134+0000 7f626753b640 1 -- 172.21.15.87:0/522490308 wait complete. 2024-09-17T07:10:55.819 INFO:teuthology.orchestra.run.smithi087.stdout:Enabling cephadm module... 2024-09-17T07:10:59.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:10:59 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/442334672' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-17T07:11:00.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:00 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/442334672' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-17T07:11:00.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:00 smithi087 ceph-mon[27636]: mgrmap e5: smithi087.vuvjer(active, since 12s) 2024-09-17T07:11:02.266 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:58.954+0000 7f3be0584640 1 Processor -- start 2024-09-17T07:11:02.266 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:58.954+0000 7f3be0584640 1 -- start start 2024-09-17T07:11:02.267 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:58.954+0000 7f3be0584640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3bd81022e0 0x7f3bd81026f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:02.267 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:58.954+0000 7f3be0584640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd8102c30 con 0x7f3bd81022e0 2024-09-17T07:11:02.267 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:58.955+0000 7f3bde320640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3bd81022e0 0x7f3bd81026f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:02.267 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:58.955+0000 7f3bde320640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3bd81022e0 0x7f3bd81026f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55556/0 (socket says 172.21.15.87:55556) 2024-09-17T07:11:02.267 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:58.955+0000 7f3bde320640 1 -- 172.21.15.87:0/1546561373 learned_addr learned my addr 172.21.15.87:0/1546561373 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:11:02.267 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:58.955+0000 7f3bde320640 1 -- 172.21.15.87:0/1546561373 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bd8100880 con 0x7f3bd81022e0 2024-09-17T07:11:02.267 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:58.956+0000 7f3bde320640 1 --2- 172.21.15.87:0/1546561373 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3bd81022e0 0x7f3bd81026f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3bd4009840 tx=0x7f3bd40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4c24bd02cf86260 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:02.267 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:58.956+0000 7f3bdd31e640 1 -- 172.21.15.87:0/1546561373 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3bd4032440 con 0x7f3bd81022e0 2024-09-17T07:11:02.267 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:58.956+0000 7f3bdd31e640 1 -- 172.21.15.87:0/1546561373 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 970+0+0 (secure 0 0 0) 0x7f3bd40329e0 con 0x7f3bd81022e0 2024-09-17T07:11:02.267 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:58.956+0000 7f3bdd31e640 1 -- 172.21.15.87:0/1546561373 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3bd4031930 con 0x7f3bd81022e0 2024-09-17T07:11:02.267 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:58.957+0000 7f3be0584640 1 -- 172.21.15.87:0/1546561373 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3bd81022e0 msgr2=0x7f3bd81026f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:02.267 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:58.957+0000 7f3be0584640 1 --2- 172.21.15.87:0/1546561373 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3bd81022e0 0x7f3bd81026f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3bd4009840 tx=0x7f3bd40091d0 comp rx=0 tx=0).stop 2024-09-17T07:11:02.268 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:58.957+0000 7f3be0584640 1 -- 172.21.15.87:0/1546561373 shutdown_connections 2024-09-17T07:11:02.268 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:58.957+0000 7f3be0584640 1 --2- 172.21.15.87:0/1546561373 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3bd81022e0 0x7f3bd81026f0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:02.268 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:58.957+0000 7f3be0584640 1 -- 172.21.15.87:0/1546561373 >> 172.21.15.87:0/1546561373 conn(0x7f3bd80fc390 msgr2=0x7f3bd80fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:11:02.268 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:58.957+0000 7f3be0584640 1 -- 172.21.15.87:0/1546561373 shutdown_connections 2024-09-17T07:11:02.268 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:58.957+0000 7f3be0584640 1 -- 172.21.15.87:0/1546561373 wait complete. 2024-09-17T07:11:02.268 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:58.957+0000 7f3be0584640 1 Processor -- start 2024-09-17T07:11:02.268 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:58.957+0000 7f3be0584640 1 -- start start 2024-09-17T07:11:02.268 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:58.958+0000 7f3be0584640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3bd81022e0 0x7f3bd810f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:02.268 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:58.958+0000 7f3be0584640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd810fec0 con 0x7f3bd81022e0 2024-09-17T07:11:02.268 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:58.958+0000 7f3bde320640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3bd81022e0 0x7f3bd810f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:02.268 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:58.958+0000 7f3bde320640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3bd81022e0 0x7f3bd810f980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55570/0 (socket says 172.21.15.87:55570) 2024-09-17T07:11:02.268 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:58.958+0000 7f3bde320640 1 -- 172.21.15.87:0/442334672 learned_addr learned my addr 172.21.15.87:0/442334672 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:11:02.269 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:58.958+0000 7f3bde320640 1 -- 172.21.15.87:0/442334672 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bd4009450 con 0x7f3bd81022e0 2024-09-17T07:11:02.269 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:58.958+0000 7f3bde320640 1 --2- 172.21.15.87:0/442334672 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3bd81022e0 0x7f3bd810f980 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3bd4006a70 tx=0x7f3bd4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:02.269 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:58.958+0000 7f3bceffd640 1 -- 172.21.15.87:0/442334672 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3bd4031ee0 con 0x7f3bd81022e0 2024-09-17T07:11:02.269 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:58.958+0000 7f3bceffd640 1 -- 172.21.15.87:0/442334672 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 970+0+0 (secure 0 0 0) 0x7f3bd403d890 con 0x7f3bd81022e0 2024-09-17T07:11:02.269 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:58.958+0000 7f3bceffd640 1 -- 172.21.15.87:0/442334672 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3bd403b820 con 0x7f3bd81022e0 2024-09-17T07:11:02.269 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:58.958+0000 7f3be0584640 1 -- 172.21.15.87:0/442334672 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bd81100c0 con 0x7f3bd81022e0 2024-09-17T07:11:02.269 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:58.958+0000 7f3be0584640 1 -- 172.21.15.87:0/442334672 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bd8110530 con 0x7f3bd81022e0 2024-09-17T07:11:02.269 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:58.959+0000 7f3bceffd640 1 -- 172.21.15.87:0/442334672 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 4) v1 ==== 45496+0+0 (secure 0 0 0) 0x7f3bd4039070 con 0x7f3bd81022e0 2024-09-17T07:11:02.269 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:58.959+0000 7f3bceffd640 1 --2- 172.21.15.87:0/442334672 >> [v2:172.21.15.87:6800/2633029569,v1:172.21.15.87:6801/2633029569] conn(0x7f3bc4039490 0x7f3bc403b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:02.269 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:58.959+0000 7f3be0584640 1 -- 172.21.15.87:0/442334672 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bd81015a0 con 0x7f3bd81022e0 2024-09-17T07:11:02.269 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:58.960+0000 7f3bceffd640 1 -- 172.21.15.87:0/442334672 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f3bd406cd30 con 0x7f3bd81022e0 2024-09-17T07:11:02.269 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:58.960+0000 7f3bddb1f640 1 --2- 172.21.15.87:0/442334672 >> [v2:172.21.15.87:6800/2633029569,v1:172.21.15.87:6801/2633029569] conn(0x7f3bc4039490 0x7f3bc403b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:02.270 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:58.960+0000 7f3bddb1f640 1 --2- 172.21.15.87:0/442334672 >> [v2:172.21.15.87:6800/2633029569,v1:172.21.15.87:6801/2633029569] conn(0x7f3bc4039490 0x7f3bc403b940 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3bc8006fd0 tx=0x7f3bc8006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:02.270 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:58.964+0000 7f3bceffd640 1 -- 172.21.15.87:0/442334672 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f3bd403c590 con 0x7f3bd81022e0 2024-09-17T07:11:02.270 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:59.161+0000 7f3be0584640 1 -- 172.21.15.87:0/442334672 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f3bd8110530 con 0x7f3bd81022e0 2024-09-17T07:11:02.270 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:59.214+0000 7f3bceffd640 1 -- 172.21.15.87:0/442334672 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mgrmap(e 5) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f3bd4045c90 con 0x7f3bd81022e0 2024-09-17T07:11:02.270 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:59.215+0000 7f3bceffd640 1 -- 172.21.15.87:0/442334672 <== mon.0 v2:172.21.15.87:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f3bd403c3b0 con 0x7f3bd81022e0 2024-09-17T07:11:02.270 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:59.218+0000 7f3be0584640 1 -- 172.21.15.87:0/442334672 >> [v2:172.21.15.87:6800/2633029569,v1:172.21.15.87:6801/2633029569] conn(0x7f3bc4039490 msgr2=0x7f3bc403b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:02.270 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:59.218+0000 7f3be0584640 1 --2- 172.21.15.87:0/442334672 >> [v2:172.21.15.87:6800/2633029569,v1:172.21.15.87:6801/2633029569] conn(0x7f3bc4039490 0x7f3bc403b940 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3bc8006fd0 tx=0x7f3bc8006db0 comp rx=0 tx=0).stop 2024-09-17T07:11:02.270 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:59.218+0000 7f3be0584640 1 -- 172.21.15.87:0/442334672 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3bd81022e0 msgr2=0x7f3bd810f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:02.270 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:59.218+0000 7f3be0584640 1 --2- 172.21.15.87:0/442334672 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3bd81022e0 0x7f3bd810f980 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3bd4006a70 tx=0x7f3bd4008040 comp rx=0 tx=0).stop 2024-09-17T07:11:02.270 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:59.218+0000 7f3be0584640 1 -- 172.21.15.87:0/442334672 shutdown_connections 2024-09-17T07:11:02.270 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:59.218+0000 7f3be0584640 1 --2- 172.21.15.87:0/442334672 >> [v2:172.21.15.87:6800/2633029569,v1:172.21.15.87:6801/2633029569] conn(0x7f3bc4039490 0x7f3bc403b940 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:02.270 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:59.218+0000 7f3be0584640 1 --2- 172.21.15.87:0/442334672 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3bd81022e0 0x7f3bd810f980 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:02.270 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:59.218+0000 7f3be0584640 1 -- 172.21.15.87:0/442334672 >> 172.21.15.87:0/442334672 conn(0x7f3bd80fc390 msgr2=0x7f3bd80fcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:11:02.271 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:59.218+0000 7f3be0584640 1 -- 172.21.15.87:0/442334672 shutdown_connections 2024-09-17T07:11:02.271 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:10:59.218+0000 7f3be0584640 1 -- 172.21.15.87:0/442334672 wait complete. 2024-09-17T07:11:03.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:02 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/3033218127' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-17T07:11:03.424 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout { 2024-09-17T07:11:03.424 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-17T07:11:03.424 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-17T07:11:03.424 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "active_name": "smithi087.vuvjer", 2024-09-17T07:11:03.424 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-17T07:11:03.424 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout } 2024-09-17T07:11:03.424 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:02.712+0000 7f563c2fd640 1 Processor -- start 2024-09-17T07:11:03.425 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:02.712+0000 7f563c2fd640 1 -- start start 2024-09-17T07:11:03.425 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:02.713+0000 7f563c2fd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56341022e0 0x7f56341026f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:03.425 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:02.713+0000 7f563c2fd640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5634102c30 con 0x7f56341022e0 2024-09-17T07:11:03.425 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:02.713+0000 7f563a099640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56341022e0 0x7f56341026f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:03.425 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:02.713+0000 7f563a099640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56341022e0 0x7f56341026f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55604/0 (socket says 172.21.15.87:55604) 2024-09-17T07:11:03.425 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:02.713+0000 7f563a099640 1 -- 172.21.15.87:0/3781642868 learned_addr learned my addr 172.21.15.87:0/3781642868 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:11:03.425 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:02.713+0000 7f563a099640 1 -- 172.21.15.87:0/3781642868 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5634100880 con 0x7f56341022e0 2024-09-17T07:11:03.425 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:02.714+0000 7f563a099640 1 --2- 172.21.15.87:0/3781642868 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56341022e0 0x7f56341026f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5630009840 tx=0x7f56300091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e27022b1562e5491 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:03.425 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:02.714+0000 7f5639097640 1 -- 172.21.15.87:0/3781642868 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5630032440 con 0x7f56341022e0 2024-09-17T07:11:03.425 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:02.714+0000 7f5639097640 1 -- 172.21.15.87:0/3781642868 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 970+0+0 (secure 0 0 0) 0x7f56300329e0 con 0x7f56341022e0 2024-09-17T07:11:03.425 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:02.714+0000 7f5639097640 1 -- 172.21.15.87:0/3781642868 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5630031930 con 0x7f56341022e0 2024-09-17T07:11:03.425 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:02.715+0000 7f563c2fd640 1 -- 172.21.15.87:0/3781642868 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56341022e0 msgr2=0x7f56341026f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:03.425 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:02.715+0000 7f563c2fd640 1 --2- 172.21.15.87:0/3781642868 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56341022e0 0x7f56341026f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5630009840 tx=0x7f56300091d0 comp rx=0 tx=0).stop 2024-09-17T07:11:03.426 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:02.715+0000 7f563c2fd640 1 -- 172.21.15.87:0/3781642868 shutdown_connections 2024-09-17T07:11:03.426 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:02.715+0000 7f563c2fd640 1 --2- 172.21.15.87:0/3781642868 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56341022e0 0x7f56341026f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:03.426 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:02.715+0000 7f563c2fd640 1 -- 172.21.15.87:0/3781642868 >> 172.21.15.87:0/3781642868 conn(0x7f56340fc390 msgr2=0x7f56340fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:11:03.426 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:02.715+0000 7f563c2fd640 1 -- 172.21.15.87:0/3781642868 shutdown_connections 2024-09-17T07:11:03.426 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:02.715+0000 7f563c2fd640 1 -- 172.21.15.87:0/3781642868 wait complete. 2024-09-17T07:11:03.426 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:02.715+0000 7f563c2fd640 1 Processor -- start 2024-09-17T07:11:03.426 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:02.715+0000 7f563c2fd640 1 -- start start 2024-09-17T07:11:03.426 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:02.716+0000 7f563c2fd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56341022e0 0x7f563410e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:03.426 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:02.716+0000 7f563c2fd640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f563410eda0 con 0x7f56341022e0 2024-09-17T07:11:03.426 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:02.716+0000 7f563a099640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56341022e0 0x7f563410e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:03.426 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:02.716+0000 7f563a099640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56341022e0 0x7f563410e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55618/0 (socket says 172.21.15.87:55618) 2024-09-17T07:11:03.426 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:02.716+0000 7f563a099640 1 -- 172.21.15.87:0/3033218127 learned_addr learned my addr 172.21.15.87:0/3033218127 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:11:03.426 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:02.716+0000 7f563a099640 1 -- 172.21.15.87:0/3033218127 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5630009450 con 0x7f56341022e0 2024-09-17T07:11:03.427 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:02.716+0000 7f563a099640 1 --2- 172.21.15.87:0/3033218127 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56341022e0 0x7f563410e860 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5630031610 tx=0x7f5630008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:03.427 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:02.716+0000 7f562affd640 1 -- 172.21.15.87:0/3033218127 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5630032880 con 0x7f56341022e0 2024-09-17T07:11:03.427 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:02.716+0000 7f562affd640 1 -- 172.21.15.87:0/3033218127 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 970+0+0 (secure 0 0 0) 0x7f563003d890 con 0x7f56341022e0 2024-09-17T07:11:03.427 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:02.716+0000 7f563c2fd640 1 -- 172.21.15.87:0/3033218127 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f563410efa0 con 0x7f56341022e0 2024-09-17T07:11:03.427 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:02.716+0000 7f562affd640 1 -- 172.21.15.87:0/3033218127 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f563003b820 con 0x7f56341022e0 2024-09-17T07:11:03.427 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:02.716+0000 7f563c2fd640 1 -- 172.21.15.87:0/3033218127 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f563410f410 con 0x7f56341022e0 2024-09-17T07:11:03.427 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:02.717+0000 7f562affd640 1 -- 172.21.15.87:0/3033218127 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f5630039070 con 0x7f56341022e0 2024-09-17T07:11:03.427 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:02.717+0000 7f563c2fd640 1 -- 172.21.15.87:0/3033218127 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5634101430 con 0x7f56341022e0 2024-09-17T07:11:03.427 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:02.718+0000 7f562affd640 1 --2- 172.21.15.87:0/3033218127 >> [v2:172.21.15.87:6800/2633029569,v1:172.21.15.87:6801/2633029569] conn(0x7f562003b6e0 0x7f562003db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:03.427 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:02.718+0000 7f562affd640 1 -- 172.21.15.87:0/3033218127 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f563006ce70 con 0x7f56341022e0 2024-09-17T07:11:03.427 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:02.718+0000 7f5639898640 1 -- 172.21.15.87:0/3033218127 >> [v2:172.21.15.87:6800/2633029569,v1:172.21.15.87:6801/2633029569] conn(0x7f562003b6e0 msgr2=0x7f562003db90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.87:6800/2633029569 2024-09-17T07:11:03.427 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:02.718+0000 7f5639898640 1 --2- 172.21.15.87:0/3033218127 >> [v2:172.21.15.87:6800/2633029569,v1:172.21.15.87:6801/2633029569] conn(0x7f562003b6e0 0x7f562003db90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-17T07:11:03.427 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:02.722+0000 7f562affd640 1 -- 172.21.15.87:0/3033218127 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f563004ed70 con 0x7f56341022e0 2024-09-17T07:11:03.427 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:02.919+0000 7f5639898640 1 -- 172.21.15.87:0/3033218127 >> [v2:172.21.15.87:6800/2633029569,v1:172.21.15.87:6801/2633029569] conn(0x7f562003b6e0 msgr2=0x7f562003db90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.87:6800/2633029569 2024-09-17T07:11:03.428 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:02.919+0000 7f5639898640 1 --2- 172.21.15.87:0/3033218127 >> [v2:172.21.15.87:6800/2633029569,v1:172.21.15.87:6801/2633029569] conn(0x7f562003b6e0 0x7f562003db90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-17T07:11:03.428 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:02.920+0000 7f563c2fd640 1 -- 172.21.15.87:0/3033218127 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f563410f410 con 0x7f56341022e0 2024-09-17T07:11:03.428 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:02.920+0000 7f562affd640 1 -- 172.21.15.87:0/3033218127 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+103 (secure 0 0 0) 0x7f5630041070 con 0x7f56341022e0 2024-09-17T07:11:03.428 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:02.923+0000 7f563c2fd640 1 -- 172.21.15.87:0/3033218127 >> [v2:172.21.15.87:6800/2633029569,v1:172.21.15.87:6801/2633029569] conn(0x7f562003b6e0 msgr2=0x7f562003db90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T07:11:03.428 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:02.923+0000 7f563c2fd640 1 --2- 172.21.15.87:0/3033218127 >> [v2:172.21.15.87:6800/2633029569,v1:172.21.15.87:6801/2633029569] conn(0x7f562003b6e0 0x7f562003db90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:03.428 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:02.923+0000 7f563c2fd640 1 -- 172.21.15.87:0/3033218127 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56341022e0 msgr2=0x7f563410e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:03.428 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:02.923+0000 7f563c2fd640 1 --2- 172.21.15.87:0/3033218127 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56341022e0 0x7f563410e860 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5630031610 tx=0x7f5630008040 comp rx=0 tx=0).stop 2024-09-17T07:11:03.428 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:02.923+0000 7f563c2fd640 1 -- 172.21.15.87:0/3033218127 shutdown_connections 2024-09-17T07:11:03.428 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:02.923+0000 7f563c2fd640 1 --2- 172.21.15.87:0/3033218127 >> [v2:172.21.15.87:6800/2633029569,v1:172.21.15.87:6801/2633029569] conn(0x7f562003b6e0 0x7f562003db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:03.428 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:02.923+0000 7f563c2fd640 1 --2- 172.21.15.87:0/3033218127 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56341022e0 0x7f563410e860 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:03.428 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:02.923+0000 7f563c2fd640 1 -- 172.21.15.87:0/3033218127 >> 172.21.15.87:0/3033218127 conn(0x7f56340fc390 msgr2=0x7f5634105100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:11:03.428 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:02.923+0000 7f563c2fd640 1 -- 172.21.15.87:0/3033218127 shutdown_connections 2024-09-17T07:11:03.428 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:02.923+0000 7f563c2fd640 1 -- 172.21.15.87:0/3033218127 wait complete. 2024-09-17T07:11:03.428 INFO:teuthology.orchestra.run.smithi087.stdout:Waiting for the mgr to restart... 2024-09-17T07:11:03.429 INFO:teuthology.orchestra.run.smithi087.stdout:Waiting for mgr epoch 5... 2024-09-17T07:11:04.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:03 smithi087 ceph-mon[27636]: Active manager daemon smithi087.vuvjer restarted 2024-09-17T07:11:04.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:03 smithi087 ceph-mon[27636]: Activating manager daemon smithi087.vuvjer 2024-09-17T07:11:04.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:03 smithi087 ceph-mon[27636]: osdmap e2: 0 total, 0 up, 0 in 2024-09-17T07:11:04.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:03 smithi087 ceph-mon[27636]: mgrmap e6: smithi087.vuvjer(active, starting, since 0.00355461s) 2024-09-17T07:11:04.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:03 smithi087 ceph-mon[27636]: from='mgr.14118 172.21.15.87:0/353374649' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mon metadata", "id": "smithi087"}]: dispatch 2024-09-17T07:11:04.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:03 smithi087 ceph-mon[27636]: from='mgr.14118 172.21.15.87:0/353374649' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mgr metadata", "who": "smithi087.vuvjer", "id": "smithi087.vuvjer"}]: dispatch 2024-09-17T07:11:04.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:03 smithi087 ceph-mon[27636]: from='mgr.14118 172.21.15.87:0/353374649' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T07:11:04.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:03 smithi087 ceph-mon[27636]: from='mgr.14118 172.21.15.87:0/353374649' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T07:11:04.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:03 smithi087 ceph-mon[27636]: from='mgr.14118 172.21.15.87:0/353374649' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T07:11:04.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:03 smithi087 ceph-mon[27636]: Manager daemon smithi087.vuvjer is now available 2024-09-17T07:11:04.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:03 smithi087 ceph-mon[27636]: from='mgr.14118 172.21.15.87:0/353374649' entity='mgr.smithi087.vuvjer' 2024-09-17T07:11:04.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:03 smithi087 ceph-mon[27636]: from='mgr.14118 172.21.15.87:0/353374649' entity='mgr.smithi087.vuvjer' 2024-09-17T07:11:04.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:03 smithi087 ceph-mon[27636]: from='mgr.14118 172.21.15.87:0/353374649' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:11:04.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:03 smithi087 ceph-mon[27636]: from='mgr.14118 172.21.15.87:0/353374649' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:11:04.178 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:03 smithi087 ceph-mon[27636]: from='mgr.14118 172.21.15.87:0/353374649' entity='mgr.smithi087.vuvjer' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi087.vuvjer/mirror_snapshot_schedule"}]: dispatch 2024-09-17T07:11:04.178 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:03 smithi087 ceph-mon[27636]: from='mgr.14118 172.21.15.87:0/353374649' entity='mgr.smithi087.vuvjer' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi087.vuvjer/trash_purge_schedule"}]: dispatch 2024-09-17T07:11:05.130 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:04 smithi087 ceph-mon[27636]: Found migration_current of "None". Setting to last migration. 2024-09-17T07:11:05.130 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:04 smithi087 ceph-mon[27636]: mgrmap e7: smithi087.vuvjer(active, since 1.00521s) 2024-09-17T07:11:05.138 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout { 2024-09-17T07:11:05.138 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-17T07:11:05.139 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-17T07:11:05.139 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout } 2024-09-17T07:11:05.139 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:03.883+0000 7f7fb6d4a640 1 Processor -- start 2024-09-17T07:11:05.139 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:03.883+0000 7f7fb6d4a640 1 -- start start 2024-09-17T07:11:05.139 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:03.884+0000 7f7fb6d4a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fb01006e0 0x7f7fb0100af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:05.139 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:03.884+0000 7f7fb6d4a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb0070ae0 con 0x7f7fb01006e0 2024-09-17T07:11:05.139 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:03.884+0000 7f7fb4ae6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fb01006e0 0x7f7fb0100af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:05.139 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:03.884+0000 7f7fb4ae6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fb01006e0 0x7f7fb0100af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55710/0 (socket says 172.21.15.87:55710) 2024-09-17T07:11:05.139 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:03.884+0000 7f7fb4ae6640 1 -- 172.21.15.87:0/1376738981 learned_addr learned my addr 172.21.15.87:0/1376738981 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:11:05.139 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:03.884+0000 7f7fb4ae6640 1 -- 172.21.15.87:0/1376738981 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fb0070c20 con 0x7f7fb01006e0 2024-09-17T07:11:05.139 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:03.885+0000 7f7fb4ae6640 1 --2- 172.21.15.87:0/1376738981 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fb01006e0 0x7f7fb0100af0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7fa4009840 tx=0x7f7fa40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b8142d998933ee2 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:05.139 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:03.885+0000 7f7faf7fe640 1 -- 172.21.15.87:0/1376738981 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7fa4032440 con 0x7f7fb01006e0 2024-09-17T07:11:05.139 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:03.885+0000 7f7faf7fe640 1 -- 172.21.15.87:0/1376738981 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 970+0+0 (secure 0 0 0) 0x7f7fa40329e0 con 0x7f7fb01006e0 2024-09-17T07:11:05.140 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:03.885+0000 7f7faf7fe640 1 -- 172.21.15.87:0/1376738981 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7fa4031930 con 0x7f7fb01006e0 2024-09-17T07:11:05.140 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:03.886+0000 7f7fb6d4a640 1 -- 172.21.15.87:0/1376738981 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fb01006e0 msgr2=0x7f7fb0100af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:05.140 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:03.886+0000 7f7fb6d4a640 1 --2- 172.21.15.87:0/1376738981 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fb01006e0 0x7f7fb0100af0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7fa4009840 tx=0x7f7fa40091d0 comp rx=0 tx=0).stop 2024-09-17T07:11:05.140 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:03.886+0000 7f7fb6d4a640 1 -- 172.21.15.87:0/1376738981 shutdown_connections 2024-09-17T07:11:05.140 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:03.886+0000 7f7fb6d4a640 1 --2- 172.21.15.87:0/1376738981 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fb01006e0 0x7f7fb0100af0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:05.140 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:03.886+0000 7f7fb6d4a640 1 -- 172.21.15.87:0/1376738981 >> 172.21.15.87:0/1376738981 conn(0x7f7fb00fc390 msgr2=0x7f7fb00fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:11:05.140 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:03.886+0000 7f7fb6d4a640 1 -- 172.21.15.87:0/1376738981 shutdown_connections 2024-09-17T07:11:05.140 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:03.886+0000 7f7fb6d4a640 1 -- 172.21.15.87:0/1376738981 wait complete. 2024-09-17T07:11:05.140 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:03.886+0000 7f7fb6d4a640 1 Processor -- start 2024-09-17T07:11:05.140 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:03.886+0000 7f7fb6d4a640 1 -- start start 2024-09-17T07:11:05.140 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:03.887+0000 7f7fb6d4a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fb01006e0 0x7f7fb0112e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:05.140 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:03.887+0000 7f7fb6d4a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb0113370 con 0x7f7fb01006e0 2024-09-17T07:11:05.140 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:03.887+0000 7f7fb4ae6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fb01006e0 0x7f7fb0112e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:05.141 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:03.887+0000 7f7fb4ae6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fb01006e0 0x7f7fb0112e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55712/0 (socket says 172.21.15.87:55712) 2024-09-17T07:11:05.141 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:03.887+0000 7f7fb4ae6640 1 -- 172.21.15.87:0/1109215745 learned_addr learned my addr 172.21.15.87:0/1109215745 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:11:05.141 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:03.887+0000 7f7fb4ae6640 1 -- 172.21.15.87:0/1109215745 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa4009450 con 0x7f7fb01006e0 2024-09-17T07:11:05.141 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:03.887+0000 7f7fb4ae6640 1 --2- 172.21.15.87:0/1109215745 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fb01006e0 0x7f7fb0112e30 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7fa4031920 tx=0x7f7fa4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:05.141 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:03.887+0000 7f7fad7fa640 1 -- 172.21.15.87:0/1109215745 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7fa4031f10 con 0x7f7fb01006e0 2024-09-17T07:11:05.141 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:03.887+0000 7f7fb6d4a640 1 -- 172.21.15.87:0/1109215745 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fb0113570 con 0x7f7fb01006e0 2024-09-17T07:11:05.141 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:03.887+0000 7f7fb6d4a640 1 -- 172.21.15.87:0/1109215745 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fb0113fc0 con 0x7f7fb01006e0 2024-09-17T07:11:05.141 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:03.888+0000 7f7fad7fa640 1 -- 172.21.15.87:0/1109215745 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 970+0+0 (secure 0 0 0) 0x7f7fa403d890 con 0x7f7fb01006e0 2024-09-17T07:11:05.142 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:03.888+0000 7f7fad7fa640 1 -- 172.21.15.87:0/1109215745 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7fa403b7a0 con 0x7f7fb01006e0 2024-09-17T07:11:05.142 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:03.888+0000 7f7fad7fa640 1 -- 172.21.15.87:0/1109215745 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 6) v1 ==== 45274+0+0 (secure 0 0 0) 0x7f7fa4039070 con 0x7f7fb01006e0 2024-09-17T07:11:05.142 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:03.889+0000 7f7fad7fa640 1 -- 172.21.15.87:0/1109215745 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f7fa406ce10 con 0x7f7fb01006e0 2024-09-17T07:11:05.142 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:04.576+0000 7f7fad7fa640 1 -- 172.21.15.87:0/1109215745 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mgrmap(e 7) v1 ==== 45401+0+0 (secure 0 0 0) 0x7f7fa403da00 con 0x7f7fb01006e0 2024-09-17T07:11:05.142 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:04.576+0000 7f7fad7fa640 1 --2- 172.21.15.87:0/1109215745 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f7fa0039fb0 0x7f7fa003c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:05.142 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:04.576+0000 7f7fad7fa640 1 -- 172.21.15.87:0/1109215745 --> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7fa003c8d0 con 0x7f7fa0039fb0 2024-09-17T07:11:05.142 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:04.577+0000 7f7faffff640 1 --2- 172.21.15.87:0/1109215745 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f7fa0039fb0 0x7f7fa003c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:05.142 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:04.577+0000 7f7faffff640 1 --2- 172.21.15.87:0/1109215745 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f7fa0039fb0 0x7f7fa003c390 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c006fd0 tx=0x7f7f9c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:05.142 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:04.577+0000 7f7fad7fa640 1 -- 172.21.15.87:0/1109215745 <== mgr.14118 v2:172.21.15.87:6800/1735030430 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7f7fa003c8d0 con 0x7f7fa0039fb0 2024-09-17T07:11:05.142 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:04.582+0000 7f7fb6d4a640 1 -- 172.21.15.87:0/1109215745 --> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f7f94002560 con 0x7f7fa0039fb0 2024-09-17T07:11:05.142 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:04.582+0000 7f7fad7fa640 1 -- 172.21.15.87:0/1109215745 <== mgr.14118 v2:172.21.15.87:6800/1735030430 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f7f94002560 con 0x7f7fa0039fb0 2024-09-17T07:11:05.142 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:04.583+0000 7f7fb6d4a640 1 -- 172.21.15.87:0/1109215745 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f7fa0039fb0 msgr2=0x7f7fa003c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:05.142 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:04.583+0000 7f7fb6d4a640 1 --2- 172.21.15.87:0/1109215745 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f7fa0039fb0 0x7f7fa003c390 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c006fd0 tx=0x7f7f9c006db0 comp rx=0 tx=0).stop 2024-09-17T07:11:05.143 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:04.583+0000 7f7fb6d4a640 1 -- 172.21.15.87:0/1109215745 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fb01006e0 msgr2=0x7f7fb0112e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:05.143 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:04.583+0000 7f7fb6d4a640 1 --2- 172.21.15.87:0/1109215745 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fb01006e0 0x7f7fb0112e30 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7fa4031920 tx=0x7f7fa4008040 comp rx=0 tx=0).stop 2024-09-17T07:11:05.143 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:04.583+0000 7f7fb6d4a640 1 -- 172.21.15.87:0/1109215745 shutdown_connections 2024-09-17T07:11:05.143 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:04.583+0000 7f7fb6d4a640 1 --2- 172.21.15.87:0/1109215745 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f7fa0039fb0 0x7f7fa003c390 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:05.143 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:04.583+0000 7f7fb6d4a640 1 --2- 172.21.15.87:0/1109215745 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fb01006e0 0x7f7fb0112e30 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:05.143 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:04.583+0000 7f7fb6d4a640 1 -- 172.21.15.87:0/1109215745 >> 172.21.15.87:0/1109215745 conn(0x7f7fb00fc390 msgr2=0x7f7fb01072c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:11:05.143 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:04.583+0000 7f7fb6d4a640 1 -- 172.21.15.87:0/1109215745 shutdown_connections 2024-09-17T07:11:05.143 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:04.583+0000 7f7fb6d4a640 1 -- 172.21.15.87:0/1109215745 wait complete. 2024-09-17T07:11:05.143 INFO:teuthology.orchestra.run.smithi087.stdout:mgr epoch 5 is available 2024-09-17T07:11:05.143 INFO:teuthology.orchestra.run.smithi087.stdout:Setting orchestrator backend to cephadm... 2024-09-17T07:11:06.239 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:05 smithi087 ceph-mon[27636]: from='client.14128 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-17T07:11:06.239 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:05 smithi087 ceph-mon[27636]: from='client.14128 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-17T07:11:06.239 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:05 smithi087 ceph-mon[27636]: from='mgr.14118 172.21.15.87:0/353374649' entity='mgr.smithi087.vuvjer' 2024-09-17T07:11:06.239 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:05 smithi087 ceph-mon[27636]: from='mgr.14118 172.21.15.87:0/353374649' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:11:06.239 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:05 smithi087 ceph-mon[27636]: from='mgr.14118 172.21.15.87:0/353374649' entity='mgr.smithi087.vuvjer' 2024-09-17T07:11:06.239 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:05 smithi087 ceph-mon[27636]: from='mgr.14118 172.21.15.87:0/353374649' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:11:06.247 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:05.500+0000 7f46ff1bc640 1 Processor -- start 2024-09-17T07:11:06.247 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:05.500+0000 7f46ff1bc640 1 -- start start 2024-09-17T07:11:06.247 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:05.500+0000 7f46ff1bc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46f8077d60 0x7f46f8076120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:06.248 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:05.500+0000 7f46ff1bc640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46f8076660 con 0x7f46f8077d60 2024-09-17T07:11:06.248 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:05.500+0000 7f46fcf58640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46f8077d60 0x7f46f8076120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:06.248 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:05.500+0000 7f46fcf58640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46f8077d60 0x7f46f8076120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52156/0 (socket says 172.21.15.87:52156) 2024-09-17T07:11:06.248 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:05.500+0000 7f46fcf58640 1 -- 172.21.15.87:0/126954208 learned_addr learned my addr 172.21.15.87:0/126954208 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:11:06.248 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:05.500+0000 7f46fcf58640 1 -- 172.21.15.87:0/126954208 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46f80767a0 con 0x7f46f8077d60 2024-09-17T07:11:06.248 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:05.501+0000 7f46fcf58640 1 --2- 172.21.15.87:0/126954208 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46f8077d60 0x7f46f8076120 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f46ec009840 tx=0x7f46ec0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e17b8e6ee79d70dd server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:06.248 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:05.501+0000 7f46f77fe640 1 -- 172.21.15.87:0/126954208 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f46ec032440 con 0x7f46f8077d60 2024-09-17T07:11:06.248 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:05.501+0000 7f46f77fe640 1 -- 172.21.15.87:0/126954208 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 970+0+0 (secure 0 0 0) 0x7f46ec0329e0 con 0x7f46f8077d60 2024-09-17T07:11:06.248 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:05.501+0000 7f46f77fe640 1 -- 172.21.15.87:0/126954208 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f46ec031930 con 0x7f46f8077d60 2024-09-17T07:11:06.248 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:05.502+0000 7f46ff1bc640 1 -- 172.21.15.87:0/126954208 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46f8077d60 msgr2=0x7f46f8076120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:06.248 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:05.502+0000 7f46ff1bc640 1 --2- 172.21.15.87:0/126954208 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46f8077d60 0x7f46f8076120 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f46ec009840 tx=0x7f46ec0091d0 comp rx=0 tx=0).stop 2024-09-17T07:11:06.248 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:05.502+0000 7f46ff1bc640 1 -- 172.21.15.87:0/126954208 shutdown_connections 2024-09-17T07:11:06.248 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:05.502+0000 7f46ff1bc640 1 --2- 172.21.15.87:0/126954208 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46f8077d60 0x7f46f8076120 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:06.249 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:05.502+0000 7f46ff1bc640 1 -- 172.21.15.87:0/126954208 >> 172.21.15.87:0/126954208 conn(0x7f46f80fd4e0 msgr2=0x7f46f80ff8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:11:06.249 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:05.502+0000 7f46ff1bc640 1 -- 172.21.15.87:0/126954208 shutdown_connections 2024-09-17T07:11:06.249 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:05.502+0000 7f46ff1bc640 1 -- 172.21.15.87:0/126954208 wait complete. 2024-09-17T07:11:06.249 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:05.502+0000 7f46ff1bc640 1 Processor -- start 2024-09-17T07:11:06.249 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:05.502+0000 7f46ff1bc640 1 -- start start 2024-09-17T07:11:06.249 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:05.503+0000 7f46ff1bc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46f8077d60 0x7f46f8117120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:06.249 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:05.503+0000 7f46ff1bc640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46f8117660 con 0x7f46f8077d60 2024-09-17T07:11:06.249 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:05.503+0000 7f46fcf58640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46f8077d60 0x7f46f8117120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:06.249 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:05.503+0000 7f46fcf58640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46f8077d60 0x7f46f8117120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52158/0 (socket says 172.21.15.87:52158) 2024-09-17T07:11:06.249 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:05.503+0000 7f46fcf58640 1 -- 172.21.15.87:0/1468453707 learned_addr learned my addr 172.21.15.87:0/1468453707 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:11:06.249 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:05.503+0000 7f46fcf58640 1 -- 172.21.15.87:0/1468453707 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46ec009450 con 0x7f46f8077d60 2024-09-17T07:11:06.249 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:05.503+0000 7f46fcf58640 1 --2- 172.21.15.87:0/1468453707 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46f8077d60 0x7f46f8117120 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f46ec0098a0 tx=0x7f46ec008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:06.249 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:05.504+0000 7f46f57fa640 1 -- 172.21.15.87:0/1468453707 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f46ec0327b0 con 0x7f46f8077d60 2024-09-17T07:11:06.250 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:05.504+0000 7f46ff1bc640 1 -- 172.21.15.87:0/1468453707 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46f8117860 con 0x7f46f8077d60 2024-09-17T07:11:06.250 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:05.504+0000 7f46f57fa640 1 -- 172.21.15.87:0/1468453707 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 970+0+0 (secure 0 0 0) 0x7f46ec03d890 con 0x7f46f8077d60 2024-09-17T07:11:06.250 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:05.504+0000 7f46f57fa640 1 -- 172.21.15.87:0/1468453707 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f46ec03b780 con 0x7f46f8077d60 2024-09-17T07:11:06.250 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:05.504+0000 7f46ff1bc640 1 -- 172.21.15.87:0/1468453707 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46f8117cd0 con 0x7f46f8077d60 2024-09-17T07:11:06.250 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:05.504+0000 7f46f57fa640 1 -- 172.21.15.87:0/1468453707 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 7) v1 ==== 45401+0+0 (secure 0 0 0) 0x7f46ec039070 con 0x7f46f8077d60 2024-09-17T07:11:06.250 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:05.505+0000 7f46f57fa640 1 --2- 172.21.15.87:0/1468453707 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f46e8039380 0x7f46e803b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:06.250 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:05.505+0000 7f46f57fa640 1 -- 172.21.15.87:0/1468453707 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f46ec06cfe0 con 0x7f46f8077d60 2024-09-17T07:11:06.250 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:05.505+0000 7f46ff1bc640 1 -- 172.21.15.87:0/1468453707 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46f8117cd0 con 0x7f46f8077d60 2024-09-17T07:11:06.250 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:05.505+0000 7f46f7fff640 1 --2- 172.21.15.87:0/1468453707 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f46e8039380 0x7f46e803b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:06.250 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:05.505+0000 7f46f7fff640 1 --2- 172.21.15.87:0/1468453707 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f46e8039380 0x7f46e803b830 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f46e4006fd0 tx=0x7f46e4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:06.250 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:05.510+0000 7f46f57fa640 1 -- 172.21.15.87:0/1468453707 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f46f8117cd0 con 0x7f46f8077d60 2024-09-17T07:11:06.250 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:05.677+0000 7f46ff1bc640 1 -- 172.21.15.87:0/1468453707 --> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f46f8117cd0 con 0x7f46e8039380 2024-09-17T07:11:06.250 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:05.684+0000 7f46f57fa640 1 -- 172.21.15.87:0/1468453707 <== mgr.14118 v2:172.21.15.87:6800/1735030430 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f46f8117cd0 con 0x7f46e8039380 2024-09-17T07:11:06.251 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:05.687+0000 7f46ff1bc640 1 -- 172.21.15.87:0/1468453707 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f46e8039380 msgr2=0x7f46e803b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:06.251 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:05.687+0000 7f46ff1bc640 1 --2- 172.21.15.87:0/1468453707 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f46e8039380 0x7f46e803b830 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f46e4006fd0 tx=0x7f46e4006db0 comp rx=0 tx=0).stop 2024-09-17T07:11:06.251 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:05.687+0000 7f46ff1bc640 1 -- 172.21.15.87:0/1468453707 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46f8077d60 msgr2=0x7f46f8117120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:06.251 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:05.687+0000 7f46ff1bc640 1 --2- 172.21.15.87:0/1468453707 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46f8077d60 0x7f46f8117120 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f46ec0098a0 tx=0x7f46ec008040 comp rx=0 tx=0).stop 2024-09-17T07:11:06.251 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:05.687+0000 7f46ff1bc640 1 -- 172.21.15.87:0/1468453707 shutdown_connections 2024-09-17T07:11:06.251 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:05.687+0000 7f46ff1bc640 1 --2- 172.21.15.87:0/1468453707 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f46e8039380 0x7f46e803b830 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:06.251 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:05.687+0000 7f46ff1bc640 1 --2- 172.21.15.87:0/1468453707 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46f8077d60 0x7f46f8117120 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:06.251 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:05.687+0000 7f46ff1bc640 1 -- 172.21.15.87:0/1468453707 >> 172.21.15.87:0/1468453707 conn(0x7f46f80fd4e0 msgr2=0x7f46f810e3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:11:06.251 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:05.687+0000 7f46ff1bc640 1 -- 172.21.15.87:0/1468453707 shutdown_connections 2024-09-17T07:11:06.251 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:05.687+0000 7f46ff1bc640 1 -- 172.21.15.87:0/1468453707 wait complete. 2024-09-17T07:11:07.128 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:06 smithi087 ceph-mon[27636]: [17/Sep/2024:07:11:05] ENGINE Bus STARTING 2024-09-17T07:11:07.129 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:06 smithi087 ceph-mon[27636]: [17/Sep/2024:07:11:05] ENGINE Serving on https://172.21.15.87:7150 2024-09-17T07:11:07.129 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:06 smithi087 ceph-mon[27636]: [17/Sep/2024:07:11:05] ENGINE Bus STARTED 2024-09-17T07:11:07.129 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:06 smithi087 ceph-mon[27636]: [17/Sep/2024:07:11:05] ENGINE Error in HTTPServer.serve 2024-09-17T07:11:07.129 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Traceback (most recent call last): 2024-09-17T07:11:07.129 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T07:11:07.129 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: self._connections.run(self.expiration_interval) 2024-09-17T07:11:07.129 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T07:11:07.129 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: self._run(expiration_interval) 2024-09-17T07:11:07.129 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T07:11:07.129 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T07:11:07.129 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T07:11:07.129 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T07:11:07.129 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T07:11:07.129 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: s = self.context.wrap_socket( 2024-09-17T07:11:07.130 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T07:11:07.130 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: return self.sslsocket_class._create( 2024-09-17T07:11:07.130 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T07:11:07.130 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: self.do_handshake() 2024-09-17T07:11:07.130 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T07:11:07.130 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: self._sslobj.do_handshake() 2024-09-17T07:11:07.130 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T07:11:07.130 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:06 smithi087 ceph-mon[27636]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:11:07.130 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:06 smithi087 ceph-mon[27636]: mgrmap e8: smithi087.vuvjer(active, since 2s) 2024-09-17T07:11:07.744 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-17T07:11:07.745 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:06.632+0000 7f55a87e4640 1 Processor -- start 2024-09-17T07:11:07.745 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:06.632+0000 7f55a87e4640 1 -- start start 2024-09-17T07:11:07.745 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:06.633+0000 7f55a87e4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55a0101e60 0x7f55a0102270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:07.745 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:06.633+0000 7f55a87e4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55a01027b0 con 0x7f55a0101e60 2024-09-17T07:11:07.745 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:06.633+0000 7f55a6580640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55a0101e60 0x7f55a0102270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:07.745 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:06.633+0000 7f55a6580640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55a0101e60 0x7f55a0102270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52166/0 (socket says 172.21.15.87:52166) 2024-09-17T07:11:07.745 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:06.633+0000 7f55a6580640 1 -- 172.21.15.87:0/3043225101 learned_addr learned my addr 172.21.15.87:0/3043225101 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:11:07.745 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:06.633+0000 7f55a6580640 1 -- 172.21.15.87:0/3043225101 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55a01028f0 con 0x7f55a0101e60 2024-09-17T07:11:07.745 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:06.634+0000 7f55a6580640 1 --2- 172.21.15.87:0/3043225101 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55a0101e60 0x7f55a0102270 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5594009840 tx=0x7f55940091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=168ff5dab06c7b1a server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:07.745 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:06.634+0000 7f55a557e640 1 -- 172.21.15.87:0/3043225101 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5594032440 con 0x7f55a0101e60 2024-09-17T07:11:07.745 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:06.634+0000 7f55a557e640 1 -- 172.21.15.87:0/3043225101 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 970+0+0 (secure 0 0 0) 0x7f55940329e0 con 0x7f55a0101e60 2024-09-17T07:11:07.746 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:06.634+0000 7f55a557e640 1 -- 172.21.15.87:0/3043225101 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f55940319c0 con 0x7f55a0101e60 2024-09-17T07:11:07.746 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:06.635+0000 7f55a87e4640 1 -- 172.21.15.87:0/3043225101 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55a0101e60 msgr2=0x7f55a0102270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:07.746 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:06.635+0000 7f55a87e4640 1 --2- 172.21.15.87:0/3043225101 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55a0101e60 0x7f55a0102270 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5594009840 tx=0x7f55940091d0 comp rx=0 tx=0).stop 2024-09-17T07:11:07.746 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:06.635+0000 7f55a87e4640 1 -- 172.21.15.87:0/3043225101 shutdown_connections 2024-09-17T07:11:07.746 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:06.635+0000 7f55a87e4640 1 --2- 172.21.15.87:0/3043225101 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55a0101e60 0x7f55a0102270 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:07.746 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:06.635+0000 7f55a87e4640 1 -- 172.21.15.87:0/3043225101 >> 172.21.15.87:0/3043225101 conn(0x7f55a00fd5e0 msgr2=0x7f55a00ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:11:07.746 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:06.635+0000 7f55a87e4640 1 -- 172.21.15.87:0/3043225101 shutdown_connections 2024-09-17T07:11:07.746 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:06.635+0000 7f55a87e4640 1 -- 172.21.15.87:0/3043225101 wait complete. 2024-09-17T07:11:07.746 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:06.635+0000 7f55a87e4640 1 Processor -- start 2024-09-17T07:11:07.746 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:06.635+0000 7f55a87e4640 1 -- start start 2024-09-17T07:11:07.746 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:06.635+0000 7f55a87e4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55a0101e60 0x7f55a0110ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:07.746 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:06.635+0000 7f55a87e4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55a0111020 con 0x7f55a0101e60 2024-09-17T07:11:07.746 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:06.635+0000 7f55a6580640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55a0101e60 0x7f55a0110ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:07.746 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:06.635+0000 7f55a6580640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55a0101e60 0x7f55a0110ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52174/0 (socket says 172.21.15.87:52174) 2024-09-17T07:11:07.747 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:06.635+0000 7f55a6580640 1 -- 172.21.15.87:0/2952023426 learned_addr learned my addr 172.21.15.87:0/2952023426 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:11:07.747 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:06.636+0000 7f55a6580640 1 -- 172.21.15.87:0/2952023426 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5594009450 con 0x7f55a0101e60 2024-09-17T07:11:07.747 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:06.636+0000 7f55a6580640 1 --2- 172.21.15.87:0/2952023426 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55a0101e60 0x7f55a0110ae0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f55940315c0 tx=0x7f55940091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:07.747 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:06.636+0000 7f5592ffd640 1 -- 172.21.15.87:0/2952023426 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f55940327b0 con 0x7f55a0101e60 2024-09-17T07:11:07.747 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:06.636+0000 7f5592ffd640 1 -- 172.21.15.87:0/2952023426 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 970+0+0 (secure 0 0 0) 0x7f559403b870 con 0x7f55a0101e60 2024-09-17T07:11:07.747 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:06.636+0000 7f55a87e4640 1 -- 172.21.15.87:0/2952023426 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55a0111220 con 0x7f55a0101e60 2024-09-17T07:11:07.747 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:06.636+0000 7f5592ffd640 1 -- 172.21.15.87:0/2952023426 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f559403a650 con 0x7f55a0101e60 2024-09-17T07:11:07.747 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:06.636+0000 7f55a87e4640 1 -- 172.21.15.87:0/2952023426 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55a0111690 con 0x7f55a0101e60 2024-09-17T07:11:07.747 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:06.637+0000 7f5592ffd640 1 -- 172.21.15.87:0/2952023426 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f5594039040 con 0x7f55a0101e60 2024-09-17T07:11:07.747 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:06.637+0000 7f5592ffd640 1 --2- 172.21.15.87:0/2952023426 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f558c039490 0x7f558c03b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:07.747 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:06.637+0000 7f5592ffd640 1 -- 172.21.15.87:0/2952023426 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f559406c9b0 con 0x7f55a0101e60 2024-09-17T07:11:07.747 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:06.637+0000 7f55a87e4640 1 -- 172.21.15.87:0/2952023426 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55a005ed70 con 0x7f55a0101e60 2024-09-17T07:11:07.748 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:06.637+0000 7f55a5d7f640 1 --2- 172.21.15.87:0/2952023426 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f558c039490 0x7f558c03b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:07.748 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:06.637+0000 7f55a5d7f640 1 --2- 172.21.15.87:0/2952023426 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f558c039490 0x7f558c03b940 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f559c006fd0 tx=0x7f559c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:07.748 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:06.641+0000 7f5592ffd640 1 -- 172.21.15.87:0/2952023426 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f559403f020 con 0x7f55a0101e60 2024-09-17T07:11:07.748 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:06.799+0000 7f55a87e4640 1 -- 172.21.15.87:0/2952023426 --> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f55a00fe940 con 0x7f558c039490 2024-09-17T07:11:07.748 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:06.800+0000 7f5592ffd640 1 -- 172.21.15.87:0/2952023426 <== mgr.14118 v2:172.21.15.87:6800/1735030430 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f55a00fe940 con 0x7f558c039490 2024-09-17T07:11:07.748 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:06.802+0000 7f55a87e4640 1 -- 172.21.15.87:0/2952023426 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f558c039490 msgr2=0x7f558c03b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:07.748 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:06.802+0000 7f55a87e4640 1 --2- 172.21.15.87:0/2952023426 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f558c039490 0x7f558c03b940 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f559c006fd0 tx=0x7f559c006db0 comp rx=0 tx=0).stop 2024-09-17T07:11:07.748 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:06.802+0000 7f55a87e4640 1 -- 172.21.15.87:0/2952023426 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55a0101e60 msgr2=0x7f55a0110ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:07.748 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:06.802+0000 7f55a87e4640 1 --2- 172.21.15.87:0/2952023426 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55a0101e60 0x7f55a0110ae0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f55940315c0 tx=0x7f55940091d0 comp rx=0 tx=0).stop 2024-09-17T07:11:07.748 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:06.802+0000 7f55a87e4640 1 -- 172.21.15.87:0/2952023426 shutdown_connections 2024-09-17T07:11:07.748 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:06.802+0000 7f55a87e4640 1 --2- 172.21.15.87:0/2952023426 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f558c039490 0x7f558c03b940 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:07.748 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:06.802+0000 7f55a87e4640 1 --2- 172.21.15.87:0/2952023426 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55a0101e60 0x7f55a0110ae0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:07.749 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:06.802+0000 7f55a87e4640 1 -- 172.21.15.87:0/2952023426 >> 172.21.15.87:0/2952023426 conn(0x7f55a00fd5e0 msgr2=0x7f55a00fe210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:11:07.749 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:06.802+0000 7f55a87e4640 1 -- 172.21.15.87:0/2952023426 shutdown_connections 2024-09-17T07:11:07.749 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:06.802+0000 7f55a87e4640 1 -- 172.21.15.87:0/2952023426 wait complete. 2024-09-17T07:11:07.749 INFO:teuthology.orchestra.run.smithi087.stdout:Generating ssh key... 2024-09-17T07:11:08.147 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:07 smithi087 ceph-mon[27636]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:11:09.434 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:08.413+0000 7f9a0cc1a640 1 Processor -- start 2024-09-17T07:11:09.435 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:08.413+0000 7f9a0cc1a640 1 -- start start 2024-09-17T07:11:09.435 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:08.413+0000 7f9a0cc1a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a08076c50 0x7f9a08106de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:09.435 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:08.413+0000 7f9a0cc1a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a081027d0 con 0x7f9a08076c50 2024-09-17T07:11:09.435 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:08.413+0000 7f9a0659c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a08076c50 0x7f9a08106de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:09.435 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:08.414+0000 7f9a0659c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a08076c50 0x7f9a08106de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52190/0 (socket says 172.21.15.87:52190) 2024-09-17T07:11:09.435 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:08.414+0000 7f9a0659c640 1 -- 172.21.15.87:0/4109977100 learned_addr learned my addr 172.21.15.87:0/4109977100 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:11:09.435 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:08.414+0000 7f9a0659c640 1 -- 172.21.15.87:0/4109977100 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a08107320 con 0x7f9a08076c50 2024-09-17T07:11:09.435 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:08.415+0000 7f9a0659c640 1 --2- 172.21.15.87:0/4109977100 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a08076c50 0x7f9a08106de0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f99f8009840 tx=0x7f99f80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d1e63aaf7cbbd23 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:09.435 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:08.415+0000 7f9a05d9b640 1 -- 172.21.15.87:0/4109977100 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f99f8032440 con 0x7f9a08076c50 2024-09-17T07:11:09.435 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:08.415+0000 7f9a05d9b640 1 -- 172.21.15.87:0/4109977100 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 970+0+0 (secure 0 0 0) 0x7f99f80329e0 con 0x7f9a08076c50 2024-09-17T07:11:09.435 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:08.415+0000 7f9a05d9b640 1 -- 172.21.15.87:0/4109977100 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f99f8031930 con 0x7f9a08076c50 2024-09-17T07:11:09.436 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:08.415+0000 7f9a0cc1a640 1 -- 172.21.15.87:0/4109977100 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a08076c50 msgr2=0x7f9a08106de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:09.436 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:08.415+0000 7f9a0cc1a640 1 --2- 172.21.15.87:0/4109977100 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a08076c50 0x7f9a08106de0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f99f8009840 tx=0x7f99f80091d0 comp rx=0 tx=0).stop 2024-09-17T07:11:09.436 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:08.415+0000 7f9a0cc1a640 1 -- 172.21.15.87:0/4109977100 shutdown_connections 2024-09-17T07:11:09.436 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:08.415+0000 7f9a0cc1a640 1 --2- 172.21.15.87:0/4109977100 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a08076c50 0x7f9a08106de0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:09.436 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:08.415+0000 7f9a0cc1a640 1 -- 172.21.15.87:0/4109977100 >> 172.21.15.87:0/4109977100 conn(0x7f9a080fc430 msgr2=0x7f9a080fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:11:09.436 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:08.415+0000 7f9a0cc1a640 1 -- 172.21.15.87:0/4109977100 shutdown_connections 2024-09-17T07:11:09.436 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:08.415+0000 7f9a0cc1a640 1 -- 172.21.15.87:0/4109977100 wait complete. 2024-09-17T07:11:09.436 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:08.416+0000 7f9a0cc1a640 1 Processor -- start 2024-09-17T07:11:09.436 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:08.416+0000 7f9a0cc1a640 1 -- start start 2024-09-17T07:11:09.436 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:08.416+0000 7f9a0cc1a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a08076c50 0x7f9a08112e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:09.436 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:08.416+0000 7f9a0cc1a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a08113340 con 0x7f9a08076c50 2024-09-17T07:11:09.436 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:08.416+0000 7f9a0659c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a08076c50 0x7f9a08112e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:09.436 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:08.416+0000 7f9a0659c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a08076c50 0x7f9a08112e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52202/0 (socket says 172.21.15.87:52202) 2024-09-17T07:11:09.437 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:08.416+0000 7f9a0659c640 1 -- 172.21.15.87:0/3372560891 learned_addr learned my addr 172.21.15.87:0/3372560891 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:11:09.437 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:08.417+0000 7f9a0659c640 1 -- 172.21.15.87:0/3372560891 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f8009450 con 0x7f9a08076c50 2024-09-17T07:11:09.437 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:08.417+0000 7f9a0659c640 1 --2- 172.21.15.87:0/3372560891 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a08076c50 0x7f9a08112e00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f99f802a700 tx=0x7f99f8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:09.437 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:08.417+0000 7f99feffd640 1 -- 172.21.15.87:0/3372560891 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f99f8031ee0 con 0x7f9a08076c50 2024-09-17T07:11:09.437 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:08.417+0000 7f99feffd640 1 -- 172.21.15.87:0/3372560891 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 970+0+0 (secure 0 0 0) 0x7f99f803d890 con 0x7f9a08076c50 2024-09-17T07:11:09.437 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:08.417+0000 7f9a0cc1a640 1 -- 172.21.15.87:0/3372560891 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a08113540 con 0x7f9a08076c50 2024-09-17T07:11:09.437 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:08.417+0000 7f99feffd640 1 -- 172.21.15.87:0/3372560891 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f99f803b770 con 0x7f9a08076c50 2024-09-17T07:11:09.437 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:08.417+0000 7f9a0cc1a640 1 -- 172.21.15.87:0/3372560891 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a08113f90 con 0x7f9a08076c50 2024-09-17T07:11:09.437 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:08.418+0000 7f99feffd640 1 -- 172.21.15.87:0/3372560891 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f99f8039070 con 0x7f9a08076c50 2024-09-17T07:11:09.437 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:08.418+0000 7f99feffd640 1 --2- 172.21.15.87:0/3372560891 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f99f40394e0 0x7f99f403b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:09.437 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:08.418+0000 7f9a0cc1a640 1 -- 172.21.15.87:0/3372560891 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a0805ed70 con 0x7f9a08076c50 2024-09-17T07:11:09.437 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:08.418+0000 7f99feffd640 1 -- 172.21.15.87:0/3372560891 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f99f806d1e0 con 0x7f9a08076c50 2024-09-17T07:11:09.437 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:08.418+0000 7f99fffff640 1 --2- 172.21.15.87:0/3372560891 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f99f40394e0 0x7f99f403b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:09.437 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:08.419+0000 7f99fffff640 1 --2- 172.21.15.87:0/3372560891 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f99f40394e0 0x7f99f403b990 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f99f0006fd0 tx=0x7f99f0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:09.438 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:08.423+0000 7f99feffd640 1 -- 172.21.15.87:0/3372560891 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f99f803da00 con 0x7f9a08076c50 2024-09-17T07:11:09.438 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:08.579+0000 7f9a0cc1a640 1 -- 172.21.15.87:0/3372560891 --> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f9a080fd900 con 0x7f99f40394e0 2024-09-17T07:11:09.438 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:08.783+0000 7f99feffd640 1 -- 172.21.15.87:0/3372560891 <== mgr.14118 v2:172.21.15.87:6800/1735030430 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f9a080fd900 con 0x7f99f40394e0 2024-09-17T07:11:09.438 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:08.785+0000 7f9a0cc1a640 1 -- 172.21.15.87:0/3372560891 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f99f40394e0 msgr2=0x7f99f403b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:09.438 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:08.785+0000 7f9a0cc1a640 1 --2- 172.21.15.87:0/3372560891 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f99f40394e0 0x7f99f403b990 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f99f0006fd0 tx=0x7f99f0006db0 comp rx=0 tx=0).stop 2024-09-17T07:11:09.438 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:08.785+0000 7f9a0cc1a640 1 -- 172.21.15.87:0/3372560891 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a08076c50 msgr2=0x7f9a08112e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:09.438 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:08.785+0000 7f9a0cc1a640 1 --2- 172.21.15.87:0/3372560891 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a08076c50 0x7f9a08112e00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f99f802a700 tx=0x7f99f8008040 comp rx=0 tx=0).stop 2024-09-17T07:11:09.438 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:08.785+0000 7f9a0cc1a640 1 -- 172.21.15.87:0/3372560891 shutdown_connections 2024-09-17T07:11:09.438 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:08.785+0000 7f9a0cc1a640 1 --2- 172.21.15.87:0/3372560891 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f99f40394e0 0x7f99f403b990 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:09.438 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:08.785+0000 7f9a0cc1a640 1 --2- 172.21.15.87:0/3372560891 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a08076c50 0x7f9a08112e00 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:09.438 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:08.785+0000 7f9a0cc1a640 1 -- 172.21.15.87:0/3372560891 >> 172.21.15.87:0/3372560891 conn(0x7f9a080fc430 msgr2=0x7f9a080fd130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:11:09.438 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:08.786+0000 7f9a0cc1a640 1 -- 172.21.15.87:0/3372560891 shutdown_connections 2024-09-17T07:11:09.438 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:08.786+0000 7f9a0cc1a640 1 -- 172.21.15.87:0/3372560891 wait complete. 2024-09-17T07:11:09.993 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:09 smithi087 ceph-mon[27636]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:11:09.993 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:09 smithi087 ceph-mon[27636]: Generating ssh key... 2024-09-17T07:11:09.993 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:09 smithi087 ceph-mon[27636]: from='mgr.14118 172.21.15.87:0/353374649' entity='mgr.smithi087.vuvjer' 2024-09-17T07:11:09.993 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:09 smithi087 ceph-mon[27636]: from='mgr.14118 172.21.15.87:0/353374649' entity='mgr.smithi087.vuvjer' 2024-09-17T07:11:10.508 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDGMP9NyxWM96gatnzgz9Avvk1mI88qECyrLW7Fu3s+4U1JHtpPcIR3HjORS2sO9dyMt6G+gFOcg5dEuWdoiRNFPblD/wRRkVsVtg/+gpOOPWLtZrIGShOuT2B9kitX6sllrjieo8Wlol6X89SuDoU91DgR+tVH+pVB2AWFF84iCIqQWtskyAKHeRb6ROgDJ+EZOgmsozWcyMo0sfh1yjvxDskWKMTXYg1UzzHBhLuzBi0mNkPX9RX3/yxctxUt8ESlz6lg6CczoRuUSKXzi1pZkbEY9hMikwNqpTTD/DpDnrShhy7MOzRtZj0Q+OhfehD5J479kZN1uEApdJO5xjdmxWgQ5fWxnkrz/WkEKwmmIfJAPEdlUIoRpMBs2RMJtbYNXNnHIxDDqQjniBerMXEzf6erad1F69uTD1wlFthUZBSM+MAC6L/vhyxEZaU9e2ZcBjwRs+80gAqHEYHs65v8Mu/F+kN9aKbfV/SdVxHcQEcpse7mEgkzajlDGuRFOHk= ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968 2024-09-17T07:11:10.508 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:09.814+0000 7f8195d0c640 1 Processor -- start 2024-09-17T07:11:10.508 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:09.814+0000 7f8195d0c640 1 -- start start 2024-09-17T07:11:10.508 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:09.814+0000 7f8195d0c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8190102300 0x7f8190102710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:10.508 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:09.814+0000 7f8195d0c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8190102c50 con 0x7f8190102300 2024-09-17T07:11:10.508 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:09.814+0000 7f818f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8190102300 0x7f8190102710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:10.508 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:09.814+0000 7f818f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8190102300 0x7f8190102710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52218/0 (socket says 172.21.15.87:52218) 2024-09-17T07:11:10.509 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:09.814+0000 7f818f7fe640 1 -- 172.21.15.87:0/3781588074 learned_addr learned my addr 172.21.15.87:0/3781588074 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:11:10.509 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:09.815+0000 7f818f7fe640 1 -- 172.21.15.87:0/3781588074 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8190102d90 con 0x7f8190102300 2024-09-17T07:11:10.509 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:09.815+0000 7f818f7fe640 1 --2- 172.21.15.87:0/3781588074 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8190102300 0x7f8190102710 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8180009840 tx=0x7f81800091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e863660989f61bc1 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:10.509 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:09.815+0000 7f818e7fc640 1 -- 172.21.15.87:0/3781588074 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8180032440 con 0x7f8190102300 2024-09-17T07:11:10.509 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:09.815+0000 7f818e7fc640 1 -- 172.21.15.87:0/3781588074 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 970+0+0 (secure 0 0 0) 0x7f81800329e0 con 0x7f8190102300 2024-09-17T07:11:10.509 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:09.815+0000 7f818e7fc640 1 -- 172.21.15.87:0/3781588074 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8180031930 con 0x7f8190102300 2024-09-17T07:11:10.509 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:09.816+0000 7f8195d0c640 1 -- 172.21.15.87:0/3781588074 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8190102300 msgr2=0x7f8190102710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:10.509 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:09.816+0000 7f8195d0c640 1 --2- 172.21.15.87:0/3781588074 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8190102300 0x7f8190102710 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8180009840 tx=0x7f81800091d0 comp rx=0 tx=0).stop 2024-09-17T07:11:10.509 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:09.816+0000 7f8195d0c640 1 -- 172.21.15.87:0/3781588074 shutdown_connections 2024-09-17T07:11:10.509 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:09.816+0000 7f8195d0c640 1 --2- 172.21.15.87:0/3781588074 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8190102300 0x7f8190102710 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:10.509 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:09.816+0000 7f8195d0c640 1 -- 172.21.15.87:0/3781588074 >> 172.21.15.87:0/3781588074 conn(0x7f81900fbb70 msgr2=0x7f81900fdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:11:10.509 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:09.816+0000 7f8195d0c640 1 -- 172.21.15.87:0/3781588074 shutdown_connections 2024-09-17T07:11:10.509 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:09.816+0000 7f8195d0c640 1 -- 172.21.15.87:0/3781588074 wait complete. 2024-09-17T07:11:10.510 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:09.817+0000 7f8195d0c640 1 Processor -- start 2024-09-17T07:11:10.510 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:09.817+0000 7f8195d0c640 1 -- start start 2024-09-17T07:11:10.510 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:09.817+0000 7f8195d0c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8190102300 0x7f81901008c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:10.510 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:09.817+0000 7f8195d0c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8190113820 con 0x7f8190102300 2024-09-17T07:11:10.510 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:09.817+0000 7f818f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8190102300 0x7f81901008c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:10.510 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:09.817+0000 7f818f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8190102300 0x7f81901008c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52226/0 (socket says 172.21.15.87:52226) 2024-09-17T07:11:10.510 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:09.817+0000 7f818f7fe640 1 -- 172.21.15.87:0/2091606121 learned_addr learned my addr 172.21.15.87:0/2091606121 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:11:10.510 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:09.817+0000 7f818f7fe640 1 -- 172.21.15.87:0/2091606121 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8180009450 con 0x7f8190102300 2024-09-17T07:11:10.510 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:09.818+0000 7f818f7fe640 1 --2- 172.21.15.87:0/2091606121 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8190102300 0x7f81901008c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f81800098a0 tx=0x7f8180008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:10.510 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:09.818+0000 7f8177fff640 1 -- 172.21.15.87:0/2091606121 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f81800327b0 con 0x7f8190102300 2024-09-17T07:11:10.510 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:09.818+0000 7f8177fff640 1 -- 172.21.15.87:0/2091606121 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 970+0+0 (secure 0 0 0) 0x7f818003d890 con 0x7f8190102300 2024-09-17T07:11:10.510 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:09.818+0000 7f8195d0c640 1 -- 172.21.15.87:0/2091606121 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8190113960 con 0x7f8190102300 2024-09-17T07:11:10.510 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:09.818+0000 7f8177fff640 1 -- 172.21.15.87:0/2091606121 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f818003b780 con 0x7f8190102300 2024-09-17T07:11:10.510 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:09.818+0000 7f8195d0c640 1 -- 172.21.15.87:0/2091606121 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8190113d70 con 0x7f8190102300 2024-09-17T07:11:10.511 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:09.819+0000 7f8177fff640 1 -- 172.21.15.87:0/2091606121 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f8180039070 con 0x7f8190102300 2024-09-17T07:11:10.511 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:09.819+0000 7f8177fff640 1 --2- 172.21.15.87:0/2091606121 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f8178039490 0x7f817803b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:10.511 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:09.819+0000 7f8177fff640 1 -- 172.21.15.87:0/2091606121 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f818006d370 con 0x7f8190102300 2024-09-17T07:11:10.511 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:09.819+0000 7f8195d0c640 1 -- 172.21.15.87:0/2091606121 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f819005ed70 con 0x7f8190102300 2024-09-17T07:11:10.511 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:09.819+0000 7f818effd640 1 --2- 172.21.15.87:0/2091606121 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f8178039490 0x7f817803b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:10.511 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:09.819+0000 7f818effd640 1 --2- 172.21.15.87:0/2091606121 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f8178039490 0x7f817803b940 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8184006fd0 tx=0x7f8184006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:10.511 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:09.823+0000 7f8177fff640 1 -- 172.21.15.87:0/2091606121 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f8180037070 con 0x7f8190102300 2024-09-17T07:11:10.511 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:09.981+0000 7f8195d0c640 1 -- 172.21.15.87:0/2091606121 --> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f81900fceb0 con 0x7f8178039490 2024-09-17T07:11:10.511 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:09.982+0000 7f8177fff640 1 -- 172.21.15.87:0/2091606121 <== mgr.14118 v2:172.21.15.87:6800/1735030430 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f81900fceb0 con 0x7f8178039490 2024-09-17T07:11:10.511 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:09.983+0000 7f8195d0c640 1 -- 172.21.15.87:0/2091606121 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f8178039490 msgr2=0x7f817803b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:10.511 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:09.983+0000 7f8195d0c640 1 --2- 172.21.15.87:0/2091606121 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f8178039490 0x7f817803b940 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8184006fd0 tx=0x7f8184006db0 comp rx=0 tx=0).stop 2024-09-17T07:11:10.511 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:09.983+0000 7f8195d0c640 1 -- 172.21.15.87:0/2091606121 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8190102300 msgr2=0x7f81901008c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:10.511 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:09.983+0000 7f8195d0c640 1 --2- 172.21.15.87:0/2091606121 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8190102300 0x7f81901008c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f81800098a0 tx=0x7f8180008040 comp rx=0 tx=0).stop 2024-09-17T07:11:10.512 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:09.984+0000 7f8195d0c640 1 -- 172.21.15.87:0/2091606121 shutdown_connections 2024-09-17T07:11:10.512 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:09.984+0000 7f8195d0c640 1 --2- 172.21.15.87:0/2091606121 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f8178039490 0x7f817803b940 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:10.512 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:09.984+0000 7f8195d0c640 1 --2- 172.21.15.87:0/2091606121 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8190102300 0x7f81901008c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:10.512 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:09.984+0000 7f8195d0c640 1 -- 172.21.15.87:0/2091606121 >> 172.21.15.87:0/2091606121 conn(0x7f81900fbb70 msgr2=0x7f81900fc760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:11:10.512 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:09.984+0000 7f8195d0c640 1 -- 172.21.15.87:0/2091606121 shutdown_connections 2024-09-17T07:11:10.512 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:09.984+0000 7f8195d0c640 1 -- 172.21.15.87:0/2091606121 wait complete. 2024-09-17T07:11:10.512 INFO:teuthology.orchestra.run.smithi087.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-17T07:11:10.512 INFO:teuthology.orchestra.run.smithi087.stdout:Adding key to root@localhost authorized_keys... 2024-09-17T07:11:10.513 INFO:teuthology.orchestra.run.smithi087.stdout:Adding host smithi087... 2024-09-17T07:11:10.895 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:10 smithi087 ceph-mon[27636]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:11:11.844 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:11 smithi087 ceph-mon[27636]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi087", "addr": "172.21.15.87", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:11:12.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:12 smithi087 ceph-mon[27636]: Deploying cephadm binary to smithi087 2024-09-17T07:11:14.409 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout Added host 'smithi087' with addr '172.21.15.87' 2024-09-17T07:11:14.409 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:10.900+0000 7f5d71ad2640 1 Processor -- start 2024-09-17T07:11:14.409 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:10.900+0000 7f5d71ad2640 1 -- start start 2024-09-17T07:11:14.409 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:10.900+0000 7f5d71ad2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d6c076c90 0x7f5d6c1049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:14.409 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:10.900+0000 7f5d71ad2640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6c104ee0 con 0x7f5d6c076c90 2024-09-17T07:11:14.409 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:10.900+0000 7f5d6b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d6c076c90 0x7f5d6c1049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:14.409 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:10.900+0000 7f5d6b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d6c076c90 0x7f5d6c1049a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52238/0 (socket says 172.21.15.87:52238) 2024-09-17T07:11:14.410 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:10.901+0000 7f5d6b7fe640 1 -- 172.21.15.87:0/4084391262 learned_addr learned my addr 172.21.15.87:0/4084391262 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:11:14.410 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:10.901+0000 7f5d6b7fe640 1 -- 172.21.15.87:0/4084391262 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d6c105020 con 0x7f5d6c076c90 2024-09-17T07:11:14.410 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:10.901+0000 7f5d6b7fe640 1 --2- 172.21.15.87:0/4084391262 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d6c076c90 0x7f5d6c1049a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c009840 tx=0x7f5d5c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79ed65cc39b8d7ed server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:14.410 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:10.902+0000 7f5d6affd640 1 -- 172.21.15.87:0/4084391262 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5d5c032440 con 0x7f5d6c076c90 2024-09-17T07:11:14.410 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:10.902+0000 7f5d6affd640 1 -- 172.21.15.87:0/4084391262 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 970+0+0 (secure 0 0 0) 0x7f5d5c0329e0 con 0x7f5d6c076c90 2024-09-17T07:11:14.410 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:10.902+0000 7f5d6affd640 1 -- 172.21.15.87:0/4084391262 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5d5c031930 con 0x7f5d6c076c90 2024-09-17T07:11:14.410 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:10.902+0000 7f5d71ad2640 1 -- 172.21.15.87:0/4084391262 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d6c076c90 msgr2=0x7f5d6c1049a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:14.410 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:10.902+0000 7f5d71ad2640 1 --2- 172.21.15.87:0/4084391262 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d6c076c90 0x7f5d6c1049a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c009840 tx=0x7f5d5c0091d0 comp rx=0 tx=0).stop 2024-09-17T07:11:14.410 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:10.902+0000 7f5d71ad2640 1 -- 172.21.15.87:0/4084391262 shutdown_connections 2024-09-17T07:11:14.410 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:10.902+0000 7f5d71ad2640 1 --2- 172.21.15.87:0/4084391262 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d6c076c90 0x7f5d6c1049a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:14.410 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:10.902+0000 7f5d71ad2640 1 -- 172.21.15.87:0/4084391262 >> 172.21.15.87:0/4084391262 conn(0x7f5d6c0fc430 msgr2=0x7f5d6c0fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:11:14.410 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:10.902+0000 7f5d71ad2640 1 -- 172.21.15.87:0/4084391262 shutdown_connections 2024-09-17T07:11:14.410 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:10.902+0000 7f5d71ad2640 1 -- 172.21.15.87:0/4084391262 wait complete. 2024-09-17T07:11:14.411 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:10.903+0000 7f5d71ad2640 1 Processor -- start 2024-09-17T07:11:14.411 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:10.903+0000 7f5d71ad2640 1 -- start start 2024-09-17T07:11:14.411 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:10.903+0000 7f5d71ad2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d6c110ad0 0x7f5d6c110ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:14.411 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:10.903+0000 7f5d71ad2640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6c111420 con 0x7f5d6c110ad0 2024-09-17T07:11:14.411 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:10.903+0000 7f5d6b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d6c110ad0 0x7f5d6c110ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:14.411 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:10.903+0000 7f5d6b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d6c110ad0 0x7f5d6c110ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52250/0 (socket says 172.21.15.87:52250) 2024-09-17T07:11:14.411 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:10.903+0000 7f5d6b7fe640 1 -- 172.21.15.87:0/2587398076 learned_addr learned my addr 172.21.15.87:0/2587398076 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:11:14.411 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:10.904+0000 7f5d6b7fe640 1 -- 172.21.15.87:0/2587398076 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d5c009450 con 0x7f5d6c110ad0 2024-09-17T07:11:14.411 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:10.904+0000 7f5d6b7fe640 1 --2- 172.21.15.87:0/2587398076 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d6c110ad0 0x7f5d6c110ee0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c0098a0 tx=0x7f5d5c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:14.411 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:10.904+0000 7f5d68ff9640 1 -- 172.21.15.87:0/2587398076 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5d5c0327b0 con 0x7f5d6c110ad0 2024-09-17T07:11:14.411 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:10.904+0000 7f5d71ad2640 1 -- 172.21.15.87:0/2587398076 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d6c111620 con 0x7f5d6c110ad0 2024-09-17T07:11:14.411 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:10.904+0000 7f5d68ff9640 1 -- 172.21.15.87:0/2587398076 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 970+0+0 (secure 0 0 0) 0x7f5d5c03d890 con 0x7f5d6c110ad0 2024-09-17T07:11:14.411 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:10.904+0000 7f5d68ff9640 1 -- 172.21.15.87:0/2587398076 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5d5c03b780 con 0x7f5d6c110ad0 2024-09-17T07:11:14.411 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:10.904+0000 7f5d71ad2640 1 -- 172.21.15.87:0/2587398076 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d6c112000 con 0x7f5d6c110ad0 2024-09-17T07:11:14.412 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:10.905+0000 7f5d68ff9640 1 -- 172.21.15.87:0/2587398076 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f5d5c039070 con 0x7f5d6c110ad0 2024-09-17T07:11:14.412 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:10.905+0000 7f5d71ad2640 1 -- 172.21.15.87:0/2587398076 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d6c05ed70 con 0x7f5d6c110ad0 2024-09-17T07:11:14.412 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:10.905+0000 7f5d68ff9640 1 --2- 172.21.15.87:0/2587398076 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f5d58039490 0x7f5d5803b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:14.412 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:10.905+0000 7f5d68ff9640 1 -- 172.21.15.87:0/2587398076 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f5d5c06d400 con 0x7f5d6c110ad0 2024-09-17T07:11:14.412 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:10.905+0000 7f5d62ffd640 1 --2- 172.21.15.87:0/2587398076 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f5d58039490 0x7f5d5803b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:14.412 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:10.906+0000 7f5d62ffd640 1 --2- 172.21.15.87:0/2587398076 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f5d58039490 0x7f5d5803b940 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5d54006fd0 tx=0x7f5d54006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:14.412 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:10.910+0000 7f5d68ff9640 1 -- 172.21.15.87:0/2587398076 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f5d5c03da00 con 0x7f5d6c110ad0 2024-09-17T07:11:14.412 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:11.067+0000 7f5d71ad2640 1 -- 172.21.15.87:0/2587398076 --> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi087", "addr": "172.21.15.87", "target": ["mon-mgr", ""]}) v1 -- 0x7f5d6c0fd7a0 con 0x7f5d58039490 2024-09-17T07:11:14.412 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:13.802+0000 7f5d68ff9640 1 -- 172.21.15.87:0/2587398076 <== mgr.14118 v2:172.21.15.87:6800/1735030430 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7f5d6c0fd7a0 con 0x7f5d58039490 2024-09-17T07:11:14.412 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:13.804+0000 7f5d71ad2640 1 -- 172.21.15.87:0/2587398076 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f5d58039490 msgr2=0x7f5d5803b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:14.413 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:13.804+0000 7f5d71ad2640 1 --2- 172.21.15.87:0/2587398076 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f5d58039490 0x7f5d5803b940 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5d54006fd0 tx=0x7f5d54006db0 comp rx=0 tx=0).stop 2024-09-17T07:11:14.413 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:13.804+0000 7f5d71ad2640 1 -- 172.21.15.87:0/2587398076 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d6c110ad0 msgr2=0x7f5d6c110ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:14.413 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:13.804+0000 7f5d71ad2640 1 --2- 172.21.15.87:0/2587398076 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d6c110ad0 0x7f5d6c110ee0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c0098a0 tx=0x7f5d5c008040 comp rx=0 tx=0).stop 2024-09-17T07:11:14.413 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:13.804+0000 7f5d71ad2640 1 -- 172.21.15.87:0/2587398076 shutdown_connections 2024-09-17T07:11:14.413 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:13.804+0000 7f5d71ad2640 1 --2- 172.21.15.87:0/2587398076 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f5d58039490 0x7f5d5803b940 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:14.413 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:13.804+0000 7f5d71ad2640 1 --2- 172.21.15.87:0/2587398076 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d6c110ad0 0x7f5d6c110ee0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:14.413 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:13.804+0000 7f5d71ad2640 1 -- 172.21.15.87:0/2587398076 >> 172.21.15.87:0/2587398076 conn(0x7f5d6c0fc430 msgr2=0x7f5d6c0fcfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:11:14.413 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:13.805+0000 7f5d71ad2640 1 -- 172.21.15.87:0/2587398076 shutdown_connections 2024-09-17T07:11:14.413 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:13.805+0000 7f5d71ad2640 1 -- 172.21.15.87:0/2587398076 wait complete. 2024-09-17T07:11:14.413 INFO:teuthology.orchestra.run.smithi087.stdout:Deploying mon service with default placement... 2024-09-17T07:11:14.986 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:14 smithi087 ceph-mon[27636]: from='mgr.14118 172.21.15.87:0/353374649' entity='mgr.smithi087.vuvjer' 2024-09-17T07:11:14.986 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:14 smithi087 ceph-mon[27636]: Added host smithi087 2024-09-17T07:11:14.987 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:14 smithi087 ceph-mon[27636]: from='mgr.14118 172.21.15.87:0/353374649' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:11:15.808 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-17T07:11:15.808 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:14.804+0000 7f2accf61640 1 Processor -- start 2024-09-17T07:11:15.808 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:14.804+0000 7f2accf61640 1 -- start start 2024-09-17T07:11:15.808 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:14.804+0000 7f2accf61640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ac8101de0 0x7f2ac81021f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:15.809 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:14.804+0000 7f2accf61640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac8102730 con 0x7f2ac8101de0 2024-09-17T07:11:15.809 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:14.804+0000 7f2ac659c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ac8101de0 0x7f2ac81021f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:15.809 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:14.804+0000 7f2ac659c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ac8101de0 0x7f2ac81021f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52520/0 (socket says 172.21.15.87:52520) 2024-09-17T07:11:15.809 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:14.804+0000 7f2ac659c640 1 -- 172.21.15.87:0/1450515059 learned_addr learned my addr 172.21.15.87:0/1450515059 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:11:15.809 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:14.804+0000 7f2ac659c640 1 -- 172.21.15.87:0/1450515059 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ac8102870 con 0x7f2ac8101de0 2024-09-17T07:11:15.809 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:14.805+0000 7f2ac659c640 1 --2- 172.21.15.87:0/1450515059 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ac8101de0 0x7f2ac81021f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2ac0009840 tx=0x7f2ac00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f120907b5d615d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:15.809 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:14.805+0000 7f2ac559a640 1 -- 172.21.15.87:0/1450515059 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2ac0032440 con 0x7f2ac8101de0 2024-09-17T07:11:15.809 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:14.805+0000 7f2ac559a640 1 -- 172.21.15.87:0/1450515059 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 970+0+0 (secure 0 0 0) 0x7f2ac00329e0 con 0x7f2ac8101de0 2024-09-17T07:11:15.809 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:14.805+0000 7f2ac559a640 1 -- 172.21.15.87:0/1450515059 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2ac0031930 con 0x7f2ac8101de0 2024-09-17T07:11:15.809 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:14.806+0000 7f2accf61640 1 -- 172.21.15.87:0/1450515059 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ac8101de0 msgr2=0x7f2ac81021f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:15.809 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:14.806+0000 7f2accf61640 1 --2- 172.21.15.87:0/1450515059 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ac8101de0 0x7f2ac81021f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2ac0009840 tx=0x7f2ac00091d0 comp rx=0 tx=0).stop 2024-09-17T07:11:15.809 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:14.806+0000 7f2accf61640 1 -- 172.21.15.87:0/1450515059 shutdown_connections 2024-09-17T07:11:15.810 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:14.806+0000 7f2accf61640 1 --2- 172.21.15.87:0/1450515059 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ac8101de0 0x7f2ac81021f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:15.810 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:14.806+0000 7f2accf61640 1 -- 172.21.15.87:0/1450515059 >> 172.21.15.87:0/1450515059 conn(0x7f2ac80fd580 msgr2=0x7f2ac80ff9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:11:15.810 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:14.806+0000 7f2accf61640 1 -- 172.21.15.87:0/1450515059 shutdown_connections 2024-09-17T07:11:15.810 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:14.806+0000 7f2accf61640 1 -- 172.21.15.87:0/1450515059 wait complete. 2024-09-17T07:11:15.810 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:14.806+0000 7f2accf61640 1 Processor -- start 2024-09-17T07:11:15.810 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:14.807+0000 7f2accf61640 1 -- start start 2024-09-17T07:11:15.811 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:14.807+0000 7f2accf61640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ac8101de0 0x7f2ac8078bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:15.811 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:14.807+0000 7f2accf61640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac8079100 con 0x7f2ac8101de0 2024-09-17T07:11:15.811 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:14.807+0000 7f2ac659c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ac8101de0 0x7f2ac8078bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:15.811 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:14.807+0000 7f2ac659c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ac8101de0 0x7f2ac8078bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52530/0 (socket says 172.21.15.87:52530) 2024-09-17T07:11:15.811 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:14.807+0000 7f2ac659c640 1 -- 172.21.15.87:0/2084800109 learned_addr learned my addr 172.21.15.87:0/2084800109 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:11:15.811 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:14.807+0000 7f2ac659c640 1 -- 172.21.15.87:0/2084800109 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ac0009450 con 0x7f2ac8101de0 2024-09-17T07:11:15.811 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:14.807+0000 7f2ac659c640 1 --2- 172.21.15.87:0/2084800109 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ac8101de0 0x7f2ac8078bc0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2ac0006a70 tx=0x7f2ac0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:15.811 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:14.807+0000 7f2ab6ffd640 1 -- 172.21.15.87:0/2084800109 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2ac0031e90 con 0x7f2ac8101de0 2024-09-17T07:11:15.811 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:14.807+0000 7f2ab6ffd640 1 -- 172.21.15.87:0/2084800109 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 970+0+0 (secure 0 0 0) 0x7f2ac003d890 con 0x7f2ac8101de0 2024-09-17T07:11:15.811 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:14.807+0000 7f2ab6ffd640 1 -- 172.21.15.87:0/2084800109 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2ac003b760 con 0x7f2ac8101de0 2024-09-17T07:11:15.811 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:14.807+0000 7f2accf61640 1 -- 172.21.15.87:0/2084800109 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ac8077190 con 0x7f2ac8101de0 2024-09-17T07:11:15.811 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:14.807+0000 7f2accf61640 1 -- 172.21.15.87:0/2084800109 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ac8077600 con 0x7f2ac8101de0 2024-09-17T07:11:15.811 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:14.808+0000 7f2ab6ffd640 1 -- 172.21.15.87:0/2084800109 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f2ac0039070 con 0x7f2ac8101de0 2024-09-17T07:11:15.811 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:14.808+0000 7f2accf61640 1 -- 172.21.15.87:0/2084800109 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ac804b720 con 0x7f2ac8101de0 2024-09-17T07:11:15.812 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:14.809+0000 7f2ab6ffd640 1 --2- 172.21.15.87:0/2084800109 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f2ab00394e0 0x7f2ab003b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:15.812 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:14.809+0000 7f2ab6ffd640 1 -- 172.21.15.87:0/2084800109 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f2ac006d2d0 con 0x7f2ac8101de0 2024-09-17T07:11:15.812 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:14.809+0000 7f2ac5d9b640 1 --2- 172.21.15.87:0/2084800109 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f2ab00394e0 0x7f2ab003b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:15.812 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:14.809+0000 7f2ac5d9b640 1 --2- 172.21.15.87:0/2084800109 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f2ab00394e0 0x7f2ab003b990 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2abc00ad90 tx=0x7f2abc009410 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:15.812 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:14.813+0000 7f2ab6ffd640 1 -- 172.21.15.87:0/2084800109 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f2ac003da00 con 0x7f2ac8101de0 2024-09-17T07:11:15.812 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:14.985+0000 7f2accf61640 1 -- 172.21.15.87:0/2084800109 --> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7f2ac8077c80 con 0x7f2ab00394e0 2024-09-17T07:11:15.812 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:14.989+0000 7f2ab6ffd640 1 -- 172.21.15.87:0/2084800109 <== mgr.14118 v2:172.21.15.87:6800/1735030430 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f2ac8077c80 con 0x7f2ab00394e0 2024-09-17T07:11:15.812 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:14.991+0000 7f2accf61640 1 -- 172.21.15.87:0/2084800109 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f2ab00394e0 msgr2=0x7f2ab003b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:15.812 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:14.991+0000 7f2accf61640 1 --2- 172.21.15.87:0/2084800109 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f2ab00394e0 0x7f2ab003b990 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2abc00ad90 tx=0x7f2abc009410 comp rx=0 tx=0).stop 2024-09-17T07:11:15.813 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:14.991+0000 7f2accf61640 1 -- 172.21.15.87:0/2084800109 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ac8101de0 msgr2=0x7f2ac8078bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:15.813 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:14.991+0000 7f2accf61640 1 --2- 172.21.15.87:0/2084800109 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ac8101de0 0x7f2ac8078bc0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2ac0006a70 tx=0x7f2ac0008040 comp rx=0 tx=0).stop 2024-09-17T07:11:15.813 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:14.991+0000 7f2accf61640 1 -- 172.21.15.87:0/2084800109 shutdown_connections 2024-09-17T07:11:15.813 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:14.991+0000 7f2accf61640 1 --2- 172.21.15.87:0/2084800109 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f2ab00394e0 0x7f2ab003b990 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:15.813 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:14.991+0000 7f2accf61640 1 --2- 172.21.15.87:0/2084800109 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ac8101de0 0x7f2ac8078bc0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:15.813 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:14.991+0000 7f2accf61640 1 -- 172.21.15.87:0/2084800109 >> 172.21.15.87:0/2084800109 conn(0x7f2ac80fd580 msgr2=0x7f2ac80fe190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:11:15.813 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:14.991+0000 7f2accf61640 1 -- 172.21.15.87:0/2084800109 shutdown_connections 2024-09-17T07:11:15.813 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:14.992+0000 7f2accf61640 1 -- 172.21.15.87:0/2084800109 wait complete. 2024-09-17T07:11:15.813 INFO:teuthology.orchestra.run.smithi087.stdout:Deploying mgr service with default placement... 2024-09-17T07:11:16.120 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:15 smithi087 ceph-mon[27636]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:11:16.121 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:15 smithi087 ceph-mon[27636]: Saving service mon spec with placement count:5 2024-09-17T07:11:16.121 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:15 smithi087 ceph-mon[27636]: from='mgr.14118 172.21.15.87:0/353374649' entity='mgr.smithi087.vuvjer' 2024-09-17T07:11:17.302 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-17T07:11:17.302 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:16.395+0000 7f65fbf31640 1 Processor -- start 2024-09-17T07:11:17.303 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:16.396+0000 7f65fbf31640 1 -- start start 2024-09-17T07:11:17.303 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:16.396+0000 7f65fbf31640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65f4101ec0 0x7f65f41022d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:17.303 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:16.396+0000 7f65fbf31640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f41028a0 con 0x7f65f4101ec0 2024-09-17T07:11:17.303 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:16.396+0000 7f65f9ccd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65f4101ec0 0x7f65f41022d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:17.303 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:16.396+0000 7f65f9ccd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65f4101ec0 0x7f65f41022d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52544/0 (socket says 172.21.15.87:52544) 2024-09-17T07:11:17.303 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:16.396+0000 7f65f9ccd640 1 -- 172.21.15.87:0/856663374 learned_addr learned my addr 172.21.15.87:0/856663374 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:11:17.303 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:16.396+0000 7f65f9ccd640 1 -- 172.21.15.87:0/856663374 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65f41029e0 con 0x7f65f4101ec0 2024-09-17T07:11:17.303 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:16.397+0000 7f65f9ccd640 1 --2- 172.21.15.87:0/856663374 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65f4101ec0 0x7f65f41022d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f65e8009840 tx=0x7f65e80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c6c06257e616355 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:17.303 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:16.397+0000 7f65f8ccb640 1 -- 172.21.15.87:0/856663374 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f65e8032440 con 0x7f65f4101ec0 2024-09-17T07:11:17.303 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:16.397+0000 7f65f8ccb640 1 -- 172.21.15.87:0/856663374 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 970+0+0 (secure 0 0 0) 0x7f65e80329e0 con 0x7f65f4101ec0 2024-09-17T07:11:17.303 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:16.397+0000 7f65f8ccb640 1 -- 172.21.15.87:0/856663374 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f65e8031930 con 0x7f65f4101ec0 2024-09-17T07:11:17.303 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:16.398+0000 7f65fbf31640 1 -- 172.21.15.87:0/856663374 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65f4101ec0 msgr2=0x7f65f41022d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:17.303 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:16.398+0000 7f65fbf31640 1 --2- 172.21.15.87:0/856663374 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65f4101ec0 0x7f65f41022d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f65e8009840 tx=0x7f65e80091d0 comp rx=0 tx=0).stop 2024-09-17T07:11:17.304 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:16.398+0000 7f65fbf31640 1 -- 172.21.15.87:0/856663374 shutdown_connections 2024-09-17T07:11:17.304 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:16.398+0000 7f65fbf31640 1 --2- 172.21.15.87:0/856663374 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65f4101ec0 0x7f65f41022d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:17.304 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:16.398+0000 7f65fbf31640 1 -- 172.21.15.87:0/856663374 >> 172.21.15.87:0/856663374 conn(0x7f65f40fd680 msgr2=0x7f65f40ffab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:11:17.304 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:16.398+0000 7f65fbf31640 1 -- 172.21.15.87:0/856663374 shutdown_connections 2024-09-17T07:11:17.304 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:16.398+0000 7f65fbf31640 1 -- 172.21.15.87:0/856663374 wait complete. 2024-09-17T07:11:17.304 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:16.398+0000 7f65fbf31640 1 Processor -- start 2024-09-17T07:11:17.304 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:16.398+0000 7f65fbf31640 1 -- start start 2024-09-17T07:11:17.304 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:16.399+0000 7f65fbf31640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65f4101ec0 0x7f65f4110b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:17.304 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:16.399+0000 7f65fbf31640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f4111090 con 0x7f65f4101ec0 2024-09-17T07:11:17.304 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:16.399+0000 7f65f9ccd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65f4101ec0 0x7f65f4110b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:17.304 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:16.399+0000 7f65f9ccd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65f4101ec0 0x7f65f4110b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52558/0 (socket says 172.21.15.87:52558) 2024-09-17T07:11:17.304 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:16.399+0000 7f65f9ccd640 1 -- 172.21.15.87:0/2604347072 learned_addr learned my addr 172.21.15.87:0/2604347072 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:11:17.305 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:16.399+0000 7f65f9ccd640 1 -- 172.21.15.87:0/2604347072 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65e8009450 con 0x7f65f4101ec0 2024-09-17T07:11:17.305 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:16.399+0000 7f65f9ccd640 1 --2- 172.21.15.87:0/2604347072 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65f4101ec0 0x7f65f4110b50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f65e802a7a0 tx=0x7f65e8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:17.305 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:16.399+0000 7f65e67fc640 1 -- 172.21.15.87:0/2604347072 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f65e80327b0 con 0x7f65f4101ec0 2024-09-17T07:11:17.305 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:16.399+0000 7f65e67fc640 1 -- 172.21.15.87:0/2604347072 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 970+0+0 (secure 0 0 0) 0x7f65e803b8b0 con 0x7f65f4101ec0 2024-09-17T07:11:17.305 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:16.399+0000 7f65e67fc640 1 -- 172.21.15.87:0/2604347072 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f65e803a680 con 0x7f65f4101ec0 2024-09-17T07:11:17.305 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:16.399+0000 7f65fbf31640 1 -- 172.21.15.87:0/2604347072 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65f4111290 con 0x7f65f4101ec0 2024-09-17T07:11:17.305 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:16.399+0000 7f65fbf31640 1 -- 172.21.15.87:0/2604347072 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65f4111700 con 0x7f65f4101ec0 2024-09-17T07:11:17.305 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:16.400+0000 7f65e67fc640 1 -- 172.21.15.87:0/2604347072 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f65e803b470 con 0x7f65f4101ec0 2024-09-17T07:11:17.305 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:16.400+0000 7f65fbf31640 1 -- 172.21.15.87:0/2604347072 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65f404b720 con 0x7f65f4101ec0 2024-09-17T07:11:17.305 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:16.400+0000 7f65e67fc640 1 --2- 172.21.15.87:0/2604347072 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f65e0039490 0x7f65e003b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:17.305 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:16.400+0000 7f65e67fc640 1 -- 172.21.15.87:0/2604347072 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f65e806c9d0 con 0x7f65f4101ec0 2024-09-17T07:11:17.305 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:16.400+0000 7f65f94cc640 1 --2- 172.21.15.87:0/2604347072 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f65e0039490 0x7f65e003b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:17.306 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:16.401+0000 7f65f94cc640 1 --2- 172.21.15.87:0/2604347072 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f65e0039490 0x7f65e003b940 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f65f0006fd0 tx=0x7f65f0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:17.306 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:16.405+0000 7f65e67fc640 1 -- 172.21.15.87:0/2604347072 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f65e8045460 con 0x7f65f4101ec0 2024-09-17T07:11:17.306 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:16.571+0000 7f65fbf31640 1 -- 172.21.15.87:0/2604347072 --> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7f65f4111700 con 0x7f65e0039490 2024-09-17T07:11:17.306 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:16.575+0000 7f65e67fc640 1 -- 172.21.15.87:0/2604347072 <== mgr.14118 v2:172.21.15.87:6800/1735030430 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f65f4111700 con 0x7f65e0039490 2024-09-17T07:11:17.306 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:16.577+0000 7f65fbf31640 1 -- 172.21.15.87:0/2604347072 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f65e0039490 msgr2=0x7f65e003b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:17.306 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:16.577+0000 7f65fbf31640 1 --2- 172.21.15.87:0/2604347072 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f65e0039490 0x7f65e003b940 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f65f0006fd0 tx=0x7f65f0006db0 comp rx=0 tx=0).stop 2024-09-17T07:11:17.306 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:16.577+0000 7f65fbf31640 1 -- 172.21.15.87:0/2604347072 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65f4101ec0 msgr2=0x7f65f4110b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:17.306 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:16.577+0000 7f65fbf31640 1 --2- 172.21.15.87:0/2604347072 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65f4101ec0 0x7f65f4110b50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f65e802a7a0 tx=0x7f65e8008040 comp rx=0 tx=0).stop 2024-09-17T07:11:17.306 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:16.578+0000 7f65fbf31640 1 -- 172.21.15.87:0/2604347072 shutdown_connections 2024-09-17T07:11:17.306 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:16.578+0000 7f65fbf31640 1 --2- 172.21.15.87:0/2604347072 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f65e0039490 0x7f65e003b940 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:17.307 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:16.578+0000 7f65fbf31640 1 --2- 172.21.15.87:0/2604347072 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65f4101ec0 0x7f65f4110b50 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:17.307 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:16.578+0000 7f65fbf31640 1 -- 172.21.15.87:0/2604347072 >> 172.21.15.87:0/2604347072 conn(0x7f65f40fd680 msgr2=0x7f65f40fe250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:11:17.307 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:16.578+0000 7f65fbf31640 1 -- 172.21.15.87:0/2604347072 shutdown_connections 2024-09-17T07:11:17.307 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:16.578+0000 7f65fbf31640 1 -- 172.21.15.87:0/2604347072 wait complete. 2024-09-17T07:11:17.307 INFO:teuthology.orchestra.run.smithi087.stdout:Deploying crash service with default placement... 2024-09-17T07:11:17.850 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:17 smithi087 ceph-mon[27636]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:11:17.850 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:17 smithi087 ceph-mon[27636]: Saving service mgr spec with placement count:2 2024-09-17T07:11:17.850 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:17 smithi087 ceph-mon[27636]: from='mgr.14118 172.21.15.87:0/353374649' entity='mgr.smithi087.vuvjer' 2024-09-17T07:11:18.911 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2024-09-17T07:11:18.911 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:18.149+0000 7f43d7120640 1 Processor -- start 2024-09-17T07:11:18.911 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:18.150+0000 7f43d7120640 1 -- start start 2024-09-17T07:11:18.911 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:18.150+0000 7f43d7120640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43d0102340 0x7f43d0102750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:18.911 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:18.150+0000 7f43d7120640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d0102c90 con 0x7f43d0102340 2024-09-17T07:11:18.911 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:18.150+0000 7f43d4ebc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43d0102340 0x7f43d0102750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:18.912 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:18.150+0000 7f43d4ebc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43d0102340 0x7f43d0102750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52574/0 (socket says 172.21.15.87:52574) 2024-09-17T07:11:18.912 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:18.150+0000 7f43d4ebc640 1 -- 172.21.15.87:0/3266140089 learned_addr learned my addr 172.21.15.87:0/3266140089 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:11:18.912 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:18.150+0000 7f43d4ebc640 1 -- 172.21.15.87:0/3266140089 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43d0102dd0 con 0x7f43d0102340 2024-09-17T07:11:18.912 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:18.151+0000 7f43d4ebc640 1 --2- 172.21.15.87:0/3266140089 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43d0102340 0x7f43d0102750 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f43c400baf0 tx=0x7f43c400b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7014e3b69691f177 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:18.912 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:18.151+0000 7f43cf7fe640 1 -- 172.21.15.87:0/3266140089 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f43c40327a0 con 0x7f43d0102340 2024-09-17T07:11:18.912 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:18.151+0000 7f43cf7fe640 1 -- 172.21.15.87:0/3266140089 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f43c4032d80 con 0x7f43d0102340 2024-09-17T07:11:18.912 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:18.151+0000 7f43cf7fe640 1 -- 172.21.15.87:0/3266140089 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f43c4031dd0 con 0x7f43d0102340 2024-09-17T07:11:18.912 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:18.152+0000 7f43d7120640 1 -- 172.21.15.87:0/3266140089 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43d0102340 msgr2=0x7f43d0102750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:18.912 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:18.152+0000 7f43d7120640 1 --2- 172.21.15.87:0/3266140089 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43d0102340 0x7f43d0102750 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f43c400baf0 tx=0x7f43c400b460 comp rx=0 tx=0).stop 2024-09-17T07:11:18.912 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:18.152+0000 7f43d7120640 1 -- 172.21.15.87:0/3266140089 shutdown_connections 2024-09-17T07:11:18.912 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:18.152+0000 7f43d7120640 1 --2- 172.21.15.87:0/3266140089 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43d0102340 0x7f43d0102750 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:18.913 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:18.152+0000 7f43d7120640 1 -- 172.21.15.87:0/3266140089 >> 172.21.15.87:0/3266140089 conn(0x7f43d00fbb70 msgr2=0x7f43d00fdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:11:18.913 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:18.152+0000 7f43d7120640 1 -- 172.21.15.87:0/3266140089 shutdown_connections 2024-09-17T07:11:18.913 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:18.152+0000 7f43d7120640 1 -- 172.21.15.87:0/3266140089 wait complete. 2024-09-17T07:11:18.913 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:18.152+0000 7f43d7120640 1 Processor -- start 2024-09-17T07:11:18.913 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:18.152+0000 7f43d7120640 1 -- start start 2024-09-17T07:11:18.913 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:18.153+0000 7f43d7120640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43d0102340 0x7f43d010e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:18.913 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:18.153+0000 7f43d7120640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d010eef0 con 0x7f43d0102340 2024-09-17T07:11:18.913 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:18.153+0000 7f43d4ebc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43d0102340 0x7f43d010e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:18.913 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:18.153+0000 7f43d4ebc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43d0102340 0x7f43d010e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52584/0 (socket says 172.21.15.87:52584) 2024-09-17T07:11:18.913 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:18.153+0000 7f43d4ebc640 1 -- 172.21.15.87:0/34667979 learned_addr learned my addr 172.21.15.87:0/34667979 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:11:18.913 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:18.153+0000 7f43d4ebc640 1 -- 172.21.15.87:0/34667979 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c400b700 con 0x7f43d0102340 2024-09-17T07:11:18.913 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:18.153+0000 7f43d4ebc640 1 --2- 172.21.15.87:0/34667979 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43d0102340 0x7f43d010e9b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f43c400b2c0 tx=0x7f43c403d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:18.913 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:18.153+0000 7f43cd7fa640 1 -- 172.21.15.87:0/34667979 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f43c4032a80 con 0x7f43d0102340 2024-09-17T07:11:18.914 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:18.153+0000 7f43cd7fa640 1 -- 172.21.15.87:0/34667979 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f43c4032be0 con 0x7f43d0102340 2024-09-17T07:11:18.914 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:18.153+0000 7f43d7120640 1 -- 172.21.15.87:0/34667979 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43d010f0f0 con 0x7f43d0102340 2024-09-17T07:11:18.914 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:18.154+0000 7f43cd7fa640 1 -- 172.21.15.87:0/34667979 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f43c40455b0 con 0x7f43d0102340 2024-09-17T07:11:18.914 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:18.154+0000 7f43d7120640 1 -- 172.21.15.87:0/34667979 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43d010f560 con 0x7f43d0102340 2024-09-17T07:11:18.914 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:18.154+0000 7f43cd7fa640 1 -- 172.21.15.87:0/34667979 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f43c4045870 con 0x7f43d0102340 2024-09-17T07:11:18.914 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:18.155+0000 7f43d7120640 1 -- 172.21.15.87:0/34667979 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43d0101b20 con 0x7f43d0102340 2024-09-17T07:11:18.914 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:18.155+0000 7f43cd7fa640 1 --2- 172.21.15.87:0/34667979 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f43c0039490 0x7f43c003b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:18.914 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:18.155+0000 7f43cd7fa640 1 -- 172.21.15.87:0/34667979 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f43c406fd10 con 0x7f43d0102340 2024-09-17T07:11:18.914 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:18.155+0000 7f43cffff640 1 --2- 172.21.15.87:0/34667979 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f43c0039490 0x7f43c003b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:18.914 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:18.155+0000 7f43cffff640 1 --2- 172.21.15.87:0/34667979 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f43c0039490 0x7f43c003b940 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f43bc006fd0 tx=0x7f43bc006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:18.914 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:18.163+0000 7f43cd7fa640 1 -- 172.21.15.87:0/34667979 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f43c404c300 con 0x7f43d0102340 2024-09-17T07:11:18.914 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:18.343+0000 7f43d7120640 1 -- 172.21.15.87:0/34667979 --> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7f43d010f560 con 0x7f43c0039490 2024-09-17T07:11:18.915 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:18.349+0000 7f43cd7fa640 1 -- 172.21.15.87:0/34667979 <== mgr.14118 v2:172.21.15.87:6800/1735030430 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7f43d010f560 con 0x7f43c0039490 2024-09-17T07:11:18.915 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:18.351+0000 7f43d7120640 1 -- 172.21.15.87:0/34667979 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f43c0039490 msgr2=0x7f43c003b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:18.915 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:18.351+0000 7f43d7120640 1 --2- 172.21.15.87:0/34667979 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f43c0039490 0x7f43c003b940 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f43bc006fd0 tx=0x7f43bc006db0 comp rx=0 tx=0).stop 2024-09-17T07:11:18.915 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:18.351+0000 7f43d7120640 1 -- 172.21.15.87:0/34667979 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43d0102340 msgr2=0x7f43d010e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:18.915 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:18.351+0000 7f43d7120640 1 --2- 172.21.15.87:0/34667979 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43d0102340 0x7f43d010e9b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f43c400b2c0 tx=0x7f43c403d040 comp rx=0 tx=0).stop 2024-09-17T07:11:18.915 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:18.351+0000 7f43d7120640 1 -- 172.21.15.87:0/34667979 shutdown_connections 2024-09-17T07:11:18.915 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:18.351+0000 7f43d7120640 1 --2- 172.21.15.87:0/34667979 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f43c0039490 0x7f43c003b940 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:18.915 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:18.351+0000 7f43d7120640 1 --2- 172.21.15.87:0/34667979 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43d0102340 0x7f43d010e9b0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:18.915 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:18.351+0000 7f43d7120640 1 -- 172.21.15.87:0/34667979 >> 172.21.15.87:0/34667979 conn(0x7f43d00fbb70 msgr2=0x7f43d0105210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:11:18.915 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:18.351+0000 7f43d7120640 1 -- 172.21.15.87:0/34667979 shutdown_connections 2024-09-17T07:11:18.915 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:18.351+0000 7f43d7120640 1 -- 172.21.15.87:0/34667979 wait complete. 2024-09-17T07:11:18.915 INFO:teuthology.orchestra.run.smithi087.stdout:Deploying prometheus service with default placement... 2024-09-17T07:11:19.013 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:18 smithi087 ceph-mon[27636]: from='mgr.14118 172.21.15.87:0/353374649' entity='mgr.smithi087.vuvjer' 2024-09-17T07:11:19.013 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:18 smithi087 ceph-mon[27636]: from='mgr.14118 172.21.15.87:0/353374649' entity='mgr.smithi087.vuvjer' 2024-09-17T07:11:19.013 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:18 smithi087 ceph-mon[27636]: from='mgr.14118 172.21.15.87:0/353374649' entity='mgr.smithi087.vuvjer' 2024-09-17T07:11:19.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:19 smithi087 ceph-mon[27636]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:11:19.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:19 smithi087 ceph-mon[27636]: Saving service crash spec with placement * 2024-09-17T07:11:19.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:19 smithi087 ceph-mon[27636]: from='mgr.14118 172.21.15.87:0/353374649' entity='mgr.smithi087.vuvjer' 2024-09-17T07:11:20.112 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2024-09-17T07:11:20.112 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:19.407+0000 7f57e3c3f640 1 Processor -- start 2024-09-17T07:11:20.112 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:19.407+0000 7f57e3c3f640 1 -- start start 2024-09-17T07:11:20.112 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:19.407+0000 7f57e3c3f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57dc100780 0x7f57dc100b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:20.112 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:19.407+0000 7f57e3c3f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57dc076cb0 con 0x7f57dc100780 2024-09-17T07:11:20.112 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:19.407+0000 7f57e19db640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57dc100780 0x7f57dc100b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:20.112 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:19.407+0000 7f57e19db640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57dc100780 0x7f57dc100b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52586/0 (socket says 172.21.15.87:52586) 2024-09-17T07:11:20.112 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:19.407+0000 7f57e19db640 1 -- 172.21.15.87:0/2077812937 learned_addr learned my addr 172.21.15.87:0/2077812937 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:11:20.112 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:19.407+0000 7f57e19db640 1 -- 172.21.15.87:0/2077812937 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57dc076df0 con 0x7f57dc100780 2024-09-17T07:11:20.112 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:19.408+0000 7f57e19db640 1 --2- 172.21.15.87:0/2077812937 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57dc100780 0x7f57dc100b90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f57d0009840 tx=0x7f57d00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75e1e250aa1c9f94 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:20.113 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:19.408+0000 7f57e09d9640 1 -- 172.21.15.87:0/2077812937 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f57d0032440 con 0x7f57dc100780 2024-09-17T07:11:20.113 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:19.408+0000 7f57e09d9640 1 -- 172.21.15.87:0/2077812937 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f57d0032a20 con 0x7f57dc100780 2024-09-17T07:11:20.113 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:19.408+0000 7f57e09d9640 1 -- 172.21.15.87:0/2077812937 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f57d00319e0 con 0x7f57dc100780 2024-09-17T07:11:20.113 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:19.409+0000 7f57e3c3f640 1 -- 172.21.15.87:0/2077812937 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57dc100780 msgr2=0x7f57dc100b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:20.113 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:19.409+0000 7f57e3c3f640 1 --2- 172.21.15.87:0/2077812937 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57dc100780 0x7f57dc100b90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f57d0009840 tx=0x7f57d00091d0 comp rx=0 tx=0).stop 2024-09-17T07:11:20.113 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:19.409+0000 7f57e3c3f640 1 -- 172.21.15.87:0/2077812937 shutdown_connections 2024-09-17T07:11:20.113 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:19.409+0000 7f57e3c3f640 1 --2- 172.21.15.87:0/2077812937 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57dc100780 0x7f57dc100b90 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:20.113 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:19.409+0000 7f57e3c3f640 1 -- 172.21.15.87:0/2077812937 >> 172.21.15.87:0/2077812937 conn(0x7f57dc0fc470 msgr2=0x7f57dc0fe880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:11:20.113 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:19.409+0000 7f57e3c3f640 1 -- 172.21.15.87:0/2077812937 shutdown_connections 2024-09-17T07:11:20.113 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:19.409+0000 7f57e3c3f640 1 -- 172.21.15.87:0/2077812937 wait complete. 2024-09-17T07:11:20.113 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:19.409+0000 7f57e3c3f640 1 Processor -- start 2024-09-17T07:11:20.113 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:19.410+0000 7f57e3c3f640 1 -- start start 2024-09-17T07:11:20.114 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:19.410+0000 7f57e3c3f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57dc100780 0x7f57dc117180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:20.114 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:19.410+0000 7f57e3c3f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57dc1176c0 con 0x7f57dc100780 2024-09-17T07:11:20.114 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:19.410+0000 7f57e19db640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57dc100780 0x7f57dc117180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:20.114 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:19.410+0000 7f57e19db640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57dc100780 0x7f57dc117180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52596/0 (socket says 172.21.15.87:52596) 2024-09-17T07:11:20.114 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:19.410+0000 7f57e19db640 1 -- 172.21.15.87:0/3078752875 learned_addr learned my addr 172.21.15.87:0/3078752875 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:11:20.114 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:19.410+0000 7f57e19db640 1 -- 172.21.15.87:0/3078752875 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57d0009450 con 0x7f57dc100780 2024-09-17T07:11:20.114 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:19.410+0000 7f57e19db640 1 --2- 172.21.15.87:0/3078752875 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57dc100780 0x7f57dc117180 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f57d0006f00 tx=0x7f57d002c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:20.114 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:19.410+0000 7f57ce7fc640 1 -- 172.21.15.87:0/3078752875 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f57d0031e00 con 0x7f57dc100780 2024-09-17T07:11:20.114 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:19.410+0000 7f57ce7fc640 1 -- 172.21.15.87:0/3078752875 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f57d003b8c0 con 0x7f57dc100780 2024-09-17T07:11:20.114 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:19.410+0000 7f57e3c3f640 1 -- 172.21.15.87:0/3078752875 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57dc1178c0 con 0x7f57dc100780 2024-09-17T07:11:20.114 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:19.410+0000 7f57ce7fc640 1 -- 172.21.15.87:0/3078752875 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f57d003a680 con 0x7f57dc100780 2024-09-17T07:11:20.114 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:19.410+0000 7f57e3c3f640 1 -- 172.21.15.87:0/3078752875 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57dc117d30 con 0x7f57dc100780 2024-09-17T07:11:20.115 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:19.411+0000 7f57ce7fc640 1 -- 172.21.15.87:0/3078752875 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f57d0039070 con 0x7f57dc100780 2024-09-17T07:11:20.115 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:19.412+0000 7f57e3c3f640 1 -- 172.21.15.87:0/3078752875 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57dc101c10 con 0x7f57dc100780 2024-09-17T07:11:20.115 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:19.412+0000 7f57ce7fc640 1 --2- 172.21.15.87:0/3078752875 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f57c80394e0 0x7f57c803b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:20.115 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:19.412+0000 7f57ce7fc640 1 -- 172.21.15.87:0/3078752875 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f57d006c960 con 0x7f57dc100780 2024-09-17T07:11:20.115 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:19.412+0000 7f57e11da640 1 --2- 172.21.15.87:0/3078752875 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f57c80394e0 0x7f57c803b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:20.115 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:19.412+0000 7f57e11da640 1 --2- 172.21.15.87:0/3078752875 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f57c80394e0 0x7f57c803b990 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f57d8006fd0 tx=0x7f57d8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:20.115 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:19.416+0000 7f57ce7fc640 1 -- 172.21.15.87:0/3078752875 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f57d0030940 con 0x7f57dc100780 2024-09-17T07:11:20.115 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:19.582+0000 7f57e3c3f640 1 -- 172.21.15.87:0/3078752875 --> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7f57dc117d30 con 0x7f57c80394e0 2024-09-17T07:11:20.115 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:19.586+0000 7f57ce7fc640 1 -- 172.21.15.87:0/3078752875 <== mgr.14118 v2:172.21.15.87:6800/1735030430 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7f57dc117d30 con 0x7f57c80394e0 2024-09-17T07:11:20.115 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:19.587+0000 7f57e3c3f640 1 -- 172.21.15.87:0/3078752875 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f57c80394e0 msgr2=0x7f57c803b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:20.115 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:19.587+0000 7f57e3c3f640 1 --2- 172.21.15.87:0/3078752875 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f57c80394e0 0x7f57c803b990 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f57d8006fd0 tx=0x7f57d8006db0 comp rx=0 tx=0).stop 2024-09-17T07:11:20.115 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:19.587+0000 7f57e3c3f640 1 -- 172.21.15.87:0/3078752875 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57dc100780 msgr2=0x7f57dc117180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:20.115 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:19.587+0000 7f57e3c3f640 1 --2- 172.21.15.87:0/3078752875 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57dc100780 0x7f57dc117180 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f57d0006f00 tx=0x7f57d002c040 comp rx=0 tx=0).stop 2024-09-17T07:11:20.116 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:19.587+0000 7f57e3c3f640 1 -- 172.21.15.87:0/3078752875 shutdown_connections 2024-09-17T07:11:20.116 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:19.587+0000 7f57e3c3f640 1 --2- 172.21.15.87:0/3078752875 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f57c80394e0 0x7f57c803b990 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:20.116 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:19.587+0000 7f57e3c3f640 1 --2- 172.21.15.87:0/3078752875 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57dc100780 0x7f57dc117180 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:20.116 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:19.587+0000 7f57e3c3f640 1 -- 172.21.15.87:0/3078752875 >> 172.21.15.87:0/3078752875 conn(0x7f57dc0fc470 msgr2=0x7f57dc102e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:11:20.116 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:19.588+0000 7f57e3c3f640 1 -- 172.21.15.87:0/3078752875 shutdown_connections 2024-09-17T07:11:20.116 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:19.588+0000 7f57e3c3f640 1 -- 172.21.15.87:0/3078752875 wait complete. 2024-09-17T07:11:20.116 INFO:teuthology.orchestra.run.smithi087.stdout:Deploying grafana service with default placement... 2024-09-17T07:11:20.744 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:20 smithi087 ceph-mon[27636]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:11:20.744 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:20 smithi087 ceph-mon[27636]: Saving service prometheus spec with placement count:1 2024-09-17T07:11:20.744 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:20 smithi087 ceph-mon[27636]: from='mgr.14118 172.21.15.87:0/353374649' entity='mgr.smithi087.vuvjer' 2024-09-17T07:11:21.521 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2024-09-17T07:11:21.522 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:20.743+0000 7f3f81241640 1 Processor -- start 2024-09-17T07:11:21.522 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:20.743+0000 7f3f81241640 1 -- start start 2024-09-17T07:11:21.522 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:20.743+0000 7f3f81241640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f7c101eb0 0x7f3f7c1022c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:21.522 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:20.743+0000 7f3f81241640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f7c102890 con 0x7f3f7c101eb0 2024-09-17T07:11:21.522 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:20.743+0000 7f3f7ad9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f7c101eb0 0x7f3f7c1022c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:21.522 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:20.743+0000 7f3f7ad9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f7c101eb0 0x7f3f7c1022c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52600/0 (socket says 172.21.15.87:52600) 2024-09-17T07:11:21.523 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:20.743+0000 7f3f7ad9d640 1 -- 172.21.15.87:0/2989505785 learned_addr learned my addr 172.21.15.87:0/2989505785 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:11:21.523 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:20.743+0000 7f3f7ad9d640 1 -- 172.21.15.87:0/2989505785 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f7c1029d0 con 0x7f3f7c101eb0 2024-09-17T07:11:21.523 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:20.744+0000 7f3f7ad9d640 1 --2- 172.21.15.87:0/2989505785 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f7c101eb0 0x7f3f7c1022c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c009840 tx=0x7f3f6c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e61e1b0deca3793 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:21.523 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:20.744+0000 7f3f79d9b640 1 -- 172.21.15.87:0/2989505785 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3f6c032440 con 0x7f3f7c101eb0 2024-09-17T07:11:21.523 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:20.744+0000 7f3f79d9b640 1 -- 172.21.15.87:0/2989505785 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f3f6c032a20 con 0x7f3f7c101eb0 2024-09-17T07:11:21.523 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:20.744+0000 7f3f79d9b640 1 -- 172.21.15.87:0/2989505785 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3f6c0319e0 con 0x7f3f7c101eb0 2024-09-17T07:11:21.523 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:20.745+0000 7f3f81241640 1 -- 172.21.15.87:0/2989505785 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f7c101eb0 msgr2=0x7f3f7c1022c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:21.523 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:20.745+0000 7f3f81241640 1 --2- 172.21.15.87:0/2989505785 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f7c101eb0 0x7f3f7c1022c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c009840 tx=0x7f3f6c0091d0 comp rx=0 tx=0).stop 2024-09-17T07:11:21.523 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:20.745+0000 7f3f81241640 1 -- 172.21.15.87:0/2989505785 shutdown_connections 2024-09-17T07:11:21.524 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:20.745+0000 7f3f81241640 1 --2- 172.21.15.87:0/2989505785 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f7c101eb0 0x7f3f7c1022c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:21.524 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:20.745+0000 7f3f81241640 1 -- 172.21.15.87:0/2989505785 >> 172.21.15.87:0/2989505785 conn(0x7f3f7c0fd670 msgr2=0x7f3f7c0ffaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:11:21.524 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:20.745+0000 7f3f81241640 1 -- 172.21.15.87:0/2989505785 shutdown_connections 2024-09-17T07:11:21.524 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:20.745+0000 7f3f81241640 1 -- 172.21.15.87:0/2989505785 wait complete. 2024-09-17T07:11:21.524 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:20.746+0000 7f3f81241640 1 Processor -- start 2024-09-17T07:11:21.524 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:20.746+0000 7f3f81241640 1 -- start start 2024-09-17T07:11:21.524 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:20.746+0000 7f3f81241640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f7c101eb0 0x7f3f7c110b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:21.524 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:20.746+0000 7f3f81241640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f7c111080 con 0x7f3f7c101eb0 2024-09-17T07:11:21.525 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:20.746+0000 7f3f7ad9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f7c101eb0 0x7f3f7c110b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:21.525 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:20.746+0000 7f3f7ad9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f7c101eb0 0x7f3f7c110b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52606/0 (socket says 172.21.15.87:52606) 2024-09-17T07:11:21.525 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:20.746+0000 7f3f7ad9d640 1 -- 172.21.15.87:0/741330262 learned_addr learned my addr 172.21.15.87:0/741330262 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:11:21.525 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:20.746+0000 7f3f7ad9d640 1 -- 172.21.15.87:0/741330262 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f6c009450 con 0x7f3f7c101eb0 2024-09-17T07:11:21.525 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:20.746+0000 7f3f7ad9d640 1 --2- 172.21.15.87:0/741330262 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f7c101eb0 0x7f3f7c110b40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c035040 tx=0x7f3f6c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:21.525 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:20.747+0000 7f3f637fe640 1 -- 172.21.15.87:0/741330262 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3f6c032880 con 0x7f3f7c101eb0 2024-09-17T07:11:21.525 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:20.747+0000 7f3f637fe640 1 -- 172.21.15.87:0/741330262 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f3f6c03d8d0 con 0x7f3f7c101eb0 2024-09-17T07:11:21.525 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:20.747+0000 7f3f81241640 1 -- 172.21.15.87:0/741330262 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f7c111280 con 0x7f3f7c101eb0 2024-09-17T07:11:21.525 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:20.747+0000 7f3f637fe640 1 -- 172.21.15.87:0/741330262 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3f6c03b970 con 0x7f3f7c101eb0 2024-09-17T07:11:21.525 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:20.747+0000 7f3f81241640 1 -- 172.21.15.87:0/741330262 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f7c1116f0 con 0x7f3f7c101eb0 2024-09-17T07:11:21.525 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:20.747+0000 7f3f637fe640 1 -- 172.21.15.87:0/741330262 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f3f6c039070 con 0x7f3f7c101eb0 2024-09-17T07:11:21.525 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:20.748+0000 7f3f81241640 1 -- 172.21.15.87:0/741330262 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f7c04b720 con 0x7f3f7c101eb0 2024-09-17T07:11:21.525 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:20.748+0000 7f3f637fe640 1 --2- 172.21.15.87:0/741330262 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f3f64039490 0x7f3f6403b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:21.526 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:20.748+0000 7f3f637fe640 1 -- 172.21.15.87:0/741330262 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f3f6c06e010 con 0x7f3f7c101eb0 2024-09-17T07:11:21.526 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:20.748+0000 7f3f7a59c640 1 --2- 172.21.15.87:0/741330262 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f3f64039490 0x7f3f6403b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:21.526 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:20.748+0000 7f3f7a59c640 1 --2- 172.21.15.87:0/741330262 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f3f64039490 0x7f3f6403b940 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3f70006fd0 tx=0x7f3f70006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:21.526 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:20.752+0000 7f3f637fe640 1 -- 172.21.15.87:0/741330262 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f3f6c04eda0 con 0x7f3f7c101eb0 2024-09-17T07:11:21.526 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:20.925+0000 7f3f81241640 1 -- 172.21.15.87:0/741330262 --> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7f3f7c1116f0 con 0x7f3f64039490 2024-09-17T07:11:21.526 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:20.932+0000 7f3f637fe640 1 -- 172.21.15.87:0/741330262 <== mgr.14118 v2:172.21.15.87:6800/1735030430 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7f3f7c1116f0 con 0x7f3f64039490 2024-09-17T07:11:21.526 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:20.934+0000 7f3f81241640 1 -- 172.21.15.87:0/741330262 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f3f64039490 msgr2=0x7f3f6403b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:21.526 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:20.934+0000 7f3f81241640 1 --2- 172.21.15.87:0/741330262 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f3f64039490 0x7f3f6403b940 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3f70006fd0 tx=0x7f3f70006db0 comp rx=0 tx=0).stop 2024-09-17T07:11:21.526 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:20.934+0000 7f3f81241640 1 -- 172.21.15.87:0/741330262 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f7c101eb0 msgr2=0x7f3f7c110b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:21.526 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:20.934+0000 7f3f81241640 1 --2- 172.21.15.87:0/741330262 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f7c101eb0 0x7f3f7c110b40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c035040 tx=0x7f3f6c008040 comp rx=0 tx=0).stop 2024-09-17T07:11:21.526 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:20.934+0000 7f3f81241640 1 -- 172.21.15.87:0/741330262 shutdown_connections 2024-09-17T07:11:21.526 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:20.934+0000 7f3f81241640 1 --2- 172.21.15.87:0/741330262 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f3f64039490 0x7f3f6403b940 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:21.527 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:20.934+0000 7f3f81241640 1 --2- 172.21.15.87:0/741330262 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f7c101eb0 0x7f3f7c110b40 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:21.527 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:20.934+0000 7f3f81241640 1 -- 172.21.15.87:0/741330262 >> 172.21.15.87:0/741330262 conn(0x7f3f7c0fd670 msgr2=0x7f3f7c0fe1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:11:21.527 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:20.934+0000 7f3f81241640 1 -- 172.21.15.87:0/741330262 shutdown_connections 2024-09-17T07:11:21.527 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:20.934+0000 7f3f81241640 1 -- 172.21.15.87:0/741330262 wait complete. 2024-09-17T07:11:21.527 INFO:teuthology.orchestra.run.smithi087.stdout:Deploying node-exporter service with default placement... 2024-09-17T07:11:22.046 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:21 smithi087 ceph-mon[27636]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:11:22.047 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:21 smithi087 ceph-mon[27636]: Saving service grafana spec with placement count:1 2024-09-17T07:11:22.047 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:21 smithi087 ceph-mon[27636]: from='mgr.14118 172.21.15.87:0/353374649' entity='mgr.smithi087.vuvjer' 2024-09-17T07:11:22.047 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:21 smithi087 ceph-mon[27636]: from='mgr.14118 172.21.15.87:0/353374649' entity='mgr.smithi087.vuvjer' 2024-09-17T07:11:22.728 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2024-09-17T07:11:22.728 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:21.864+0000 7f3d5ccba640 1 Processor -- start 2024-09-17T07:11:22.728 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:21.864+0000 7f3d5ccba640 1 -- start start 2024-09-17T07:11:22.728 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:21.865+0000 7f3d5ccba640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d58103430 0x7f3d58103840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:22.729 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:21.865+0000 7f3d5ccba640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d58103d80 con 0x7f3d58103430 2024-09-17T07:11:22.729 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:21.865+0000 7f3d5659c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d58103430 0x7f3d58103840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:22.729 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:21.865+0000 7f3d5659c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d58103430 0x7f3d58103840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52614/0 (socket says 172.21.15.87:52614) 2024-09-17T07:11:22.729 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:21.865+0000 7f3d5659c640 1 -- 172.21.15.87:0/2912345900 learned_addr learned my addr 172.21.15.87:0/2912345900 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:11:22.729 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:21.865+0000 7f3d5659c640 1 -- 172.21.15.87:0/2912345900 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d58103ec0 con 0x7f3d58103430 2024-09-17T07:11:22.729 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:21.866+0000 7f3d5659c640 1 --2- 172.21.15.87:0/2912345900 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d58103430 0x7f3d58103840 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3d48009840 tx=0x7f3d480091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f62253e2b6ed5f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:22.729 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:21.866+0000 7f3d5559a640 1 -- 172.21.15.87:0/2912345900 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3d48032440 con 0x7f3d58103430 2024-09-17T07:11:22.729 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:21.866+0000 7f3d5559a640 1 -- 172.21.15.87:0/2912345900 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f3d48032a20 con 0x7f3d58103430 2024-09-17T07:11:22.729 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:21.866+0000 7f3d5559a640 1 -- 172.21.15.87:0/2912345900 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3d480319e0 con 0x7f3d58103430 2024-09-17T07:11:22.729 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:21.866+0000 7f3d5ccba640 1 -- 172.21.15.87:0/2912345900 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d58103430 msgr2=0x7f3d58103840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:22.729 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:21.866+0000 7f3d5ccba640 1 --2- 172.21.15.87:0/2912345900 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d58103430 0x7f3d58103840 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3d48009840 tx=0x7f3d480091d0 comp rx=0 tx=0).stop 2024-09-17T07:11:22.729 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:21.867+0000 7f3d5ccba640 1 -- 172.21.15.87:0/2912345900 shutdown_connections 2024-09-17T07:11:22.729 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:21.867+0000 7f3d5ccba640 1 --2- 172.21.15.87:0/2912345900 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d58103430 0x7f3d58103840 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:22.730 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:21.867+0000 7f3d5ccba640 1 -- 172.21.15.87:0/2912345900 >> 172.21.15.87:0/2912345900 conn(0x7f3d580fbb50 msgr2=0x7f3d580fdfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:11:22.730 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:21.867+0000 7f3d5ccba640 1 -- 172.21.15.87:0/2912345900 shutdown_connections 2024-09-17T07:11:22.730 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:21.867+0000 7f3d5ccba640 1 -- 172.21.15.87:0/2912345900 wait complete. 2024-09-17T07:11:22.730 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:21.867+0000 7f3d5ccba640 1 Processor -- start 2024-09-17T07:11:22.730 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:21.867+0000 7f3d5ccba640 1 -- start start 2024-09-17T07:11:22.730 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:21.867+0000 7f3d5ccba640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d58103430 0x7f3d58110bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:22.730 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:21.867+0000 7f3d5ccba640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d581110f0 con 0x7f3d58103430 2024-09-17T07:11:22.730 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:21.867+0000 7f3d5659c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d58103430 0x7f3d58110bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:22.730 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:21.867+0000 7f3d5659c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d58103430 0x7f3d58110bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52618/0 (socket says 172.21.15.87:52618) 2024-09-17T07:11:22.730 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:21.867+0000 7f3d5659c640 1 -- 172.21.15.87:0/3819952905 learned_addr learned my addr 172.21.15.87:0/3819952905 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:11:22.730 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:21.868+0000 7f3d5659c640 1 -- 172.21.15.87:0/3819952905 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d48009450 con 0x7f3d58103430 2024-09-17T07:11:22.730 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:21.868+0000 7f3d5659c640 1 --2- 172.21.15.87:0/3819952905 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d58103430 0x7f3d58110bb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3d48006f00 tx=0x7f3d4802c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:22.730 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:21.868+0000 7f3d46ffd640 1 -- 172.21.15.87:0/3819952905 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3d48031e00 con 0x7f3d58103430 2024-09-17T07:11:22.731 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:21.868+0000 7f3d46ffd640 1 -- 172.21.15.87:0/3819952905 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f3d4803b8c0 con 0x7f3d58103430 2024-09-17T07:11:22.731 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:21.868+0000 7f3d5ccba640 1 -- 172.21.15.87:0/3819952905 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d581112f0 con 0x7f3d58103430 2024-09-17T07:11:22.731 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:21.868+0000 7f3d46ffd640 1 -- 172.21.15.87:0/3819952905 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3d4803a680 con 0x7f3d58103430 2024-09-17T07:11:22.731 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:21.868+0000 7f3d5ccba640 1 -- 172.21.15.87:0/3819952905 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d58111760 con 0x7f3d58103430 2024-09-17T07:11:22.731 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:21.869+0000 7f3d46ffd640 1 -- 172.21.15.87:0/3819952905 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f3d48039070 con 0x7f3d58103430 2024-09-17T07:11:22.731 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:21.869+0000 7f3d5ccba640 1 -- 172.21.15.87:0/3819952905 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d581008f0 con 0x7f3d58103430 2024-09-17T07:11:22.731 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:21.869+0000 7f3d46ffd640 1 --2- 172.21.15.87:0/3819952905 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f3d40039490 0x7f3d4003b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:22.731 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:21.869+0000 7f3d46ffd640 1 -- 172.21.15.87:0/3819952905 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f3d4806c8f0 con 0x7f3d58103430 2024-09-17T07:11:22.731 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:21.869+0000 7f3d55d9b640 1 --2- 172.21.15.87:0/3819952905 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f3d40039490 0x7f3d4003b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:22.731 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:21.870+0000 7f3d55d9b640 1 --2- 172.21.15.87:0/3819952905 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f3d40039490 0x7f3d4003b940 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c006fd0 tx=0x7f3d4c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:22.731 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:21.873+0000 7f3d46ffd640 1 -- 172.21.15.87:0/3819952905 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f3d48039ae0 con 0x7f3d58103430 2024-09-17T07:11:22.731 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:22.045+0000 7f3d5ccba640 1 -- 172.21.15.87:0/3819952905 --> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7f3d58111760 con 0x7f3d40039490 2024-09-17T07:11:22.731 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:22.051+0000 7f3d46ffd640 1 -- 172.21.15.87:0/3819952905 <== mgr.14118 v2:172.21.15.87:6800/1735030430 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7f3d58111760 con 0x7f3d40039490 2024-09-17T07:11:22.732 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:22.053+0000 7f3d5ccba640 1 -- 172.21.15.87:0/3819952905 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f3d40039490 msgr2=0x7f3d4003b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:22.732 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:22.053+0000 7f3d5ccba640 1 --2- 172.21.15.87:0/3819952905 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f3d40039490 0x7f3d4003b940 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c006fd0 tx=0x7f3d4c006db0 comp rx=0 tx=0).stop 2024-09-17T07:11:22.732 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:22.053+0000 7f3d5ccba640 1 -- 172.21.15.87:0/3819952905 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d58103430 msgr2=0x7f3d58110bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:22.732 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:22.053+0000 7f3d5ccba640 1 --2- 172.21.15.87:0/3819952905 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d58103430 0x7f3d58110bb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3d48006f00 tx=0x7f3d4802c040 comp rx=0 tx=0).stop 2024-09-17T07:11:22.732 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:22.053+0000 7f3d5ccba640 1 -- 172.21.15.87:0/3819952905 shutdown_connections 2024-09-17T07:11:22.732 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:22.053+0000 7f3d5ccba640 1 --2- 172.21.15.87:0/3819952905 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f3d40039490 0x7f3d4003b940 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:22.732 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:22.053+0000 7f3d5ccba640 1 --2- 172.21.15.87:0/3819952905 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d58103430 0x7f3d58110bb0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:22.732 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:22.053+0000 7f3d5ccba640 1 -- 172.21.15.87:0/3819952905 >> 172.21.15.87:0/3819952905 conn(0x7f3d580fbb50 msgr2=0x7f3d580fc7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:11:22.732 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:22.053+0000 7f3d5ccba640 1 -- 172.21.15.87:0/3819952905 shutdown_connections 2024-09-17T07:11:22.732 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:22.053+0000 7f3d5ccba640 1 -- 172.21.15.87:0/3819952905 wait complete. 2024-09-17T07:11:22.732 INFO:teuthology.orchestra.run.smithi087.stdout:Deploying alertmanager service with default placement... 2024-09-17T07:11:23.350 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:23 smithi087 ceph-mon[27636]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:11:23.350 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:23 smithi087 ceph-mon[27636]: Saving service node-exporter spec with placement * 2024-09-17T07:11:23.350 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:23 smithi087 ceph-mon[27636]: from='mgr.14118 172.21.15.87:0/353374649' entity='mgr.smithi087.vuvjer' 2024-09-17T07:11:24.524 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2024-09-17T07:11:24.524 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:23.783+0000 7f44c1a1e640 1 Processor -- start 2024-09-17T07:11:24.524 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:23.783+0000 7f44c1a1e640 1 -- start start 2024-09-17T07:11:24.524 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:23.783+0000 7f44c1a1e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44bc101ec0 0x7f44bc1022d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:24.524 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:23.783+0000 7f44c1a1e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44bc1028a0 con 0x7f44bc101ec0 2024-09-17T07:11:24.524 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:23.783+0000 7f44baffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44bc101ec0 0x7f44bc1022d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:24.524 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:23.783+0000 7f44baffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44bc101ec0 0x7f44bc1022d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52620/0 (socket says 172.21.15.87:52620) 2024-09-17T07:11:24.524 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:23.783+0000 7f44baffd640 1 -- 172.21.15.87:0/1849533450 learned_addr learned my addr 172.21.15.87:0/1849533450 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:11:24.525 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:23.784+0000 7f44baffd640 1 -- 172.21.15.87:0/1849533450 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44bc1029e0 con 0x7f44bc101ec0 2024-09-17T07:11:24.525 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:23.784+0000 7f44baffd640 1 --2- 172.21.15.87:0/1849533450 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44bc101ec0 0x7f44bc1022d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f44ac009e50 tx=0x7f44ac009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10b6425918a30b85 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:24.525 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:23.785+0000 7f44b9ffb640 1 -- 172.21.15.87:0/1849533450 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f44ac031560 con 0x7f44bc101ec0 2024-09-17T07:11:24.525 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:23.785+0000 7f44b9ffb640 1 -- 172.21.15.87:0/1849533450 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f44ac02d050 con 0x7f44bc101ec0 2024-09-17T07:11:24.525 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:23.785+0000 7f44b9ffb640 1 -- 172.21.15.87:0/1849533450 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f44ac0079b0 con 0x7f44bc101ec0 2024-09-17T07:11:24.525 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:23.785+0000 7f44c1a1e640 1 -- 172.21.15.87:0/1849533450 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44bc101ec0 msgr2=0x7f44bc1022d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:24.525 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:23.785+0000 7f44c1a1e640 1 --2- 172.21.15.87:0/1849533450 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44bc101ec0 0x7f44bc1022d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f44ac009e50 tx=0x7f44ac009840 comp rx=0 tx=0).stop 2024-09-17T07:11:24.525 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:23.785+0000 7f44c1a1e640 1 -- 172.21.15.87:0/1849533450 shutdown_connections 2024-09-17T07:11:24.525 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:23.785+0000 7f44c1a1e640 1 --2- 172.21.15.87:0/1849533450 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44bc101ec0 0x7f44bc1022d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:24.525 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:23.785+0000 7f44c1a1e640 1 -- 172.21.15.87:0/1849533450 >> 172.21.15.87:0/1849533450 conn(0x7f44bc0fd680 msgr2=0x7f44bc0ffab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:11:24.525 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:23.785+0000 7f44c1a1e640 1 -- 172.21.15.87:0/1849533450 shutdown_connections 2024-09-17T07:11:24.525 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:23.785+0000 7f44c1a1e640 1 -- 172.21.15.87:0/1849533450 wait complete. 2024-09-17T07:11:24.525 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:23.786+0000 7f44c1a1e640 1 Processor -- start 2024-09-17T07:11:24.526 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:23.786+0000 7f44c1a1e640 1 -- start start 2024-09-17T07:11:24.526 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:23.786+0000 7f44c1a1e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44bc101ec0 0x7f44bc078bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:24.526 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:23.786+0000 7f44c1a1e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44bc079100 con 0x7f44bc101ec0 2024-09-17T07:11:24.526 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:23.786+0000 7f44baffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44bc101ec0 0x7f44bc078bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:24.526 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:23.786+0000 7f44baffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44bc101ec0 0x7f44bc078bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52628/0 (socket says 172.21.15.87:52628) 2024-09-17T07:11:24.526 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:23.786+0000 7f44baffd640 1 -- 172.21.15.87:0/184861482 learned_addr learned my addr 172.21.15.87:0/184861482 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:11:24.526 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:23.787+0000 7f44baffd640 1 -- 172.21.15.87:0/184861482 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44ac009ae0 con 0x7f44bc101ec0 2024-09-17T07:11:24.526 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:23.787+0000 7f44baffd640 1 --2- 172.21.15.87:0/184861482 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44bc101ec0 0x7f44bc078bc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f44ac007690 tx=0x7f44ac009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:24.526 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:23.787+0000 7f44a37fe640 1 -- 172.21.15.87:0/184861482 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f44ac031b40 con 0x7f44bc101ec0 2024-09-17T07:11:24.526 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:23.787+0000 7f44a37fe640 1 -- 172.21.15.87:0/184861482 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f44ac031ca0 con 0x7f44bc101ec0 2024-09-17T07:11:24.527 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:23.787+0000 7f44c1a1e640 1 -- 172.21.15.87:0/184861482 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44bc077190 con 0x7f44bc101ec0 2024-09-17T07:11:24.527 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:23.787+0000 7f44a37fe640 1 -- 172.21.15.87:0/184861482 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f44ac0443e0 con 0x7f44bc101ec0 2024-09-17T07:11:24.527 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:23.787+0000 7f44c1a1e640 1 -- 172.21.15.87:0/184861482 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44bc077600 con 0x7f44bc101ec0 2024-09-17T07:11:24.527 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:23.788+0000 7f44a37fe640 1 -- 172.21.15.87:0/184861482 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f44ac038040 con 0x7f44bc101ec0 2024-09-17T07:11:24.527 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:23.788+0000 7f44a37fe640 1 --2- 172.21.15.87:0/184861482 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f44a40394e0 0x7f44a403b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:24.527 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:23.788+0000 7f44a37fe640 1 -- 172.21.15.87:0/184861482 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f44ac040030 con 0x7f44bc101ec0 2024-09-17T07:11:24.527 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:23.788+0000 7f44c1a1e640 1 -- 172.21.15.87:0/184861482 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44bc04b720 con 0x7f44bc101ec0 2024-09-17T07:11:24.527 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:23.788+0000 7f44ba7fc640 1 --2- 172.21.15.87:0/184861482 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f44a40394e0 0x7f44a403b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:24.527 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:23.789+0000 7f44ba7fc640 1 --2- 172.21.15.87:0/184861482 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f44a40394e0 0x7f44a403b990 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f44b0006fd0 tx=0x7f44b0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:24.527 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:23.793+0000 7f44a37fe640 1 -- 172.21.15.87:0/184861482 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f44ac036070 con 0x7f44bc101ec0 2024-09-17T07:11:24.527 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:23.959+0000 7f44c1a1e640 1 -- 172.21.15.87:0/184861482 --> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7f44bc077ba0 con 0x7f44a40394e0 2024-09-17T07:11:24.527 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:23.964+0000 7f44a37fe640 1 -- 172.21.15.87:0/184861482 <== mgr.14118 v2:172.21.15.87:6800/1735030430 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7f44bc077ba0 con 0x7f44a40394e0 2024-09-17T07:11:24.528 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:23.966+0000 7f44c1a1e640 1 -- 172.21.15.87:0/184861482 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f44a40394e0 msgr2=0x7f44a403b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:24.528 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:23.966+0000 7f44c1a1e640 1 --2- 172.21.15.87:0/184861482 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f44a40394e0 0x7f44a403b990 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f44b0006fd0 tx=0x7f44b0006db0 comp rx=0 tx=0).stop 2024-09-17T07:11:24.528 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:23.966+0000 7f44c1a1e640 1 -- 172.21.15.87:0/184861482 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44bc101ec0 msgr2=0x7f44bc078bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:24.528 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:23.966+0000 7f44c1a1e640 1 --2- 172.21.15.87:0/184861482 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44bc101ec0 0x7f44bc078bc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f44ac007690 tx=0x7f44ac009840 comp rx=0 tx=0).stop 2024-09-17T07:11:24.528 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:23.966+0000 7f44c1a1e640 1 -- 172.21.15.87:0/184861482 shutdown_connections 2024-09-17T07:11:24.528 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:23.966+0000 7f44c1a1e640 1 --2- 172.21.15.87:0/184861482 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f44a40394e0 0x7f44a403b990 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:24.528 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:23.966+0000 7f44c1a1e640 1 --2- 172.21.15.87:0/184861482 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44bc101ec0 0x7f44bc078bc0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:24.528 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:23.966+0000 7f44c1a1e640 1 -- 172.21.15.87:0/184861482 >> 172.21.15.87:0/184861482 conn(0x7f44bc0fd680 msgr2=0x7f44bc0fe270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:11:24.528 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:23.966+0000 7f44c1a1e640 1 -- 172.21.15.87:0/184861482 shutdown_connections 2024-09-17T07:11:24.528 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:23.966+0000 7f44c1a1e640 1 -- 172.21.15.87:0/184861482 wait complete. 2024-09-17T07:11:25.092 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:24 smithi087 ceph-mon[27636]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T07:11:25.092 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:24 smithi087 ceph-mon[27636]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:11:25.092 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:24 smithi087 ceph-mon[27636]: Saving service alertmanager spec with placement count:1 2024-09-17T07:11:25.092 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:24 smithi087 ceph-mon[27636]: from='mgr.14118 172.21.15.87:0/353374649' entity='mgr.smithi087.vuvjer' 2024-09-17T07:11:25.620 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:24.910+0000 7f1afc06d640 1 Processor -- start 2024-09-17T07:11:25.620 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:24.910+0000 7f1afc06d640 1 -- start start 2024-09-17T07:11:25.620 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:24.911+0000 7f1afc06d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1af4102340 0x7f1af4102730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:25.621 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:24.911+0000 7f1afc06d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1af4102c70 con 0x7f1af4102340 2024-09-17T07:11:25.621 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:24.911+0000 7f1af9e09640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1af4102340 0x7f1af4102730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:25.621 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:24.911+0000 7f1af9e09640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1af4102340 0x7f1af4102730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35298/0 (socket says 172.21.15.87:35298) 2024-09-17T07:11:25.621 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:24.911+0000 7f1af9e09640 1 -- 172.21.15.87:0/749654907 learned_addr learned my addr 172.21.15.87:0/749654907 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:11:25.621 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:24.911+0000 7f1af9e09640 1 -- 172.21.15.87:0/749654907 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1af4102db0 con 0x7f1af4102340 2024-09-17T07:11:25.621 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:24.912+0000 7f1af9e09640 1 --2- 172.21.15.87:0/749654907 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1af4102340 0x7f1af4102730 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1ae8009840 tx=0x7f1ae80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b793ed39c34df2 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:25.622 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:24.912+0000 7f1af8e07640 1 -- 172.21.15.87:0/749654907 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1ae8032440 con 0x7f1af4102340 2024-09-17T07:11:25.622 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:24.912+0000 7f1af8e07640 1 -- 172.21.15.87:0/749654907 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f1ae8032a20 con 0x7f1af4102340 2024-09-17T07:11:25.622 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:24.912+0000 7f1af8e07640 1 -- 172.21.15.87:0/749654907 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1ae80319e0 con 0x7f1af4102340 2024-09-17T07:11:25.622 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:24.913+0000 7f1afc06d640 1 -- 172.21.15.87:0/749654907 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1af4102340 msgr2=0x7f1af4102730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:25.622 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:24.913+0000 7f1afc06d640 1 --2- 172.21.15.87:0/749654907 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1af4102340 0x7f1af4102730 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1ae8009840 tx=0x7f1ae80091d0 comp rx=0 tx=0).stop 2024-09-17T07:11:25.622 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:24.913+0000 7f1afc06d640 1 -- 172.21.15.87:0/749654907 shutdown_connections 2024-09-17T07:11:25.623 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:24.913+0000 7f1afc06d640 1 --2- 172.21.15.87:0/749654907 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1af4102340 0x7f1af4102730 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:25.623 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:24.913+0000 7f1afc06d640 1 -- 172.21.15.87:0/749654907 >> 172.21.15.87:0/749654907 conn(0x7f1af40fbc00 msgr2=0x7f1af40fe010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:11:25.623 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:24.913+0000 7f1afc06d640 1 -- 172.21.15.87:0/749654907 shutdown_connections 2024-09-17T07:11:25.623 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:24.913+0000 7f1afc06d640 1 -- 172.21.15.87:0/749654907 wait complete. 2024-09-17T07:11:25.623 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:24.913+0000 7f1afc06d640 1 Processor -- start 2024-09-17T07:11:25.623 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:24.913+0000 7f1afc06d640 1 -- start start 2024-09-17T07:11:25.623 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:24.913+0000 7f1afc06d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1af4102340 0x7f1af4112e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:25.623 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:24.913+0000 7f1afc06d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1af4113350 con 0x7f1af4102340 2024-09-17T07:11:25.624 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:24.913+0000 7f1af9e09640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1af4102340 0x7f1af4112e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:25.624 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:24.913+0000 7f1af9e09640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1af4102340 0x7f1af4112e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35304/0 (socket says 172.21.15.87:35304) 2024-09-17T07:11:25.624 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:24.913+0000 7f1af9e09640 1 -- 172.21.15.87:0/2110481333 learned_addr learned my addr 172.21.15.87:0/2110481333 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:11:25.624 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:24.914+0000 7f1af9e09640 1 -- 172.21.15.87:0/2110481333 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ae8009450 con 0x7f1af4102340 2024-09-17T07:11:25.624 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:24.914+0000 7f1af9e09640 1 --2- 172.21.15.87:0/2110481333 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1af4102340 0x7f1af4112e10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1ae8009810 tx=0x7f1ae802c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:25.624 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:24.914+0000 7f1ae67fc640 1 -- 172.21.15.87:0/2110481333 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1ae8032880 con 0x7f1af4102340 2024-09-17T07:11:25.624 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:24.914+0000 7f1ae67fc640 1 -- 172.21.15.87:0/2110481333 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f1ae803b8c0 con 0x7f1af4102340 2024-09-17T07:11:25.624 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:24.914+0000 7f1afc06d640 1 -- 172.21.15.87:0/2110481333 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1af4113550 con 0x7f1af4102340 2024-09-17T07:11:25.624 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:24.914+0000 7f1ae67fc640 1 -- 172.21.15.87:0/2110481333 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1ae803a7f0 con 0x7f1af4102340 2024-09-17T07:11:25.624 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:24.914+0000 7f1afc06d640 1 -- 172.21.15.87:0/2110481333 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1af4113fa0 con 0x7f1af4102340 2024-09-17T07:11:25.624 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:24.915+0000 7f1ae67fc640 1 -- 172.21.15.87:0/2110481333 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f1ae8039070 con 0x7f1af4102340 2024-09-17T07:11:25.625 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:24.915+0000 7f1afc06d640 1 -- 172.21.15.87:0/2110481333 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1af405ed70 con 0x7f1af4102340 2024-09-17T07:11:25.625 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:24.915+0000 7f1ae67fc640 1 --2- 172.21.15.87:0/2110481333 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f1ae00394e0 0x7f1ae003b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:25.625 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:24.915+0000 7f1ae67fc640 1 -- 172.21.15.87:0/2110481333 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f1ae806c900 con 0x7f1af4102340 2024-09-17T07:11:25.625 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:24.915+0000 7f1af9608640 1 --2- 172.21.15.87:0/2110481333 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f1ae00394e0 0x7f1ae003b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:25.625 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:24.916+0000 7f1af9608640 1 --2- 172.21.15.87:0/2110481333 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f1ae00394e0 0x7f1ae003b990 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1af0006fd0 tx=0x7f1af0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:25.625 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:24.919+0000 7f1ae67fc640 1 -- 172.21.15.87:0/2110481333 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f1ae803b440 con 0x7f1af4102340 2024-09-17T07:11:25.625 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:25.075+0000 7f1afc06d640 1 -- 172.21.15.87:0/2110481333 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7f1af404b720 con 0x7f1af4102340 2024-09-17T07:11:25.626 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:25.079+0000 7f1ae67fc640 1 -- 172.21.15.87:0/2110481333 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7f1ae803f070 con 0x7f1af4102340 2024-09-17T07:11:25.626 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:25.081+0000 7f1afc06d640 1 -- 172.21.15.87:0/2110481333 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f1ae00394e0 msgr2=0x7f1ae003b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:25.626 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:25.081+0000 7f1afc06d640 1 --2- 172.21.15.87:0/2110481333 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f1ae00394e0 0x7f1ae003b990 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1af0006fd0 tx=0x7f1af0006db0 comp rx=0 tx=0).stop 2024-09-17T07:11:25.626 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:25.081+0000 7f1afc06d640 1 -- 172.21.15.87:0/2110481333 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1af4102340 msgr2=0x7f1af4112e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:25.626 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:25.081+0000 7f1afc06d640 1 --2- 172.21.15.87:0/2110481333 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1af4102340 0x7f1af4112e10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1ae8009810 tx=0x7f1ae802c040 comp rx=0 tx=0).stop 2024-09-17T07:11:25.626 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:25.081+0000 7f1afc06d640 1 -- 172.21.15.87:0/2110481333 shutdown_connections 2024-09-17T07:11:25.626 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:25.081+0000 7f1afc06d640 1 --2- 172.21.15.87:0/2110481333 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f1ae00394e0 0x7f1ae003b990 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:25.626 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:25.081+0000 7f1afc06d640 1 --2- 172.21.15.87:0/2110481333 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1af4102340 0x7f1af4112e10 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:25.626 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:25.081+0000 7f1afc06d640 1 -- 172.21.15.87:0/2110481333 >> 172.21.15.87:0/2110481333 conn(0x7f1af40fbc00 msgr2=0x7f1af40fc740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:11:25.626 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:25.081+0000 7f1afc06d640 1 -- 172.21.15.87:0/2110481333 shutdown_connections 2024-09-17T07:11:25.626 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:25.081+0000 7f1afc06d640 1 -- 172.21.15.87:0/2110481333 wait complete. 2024-09-17T07:11:26.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:26 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/2110481333' entity='client.admin' 2024-09-17T07:11:26.751 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:25.999+0000 7f5c4fcb6640 1 Processor -- start 2024-09-17T07:11:26.751 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:25.999+0000 7f5c4fcb6640 1 -- start start 2024-09-17T07:11:26.751 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:25.999+0000 7f5c4fcb6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c481028d0 0x7f5c48104cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:26.751 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:25.999+0000 7f5c4fcb6640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c48070ae0 con 0x7f5c481028d0 2024-09-17T07:11:26.751 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:25.999+0000 7f5c4da52640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c481028d0 0x7f5c48104cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:26.751 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:25.999+0000 7f5c4da52640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c481028d0 0x7f5c48104cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35316/0 (socket says 172.21.15.87:35316) 2024-09-17T07:11:26.752 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:25.999+0000 7f5c4da52640 1 -- 172.21.15.87:0/2384534670 learned_addr learned my addr 172.21.15.87:0/2384534670 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:11:26.752 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:26.000+0000 7f5c4da52640 1 -- 172.21.15.87:0/2384534670 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c48070c20 con 0x7f5c481028d0 2024-09-17T07:11:26.752 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:26.000+0000 7f5c4da52640 1 --2- 172.21.15.87:0/2384534670 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c481028d0 0x7f5c48104cb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5c44009840 tx=0x7f5c440091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9871a0f0b6364094 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:26.752 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:26.000+0000 7f5c4ca50640 1 -- 172.21.15.87:0/2384534670 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5c44032440 con 0x7f5c481028d0 2024-09-17T07:11:26.752 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:26.000+0000 7f5c4ca50640 1 -- 172.21.15.87:0/2384534670 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f5c44032a20 con 0x7f5c481028d0 2024-09-17T07:11:26.752 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:26.000+0000 7f5c4ca50640 1 -- 172.21.15.87:0/2384534670 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5c440319e0 con 0x7f5c481028d0 2024-09-17T07:11:26.752 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:26.001+0000 7f5c4fcb6640 1 -- 172.21.15.87:0/2384534670 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c481028d0 msgr2=0x7f5c48104cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:26.752 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:26.001+0000 7f5c4fcb6640 1 --2- 172.21.15.87:0/2384534670 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c481028d0 0x7f5c48104cb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5c44009840 tx=0x7f5c440091d0 comp rx=0 tx=0).stop 2024-09-17T07:11:26.752 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:26.001+0000 7f5c4fcb6640 1 -- 172.21.15.87:0/2384534670 shutdown_connections 2024-09-17T07:11:26.752 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:26.001+0000 7f5c4fcb6640 1 --2- 172.21.15.87:0/2384534670 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c481028d0 0x7f5c48104cb0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:26.752 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:26.001+0000 7f5c4fcb6640 1 -- 172.21.15.87:0/2384534670 >> 172.21.15.87:0/2384534670 conn(0x7f5c480fc390 msgr2=0x7f5c480fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:11:26.752 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:26.001+0000 7f5c4fcb6640 1 -- 172.21.15.87:0/2384534670 shutdown_connections 2024-09-17T07:11:26.752 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:26.001+0000 7f5c4fcb6640 1 -- 172.21.15.87:0/2384534670 wait complete. 2024-09-17T07:11:26.753 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:26.002+0000 7f5c4fcb6640 1 Processor -- start 2024-09-17T07:11:26.753 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:26.002+0000 7f5c4fcb6640 1 -- start start 2024-09-17T07:11:26.753 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:26.002+0000 7f5c4fcb6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c481028d0 0x7f5c48110b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:26.753 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:26.002+0000 7f5c4fcb6640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c48111040 con 0x7f5c481028d0 2024-09-17T07:11:26.753 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:26.002+0000 7f5c4da52640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c481028d0 0x7f5c48110b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:26.753 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:26.002+0000 7f5c4da52640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c481028d0 0x7f5c48110b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35318/0 (socket says 172.21.15.87:35318) 2024-09-17T07:11:26.753 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:26.002+0000 7f5c4da52640 1 -- 172.21.15.87:0/117089421 learned_addr learned my addr 172.21.15.87:0/117089421 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:11:26.753 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:26.002+0000 7f5c4da52640 1 -- 172.21.15.87:0/117089421 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c44009450 con 0x7f5c481028d0 2024-09-17T07:11:26.753 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:26.002+0000 7f5c4da52640 1 --2- 172.21.15.87:0/117089421 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c481028d0 0x7f5c48110b00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5c44009810 tx=0x7f5c4402c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:26.753 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:26.002+0000 7f5c3e7fc640 1 -- 172.21.15.87:0/117089421 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5c44032880 con 0x7f5c481028d0 2024-09-17T07:11:26.753 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:26.002+0000 7f5c3e7fc640 1 -- 172.21.15.87:0/117089421 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f5c4403b8c0 con 0x7f5c481028d0 2024-09-17T07:11:26.753 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:26.002+0000 7f5c4fcb6640 1 -- 172.21.15.87:0/117089421 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c48111240 con 0x7f5c481028d0 2024-09-17T07:11:26.753 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:26.002+0000 7f5c3e7fc640 1 -- 172.21.15.87:0/117089421 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5c4403a860 con 0x7f5c481028d0 2024-09-17T07:11:26.753 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:26.003+0000 7f5c4fcb6640 1 -- 172.21.15.87:0/117089421 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c481116b0 con 0x7f5c481028d0 2024-09-17T07:11:26.754 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:26.003+0000 7f5c3e7fc640 1 -- 172.21.15.87:0/117089421 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f5c44039070 con 0x7f5c481028d0 2024-09-17T07:11:26.754 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:26.003+0000 7f5c3e7fc640 1 --2- 172.21.15.87:0/117089421 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f5c34039490 0x7f5c3403b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:26.754 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:26.004+0000 7f5c3e7fc640 1 -- 172.21.15.87:0/117089421 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f5c4406c970 con 0x7f5c481028d0 2024-09-17T07:11:26.754 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:26.004+0000 7f5c4fcb6640 1 -- 172.21.15.87:0/117089421 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c4805ed70 con 0x7f5c481028d0 2024-09-17T07:11:26.754 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:26.004+0000 7f5c4d251640 1 --2- 172.21.15.87:0/117089421 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f5c34039490 0x7f5c3403b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:26.754 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:26.004+0000 7f5c4d251640 1 --2- 172.21.15.87:0/117089421 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f5c34039490 0x7f5c3403b940 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5c38006fd0 tx=0x7f5c38006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:26.754 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:26.008+0000 7f5c3e7fc640 1 -- 172.21.15.87:0/117089421 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f5c44049020 con 0x7f5c481028d0 2024-09-17T07:11:26.754 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:26.165+0000 7f5c4fcb6640 1 -- 172.21.15.87:0/117089421 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f5c48105e00 con 0x7f5c481028d0 2024-09-17T07:11:26.754 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:26.169+0000 7f5c3e7fc640 1 -- 172.21.15.87:0/117089421 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f5c4403f020 con 0x7f5c481028d0 2024-09-17T07:11:26.755 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:26.171+0000 7f5c4fcb6640 1 -- 172.21.15.87:0/117089421 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f5c34039490 msgr2=0x7f5c3403b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:26.755 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:26.171+0000 7f5c4fcb6640 1 --2- 172.21.15.87:0/117089421 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f5c34039490 0x7f5c3403b940 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5c38006fd0 tx=0x7f5c38006db0 comp rx=0 tx=0).stop 2024-09-17T07:11:26.755 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:26.171+0000 7f5c4fcb6640 1 -- 172.21.15.87:0/117089421 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c481028d0 msgr2=0x7f5c48110b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:26.755 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:26.171+0000 7f5c4fcb6640 1 --2- 172.21.15.87:0/117089421 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c481028d0 0x7f5c48110b00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5c44009810 tx=0x7f5c4402c040 comp rx=0 tx=0).stop 2024-09-17T07:11:26.755 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:26.171+0000 7f5c4fcb6640 1 -- 172.21.15.87:0/117089421 shutdown_connections 2024-09-17T07:11:26.755 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:26.171+0000 7f5c4fcb6640 1 --2- 172.21.15.87:0/117089421 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f5c34039490 0x7f5c3403b940 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:26.755 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:26.171+0000 7f5c4fcb6640 1 --2- 172.21.15.87:0/117089421 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c481028d0 0x7f5c48110b00 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:26.755 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:26.171+0000 7f5c4fcb6640 1 -- 172.21.15.87:0/117089421 >> 172.21.15.87:0/117089421 conn(0x7f5c480fc390 msgr2=0x7f5c480fcf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:11:26.756 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:26.171+0000 7f5c4fcb6640 1 -- 172.21.15.87:0/117089421 shutdown_connections 2024-09-17T07:11:26.756 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:26.171+0000 7f5c4fcb6640 1 -- 172.21.15.87:0/117089421 wait complete. 2024-09-17T07:11:26.756 INFO:teuthology.orchestra.run.smithi087.stdout:Enabling the dashboard module... 2024-09-17T07:11:27.329 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:27 smithi087 ceph-mon[27636]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T07:11:27.330 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:27 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/117089421' entity='client.admin' 2024-09-17T07:11:28.225 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:28 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/3299998773' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-17T07:11:28.830 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:27.120+0000 7fe6c9a7c640 1 Processor -- start 2024-09-17T07:11:28.836 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:27.120+0000 7fe6c9a7c640 1 -- start start 2024-09-17T07:11:28.836 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:27.120+0000 7fe6c9a7c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6c4101e30 0x7fe6c4102240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:28.836 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:27.120+0000 7fe6c9a7c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c4102780 con 0x7fe6c4101e30 2024-09-17T07:11:28.836 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:27.120+0000 7fe6c37fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6c4101e30 0x7fe6c4102240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:28.836 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:27.120+0000 7fe6c37fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6c4101e30 0x7fe6c4102240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35326/0 (socket says 172.21.15.87:35326) 2024-09-17T07:11:28.836 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:27.120+0000 7fe6c37fe640 1 -- 172.21.15.87:0/1398791648 learned_addr learned my addr 172.21.15.87:0/1398791648 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:11:28.837 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:27.121+0000 7fe6c37fe640 1 -- 172.21.15.87:0/1398791648 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6c41028c0 con 0x7fe6c4101e30 2024-09-17T07:11:28.837 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:27.121+0000 7fe6c37fe640 1 --2- 172.21.15.87:0/1398791648 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6c4101e30 0x7fe6c4102240 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe6b4009840 tx=0x7fe6b40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa11c3b9604e52c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:28.837 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:27.121+0000 7fe6c27fc640 1 -- 172.21.15.87:0/1398791648 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe6b4032440 con 0x7fe6c4101e30 2024-09-17T07:11:28.837 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:27.121+0000 7fe6c27fc640 1 -- 172.21.15.87:0/1398791648 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fe6b4032a20 con 0x7fe6c4101e30 2024-09-17T07:11:28.837 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:27.121+0000 7fe6c27fc640 1 -- 172.21.15.87:0/1398791648 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe6b40319e0 con 0x7fe6c4101e30 2024-09-17T07:11:28.837 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:27.122+0000 7fe6c9a7c640 1 -- 172.21.15.87:0/1398791648 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6c4101e30 msgr2=0x7fe6c4102240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:28.837 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:27.122+0000 7fe6c9a7c640 1 --2- 172.21.15.87:0/1398791648 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6c4101e30 0x7fe6c4102240 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe6b4009840 tx=0x7fe6b40091d0 comp rx=0 tx=0).stop 2024-09-17T07:11:28.837 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:27.122+0000 7fe6c9a7c640 1 -- 172.21.15.87:0/1398791648 shutdown_connections 2024-09-17T07:11:28.837 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:27.122+0000 7fe6c9a7c640 1 --2- 172.21.15.87:0/1398791648 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6c4101e30 0x7fe6c4102240 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:28.837 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:27.122+0000 7fe6c9a7c640 1 -- 172.21.15.87:0/1398791648 >> 172.21.15.87:0/1398791648 conn(0x7fe6c40fd520 msgr2=0x7fe6c40ff930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:11:28.838 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:27.122+0000 7fe6c9a7c640 1 -- 172.21.15.87:0/1398791648 shutdown_connections 2024-09-17T07:11:28.838 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:27.122+0000 7fe6c9a7c640 1 -- 172.21.15.87:0/1398791648 wait complete. 2024-09-17T07:11:28.838 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:27.122+0000 7fe6c9a7c640 1 Processor -- start 2024-09-17T07:11:28.838 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:27.123+0000 7fe6c9a7c640 1 -- start start 2024-09-17T07:11:28.838 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:27.123+0000 7fe6c9a7c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6c4101e30 0x7fe6c4110b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:28.838 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:27.123+0000 7fe6c9a7c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c4111040 con 0x7fe6c4101e30 2024-09-17T07:11:28.838 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:27.123+0000 7fe6c37fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6c4101e30 0x7fe6c4110b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:28.838 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:27.123+0000 7fe6c37fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6c4101e30 0x7fe6c4110b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35340/0 (socket says 172.21.15.87:35340) 2024-09-17T07:11:28.838 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:27.123+0000 7fe6c37fe640 1 -- 172.21.15.87:0/3299998773 learned_addr learned my addr 172.21.15.87:0/3299998773 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:11:28.838 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:27.123+0000 7fe6c37fe640 1 -- 172.21.15.87:0/3299998773 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6b4009450 con 0x7fe6c4101e30 2024-09-17T07:11:28.838 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:27.123+0000 7fe6c37fe640 1 --2- 172.21.15.87:0/3299998773 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6c4101e30 0x7fe6c4110b00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe6b4006f00 tx=0x7fe6b402c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:28.838 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:27.123+0000 7fe6abfff640 1 -- 172.21.15.87:0/3299998773 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe6b403b440 con 0x7fe6c4101e30 2024-09-17T07:11:28.838 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:27.123+0000 7fe6abfff640 1 -- 172.21.15.87:0/3299998773 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fe6b403ba20 con 0x7fe6c4101e30 2024-09-17T07:11:28.839 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:27.123+0000 7fe6abfff640 1 -- 172.21.15.87:0/3299998773 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe6b403a800 con 0x7fe6c4101e30 2024-09-17T07:11:28.839 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:27.123+0000 7fe6c9a7c640 1 -- 172.21.15.87:0/3299998773 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6c4111240 con 0x7fe6c4101e30 2024-09-17T07:11:28.839 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:27.124+0000 7fe6c9a7c640 1 -- 172.21.15.87:0/3299998773 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6c41116b0 con 0x7fe6c4101e30 2024-09-17T07:11:28.839 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:27.124+0000 7fe6abfff640 1 -- 172.21.15.87:0/3299998773 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7fe6b4039070 con 0x7fe6c4101e30 2024-09-17T07:11:28.839 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:27.124+0000 7fe6c9a7c640 1 -- 172.21.15.87:0/3299998773 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6c404b720 con 0x7fe6c4101e30 2024-09-17T07:11:28.839 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:27.125+0000 7fe6abfff640 1 --2- 172.21.15.87:0/3299998773 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7fe6ac0394e0 0x7fe6ac03b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:28.839 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:27.125+0000 7fe6abfff640 1 -- 172.21.15.87:0/3299998773 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fe6b406c860 con 0x7fe6c4101e30 2024-09-17T07:11:28.839 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:27.125+0000 7fe6c2ffd640 1 --2- 172.21.15.87:0/3299998773 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7fe6ac0394e0 0x7fe6ac03b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:28.839 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:27.125+0000 7fe6c2ffd640 1 --2- 172.21.15.87:0/3299998773 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7fe6ac0394e0 0x7fe6ac03b990 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe6b8006fd0 tx=0x7fe6b8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:28.839 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:27.129+0000 7fe6abfff640 1 -- 172.21.15.87:0/3299998773 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fe6b4042e60 con 0x7fe6c4101e30 2024-09-17T07:11:28.839 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:27.328+0000 7fe6c9a7c640 1 -- 172.21.15.87:0/3299998773 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7fe6c4103bc0 con 0x7fe6c4101e30 2024-09-17T07:11:28.839 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:28.172+0000 7fe6abfff640 1 -- 172.21.15.87:0/3299998773 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mgrmap(e 9) v1 ==== 45520+0+0 (secure 0 0 0) 0x7fe6b4041d60 con 0x7fe6c4101e30 2024-09-17T07:11:28.839 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:28.174+0000 7fe6abfff640 1 -- 172.21.15.87:0/3299998773 <== mon.0 v2:172.21.15.87:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7fe6b402bae0 con 0x7fe6c4101e30 2024-09-17T07:11:28.839 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:28.176+0000 7fe6c9a7c640 1 -- 172.21.15.87:0/3299998773 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7fe6ac0394e0 msgr2=0x7fe6ac03b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:28.840 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:28.176+0000 7fe6c9a7c640 1 --2- 172.21.15.87:0/3299998773 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7fe6ac0394e0 0x7fe6ac03b990 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe6b8006fd0 tx=0x7fe6b8006db0 comp rx=0 tx=0).stop 2024-09-17T07:11:28.840 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:28.176+0000 7fe6c9a7c640 1 -- 172.21.15.87:0/3299998773 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6c4101e30 msgr2=0x7fe6c4110b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:28.840 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:28.176+0000 7fe6c9a7c640 1 --2- 172.21.15.87:0/3299998773 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6c4101e30 0x7fe6c4110b00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe6b4006f00 tx=0x7fe6b402c040 comp rx=0 tx=0).stop 2024-09-17T07:11:28.840 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:28.176+0000 7fe6c9a7c640 1 -- 172.21.15.87:0/3299998773 shutdown_connections 2024-09-17T07:11:28.840 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:28.176+0000 7fe6c9a7c640 1 --2- 172.21.15.87:0/3299998773 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7fe6ac0394e0 0x7fe6ac03b990 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:28.840 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:28.176+0000 7fe6c9a7c640 1 --2- 172.21.15.87:0/3299998773 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6c4101e30 0x7fe6c4110b00 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:28.840 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:28.176+0000 7fe6c9a7c640 1 -- 172.21.15.87:0/3299998773 >> 172.21.15.87:0/3299998773 conn(0x7fe6c40fd520 msgr2=0x7fe6c40fe130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:11:28.840 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:28.176+0000 7fe6c9a7c640 1 -- 172.21.15.87:0/3299998773 shutdown_connections 2024-09-17T07:11:28.840 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:28.176+0000 7fe6c9a7c640 1 -- 172.21.15.87:0/3299998773 wait complete. 2024-09-17T07:11:29.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:29 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/3299998773' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-17T07:11:29.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:29 smithi087 ceph-mon[27636]: mgrmap e9: smithi087.vuvjer(active, since 24s) 2024-09-17T07:11:30.094 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout { 2024-09-17T07:11:30.095 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-17T07:11:30.095 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-17T07:11:30.095 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "active_name": "smithi087.vuvjer", 2024-09-17T07:11:30.095 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-17T07:11:30.095 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout } 2024-09-17T07:11:30.095 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:29.230+0000 7f630561b640 1 Processor -- start 2024-09-17T07:11:30.095 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:29.230+0000 7f630561b640 1 -- start start 2024-09-17T07:11:30.095 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:29.230+0000 7f630561b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6300076be0 0x7f6300104940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:30.095 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:29.230+0000 7f630561b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6300104e80 con 0x7f6300076be0 2024-09-17T07:11:30.095 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:29.230+0000 7f62feffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6300076be0 0x7f6300104940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:30.095 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:29.230+0000 7f62feffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6300076be0 0x7f6300104940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35362/0 (socket says 172.21.15.87:35362) 2024-09-17T07:11:30.096 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:29.230+0000 7f62feffd640 1 -- 172.21.15.87:0/1983729333 learned_addr learned my addr 172.21.15.87:0/1983729333 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:11:30.096 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:29.230+0000 7f62feffd640 1 -- 172.21.15.87:0/1983729333 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6300104fc0 con 0x7f6300076be0 2024-09-17T07:11:30.096 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:29.231+0000 7f62feffd640 1 --2- 172.21.15.87:0/1983729333 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6300076be0 0x7f6300104940 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f62f0009840 tx=0x7f62f00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19fed9d86d251e66 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:30.096 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:29.231+0000 7f62fdffb640 1 -- 172.21.15.87:0/1983729333 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f62f0032440 con 0x7f6300076be0 2024-09-17T07:11:30.096 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:29.231+0000 7f62fdffb640 1 -- 172.21.15.87:0/1983729333 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f62f0032a20 con 0x7f6300076be0 2024-09-17T07:11:30.096 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:29.231+0000 7f62fdffb640 1 -- 172.21.15.87:0/1983729333 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f62f00319e0 con 0x7f6300076be0 2024-09-17T07:11:30.096 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:29.232+0000 7f630561b640 1 -- 172.21.15.87:0/1983729333 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6300076be0 msgr2=0x7f6300104940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:30.096 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:29.232+0000 7f630561b640 1 --2- 172.21.15.87:0/1983729333 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6300076be0 0x7f6300104940 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f62f0009840 tx=0x7f62f00091d0 comp rx=0 tx=0).stop 2024-09-17T07:11:30.096 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:29.232+0000 7f630561b640 1 -- 172.21.15.87:0/1983729333 shutdown_connections 2024-09-17T07:11:30.097 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:29.232+0000 7f630561b640 1 --2- 172.21.15.87:0/1983729333 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6300076be0 0x7f6300104940 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:30.097 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:29.232+0000 7f630561b640 1 -- 172.21.15.87:0/1983729333 >> 172.21.15.87:0/1983729333 conn(0x7f63000fc430 msgr2=0x7f63000fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:11:30.097 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:29.232+0000 7f630561b640 1 -- 172.21.15.87:0/1983729333 shutdown_connections 2024-09-17T07:11:30.097 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:29.232+0000 7f630561b640 1 -- 172.21.15.87:0/1983729333 wait complete. 2024-09-17T07:11:30.097 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:29.233+0000 7f630561b640 1 Processor -- start 2024-09-17T07:11:30.097 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:29.233+0000 7f630561b640 1 -- start start 2024-09-17T07:11:30.097 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:29.233+0000 7f630561b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6300076be0 0x7f6300110b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:30.097 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:29.233+0000 7f630561b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6300111040 con 0x7f6300076be0 2024-09-17T07:11:30.097 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:29.233+0000 7f62feffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6300076be0 0x7f6300110b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:30.097 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:29.233+0000 7f62feffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6300076be0 0x7f6300110b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35366/0 (socket says 172.21.15.87:35366) 2024-09-17T07:11:30.097 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:29.233+0000 7f62feffd640 1 -- 172.21.15.87:0/639934493 learned_addr learned my addr 172.21.15.87:0/639934493 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:11:30.098 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:29.234+0000 7f62feffd640 1 -- 172.21.15.87:0/639934493 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62f0009450 con 0x7f6300076be0 2024-09-17T07:11:30.098 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:29.234+0000 7f62feffd640 1 --2- 172.21.15.87:0/639934493 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6300076be0 0x7f6300110b00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f62f0006f00 tx=0x7f62f002c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:30.098 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:29.234+0000 7f62e77fe640 1 -- 172.21.15.87:0/639934493 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f62f003b440 con 0x7f6300076be0 2024-09-17T07:11:30.098 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:29.234+0000 7f62e77fe640 1 -- 172.21.15.87:0/639934493 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f62f003ba20 con 0x7f6300076be0 2024-09-17T07:11:30.098 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:29.234+0000 7f630561b640 1 -- 172.21.15.87:0/639934493 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6300111240 con 0x7f6300076be0 2024-09-17T07:11:30.098 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:29.234+0000 7f62e77fe640 1 -- 172.21.15.87:0/639934493 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f62f003a7d0 con 0x7f6300076be0 2024-09-17T07:11:30.098 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:29.234+0000 7f630561b640 1 -- 172.21.15.87:0/639934493 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63001116b0 con 0x7f6300076be0 2024-09-17T07:11:30.098 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:29.235+0000 7f62e77fe640 1 -- 172.21.15.87:0/639934493 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 9) v1 ==== 45520+0+0 (secure 0 0 0) 0x7f62f0039070 con 0x7f6300076be0 2024-09-17T07:11:30.098 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:29.235+0000 7f62e77fe640 1 --2- 172.21.15.87:0/639934493 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f62e80394e0 0x7f62e803b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:30.098 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:29.235+0000 7f62e77fe640 1 -- 172.21.15.87:0/639934493 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f62f006cb90 con 0x7f6300076be0 2024-09-17T07:11:30.098 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:29.235+0000 7f62fe7fc640 1 -- 172.21.15.87:0/639934493 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f62e80394e0 msgr2=0x7f62e803b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.87:6800/1735030430 2024-09-17T07:11:30.098 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:29.235+0000 7f62fe7fc640 1 --2- 172.21.15.87:0/639934493 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f62e80394e0 0x7f62e803b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-17T07:11:30.098 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:29.235+0000 7f630561b640 1 -- 172.21.15.87:0/639934493 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f630005ed70 con 0x7f6300076be0 2024-09-17T07:11:30.099 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:29.240+0000 7f62e77fe640 1 -- 172.21.15.87:0/639934493 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f62f0037030 con 0x7f6300076be0 2024-09-17T07:11:30.099 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:29.436+0000 7f62fe7fc640 1 -- 172.21.15.87:0/639934493 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f62e80394e0 msgr2=0x7f62e803b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.87:6800/1735030430 2024-09-17T07:11:30.099 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:29.436+0000 7f62fe7fc640 1 --2- 172.21.15.87:0/639934493 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f62e80394e0 0x7f62e803b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-17T07:11:30.099 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:29.443+0000 7f630561b640 1 -- 172.21.15.87:0/639934493 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f6300105cf0 con 0x7f6300076be0 2024-09-17T07:11:30.099 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:29.443+0000 7f62e77fe640 1 -- 172.21.15.87:0/639934493 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+103 (secure 0 0 0) 0x7f62f0052070 con 0x7f6300076be0 2024-09-17T07:11:30.099 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:29.445+0000 7f630561b640 1 -- 172.21.15.87:0/639934493 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f62e80394e0 msgr2=0x7f62e803b990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T07:11:30.099 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:29.445+0000 7f630561b640 1 --2- 172.21.15.87:0/639934493 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f62e80394e0 0x7f62e803b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:30.099 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:29.445+0000 7f630561b640 1 -- 172.21.15.87:0/639934493 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6300076be0 msgr2=0x7f6300110b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:30.099 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:29.445+0000 7f630561b640 1 --2- 172.21.15.87:0/639934493 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6300076be0 0x7f6300110b00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f62f0006f00 tx=0x7f62f002c040 comp rx=0 tx=0).stop 2024-09-17T07:11:30.099 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:29.445+0000 7f630561b640 1 -- 172.21.15.87:0/639934493 shutdown_connections 2024-09-17T07:11:30.100 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:29.445+0000 7f630561b640 1 --2- 172.21.15.87:0/639934493 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f62e80394e0 0x7f62e803b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:30.100 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:29.445+0000 7f630561b640 1 --2- 172.21.15.87:0/639934493 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6300076be0 0x7f6300110b00 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:30.100 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:29.445+0000 7f630561b640 1 -- 172.21.15.87:0/639934493 >> 172.21.15.87:0/639934493 conn(0x7f63000fc430 msgr2=0x7f63000fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:11:30.100 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:29.445+0000 7f630561b640 1 -- 172.21.15.87:0/639934493 shutdown_connections 2024-09-17T07:11:30.100 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:29.445+0000 7f630561b640 1 -- 172.21.15.87:0/639934493 wait complete. 2024-09-17T07:11:30.100 INFO:teuthology.orchestra.run.smithi087.stdout:Waiting for the mgr to restart... 2024-09-17T07:11:30.100 INFO:teuthology.orchestra.run.smithi087.stdout:Waiting for mgr epoch 9... 2024-09-17T07:11:30.329 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:30 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/639934493' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-17T07:11:32.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:32 smithi087 ceph-mon[27636]: Active manager daemon smithi087.vuvjer restarted 2024-09-17T07:11:32.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:32 smithi087 ceph-mon[27636]: Activating manager daemon smithi087.vuvjer 2024-09-17T07:11:32.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:32 smithi087 ceph-mon[27636]: osdmap e3: 0 total, 0 up, 0 in 2024-09-17T07:11:32.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:32 smithi087 ceph-mon[27636]: mgrmap e10: smithi087.vuvjer(active, starting, since 0.0033335s) 2024-09-17T07:11:32.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:32 smithi087 ceph-mon[27636]: from='mgr.14160 172.21.15.87:0/3005432640' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mon metadata", "id": "smithi087"}]: dispatch 2024-09-17T07:11:32.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:32 smithi087 ceph-mon[27636]: from='mgr.14160 172.21.15.87:0/3005432640' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mgr metadata", "who": "smithi087.vuvjer", "id": "smithi087.vuvjer"}]: dispatch 2024-09-17T07:11:32.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:32 smithi087 ceph-mon[27636]: from='mgr.14160 172.21.15.87:0/3005432640' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T07:11:32.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:32 smithi087 ceph-mon[27636]: from='mgr.14160 172.21.15.87:0/3005432640' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T07:11:32.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:32 smithi087 ceph-mon[27636]: from='mgr.14160 172.21.15.87:0/3005432640' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T07:11:32.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:32 smithi087 ceph-mon[27636]: Manager daemon smithi087.vuvjer is now available 2024-09-17T07:11:32.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:32 smithi087 ceph-mon[27636]: from='mgr.14160 172.21.15.87:0/3005432640' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:11:32.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:32 smithi087 ceph-mon[27636]: from='mgr.14160 172.21.15.87:0/3005432640' entity='mgr.smithi087.vuvjer' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi087.vuvjer/mirror_snapshot_schedule"}]: dispatch 2024-09-17T07:11:32.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:32 smithi087 ceph-mon[27636]: from='mgr.14160 172.21.15.87:0/3005432640' entity='mgr.smithi087.vuvjer' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi087.vuvjer/trash_purge_schedule"}]: dispatch 2024-09-17T07:11:34.210 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout { 2024-09-17T07:11:34.210 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-17T07:11:34.210 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-17T07:11:34.210 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout } 2024-09-17T07:11:34.210 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:30.494+0000 7f63b2196640 1 Processor -- start 2024-09-17T07:11:34.210 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:30.494+0000 7f63b2196640 1 -- start start 2024-09-17T07:11:34.210 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:30.494+0000 7f63b2196640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63ac1022f0 0x7f63ac102700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:34.210 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:30.494+0000 7f63b2196640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63ac102c40 con 0x7f63ac1022f0 2024-09-17T07:11:34.210 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:30.494+0000 7f63ab7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63ac1022f0 0x7f63ac102700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:34.210 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:30.494+0000 7f63ab7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63ac1022f0 0x7f63ac102700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35374/0 (socket says 172.21.15.87:35374) 2024-09-17T07:11:34.210 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:30.494+0000 7f63ab7fe640 1 -- 172.21.15.87:0/987636254 learned_addr learned my addr 172.21.15.87:0/987636254 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:11:34.211 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:30.494+0000 7f63ab7fe640 1 -- 172.21.15.87:0/987636254 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63ac100900 con 0x7f63ac1022f0 2024-09-17T07:11:34.211 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:30.495+0000 7f63ab7fe640 1 --2- 172.21.15.87:0/987636254 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63ac1022f0 0x7f63ac102700 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f639c009840 tx=0x7f639c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4be2cb6b7da82403 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:34.211 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:30.495+0000 7f63aa7fc640 1 -- 172.21.15.87:0/987636254 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f639c032440 con 0x7f63ac1022f0 2024-09-17T07:11:34.211 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:30.495+0000 7f63aa7fc640 1 -- 172.21.15.87:0/987636254 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f639c032a20 con 0x7f63ac1022f0 2024-09-17T07:11:34.211 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:30.495+0000 7f63aa7fc640 1 -- 172.21.15.87:0/987636254 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f639c0319e0 con 0x7f63ac1022f0 2024-09-17T07:11:34.211 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:30.496+0000 7f63b2196640 1 -- 172.21.15.87:0/987636254 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63ac1022f0 msgr2=0x7f63ac102700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:34.211 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:30.496+0000 7f63b2196640 1 --2- 172.21.15.87:0/987636254 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63ac1022f0 0x7f63ac102700 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f639c009840 tx=0x7f639c0091d0 comp rx=0 tx=0).stop 2024-09-17T07:11:34.211 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:30.496+0000 7f63b2196640 1 -- 172.21.15.87:0/987636254 shutdown_connections 2024-09-17T07:11:34.211 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:30.496+0000 7f63b2196640 1 --2- 172.21.15.87:0/987636254 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63ac1022f0 0x7f63ac102700 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:34.211 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:30.496+0000 7f63b2196640 1 -- 172.21.15.87:0/987636254 >> 172.21.15.87:0/987636254 conn(0x7f63ac0fc410 msgr2=0x7f63ac0fe820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:11:34.211 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:30.496+0000 7f63b2196640 1 -- 172.21.15.87:0/987636254 shutdown_connections 2024-09-17T07:11:34.211 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:30.496+0000 7f63b2196640 1 -- 172.21.15.87:0/987636254 wait complete. 2024-09-17T07:11:34.211 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:30.497+0000 7f63b2196640 1 Processor -- start 2024-09-17T07:11:34.212 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:30.497+0000 7f63b2196640 1 -- start start 2024-09-17T07:11:34.212 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:30.497+0000 7f63b2196640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63ac1022f0 0x7f63ac10e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:34.212 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:30.497+0000 7f63b2196640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63ac10ee50 con 0x7f63ac1022f0 2024-09-17T07:11:34.212 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:30.497+0000 7f63ab7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63ac1022f0 0x7f63ac10e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:34.212 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:30.497+0000 7f63ab7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63ac1022f0 0x7f63ac10e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35378/0 (socket says 172.21.15.87:35378) 2024-09-17T07:11:34.212 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:30.497+0000 7f63ab7fe640 1 -- 172.21.15.87:0/2345688843 learned_addr learned my addr 172.21.15.87:0/2345688843 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:11:34.212 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:30.497+0000 7f63ab7fe640 1 -- 172.21.15.87:0/2345688843 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f639c009450 con 0x7f63ac1022f0 2024-09-17T07:11:34.212 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:30.498+0000 7f63ab7fe640 1 --2- 172.21.15.87:0/2345688843 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63ac1022f0 0x7f63ac10e910 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f639c006f00 tx=0x7f639c02c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:34.212 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:30.498+0000 7f6393fff640 1 -- 172.21.15.87:0/2345688843 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f639c031e00 con 0x7f63ac1022f0 2024-09-17T07:11:34.212 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:30.498+0000 7f6393fff640 1 -- 172.21.15.87:0/2345688843 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f639c03b8c0 con 0x7f63ac1022f0 2024-09-17T07:11:34.212 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:30.498+0000 7f6393fff640 1 -- 172.21.15.87:0/2345688843 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f639c03a680 con 0x7f63ac1022f0 2024-09-17T07:11:34.212 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:30.498+0000 7f63b2196640 1 -- 172.21.15.87:0/2345688843 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63ac10f050 con 0x7f63ac1022f0 2024-09-17T07:11:34.212 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:30.498+0000 7f63b2196640 1 -- 172.21.15.87:0/2345688843 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63ac10f4c0 con 0x7f63ac1022f0 2024-09-17T07:11:34.213 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:30.499+0000 7f6393fff640 1 -- 172.21.15.87:0/2345688843 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 9) v1 ==== 45520+0+0 (secure 0 0 0) 0x7f639c039070 con 0x7f63ac1022f0 2024-09-17T07:11:34.213 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:30.499+0000 7f6393fff640 1 --2- 172.21.15.87:0/2345688843 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f639403b780 0x7f639403dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:34.213 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:30.499+0000 7f6393fff640 1 -- 172.21.15.87:0/2345688843 --> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f639403e340 con 0x7f639403b780 2024-09-17T07:11:34.213 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:30.499+0000 7f6393fff640 1 -- 172.21.15.87:0/2345688843 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f639c06c800 con 0x7f63ac1022f0 2024-09-17T07:11:34.213 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:30.499+0000 7f63aaffd640 1 -- 172.21.15.87:0/2345688843 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f639403b780 msgr2=0x7f639403dc30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.87:6800/1735030430 2024-09-17T07:11:34.213 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:30.499+0000 7f63aaffd640 1 --2- 172.21.15.87:0/2345688843 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f639403b780 0x7f639403dc30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-17T07:11:34.213 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:30.700+0000 7f63aaffd640 1 -- 172.21.15.87:0/2345688843 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f639403b780 msgr2=0x7f639403dc30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.87:6800/1735030430 2024-09-17T07:11:34.213 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:30.700+0000 7f63aaffd640 1 --2- 172.21.15.87:0/2345688843 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f639403b780 0x7f639403dc30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-17T07:11:34.213 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:31.101+0000 7f63aaffd640 1 -- 172.21.15.87:0/2345688843 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f639403b780 msgr2=0x7f639403dc30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.87:6800/1735030430 2024-09-17T07:11:34.213 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:31.101+0000 7f63aaffd640 1 --2- 172.21.15.87:0/2345688843 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f639403b780 0x7f639403dc30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-17T07:11:34.213 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:31.902+0000 7f63aaffd640 1 -- 172.21.15.87:0/2345688843 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f639403b780 msgr2=0x7f639403dc30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.87:6800/1735030430 2024-09-17T07:11:34.213 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:31.902+0000 7f63aaffd640 1 --2- 172.21.15.87:0/2345688843 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f639403b780 0x7f639403dc30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-17T07:11:34.214 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:32.591+0000 7f6393fff640 1 -- 172.21.15.87:0/2345688843 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mgrmap(e 10) v1 ==== 45287+0+0 (secure 0 0 0) 0x7f639c06b9a0 con 0x7f63ac1022f0 2024-09-17T07:11:34.214 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:32.591+0000 7f6393fff640 1 -- 172.21.15.87:0/2345688843 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f639403b780 msgr2=0x7f639403dc30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T07:11:34.214 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:32.591+0000 7f6393fff640 1 --2- 172.21.15.87:0/2345688843 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f639403b780 0x7f639403dc30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:34.214 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:33.592+0000 7f6393fff640 1 -- 172.21.15.87:0/2345688843 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mgrmap(e 11) v1 ==== 45414+0+0 (secure 0 0 0) 0x7f639c03ba30 con 0x7f63ac1022f0 2024-09-17T07:11:34.214 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:33.592+0000 7f6393fff640 1 --2- 172.21.15.87:0/2345688843 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f639403efc0 0x7f63940413a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:34.214 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:33.592+0000 7f6393fff640 1 -- 172.21.15.87:0/2345688843 --> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f639403e340 con 0x7f639403efc0 2024-09-17T07:11:34.214 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:33.593+0000 7f63aaffd640 1 --2- 172.21.15.87:0/2345688843 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f639403efc0 0x7f63940413a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:34.214 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:33.593+0000 7f63aaffd640 1 --2- 172.21.15.87:0/2345688843 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f639403efc0 0x7f63940413a0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f63a0003940 tx=0x7f63a0009350 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:34.214 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:33.594+0000 7f6393fff640 1 -- 172.21.15.87:0/2345688843 <== mgr.14160 v2:172.21.15.87:6800/2341884603 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7f639403e340 con 0x7f639403efc0 2024-09-17T07:11:34.214 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:33.599+0000 7f63b2196640 1 -- 172.21.15.87:0/2345688843 --> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f63ac10f4c0 con 0x7f639403efc0 2024-09-17T07:11:34.214 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:33.599+0000 7f6393fff640 1 -- 172.21.15.87:0/2345688843 <== mgr.14160 v2:172.21.15.87:6800/2341884603 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f63ac10f4c0 con 0x7f639403efc0 2024-09-17T07:11:34.214 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:33.600+0000 7f63b2196640 1 -- 172.21.15.87:0/2345688843 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f639403efc0 msgr2=0x7f63940413a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:34.214 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:33.600+0000 7f63b2196640 1 --2- 172.21.15.87:0/2345688843 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f639403efc0 0x7f63940413a0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f63a0003940 tx=0x7f63a0009350 comp rx=0 tx=0).stop 2024-09-17T07:11:34.215 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:33.600+0000 7f63b2196640 1 -- 172.21.15.87:0/2345688843 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63ac1022f0 msgr2=0x7f63ac10e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:34.215 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:33.600+0000 7f63b2196640 1 --2- 172.21.15.87:0/2345688843 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63ac1022f0 0x7f63ac10e910 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f639c006f00 tx=0x7f639c02c040 comp rx=0 tx=0).stop 2024-09-17T07:11:34.215 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:33.600+0000 7f63b2196640 1 -- 172.21.15.87:0/2345688843 shutdown_connections 2024-09-17T07:11:34.215 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:33.600+0000 7f63b2196640 1 --2- 172.21.15.87:0/2345688843 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f639403efc0 0x7f63940413a0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:34.215 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:33.600+0000 7f63b2196640 1 --2- 172.21.15.87:0/2345688843 >> [v2:172.21.15.87:6800/1735030430,v1:172.21.15.87:6801/1735030430] conn(0x7f639403b780 0x7f639403dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:34.215 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:33.600+0000 7f63b2196640 1 --2- 172.21.15.87:0/2345688843 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63ac1022f0 0x7f63ac10e910 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:34.215 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:33.600+0000 7f63b2196640 1 -- 172.21.15.87:0/2345688843 >> 172.21.15.87:0/2345688843 conn(0x7f63ac0fc410 msgr2=0x7f63ac105170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:11:34.215 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:33.600+0000 7f63b2196640 1 -- 172.21.15.87:0/2345688843 shutdown_connections 2024-09-17T07:11:34.215 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:33.600+0000 7f63b2196640 1 -- 172.21.15.87:0/2345688843 wait complete. 2024-09-17T07:11:34.215 INFO:teuthology.orchestra.run.smithi087.stdout:mgr epoch 9 is available 2024-09-17T07:11:34.215 INFO:teuthology.orchestra.run.smithi087.stdout:Generating a dashboard self-signed certificate... 2024-09-17T07:11:34.810 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:34 smithi087 ceph-mon[27636]: mgrmap e11: smithi087.vuvjer(active, since 1.00568s) 2024-09-17T07:11:34.811 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:34 smithi087 ceph-mon[27636]: [17/Sep/2024:07:11:34] ENGINE Bus STARTING 2024-09-17T07:11:34.811 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:34 smithi087 ceph-mon[27636]: from='mgr.14160 172.21.15.87:0/3005432640' entity='mgr.smithi087.vuvjer' 2024-09-17T07:11:34.811 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:34 smithi087 ceph-mon[27636]: from='mgr.14160 172.21.15.87:0/3005432640' entity='mgr.smithi087.vuvjer' 2024-09-17T07:11:35.529 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-17T07:11:35.529 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:34.621+0000 7f2af03a9640 1 Processor -- start 2024-09-17T07:11:35.529 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:34.621+0000 7f2af03a9640 1 -- start start 2024-09-17T07:11:35.529 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:34.622+0000 7f2af03a9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ae8103450 0x7f2ae8103860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:35.529 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:34.622+0000 7f2af03a9640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae8103da0 con 0x7f2ae8103450 2024-09-17T07:11:35.529 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:34.622+0000 7f2aee145640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ae8103450 0x7f2ae8103860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:35.529 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:34.622+0000 7f2aee145640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ae8103450 0x7f2ae8103860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54534/0 (socket says 172.21.15.87:54534) 2024-09-17T07:11:35.529 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:34.622+0000 7f2aee145640 1 -- 172.21.15.87:0/1770608830 learned_addr learned my addr 172.21.15.87:0/1770608830 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:11:35.529 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:34.622+0000 7f2aee145640 1 -- 172.21.15.87:0/1770608830 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ae8103ee0 con 0x7f2ae8103450 2024-09-17T07:11:35.530 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:34.623+0000 7f2aee145640 1 --2- 172.21.15.87:0/1770608830 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ae8103450 0x7f2ae8103860 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2ae4009840 tx=0x7f2ae40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6614ffcf40fa8fca server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:35.530 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:34.623+0000 7f2aed143640 1 -- 172.21.15.87:0/1770608830 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2ae4032440 con 0x7f2ae8103450 2024-09-17T07:11:35.530 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:34.623+0000 7f2aed143640 1 -- 172.21.15.87:0/1770608830 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f2ae4032a20 con 0x7f2ae8103450 2024-09-17T07:11:35.530 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:34.623+0000 7f2aed143640 1 -- 172.21.15.87:0/1770608830 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2ae40319e0 con 0x7f2ae8103450 2024-09-17T07:11:35.530 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:34.623+0000 7f2af03a9640 1 -- 172.21.15.87:0/1770608830 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ae8103450 msgr2=0x7f2ae8103860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:35.530 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:34.623+0000 7f2af03a9640 1 --2- 172.21.15.87:0/1770608830 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ae8103450 0x7f2ae8103860 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2ae4009840 tx=0x7f2ae40091d0 comp rx=0 tx=0).stop 2024-09-17T07:11:35.530 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:34.624+0000 7f2af03a9640 1 -- 172.21.15.87:0/1770608830 shutdown_connections 2024-09-17T07:11:35.530 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:34.624+0000 7f2af03a9640 1 --2- 172.21.15.87:0/1770608830 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ae8103450 0x7f2ae8103860 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:35.530 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:34.624+0000 7f2af03a9640 1 -- 172.21.15.87:0/1770608830 >> 172.21.15.87:0/1770608830 conn(0x7f2ae80fbb70 msgr2=0x7f2ae80fdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:11:35.530 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:34.624+0000 7f2af03a9640 1 -- 172.21.15.87:0/1770608830 shutdown_connections 2024-09-17T07:11:35.530 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:34.624+0000 7f2af03a9640 1 -- 172.21.15.87:0/1770608830 wait complete. 2024-09-17T07:11:35.530 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:34.624+0000 7f2af03a9640 1 Processor -- start 2024-09-17T07:11:35.531 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:34.624+0000 7f2af03a9640 1 -- start start 2024-09-17T07:11:35.531 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:34.624+0000 7f2af03a9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ae8103450 0x7f2ae8102b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:35.531 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:34.624+0000 7f2af03a9640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae8103060 con 0x7f2ae8103450 2024-09-17T07:11:35.531 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:34.625+0000 7f2aee145640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ae8103450 0x7f2ae8102b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:35.531 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:34.625+0000 7f2aee145640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ae8103450 0x7f2ae8102b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54548/0 (socket says 172.21.15.87:54548) 2024-09-17T07:11:35.531 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:34.625+0000 7f2aee145640 1 -- 172.21.15.87:0/443895293 learned_addr learned my addr 172.21.15.87:0/443895293 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:11:35.531 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:34.625+0000 7f2aee145640 1 -- 172.21.15.87:0/443895293 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ae4009450 con 0x7f2ae8103450 2024-09-17T07:11:35.531 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:34.625+0000 7f2aee145640 1 --2- 172.21.15.87:0/443895293 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ae8103450 0x7f2ae8102b20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2ae4006f00 tx=0x7f2ae402c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:35.531 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:34.625+0000 7f2adeffd640 1 -- 172.21.15.87:0/443895293 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2ae403b440 con 0x7f2ae8103450 2024-09-17T07:11:35.531 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:34.625+0000 7f2adeffd640 1 -- 172.21.15.87:0/443895293 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f2ae403ba20 con 0x7f2ae8103450 2024-09-17T07:11:35.531 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:34.625+0000 7f2af03a9640 1 -- 172.21.15.87:0/443895293 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ae81010f0 con 0x7f2ae8103450 2024-09-17T07:11:35.531 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:34.625+0000 7f2adeffd640 1 -- 172.21.15.87:0/443895293 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2ae403a800 con 0x7f2ae8103450 2024-09-17T07:11:35.531 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:34.625+0000 7f2af03a9640 1 -- 172.21.15.87:0/443895293 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ae8101560 con 0x7f2ae8103450 2024-09-17T07:11:35.532 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:34.626+0000 7f2adeffd640 1 -- 172.21.15.87:0/443895293 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 11) v1 ==== 45414+0+0 (secure 0 0 0) 0x7f2ae4039070 con 0x7f2ae8103450 2024-09-17T07:11:35.532 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:34.626+0000 7f2af03a9640 1 -- 172.21.15.87:0/443895293 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ae8100930 con 0x7f2ae8103450 2024-09-17T07:11:35.532 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:34.626+0000 7f2adeffd640 1 --2- 172.21.15.87:0/443895293 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f2ad4039420 0x7f2ad403b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:35.532 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:34.626+0000 7f2adeffd640 1 -- 172.21.15.87:0/443895293 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f2ae406c9c0 con 0x7f2ae8103450 2024-09-17T07:11:35.532 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:34.626+0000 7f2aed944640 1 --2- 172.21.15.87:0/443895293 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f2ad4039420 0x7f2ad403b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:35.532 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:34.627+0000 7f2aed944640 1 --2- 172.21.15.87:0/443895293 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f2ad4039420 0x7f2ad403b8d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2ad8006fd0 tx=0x7f2ad8006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:35.532 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:34.631+0000 7f2adeffd640 1 -- 172.21.15.87:0/443895293 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f2ae4030b20 con 0x7f2ae8103450 2024-09-17T07:11:35.532 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:34.809+0000 7f2af03a9640 1 -- 172.21.15.87:0/443895293 --> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7f2ae8101b80 con 0x7f2ad4039420 2024-09-17T07:11:35.532 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:34.902+0000 7f2adeffd640 1 -- 172.21.15.87:0/443895293 <== mgr.14160 v2:172.21.15.87:6800/2341884603 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f2ae8101b80 con 0x7f2ad4039420 2024-09-17T07:11:35.532 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:34.904+0000 7f2af03a9640 1 -- 172.21.15.87:0/443895293 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f2ad4039420 msgr2=0x7f2ad403b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:35.532 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:34.904+0000 7f2af03a9640 1 --2- 172.21.15.87:0/443895293 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f2ad4039420 0x7f2ad403b8d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2ad8006fd0 tx=0x7f2ad8006db0 comp rx=0 tx=0).stop 2024-09-17T07:11:35.532 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:34.904+0000 7f2af03a9640 1 -- 172.21.15.87:0/443895293 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ae8103450 msgr2=0x7f2ae8102b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:35.532 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:34.904+0000 7f2af03a9640 1 --2- 172.21.15.87:0/443895293 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ae8103450 0x7f2ae8102b20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2ae4006f00 tx=0x7f2ae402c040 comp rx=0 tx=0).stop 2024-09-17T07:11:35.532 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:34.904+0000 7f2af03a9640 1 -- 172.21.15.87:0/443895293 shutdown_connections 2024-09-17T07:11:35.533 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:34.904+0000 7f2af03a9640 1 --2- 172.21.15.87:0/443895293 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f2ad4039420 0x7f2ad403b8d0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:35.533 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:34.904+0000 7f2af03a9640 1 --2- 172.21.15.87:0/443895293 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ae8103450 0x7f2ae8102b20 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:35.533 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:34.904+0000 7f2af03a9640 1 -- 172.21.15.87:0/443895293 >> 172.21.15.87:0/443895293 conn(0x7f2ae80fbb70 msgr2=0x7f2ae80fc780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:11:35.533 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:34.904+0000 7f2af03a9640 1 -- 172.21.15.87:0/443895293 shutdown_connections 2024-09-17T07:11:35.533 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:34.904+0000 7f2af03a9640 1 -- 172.21.15.87:0/443895293 wait complete. 2024-09-17T07:11:35.533 INFO:teuthology.orchestra.run.smithi087.stdout:Creating initial admin user... 2024-09-17T07:11:36.165 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:35 smithi087 ceph-mon[27636]: [17/Sep/2024:07:11:34] ENGINE Serving on https://172.21.15.87:7150 2024-09-17T07:11:36.165 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:35 smithi087 ceph-mon[27636]: [17/Sep/2024:07:11:34] ENGINE Bus STARTED 2024-09-17T07:11:36.165 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:35 smithi087 ceph-mon[27636]: [17/Sep/2024:07:11:34] ENGINE Error in HTTPServer.serve 2024-09-17T07:11:36.165 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Traceback (most recent call last): 2024-09-17T07:11:36.165 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T07:11:36.165 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: self._connections.run(self.expiration_interval) 2024-09-17T07:11:36.165 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T07:11:36.166 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: self._run(expiration_interval) 2024-09-17T07:11:36.166 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T07:11:36.166 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T07:11:36.166 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T07:11:36.166 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T07:11:36.166 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T07:11:36.166 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: s = self.context.wrap_socket( 2024-09-17T07:11:36.166 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T07:11:36.166 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: return self.sslsocket_class._create( 2024-09-17T07:11:36.166 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T07:11:36.166 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: self.do_handshake() 2024-09-17T07:11:36.166 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T07:11:36.166 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: self._sslobj.do_handshake() 2024-09-17T07:11:36.166 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T07:11:36.167 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:35 smithi087 ceph-mon[27636]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:11:36.167 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:35 smithi087 ceph-mon[27636]: from='mgr.14160 172.21.15.87:0/3005432640' entity='mgr.smithi087.vuvjer' 2024-09-17T07:11:36.167 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:35 smithi087 ceph-mon[27636]: from='mgr.14160 172.21.15.87:0/3005432640' entity='mgr.smithi087.vuvjer' 2024-09-17T07:11:36.167 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:35 smithi087 ceph-mon[27636]: from='mgr.14160 172.21.15.87:0/3005432640' entity='mgr.smithi087.vuvjer' 2024-09-17T07:11:36.167 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:35 smithi087 ceph-mon[27636]: mgrmap e12: smithi087.vuvjer(active, since 2s) 2024-09-17T07:11:37.008 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$t06JUfL/lgwub02suYB4A.XCI0.ZMGHI3aLN1N0kEpK8WhDtsIq5e", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726557096, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-17T07:11:37.008 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:35.911+0000 7fe8542f7640 1 Processor -- start 2024-09-17T07:11:37.008 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:35.911+0000 7fe8542f7640 1 -- start start 2024-09-17T07:11:37.009 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:35.912+0000 7fe8542f7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe84c1022e0 0x7fe84c1026f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:37.009 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:35.912+0000 7fe8542f7640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe84c102c30 con 0x7fe84c1022e0 2024-09-17T07:11:37.009 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:35.912+0000 7fe852093640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe84c1022e0 0x7fe84c1026f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:37.009 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:35.912+0000 7fe852093640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe84c1022e0 0x7fe84c1026f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54560/0 (socket says 172.21.15.87:54560) 2024-09-17T07:11:37.009 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:35.912+0000 7fe852093640 1 -- 172.21.15.87:0/1808988726 learned_addr learned my addr 172.21.15.87:0/1808988726 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:11:37.009 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:35.912+0000 7fe852093640 1 -- 172.21.15.87:0/1808988726 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe84c100880 con 0x7fe84c1022e0 2024-09-17T07:11:37.009 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:35.913+0000 7fe852093640 1 --2- 172.21.15.87:0/1808988726 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe84c1022e0 0x7fe84c1026f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe840009840 tx=0x7fe8400091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9631e41ef22a3391 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:37.009 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:35.913+0000 7fe851091640 1 -- 172.21.15.87:0/1808988726 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe840032440 con 0x7fe84c1022e0 2024-09-17T07:11:37.009 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:35.913+0000 7fe851091640 1 -- 172.21.15.87:0/1808988726 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fe840032a20 con 0x7fe84c1022e0 2024-09-17T07:11:37.009 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:35.913+0000 7fe851091640 1 -- 172.21.15.87:0/1808988726 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe8400319e0 con 0x7fe84c1022e0 2024-09-17T07:11:37.009 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:35.914+0000 7fe8542f7640 1 -- 172.21.15.87:0/1808988726 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe84c1022e0 msgr2=0x7fe84c1026f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:37.009 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:35.914+0000 7fe8542f7640 1 --2- 172.21.15.87:0/1808988726 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe84c1022e0 0x7fe84c1026f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe840009840 tx=0x7fe8400091d0 comp rx=0 tx=0).stop 2024-09-17T07:11:37.009 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:35.914+0000 7fe8542f7640 1 -- 172.21.15.87:0/1808988726 shutdown_connections 2024-09-17T07:11:37.010 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:35.914+0000 7fe8542f7640 1 --2- 172.21.15.87:0/1808988726 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe84c1022e0 0x7fe84c1026f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:37.010 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:35.914+0000 7fe8542f7640 1 -- 172.21.15.87:0/1808988726 >> 172.21.15.87:0/1808988726 conn(0x7fe84c0fc390 msgr2=0x7fe84c0fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:11:37.010 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:35.914+0000 7fe8542f7640 1 -- 172.21.15.87:0/1808988726 shutdown_connections 2024-09-17T07:11:37.010 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:35.914+0000 7fe8542f7640 1 -- 172.21.15.87:0/1808988726 wait complete. 2024-09-17T07:11:37.010 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:35.914+0000 7fe8542f7640 1 Processor -- start 2024-09-17T07:11:37.010 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:35.914+0000 7fe8542f7640 1 -- start start 2024-09-17T07:11:37.010 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:35.914+0000 7fe8542f7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe84c1022e0 0x7fe84c106e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:37.010 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:35.914+0000 7fe8542f7640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe84c1073c0 con 0x7fe84c1022e0 2024-09-17T07:11:37.010 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:35.915+0000 7fe852093640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe84c1022e0 0x7fe84c106e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:37.010 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:35.915+0000 7fe852093640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe84c1022e0 0x7fe84c106e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54568/0 (socket says 172.21.15.87:54568) 2024-09-17T07:11:37.010 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:35.915+0000 7fe852093640 1 -- 172.21.15.87:0/3484895122 learned_addr learned my addr 172.21.15.87:0/3484895122 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:11:37.010 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:35.915+0000 7fe852093640 1 -- 172.21.15.87:0/3484895122 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe840009450 con 0x7fe84c1022e0 2024-09-17T07:11:37.010 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:35.915+0000 7fe852093640 1 --2- 172.21.15.87:0/3484895122 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe84c1022e0 0x7fe84c106e80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe840006f00 tx=0x7fe84002c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:37.010 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:35.915+0000 7fe83effd640 1 -- 172.21.15.87:0/3484895122 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe84003b440 con 0x7fe84c1022e0 2024-09-17T07:11:37.011 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:35.915+0000 7fe8542f7640 1 -- 172.21.15.87:0/3484895122 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe84c105450 con 0x7fe84c1022e0 2024-09-17T07:11:37.011 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:35.915+0000 7fe83effd640 1 -- 172.21.15.87:0/3484895122 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fe84003ba20 con 0x7fe84c1022e0 2024-09-17T07:11:37.011 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:35.915+0000 7fe83effd640 1 -- 172.21.15.87:0/3484895122 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe84003a870 con 0x7fe84c1022e0 2024-09-17T07:11:37.011 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:35.915+0000 7fe8542f7640 1 -- 172.21.15.87:0/3484895122 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe84c1058c0 con 0x7fe84c1022e0 2024-09-17T07:11:37.011 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:35.916+0000 7fe83effd640 1 -- 172.21.15.87:0/3484895122 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 12) v1 ==== 45520+0+0 (secure 0 0 0) 0x7fe840039070 con 0x7fe84c1022e0 2024-09-17T07:11:37.011 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:35.916+0000 7fe8542f7640 1 -- 172.21.15.87:0/3484895122 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe84c05ed70 con 0x7fe84c1022e0 2024-09-17T07:11:37.011 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:35.916+0000 7fe83effd640 1 --2- 172.21.15.87:0/3484895122 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7fe8380394e0 0x7fe83803b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:37.011 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:35.916+0000 7fe83effd640 1 -- 172.21.15.87:0/3484895122 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fe84006cbe0 con 0x7fe84c1022e0 2024-09-17T07:11:37.011 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:35.916+0000 7fe851892640 1 --2- 172.21.15.87:0/3484895122 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7fe8380394e0 0x7fe83803b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:37.011 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:35.917+0000 7fe851892640 1 --2- 172.21.15.87:0/3484895122 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7fe8380394e0 0x7fe83803b990 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe848006fd0 tx=0x7fe848006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:37.011 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:35.921+0000 7fe83effd640 1 -- 172.21.15.87:0/3484895122 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fe84003bb90 con 0x7fe84c1022e0 2024-09-17T07:11:37.011 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:36.102+0000 7fe8542f7640 1 -- 172.21.15.87:0/3484895122 --> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fe84c101610 con 0x7fe8380394e0 2024-09-17T07:11:37.011 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:36.327+0000 7fe83effd640 1 -- 172.21.15.87:0/3484895122 <== mgr.14160 v2:172.21.15.87:6800/2341884603 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7fe84c101610 con 0x7fe8380394e0 2024-09-17T07:11:37.011 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:36.329+0000 7fe8542f7640 1 -- 172.21.15.87:0/3484895122 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7fe8380394e0 msgr2=0x7fe83803b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:37.012 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:36.329+0000 7fe8542f7640 1 --2- 172.21.15.87:0/3484895122 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7fe8380394e0 0x7fe83803b990 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe848006fd0 tx=0x7fe848006db0 comp rx=0 tx=0).stop 2024-09-17T07:11:37.012 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:36.329+0000 7fe8542f7640 1 -- 172.21.15.87:0/3484895122 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe84c1022e0 msgr2=0x7fe84c106e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:37.012 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:36.329+0000 7fe8542f7640 1 --2- 172.21.15.87:0/3484895122 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe84c1022e0 0x7fe84c106e80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe840006f00 tx=0x7fe84002c040 comp rx=0 tx=0).stop 2024-09-17T07:11:37.012 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:36.329+0000 7fe8542f7640 1 -- 172.21.15.87:0/3484895122 shutdown_connections 2024-09-17T07:11:37.012 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:36.329+0000 7fe8542f7640 1 --2- 172.21.15.87:0/3484895122 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7fe8380394e0 0x7fe83803b990 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:37.012 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:36.329+0000 7fe8542f7640 1 --2- 172.21.15.87:0/3484895122 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe84c1022e0 0x7fe84c106e80 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:37.012 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:36.329+0000 7fe8542f7640 1 -- 172.21.15.87:0/3484895122 >> 172.21.15.87:0/3484895122 conn(0x7fe84c0fc390 msgr2=0x7fe84c0fcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:11:37.012 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:36.329+0000 7fe8542f7640 1 -- 172.21.15.87:0/3484895122 shutdown_connections 2024-09-17T07:11:37.012 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:36.329+0000 7fe8542f7640 1 -- 172.21.15.87:0/3484895122 wait complete. 2024-09-17T07:11:37.012 INFO:teuthology.orchestra.run.smithi087.stdout:Fetching dashboard port number... 2024-09-17T07:11:37.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:36 smithi087 ceph-mon[27636]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:11:37.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:36 smithi087 ceph-mon[27636]: from='mgr.14160 172.21.15.87:0/3005432640' entity='mgr.smithi087.vuvjer' 2024-09-17T07:11:38.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:38 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/632982821' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-17T07:11:38.702 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stdout 8443 2024-09-17T07:11:38.702 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:37.797+0000 7f8d0181f640 1 Processor -- start 2024-09-17T07:11:38.702 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:37.798+0000 7f8d0181f640 1 -- start start 2024-09-17T07:11:38.702 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:37.798+0000 7f8d0181f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8cfc076b90 0x7f8cfc104a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:38.702 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:37.798+0000 7f8d0181f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cfc104f70 con 0x7f8cfc076b90 2024-09-17T07:11:38.702 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:37.798+0000 7f8cfaffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8cfc076b90 0x7f8cfc104a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:38.703 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:37.798+0000 7f8cfaffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8cfc076b90 0x7f8cfc104a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54582/0 (socket says 172.21.15.87:54582) 2024-09-17T07:11:38.703 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:37.798+0000 7f8cfaffd640 1 -- 172.21.15.87:0/2073476591 learned_addr learned my addr 172.21.15.87:0/2073476591 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:11:38.703 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:37.798+0000 7f8cfaffd640 1 -- 172.21.15.87:0/2073476591 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cfc1050b0 con 0x7f8cfc076b90 2024-09-17T07:11:38.703 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:37.799+0000 7f8cfaffd640 1 --2- 172.21.15.87:0/2073476591 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8cfc076b90 0x7f8cfc104a30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8cec009840 tx=0x7f8cec0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aac0df000de03257 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:38.703 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:37.799+0000 7f8cf9ffb640 1 -- 172.21.15.87:0/2073476591 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8cec032440 con 0x7f8cfc076b90 2024-09-17T07:11:38.703 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:37.799+0000 7f8cf9ffb640 1 -- 172.21.15.87:0/2073476591 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f8cec032a20 con 0x7f8cfc076b90 2024-09-17T07:11:38.703 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:37.799+0000 7f8cf9ffb640 1 -- 172.21.15.87:0/2073476591 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8cec0319e0 con 0x7f8cfc076b90 2024-09-17T07:11:38.703 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:37.800+0000 7f8d0181f640 1 -- 172.21.15.87:0/2073476591 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8cfc076b90 msgr2=0x7f8cfc104a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:38.703 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:37.800+0000 7f8d0181f640 1 --2- 172.21.15.87:0/2073476591 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8cfc076b90 0x7f8cfc104a30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8cec009840 tx=0x7f8cec0091d0 comp rx=0 tx=0).stop 2024-09-17T07:11:38.704 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:37.800+0000 7f8d0181f640 1 -- 172.21.15.87:0/2073476591 shutdown_connections 2024-09-17T07:11:38.704 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:37.800+0000 7f8d0181f640 1 --2- 172.21.15.87:0/2073476591 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8cfc076b90 0x7f8cfc104a30 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:38.704 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:37.800+0000 7f8d0181f640 1 -- 172.21.15.87:0/2073476591 >> 172.21.15.87:0/2073476591 conn(0x7f8cfc0fc4a0 msgr2=0x7f8cfc0fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:11:38.704 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:37.800+0000 7f8d0181f640 1 -- 172.21.15.87:0/2073476591 shutdown_connections 2024-09-17T07:11:38.704 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:37.800+0000 7f8d0181f640 1 -- 172.21.15.87:0/2073476591 wait complete. 2024-09-17T07:11:38.704 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:37.800+0000 7f8d0181f640 1 Processor -- start 2024-09-17T07:11:38.704 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:37.800+0000 7f8d0181f640 1 -- start start 2024-09-17T07:11:38.704 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:37.801+0000 7f8d0181f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8cfc076b90 0x7f8cfc110b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:38.704 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:37.801+0000 7f8d0181f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cfc111050 con 0x7f8cfc076b90 2024-09-17T07:11:38.704 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:37.801+0000 7f8cfaffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8cfc076b90 0x7f8cfc110b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:38.704 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:37.801+0000 7f8cfaffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8cfc076b90 0x7f8cfc110b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54596/0 (socket says 172.21.15.87:54596) 2024-09-17T07:11:38.704 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:37.801+0000 7f8cfaffd640 1 -- 172.21.15.87:0/632982821 learned_addr learned my addr 172.21.15.87:0/632982821 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:11:38.704 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:37.801+0000 7f8cfaffd640 1 -- 172.21.15.87:0/632982821 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cec009450 con 0x7f8cfc076b90 2024-09-17T07:11:38.705 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:37.801+0000 7f8cfaffd640 1 --2- 172.21.15.87:0/632982821 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8cfc076b90 0x7f8cfc110b10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8cec009810 tx=0x7f8cec02c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:38.705 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:37.801+0000 7f8ce37fe640 1 -- 172.21.15.87:0/632982821 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8cec032880 con 0x7f8cfc076b90 2024-09-17T07:11:38.705 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:37.801+0000 7f8d0181f640 1 -- 172.21.15.87:0/632982821 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cfc111250 con 0x7f8cfc076b90 2024-09-17T07:11:38.705 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:37.801+0000 7f8ce37fe640 1 -- 172.21.15.87:0/632982821 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f8cec03b8c0 con 0x7f8cfc076b90 2024-09-17T07:11:38.705 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:37.802+0000 7f8ce37fe640 1 -- 172.21.15.87:0/632982821 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8cec03a7f0 con 0x7f8cfc076b90 2024-09-17T07:11:38.705 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:37.802+0000 7f8d0181f640 1 -- 172.21.15.87:0/632982821 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cfc1116c0 con 0x7f8cfc076b90 2024-09-17T07:11:38.705 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:37.802+0000 7f8ce37fe640 1 -- 172.21.15.87:0/632982821 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 12) v1 ==== 45520+0+0 (secure 0 0 0) 0x7f8cec039070 con 0x7f8cfc076b90 2024-09-17T07:11:38.705 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:37.802+0000 7f8d0181f640 1 -- 172.21.15.87:0/632982821 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cfc04b720 con 0x7f8cfc076b90 2024-09-17T07:11:38.705 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:37.803+0000 7f8ce37fe640 1 --2- 172.21.15.87:0/632982821 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f8ce4039530 0x7f8ce403b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:38.705 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:37.803+0000 7f8ce37fe640 1 -- 172.21.15.87:0/632982821 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f8cec06c8a0 con 0x7f8cfc076b90 2024-09-17T07:11:38.705 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:37.803+0000 7f8cfa7fc640 1 --2- 172.21.15.87:0/632982821 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f8ce4039530 0x7f8ce403b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:38.705 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:37.803+0000 7f8cfa7fc640 1 --2- 172.21.15.87:0/632982821 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f8ce4039530 0x7f8ce403b9e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0006fd0 tx=0x7f8cf0006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:38.705 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:37.807+0000 7f8ce37fe640 1 -- 172.21.15.87:0/632982821 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f8cec04c350 con 0x7f8cfc076b90 2024-09-17T07:11:38.706 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:37.965+0000 7f8d0181f640 1 -- 172.21.15.87:0/632982821 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f8cfc112020 con 0x7f8cfc076b90 2024-09-17T07:11:38.706 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:37.966+0000 7f8ce37fe640 1 -- 172.21.15.87:0/632982821 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f8cec03f070 con 0x7f8cfc076b90 2024-09-17T07:11:38.706 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:37.968+0000 7f8d0181f640 1 -- 172.21.15.87:0/632982821 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f8ce4039530 msgr2=0x7f8ce403b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:38.706 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:37.968+0000 7f8d0181f640 1 --2- 172.21.15.87:0/632982821 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f8ce4039530 0x7f8ce403b9e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0006fd0 tx=0x7f8cf0006db0 comp rx=0 tx=0).stop 2024-09-17T07:11:38.706 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:37.968+0000 7f8d0181f640 1 -- 172.21.15.87:0/632982821 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8cfc076b90 msgr2=0x7f8cfc110b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:38.706 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:37.968+0000 7f8d0181f640 1 --2- 172.21.15.87:0/632982821 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8cfc076b90 0x7f8cfc110b10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8cec009810 tx=0x7f8cec02c040 comp rx=0 tx=0).stop 2024-09-17T07:11:38.706 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:37.968+0000 7f8d0181f640 1 -- 172.21.15.87:0/632982821 shutdown_connections 2024-09-17T07:11:38.706 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:37.968+0000 7f8d0181f640 1 --2- 172.21.15.87:0/632982821 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f8ce4039530 0x7f8ce403b9e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:38.706 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:37.968+0000 7f8d0181f640 1 --2- 172.21.15.87:0/632982821 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8cfc076b90 0x7f8cfc110b10 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:38.706 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:37.968+0000 7f8d0181f640 1 -- 172.21.15.87:0/632982821 >> 172.21.15.87:0/632982821 conn(0x7f8cfc0fc4a0 msgr2=0x7f8cfc0fd010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:11:38.706 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:37.968+0000 7f8d0181f640 1 -- 172.21.15.87:0/632982821 shutdown_connections 2024-09-17T07:11:38.706 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:37.968+0000 7f8d0181f640 1 -- 172.21.15.87:0/632982821 wait complete. 2024-09-17T07:11:38.708 INFO:teuthology.orchestra.run.smithi087.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-17T07:11:38.708 INFO:teuthology.orchestra.run.smithi087.stdout:systemctl: stdout disabled 2024-09-17T07:11:38.715 INFO:teuthology.orchestra.run.smithi087.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-17T07:11:38.715 INFO:teuthology.orchestra.run.smithi087.stdout:systemctl: stdout inactive 2024-09-17T07:11:38.715 INFO:teuthology.orchestra.run.smithi087.stdout:firewalld.service is not enabled 2024-09-17T07:11:38.715 INFO:teuthology.orchestra.run.smithi087.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-17T07:11:38.716 INFO:teuthology.orchestra.run.smithi087.stdout:Ceph Dashboard is now available at: 2024-09-17T07:11:38.716 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:11:38.716 INFO:teuthology.orchestra.run.smithi087.stdout: URL: https://smithi087.front.sepia.ceph.com:8443/ 2024-09-17T07:11:38.717 INFO:teuthology.orchestra.run.smithi087.stdout: User: admin 2024-09-17T07:11:38.717 INFO:teuthology.orchestra.run.smithi087.stdout: Password: r8ir06k6q4 2024-09-17T07:11:38.717 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:11:38.717 INFO:teuthology.orchestra.run.smithi087.stdout:Saving cluster configuration to /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/config directory 2024-09-17T07:11:38.717 INFO:teuthology.orchestra.run.smithi087.stdout:Enabling autotune for osd_memory_target 2024-09-17T07:11:39.866 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:39.096+0000 7f04ac956640 1 Processor -- start 2024-09-17T07:11:39.866 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:39.096+0000 7f04ac956640 1 -- start start 2024-09-17T07:11:39.866 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:39.096+0000 7f04ac956640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04a8100160 0x7f04a8100550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:39.866 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:39.096+0000 7f04ac956640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04a8100a90 con 0x7f04a8100160 2024-09-17T07:11:39.866 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:39.096+0000 7f04a659c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04a8100160 0x7f04a8100550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:39.866 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:39.096+0000 7f04a659c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04a8100160 0x7f04a8100550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54612/0 (socket says 172.21.15.87:54612) 2024-09-17T07:11:39.866 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:39.096+0000 7f04a659c640 1 -- 172.21.15.87:0/3436781272 learned_addr learned my addr 172.21.15.87:0/3436781272 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:11:39.867 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:39.096+0000 7f04a659c640 1 -- 172.21.15.87:0/3436781272 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04a8100bd0 con 0x7f04a8100160 2024-09-17T07:11:39.867 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:39.097+0000 7f04a659c640 1 --2- 172.21.15.87:0/3436781272 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04a8100160 0x7f04a8100550 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0498009840 tx=0x7f04980091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77bb176cd9134f91 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:39.867 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:39.097+0000 7f04a5d9b640 1 -- 172.21.15.87:0/3436781272 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0498032440 con 0x7f04a8100160 2024-09-17T07:11:39.867 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:39.097+0000 7f04a5d9b640 1 -- 172.21.15.87:0/3436781272 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f0498032a20 con 0x7f04a8100160 2024-09-17T07:11:39.867 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:39.097+0000 7f04a5d9b640 1 -- 172.21.15.87:0/3436781272 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f04980319e0 con 0x7f04a8100160 2024-09-17T07:11:39.867 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:39.098+0000 7f04ac956640 1 -- 172.21.15.87:0/3436781272 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04a8100160 msgr2=0x7f04a8100550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:39.867 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:39.098+0000 7f04ac956640 1 --2- 172.21.15.87:0/3436781272 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04a8100160 0x7f04a8100550 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0498009840 tx=0x7f04980091d0 comp rx=0 tx=0).stop 2024-09-17T07:11:39.867 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:39.098+0000 7f04ac956640 1 -- 172.21.15.87:0/3436781272 shutdown_connections 2024-09-17T07:11:39.867 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:39.098+0000 7f04ac956640 1 --2- 172.21.15.87:0/3436781272 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04a8100160 0x7f04a8100550 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:39.867 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:39.098+0000 7f04ac956640 1 -- 172.21.15.87:0/3436781272 >> 172.21.15.87:0/3436781272 conn(0x7f04a80fbbc0 msgr2=0x7f04a80fe010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:11:39.867 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:39.098+0000 7f04ac956640 1 -- 172.21.15.87:0/3436781272 shutdown_connections 2024-09-17T07:11:39.867 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:39.098+0000 7f04ac956640 1 -- 172.21.15.87:0/3436781272 wait complete. 2024-09-17T07:11:39.867 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:39.098+0000 7f04ac956640 1 Processor -- start 2024-09-17T07:11:39.868 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:39.098+0000 7f04ac956640 1 -- start start 2024-09-17T07:11:39.868 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:39.099+0000 7f04ac956640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04a8100160 0x7f04a8110b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:39.868 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:39.099+0000 7f04ac956640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04a8111050 con 0x7f04a8100160 2024-09-17T07:11:39.868 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:39.099+0000 7f04a659c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04a8100160 0x7f04a8110b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:39.868 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:39.099+0000 7f04a659c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04a8100160 0x7f04a8110b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54628/0 (socket says 172.21.15.87:54628) 2024-09-17T07:11:39.868 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:39.099+0000 7f04a659c640 1 -- 172.21.15.87:0/2311981248 learned_addr learned my addr 172.21.15.87:0/2311981248 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:11:39.868 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:39.099+0000 7f04a659c640 1 -- 172.21.15.87:0/2311981248 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0498009450 con 0x7f04a8100160 2024-09-17T07:11:39.868 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:39.099+0000 7f04a659c640 1 --2- 172.21.15.87:0/2311981248 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04a8100160 0x7f04a8110b10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0498006f00 tx=0x7f049802c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:39.868 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:39.099+0000 7f049effd640 1 -- 172.21.15.87:0/2311981248 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f049803b440 con 0x7f04a8100160 2024-09-17T07:11:39.868 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:39.099+0000 7f049effd640 1 -- 172.21.15.87:0/2311981248 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f049803ba20 con 0x7f04a8100160 2024-09-17T07:11:39.868 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:39.099+0000 7f04ac956640 1 -- 172.21.15.87:0/2311981248 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04a8111250 con 0x7f04a8100160 2024-09-17T07:11:39.868 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:39.099+0000 7f049effd640 1 -- 172.21.15.87:0/2311981248 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f049803a800 con 0x7f04a8100160 2024-09-17T07:11:39.868 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:39.099+0000 7f04ac956640 1 -- 172.21.15.87:0/2311981248 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04a81116c0 con 0x7f04a8100160 2024-09-17T07:11:39.869 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:39.100+0000 7f049effd640 1 -- 172.21.15.87:0/2311981248 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7f0498039070 con 0x7f04a8100160 2024-09-17T07:11:39.869 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:39.100+0000 7f04ac956640 1 -- 172.21.15.87:0/2311981248 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04a8105de0 con 0x7f04a8100160 2024-09-17T07:11:39.869 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:39.100+0000 7f049effd640 1 --2- 172.21.15.87:0/2311981248 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f0494039580 0x7f049403ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:39.869 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:39.101+0000 7f049effd640 1 -- 172.21.15.87:0/2311981248 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f049806cba0 con 0x7f04a8100160 2024-09-17T07:11:39.869 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:39.101+0000 7f049ffff640 1 --2- 172.21.15.87:0/2311981248 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f0494039580 0x7f049403ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:39.870 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:39.101+0000 7f049ffff640 1 --2- 172.21.15.87:0/2311981248 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f0494039580 0x7f049403ba30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0490006fd0 tx=0x7f0490006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:39.870 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:39.105+0000 7f049effd640 1 -- 172.21.15.87:0/2311981248 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f049804c350 con 0x7f04a8100160 2024-09-17T07:11:39.870 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:39.278+0000 7f04ac956640 1 -- 172.21.15.87:0/2311981248 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7f04a81116c0 con 0x7f04a8100160 2024-09-17T07:11:39.870 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:39.278+0000 7f049effd640 1 -- 172.21.15.87:0/2311981248 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7f0498037070 con 0x7f04a8100160 2024-09-17T07:11:39.870 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:39.280+0000 7f04ac956640 1 -- 172.21.15.87:0/2311981248 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f0494039580 msgr2=0x7f049403ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:39.870 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:39.280+0000 7f04ac956640 1 --2- 172.21.15.87:0/2311981248 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f0494039580 0x7f049403ba30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0490006fd0 tx=0x7f0490006db0 comp rx=0 tx=0).stop 2024-09-17T07:11:39.870 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:39.280+0000 7f04ac956640 1 -- 172.21.15.87:0/2311981248 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04a8100160 msgr2=0x7f04a8110b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:39.870 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:39.280+0000 7f04ac956640 1 --2- 172.21.15.87:0/2311981248 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04a8100160 0x7f04a8110b10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0498006f00 tx=0x7f049802c040 comp rx=0 tx=0).stop 2024-09-17T07:11:39.870 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:39.280+0000 7f04ac956640 1 -- 172.21.15.87:0/2311981248 shutdown_connections 2024-09-17T07:11:39.870 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:39.280+0000 7f04ac956640 1 --2- 172.21.15.87:0/2311981248 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f0494039580 0x7f049403ba30 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:39.870 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:39.280+0000 7f04ac956640 1 --2- 172.21.15.87:0/2311981248 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04a8100160 0x7f04a8110b10 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:39.870 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:39.280+0000 7f04ac956640 1 -- 172.21.15.87:0/2311981248 >> 172.21.15.87:0/2311981248 conn(0x7f04a80fbbc0 msgr2=0x7f04a80fc810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:11:39.870 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:39.280+0000 7f04ac956640 1 -- 172.21.15.87:0/2311981248 shutdown_connections 2024-09-17T07:11:39.870 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:39.280+0000 7f04ac956640 1 -- 172.21.15.87:0/2311981248 wait complete. 2024-09-17T07:11:40.261 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:40 smithi087 ceph-mon[27636]: mgrmap e13: smithi087.vuvjer(active, since 6s) 2024-09-17T07:11:41.064 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:40.260+0000 7f4ed8fdf640 1 Processor -- start 2024-09-17T07:11:41.064 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:40.260+0000 7f4ed8fdf640 1 -- start start 2024-09-17T07:11:41.064 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:40.261+0000 7f4ed8fdf640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ed4100050 0x7f4ed4100460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:41.064 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:40.261+0000 7f4ed8fdf640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed41009a0 con 0x7f4ed4100050 2024-09-17T07:11:41.064 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:40.261+0000 7f4ed259c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ed4100050 0x7f4ed4100460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:41.064 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:40.261+0000 7f4ed259c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ed4100050 0x7f4ed4100460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54644/0 (socket says 172.21.15.87:54644) 2024-09-17T07:11:41.064 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:40.261+0000 7f4ed259c640 1 -- 172.21.15.87:0/1728889365 learned_addr learned my addr 172.21.15.87:0/1728889365 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:11:41.065 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:40.261+0000 7f4ed259c640 1 -- 172.21.15.87:0/1728889365 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed4100ae0 con 0x7f4ed4100050 2024-09-17T07:11:41.065 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:40.262+0000 7f4ed259c640 1 --2- 172.21.15.87:0/1728889365 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ed4100050 0x7f4ed4100460 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4ec4009840 tx=0x7f4ec40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c3172ca340a95ac server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:41.065 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:40.262+0000 7f4ed159a640 1 -- 172.21.15.87:0/1728889365 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4ec4032440 con 0x7f4ed4100050 2024-09-17T07:11:41.065 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:40.262+0000 7f4ed159a640 1 -- 172.21.15.87:0/1728889365 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f4ec4032a20 con 0x7f4ed4100050 2024-09-17T07:11:41.065 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:40.262+0000 7f4ed159a640 1 -- 172.21.15.87:0/1728889365 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4ec40319e0 con 0x7f4ed4100050 2024-09-17T07:11:41.065 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:40.263+0000 7f4ed8fdf640 1 -- 172.21.15.87:0/1728889365 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ed4100050 msgr2=0x7f4ed4100460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:41.065 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:40.263+0000 7f4ed8fdf640 1 --2- 172.21.15.87:0/1728889365 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ed4100050 0x7f4ed4100460 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4ec4009840 tx=0x7f4ec40091d0 comp rx=0 tx=0).stop 2024-09-17T07:11:41.065 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:40.263+0000 7f4ed8fdf640 1 -- 172.21.15.87:0/1728889365 shutdown_connections 2024-09-17T07:11:41.065 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:40.263+0000 7f4ed8fdf640 1 --2- 172.21.15.87:0/1728889365 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ed4100050 0x7f4ed4100460 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:41.065 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:40.263+0000 7f4ed8fdf640 1 -- 172.21.15.87:0/1728889365 >> 172.21.15.87:0/1728889365 conn(0x7f4ed40fbc00 msgr2=0x7f4ed40fe010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:11:41.065 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:40.263+0000 7f4ed8fdf640 1 -- 172.21.15.87:0/1728889365 shutdown_connections 2024-09-17T07:11:41.065 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:40.263+0000 7f4ed8fdf640 1 -- 172.21.15.87:0/1728889365 wait complete. 2024-09-17T07:11:41.065 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:40.263+0000 7f4ed8fdf640 1 Processor -- start 2024-09-17T07:11:41.066 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:40.263+0000 7f4ed8fdf640 1 -- start start 2024-09-17T07:11:41.066 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:40.263+0000 7f4ed8fdf640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ed4100050 0x7f4ed4110b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:41.066 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:40.263+0000 7f4ed8fdf640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed4111060 con 0x7f4ed4100050 2024-09-17T07:11:41.066 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:40.264+0000 7f4ed259c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ed4100050 0x7f4ed4110b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:41.066 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:40.264+0000 7f4ed259c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ed4100050 0x7f4ed4110b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54650/0 (socket says 172.21.15.87:54650) 2024-09-17T07:11:41.066 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:40.264+0000 7f4ed259c640 1 -- 172.21.15.87:0/839997143 learned_addr learned my addr 172.21.15.87:0/839997143 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:11:41.066 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:40.264+0000 7f4ed259c640 1 -- 172.21.15.87:0/839997143 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ec4009450 con 0x7f4ed4100050 2024-09-17T07:11:41.066 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:40.264+0000 7f4ed259c640 1 --2- 172.21.15.87:0/839997143 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ed4100050 0x7f4ed4110b20 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4ec4006f00 tx=0x7f4ec402c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:41.066 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:40.264+0000 7f4ec2ffd640 1 -- 172.21.15.87:0/839997143 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4ec403b440 con 0x7f4ed4100050 2024-09-17T07:11:41.066 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:40.264+0000 7f4ec2ffd640 1 -- 172.21.15.87:0/839997143 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f4ec403ba20 con 0x7f4ed4100050 2024-09-17T07:11:41.066 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:40.264+0000 7f4ec2ffd640 1 -- 172.21.15.87:0/839997143 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4ec403a800 con 0x7f4ed4100050 2024-09-17T07:11:41.066 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:40.264+0000 7f4ed8fdf640 1 -- 172.21.15.87:0/839997143 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ed4111260 con 0x7f4ed4100050 2024-09-17T07:11:41.066 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:40.264+0000 7f4ed8fdf640 1 -- 172.21.15.87:0/839997143 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ed41116d0 con 0x7f4ed4100050 2024-09-17T07:11:41.066 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:40.265+0000 7f4ec2ffd640 1 -- 172.21.15.87:0/839997143 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7f4ec4039070 con 0x7f4ed4100050 2024-09-17T07:11:41.067 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:40.265+0000 7f4ed8fdf640 1 -- 172.21.15.87:0/839997143 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ed404b720 con 0x7f4ed4100050 2024-09-17T07:11:41.067 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:40.265+0000 7f4ec2ffd640 1 --2- 172.21.15.87:0/839997143 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f4ebc0395d0 0x7f4ebc03ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:41.067 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:40.265+0000 7f4ec2ffd640 1 -- 172.21.15.87:0/839997143 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f4ec406ca30 con 0x7f4ed4100050 2024-09-17T07:11:41.067 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:40.265+0000 7f4ed1d9b640 1 --2- 172.21.15.87:0/839997143 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f4ebc0395d0 0x7f4ebc03ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:41.067 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:40.266+0000 7f4ed1d9b640 1 --2- 172.21.15.87:0/839997143 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f4ebc0395d0 0x7f4ebc03ba80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4ec8006fd0 tx=0x7f4ec8006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:41.067 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:40.270+0000 7f4ec2ffd640 1 -- 172.21.15.87:0/839997143 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f4ec403b5a0 con 0x7f4ed4100050 2024-09-17T07:11:41.067 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:40.505+0000 7f4ed8fdf640 1 -- 172.21.15.87:0/839997143 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f4ed4112030 con 0x7f4ed4100050 2024-09-17T07:11:41.067 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:40.508+0000 7f4ec2ffd640 1 -- 172.21.15.87:0/839997143 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v33)=0 set mgr/dashboard/cluster/status v33) v1 ==== 153+0+0 (secure 0 0 0) 0x7f4ec403f0c0 con 0x7f4ed4100050 2024-09-17T07:11:41.067 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-17T07:11:41.067 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:40.510+0000 7f4ed8fdf640 1 -- 172.21.15.87:0/839997143 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f4ebc0395d0 msgr2=0x7f4ebc03ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:41.067 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:40.510+0000 7f4ed8fdf640 1 --2- 172.21.15.87:0/839997143 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f4ebc0395d0 0x7f4ebc03ba80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4ec8006fd0 tx=0x7f4ec8006db0 comp rx=0 tx=0).stop 2024-09-17T07:11:41.067 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:40.510+0000 7f4ed8fdf640 1 -- 172.21.15.87:0/839997143 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ed4100050 msgr2=0x7f4ed4110b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:41.067 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:40.510+0000 7f4ed8fdf640 1 --2- 172.21.15.87:0/839997143 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ed4100050 0x7f4ed4110b20 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4ec4006f00 tx=0x7f4ec402c040 comp rx=0 tx=0).stop 2024-09-17T07:11:41.067 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:40.510+0000 7f4ed8fdf640 1 -- 172.21.15.87:0/839997143 shutdown_connections 2024-09-17T07:11:41.068 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:40.510+0000 7f4ed8fdf640 1 --2- 172.21.15.87:0/839997143 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f4ebc0395d0 0x7f4ebc03ba80 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:41.068 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:40.510+0000 7f4ed8fdf640 1 --2- 172.21.15.87:0/839997143 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ed4100050 0x7f4ed4110b20 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:41.068 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:40.510+0000 7f4ed8fdf640 1 -- 172.21.15.87:0/839997143 >> 172.21.15.87:0/839997143 conn(0x7f4ed40fbc00 msgr2=0x7f4ed40fc7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:11:41.068 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:40.510+0000 7f4ed8fdf640 1 -- 172.21.15.87:0/839997143 shutdown_connections 2024-09-17T07:11:41.068 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/ceph: stderr 2024-09-17T07:11:40.510+0000 7f4ed8fdf640 1 -- 172.21.15.87:0/839997143 wait complete. 2024-09-17T07:11:41.068 INFO:teuthology.orchestra.run.smithi087.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-17T07:11:41.068 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:11:41.068 INFO:teuthology.orchestra.run.smithi087.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-17T07:11:41.068 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:11:41.068 INFO:teuthology.orchestra.run.smithi087.stdout:Or, if you are only running a single cluster on this host: 2024-09-17T07:11:41.068 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:11:41.068 INFO:teuthology.orchestra.run.smithi087.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-17T07:11:41.068 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:11:41.068 INFO:teuthology.orchestra.run.smithi087.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-17T07:11:41.069 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:11:41.069 INFO:teuthology.orchestra.run.smithi087.stdout: ceph telemetry on 2024-09-17T07:11:41.069 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:11:41.069 INFO:teuthology.orchestra.run.smithi087.stdout:For more information see: 2024-09-17T07:11:41.069 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:11:41.069 INFO:teuthology.orchestra.run.smithi087.stdout: https://docs.ceph.com/docs/master/mgr/telemetry/ 2024-09-17T07:11:41.069 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:11:41.069 INFO:teuthology.orchestra.run.smithi087.stdout:Bootstrap complete. 2024-09-17T07:11:41.098 INFO:tasks.cephadm:Fetching config... 2024-09-17T07:11:41.099 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-17T07:11:41.099 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-17T07:11:41.114 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-17T07:11:41.115 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-17T07:11:41.115 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-17T07:11:41.171 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-17T07:11:41.171 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-17T07:11:41.171 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/mon.smithi087/keyring of=/dev/stdout 2024-09-17T07:11:41.236 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-17T07:11:41.236 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-17T07:11:41.236 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-17T07:11:41.293 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-17T07:11:41.293 DEBUG:teuthology.orchestra.run.smithi087:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDGMP9NyxWM96gatnzgz9Avvk1mI88qECyrLW7Fu3s+4U1JHtpPcIR3HjORS2sO9dyMt6G+gFOcg5dEuWdoiRNFPblD/wRRkVsVtg/+gpOOPWLtZrIGShOuT2B9kitX6sllrjieo8Wlol6X89SuDoU91DgR+tVH+pVB2AWFF84iCIqQWtskyAKHeRb6ROgDJ+EZOgmsozWcyMo0sfh1yjvxDskWKMTXYg1UzzHBhLuzBi0mNkPX9RX3/yxctxUt8ESlz6lg6CczoRuUSKXzi1pZkbEY9hMikwNqpTTD/DpDnrShhy7MOzRtZj0Q+OhfehD5J479kZN1uEApdJO5xjdmxWgQ5fWxnkrz/WkEKwmmIfJAPEdlUIoRpMBs2RMJtbYNXNnHIxDDqQjniBerMXEzf6erad1F69uTD1wlFthUZBSM+MAC6L/vhyxEZaU9e2ZcBjwRs+80gAqHEYHs65v8Mu/F+kN9aKbfV/SdVxHcQEcpse7mEgkzajlDGuRFOHk= ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-17T07:11:41.366 INFO:teuthology.orchestra.run.smithi087.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDGMP9NyxWM96gatnzgz9Avvk1mI88qECyrLW7Fu3s+4U1JHtpPcIR3HjORS2sO9dyMt6G+gFOcg5dEuWdoiRNFPblD/wRRkVsVtg/+gpOOPWLtZrIGShOuT2B9kitX6sllrjieo8Wlol6X89SuDoU91DgR+tVH+pVB2AWFF84iCIqQWtskyAKHeRb6ROgDJ+EZOgmsozWcyMo0sfh1yjvxDskWKMTXYg1UzzHBhLuzBi0mNkPX9RX3/yxctxUt8ESlz6lg6CczoRuUSKXzi1pZkbEY9hMikwNqpTTD/DpDnrShhy7MOzRtZj0Q+OhfehD5J479kZN1uEApdJO5xjdmxWgQ5fWxnkrz/WkEKwmmIfJAPEdlUIoRpMBs2RMJtbYNXNnHIxDDqQjniBerMXEzf6erad1F69uTD1wlFthUZBSM+MAC6L/vhyxEZaU9e2ZcBjwRs+80gAqHEYHs65v8Mu/F+kN9aKbfV/SdVxHcQEcpse7mEgkzajlDGuRFOHk= ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968 2024-09-17T07:11:41.377 DEBUG:teuthology.orchestra.run.smithi139:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDGMP9NyxWM96gatnzgz9Avvk1mI88qECyrLW7Fu3s+4U1JHtpPcIR3HjORS2sO9dyMt6G+gFOcg5dEuWdoiRNFPblD/wRRkVsVtg/+gpOOPWLtZrIGShOuT2B9kitX6sllrjieo8Wlol6X89SuDoU91DgR+tVH+pVB2AWFF84iCIqQWtskyAKHeRb6ROgDJ+EZOgmsozWcyMo0sfh1yjvxDskWKMTXYg1UzzHBhLuzBi0mNkPX9RX3/yxctxUt8ESlz6lg6CczoRuUSKXzi1pZkbEY9hMikwNqpTTD/DpDnrShhy7MOzRtZj0Q+OhfehD5J479kZN1uEApdJO5xjdmxWgQ5fWxnkrz/WkEKwmmIfJAPEdlUIoRpMBs2RMJtbYNXNnHIxDDqQjniBerMXEzf6erad1F69uTD1wlFthUZBSM+MAC6L/vhyxEZaU9e2ZcBjwRs+80gAqHEYHs65v8Mu/F+kN9aKbfV/SdVxHcQEcpse7mEgkzajlDGuRFOHk= ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-17T07:11:41.430 INFO:teuthology.orchestra.run.smithi139.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDGMP9NyxWM96gatnzgz9Avvk1mI88qECyrLW7Fu3s+4U1JHtpPcIR3HjORS2sO9dyMt6G+gFOcg5dEuWdoiRNFPblD/wRRkVsVtg/+gpOOPWLtZrIGShOuT2B9kitX6sllrjieo8Wlol6X89SuDoU91DgR+tVH+pVB2AWFF84iCIqQWtskyAKHeRb6ROgDJ+EZOgmsozWcyMo0sfh1yjvxDskWKMTXYg1UzzHBhLuzBi0mNkPX9RX3/yxctxUt8ESlz6lg6CczoRuUSKXzi1pZkbEY9hMikwNqpTTD/DpDnrShhy7MOzRtZj0Q+OhfehD5J479kZN1uEApdJO5xjdmxWgQ5fWxnkrz/WkEKwmmIfJAPEdlUIoRpMBs2RMJtbYNXNnHIxDDqQjniBerMXEzf6erad1F69uTD1wlFthUZBSM+MAC6L/vhyxEZaU9e2ZcBjwRs+80gAqHEYHs65v8Mu/F+kN9aKbfV/SdVxHcQEcpse7mEgkzajlDGuRFOHk= ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968 2024-09-17T07:11:41.443 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-17T07:11:41.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:41 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/839997143' entity='client.admin' 2024-09-17T07:11:41.685 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/mon.smithi087/config 2024-09-17T07:11:43.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:43.939+0000 7f3abbd5f640 1 -- 172.21.15.87:0/932517526 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ab4065650 msgr2=0x7f3ab40feff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:43.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:43.939+0000 7f3abbd5f640 1 --2- 172.21.15.87:0/932517526 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ab4065650 0x7f3ab40feff0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3aa4009bd0 tx=0x7f3aa4004d10 comp rx=0 tx=0).stop 2024-09-17T07:11:43.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:43.939+0000 7f3abbd5f640 1 -- 172.21.15.87:0/932517526 shutdown_connections 2024-09-17T07:11:43.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:43.939+0000 7f3abbd5f640 1 --2- 172.21.15.87:0/932517526 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ab4065650 0x7f3ab40feff0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:43.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:43.939+0000 7f3abbd5f640 1 -- 172.21.15.87:0/932517526 >> 172.21.15.87:0/932517526 conn(0x7f3ab40f6ac0 msgr2=0x7f3ab40f8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:11:43.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:43.939+0000 7f3abbd5f640 1 -- 172.21.15.87:0/932517526 shutdown_connections 2024-09-17T07:11:43.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:43.939+0000 7f3abbd5f640 1 -- 172.21.15.87:0/932517526 wait complete. 2024-09-17T07:11:43.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:43.939+0000 7f3abbd5f640 1 Processor -- start 2024-09-17T07:11:43.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:43.939+0000 7f3abbd5f640 1 -- start start 2024-09-17T07:11:43.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:43.939+0000 7f3abbd5f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ab4065650 0x7f3ab410c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:43.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:43.939+0000 7f3abbd5f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab410cdb0 con 0x7f3ab4065650 2024-09-17T07:11:43.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:43.939+0000 7f3ab9afb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ab4065650 0x7f3ab410c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:43.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:43.939+0000 7f3ab9afb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ab4065650 0x7f3ab410c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54666/0 (socket says 172.21.15.87:54666) 2024-09-17T07:11:43.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:43.939+0000 7f3ab9afb640 1 -- 172.21.15.87:0/230362212 learned_addr learned my addr 172.21.15.87:0/230362212 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:11:43.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:43.940+0000 7f3ab9afb640 1 -- 172.21.15.87:0/230362212 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aa40098b0 con 0x7f3ab4065650 2024-09-17T07:11:43.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:43.940+0000 7f3ab9afb640 1 --2- 172.21.15.87:0/230362212 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ab4065650 0x7f3ab410c870 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3aa4003400 tx=0x7f3aa4004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:43.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:43.940+0000 7f3ab27fc640 1 -- 172.21.15.87:0/230362212 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3aa4032820 con 0x7f3ab4065650 2024-09-17T07:11:43.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:43.940+0000 7f3ab27fc640 1 -- 172.21.15.87:0/230362212 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f3aa4032e00 con 0x7f3ab4065650 2024-09-17T07:11:43.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:43.940+0000 7f3abbd5f640 1 -- 172.21.15.87:0/230362212 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ab410cfb0 con 0x7f3ab4065650 2024-09-17T07:11:43.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:43.940+0000 7f3ab27fc640 1 -- 172.21.15.87:0/230362212 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3aa403dc40 con 0x7f3ab4065650 2024-09-17T07:11:43.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:43.940+0000 7f3abbd5f640 1 -- 172.21.15.87:0/230362212 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ab410d420 con 0x7f3ab4065650 2024-09-17T07:11:43.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:43.941+0000 7f3ab27fc640 1 -- 172.21.15.87:0/230362212 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7f3aa402f030 con 0x7f3ab4065650 2024-09-17T07:11:43.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:43.941+0000 7f3abbd5f640 1 -- 172.21.15.87:0/230362212 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ab405ed70 con 0x7f3ab4065650 2024-09-17T07:11:43.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:43.941+0000 7f3ab27fc640 1 --2- 172.21.15.87:0/230362212 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f3a9c0395d0 0x7f3a9c03ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:43.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:43.941+0000 7f3ab27fc640 1 -- 172.21.15.87:0/230362212 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f3aa406ccd0 con 0x7f3ab4065650 2024-09-17T07:11:43.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:43.941+0000 7f3ab92fa640 1 --2- 172.21.15.87:0/230362212 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f3a9c0395d0 0x7f3a9c03ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:43.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:43.942+0000 7f3ab92fa640 1 --2- 172.21.15.87:0/230362212 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f3a9c0395d0 0x7f3a9c03ba80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3aa8006fd0 tx=0x7f3aa8006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:43.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:43.946+0000 7f3ab27fc640 1 -- 172.21.15.87:0/230362212 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f3aa4072020 con 0x7f3ab4065650 2024-09-17T07:11:44.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:44.103+0000 7f3abbd5f640 1 -- 172.21.15.87:0/230362212 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f3ab410d420 con 0x7f3ab4065650 2024-09-17T07:11:44.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:44.106+0000 7f3ab27fc640 1 -- 172.21.15.87:0/230362212 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7f3aa403de60 con 0x7f3ab4065650 2024-09-17T07:11:44.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:44.109+0000 7f3abbd5f640 1 -- 172.21.15.87:0/230362212 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f3a9c0395d0 msgr2=0x7f3a9c03ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:44.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:44.109+0000 7f3abbd5f640 1 --2- 172.21.15.87:0/230362212 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f3a9c0395d0 0x7f3a9c03ba80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3aa8006fd0 tx=0x7f3aa8006db0 comp rx=0 tx=0).stop 2024-09-17T07:11:44.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:44.109+0000 7f3abbd5f640 1 -- 172.21.15.87:0/230362212 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ab4065650 msgr2=0x7f3ab410c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:44.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:44.109+0000 7f3abbd5f640 1 --2- 172.21.15.87:0/230362212 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ab4065650 0x7f3ab410c870 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3aa4003400 tx=0x7f3aa4004d10 comp rx=0 tx=0).stop 2024-09-17T07:11:44.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:44.109+0000 7f3abbd5f640 1 -- 172.21.15.87:0/230362212 shutdown_connections 2024-09-17T07:11:44.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:44.109+0000 7f3abbd5f640 1 --2- 172.21.15.87:0/230362212 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f3a9c0395d0 0x7f3a9c03ba80 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:44.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:44.109+0000 7f3abbd5f640 1 --2- 172.21.15.87:0/230362212 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ab4065650 0x7f3ab410c870 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:44.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:44.109+0000 7f3abbd5f640 1 -- 172.21.15.87:0/230362212 >> 172.21.15.87:0/230362212 conn(0x7f3ab40f6ac0 msgr2=0x7f3ab40f72f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:11:44.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:44.109+0000 7f3abbd5f640 1 -- 172.21.15.87:0/230362212 shutdown_connections 2024-09-17T07:11:44.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:44.109+0000 7f3abbd5f640 1 -- 172.21.15.87:0/230362212 wait complete. 2024-09-17T07:11:44.762 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-17T07:11:44.763 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-17T07:11:45.359 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:45 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/230362212' entity='client.admin' 2024-09-17T07:11:45.435 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/mon.smithi087/config 2024-09-17T07:11:46.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:46 smithi087 ceph-mon[27636]: from='mgr.14160 172.21.15.87:0/3005432640' entity='mgr.smithi087.vuvjer' 2024-09-17T07:11:46.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:46 smithi087 ceph-mon[27636]: from='mgr.14160 172.21.15.87:0/3005432640' entity='mgr.smithi087.vuvjer' 2024-09-17T07:11:46.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:46 smithi087 ceph-mon[27636]: from='mgr.14160 172.21.15.87:0/3005432640' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "who": "osd/host:smithi087", "name": "osd_memory_target"}]: dispatch 2024-09-17T07:11:46.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:46 smithi087 ceph-mon[27636]: from='mgr.14160 172.21.15.87:0/3005432640' entity='mgr.smithi087.vuvjer' 2024-09-17T07:11:46.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:46 smithi087 ceph-mon[27636]: from='mgr.14160 172.21.15.87:0/3005432640' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi087", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-17T07:11:46.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:46 smithi087 ceph-mon[27636]: from='mgr.14160 172.21.15.87:0/3005432640' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi087", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-17T07:11:46.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:46 smithi087 ceph-mon[27636]: from='mgr.14160 172.21.15.87:0/3005432640' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:11:46.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:46 smithi087 ceph-mon[27636]: Deploying daemon crash.smithi087 on smithi087 2024-09-17T07:11:47.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:47.376+0000 7ff75cdbc640 1 -- 172.21.15.87:0/1512214579 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7580fd820 msgr2=0x7ff7580fdc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:47.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:47.376+0000 7ff75cdbc640 1 --2- 172.21.15.87:0/1512214579 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7580fd820 0x7ff7580fdc30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff748004850 tx=0x7ff748009da0 comp rx=0 tx=0).stop 2024-09-17T07:11:47.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:47.376+0000 7ff75cdbc640 1 -- 172.21.15.87:0/1512214579 shutdown_connections 2024-09-17T07:11:47.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:47.376+0000 7ff75cdbc640 1 --2- 172.21.15.87:0/1512214579 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7580fd820 0x7ff7580fdc30 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:47.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:47.376+0000 7ff75cdbc640 1 -- 172.21.15.87:0/1512214579 >> 172.21.15.87:0/1512214579 conn(0x7ff7580f6040 msgr2=0x7ff7580f8450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:11:47.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:47.376+0000 7ff75cdbc640 1 -- 172.21.15.87:0/1512214579 shutdown_connections 2024-09-17T07:11:47.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:47.376+0000 7ff75cdbc640 1 -- 172.21.15.87:0/1512214579 wait complete. 2024-09-17T07:11:47.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:47.376+0000 7ff75cdbc640 1 Processor -- start 2024-09-17T07:11:47.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:47.377+0000 7ff75cdbc640 1 -- start start 2024-09-17T07:11:47.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:47.377+0000 7ff75cdbc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7580fd820 0x7ff75810c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:47.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:47.377+0000 7ff75cdbc640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff75810cb50 con 0x7ff7580fd820 2024-09-17T07:11:47.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:47.377+0000 7ff75659c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7580fd820 0x7ff75810c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:47.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:47.377+0000 7ff75659c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7580fd820 0x7ff75810c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55334/0 (socket says 172.21.15.87:55334) 2024-09-17T07:11:47.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:47.377+0000 7ff75659c640 1 -- 172.21.15.87:0/3612305620 learned_addr learned my addr 172.21.15.87:0/3612305620 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:11:47.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:47.377+0000 7ff75659c640 1 -- 172.21.15.87:0/3612305620 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff748005040 con 0x7ff7580fd820 2024-09-17T07:11:47.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:47.377+0000 7ff75659c640 1 --2- 172.21.15.87:0/3612305620 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7580fd820 0x7ff75810c610 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff74800b020 tx=0x7ff748009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:47.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:47.377+0000 7ff74effd640 1 -- 172.21.15.87:0/3612305620 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff7480096a0 con 0x7ff7580fd820 2024-09-17T07:11:47.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:47.377+0000 7ff74effd640 1 -- 172.21.15.87:0/3612305620 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7ff7480338a0 con 0x7ff7580fd820 2024-09-17T07:11:47.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:47.377+0000 7ff75cdbc640 1 -- 172.21.15.87:0/3612305620 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff75810cd50 con 0x7ff7580fd820 2024-09-17T07:11:47.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:47.377+0000 7ff74effd640 1 -- 172.21.15.87:0/3612305620 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff74803c830 con 0x7ff7580fd820 2024-09-17T07:11:47.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:47.377+0000 7ff75cdbc640 1 -- 172.21.15.87:0/3612305620 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff75810d160 con 0x7ff7580fd820 2024-09-17T07:11:47.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:47.378+0000 7ff74effd640 1 -- 172.21.15.87:0/3612305620 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7ff748030020 con 0x7ff7580fd820 2024-09-17T07:11:47.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:47.378+0000 7ff75cdbc640 1 -- 172.21.15.87:0/3612305620 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff75805ed70 con 0x7ff7580fd820 2024-09-17T07:11:47.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:47.378+0000 7ff74effd640 1 --2- 172.21.15.87:0/3612305620 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7ff7440395d0 0x7ff74403ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:47.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:47.379+0000 7ff74effd640 1 -- 172.21.15.87:0/3612305620 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7ff74806be60 con 0x7ff7580fd820 2024-09-17T07:11:47.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:47.379+0000 7ff74ffff640 1 --2- 172.21.15.87:0/3612305620 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7ff7440395d0 0x7ff74403ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:47.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:47.379+0000 7ff74ffff640 1 --2- 172.21.15.87:0/3612305620 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7ff7440395d0 0x7ff74403ba80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff740006fd0 tx=0x7ff740006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:47.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:47.383+0000 7ff74effd640 1 -- 172.21.15.87:0/3612305620 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ff748033df0 con 0x7ff7580fd820 2024-09-17T07:11:47.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:47.543+0000 7ff75cdbc640 1 -- 172.21.15.87:0/3612305620 --> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7ff758105ab0 con 0x7ff7440395d0 2024-09-17T07:11:47.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:47.546+0000 7ff74effd640 1 -- 172.21.15.87:0/3612305620 <== mgr.14160 v2:172.21.15.87:6800/2341884603 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7ff758105ab0 con 0x7ff7440395d0 2024-09-17T07:11:47.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:47.548+0000 7ff75cdbc640 1 -- 172.21.15.87:0/3612305620 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7ff7440395d0 msgr2=0x7ff74403ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:47.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:47.548+0000 7ff75cdbc640 1 --2- 172.21.15.87:0/3612305620 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7ff7440395d0 0x7ff74403ba80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff740006fd0 tx=0x7ff740006db0 comp rx=0 tx=0).stop 2024-09-17T07:11:47.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:47.548+0000 7ff75cdbc640 1 -- 172.21.15.87:0/3612305620 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7580fd820 msgr2=0x7ff75810c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:47.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:47.548+0000 7ff75cdbc640 1 --2- 172.21.15.87:0/3612305620 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7580fd820 0x7ff75810c610 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff74800b020 tx=0x7ff748009da0 comp rx=0 tx=0).stop 2024-09-17T07:11:47.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:47.548+0000 7ff75cdbc640 1 -- 172.21.15.87:0/3612305620 shutdown_connections 2024-09-17T07:11:47.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:47.548+0000 7ff75cdbc640 1 --2- 172.21.15.87:0/3612305620 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7ff7440395d0 0x7ff74403ba80 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:47.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:47.548+0000 7ff75cdbc640 1 --2- 172.21.15.87:0/3612305620 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7580fd820 0x7ff75810c610 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:47.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:47.548+0000 7ff75cdbc640 1 -- 172.21.15.87:0/3612305620 >> 172.21.15.87:0/3612305620 conn(0x7ff7580f6040 msgr2=0x7ff7580f6c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:11:47.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:47.548+0000 7ff75cdbc640 1 -- 172.21.15.87:0/3612305620 shutdown_connections 2024-09-17T07:11:47.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:47.548+0000 7ff75cdbc640 1 -- 172.21.15.87:0/3612305620 wait complete. 2024-09-17T07:11:48.555 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi139 2024-09-17T07:11:48.555 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-17T07:11:48.556 DEBUG:teuthology.orchestra.run.smithi139:> dd of=/etc/ceph/ceph.conf 2024-09-17T07:11:48.574 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-17T07:11:48.575 DEBUG:teuthology.orchestra.run.smithi139:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-17T07:11:48.633 INFO:tasks.cephadm:Adding host smithi139 to orchestrator... 2024-09-17T07:11:48.633 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -- ceph orch host add smithi139 2024-09-17T07:11:48.869 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:48 smithi087 ceph-mon[27636]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:11:48.869 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:48 smithi087 ceph-mon[27636]: from='mgr.14160 172.21.15.87:0/3005432640' entity='mgr.smithi087.vuvjer' 2024-09-17T07:11:49.107 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/mon.smithi087/config 2024-09-17T07:11:50.248 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:50 smithi087 ceph-mon[27636]: from='mgr.14160 172.21.15.87:0/3005432640' entity='mgr.smithi087.vuvjer' 2024-09-17T07:11:50.248 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:50 smithi087 ceph-mon[27636]: from='mgr.14160 172.21.15.87:0/3005432640' entity='mgr.smithi087.vuvjer' 2024-09-17T07:11:50.248 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:50 smithi087 ceph-mon[27636]: from='mgr.14160 172.21.15.87:0/3005432640' entity='mgr.smithi087.vuvjer' 2024-09-17T07:11:50.248 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:50 smithi087 ceph-mon[27636]: from='mgr.14160 172.21.15.87:0/3005432640' entity='mgr.smithi087.vuvjer' 2024-09-17T07:11:50.248 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:50 smithi087 ceph-mon[27636]: Deploying daemon node-exporter.smithi087 on smithi087 2024-09-17T07:11:50.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:50.403+0000 7f99f96cf640 1 -- 172.21.15.87:0/498765762 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99f40fb0c0 msgr2=0x7f99f40fb4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:50.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:50.403+0000 7f99f96cf640 1 --2- 172.21.15.87:0/498765762 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99f40fb0c0 0x7f99f40fb4d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f99e4004850 tx=0x7f99e4009da0 comp rx=0 tx=0).stop 2024-09-17T07:11:50.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:50.403+0000 7f99f96cf640 1 -- 172.21.15.87:0/498765762 shutdown_connections 2024-09-17T07:11:50.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:50.403+0000 7f99f96cf640 1 --2- 172.21.15.87:0/498765762 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99f40fb0c0 0x7f99f40fb4d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:50.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:50.403+0000 7f99f96cf640 1 -- 172.21.15.87:0/498765762 >> 172.21.15.87:0/498765762 conn(0x7f99f40f6880 msgr2=0x7f99f40f8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:11:50.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:50.403+0000 7f99f96cf640 1 -- 172.21.15.87:0/498765762 shutdown_connections 2024-09-17T07:11:50.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:50.403+0000 7f99f96cf640 1 -- 172.21.15.87:0/498765762 wait complete. 2024-09-17T07:11:50.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:50.404+0000 7f99f96cf640 1 Processor -- start 2024-09-17T07:11:50.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:50.404+0000 7f99f96cf640 1 -- start start 2024-09-17T07:11:50.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:50.404+0000 7f99f96cf640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99f40fb0c0 0x7f99f410b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:50.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:50.404+0000 7f99f96cf640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f410ba80 con 0x7f99f40fb0c0 2024-09-17T07:11:50.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:50.404+0000 7f99f2ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99f40fb0c0 0x7f99f410b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:50.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:50.404+0000 7f99f2ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99f40fb0c0 0x7f99f410b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55362/0 (socket says 172.21.15.87:55362) 2024-09-17T07:11:50.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:50.404+0000 7f99f2ffd640 1 -- 172.21.15.87:0/4212893549 learned_addr learned my addr 172.21.15.87:0/4212893549 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:11:50.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:50.405+0000 7f99f2ffd640 1 -- 172.21.15.87:0/4212893549 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99e4005040 con 0x7f99f40fb0c0 2024-09-17T07:11:50.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:50.405+0000 7f99f2ffd640 1 --2- 172.21.15.87:0/4212893549 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99f40fb0c0 0x7f99f410b540 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f99e400b020 tx=0x7f99e4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:50.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:50.405+0000 7f99ebfff640 1 -- 172.21.15.87:0/4212893549 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f99e40096a0 con 0x7f99f40fb0c0 2024-09-17T07:11:50.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:50.405+0000 7f99f96cf640 1 -- 172.21.15.87:0/4212893549 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99f410bc80 con 0x7f99f40fb0c0 2024-09-17T07:11:50.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:50.405+0000 7f99ebfff640 1 -- 172.21.15.87:0/4212893549 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f99e40338a0 con 0x7f99f40fb0c0 2024-09-17T07:11:50.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:50.405+0000 7f99ebfff640 1 -- 172.21.15.87:0/4212893549 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f99e403c830 con 0x7f99f40fb0c0 2024-09-17T07:11:50.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:50.405+0000 7f99f96cf640 1 -- 172.21.15.87:0/4212893549 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99f410c090 con 0x7f99f40fb0c0 2024-09-17T07:11:50.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:50.406+0000 7f99ebfff640 1 -- 172.21.15.87:0/4212893549 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7f99e4030020 con 0x7f99f40fb0c0 2024-09-17T07:11:50.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:50.406+0000 7f99f96cf640 1 -- 172.21.15.87:0/4212893549 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99f405ed70 con 0x7f99f40fb0c0 2024-09-17T07:11:50.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:50.406+0000 7f99ebfff640 1 --2- 172.21.15.87:0/4212893549 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f99e00395d0 0x7f99e003ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:50.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:50.406+0000 7f99ebfff640 1 -- 172.21.15.87:0/4212893549 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f99e406bee0 con 0x7f99f40fb0c0 2024-09-17T07:11:50.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:50.406+0000 7f99ea7fc640 1 --2- 172.21.15.87:0/4212893549 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f99e00395d0 0x7f99e003ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:50.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:50.407+0000 7f99ea7fc640 1 --2- 172.21.15.87:0/4212893549 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f99e00395d0 0x7f99e003ba80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f99dc006fd0 tx=0x7f99dc006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:50.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:50.411+0000 7f99ebfff640 1 -- 172.21.15.87:0/4212893549 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f99e40302d0 con 0x7f99f40fb0c0 2024-09-17T07:11:50.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:50.592+0000 7f99f96cf640 1 -- 172.21.15.87:0/4212893549 --> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi139", "target": ["mon-mgr", ""]}) v1 -- 0x7f99f41052a0 con 0x7f99e00395d0 2024-09-17T07:11:51.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:51 smithi087 ceph-mon[27636]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi139", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:11:52.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:52 smithi087 ceph-mon[27636]: Deploying cephadm binary to smithi139 2024-09-17T07:11:53.325 INFO:teuthology.orchestra.run.smithi087.stdout:Added host 'smithi139' with addr '172.21.15.139' 2024-09-17T07:11:53.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:53.323+0000 7f99ebfff640 1 -- 172.21.15.87:0/4212893549 <== mgr.14160 v2:172.21.15.87:6800/2341884603 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f99f41052a0 con 0x7f99e00395d0 2024-09-17T07:11:53.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:53.326+0000 7f99f96cf640 1 -- 172.21.15.87:0/4212893549 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f99e00395d0 msgr2=0x7f99e003ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:53.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:53.326+0000 7f99f96cf640 1 --2- 172.21.15.87:0/4212893549 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f99e00395d0 0x7f99e003ba80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f99dc006fd0 tx=0x7f99dc006db0 comp rx=0 tx=0).stop 2024-09-17T07:11:53.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:53.326+0000 7f99f96cf640 1 -- 172.21.15.87:0/4212893549 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99f40fb0c0 msgr2=0x7f99f410b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:53.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:53.326+0000 7f99f96cf640 1 --2- 172.21.15.87:0/4212893549 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99f40fb0c0 0x7f99f410b540 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f99e400b020 tx=0x7f99e4009da0 comp rx=0 tx=0).stop 2024-09-17T07:11:53.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:53.326+0000 7f99f96cf640 1 -- 172.21.15.87:0/4212893549 shutdown_connections 2024-09-17T07:11:53.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:53.326+0000 7f99f96cf640 1 --2- 172.21.15.87:0/4212893549 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f99e00395d0 0x7f99e003ba80 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:53.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:53.326+0000 7f99f96cf640 1 --2- 172.21.15.87:0/4212893549 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99f40fb0c0 0x7f99f410b540 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:53.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:53.326+0000 7f99f96cf640 1 -- 172.21.15.87:0/4212893549 >> 172.21.15.87:0/4212893549 conn(0x7f99f40f6880 msgr2=0x7f99f40f70c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:11:53.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:53.326+0000 7f99f96cf640 1 -- 172.21.15.87:0/4212893549 shutdown_connections 2024-09-17T07:11:53.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:53.326+0000 7f99f96cf640 1 -- 172.21.15.87:0/4212893549 wait complete. 2024-09-17T07:11:53.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:53 smithi087 ceph-mon[27636]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T07:11:53.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:53 smithi087 ceph-mon[27636]: from='mgr.14160 172.21.15.87:0/3005432640' entity='mgr.smithi087.vuvjer' 2024-09-17T07:11:53.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:53 smithi087 ceph-mon[27636]: from='mgr.14160 172.21.15.87:0/3005432640' entity='mgr.smithi087.vuvjer' 2024-09-17T07:11:53.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:53 smithi087 ceph-mon[27636]: from='mgr.14160 172.21.15.87:0/3005432640' entity='mgr.smithi087.vuvjer' 2024-09-17T07:11:53.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:53 smithi087 ceph-mon[27636]: from='mgr.14160 172.21.15.87:0/3005432640' entity='mgr.smithi087.vuvjer' 2024-09-17T07:11:53.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:53 smithi087 ceph-mon[27636]: from='mgr.14160 172.21.15.87:0/3005432640' entity='mgr.smithi087.vuvjer' 2024-09-17T07:11:53.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:53 smithi087 ceph-mon[27636]: from='mgr.14160 172.21.15.87:0/3005432640' entity='mgr.smithi087.vuvjer' 2024-09-17T07:11:54.150 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-17T07:11:54.402 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/mon.smithi087/config 2024-09-17T07:11:54.836 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:54 smithi087 ceph-mon[27636]: Added host smithi139 2024-09-17T07:11:54.836 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:54 smithi087 ceph-mon[27636]: Deploying daemon alertmanager.smithi087 on smithi087 2024-09-17T07:11:55.911 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:55 smithi087 ceph-mon[27636]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T07:11:56.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:56.448+0000 7f1decf4c640 1 -- 172.21.15.87:0/2141006329 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1de80fb0b0 msgr2=0x7f1de80fb4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:56.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:56.448+0000 7f1decf4c640 1 --2- 172.21.15.87:0/2141006329 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1de80fb0b0 0x7f1de80fb4c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1dd8004850 tx=0x7f1dd8009da0 comp rx=0 tx=0).stop 2024-09-17T07:11:56.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:56.448+0000 7f1decf4c640 1 -- 172.21.15.87:0/2141006329 shutdown_connections 2024-09-17T07:11:56.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:56.449+0000 7f1decf4c640 1 --2- 172.21.15.87:0/2141006329 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1de80fb0b0 0x7f1de80fb4c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:56.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:56.449+0000 7f1decf4c640 1 -- 172.21.15.87:0/2141006329 >> 172.21.15.87:0/2141006329 conn(0x7f1de80f6850 msgr2=0x7f1de80f8ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:11:56.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:56.449+0000 7f1decf4c640 1 -- 172.21.15.87:0/2141006329 shutdown_connections 2024-09-17T07:11:56.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:56.449+0000 7f1decf4c640 1 -- 172.21.15.87:0/2141006329 wait complete. 2024-09-17T07:11:56.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:56.449+0000 7f1decf4c640 1 Processor -- start 2024-09-17T07:11:56.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:56.449+0000 7f1decf4c640 1 -- start start 2024-09-17T07:11:56.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:56.449+0000 7f1decf4c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1de80fb0b0 0x7f1de80660a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:56.635 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:11:56.635 INFO:teuthology.orchestra.run.smithi087.stdout:[{"addr": "172.21.15.87", "hostname": "smithi087", "labels": [], "status": ""}, {"addr": "172.21.15.139", "hostname": "smithi139", "labels": [], "status": ""}] 2024-09-17T07:11:56.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:56.449+0000 7f1decf4c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de810f2d0 con 0x7f1de80fb0b0 2024-09-17T07:11:56.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:56.449+0000 7f1de659c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1de80fb0b0 0x7f1de80660a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:56.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:56.449+0000 7f1de659c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1de80fb0b0 0x7f1de80660a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60144/0 (socket says 172.21.15.87:60144) 2024-09-17T07:11:56.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:56.449+0000 7f1de659c640 1 -- 172.21.15.87:0/1099551096 learned_addr learned my addr 172.21.15.87:0/1099551096 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:11:56.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:56.450+0000 7f1de659c640 1 -- 172.21.15.87:0/1099551096 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dd8005040 con 0x7f1de80fb0b0 2024-09-17T07:11:56.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:56.450+0000 7f1de659c640 1 --2- 172.21.15.87:0/1099551096 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1de80fb0b0 0x7f1de80660a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1dd800b020 tx=0x7f1dd8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:56.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:56.450+0000 7f1dd6ffd640 1 -- 172.21.15.87:0/1099551096 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1dd80096a0 con 0x7f1de80fb0b0 2024-09-17T07:11:56.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:56.450+0000 7f1dd6ffd640 1 -- 172.21.15.87:0/1099551096 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f1dd80338a0 con 0x7f1de80fb0b0 2024-09-17T07:11:56.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:56.450+0000 7f1decf4c640 1 -- 172.21.15.87:0/1099551096 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1de810f410 con 0x7f1de80fb0b0 2024-09-17T07:11:56.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:56.450+0000 7f1dd6ffd640 1 -- 172.21.15.87:0/1099551096 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1dd803c830 con 0x7f1de80fb0b0 2024-09-17T07:11:56.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:56.450+0000 7f1decf4c640 1 -- 172.21.15.87:0/1099551096 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1de810f820 con 0x7f1de80fb0b0 2024-09-17T07:11:56.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:56.451+0000 7f1dd6ffd640 1 -- 172.21.15.87:0/1099551096 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7f1dd8030020 con 0x7f1de80fb0b0 2024-09-17T07:11:56.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:56.451+0000 7f1dd6ffd640 1 --2- 172.21.15.87:0/1099551096 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f1dd00395d0 0x7f1dd003ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:11:56.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:56.451+0000 7f1decf4c640 1 -- 172.21.15.87:0/1099551096 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1de805ed70 con 0x7f1de80fb0b0 2024-09-17T07:11:56.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:56.451+0000 7f1dd6ffd640 1 -- 172.21.15.87:0/1099551096 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f1dd806be20 con 0x7f1de80fb0b0 2024-09-17T07:11:56.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:56.451+0000 7f1de5d9b640 1 --2- 172.21.15.87:0/1099551096 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f1dd00395d0 0x7f1dd003ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:11:56.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:56.451+0000 7f1de5d9b640 1 --2- 172.21.15.87:0/1099551096 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f1dd00395d0 0x7f1dd003ba80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc006fd0 tx=0x7f1ddc006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:11:56.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:56.455+0000 7f1dd6ffd640 1 -- 172.21.15.87:0/1099551096 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f1dd8070070 con 0x7f1de80fb0b0 2024-09-17T07:11:56.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:56.616+0000 7f1decf4c640 1 -- 172.21.15.87:0/1099551096 --> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1de805db50 con 0x7f1dd00395d0 2024-09-17T07:11:56.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:56.617+0000 7f1dd6ffd640 1 -- 172.21.15.87:0/1099551096 <== mgr.14160 v2:172.21.15.87:6800/2341884603 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+160 (secure 0 0 0) 0x7f1de805db50 con 0x7f1dd00395d0 2024-09-17T07:11:56.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:56.619+0000 7f1decf4c640 1 -- 172.21.15.87:0/1099551096 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f1dd00395d0 msgr2=0x7f1dd003ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:56.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:56.619+0000 7f1decf4c640 1 --2- 172.21.15.87:0/1099551096 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f1dd00395d0 0x7f1dd003ba80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc006fd0 tx=0x7f1ddc006db0 comp rx=0 tx=0).stop 2024-09-17T07:11:56.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:56.619+0000 7f1decf4c640 1 -- 172.21.15.87:0/1099551096 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1de80fb0b0 msgr2=0x7f1de80660a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:11:56.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:56.619+0000 7f1decf4c640 1 --2- 172.21.15.87:0/1099551096 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1de80fb0b0 0x7f1de80660a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1dd800b020 tx=0x7f1dd8009da0 comp rx=0 tx=0).stop 2024-09-17T07:11:56.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:56.619+0000 7f1decf4c640 1 -- 172.21.15.87:0/1099551096 shutdown_connections 2024-09-17T07:11:56.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:56.619+0000 7f1decf4c640 1 --2- 172.21.15.87:0/1099551096 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f1dd00395d0 0x7f1dd003ba80 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:56.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:56.619+0000 7f1decf4c640 1 --2- 172.21.15.87:0/1099551096 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1de80fb0b0 0x7f1de80660a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:11:56.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:56.619+0000 7f1decf4c640 1 -- 172.21.15.87:0/1099551096 >> 172.21.15.87:0/1099551096 conn(0x7f1de80f6850 msgr2=0x7f1de80f7150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:11:56.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:56.619+0000 7f1decf4c640 1 -- 172.21.15.87:0/1099551096 shutdown_connections 2024-09-17T07:11:56.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:11:56.619+0000 7f1decf4c640 1 -- 172.21.15.87:0/1099551096 wait complete. 2024-09-17T07:11:57.872 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-17T07:11:57.873 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -- ceph osd crush tunables default 2024-09-17T07:11:57.893 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:57 smithi087 ceph-mon[27636]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T07:11:57.893 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:57 smithi087 ceph-mon[27636]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-17T07:11:58.575 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/mon.smithi087/config 2024-09-17T07:11:58.897 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:58 smithi087 ceph-mon[27636]: from='mgr.14160 172.21.15.87:0/3005432640' entity='mgr.smithi087.vuvjer' 2024-09-17T07:11:59.858 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:11:59 smithi087 ceph-mon[27636]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T07:12:01.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:01 smithi087 ceph-mon[27636]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T07:12:02.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:12:02.915+0000 7fed61bee640 1 -- 172.21.15.87:0/3019917961 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed5c0fb2e0 msgr2=0x7fed5c0fb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:12:02.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:12:02.915+0000 7fed61bee640 1 --2- 172.21.15.87:0/3019917961 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed5c0fb2e0 0x7fed5c0fb6f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fed4c004850 tx=0x7fed4c009da0 comp rx=0 tx=0).stop 2024-09-17T07:12:02.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:12:02.916+0000 7fed61bee640 1 -- 172.21.15.87:0/3019917961 shutdown_connections 2024-09-17T07:12:02.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:12:02.916+0000 7fed61bee640 1 --2- 172.21.15.87:0/3019917961 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed5c0fb2e0 0x7fed5c0fb6f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:12:02.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:12:02.916+0000 7fed61bee640 1 -- 172.21.15.87:0/3019917961 >> 172.21.15.87:0/3019917961 conn(0x7fed5c0f6ac0 msgr2=0x7fed5c0f8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:12:02.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:12:02.916+0000 7fed61bee640 1 -- 172.21.15.87:0/3019917961 shutdown_connections 2024-09-17T07:12:02.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:12:02.916+0000 7fed61bee640 1 -- 172.21.15.87:0/3019917961 wait complete. 2024-09-17T07:12:02.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:12:02.917+0000 7fed61bee640 1 Processor -- start 2024-09-17T07:12:02.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:12:02.917+0000 7fed61bee640 1 -- start start 2024-09-17T07:12:02.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:12:02.917+0000 7fed61bee640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed5c0fb2e0 0x7fed5c0654d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:12:02.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:12:02.917+0000 7fed61bee640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed5c10f590 con 0x7fed5c0fb2e0 2024-09-17T07:12:02.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:12:02.917+0000 7fed5b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed5c0fb2e0 0x7fed5c0654d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:12:02.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:12:02.917+0000 7fed5b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed5c0fb2e0 0x7fed5c0654d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60152/0 (socket says 172.21.15.87:60152) 2024-09-17T07:12:02.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:12:02.917+0000 7fed5b7fe640 1 -- 172.21.15.87:0/1887917764 learned_addr learned my addr 172.21.15.87:0/1887917764 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:12:02.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:12:02.917+0000 7fed5b7fe640 1 -- 172.21.15.87:0/1887917764 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed4c005040 con 0x7fed5c0fb2e0 2024-09-17T07:12:02.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:12:02.918+0000 7fed5b7fe640 1 --2- 172.21.15.87:0/1887917764 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed5c0fb2e0 0x7fed5c0654d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fed4c004820 tx=0x7fed4c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:12:02.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:12:02.918+0000 7fed43fff640 1 -- 172.21.15.87:0/1887917764 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fed4c0096c0 con 0x7fed5c0fb2e0 2024-09-17T07:12:02.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:12:02.918+0000 7fed43fff640 1 -- 172.21.15.87:0/1887917764 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fed4c03d8a0 con 0x7fed5c0fb2e0 2024-09-17T07:12:02.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:12:02.918+0000 7fed61bee640 1 -- 172.21.15.87:0/1887917764 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed5c10f6d0 con 0x7fed5c0fb2e0 2024-09-17T07:12:02.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:12:02.918+0000 7fed43fff640 1 -- 172.21.15.87:0/1887917764 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fed4c0338b0 con 0x7fed5c0fb2e0 2024-09-17T07:12:02.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:12:02.918+0000 7fed61bee640 1 -- 172.21.15.87:0/1887917764 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed5c10fb40 con 0x7fed5c0fb2e0 2024-09-17T07:12:02.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:12:02.918+0000 7fed43fff640 1 -- 172.21.15.87:0/1887917764 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7fed4c030020 con 0x7fed5c0fb2e0 2024-09-17T07:12:02.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:12:02.919+0000 7fed43fff640 1 --2- 172.21.15.87:0/1887917764 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7fed44039580 0x7fed4403ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:12:02.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:12:02.919+0000 7fed43fff640 1 -- 172.21.15.87:0/1887917764 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fed4c06d7d0 con 0x7fed5c0fb2e0 2024-09-17T07:12:02.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:12:02.919+0000 7fed5affd640 1 --2- 172.21.15.87:0/1887917764 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7fed44039580 0x7fed4403ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:12:02.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:12:02.919+0000 7fed61bee640 1 -- 172.21.15.87:0/1887917764 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed5c1015c0 con 0x7fed5c0fb2e0 2024-09-17T07:12:02.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:12:02.919+0000 7fed5affd640 1 --2- 172.21.15.87:0/1887917764 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7fed44039580 0x7fed4403ba30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fed50006fd0 tx=0x7fed50006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:12:02.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:12:02.923+0000 7fed43fff640 1 -- 172.21.15.87:0/1887917764 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fed4c033a10 con 0x7fed5c0fb2e0 2024-09-17T07:12:03.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:12:03.094+0000 7fed61bee640 1 -- 172.21.15.87:0/1887917764 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fed5c05ed70 con 0x7fed5c0fb2e0 2024-09-17T07:12:03.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:12:03.660+0000 7fed43fff640 1 -- 172.21.15.87:0/1887917764 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7fed4c042210 con 0x7fed5c0fb2e0 2024-09-17T07:12:03.662 INFO:teuthology.orchestra.run.smithi087.stderr:adjusted tunables profile to default 2024-09-17T07:12:03.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:12:03.662+0000 7fed61bee640 1 -- 172.21.15.87:0/1887917764 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7fed44039580 msgr2=0x7fed4403ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:12:03.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:12:03.662+0000 7fed61bee640 1 --2- 172.21.15.87:0/1887917764 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7fed44039580 0x7fed4403ba30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fed50006fd0 tx=0x7fed50006db0 comp rx=0 tx=0).stop 2024-09-17T07:12:03.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:12:03.662+0000 7fed61bee640 1 -- 172.21.15.87:0/1887917764 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed5c0fb2e0 msgr2=0x7fed5c0654d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:12:03.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:12:03.662+0000 7fed61bee640 1 --2- 172.21.15.87:0/1887917764 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed5c0fb2e0 0x7fed5c0654d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fed4c004820 tx=0x7fed4c009da0 comp rx=0 tx=0).stop 2024-09-17T07:12:03.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:12:03.662+0000 7fed61bee640 1 -- 172.21.15.87:0/1887917764 shutdown_connections 2024-09-17T07:12:03.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:12:03.662+0000 7fed61bee640 1 --2- 172.21.15.87:0/1887917764 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7fed44039580 0x7fed4403ba30 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:12:03.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:12:03.662+0000 7fed61bee640 1 --2- 172.21.15.87:0/1887917764 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed5c0fb2e0 0x7fed5c0654d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:12:03.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:12:03.662+0000 7fed61bee640 1 -- 172.21.15.87:0/1887917764 >> 172.21.15.87:0/1887917764 conn(0x7fed5c0f6ac0 msgr2=0x7fed5c0f7350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:12:03.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:12:03.662+0000 7fed61bee640 1 -- 172.21.15.87:0/1887917764 shutdown_connections 2024-09-17T07:12:03.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:12:03.662+0000 7fed61bee640 1 -- 172.21.15.87:0/1887917764 wait complete. 2024-09-17T07:12:03.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:03 smithi087 ceph-mon[27636]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T07:12:03.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:03 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/1887917764' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-17T07:12:04.276 INFO:tasks.cephadm:Adding mon.smithi087 on smithi087 2024-09-17T07:12:04.276 INFO:tasks.cephadm:Adding mon.smithi139 on smithi139 2024-09-17T07:12:04.276 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -- ceph orch apply mon '2;smithi087:172.21.15.87=smithi087;smithi139:172.21.15.139=smithi139' 2024-09-17T07:12:04.516 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T07:12:04.572 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T07:12:04.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:04 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/1887917764' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-17T07:12:04.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:04 smithi087 ceph-mon[27636]: osdmap e4: 0 total, 0 up, 0 in 2024-09-17T07:12:04.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:04 smithi087 ceph-mon[27636]: from='mgr.14160 172.21.15.87:0/3005432640' entity='mgr.smithi087.vuvjer' 2024-09-17T07:12:04.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:04 smithi087 ceph-mon[27636]: from='mgr.14160 172.21.15.87:0/3005432640' entity='mgr.smithi087.vuvjer' 2024-09-17T07:12:04.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:04 smithi087 ceph-mon[27636]: from='mgr.14160 172.21.15.87:0/3005432640' entity='mgr.smithi087.vuvjer' 2024-09-17T07:12:04.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:04 smithi087 ceph-mon[27636]: from='mgr.14160 172.21.15.87:0/3005432640' entity='mgr.smithi087.vuvjer' 2024-09-17T07:12:04.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:04 smithi087 ceph-mon[27636]: from='mgr.14160 172.21.15.87:0/3005432640' entity='mgr.smithi087.vuvjer' 2024-09-17T07:12:04.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:04 smithi087 ceph-mon[27636]: from='mgr.14160 172.21.15.87:0/3005432640' entity='mgr.smithi087.vuvjer' 2024-09-17T07:12:04.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:04 smithi087 ceph-mon[27636]: from='mgr.14160 172.21.15.87:0/3005432640' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-17T07:12:04.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:04 smithi087 ceph-mon[27636]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-17T07:12:04.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:04 smithi087 ceph-mon[27636]: from='mgr.14160 172.21.15.87:0/3005432640' entity='mgr.smithi087.vuvjer' 2024-09-17T07:12:04.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:04 smithi087 ceph-mon[27636]: Deploying daemon grafana.smithi087 on smithi087 2024-09-17T07:12:05.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:05 smithi087 ceph-mon[27636]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T07:12:06.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:06.060+0000 7fbdbe215640 1 -- 172.21.15.139:0/726919858 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbdb80fd820 msgr2=0x7fbdb80fdc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:12:06.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:06.060+0000 7fbdbe215640 1 --2- 172.21.15.139:0/726919858 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbdb80fd820 0x7fbdb80fdc30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbda8009bd0 tx=0x7fbda8004d10 comp rx=0 tx=0).stop 2024-09-17T07:12:06.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:06.061+0000 7fbdbe215640 1 -- 172.21.15.139:0/726919858 shutdown_connections 2024-09-17T07:12:06.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:06.061+0000 7fbdbe215640 1 --2- 172.21.15.139:0/726919858 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbdb80fd820 0x7fbdb80fdc30 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:12:06.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:06.061+0000 7fbdbe215640 1 -- 172.21.15.139:0/726919858 >> 172.21.15.139:0/726919858 conn(0x7fbdb80f6040 msgr2=0x7fbdb80f8450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:12:06.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:06.061+0000 7fbdbe215640 1 -- 172.21.15.139:0/726919858 shutdown_connections 2024-09-17T07:12:06.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:06.061+0000 7fbdbe215640 1 -- 172.21.15.139:0/726919858 wait complete. 2024-09-17T07:12:06.065 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:06.061+0000 7fbdbe215640 1 Processor -- start 2024-09-17T07:12:06.065 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:06.061+0000 7fbdbe215640 1 -- start start 2024-09-17T07:12:06.065 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:06.061+0000 7fbdbe215640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbdb80fd820 0x7fbdb80fcf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:12:06.065 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:06.061+0000 7fbdbe215640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb80fd470 con 0x7fbdb80fd820 2024-09-17T07:12:06.065 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:06.062+0000 7fbdb77fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbdb80fd820 0x7fbdb80fcf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:12:06.065 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:06.062+0000 7fbdb77fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbdb80fd820 0x7fbdb80fcf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.139:47416/0 (socket says 172.21.15.139:47416) 2024-09-17T07:12:06.065 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:06.062+0000 7fbdb77fe640 1 -- 172.21.15.139:0/1532465597 learned_addr learned my addr 172.21.15.139:0/1532465597 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-17T07:12:06.065 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:06.062+0000 7fbdb77fe640 1 -- 172.21.15.139:0/1532465597 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda80098b0 con 0x7fbdb80fd820 2024-09-17T07:12:06.065 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:06.062+0000 7fbdb77fe640 1 --2- 172.21.15.139:0/1532465597 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbdb80fd820 0x7fbdb80fcf30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fbda8009880 tx=0x7fbda8004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:12:06.065 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:06.062+0000 7fbd9ffff640 1 -- 172.21.15.139:0/1532465597 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbda8032900 con 0x7fbdb80fd820 2024-09-17T07:12:06.065 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:06.062+0000 7fbd9ffff640 1 -- 172.21.15.139:0/1532465597 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fbda803d420 con 0x7fbdb80fd820 2024-09-17T07:12:06.065 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:06.062+0000 7fbd9ffff640 1 -- 172.21.15.139:0/1532465597 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbda80313d0 con 0x7fbdb80fd820 2024-09-17T07:12:06.066 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:06.062+0000 7fbdbe215640 1 -- 172.21.15.139:0/1532465597 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdb80fb500 con 0x7fbdb80fd820 2024-09-17T07:12:06.066 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:06.062+0000 7fbdbe215640 1 -- 172.21.15.139:0/1532465597 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdb80fb970 con 0x7fbdb80fd820 2024-09-17T07:12:06.067 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:06.063+0000 7fbd9ffff640 1 -- 172.21.15.139:0/1532465597 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7fbda802f030 con 0x7fbdb80fd820 2024-09-17T07:12:06.067 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:06.063+0000 7fbdbe215640 1 -- 172.21.15.139:0/1532465597 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdb81024c0 con 0x7fbdb80fd820 2024-09-17T07:12:06.067 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:06.063+0000 7fbd9ffff640 1 --2- 172.21.15.139:0/1532465597 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7fbda0039580 0x7fbda003ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:12:06.067 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:06.064+0000 7fbd9ffff640 1 -- 172.21.15.139:0/1532465597 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fbda806d6d0 con 0x7fbdb80fd820 2024-09-17T07:12:06.067 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:06.064+0000 7fbdb6ffd640 1 --2- 172.21.15.139:0/1532465597 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7fbda0039580 0x7fbda003ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:12:06.067 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:06.064+0000 7fbdb6ffd640 1 --2- 172.21.15.139:0/1532465597 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7fbda0039580 0x7fbda003ba30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fbdac006fd0 tx=0x7fbdac006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:12:06.069 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:06.068+0000 7fbd9ffff640 1 -- 172.21.15.139:0/1532465597 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fbda8030df0 con 0x7fbdb80fd820 2024-09-17T07:12:06.233 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:06.232+0000 7fbdbe215640 1 -- 172.21.15.139:0/1532465597 --> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi087:172.21.15.87=smithi087;smithi139:172.21.15.139=smithi139", "target": ["mon-mgr", ""]}) v1 -- 0x7fbdb80fbc60 con 0x7fbda0039580 2024-09-17T07:12:06.241 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:06.240+0000 7fbd9ffff640 1 -- 172.21.15.139:0/1532465597 <== mgr.14160 v2:172.21.15.87:6800/2341884603 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fbdb80fbc60 con 0x7fbda0039580 2024-09-17T07:12:06.241 INFO:teuthology.orchestra.run.smithi139.stdout:Scheduled mon update... 2024-09-17T07:12:06.243 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:06.242+0000 7fbdbe215640 1 -- 172.21.15.139:0/1532465597 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7fbda0039580 msgr2=0x7fbda003ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:12:06.243 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:06.242+0000 7fbdbe215640 1 --2- 172.21.15.139:0/1532465597 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7fbda0039580 0x7fbda003ba30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fbdac006fd0 tx=0x7fbdac006db0 comp rx=0 tx=0).stop 2024-09-17T07:12:06.244 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:06.242+0000 7fbdbe215640 1 -- 172.21.15.139:0/1532465597 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbdb80fd820 msgr2=0x7fbdb80fcf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:12:06.244 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:06.242+0000 7fbdbe215640 1 --2- 172.21.15.139:0/1532465597 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbdb80fd820 0x7fbdb80fcf30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fbda8009880 tx=0x7fbda8004d10 comp rx=0 tx=0).stop 2024-09-17T07:12:06.244 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:06.242+0000 7fbdbe215640 1 -- 172.21.15.139:0/1532465597 shutdown_connections 2024-09-17T07:12:06.244 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:06.242+0000 7fbdbe215640 1 --2- 172.21.15.139:0/1532465597 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7fbda0039580 0x7fbda003ba30 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:12:06.244 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:06.242+0000 7fbdbe215640 1 --2- 172.21.15.139:0/1532465597 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbdb80fd820 0x7fbdb80fcf30 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:12:06.244 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:06.242+0000 7fbdbe215640 1 -- 172.21.15.139:0/1532465597 >> 172.21.15.139:0/1532465597 conn(0x7fbdb80f6040 msgr2=0x7fbdb80f6c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:12:06.244 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:06.242+0000 7fbdbe215640 1 -- 172.21.15.139:0/1532465597 shutdown_connections 2024-09-17T07:12:06.244 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:06.242+0000 7fbdbe215640 1 -- 172.21.15.139:0/1532465597 wait complete. 2024-09-17T07:12:06.750 DEBUG:teuthology.orchestra.run.smithi139:mon.smithi139> sudo journalctl -f -n 0 -u ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968@mon.smithi139.service 2024-09-17T07:12:06.752 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T07:12:06.753 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T07:12:07.018 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T07:12:07.062 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T07:12:07.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:07 smithi087 ceph-mon[27636]: from='client.14192 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi087:172.21.15.87=smithi087;smithi139:172.21.15.139=smithi139", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:12:07.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:07 smithi087 ceph-mon[27636]: Saving service mon spec with placement smithi087:172.21.15.87=smithi087;smithi139:172.21.15.139=smithi139;count:2 2024-09-17T07:12:07.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:07 smithi087 ceph-mon[27636]: from='mgr.14160 172.21.15.87:0/3005432640' entity='mgr.smithi087.vuvjer' 2024-09-17T07:12:07.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:07 smithi087 ceph-mon[27636]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T07:12:08.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:08.470+0000 7feb050d3640 1 -- 172.21.15.139:0/1166930842 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb00065e80 msgr2=0x7feb000fee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:12:08.472 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:08.470+0000 7feb050d3640 1 --2- 172.21.15.139:0/1166930842 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb00065e80 0x7feb000fee30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7feaf0004850 tx=0x7feaf0009da0 comp rx=0 tx=0).stop 2024-09-17T07:12:08.472 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:08.470+0000 7feb050d3640 1 -- 172.21.15.139:0/1166930842 shutdown_connections 2024-09-17T07:12:08.472 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:08.470+0000 7feb050d3640 1 --2- 172.21.15.139:0/1166930842 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb00065e80 0x7feb000fee30 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:12:08.472 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:08.470+0000 7feb050d3640 1 -- 172.21.15.139:0/1166930842 >> 172.21.15.139:0/1166930842 conn(0x7feb000f6880 msgr2=0x7feb000f8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:12:08.472 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:08.470+0000 7feb050d3640 1 -- 172.21.15.139:0/1166930842 shutdown_connections 2024-09-17T07:12:08.472 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:08.470+0000 7feb050d3640 1 -- 172.21.15.139:0/1166930842 wait complete. 2024-09-17T07:12:08.475 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:08.471+0000 7feb050d3640 1 Processor -- start 2024-09-17T07:12:08.475 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:08.471+0000 7feb050d3640 1 -- start start 2024-09-17T07:12:08.475 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:08.471+0000 7feb050d3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb00065e80 0x7feb0010c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:12:08.475 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:08.471+0000 7feb050d3640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb0010cc20 con 0x7feb00065e80 2024-09-17T07:12:08.476 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:08.471+0000 7feafed9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb00065e80 0x7feb0010c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:12:08.476 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:08.471+0000 7feafed9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb00065e80 0x7feb0010c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.139:46562/0 (socket says 172.21.15.139:46562) 2024-09-17T07:12:08.476 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:08.471+0000 7feafed9d640 1 -- 172.21.15.139:0/2872303982 learned_addr learned my addr 172.21.15.139:0/2872303982 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-17T07:12:08.476 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:08.472+0000 7feafed9d640 1 -- 172.21.15.139:0/2872303982 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaf0005040 con 0x7feb00065e80 2024-09-17T07:12:08.477 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:08.472+0000 7feafed9d640 1 --2- 172.21.15.139:0/2872303982 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb00065e80 0x7feb0010c6e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7feaf002a670 tx=0x7feaf0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:12:08.477 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:08.472+0000 7feae77fe640 1 -- 172.21.15.139:0/2872303982 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feaf0008e90 con 0x7feb00065e80 2024-09-17T07:12:08.477 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:08.472+0000 7feb050d3640 1 -- 172.21.15.139:0/2872303982 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb0010ce20 con 0x7feb00065e80 2024-09-17T07:12:08.477 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:08.472+0000 7feae77fe640 1 -- 172.21.15.139:0/2872303982 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7feaf003d8a0 con 0x7feb00065e80 2024-09-17T07:12:08.477 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:08.472+0000 7feb050d3640 1 -- 172.21.15.139:0/2872303982 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb0010d290 con 0x7feb00065e80 2024-09-17T07:12:08.477 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:08.472+0000 7feae77fe640 1 -- 172.21.15.139:0/2872303982 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feaf0033860 con 0x7feb00065e80 2024-09-17T07:12:08.477 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:08.473+0000 7feb050d3640 1 -- 172.21.15.139:0/2872303982 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb0005ed70 con 0x7feb00065e80 2024-09-17T07:12:08.477 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:08.473+0000 7feae77fe640 1 -- 172.21.15.139:0/2872303982 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7feaf0030020 con 0x7feb00065e80 2024-09-17T07:12:08.477 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:08.473+0000 7feae77fe640 1 --2- 172.21.15.139:0/2872303982 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7feae8039580 0x7feae803ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:12:08.478 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:08.473+0000 7feae77fe640 1 -- 172.21.15.139:0/2872303982 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7feaf006c650 con 0x7feb00065e80 2024-09-17T07:12:08.478 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:08.474+0000 7feafe59c640 1 --2- 172.21.15.139:0/2872303982 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7feae8039580 0x7feae803ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:12:08.478 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:08.474+0000 7feafe59c640 1 --2- 172.21.15.139:0/2872303982 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7feae8039580 0x7feae803ba30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7feaf4006fd0 tx=0x7feaf4006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:12:08.481 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:08.480+0000 7feae77fe640 1 -- 172.21.15.139:0/2872303982 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7feaf0045390 con 0x7feb00065e80 2024-09-17T07:12:08.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:08.692+0000 7feb050d3640 1 -- 172.21.15.139:0/2872303982 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7feb0004b720 con 0x7feb00065e80 2024-09-17T07:12:08.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:08.692+0000 7feae77fe640 1 -- 172.21.15.139:0/2872303982 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7feaf0045390 con 0x7feb00065e80 2024-09-17T07:12:08.694 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:12:08.694 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":1,"fsid":"d5dbf8d6-74c3-11ef-bceb-c7b262605968","modified":"2024-09-17T07:10:32.618802Z","created":"2024-09-17T07:10:32.618802Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi087","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:3300","nonce":0},{"type":"v1","addr":"172.21.15.87:6789","nonce":0}]},"addr":"172.21.15.87:6789/0","public_addr":"172.21.15.87:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T07:12:08.694 INFO:teuthology.orchestra.run.smithi139.stderr:dumped monmap epoch 1 2024-09-17T07:12:08.695 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:08.694+0000 7feb050d3640 1 -- 172.21.15.139:0/2872303982 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7feae8039580 msgr2=0x7feae803ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:12:08.695 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:08.694+0000 7feb050d3640 1 --2- 172.21.15.139:0/2872303982 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7feae8039580 0x7feae803ba30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7feaf4006fd0 tx=0x7feaf4006db0 comp rx=0 tx=0).stop 2024-09-17T07:12:08.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:08.694+0000 7feb050d3640 1 -- 172.21.15.139:0/2872303982 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb00065e80 msgr2=0x7feb0010c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:12:08.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:08.694+0000 7feb050d3640 1 --2- 172.21.15.139:0/2872303982 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb00065e80 0x7feb0010c6e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7feaf002a670 tx=0x7feaf0009da0 comp rx=0 tx=0).stop 2024-09-17T07:12:08.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:08.694+0000 7feb050d3640 1 -- 172.21.15.139:0/2872303982 shutdown_connections 2024-09-17T07:12:08.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:08.694+0000 7feb050d3640 1 --2- 172.21.15.139:0/2872303982 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7feae8039580 0x7feae803ba30 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:12:08.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:08.694+0000 7feb050d3640 1 --2- 172.21.15.139:0/2872303982 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb00065e80 0x7feb0010c6e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:12:08.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:08.694+0000 7feb050d3640 1 -- 172.21.15.139:0/2872303982 >> 172.21.15.139:0/2872303982 conn(0x7feb000f6880 msgr2=0x7feb000f7140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:12:08.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:08.694+0000 7feb050d3640 1 -- 172.21.15.139:0/2872303982 shutdown_connections 2024-09-17T07:12:08.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:08.694+0000 7feb050d3640 1 -- 172.21.15.139:0/2872303982 wait complete. 2024-09-17T07:12:08.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:08 smithi087 ceph-mon[27636]: from='mgr.14160 172.21.15.87:0/3005432640' entity='mgr.smithi087.vuvjer' 2024-09-17T07:12:09.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:09 smithi087 ceph-mon[27636]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T07:12:09.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:09 smithi087 ceph-mon[27636]: from='client.? 172.21.15.139:0/2872303982' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T07:12:10.255 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T07:12:10.256 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T07:12:10.495 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T07:12:10.539 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T07:12:11.846 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:11.830+0000 7effb63f6640 1 -- 172.21.15.139:0/1444384109 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7effb00fd8d0 msgr2=0x7effb00fdce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:12:11.847 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:11.830+0000 7effb63f6640 1 --2- 172.21.15.139:0/1444384109 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7effb00fd8d0 0x7effb00fdce0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7effa0004850 tx=0x7effa0009da0 comp rx=0 tx=0).stop 2024-09-17T07:12:11.847 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:11.830+0000 7effb63f6640 1 -- 172.21.15.139:0/1444384109 shutdown_connections 2024-09-17T07:12:11.847 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:11.830+0000 7effb63f6640 1 --2- 172.21.15.139:0/1444384109 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7effb00fd8d0 0x7effb00fdce0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:12:11.847 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:11.830+0000 7effb63f6640 1 -- 172.21.15.139:0/1444384109 >> 172.21.15.139:0/1444384109 conn(0x7effb00f6010 msgr2=0x7effb00f8440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:12:11.847 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:11.830+0000 7effb63f6640 1 -- 172.21.15.139:0/1444384109 shutdown_connections 2024-09-17T07:12:11.847 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:11.830+0000 7effb63f6640 1 -- 172.21.15.139:0/1444384109 wait complete. 2024-09-17T07:12:11.847 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:11.831+0000 7effb63f6640 1 Processor -- start 2024-09-17T07:12:11.847 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:11.831+0000 7effb63f6640 1 -- start start 2024-09-17T07:12:11.847 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:11.831+0000 7effb63f6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7effb00fd8d0 0x7effb010c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:12:11.847 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:11.831+0000 7effb63f6640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb010cbf0 con 0x7effb00fd8d0 2024-09-17T07:12:11.847 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:11.831+0000 7effaffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7effb00fd8d0 0x7effb010c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:12:11.847 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:11.831+0000 7effaffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7effb00fd8d0 0x7effb010c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.139:46574/0 (socket says 172.21.15.139:46574) 2024-09-17T07:12:11.848 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:11.831+0000 7effaffff640 1 -- 172.21.15.139:0/1118192724 learned_addr learned my addr 172.21.15.139:0/1118192724 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-17T07:12:11.848 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:11.832+0000 7effaffff640 1 -- 172.21.15.139:0/1118192724 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa0005040 con 0x7effb00fd8d0 2024-09-17T07:12:11.848 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:11.832+0000 7effaffff640 1 --2- 172.21.15.139:0/1118192724 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7effb00fd8d0 0x7effb010c6b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7effa0004820 tx=0x7effa0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:12:11.848 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:11.832+0000 7effacff9640 1 -- 172.21.15.139:0/1118192724 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7effa00095d0 con 0x7effb00fd8d0 2024-09-17T07:12:11.848 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:11.832+0000 7effacff9640 1 -- 172.21.15.139:0/1118192724 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7effa0009730 con 0x7effb00fd8d0 2024-09-17T07:12:11.848 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:11.832+0000 7effb63f6640 1 -- 172.21.15.139:0/1118192724 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effb010cdf0 con 0x7effb00fd8d0 2024-09-17T07:12:11.848 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:11.832+0000 7effacff9640 1 -- 172.21.15.139:0/1118192724 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7effa0033780 con 0x7effb00fd8d0 2024-09-17T07:12:11.848 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:11.832+0000 7effb63f6640 1 -- 172.21.15.139:0/1118192724 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effb010d980 con 0x7effb00fd8d0 2024-09-17T07:12:11.848 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:11.833+0000 7effacff9640 1 -- 172.21.15.139:0/1118192724 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7effa0030020 con 0x7effb00fd8d0 2024-09-17T07:12:11.848 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:11.833+0000 7effacff9640 1 --2- 172.21.15.139:0/1118192724 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7eff98039580 0x7eff9803ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:12:11.848 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:11.833+0000 7effacff9640 1 -- 172.21.15.139:0/1118192724 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7effa006c880 con 0x7effb00fd8d0 2024-09-17T07:12:11.848 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:11.833+0000 7effb63f6640 1 -- 172.21.15.139:0/1118192724 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effb01024c0 con 0x7effb00fd8d0 2024-09-17T07:12:11.848 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:11.833+0000 7effaf7fe640 1 --2- 172.21.15.139:0/1118192724 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7eff98039580 0x7eff9803ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:12:11.849 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:11.834+0000 7effaf7fe640 1 --2- 172.21.15.139:0/1118192724 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7eff98039580 0x7eff9803ba30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7effa4006fd0 tx=0x7effa4006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:12:11.849 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:11.838+0000 7effacff9640 1 -- 172.21.15.139:0/1118192724 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7effa003b970 con 0x7effb00fd8d0 2024-09-17T07:12:11.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:11 smithi087 ceph-mon[27636]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T07:12:12.054 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:12.053+0000 7effb63f6640 1 -- 172.21.15.139:0/1118192724 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7effb004b720 con 0x7effb00fd8d0 2024-09-17T07:12:12.054 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:12.053+0000 7effacff9640 1 -- 172.21.15.139:0/1118192724 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7effa0069020 con 0x7effb00fd8d0 2024-09-17T07:12:12.055 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:12:12.055 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":1,"fsid":"d5dbf8d6-74c3-11ef-bceb-c7b262605968","modified":"2024-09-17T07:10:32.618802Z","created":"2024-09-17T07:10:32.618802Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi087","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:3300","nonce":0},{"type":"v1","addr":"172.21.15.87:6789","nonce":0}]},"addr":"172.21.15.87:6789/0","public_addr":"172.21.15.87:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T07:12:12.055 INFO:teuthology.orchestra.run.smithi139.stderr:dumped monmap epoch 1 2024-09-17T07:12:12.057 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:12.056+0000 7effb63f6640 1 -- 172.21.15.139:0/1118192724 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7eff98039580 msgr2=0x7eff9803ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:12:12.057 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:12.056+0000 7effb63f6640 1 --2- 172.21.15.139:0/1118192724 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7eff98039580 0x7eff9803ba30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7effa4006fd0 tx=0x7effa4006db0 comp rx=0 tx=0).stop 2024-09-17T07:12:12.057 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:12.056+0000 7effb63f6640 1 -- 172.21.15.139:0/1118192724 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7effb00fd8d0 msgr2=0x7effb010c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:12:12.057 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:12.056+0000 7effb63f6640 1 --2- 172.21.15.139:0/1118192724 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7effb00fd8d0 0x7effb010c6b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7effa0004820 tx=0x7effa0009da0 comp rx=0 tx=0).stop 2024-09-17T07:12:12.057 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:12.056+0000 7effb63f6640 1 -- 172.21.15.139:0/1118192724 shutdown_connections 2024-09-17T07:12:12.057 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:12.056+0000 7effb63f6640 1 --2- 172.21.15.139:0/1118192724 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7eff98039580 0x7eff9803ba30 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:12:12.057 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:12.056+0000 7effb63f6640 1 --2- 172.21.15.139:0/1118192724 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7effb00fd8d0 0x7effb010c6b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:12:12.057 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:12.056+0000 7effb63f6640 1 -- 172.21.15.139:0/1118192724 >> 172.21.15.139:0/1118192724 conn(0x7effb00f6010 msgr2=0x7effb00f6d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:12:12.057 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:12.056+0000 7effb63f6640 1 -- 172.21.15.139:0/1118192724 shutdown_connections 2024-09-17T07:12:12.057 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:12.056+0000 7effb63f6640 1 -- 172.21.15.139:0/1118192724 wait complete. 2024-09-17T07:12:12.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:12 smithi087 ceph-mon[27636]: from='client.? 172.21.15.139:0/1118192724' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T07:12:13.652 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T07:12:13.652 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T07:12:13.869 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:13 smithi087 ceph-mon[27636]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T07:12:13.895 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T07:12:13.939 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T07:12:15.325 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:15.307+0000 7f0ae83bd640 1 -- 172.21.15.139:0/1034244022 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ae00fc1d0 msgr2=0x7f0ae00fc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:12:15.325 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:15.307+0000 7f0ae83bd640 1 --2- 172.21.15.139:0/1034244022 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ae00fc1d0 0x7f0ae00fc5e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0ad0004850 tx=0x7f0ad0009da0 comp rx=0 tx=0).stop 2024-09-17T07:12:15.325 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:15.307+0000 7f0ae83bd640 1 -- 172.21.15.139:0/1034244022 shutdown_connections 2024-09-17T07:12:15.325 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:15.307+0000 7f0ae83bd640 1 --2- 172.21.15.139:0/1034244022 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ae00fc1d0 0x7f0ae00fc5e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:12:15.325 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:15.307+0000 7f0ae83bd640 1 -- 172.21.15.139:0/1034244022 >> 172.21.15.139:0/1034244022 conn(0x7f0ae00f79b0 msgr2=0x7f0ae00f9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:12:15.325 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:15.307+0000 7f0ae83bd640 1 -- 172.21.15.139:0/1034244022 shutdown_connections 2024-09-17T07:12:15.325 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:15.307+0000 7f0ae83bd640 1 -- 172.21.15.139:0/1034244022 wait complete. 2024-09-17T07:12:15.325 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:15.308+0000 7f0ae83bd640 1 Processor -- start 2024-09-17T07:12:15.325 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:15.308+0000 7f0ae83bd640 1 -- start start 2024-09-17T07:12:15.325 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:15.308+0000 7f0ae83bd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ae00fc1d0 0x7f0ae010c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:12:15.325 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:15.308+0000 7f0ae83bd640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae010cb60 con 0x7f0ae00fc1d0 2024-09-17T07:12:15.326 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:15.308+0000 7f0ae6159640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ae00fc1d0 0x7f0ae010c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:12:15.326 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:15.308+0000 7f0ae6159640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ae00fc1d0 0x7f0ae010c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.139:46586/0 (socket says 172.21.15.139:46586) 2024-09-17T07:12:15.326 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:15.308+0000 7f0ae6159640 1 -- 172.21.15.139:0/3540616096 learned_addr learned my addr 172.21.15.139:0/3540616096 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-17T07:12:15.326 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:15.308+0000 7f0ae6159640 1 -- 172.21.15.139:0/3540616096 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ad0005040 con 0x7f0ae00fc1d0 2024-09-17T07:12:15.326 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:15.308+0000 7f0ae6159640 1 --2- 172.21.15.139:0/3540616096 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ae00fc1d0 0x7f0ae010c620 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0ad000b020 tx=0x7f0ad0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:12:15.326 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:15.308+0000 7f0ad6ffd640 1 -- 172.21.15.139:0/3540616096 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0ad00096a0 con 0x7f0ae00fc1d0 2024-09-17T07:12:15.326 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:15.309+0000 7f0ad6ffd640 1 -- 172.21.15.139:0/3540616096 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f0ad00338a0 con 0x7f0ae00fc1d0 2024-09-17T07:12:15.326 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:15.309+0000 7f0ae83bd640 1 -- 172.21.15.139:0/3540616096 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ae010cd60 con 0x7f0ae00fc1d0 2024-09-17T07:12:15.326 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:15.309+0000 7f0ad6ffd640 1 -- 172.21.15.139:0/3540616096 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0ad003c830 con 0x7f0ae00fc1d0 2024-09-17T07:12:15.327 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:15.309+0000 7f0ae83bd640 1 -- 172.21.15.139:0/3540616096 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ae010d170 con 0x7f0ae00fc1d0 2024-09-17T07:12:15.327 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:15.309+0000 7f0ad6ffd640 1 -- 172.21.15.139:0/3540616096 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7f0ad0030020 con 0x7f0ae00fc1d0 2024-09-17T07:12:15.327 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:15.310+0000 7f0ad6ffd640 1 --2- 172.21.15.139:0/3540616096 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f0acc039580 0x7f0acc03ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:12:15.327 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:15.310+0000 7f0ae83bd640 1 -- 172.21.15.139:0/3540616096 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ae005ed70 con 0x7f0ae00fc1d0 2024-09-17T07:12:15.327 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:15.310+0000 7f0ad6ffd640 1 -- 172.21.15.139:0/3540616096 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f0ad006bf80 con 0x7f0ae00fc1d0 2024-09-17T07:12:15.327 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:15.310+0000 7f0ae5958640 1 --2- 172.21.15.139:0/3540616096 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f0acc039580 0x7f0acc03ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:12:15.327 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:15.310+0000 7f0ae5958640 1 --2- 172.21.15.139:0/3540616096 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f0acc039580 0x7f0acc03ba30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f0adc006fd0 tx=0x7f0adc006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:12:15.327 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:15.314+0000 7f0ad6ffd640 1 -- 172.21.15.139:0/3540616096 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f0ad00323d0 con 0x7f0ae00fc1d0 2024-09-17T07:12:15.530 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:15.529+0000 7f0ae83bd640 1 -- 172.21.15.139:0/3540616096 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f0ae004b720 con 0x7f0ae00fc1d0 2024-09-17T07:12:15.530 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:15.529+0000 7f0ad6ffd640 1 -- 172.21.15.139:0/3540616096 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f0ad003a730 con 0x7f0ae00fc1d0 2024-09-17T07:12:15.531 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:12:15.531 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":1,"fsid":"d5dbf8d6-74c3-11ef-bceb-c7b262605968","modified":"2024-09-17T07:10:32.618802Z","created":"2024-09-17T07:10:32.618802Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi087","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:3300","nonce":0},{"type":"v1","addr":"172.21.15.87:6789","nonce":0}]},"addr":"172.21.15.87:6789/0","public_addr":"172.21.15.87:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T07:12:15.531 INFO:teuthology.orchestra.run.smithi139.stderr:dumped monmap epoch 1 2024-09-17T07:12:15.533 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:15.532+0000 7f0ae83bd640 1 -- 172.21.15.139:0/3540616096 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f0acc039580 msgr2=0x7f0acc03ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:12:15.533 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:15.532+0000 7f0ae83bd640 1 --2- 172.21.15.139:0/3540616096 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f0acc039580 0x7f0acc03ba30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f0adc006fd0 tx=0x7f0adc006db0 comp rx=0 tx=0).stop 2024-09-17T07:12:15.533 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:15.532+0000 7f0ae83bd640 1 -- 172.21.15.139:0/3540616096 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ae00fc1d0 msgr2=0x7f0ae010c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:12:15.533 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:15.532+0000 7f0ae83bd640 1 --2- 172.21.15.139:0/3540616096 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ae00fc1d0 0x7f0ae010c620 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0ad000b020 tx=0x7f0ad0009da0 comp rx=0 tx=0).stop 2024-09-17T07:12:15.533 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:15.532+0000 7f0ae83bd640 1 -- 172.21.15.139:0/3540616096 shutdown_connections 2024-09-17T07:12:15.533 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:15.532+0000 7f0ae83bd640 1 --2- 172.21.15.139:0/3540616096 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f0acc039580 0x7f0acc03ba30 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:12:15.533 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:15.532+0000 7f0ae83bd640 1 --2- 172.21.15.139:0/3540616096 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ae00fc1d0 0x7f0ae010c620 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:12:15.533 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:15.532+0000 7f0ae83bd640 1 -- 172.21.15.139:0/3540616096 >> 172.21.15.139:0/3540616096 conn(0x7f0ae00f79b0 msgr2=0x7f0ae00f8240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:12:15.534 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:15.532+0000 7f0ae83bd640 1 -- 172.21.15.139:0/3540616096 shutdown_connections 2024-09-17T07:12:15.534 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:15.532+0000 7f0ae83bd640 1 -- 172.21.15.139:0/3540616096 wait complete. 2024-09-17T07:12:16.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:15 smithi087 ceph-mon[27636]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T07:12:16.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:15 smithi087 ceph-mon[27636]: from='mgr.14160 172.21.15.87:0/3005432640' entity='mgr.smithi087.vuvjer' 2024-09-17T07:12:16.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:15 smithi087 ceph-mon[27636]: from='mgr.14160 172.21.15.87:0/3005432640' entity='mgr.smithi087.vuvjer' 2024-09-17T07:12:16.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:15 smithi087 ceph-mon[27636]: from='mgr.14160 172.21.15.87:0/3005432640' entity='mgr.smithi087.vuvjer' 2024-09-17T07:12:16.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:15 smithi087 ceph-mon[27636]: from='mgr.14160 172.21.15.87:0/3005432640' entity='mgr.smithi087.vuvjer' 2024-09-17T07:12:16.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:15 smithi087 ceph-mon[27636]: from='mgr.14160 172.21.15.87:0/3005432640' entity='mgr.smithi087.vuvjer' 2024-09-17T07:12:16.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:15 smithi087 ceph-mon[27636]: from='mgr.14160 172.21.15.87:0/3005432640' entity='mgr.smithi087.vuvjer' 2024-09-17T07:12:16.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:15 smithi087 ceph-mon[27636]: Deploying daemon prometheus.smithi087 on smithi087 2024-09-17T07:12:16.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:15 smithi087 ceph-mon[27636]: from='client.? 172.21.15.139:0/3540616096' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T07:12:17.078 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T07:12:17.078 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T07:12:17.322 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T07:12:17.366 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T07:12:18.051 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:17 smithi087 ceph-mon[27636]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T07:12:18.051 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:17 smithi087 ceph-mon[27636]: from='mgr.14160 172.21.15.87:0/3005432640' entity='mgr.smithi087.vuvjer' 2024-09-17T07:12:18.802 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:18.794+0000 7f4c81b0a640 1 -- 172.21.15.139:0/1869889402 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c7c0fb2e0 msgr2=0x7f4c7c0fb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:12:18.803 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:18.794+0000 7f4c81b0a640 1 --2- 172.21.15.139:0/1869889402 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c7c0fb2e0 0x7f4c7c0fb6f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c004850 tx=0x7f4c6c009da0 comp rx=0 tx=0).stop 2024-09-17T07:12:18.803 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:18.794+0000 7f4c81b0a640 1 -- 172.21.15.139:0/1869889402 shutdown_connections 2024-09-17T07:12:18.803 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:18.794+0000 7f4c81b0a640 1 --2- 172.21.15.139:0/1869889402 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c7c0fb2e0 0x7f4c7c0fb6f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:12:18.803 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:18.794+0000 7f4c81b0a640 1 -- 172.21.15.139:0/1869889402 >> 172.21.15.139:0/1869889402 conn(0x7f4c7c0f6ac0 msgr2=0x7f4c7c0f8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:12:18.803 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:18.794+0000 7f4c81b0a640 1 -- 172.21.15.139:0/1869889402 shutdown_connections 2024-09-17T07:12:18.803 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:18.794+0000 7f4c81b0a640 1 -- 172.21.15.139:0/1869889402 wait complete. 2024-09-17T07:12:18.803 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:18.795+0000 7f4c81b0a640 1 Processor -- start 2024-09-17T07:12:18.803 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:18.795+0000 7f4c81b0a640 1 -- start start 2024-09-17T07:12:18.803 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:18.795+0000 7f4c81b0a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c7c0fb2e0 0x7f4c7c10c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:12:18.803 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:18.795+0000 7f4c81b0a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c7c10cd90 con 0x7f4c7c0fb2e0 2024-09-17T07:12:18.803 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:18.795+0000 7f4c7b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c7c0fb2e0 0x7f4c7c10c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:12:18.803 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:18.795+0000 7f4c7b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c7c0fb2e0 0x7f4c7c10c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.139:37034/0 (socket says 172.21.15.139:37034) 2024-09-17T07:12:18.804 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:18.795+0000 7f4c7b7fe640 1 -- 172.21.15.139:0/1574552581 learned_addr learned my addr 172.21.15.139:0/1574552581 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-17T07:12:18.804 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:18.795+0000 7f4c7b7fe640 1 -- 172.21.15.139:0/1574552581 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c6c005040 con 0x7f4c7c0fb2e0 2024-09-17T07:12:18.804 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:18.796+0000 7f4c7b7fe640 1 --2- 172.21.15.139:0/1574552581 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c7c0fb2e0 0x7f4c7c10c850 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c004820 tx=0x7f4c6c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:12:18.804 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:18.796+0000 7f4c78ff9640 1 -- 172.21.15.139:0/1574552581 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4c6c0096c0 con 0x7f4c7c0fb2e0 2024-09-17T07:12:18.804 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:18.796+0000 7f4c81b0a640 1 -- 172.21.15.139:0/1574552581 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c7c10cf90 con 0x7f4c7c0fb2e0 2024-09-17T07:12:18.804 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:18.796+0000 7f4c78ff9640 1 -- 172.21.15.139:0/1574552581 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f4c6c03d8a0 con 0x7f4c7c0fb2e0 2024-09-17T07:12:18.804 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:18.796+0000 7f4c78ff9640 1 -- 172.21.15.139:0/1574552581 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4c6c0338b0 con 0x7f4c7c0fb2e0 2024-09-17T07:12:18.804 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:18.796+0000 7f4c81b0a640 1 -- 172.21.15.139:0/1574552581 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c7c10db20 con 0x7f4c7c0fb2e0 2024-09-17T07:12:18.804 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:18.797+0000 7f4c78ff9640 1 -- 172.21.15.139:0/1574552581 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7f4c6c030020 con 0x7f4c7c0fb2e0 2024-09-17T07:12:18.804 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:18.797+0000 7f4c81b0a640 1 -- 172.21.15.139:0/1574552581 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c7c1015c0 con 0x7f4c7c0fb2e0 2024-09-17T07:12:18.804 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:18.797+0000 7f4c78ff9640 1 --2- 172.21.15.139:0/1574552581 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f4c68039580 0x7f4c6803ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:12:18.804 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:18.797+0000 7f4c78ff9640 1 -- 172.21.15.139:0/1574552581 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f4c6c06c870 con 0x7f4c7c0fb2e0 2024-09-17T07:12:18.804 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:18.797+0000 7f4c72ffd640 1 --2- 172.21.15.139:0/1574552581 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f4c68039580 0x7f4c6803ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:12:18.805 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:18.798+0000 7f4c72ffd640 1 --2- 172.21.15.139:0/1574552581 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f4c68039580 0x7f4c6803ba30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4c64006fd0 tx=0x7f4c64006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:12:18.805 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:18.803+0000 7f4c78ff9640 1 -- 172.21.15.139:0/1574552581 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f4c6c03cbb0 con 0x7f4c7c0fb2e0 2024-09-17T07:12:19.015 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:19.015+0000 7f4c81b0a640 1 -- 172.21.15.139:0/1574552581 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f4c7c0008d0 con 0x7f4c7c0fb2e0 2024-09-17T07:12:19.015 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:19.015+0000 7f4c78ff9640 1 -- 172.21.15.139:0/1574552581 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f4c6c001050 con 0x7f4c7c0fb2e0 2024-09-17T07:12:19.016 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:12:19.016 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":1,"fsid":"d5dbf8d6-74c3-11ef-bceb-c7b262605968","modified":"2024-09-17T07:10:32.618802Z","created":"2024-09-17T07:10:32.618802Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi087","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:3300","nonce":0},{"type":"v1","addr":"172.21.15.87:6789","nonce":0}]},"addr":"172.21.15.87:6789/0","public_addr":"172.21.15.87:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T07:12:19.016 INFO:teuthology.orchestra.run.smithi139.stderr:dumped monmap epoch 1 2024-09-17T07:12:19.017 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:19.017+0000 7f4c81b0a640 1 -- 172.21.15.139:0/1574552581 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f4c68039580 msgr2=0x7f4c6803ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:12:19.017 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:19.017+0000 7f4c81b0a640 1 --2- 172.21.15.139:0/1574552581 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f4c68039580 0x7f4c6803ba30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4c64006fd0 tx=0x7f4c64006db0 comp rx=0 tx=0).stop 2024-09-17T07:12:19.017 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:19.017+0000 7f4c81b0a640 1 -- 172.21.15.139:0/1574552581 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c7c0fb2e0 msgr2=0x7f4c7c10c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:12:19.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:19.017+0000 7f4c81b0a640 1 --2- 172.21.15.139:0/1574552581 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c7c0fb2e0 0x7f4c7c10c850 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c004820 tx=0x7f4c6c009da0 comp rx=0 tx=0).stop 2024-09-17T07:12:19.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:19.017+0000 7f4c81b0a640 1 -- 172.21.15.139:0/1574552581 shutdown_connections 2024-09-17T07:12:19.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:19.017+0000 7f4c81b0a640 1 --2- 172.21.15.139:0/1574552581 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f4c68039580 0x7f4c6803ba30 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:12:19.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:19.017+0000 7f4c81b0a640 1 --2- 172.21.15.139:0/1574552581 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c7c0fb2e0 0x7f4c7c10c850 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:12:19.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:19.017+0000 7f4c81b0a640 1 -- 172.21.15.139:0/1574552581 >> 172.21.15.139:0/1574552581 conn(0x7f4c7c0f6ac0 msgr2=0x7f4c7c064990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:12:19.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:19.017+0000 7f4c81b0a640 1 -- 172.21.15.139:0/1574552581 shutdown_connections 2024-09-17T07:12:19.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:19.017+0000 7f4c81b0a640 1 -- 172.21.15.139:0/1574552581 wait complete. 2024-09-17T07:12:20.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:19 smithi087 ceph-mon[27636]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T07:12:20.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:19 smithi087 ceph-mon[27636]: from='client.? 172.21.15.139:0/1574552581' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T07:12:20.600 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T07:12:20.600 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T07:12:20.842 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T07:12:20.886 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T07:12:21.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:21 smithi087 ceph-mon[27636]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T07:12:22.222 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:22.214+0000 7f48a6534640 1 -- 172.21.15.139:0/3005544936 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48a00fd810 msgr2=0x7f48a00fdc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:12:22.222 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:22.214+0000 7f48a6534640 1 --2- 172.21.15.139:0/3005544936 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48a00fd810 0x7f48a00fdc20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4890004850 tx=0x7f4890009da0 comp rx=0 tx=0).stop 2024-09-17T07:12:22.222 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:22.214+0000 7f48a6534640 1 -- 172.21.15.139:0/3005544936 shutdown_connections 2024-09-17T07:12:22.223 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:22.214+0000 7f48a6534640 1 --2- 172.21.15.139:0/3005544936 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48a00fd810 0x7f48a00fdc20 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:12:22.223 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:22.214+0000 7f48a6534640 1 -- 172.21.15.139:0/3005544936 >> 172.21.15.139:0/3005544936 conn(0x7f48a00f6010 msgr2=0x7f48a00f8440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:12:22.223 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:22.214+0000 7f48a6534640 1 -- 172.21.15.139:0/3005544936 shutdown_connections 2024-09-17T07:12:22.223 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:22.214+0000 7f48a6534640 1 -- 172.21.15.139:0/3005544936 wait complete. 2024-09-17T07:12:22.223 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:22.214+0000 7f48a6534640 1 Processor -- start 2024-09-17T07:12:22.223 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:22.215+0000 7f48a6534640 1 -- start start 2024-09-17T07:12:22.223 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:22.215+0000 7f48a6534640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48a00fd810 0x7f48a010c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:12:22.223 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:22.215+0000 7f48a6534640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48a010cbb0 con 0x7f48a00fd810 2024-09-17T07:12:22.223 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:22.215+0000 7f489ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48a00fd810 0x7f48a010c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:12:22.223 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:22.215+0000 7f489ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48a00fd810 0x7f48a010c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.139:37042/0 (socket says 172.21.15.139:37042) 2024-09-17T07:12:22.223 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:22.215+0000 7f489ffff640 1 -- 172.21.15.139:0/915412103 learned_addr learned my addr 172.21.15.139:0/915412103 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-17T07:12:22.223 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:22.215+0000 7f489ffff640 1 -- 172.21.15.139:0/915412103 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4890005040 con 0x7f48a00fd810 2024-09-17T07:12:22.223 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:22.216+0000 7f489ffff640 1 --2- 172.21.15.139:0/915412103 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48a00fd810 0x7f48a010c670 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4890003080 tx=0x7f4890009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:12:22.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:22.216+0000 7f489cff9640 1 -- 172.21.15.139:0/915412103 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4890033420 con 0x7f48a00fd810 2024-09-17T07:12:22.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:22.216+0000 7f48a6534640 1 -- 172.21.15.139:0/915412103 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48a010cdb0 con 0x7f48a00fd810 2024-09-17T07:12:22.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:22.216+0000 7f489cff9640 1 -- 172.21.15.139:0/915412103 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f4890033a00 con 0x7f48a00fd810 2024-09-17T07:12:22.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:22.216+0000 7f489cff9640 1 -- 172.21.15.139:0/915412103 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f489003c7d0 con 0x7f48a00fd810 2024-09-17T07:12:22.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:22.216+0000 7f48a6534640 1 -- 172.21.15.139:0/915412103 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48a010d220 con 0x7f48a00fd810 2024-09-17T07:12:22.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:22.217+0000 7f489cff9640 1 -- 172.21.15.139:0/915412103 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7f4890030020 con 0x7f48a00fd810 2024-09-17T07:12:22.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:22.217+0000 7f48a6534640 1 -- 172.21.15.139:0/915412103 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48a005ed70 con 0x7f48a00fd810 2024-09-17T07:12:22.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:22.217+0000 7f489cff9640 1 --2- 172.21.15.139:0/915412103 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f4888039580 0x7f488803ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:12:22.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:22.217+0000 7f489cff9640 1 -- 172.21.15.139:0/915412103 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f489006bda0 con 0x7f48a00fd810 2024-09-17T07:12:22.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:22.217+0000 7f489f7fe640 1 --2- 172.21.15.139:0/915412103 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f4888039580 0x7f488803ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:12:22.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:22.218+0000 7f489f7fe640 1 --2- 172.21.15.139:0/915412103 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f4888039580 0x7f488803ba30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4894006fd0 tx=0x7f4894006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:12:22.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:22.222+0000 7f489cff9640 1 -- 172.21.15.139:0/915412103 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f489003b7e0 con 0x7f48a00fd810 2024-09-17T07:12:22.435 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:22.434+0000 7f48a6534640 1 -- 172.21.15.139:0/915412103 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f48a004b720 con 0x7f48a00fd810 2024-09-17T07:12:22.435 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:22.435+0000 7f489cff9640 1 -- 172.21.15.139:0/915412103 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f4890041070 con 0x7f48a00fd810 2024-09-17T07:12:22.435 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:12:22.435 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":1,"fsid":"d5dbf8d6-74c3-11ef-bceb-c7b262605968","modified":"2024-09-17T07:10:32.618802Z","created":"2024-09-17T07:10:32.618802Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi087","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:3300","nonce":0},{"type":"v1","addr":"172.21.15.87:6789","nonce":0}]},"addr":"172.21.15.87:6789/0","public_addr":"172.21.15.87:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T07:12:22.436 INFO:teuthology.orchestra.run.smithi139.stderr:dumped monmap epoch 1 2024-09-17T07:12:22.437 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:22.437+0000 7f48a6534640 1 -- 172.21.15.139:0/915412103 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f4888039580 msgr2=0x7f488803ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:12:22.437 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:22.437+0000 7f48a6534640 1 --2- 172.21.15.139:0/915412103 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f4888039580 0x7f488803ba30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4894006fd0 tx=0x7f4894006db0 comp rx=0 tx=0).stop 2024-09-17T07:12:22.437 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:22.437+0000 7f48a6534640 1 -- 172.21.15.139:0/915412103 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48a00fd810 msgr2=0x7f48a010c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:12:22.437 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:22.437+0000 7f48a6534640 1 --2- 172.21.15.139:0/915412103 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48a00fd810 0x7f48a010c670 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4890003080 tx=0x7f4890009da0 comp rx=0 tx=0).stop 2024-09-17T07:12:22.437 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:22.437+0000 7f48a6534640 1 -- 172.21.15.139:0/915412103 shutdown_connections 2024-09-17T07:12:22.437 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:22.437+0000 7f48a6534640 1 --2- 172.21.15.139:0/915412103 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f4888039580 0x7f488803ba30 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:12:22.438 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:22.437+0000 7f48a6534640 1 --2- 172.21.15.139:0/915412103 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48a00fd810 0x7f48a010c670 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:12:22.438 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:22.437+0000 7f48a6534640 1 -- 172.21.15.139:0/915412103 >> 172.21.15.139:0/915412103 conn(0x7f48a00f6010 msgr2=0x7f48a00f6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:12:22.438 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:22.437+0000 7f48a6534640 1 -- 172.21.15.139:0/915412103 shutdown_connections 2024-09-17T07:12:22.438 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:22.437+0000 7f48a6534640 1 -- 172.21.15.139:0/915412103 wait complete. 2024-09-17T07:12:23.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:22 smithi087 ceph-mon[27636]: from='client.? 172.21.15.139:0/915412103' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T07:12:24.008 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T07:12:24.008 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T07:12:24.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:23 smithi087 ceph-mon[27636]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T07:12:24.237 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T07:12:24.282 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T07:12:25.619 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:25.618+0000 7f8ed3a2e640 1 -- 172.21.15.139:0/3403629484 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ecc0fc1b0 msgr2=0x7f8ecc0fc5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:12:25.619 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:25.618+0000 7f8ed3a2e640 1 --2- 172.21.15.139:0/3403629484 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ecc0fc1b0 0x7f8ecc0fc5c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8ec4004850 tx=0x7f8ec4009da0 comp rx=0 tx=0).stop 2024-09-17T07:12:25.619 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:25.618+0000 7f8ed3a2e640 1 -- 172.21.15.139:0/3403629484 shutdown_connections 2024-09-17T07:12:25.619 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:25.618+0000 7f8ed3a2e640 1 --2- 172.21.15.139:0/3403629484 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ecc0fc1b0 0x7f8ecc0fc5c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:12:25.619 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:25.618+0000 7f8ed3a2e640 1 -- 172.21.15.139:0/3403629484 >> 172.21.15.139:0/3403629484 conn(0x7f8ecc0f7990 msgr2=0x7f8ecc0f9da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:12:25.619 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:25.618+0000 7f8ed3a2e640 1 -- 172.21.15.139:0/3403629484 shutdown_connections 2024-09-17T07:12:25.619 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:25.618+0000 7f8ed3a2e640 1 -- 172.21.15.139:0/3403629484 wait complete. 2024-09-17T07:12:25.620 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:25.618+0000 7f8ed3a2e640 1 Processor -- start 2024-09-17T07:12:25.620 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:25.618+0000 7f8ed3a2e640 1 -- start start 2024-09-17T07:12:25.620 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:25.618+0000 7f8ed3a2e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ecc0fc1b0 0x7f8ecc10c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:12:25.620 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:25.618+0000 7f8ed3a2e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ecc10cb60 con 0x7f8ecc0fc1b0 2024-09-17T07:12:25.620 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:25.619+0000 7f8ed17ca640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ecc0fc1b0 0x7f8ecc10c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:12:25.620 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:25.619+0000 7f8ed17ca640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ecc0fc1b0 0x7f8ecc10c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.139:37060/0 (socket says 172.21.15.139:37060) 2024-09-17T07:12:25.620 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:25.619+0000 7f8ed17ca640 1 -- 172.21.15.139:0/1242697574 learned_addr learned my addr 172.21.15.139:0/1242697574 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-17T07:12:25.620 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:25.619+0000 7f8ed17ca640 1 -- 172.21.15.139:0/1242697574 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec4005040 con 0x7f8ecc0fc1b0 2024-09-17T07:12:25.621 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:25.619+0000 7f8ed17ca640 1 --2- 172.21.15.139:0/1242697574 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ecc0fc1b0 0x7f8ecc10c620 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8ec4004820 tx=0x7f8ec4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:12:25.622 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:25.619+0000 7f8ec9ffb640 1 -- 172.21.15.139:0/1242697574 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8ec40096c0 con 0x7f8ecc0fc1b0 2024-09-17T07:12:25.622 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:25.619+0000 7f8ed3a2e640 1 -- 172.21.15.139:0/1242697574 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ecc10cd60 con 0x7f8ecc0fc1b0 2024-09-17T07:12:25.622 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:25.620+0000 7f8ec9ffb640 1 -- 172.21.15.139:0/1242697574 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f8ec403d8a0 con 0x7f8ecc0fc1b0 2024-09-17T07:12:25.622 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:25.620+0000 7f8ec9ffb640 1 -- 172.21.15.139:0/1242697574 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8ec40338b0 con 0x7f8ecc0fc1b0 2024-09-17T07:12:25.622 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:25.620+0000 7f8ed3a2e640 1 -- 172.21.15.139:0/1242697574 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ecc10d8f0 con 0x7f8ecc0fc1b0 2024-09-17T07:12:25.622 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:25.621+0000 7f8ed3a2e640 1 -- 172.21.15.139:0/1242697574 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ecc10d230 con 0x7f8ecc0fc1b0 2024-09-17T07:12:25.622 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:25.621+0000 7f8ec9ffb640 1 -- 172.21.15.139:0/1242697574 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7f8ec4030020 con 0x7f8ecc0fc1b0 2024-09-17T07:12:25.622 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:25.621+0000 7f8ec9ffb640 1 --2- 172.21.15.139:0/1242697574 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f8eb4039580 0x7f8eb403ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:12:25.622 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:25.621+0000 7f8ec9ffb640 1 -- 172.21.15.139:0/1242697574 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f8ec406c8a0 con 0x7f8ecc0fc1b0 2024-09-17T07:12:25.622 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:25.621+0000 7f8ed0fc9640 1 --2- 172.21.15.139:0/1242697574 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f8eb4039580 0x7f8eb403ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:12:25.622 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:25.622+0000 7f8ed0fc9640 1 --2- 172.21.15.139:0/1242697574 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f8eb4039580 0x7f8eb403ba30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8ec0006fd0 tx=0x7f8ec0006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:12:25.626 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:25.626+0000 7f8ec9ffb640 1 -- 172.21.15.139:0/1242697574 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f8ecc10d230 con 0x7f8ecc0fc1b0 2024-09-17T07:12:25.838 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:25.838+0000 7f8ed3a2e640 1 -- 172.21.15.139:0/1242697574 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f8ecc102490 con 0x7f8ecc0fc1b0 2024-09-17T07:12:25.839 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:25.839+0000 7f8ec9ffb640 1 -- 172.21.15.139:0/1242697574 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f8ec4045990 con 0x7f8ecc0fc1b0 2024-09-17T07:12:25.839 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:12:25.840 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":1,"fsid":"d5dbf8d6-74c3-11ef-bceb-c7b262605968","modified":"2024-09-17T07:10:32.618802Z","created":"2024-09-17T07:10:32.618802Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi087","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:3300","nonce":0},{"type":"v1","addr":"172.21.15.87:6789","nonce":0}]},"addr":"172.21.15.87:6789/0","public_addr":"172.21.15.87:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T07:12:25.840 INFO:teuthology.orchestra.run.smithi139.stderr:dumped monmap epoch 1 2024-09-17T07:12:25.841 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:25.841+0000 7f8ed3a2e640 1 -- 172.21.15.139:0/1242697574 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f8eb4039580 msgr2=0x7f8eb403ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:12:25.841 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:25.841+0000 7f8ed3a2e640 1 --2- 172.21.15.139:0/1242697574 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f8eb4039580 0x7f8eb403ba30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8ec0006fd0 tx=0x7f8ec0006db0 comp rx=0 tx=0).stop 2024-09-17T07:12:25.841 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:25.841+0000 7f8ed3a2e640 1 -- 172.21.15.139:0/1242697574 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ecc0fc1b0 msgr2=0x7f8ecc10c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:12:25.842 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:25.841+0000 7f8ed3a2e640 1 --2- 172.21.15.139:0/1242697574 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ecc0fc1b0 0x7f8ecc10c620 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8ec4004820 tx=0x7f8ec4009da0 comp rx=0 tx=0).stop 2024-09-17T07:12:25.842 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:25.841+0000 7f8ed3a2e640 1 -- 172.21.15.139:0/1242697574 shutdown_connections 2024-09-17T07:12:25.842 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:25.841+0000 7f8ed3a2e640 1 --2- 172.21.15.139:0/1242697574 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f8eb4039580 0x7f8eb403ba30 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:12:25.842 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:25.841+0000 7f8ed3a2e640 1 --2- 172.21.15.139:0/1242697574 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ecc0fc1b0 0x7f8ecc10c620 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:12:25.842 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:25.841+0000 7f8ed3a2e640 1 -- 172.21.15.139:0/1242697574 >> 172.21.15.139:0/1242697574 conn(0x7f8ecc0f7990 msgr2=0x7f8ecc0f8220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:12:25.842 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:25.841+0000 7f8ed3a2e640 1 -- 172.21.15.139:0/1242697574 shutdown_connections 2024-09-17T07:12:25.842 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:25.841+0000 7f8ed3a2e640 1 -- 172.21.15.139:0/1242697574 wait complete. 2024-09-17T07:12:26.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:25 smithi087 ceph-mon[27636]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T07:12:27.077 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:26 smithi087 ceph-mon[27636]: from='client.? 172.21.15.139:0/1242697574' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T07:12:27.396 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T07:12:27.397 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T07:12:27.653 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T07:12:27.697 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T07:12:28.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:27 smithi087 ceph-mon[27636]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T07:12:29.022 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:29.020+0000 7f9a09928640 1 -- 172.21.15.139:0/1977000135 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a040fb2e0 msgr2=0x7f9a040fb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:12:29.022 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:29.020+0000 7f9a09928640 1 --2- 172.21.15.139:0/1977000135 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a040fb2e0 0x7f9a040fb6f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f99f4009bd0 tx=0x7f99f4004d10 comp rx=0 tx=0).stop 2024-09-17T07:12:29.022 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:29.020+0000 7f9a09928640 1 -- 172.21.15.139:0/1977000135 shutdown_connections 2024-09-17T07:12:29.022 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:29.020+0000 7f9a09928640 1 --2- 172.21.15.139:0/1977000135 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a040fb2e0 0x7f9a040fb6f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:12:29.022 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:29.020+0000 7f9a09928640 1 -- 172.21.15.139:0/1977000135 >> 172.21.15.139:0/1977000135 conn(0x7f9a040f6ac0 msgr2=0x7f9a040f8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:12:29.022 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:29.021+0000 7f9a09928640 1 -- 172.21.15.139:0/1977000135 shutdown_connections 2024-09-17T07:12:29.022 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:29.021+0000 7f9a09928640 1 -- 172.21.15.139:0/1977000135 wait complete. 2024-09-17T07:12:29.022 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:29.021+0000 7f9a09928640 1 Processor -- start 2024-09-17T07:12:29.022 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:29.021+0000 7f9a09928640 1 -- start start 2024-09-17T07:12:29.022 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:29.021+0000 7f9a09928640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a040fb2e0 0x7f9a040654d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:12:29.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:29.021+0000 7f9a09928640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0410f590 con 0x7f9a040fb2e0 2024-09-17T07:12:29.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:29.022+0000 7f9a02ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a040fb2e0 0x7f9a040654d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:12:29.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:29.022+0000 7f9a02ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a040fb2e0 0x7f9a040654d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.139:36950/0 (socket says 172.21.15.139:36950) 2024-09-17T07:12:29.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:29.022+0000 7f9a02ffd640 1 -- 172.21.15.139:0/3167728534 learned_addr learned my addr 172.21.15.139:0/3167728534 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-17T07:12:29.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:29.022+0000 7f9a02ffd640 1 -- 172.21.15.139:0/3167728534 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f40098b0 con 0x7f9a040fb2e0 2024-09-17T07:12:29.024 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:29.022+0000 7f9a02ffd640 1 --2- 172.21.15.139:0/3167728534 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a040fb2e0 0x7f9a040654d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f99f4009880 tx=0x7f99f4004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:12:29.024 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:29.022+0000 7f99fb7fe640 1 -- 172.21.15.139:0/3167728534 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f99f4032900 con 0x7f9a040fb2e0 2024-09-17T07:12:29.024 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:29.022+0000 7f99fb7fe640 1 -- 172.21.15.139:0/3167728534 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f99f403d420 con 0x7f9a040fb2e0 2024-09-17T07:12:29.024 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:29.022+0000 7f9a09928640 1 -- 172.21.15.139:0/3167728534 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a0410f6d0 con 0x7f9a040fb2e0 2024-09-17T07:12:29.024 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:29.022+0000 7f99fb7fe640 1 -- 172.21.15.139:0/3167728534 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f99f40313d0 con 0x7f9a040fb2e0 2024-09-17T07:12:29.024 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:29.022+0000 7f9a09928640 1 -- 172.21.15.139:0/3167728534 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a0410fae0 con 0x7f9a040fb2e0 2024-09-17T07:12:29.025 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:29.023+0000 7f99fb7fe640 1 -- 172.21.15.139:0/3167728534 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7f99f402f030 con 0x7f9a040fb2e0 2024-09-17T07:12:29.025 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:29.023+0000 7f9a09928640 1 -- 172.21.15.139:0/3167728534 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a0405ed70 con 0x7f9a040fb2e0 2024-09-17T07:12:29.025 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:29.023+0000 7f99fb7fe640 1 --2- 172.21.15.139:0/3167728534 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f99f0039580 0x7f99f003ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:12:29.025 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:29.023+0000 7f99fb7fe640 1 -- 172.21.15.139:0/3167728534 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f99f406d470 con 0x7f9a040fb2e0 2024-09-17T07:12:29.025 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:29.024+0000 7f9a027fc640 1 --2- 172.21.15.139:0/3167728534 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f99f0039580 0x7f99f003ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:12:29.025 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:29.024+0000 7f9a027fc640 1 --2- 172.21.15.139:0/3167728534 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f99f0039580 0x7f99f003ba30 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f99ec006fd0 tx=0x7f99ec006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:12:29.028 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:29.028+0000 7f99fb7fe640 1 -- 172.21.15.139:0/3167728534 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f99f4032a60 con 0x7f9a040fb2e0 2024-09-17T07:12:29.241 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:29.239+0000 7f9a09928640 1 -- 172.21.15.139:0/3167728534 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f9a0404b720 con 0x7f9a040fb2e0 2024-09-17T07:12:29.241 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:29.240+0000 7f99fb7fe640 1 -- 172.21.15.139:0/3167728534 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f99f4030b70 con 0x7f9a040fb2e0 2024-09-17T07:12:29.242 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:12:29.242 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":1,"fsid":"d5dbf8d6-74c3-11ef-bceb-c7b262605968","modified":"2024-09-17T07:10:32.618802Z","created":"2024-09-17T07:10:32.618802Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi087","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:3300","nonce":0},{"type":"v1","addr":"172.21.15.87:6789","nonce":0}]},"addr":"172.21.15.87:6789/0","public_addr":"172.21.15.87:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T07:12:29.242 INFO:teuthology.orchestra.run.smithi139.stderr:dumped monmap epoch 1 2024-09-17T07:12:29.242 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:29.242+0000 7f9a09928640 1 -- 172.21.15.139:0/3167728534 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f99f0039580 msgr2=0x7f99f003ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:12:29.243 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:29.242+0000 7f9a09928640 1 --2- 172.21.15.139:0/3167728534 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f99f0039580 0x7f99f003ba30 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f99ec006fd0 tx=0x7f99ec006db0 comp rx=0 tx=0).stop 2024-09-17T07:12:29.243 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:29.242+0000 7f9a09928640 1 -- 172.21.15.139:0/3167728534 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a040fb2e0 msgr2=0x7f9a040654d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:12:29.243 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:29.242+0000 7f9a09928640 1 --2- 172.21.15.139:0/3167728534 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a040fb2e0 0x7f9a040654d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f99f4009880 tx=0x7f99f4004d10 comp rx=0 tx=0).stop 2024-09-17T07:12:29.243 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:29.242+0000 7f9a09928640 1 -- 172.21.15.139:0/3167728534 shutdown_connections 2024-09-17T07:12:29.243 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:29.242+0000 7f9a09928640 1 --2- 172.21.15.139:0/3167728534 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f99f0039580 0x7f99f003ba30 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:12:29.243 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:29.242+0000 7f9a09928640 1 --2- 172.21.15.139:0/3167728534 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a040fb2e0 0x7f9a040654d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:12:29.243 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:29.242+0000 7f9a09928640 1 -- 172.21.15.139:0/3167728534 >> 172.21.15.139:0/3167728534 conn(0x7f9a040f6ac0 msgr2=0x7f9a040f7350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:12:29.243 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:29.242+0000 7f9a09928640 1 -- 172.21.15.139:0/3167728534 shutdown_connections 2024-09-17T07:12:29.243 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:29.242+0000 7f9a09928640 1 -- 172.21.15.139:0/3167728534 wait complete. 2024-09-17T07:12:30.053 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:29 smithi087 ceph-mon[27636]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T07:12:30.053 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:29 smithi087 ceph-mon[27636]: from='client.? 172.21.15.139:0/3167728534' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T07:12:30.700 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T07:12:30.700 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T07:12:30.949 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T07:12:30.993 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T07:12:32.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:31 smithi087 ceph-mon[27636]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T07:12:32.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:31 smithi087 ceph-mon[27636]: from='mgr.14160 172.21.15.87:0/3005432640' entity='mgr.smithi087.vuvjer' 2024-09-17T07:12:32.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:31 smithi087 ceph-mon[27636]: from='mgr.14160 172.21.15.87:0/3005432640' entity='mgr.smithi087.vuvjer' 2024-09-17T07:12:32.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:31 smithi087 ceph-mon[27636]: from='mgr.14160 172.21.15.87:0/3005432640' entity='mgr.smithi087.vuvjer' 2024-09-17T07:12:32.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:31 smithi087 ceph-mon[27636]: from='mgr.14160 172.21.15.87:0/3005432640' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-17T07:12:32.501 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:32.500+0000 7fbc50a14640 1 -- 172.21.15.139:0/4280472137 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbc4c0fc1d0 msgr2=0x7fbc4c0fc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:12:32.501 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:32.500+0000 7fbc50a14640 1 --2- 172.21.15.139:0/4280472137 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbc4c0fc1d0 0x7fbc4c0fc5e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fbc44004850 tx=0x7fbc44009da0 comp rx=0 tx=0).stop 2024-09-17T07:12:32.502 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:32.500+0000 7fbc50a14640 1 -- 172.21.15.139:0/4280472137 shutdown_connections 2024-09-17T07:12:32.502 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:32.500+0000 7fbc50a14640 1 --2- 172.21.15.139:0/4280472137 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbc4c0fc1d0 0x7fbc4c0fc5e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:12:32.502 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:32.500+0000 7fbc50a14640 1 -- 172.21.15.139:0/4280472137 >> 172.21.15.139:0/4280472137 conn(0x7fbc4c0f79b0 msgr2=0x7fbc4c0f9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:12:32.502 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:32.500+0000 7fbc50a14640 1 -- 172.21.15.139:0/4280472137 shutdown_connections 2024-09-17T07:12:32.502 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:32.500+0000 7fbc50a14640 1 -- 172.21.15.139:0/4280472137 wait complete. 2024-09-17T07:12:32.502 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:32.500+0000 7fbc50a14640 1 Processor -- start 2024-09-17T07:12:32.502 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:32.500+0000 7fbc50a14640 1 -- start start 2024-09-17T07:12:32.502 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:32.500+0000 7fbc50a14640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbc4c0fc1d0 0x7fbc4c071490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:12:32.502 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:32.500+0000 7fbc50a14640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4c0719d0 con 0x7fbc4c0fc1d0 2024-09-17T07:12:32.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:32.501+0000 7fbc4a59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbc4c0fc1d0 0x7fbc4c071490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:12:32.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:32.501+0000 7fbc4a59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbc4c0fc1d0 0x7fbc4c071490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.139:36968/0 (socket says 172.21.15.139:36968) 2024-09-17T07:12:32.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:32.501+0000 7fbc4a59c640 1 -- 172.21.15.139:0/1633875203 learned_addr learned my addr 172.21.15.139:0/1633875203 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-17T07:12:32.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:32.501+0000 7fbc4a59c640 1 -- 172.21.15.139:0/1633875203 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc44005040 con 0x7fbc4c0fc1d0 2024-09-17T07:12:32.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:32.501+0000 7fbc4a59c640 1 --2- 172.21.15.139:0/1633875203 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbc4c0fc1d0 0x7fbc4c071490 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbc44004820 tx=0x7fbc44009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:12:32.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:32.501+0000 7fbc42ffd640 1 -- 172.21.15.139:0/1633875203 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbc440096c0 con 0x7fbc4c0fc1d0 2024-09-17T07:12:32.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:32.501+0000 7fbc50a14640 1 -- 172.21.15.139:0/1633875203 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc4c06fa60 con 0x7fbc4c0fc1d0 2024-09-17T07:12:32.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:32.501+0000 7fbc42ffd640 1 -- 172.21.15.139:0/1633875203 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fbc4403d8a0 con 0x7fbc4c0fc1d0 2024-09-17T07:12:32.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:32.501+0000 7fbc42ffd640 1 -- 172.21.15.139:0/1633875203 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbc440338b0 con 0x7fbc4c0fc1d0 2024-09-17T07:12:32.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:32.501+0000 7fbc50a14640 1 -- 172.21.15.139:0/1633875203 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc4c06ff30 con 0x7fbc4c0fc1d0 2024-09-17T07:12:32.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:32.502+0000 7fbc42ffd640 1 -- 172.21.15.139:0/1633875203 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 14) v1 ==== 45577+0+0 (secure 0 0 0) 0x7fbc44030020 con 0x7fbc4c0fc1d0 2024-09-17T07:12:32.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:32.502+0000 7fbc50a14640 1 -- 172.21.15.139:0/1633875203 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc4c05ed70 con 0x7fbc4c0fc1d0 2024-09-17T07:12:32.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:32.502+0000 7fbc42ffd640 1 --2- 172.21.15.139:0/1633875203 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7fbc380395d0 0x7fbc3803ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:12:32.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:32.502+0000 7fbc42ffd640 1 -- 172.21.15.139:0/1633875203 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fbc4406c890 con 0x7fbc4c0fc1d0 2024-09-17T07:12:32.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:32.502+0000 7fbc49d9b640 1 -- 172.21.15.139:0/1633875203 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7fbc380395d0 msgr2=0x7fbc3803ba80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.87:6800/2341884603 2024-09-17T07:12:32.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:32.502+0000 7fbc49d9b640 1 --2- 172.21.15.139:0/1633875203 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7fbc380395d0 0x7fbc3803ba80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-17T07:12:32.507 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:32.507+0000 7fbc42ffd640 1 -- 172.21.15.139:0/1633875203 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fbc44045390 con 0x7fbc4c0fc1d0 2024-09-17T07:12:32.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:32.703+0000 7fbc49d9b640 1 -- 172.21.15.139:0/1633875203 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7fbc380395d0 msgr2=0x7fbc3803ba80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.87:6800/2341884603 2024-09-17T07:12:32.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:32.703+0000 7fbc49d9b640 1 --2- 172.21.15.139:0/1633875203 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7fbc380395d0 0x7fbc3803ba80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-17T07:12:32.723 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:32.723+0000 7fbc50a14640 1 -- 172.21.15.139:0/1633875203 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fbc4c04b720 con 0x7fbc4c0fc1d0 2024-09-17T07:12:32.723 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:32.723+0000 7fbc42ffd640 1 -- 172.21.15.139:0/1633875203 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fbc44047e60 con 0x7fbc4c0fc1d0 2024-09-17T07:12:32.724 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:12:32.724 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":1,"fsid":"d5dbf8d6-74c3-11ef-bceb-c7b262605968","modified":"2024-09-17T07:10:32.618802Z","created":"2024-09-17T07:10:32.618802Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi087","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:3300","nonce":0},{"type":"v1","addr":"172.21.15.87:6789","nonce":0}]},"addr":"172.21.15.87:6789/0","public_addr":"172.21.15.87:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T07:12:32.724 INFO:teuthology.orchestra.run.smithi139.stderr:dumped monmap epoch 1 2024-09-17T07:12:32.725 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:32.725+0000 7fbc50a14640 1 -- 172.21.15.139:0/1633875203 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7fbc380395d0 msgr2=0x7fbc3803ba80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T07:12:32.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:32.725+0000 7fbc50a14640 1 --2- 172.21.15.139:0/1633875203 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7fbc380395d0 0x7fbc3803ba80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:12:32.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:32.725+0000 7fbc50a14640 1 -- 172.21.15.139:0/1633875203 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbc4c0fc1d0 msgr2=0x7fbc4c071490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:12:32.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:32.725+0000 7fbc50a14640 1 --2- 172.21.15.139:0/1633875203 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbc4c0fc1d0 0x7fbc4c071490 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbc44004820 tx=0x7fbc44009da0 comp rx=0 tx=0).stop 2024-09-17T07:12:32.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:32.725+0000 7fbc50a14640 1 -- 172.21.15.139:0/1633875203 shutdown_connections 2024-09-17T07:12:32.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:32.725+0000 7fbc50a14640 1 --2- 172.21.15.139:0/1633875203 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7fbc380395d0 0x7fbc3803ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:12:32.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:32.725+0000 7fbc50a14640 1 --2- 172.21.15.139:0/1633875203 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbc4c0fc1d0 0x7fbc4c071490 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:12:32.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:32.725+0000 7fbc50a14640 1 -- 172.21.15.139:0/1633875203 >> 172.21.15.139:0/1633875203 conn(0x7fbc4c0f79b0 msgr2=0x7fbc4c0f8240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:12:32.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:32.725+0000 7fbc50a14640 1 -- 172.21.15.139:0/1633875203 shutdown_connections 2024-09-17T07:12:32.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:32.725+0000 7fbc50a14640 1 -- 172.21.15.139:0/1633875203 wait complete. 2024-09-17T07:12:33.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:33 smithi087 ceph-mon[27636]: from='mgr.14160 172.21.15.87:0/3005432640' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-17T07:12:33.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:33 smithi087 ceph-mon[27636]: mgrmap e14: smithi087.vuvjer(active, since 59s) 2024-09-17T07:12:33.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:33 smithi087 ceph-mon[27636]: from='client.? 172.21.15.139:0/1633875203' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T07:12:34.229 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T07:12:34.229 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T07:12:34.471 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T07:12:34.516 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T07:12:36.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:36.114+0000 7f323ecc5640 1 -- 172.21.15.139:0/1430820609 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f32380fc830 msgr2=0x7f32380fcc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:12:36.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:36.114+0000 7f323ecc5640 1 --2- 172.21.15.139:0/1430820609 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f32380fc830 0x7f32380fcc40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3234004850 tx=0x7f3234009da0 comp rx=0 tx=0).stop 2024-09-17T07:12:36.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:36.114+0000 7f323ecc5640 1 -- 172.21.15.139:0/1430820609 shutdown_connections 2024-09-17T07:12:36.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:36.114+0000 7f323ecc5640 1 --2- 172.21.15.139:0/1430820609 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f32380fc830 0x7f32380fcc40 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:12:36.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:36.114+0000 7f323ecc5640 1 -- 172.21.15.139:0/1430820609 >> 172.21.15.139:0/1430820609 conn(0x7f32380f6040 msgr2=0x7f32380f8450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:12:36.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:36.114+0000 7f323ecc5640 1 -- 172.21.15.139:0/1430820609 shutdown_connections 2024-09-17T07:12:36.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:36.115+0000 7f323ecc5640 1 -- 172.21.15.139:0/1430820609 wait complete. 2024-09-17T07:12:36.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:36.115+0000 7f323ecc5640 1 Processor -- start 2024-09-17T07:12:36.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:36.115+0000 7f323ecc5640 1 -- start start 2024-09-17T07:12:36.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:36.116+0000 7f323ecc5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f32380fc830 0x7f323810e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:12:36.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:36.116+0000 7f323ecc5640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f323810ed80 con 0x7f32380fc830 2024-09-17T07:12:36.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:36.116+0000 7f323ca61640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f32380fc830 0x7f323810e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:12:36.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:36.116+0000 7f323ca61640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f32380fc830 0x7f323810e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.139:36140/0 (socket says 172.21.15.139:36140) 2024-09-17T07:12:36.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:36.116+0000 7f323ca61640 1 -- 172.21.15.139:0/1478036017 learned_addr learned my addr 172.21.15.139:0/1478036017 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-17T07:12:36.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:36.116+0000 7f323ca61640 1 -- 172.21.15.139:0/1478036017 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3234005040 con 0x7f32380fc830 2024-09-17T07:12:36.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:36.116+0000 7f323ca61640 1 --2- 172.21.15.139:0/1478036017 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f32380fc830 0x7f323810e840 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f323400b020 tx=0x7f3234009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:12:36.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:36.116+0000 7f322d7fa640 1 -- 172.21.15.139:0/1478036017 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f32340096a0 con 0x7f32380fc830 2024-09-17T07:12:36.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:36.116+0000 7f322d7fa640 1 -- 172.21.15.139:0/1478036017 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f32340338a0 con 0x7f32380fc830 2024-09-17T07:12:36.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:36.116+0000 7f323ecc5640 1 -- 172.21.15.139:0/1478036017 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f323810ef80 con 0x7f32380fc830 2024-09-17T07:12:36.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:36.116+0000 7f322d7fa640 1 -- 172.21.15.139:0/1478036017 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f323403c830 con 0x7f32380fc830 2024-09-17T07:12:36.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:36.116+0000 7f323ecc5640 1 -- 172.21.15.139:0/1478036017 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f323810f390 con 0x7f32380fc830 2024-09-17T07:12:36.120 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:36.118+0000 7f322d7fa640 1 -- 172.21.15.139:0/1478036017 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 14) v1 ==== 45577+0+0 (secure 0 0 0) 0x7f3234030020 con 0x7f32380fc830 2024-09-17T07:12:36.120 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:36.118+0000 7f323ecc5640 1 -- 172.21.15.139:0/1478036017 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f323805ed70 con 0x7f32380fc830 2024-09-17T07:12:36.120 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:36.118+0000 7f322d7fa640 1 --2- 172.21.15.139:0/1478036017 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f3220039620 0x7f322003bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:12:36.120 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:36.118+0000 7f322d7fa640 1 -- 172.21.15.139:0/1478036017 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f323406bea0 con 0x7f32380fc830 2024-09-17T07:12:36.120 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:36.118+0000 7f322ffff640 1 -- 172.21.15.139:0/1478036017 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f3220039620 msgr2=0x7f322003bad0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.87:6800/2341884603 2024-09-17T07:12:36.120 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:36.118+0000 7f322ffff640 1 --2- 172.21.15.139:0/1478036017 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f3220039620 0x7f322003bad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-17T07:12:36.123 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:36.122+0000 7f322d7fa640 1 -- 172.21.15.139:0/1478036017 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f3234033df0 con 0x7f32380fc830 2024-09-17T07:12:36.320 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:36.319+0000 7f322ffff640 1 -- 172.21.15.139:0/1478036017 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f3220039620 msgr2=0x7f322003bad0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.87:6800/2341884603 2024-09-17T07:12:36.320 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:36.319+0000 7f322ffff640 1 --2- 172.21.15.139:0/1478036017 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f3220039620 0x7f322003bad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-17T07:12:36.336 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:36.335+0000 7f323ecc5640 1 -- 172.21.15.139:0/1478036017 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f323804b720 con 0x7f32380fc830 2024-09-17T07:12:36.336 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:36.335+0000 7f322d7fa640 1 -- 172.21.15.139:0/1478036017 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f3234043ab0 con 0x7f32380fc830 2024-09-17T07:12:36.337 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:12:36.337 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":1,"fsid":"d5dbf8d6-74c3-11ef-bceb-c7b262605968","modified":"2024-09-17T07:10:32.618802Z","created":"2024-09-17T07:10:32.618802Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi087","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:3300","nonce":0},{"type":"v1","addr":"172.21.15.87:6789","nonce":0}]},"addr":"172.21.15.87:6789/0","public_addr":"172.21.15.87:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T07:12:36.337 INFO:teuthology.orchestra.run.smithi139.stderr:dumped monmap epoch 1 2024-09-17T07:12:36.339 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:36.337+0000 7f323ecc5640 1 -- 172.21.15.139:0/1478036017 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f3220039620 msgr2=0x7f322003bad0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T07:12:36.339 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:36.337+0000 7f323ecc5640 1 --2- 172.21.15.139:0/1478036017 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f3220039620 0x7f322003bad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:12:36.339 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:36.337+0000 7f323ecc5640 1 -- 172.21.15.139:0/1478036017 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f32380fc830 msgr2=0x7f323810e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:12:36.339 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:36.337+0000 7f323ecc5640 1 --2- 172.21.15.139:0/1478036017 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f32380fc830 0x7f323810e840 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f323400b020 tx=0x7f3234009da0 comp rx=0 tx=0).stop 2024-09-17T07:12:36.339 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:36.338+0000 7f323ecc5640 1 -- 172.21.15.139:0/1478036017 shutdown_connections 2024-09-17T07:12:36.339 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:36.338+0000 7f323ecc5640 1 --2- 172.21.15.139:0/1478036017 >> [v2:172.21.15.87:6800/2341884603,v1:172.21.15.87:6801/2341884603] conn(0x7f3220039620 0x7f322003bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:12:36.339 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:36.338+0000 7f323ecc5640 1 --2- 172.21.15.139:0/1478036017 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f32380fc830 0x7f323810e840 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:12:36.339 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:36.338+0000 7f323ecc5640 1 -- 172.21.15.139:0/1478036017 >> 172.21.15.139:0/1478036017 conn(0x7f32380f6040 msgr2=0x7f32380f6970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:12:36.339 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:36.338+0000 7f323ecc5640 1 -- 172.21.15.139:0/1478036017 shutdown_connections 2024-09-17T07:12:36.339 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:36.338+0000 7f323ecc5640 1 -- 172.21.15.139:0/1478036017 wait complete. 2024-09-17T07:12:36.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:36 smithi087 ceph-mon[27636]: from='client.? 172.21.15.139:0/1478036017' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T07:12:37.647 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:37 smithi087 ceph-mon[27636]: Active manager daemon smithi087.vuvjer restarted 2024-09-17T07:12:37.648 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:37 smithi087 ceph-mon[27636]: Activating manager daemon smithi087.vuvjer 2024-09-17T07:12:37.648 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:37 smithi087 ceph-mon[27636]: osdmap e5: 0 total, 0 up, 0 in 2024-09-17T07:12:37.648 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:37 smithi087 ceph-mon[27636]: mgrmap e15: smithi087.vuvjer(active, starting, since 0.00825117s) 2024-09-17T07:12:37.648 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:37 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mon metadata", "id": "smithi087"}]: dispatch 2024-09-17T07:12:37.648 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:37 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mgr metadata", "who": "smithi087.vuvjer", "id": "smithi087.vuvjer"}]: dispatch 2024-09-17T07:12:37.648 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:37 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T07:12:37.648 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:37 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T07:12:37.648 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:37 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T07:12:37.648 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:37 smithi087 ceph-mon[27636]: Manager daemon smithi087.vuvjer is now available 2024-09-17T07:12:37.648 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:37 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:12:37.649 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:37 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:12:37.649 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:37 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:12:37.649 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:37 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi087.vuvjer/mirror_snapshot_schedule"}]: dispatch 2024-09-17T07:12:37.649 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:37 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi087.vuvjer/trash_purge_schedule"}]: dispatch 2024-09-17T07:12:37.649 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:37 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:12:37.992 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T07:12:37.992 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T07:12:38.229 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T07:12:38.273 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T07:12:38.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:38 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:12:38.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:38 smithi087 ceph-mon[27636]: mgrmap e16: smithi087.vuvjer(active, since 1.0089s) 2024-09-17T07:12:38.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:38 smithi087 ceph-mon[27636]: [17/Sep/2024:07:12:37] ENGINE Bus STARTING 2024-09-17T07:12:38.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:38 smithi087 ceph-mon[27636]: [17/Sep/2024:07:12:37] ENGINE Serving on https://172.21.15.87:7150 2024-09-17T07:12:38.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:38 smithi087 ceph-mon[27636]: [17/Sep/2024:07:12:37] ENGINE Bus STARTED 2024-09-17T07:12:38.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:38 smithi087 ceph-mon[27636]: [17/Sep/2024:07:12:37] ENGINE Error in HTTPServer.serve 2024-09-17T07:12:38.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Traceback (most recent call last): 2024-09-17T07:12:38.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T07:12:38.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: self._connections.run(self.expiration_interval) 2024-09-17T07:12:38.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T07:12:38.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: self._run(expiration_interval) 2024-09-17T07:12:38.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T07:12:38.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T07:12:38.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T07:12:38.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T07:12:38.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T07:12:38.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: s = self.context.wrap_socket( 2024-09-17T07:12:38.678 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T07:12:38.678 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: return self.sslsocket_class._create( 2024-09-17T07:12:38.678 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T07:12:38.678 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: self.do_handshake() 2024-09-17T07:12:38.678 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T07:12:38.678 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: self._sslobj.do_handshake() 2024-09-17T07:12:38.678 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T07:12:38.678 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:38 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:12:38.678 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:38 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:12:40.204 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:40.201+0000 7f86733d1640 1 -- 172.21.15.139:0/3452294553 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f866c0fd810 msgr2=0x7f866c0fdc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:12:40.204 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:40.201+0000 7f86733d1640 1 --2- 172.21.15.139:0/3452294553 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f866c0fd810 0x7f866c0fdc20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8660004850 tx=0x7f8660009da0 comp rx=0 tx=0).stop 2024-09-17T07:12:40.204 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:40.201+0000 7f86733d1640 1 -- 172.21.15.139:0/3452294553 shutdown_connections 2024-09-17T07:12:40.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:40.201+0000 7f86733d1640 1 --2- 172.21.15.139:0/3452294553 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f866c0fd810 0x7f866c0fdc20 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:12:40.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:40.201+0000 7f86733d1640 1 -- 172.21.15.139:0/3452294553 >> 172.21.15.139:0/3452294553 conn(0x7f866c0f6010 msgr2=0x7f866c0f8440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:12:40.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:40.201+0000 7f86733d1640 1 -- 172.21.15.139:0/3452294553 shutdown_connections 2024-09-17T07:12:40.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:40.201+0000 7f86733d1640 1 -- 172.21.15.139:0/3452294553 wait complete. 2024-09-17T07:12:40.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:40.202+0000 7f86733d1640 1 Processor -- start 2024-09-17T07:12:40.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:40.202+0000 7f86733d1640 1 -- start start 2024-09-17T07:12:40.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:40.202+0000 7f86733d1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f866c0fd810 0x7f866c0fcf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:12:40.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:40.202+0000 7f86733d1640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f866c0fd460 con 0x7f866c0fd810 2024-09-17T07:12:40.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:40.202+0000 7f867116d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f866c0fd810 0x7f866c0fcf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:12:40.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:40.202+0000 7f867116d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f866c0fd810 0x7f866c0fcf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.139:36156/0 (socket says 172.21.15.139:36156) 2024-09-17T07:12:40.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:40.202+0000 7f867116d640 1 -- 172.21.15.139:0/3217126542 learned_addr learned my addr 172.21.15.139:0/3217126542 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-17T07:12:40.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:40.202+0000 7f867116d640 1 -- 172.21.15.139:0/3217126542 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8660005040 con 0x7f866c0fd810 2024-09-17T07:12:40.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:40.203+0000 7f867116d640 1 --2- 172.21.15.139:0/3217126542 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f866c0fd810 0x7f866c0fcf20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8660003080 tx=0x7f8660009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:12:40.206 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:40.203+0000 7f865dffb640 1 -- 172.21.15.139:0/3217126542 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8660033420 con 0x7f866c0fd810 2024-09-17T07:12:40.206 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:40.203+0000 7f865dffb640 1 -- 172.21.15.139:0/3217126542 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f8660033a00 con 0x7f866c0fd810 2024-09-17T07:12:40.206 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:40.203+0000 7f86733d1640 1 -- 172.21.15.139:0/3217126542 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f866c0fb4f0 con 0x7f866c0fd810 2024-09-17T07:12:40.206 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:40.203+0000 7f865dffb640 1 -- 172.21.15.139:0/3217126542 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f866003c7d0 con 0x7f866c0fd810 2024-09-17T07:12:40.206 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:40.203+0000 7f86733d1640 1 -- 172.21.15.139:0/3217126542 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f866c0fb960 con 0x7f866c0fd810 2024-09-17T07:12:40.207 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:40.204+0000 7f865dffb640 1 -- 172.21.15.139:0/3217126542 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 17) v1 ==== 45620+0+0 (secure 0 0 0) 0x7f8660030020 con 0x7f866c0fd810 2024-09-17T07:12:40.207 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:40.204+0000 7f86733d1640 1 -- 172.21.15.139:0/3217126542 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f866c1024b0 con 0x7f866c0fd810 2024-09-17T07:12:40.207 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:40.204+0000 7f865dffb640 1 --2- 172.21.15.139:0/3217126542 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f8658039670 0x7f865803bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:12:40.207 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:40.204+0000 7f865dffb640 1 -- 172.21.15.139:0/3217126542 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f866006c240 con 0x7f866c0fd810 2024-09-17T07:12:40.207 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:40.204+0000 7f867096c640 1 --2- 172.21.15.139:0/3217126542 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f8658039670 0x7f865803bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:12:40.207 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:40.205+0000 7f867096c640 1 --2- 172.21.15.139:0/3217126542 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f8658039670 0x7f865803bb20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f8668006fd0 tx=0x7f8668006db0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:12:40.209 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:40.209+0000 7f865dffb640 1 -- 172.21.15.139:0/3217126542 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f866003b7e0 con 0x7f866c0fd810 2024-09-17T07:12:40.430 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:40.429+0000 7f86733d1640 1 -- 172.21.15.139:0/3217126542 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f866c05ed70 con 0x7f866c0fd810 2024-09-17T07:12:40.430 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:40.429+0000 7f865dffb640 1 -- 172.21.15.139:0/3217126542 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f8660041070 con 0x7f866c0fd810 2024-09-17T07:12:40.431 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:12:40.431 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":1,"fsid":"d5dbf8d6-74c3-11ef-bceb-c7b262605968","modified":"2024-09-17T07:10:32.618802Z","created":"2024-09-17T07:10:32.618802Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi087","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:3300","nonce":0},{"type":"v1","addr":"172.21.15.87:6789","nonce":0}]},"addr":"172.21.15.87:6789/0","public_addr":"172.21.15.87:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T07:12:40.431 INFO:teuthology.orchestra.run.smithi139.stderr:dumped monmap epoch 1 2024-09-17T07:12:40.433 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:40.432+0000 7f86733d1640 1 -- 172.21.15.139:0/3217126542 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f8658039670 msgr2=0x7f865803bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:12:40.433 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:40.432+0000 7f86733d1640 1 --2- 172.21.15.139:0/3217126542 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f8658039670 0x7f865803bb20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f8668006fd0 tx=0x7f8668006db0 comp rx=0 tx=0).stop 2024-09-17T07:12:40.433 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:40.432+0000 7f86733d1640 1 -- 172.21.15.139:0/3217126542 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f866c0fd810 msgr2=0x7f866c0fcf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:12:40.433 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:40.432+0000 7f86733d1640 1 --2- 172.21.15.139:0/3217126542 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f866c0fd810 0x7f866c0fcf20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8660003080 tx=0x7f8660009da0 comp rx=0 tx=0).stop 2024-09-17T07:12:40.433 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:40.432+0000 7f86733d1640 1 -- 172.21.15.139:0/3217126542 shutdown_connections 2024-09-17T07:12:40.433 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:40.432+0000 7f86733d1640 1 --2- 172.21.15.139:0/3217126542 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f8658039670 0x7f865803bb20 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:12:40.434 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:40.432+0000 7f86733d1640 1 --2- 172.21.15.139:0/3217126542 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f866c0fd810 0x7f866c0fcf20 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:12:40.434 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:40.432+0000 7f86733d1640 1 -- 172.21.15.139:0/3217126542 >> 172.21.15.139:0/3217126542 conn(0x7f866c0f6010 msgr2=0x7f866c0f68b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:12:40.434 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:40.432+0000 7f86733d1640 1 -- 172.21.15.139:0/3217126542 shutdown_connections 2024-09-17T07:12:40.434 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:40.432+0000 7f86733d1640 1 -- 172.21.15.139:0/3217126542 wait complete. 2024-09-17T07:12:40.541 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:40 smithi087 ceph-mon[27636]: mgrmap e17: smithi087.vuvjer(active, since 2s) 2024-09-17T07:12:40.541 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:40 smithi087 ceph-mon[27636]: from='client.? 172.21.15.139:0/3217126542' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T07:12:42.090 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T07:12:42.090 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T07:12:42.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:41 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:12:42.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:41 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:12:42.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:41 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:12:42.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:41 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:12:42.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:41 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "who": "osd/host:smithi087", "name": "osd_memory_target"}]: dispatch 2024-09-17T07:12:42.666 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T07:12:42.719 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T07:12:43.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:43 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:12:43.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:43 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:12:43.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:43 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:12:43.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:43 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:12:43.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:43 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "who": "osd/host:smithi139", "name": "osd_memory_target"}]: dispatch 2024-09-17T07:12:43.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:43 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:12:43.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:43 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:12:43.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:43 smithi087 ceph-mon[27636]: Updating smithi087:/etc/ceph/ceph.conf 2024-09-17T07:12:43.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:43 smithi087 ceph-mon[27636]: Updating smithi139:/etc/ceph/ceph.conf 2024-09-17T07:12:43.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:43 smithi087 ceph-mon[27636]: Updating smithi087:/var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T07:12:43.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:43 smithi087 ceph-mon[27636]: Updating smithi139:/var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T07:12:43.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:43 smithi087 ceph-mon[27636]: Updating smithi087:/etc/ceph/ceph.client.admin.keyring 2024-09-17T07:12:43.928 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:43 smithi087 ceph-mon[27636]: Updating smithi139:/etc/ceph/ceph.client.admin.keyring 2024-09-17T07:12:43.928 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:43 smithi087 ceph-mon[27636]: Updating smithi087:/var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T07:12:43.928 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:43 smithi087 ceph-mon[27636]: Updating smithi139:/var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T07:12:43.928 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:43 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:12:43.928 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:43 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:12:43.928 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:43 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:12:43.928 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:43 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:12:43.928 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:43 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:12:43.928 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:43 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi139", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-17T07:12:43.928 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:43 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi139", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-17T07:12:43.928 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:43 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:12:44.257 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:44.251+0000 7fb918644640 1 -- 172.21.15.139:0/478657440 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9101010d0 msgr2=0x7fb9101014a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:12:44.257 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:44.251+0000 7fb918644640 1 --2- 172.21.15.139:0/478657440 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9101010d0 0x7fb9101014a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb90c004850 tx=0x7fb90c009da0 comp rx=0 tx=0).stop 2024-09-17T07:12:44.257 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:44.251+0000 7fb918644640 1 -- 172.21.15.139:0/478657440 shutdown_connections 2024-09-17T07:12:44.257 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:44.251+0000 7fb918644640 1 --2- 172.21.15.139:0/478657440 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9101010d0 0x7fb9101014a0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:12:44.257 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:44.251+0000 7fb918644640 1 -- 172.21.15.139:0/478657440 >> 172.21.15.139:0/478657440 conn(0x7fb9100f6ca0 msgr2=0x7fb9100f90b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:12:44.257 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:44.251+0000 7fb918644640 1 -- 172.21.15.139:0/478657440 shutdown_connections 2024-09-17T07:12:44.257 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:44.251+0000 7fb918644640 1 -- 172.21.15.139:0/478657440 wait complete. 2024-09-17T07:12:44.258 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:44.252+0000 7fb918644640 1 Processor -- start 2024-09-17T07:12:44.258 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:44.252+0000 7fb918644640 1 -- start start 2024-09-17T07:12:44.258 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:44.252+0000 7fb918644640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9101010d0 0x7fb9101126b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:12:44.258 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:44.252+0000 7fb918644640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb910112bf0 con 0x7fb9101010d0 2024-09-17T07:12:44.258 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:44.252+0000 7fb9163e0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9101010d0 0x7fb9101126b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:12:44.258 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:44.252+0000 7fb9163e0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9101010d0 0x7fb9101126b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.139:36174/0 (socket says 172.21.15.139:36174) 2024-09-17T07:12:44.258 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:44.252+0000 7fb9163e0640 1 -- 172.21.15.139:0/3042220833 learned_addr learned my addr 172.21.15.139:0/3042220833 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-17T07:12:44.258 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:44.252+0000 7fb9163e0640 1 -- 172.21.15.139:0/3042220833 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb90c005040 con 0x7fb9101010d0 2024-09-17T07:12:44.258 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:44.253+0000 7fb9163e0640 1 --2- 172.21.15.139:0/3042220833 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9101010d0 0x7fb9101126b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb90c004820 tx=0x7fb90c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:12:44.258 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:44.253+0000 7fb906ffd640 1 -- 172.21.15.139:0/3042220833 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb90c0096a0 con 0x7fb9101010d0 2024-09-17T07:12:44.258 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:44.253+0000 7fb918644640 1 -- 172.21.15.139:0/3042220833 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb910112df0 con 0x7fb9101010d0 2024-09-17T07:12:44.258 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:44.253+0000 7fb906ffd640 1 -- 172.21.15.139:0/3042220833 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fb90c009800 con 0x7fb9101010d0 2024-09-17T07:12:44.258 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:44.253+0000 7fb906ffd640 1 -- 172.21.15.139:0/3042220833 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb90c03c660 con 0x7fb9101010d0 2024-09-17T07:12:44.259 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:44.253+0000 7fb918644640 1 -- 172.21.15.139:0/3042220833 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb910113260 con 0x7fb9101010d0 2024-09-17T07:12:44.259 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:44.254+0000 7fb906ffd640 1 -- 172.21.15.139:0/3042220833 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 17) v1 ==== 45620+0+0 (secure 0 0 0) 0x7fb90c030020 con 0x7fb9101010d0 2024-09-17T07:12:44.259 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:44.254+0000 7fb918644640 1 -- 172.21.15.139:0/3042220833 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9100fc840 con 0x7fb9101010d0 2024-09-17T07:12:44.259 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:44.254+0000 7fb906ffd640 1 --2- 172.21.15.139:0/3042220833 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fb8fc039670 0x7fb8fc03bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:12:44.259 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:44.254+0000 7fb906ffd640 1 -- 172.21.15.139:0/3042220833 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fb90c06c0c0 con 0x7fb9101010d0 2024-09-17T07:12:44.259 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:44.254+0000 7fb915bdf640 1 --2- 172.21.15.139:0/3042220833 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fb8fc039670 0x7fb8fc03bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:12:44.259 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:44.255+0000 7fb915bdf640 1 --2- 172.21.15.139:0/3042220833 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fb8fc039670 0x7fb8fc03bb20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb900006fd0 tx=0x7fb900006db0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:12:44.260 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:44.259+0000 7fb906ffd640 1 -- 172.21.15.139:0/3042220833 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fb90c03b550 con 0x7fb9101010d0 2024-09-17T07:12:44.481 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:44.480+0000 7fb918644640 1 -- 172.21.15.139:0/3042220833 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fb91005ed70 con 0x7fb9101010d0 2024-09-17T07:12:44.482 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:44.481+0000 7fb906ffd640 1 -- 172.21.15.139:0/3042220833 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fb90c041070 con 0x7fb9101010d0 2024-09-17T07:12:44.482 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:12:44.482 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":1,"fsid":"d5dbf8d6-74c3-11ef-bceb-c7b262605968","modified":"2024-09-17T07:10:32.618802Z","created":"2024-09-17T07:10:32.618802Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi087","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:3300","nonce":0},{"type":"v1","addr":"172.21.15.87:6789","nonce":0}]},"addr":"172.21.15.87:6789/0","public_addr":"172.21.15.87:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T07:12:44.482 INFO:teuthology.orchestra.run.smithi139.stderr:dumped monmap epoch 1 2024-09-17T07:12:44.484 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:44.483+0000 7fb918644640 1 -- 172.21.15.139:0/3042220833 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fb8fc039670 msgr2=0x7fb8fc03bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:12:44.484 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:44.483+0000 7fb918644640 1 --2- 172.21.15.139:0/3042220833 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fb8fc039670 0x7fb8fc03bb20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb900006fd0 tx=0x7fb900006db0 comp rx=0 tx=0).stop 2024-09-17T07:12:44.484 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:44.483+0000 7fb918644640 1 -- 172.21.15.139:0/3042220833 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9101010d0 msgr2=0x7fb9101126b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:12:44.484 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:44.483+0000 7fb918644640 1 --2- 172.21.15.139:0/3042220833 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9101010d0 0x7fb9101126b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb90c004820 tx=0x7fb90c009da0 comp rx=0 tx=0).stop 2024-09-17T07:12:44.484 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:44.483+0000 7fb918644640 1 -- 172.21.15.139:0/3042220833 shutdown_connections 2024-09-17T07:12:44.484 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:44.483+0000 7fb918644640 1 --2- 172.21.15.139:0/3042220833 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fb8fc039670 0x7fb8fc03bb20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:12:44.484 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:44.483+0000 7fb918644640 1 --2- 172.21.15.139:0/3042220833 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9101010d0 0x7fb9101126b0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:12:44.484 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:44.483+0000 7fb918644640 1 -- 172.21.15.139:0/3042220833 >> 172.21.15.139:0/3042220833 conn(0x7fb9100f6ca0 msgr2=0x7fb910065940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:12:44.484 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:44.483+0000 7fb918644640 1 -- 172.21.15.139:0/3042220833 shutdown_connections 2024-09-17T07:12:44.485 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:44.483+0000 7fb918644640 1 -- 172.21.15.139:0/3042220833 wait complete. 2024-09-17T07:12:44.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:44 smithi087 ceph-mon[27636]: Deploying daemon crash.smithi139 on smithi139 2024-09-17T07:12:44.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:44 smithi087 ceph-mon[27636]: from='client.? 172.21.15.139:0/3042220833' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T07:12:46.382 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T07:12:46.382 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T07:12:46.629 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T07:12:48.487 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:48.467+0000 7f9982a95640 1 -- 172.21.15.139:0/4235961842 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f997c1021e0 msgr2=0x7f997c1025b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:12:48.487 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:48.467+0000 7f9982a95640 1 --2- 172.21.15.139:0/4235961842 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f997c1021e0 0x7f997c1025b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9970004850 tx=0x7f9970009da0 comp rx=0 tx=0).stop 2024-09-17T07:12:48.488 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:48.467+0000 7f9982a95640 1 -- 172.21.15.139:0/4235961842 shutdown_connections 2024-09-17T07:12:48.488 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:48.467+0000 7f9982a95640 1 --2- 172.21.15.139:0/4235961842 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f997c1021e0 0x7f997c1025b0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:12:48.488 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:48.467+0000 7f9982a95640 1 -- 172.21.15.139:0/4235961842 >> 172.21.15.139:0/4235961842 conn(0x7f997c0710b0 msgr2=0x7f997c0714b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:12:48.488 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:48.467+0000 7f9982a95640 1 -- 172.21.15.139:0/4235961842 shutdown_connections 2024-09-17T07:12:48.488 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:48.467+0000 7f9982a95640 1 -- 172.21.15.139:0/4235961842 wait complete. 2024-09-17T07:12:48.488 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:48.468+0000 7f9982a95640 1 Processor -- start 2024-09-17T07:12:48.488 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:48.468+0000 7f9982a95640 1 -- start start 2024-09-17T07:12:48.488 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:48.468+0000 7f9982a95640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f997c1021e0 0x7f997c1126a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:12:48.488 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:48.468+0000 7f9982a95640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f997c112be0 con 0x7f997c1021e0 2024-09-17T07:12:48.488 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:48.469+0000 7f9980831640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f997c1021e0 0x7f997c1126a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:12:48.488 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:48.469+0000 7f9980831640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f997c1021e0 0x7f997c1126a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.139:59980/0 (socket says 172.21.15.139:59980) 2024-09-17T07:12:48.488 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:48.469+0000 7f9980831640 1 -- 172.21.15.139:0/731414199 learned_addr learned my addr 172.21.15.139:0/731414199 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-17T07:12:48.489 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:48.469+0000 7f9980831640 1 -- 172.21.15.139:0/731414199 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9970005040 con 0x7f997c1021e0 2024-09-17T07:12:48.489 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:48.469+0000 7f9980831640 1 --2- 172.21.15.139:0/731414199 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f997c1021e0 0x7f997c1126a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9970004820 tx=0x7f9970009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:12:48.489 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:48.469+0000 7f99797fa640 1 -- 172.21.15.139:0/731414199 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f99700096a0 con 0x7f997c1021e0 2024-09-17T07:12:48.489 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:48.469+0000 7f9982a95640 1 -- 172.21.15.139:0/731414199 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f997c112de0 con 0x7f997c1021e0 2024-09-17T07:12:48.489 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:48.470+0000 7f99797fa640 1 -- 172.21.15.139:0/731414199 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f9970009800 con 0x7f997c1021e0 2024-09-17T07:12:48.489 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:48.470+0000 7f99797fa640 1 -- 172.21.15.139:0/731414199 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f997003c660 con 0x7f997c1021e0 2024-09-17T07:12:48.489 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:48.470+0000 7f9982a95640 1 -- 172.21.15.139:0/731414199 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f997c1131d0 con 0x7f997c1021e0 2024-09-17T07:12:48.489 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:48.471+0000 7f99797fa640 1 -- 172.21.15.139:0/731414199 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 17) v1 ==== 45620+0+0 (secure 0 0 0) 0x7f9970030020 con 0x7f997c1021e0 2024-09-17T07:12:48.489 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:48.471+0000 7f99797fa640 1 --2- 172.21.15.139:0/731414199 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f996c039670 0x7f996c03bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:12:48.489 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:48.471+0000 7f99797fa640 1 -- 172.21.15.139:0/731414199 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f997006c0b0 con 0x7f997c1021e0 2024-09-17T07:12:48.489 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:48.471+0000 7f9982a95640 1 -- 172.21.15.139:0/731414199 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f997c0fd950 con 0x7f997c1021e0 2024-09-17T07:12:48.489 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:48.471+0000 7f997bfff640 1 --2- 172.21.15.139:0/731414199 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f996c039670 0x7f996c03bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:12:48.489 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:48.471+0000 7f997bfff640 1 --2- 172.21.15.139:0/731414199 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f996c039670 0x7f996c03bb20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9968006fd0 tx=0x7f9968006db0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:12:48.490 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:48.476+0000 7f99797fa640 1 -- 172.21.15.139:0/731414199 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f9970041080 con 0x7f997c1021e0 2024-09-17T07:12:48.716 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:48.714+0000 7f9982a95640 1 -- 172.21.15.139:0/731414199 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f997c10dd10 con 0x7f997c1021e0 2024-09-17T07:12:48.716 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:48.715+0000 7f99797fa640 1 -- 172.21.15.139:0/731414199 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f99700323d0 con 0x7f997c1021e0 2024-09-17T07:12:48.717 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:12:48.717 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":1,"fsid":"d5dbf8d6-74c3-11ef-bceb-c7b262605968","modified":"2024-09-17T07:10:32.618802Z","created":"2024-09-17T07:10:32.618802Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi087","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:3300","nonce":0},{"type":"v1","addr":"172.21.15.87:6789","nonce":0}]},"addr":"172.21.15.87:6789/0","public_addr":"172.21.15.87:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T07:12:48.717 INFO:teuthology.orchestra.run.smithi139.stderr:dumped monmap epoch 1 2024-09-17T07:12:48.719 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:48.718+0000 7f9982a95640 1 -- 172.21.15.139:0/731414199 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f996c039670 msgr2=0x7f996c03bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:12:48.719 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:48.718+0000 7f9982a95640 1 --2- 172.21.15.139:0/731414199 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f996c039670 0x7f996c03bb20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9968006fd0 tx=0x7f9968006db0 comp rx=0 tx=0).stop 2024-09-17T07:12:48.719 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:48.718+0000 7f9982a95640 1 -- 172.21.15.139:0/731414199 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f997c1021e0 msgr2=0x7f997c1126a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:12:48.719 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:48.718+0000 7f9982a95640 1 --2- 172.21.15.139:0/731414199 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f997c1021e0 0x7f997c1126a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9970004820 tx=0x7f9970009da0 comp rx=0 tx=0).stop 2024-09-17T07:12:48.719 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:48.718+0000 7f9982a95640 1 -- 172.21.15.139:0/731414199 shutdown_connections 2024-09-17T07:12:48.720 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:48.718+0000 7f9982a95640 1 --2- 172.21.15.139:0/731414199 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f996c039670 0x7f996c03bb20 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:12:48.720 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:48.718+0000 7f9982a95640 1 --2- 172.21.15.139:0/731414199 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f997c1021e0 0x7f997c1126a0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:12:48.720 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:48.718+0000 7f9982a95640 1 -- 172.21.15.139:0/731414199 >> 172.21.15.139:0/731414199 conn(0x7f997c0710b0 msgr2=0x7f997c0fa1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:12:48.720 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:48.718+0000 7f9982a95640 1 -- 172.21.15.139:0/731414199 shutdown_connections 2024-09-17T07:12:48.720 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:48.718+0000 7f9982a95640 1 -- 172.21.15.139:0/731414199 wait complete. 2024-09-17T07:12:49.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:49 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:12:49.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:49 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:12:49.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:49 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:12:49.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:49 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:12:49.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:49 smithi087 ceph-mon[27636]: from='client.? 172.21.15.139:0/731414199' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T07:12:50.366 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T07:12:50.367 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T07:12:50.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:50 smithi087 ceph-mon[27636]: Deploying daemon node-exporter.smithi139 on smithi139 2024-09-17T07:12:51.308 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T07:12:52.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:52 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:12:52.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:52 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:12:53.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:53 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:12:53.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:53 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:12:53.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:53 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:12:53.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:53 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:12:53.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:53 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi139.tuqnpn", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T07:12:53.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:53 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi139.tuqnpn", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-17T07:12:53.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:53 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T07:12:53.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:53 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:12:53.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:53 smithi087 ceph-mon[27636]: Deploying daemon mgr.smithi139.tuqnpn on smithi139 2024-09-17T07:12:54.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:53.529+0000 7f3398e9e640 1 -- 172.21.15.139:0/3333182421 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3394102200 msgr2=0x7f33941025d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:12:54.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:53.529+0000 7f3398e9e640 1 --2- 172.21.15.139:0/3333182421 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3394102200 0x7f33941025d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3384004850 tx=0x7f3384009da0 comp rx=0 tx=0).stop 2024-09-17T07:12:54.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:53.529+0000 7f3398e9e640 1 -- 172.21.15.139:0/3333182421 shutdown_connections 2024-09-17T07:12:54.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:53.529+0000 7f3398e9e640 1 --2- 172.21.15.139:0/3333182421 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3394102200 0x7f33941025d0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:12:54.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:53.529+0000 7f3398e9e640 1 -- 172.21.15.139:0/3333182421 >> 172.21.15.139:0/3333182421 conn(0x7f33940f7dd0 msgr2=0x7f33940fa1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:12:54.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:53.529+0000 7f3398e9e640 1 -- 172.21.15.139:0/3333182421 shutdown_connections 2024-09-17T07:12:54.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:53.529+0000 7f3398e9e640 1 -- 172.21.15.139:0/3333182421 wait complete. 2024-09-17T07:12:54.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:53.530+0000 7f3398e9e640 1 Processor -- start 2024-09-17T07:12:54.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:53.530+0000 7f3398e9e640 1 -- start start 2024-09-17T07:12:54.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:53.530+0000 7f3398e9e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3394102200 0x7f3394112680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:12:54.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:53.530+0000 7f3398e9e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3394112bc0 con 0x7f3394102200 2024-09-17T07:12:54.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:53.530+0000 7f339259c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3394102200 0x7f3394112680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:12:54.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:53.530+0000 7f339259c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3394102200 0x7f3394112680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.139:59992/0 (socket says 172.21.15.139:59992) 2024-09-17T07:12:54.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:53.530+0000 7f339259c640 1 -- 172.21.15.139:0/2334877419 learned_addr learned my addr 172.21.15.139:0/2334877419 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-17T07:12:54.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:53.531+0000 7f339259c640 1 -- 172.21.15.139:0/2334877419 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3384005040 con 0x7f3394102200 2024-09-17T07:12:54.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:53.531+0000 7f339259c640 1 --2- 172.21.15.139:0/2334877419 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3394102200 0x7f3394112680 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3384000c00 tx=0x7f3384009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:12:54.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:53.531+0000 7f3382ffd640 1 -- 172.21.15.139:0/2334877419 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f33840096c0 con 0x7f3394102200 2024-09-17T07:12:54.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:53.531+0000 7f3398e9e640 1 -- 172.21.15.139:0/2334877419 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3394112dc0 con 0x7f3394102200 2024-09-17T07:12:54.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:53.531+0000 7f3398e9e640 1 -- 172.21.15.139:0/2334877419 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3394113230 con 0x7f3394102200 2024-09-17T07:12:54.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:53.531+0000 7f3382ffd640 1 -- 172.21.15.139:0/2334877419 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f3384009820 con 0x7f3394102200 2024-09-17T07:12:54.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:53.531+0000 7f3382ffd640 1 -- 172.21.15.139:0/2334877419 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f33840336f0 con 0x7f3394102200 2024-09-17T07:12:54.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:53.532+0000 7f3398e9e640 1 -- 172.21.15.139:0/2334877419 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3374005210 con 0x7f3394102200 2024-09-17T07:12:54.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:53.532+0000 7f3382ffd640 1 -- 172.21.15.139:0/2334877419 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 17) v1 ==== 45620+0+0 (secure 0 0 0) 0x7f3384030020 con 0x7f3394102200 2024-09-17T07:12:54.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:53.532+0000 7f3382ffd640 1 --2- 172.21.15.139:0/2334877419 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f337c0396c0 0x7f337c03bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:12:54.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:53.532+0000 7f3382ffd640 1 -- 172.21.15.139:0/2334877419 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f338406c7a0 con 0x7f3394102200 2024-09-17T07:12:54.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:53.533+0000 7f3391d9b640 1 --2- 172.21.15.139:0/2334877419 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f337c0396c0 0x7f337c03bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:12:54.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:53.533+0000 7f3391d9b640 1 --2- 172.21.15.139:0/2334877419 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f337c0396c0 0x7f337c03bb70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3388006fd0 tx=0x7f3388006db0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:12:54.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:53.537+0000 7f3382ffd640 1 -- 172.21.15.139:0/2334877419 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f338403db30 con 0x7f3394102200 2024-09-17T07:12:54.471 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:12:54.471 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":1,"fsid":"d5dbf8d6-74c3-11ef-bceb-c7b262605968","modified":"2024-09-17T07:10:32.618802Z","created":"2024-09-17T07:10:32.618802Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi087","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:3300","nonce":0},{"type":"v1","addr":"172.21.15.87:6789","nonce":0}]},"addr":"172.21.15.87:6789/0","public_addr":"172.21.15.87:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T07:12:54.472 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:53.762+0000 7f3398e9e640 1 -- 172.21.15.139:0/2334877419 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f33740054c0 con 0x7f3394102200 2024-09-17T07:12:54.472 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:53.763+0000 7f3382ffd640 1 -- 172.21.15.139:0/2334877419 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f338403cbc0 con 0x7f3394102200 2024-09-17T07:12:54.472 INFO:teuthology.orchestra.run.smithi139.stderr:dumped monmap epoch 1 2024-09-17T07:12:54.472 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:53.765+0000 7f3398e9e640 1 -- 172.21.15.139:0/2334877419 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f337c0396c0 msgr2=0x7f337c03bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:12:54.472 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:53.765+0000 7f3398e9e640 1 --2- 172.21.15.139:0/2334877419 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f337c0396c0 0x7f337c03bb70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3388006fd0 tx=0x7f3388006db0 comp rx=0 tx=0).stop 2024-09-17T07:12:54.472 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:53.765+0000 7f3398e9e640 1 -- 172.21.15.139:0/2334877419 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3394102200 msgr2=0x7f3394112680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:12:54.472 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:53.765+0000 7f3398e9e640 1 --2- 172.21.15.139:0/2334877419 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3394102200 0x7f3394112680 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3384000c00 tx=0x7f3384009da0 comp rx=0 tx=0).stop 2024-09-17T07:12:54.472 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:53.765+0000 7f3398e9e640 1 -- 172.21.15.139:0/2334877419 shutdown_connections 2024-09-17T07:12:54.472 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:53.765+0000 7f3398e9e640 1 --2- 172.21.15.139:0/2334877419 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f337c0396c0 0x7f337c03bb70 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:12:54.472 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:53.765+0000 7f3398e9e640 1 --2- 172.21.15.139:0/2334877419 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3394102200 0x7f3394112680 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:12:54.472 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:53.765+0000 7f3398e9e640 1 -- 172.21.15.139:0/2334877419 >> 172.21.15.139:0/2334877419 conn(0x7f33940f7dd0 msgr2=0x7f33940f9750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:12:54.472 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:53.766+0000 7f3398e9e640 1 -- 172.21.15.139:0/2334877419 shutdown_connections 2024-09-17T07:12:54.473 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:53.766+0000 7f3398e9e640 1 -- 172.21.15.139:0/2334877419 wait complete. 2024-09-17T07:12:54.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:54 smithi087 ceph-mon[27636]: from='client.? 172.21.15.139:0/2334877419' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T07:12:56.261 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T07:12:56.262 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T07:12:57.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:56 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:12:57.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:56 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:12:57.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:56 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:12:57.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:56 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:12:57.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:56 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T07:12:57.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:56 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:12:57.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:56 smithi087 ceph-mon[27636]: Deploying daemon mon.smithi139 on smithi139 2024-09-17T07:12:57.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:56 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:12:58.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:57 smithi087 ceph-mon[27636]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T07:12:58.381 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/mon.smithi139/config 2024-09-17T07:12:59.987 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:59.985+0000 7f30e34b7640 1 -- 172.21.15.139:0/2640827873 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f30dc1011f0 msgr2=0x7f30dc1015c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:12:59.987 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:59.985+0000 7f30e34b7640 1 --2- 172.21.15.139:0/2640827873 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f30dc1011f0 0x7f30dc1015c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f30d8004850 tx=0x7f30d8009da0 comp rx=0 tx=0).stop 2024-09-17T07:12:59.988 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:59.985+0000 7f30e34b7640 1 -- 172.21.15.139:0/2640827873 shutdown_connections 2024-09-17T07:12:59.988 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:59.985+0000 7f30e34b7640 1 --2- 172.21.15.139:0/2640827873 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f30dc1011f0 0x7f30dc1015c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:12:59.988 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:59.985+0000 7f30e34b7640 1 -- 172.21.15.139:0/2640827873 >> 172.21.15.139:0/2640827873 conn(0x7f30dc0711c0 msgr2=0x7f30dc0715c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:12:59.988 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:59.985+0000 7f30e34b7640 1 -- 172.21.15.139:0/2640827873 shutdown_connections 2024-09-17T07:12:59.988 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:59.985+0000 7f30e34b7640 1 -- 172.21.15.139:0/2640827873 wait complete. 2024-09-17T07:12:59.988 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:59.986+0000 7f30e34b7640 1 Processor -- start 2024-09-17T07:12:59.988 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:59.986+0000 7f30e34b7640 1 -- start start 2024-09-17T07:12:59.988 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:59.986+0000 7f30e34b7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f30dc1011f0 0x7f30dc10d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:12:59.988 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:59.986+0000 7f30e34b7640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30dc10dcf0 con 0x7f30dc1011f0 2024-09-17T07:12:59.988 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:59.986+0000 7f30e1253640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f30dc1011f0 0x7f30dc10d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:12:59.988 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:59.986+0000 7f30e1253640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f30dc1011f0 0x7f30dc10d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.139:40358/0 (socket says 172.21.15.139:40358) 2024-09-17T07:12:59.988 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:59.986+0000 7f30e1253640 1 -- 172.21.15.139:0/3281635786 learned_addr learned my addr 172.21.15.139:0/3281635786 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-17T07:12:59.990 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:59.987+0000 7f30e1253640 1 -- 172.21.15.139:0/3281635786 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30d8005040 con 0x7f30dc1011f0 2024-09-17T07:12:59.990 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:59.987+0000 7f30e1253640 1 --2- 172.21.15.139:0/3281635786 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f30dc1011f0 0x7f30dc10d7b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f30d8004820 tx=0x7f30d8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:12:59.990 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:59.987+0000 7f30d1ffb640 1 -- 172.21.15.139:0/3281635786 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f30d80096a0 con 0x7f30dc1011f0 2024-09-17T07:12:59.990 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:59.987+0000 7f30e34b7640 1 -- 172.21.15.139:0/3281635786 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30dc10def0 con 0x7f30dc1011f0 2024-09-17T07:12:59.990 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:59.987+0000 7f30d1ffb640 1 -- 172.21.15.139:0/3281635786 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f30d8009800 con 0x7f30dc1011f0 2024-09-17T07:12:59.990 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:59.987+0000 7f30d1ffb640 1 -- 172.21.15.139:0/3281635786 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f30d803c660 con 0x7f30dc1011f0 2024-09-17T07:12:59.990 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:59.987+0000 7f30e34b7640 1 -- 172.21.15.139:0/3281635786 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30dc10e360 con 0x7f30dc1011f0 2024-09-17T07:12:59.990 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:59.988+0000 7f30e34b7640 1 -- 172.21.15.139:0/3281635786 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30dc0f9840 con 0x7f30dc1011f0 2024-09-17T07:12:59.990 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:59.988+0000 7f30d1ffb640 1 -- 172.21.15.139:0/3281635786 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 17) v1 ==== 45620+0+0 (secure 0 0 0) 0x7f30d8030020 con 0x7f30dc1011f0 2024-09-17T07:12:59.990 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:59.989+0000 7f30d1ffb640 1 --2- 172.21.15.139:0/3281635786 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f30c8039670 0x7f30c803bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:12:59.991 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:59.989+0000 7f30d1ffb640 1 -- 172.21.15.139:0/3281635786 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f30d806c020 con 0x7f30dc1011f0 2024-09-17T07:12:59.991 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:59.989+0000 7f30e0a52640 1 --2- 172.21.15.139:0/3281635786 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f30c8039670 0x7f30c803bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:12:59.991 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:59.989+0000 7f30e0a52640 1 --2- 172.21.15.139:0/3281635786 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f30c8039670 0x7f30c803bb20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f30cc006fd0 tx=0x7f30cc006db0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:12:59.994 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:12:59.993+0000 7f30d1ffb640 1 -- 172.21.15.139:0/3281635786 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f30d803aaf0 con 0x7f30dc1011f0 2024-09-17T07:13:00.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:12:59 smithi087 ceph-mon[27636]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T07:13:00.223 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:13:00.222+0000 7f30e34b7640 1 -- 172.21.15.139:0/3281635786 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f30dc04b720 con 0x7f30dc1011f0 2024-09-17T07:13:00.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:13:00.223+0000 7f30d1ffb640 1 -- 172.21.15.139:0/3281635786 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f30d8041090 con 0x7f30dc1011f0 2024-09-17T07:13:00.224 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:13:00.224 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":1,"fsid":"d5dbf8d6-74c3-11ef-bceb-c7b262605968","modified":"2024-09-17T07:10:32.618802Z","created":"2024-09-17T07:10:32.618802Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi087","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:3300","nonce":0},{"type":"v1","addr":"172.21.15.87:6789","nonce":0}]},"addr":"172.21.15.87:6789/0","public_addr":"172.21.15.87:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T07:13:00.225 INFO:teuthology.orchestra.run.smithi139.stderr:dumped monmap epoch 1 2024-09-17T07:13:00.227 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:13:00.226+0000 7f30e34b7640 1 -- 172.21.15.139:0/3281635786 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f30c8039670 msgr2=0x7f30c803bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:13:00.227 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:13:00.226+0000 7f30e34b7640 1 --2- 172.21.15.139:0/3281635786 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f30c8039670 0x7f30c803bb20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f30cc006fd0 tx=0x7f30cc006db0 comp rx=0 tx=0).stop 2024-09-17T07:13:00.227 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:13:00.226+0000 7f30e34b7640 1 -- 172.21.15.139:0/3281635786 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f30dc1011f0 msgr2=0x7f30dc10d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:13:00.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:13:00.226+0000 7f30e34b7640 1 --2- 172.21.15.139:0/3281635786 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f30dc1011f0 0x7f30dc10d7b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f30d8004820 tx=0x7f30d8009da0 comp rx=0 tx=0).stop 2024-09-17T07:13:00.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:13:00.226+0000 7f30e34b7640 1 -- 172.21.15.139:0/3281635786 shutdown_connections 2024-09-17T07:13:00.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:13:00.226+0000 7f30e34b7640 1 --2- 172.21.15.139:0/3281635786 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f30c8039670 0x7f30c803bb20 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:13:00.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:13:00.226+0000 7f30e34b7640 1 --2- 172.21.15.139:0/3281635786 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f30dc1011f0 0x7f30dc10d7b0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:13:00.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:13:00.226+0000 7f30e34b7640 1 -- 172.21.15.139:0/3281635786 >> 172.21.15.139:0/3281635786 conn(0x7f30dc0711c0 msgr2=0x7f30dc0fa2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:13:00.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:13:00.226+0000 7f30e34b7640 1 -- 172.21.15.139:0/3281635786 shutdown_connections 2024-09-17T07:13:00.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:13:00.226+0000 7f30e34b7640 1 -- 172.21.15.139:0/3281635786 wait complete. 2024-09-17T07:13:02.104 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T07:13:02.104 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T07:13:02.356 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/mon.smithi139/config 2024-09-17T07:13:05.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:05 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:05.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:05 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mon metadata", "id": "smithi087"}]: dispatch 2024-09-17T07:13:05.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:05 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mon metadata", "id": "smithi139"}]: dispatch 2024-09-17T07:13:05.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:05 smithi087 ceph-mon[27636]: mon.smithi087 calling monitor election 2024-09-17T07:13:05.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:05 smithi087 ceph-mon[27636]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T07:13:05.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:05 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mon metadata", "id": "smithi139"}]: dispatch 2024-09-17T07:13:05.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:05 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mon metadata", "id": "smithi139"}]: dispatch 2024-09-17T07:13:05.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:05 smithi087 ceph-mon[27636]: mon.smithi139 calling monitor election 2024-09-17T07:13:05.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:05 smithi087 ceph-mon[27636]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T07:13:05.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:05 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mon metadata", "id": "smithi139"}]: dispatch 2024-09-17T07:13:05.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:05 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mon metadata", "id": "smithi139"}]: dispatch 2024-09-17T07:13:05.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:05 smithi087 ceph-mon[27636]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T07:13:05.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:05 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mon metadata", "id": "smithi139"}]: dispatch 2024-09-17T07:13:05.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:05 smithi087 ceph-mon[27636]: mon.smithi087 is new leader, mons smithi087,smithi139 in quorum (ranks 0,1) 2024-09-17T07:13:05.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:05 smithi087 ceph-mon[27636]: monmap e2: 2 mons at {smithi087=[v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0],smithi139=[v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-17T07:13:05.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:05 smithi087 ceph-mon[27636]: fsmap 2024-09-17T07:13:05.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:05 smithi087 ceph-mon[27636]: osdmap e5: 0 total, 0 up, 0 in 2024-09-17T07:13:05.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:05 smithi087 ceph-mon[27636]: mgrmap e17: smithi087.vuvjer(active, since 28s) 2024-09-17T07:13:05.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:05 smithi087 ceph-mon[27636]: overall HEALTH_OK 2024-09-17T07:13:05.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:05 smithi087 ceph-mon[27636]: Standby manager daemon smithi139.tuqnpn started 2024-09-17T07:13:05.928 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:05 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:05.928 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:05 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:05.928 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:05 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:05.928 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:05 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:05.928 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:05 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:06.860 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:06 smithi139 ceph-mon[34403]: mgrmap e18: smithi087.vuvjer(active, since 28s), standbys: smithi139.tuqnpn 2024-09-17T07:13:06.860 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:06 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mgr metadata", "who": "smithi139.tuqnpn", "id": "smithi139.tuqnpn"}]: dispatch 2024-09-17T07:13:06.860 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:06 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:13:06.860 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:06 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mon metadata", "id": "smithi139"}]: dispatch 2024-09-17T07:13:06.892 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:13:06.892+0000 7f3cdb849640 1 -- 172.21.15.139:0/2053912440 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3cc00034f0 msgr2=0x7f3cc0005970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:13:06.892 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:13:06.892+0000 7f3cdb849640 1 --2- 172.21.15.139:0/2053912440 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3cc00034f0 0x7f3cc0005970 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3cd40fc270 tx=0x7f3cd000b040 comp rx=0 tx=0).stop 2024-09-17T07:13:06.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:13:06.892+0000 7f3cdb849640 1 -- 172.21.15.139:0/2053912440 shutdown_connections 2024-09-17T07:13:06.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:13:06.892+0000 7f3cdb849640 1 --2- 172.21.15.139:0/2053912440 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3cc00034f0 0x7f3cc0005970 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:13:06.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:13:06.892+0000 7f3cdb849640 1 -- 172.21.15.139:0/2053912440 >> 172.21.15.139:0/2053912440 conn(0x7f3cd40f7f20 msgr2=0x7f3cd40fa330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:13:06.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:13:06.892+0000 7f3cdb849640 1 -- 172.21.15.139:0/2053912440 shutdown_connections 2024-09-17T07:13:06.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:13:06.892+0000 7f3cdb849640 1 -- 172.21.15.139:0/2053912440 wait complete. 2024-09-17T07:13:06.894 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:13:06.893+0000 7f3cdb849640 1 Processor -- start 2024-09-17T07:13:06.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:13:06.893+0000 7f3cdb849640 1 -- start start 2024-09-17T07:13:06.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:13:06.893+0000 7f3cdb849640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3cc00034f0 0x7f3cd4112850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:13:06.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:13:06.893+0000 7f3cdb849640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3cd4112d90 0x7f3cd410c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:13:06.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:13:06.893+0000 7f3cdb849640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd4113350 con 0x7f3cc00034f0 2024-09-17T07:13:06.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:13:06.893+0000 7f3cdb849640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd4113490 con 0x7f3cd4112d90 2024-09-17T07:13:06.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:13:06.893+0000 7f3cd8de4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3cd4112d90 0x7f3cd410c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:13:06.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:13:06.893+0000 7f3cd8de4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3cd4112d90 0x7f3cd410c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41804/0 (socket says 172.21.15.139:41804) 2024-09-17T07:13:06.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:13:06.893+0000 7f3cd8de4640 1 -- 172.21.15.139:0/3645030504 learned_addr learned my addr 172.21.15.139:0/3645030504 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-17T07:13:06.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:13:06.893+0000 7f3cd8de4640 1 -- 172.21.15.139:0/3645030504 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3cd4112d90 msgr2=0x7f3cd410c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-17T07:13:06.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:13:06.893+0000 7f3cd8de4640 1 -- 172.21.15.139:0/3645030504 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3cd4112d90 msgr2=0x7f3cd410c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-17T07:13:06.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:13:06.893+0000 7f3cd8de4640 1 --2- 172.21.15.139:0/3645030504 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3cd4112d90 0x7f3cd410c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-09-17T07:13:06.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:13:06.893+0000 7f3cd8de4640 1 --2- 172.21.15.139:0/3645030504 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3cd4112d90 0x7f3cd410c7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-17T07:13:06.896 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:13:06.893+0000 7f3cd95e5640 1 --2- 172.21.15.139:0/3645030504 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3cc00034f0 0x7f3cd4112850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:13:06.896 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:13:06.894+0000 7f3cd95e5640 1 -- 172.21.15.139:0/3645030504 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3cd4112d90 msgr2=0x7f3cd410c7f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T07:13:06.896 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:13:06.894+0000 7f3cd95e5640 1 --2- 172.21.15.139:0/3645030504 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3cd4112d90 0x7f3cd410c7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:13:06.896 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:13:06.894+0000 7f3cd95e5640 1 -- 172.21.15.139:0/3645030504 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd0005040 con 0x7f3cc00034f0 2024-09-17T07:13:06.896 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:13:06.894+0000 7f3cd95e5640 1 --2- 172.21.15.139:0/3645030504 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3cc00034f0 0x7f3cd4112850 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3cd00043d0 tx=0x7f3cd000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:13:06.896 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:13:06.894+0000 7f3cc9ffb640 1 -- 172.21.15.139:0/3645030504 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3cd00309f0 con 0x7f3cc00034f0 2024-09-17T07:13:06.896 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:13:06.894+0000 7f3cc9ffb640 1 -- 172.21.15.139:0/3645030504 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f3cd000f040 con 0x7f3cc00034f0 2024-09-17T07:13:06.896 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:13:06.894+0000 7f3cdb849640 1 -- 172.21.15.139:0/3645030504 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cd410cdf0 con 0x7f3cc00034f0 2024-09-17T07:13:06.896 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:13:06.894+0000 7f3cc9ffb640 1 -- 172.21.15.139:0/3645030504 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3cd003c410 con 0x7f3cc00034f0 2024-09-17T07:13:06.896 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:13:06.894+0000 7f3cdb849640 1 -- 172.21.15.139:0/3645030504 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cd410d390 con 0x7f3cc00034f0 2024-09-17T07:13:06.897 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:13:06.895+0000 7f3cdb849640 1 -- 172.21.15.139:0/3645030504 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cd40fda80 con 0x7f3cc00034f0 2024-09-17T07:13:06.897 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:13:06.896+0000 7f3cc9ffb640 1 -- 172.21.15.139:0/3645030504 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 18) v1 ==== 90811+0+0 (secure 0 0 0) 0x7f3cd003e440 con 0x7f3cc00034f0 2024-09-17T07:13:06.897 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:13:06.896+0000 7f3cc9ffb640 1 --2- 172.21.15.139:0/3645030504 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f3cb806ee20 0x7f3cb80712d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:13:06.897 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:13:06.897+0000 7f3cc9ffb640 1 -- 172.21.15.139:0/3645030504 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f3cd00ae310 con 0x7f3cc00034f0 2024-09-17T07:13:06.897 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:13:06.897+0000 7f3cd8de4640 1 --2- 172.21.15.139:0/3645030504 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f3cb806ee20 0x7f3cb80712d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:13:06.898 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:13:06.897+0000 7f3cd8de4640 1 --2- 172.21.15.139:0/3645030504 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f3cb806ee20 0x7f3cb80712d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3cc4006fd0 tx=0x7f3cc4008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:13:06.901 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:13:06.901+0000 7f3cc9ffb640 1 -- 172.21.15.139:0/3645030504 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f3cd007c4b0 con 0x7f3cc00034f0 2024-09-17T07:13:06.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:06 smithi087 ceph-mon[27636]: mgrmap e18: smithi087.vuvjer(active, since 28s), standbys: smithi139.tuqnpn 2024-09-17T07:13:06.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:06 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mgr metadata", "who": "smithi139.tuqnpn", "id": "smithi139.tuqnpn"}]: dispatch 2024-09-17T07:13:06.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:06 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:13:06.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:06 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mon metadata", "id": "smithi139"}]: dispatch 2024-09-17T07:13:07.123 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:13:07.123+0000 7f3cdb849640 1 -- 172.21.15.139:0/3645030504 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f3cd404b720 con 0x7f3cc00034f0 2024-09-17T07:13:07.123 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:13:07.123+0000 7f3cc9ffb640 1 -- 172.21.15.139:0/3645030504 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1017 (secure 0 0 0) 0x7f3cd0030e10 con 0x7f3cc00034f0 2024-09-17T07:13:07.124 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-17T07:13:07.124 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":2,"fsid":"d5dbf8d6-74c3-11ef-bceb-c7b262605968","modified":"2024-09-17T07:13:00.399910Z","created":"2024-09-17T07:10:32.618802Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi087","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:3300","nonce":0},{"type":"v1","addr":"172.21.15.87:6789","nonce":0}]},"addr":"172.21.15.87:6789/0","public_addr":"172.21.15.87:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi139","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3300","nonce":0},{"type":"v1","addr":"172.21.15.139:6789","nonce":0}]},"addr":"172.21.15.139:6789/0","public_addr":"172.21.15.139:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-17T07:13:07.124 INFO:teuthology.orchestra.run.smithi139.stderr:dumped monmap epoch 2 2024-09-17T07:13:07.126 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:13:07.126+0000 7f3cdb849640 1 -- 172.21.15.139:0/3645030504 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f3cb806ee20 msgr2=0x7f3cb80712d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:13:07.126 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:13:07.126+0000 7f3cdb849640 1 --2- 172.21.15.139:0/3645030504 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f3cb806ee20 0x7f3cb80712d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3cc4006fd0 tx=0x7f3cc4008040 comp rx=0 tx=0).stop 2024-09-17T07:13:07.126 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:13:07.126+0000 7f3cdb849640 1 -- 172.21.15.139:0/3645030504 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3cc00034f0 msgr2=0x7f3cd4112850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:13:07.126 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:13:07.126+0000 7f3cdb849640 1 --2- 172.21.15.139:0/3645030504 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3cc00034f0 0x7f3cd4112850 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3cd00043d0 tx=0x7f3cd000b040 comp rx=0 tx=0).stop 2024-09-17T07:13:07.126 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:13:07.126+0000 7f3cdb849640 1 -- 172.21.15.139:0/3645030504 shutdown_connections 2024-09-17T07:13:07.126 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:13:07.126+0000 7f3cdb849640 1 --2- 172.21.15.139:0/3645030504 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f3cb806ee20 0x7f3cb80712d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:13:07.126 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:13:07.126+0000 7f3cdb849640 1 --2- 172.21.15.139:0/3645030504 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3cd4112d90 0x7f3cd410c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:13:07.126 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:13:07.126+0000 7f3cdb849640 1 --2- 172.21.15.139:0/3645030504 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3cc00034f0 0x7f3cd4112850 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:13:07.126 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:13:07.126+0000 7f3cdb849640 1 -- 172.21.15.139:0/3645030504 >> 172.21.15.139:0/3645030504 conn(0x7f3cd40f7f20 msgr2=0x7f3cd4101750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:13:07.127 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:13:07.126+0000 7f3cdb849640 1 -- 172.21.15.139:0/3645030504 shutdown_connections 2024-09-17T07:13:07.127 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:13:07.126+0000 7f3cdb849640 1 -- 172.21.15.139:0/3645030504 wait complete. 2024-09-17T07:13:07.716 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:07 smithi139 ceph-mon[34403]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T07:13:07.716 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:07 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:13:07.717 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:07 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:07.717 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:07 smithi139 ceph-mon[34403]: from='client.? 172.21.15.139:0/3645030504' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T07:13:07.740 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-17T07:13:07.740 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -- ceph config generate-minimal-conf 2024-09-17T07:13:07.769 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:07 smithi087 ceph-mon[27636]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T07:13:07.769 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:07 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:13:07.769 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:07 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:07.769 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:07 smithi087 ceph-mon[27636]: from='client.? 172.21.15.139:0/3645030504' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T07:13:08.031 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/mon.smithi087/config 2024-09-17T07:13:09.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:08 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:09.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:08 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:09.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:08 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:13:09.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:08 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:13:09.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:08 smithi139 ceph-mon[34403]: Updating smithi087:/etc/ceph/ceph.conf 2024-09-17T07:13:09.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:08 smithi139 ceph-mon[34403]: Updating smithi139:/etc/ceph/ceph.conf 2024-09-17T07:13:09.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:08 smithi139 ceph-mon[34403]: Updating smithi139:/var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T07:13:09.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:08 smithi139 ceph-mon[34403]: Updating smithi087:/var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T07:13:09.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:08 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:09.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:08 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:09.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:08 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:09.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:08 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:09.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:08 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:09.118 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:08 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T07:13:09.118 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:08 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T07:13:09.118 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:08 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:13:09.153 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:08 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:09.153 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:08 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:09.153 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:08 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:13:09.153 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:08 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:13:09.153 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:08 smithi087 ceph-mon[27636]: Updating smithi087:/etc/ceph/ceph.conf 2024-09-17T07:13:09.153 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:08 smithi087 ceph-mon[27636]: Updating smithi139:/etc/ceph/ceph.conf 2024-09-17T07:13:09.153 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:08 smithi087 ceph-mon[27636]: Updating smithi139:/var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T07:13:09.153 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:08 smithi087 ceph-mon[27636]: Updating smithi087:/var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T07:13:09.153 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:08 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:09.153 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:08 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:09.153 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:08 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:09.154 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:08 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:09.154 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:08 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:09.154 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:08 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T07:13:09.154 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:08 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T07:13:09.154 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:08 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:13:10.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:10 smithi087 ceph-mon[27636]: Reconfiguring mon.smithi087 (unknown last config time)... 2024-09-17T07:13:10.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:10 smithi087 ceph-mon[27636]: Reconfiguring daemon mon.smithi087 on smithi087 2024-09-17T07:13:10.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:10 smithi087 ceph-mon[27636]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T07:13:10.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:10 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:10.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:10 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:10.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:10 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi087.vuvjer", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T07:13:10.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:10 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T07:13:10.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:10 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:13:10.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:10 smithi139 ceph-mon[34403]: Reconfiguring mon.smithi087 (unknown last config time)... 2024-09-17T07:13:10.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:10 smithi139 ceph-mon[34403]: Reconfiguring daemon mon.smithi087 on smithi087 2024-09-17T07:13:10.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:10 smithi139 ceph-mon[34403]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T07:13:10.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:10 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:10.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:10 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:10.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:10 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi087.vuvjer", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T07:13:10.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:10 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T07:13:10.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:10 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:13:11.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:11.269+0000 7f4c84dcc640 1 -- 172.21.15.87:0/209365514 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c800fb480 msgr2=0x7f4c800fb8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:13:11.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:11.269+0000 7f4c84dcc640 1 --2- 172.21.15.87:0/209365514 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c800fb480 0x7f4c800fb8f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4c740048d0 tx=0x7f4c74009da0 comp rx=0 tx=0).stop 2024-09-17T07:13:11.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:11.269+0000 7f4c84dcc640 1 -- 172.21.15.87:0/209365514 shutdown_connections 2024-09-17T07:13:11.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:11.269+0000 7f4c84dcc640 1 --2- 172.21.15.87:0/209365514 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c800fb480 0x7f4c800fb8f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:13:11.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:11.269+0000 7f4c84dcc640 1 --2- 172.21.15.87:0/209365514 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4c801014c0 0x7f4c80101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:13:11.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:11.269+0000 7f4c84dcc640 1 -- 172.21.15.87:0/209365514 >> 172.21.15.87:0/209365514 conn(0x7f4c800f7000 msgr2=0x7f4c800f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:13:11.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:11.269+0000 7f4c84dcc640 1 -- 172.21.15.87:0/209365514 shutdown_connections 2024-09-17T07:13:11.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:11.269+0000 7f4c84dcc640 1 -- 172.21.15.87:0/209365514 wait complete. 2024-09-17T07:13:11.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:11.269+0000 7f4c84dcc640 1 Processor -- start 2024-09-17T07:13:11.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:11.269+0000 7f4c84dcc640 1 -- start start 2024-09-17T07:13:11.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:11.269+0000 7f4c84dcc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c800fb480 0x7f4c80112040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:13:11.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:11.269+0000 7f4c84dcc640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4c801014c0 0x7f4c80112580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:13:11.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:11.270+0000 7f4c84dcc640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c80112c10 con 0x7f4c800fb480 2024-09-17T07:13:11.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:11.270+0000 7f4c84dcc640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8010bfc0 con 0x7f4c801014c0 2024-09-17T07:13:11.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:11.270+0000 7f4c7e59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c800fb480 0x7f4c80112040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:13:11.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:11.270+0000 7f4c7e59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c800fb480 0x7f4c80112040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:34318/0 (socket says 172.21.15.87:34318) 2024-09-17T07:13:11.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:11.270+0000 7f4c7e59c640 1 -- 172.21.15.87:0/1947538790 learned_addr learned my addr 172.21.15.87:0/1947538790 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:13:11.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:11.270+0000 7f4c7dd9b640 1 --2- 172.21.15.87:0/1947538790 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4c801014c0 0x7f4c80112580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:13:11.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:11.270+0000 7f4c7e59c640 1 -- 172.21.15.87:0/1947538790 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4c801014c0 msgr2=0x7f4c80112580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:13:11.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:11.270+0000 7f4c7e59c640 1 --2- 172.21.15.87:0/1947538790 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4c801014c0 0x7f4c80112580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:13:11.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:11.270+0000 7f4c7e59c640 1 -- 172.21.15.87:0/1947538790 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c74005040 con 0x7f4c800fb480 2024-09-17T07:13:11.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:11.270+0000 7f4c7e59c640 1 --2- 172.21.15.87:0/1947538790 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c800fb480 0x7f4c80112040 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4c7000b790 tx=0x7f4c700091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:13:11.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:11.270+0000 7f4c6effd640 1 -- 172.21.15.87:0/1947538790 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c7000c700 con 0x7f4c800fb480 2024-09-17T07:13:11.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:11.270+0000 7f4c6effd640 1 -- 172.21.15.87:0/1947538790 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f4c7000cce0 con 0x7f4c800fb480 2024-09-17T07:13:11.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:11.270+0000 7f4c84dcc640 1 -- 172.21.15.87:0/1947538790 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c8010c2a0 con 0x7f4c800fb480 2024-09-17T07:13:11.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:11.270+0000 7f4c6effd640 1 -- 172.21.15.87:0/1947538790 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c70015e30 con 0x7f4c800fb480 2024-09-17T07:13:11.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:11.270+0000 7f4c84dcc640 1 -- 172.21.15.87:0/1947538790 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c8010c7c0 con 0x7f4c800fb480 2024-09-17T07:13:11.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:11.271+0000 7f4c84dcc640 1 -- 172.21.15.87:0/1947538790 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c800fcbc0 con 0x7f4c800fb480 2024-09-17T07:13:11.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:11.272+0000 7f4c6effd640 1 -- 172.21.15.87:0/1947538790 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 18) v1 ==== 90811+0+0 (secure 0 0 0) 0x7f4c70012070 con 0x7f4c800fb480 2024-09-17T07:13:11.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:11.272+0000 7f4c6effd640 1 --2- 172.21.15.87:0/1947538790 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f4c6806ecc0 0x7f4c68071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:13:11.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:11.272+0000 7f4c6effd640 1 -- 172.21.15.87:0/1947538790 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f4c7008c9d0 con 0x7f4c800fb480 2024-09-17T07:13:11.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:11.272+0000 7f4c7dd9b640 1 --2- 172.21.15.87:0/1947538790 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f4c6806ecc0 0x7f4c68071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:13:11.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:11.273+0000 7f4c7dd9b640 1 --2- 172.21.15.87:0/1947538790 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f4c6806ecc0 0x7f4c68071170 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4c8010d900 tx=0x7f4c74035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:13:11.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:11.276+0000 7f4c6effd640 1 -- 172.21.15.87:0/1947538790 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f4c7005abd0 con 0x7f4c800fb480 2024-09-17T07:13:11.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:11.440+0000 7f4c84dcc640 1 -- 172.21.15.87:0/1947538790 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f4c8004b770 con 0x7f4c800fb480 2024-09-17T07:13:11.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:11.441+0000 7f4c6effd640 1 -- 172.21.15.87:0/1947538790 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v10) v1 ==== 76+0+225 (secure 0 0 0) 0x7f4c7008c180 con 0x7f4c800fb480 2024-09-17T07:13:11.441 INFO:teuthology.orchestra.run.smithi087.stdout:# minimal ceph.conf for d5dbf8d6-74c3-11ef-bceb-c7b262605968 2024-09-17T07:13:11.441 INFO:teuthology.orchestra.run.smithi087.stdout:[global] 2024-09-17T07:13:11.441 INFO:teuthology.orchestra.run.smithi087.stdout: fsid = d5dbf8d6-74c3-11ef-bceb-c7b262605968 2024-09-17T07:13:11.441 INFO:teuthology.orchestra.run.smithi087.stdout: mon_host = [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] 2024-09-17T07:13:11.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:11.443+0000 7f4c84dcc640 1 -- 172.21.15.87:0/1947538790 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f4c6806ecc0 msgr2=0x7f4c68071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:13:11.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:11.443+0000 7f4c84dcc640 1 --2- 172.21.15.87:0/1947538790 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f4c6806ecc0 0x7f4c68071170 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4c8010d900 tx=0x7f4c74035040 comp rx=0 tx=0).stop 2024-09-17T07:13:11.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:11.443+0000 7f4c84dcc640 1 -- 172.21.15.87:0/1947538790 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c800fb480 msgr2=0x7f4c80112040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:13:11.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:11.443+0000 7f4c84dcc640 1 --2- 172.21.15.87:0/1947538790 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c800fb480 0x7f4c80112040 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4c7000b790 tx=0x7f4c700091d0 comp rx=0 tx=0).stop 2024-09-17T07:13:11.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:11.443+0000 7f4c84dcc640 1 -- 172.21.15.87:0/1947538790 shutdown_connections 2024-09-17T07:13:11.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:11.443+0000 7f4c84dcc640 1 --2- 172.21.15.87:0/1947538790 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f4c6806ecc0 0x7f4c68071170 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:13:11.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:11.443+0000 7f4c84dcc640 1 --2- 172.21.15.87:0/1947538790 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4c801014c0 0x7f4c80112580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:13:11.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:11.443+0000 7f4c84dcc640 1 --2- 172.21.15.87:0/1947538790 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c800fb480 0x7f4c80112040 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:13:11.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:11.443+0000 7f4c84dcc640 1 -- 172.21.15.87:0/1947538790 >> 172.21.15.87:0/1947538790 conn(0x7f4c800f7000 msgr2=0x7f4c800fef90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:13:11.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:11.443+0000 7f4c84dcc640 1 -- 172.21.15.87:0/1947538790 shutdown_connections 2024-09-17T07:13:11.444 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:11 smithi087 ceph-mon[27636]: Reconfiguring mgr.smithi087.vuvjer (unknown last config time)... 2024-09-17T07:13:11.444 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:11 smithi087 ceph-mon[27636]: Reconfiguring daemon mgr.smithi087.vuvjer on smithi087 2024-09-17T07:13:11.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:11.443+0000 7f4c84dcc640 1 -- 172.21.15.87:0/1947538790 wait complete. 2024-09-17T07:13:11.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:11 smithi139 ceph-mon[34403]: Reconfiguring mgr.smithi087.vuvjer (unknown last config time)... 2024-09-17T07:13:11.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:11 smithi139 ceph-mon[34403]: Reconfiguring daemon mgr.smithi087.vuvjer on smithi087 2024-09-17T07:13:12.294 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-17T07:13:12.294 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-17T07:13:12.294 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/ceph/ceph.conf 2024-09-17T07:13:12.362 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-17T07:13:12.363 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-17T07:13:12.427 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-17T07:13:12.427 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/etc/ceph/ceph.conf 2024-09-17T07:13:12.455 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-17T07:13:12.455 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-17T07:13:12.520 INFO:tasks.cephadm:Deploying OSDs... 2024-09-17T07:13:12.520 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-17T07:13:12.520 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/scratch_devs of=/dev/stdout 2024-09-17T07:13:12.535 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-17T07:13:12.535 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_1 2024-09-17T07:13:12.592 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-17T07:13:12.592 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T07:13:12.592 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-17T07:13:12.593 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T07:13:12.593 INFO:teuthology.orchestra.run.smithi087.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T07:13:12.593 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2024-09-17 07:12:30.629121895 +0000 2024-09-17T07:13:12.593 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2024-09-17 07:07:29.028244166 +0000 2024-09-17T07:13:12.593 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2024-09-17 07:07:29.028244166 +0000 2024-09-17T07:13:12.593 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: 2024-09-17 07:07:29.028244166 +0000 2024-09-17T07:13:12.593 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-17T07:13:12.603 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:12 smithi087 ceph-mon[27636]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T07:13:12.603 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:12 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/1947538790' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:13:12.603 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:12 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:12.603 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:12 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:12.603 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:12 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi087", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-17T07:13:12.603 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:12 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:13:12.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:12 smithi139 ceph-mon[34403]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T07:13:12.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:12 smithi139 ceph-mon[34403]: from='client.? 172.21.15.87:0/1947538790' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:13:12.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:12 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:12.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:12 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:12.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:12 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi087", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-17T07:13:12.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:12 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:13:12.626 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2024-09-17T07:13:12.627 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2024-09-17T07:13:12.627 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.000191611 s, 2.7 MB/s 2024-09-17T07:13:12.628 DEBUG:teuthology.orchestra.run.smithi087:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-17T07:13:12.683 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_2 2024-09-17T07:13:12.740 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-17T07:13:12.740 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T07:13:12.740 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-17T07:13:12.741 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T07:13:12.741 INFO:teuthology.orchestra.run.smithi087.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T07:13:12.741 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2024-09-17 07:12:30.629121895 +0000 2024-09-17T07:13:12.741 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2024-09-17 07:07:29.356236228 +0000 2024-09-17T07:13:12.741 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2024-09-17 07:07:29.356236228 +0000 2024-09-17T07:13:12.741 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: 2024-09-17 07:07:29.356236228 +0000 2024-09-17T07:13:12.741 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-17T07:13:12.805 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2024-09-17T07:13:12.805 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2024-09-17T07:13:12.805 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.000188865 s, 2.7 MB/s 2024-09-17T07:13:12.806 DEBUG:teuthology.orchestra.run.smithi087:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-17T07:13:12.863 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_3 2024-09-17T07:13:12.919 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-17T07:13:12.919 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T07:13:12.919 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-17T07:13:12.920 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T07:13:12.920 INFO:teuthology.orchestra.run.smithi087.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T07:13:12.920 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2024-09-17 07:12:30.630121871 +0000 2024-09-17T07:13:12.920 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2024-09-17 07:07:29.677228460 +0000 2024-09-17T07:13:12.920 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2024-09-17 07:07:29.677228460 +0000 2024-09-17T07:13:12.920 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: 2024-09-17 07:07:29.677228460 +0000 2024-09-17T07:13:12.920 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-17T07:13:12.983 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2024-09-17T07:13:12.983 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2024-09-17T07:13:12.983 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.000198376 s, 2.6 MB/s 2024-09-17T07:13:12.984 DEBUG:teuthology.orchestra.run.smithi087:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-17T07:13:13.042 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_4 2024-09-17T07:13:13.097 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-17T07:13:13.098 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T07:13:13.098 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-17T07:13:13.098 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T07:13:13.098 INFO:teuthology.orchestra.run.smithi087.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T07:13:13.099 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2024-09-17 07:12:30.630121871 +0000 2024-09-17T07:13:13.099 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2024-09-17 07:07:30.013220329 +0000 2024-09-17T07:13:13.099 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2024-09-17 07:07:30.013220329 +0000 2024-09-17T07:13:13.099 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: 2024-09-17 07:07:30.013220329 +0000 2024-09-17T07:13:13.099 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-17T07:13:13.161 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2024-09-17T07:13:13.161 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2024-09-17T07:13:13.161 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.000194696 s, 2.6 MB/s 2024-09-17T07:13:13.162 DEBUG:teuthology.orchestra.run.smithi087:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-17T07:13:13.220 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-17T07:13:13.220 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/scratch_devs of=/dev/stdout 2024-09-17T07:13:13.237 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-17T07:13:13.237 DEBUG:teuthology.orchestra.run.smithi139:> stat /dev/vg_nvme/lv_1 2024-09-17T07:13:13.294 INFO:teuthology.orchestra.run.smithi139.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-17T07:13:13.295 INFO:teuthology.orchestra.run.smithi139.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T07:13:13.295 INFO:teuthology.orchestra.run.smithi139.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-17T07:13:13.295 INFO:teuthology.orchestra.run.smithi139.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T07:13:13.295 INFO:teuthology.orchestra.run.smithi139.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T07:13:13.295 INFO:teuthology.orchestra.run.smithi139.stdout:Access: 2024-09-17 07:12:58.607495801 +0000 2024-09-17T07:13:13.296 INFO:teuthology.orchestra.run.smithi139.stdout:Modify: 2024-09-17 07:07:29.027833892 +0000 2024-09-17T07:13:13.296 INFO:teuthology.orchestra.run.smithi139.stdout:Change: 2024-09-17 07:07:29.027833892 +0000 2024-09-17T07:13:13.296 INFO:teuthology.orchestra.run.smithi139.stdout: Birth: 2024-09-17 07:07:29.027833892 +0000 2024-09-17T07:13:13.296 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-17T07:13:13.359 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records in 2024-09-17T07:13:13.359 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records out 2024-09-17T07:13:13.359 INFO:teuthology.orchestra.run.smithi139.stderr:512 bytes copied, 0.000235925 s, 2.2 MB/s 2024-09-17T07:13:13.360 DEBUG:teuthology.orchestra.run.smithi139:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-17T07:13:13.417 DEBUG:teuthology.orchestra.run.smithi139:> stat /dev/vg_nvme/lv_2 2024-09-17T07:13:13.473 INFO:teuthology.orchestra.run.smithi139.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-17T07:13:13.473 INFO:teuthology.orchestra.run.smithi139.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T07:13:13.473 INFO:teuthology.orchestra.run.smithi139.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-17T07:13:13.473 INFO:teuthology.orchestra.run.smithi139.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T07:13:13.474 INFO:teuthology.orchestra.run.smithi139.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T07:13:13.474 INFO:teuthology.orchestra.run.smithi139.stdout:Access: 2024-09-17 07:12:58.608495780 +0000 2024-09-17T07:13:13.474 INFO:teuthology.orchestra.run.smithi139.stdout:Modify: 2024-09-17 07:07:29.355826964 +0000 2024-09-17T07:13:13.474 INFO:teuthology.orchestra.run.smithi139.stdout:Change: 2024-09-17 07:07:29.355826964 +0000 2024-09-17T07:13:13.474 INFO:teuthology.orchestra.run.smithi139.stdout: Birth: 2024-09-17 07:07:29.355826964 +0000 2024-09-17T07:13:13.474 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-17T07:13:13.537 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records in 2024-09-17T07:13:13.538 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records out 2024-09-17T07:13:13.538 INFO:teuthology.orchestra.run.smithi139.stderr:512 bytes copied, 0.000189536 s, 2.7 MB/s 2024-09-17T07:13:13.539 DEBUG:teuthology.orchestra.run.smithi139:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-17T07:13:13.595 DEBUG:teuthology.orchestra.run.smithi139:> stat /dev/vg_nvme/lv_3 2024-09-17T07:13:13.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:13 smithi139 ceph-mon[34403]: Reconfiguring crash.smithi087 (monmap changed)... 2024-09-17T07:13:13.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:13 smithi139 ceph-mon[34403]: Reconfiguring daemon crash.smithi087 on smithi087 2024-09-17T07:13:13.631 INFO:teuthology.orchestra.run.smithi139.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-17T07:13:13.631 INFO:teuthology.orchestra.run.smithi139.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T07:13:13.631 INFO:teuthology.orchestra.run.smithi139.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-17T07:13:13.631 INFO:teuthology.orchestra.run.smithi139.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T07:13:13.631 INFO:teuthology.orchestra.run.smithi139.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T07:13:13.631 INFO:teuthology.orchestra.run.smithi139.stdout:Access: 2024-09-17 07:12:58.608495780 +0000 2024-09-17T07:13:13.631 INFO:teuthology.orchestra.run.smithi139.stdout:Modify: 2024-09-17 07:07:29.688819930 +0000 2024-09-17T07:13:13.631 INFO:teuthology.orchestra.run.smithi139.stdout:Change: 2024-09-17 07:07:29.688819930 +0000 2024-09-17T07:13:13.631 INFO:teuthology.orchestra.run.smithi139.stdout: Birth: 2024-09-17 07:07:29.688819930 +0000 2024-09-17T07:13:13.632 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-17T07:13:13.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:13 smithi087 ceph-mon[27636]: Reconfiguring crash.smithi087 (monmap changed)... 2024-09-17T07:13:13.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:13 smithi087 ceph-mon[27636]: Reconfiguring daemon crash.smithi087 on smithi087 2024-09-17T07:13:13.694 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records in 2024-09-17T07:13:13.694 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records out 2024-09-17T07:13:13.695 INFO:teuthology.orchestra.run.smithi139.stderr:512 bytes copied, 0.000216709 s, 2.4 MB/s 2024-09-17T07:13:13.696 DEBUG:teuthology.orchestra.run.smithi139:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-17T07:13:13.751 DEBUG:teuthology.orchestra.run.smithi139:> stat /dev/vg_nvme/lv_4 2024-09-17T07:13:13.807 INFO:teuthology.orchestra.run.smithi139.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-17T07:13:13.807 INFO:teuthology.orchestra.run.smithi139.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T07:13:13.808 INFO:teuthology.orchestra.run.smithi139.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-17T07:13:13.808 INFO:teuthology.orchestra.run.smithi139.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T07:13:13.808 INFO:teuthology.orchestra.run.smithi139.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T07:13:13.808 INFO:teuthology.orchestra.run.smithi139.stdout:Access: 2024-09-17 07:12:58.609495759 +0000 2024-09-17T07:13:13.808 INFO:teuthology.orchestra.run.smithi139.stdout:Modify: 2024-09-17 07:07:30.008813172 +0000 2024-09-17T07:13:13.808 INFO:teuthology.orchestra.run.smithi139.stdout:Change: 2024-09-17 07:07:30.008813172 +0000 2024-09-17T07:13:13.808 INFO:teuthology.orchestra.run.smithi139.stdout: Birth: 2024-09-17 07:07:30.008813172 +0000 2024-09-17T07:13:13.808 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-17T07:13:13.871 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records in 2024-09-17T07:13:13.871 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records out 2024-09-17T07:13:13.871 INFO:teuthology.orchestra.run.smithi139.stderr:512 bytes copied, 0.000288174 s, 1.8 MB/s 2024-09-17T07:13:13.873 DEBUG:teuthology.orchestra.run.smithi139:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-17T07:13:13.930 INFO:tasks.cephadm:Deploying osd.0 on smithi087 with /dev/vg_nvme/lv_4... 2024-09-17T07:13:13.930 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-09-17T07:13:14.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:14 smithi139 ceph-mon[34403]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T07:13:14.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:14 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:14.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:14 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:14.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:14 smithi087 ceph-mon[27636]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T07:13:14.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:14 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:14.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:14 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:15.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:15 smithi087 ceph-mon[27636]: Reconfiguring alertmanager.smithi087 (dependencies changed)... 2024-09-17T07:13:15.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:15 smithi087 ceph-mon[27636]: Reconfiguring daemon alertmanager.smithi087 on smithi087 2024-09-17T07:13:15.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:15 smithi139 ceph-mon[34403]: Reconfiguring alertmanager.smithi087 (dependencies changed)... 2024-09-17T07:13:15.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:15 smithi139 ceph-mon[34403]: Reconfiguring daemon alertmanager.smithi087 on smithi087 2024-09-17T07:13:15.971 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/mon.smithi087/config 2024-09-17T07:13:16.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:16 smithi139 ceph-mon[34403]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T07:13:16.667 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:16 smithi087 ceph-mon[27636]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T07:13:17.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:17 smithi087 ceph-mon[27636]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T07:13:17.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:17 smithi139 ceph-mon[34403]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T07:13:18.317 INFO:teuthology.orchestra.run.smithi087.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-09-17T07:13:18.395 INFO:teuthology.orchestra.run.smithi087.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-09-17T07:13:18.408 INFO:teuthology.orchestra.run.smithi087.stderr: stderr: 10+0 records in 2024-09-17T07:13:18.409 INFO:teuthology.orchestra.run.smithi087.stderr:10+0 records out 2024-09-17T07:13:18.409 INFO:teuthology.orchestra.run.smithi087.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0117336 s, 894 MB/s 2024-09-17T07:13:18.409 INFO:teuthology.orchestra.run.smithi087.stderr:--> Zapping successful for: 2024-09-17T07:13:19.493 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi087:vg_nvme/lv_4 2024-09-17T07:13:19.756 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/mon.smithi087/config 2024-09-17T07:13:19.879 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:19 smithi087 ceph-mon[27636]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T07:13:20.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:19 smithi139 ceph-mon[34403]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T07:13:21.660 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:21 smithi087 ceph-mon[27636]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T07:13:21.661 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:21 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:21.661 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:21 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:21.661 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:21 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:13:21.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:21.978+0000 7f80a1d59640 1 -- 172.21.15.87:0/459865900 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f809c0ff700 msgr2=0x7f809c101ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:13:21.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:21.978+0000 7f80a1d59640 1 --2- 172.21.15.87:0/459865900 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f809c0ff700 0x7f809c101ae0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f80900048d0 tx=0x7f8090009da0 comp rx=0 tx=0).stop 2024-09-17T07:13:21.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:21.978+0000 7f80a1d59640 1 -- 172.21.15.87:0/459865900 shutdown_connections 2024-09-17T07:13:21.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:21.978+0000 7f80a1d59640 1 --2- 172.21.15.87:0/459865900 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f809c0ff700 0x7f809c101ae0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:13:21.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:21.978+0000 7f80a1d59640 1 --2- 172.21.15.87:0/459865900 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f809c0666b0 0x7f809c0ff1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:13:21.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:21.978+0000 7f80a1d59640 1 -- 172.21.15.87:0/459865900 >> 172.21.15.87:0/459865900 conn(0x7f809c0f6c10 msgr2=0x7f809c0f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:13:21.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:21.978+0000 7f80a1d59640 1 -- 172.21.15.87:0/459865900 shutdown_connections 2024-09-17T07:13:21.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:21.978+0000 7f80a1d59640 1 -- 172.21.15.87:0/459865900 wait complete. 2024-09-17T07:13:21.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:21.979+0000 7f80a1d59640 1 Processor -- start 2024-09-17T07:13:21.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:21.979+0000 7f80a1d59640 1 -- start start 2024-09-17T07:13:21.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:21.979+0000 7f80a1d59640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f809c0666b0 0x7f809c10d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:13:21.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:21.979+0000 7f80a1d59640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f809c0ff700 0x7f809c10d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:13:21.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:21.979+0000 7f80a1d59640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f809c10e480 con 0x7f809c0666b0 2024-09-17T07:13:21.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:21.979+0000 7f80a1d59640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f809c10e5f0 con 0x7f809c0ff700 2024-09-17T07:13:21.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:21.979+0000 7f809b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f809c0666b0 0x7f809c10d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:13:21.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:21.979+0000 7f809b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f809c0666b0 0x7f809c10d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47774/0 (socket says 172.21.15.87:47774) 2024-09-17T07:13:21.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:21.979+0000 7f809b7fe640 1 -- 172.21.15.87:0/2152588224 learned_addr learned my addr 172.21.15.87:0/2152588224 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:13:21.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:21.979+0000 7f809affd640 1 --2- 172.21.15.87:0/2152588224 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f809c0ff700 0x7f809c10d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:13:21.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:21.979+0000 7f809b7fe640 1 -- 172.21.15.87:0/2152588224 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f809c0ff700 msgr2=0x7f809c10d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:13:21.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:21.979+0000 7f809b7fe640 1 --2- 172.21.15.87:0/2152588224 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f809c0ff700 0x7f809c10d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:13:21.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:21.979+0000 7f809b7fe640 1 -- 172.21.15.87:0/2152588224 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8090005040 con 0x7f809c0666b0 2024-09-17T07:13:21.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:21.979+0000 7f809affd640 1 --2- 172.21.15.87:0/2152588224 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f809c0ff700 0x7f809c10d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T07:13:21.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:21.980+0000 7f809b7fe640 1 --2- 172.21.15.87:0/2152588224 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f809c0666b0 0x7f809c10d0d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f808c00b580 tx=0x7f808c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:13:21.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:21.980+0000 7f8083fff640 1 -- 172.21.15.87:0/2152588224 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f808c00f570 con 0x7f809c0666b0 2024-09-17T07:13:21.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:21.980+0000 7f8083fff640 1 -- 172.21.15.87:0/2152588224 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f808c00fb50 con 0x7f809c0666b0 2024-09-17T07:13:21.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:21.980+0000 7f80a1d59640 1 -- 172.21.15.87:0/2152588224 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f809c10e8d0 con 0x7f809c0666b0 2024-09-17T07:13:21.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:21.980+0000 7f8083fff640 1 -- 172.21.15.87:0/2152588224 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f808c010c90 con 0x7f809c0666b0 2024-09-17T07:13:21.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:21.980+0000 7f80a1d59640 1 -- 172.21.15.87:0/2152588224 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f809c10edf0 con 0x7f809c0666b0 2024-09-17T07:13:21.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:21.981+0000 7f80a1d59640 1 -- 172.21.15.87:0/2152588224 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f809c1056d0 con 0x7f809c0666b0 2024-09-17T07:13:21.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:21.981+0000 7f8083fff640 1 -- 172.21.15.87:0/2152588224 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 18) v1 ==== 90811+0+0 (secure 0 0 0) 0x7f808c00fcc0 con 0x7f809c0666b0 2024-09-17T07:13:21.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:21.982+0000 7f8083fff640 1 --2- 172.21.15.87:0/2152588224 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f808406ecc0 0x7f8084071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:13:21.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:21.982+0000 7f8083fff640 1 -- 172.21.15.87:0/2152588224 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f808c08cda0 con 0x7f809c0666b0 2024-09-17T07:13:21.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:21.982+0000 7f809affd640 1 --2- 172.21.15.87:0/2152588224 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f808406ecc0 0x7f8084071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:13:21.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:21.982+0000 7f809affd640 1 --2- 172.21.15.87:0/2152588224 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f808406ecc0 0x7f8084071170 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8090009ac0 tx=0x7f8090009da0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:13:21.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:21.986+0000 7f8083fff640 1 -- 172.21.15.87:0/2152588224 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f808c05b0c0 con 0x7f809c0666b0 2024-09-17T07:13:22.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:21 smithi139 ceph-mon[34403]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T07:13:22.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:21 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:22.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:21 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:22.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:21 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:13:22.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:22.165+0000 7f80a1d59640 1 -- 172.21.15.87:0/2152588224 --> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi087:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f809c10f060 con 0x7f808406ecc0 2024-09-17T07:13:22.903 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:22 smithi087 ceph-mon[27636]: Reconfiguring grafana.smithi087 (dependencies changed)... 2024-09-17T07:13:22.903 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:22 smithi087 ceph-mon[27636]: Reconfiguring daemon grafana.smithi087 on smithi087 2024-09-17T07:13:22.903 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:22 smithi087 ceph-mon[27636]: from='client.14242 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi087:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:13:22.903 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:22 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T07:13:22.903 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:22 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T07:13:22.903 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:22 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:13:23.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:22 smithi139 ceph-mon[34403]: Reconfiguring grafana.smithi087 (dependencies changed)... 2024-09-17T07:13:23.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:22 smithi139 ceph-mon[34403]: Reconfiguring daemon grafana.smithi087 on smithi087 2024-09-17T07:13:23.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:22 smithi139 ceph-mon[34403]: from='client.14242 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi087:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:13:23.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:22 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T07:13:23.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:22 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T07:13:23.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:22 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:13:23.903 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:23 smithi087 ceph-mon[27636]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T07:13:24.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:23 smithi139 ceph-mon[34403]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T07:13:25.871 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:25 smithi087 ceph-mon[27636]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T07:13:26.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:25 smithi139 ceph-mon[34403]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T07:13:27.818 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:27 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:27.818 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:27 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:27.818 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:27 smithi087 ceph-mon[27636]: Reconfiguring prometheus.smithi087 (dependencies changed)... 2024-09-17T07:13:27.818 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:27 smithi087 ceph-mon[27636]: Reconfiguring daemon prometheus.smithi087 on smithi087 2024-09-17T07:13:27.818 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:27 smithi087 ceph-mon[27636]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T07:13:27.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:27 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:27.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:27 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:27.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:27 smithi139 ceph-mon[34403]: Reconfiguring prometheus.smithi087 (dependencies changed)... 2024-09-17T07:13:27.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:27 smithi139 ceph-mon[34403]: Reconfiguring daemon prometheus.smithi087 on smithi087 2024-09-17T07:13:27.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:27 smithi139 ceph-mon[34403]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T07:13:28.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:28 smithi139 ceph-mon[34403]: from='client.? 172.21.15.87:0/2351960226' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "aa28f635-8a58-48f8-bd4e-1626b8da9749"}]: dispatch 2024-09-17T07:13:28.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:28 smithi139 ceph-mon[34403]: from='client.? 172.21.15.87:0/2351960226' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "aa28f635-8a58-48f8-bd4e-1626b8da9749"}]': finished 2024-09-17T07:13:28.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:28 smithi139 ceph-mon[34403]: osdmap e6: 1 total, 0 up, 1 in 2024-09-17T07:13:28.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:28 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T07:13:28.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:28 smithi139 ceph-mon[34403]: from='client.? 172.21.15.87:0/2542751597' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T07:13:28.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:28 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/2351960226' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "aa28f635-8a58-48f8-bd4e-1626b8da9749"}]: dispatch 2024-09-17T07:13:28.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:28 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/2351960226' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "aa28f635-8a58-48f8-bd4e-1626b8da9749"}]': finished 2024-09-17T07:13:28.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:28 smithi087 ceph-mon[27636]: osdmap e6: 1 total, 0 up, 1 in 2024-09-17T07:13:28.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:28 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T07:13:28.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:28 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/2542751597' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T07:13:29.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:29 smithi139 ceph-mon[34403]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T07:13:29.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:29 smithi087 ceph-mon[27636]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T07:13:31.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:31 smithi087 ceph-mon[27636]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T07:13:32.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:31 smithi139 ceph-mon[34403]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T07:13:33.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:33 smithi087 ceph-mon[27636]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T07:13:34.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:33 smithi139 ceph-mon[34403]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T07:13:35.883 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:35 smithi087 ceph-mon[27636]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T07:13:36.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:35 smithi139 ceph-mon[34403]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T07:13:36.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:36 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:13:37.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:36 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:13:38.501 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:38 smithi087 ceph-mon[27636]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T07:13:38.501 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:38 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:38.501 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:38 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:38.501 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:38 smithi087 ceph-mon[27636]: Reconfiguring crash.smithi139 (monmap changed)... 2024-09-17T07:13:38.501 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:38 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi139", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-17T07:13:38.501 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:38 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:13:38.501 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:38 smithi087 ceph-mon[27636]: Reconfiguring daemon crash.smithi139 on smithi139 2024-09-17T07:13:38.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:38 smithi139 ceph-mon[34403]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T07:13:38.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:38 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:38.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:38 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:38.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:38 smithi139 ceph-mon[34403]: Reconfiguring crash.smithi139 (monmap changed)... 2024-09-17T07:13:38.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:38 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi139", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-17T07:13:38.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:38 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:13:38.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:38 smithi139 ceph-mon[34403]: Reconfiguring daemon crash.smithi139 on smithi139 2024-09-17T07:13:39.319 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:39 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-17T07:13:39.319 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:39 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:13:39.319 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:39 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:39.320 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:39 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:39.320 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:39 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi139.tuqnpn", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T07:13:39.320 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:39 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T07:13:39.320 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:39 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:13:39.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:39 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-17T07:13:39.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:39 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:13:39.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:39 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:39.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:39 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:39.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:39 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi139.tuqnpn", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T07:13:39.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:39 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T07:13:39.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:39 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:13:40.491 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:40 smithi087 ceph-mon[27636]: Deploying daemon osd.0 on smithi087 2024-09-17T07:13:40.491 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:40 smithi087 ceph-mon[27636]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T07:13:40.491 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:40 smithi087 ceph-mon[27636]: Reconfiguring mgr.smithi139.tuqnpn (monmap changed)... 2024-09-17T07:13:40.491 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:40 smithi087 ceph-mon[27636]: Reconfiguring daemon mgr.smithi139.tuqnpn on smithi139 2024-09-17T07:13:40.491 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:40 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:40.491 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:40 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:40.491 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:40 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T07:13:40.492 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:40 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T07:13:40.492 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:40 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:13:40.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:40 smithi139 ceph-mon[34403]: Deploying daemon osd.0 on smithi087 2024-09-17T07:13:40.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:40 smithi139 ceph-mon[34403]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T07:13:40.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:40 smithi139 ceph-mon[34403]: Reconfiguring mgr.smithi139.tuqnpn (monmap changed)... 2024-09-17T07:13:40.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:40 smithi139 ceph-mon[34403]: Reconfiguring daemon mgr.smithi139.tuqnpn on smithi139 2024-09-17T07:13:40.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:40 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:40.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:40 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:40.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:40 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T07:13:40.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:40 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T07:13:40.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:40 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:13:41.557 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:41 smithi087 ceph-mon[27636]: Reconfiguring mon.smithi139 (monmap changed)... 2024-09-17T07:13:41.557 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:41 smithi087 ceph-mon[27636]: Reconfiguring daemon mon.smithi139 on smithi139 2024-09-17T07:13:41.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:41 smithi139 ceph-mon[34403]: Reconfiguring mon.smithi139 (monmap changed)... 2024-09-17T07:13:41.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:41 smithi139 ceph-mon[34403]: Reconfiguring daemon mon.smithi139 on smithi139 2024-09-17T07:13:42.359 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:42 smithi087 ceph-mon[27636]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T07:13:42.360 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:42 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:42.360 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:42 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:42.360 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:42 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-17T07:13:42.360 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:42 smithi087 ceph-mon[27636]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-17T07:13:42.360 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:42 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi087.front.sepia.ceph.com:9093"}]: dispatch 2024-09-17T07:13:42.360 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:42 smithi087 ceph-mon[27636]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi087.front.sepia.ceph.com:9093"}]: dispatch 2024-09-17T07:13:42.360 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:42 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:42.361 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:42 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-17T07:13:42.361 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:42 smithi087 ceph-mon[27636]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-17T07:13:42.361 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:42 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi087.front.sepia.ceph.com:3000"}]: dispatch 2024-09-17T07:13:42.361 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:42 smithi087 ceph-mon[27636]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi087.front.sepia.ceph.com:3000"}]: dispatch 2024-09-17T07:13:42.361 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:42 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:42.361 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:42 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T07:13:42.361 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:42 smithi087 ceph-mon[27636]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T07:13:42.361 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:42 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi087.front.sepia.ceph.com:9095"}]: dispatch 2024-09-17T07:13:42.362 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:42 smithi087 ceph-mon[27636]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi087.front.sepia.ceph.com:9095"}]: dispatch 2024-09-17T07:13:42.362 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:42 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:42.362 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:42 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:13:42.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:42 smithi139 ceph-mon[34403]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T07:13:42.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:42 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:42.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:42 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:42.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:42 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-17T07:13:42.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:42 smithi139 ceph-mon[34403]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-17T07:13:42.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:42 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi087.front.sepia.ceph.com:9093"}]: dispatch 2024-09-17T07:13:42.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:42 smithi139 ceph-mon[34403]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi087.front.sepia.ceph.com:9093"}]: dispatch 2024-09-17T07:13:42.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:42 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:42.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:42 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-17T07:13:42.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:42 smithi139 ceph-mon[34403]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-17T07:13:42.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:42 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi087.front.sepia.ceph.com:3000"}]: dispatch 2024-09-17T07:13:42.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:42 smithi139 ceph-mon[34403]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi087.front.sepia.ceph.com:3000"}]: dispatch 2024-09-17T07:13:42.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:42 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:42.618 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:42 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T07:13:42.618 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:42 smithi139 ceph-mon[34403]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T07:13:42.618 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:42 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi087.front.sepia.ceph.com:9095"}]: dispatch 2024-09-17T07:13:42.618 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:42 smithi139 ceph-mon[34403]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi087.front.sepia.ceph.com:9095"}]: dispatch 2024-09-17T07:13:42.618 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:42 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:42.618 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:42 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:13:44.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:44 smithi087 ceph-mon[27636]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T07:13:44.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:44 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:44.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:44 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:44.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:44 smithi139 ceph-mon[34403]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T07:13:44.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:44 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:44.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:44 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:46.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:46 smithi087 ceph-mon[27636]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T07:13:46.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:46 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:46.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:46 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:46.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:46 smithi139 ceph-mon[34403]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T07:13:46.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:46 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:46.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:46 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:48.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:48 smithi087 ceph-mon[27636]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T07:13:48.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:48 smithi139 ceph-mon[34403]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T07:13:48.979 INFO:teuthology.orchestra.run.smithi087.stdout:Created osd(s) 0 on host 'smithi087' 2024-09-17T07:13:48.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:48.978+0000 7f8083fff640 1 -- 172.21.15.87:0/2152588224 <== mgr.14208 v2:172.21.15.87:6800/611048628 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f809c10f060 con 0x7f808406ecc0 2024-09-17T07:13:48.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:48.980+0000 7f80a1d59640 1 -- 172.21.15.87:0/2152588224 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f808406ecc0 msgr2=0x7f8084071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:13:48.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:48.980+0000 7f80a1d59640 1 --2- 172.21.15.87:0/2152588224 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f808406ecc0 0x7f8084071170 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8090009ac0 tx=0x7f8090009da0 comp rx=0 tx=0).stop 2024-09-17T07:13:48.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:48.980+0000 7f80a1d59640 1 -- 172.21.15.87:0/2152588224 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f809c0666b0 msgr2=0x7f809c10d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:13:48.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:48.980+0000 7f80a1d59640 1 --2- 172.21.15.87:0/2152588224 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f809c0666b0 0x7f809c10d0d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f808c00b580 tx=0x7f808c0091a0 comp rx=0 tx=0).stop 2024-09-17T07:13:48.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:48.980+0000 7f80a1d59640 1 -- 172.21.15.87:0/2152588224 shutdown_connections 2024-09-17T07:13:48.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:48.980+0000 7f80a1d59640 1 --2- 172.21.15.87:0/2152588224 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f808406ecc0 0x7f8084071170 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:13:48.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:48.980+0000 7f80a1d59640 1 --2- 172.21.15.87:0/2152588224 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f809c0ff700 0x7f809c10d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:13:48.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:48.980+0000 7f80a1d59640 1 --2- 172.21.15.87:0/2152588224 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f809c0666b0 0x7f809c10d0d0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:13:48.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:48.980+0000 7f80a1d59640 1 -- 172.21.15.87:0/2152588224 >> 172.21.15.87:0/2152588224 conn(0x7f809c0f6c10 msgr2=0x7f809c0f7030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:13:48.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:48.980+0000 7f80a1d59640 1 -- 172.21.15.87:0/2152588224 shutdown_connections 2024-09-17T07:13:48.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:48.980+0000 7f80a1d59640 1 -- 172.21.15.87:0/2152588224 wait complete. 2024-09-17T07:13:49.617 DEBUG:teuthology.orchestra.run.smithi087:osd.0> sudo journalctl -f -n 0 -u ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968@osd.0.service 2024-09-17T07:13:49.620 INFO:tasks.cephadm:Deploying osd.1 on smithi087 with /dev/vg_nvme/lv_3... 2024-09-17T07:13:49.620 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-09-17T07:13:49.844 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:49 smithi087 ceph-mon[27636]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T07:13:49.844 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:49 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:49.844 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:49 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:49.844 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:49 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:49.844 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:49 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:49.844 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:49 smithi087 ceph-mon[27636]: from='osd.0 [v2:172.21.15.87:6802/2205744672,v1:172.21.15.87:6803/2205744672]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-17T07:13:50.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:49 smithi139 ceph-mon[34403]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T07:13:50.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:49 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:50.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:49 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:50.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:49 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:50.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:49 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:50.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:49 smithi139 ceph-mon[34403]: from='osd.0 [v2:172.21.15.87:6802/2205744672,v1:172.21.15.87:6803/2205744672]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-17T07:13:50.836 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/mon.smithi087/config 2024-09-17T07:13:51.098 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:50 smithi087 ceph-mon[27636]: from='osd.0 [v2:172.21.15.87:6802/2205744672,v1:172.21.15.87:6803/2205744672]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-17T07:13:51.098 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:50 smithi087 ceph-mon[27636]: osdmap e7: 1 total, 0 up, 1 in 2024-09-17T07:13:51.098 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:50 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T07:13:51.098 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:50 smithi087 ceph-mon[27636]: from='osd.0 [v2:172.21.15.87:6802/2205744672,v1:172.21.15.87:6803/2205744672]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-09-17T07:13:51.099 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 17 07:13:50 smithi087 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-0[45497]: 2024-09-17T07:13:50.990+0000 7f3e3638e640 -1 osd.0 0 waiting for initial osdmap 2024-09-17T07:13:51.099 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 17 07:13:50 smithi087 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-0[45497]: 2024-09-17T07:13:50.996+0000 7f3e2f9c2640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T07:13:51.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:50 smithi139 ceph-mon[34403]: from='osd.0 [v2:172.21.15.87:6802/2205744672,v1:172.21.15.87:6803/2205744672]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-17T07:13:51.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:50 smithi139 ceph-mon[34403]: osdmap e7: 1 total, 0 up, 1 in 2024-09-17T07:13:51.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:50 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T07:13:51.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:50 smithi139 ceph-mon[34403]: from='osd.0 [v2:172.21.15.87:6802/2205744672,v1:172.21.15.87:6803/2205744672]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-09-17T07:13:52.117 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:52 smithi087 ceph-mon[27636]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T07:13:52.117 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:52 smithi087 ceph-mon[27636]: from='osd.0 [v2:172.21.15.87:6802/2205744672,v1:172.21.15.87:6803/2205744672]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]': finished 2024-09-17T07:13:52.117 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:52 smithi087 ceph-mon[27636]: osdmap e8: 1 total, 0 up, 1 in 2024-09-17T07:13:52.117 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:52 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T07:13:52.117 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:52 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T07:13:52.117 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:52 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:13:52.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:52 smithi139 ceph-mon[34403]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T07:13:52.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:52 smithi139 ceph-mon[34403]: from='osd.0 [v2:172.21.15.87:6802/2205744672,v1:172.21.15.87:6803/2205744672]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]': finished 2024-09-17T07:13:52.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:52 smithi139 ceph-mon[34403]: osdmap e8: 1 total, 0 up, 1 in 2024-09-17T07:13:52.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:52 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T07:13:52.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:52 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T07:13:52.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:52 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:13:52.970 INFO:teuthology.orchestra.run.smithi087.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-09-17T07:13:53.059 INFO:teuthology.orchestra.run.smithi087.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-09-17T07:13:53.073 INFO:teuthology.orchestra.run.smithi087.stderr: stderr: 10+0 records in 2024-09-17T07:13:53.074 INFO:teuthology.orchestra.run.smithi087.stderr:10+0 records out 2024-09-17T07:13:53.074 INFO:teuthology.orchestra.run.smithi087.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0119256 s, 879 MB/s 2024-09-17T07:13:53.074 INFO:teuthology.orchestra.run.smithi087.stderr:--> Zapping successful for: 2024-09-17T07:13:53.358 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:53 smithi087 ceph-mon[27636]: purged_snaps scrub starts 2024-09-17T07:13:53.358 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:53 smithi087 ceph-mon[27636]: purged_snaps scrub ok 2024-09-17T07:13:53.358 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:53 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T07:13:53.358 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:53 smithi087 ceph-mon[27636]: osd.0 [v2:172.21.15.87:6802/2205744672,v1:172.21.15.87:6803/2205744672] boot 2024-09-17T07:13:53.358 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:53 smithi087 ceph-mon[27636]: osdmap e9: 1 total, 1 up, 1 in 2024-09-17T07:13:53.358 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:53 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T07:13:53.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:53 smithi139 ceph-mon[34403]: purged_snaps scrub starts 2024-09-17T07:13:53.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:53 smithi139 ceph-mon[34403]: purged_snaps scrub ok 2024-09-17T07:13:53.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:53 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T07:13:53.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:53 smithi139 ceph-mon[34403]: osd.0 [v2:172.21.15.87:6802/2205744672,v1:172.21.15.87:6803/2205744672] boot 2024-09-17T07:13:53.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:53 smithi139 ceph-mon[34403]: osdmap e9: 1 total, 1 up, 1 in 2024-09-17T07:13:53.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:53 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T07:13:53.657 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi087:vg_nvme/lv_3 2024-09-17T07:13:54.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:54 smithi139 ceph-mon[34403]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T07:13:54.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:54 smithi139 ceph-mon[34403]: osdmap e10: 1 total, 1 up, 1 in 2024-09-17T07:13:54.394 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:54 smithi087 ceph-mon[27636]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T07:13:54.395 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:54 smithi087 ceph-mon[27636]: osdmap e10: 1 total, 1 up, 1 in 2024-09-17T07:13:54.468 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/mon.smithi087/config 2024-09-17T07:13:55.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:55 smithi139 ceph-mon[34403]: Detected new or changed devices on smithi087 2024-09-17T07:13:55.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:55 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:55.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:55 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:55.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:55 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T07:13:55.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:55 smithi139 ceph-mon[34403]: Adjusting osd_memory_target on smithi087 to 12864M 2024-09-17T07:13:55.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:55 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:55.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:55 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:13:55.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:55 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:13:55.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:55 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:55.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:55 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:13:55.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:55 smithi139 ceph-mon[34403]: pgmap v37: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-17T07:13:55.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:55 smithi087 ceph-mon[27636]: Detected new or changed devices on smithi087 2024-09-17T07:13:55.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:55 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:55.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:55 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:55.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:55 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T07:13:55.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:55 smithi087 ceph-mon[27636]: Adjusting osd_memory_target on smithi087 to 12864M 2024-09-17T07:13:55.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:55 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:55.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:55 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:13:55.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:55 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:13:55.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:55 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:55.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:55 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:13:55.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:55 smithi087 ceph-mon[27636]: pgmap v37: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-17T07:13:56.011 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:56.007+0000 7fd681b15640 1 -- 172.21.15.87:0/2273172590 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd67c0fc550 msgr2=0x7fd67c0fc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:13:56.011 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:56.007+0000 7fd681b15640 1 --2- 172.21.15.87:0/2273172590 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd67c0fc550 0x7fd67c0fc960 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd66c0048d0 tx=0x7fd66c009da0 comp rx=0 tx=0).stop 2024-09-17T07:13:56.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:56.007+0000 7fd681b15640 1 -- 172.21.15.87:0/2273172590 shutdown_connections 2024-09-17T07:13:56.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:56.007+0000 7fd681b15640 1 --2- 172.21.15.87:0/2273172590 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd67c0fd820 0x7fd67c0fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:13:56.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:56.007+0000 7fd681b15640 1 --2- 172.21.15.87:0/2273172590 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd67c0fc550 0x7fd67c0fc960 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:13:56.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:56.007+0000 7fd681b15640 1 -- 172.21.15.87:0/2273172590 >> 172.21.15.87:0/2273172590 conn(0x7fd67c0f7d30 msgr2=0x7fd67c0fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:13:56.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:56.007+0000 7fd681b15640 1 -- 172.21.15.87:0/2273172590 shutdown_connections 2024-09-17T07:13:56.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:56.007+0000 7fd681b15640 1 -- 172.21.15.87:0/2273172590 wait complete. 2024-09-17T07:13:56.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:56.008+0000 7fd681b15640 1 Processor -- start 2024-09-17T07:13:56.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:56.008+0000 7fd681b15640 1 -- start start 2024-09-17T07:13:56.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:56.008+0000 7fd681b15640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd67c0fc550 0x7fd67c071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:13:56.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:56.008+0000 7fd681b15640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd67c0fd820 0x7fd67c06fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:13:56.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:56.008+0000 7fd681b15640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd67c070080 con 0x7fd67c0fc550 2024-09-17T07:13:56.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:56.008+0000 7fd681b15640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd67c0701c0 con 0x7fd67c0fd820 2024-09-17T07:13:56.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:56.008+0000 7fd67b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd67c0fc550 0x7fd67c071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:13:56.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:56.008+0000 7fd67b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd67c0fc550 0x7fd67c071570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:38642/0 (socket says 172.21.15.87:38642) 2024-09-17T07:13:56.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:56.008+0000 7fd67b7fe640 1 -- 172.21.15.87:0/3636535197 learned_addr learned my addr 172.21.15.87:0/3636535197 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:13:56.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:56.008+0000 7fd67affd640 1 --2- 172.21.15.87:0/3636535197 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd67c0fd820 0x7fd67c06fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:13:56.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:56.008+0000 7fd67b7fe640 1 -- 172.21.15.87:0/3636535197 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd67c0fd820 msgr2=0x7fd67c06fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:13:56.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:56.008+0000 7fd67b7fe640 1 --2- 172.21.15.87:0/3636535197 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd67c0fd820 0x7fd67c06fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:13:56.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:56.008+0000 7fd67b7fe640 1 -- 172.21.15.87:0/3636535197 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd66c005040 con 0x7fd67c0fc550 2024-09-17T07:13:56.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:56.008+0000 7fd67affd640 1 --2- 172.21.15.87:0/3636535197 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd67c0fd820 0x7fd67c06fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T07:13:56.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:56.009+0000 7fd67b7fe640 1 --2- 172.21.15.87:0/3636535197 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd67c0fc550 0x7fd67c071570 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd66c009ac0 tx=0x7fd66c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:13:56.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:56.009+0000 7fd663fff640 1 -- 172.21.15.87:0/3636535197 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd66c038070 con 0x7fd67c0fc550 2024-09-17T07:13:56.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:56.009+0000 7fd663fff640 1 -- 172.21.15.87:0/3636535197 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fd66c02ae70 con 0x7fd67c0fc550 2024-09-17T07:13:56.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:56.009+0000 7fd681b15640 1 -- 172.21.15.87:0/3636535197 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd67c070440 con 0x7fd67c0fc550 2024-09-17T07:13:56.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:56.009+0000 7fd663fff640 1 -- 172.21.15.87:0/3636535197 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd66c033420 con 0x7fd67c0fc550 2024-09-17T07:13:56.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:56.009+0000 7fd681b15640 1 -- 172.21.15.87:0/3636535197 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd67c1150a0 con 0x7fd67c0fc550 2024-09-17T07:13:56.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:56.010+0000 7fd681b15640 1 -- 172.21.15.87:0/3636535197 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd67c0fb9b0 con 0x7fd67c0fc550 2024-09-17T07:13:56.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:56.010+0000 7fd663fff640 1 -- 172.21.15.87:0/3636535197 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 18) v1 ==== 90811+0+0 (secure 0 0 0) 0x7fd66c030020 con 0x7fd67c0fc550 2024-09-17T07:13:56.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:56.011+0000 7fd663fff640 1 --2- 172.21.15.87:0/3636535197 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fd66406ecc0 0x7fd664071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:13:56.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:56.011+0000 7fd67affd640 1 --2- 172.21.15.87:0/3636535197 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fd66406ecc0 0x7fd664071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:13:56.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:56.011+0000 7fd663fff640 1 -- 172.21.15.87:0/3636535197 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1978+0+0 (secure 0 0 0) 0x7fd66c0ad220 con 0x7fd67c0fc550 2024-09-17T07:13:56.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:56.011+0000 7fd67affd640 1 --2- 172.21.15.87:0/3636535197 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fd66406ecc0 0x7fd664071170 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd670006fd0 tx=0x7fd670008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:13:56.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:56.015+0000 7fd663fff640 1 -- 172.21.15.87:0/3636535197 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fd66c07b240 con 0x7fd67c0fc550 2024-09-17T07:13:56.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:13:56.208+0000 7fd681b15640 1 -- 172.21.15.87:0/3636535197 --> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi087:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fd67c101d40 con 0x7fd66406ecc0 2024-09-17T07:13:56.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:56 smithi087 ceph-mon[27636]: from='client.14260 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi087:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:13:56.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:56 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T07:13:56.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:56 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T07:13:56.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:56 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:13:56.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:56 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:56.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:56 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:56.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:56 smithi139 ceph-mon[34403]: from='client.14260 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi087:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:13:56.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:56 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T07:13:56.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:56 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T07:13:56.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:56 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:13:56.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:56 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:56.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:56 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:13:57.787 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:57 smithi087 ceph-mon[27636]: pgmap v38: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-17T07:13:57.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:57 smithi139 ceph-mon[34403]: pgmap v38: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-17T07:13:59.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:59 smithi087 ceph-mon[27636]: pgmap v39: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-17T07:13:59.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:59 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/1193309237' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3a7464ee-c016-40fd-ab8a-9652397b193c"}]: dispatch 2024-09-17T07:13:59.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:59 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/1193309237' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3a7464ee-c016-40fd-ab8a-9652397b193c"}]': finished 2024-09-17T07:13:59.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:59 smithi087 ceph-mon[27636]: osdmap e11: 2 total, 1 up, 2 in 2024-09-17T07:13:59.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:59 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T07:13:59.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:13:59 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/1888680689' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T07:14:00.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:59 smithi139 ceph-mon[34403]: pgmap v39: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-17T07:14:00.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:59 smithi139 ceph-mon[34403]: from='client.? 172.21.15.87:0/1193309237' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3a7464ee-c016-40fd-ab8a-9652397b193c"}]: dispatch 2024-09-17T07:14:00.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:59 smithi139 ceph-mon[34403]: from='client.? 172.21.15.87:0/1193309237' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3a7464ee-c016-40fd-ab8a-9652397b193c"}]': finished 2024-09-17T07:14:00.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:59 smithi139 ceph-mon[34403]: osdmap e11: 2 total, 1 up, 2 in 2024-09-17T07:14:00.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:59 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T07:14:00.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:13:59 smithi139 ceph-mon[34403]: from='client.? 172.21.15.87:0/1888680689' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T07:14:01.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:01 smithi087 ceph-mon[27636]: pgmap v41: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-17T07:14:01.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:01 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:14:01.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:01 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:14:01.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:01 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:14:01.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:01 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:14:01.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:01 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:14:02.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:01 smithi139 ceph-mon[34403]: pgmap v41: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-17T07:14:02.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:01 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:14:02.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:01 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:14:02.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:01 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:14:02.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:01 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:14:02.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:01 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:14:03.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:03 smithi087 ceph-mon[27636]: pgmap v42: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-17T07:14:04.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:03 smithi139 ceph-mon[34403]: pgmap v42: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-17T07:14:05.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:05 smithi087 ceph-mon[27636]: pgmap v43: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-17T07:14:06.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:05 smithi139 ceph-mon[34403]: pgmap v43: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-17T07:14:06.831 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:06 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-17T07:14:06.831 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:06 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:14:06.831 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:06 smithi087 ceph-mon[27636]: Deploying daemon osd.1 on smithi087 2024-09-17T07:14:06.831 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:06 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:14:07.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:06 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-17T07:14:07.123 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:06 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:14:07.123 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:06 smithi139 ceph-mon[34403]: Deploying daemon osd.1 on smithi087 2024-09-17T07:14:07.124 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:06 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:14:07.878 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:07 smithi087 ceph-mon[27636]: pgmap v44: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-17T07:14:08.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:07 smithi139 ceph-mon[34403]: pgmap v44: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-17T07:14:09.814 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:09 smithi087 ceph-mon[27636]: pgmap v45: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-17T07:14:10.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:09 smithi139 ceph-mon[34403]: pgmap v45: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-17T07:14:11.795 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:11 smithi087 ceph-mon[27636]: pgmap v46: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-17T07:14:11.795 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:11 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:14:11.795 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:11 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:14:11.796 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:11 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:14:11.918 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:11 smithi139 ceph-mon[34403]: pgmap v46: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-17T07:14:11.918 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:11 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:14:11.919 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:11 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:14:11.919 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:11 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:14:14.093 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:13 smithi087 ceph-mon[27636]: pgmap v47: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-17T07:14:14.093 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:13 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:14:14.093 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:13 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:14:14.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:13 smithi139 ceph-mon[34403]: pgmap v47: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-17T07:14:14.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:13 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:14:14.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:13 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:14:14.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:14:14.435+0000 7fd663fff640 1 -- 172.21.15.87:0/3636535197 <== mgr.14208 v2:172.21.15.87:6800/611048628 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fd67c101d40 con 0x7fd66406ecc0 2024-09-17T07:14:14.437 INFO:teuthology.orchestra.run.smithi087.stdout:Created osd(s) 1 on host 'smithi087' 2024-09-17T07:14:14.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:14:14.437+0000 7fd681b15640 1 -- 172.21.15.87:0/3636535197 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fd66406ecc0 msgr2=0x7fd664071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:14:14.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:14:14.437+0000 7fd681b15640 1 --2- 172.21.15.87:0/3636535197 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fd66406ecc0 0x7fd664071170 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd670006fd0 tx=0x7fd670008040 comp rx=0 tx=0).stop 2024-09-17T07:14:14.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:14:14.437+0000 7fd681b15640 1 -- 172.21.15.87:0/3636535197 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd67c0fc550 msgr2=0x7fd67c071570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:14:14.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:14:14.437+0000 7fd681b15640 1 --2- 172.21.15.87:0/3636535197 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd67c0fc550 0x7fd67c071570 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd66c009ac0 tx=0x7fd66c009da0 comp rx=0 tx=0).stop 2024-09-17T07:14:14.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:14:14.437+0000 7fd681b15640 1 -- 172.21.15.87:0/3636535197 shutdown_connections 2024-09-17T07:14:14.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:14:14.437+0000 7fd681b15640 1 --2- 172.21.15.87:0/3636535197 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fd66406ecc0 0x7fd664071170 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:14:14.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:14:14.437+0000 7fd681b15640 1 --2- 172.21.15.87:0/3636535197 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd67c0fd820 0x7fd67c06fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:14:14.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:14:14.437+0000 7fd681b15640 1 --2- 172.21.15.87:0/3636535197 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd67c0fc550 0x7fd67c071570 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:14:14.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:14:14.437+0000 7fd681b15640 1 -- 172.21.15.87:0/3636535197 >> 172.21.15.87:0/3636535197 conn(0x7fd67c0f7d30 msgr2=0x7fd67c0f95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:14:14.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:14:14.437+0000 7fd681b15640 1 -- 172.21.15.87:0/3636535197 shutdown_connections 2024-09-17T07:14:14.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:14:14.437+0000 7fd681b15640 1 -- 172.21.15.87:0/3636535197 wait complete. 2024-09-17T07:14:15.465 DEBUG:teuthology.orchestra.run.smithi087:osd.1> sudo journalctl -f -n 0 -u ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968@osd.1.service 2024-09-17T07:14:15.468 INFO:tasks.cephadm:Deploying osd.2 on smithi087 with /dev/vg_nvme/lv_2... 2024-09-17T07:14:15.468 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-09-17T07:14:15.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:15 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:14:15.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:15 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:14:15.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:15 smithi139 ceph-mon[34403]: pgmap v48: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-17T07:14:15.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:15 smithi139 ceph-mon[34403]: from='osd.1 [v2:172.21.15.87:6810/3001772283,v1:172.21.15.87:6811/3001772283]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-17T07:14:15.922 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:15 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:14:15.922 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:15 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:14:15.922 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:15 smithi087 ceph-mon[27636]: pgmap v48: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-17T07:14:15.923 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:15 smithi087 ceph-mon[27636]: from='osd.1 [v2:172.21.15.87:6810/3001772283,v1:172.21.15.87:6811/3001772283]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-17T07:14:16.216 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/mon.smithi087/config 2024-09-17T07:14:16.655 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:16 smithi087 ceph-mon[27636]: from='osd.1 [v2:172.21.15.87:6810/3001772283,v1:172.21.15.87:6811/3001772283]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-17T07:14:16.655 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:16 smithi087 ceph-mon[27636]: osdmap e12: 2 total, 1 up, 2 in 2024-09-17T07:14:16.655 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:16 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T07:14:16.655 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:16 smithi087 ceph-mon[27636]: from='osd.1 [v2:172.21.15.87:6810/3001772283,v1:172.21.15.87:6811/3001772283]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-09-17T07:14:16.656 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 17 07:14:16 smithi087 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-1[52723]: 2024-09-17T07:14:16.443+0000 7f97394ef640 -1 osd.1 0 waiting for initial osdmap 2024-09-17T07:14:16.656 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 17 07:14:16 smithi087 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-1[52723]: 2024-09-17T07:14:16.447+0000 7f9733b25640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T07:14:16.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:16 smithi139 ceph-mon[34403]: from='osd.1 [v2:172.21.15.87:6810/3001772283,v1:172.21.15.87:6811/3001772283]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-17T07:14:16.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:16 smithi139 ceph-mon[34403]: osdmap e12: 2 total, 1 up, 2 in 2024-09-17T07:14:16.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:16 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T07:14:16.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:16 smithi139 ceph-mon[34403]: from='osd.1 [v2:172.21.15.87:6810/3001772283,v1:172.21.15.87:6811/3001772283]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-09-17T07:14:17.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:17 smithi139 ceph-mon[34403]: from='osd.1 [v2:172.21.15.87:6810/3001772283,v1:172.21.15.87:6811/3001772283]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]': finished 2024-09-17T07:14:17.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:17 smithi139 ceph-mon[34403]: osdmap e13: 2 total, 1 up, 2 in 2024-09-17T07:14:17.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:17 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T07:14:17.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:17 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T07:14:17.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:17 smithi139 ceph-mon[34403]: pgmap v51: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-17T07:14:17.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:17 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T07:14:17.893 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:17 smithi087 ceph-mon[27636]: from='osd.1 [v2:172.21.15.87:6810/3001772283,v1:172.21.15.87:6811/3001772283]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]': finished 2024-09-17T07:14:17.893 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:17 smithi087 ceph-mon[27636]: osdmap e13: 2 total, 1 up, 2 in 2024-09-17T07:14:17.893 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:17 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T07:14:17.894 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:17 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T07:14:17.894 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:17 smithi087 ceph-mon[27636]: pgmap v51: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-17T07:14:17.894 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:17 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T07:14:18.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:18 smithi087 ceph-mon[27636]: purged_snaps scrub starts 2024-09-17T07:14:18.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:18 smithi087 ceph-mon[27636]: purged_snaps scrub ok 2024-09-17T07:14:18.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:18 smithi087 ceph-mon[27636]: osd.1 [v2:172.21.15.87:6810/3001772283,v1:172.21.15.87:6811/3001772283] boot 2024-09-17T07:14:18.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:18 smithi087 ceph-mon[27636]: osdmap e14: 2 total, 2 up, 2 in 2024-09-17T07:14:18.714 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:18 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T07:14:18.868 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:18 smithi139 ceph-mon[34403]: purged_snaps scrub starts 2024-09-17T07:14:18.869 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:18 smithi139 ceph-mon[34403]: purged_snaps scrub ok 2024-09-17T07:14:18.869 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:18 smithi139 ceph-mon[34403]: osd.1 [v2:172.21.15.87:6810/3001772283,v1:172.21.15.87:6811/3001772283] boot 2024-09-17T07:14:18.869 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:18 smithi139 ceph-mon[34403]: osdmap e14: 2 total, 2 up, 2 in 2024-09-17T07:14:18.869 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:18 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T07:14:19.218 INFO:teuthology.orchestra.run.smithi087.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-09-17T07:14:19.305 INFO:teuthology.orchestra.run.smithi087.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-09-17T07:14:19.320 INFO:teuthology.orchestra.run.smithi087.stderr: stderr: 10+0 records in 2024-09-17T07:14:19.320 INFO:teuthology.orchestra.run.smithi087.stderr:10+0 records out 2024-09-17T07:14:19.320 INFO:teuthology.orchestra.run.smithi087.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0126617 s, 828 MB/s 2024-09-17T07:14:19.320 INFO:teuthology.orchestra.run.smithi087.stderr:--> Zapping successful for: 2024-09-17T07:14:19.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:19 smithi087 ceph-mon[27636]: osdmap e15: 2 total, 2 up, 2 in 2024-09-17T07:14:19.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:19 smithi087 ceph-mon[27636]: pgmap v54: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-17T07:14:19.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:19 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:14:19.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:19 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:14:19.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:19 smithi139 ceph-mon[34403]: osdmap e15: 2 total, 2 up, 2 in 2024-09-17T07:14:19.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:19 smithi139 ceph-mon[34403]: pgmap v54: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-17T07:14:19.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:19 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:14:19.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:19 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:14:19.917 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi087:vg_nvme/lv_2 2024-09-17T07:14:21.634 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/mon.smithi087/config 2024-09-17T07:14:21.872 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:21 smithi087 ceph-mon[27636]: pgmap v55: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-17T07:14:21.872 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:21 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:14:22.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:21 smithi139 ceph-mon[34403]: pgmap v55: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-17T07:14:22.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:21 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:14:23.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:14:23.845+0000 7f3632c31640 1 -- 172.21.15.87:0/378999324 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f362c0fd810 msgr2=0x7f362c0fdc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:14:23.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:14:23.845+0000 7f3632c31640 1 --2- 172.21.15.87:0/378999324 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f362c0fd810 0x7f362c0fdc80 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f36180048d0 tx=0x7f3618009da0 comp rx=0 tx=0).stop 2024-09-17T07:14:23.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:14:23.845+0000 7f3632c31640 1 -- 172.21.15.87:0/378999324 shutdown_connections 2024-09-17T07:14:23.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:14:23.845+0000 7f3632c31640 1 --2- 172.21.15.87:0/378999324 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f362c0fd810 0x7f362c0fdc80 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:14:23.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:14:23.845+0000 7f3632c31640 1 --2- 172.21.15.87:0/378999324 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f362c0fc540 0x7f362c0fc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:14:23.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:14:23.845+0000 7f3632c31640 1 -- 172.21.15.87:0/378999324 >> 172.21.15.87:0/378999324 conn(0x7f362c0f7ce0 msgr2=0x7f362c0fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:14:23.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:14:23.845+0000 7f3632c31640 1 -- 172.21.15.87:0/378999324 shutdown_connections 2024-09-17T07:14:23.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:14:23.845+0000 7f3632c31640 1 -- 172.21.15.87:0/378999324 wait complete. 2024-09-17T07:14:23.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:14:23.845+0000 7f3632c31640 1 Processor -- start 2024-09-17T07:14:23.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:14:23.845+0000 7f3632c31640 1 -- start start 2024-09-17T07:14:23.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:14:23.846+0000 7f3632c31640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f362c0fc540 0x7f362c10cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:14:23.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:14:23.846+0000 7f3632c31640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f362c0fd810 0x7f362c10d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:14:23.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:14:23.846+0000 7f3632c31640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f362c10db50 con 0x7f362c0fc540 2024-09-17T07:14:23.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:14:23.846+0000 7f3632c31640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f362c10e370 con 0x7f362c0fd810 2024-09-17T07:14:23.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:14:23.846+0000 7f36309cd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f362c0fc540 0x7f362c10cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:14:23.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:14:23.846+0000 7f36309cd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f362c0fc540 0x7f362c10cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:50038/0 (socket says 172.21.15.87:50038) 2024-09-17T07:14:23.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:14:23.846+0000 7f36309cd640 1 -- 172.21.15.87:0/1121570357 learned_addr learned my addr 172.21.15.87:0/1121570357 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:14:23.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:14:23.846+0000 7f362bfff640 1 --2- 172.21.15.87:0/1121570357 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f362c0fd810 0x7f362c10d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:14:23.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:14:23.846+0000 7f36309cd640 1 -- 172.21.15.87:0/1121570357 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f362c0fd810 msgr2=0x7f362c10d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:14:23.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:14:23.846+0000 7f36309cd640 1 --2- 172.21.15.87:0/1121570357 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f362c0fd810 0x7f362c10d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:14:23.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:14:23.846+0000 7f36309cd640 1 -- 172.21.15.87:0/1121570357 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3618005040 con 0x7f362c0fc540 2024-09-17T07:14:23.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:14:23.846+0000 7f36309cd640 1 --2- 172.21.15.87:0/1121570357 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f362c0fc540 0x7f362c10cfc0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f362000c810 tx=0x7f36200043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:14:23.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:14:23.847+0000 7f36297fa640 1 -- 172.21.15.87:0/1121570357 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f362000a7a0 con 0x7f362c0fc540 2024-09-17T07:14:23.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:14:23.847+0000 7f3632c31640 1 -- 172.21.15.87:0/1121570357 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f362c10e600 con 0x7f362c0fc540 2024-09-17T07:14:23.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:14:23.847+0000 7f36297fa640 1 -- 172.21.15.87:0/1121570357 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f362000ad80 con 0x7f362c0fc540 2024-09-17T07:14:23.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:14:23.847+0000 7f36297fa640 1 -- 172.21.15.87:0/1121570357 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3620011380 con 0x7f362c0fc540 2024-09-17T07:14:23.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:14:23.847+0000 7f3632c31640 1 -- 172.21.15.87:0/1121570357 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f362c10eb70 con 0x7f362c0fc540 2024-09-17T07:14:23.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:14:23.848+0000 7f3632c31640 1 -- 172.21.15.87:0/1121570357 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f362c105620 con 0x7f362c0fc540 2024-09-17T07:14:23.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:14:23.848+0000 7f36297fa640 1 -- 172.21.15.87:0/1121570357 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 18) v1 ==== 90811+0+0 (secure 0 0 0) 0x7f36200114e0 con 0x7f362c0fc540 2024-09-17T07:14:23.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:14:23.849+0000 7f36297fa640 1 --2- 172.21.15.87:0/1121570357 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f361c06ecc0 0x7f361c071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:14:23.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:14:23.849+0000 7f36297fa640 1 -- 172.21.15.87:0/1121570357 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2410+0+0 (secure 0 0 0) 0x7f362008d8b0 con 0x7f362c0fc540 2024-09-17T07:14:23.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:14:23.849+0000 7f362bfff640 1 --2- 172.21.15.87:0/1121570357 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f361c06ecc0 0x7f361c071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:14:23.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:14:23.849+0000 7f362bfff640 1 --2- 172.21.15.87:0/1121570357 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f361c06ecc0 0x7f361c071170 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3618000c00 tx=0x7f3618035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:14:23.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:14:23.853+0000 7f36297fa640 1 -- 172.21.15.87:0/1121570357 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f362005b6a0 con 0x7f362c0fc540 2024-09-17T07:14:23.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:23 smithi087 ceph-mon[27636]: pgmap v56: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-17T07:14:24.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:14:24.025+0000 7f3632c31640 1 -- 172.21.15.87:0/1121570357 --> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi087:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f362c10ef00 con 0x7f361c06ecc0 2024-09-17T07:14:24.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:23 smithi139 ceph-mon[34403]: pgmap v56: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-17T07:14:24.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:24 smithi087 ceph-mon[27636]: Detected new or changed devices on smithi087 2024-09-17T07:14:24.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:24 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:14:24.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:24 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:14:24.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:24 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T07:14:24.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:24 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-17T07:14:24.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:24 smithi087 ceph-mon[27636]: Adjusting osd_memory_target on smithi087 to 6432M 2024-09-17T07:14:24.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:24 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:14:24.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:24 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:14:24.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:24 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:14:24.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:24 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:14:24.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:24 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:14:24.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:24 smithi087 ceph-mon[27636]: from='client.14278 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi087:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:14:24.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:24 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T07:14:24.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:24 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T07:14:24.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:24 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:14:25.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:24 smithi139 ceph-mon[34403]: Detected new or changed devices on smithi087 2024-09-17T07:14:25.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:24 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:14:25.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:24 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:14:25.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:24 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T07:14:25.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:24 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-17T07:14:25.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:24 smithi139 ceph-mon[34403]: Adjusting osd_memory_target on smithi087 to 6432M 2024-09-17T07:14:25.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:24 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:14:25.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:24 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:14:25.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:24 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:14:25.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:24 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:14:25.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:24 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:14:25.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:24 smithi139 ceph-mon[34403]: from='client.14278 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi087:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:14:25.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:24 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T07:14:25.118 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:24 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T07:14:25.118 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:24 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:14:25.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:25 smithi087 ceph-mon[27636]: pgmap v57: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-17T07:14:26.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:25 smithi139 ceph-mon[34403]: pgmap v57: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-17T07:14:27.841 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:27 smithi087 ceph-mon[27636]: pgmap v58: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-17T07:14:27.841 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:27 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/3765812843' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "31ffe6e4-fa51-43ed-8887-022ad51fbd6f"}]: dispatch 2024-09-17T07:14:27.841 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:27 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/3765812843' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "31ffe6e4-fa51-43ed-8887-022ad51fbd6f"}]': finished 2024-09-17T07:14:27.841 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:27 smithi087 ceph-mon[27636]: osdmap e16: 3 total, 2 up, 3 in 2024-09-17T07:14:27.842 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:27 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T07:14:28.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:27 smithi139 ceph-mon[34403]: pgmap v58: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-17T07:14:28.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:27 smithi139 ceph-mon[34403]: from='client.? 172.21.15.87:0/3765812843' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "31ffe6e4-fa51-43ed-8887-022ad51fbd6f"}]: dispatch 2024-09-17T07:14:28.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:27 smithi139 ceph-mon[34403]: from='client.? 172.21.15.87:0/3765812843' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "31ffe6e4-fa51-43ed-8887-022ad51fbd6f"}]': finished 2024-09-17T07:14:28.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:27 smithi139 ceph-mon[34403]: osdmap e16: 3 total, 2 up, 3 in 2024-09-17T07:14:28.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:27 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T07:14:28.825 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:28 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/937455122' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T07:14:29.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:28 smithi139 ceph-mon[34403]: from='client.? 172.21.15.87:0/937455122' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T07:14:30.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:29 smithi139 ceph-mon[34403]: pgmap v60: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-17T07:14:30.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:29 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:14:30.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:29 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:14:30.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:29 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:14:30.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:29 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:14:30.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:29 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:14:30.120 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:29 smithi087 ceph-mon[27636]: pgmap v60: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-17T07:14:30.120 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:29 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:14:30.120 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:29 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:14:30.120 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:29 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:14:30.120 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:29 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:14:30.120 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:29 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:14:32.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:31 smithi139 ceph-mon[34403]: pgmap v61: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-17T07:14:32.145 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:31 smithi087 ceph-mon[27636]: pgmap v61: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-17T07:14:33.995 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:33 smithi087 ceph-mon[27636]: pgmap v62: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-17T07:14:34.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:33 smithi139 ceph-mon[34403]: pgmap v62: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-17T07:14:34.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:34 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-17T07:14:34.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:34 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:14:35.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:34 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-17T07:14:35.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:34 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:14:36.028 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:35 smithi087 ceph-mon[27636]: pgmap v63: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-17T07:14:36.028 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:35 smithi087 ceph-mon[27636]: Deploying daemon osd.2 on smithi087 2024-09-17T07:14:36.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:35 smithi139 ceph-mon[34403]: pgmap v63: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-17T07:14:36.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:35 smithi139 ceph-mon[34403]: Deploying daemon osd.2 on smithi087 2024-09-17T07:14:37.028 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:36 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:14:37.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:36 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:14:37.871 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:37 smithi087 ceph-mon[27636]: pgmap v64: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-17T07:14:38.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:37 smithi139 ceph-mon[34403]: pgmap v64: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-17T07:14:39.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:39 smithi087 ceph-mon[27636]: pgmap v65: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-17T07:14:39.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:39 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:14:39.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:39 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:14:39.965 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:39 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:14:40.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:39 smithi139 ceph-mon[34403]: pgmap v65: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-17T07:14:40.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:39 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:14:40.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:39 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:14:40.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:39 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:14:41.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:41 smithi087 ceph-mon[27636]: pgmap v66: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-17T07:14:42.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:41 smithi139 ceph-mon[34403]: pgmap v66: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-17T07:14:43.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:14:43.398+0000 7f36297fa640 1 -- 172.21.15.87:0/1121570357 <== mgr.14208 v2:172.21.15.87:6800/611048628 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f362c10ef00 con 0x7f361c06ecc0 2024-09-17T07:14:43.399 INFO:teuthology.orchestra.run.smithi087.stdout:Created osd(s) 2 on host 'smithi087' 2024-09-17T07:14:43.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:14:43.400+0000 7f3632c31640 1 -- 172.21.15.87:0/1121570357 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f361c06ecc0 msgr2=0x7f361c071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:14:43.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:14:43.400+0000 7f3632c31640 1 --2- 172.21.15.87:0/1121570357 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f361c06ecc0 0x7f361c071170 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3618000c00 tx=0x7f3618035040 comp rx=0 tx=0).stop 2024-09-17T07:14:43.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:14:43.400+0000 7f3632c31640 1 -- 172.21.15.87:0/1121570357 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f362c0fc540 msgr2=0x7f362c10cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:14:43.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:14:43.400+0000 7f3632c31640 1 --2- 172.21.15.87:0/1121570357 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f362c0fc540 0x7f362c10cfc0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f362000c810 tx=0x7f36200043c0 comp rx=0 tx=0).stop 2024-09-17T07:14:43.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:14:43.400+0000 7f3632c31640 1 -- 172.21.15.87:0/1121570357 shutdown_connections 2024-09-17T07:14:43.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:14:43.400+0000 7f3632c31640 1 --2- 172.21.15.87:0/1121570357 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f361c06ecc0 0x7f361c071170 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:14:43.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:14:43.400+0000 7f3632c31640 1 --2- 172.21.15.87:0/1121570357 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f362c0fd810 0x7f362c10d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:14:43.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:14:43.400+0000 7f3632c31640 1 --2- 172.21.15.87:0/1121570357 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f362c0fc540 0x7f362c10cfc0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:14:43.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:14:43.400+0000 7f3632c31640 1 -- 172.21.15.87:0/1121570357 >> 172.21.15.87:0/1121570357 conn(0x7f362c0f7ce0 msgr2=0x7f362c0f9570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:14:43.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:14:43.400+0000 7f3632c31640 1 -- 172.21.15.87:0/1121570357 shutdown_connections 2024-09-17T07:14:43.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:14:43.400+0000 7f3632c31640 1 -- 172.21.15.87:0/1121570357 wait complete. 2024-09-17T07:14:44.044 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:43 smithi087 ceph-mon[27636]: pgmap v67: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-17T07:14:44.044 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:43 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:14:44.044 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:43 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:14:44.044 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:43 smithi087 ceph-mon[27636]: from='osd.2 [v2:172.21.15.87:6818/2282787545,v1:172.21.15.87:6819/2282787545]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-17T07:14:44.070 DEBUG:teuthology.orchestra.run.smithi087:osd.2> sudo journalctl -f -n 0 -u ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968@osd.2.service 2024-09-17T07:14:44.073 INFO:tasks.cephadm:Deploying osd.3 on smithi139 with /dev/vg_nvme/lv_4... 2024-09-17T07:14:44.073 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-09-17T07:14:44.102 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:43 smithi139 ceph-mon[34403]: pgmap v67: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-17T07:14:44.103 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:43 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:14:44.103 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:43 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:14:44.103 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:43 smithi139 ceph-mon[34403]: from='osd.2 [v2:172.21.15.87:6818/2282787545,v1:172.21.15.87:6819/2282787545]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-17T07:14:44.326 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/mon.smithi139/config 2024-09-17T07:14:45.575 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:45 smithi139 ceph-mon[34403]: from='osd.2 [v2:172.21.15.87:6818/2282787545,v1:172.21.15.87:6819/2282787545]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-17T07:14:45.575 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:45 smithi139 ceph-mon[34403]: osdmap e17: 3 total, 2 up, 3 in 2024-09-17T07:14:45.575 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:45 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T07:14:45.575 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:45 smithi139 ceph-mon[34403]: from='osd.2 [v2:172.21.15.87:6818/2282787545,v1:172.21.15.87:6819/2282787545]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-09-17T07:14:45.575 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:45 smithi139 ceph-mon[34403]: pgmap v69: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-17T07:14:45.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:45 smithi087 ceph-mon[27636]: from='osd.2 [v2:172.21.15.87:6818/2282787545,v1:172.21.15.87:6819/2282787545]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-17T07:14:45.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:45 smithi087 ceph-mon[27636]: osdmap e17: 3 total, 2 up, 3 in 2024-09-17T07:14:45.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:45 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T07:14:45.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:45 smithi087 ceph-mon[27636]: from='osd.2 [v2:172.21.15.87:6818/2282787545,v1:172.21.15.87:6819/2282787545]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-09-17T07:14:45.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:45 smithi087 ceph-mon[27636]: pgmap v69: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-17T07:14:45.677 INFO:journalctl@ceph.osd.2.smithi087.stdout:Sep 17 07:14:45 smithi087 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-2[59990]: 2024-09-17T07:14:45.406+0000 7fdd2c20a640 -1 osd.2 0 waiting for initial osdmap 2024-09-17T07:14:45.677 INFO:journalctl@ceph.osd.2.smithi087.stdout:Sep 17 07:14:45 smithi087 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-2[59990]: 2024-09-17T07:14:45.412+0000 7fdd2581c640 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T07:14:45.920 INFO:teuthology.orchestra.run.smithi139.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-09-17T07:14:46.004 INFO:teuthology.orchestra.run.smithi139.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-09-17T07:14:46.018 INFO:teuthology.orchestra.run.smithi139.stderr: stderr: 10+0 records in 2024-09-17T07:14:46.018 INFO:teuthology.orchestra.run.smithi139.stderr:10+0 records out 2024-09-17T07:14:46.018 INFO:teuthology.orchestra.run.smithi139.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.011427 s, 918 MB/s 2024-09-17T07:14:46.018 INFO:teuthology.orchestra.run.smithi139.stderr:--> Zapping successful for: 2024-09-17T07:14:46.604 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:46 smithi139 ceph-mon[34403]: from='osd.2 [v2:172.21.15.87:6818/2282787545,v1:172.21.15.87:6819/2282787545]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]': finished 2024-09-17T07:14:46.604 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:46 smithi139 ceph-mon[34403]: osdmap e18: 3 total, 2 up, 3 in 2024-09-17T07:14:46.605 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:46 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T07:14:46.605 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:46 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T07:14:46.605 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:46 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:14:46.605 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:46 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:14:46.634 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi139:vg_nvme/lv_4 2024-09-17T07:14:46.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:46 smithi087 ceph-mon[27636]: from='osd.2 [v2:172.21.15.87:6818/2282787545,v1:172.21.15.87:6819/2282787545]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]': finished 2024-09-17T07:14:46.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:46 smithi087 ceph-mon[27636]: osdmap e18: 3 total, 2 up, 3 in 2024-09-17T07:14:46.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:46 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T07:14:46.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:46 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T07:14:46.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:46 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:14:46.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:46 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:14:46.921 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/mon.smithi139/config 2024-09-17T07:14:47.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:47 smithi139 ceph-mon[34403]: purged_snaps scrub starts 2024-09-17T07:14:47.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:47 smithi139 ceph-mon[34403]: purged_snaps scrub ok 2024-09-17T07:14:47.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:47 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T07:14:47.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:47 smithi139 ceph-mon[34403]: osd.2 [v2:172.21.15.87:6818/2282787545,v1:172.21.15.87:6819/2282787545] boot 2024-09-17T07:14:47.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:47 smithi139 ceph-mon[34403]: osdmap e19: 3 total, 3 up, 3 in 2024-09-17T07:14:47.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:47 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T07:14:47.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:47 smithi139 ceph-mon[34403]: pgmap v72: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-17T07:14:47.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:47 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-09-17T07:14:47.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:47 smithi087 ceph-mon[27636]: purged_snaps scrub starts 2024-09-17T07:14:47.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:47 smithi087 ceph-mon[27636]: purged_snaps scrub ok 2024-09-17T07:14:47.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:47 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T07:14:47.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:47 smithi087 ceph-mon[27636]: osd.2 [v2:172.21.15.87:6818/2282787545,v1:172.21.15.87:6819/2282787545] boot 2024-09-17T07:14:47.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:47 smithi087 ceph-mon[27636]: osdmap e19: 3 total, 3 up, 3 in 2024-09-17T07:14:47.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:47 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T07:14:47.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:47 smithi087 ceph-mon[27636]: pgmap v72: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-17T07:14:47.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:47 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-09-17T07:14:48.423 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:48 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-09-17T07:14:48.423 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:48 smithi087 ceph-mon[27636]: osdmap e20: 3 total, 3 up, 3 in 2024-09-17T07:14:48.423 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:48 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-17T07:14:48.426 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:14:48.426+0000 7f50daa85640 1 -- 172.21.15.139:0/3354275522 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f50d40fb430 msgr2=0x7f50d40fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:14:48.427 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:14:48.426+0000 7f50daa85640 1 --2- 172.21.15.139:0/3354275522 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f50d40fb430 0x7f50d40fb840 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f50c80048d0 tx=0x7f50c8009da0 comp rx=0 tx=0).stop 2024-09-17T07:14:48.427 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:14:48.426+0000 7f50daa85640 1 -- 172.21.15.139:0/3354275522 shutdown_connections 2024-09-17T07:14:48.427 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:14:48.426+0000 7f50daa85640 1 --2- 172.21.15.139:0/3354275522 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50d40fc700 0x7f50d40fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:14:48.427 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:14:48.426+0000 7f50daa85640 1 --2- 172.21.15.139:0/3354275522 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f50d40fb430 0x7f50d40fb840 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:14:48.427 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:14:48.426+0000 7f50daa85640 1 -- 172.21.15.139:0/3354275522 >> 172.21.15.139:0/3354275522 conn(0x7f50d40f6c10 msgr2=0x7f50d40f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:14:48.427 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:14:48.426+0000 7f50daa85640 1 -- 172.21.15.139:0/3354275522 shutdown_connections 2024-09-17T07:14:48.427 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:14:48.426+0000 7f50daa85640 1 -- 172.21.15.139:0/3354275522 wait complete. 2024-09-17T07:14:48.427 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:14:48.427+0000 7f50daa85640 1 Processor -- start 2024-09-17T07:14:48.427 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:14:48.427+0000 7f50daa85640 1 -- start start 2024-09-17T07:14:48.429 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:14:48.427+0000 7f50daa85640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50d40fb430 0x7f50d40ff550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:14:48.429 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:14:48.427+0000 7f50daa85640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f50d40fc700 0x7f50d40fda40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:14:48.429 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:14:48.427+0000 7f50daa85640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50d40fdfd0 con 0x7f50d40fb430 2024-09-17T07:14:48.429 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:14:48.427+0000 7f50daa85640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50d40fe110 con 0x7f50d40fc700 2024-09-17T07:14:48.429 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:14:48.427+0000 7f50d3fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f50d40fc700 0x7f50d40fda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:14:48.429 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:14:48.427+0000 7f50d3fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f50d40fc700 0x7f50d40fda40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:59934/0 (socket says 172.21.15.139:59934) 2024-09-17T07:14:48.429 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:14:48.427+0000 7f50d8821640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50d40fb430 0x7f50d40ff550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:14:48.429 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:14:48.427+0000 7f50d3fff640 1 -- 172.21.15.139:0/2971458694 learned_addr learned my addr 172.21.15.139:0/2971458694 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-17T07:14:48.429 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:14:48.427+0000 7f50d3fff640 1 -- 172.21.15.139:0/2971458694 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50d40fb430 msgr2=0x7f50d40ff550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:14:48.429 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:14:48.427+0000 7f50d3fff640 1 --2- 172.21.15.139:0/2971458694 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50d40fb430 0x7f50d40ff550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:14:48.429 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:14:48.427+0000 7f50d3fff640 1 -- 172.21.15.139:0/2971458694 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50c8005040 con 0x7f50d40fc700 2024-09-17T07:14:48.430 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:14:48.428+0000 7f50d3fff640 1 --2- 172.21.15.139:0/2971458694 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f50d40fc700 0x7f50d40fda40 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f50c0002a50 tx=0x7f50c0004600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:14:48.430 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:14:48.428+0000 7f50d17fa640 1 -- 172.21.15.139:0/2971458694 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50c0007c30 con 0x7f50d40fc700 2024-09-17T07:14:48.430 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:14:48.428+0000 7f50d17fa640 1 -- 172.21.15.139:0/2971458694 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f50c000f040 con 0x7f50d40fc700 2024-09-17T07:14:48.430 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:14:48.428+0000 7f50daa85640 1 -- 172.21.15.139:0/2971458694 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50d40fe3f0 con 0x7f50d40fc700 2024-09-17T07:14:48.430 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:14:48.428+0000 7f50d17fa640 1 -- 172.21.15.139:0/2971458694 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50c000da30 con 0x7f50d40fc700 2024-09-17T07:14:48.430 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:14:48.428+0000 7f50daa85640 1 -- 172.21.15.139:0/2971458694 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50d4114fe0 con 0x7f50d40fc700 2024-09-17T07:14:48.430 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:14:48.429+0000 7f50daa85640 1 -- 172.21.15.139:0/2971458694 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50d40fa890 con 0x7f50d40fc700 2024-09-17T07:14:48.431 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:14:48.429+0000 7f50d17fa640 1 -- 172.21.15.139:0/2971458694 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 18) v1 ==== 90811+0+0 (secure 0 0 0) 0x7f50c000db90 con 0x7f50d40fc700 2024-09-17T07:14:48.431 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:14:48.430+0000 7f50d17fa640 1 --2- 172.21.15.139:0/2971458694 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f50c406ecc0 0x7f50c4071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:14:48.431 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:14:48.430+0000 7f50d17fa640 1 -- 172.21.15.139:0/2971458694 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3228+0+0 (secure 0 0 0) 0x7f50c008d540 con 0x7f50d40fc700 2024-09-17T07:14:48.431 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:14:48.430+0000 7f50d8821640 1 --2- 172.21.15.139:0/2971458694 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f50c406ecc0 0x7f50c4071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:14:48.431 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:14:48.430+0000 7f50d8821640 1 --2- 172.21.15.139:0/2971458694 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f50c406ecc0 0x7f50c4071170 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f50d40ff300 tx=0x7f50c8035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:14:48.434 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:14:48.434+0000 7f50d17fa640 1 -- 172.21.15.139:0/2971458694 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f50c005b080 con 0x7f50d40fc700 2024-09-17T07:14:48.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:14:48.597+0000 7f50daa85640 1 -- 172.21.15.139:0/2971458694 --> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f50d4065710 con 0x7f50c406ecc0 2024-09-17T07:14:48.598 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:48 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-09-17T07:14:48.598 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:48 smithi139 ceph-mon[34403]: osdmap e20: 3 total, 3 up, 3 in 2024-09-17T07:14:48.598 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:48 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-17T07:14:49.556 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 17 07:14:49 smithi087 sudo[64629]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-17T07:14:49.556 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 17 07:14:49 smithi087 sudo[64629]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-17T07:14:49.556 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 17 07:14:49 smithi087 sudo[64629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-17T07:14:49.557 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 17 07:14:49 smithi087 sudo[64629]: pam_unix(sudo:session): session closed for user root 2024-09-17T07:14:49.557 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:49 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-17T07:14:49.557 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:49 smithi087 ceph-mon[27636]: osdmap e21: 3 total, 3 up, 3 in 2024-09-17T07:14:49.557 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:49 smithi087 ceph-mon[27636]: pgmap v75: 1 pgs: 1 creating+activating; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-09-17T07:14:49.557 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:49 smithi087 ceph-mon[27636]: from='client.24127 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:14:49.558 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:49 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T07:14:49.558 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:49 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T07:14:49.558 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:49 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:14:49.558 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:49 smithi087 ceph-mon[27636]: Detected new or changed devices on smithi087 2024-09-17T07:14:49.558 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:49 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:14:49.559 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:49 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:14:49.559 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:49 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T07:14:49.559 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:49 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-17T07:14:49.559 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:49 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-17T07:14:49.559 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:49 smithi087 ceph-mon[27636]: Adjusting osd_memory_target on smithi087 to 4288M 2024-09-17T07:14:49.559 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:49 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:14:49.560 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:49 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:14:49.560 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:49 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:14:49.560 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:49 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:14:49.560 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:49 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:14:49.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:49 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-17T07:14:49.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:49 smithi139 ceph-mon[34403]: osdmap e21: 3 total, 3 up, 3 in 2024-09-17T07:14:49.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:49 smithi139 ceph-mon[34403]: pgmap v75: 1 pgs: 1 creating+activating; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-09-17T07:14:49.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:49 smithi139 ceph-mon[34403]: from='client.24127 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:14:49.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:49 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T07:14:49.618 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:49 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T07:14:49.618 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:49 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:14:49.618 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:49 smithi139 ceph-mon[34403]: Detected new or changed devices on smithi087 2024-09-17T07:14:49.618 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:49 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:14:49.618 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:49 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:14:49.618 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:49 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T07:14:49.618 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:49 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-17T07:14:49.618 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:49 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-17T07:14:49.619 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:49 smithi139 ceph-mon[34403]: Adjusting osd_memory_target on smithi087 to 4288M 2024-09-17T07:14:49.619 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:49 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:14:49.619 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:49 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:14:49.619 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:49 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:14:49.619 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:49 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:14:49.619 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:49 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:14:49.830 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 17 07:14:49 smithi087 sudo[64714]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-17T07:14:49.830 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 17 07:14:49 smithi087 sudo[64714]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-17T07:14:49.830 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 17 07:14:49 smithi087 sudo[64714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-17T07:14:49.830 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 17 07:14:49 smithi087 sudo[64714]: pam_unix(sudo:session): session closed for user root 2024-09-17T07:14:50.090 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 17 07:14:49 smithi087 sudo[64725]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-17T07:14:50.090 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 17 07:14:49 smithi087 sudo[64725]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-17T07:14:50.090 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 17 07:14:49 smithi087 sudo[64725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-17T07:14:50.090 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 17 07:14:49 smithi087 sudo[64725]: pam_unix(sudo:session): session closed for user root 2024-09-17T07:14:50.354 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 17 07:14:50 smithi087 sudo[64739]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-17T07:14:50.354 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 17 07:14:50 smithi087 sudo[64739]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-17T07:14:50.354 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 17 07:14:50 smithi087 sudo[64739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-17T07:14:50.354 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 17 07:14:50 smithi087 sudo[64739]: pam_unix(sudo:session): session closed for user root 2024-09-17T07:14:50.567 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:50 smithi139 ceph-mon[34403]: osdmap e22: 3 total, 3 up, 3 in 2024-09-17T07:14:50.567 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:50 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:14:50.615 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:50 smithi087 ceph-mon[27636]: osdmap e22: 3 total, 3 up, 3 in 2024-09-17T07:14:50.615 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:50 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:14:50.615 INFO:journalctl@ceph.osd.2.smithi087.stdout:Sep 17 07:14:50 smithi087 sudo[64824]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-17T07:14:50.616 INFO:journalctl@ceph.osd.2.smithi087.stdout:Sep 17 07:14:50 smithi087 sudo[64824]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-17T07:14:50.616 INFO:journalctl@ceph.osd.2.smithi087.stdout:Sep 17 07:14:50 smithi087 sudo[64824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-17T07:14:50.616 INFO:journalctl@ceph.osd.2.smithi087.stdout:Sep 17 07:14:50 smithi087 sudo[64824]: pam_unix(sudo:session): session closed for user root 2024-09-17T07:14:50.877 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:50 smithi087 sudo[64850]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-17T07:14:50.877 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:50 smithi087 sudo[64850]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-17T07:14:50.877 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:50 smithi087 sudo[64850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-17T07:14:50.877 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:50 smithi087 sudo[64850]: pam_unix(sudo:session): session closed for user root 2024-09-17T07:14:50.877 INFO:journalctl@ceph.osd.2.smithi087.stdout:Sep 17 07:14:50 smithi087 sudo[64847]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-17T07:14:50.878 INFO:journalctl@ceph.osd.2.smithi087.stdout:Sep 17 07:14:50 smithi087 sudo[64847]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-17T07:14:50.878 INFO:journalctl@ceph.osd.2.smithi087.stdout:Sep 17 07:14:50 smithi087 sudo[64847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-17T07:14:50.878 INFO:journalctl@ceph.osd.2.smithi087.stdout:Sep 17 07:14:50 smithi087 sudo[64847]: pam_unix(sudo:session): session closed for user root 2024-09-17T07:14:51.398 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:51 smithi087 sudo[64896]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-17T07:14:51.398 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:51 smithi087 sudo[64896]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-17T07:14:51.398 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:51 smithi087 sudo[64896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-17T07:14:51.398 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:51 smithi087 sudo[64896]: pam_unix(sudo:session): session closed for user root 2024-09-17T07:14:51.640 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:51 smithi139 sudo[37787]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-17T07:14:51.641 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:51 smithi139 sudo[37787]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-17T07:14:51.641 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:51 smithi139 sudo[37787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-17T07:14:51.641 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:51 smithi139 sudo[37787]: pam_unix(sudo:session): session closed for user root 2024-09-17T07:14:51.656 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:14:51.656+0000 7f50d17fa640 1 -- 172.21.15.139:0/2971458694 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f50c00575e0 con 0x7f50d40fc700 2024-09-17T07:14:51.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:51 smithi087 ceph-mon[27636]: pgmap v77: 1 pgs: 1 creating+activating; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-09-17T07:14:51.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:51 smithi087 ceph-mon[27636]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-17T07:14:51.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:51 smithi087 ceph-mon[27636]: from='client.? 172.21.15.139:0/1901453930' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "00b175ca-ddfd-41f9-b219-130321a7fbc9"}]: dispatch 2024-09-17T07:14:51.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:51 smithi087 ceph-mon[27636]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-17T07:14:51.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:51 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mon metadata", "id": "smithi087"}]: dispatch 2024-09-17T07:14:51.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:51 smithi087 ceph-mon[27636]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "00b175ca-ddfd-41f9-b219-130321a7fbc9"}]: dispatch 2024-09-17T07:14:51.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:51 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mon metadata", "id": "smithi139"}]: dispatch 2024-09-17T07:14:51.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:51 smithi087 ceph-mon[27636]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "00b175ca-ddfd-41f9-b219-130321a7fbc9"}]': finished 2024-09-17T07:14:51.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:51 smithi087 ceph-mon[27636]: osdmap e23: 4 total, 3 up, 4 in 2024-09-17T07:14:51.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:51 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T07:14:51.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:51 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mon metadata", "id": "smithi087"}]: dispatch 2024-09-17T07:14:51.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:51 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mon metadata", "id": "smithi139"}]: dispatch 2024-09-17T07:14:51.940 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:51 smithi139 sudo[37790]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-17T07:14:51.940 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:51 smithi139 sudo[37790]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-17T07:14:51.940 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:51 smithi139 sudo[37790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-17T07:14:51.940 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:51 smithi139 sudo[37790]: pam_unix(sudo:session): session closed for user root 2024-09-17T07:14:51.940 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:51 smithi139 ceph-mon[34403]: pgmap v77: 1 pgs: 1 creating+activating; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-09-17T07:14:51.940 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:51 smithi139 ceph-mon[34403]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-17T07:14:51.940 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:51 smithi139 ceph-mon[34403]: from='client.? 172.21.15.139:0/1901453930' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "00b175ca-ddfd-41f9-b219-130321a7fbc9"}]: dispatch 2024-09-17T07:14:51.940 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:51 smithi139 ceph-mon[34403]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-17T07:14:51.941 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:51 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mon metadata", "id": "smithi087"}]: dispatch 2024-09-17T07:14:51.941 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:51 smithi139 ceph-mon[34403]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "00b175ca-ddfd-41f9-b219-130321a7fbc9"}]: dispatch 2024-09-17T07:14:51.941 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:51 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mon metadata", "id": "smithi139"}]: dispatch 2024-09-17T07:14:51.941 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:51 smithi139 ceph-mon[34403]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "00b175ca-ddfd-41f9-b219-130321a7fbc9"}]': finished 2024-09-17T07:14:51.941 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:51 smithi139 ceph-mon[34403]: osdmap e23: 4 total, 3 up, 4 in 2024-09-17T07:14:51.941 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:51 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T07:14:51.941 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:51 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mon metadata", "id": "smithi087"}]: dispatch 2024-09-17T07:14:51.941 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:51 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mon metadata", "id": "smithi139"}]: dispatch 2024-09-17T07:14:52.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:52 smithi087 ceph-mon[27636]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-17T07:14:52.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:52 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:14:52.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:52 smithi087 ceph-mon[27636]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-17T07:14:52.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:52 smithi087 ceph-mon[27636]: mgrmap e19: smithi087.vuvjer(active, since 2m), standbys: smithi139.tuqnpn 2024-09-17T07:14:52.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:52 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:14:52.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:52 smithi087 ceph-mon[27636]: from='client.? 172.21.15.139:0/1369759806' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T07:14:53.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:52 smithi139 ceph-mon[34403]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-17T07:14:53.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:52 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:14:53.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:52 smithi139 ceph-mon[34403]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-17T07:14:53.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:52 smithi139 ceph-mon[34403]: mgrmap e19: smithi087.vuvjer(active, since 2m), standbys: smithi139.tuqnpn 2024-09-17T07:14:53.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:52 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:14:53.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:52 smithi139 ceph-mon[34403]: from='client.? 172.21.15.139:0/1369759806' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T07:14:54.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:54 smithi139 ceph-mon[34403]: pgmap v79: 1 pgs: 1 creating+activating; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-09-17T07:14:54.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:54 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:14:54.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:54 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:14:54.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:54 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:14:54.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:54 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:14:54.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:54 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:14:54.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:54 smithi087 ceph-mon[27636]: pgmap v79: 1 pgs: 1 creating+activating; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-09-17T07:14:54.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:54 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:14:54.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:54 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:14:54.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:54 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:14:54.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:54 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:14:54.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:54 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:14:56.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:56 smithi139 ceph-mon[34403]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-17T07:14:56.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:56 smithi087 ceph-mon[27636]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-17T07:14:58.530 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:58 smithi139 ceph-mon[34403]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-17T07:14:58.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:58 smithi087 ceph-mon[27636]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-17T07:14:59.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:59 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-17T07:14:59.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:14:59 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:14:59.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:59 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-17T07:14:59.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:14:59 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:15:00.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:00 smithi087 ceph-mon[27636]: Deploying daemon osd.3 on smithi139 2024-09-17T07:15:00.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:00 smithi087 ceph-mon[27636]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-17T07:15:00.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:00 smithi139 ceph-mon[34403]: Deploying daemon osd.3 on smithi139 2024-09-17T07:15:00.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:00 smithi139 ceph-mon[34403]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-17T07:15:02.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:02 smithi139 ceph-mon[34403]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-17T07:15:02.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:02 smithi087 ceph-mon[27636]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-17T07:15:03.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:03 smithi139 ceph-mon[34403]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-17T07:15:03.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:03 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:15:03.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:03 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:15:03.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:03 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:15:03.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:03 smithi087 ceph-mon[27636]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-17T07:15:03.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:03 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:15:03.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:03 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:15:03.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:03 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:15:05.849 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:05 smithi139 ceph-mon[34403]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-17T07:15:05.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:05 smithi087 ceph-mon[27636]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-17T07:15:06.173 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:06.172+0000 7f50d17fa640 1 -- 172.21.15.139:0/2971458694 <== mgr.14208 v2:172.21.15.87:6800/611048628 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f50d4065710 con 0x7f50c406ecc0 2024-09-17T07:15:06.173 INFO:teuthology.orchestra.run.smithi139.stdout:Created osd(s) 3 on host 'smithi139' 2024-09-17T07:15:06.176 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:06.174+0000 7f50daa85640 1 -- 172.21.15.139:0/2971458694 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f50c406ecc0 msgr2=0x7f50c4071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:15:06.176 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:06.175+0000 7f50daa85640 1 --2- 172.21.15.139:0/2971458694 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f50c406ecc0 0x7f50c4071170 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f50d40ff300 tx=0x7f50c8035040 comp rx=0 tx=0).stop 2024-09-17T07:15:06.176 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:06.175+0000 7f50daa85640 1 -- 172.21.15.139:0/2971458694 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f50d40fc700 msgr2=0x7f50d40fda40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:15:06.176 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:06.175+0000 7f50daa85640 1 --2- 172.21.15.139:0/2971458694 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f50d40fc700 0x7f50d40fda40 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f50c0002a50 tx=0x7f50c0004600 comp rx=0 tx=0).stop 2024-09-17T07:15:06.176 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:06.175+0000 7f50daa85640 1 -- 172.21.15.139:0/2971458694 shutdown_connections 2024-09-17T07:15:06.176 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:06.175+0000 7f50daa85640 1 --2- 172.21.15.139:0/2971458694 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f50c406ecc0 0x7f50c4071170 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:15:06.176 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:06.175+0000 7f50daa85640 1 --2- 172.21.15.139:0/2971458694 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f50d40fc700 0x7f50d40fda40 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:15:06.176 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:06.175+0000 7f50daa85640 1 --2- 172.21.15.139:0/2971458694 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50d40fb430 0x7f50d40ff550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:15:06.176 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:06.175+0000 7f50daa85640 1 -- 172.21.15.139:0/2971458694 >> 172.21.15.139:0/2971458694 conn(0x7f50d40f6c10 msgr2=0x7f50d4065000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:15:06.176 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:06.175+0000 7f50daa85640 1 -- 172.21.15.139:0/2971458694 shutdown_connections 2024-09-17T07:15:06.176 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:06.175+0000 7f50daa85640 1 -- 172.21.15.139:0/2971458694 wait complete. 2024-09-17T07:15:07.028 DEBUG:teuthology.orchestra.run.smithi139:osd.3> sudo journalctl -f -n 0 -u ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968@osd.3.service 2024-09-17T07:15:07.031 INFO:tasks.cephadm:Deploying osd.4 on smithi139 with /dev/vg_nvme/lv_3... 2024-09-17T07:15:07.032 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-09-17T07:15:07.308 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:07 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:15:07.309 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:07 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:15:07.309 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:07 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:15:07.309 INFO:journalctl@ceph.osd.3.smithi139.stdout:Sep 17 07:15:07 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-3[39860]: 2024-09-17T07:15:07.202+0000 7f051e641440 -1 osd.3 0 log_to_monitors true 2024-09-17T07:15:07.429 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:07 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:15:07.429 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:07 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:15:07.429 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:07 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:15:07.758 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/mon.smithi139/config 2024-09-17T07:15:08.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:08 smithi087 ceph-mon[27636]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-17T07:15:08.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:08 smithi087 ceph-mon[27636]: from='osd.3 [v2:172.21.15.139:6800/796189750,v1:172.21.15.139:6801/796189750]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-17T07:15:08.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:08 smithi087 ceph-mon[27636]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-17T07:15:08.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:08 smithi139 ceph-mon[34403]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-17T07:15:08.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:08 smithi139 ceph-mon[34403]: from='osd.3 [v2:172.21.15.139:6800/796189750,v1:172.21.15.139:6801/796189750]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-17T07:15:08.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:08 smithi139 ceph-mon[34403]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-17T07:15:09.366 INFO:journalctl@ceph.osd.3.smithi139.stdout:Sep 17 07:15:09 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-3[39860]: 2024-09-17T07:15:09.192+0000 7f0519db3640 -1 osd.3 0 waiting for initial osdmap 2024-09-17T07:15:09.366 INFO:journalctl@ceph.osd.3.smithi139.stdout:Sep 17 07:15:09 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-3[39860]: 2024-09-17T07:15:09.197+0000 7f05143e9640 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T07:15:09.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:09 smithi139 ceph-mon[34403]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-17T07:15:09.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:09 smithi139 ceph-mon[34403]: osdmap e24: 4 total, 3 up, 4 in 2024-09-17T07:15:09.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:09 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T07:15:09.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:09 smithi139 ceph-mon[34403]: from='osd.3 [v2:172.21.15.139:6800/796189750,v1:172.21.15.139:6801/796189750]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-09-17T07:15:09.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:09 smithi139 ceph-mon[34403]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-09-17T07:15:09.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:09 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:15:09.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:09 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:15:09.449 INFO:teuthology.orchestra.run.smithi139.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-09-17T07:15:09.533 INFO:teuthology.orchestra.run.smithi139.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-09-17T07:15:09.549 INFO:teuthology.orchestra.run.smithi139.stderr: stderr: 10+0 records in 2024-09-17T07:15:09.549 INFO:teuthology.orchestra.run.smithi139.stderr:10+0 records out 2024-09-17T07:15:09.549 INFO:teuthology.orchestra.run.smithi139.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0131218 s, 799 MB/s 2024-09-17T07:15:09.549 INFO:teuthology.orchestra.run.smithi139.stderr:--> Zapping successful for: 2024-09-17T07:15:09.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:09 smithi087 ceph-mon[27636]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-17T07:15:09.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:09 smithi087 ceph-mon[27636]: osdmap e24: 4 total, 3 up, 4 in 2024-09-17T07:15:09.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:09 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T07:15:09.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:09 smithi087 ceph-mon[27636]: from='osd.3 [v2:172.21.15.139:6800/796189750,v1:172.21.15.139:6801/796189750]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-09-17T07:15:09.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:09 smithi087 ceph-mon[27636]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-09-17T07:15:09.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:09 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:15:09.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:09 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:15:10.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:10 smithi087 ceph-mon[27636]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-17T07:15:10.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:10 smithi087 ceph-mon[27636]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]': finished 2024-09-17T07:15:10.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:10 smithi087 ceph-mon[27636]: osdmap e25: 4 total, 3 up, 4 in 2024-09-17T07:15:10.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:10 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T07:15:10.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:10 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T07:15:10.575 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:10 smithi139 ceph-mon[34403]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-17T07:15:10.575 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:10 smithi139 ceph-mon[34403]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]': finished 2024-09-17T07:15:10.575 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:10 smithi139 ceph-mon[34403]: osdmap e25: 4 total, 3 up, 4 in 2024-09-17T07:15:10.575 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:10 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T07:15:10.575 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:10 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T07:15:11.374 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:11 smithi139 ceph-mon[34403]: purged_snaps scrub starts 2024-09-17T07:15:11.374 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:11 smithi139 ceph-mon[34403]: purged_snaps scrub ok 2024-09-17T07:15:11.374 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:11 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T07:15:11.374 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:11 smithi139 ceph-mon[34403]: osd.3 [v2:172.21.15.139:6800/796189750,v1:172.21.15.139:6801/796189750] boot 2024-09-17T07:15:11.374 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:11 smithi139 ceph-mon[34403]: osdmap e26: 4 total, 4 up, 4 in 2024-09-17T07:15:11.374 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:11 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T07:15:11.374 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:11 smithi139 ceph-mon[34403]: osdmap e27: 4 total, 4 up, 4 in 2024-09-17T07:15:11.406 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi139:vg_nvme/lv_3 2024-09-17T07:15:11.666 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/mon.smithi139/config 2024-09-17T07:15:11.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:11 smithi087 ceph-mon[27636]: purged_snaps scrub starts 2024-09-17T07:15:11.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:11 smithi087 ceph-mon[27636]: purged_snaps scrub ok 2024-09-17T07:15:11.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:11 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T07:15:11.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:11 smithi087 ceph-mon[27636]: osd.3 [v2:172.21.15.139:6800/796189750,v1:172.21.15.139:6801/796189750] boot 2024-09-17T07:15:11.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:11 smithi087 ceph-mon[27636]: osdmap e26: 4 total, 4 up, 4 in 2024-09-17T07:15:11.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:11 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T07:15:11.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:11 smithi087 ceph-mon[27636]: osdmap e27: 4 total, 4 up, 4 in 2024-09-17T07:15:12.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:12 smithi139 ceph-mon[34403]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-17T07:15:12.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:12 smithi139 ceph-mon[34403]: osdmap e28: 4 total, 4 up, 4 in 2024-09-17T07:15:12.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:12 smithi087 ceph-mon[27636]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-17T07:15:12.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:12 smithi087 ceph-mon[27636]: osdmap e28: 4 total, 4 up, 4 in 2024-09-17T07:15:13.878 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:13.873+0000 7f25f245e640 1 -- 172.21.15.139:0/2839496633 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25ec0fc520 msgr2=0x7f25ec0fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:15:13.878 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:13.873+0000 7f25f245e640 1 --2- 172.21.15.139:0/2839496633 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25ec0fc520 0x7f25ec0fc930 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f25dc0048d0 tx=0x7f25dc009da0 comp rx=0 tx=0).stop 2024-09-17T07:15:13.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:13.873+0000 7f25f245e640 1 -- 172.21.15.139:0/2839496633 shutdown_connections 2024-09-17T07:15:13.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:13.873+0000 7f25f245e640 1 --2- 172.21.15.139:0/2839496633 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25ec0fd7f0 0x7f25ec0fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:15:13.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:13.873+0000 7f25f245e640 1 --2- 172.21.15.139:0/2839496633 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25ec0fc520 0x7f25ec0fc930 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:15:13.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:13.873+0000 7f25f245e640 1 -- 172.21.15.139:0/2839496633 >> 172.21.15.139:0/2839496633 conn(0x7f25ec0f7ce0 msgr2=0x7f25ec0fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:15:13.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:13.873+0000 7f25f245e640 1 -- 172.21.15.139:0/2839496633 shutdown_connections 2024-09-17T07:15:13.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:13.873+0000 7f25f245e640 1 -- 172.21.15.139:0/2839496633 wait complete. 2024-09-17T07:15:13.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:13.873+0000 7f25f245e640 1 Processor -- start 2024-09-17T07:15:13.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:13.874+0000 7f25f245e640 1 -- start start 2024-09-17T07:15:13.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:13.874+0000 7f25f245e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25ec0fc520 0x7f25ec071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:15:13.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:13.874+0000 7f25f245e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25ec0fd7f0 0x7f25ec06fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:15:13.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:13.874+0000 7f25f245e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25ec06fff0 con 0x7f25ec0fc520 2024-09-17T07:15:13.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:13.874+0000 7f25f245e640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25ec070130 con 0x7f25ec0fd7f0 2024-09-17T07:15:13.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:13.874+0000 7f25eb7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25ec0fd7f0 0x7f25ec06fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:15:13.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:13.874+0000 7f25eb7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25ec0fd7f0 0x7f25ec06fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:36724/0 (socket says 172.21.15.139:36724) 2024-09-17T07:15:13.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:13.874+0000 7f25eb7fe640 1 -- 172.21.15.139:0/3637029417 learned_addr learned my addr 172.21.15.139:0/3637029417 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-17T07:15:13.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:13.874+0000 7f25ebfff640 1 --2- 172.21.15.139:0/3637029417 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25ec0fc520 0x7f25ec071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:15:13.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:13.874+0000 7f25eb7fe640 1 -- 172.21.15.139:0/3637029417 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25ec0fc520 msgr2=0x7f25ec071570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:15:13.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:13.874+0000 7f25eb7fe640 1 --2- 172.21.15.139:0/3637029417 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25ec0fc520 0x7f25ec071570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:15:13.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:13.874+0000 7f25eb7fe640 1 -- 172.21.15.139:0/3637029417 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25dc005040 con 0x7f25ec0fd7f0 2024-09-17T07:15:13.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:13.874+0000 7f25eb7fe640 1 --2- 172.21.15.139:0/3637029417 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25ec0fd7f0 0x7f25ec06fa60 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f25e000c810 tx=0x7f25e00043c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:15:13.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:13.875+0000 7f25e8ff9640 1 -- 172.21.15.139:0/3637029417 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25e000a7a0 con 0x7f25ec0fd7f0 2024-09-17T07:15:13.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:13.875+0000 7f25e8ff9640 1 -- 172.21.15.139:0/3637029417 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f25e000ad80 con 0x7f25ec0fd7f0 2024-09-17T07:15:13.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:13.875+0000 7f25f245e640 1 -- 172.21.15.139:0/3637029417 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25ec070410 con 0x7f25ec0fd7f0 2024-09-17T07:15:13.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:13.875+0000 7f25e8ff9640 1 -- 172.21.15.139:0/3637029417 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25e0011380 con 0x7f25ec0fd7f0 2024-09-17T07:15:13.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:13.875+0000 7f25f245e640 1 -- 172.21.15.139:0/3637029417 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25ec114ff0 con 0x7f25ec0fd7f0 2024-09-17T07:15:13.881 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:13.876+0000 7f25f245e640 1 -- 172.21.15.139:0/3637029417 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25ec0fb980 con 0x7f25ec0fd7f0 2024-09-17T07:15:13.881 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:13.876+0000 7f25e8ff9640 1 -- 172.21.15.139:0/3637029417 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f25e0012420 con 0x7f25ec0fd7f0 2024-09-17T07:15:13.881 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:13.877+0000 7f25e8ff9640 1 --2- 172.21.15.139:0/3637029417 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f25d406ed60 0x7f25d4071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:15:13.881 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:13.877+0000 7f25e8ff9640 1 -- 172.21.15.139:0/3637029417 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 3770+0+0 (secure 0 0 0) 0x7f25e008de90 con 0x7f25ec0fd7f0 2024-09-17T07:15:13.881 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:13.877+0000 7f25ebfff640 1 --2- 172.21.15.139:0/3637029417 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f25d406ed60 0x7f25d4071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:15:13.881 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:13.877+0000 7f25ebfff640 1 --2- 172.21.15.139:0/3637029417 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f25d406ed60 0x7f25d4071210 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f25ec071320 tx=0x7f25dc035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:15:13.882 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:13.881+0000 7f25e8ff9640 1 -- 172.21.15.139:0/3637029417 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f25e005b6d0 con 0x7f25ec0fd7f0 2024-09-17T07:15:14.044 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:14.042+0000 7f25f245e640 1 -- 172.21.15.139:0/3637029417 --> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f25ec101d30 con 0x7f25d406ed60 2024-09-17T07:15:14.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:14 smithi139 ceph-mon[34403]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-17T07:15:14.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:14 smithi139 ceph-mon[34403]: Detected new or changed devices on smithi139 2024-09-17T07:15:14.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:14 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:15:14.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:14 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:15:14.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:14 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-17T07:15:14.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:14 smithi139 ceph-mon[34403]: Adjusting osd_memory_target on smithi139 to 15936M 2024-09-17T07:15:14.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:14 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:15:14.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:14 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:15:14.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:14 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:15:14.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:14 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:15:14.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:14 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:15:14.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:14 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:15:14.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:14 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:15:14.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:14 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:15:14.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:14 smithi087 ceph-mon[27636]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-17T07:15:14.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:14 smithi087 ceph-mon[27636]: Detected new or changed devices on smithi139 2024-09-17T07:15:14.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:14 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:15:14.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:14 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:15:14.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:14 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-17T07:15:14.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:14 smithi087 ceph-mon[27636]: Adjusting osd_memory_target on smithi139 to 15936M 2024-09-17T07:15:14.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:14 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:15:14.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:14 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:15:14.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:14 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:15:14.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:14 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:15:14.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:14 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:15:14.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:14 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:15:14.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:14 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:15:14.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:14 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:15:15.319 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:15 smithi139 ceph-mon[34403]: from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:15:15.319 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:15 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T07:15:15.319 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:15 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T07:15:15.319 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:15 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:15:15.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:15 smithi087 ceph-mon[27636]: from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:15:15.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:15 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T07:15:15.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:15 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T07:15:15.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:15 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:15:16.101 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:16 smithi139 ceph-mon[34403]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 107 KiB/s, 0 objects/s recovering 2024-09-17T07:15:16.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:16 smithi087 ceph-mon[27636]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 107 KiB/s, 0 objects/s recovering 2024-09-17T07:15:17.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:17 smithi139 ceph-mon[34403]: from='client.? 172.21.15.139:0/1083791244' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d318cab6-e472-472e-8805-d2ab7e04db2f"}]: dispatch 2024-09-17T07:15:17.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:17 smithi139 ceph-mon[34403]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d318cab6-e472-472e-8805-d2ab7e04db2f"}]: dispatch 2024-09-17T07:15:17.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:17 smithi139 ceph-mon[34403]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d318cab6-e472-472e-8805-d2ab7e04db2f"}]': finished 2024-09-17T07:15:17.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:17 smithi139 ceph-mon[34403]: osdmap e29: 5 total, 4 up, 5 in 2024-09-17T07:15:17.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:17 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T07:15:17.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:17 smithi139 ceph-mon[34403]: from='client.? 172.21.15.139:0/2472482261' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T07:15:17.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:17 smithi087 ceph-mon[27636]: from='client.? 172.21.15.139:0/1083791244' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d318cab6-e472-472e-8805-d2ab7e04db2f"}]: dispatch 2024-09-17T07:15:17.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:17 smithi087 ceph-mon[27636]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d318cab6-e472-472e-8805-d2ab7e04db2f"}]: dispatch 2024-09-17T07:15:17.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:17 smithi087 ceph-mon[27636]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d318cab6-e472-472e-8805-d2ab7e04db2f"}]': finished 2024-09-17T07:15:17.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:17 smithi087 ceph-mon[27636]: osdmap e29: 5 total, 4 up, 5 in 2024-09-17T07:15:17.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:17 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T07:15:17.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:17 smithi087 ceph-mon[27636]: from='client.? 172.21.15.139:0/2472482261' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T07:15:18.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:18 smithi139 ceph-mon[34403]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-09-17T07:15:18.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:18 smithi087 ceph-mon[27636]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-09-17T07:15:20.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:20 smithi139 ceph-mon[34403]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-17T07:15:20.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:20 smithi087 ceph-mon[27636]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-17T07:15:22.173 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:22 smithi139 ceph-mon[34403]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-17T07:15:22.173 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:22 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:15:22.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:22 smithi087 ceph-mon[27636]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-17T07:15:22.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:22 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:15:24.201 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:24 smithi139 ceph-mon[34403]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-17T07:15:24.201 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:24 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-17T07:15:24.201 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:24 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:15:24.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:24 smithi087 ceph-mon[27636]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-17T07:15:24.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:24 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-17T07:15:24.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:24 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:15:25.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:25 smithi139 ceph-mon[34403]: Deploying daemon osd.4 on smithi139 2024-09-17T07:15:25.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:25 smithi087 ceph-mon[27636]: Deploying daemon osd.4 on smithi139 2024-09-17T07:15:26.282 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:26 smithi139 ceph-mon[34403]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-17T07:15:26.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:26 smithi087 ceph-mon[27636]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-17T07:15:28.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:28 smithi139 ceph-mon[34403]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-17T07:15:28.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:28 smithi087 ceph-mon[27636]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-17T07:15:29.080 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:29 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:15:29.080 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:29 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:15:29.080 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:29 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:15:29.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:29 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:15:29.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:29 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:15:29.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:29 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:15:30.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:30 smithi139 ceph-mon[34403]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-17T07:15:30.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:30 smithi087 ceph-mon[27636]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-17T07:15:31.208 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:31.208+0000 7f25e8ff9640 1 -- 172.21.15.139:0/3637029417 <== mgr.14208 v2:172.21.15.87:6800/611048628 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f25ec101d30 con 0x7f25d406ed60 2024-09-17T07:15:31.208 INFO:teuthology.orchestra.run.smithi139.stdout:Created osd(s) 4 on host 'smithi139' 2024-09-17T07:15:31.210 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:31.210+0000 7f25f245e640 1 -- 172.21.15.139:0/3637029417 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f25d406ed60 msgr2=0x7f25d4071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:15:31.210 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:31.210+0000 7f25f245e640 1 --2- 172.21.15.139:0/3637029417 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f25d406ed60 0x7f25d4071210 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f25ec071320 tx=0x7f25dc035040 comp rx=0 tx=0).stop 2024-09-17T07:15:31.210 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:31.210+0000 7f25f245e640 1 -- 172.21.15.139:0/3637029417 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25ec0fd7f0 msgr2=0x7f25ec06fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:15:31.210 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:31.210+0000 7f25f245e640 1 --2- 172.21.15.139:0/3637029417 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25ec0fd7f0 0x7f25ec06fa60 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f25e000c810 tx=0x7f25e00043c0 comp rx=0 tx=0).stop 2024-09-17T07:15:31.210 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:31.210+0000 7f25f245e640 1 -- 172.21.15.139:0/3637029417 shutdown_connections 2024-09-17T07:15:31.210 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:31.210+0000 7f25f245e640 1 --2- 172.21.15.139:0/3637029417 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f25d406ed60 0x7f25d4071210 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:15:31.211 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:31.210+0000 7f25f245e640 1 --2- 172.21.15.139:0/3637029417 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25ec0fd7f0 0x7f25ec06fa60 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:15:31.211 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:31.210+0000 7f25f245e640 1 --2- 172.21.15.139:0/3637029417 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25ec0fc520 0x7f25ec071570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:15:31.211 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:31.210+0000 7f25f245e640 1 -- 172.21.15.139:0/3637029417 >> 172.21.15.139:0/3637029417 conn(0x7f25ec0f7ce0 msgr2=0x7f25ec0f9560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:15:31.211 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:31.210+0000 7f25f245e640 1 -- 172.21.15.139:0/3637029417 shutdown_connections 2024-09-17T07:15:31.211 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:31.210+0000 7f25f245e640 1 -- 172.21.15.139:0/3637029417 wait complete. 2024-09-17T07:15:32.178 DEBUG:teuthology.orchestra.run.smithi139:osd.4> sudo journalctl -f -n 0 -u ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968@osd.4.service 2024-09-17T07:15:32.180 INFO:tasks.cephadm:Deploying osd.5 on smithi139 with /dev/vg_nvme/lv_2... 2024-09-17T07:15:32.180 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-09-17T07:15:32.442 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:32 smithi139 ceph-mon[34403]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-17T07:15:32.442 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:32 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:15:32.442 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:32 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:15:32.442 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 17 07:15:32 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-4[46317]: 2024-09-17T07:15:32.305+0000 7f0c3dbc4440 -1 osd.4 0 log_to_monitors true 2024-09-17T07:15:32.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:32 smithi087 ceph-mon[27636]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-17T07:15:32.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:32 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:15:32.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:32 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:15:32.934 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/mon.smithi139/config 2024-09-17T07:15:33.352 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:33 smithi139 ceph-mon[34403]: from='osd.4 [v2:172.21.15.139:6808/1310055282,v1:172.21.15.139:6809/1310055282]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-17T07:15:33.352 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:33 smithi139 ceph-mon[34403]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-17T07:15:33.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:33 smithi087 ceph-mon[27636]: from='osd.4 [v2:172.21.15.139:6808/1310055282,v1:172.21.15.139:6809/1310055282]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-17T07:15:33.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:33 smithi087 ceph-mon[27636]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-17T07:15:34.449 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 17 07:15:34 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-4[46317]: 2024-09-17T07:15:34.216+0000 7f0c39336640 -1 osd.4 0 waiting for initial osdmap 2024-09-17T07:15:34.450 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 17 07:15:34 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-4[46317]: 2024-09-17T07:15:34.223+0000 7f0c36171640 -1 osd.4 31 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T07:15:34.450 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:34 smithi139 ceph-mon[34403]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-17T07:15:34.450 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:34 smithi139 ceph-mon[34403]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-17T07:15:34.450 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:34 smithi139 ceph-mon[34403]: osdmap e30: 5 total, 4 up, 5 in 2024-09-17T07:15:34.450 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:34 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T07:15:34.450 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:34 smithi139 ceph-mon[34403]: from='osd.4 [v2:172.21.15.139:6808/1310055282,v1:172.21.15.139:6809/1310055282]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-09-17T07:15:34.450 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:34 smithi139 ceph-mon[34403]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-09-17T07:15:34.450 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:34 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:15:34.450 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:34 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:15:34.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:34 smithi087 ceph-mon[27636]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-17T07:15:34.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:34 smithi087 ceph-mon[27636]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-17T07:15:34.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:34 smithi087 ceph-mon[27636]: osdmap e30: 5 total, 4 up, 5 in 2024-09-17T07:15:34.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:34 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T07:15:34.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:34 smithi087 ceph-mon[27636]: from='osd.4 [v2:172.21.15.139:6808/1310055282,v1:172.21.15.139:6809/1310055282]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-09-17T07:15:34.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:34 smithi087 ceph-mon[27636]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-09-17T07:15:34.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:34 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:15:34.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:34 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:15:34.902 INFO:teuthology.orchestra.run.smithi139.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-09-17T07:15:34.987 INFO:teuthology.orchestra.run.smithi139.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-09-17T07:15:35.001 INFO:teuthology.orchestra.run.smithi139.stderr: stderr: 10+0 records in 2024-09-17T07:15:35.001 INFO:teuthology.orchestra.run.smithi139.stderr:10+0 records out 2024-09-17T07:15:35.002 INFO:teuthology.orchestra.run.smithi139.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0124281 s, 844 MB/s 2024-09-17T07:15:35.002 INFO:teuthology.orchestra.run.smithi139.stderr:--> Zapping successful for: 2024-09-17T07:15:35.319 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:35 smithi139 ceph-mon[34403]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]': finished 2024-09-17T07:15:35.319 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:35 smithi139 ceph-mon[34403]: osdmap e31: 5 total, 4 up, 5 in 2024-09-17T07:15:35.319 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:35 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T07:15:35.319 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:35 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T07:15:35.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:35 smithi087 ceph-mon[27636]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]': finished 2024-09-17T07:15:35.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:35 smithi087 ceph-mon[27636]: osdmap e31: 5 total, 4 up, 5 in 2024-09-17T07:15:35.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:35 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T07:15:35.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:35 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T07:15:35.773 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi139:vg_nvme/lv_2 2024-09-17T07:15:36.492 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:36 smithi139 ceph-mon[34403]: purged_snaps scrub starts 2024-09-17T07:15:36.492 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:36 smithi139 ceph-mon[34403]: purged_snaps scrub ok 2024-09-17T07:15:36.492 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:36 smithi139 ceph-mon[34403]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-17T07:15:36.492 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:36 smithi139 ceph-mon[34403]: osd.4 [v2:172.21.15.139:6808/1310055282,v1:172.21.15.139:6809/1310055282] boot 2024-09-17T07:15:36.492 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:36 smithi139 ceph-mon[34403]: osdmap e32: 5 total, 5 up, 5 in 2024-09-17T07:15:36.492 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:36 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T07:15:36.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:36 smithi087 ceph-mon[27636]: purged_snaps scrub starts 2024-09-17T07:15:36.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:36 smithi087 ceph-mon[27636]: purged_snaps scrub ok 2024-09-17T07:15:36.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:36 smithi087 ceph-mon[27636]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-17T07:15:36.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:36 smithi087 ceph-mon[27636]: osd.4 [v2:172.21.15.139:6808/1310055282,v1:172.21.15.139:6809/1310055282] boot 2024-09-17T07:15:36.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:36 smithi087 ceph-mon[27636]: osdmap e32: 5 total, 5 up, 5 in 2024-09-17T07:15:36.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:36 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T07:15:36.755 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/mon.smithi139/config 2024-09-17T07:15:37.473 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:37 smithi139 ceph-mon[34403]: osdmap e33: 5 total, 5 up, 5 in 2024-09-17T07:15:37.473 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:37 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:15:37.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:37 smithi087 ceph-mon[27636]: osdmap e33: 5 total, 5 up, 5 in 2024-09-17T07:15:37.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:37 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:15:38.514 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:38 smithi139 ceph-mon[34403]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-17T07:15:38.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:38 smithi087 ceph-mon[27636]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-17T07:15:39.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:39.014+0000 7fad29cc1640 1 -- 172.21.15.139:0/3709746800 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fad240fc720 msgr2=0x7fad240fcb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:15:39.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:39.014+0000 7fad29cc1640 1 --2- 172.21.15.139:0/3709746800 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fad240fc720 0x7fad240fcb90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fad180048d0 tx=0x7fad18009da0 comp rx=0 tx=0).stop 2024-09-17T07:15:39.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:39.014+0000 7fad29cc1640 1 -- 172.21.15.139:0/3709746800 shutdown_connections 2024-09-17T07:15:39.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:39.014+0000 7fad29cc1640 1 --2- 172.21.15.139:0/3709746800 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fad240fc720 0x7fad240fcb90 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:15:39.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:39.014+0000 7fad29cc1640 1 --2- 172.21.15.139:0/3709746800 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad240fb450 0x7fad240fb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:15:39.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:39.014+0000 7fad29cc1640 1 -- 172.21.15.139:0/3709746800 >> 172.21.15.139:0/3709746800 conn(0x7fad240f6c10 msgr2=0x7fad240f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:15:39.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:39.014+0000 7fad29cc1640 1 -- 172.21.15.139:0/3709746800 shutdown_connections 2024-09-17T07:15:39.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:39.014+0000 7fad29cc1640 1 -- 172.21.15.139:0/3709746800 wait complete. 2024-09-17T07:15:39.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:39.015+0000 7fad29cc1640 1 Processor -- start 2024-09-17T07:15:39.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:39.015+0000 7fad29cc1640 1 -- start start 2024-09-17T07:15:39.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:39.015+0000 7fad29cc1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad240fb450 0x7fad24066640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:15:39.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:39.015+0000 7fad29cc1640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fad240fc720 0x7fad24111d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:15:39.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:39.015+0000 7fad29cc1640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad24112380 con 0x7fad240fb450 2024-09-17T07:15:39.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:39.015+0000 7fad29cc1640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad241124c0 con 0x7fad240fc720 2024-09-17T07:15:39.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:39.015+0000 7fad22ffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fad240fc720 0x7fad24111d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:15:39.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:39.015+0000 7fad22ffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fad240fc720 0x7fad24111d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41982/0 (socket says 172.21.15.139:41982) 2024-09-17T07:15:39.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:39.015+0000 7fad22ffd640 1 -- 172.21.15.139:0/1689546160 learned_addr learned my addr 172.21.15.139:0/1689546160 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-17T07:15:39.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:39.015+0000 7fad237fe640 1 --2- 172.21.15.139:0/1689546160 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad240fb450 0x7fad24066640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:15:39.020 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:39.015+0000 7fad22ffd640 1 -- 172.21.15.139:0/1689546160 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad240fb450 msgr2=0x7fad24066640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:15:39.020 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:39.015+0000 7fad22ffd640 1 --2- 172.21.15.139:0/1689546160 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad240fb450 0x7fad24066640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:15:39.020 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:39.015+0000 7fad22ffd640 1 -- 172.21.15.139:0/1689546160 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad18005040 con 0x7fad240fc720 2024-09-17T07:15:39.020 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:39.015+0000 7fad237fe640 1 --2- 172.21.15.139:0/1689546160 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad240fb450 0x7fad24066640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T07:15:39.020 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:39.015+0000 7fad22ffd640 1 --2- 172.21.15.139:0/1689546160 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fad240fc720 0x7fad24111d50 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fad18009ac0 tx=0x7fad18009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:15:39.020 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:39.016+0000 7fad0bfff640 1 -- 172.21.15.139:0/1689546160 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad18038070 con 0x7fad240fc720 2024-09-17T07:15:39.020 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:39.016+0000 7fad0bfff640 1 -- 172.21.15.139:0/1689546160 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fad1802ae70 con 0x7fad240fc720 2024-09-17T07:15:39.020 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:39.016+0000 7fad29cc1640 1 -- 172.21.15.139:0/1689546160 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad24112740 con 0x7fad240fc720 2024-09-17T07:15:39.020 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:39.016+0000 7fad0bfff640 1 -- 172.21.15.139:0/1689546160 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad18033420 con 0x7fad240fc720 2024-09-17T07:15:39.021 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:39.016+0000 7fad29cc1640 1 -- 172.21.15.139:0/1689546160 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad24112c80 con 0x7fad240fc720 2024-09-17T07:15:39.021 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:39.017+0000 7fad29cc1640 1 -- 172.21.15.139:0/1689546160 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad2404b720 con 0x7fad240fc720 2024-09-17T07:15:39.021 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:39.017+0000 7fad0bfff640 1 -- 172.21.15.139:0/1689546160 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fad18030020 con 0x7fad240fc720 2024-09-17T07:15:39.021 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:39.018+0000 7fad0bfff640 1 --2- 172.21.15.139:0/1689546160 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fad0c06ed60 0x7fad0c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:15:39.021 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:39.018+0000 7fad0bfff640 1 -- 172.21.15.139:0/1689546160 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4202+0+0 (secure 0 0 0) 0x7fad180adca0 con 0x7fad240fc720 2024-09-17T07:15:39.021 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:39.018+0000 7fad237fe640 1 --2- 172.21.15.139:0/1689546160 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fad0c06ed60 0x7fad0c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:15:39.021 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:39.019+0000 7fad237fe640 1 --2- 172.21.15.139:0/1689546160 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fad0c06ed60 0x7fad0c071210 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fad140041d0 tx=0x7fad14009040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:15:39.022 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:39.022+0000 7fad0bfff640 1 -- 172.21.15.139:0/1689546160 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fad180b2070 con 0x7fad240fc720 2024-09-17T07:15:39.187 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:39.187+0000 7fad29cc1640 1 -- 172.21.15.139:0/1689546160 --> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fad2405db50 con 0x7fad0c06ed60 2024-09-17T07:15:39.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:39 smithi139 ceph-mon[34403]: Detected new or changed devices on smithi139 2024-09-17T07:15:39.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:39 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:15:39.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:39 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:15:39.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:39 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-17T07:15:39.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:39 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-17T07:15:39.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:39 smithi139 ceph-mon[34403]: Adjusting osd_memory_target on smithi139 to 7968M 2024-09-17T07:15:39.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:39 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:15:39.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:39 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:15:39.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:39 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:15:39.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:39 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:15:39.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:39 smithi139 ceph-mon[34403]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-17T07:15:39.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:39 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:15:39.868 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:39 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:15:39.868 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:39 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:15:39.868 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:39 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:15:39.868 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:39 smithi139 ceph-mon[34403]: from='client.24167 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:15:39.868 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:39 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T07:15:39.868 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:39 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T07:15:39.868 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:39 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:15:39.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:39 smithi087 ceph-mon[27636]: Detected new or changed devices on smithi139 2024-09-17T07:15:39.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:39 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:15:39.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:39 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:15:39.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:39 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-17T07:15:39.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:39 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-17T07:15:39.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:39 smithi087 ceph-mon[27636]: Adjusting osd_memory_target on smithi139 to 7968M 2024-09-17T07:15:39.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:39 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:15:39.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:39 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:15:39.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:39 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:15:39.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:39 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:15:39.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:39 smithi087 ceph-mon[27636]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-17T07:15:39.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:39 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:15:39.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:39 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:15:39.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:39 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:15:39.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:39 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:15:39.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:39 smithi087 ceph-mon[27636]: from='client.24167 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:15:39.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:39 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T07:15:39.928 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:39 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T07:15:39.928 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:39 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:15:41.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:41 smithi087 ceph-mon[27636]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-17T07:15:41.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:41 smithi087 ceph-mon[27636]: from='client.? 172.21.15.139:0/1267691199' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "37b86806-e559-401c-aedf-3d9de1ac347e"}]: dispatch 2024-09-17T07:15:41.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:41 smithi087 ceph-mon[27636]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "37b86806-e559-401c-aedf-3d9de1ac347e"}]: dispatch 2024-09-17T07:15:41.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:41 smithi087 ceph-mon[27636]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "37b86806-e559-401c-aedf-3d9de1ac347e"}]': finished 2024-09-17T07:15:41.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:41 smithi087 ceph-mon[27636]: osdmap e34: 6 total, 5 up, 6 in 2024-09-17T07:15:41.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:41 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T07:15:41.938 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:41 smithi139 ceph-mon[34403]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-17T07:15:41.938 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:41 smithi139 ceph-mon[34403]: from='client.? 172.21.15.139:0/1267691199' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "37b86806-e559-401c-aedf-3d9de1ac347e"}]: dispatch 2024-09-17T07:15:41.938 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:41 smithi139 ceph-mon[34403]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "37b86806-e559-401c-aedf-3d9de1ac347e"}]: dispatch 2024-09-17T07:15:41.938 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:41 smithi139 ceph-mon[34403]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "37b86806-e559-401c-aedf-3d9de1ac347e"}]': finished 2024-09-17T07:15:41.939 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:41 smithi139 ceph-mon[34403]: osdmap e34: 6 total, 5 up, 6 in 2024-09-17T07:15:41.939 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:41 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T07:15:42.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:42 smithi087 ceph-mon[27636]: from='client.? 172.21.15.139:0/1587328574' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T07:15:43.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:42 smithi139 ceph-mon[34403]: from='client.? 172.21.15.139:0/1587328574' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T07:15:43.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:43 smithi087 ceph-mon[27636]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-17T07:15:44.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:43 smithi139 ceph-mon[34403]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-17T07:15:45.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:45 smithi087 ceph-mon[27636]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-17T07:15:46.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:45 smithi139 ceph-mon[34403]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-17T07:15:47.863 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:47 smithi139 ceph-mon[34403]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-17T07:15:47.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:47 smithi087 ceph-mon[27636]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-17T07:15:50.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:49 smithi139 ceph-mon[34403]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-17T07:15:50.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:49 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-17T07:15:50.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:49 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:15:50.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:49 smithi139 ceph-mon[34403]: Deploying daemon osd.5 on smithi139 2024-09-17T07:15:50.119 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:49 smithi087 ceph-mon[27636]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-17T07:15:50.119 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:49 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-17T07:15:50.119 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:49 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:15:50.119 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:49 smithi087 ceph-mon[27636]: Deploying daemon osd.5 on smithi139 2024-09-17T07:15:52.077 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:51 smithi139 ceph-mon[34403]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-17T07:15:52.077 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:51 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:15:52.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:51 smithi087 ceph-mon[27636]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-17T07:15:52.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:51 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:15:53.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:53 smithi139 ceph-mon[34403]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-17T07:15:54.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:53 smithi087 ceph-mon[27636]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-17T07:15:54.937 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:54 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:15:54.937 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:54 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:15:54.938 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:54 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:15:55.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:54 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:15:55.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:54 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:15:55.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:54 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:15:56.050 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:55 smithi139 ceph-mon[34403]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-17T07:15:56.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:55 smithi087 ceph-mon[27636]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-17T07:15:57.809 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:57.807+0000 7fad0bfff640 1 -- 172.21.15.139:0/1689546160 <== mgr.14208 v2:172.21.15.87:6800/611048628 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fad2405db50 con 0x7fad0c06ed60 2024-09-17T07:15:57.813 INFO:teuthology.orchestra.run.smithi139.stdout:Created osd(s) 5 on host 'smithi139' 2024-09-17T07:15:57.813 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:57.810+0000 7fad29cc1640 1 -- 172.21.15.139:0/1689546160 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fad0c06ed60 msgr2=0x7fad0c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:15:57.813 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:57.810+0000 7fad29cc1640 1 --2- 172.21.15.139:0/1689546160 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fad0c06ed60 0x7fad0c071210 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fad140041d0 tx=0x7fad14009040 comp rx=0 tx=0).stop 2024-09-17T07:15:57.814 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:57.810+0000 7fad29cc1640 1 -- 172.21.15.139:0/1689546160 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fad240fc720 msgr2=0x7fad24111d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:15:57.814 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:57.810+0000 7fad29cc1640 1 --2- 172.21.15.139:0/1689546160 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fad240fc720 0x7fad24111d50 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fad18009ac0 tx=0x7fad18009da0 comp rx=0 tx=0).stop 2024-09-17T07:15:57.814 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:57.810+0000 7fad29cc1640 1 -- 172.21.15.139:0/1689546160 shutdown_connections 2024-09-17T07:15:57.814 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:57.810+0000 7fad29cc1640 1 --2- 172.21.15.139:0/1689546160 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fad0c06ed60 0x7fad0c071210 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:15:57.814 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:57.810+0000 7fad29cc1640 1 --2- 172.21.15.139:0/1689546160 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fad240fc720 0x7fad24111d50 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:15:57.814 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:57.810+0000 7fad29cc1640 1 --2- 172.21.15.139:0/1689546160 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad240fb450 0x7fad24066640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:15:57.814 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:57.810+0000 7fad29cc1640 1 -- 172.21.15.139:0/1689546160 >> 172.21.15.139:0/1689546160 conn(0x7fad240f6c10 msgr2=0x7fad240ffa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:15:57.814 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:57.810+0000 7fad29cc1640 1 -- 172.21.15.139:0/1689546160 shutdown_connections 2024-09-17T07:15:57.814 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:15:57.810+0000 7fad29cc1640 1 -- 172.21.15.139:0/1689546160 wait complete. 2024-09-17T07:15:58.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:58 smithi139 ceph-mon[34403]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-17T07:15:58.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:58 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:15:58.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:58 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:15:58.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:58 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:15:58.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:58 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:15:58.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:58 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:15:58.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:58 smithi139 ceph-mon[34403]: from='osd.5 [v2:172.21.15.139:6816/1731614128,v1:172.21.15.139:6817/1731614128]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-17T07:15:58.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:58 smithi139 ceph-mon[34403]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-17T07:15:58.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:58 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:15:58.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:58 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:15:58.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:58 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:15:58.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:58 smithi087 ceph-mon[27636]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-17T07:15:58.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:58 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:15:58.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:58 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:15:58.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:58 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:15:58.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:58 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:15:58.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:58 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:15:58.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:58 smithi087 ceph-mon[27636]: from='osd.5 [v2:172.21.15.139:6816/1731614128,v1:172.21.15.139:6817/1731614128]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-17T07:15:58.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:58 smithi087 ceph-mon[27636]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-17T07:15:58.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:58 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:15:58.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:58 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:15:58.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:58 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:15:58.445 DEBUG:teuthology.orchestra.run.smithi139:osd.5> sudo journalctl -f -n 0 -u ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968@osd.5.service 2024-09-17T07:15:58.447 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-09-17T07:15:58.448 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-17T07:15:58.706 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/mon.smithi087/config 2024-09-17T07:15:59.754 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:59 smithi139 ceph-mon[34403]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-17T07:15:59.754 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:59 smithi139 ceph-mon[34403]: osdmap e35: 6 total, 5 up, 6 in 2024-09-17T07:15:59.754 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:59 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T07:15:59.754 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:59 smithi139 ceph-mon[34403]: from='osd.5 [v2:172.21.15.139:6816/1731614128,v1:172.21.15.139:6817/1731614128]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-09-17T07:15:59.754 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:59 smithi139 ceph-mon[34403]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-09-17T07:15:59.754 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:15:59 smithi139 ceph-mon[34403]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-17T07:15:59.754 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:15:59 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-5[53021]: 2024-09-17T07:15:59.496+0000 7fe5f796f640 -1 osd.5 0 waiting for initial osdmap 2024-09-17T07:15:59.754 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:15:59 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-5[53021]: 2024-09-17T07:15:59.505+0000 7fe5f2fa7640 -1 osd.5 36 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T07:15:59.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:59 smithi087 ceph-mon[27636]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-17T07:15:59.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:59 smithi087 ceph-mon[27636]: osdmap e35: 6 total, 5 up, 6 in 2024-09-17T07:15:59.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:59 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T07:15:59.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:59 smithi087 ceph-mon[27636]: from='osd.5 [v2:172.21.15.139:6816/1731614128,v1:172.21.15.139:6817/1731614128]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-09-17T07:15:59.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:59 smithi087 ceph-mon[27636]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-09-17T07:15:59.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:15:59 smithi087 ceph-mon[27636]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-17T07:16:00.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:00.383+0000 7f2a432b8640 1 -- 172.21.15.87:0/1531861257 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2a3c0fd440 msgr2=0x7f2a3c103db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:00.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:00.383+0000 7f2a432b8640 1 --2- 172.21.15.87:0/1531861257 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2a3c0fd440 0x7f2a3c103db0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2a380048d0 tx=0x7f2a38009da0 comp rx=0 tx=0).stop 2024-09-17T07:16:00.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:00.383+0000 7f2a432b8640 1 -- 172.21.15.87:0/1531861257 shutdown_connections 2024-09-17T07:16:00.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:00.383+0000 7f2a432b8640 1 --2- 172.21.15.87:0/1531861257 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2a3c0fd440 0x7f2a3c103db0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:00.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:00.383+0000 7f2a432b8640 1 --2- 172.21.15.87:0/1531861257 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2a3c0fcaf0 0x7f2a3c0fcf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:00.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:00.383+0000 7f2a432b8640 1 -- 172.21.15.87:0/1531861257 >> 172.21.15.87:0/1531861257 conn(0x7f2a3c0f63c0 msgr2=0x7f2a3c0f87f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:16:00.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:00.383+0000 7f2a432b8640 1 -- 172.21.15.87:0/1531861257 shutdown_connections 2024-09-17T07:16:00.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:00.383+0000 7f2a432b8640 1 -- 172.21.15.87:0/1531861257 wait complete. 2024-09-17T07:16:00.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:00.384+0000 7f2a432b8640 1 Processor -- start 2024-09-17T07:16:00.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:00.384+0000 7f2a432b8640 1 -- start start 2024-09-17T07:16:00.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:00.384+0000 7f2a432b8640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2a3c0fcaf0 0x7f2a3c10f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:16:00.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:00.384+0000 7f2a432b8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2a3c0fd440 0x7f2a3c10f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:16:00.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:00.384+0000 7f2a432b8640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3c10fdc0 con 0x7f2a3c0fd440 2024-09-17T07:16:00.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:00.384+0000 7f2a432b8640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3c1105e0 con 0x7f2a3c0fcaf0 2024-09-17T07:16:00.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:00.384+0000 7f2a40853640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2a3c0fd440 0x7f2a3c10f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:16:00.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:00.384+0000 7f2a40853640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2a3c0fd440 0x7f2a3c10f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37692/0 (socket says 172.21.15.87:37692) 2024-09-17T07:16:00.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:00.384+0000 7f2a40853640 1 -- 172.21.15.87:0/3931407795 learned_addr learned my addr 172.21.15.87:0/3931407795 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:16:00.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:00.384+0000 7f2a41054640 1 --2- 172.21.15.87:0/3931407795 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2a3c0fcaf0 0x7f2a3c10f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:16:00.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:00.384+0000 7f2a40853640 1 -- 172.21.15.87:0/3931407795 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2a3c0fcaf0 msgr2=0x7f2a3c10f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:00.608 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:00.384+0000 7f2a40853640 1 --2- 172.21.15.87:0/3931407795 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2a3c0fcaf0 0x7f2a3c10f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:00.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:00.384+0000 7f2a40853640 1 -- 172.21.15.87:0/3931407795 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a38005040 con 0x7f2a3c0fd440 2024-09-17T07:16:00.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:00.385+0000 7f2a40853640 1 --2- 172.21.15.87:0/3931407795 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2a3c0fd440 0x7f2a3c10f770 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2a38004930 tx=0x7f2a38009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:16:00.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:00.385+0000 7f2a2dffb640 1 -- 172.21.15.87:0/3931407795 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a38038070 con 0x7f2a3c0fd440 2024-09-17T07:16:00.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:00.385+0000 7f2a2dffb640 1 -- 172.21.15.87:0/3931407795 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f2a3802ade0 con 0x7f2a3c0fd440 2024-09-17T07:16:00.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:00.385+0000 7f2a432b8640 1 -- 172.21.15.87:0/3931407795 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a3c110810 con 0x7f2a3c0fd440 2024-09-17T07:16:00.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:00.385+0000 7f2a2dffb640 1 -- 172.21.15.87:0/3931407795 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a3802c8b0 con 0x7f2a3c0fd440 2024-09-17T07:16:00.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:00.385+0000 7f2a432b8640 1 -- 172.21.15.87:0/3931407795 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a3c110db0 con 0x7f2a3c0fd440 2024-09-17T07:16:00.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:00.386+0000 7f2a432b8640 1 -- 172.21.15.87:0/3931407795 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a3c0fa060 con 0x7f2a3c0fd440 2024-09-17T07:16:00.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:00.387+0000 7f2a2dffb640 1 -- 172.21.15.87:0/3931407795 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f2a38030020 con 0x7f2a3c0fd440 2024-09-17T07:16:00.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:00.387+0000 7f2a2dffb640 1 --2- 172.21.15.87:0/3931407795 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f2a2806ed60 0x7f2a28071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:16:00.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:00.387+0000 7f2a2dffb640 1 -- 172.21.15.87:0/3931407795 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4354+0+0 (secure 0 0 0) 0x7f2a380ae280 con 0x7f2a3c0fd440 2024-09-17T07:16:00.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:00.387+0000 7f2a41054640 1 --2- 172.21.15.87:0/3931407795 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f2a2806ed60 0x7f2a28071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:16:00.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:00.388+0000 7f2a41054640 1 --2- 172.21.15.87:0/3931407795 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f2a2806ed60 0x7f2a28071210 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2a30009af0 tx=0x7f2a3000b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:16:00.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:00.391+0000 7f2a2dffb640 1 -- 172.21.15.87:0/3931407795 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f2a3807b8b0 con 0x7f2a3c0fd440 2024-09-17T07:16:00.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:00.549+0000 7f2a432b8640 1 -- 172.21.15.87:0/3931407795 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f2a3c111070 con 0x7f2a3c0fd440 2024-09-17T07:16:00.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:00.549+0000 7f2a2dffb640 1 -- 172.21.15.87:0/3931407795 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v37) v1 ==== 74+0+130 (secure 0 0 0) 0x7f2a3807b250 con 0x7f2a3c0fd440 2024-09-17T07:16:00.611 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:16:00.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:00.551+0000 7f2a432b8640 1 -- 172.21.15.87:0/3931407795 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f2a2806ed60 msgr2=0x7f2a28071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:00.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:00.551+0000 7f2a432b8640 1 --2- 172.21.15.87:0/3931407795 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f2a2806ed60 0x7f2a28071210 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2a30009af0 tx=0x7f2a3000b040 comp rx=0 tx=0).stop 2024-09-17T07:16:00.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:00.551+0000 7f2a432b8640 1 -- 172.21.15.87:0/3931407795 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2a3c0fd440 msgr2=0x7f2a3c10f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:00.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:00.551+0000 7f2a432b8640 1 --2- 172.21.15.87:0/3931407795 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2a3c0fd440 0x7f2a3c10f770 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2a38004930 tx=0x7f2a38009da0 comp rx=0 tx=0).stop 2024-09-17T07:16:00.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:00.551+0000 7f2a432b8640 1 -- 172.21.15.87:0/3931407795 shutdown_connections 2024-09-17T07:16:00.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:00.551+0000 7f2a432b8640 1 --2- 172.21.15.87:0/3931407795 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2a3c0fd440 0x7f2a3c10f770 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:00.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:00.551+0000 7f2a432b8640 1 --2- 172.21.15.87:0/3931407795 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f2a2806ed60 0x7f2a28071210 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:00.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:00.551+0000 7f2a432b8640 1 --2- 172.21.15.87:0/3931407795 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2a3c0fcaf0 0x7f2a3c10f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:00.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:00.551+0000 7f2a432b8640 1 -- 172.21.15.87:0/3931407795 >> 172.21.15.87:0/3931407795 conn(0x7f2a3c0f63c0 msgr2=0x7f2a3c0f67e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:16:00.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:00.552+0000 7f2a432b8640 1 -- 172.21.15.87:0/3931407795 shutdown_connections 2024-09-17T07:16:00.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:00.552+0000 7f2a432b8640 1 -- 172.21.15.87:0/3931407795 wait complete. 2024-09-17T07:16:00.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:16:00 smithi139 ceph-mon[34403]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]': finished 2024-09-17T07:16:00.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:16:00 smithi139 ceph-mon[34403]: osdmap e36: 6 total, 5 up, 6 in 2024-09-17T07:16:00.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:16:00 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T07:16:00.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:16:00 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T07:16:00.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:16:00 smithi087 ceph-mon[27636]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]': finished 2024-09-17T07:16:00.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:16:00 smithi087 ceph-mon[27636]: osdmap e36: 6 total, 5 up, 6 in 2024-09-17T07:16:00.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:16:00 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T07:16:00.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:16:00 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T07:16:01.227 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":37,"num_osds":6,"num_up_osds":6,"osd_up_since":1726557360,"num_in_osds":6,"osd_in_since":1726557341,"num_remapped_pgs":0} 2024-09-17T07:16:01.227 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-17T07:16:01.488 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/mon.smithi087/config 2024-09-17T07:16:01.803 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:16:01 smithi087 ceph-mon[27636]: purged_snaps scrub starts 2024-09-17T07:16:01.804 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:16:01 smithi087 ceph-mon[27636]: purged_snaps scrub ok 2024-09-17T07:16:01.804 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:16:01 smithi087 ceph-mon[27636]: osd.5 [v2:172.21.15.139:6816/1731614128,v1:172.21.15.139:6817/1731614128] boot 2024-09-17T07:16:01.804 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:16:01 smithi087 ceph-mon[27636]: osdmap e37: 6 total, 6 up, 6 in 2024-09-17T07:16:01.804 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:16:01 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T07:16:01.804 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:16:01 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/3931407795' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-17T07:16:01.804 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:16:01 smithi087 ceph-mon[27636]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-17T07:16:01.804 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:16:01 smithi087 ceph-mon[27636]: Detected new or changed devices on smithi139 2024-09-17T07:16:01.804 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:16:01 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:16:01.804 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:16:01 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:16:01.804 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:16:01 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-17T07:16:01.804 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:16:01 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-17T07:16:01.804 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:16:01 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-17T07:16:01.804 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:16:01 smithi087 ceph-mon[27636]: Adjusting osd_memory_target on smithi139 to 5312M 2024-09-17T07:16:01.805 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:16:01 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:16:01.805 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:16:01 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:16:01.805 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:16:01 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:16:01.805 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:16:01 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:16:01.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:16:01 smithi139 ceph-mon[34403]: purged_snaps scrub starts 2024-09-17T07:16:01.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:16:01 smithi139 ceph-mon[34403]: purged_snaps scrub ok 2024-09-17T07:16:01.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:16:01 smithi139 ceph-mon[34403]: osd.5 [v2:172.21.15.139:6816/1731614128,v1:172.21.15.139:6817/1731614128] boot 2024-09-17T07:16:01.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:16:01 smithi139 ceph-mon[34403]: osdmap e37: 6 total, 6 up, 6 in 2024-09-17T07:16:01.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:16:01 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T07:16:01.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:16:01 smithi139 ceph-mon[34403]: from='client.? 172.21.15.87:0/3931407795' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-17T07:16:01.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:16:01 smithi139 ceph-mon[34403]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-17T07:16:01.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:16:01 smithi139 ceph-mon[34403]: Detected new or changed devices on smithi139 2024-09-17T07:16:01.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:16:01 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:16:01.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:16:01 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:16:01.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:16:01 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-17T07:16:01.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:16:01 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-17T07:16:01.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:16:01 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-17T07:16:01.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:16:01 smithi139 ceph-mon[34403]: Adjusting osd_memory_target on smithi139 to 5312M 2024-09-17T07:16:01.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:16:01 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:16:01.868 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:16:01 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:16:01.868 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:16:01 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:16:01.868 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:16:01 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:16:02.727 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:16:02 smithi087 ceph-mon[27636]: osdmap e38: 6 total, 6 up, 6 in 2024-09-17T07:16:02.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:16:02 smithi139 ceph-mon[34403]: osdmap e38: 6 total, 6 up, 6 in 2024-09-17T07:16:02.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:02.918+0000 7f81274fc640 1 -- 172.21.15.87:0/3782247246 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81200fb480 msgr2=0x7f81200fb8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:02.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:02.918+0000 7f81274fc640 1 --2- 172.21.15.87:0/3782247246 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81200fb480 0x7f81200fb8f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8114009c50 tx=0x7f8114004d10 comp rx=0 tx=0).stop 2024-09-17T07:16:02.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:02.918+0000 7f81274fc640 1 -- 172.21.15.87:0/3782247246 shutdown_connections 2024-09-17T07:16:02.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:02.918+0000 7f81274fc640 1 --2- 172.21.15.87:0/3782247246 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81200fb480 0x7f81200fb8f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:02.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:02.918+0000 7f81274fc640 1 --2- 172.21.15.87:0/3782247246 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f81201014c0 0x7f8120101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:02.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:02.918+0000 7f81274fc640 1 -- 172.21.15.87:0/3782247246 >> 172.21.15.87:0/3782247246 conn(0x7f81200f7000 msgr2=0x7f81200f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:16:02.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:02.918+0000 7f81274fc640 1 -- 172.21.15.87:0/3782247246 shutdown_connections 2024-09-17T07:16:02.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:02.918+0000 7f81274fc640 1 -- 172.21.15.87:0/3782247246 wait complete. 2024-09-17T07:16:02.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:02.919+0000 7f81274fc640 1 Processor -- start 2024-09-17T07:16:02.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:02.919+0000 7f81274fc640 1 -- start start 2024-09-17T07:16:02.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:02.919+0000 7f81274fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81200fb480 0x7f812010e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:16:02.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:02.919+0000 7f81274fc640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f81201014c0 0x7f812010e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:16:02.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:02.919+0000 7f81274fc640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f812010ec30 con 0x7f81200fb480 2024-09-17T07:16:02.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:02.919+0000 7f81274fc640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f812010eda0 con 0x7f81201014c0 2024-09-17T07:16:02.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:02.919+0000 7f8125298640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81200fb480 0x7f812010e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:16:02.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:02.919+0000 7f8125298640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81200fb480 0x7f812010e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37702/0 (socket says 172.21.15.87:37702) 2024-09-17T07:16:02.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:02.919+0000 7f8125298640 1 -- 172.21.15.87:0/3963013452 learned_addr learned my addr 172.21.15.87:0/3963013452 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:16:02.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:02.919+0000 7f8124a97640 1 --2- 172.21.15.87:0/3963013452 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f81201014c0 0x7f812010e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:16:02.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:02.919+0000 7f8125298640 1 -- 172.21.15.87:0/3963013452 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f81201014c0 msgr2=0x7f812010e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:02.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:02.919+0000 7f8125298640 1 --2- 172.21.15.87:0/3963013452 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f81201014c0 0x7f812010e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:02.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:02.919+0000 7f8125298640 1 -- 172.21.15.87:0/3963013452 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81140098b0 con 0x7f81200fb480 2024-09-17T07:16:02.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:02.919+0000 7f8125298640 1 --2- 172.21.15.87:0/3963013452 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81200fb480 0x7f812010e0a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8118002a50 tx=0x7f8118004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:16:02.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:02.920+0000 7f811dffb640 1 -- 172.21.15.87:0/3963013452 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8118007c30 con 0x7f81200fb480 2024-09-17T07:16:02.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:02.920+0000 7f811dffb640 1 -- 172.21.15.87:0/3963013452 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f811800f040 con 0x7f81200fb480 2024-09-17T07:16:02.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:02.920+0000 7f81274fc640 1 -- 172.21.15.87:0/3963013452 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8120117110 con 0x7f81200fb480 2024-09-17T07:16:02.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:02.920+0000 7f811dffb640 1 -- 172.21.15.87:0/3963013452 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f811800d990 con 0x7f81200fb480 2024-09-17T07:16:02.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:02.920+0000 7f81274fc640 1 -- 172.21.15.87:0/3963013452 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8120117620 con 0x7f81200fb480 2024-09-17T07:16:02.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:02.921+0000 7f81274fc640 1 -- 172.21.15.87:0/3963013452 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81200fcbc0 con 0x7f81200fb480 2024-09-17T07:16:02.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:02.921+0000 7f811dffb640 1 -- 172.21.15.87:0/3963013452 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f811800dc50 con 0x7f81200fb480 2024-09-17T07:16:02.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:02.921+0000 7f811dffb640 1 --2- 172.21.15.87:0/3963013452 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f810806ed60 0x7f8108071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:16:02.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:02.922+0000 7f811dffb640 1 -- 172.21.15.87:0/3963013452 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f811808d660 con 0x7f81200fb480 2024-09-17T07:16:02.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:02.922+0000 7f8124a97640 1 --2- 172.21.15.87:0/3963013452 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f810806ed60 0x7f8108071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:16:02.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:02.922+0000 7f8124a97640 1 --2- 172.21.15.87:0/3963013452 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f810806ed60 0x7f8108071210 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8114009c20 tx=0x7f8114004d10 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:16:02.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:02.925+0000 7f811dffb640 1 -- 172.21.15.87:0/3963013452 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f811804d2a0 con 0x7f81200fb480 2024-09-17T07:16:03.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:03.081+0000 7f81274fc640 1 -- 172.21.15.87:0/3963013452 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f81200fac40 con 0x7f81200fb480 2024-09-17T07:16:03.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:03.082+0000 7f811dffb640 1 -- 172.21.15.87:0/3963013452 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+11082 (secure 0 0 0) 0x7f811805a7b0 con 0x7f81200fb480 2024-09-17T07:16:03.082 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:16:03.083 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":38,"fsid":"d5dbf8d6-74c3-11ef-bceb-c7b262605968","created":"2024-09-17T07:10:35.674251+0000","modified":"2024-09-17T07:16:01.498899+0000","last_up_change":"2024-09-17T07:16:00.493452+0000","last_in_change":"2024-09-17T07:15:41.556417+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T07:14:46.855001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"aa28f635-8a58-48f8-bd4e-1626b8da9749","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2205744672},{"type":"v1","addr":"172.21.15.87:6803","nonce":2205744672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2205744672},{"type":"v1","addr":"172.21.15.87:6805","nonce":2205744672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2205744672},{"type":"v1","addr":"172.21.15.87:6809","nonce":2205744672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2205744672},{"type":"v1","addr":"172.21.15.87:6807","nonce":2205744672}]},"public_addr":"172.21.15.87:6803/2205744672","cluster_addr":"172.21.15.87:6805/2205744672","heartbeat_back_addr":"172.21.15.87:6809/2205744672","heartbeat_front_addr":"172.21.15.87:6807/2205744672","state":["exists","up"]},{"osd":1,"uuid":"3a7464ee-c016-40fd-ab8a-9652397b193c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":3001772283},{"type":"v1","addr":"172.21.15.87:6811","nonce":3001772283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":3001772283},{"type":"v1","addr":"172.21.15.87:6813","nonce":3001772283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":3001772283},{"type":"v1","addr":"172.21.15.87:6817","nonce":3001772283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":3001772283},{"type":"v1","addr":"172.21.15.87:6815","nonce":3001772283}]},"public_addr":"172.21.15.87:6811/3001772283","cluster_addr":"172.21.15.87:6813/3001772283","heartbeat_back_addr":"172.21.15.87:6817/3001772283","heartbeat_front_addr":"172.21.15.87:6815/3001772283","state":["exists","up"]},{"osd":2,"uuid":"31ffe6e4-fa51-43ed-8887-022ad51fbd6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2282787545},{"type":"v1","addr":"172.21.15.87:6819","nonce":2282787545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2282787545},{"type":"v1","addr":"172.21.15.87:6821","nonce":2282787545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2282787545},{"type":"v1","addr":"172.21.15.87:6825","nonce":2282787545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2282787545},{"type":"v1","addr":"172.21.15.87:6823","nonce":2282787545}]},"public_addr":"172.21.15.87:6819/2282787545","cluster_addr":"172.21.15.87:6821/2282787545","heartbeat_back_addr":"172.21.15.87:6825/2282787545","heartbeat_front_addr":"172.21.15.87:6823/2282787545","state":["exists","up"]},{"osd":3,"uuid":"00b175ca-ddfd-41f9-b219-130321a7fbc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":796189750},{"type":"v1","addr":"172.21.15.139:6801","nonce":796189750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":796189750},{"type":"v1","addr":"172.21.15.139:6803","nonce":796189750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":796189750},{"type":"v1","addr":"172.21.15.139:6807","nonce":796189750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":796189750},{"type":"v1","addr":"172.21.15.139:6805","nonce":796189750}]},"public_addr":"172.21.15.139:6801/796189750","cluster_addr":"172.21.15.139:6803/796189750","heartbeat_back_addr":"172.21.15.139:6807/796189750","heartbeat_front_addr":"172.21.15.139:6805/796189750","state":["exists","up"]},{"osd":4,"uuid":"d318cab6-e472-472e-8805-d2ab7e04db2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":1310055282},{"type":"v1","addr":"172.21.15.139:6809","nonce":1310055282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":1310055282},{"type":"v1","addr":"172.21.15.139:6811","nonce":1310055282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":1310055282},{"type":"v1","addr":"172.21.15.139:6815","nonce":1310055282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":1310055282},{"type":"v1","addr":"172.21.15.139:6813","nonce":1310055282}]},"public_addr":"172.21.15.139:6809/1310055282","cluster_addr":"172.21.15.139:6811/1310055282","heartbeat_back_addr":"172.21.15.139:6815/1310055282","heartbeat_front_addr":"172.21.15.139:6813/1310055282","state":["exists","up"]},{"osd":5,"uuid":"37b86806-e559-401c-aedf-3d9de1ac347e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":1731614128},{"type":"v1","addr":"172.21.15.139:6817","nonce":1731614128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":1731614128},{"type":"v1","addr":"172.21.15.139:6819","nonce":1731614128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":1731614128},{"type":"v1","addr":"172.21.15.139:6823","nonce":1731614128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":1731614128},{"type":"v1","addr":"172.21.15.139:6821","nonce":1731614128}]},"public_addr":"172.21.15.139:6817/1731614128","cluster_addr":"172.21.15.139:6819/1731614128","heartbeat_back_addr":"172.21.15.139:6823/1731614128","heartbeat_front_addr":"172.21.15.139:6821/1731614128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T07:13:50.061288+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T07:14:15.941888+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T07:14:44.449653+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T07:15:08.229646+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T07:15:33.299519+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T07:15:58.647774+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.87:0/2357718754":"2024-09-18T07:12:36.550496+0000","172.21.15.87:0/1935417402":"2024-09-18T07:11:03.573097+0000","172.21.15.87:0/2382049370":"2024-09-18T07:11:03.573097+0000","172.21.15.87:6801/1735030430":"2024-09-18T07:11:32.590075+0000","172.21.15.87:0/228221666":"2024-09-18T07:11:32.590075+0000","172.21.15.87:0/853807276":"2024-09-18T07:11:03.573097+0000","172.21.15.87:6801/2633029569":"2024-09-18T07:11:03.573097+0000","172.21.15.87:0/2452100146":"2024-09-18T07:11:32.590075+0000","172.21.15.87:6800/1735030430":"2024-09-18T07:11:32.590075+0000","172.21.15.87:0/2629320129":"2024-09-18T07:11:32.590075+0000","172.21.15.87:6801/2341884603":"2024-09-18T07:12:36.550496+0000","172.21.15.87:0/443165441":"2024-09-18T07:12:36.550496+0000","172.21.15.87:0/2056368138":"2024-09-18T07:12:36.550496+0000","172.21.15.87:6800/2633029569":"2024-09-18T07:11:03.573097+0000","172.21.15.87:6800/2341884603":"2024-09-18T07:12:36.550496+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T07:16:03.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:03.085+0000 7f81274fc640 1 -- 172.21.15.87:0/3963013452 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f810806ed60 msgr2=0x7f8108071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:03.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:03.085+0000 7f81274fc640 1 --2- 172.21.15.87:0/3963013452 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f810806ed60 0x7f8108071210 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8114009c20 tx=0x7f8114004d10 comp rx=0 tx=0).stop 2024-09-17T07:16:03.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:03.085+0000 7f81274fc640 1 -- 172.21.15.87:0/3963013452 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81200fb480 msgr2=0x7f812010e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:03.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:03.085+0000 7f81274fc640 1 --2- 172.21.15.87:0/3963013452 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81200fb480 0x7f812010e0a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8118002a50 tx=0x7f8118004600 comp rx=0 tx=0).stop 2024-09-17T07:16:03.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:03.085+0000 7f81274fc640 1 -- 172.21.15.87:0/3963013452 shutdown_connections 2024-09-17T07:16:03.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:03.085+0000 7f81274fc640 1 --2- 172.21.15.87:0/3963013452 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f810806ed60 0x7f8108071210 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:03.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:03.085+0000 7f81274fc640 1 --2- 172.21.15.87:0/3963013452 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f81201014c0 0x7f812010e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:03.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:03.085+0000 7f81274fc640 1 --2- 172.21.15.87:0/3963013452 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81200fb480 0x7f812010e0a0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:03.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:03.085+0000 7f81274fc640 1 -- 172.21.15.87:0/3963013452 >> 172.21.15.87:0/3963013452 conn(0x7f81200f7000 msgr2=0x7f81200f89c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:16:03.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:03.085+0000 7f81274fc640 1 -- 172.21.15.87:0/3963013452 shutdown_connections 2024-09-17T07:16:03.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:03.085+0000 7f81274fc640 1 -- 172.21.15.87:0/3963013452 wait complete. 2024-09-17T07:16:03.648 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:16:03 smithi087 ceph-mon[27636]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T07:16:03.648 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:16:03 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/3963013452' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-17T07:16:03.674 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T07:14:46.855001+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-09-17T07:16:03.675 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-17T07:16:03.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:16:03 smithi139 ceph-mon[34403]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T07:16:03.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:16:03 smithi139 ceph-mon[34403]: from='client.? 172.21.15.87:0/3963013452' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-17T07:16:03.928 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/mon.smithi087/config 2024-09-17T07:16:05.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:05.515+0000 7f96f04ee640 1 -- 172.21.15.87:0/1563899384 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96e8102ef0 msgr2=0x7f96e80fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:05.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:05.515+0000 7f96f04ee640 1 --2- 172.21.15.87:0/1563899384 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96e8102ef0 0x7f96e80fc5b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f96d80048d0 tx=0x7f96d8009da0 comp rx=0 tx=0).stop 2024-09-17T07:16:05.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:05.515+0000 7f96f04ee640 1 -- 172.21.15.87:0/1563899384 shutdown_connections 2024-09-17T07:16:05.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:05.515+0000 7f96f04ee640 1 --2- 172.21.15.87:0/1563899384 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96e8102ef0 0x7f96e80fc5b0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:05.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:05.515+0000 7f96f04ee640 1 --2- 172.21.15.87:0/1563899384 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f96e8102550 0x7f96e8102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:05.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:05.515+0000 7f96f04ee640 1 -- 172.21.15.87:0/1563899384 >> 172.21.15.87:0/1563899384 conn(0x7f96e80f80f0 msgr2=0x7f96e80fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:16:05.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:05.515+0000 7f96f04ee640 1 -- 172.21.15.87:0/1563899384 shutdown_connections 2024-09-17T07:16:05.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:05.515+0000 7f96f04ee640 1 -- 172.21.15.87:0/1563899384 wait complete. 2024-09-17T07:16:05.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:05.516+0000 7f96f04ee640 1 Processor -- start 2024-09-17T07:16:05.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:05.516+0000 7f96f04ee640 1 -- start start 2024-09-17T07:16:05.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:05.516+0000 7f96f04ee640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f96e8102550 0x7f96e8113540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:16:05.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:05.516+0000 7f96f04ee640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96e8102ef0 0x7f96e8113a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:16:05.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:05.516+0000 7f96f04ee640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e8114160 con 0x7f96e8102ef0 2024-09-17T07:16:05.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:05.516+0000 7f96f04ee640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e810d4e0 con 0x7f96e8102550 2024-09-17T07:16:05.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:05.516+0000 7f96eda89640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96e8102ef0 0x7f96e8113a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:16:05.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:05.516+0000 7f96eda89640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96e8102ef0 0x7f96e8113a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:48606/0 (socket says 172.21.15.87:48606) 2024-09-17T07:16:05.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:05.516+0000 7f96eda89640 1 -- 172.21.15.87:0/3422775745 learned_addr learned my addr 172.21.15.87:0/3422775745 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:16:05.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:05.516+0000 7f96ee28a640 1 --2- 172.21.15.87:0/3422775745 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f96e8102550 0x7f96e8113540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:16:05.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:05.516+0000 7f96eda89640 1 -- 172.21.15.87:0/3422775745 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f96e8102550 msgr2=0x7f96e8113540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:05.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:05.516+0000 7f96eda89640 1 --2- 172.21.15.87:0/3422775745 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f96e8102550 0x7f96e8113540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:05.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:05.516+0000 7f96eda89640 1 -- 172.21.15.87:0/3422775745 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96d8005040 con 0x7f96e8102ef0 2024-09-17T07:16:05.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:05.516+0000 7f96ee28a640 1 --2- 172.21.15.87:0/3422775745 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f96e8102550 0x7f96e8113540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T07:16:05.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:05.517+0000 7f96eda89640 1 --2- 172.21.15.87:0/3422775745 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96e8102ef0 0x7f96e8113a80 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f96d8009ac0 tx=0x7f96d8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:16:05.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:05.517+0000 7f96deffd640 1 -- 172.21.15.87:0/3422775745 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f96d8038070 con 0x7f96e8102ef0 2024-09-17T07:16:05.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:05.517+0000 7f96deffd640 1 -- 172.21.15.87:0/3422775745 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f96d8009740 con 0x7f96e8102ef0 2024-09-17T07:16:05.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:05.517+0000 7f96deffd640 1 -- 172.21.15.87:0/3422775745 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f96d803d420 con 0x7f96e8102ef0 2024-09-17T07:16:05.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:05.517+0000 7f96f04ee640 1 -- 172.21.15.87:0/3422775745 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96e810d710 con 0x7f96e8102ef0 2024-09-17T07:16:05.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:05.517+0000 7f96f04ee640 1 -- 172.21.15.87:0/3422775745 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96e810dbd0 con 0x7f96e8102ef0 2024-09-17T07:16:05.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:05.518+0000 7f96f04ee640 1 -- 172.21.15.87:0/3422775745 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96e80fdcd0 con 0x7f96e8102ef0 2024-09-17T07:16:05.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:05.518+0000 7f96deffd640 1 -- 172.21.15.87:0/3422775745 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f96d8030020 con 0x7f96e8102ef0 2024-09-17T07:16:05.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:05.519+0000 7f96deffd640 1 --2- 172.21.15.87:0/3422775745 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f96d406ed50 0x7f96d4071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:16:05.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:05.519+0000 7f96deffd640 1 -- 172.21.15.87:0/3422775745 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f96d80ae1c0 con 0x7f96e8102ef0 2024-09-17T07:16:05.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:05.519+0000 7f96ee28a640 1 --2- 172.21.15.87:0/3422775745 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f96d406ed50 0x7f96d4071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:16:05.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:05.519+0000 7f96ee28a640 1 --2- 172.21.15.87:0/3422775745 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f96d406ed50 0x7f96d4071200 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f96e4006fd0 tx=0x7f96e4008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:16:05.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:05.523+0000 7f96deffd640 1 -- 172.21.15.87:0/3422775745 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f96d807b6a0 con 0x7f96e8102ef0 2024-09-17T07:16:05.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:05.680+0000 7f96f04ee640 1 -- 172.21.15.87:0/3422775745 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f96e810ebb0 con 0x7f96e8102ef0 2024-09-17T07:16:05.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:05.681+0000 7f96deffd640 1 -- 172.21.15.87:0/3422775745 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v38) v1 ==== 93+0+10 (secure 0 0 0) 0x7f96d807b040 con 0x7f96e8102ef0 2024-09-17T07:16:05.681 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 1 2024-09-17T07:16:05.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:05.683+0000 7f96f04ee640 1 -- 172.21.15.87:0/3422775745 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f96d406ed50 msgr2=0x7f96d4071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:05.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:05.683+0000 7f96f04ee640 1 --2- 172.21.15.87:0/3422775745 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f96d406ed50 0x7f96d4071200 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f96e4006fd0 tx=0x7f96e4008040 comp rx=0 tx=0).stop 2024-09-17T07:16:05.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:05.683+0000 7f96f04ee640 1 -- 172.21.15.87:0/3422775745 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96e8102ef0 msgr2=0x7f96e8113a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:05.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:05.683+0000 7f96f04ee640 1 --2- 172.21.15.87:0/3422775745 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96e8102ef0 0x7f96e8113a80 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f96d8009ac0 tx=0x7f96d8009da0 comp rx=0 tx=0).stop 2024-09-17T07:16:05.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:05.683+0000 7f96f04ee640 1 -- 172.21.15.87:0/3422775745 shutdown_connections 2024-09-17T07:16:05.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:05.683+0000 7f96f04ee640 1 --2- 172.21.15.87:0/3422775745 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96e8102ef0 0x7f96e8113a80 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:05.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:05.683+0000 7f96f04ee640 1 --2- 172.21.15.87:0/3422775745 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f96d406ed50 0x7f96d4071200 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:05.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:05.683+0000 7f96f04ee640 1 --2- 172.21.15.87:0/3422775745 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f96e8102550 0x7f96e8113540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:05.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:05.683+0000 7f96f04ee640 1 -- 172.21.15.87:0/3422775745 >> 172.21.15.87:0/3422775745 conn(0x7f96e80f80f0 msgr2=0x7f96e80f9250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:16:05.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:05.683+0000 7f96f04ee640 1 -- 172.21.15.87:0/3422775745 shutdown_connections 2024-09-17T07:16:05.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:05.683+0000 7f96f04ee640 1 -- 172.21.15.87:0/3422775745 wait complete. 2024-09-17T07:16:05.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:16:05 smithi087 ceph-mon[27636]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T07:16:06.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:16:05 smithi139 ceph-mon[34403]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T07:16:06.418 INFO:tasks.cephadm:Setting up client nodes... 2024-09-17T07:16:06.418 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-17T07:16:06.664 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/mon.smithi087/config 2024-09-17T07:16:06.903 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:16:06 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/3422775745' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-17T07:16:06.904 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:16:06 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:16:07.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:16:06 smithi139 ceph-mon[34403]: from='client.? 172.21.15.87:0/3422775745' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-17T07:16:07.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:16:06 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:16:07.777 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:16:07 smithi087 ceph-mon[27636]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T07:16:08.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:16:07 smithi139 ceph-mon[34403]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T07:16:08.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:08.304+0000 7f4edef3d640 1 -- 172.21.15.87:0/868729507 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ed80fd820 msgr2=0x7f4ed80fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:08.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:08.304+0000 7f4edef3d640 1 --2- 172.21.15.87:0/868729507 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ed80fd820 0x7f4ed80fdc90 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4ec40048d0 tx=0x7f4ec4009da0 comp rx=0 tx=0).stop 2024-09-17T07:16:08.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:08.305+0000 7f4edef3d640 1 -- 172.21.15.87:0/868729507 shutdown_connections 2024-09-17T07:16:08.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:08.305+0000 7f4edef3d640 1 --2- 172.21.15.87:0/868729507 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ed80fd820 0x7f4ed80fdc90 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:08.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:08.305+0000 7f4edef3d640 1 --2- 172.21.15.87:0/868729507 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4ed80fc550 0x7f4ed80fc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:08.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:08.305+0000 7f4edef3d640 1 -- 172.21.15.87:0/868729507 >> 172.21.15.87:0/868729507 conn(0x7f4ed80f7d10 msgr2=0x7f4ed80fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:16:08.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:08.305+0000 7f4edef3d640 1 -- 172.21.15.87:0/868729507 shutdown_connections 2024-09-17T07:16:08.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:08.305+0000 7f4edef3d640 1 -- 172.21.15.87:0/868729507 wait complete. 2024-09-17T07:16:08.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:08.305+0000 7f4edef3d640 1 Processor -- start 2024-09-17T07:16:08.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:08.305+0000 7f4edef3d640 1 -- start start 2024-09-17T07:16:08.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:08.306+0000 7f4edef3d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4ed80fc550 0x7f4ed810d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:16:08.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:08.306+0000 7f4edef3d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ed80fd820 0x7f4ed810d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:16:08.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:08.306+0000 7f4edef3d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed810e3d0 con 0x7f4ed80fd820 2024-09-17T07:16:08.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:08.306+0000 7f4edef3d640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed810e540 con 0x7f4ed80fc550 2024-09-17T07:16:08.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:08.306+0000 7f4ed7fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ed80fd820 0x7f4ed810d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:16:08.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:08.306+0000 7f4ed7fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ed80fd820 0x7f4ed810d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:48626/0 (socket says 172.21.15.87:48626) 2024-09-17T07:16:08.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:08.306+0000 7f4ed7fff640 1 -- 172.21.15.87:0/657607380 learned_addr learned my addr 172.21.15.87:0/657607380 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:16:08.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:08.306+0000 7f4edccd9640 1 --2- 172.21.15.87:0/657607380 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4ed80fc550 0x7f4ed810d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:16:08.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:08.306+0000 7f4ed7fff640 1 -- 172.21.15.87:0/657607380 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4ed80fc550 msgr2=0x7f4ed810d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:08.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:08.306+0000 7f4ed7fff640 1 --2- 172.21.15.87:0/657607380 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4ed80fc550 0x7f4ed810d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:08.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:08.306+0000 7f4ed7fff640 1 -- 172.21.15.87:0/657607380 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ec4005040 con 0x7f4ed80fd820 2024-09-17T07:16:08.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:08.306+0000 7f4edccd9640 1 --2- 172.21.15.87:0/657607380 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4ed80fc550 0x7f4ed810d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T07:16:08.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:08.306+0000 7f4ed7fff640 1 --2- 172.21.15.87:0/657607380 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ed80fd820 0x7f4ed810d560 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4ec4009ac0 tx=0x7f4ec4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:16:08.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:08.306+0000 7f4ed57fa640 1 -- 172.21.15.87:0/657607380 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ec4038070 con 0x7f4ed80fd820 2024-09-17T07:16:08.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:08.306+0000 7f4edef3d640 1 -- 172.21.15.87:0/657607380 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ed810e7c0 con 0x7f4ed80fd820 2024-09-17T07:16:08.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:08.306+0000 7f4ed57fa640 1 -- 172.21.15.87:0/657607380 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f4ec402ae70 con 0x7f4ed80fd820 2024-09-17T07:16:08.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:08.306+0000 7f4ed57fa640 1 -- 172.21.15.87:0/657607380 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ec4033420 con 0x7f4ed80fd820 2024-09-17T07:16:08.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:08.306+0000 7f4edef3d640 1 -- 172.21.15.87:0/657607380 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ed810ec80 con 0x7f4ed80fd820 2024-09-17T07:16:08.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:08.308+0000 7f4edef3d640 1 -- 172.21.15.87:0/657607380 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ed80fb9b0 con 0x7f4ed80fd820 2024-09-17T07:16:08.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:08.308+0000 7f4ed57fa640 1 -- 172.21.15.87:0/657607380 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f4ec4030020 con 0x7f4ed80fd820 2024-09-17T07:16:08.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:08.308+0000 7f4ed57fa640 1 --2- 172.21.15.87:0/657607380 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f4ec806ed60 0x7f4ec8071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:16:08.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:08.308+0000 7f4edccd9640 1 --2- 172.21.15.87:0/657607380 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f4ec806ed60 0x7f4ec8071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:16:08.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:08.308+0000 7f4ed57fa640 1 -- 172.21.15.87:0/657607380 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f4ec40ade70 con 0x7f4ed80fd820 2024-09-17T07:16:08.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:08.309+0000 7f4edccd9640 1 --2- 172.21.15.87:0/657607380 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f4ec806ed60 0x7f4ec8071210 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc006fd0 tx=0x7f4ecc008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:16:08.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:08.312+0000 7f4ed57fa640 1 -- 172.21.15.87:0/657607380 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f4ec407b2d0 con 0x7f4ed80fd820 2024-09-17T07:16:08.529 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:08.528+0000 7f4edef3d640 1 -- 172.21.15.87:0/657607380 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f4ed804b720 con 0x7f4ed80fd820 2024-09-17T07:16:08.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:08.532+0000 7f4ed57fa640 1 -- 172.21.15.87:0/657607380 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v14) v1 ==== 170+0+59 (secure 0 0 0) 0x7f4ec407ac70 con 0x7f4ed80fd820 2024-09-17T07:16:08.533 INFO:teuthology.orchestra.run.smithi087.stdout:[client.0] 2024-09-17T07:16:08.533 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQC4LOlmpRCdHxAApxELNx2fSHMl96o21VRLfQ== 2024-09-17T07:16:08.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:08.534+0000 7f4edef3d640 1 -- 172.21.15.87:0/657607380 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f4ec806ed60 msgr2=0x7f4ec8071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:08.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:08.534+0000 7f4edef3d640 1 --2- 172.21.15.87:0/657607380 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f4ec806ed60 0x7f4ec8071210 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc006fd0 tx=0x7f4ecc008040 comp rx=0 tx=0).stop 2024-09-17T07:16:08.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:08.534+0000 7f4edef3d640 1 -- 172.21.15.87:0/657607380 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ed80fd820 msgr2=0x7f4ed810d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:08.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:08.534+0000 7f4edef3d640 1 --2- 172.21.15.87:0/657607380 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ed80fd820 0x7f4ed810d560 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4ec4009ac0 tx=0x7f4ec4009da0 comp rx=0 tx=0).stop 2024-09-17T07:16:08.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:08.534+0000 7f4edef3d640 1 -- 172.21.15.87:0/657607380 shutdown_connections 2024-09-17T07:16:08.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:08.534+0000 7f4edef3d640 1 --2- 172.21.15.87:0/657607380 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ed80fd820 0x7f4ed810d560 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:08.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:08.534+0000 7f4edef3d640 1 --2- 172.21.15.87:0/657607380 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f4ec806ed60 0x7f4ec8071210 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:08.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:08.534+0000 7f4edef3d640 1 --2- 172.21.15.87:0/657607380 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4ed80fc550 0x7f4ed810d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:08.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:08.534+0000 7f4edef3d640 1 -- 172.21.15.87:0/657607380 >> 172.21.15.87:0/657607380 conn(0x7f4ed80f7d10 msgr2=0x7f4ed80f95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:16:08.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:08.534+0000 7f4edef3d640 1 -- 172.21.15.87:0/657607380 shutdown_connections 2024-09-17T07:16:08.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:08.534+0000 7f4edef3d640 1 -- 172.21.15.87:0/657607380 wait complete. 2024-09-17T07:16:08.834 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:16:08 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/657607380' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-17T07:16:08.834 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:16:08 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/657607380' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-17T07:16:09.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:16:08 smithi139 ceph-mon[34403]: from='client.? 172.21.15.87:0/657607380' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-17T07:16:09.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:16:08 smithi139 ceph-mon[34403]: from='client.? 172.21.15.87:0/657607380' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-17T07:16:09.241 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-17T07:16:09.242 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-17T07:16:09.242 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-17T07:16:09.278 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-17T07:16:09.536 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/mon.smithi139/config 2024-09-17T07:16:09.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:16:09 smithi087 ceph-mon[27636]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T07:16:09.967 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:16:09 smithi139 ceph-mon[34403]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T07:16:11.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:16:11.098+0000 7f9b06a6b640 1 -- 172.21.15.139:0/870843375 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9b000fb470 msgr2=0x7f9b000fb880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:11.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:16:11.098+0000 7f9b06a6b640 1 --2- 172.21.15.139:0/870843375 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9b000fb470 0x7f9b000fb880 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9af40048d0 tx=0x7f9af4009da0 comp rx=0 tx=0).stop 2024-09-17T07:16:11.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:16:11.098+0000 7f9b06a6b640 1 -- 172.21.15.139:0/870843375 shutdown_connections 2024-09-17T07:16:11.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:16:11.098+0000 7f9b06a6b640 1 --2- 172.21.15.139:0/870843375 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b000fc740 0x7f9b000fcbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:11.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:16:11.098+0000 7f9b06a6b640 1 --2- 172.21.15.139:0/870843375 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9b000fb470 0x7f9b000fb880 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:11.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:16:11.098+0000 7f9b06a6b640 1 -- 172.21.15.139:0/870843375 >> 172.21.15.139:0/870843375 conn(0x7f9b000f6c30 msgr2=0x7f9b000f9060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:16:11.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:16:11.098+0000 7f9b06a6b640 1 -- 172.21.15.139:0/870843375 shutdown_connections 2024-09-17T07:16:11.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:16:11.098+0000 7f9b06a6b640 1 -- 172.21.15.139:0/870843375 wait complete. 2024-09-17T07:16:11.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:16:11.099+0000 7f9b06a6b640 1 Processor -- start 2024-09-17T07:16:11.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:16:11.099+0000 7f9b06a6b640 1 -- start start 2024-09-17T07:16:11.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:16:11.099+0000 7f9b06a6b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b000fb470 0x7f9b0010bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:16:11.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:16:11.099+0000 7f9b06a6b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9b000fc740 0x7f9b0010c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:16:11.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:16:11.099+0000 7f9b06a6b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0010d2c0 con 0x7f9b000fb470 2024-09-17T07:16:11.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:16:11.099+0000 7f9b06a6b640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0010d430 con 0x7f9b000fc740 2024-09-17T07:16:11.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:16:11.100+0000 7f9afffff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9b000fc740 0x7f9b0010c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:16:11.103 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:16:11.100+0000 7f9afffff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9b000fc740 0x7f9b0010c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:34996/0 (socket says 172.21.15.139:34996) 2024-09-17T07:16:11.103 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:16:11.100+0000 7f9afffff640 1 -- 172.21.15.139:0/1367145221 learned_addr learned my addr 172.21.15.139:0/1367145221 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-17T07:16:11.103 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:16:11.100+0000 7f9b04807640 1 --2- 172.21.15.139:0/1367145221 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b000fb470 0x7f9b0010bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:16:11.103 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:16:11.100+0000 7f9afffff640 1 -- 172.21.15.139:0/1367145221 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b000fb470 msgr2=0x7f9b0010bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:11.103 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:16:11.100+0000 7f9afffff640 1 --2- 172.21.15.139:0/1367145221 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b000fb470 0x7f9b0010bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:11.103 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:16:11.100+0000 7f9afffff640 1 -- 172.21.15.139:0/1367145221 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af4005040 con 0x7f9b000fc740 2024-09-17T07:16:11.103 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:16:11.100+0000 7f9afffff640 1 --2- 172.21.15.139:0/1367145221 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9b000fc740 0x7f9b0010c450 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9aec00b790 tx=0x7f9aec0091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:16:11.103 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:16:11.100+0000 7f9afd7fa640 1 -- 172.21.15.139:0/1367145221 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9aec00c700 con 0x7f9b000fc740 2024-09-17T07:16:11.103 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:16:11.100+0000 7f9b06a6b640 1 -- 172.21.15.139:0/1367145221 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b0010d710 con 0x7f9b000fc740 2024-09-17T07:16:11.103 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:16:11.100+0000 7f9afd7fa640 1 -- 172.21.15.139:0/1367145221 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f9aec00cce0 con 0x7f9b000fc740 2024-09-17T07:16:11.103 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:16:11.100+0000 7f9afd7fa640 1 -- 172.21.15.139:0/1367145221 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9aec015e30 con 0x7f9b000fc740 2024-09-17T07:16:11.103 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:16:11.100+0000 7f9b06a6b640 1 -- 172.21.15.139:0/1367145221 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b0010dc30 con 0x7f9b000fc740 2024-09-17T07:16:11.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:16:11.101+0000 7f9b06a6b640 1 -- 172.21.15.139:0/1367145221 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b000fa8d0 con 0x7f9b000fc740 2024-09-17T07:16:11.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:16:11.102+0000 7f9afd7fa640 1 -- 172.21.15.139:0/1367145221 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f9aec012070 con 0x7f9b000fc740 2024-09-17T07:16:11.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:16:11.102+0000 7f9afd7fa640 1 --2- 172.21.15.139:0/1367145221 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f9af006ed60 0x7f9af0071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:16:11.105 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:16:11.102+0000 7f9afd7fa640 1 -- 172.21.15.139:0/1367145221 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f9aec08d6f0 con 0x7f9b000fc740 2024-09-17T07:16:11.105 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:16:11.102+0000 7f9b04807640 1 --2- 172.21.15.139:0/1367145221 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f9af006ed60 0x7f9af0071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:16:11.105 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:16:11.103+0000 7f9b04807640 1 --2- 172.21.15.139:0/1367145221 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f9af006ed60 0x7f9af0071210 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9af4000c00 tx=0x7f9af4035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:16:11.107 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:16:11.106+0000 7f9afd7fa640 1 -- 172.21.15.139:0/1367145221 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f9aec05ab50 con 0x7f9b000fc740 2024-09-17T07:16:11.322 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:16:11.321+0000 7f9b06a6b640 1 -- 172.21.15.139:0/1367145221 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f9b0004b720 con 0x7f9b000fc740 2024-09-17T07:16:11.327 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:16:11.326+0000 7f9afd7fa640 1 -- 172.21.15.139:0/1367145221 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v15) v1 ==== 170+0+59 (secure 0 0 0) 0x7f9aec05a4f0 con 0x7f9b000fc740 2024-09-17T07:16:11.327 INFO:teuthology.orchestra.run.smithi139.stdout:[client.1] 2024-09-17T07:16:11.327 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQC7LOlmTHxIExAA1YGiQtzzBqXkExXpCdtE4g== 2024-09-17T07:16:11.329 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:16:11.328+0000 7f9b06a6b640 1 -- 172.21.15.139:0/1367145221 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f9af006ed60 msgr2=0x7f9af0071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:11.329 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:16:11.328+0000 7f9b06a6b640 1 --2- 172.21.15.139:0/1367145221 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f9af006ed60 0x7f9af0071210 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9af4000c00 tx=0x7f9af4035040 comp rx=0 tx=0).stop 2024-09-17T07:16:11.329 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:16:11.328+0000 7f9b06a6b640 1 -- 172.21.15.139:0/1367145221 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9b000fc740 msgr2=0x7f9b0010c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:11.330 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:16:11.328+0000 7f9b06a6b640 1 --2- 172.21.15.139:0/1367145221 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9b000fc740 0x7f9b0010c450 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9aec00b790 tx=0x7f9aec0091d0 comp rx=0 tx=0).stop 2024-09-17T07:16:11.330 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:16:11.328+0000 7f9b06a6b640 1 -- 172.21.15.139:0/1367145221 shutdown_connections 2024-09-17T07:16:11.330 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:16:11.328+0000 7f9b06a6b640 1 --2- 172.21.15.139:0/1367145221 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f9af006ed60 0x7f9af0071210 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:11.330 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:16:11.328+0000 7f9b06a6b640 1 --2- 172.21.15.139:0/1367145221 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9b000fc740 0x7f9b0010c450 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:11.330 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:16:11.328+0000 7f9b06a6b640 1 --2- 172.21.15.139:0/1367145221 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b000fb470 0x7f9b0010bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:11.330 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:16:11.328+0000 7f9b06a6b640 1 -- 172.21.15.139:0/1367145221 >> 172.21.15.139:0/1367145221 conn(0x7f9b000f6c30 msgr2=0x7f9b000f8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:16:11.330 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:16:11.328+0000 7f9b06a6b640 1 -- 172.21.15.139:0/1367145221 shutdown_connections 2024-09-17T07:16:11.330 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-17T07:16:11.328+0000 7f9b06a6b640 1 -- 172.21.15.139:0/1367145221 wait complete. 2024-09-17T07:16:11.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:16:11 smithi139 ceph-mon[34403]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T07:16:11.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:16:11 smithi139 ceph-mon[34403]: from='client.? 172.21.15.139:0/1367145221' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-17T07:16:11.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:16:11 smithi139 ceph-mon[34403]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-17T07:16:11.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:16:11 smithi139 ceph-mon[34403]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-17T07:16:11.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:16:11 smithi087 ceph-mon[27636]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T07:16:11.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:16:11 smithi087 ceph-mon[27636]: from='client.? 172.21.15.139:0/1367145221' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-17T07:16:11.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:16:11 smithi087 ceph-mon[27636]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-17T07:16:11.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:16:11 smithi087 ceph-mon[27636]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-17T07:16:12.091 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-17T07:16:12.091 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-09-17T07:16:12.091 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-17T07:16:12.130 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-17T07:16:12.130 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-17T07:16:12.130 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -- ceph mgr dump --format=json 2024-09-17T07:16:12.378 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/mon.smithi087/config 2024-09-17T07:16:13.763 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:16:13 smithi087 ceph-mon[27636]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T07:16:13.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:13.969+0000 7f560c32a640 1 -- 172.21.15.87:0/970828579 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5604102550 msgr2=0x7f5604102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:13.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:13.969+0000 7f560c32a640 1 --2- 172.21.15.87:0/970828579 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5604102550 0x7f5604102920 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f56000048d0 tx=0x7f5600009da0 comp rx=0 tx=0).stop 2024-09-17T07:16:13.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:13.969+0000 7f560c32a640 1 -- 172.21.15.87:0/970828579 shutdown_connections 2024-09-17T07:16:13.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:13.969+0000 7f560c32a640 1 --2- 172.21.15.87:0/970828579 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5604102ef0 0x7f56040fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:13.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:13.969+0000 7f560c32a640 1 --2- 172.21.15.87:0/970828579 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5604102550 0x7f5604102920 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:13.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:13.969+0000 7f560c32a640 1 -- 172.21.15.87:0/970828579 >> 172.21.15.87:0/970828579 conn(0x7f56040f80f0 msgr2=0x7f56040fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:16:13.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:13.969+0000 7f560c32a640 1 -- 172.21.15.87:0/970828579 shutdown_connections 2024-09-17T07:16:13.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:13.969+0000 7f560c32a640 1 -- 172.21.15.87:0/970828579 wait complete. 2024-09-17T07:16:13.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:13.970+0000 7f560c32a640 1 Processor -- start 2024-09-17T07:16:13.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:13.970+0000 7f560c32a640 1 -- start start 2024-09-17T07:16:13.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:13.970+0000 7f560c32a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5604102550 0x7f560406fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:16:13.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:13.970+0000 7f560c32a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5604102ef0 0x7f560406ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:16:13.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:13.970+0000 7f560c32a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5604070520 con 0x7f5604102550 2024-09-17T07:16:13.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:13.970+0000 7f560c32a640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5604070690 con 0x7f5604102ef0 2024-09-17T07:16:13.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:13.970+0000 7f560a0c6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5604102550 0x7f560406fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:16:13.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:13.970+0000 7f560a0c6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5604102550 0x7f560406fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:48638/0 (socket says 172.21.15.87:48638) 2024-09-17T07:16:13.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:13.970+0000 7f560a0c6640 1 -- 172.21.15.87:0/2023367721 learned_addr learned my addr 172.21.15.87:0/2023367721 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:16:13.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:13.970+0000 7f56098c5640 1 --2- 172.21.15.87:0/2023367721 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5604102ef0 0x7f560406ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:16:13.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:13.970+0000 7f560a0c6640 1 -- 172.21.15.87:0/2023367721 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5604102ef0 msgr2=0x7f560406ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:13.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:13.970+0000 7f560a0c6640 1 --2- 172.21.15.87:0/2023367721 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5604102ef0 0x7f560406ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:13.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:13.971+0000 7f560a0c6640 1 -- 172.21.15.87:0/2023367721 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5600005040 con 0x7f5604102550 2024-09-17T07:16:13.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:13.971+0000 7f56098c5640 1 --2- 172.21.15.87:0/2023367721 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5604102ef0 0x7f560406ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T07:16:13.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:13.971+0000 7f560a0c6640 1 --2- 172.21.15.87:0/2023367721 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5604102550 0x7f560406fa10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5600000c00 tx=0x7f5600009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:16:13.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:13.971+0000 7f55faffd640 1 -- 172.21.15.87:0/2023367721 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5600038070 con 0x7f5604102550 2024-09-17T07:16:13.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:13.971+0000 7f55faffd640 1 -- 172.21.15.87:0/2023367721 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f5600009880 con 0x7f5604102550 2024-09-17T07:16:13.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:13.971+0000 7f560c32a640 1 -- 172.21.15.87:0/2023367721 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56041197e0 con 0x7f5604102550 2024-09-17T07:16:13.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:13.971+0000 7f55faffd640 1 -- 172.21.15.87:0/2023367721 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f560003d420 con 0x7f5604102550 2024-09-17T07:16:13.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:13.971+0000 7f560c32a640 1 -- 172.21.15.87:0/2023367721 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5604119b60 con 0x7f5604102550 2024-09-17T07:16:13.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:13.972+0000 7f560c32a640 1 -- 172.21.15.87:0/2023367721 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56040fdcd0 con 0x7f5604102550 2024-09-17T07:16:13.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:13.973+0000 7f55faffd640 1 -- 172.21.15.87:0/2023367721 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f5600030020 con 0x7f5604102550 2024-09-17T07:16:13.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:13.973+0000 7f55faffd640 1 --2- 172.21.15.87:0/2023367721 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f55f006ed60 0x7f55f0071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:16:13.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:13.973+0000 7f56098c5640 1 --2- 172.21.15.87:0/2023367721 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f55f006ed60 0x7f55f0071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:16:13.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:13.973+0000 7f55faffd640 1 -- 172.21.15.87:0/2023367721 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f56000ae4a0 con 0x7f5604102550 2024-09-17T07:16:13.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:13.973+0000 7f56098c5640 1 --2- 172.21.15.87:0/2023367721 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f55f006ed60 0x7f55f0071210 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f55f4006fd0 tx=0x7f55f4008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:16:13.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:13.977+0000 7f55faffd640 1 -- 172.21.15.87:0/2023367721 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f560007b980 con 0x7f5604102550 2024-09-17T07:16:14.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:16:13 smithi139 ceph-mon[34403]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T07:16:14.173 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:14.172+0000 7f560c32a640 1 -- 172.21.15.87:0/2023367721 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f56040fbd50 con 0x7f5604102550 2024-09-17T07:16:14.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:14.175+0000 7f55faffd640 1 -- 172.21.15.87:0/2023367721 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) v1 ==== 74+0+176707 (secure 0 0 0) 0x7f560007b320 con 0x7f5604102550 2024-09-17T07:16:14.178 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:16:14.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:14.177+0000 7f560c32a640 1 -- 172.21.15.87:0/2023367721 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f55f006ed60 msgr2=0x7f55f0071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:14.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:14.177+0000 7f560c32a640 1 --2- 172.21.15.87:0/2023367721 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f55f006ed60 0x7f55f0071210 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f55f4006fd0 tx=0x7f55f4008040 comp rx=0 tx=0).stop 2024-09-17T07:16:14.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:14.177+0000 7f560c32a640 1 -- 172.21.15.87:0/2023367721 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5604102550 msgr2=0x7f560406fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:14.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:14.177+0000 7f560c32a640 1 --2- 172.21.15.87:0/2023367721 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5604102550 0x7f560406fa10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5600000c00 tx=0x7f5600009da0 comp rx=0 tx=0).stop 2024-09-17T07:16:14.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:14.177+0000 7f560c32a640 1 -- 172.21.15.87:0/2023367721 shutdown_connections 2024-09-17T07:16:14.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:14.177+0000 7f560c32a640 1 --2- 172.21.15.87:0/2023367721 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f55f006ed60 0x7f55f0071210 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:14.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:14.177+0000 7f560c32a640 1 --2- 172.21.15.87:0/2023367721 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5604102ef0 0x7f560406ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:14.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:14.177+0000 7f560c32a640 1 --2- 172.21.15.87:0/2023367721 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5604102550 0x7f560406fa10 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:14.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:14.177+0000 7f560c32a640 1 -- 172.21.15.87:0/2023367721 >> 172.21.15.87:0/2023367721 conn(0x7f56040f80f0 msgr2=0x7f56040f9270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:16:14.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:14.177+0000 7f560c32a640 1 -- 172.21.15.87:0/2023367721 shutdown_connections 2024-09-17T07:16:14.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:14.178+0000 7f560c32a640 1 -- 172.21.15.87:0/2023367721 wait complete. 2024-09-17T07:16:14.774 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:16:14 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/2023367721' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-17T07:16:14.798 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":19,"flags":0,"active_gid":14208,"active_name":"smithi087.vuvjer","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":611048628},{"type":"v1","addr":"172.21.15.87:6801","nonce":611048628}]},"active_addr":"172.21.15.87:6801/611048628","active_change":"2024-09-17T07:12:36.550634+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":14228,"name":"smithi139.tuqnpn","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.87:8443/","prometheus":"http://172.21.15.87:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.87:0","nonce":147535528}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.87:0","nonce":346024124}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.87:0","nonce":3586936716}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.87:0","nonce":990687259}]}]} 2024-09-17T07:16:14.803 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-17T07:16:14.803 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-17T07:16:14.803 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-17T07:16:15.047 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/mon.smithi087/config 2024-09-17T07:16:15.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:16:14 smithi139 ceph-mon[34403]: from='client.? 172.21.15.87:0/2023367721' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-17T07:16:15.706 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:16:15 smithi087 ceph-mon[27636]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T07:16:16.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:16:15 smithi139 ceph-mon[34403]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T07:16:16.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:16.652+0000 7f28f51fa640 1 -- 172.21.15.87:0/213370987 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28f00fe460 msgr2=0x7f28f00fe830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:16.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:16.652+0000 7f28f51fa640 1 --2- 172.21.15.87:0/213370987 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28f00fe460 0x7f28f00fe830 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f28d80048d0 tx=0x7f28d8009da0 comp rx=0 tx=0).stop 2024-09-17T07:16:16.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:16.652+0000 7f28f51fa640 1 -- 172.21.15.87:0/213370987 shutdown_connections 2024-09-17T07:16:16.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:16.652+0000 7f28f51fa640 1 --2- 172.21.15.87:0/213370987 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f28f0064fc0 0x7f28f0065430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:16.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:16.652+0000 7f28f51fa640 1 --2- 172.21.15.87:0/213370987 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28f00fe460 0x7f28f00fe830 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:16.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:16.652+0000 7f28f51fa640 1 -- 172.21.15.87:0/213370987 >> 172.21.15.87:0/213370987 conn(0x7f28f00723b0 msgr2=0x7f28f00727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:16:16.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:16.652+0000 7f28f51fa640 1 -- 172.21.15.87:0/213370987 shutdown_connections 2024-09-17T07:16:16.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:16.652+0000 7f28f51fa640 1 -- 172.21.15.87:0/213370987 wait complete. 2024-09-17T07:16:16.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:16.652+0000 7f28f51fa640 1 Processor -- start 2024-09-17T07:16:16.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:16.653+0000 7f28f51fa640 1 -- start start 2024-09-17T07:16:16.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:16.653+0000 7f28f51fa640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28f0064fc0 0x7f28f0113190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:16:16.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:16.653+0000 7f28f51fa640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f28f00fe460 0x7f28f01136d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:16:16.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:16.653+0000 7f28f51fa640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28f0113d60 con 0x7f28f0064fc0 2024-09-17T07:16:16.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:16.653+0000 7f28f51fa640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28f010d110 con 0x7f28f00fe460 2024-09-17T07:16:16.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:16.653+0000 7f28eed9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28f0064fc0 0x7f28f0113190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:16:16.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:16.653+0000 7f28eed9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28f0064fc0 0x7f28f0113190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52628/0 (socket says 172.21.15.87:52628) 2024-09-17T07:16:16.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:16.653+0000 7f28eed9d640 1 -- 172.21.15.87:0/1242876237 learned_addr learned my addr 172.21.15.87:0/1242876237 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:16:16.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:16.653+0000 7f28ee59c640 1 --2- 172.21.15.87:0/1242876237 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f28f00fe460 0x7f28f01136d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:16:16.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:16.653+0000 7f28eed9d640 1 -- 172.21.15.87:0/1242876237 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f28f00fe460 msgr2=0x7f28f01136d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:16.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:16.653+0000 7f28eed9d640 1 --2- 172.21.15.87:0/1242876237 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f28f00fe460 0x7f28f01136d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:16.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:16.653+0000 7f28eed9d640 1 -- 172.21.15.87:0/1242876237 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28d8005040 con 0x7f28f0064fc0 2024-09-17T07:16:16.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:16.653+0000 7f28eed9d640 1 --2- 172.21.15.87:0/1242876237 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28f0064fc0 0x7f28f0113190 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f28d8003080 tx=0x7f28d8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:16:16.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:16.653+0000 7f28e77fe640 1 -- 172.21.15.87:0/1242876237 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f28d8038070 con 0x7f28f0064fc0 2024-09-17T07:16:16.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:16.653+0000 7f28e77fe640 1 -- 172.21.15.87:0/1242876237 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f28d80097c0 con 0x7f28f0064fc0 2024-09-17T07:16:16.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:16.653+0000 7f28e77fe640 1 -- 172.21.15.87:0/1242876237 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f28d803d420 con 0x7f28f0064fc0 2024-09-17T07:16:16.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:16.653+0000 7f28f51fa640 1 -- 172.21.15.87:0/1242876237 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28f010d390 con 0x7f28f0064fc0 2024-09-17T07:16:16.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:16.653+0000 7f28f51fa640 1 -- 172.21.15.87:0/1242876237 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28f010d850 con 0x7f28f0064fc0 2024-09-17T07:16:16.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:16.655+0000 7f28f51fa640 1 -- 172.21.15.87:0/1242876237 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28f00fdcf0 con 0x7f28f0064fc0 2024-09-17T07:16:16.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:16.655+0000 7f28e77fe640 1 -- 172.21.15.87:0/1242876237 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f28d8030020 con 0x7f28f0064fc0 2024-09-17T07:16:16.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:16.656+0000 7f28e77fe640 1 --2- 172.21.15.87:0/1242876237 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f28dc06ed60 0x7f28dc071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:16:16.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:16.656+0000 7f28ee59c640 1 --2- 172.21.15.87:0/1242876237 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f28dc06ed60 0x7f28dc071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:16:16.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:16.656+0000 7f28e77fe640 1 -- 172.21.15.87:0/1242876237 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f28d80ae3a0 con 0x7f28f0064fc0 2024-09-17T07:16:16.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:16.656+0000 7f28ee59c640 1 --2- 172.21.15.87:0/1242876237 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f28dc06ed60 0x7f28dc071210 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f28e0006fd0 tx=0x7f28e0008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:16:16.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:16.660+0000 7f28e77fe640 1 -- 172.21.15.87:0/1242876237 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f28d807b880 con 0x7f28f0064fc0 2024-09-17T07:16:16.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:16.817+0000 7f28f51fa640 1 -- 172.21.15.87:0/1242876237 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f28f004b750 con 0x7f28f0064fc0 2024-09-17T07:16:16.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:16.818+0000 7f28e77fe640 1 -- 172.21.15.87:0/1242876237 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+11082 (secure 0 0 0) 0x7f28d807b220 con 0x7f28f0064fc0 2024-09-17T07:16:16.819 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:16:16.819 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":38,"fsid":"d5dbf8d6-74c3-11ef-bceb-c7b262605968","created":"2024-09-17T07:10:35.674251+0000","modified":"2024-09-17T07:16:01.498899+0000","last_up_change":"2024-09-17T07:16:00.493452+0000","last_in_change":"2024-09-17T07:15:41.556417+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T07:14:46.855001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"aa28f635-8a58-48f8-bd4e-1626b8da9749","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2205744672},{"type":"v1","addr":"172.21.15.87:6803","nonce":2205744672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2205744672},{"type":"v1","addr":"172.21.15.87:6805","nonce":2205744672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2205744672},{"type":"v1","addr":"172.21.15.87:6809","nonce":2205744672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2205744672},{"type":"v1","addr":"172.21.15.87:6807","nonce":2205744672}]},"public_addr":"172.21.15.87:6803/2205744672","cluster_addr":"172.21.15.87:6805/2205744672","heartbeat_back_addr":"172.21.15.87:6809/2205744672","heartbeat_front_addr":"172.21.15.87:6807/2205744672","state":["exists","up"]},{"osd":1,"uuid":"3a7464ee-c016-40fd-ab8a-9652397b193c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":3001772283},{"type":"v1","addr":"172.21.15.87:6811","nonce":3001772283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":3001772283},{"type":"v1","addr":"172.21.15.87:6813","nonce":3001772283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":3001772283},{"type":"v1","addr":"172.21.15.87:6817","nonce":3001772283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":3001772283},{"type":"v1","addr":"172.21.15.87:6815","nonce":3001772283}]},"public_addr":"172.21.15.87:6811/3001772283","cluster_addr":"172.21.15.87:6813/3001772283","heartbeat_back_addr":"172.21.15.87:6817/3001772283","heartbeat_front_addr":"172.21.15.87:6815/3001772283","state":["exists","up"]},{"osd":2,"uuid":"31ffe6e4-fa51-43ed-8887-022ad51fbd6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2282787545},{"type":"v1","addr":"172.21.15.87:6819","nonce":2282787545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2282787545},{"type":"v1","addr":"172.21.15.87:6821","nonce":2282787545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2282787545},{"type":"v1","addr":"172.21.15.87:6825","nonce":2282787545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2282787545},{"type":"v1","addr":"172.21.15.87:6823","nonce":2282787545}]},"public_addr":"172.21.15.87:6819/2282787545","cluster_addr":"172.21.15.87:6821/2282787545","heartbeat_back_addr":"172.21.15.87:6825/2282787545","heartbeat_front_addr":"172.21.15.87:6823/2282787545","state":["exists","up"]},{"osd":3,"uuid":"00b175ca-ddfd-41f9-b219-130321a7fbc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":796189750},{"type":"v1","addr":"172.21.15.139:6801","nonce":796189750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":796189750},{"type":"v1","addr":"172.21.15.139:6803","nonce":796189750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":796189750},{"type":"v1","addr":"172.21.15.139:6807","nonce":796189750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":796189750},{"type":"v1","addr":"172.21.15.139:6805","nonce":796189750}]},"public_addr":"172.21.15.139:6801/796189750","cluster_addr":"172.21.15.139:6803/796189750","heartbeat_back_addr":"172.21.15.139:6807/796189750","heartbeat_front_addr":"172.21.15.139:6805/796189750","state":["exists","up"]},{"osd":4,"uuid":"d318cab6-e472-472e-8805-d2ab7e04db2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":1310055282},{"type":"v1","addr":"172.21.15.139:6809","nonce":1310055282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":1310055282},{"type":"v1","addr":"172.21.15.139:6811","nonce":1310055282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":1310055282},{"type":"v1","addr":"172.21.15.139:6815","nonce":1310055282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":1310055282},{"type":"v1","addr":"172.21.15.139:6813","nonce":1310055282}]},"public_addr":"172.21.15.139:6809/1310055282","cluster_addr":"172.21.15.139:6811/1310055282","heartbeat_back_addr":"172.21.15.139:6815/1310055282","heartbeat_front_addr":"172.21.15.139:6813/1310055282","state":["exists","up"]},{"osd":5,"uuid":"37b86806-e559-401c-aedf-3d9de1ac347e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":1731614128},{"type":"v1","addr":"172.21.15.139:6817","nonce":1731614128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":1731614128},{"type":"v1","addr":"172.21.15.139:6819","nonce":1731614128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":1731614128},{"type":"v1","addr":"172.21.15.139:6823","nonce":1731614128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":1731614128},{"type":"v1","addr":"172.21.15.139:6821","nonce":1731614128}]},"public_addr":"172.21.15.139:6817/1731614128","cluster_addr":"172.21.15.139:6819/1731614128","heartbeat_back_addr":"172.21.15.139:6823/1731614128","heartbeat_front_addr":"172.21.15.139:6821/1731614128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T07:13:50.061288+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T07:14:15.941888+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T07:14:44.449653+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T07:15:08.229646+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T07:15:33.299519+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T07:15:58.647774+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.87:0/2357718754":"2024-09-18T07:12:36.550496+0000","172.21.15.87:0/1935417402":"2024-09-18T07:11:03.573097+0000","172.21.15.87:0/2382049370":"2024-09-18T07:11:03.573097+0000","172.21.15.87:6801/1735030430":"2024-09-18T07:11:32.590075+0000","172.21.15.87:0/228221666":"2024-09-18T07:11:32.590075+0000","172.21.15.87:0/853807276":"2024-09-18T07:11:03.573097+0000","172.21.15.87:6801/2633029569":"2024-09-18T07:11:03.573097+0000","172.21.15.87:0/2452100146":"2024-09-18T07:11:32.590075+0000","172.21.15.87:6800/1735030430":"2024-09-18T07:11:32.590075+0000","172.21.15.87:0/2629320129":"2024-09-18T07:11:32.590075+0000","172.21.15.87:6801/2341884603":"2024-09-18T07:12:36.550496+0000","172.21.15.87:0/443165441":"2024-09-18T07:12:36.550496+0000","172.21.15.87:0/2056368138":"2024-09-18T07:12:36.550496+0000","172.21.15.87:6800/2633029569":"2024-09-18T07:11:03.573097+0000","172.21.15.87:6800/2341884603":"2024-09-18T07:12:36.550496+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T07:16:16.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:16.820+0000 7f28f51fa640 1 -- 172.21.15.87:0/1242876237 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f28dc06ed60 msgr2=0x7f28dc071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:16.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:16.820+0000 7f28f51fa640 1 --2- 172.21.15.87:0/1242876237 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f28dc06ed60 0x7f28dc071210 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f28e0006fd0 tx=0x7f28e0008040 comp rx=0 tx=0).stop 2024-09-17T07:16:16.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:16.820+0000 7f28f51fa640 1 -- 172.21.15.87:0/1242876237 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28f0064fc0 msgr2=0x7f28f0113190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:16.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:16.820+0000 7f28f51fa640 1 --2- 172.21.15.87:0/1242876237 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28f0064fc0 0x7f28f0113190 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f28d8003080 tx=0x7f28d8009da0 comp rx=0 tx=0).stop 2024-09-17T07:16:16.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:16.820+0000 7f28f51fa640 1 -- 172.21.15.87:0/1242876237 shutdown_connections 2024-09-17T07:16:16.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:16.820+0000 7f28f51fa640 1 --2- 172.21.15.87:0/1242876237 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f28dc06ed60 0x7f28dc071210 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:16.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:16.820+0000 7f28f51fa640 1 --2- 172.21.15.87:0/1242876237 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f28f00fe460 0x7f28f01136d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:16.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:16.820+0000 7f28f51fa640 1 --2- 172.21.15.87:0/1242876237 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28f0064fc0 0x7f28f0113190 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:16.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:16.820+0000 7f28f51fa640 1 -- 172.21.15.87:0/1242876237 >> 172.21.15.87:0/1242876237 conn(0x7f28f00723b0 msgr2=0x7f28f0105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:16:16.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:16.820+0000 7f28f51fa640 1 -- 172.21.15.87:0/1242876237 shutdown_connections 2024-09-17T07:16:16.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:16.820+0000 7f28f51fa640 1 -- 172.21.15.87:0/1242876237 wait complete. 2024-09-17T07:16:17.489 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-17T07:16:17.493 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-17T07:16:17.737 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/mon.smithi087/config 2024-09-17T07:16:17.856 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:16:17 smithi087 ceph-mon[27636]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T07:16:17.856 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:16:17 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/1242876237' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-17T07:16:18.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:16:17 smithi139 ceph-mon[34403]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T07:16:18.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:16:17 smithi139 ceph-mon[34403]: from='client.? 172.21.15.87:0/1242876237' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-17T07:16:19.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:19.408+0000 7f04df06d640 1 -- 172.21.15.87:0/1916616360 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04d81014c0 msgr2=0x7f04d8101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:19.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:19.408+0000 7f04df06d640 1 --2- 172.21.15.87:0/1916616360 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04d81014c0 0x7f04d8101890 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f04d40048d0 tx=0x7f04d4009da0 comp rx=0 tx=0).stop 2024-09-17T07:16:19.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:19.408+0000 7f04df06d640 1 -- 172.21.15.87:0/1916616360 shutdown_connections 2024-09-17T07:16:19.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:19.408+0000 7f04df06d640 1 --2- 172.21.15.87:0/1916616360 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f04d80fb480 0x7f04d80fb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:19.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:19.408+0000 7f04df06d640 1 --2- 172.21.15.87:0/1916616360 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04d81014c0 0x7f04d8101890 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:19.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:19.408+0000 7f04df06d640 1 -- 172.21.15.87:0/1916616360 >> 172.21.15.87:0/1916616360 conn(0x7f04d80f7000 msgr2=0x7f04d80f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:16:19.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:19.408+0000 7f04df06d640 1 -- 172.21.15.87:0/1916616360 shutdown_connections 2024-09-17T07:16:19.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:19.408+0000 7f04df06d640 1 -- 172.21.15.87:0/1916616360 wait complete. 2024-09-17T07:16:19.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:19.409+0000 7f04df06d640 1 Processor -- start 2024-09-17T07:16:19.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:19.409+0000 7f04df06d640 1 -- start start 2024-09-17T07:16:19.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:19.409+0000 7f04df06d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f04d80fb480 0x7f04d8112080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:16:19.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:19.409+0000 7f04df06d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04d81014c0 0x7f04d81125c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:16:19.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:19.409+0000 7f04df06d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d8112c50 con 0x7f04d81014c0 2024-09-17T07:16:19.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:19.409+0000 7f04df06d640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d810c000 con 0x7f04d80fb480 2024-09-17T07:16:19.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:19.409+0000 7f04cffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04d81014c0 0x7f04d81125c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:16:19.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:19.409+0000 7f04cffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04d81014c0 0x7f04d81125c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52652/0 (socket says 172.21.15.87:52652) 2024-09-17T07:16:19.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:19.409+0000 7f04cffff640 1 -- 172.21.15.87:0/3674046352 learned_addr learned my addr 172.21.15.87:0/3674046352 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:16:19.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:19.409+0000 7f04dce09640 1 --2- 172.21.15.87:0/3674046352 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f04d80fb480 0x7f04d8112080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:16:19.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:19.409+0000 7f04cffff640 1 -- 172.21.15.87:0/3674046352 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f04d80fb480 msgr2=0x7f04d8112080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:19.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:19.409+0000 7f04cffff640 1 --2- 172.21.15.87:0/3674046352 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f04d80fb480 0x7f04d8112080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:19.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:19.409+0000 7f04cffff640 1 -- 172.21.15.87:0/3674046352 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04d4005040 con 0x7f04d81014c0 2024-09-17T07:16:19.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:19.410+0000 7f04cffff640 1 --2- 172.21.15.87:0/3674046352 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04d81014c0 0x7f04d81125c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f04c800b790 tx=0x7f04c80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:16:19.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:19.410+0000 7f04cd7fa640 1 -- 172.21.15.87:0/3674046352 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04c800c700 con 0x7f04d81014c0 2024-09-17T07:16:19.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:19.410+0000 7f04cd7fa640 1 -- 172.21.15.87:0/3674046352 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f04c800cce0 con 0x7f04d81014c0 2024-09-17T07:16:19.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:19.410+0000 7f04df06d640 1 -- 172.21.15.87:0/3674046352 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04d810c2e0 con 0x7f04d81014c0 2024-09-17T07:16:19.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:19.410+0000 7f04cd7fa640 1 -- 172.21.15.87:0/3674046352 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04c8015e10 con 0x7f04d81014c0 2024-09-17T07:16:19.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:19.410+0000 7f04df06d640 1 -- 172.21.15.87:0/3674046352 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04d810c800 con 0x7f04d81014c0 2024-09-17T07:16:19.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:19.411+0000 7f04df06d640 1 -- 172.21.15.87:0/3674046352 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04d80fcbc0 con 0x7f04d81014c0 2024-09-17T07:16:19.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:19.411+0000 7f04cd7fa640 1 -- 172.21.15.87:0/3674046352 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f04c8012070 con 0x7f04d81014c0 2024-09-17T07:16:19.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:19.412+0000 7f04cd7fa640 1 --2- 172.21.15.87:0/3674046352 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f04c006ed60 0x7f04c0071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:16:19.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:19.412+0000 7f04dce09640 1 --2- 172.21.15.87:0/3674046352 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f04c006ed60 0x7f04c0071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:16:19.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:19.412+0000 7f04cd7fa640 1 -- 172.21.15.87:0/3674046352 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f04c808da00 con 0x7f04d81014c0 2024-09-17T07:16:19.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:19.412+0000 7f04dce09640 1 --2- 172.21.15.87:0/3674046352 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f04c006ed60 0x7f04c0071210 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f04d4009ac0 tx=0x7f04d4009da0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:16:19.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:19.416+0000 7f04cd7fa640 1 -- 172.21.15.87:0/3674046352 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f04c805ae60 con 0x7f04d81014c0 2024-09-17T07:16:19.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:19.574+0000 7f04df06d640 1 -- 172.21.15.87:0/3674046352 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f04d81083e0 con 0x7f04d81014c0 2024-09-17T07:16:19.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:19.575+0000 7f04cd7fa640 1 -- 172.21.15.87:0/3674046352 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+11082 (secure 0 0 0) 0x7f04c805a800 con 0x7f04d81014c0 2024-09-17T07:16:19.576 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:16:19.576 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":38,"fsid":"d5dbf8d6-74c3-11ef-bceb-c7b262605968","created":"2024-09-17T07:10:35.674251+0000","modified":"2024-09-17T07:16:01.498899+0000","last_up_change":"2024-09-17T07:16:00.493452+0000","last_in_change":"2024-09-17T07:15:41.556417+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T07:14:46.855001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"aa28f635-8a58-48f8-bd4e-1626b8da9749","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2205744672},{"type":"v1","addr":"172.21.15.87:6803","nonce":2205744672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2205744672},{"type":"v1","addr":"172.21.15.87:6805","nonce":2205744672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2205744672},{"type":"v1","addr":"172.21.15.87:6809","nonce":2205744672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2205744672},{"type":"v1","addr":"172.21.15.87:6807","nonce":2205744672}]},"public_addr":"172.21.15.87:6803/2205744672","cluster_addr":"172.21.15.87:6805/2205744672","heartbeat_back_addr":"172.21.15.87:6809/2205744672","heartbeat_front_addr":"172.21.15.87:6807/2205744672","state":["exists","up"]},{"osd":1,"uuid":"3a7464ee-c016-40fd-ab8a-9652397b193c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":3001772283},{"type":"v1","addr":"172.21.15.87:6811","nonce":3001772283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":3001772283},{"type":"v1","addr":"172.21.15.87:6813","nonce":3001772283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":3001772283},{"type":"v1","addr":"172.21.15.87:6817","nonce":3001772283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":3001772283},{"type":"v1","addr":"172.21.15.87:6815","nonce":3001772283}]},"public_addr":"172.21.15.87:6811/3001772283","cluster_addr":"172.21.15.87:6813/3001772283","heartbeat_back_addr":"172.21.15.87:6817/3001772283","heartbeat_front_addr":"172.21.15.87:6815/3001772283","state":["exists","up"]},{"osd":2,"uuid":"31ffe6e4-fa51-43ed-8887-022ad51fbd6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2282787545},{"type":"v1","addr":"172.21.15.87:6819","nonce":2282787545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2282787545},{"type":"v1","addr":"172.21.15.87:6821","nonce":2282787545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2282787545},{"type":"v1","addr":"172.21.15.87:6825","nonce":2282787545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2282787545},{"type":"v1","addr":"172.21.15.87:6823","nonce":2282787545}]},"public_addr":"172.21.15.87:6819/2282787545","cluster_addr":"172.21.15.87:6821/2282787545","heartbeat_back_addr":"172.21.15.87:6825/2282787545","heartbeat_front_addr":"172.21.15.87:6823/2282787545","state":["exists","up"]},{"osd":3,"uuid":"00b175ca-ddfd-41f9-b219-130321a7fbc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":796189750},{"type":"v1","addr":"172.21.15.139:6801","nonce":796189750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":796189750},{"type":"v1","addr":"172.21.15.139:6803","nonce":796189750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":796189750},{"type":"v1","addr":"172.21.15.139:6807","nonce":796189750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":796189750},{"type":"v1","addr":"172.21.15.139:6805","nonce":796189750}]},"public_addr":"172.21.15.139:6801/796189750","cluster_addr":"172.21.15.139:6803/796189750","heartbeat_back_addr":"172.21.15.139:6807/796189750","heartbeat_front_addr":"172.21.15.139:6805/796189750","state":["exists","up"]},{"osd":4,"uuid":"d318cab6-e472-472e-8805-d2ab7e04db2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":1310055282},{"type":"v1","addr":"172.21.15.139:6809","nonce":1310055282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":1310055282},{"type":"v1","addr":"172.21.15.139:6811","nonce":1310055282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":1310055282},{"type":"v1","addr":"172.21.15.139:6815","nonce":1310055282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":1310055282},{"type":"v1","addr":"172.21.15.139:6813","nonce":1310055282}]},"public_addr":"172.21.15.139:6809/1310055282","cluster_addr":"172.21.15.139:6811/1310055282","heartbeat_back_addr":"172.21.15.139:6815/1310055282","heartbeat_front_addr":"172.21.15.139:6813/1310055282","state":["exists","up"]},{"osd":5,"uuid":"37b86806-e559-401c-aedf-3d9de1ac347e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":1731614128},{"type":"v1","addr":"172.21.15.139:6817","nonce":1731614128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":1731614128},{"type":"v1","addr":"172.21.15.139:6819","nonce":1731614128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":1731614128},{"type":"v1","addr":"172.21.15.139:6823","nonce":1731614128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":1731614128},{"type":"v1","addr":"172.21.15.139:6821","nonce":1731614128}]},"public_addr":"172.21.15.139:6817/1731614128","cluster_addr":"172.21.15.139:6819/1731614128","heartbeat_back_addr":"172.21.15.139:6823/1731614128","heartbeat_front_addr":"172.21.15.139:6821/1731614128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T07:13:50.061288+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T07:14:15.941888+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T07:14:44.449653+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T07:15:08.229646+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T07:15:33.299519+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T07:15:58.647774+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.87:0/2357718754":"2024-09-18T07:12:36.550496+0000","172.21.15.87:0/1935417402":"2024-09-18T07:11:03.573097+0000","172.21.15.87:0/2382049370":"2024-09-18T07:11:03.573097+0000","172.21.15.87:6801/1735030430":"2024-09-18T07:11:32.590075+0000","172.21.15.87:0/228221666":"2024-09-18T07:11:32.590075+0000","172.21.15.87:0/853807276":"2024-09-18T07:11:03.573097+0000","172.21.15.87:6801/2633029569":"2024-09-18T07:11:03.573097+0000","172.21.15.87:0/2452100146":"2024-09-18T07:11:32.590075+0000","172.21.15.87:6800/1735030430":"2024-09-18T07:11:32.590075+0000","172.21.15.87:0/2629320129":"2024-09-18T07:11:32.590075+0000","172.21.15.87:6801/2341884603":"2024-09-18T07:12:36.550496+0000","172.21.15.87:0/443165441":"2024-09-18T07:12:36.550496+0000","172.21.15.87:0/2056368138":"2024-09-18T07:12:36.550496+0000","172.21.15.87:6800/2633029569":"2024-09-18T07:11:03.573097+0000","172.21.15.87:6800/2341884603":"2024-09-18T07:12:36.550496+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T07:16:19.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:19.577+0000 7f04df06d640 1 -- 172.21.15.87:0/3674046352 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f04c006ed60 msgr2=0x7f04c0071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:19.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:19.577+0000 7f04df06d640 1 --2- 172.21.15.87:0/3674046352 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f04c006ed60 0x7f04c0071210 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f04d4009ac0 tx=0x7f04d4009da0 comp rx=0 tx=0).stop 2024-09-17T07:16:19.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:19.577+0000 7f04df06d640 1 -- 172.21.15.87:0/3674046352 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04d81014c0 msgr2=0x7f04d81125c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:19.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:19.577+0000 7f04df06d640 1 --2- 172.21.15.87:0/3674046352 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04d81014c0 0x7f04d81125c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f04c800b790 tx=0x7f04c80091d0 comp rx=0 tx=0).stop 2024-09-17T07:16:19.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:19.577+0000 7f04df06d640 1 -- 172.21.15.87:0/3674046352 shutdown_connections 2024-09-17T07:16:19.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:19.577+0000 7f04df06d640 1 --2- 172.21.15.87:0/3674046352 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04d81014c0 0x7f04d81125c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:19.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:19.577+0000 7f04df06d640 1 --2- 172.21.15.87:0/3674046352 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f04c006ed60 0x7f04c0071210 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:19.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:19.577+0000 7f04df06d640 1 --2- 172.21.15.87:0/3674046352 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f04d80fb480 0x7f04d8112080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:19.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:19.577+0000 7f04df06d640 1 -- 172.21.15.87:0/3674046352 >> 172.21.15.87:0/3674046352 conn(0x7f04d80f7000 msgr2=0x7f04d80f89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:16:19.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:19.577+0000 7f04df06d640 1 -- 172.21.15.87:0/3674046352 shutdown_connections 2024-09-17T07:16:19.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:19.577+0000 7f04df06d640 1 -- 172.21.15.87:0/3674046352 wait complete. 2024-09-17T07:16:20.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:16:19 smithi139 ceph-mon[34403]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T07:16:20.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:16:19 smithi139 ceph-mon[34403]: from='client.? 172.21.15.87:0/3674046352' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-17T07:16:20.119 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:16:19 smithi087 ceph-mon[27636]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T07:16:20.119 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:16:19 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/3674046352' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-17T07:16:20.245 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-17T07:16:20.246 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-17T07:16:20.246 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-17T07:16:20.247 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-17T07:16:20.247 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-17T07:16:20.247 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-17T07:16:20.533 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/mon.smithi087/config 2024-09-17T07:16:20.539 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/mon.smithi087/config 2024-09-17T07:16:21.883 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/mon.smithi087/config 2024-09-17T07:16:21.884 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/mon.smithi087/config 2024-09-17T07:16:21.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:16:21 smithi087 ceph-mon[27636]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T07:16:21.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:16:21 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:16:22.054 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:16:21 smithi139 ceph-mon[34403]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T07:16:22.054 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:16:21 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:16:23.117 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/mon.smithi087/config 2024-09-17T07:16:23.117 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/mon.smithi087/config 2024-09-17T07:16:23.883 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:16:23 smithi087 ceph-mon[27636]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T07:16:24.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:16:23 smithi139 ceph-mon[34403]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T07:16:24.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.399+0000 7f0dcc360640 1 -- 172.21.15.87:0/366810659 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0dc4102ed0 msgr2=0x7f0dc40fc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:24.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.399+0000 7f0dcc360640 1 --2- 172.21.15.87:0/366810659 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0dc4102ed0 0x7f0dc40fc590 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0db40048d0 tx=0x7f0db4009da0 comp rx=0 tx=0).stop 2024-09-17T07:16:24.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.399+0000 7f0dcc360640 1 -- 172.21.15.87:0/366810659 shutdown_connections 2024-09-17T07:16:24.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.399+0000 7f0dcc360640 1 --2- 172.21.15.87:0/366810659 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0dc4102ed0 0x7f0dc40fc590 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:24.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.399+0000 7f0dcc360640 1 --2- 172.21.15.87:0/366810659 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0dc4102530 0x7f0dc4102900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:24.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.399+0000 7f0dcc360640 1 -- 172.21.15.87:0/366810659 >> 172.21.15.87:0/366810659 conn(0x7f0dc40f80f0 msgr2=0x7f0dc40fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:16:24.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.399+0000 7f0dcc360640 1 -- 172.21.15.87:0/366810659 shutdown_connections 2024-09-17T07:16:24.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.399+0000 7f0dcc360640 1 -- 172.21.15.87:0/366810659 wait complete. 2024-09-17T07:16:24.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.400+0000 7f0dcc360640 1 Processor -- start 2024-09-17T07:16:24.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.400+0000 7f0dcc360640 1 -- start start 2024-09-17T07:16:24.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.400+0000 7f0dcc360640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0dc4102530 0x7f0dc4113120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:16:24.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.400+0000 7f0dcc360640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0dc4102ed0 0x7f0dc4113660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:16:24.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.400+0000 7f0dcc360640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc4113c60 con 0x7f0dc4102530 2024-09-17T07:16:24.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.400+0000 7f0dcc360640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc410d0a0 con 0x7f0dc4102ed0 2024-09-17T07:16:24.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.400+0000 7f0dca0fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0dc4102530 0x7f0dc4113120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:16:24.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.400+0000 7f0dca0fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0dc4102530 0x7f0dc4113120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:43054/0 (socket says 172.21.15.87:43054) 2024-09-17T07:16:24.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.400+0000 7f0dca0fc640 1 -- 172.21.15.87:0/859510694 learned_addr learned my addr 172.21.15.87:0/859510694 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:16:24.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.400+0000 7f0dca0fc640 1 -- 172.21.15.87:0/859510694 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0dc4102ed0 msgr2=0x7f0dc4113660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:24.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.400+0000 7f0dca0fc640 1 --2- 172.21.15.87:0/859510694 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0dc4102ed0 0x7f0dc4113660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:24.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.400+0000 7f0dca0fc640 1 -- 172.21.15.87:0/859510694 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db4005040 con 0x7f0dc4102530 2024-09-17T07:16:24.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.400+0000 7f0dca0fc640 1 --2- 172.21.15.87:0/859510694 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0dc4102530 0x7f0dc4113120 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0dc000c810 tx=0x7f0dc00043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:16:24.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.401+0000 7f0dbaffd640 1 -- 172.21.15.87:0/859510694 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0dc000a820 con 0x7f0dc4102530 2024-09-17T07:16:24.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.401+0000 7f0dbaffd640 1 -- 172.21.15.87:0/859510694 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f0dc000ae00 con 0x7f0dc4102530 2024-09-17T07:16:24.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.401+0000 7f0dcc360640 1 -- 172.21.15.87:0/859510694 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dc410d380 con 0x7f0dc4102530 2024-09-17T07:16:24.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.401+0000 7f0dbaffd640 1 -- 172.21.15.87:0/859510694 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0dc0011380 con 0x7f0dc4102530 2024-09-17T07:16:24.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.401+0000 7f0dcc360640 1 -- 172.21.15.87:0/859510694 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dc410d920 con 0x7f0dc4102530 2024-09-17T07:16:24.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.401+0000 7f0dcc360640 1 -- 172.21.15.87:0/859510694 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0dc410de60 con 0x7f0dc4102530 2024-09-17T07:16:24.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.402+0000 7f0dbaffd640 1 -- 172.21.15.87:0/859510694 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f0dc0012790 con 0x7f0dc4102530 2024-09-17T07:16:24.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.402+0000 7f0dbaffd640 1 --2- 172.21.15.87:0/859510694 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f0db006ed60 0x7f0db0071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:16:24.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.403+0000 7f0dc98fb640 1 --2- 172.21.15.87:0/859510694 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f0db006ed60 0x7f0db0071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:16:24.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.403+0000 7f0dbaffd640 1 -- 172.21.15.87:0/859510694 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f0dc008e3c0 con 0x7f0dc4102530 2024-09-17T07:16:24.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.403+0000 7f0dbaffd640 1 --2- 172.21.15.87:0/859510694 >> [v2:172.21.15.139:6808/1310055282,v1:172.21.15.139:6809/1310055282] conn(0x7f0db0074ae0 0x7f0db0076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:16:24.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.403+0000 7f0dbaffd640 1 -- 172.21.15.87:0/859510694 --> [v2:172.21.15.139:6808/1310055282,v1:172.21.15.139:6809/1310055282] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0db00775a0 con 0x7f0db0074ae0 2024-09-17T07:16:24.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.403+0000 7f0dbaffd640 1 -- 172.21.15.87:0/859510694 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0dc0090a10 con 0x7f0dc4102530 2024-09-17T07:16:24.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.403+0000 7f0dc98fb640 1 --2- 172.21.15.87:0/859510694 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f0db006ed60 0x7f0db0071210 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0db4009ac0 tx=0x7f0db4009da0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:16:24.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.403+0000 7f0dca8fd640 1 --2- 172.21.15.87:0/859510694 >> [v2:172.21.15.139:6808/1310055282,v1:172.21.15.139:6809/1310055282] conn(0x7f0db0074ae0 0x7f0db0076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:16:24.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.403+0000 7f0dca8fd640 1 --2- 172.21.15.87:0/859510694 >> [v2:172.21.15.139:6808/1310055282,v1:172.21.15.139:6809/1310055282] conn(0x7f0db0074ae0 0x7f0db0076ef0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:16:24.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.404+0000 7f0dbaffd640 1 -- 172.21.15.87:0/859510694 <== osd.4 v2:172.21.15.139:6808/1310055282 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f0db00775a0 con 0x7f0db0074ae0 2024-09-17T07:16:24.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.416+0000 7f0dcc360640 1 -- 172.21.15.87:0/859510694 --> [v2:172.21.15.139:6808/1310055282,v1:172.21.15.139:6809/1310055282] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0dc40f9bd0 con 0x7f0db0074ae0 2024-09-17T07:16:24.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.417+0000 7f0dbaffd640 1 -- 172.21.15.87:0/859510694 <== osd.4 v2:172.21.15.139:6808/1310055282 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f0dc40f9bd0 con 0x7f0db0074ae0 2024-09-17T07:16:24.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.417+0000 7f0dcc360640 1 -- 172.21.15.87:0/859510694 >> [v2:172.21.15.139:6808/1310055282,v1:172.21.15.139:6809/1310055282] conn(0x7f0db0074ae0 msgr2=0x7f0db0076ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:24.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.417+0000 7f0dcc360640 1 --2- 172.21.15.87:0/859510694 >> [v2:172.21.15.139:6808/1310055282,v1:172.21.15.139:6809/1310055282] conn(0x7f0db0074ae0 0x7f0db0076ef0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:24.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.417+0000 7f0dcc360640 1 -- 172.21.15.87:0/859510694 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f0db006ed60 msgr2=0x7f0db0071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:24.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.417+0000 7f0dcc360640 1 --2- 172.21.15.87:0/859510694 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f0db006ed60 0x7f0db0071210 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0db4009ac0 tx=0x7f0db4009da0 comp rx=0 tx=0).stop 2024-09-17T07:16:24.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.417+0000 7f0dcc360640 1 -- 172.21.15.87:0/859510694 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0dc4102530 msgr2=0x7f0dc4113120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:24.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.417+0000 7f0dcc360640 1 --2- 172.21.15.87:0/859510694 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0dc4102530 0x7f0dc4113120 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0dc000c810 tx=0x7f0dc00043c0 comp rx=0 tx=0).stop 2024-09-17T07:16:24.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.417+0000 7f0dcc360640 1 -- 172.21.15.87:0/859510694 shutdown_connections 2024-09-17T07:16:24.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.417+0000 7f0dcc360640 1 --2- 172.21.15.87:0/859510694 >> [v2:172.21.15.139:6808/1310055282,v1:172.21.15.139:6809/1310055282] conn(0x7f0db0074ae0 0x7f0db0076ef0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:24.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.417+0000 7f0dcc360640 1 --2- 172.21.15.87:0/859510694 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f0db006ed60 0x7f0db0071210 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:24.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.417+0000 7f0dcc360640 1 --2- 172.21.15.87:0/859510694 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0dc4102ed0 0x7f0dc4113660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:24.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.417+0000 7f0dcc360640 1 --2- 172.21.15.87:0/859510694 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0dc4102530 0x7f0dc4113120 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:24.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.417+0000 7f0dcc360640 1 -- 172.21.15.87:0/859510694 >> 172.21.15.87:0/859510694 conn(0x7f0dc40f80f0 msgr2=0x7f0dc40f9200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:16:24.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.417+0000 7f0dcc360640 1 -- 172.21.15.87:0/859510694 shutdown_connections 2024-09-17T07:16:24.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.417+0000 7f0dcc360640 1 -- 172.21.15.87:0/859510694 wait complete. 2024-09-17T07:16:24.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.963+0000 7fcb4629a640 1 -- 172.21.15.87:0/295417486 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb40102ed0 msgr2=0x7fcb400fc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:24.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.963+0000 7fcb4629a640 1 --2- 172.21.15.87:0/295417486 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb40102ed0 0x7fcb400fc590 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fcb280048d0 tx=0x7fcb28009da0 comp rx=0 tx=0).stop 2024-09-17T07:16:24.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.963+0000 7fcb4629a640 1 -- 172.21.15.87:0/295417486 shutdown_connections 2024-09-17T07:16:24.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.963+0000 7fcb4629a640 1 --2- 172.21.15.87:0/295417486 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb40102ed0 0x7fcb400fc590 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:24.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.963+0000 7fcb4629a640 1 --2- 172.21.15.87:0/295417486 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcb40102530 0x7fcb40102900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:24.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.963+0000 7fcb4629a640 1 -- 172.21.15.87:0/295417486 >> 172.21.15.87:0/295417486 conn(0x7fcb400f80f0 msgr2=0x7fcb400fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:16:24.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.963+0000 7fcb4629a640 1 -- 172.21.15.87:0/295417486 shutdown_connections 2024-09-17T07:16:24.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.963+0000 7fcb4629a640 1 -- 172.21.15.87:0/295417486 wait complete. 2024-09-17T07:16:24.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.963+0000 7fcb4629a640 1 Processor -- start 2024-09-17T07:16:24.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.964+0000 7fcb4629a640 1 -- start start 2024-09-17T07:16:24.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.964+0000 7fcb4629a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb40102530 0x7fcb40113120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:16:24.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.964+0000 7fcb4629a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcb40102ed0 0x7fcb40113660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:16:24.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.964+0000 7fcb4629a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb40113c60 con 0x7fcb40102530 2024-09-17T07:16:24.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.964+0000 7fcb4629a640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb4010d0a0 con 0x7fcb40102ed0 2024-09-17T07:16:24.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.964+0000 7fcb3ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb40102530 0x7fcb40113120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:16:24.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.964+0000 7fcb3ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb40102530 0x7fcb40113120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:43072/0 (socket says 172.21.15.87:43072) 2024-09-17T07:16:24.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.964+0000 7fcb3ffff640 1 -- 172.21.15.87:0/3375405798 learned_addr learned my addr 172.21.15.87:0/3375405798 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:16:24.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.964+0000 7fcb37fff640 1 --2- 172.21.15.87:0/3375405798 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcb40102ed0 0x7fcb40113660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:16:24.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.964+0000 7fcb3ffff640 1 -- 172.21.15.87:0/3375405798 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcb40102ed0 msgr2=0x7fcb40113660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:24.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.964+0000 7fcb3ffff640 1 --2- 172.21.15.87:0/3375405798 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcb40102ed0 0x7fcb40113660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:24.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.964+0000 7fcb3ffff640 1 -- 172.21.15.87:0/3375405798 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb28005040 con 0x7fcb40102530 2024-09-17T07:16:24.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.964+0000 7fcb3ffff640 1 --2- 172.21.15.87:0/3375405798 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb40102530 0x7fcb40113120 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fcb3000c830 tx=0x7fcb30004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:16:24.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.964+0000 7fcb3d7fa640 1 -- 172.21.15.87:0/3375405798 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb3000a7d0 con 0x7fcb40102530 2024-09-17T07:16:24.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.964+0000 7fcb3d7fa640 1 -- 172.21.15.87:0/3375405798 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fcb3000adb0 con 0x7fcb40102530 2024-09-17T07:16:24.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.964+0000 7fcb4629a640 1 -- 172.21.15.87:0/3375405798 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb4010d380 con 0x7fcb40102530 2024-09-17T07:16:24.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.964+0000 7fcb3d7fa640 1 -- 172.21.15.87:0/3375405798 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb300113a0 con 0x7fcb40102530 2024-09-17T07:16:24.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.965+0000 7fcb4629a640 1 -- 172.21.15.87:0/3375405798 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb4010d8f0 con 0x7fcb40102530 2024-09-17T07:16:24.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.965+0000 7fcb4629a640 1 -- 172.21.15.87:0/3375405798 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcb4010de50 con 0x7fcb40102530 2024-09-17T07:16:24.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.966+0000 7fcb3d7fa640 1 -- 172.21.15.87:0/3375405798 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fcb3000a930 con 0x7fcb40102530 2024-09-17T07:16:24.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.967+0000 7fcb3d7fa640 1 --2- 172.21.15.87:0/3375405798 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fcb2c06ed50 0x7fcb2c071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:16:24.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.967+0000 7fcb3d7fa640 1 -- 172.21.15.87:0/3375405798 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fcb3008ded0 con 0x7fcb40102530 2024-09-17T07:16:24.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.967+0000 7fcb37fff640 1 --2- 172.21.15.87:0/3375405798 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fcb2c06ed50 0x7fcb2c071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:16:24.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.967+0000 7fcb3d7fa640 1 --2- 172.21.15.87:0/3375405798 >> [v2:172.21.15.139:6816/1731614128,v1:172.21.15.139:6817/1731614128] conn(0x7fcb2c074ad0 0x7fcb2c076ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:16:24.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.967+0000 7fcb3d7fa640 1 -- 172.21.15.87:0/3375405798 --> [v2:172.21.15.139:6816/1731614128,v1:172.21.15.139:6817/1731614128] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcb2c077590 con 0x7fcb2c074ad0 2024-09-17T07:16:24.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.967+0000 7fcb3d7fa640 1 -- 172.21.15.87:0/3375405798 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcb300904e0 con 0x7fcb40102530 2024-09-17T07:16:24.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.967+0000 7fcb44837640 1 --2- 172.21.15.87:0/3375405798 >> [v2:172.21.15.139:6816/1731614128,v1:172.21.15.139:6817/1731614128] conn(0x7fcb2c074ad0 0x7fcb2c076ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:16:24.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.967+0000 7fcb37fff640 1 --2- 172.21.15.87:0/3375405798 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fcb2c06ed50 0x7fcb2c071200 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcb28000c00 tx=0x7fcb28035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:16:24.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.967+0000 7fcb44837640 1 --2- 172.21.15.87:0/3375405798 >> [v2:172.21.15.139:6816/1731614128,v1:172.21.15.139:6817/1731614128] conn(0x7fcb2c074ad0 0x7fcb2c076ee0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:16:24.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.968+0000 7fcb3d7fa640 1 -- 172.21.15.87:0/3375405798 <== osd.5 v2:172.21.15.139:6816/1731614128 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fcb2c077590 con 0x7fcb2c074ad0 2024-09-17T07:16:24.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.981+0000 7fcb4629a640 1 -- 172.21.15.87:0/3375405798 --> [v2:172.21.15.139:6816/1731614128,v1:172.21.15.139:6817/1731614128] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcb400fdcb0 con 0x7fcb2c074ad0 2024-09-17T07:16:24.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.981+0000 7fcb3d7fa640 1 -- 172.21.15.87:0/3375405798 <== osd.5 v2:172.21.15.139:6816/1731614128 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fcb400fdcb0 con 0x7fcb2c074ad0 2024-09-17T07:16:24.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.982+0000 7fcb4629a640 1 -- 172.21.15.87:0/3375405798 >> [v2:172.21.15.139:6816/1731614128,v1:172.21.15.139:6817/1731614128] conn(0x7fcb2c074ad0 msgr2=0x7fcb2c076ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:24.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.982+0000 7fcb4629a640 1 --2- 172.21.15.87:0/3375405798 >> [v2:172.21.15.139:6816/1731614128,v1:172.21.15.139:6817/1731614128] conn(0x7fcb2c074ad0 0x7fcb2c076ee0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:24.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.982+0000 7fcb4629a640 1 -- 172.21.15.87:0/3375405798 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fcb2c06ed50 msgr2=0x7fcb2c071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:24.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.982+0000 7fcb4629a640 1 --2- 172.21.15.87:0/3375405798 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fcb2c06ed50 0x7fcb2c071200 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcb28000c00 tx=0x7fcb28035040 comp rx=0 tx=0).stop 2024-09-17T07:16:24.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.982+0000 7fcb4629a640 1 -- 172.21.15.87:0/3375405798 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb40102530 msgr2=0x7fcb40113120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:24.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.982+0000 7fcb4629a640 1 --2- 172.21.15.87:0/3375405798 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb40102530 0x7fcb40113120 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fcb3000c830 tx=0x7fcb30004430 comp rx=0 tx=0).stop 2024-09-17T07:16:24.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.982+0000 7fcb4629a640 1 -- 172.21.15.87:0/3375405798 shutdown_connections 2024-09-17T07:16:24.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.982+0000 7fcb4629a640 1 --2- 172.21.15.87:0/3375405798 >> [v2:172.21.15.139:6816/1731614128,v1:172.21.15.139:6817/1731614128] conn(0x7fcb2c074ad0 0x7fcb2c076ee0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:24.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.982+0000 7fcb4629a640 1 --2- 172.21.15.87:0/3375405798 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fcb2c06ed50 0x7fcb2c071200 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:24.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.982+0000 7fcb4629a640 1 --2- 172.21.15.87:0/3375405798 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcb40102ed0 0x7fcb40113660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:24.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.982+0000 7fcb4629a640 1 --2- 172.21.15.87:0/3375405798 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb40102530 0x7fcb40113120 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:24.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.982+0000 7fcb4629a640 1 -- 172.21.15.87:0/3375405798 >> 172.21.15.87:0/3375405798 conn(0x7fcb400f80f0 msgr2=0x7fcb400f9200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:16:24.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.982+0000 7fcb4629a640 1 -- 172.21.15.87:0/3375405798 shutdown_connections 2024-09-17T07:16:24.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:24.982+0000 7fcb4629a640 1 -- 172.21.15.87:0/3375405798 wait complete. 2024-09-17T07:16:25.970 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:16:25 smithi087 ceph-mon[27636]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T07:16:26.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:16:25 smithi139 ceph-mon[34403]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T07:16:27.398 INFO:teuthology.orchestra.run.smithi087.stdout:158913789959 2024-09-17T07:16:27.398 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-17T07:16:27.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:27.818+0000 7f8590bdd640 1 -- 172.21.15.87:0/1002558545 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f858c0fb480 msgr2=0x7f858c0fb8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:27.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:27.818+0000 7f8590bdd640 1 --2- 172.21.15.87:0/1002558545 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f858c0fb480 0x7f858c0fb8f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f85800048d0 tx=0x7f8580009da0 comp rx=0 tx=0).stop 2024-09-17T07:16:27.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:27.818+0000 7f8590bdd640 1 -- 172.21.15.87:0/1002558545 shutdown_connections 2024-09-17T07:16:27.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:27.818+0000 7f8590bdd640 1 --2- 172.21.15.87:0/1002558545 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f858c0fb480 0x7f858c0fb8f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:27.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:27.818+0000 7f8590bdd640 1 --2- 172.21.15.87:0/1002558545 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f858c1014c0 0x7f858c101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:27.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:27.818+0000 7f8590bdd640 1 -- 172.21.15.87:0/1002558545 >> 172.21.15.87:0/1002558545 conn(0x7f858c0f7000 msgr2=0x7f858c0f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:16:27.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:27.818+0000 7f8590bdd640 1 -- 172.21.15.87:0/1002558545 shutdown_connections 2024-09-17T07:16:27.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:27.818+0000 7f8590bdd640 1 -- 172.21.15.87:0/1002558545 wait complete. 2024-09-17T07:16:27.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:27.819+0000 7f8590bdd640 1 Processor -- start 2024-09-17T07:16:27.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:27.819+0000 7f8590bdd640 1 -- start start 2024-09-17T07:16:27.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:27.819+0000 7f8590bdd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f858c0fb480 0x7f858c10e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:16:27.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:27.819+0000 7f8590bdd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f858c1014c0 0x7f858c10e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:16:27.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:27.819+0000 7f8590bdd640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f858c10ebe0 con 0x7f858c0fb480 2024-09-17T07:16:27.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:27.819+0000 7f8590bdd640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f858c10ed50 con 0x7f858c1014c0 2024-09-17T07:16:27.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:27.819+0000 7f858a59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f858c0fb480 0x7f858c10e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:16:27.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:27.819+0000 7f858a59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f858c0fb480 0x7f858c10e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:43090/0 (socket says 172.21.15.87:43090) 2024-09-17T07:16:27.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:27.819+0000 7f858a59c640 1 -- 172.21.15.87:0/1776363570 learned_addr learned my addr 172.21.15.87:0/1776363570 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:16:27.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:27.819+0000 7f8589d9b640 1 --2- 172.21.15.87:0/1776363570 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f858c1014c0 0x7f858c10e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:16:27.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:27.819+0000 7f858a59c640 1 -- 172.21.15.87:0/1776363570 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f858c1014c0 msgr2=0x7f858c10e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:27.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:27.819+0000 7f858a59c640 1 --2- 172.21.15.87:0/1776363570 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f858c1014c0 0x7f858c10e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:27.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:27.819+0000 7f858a59c640 1 -- 172.21.15.87:0/1776363570 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8580005040 con 0x7f858c0fb480 2024-09-17T07:16:27.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:27.819+0000 7f8589d9b640 1 --2- 172.21.15.87:0/1776363570 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f858c1014c0 0x7f858c10e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T07:16:27.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:27.820+0000 7f858a59c640 1 --2- 172.21.15.87:0/1776363570 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f858c0fb480 0x7f858c10e0a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f857c00c810 tx=0x7f857c0043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:16:27.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:27.820+0000 7f857affd640 1 -- 172.21.15.87:0/1776363570 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f857c00a820 con 0x7f858c0fb480 2024-09-17T07:16:27.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:27.820+0000 7f857affd640 1 -- 172.21.15.87:0/1776363570 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f857c00ae00 con 0x7f858c0fb480 2024-09-17T07:16:27.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:27.820+0000 7f857affd640 1 -- 172.21.15.87:0/1776363570 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f857c011380 con 0x7f858c0fb480 2024-09-17T07:16:27.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:27.820+0000 7f8590bdd640 1 -- 172.21.15.87:0/1776363570 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f858c117110 con 0x7f858c0fb480 2024-09-17T07:16:27.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:27.820+0000 7f8590bdd640 1 -- 172.21.15.87:0/1776363570 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f858c117650 con 0x7f858c0fb480 2024-09-17T07:16:27.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:27.821+0000 7f8590bdd640 1 -- 172.21.15.87:0/1776363570 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f858c0f9400 con 0x7f858c0fb480 2024-09-17T07:16:27.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:27.821+0000 7f857affd640 1 -- 172.21.15.87:0/1776363570 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f857c012790 con 0x7f858c0fb480 2024-09-17T07:16:27.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:27.822+0000 7f857affd640 1 --2- 172.21.15.87:0/1776363570 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f857406ed60 0x7f8574071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:16:27.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:27.822+0000 7f857affd640 1 -- 172.21.15.87:0/1776363570 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f857c08e2f0 con 0x7f858c0fb480 2024-09-17T07:16:27.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:27.822+0000 7f8589d9b640 1 --2- 172.21.15.87:0/1776363570 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f857406ed60 0x7f8574071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:16:27.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:27.822+0000 7f857affd640 1 --2- 172.21.15.87:0/1776363570 >> [v2:172.21.15.87:6810/3001772283,v1:172.21.15.87:6811/3001772283] conn(0x7f8574074ae0 0x7f8574076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:16:27.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:27.822+0000 7f857affd640 1 -- 172.21.15.87:0/1776363570 --> [v2:172.21.15.87:6810/3001772283,v1:172.21.15.87:6811/3001772283] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f85740775a0 con 0x7f8574074ae0 2024-09-17T07:16:27.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:27.822+0000 7f857affd640 1 -- 172.21.15.87:0/1776363570 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f857c090940 con 0x7f858c0fb480 2024-09-17T07:16:27.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:27.822+0000 7f858ad9d640 1 --2- 172.21.15.87:0/1776363570 >> [v2:172.21.15.87:6810/3001772283,v1:172.21.15.87:6811/3001772283] conn(0x7f8574074ae0 0x7f8574076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:16:27.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:27.822+0000 7f8589d9b640 1 --2- 172.21.15.87:0/1776363570 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f857406ed60 0x7f8574071210 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8580009ac0 tx=0x7f8580035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:16:27.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:27.822+0000 7f858ad9d640 1 --2- 172.21.15.87:0/1776363570 >> [v2:172.21.15.87:6810/3001772283,v1:172.21.15.87:6811/3001772283] conn(0x7f8574074ae0 0x7f8574076ef0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:16:27.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:27.823+0000 7f857affd640 1 -- 172.21.15.87:0/1776363570 <== osd.1 v2:172.21.15.87:6810/3001772283 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f85740775a0 con 0x7f8574074ae0 2024-09-17T07:16:27.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:27.835+0000 7f8590bdd640 1 -- 172.21.15.87:0/1776363570 --> [v2:172.21.15.87:6810/3001772283,v1:172.21.15.87:6811/3001772283] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f858c0fcbc0 con 0x7f8574074ae0 2024-09-17T07:16:27.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:27.836+0000 7f857affd640 1 -- 172.21.15.87:0/1776363570 <== osd.1 v2:172.21.15.87:6810/3001772283 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f858c0fcbc0 con 0x7f8574074ae0 2024-09-17T07:16:27.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:27.836+0000 7f8590bdd640 1 -- 172.21.15.87:0/1776363570 >> [v2:172.21.15.87:6810/3001772283,v1:172.21.15.87:6811/3001772283] conn(0x7f8574074ae0 msgr2=0x7f8574076ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:27.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:27.836+0000 7f8590bdd640 1 --2- 172.21.15.87:0/1776363570 >> [v2:172.21.15.87:6810/3001772283,v1:172.21.15.87:6811/3001772283] conn(0x7f8574074ae0 0x7f8574076ef0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:27.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:27.836+0000 7f8590bdd640 1 -- 172.21.15.87:0/1776363570 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f857406ed60 msgr2=0x7f8574071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:27.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:27.836+0000 7f8590bdd640 1 --2- 172.21.15.87:0/1776363570 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f857406ed60 0x7f8574071210 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8580009ac0 tx=0x7f8580035040 comp rx=0 tx=0).stop 2024-09-17T07:16:27.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:27.836+0000 7f8590bdd640 1 -- 172.21.15.87:0/1776363570 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f858c0fb480 msgr2=0x7f858c10e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:27.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:27.836+0000 7f8590bdd640 1 --2- 172.21.15.87:0/1776363570 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f858c0fb480 0x7f858c10e0a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f857c00c810 tx=0x7f857c0043c0 comp rx=0 tx=0).stop 2024-09-17T07:16:27.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:27.836+0000 7f8590bdd640 1 -- 172.21.15.87:0/1776363570 shutdown_connections 2024-09-17T07:16:27.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:27.836+0000 7f8590bdd640 1 --2- 172.21.15.87:0/1776363570 >> [v2:172.21.15.87:6810/3001772283,v1:172.21.15.87:6811/3001772283] conn(0x7f8574074ae0 0x7f8574076ef0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:27.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:27.836+0000 7f8590bdd640 1 --2- 172.21.15.87:0/1776363570 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f857406ed60 0x7f8574071210 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:27.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:27.836+0000 7f8590bdd640 1 --2- 172.21.15.87:0/1776363570 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f858c1014c0 0x7f858c10e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:27.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:27.836+0000 7f8590bdd640 1 --2- 172.21.15.87:0/1776363570 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f858c0fb480 0x7f858c10e0a0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:27.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:27.836+0000 7f8590bdd640 1 -- 172.21.15.87:0/1776363570 >> 172.21.15.87:0/1776363570 conn(0x7f858c0f7000 msgr2=0x7f858c0f89f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:16:27.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:27.836+0000 7f8590bdd640 1 -- 172.21.15.87:0/1776363570 shutdown_connections 2024-09-17T07:16:27.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:27.836+0000 7f8590bdd640 1 -- 172.21.15.87:0/1776363570 wait complete. 2024-09-17T07:16:28.110 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:16:27 smithi087 ceph-mon[27636]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T07:16:28.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:16:27 smithi139 ceph-mon[34403]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T07:16:28.933 INFO:teuthology.orchestra.run.smithi087.stdout:137438953484 2024-09-17T07:16:28.933 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-17T07:16:29.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:29.548+0000 7f443a8f6640 1 -- 172.21.15.87:0/1099173632 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44340fcf80 msgr2=0x7f44340fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:29.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:29.548+0000 7f443a8f6640 1 --2- 172.21.15.87:0/1099173632 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44340fcf80 0x7f44340fd3d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f44280048d0 tx=0x7f4428009da0 comp rx=0 tx=0).stop 2024-09-17T07:16:29.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:29.548+0000 7f443a8f6640 1 -- 172.21.15.87:0/1099173632 shutdown_connections 2024-09-17T07:16:29.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:29.548+0000 7f443a8f6640 1 --2- 172.21.15.87:0/1099173632 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44340fcf80 0x7f44340fd3d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:29.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:29.548+0000 7f443a8f6640 1 --2- 172.21.15.87:0/1099173632 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f44340fb810 0x7f44340fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:29.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:29.548+0000 7f443a8f6640 1 -- 172.21.15.87:0/1099173632 >> 172.21.15.87:0/1099173632 conn(0x7f44340723b0 msgr2=0x7f44340727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:16:29.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:29.548+0000 7f443a8f6640 1 -- 172.21.15.87:0/1099173632 shutdown_connections 2024-09-17T07:16:29.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:29.548+0000 7f443a8f6640 1 -- 172.21.15.87:0/1099173632 wait complete. 2024-09-17T07:16:29.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:29.548+0000 7f443a8f6640 1 Processor -- start 2024-09-17T07:16:29.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:29.549+0000 7f443a8f6640 1 -- start start 2024-09-17T07:16:29.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:29.549+0000 7f443a8f6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44340fb810 0x7f443410e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:16:29.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:29.549+0000 7f443a8f6640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f44340fcf80 0x7f443410e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:16:29.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:29.549+0000 7f443a8f6640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f443410ebe0 con 0x7f44340fb810 2024-09-17T07:16:29.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:29.549+0000 7f443a8f6640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f443410ed50 con 0x7f44340fcf80 2024-09-17T07:16:29.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:29.549+0000 7f4433fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44340fb810 0x7f443410e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:16:29.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:29.549+0000 7f4433fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44340fb810 0x7f443410e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:43104/0 (socket says 172.21.15.87:43104) 2024-09-17T07:16:29.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:29.549+0000 7f4433fff640 1 -- 172.21.15.87:0/1765259374 learned_addr learned my addr 172.21.15.87:0/1765259374 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:16:29.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:29.549+0000 7f4433fff640 1 -- 172.21.15.87:0/1765259374 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f44340fcf80 msgr2=0x7f443410e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:29.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:29.549+0000 7f44337fe640 1 --2- 172.21.15.87:0/1765259374 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f44340fcf80 0x7f443410e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:16:29.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:29.549+0000 7f4433fff640 1 --2- 172.21.15.87:0/1765259374 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f44340fcf80 0x7f443410e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:29.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:29.549+0000 7f4433fff640 1 -- 172.21.15.87:0/1765259374 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4428005040 con 0x7f44340fb810 2024-09-17T07:16:29.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:29.550+0000 7f4433fff640 1 --2- 172.21.15.87:0/1765259374 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44340fb810 0x7f443410e0a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f442400c790 tx=0x7f44240043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:16:29.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:29.550+0000 7f4430ff9640 1 -- 172.21.15.87:0/1765259374 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f442400a820 con 0x7f44340fb810 2024-09-17T07:16:29.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:29.550+0000 7f443a8f6640 1 -- 172.21.15.87:0/1765259374 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4434117110 con 0x7f44340fb810 2024-09-17T07:16:29.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:29.550+0000 7f443a8f6640 1 -- 172.21.15.87:0/1765259374 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4434117650 con 0x7f44340fb810 2024-09-17T07:16:29.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:29.550+0000 7f4430ff9640 1 -- 172.21.15.87:0/1765259374 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f442400ae00 con 0x7f44340fb810 2024-09-17T07:16:29.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:29.550+0000 7f4430ff9640 1 -- 172.21.15.87:0/1765259374 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44240113a0 con 0x7f44340fb810 2024-09-17T07:16:29.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:29.551+0000 7f443a8f6640 1 -- 172.21.15.87:0/1765259374 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4420000fd0 con 0x7f44340fb810 2024-09-17T07:16:29.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:29.552+0000 7f4430ff9640 1 -- 172.21.15.87:0/1765259374 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f4424012400 con 0x7f44340fb810 2024-09-17T07:16:29.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:29.552+0000 7f4430ff9640 1 --2- 172.21.15.87:0/1765259374 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f441c06ed60 0x7f441c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:16:29.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:29.552+0000 7f4430ff9640 1 -- 172.21.15.87:0/1765259374 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f442408e8a0 con 0x7f44340fb810 2024-09-17T07:16:29.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:29.553+0000 7f44337fe640 1 --2- 172.21.15.87:0/1765259374 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f441c06ed60 0x7f441c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:16:29.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:29.553+0000 7f4430ff9640 1 --2- 172.21.15.87:0/1765259374 >> [v2:172.21.15.87:6802/2205744672,v1:172.21.15.87:6803/2205744672] conn(0x7f441c074ae0 0x7f441c076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:16:29.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:29.553+0000 7f4430ff9640 1 -- 172.21.15.87:0/1765259374 --> [v2:172.21.15.87:6802/2205744672,v1:172.21.15.87:6803/2205744672] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f441c0775a0 con 0x7f441c074ae0 2024-09-17T07:16:29.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:29.553+0000 7f4430ff9640 1 -- 172.21.15.87:0/1765259374 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f442408eca0 con 0x7f44340fb810 2024-09-17T07:16:29.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:29.553+0000 7f4438e93640 1 --2- 172.21.15.87:0/1765259374 >> [v2:172.21.15.87:6802/2205744672,v1:172.21.15.87:6803/2205744672] conn(0x7f441c074ae0 0x7f441c076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:16:29.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:29.553+0000 7f44337fe640 1 --2- 172.21.15.87:0/1765259374 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f441c06ed60 0x7f441c071210 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4428009ac0 tx=0x7f4428009da0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:16:29.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:29.553+0000 7f4438e93640 1 --2- 172.21.15.87:0/1765259374 >> [v2:172.21.15.87:6802/2205744672,v1:172.21.15.87:6803/2205744672] conn(0x7f441c074ae0 0x7f441c076ef0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:16:29.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:29.554+0000 7f4430ff9640 1 -- 172.21.15.87:0/1765259374 <== osd.0 v2:172.21.15.87:6802/2205744672 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f441c0775a0 con 0x7f441c074ae0 2024-09-17T07:16:29.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:29.566+0000 7f443a8f6640 1 -- 172.21.15.87:0/1765259374 --> [v2:172.21.15.87:6802/2205744672,v1:172.21.15.87:6803/2205744672] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4420002ca0 con 0x7f441c074ae0 2024-09-17T07:16:29.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:29.566+0000 7f4430ff9640 1 -- 172.21.15.87:0/1765259374 <== osd.0 v2:172.21.15.87:6802/2205744672 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4420002ca0 con 0x7f441c074ae0 2024-09-17T07:16:29.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:29.567+0000 7f443a8f6640 1 -- 172.21.15.87:0/1765259374 >> [v2:172.21.15.87:6802/2205744672,v1:172.21.15.87:6803/2205744672] conn(0x7f441c074ae0 msgr2=0x7f441c076ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:29.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:29.567+0000 7f443a8f6640 1 --2- 172.21.15.87:0/1765259374 >> [v2:172.21.15.87:6802/2205744672,v1:172.21.15.87:6803/2205744672] conn(0x7f441c074ae0 0x7f441c076ef0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:29.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:29.567+0000 7f443a8f6640 1 -- 172.21.15.87:0/1765259374 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f441c06ed60 msgr2=0x7f441c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:29.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:29.567+0000 7f443a8f6640 1 --2- 172.21.15.87:0/1765259374 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f441c06ed60 0x7f441c071210 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4428009ac0 tx=0x7f4428009da0 comp rx=0 tx=0).stop 2024-09-17T07:16:29.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:29.567+0000 7f443a8f6640 1 -- 172.21.15.87:0/1765259374 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44340fb810 msgr2=0x7f443410e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:29.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:29.567+0000 7f443a8f6640 1 --2- 172.21.15.87:0/1765259374 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44340fb810 0x7f443410e0a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f442400c790 tx=0x7f44240043c0 comp rx=0 tx=0).stop 2024-09-17T07:16:29.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:29.567+0000 7f443a8f6640 1 -- 172.21.15.87:0/1765259374 shutdown_connections 2024-09-17T07:16:29.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:29.567+0000 7f443a8f6640 1 --2- 172.21.15.87:0/1765259374 >> [v2:172.21.15.87:6802/2205744672,v1:172.21.15.87:6803/2205744672] conn(0x7f441c074ae0 0x7f441c076ef0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:29.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:29.567+0000 7f443a8f6640 1 --2- 172.21.15.87:0/1765259374 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f441c06ed60 0x7f441c071210 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:29.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:29.567+0000 7f443a8f6640 1 --2- 172.21.15.87:0/1765259374 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f44340fcf80 0x7f443410e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:29.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:29.567+0000 7f443a8f6640 1 --2- 172.21.15.87:0/1765259374 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44340fb810 0x7f443410e0a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:29.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:29.567+0000 7f443a8f6640 1 -- 172.21.15.87:0/1765259374 >> 172.21.15.87:0/1765259374 conn(0x7f44340723b0 msgr2=0x7f44340fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:16:29.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:29.567+0000 7f443a8f6640 1 -- 172.21.15.87:0/1765259374 shutdown_connections 2024-09-17T07:16:29.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:29.567+0000 7f443a8f6640 1 -- 172.21.15.87:0/1765259374 wait complete. 2024-09-17T07:16:29.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:16:29 smithi087 ceph-mon[27636]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T07:16:30.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:16:29 smithi139 ceph-mon[34403]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T07:16:30.255 INFO:teuthology.orchestra.run.smithi087.stdout:60129542173 2024-09-17T07:16:30.256 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-17T07:16:31.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:31.331+0000 7fb2f5f8f640 1 -- 172.21.15.87:0/517601010 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2f00fac80 msgr2=0x7fb2f00fb0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:31.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:31.331+0000 7fb2f5f8f640 1 --2- 172.21.15.87:0/517601010 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2f00fac80 0x7fb2f00fb0f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb2e40048d0 tx=0x7fb2e4009da0 comp rx=0 tx=0).stop 2024-09-17T07:16:31.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:31.331+0000 7fb2f5f8f640 1 -- 172.21.15.87:0/517601010 shutdown_connections 2024-09-17T07:16:31.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:31.331+0000 7fb2f5f8f640 1 --2- 172.21.15.87:0/517601010 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2f00fac80 0x7fb2f00fb0f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:31.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:31.331+0000 7fb2f5f8f640 1 --2- 172.21.15.87:0/517601010 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb2f0102620 0x7fb2f01029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:31.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:31.331+0000 7fb2f5f8f640 1 -- 172.21.15.87:0/517601010 >> 172.21.15.87:0/517601010 conn(0x7fb2f0070ce0 msgr2=0x7fb2f00710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:16:31.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:31.332+0000 7fb2f5f8f640 1 -- 172.21.15.87:0/517601010 shutdown_connections 2024-09-17T07:16:31.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:31.332+0000 7fb2f5f8f640 1 -- 172.21.15.87:0/517601010 wait complete. 2024-09-17T07:16:31.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:31.332+0000 7fb2f5f8f640 1 Processor -- start 2024-09-17T07:16:31.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:31.332+0000 7fb2f5f8f640 1 -- start start 2024-09-17T07:16:31.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:31.332+0000 7fb2f5f8f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb2f00fac80 0x7fb2f00fbe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:16:31.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:31.332+0000 7fb2f5f8f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2f0102620 0x7fb2f00fc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:16:31.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:31.332+0000 7fb2f5f8f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f00fc8e0 con 0x7fb2f0102620 2024-09-17T07:16:31.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:31.332+0000 7fb2f5f8f640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f00fca50 con 0x7fb2f00fac80 2024-09-17T07:16:31.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:31.333+0000 7fb2eeffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2f0102620 0x7fb2f00fc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:16:31.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:31.333+0000 7fb2eeffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2f0102620 0x7fb2f00fc3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:43108/0 (socket says 172.21.15.87:43108) 2024-09-17T07:16:31.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:31.333+0000 7fb2eeffd640 1 -- 172.21.15.87:0/277190149 learned_addr learned my addr 172.21.15.87:0/277190149 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:16:31.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:31.333+0000 7fb2ef7fe640 1 --2- 172.21.15.87:0/277190149 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb2f00fac80 0x7fb2f00fbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:16:31.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:31.333+0000 7fb2eeffd640 1 -- 172.21.15.87:0/277190149 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb2f00fac80 msgr2=0x7fb2f00fbe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:31.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:31.333+0000 7fb2eeffd640 1 --2- 172.21.15.87:0/277190149 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb2f00fac80 0x7fb2f00fbe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:31.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:31.333+0000 7fb2eeffd640 1 -- 172.21.15.87:0/277190149 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2e4005040 con 0x7fb2f0102620 2024-09-17T07:16:31.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:31.333+0000 7fb2ef7fe640 1 --2- 172.21.15.87:0/277190149 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb2f00fac80 0x7fb2f00fbe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T07:16:31.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:31.333+0000 7fb2eeffd640 1 --2- 172.21.15.87:0/277190149 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2f0102620 0x7fb2f00fc3a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb2e40043d0 tx=0x7fb2e4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:16:31.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:31.333+0000 7fb2d7fff640 1 -- 172.21.15.87:0/277190149 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2e4038070 con 0x7fb2f0102620 2024-09-17T07:16:31.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:31.333+0000 7fb2d7fff640 1 -- 172.21.15.87:0/277190149 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fb2e402ade0 con 0x7fb2f0102620 2024-09-17T07:16:31.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:31.333+0000 7fb2f5f8f640 1 -- 172.21.15.87:0/277190149 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2f00fcc80 con 0x7fb2f0102620 2024-09-17T07:16:31.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:31.333+0000 7fb2d7fff640 1 -- 172.21.15.87:0/277190149 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2e402c750 con 0x7fb2f0102620 2024-09-17T07:16:31.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:31.333+0000 7fb2f5f8f640 1 -- 172.21.15.87:0/277190149 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2f0119780 con 0x7fb2f0102620 2024-09-17T07:16:31.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:31.334+0000 7fb2f5f8f640 1 -- 172.21.15.87:0/277190149 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb2f0106d50 con 0x7fb2f0102620 2024-09-17T07:16:31.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:31.334+0000 7fb2d7fff640 1 -- 172.21.15.87:0/277190149 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fb2e4030020 con 0x7fb2f0102620 2024-09-17T07:16:31.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:31.335+0000 7fb2d7fff640 1 --2- 172.21.15.87:0/277190149 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fb2d806ed60 0x7fb2d8071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:16:31.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:31.335+0000 7fb2ef7fe640 1 --2- 172.21.15.87:0/277190149 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fb2d806ed60 0x7fb2d8071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:16:31.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:31.335+0000 7fb2d7fff640 1 -- 172.21.15.87:0/277190149 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fb2e40adbd0 con 0x7fb2f0102620 2024-09-17T07:16:31.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:31.335+0000 7fb2d7fff640 1 --2- 172.21.15.87:0/277190149 >> [v2:172.21.15.139:6800/796189750,v1:172.21.15.139:6801/796189750] conn(0x7fb2d8074ae0 0x7fb2d8076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:16:31.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:31.335+0000 7fb2d7fff640 1 -- 172.21.15.87:0/277190149 --> [v2:172.21.15.139:6800/796189750,v1:172.21.15.139:6801/796189750] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb2d80775a0 con 0x7fb2d8074ae0 2024-09-17T07:16:31.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:31.335+0000 7fb2d7fff640 1 -- 172.21.15.87:0/277190149 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb2e40b2220 con 0x7fb2f0102620 2024-09-17T07:16:31.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:31.335+0000 7fb2effff640 1 --2- 172.21.15.87:0/277190149 >> [v2:172.21.15.139:6800/796189750,v1:172.21.15.139:6801/796189750] conn(0x7fb2d8074ae0 0x7fb2d8076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:16:31.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:31.335+0000 7fb2ef7fe640 1 --2- 172.21.15.87:0/277190149 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fb2d806ed60 0x7fb2d8071210 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb2e0007fd0 tx=0x7fb2e0009e90 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:16:31.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:31.336+0000 7fb2effff640 1 --2- 172.21.15.87:0/277190149 >> [v2:172.21.15.139:6800/796189750,v1:172.21.15.139:6801/796189750] conn(0x7fb2d8074ae0 0x7fb2d8076ef0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:16:31.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:31.337+0000 7fb2d7fff640 1 -- 172.21.15.87:0/277190149 <== osd.3 v2:172.21.15.139:6800/796189750 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fb2d80775a0 con 0x7fb2d8074ae0 2024-09-17T07:16:31.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:31.349+0000 7fb2f5f8f640 1 -- 172.21.15.87:0/277190149 --> [v2:172.21.15.139:6800/796189750,v1:172.21.15.139:6801/796189750] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb2f00657b0 con 0x7fb2d8074ae0 2024-09-17T07:16:31.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:31.349+0000 7fb2d7fff640 1 -- 172.21.15.87:0/277190149 <== osd.3 v2:172.21.15.139:6800/796189750 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fb2f00657b0 con 0x7fb2d8074ae0 2024-09-17T07:16:31.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:31.349+0000 7fb2f5f8f640 1 -- 172.21.15.87:0/277190149 >> [v2:172.21.15.139:6800/796189750,v1:172.21.15.139:6801/796189750] conn(0x7fb2d8074ae0 msgr2=0x7fb2d8076ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:31.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:31.349+0000 7fb2f5f8f640 1 --2- 172.21.15.87:0/277190149 >> [v2:172.21.15.139:6800/796189750,v1:172.21.15.139:6801/796189750] conn(0x7fb2d8074ae0 0x7fb2d8076ef0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:31.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:31.349+0000 7fb2f5f8f640 1 -- 172.21.15.87:0/277190149 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fb2d806ed60 msgr2=0x7fb2d8071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:31.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:31.349+0000 7fb2f5f8f640 1 --2- 172.21.15.87:0/277190149 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fb2d806ed60 0x7fb2d8071210 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb2e0007fd0 tx=0x7fb2e0009e90 comp rx=0 tx=0).stop 2024-09-17T07:16:31.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:31.349+0000 7fb2f5f8f640 1 -- 172.21.15.87:0/277190149 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2f0102620 msgr2=0x7fb2f00fc3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:31.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:31.349+0000 7fb2f5f8f640 1 --2- 172.21.15.87:0/277190149 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2f0102620 0x7fb2f00fc3a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb2e40043d0 tx=0x7fb2e4009da0 comp rx=0 tx=0).stop 2024-09-17T07:16:31.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:31.349+0000 7fb2f5f8f640 1 -- 172.21.15.87:0/277190149 shutdown_connections 2024-09-17T07:16:31.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:31.349+0000 7fb2f5f8f640 1 --2- 172.21.15.87:0/277190149 >> [v2:172.21.15.139:6800/796189750,v1:172.21.15.139:6801/796189750] conn(0x7fb2d8074ae0 0x7fb2d8076ef0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:31.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:31.349+0000 7fb2f5f8f640 1 --2- 172.21.15.87:0/277190149 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2f0102620 0x7fb2f00fc3a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:31.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:31.349+0000 7fb2f5f8f640 1 --2- 172.21.15.87:0/277190149 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fb2d806ed60 0x7fb2d8071210 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:31.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:31.349+0000 7fb2f5f8f640 1 --2- 172.21.15.87:0/277190149 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb2f00fac80 0x7fb2f00fbe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:31.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:31.349+0000 7fb2f5f8f640 1 -- 172.21.15.87:0/277190149 >> 172.21.15.87:0/277190149 conn(0x7fb2f0070ce0 msgr2=0x7fb2f0105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:16:31.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:31.350+0000 7fb2f5f8f640 1 -- 172.21.15.87:0/277190149 shutdown_connections 2024-09-17T07:16:31.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:31.350+0000 7fb2f5f8f640 1 -- 172.21.15.87:0/277190149 wait complete. 2024-09-17T07:16:31.951 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:16:31 smithi087 ceph-mon[27636]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T07:16:31.976 INFO:teuthology.orchestra.run.smithi087.stdout:111669149716 2024-09-17T07:16:31.977 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-17T07:16:32.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:16:31 smithi139 ceph-mon[34403]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T07:16:32.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:32.180+0000 7f37aaaa7640 1 -- 172.21.15.87:0/2746226832 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f37a4070360 msgr2=0x7f37a41088d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:32.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:32.180+0000 7f37aaaa7640 1 --2- 172.21.15.87:0/2746226832 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f37a4070360 0x7f37a41088d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f37900048d0 tx=0x7f3790009da0 comp rx=0 tx=0).stop 2024-09-17T07:16:32.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:32.180+0000 7f37aaaa7640 1 -- 172.21.15.87:0/2746226832 shutdown_connections 2024-09-17T07:16:32.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:32.180+0000 7f37aaaa7640 1 --2- 172.21.15.87:0/2746226832 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f37a4070360 0x7f37a41088d0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:32.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:32.180+0000 7f37aaaa7640 1 --2- 172.21.15.87:0/2746226832 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f37a406fa50 0x7f37a406fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:32.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:32.180+0000 7f37aaaa7640 1 -- 172.21.15.87:0/2746226832 >> 172.21.15.87:0/2746226832 conn(0x7f37a40f80f0 msgr2=0x7f37a40fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:16:32.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:32.180+0000 7f37aaaa7640 1 -- 172.21.15.87:0/2746226832 shutdown_connections 2024-09-17T07:16:32.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:32.180+0000 7f37aaaa7640 1 -- 172.21.15.87:0/2746226832 wait complete. 2024-09-17T07:16:32.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:32.180+0000 7f37aaaa7640 1 Processor -- start 2024-09-17T07:16:32.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:32.180+0000 7f37aaaa7640 1 -- start start 2024-09-17T07:16:32.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:32.181+0000 7f37aaaa7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f37a406fa50 0x7f37a41153c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:16:32.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:32.181+0000 7f37aaaa7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f37a4070360 0x7f37a4115900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:16:32.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:32.181+0000 7f37aaaa7640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a4115f90 con 0x7f37a406fa50 2024-09-17T07:16:32.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:32.181+0000 7f37aaaa7640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a410f340 con 0x7f37a4070360 2024-09-17T07:16:32.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:32.181+0000 7f37a8843640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f37a406fa50 0x7f37a41153c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:16:32.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:32.181+0000 7f37a8843640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f37a406fa50 0x7f37a41153c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:43136/0 (socket says 172.21.15.87:43136) 2024-09-17T07:16:32.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:32.181+0000 7f37a8843640 1 -- 172.21.15.87:0/4133408087 learned_addr learned my addr 172.21.15.87:0/4133408087 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:16:32.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:32.181+0000 7f37a3fff640 1 --2- 172.21.15.87:0/4133408087 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f37a4070360 0x7f37a4115900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:16:32.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:32.181+0000 7f37a8843640 1 -- 172.21.15.87:0/4133408087 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f37a4070360 msgr2=0x7f37a4115900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:32.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:32.181+0000 7f37a8843640 1 --2- 172.21.15.87:0/4133408087 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f37a4070360 0x7f37a4115900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:32.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:32.181+0000 7f37a8843640 1 -- 172.21.15.87:0/4133408087 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3790005040 con 0x7f37a406fa50 2024-09-17T07:16:32.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:32.181+0000 7f37a3fff640 1 --2- 172.21.15.87:0/4133408087 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f37a4070360 0x7f37a4115900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T07:16:32.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:32.181+0000 7f37a8843640 1 --2- 172.21.15.87:0/4133408087 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f37a406fa50 0x7f37a41153c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f379800b790 tx=0x7f37980091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:16:32.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:32.181+0000 7f37a17fa640 1 -- 172.21.15.87:0/4133408087 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f379800c700 con 0x7f37a406fa50 2024-09-17T07:16:32.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:32.181+0000 7f37a17fa640 1 -- 172.21.15.87:0/4133408087 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f379800cce0 con 0x7f37a406fa50 2024-09-17T07:16:32.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:32.181+0000 7f37aaaa7640 1 -- 172.21.15.87:0/4133408087 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37a410f620 con 0x7f37a406fa50 2024-09-17T07:16:32.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:32.181+0000 7f37a17fa640 1 -- 172.21.15.87:0/4133408087 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3798015e10 con 0x7f37a406fa50 2024-09-17T07:16:32.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:32.181+0000 7f37aaaa7640 1 -- 172.21.15.87:0/4133408087 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37a410fb40 con 0x7f37a406fa50 2024-09-17T07:16:32.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:32.182+0000 7f37aaaa7640 1 -- 172.21.15.87:0/4133408087 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f37a4110080 con 0x7f37a406fa50 2024-09-17T07:16:32.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:32.183+0000 7f37a17fa640 1 -- 172.21.15.87:0/4133408087 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f3798012070 con 0x7f37a406fa50 2024-09-17T07:16:32.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:32.183+0000 7f37a17fa640 1 --2- 172.21.15.87:0/4133408087 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f379406ed60 0x7f3794071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:16:32.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:32.183+0000 7f37a17fa640 1 -- 172.21.15.87:0/4133408087 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f379808da00 con 0x7f37a406fa50 2024-09-17T07:16:32.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:32.183+0000 7f37a3fff640 1 --2- 172.21.15.87:0/4133408087 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f379406ed60 0x7f3794071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:16:32.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:32.183+0000 7f37a17fa640 1 --2- 172.21.15.87:0/4133408087 >> [v2:172.21.15.87:6818/2282787545,v1:172.21.15.87:6819/2282787545] conn(0x7f3794074b30 0x7f3794076f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:16:32.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:32.183+0000 7f37a17fa640 1 -- 172.21.15.87:0/4133408087 --> [v2:172.21.15.87:6818/2282787545,v1:172.21.15.87:6819/2282787545] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f37940775f0 con 0x7f3794074b30 2024-09-17T07:16:32.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:32.183+0000 7f37a17fa640 1 -- 172.21.15.87:0/4133408087 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3798092220 con 0x7f37a406fa50 2024-09-17T07:16:32.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:32.184+0000 7f37a9044640 1 --2- 172.21.15.87:0/4133408087 >> [v2:172.21.15.87:6818/2282787545,v1:172.21.15.87:6819/2282787545] conn(0x7f3794074b30 0x7f3794076f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:16:32.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:32.184+0000 7f37a3fff640 1 --2- 172.21.15.87:0/4133408087 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f379406ed60 0x7f3794071210 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f37900043d0 tx=0x7f3790009da0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:16:32.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:32.184+0000 7f37a9044640 1 --2- 172.21.15.87:0/4133408087 >> [v2:172.21.15.87:6818/2282787545,v1:172.21.15.87:6819/2282787545] conn(0x7f3794074b30 0x7f3794076f40 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:16:32.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:32.184+0000 7f37a17fa640 1 -- 172.21.15.87:0/4133408087 <== osd.2 v2:172.21.15.87:6818/2282787545 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f37940775f0 con 0x7f3794074b30 2024-09-17T07:16:32.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:32.197+0000 7f37aaaa7640 1 -- 172.21.15.87:0/4133408087 --> [v2:172.21.15.87:6818/2282787545,v1:172.21.15.87:6819/2282787545] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f37a4071190 con 0x7f3794074b30 2024-09-17T07:16:32.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:32.197+0000 7f37a17fa640 1 -- 172.21.15.87:0/4133408087 <== osd.2 v2:172.21.15.87:6818/2282787545 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f37a4071190 con 0x7f3794074b30 2024-09-17T07:16:32.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:32.197+0000 7f37aaaa7640 1 -- 172.21.15.87:0/4133408087 >> [v2:172.21.15.87:6818/2282787545,v1:172.21.15.87:6819/2282787545] conn(0x7f3794074b30 msgr2=0x7f3794076f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:32.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:32.197+0000 7f37aaaa7640 1 --2- 172.21.15.87:0/4133408087 >> [v2:172.21.15.87:6818/2282787545,v1:172.21.15.87:6819/2282787545] conn(0x7f3794074b30 0x7f3794076f40 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:32.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:32.197+0000 7f37aaaa7640 1 -- 172.21.15.87:0/4133408087 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f379406ed60 msgr2=0x7f3794071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:32.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:32.197+0000 7f37aaaa7640 1 --2- 172.21.15.87:0/4133408087 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f379406ed60 0x7f3794071210 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f37900043d0 tx=0x7f3790009da0 comp rx=0 tx=0).stop 2024-09-17T07:16:32.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:32.197+0000 7f37aaaa7640 1 -- 172.21.15.87:0/4133408087 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f37a406fa50 msgr2=0x7f37a41153c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:32.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:32.197+0000 7f37aaaa7640 1 --2- 172.21.15.87:0/4133408087 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f37a406fa50 0x7f37a41153c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f379800b790 tx=0x7f37980091d0 comp rx=0 tx=0).stop 2024-09-17T07:16:32.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:32.197+0000 7f37aaaa7640 1 -- 172.21.15.87:0/4133408087 shutdown_connections 2024-09-17T07:16:32.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:32.197+0000 7f37aaaa7640 1 --2- 172.21.15.87:0/4133408087 >> [v2:172.21.15.87:6818/2282787545,v1:172.21.15.87:6819/2282787545] conn(0x7f3794074b30 0x7f3794076f40 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:32.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:32.197+0000 7f37aaaa7640 1 --2- 172.21.15.87:0/4133408087 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f379406ed60 0x7f3794071210 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:32.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:32.197+0000 7f37aaaa7640 1 --2- 172.21.15.87:0/4133408087 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f37a4070360 0x7f37a4115900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:32.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:32.197+0000 7f37aaaa7640 1 --2- 172.21.15.87:0/4133408087 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f37a406fa50 0x7f37a41153c0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:32.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:32.197+0000 7f37aaaa7640 1 -- 172.21.15.87:0/4133408087 >> 172.21.15.87:0/4133408087 conn(0x7f37a40f80f0 msgr2=0x7f37a40f9700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:16:32.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:32.197+0000 7f37aaaa7640 1 -- 172.21.15.87:0/4133408087 shutdown_connections 2024-09-17T07:16:32.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:32.197+0000 7f37aaaa7640 1 -- 172.21.15.87:0/4133408087 wait complete. 2024-09-17T07:16:33.023 INFO:teuthology.orchestra.run.smithi087.stdout:38654705699 2024-09-17T07:16:33.024 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-17T07:16:33.073 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/mon.smithi087/config 2024-09-17T07:16:33.073 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/mon.smithi087/config 2024-09-17T07:16:33.074 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/mon.smithi087/config 2024-09-17T07:16:33.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:16:33 smithi087 ceph-mon[27636]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T07:16:34.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:16:33 smithi139 ceph-mon[34403]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T07:16:34.750 INFO:teuthology.orchestra.run.smithi087.stdout:81604378648 2024-09-17T07:16:34.750 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-17T07:16:34.753 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/mon.smithi087/config 2024-09-17T07:16:36.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:16:35 smithi139 ceph-mon[34403]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T07:16:36.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:16:35 smithi087 ceph-mon[27636]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T07:16:36.884 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:16:36 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:16:37.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:16:36 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:16:37.128 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/mon.smithi087/config 2024-09-17T07:16:37.894 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:16:37 smithi087 ceph-mon[27636]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T07:16:38.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:16:37 smithi139 ceph-mon[34403]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T07:16:39.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.249+0000 7fad040f1640 1 -- 172.21.15.87:0/91038499 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7facfc0fe450 msgr2=0x7facfc0fe820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:39.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.249+0000 7fad040f1640 1 --2- 172.21.15.87:0/91038499 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7facfc0fe450 0x7facfc0fe820 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7facf80048d0 tx=0x7facf8009da0 comp rx=0 tx=0).stop 2024-09-17T07:16:39.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.249+0000 7fad040f1640 1 -- 172.21.15.87:0/91038499 shutdown_connections 2024-09-17T07:16:39.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.249+0000 7fad040f1640 1 --2- 172.21.15.87:0/91038499 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7facfc064fe0 0x7facfc065430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:39.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.249+0000 7fad040f1640 1 --2- 172.21.15.87:0/91038499 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7facfc0fe450 0x7facfc0fe820 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:39.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.249+0000 7fad040f1640 1 -- 172.21.15.87:0/91038499 >> 172.21.15.87:0/91038499 conn(0x7facfc0723b0 msgr2=0x7facfc0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:16:39.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.249+0000 7fad040f1640 1 -- 172.21.15.87:0/91038499 shutdown_connections 2024-09-17T07:16:39.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.249+0000 7fad040f1640 1 -- 172.21.15.87:0/91038499 wait complete. 2024-09-17T07:16:39.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.249+0000 7fad040f1640 1 Processor -- start 2024-09-17T07:16:39.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.249+0000 7fad040f1640 1 -- start start 2024-09-17T07:16:39.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.250+0000 7fad040f1640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7facfc064fe0 0x7facfc0fb560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:16:39.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.250+0000 7fad040f1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7facfc0fe450 0x7facfc0fbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:16:39.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.250+0000 7fad040f1640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facfc0fbfe0 con 0x7facfc0fe450 2024-09-17T07:16:39.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.250+0000 7fad040f1640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facfc0fc150 con 0x7facfc064fe0 2024-09-17T07:16:39.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.250+0000 7fad0168c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7facfc0fe450 0x7facfc0fbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:16:39.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.250+0000 7fad0168c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7facfc0fe450 0x7facfc0fbaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46678/0 (socket says 172.21.15.87:46678) 2024-09-17T07:16:39.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.250+0000 7fad0168c640 1 -- 172.21.15.87:0/1221057724 learned_addr learned my addr 172.21.15.87:0/1221057724 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:16:39.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.250+0000 7fad01e8d640 1 --2- 172.21.15.87:0/1221057724 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7facfc064fe0 0x7facfc0fb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:16:39.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.250+0000 7fad0168c640 1 -- 172.21.15.87:0/1221057724 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7facfc064fe0 msgr2=0x7facfc0fb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:39.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.250+0000 7fad0168c640 1 --2- 172.21.15.87:0/1221057724 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7facfc064fe0 0x7facfc0fb560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:39.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.250+0000 7fad0168c640 1 -- 172.21.15.87:0/1221057724 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facf8005040 con 0x7facfc0fe450 2024-09-17T07:16:39.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.250+0000 7fad0168c640 1 --2- 172.21.15.87:0/1221057724 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7facfc0fe450 0x7facfc0fbaa0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7facec00c830 tx=0x7facec004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:16:39.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.250+0000 7facf27fc640 1 -- 172.21.15.87:0/1221057724 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7facec00a850 con 0x7facfc0fe450 2024-09-17T07:16:39.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.250+0000 7facf27fc640 1 -- 172.21.15.87:0/1221057724 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7facec00ae30 con 0x7facfc0fe450 2024-09-17T07:16:39.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.250+0000 7fad040f1640 1 -- 172.21.15.87:0/1221057724 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facfc119450 con 0x7facfc0fe450 2024-09-17T07:16:39.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.250+0000 7facf27fc640 1 -- 172.21.15.87:0/1221057724 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7facec0113a0 con 0x7facfc0fe450 2024-09-17T07:16:39.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.250+0000 7fad040f1640 1 -- 172.21.15.87:0/1221057724 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facfc119850 con 0x7facfc0fe450 2024-09-17T07:16:39.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.251+0000 7fad040f1640 1 -- 172.21.15.87:0/1221057724 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facfc0fdce0 con 0x7facfc0fe450 2024-09-17T07:16:39.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.252+0000 7facf27fc640 1 -- 172.21.15.87:0/1221057724 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7facec012400 con 0x7facfc0fe450 2024-09-17T07:16:39.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.252+0000 7facf27fc640 1 --2- 172.21.15.87:0/1221057724 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7face806ed60 0x7face8071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:16:39.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.253+0000 7facf27fc640 1 -- 172.21.15.87:0/1221057724 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7facec08e0a0 con 0x7facfc0fe450 2024-09-17T07:16:39.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.253+0000 7fad01e8d640 1 --2- 172.21.15.87:0/1221057724 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7face806ed60 0x7face8071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:16:39.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.253+0000 7fad01e8d640 1 --2- 172.21.15.87:0/1221057724 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7face806ed60 0x7face8071210 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7facf8009ac0 tx=0x7facf8035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:16:39.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.257+0000 7facf27fc640 1 -- 172.21.15.87:0/1221057724 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7facec05b5e0 con 0x7facfc0fe450 2024-09-17T07:16:39.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.418+0000 7fad040f1640 1 -- 172.21.15.87:0/1221057724 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7facfc072ec0 con 0x7facfc0fe450 2024-09-17T07:16:39.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.418+0000 7facf27fc640 1 -- 172.21.15.87:0/1221057724 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7facec05af80 con 0x7facfc0fe450 2024-09-17T07:16:39.418 INFO:teuthology.orchestra.run.smithi087.stdout:60129542176 2024-09-17T07:16:39.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.420+0000 7fad040f1640 1 -- 172.21.15.87:0/1221057724 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7face806ed60 msgr2=0x7face8071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:39.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.420+0000 7fad040f1640 1 --2- 172.21.15.87:0/1221057724 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7face806ed60 0x7face8071210 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7facf8009ac0 tx=0x7facf8035040 comp rx=0 tx=0).stop 2024-09-17T07:16:39.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.420+0000 7fad040f1640 1 -- 172.21.15.87:0/1221057724 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7facfc0fe450 msgr2=0x7facfc0fbaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:39.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.420+0000 7fad040f1640 1 --2- 172.21.15.87:0/1221057724 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7facfc0fe450 0x7facfc0fbaa0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7facec00c830 tx=0x7facec004430 comp rx=0 tx=0).stop 2024-09-17T07:16:39.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.420+0000 7fad040f1640 1 -- 172.21.15.87:0/1221057724 shutdown_connections 2024-09-17T07:16:39.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.420+0000 7fad040f1640 1 --2- 172.21.15.87:0/1221057724 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7facfc0fe450 0x7facfc0fbaa0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:39.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.420+0000 7fad040f1640 1 --2- 172.21.15.87:0/1221057724 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7face806ed60 0x7face8071210 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:39.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.420+0000 7fad040f1640 1 --2- 172.21.15.87:0/1221057724 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7facfc064fe0 0x7facfc0fb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:39.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.420+0000 7fad040f1640 1 -- 172.21.15.87:0/1221057724 >> 172.21.15.87:0/1221057724 conn(0x7facfc0723b0 msgr2=0x7facfc0fa350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:16:39.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.420+0000 7fad040f1640 1 -- 172.21.15.87:0/1221057724 shutdown_connections 2024-09-17T07:16:39.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.420+0000 7fad040f1640 1 -- 172.21.15.87:0/1221057724 wait complete. 2024-09-17T07:16:39.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.824+0000 7fe738d5b640 1 -- 172.21.15.87:0/2071857367 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7341014f0 msgr2=0x7fe7341018c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:39.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.824+0000 7fe738d5b640 1 --2- 172.21.15.87:0/2071857367 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7341014f0 0x7fe7341018c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe72c0048d0 tx=0x7fe72c009da0 comp rx=0 tx=0).stop 2024-09-17T07:16:39.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.824+0000 7fe738d5b640 1 -- 172.21.15.87:0/2071857367 shutdown_connections 2024-09-17T07:16:39.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.824+0000 7fe738d5b640 1 --2- 172.21.15.87:0/2071857367 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe7340fb4b0 0x7fe7340fb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:39.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.824+0000 7fe738d5b640 1 --2- 172.21.15.87:0/2071857367 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7341014f0 0x7fe7341018c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:39.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.824+0000 7fe738d5b640 1 -- 172.21.15.87:0/2071857367 >> 172.21.15.87:0/2071857367 conn(0x7fe7340f7090 msgr2=0x7fe7340f94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:16:39.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.824+0000 7fe738d5b640 1 -- 172.21.15.87:0/2071857367 shutdown_connections 2024-09-17T07:16:39.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.824+0000 7fe738d5b640 1 -- 172.21.15.87:0/2071857367 wait complete. 2024-09-17T07:16:39.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.825+0000 7fe738d5b640 1 Processor -- start 2024-09-17T07:16:39.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.825+0000 7fe738d5b640 1 -- start start 2024-09-17T07:16:39.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.825+0000 7fe738d5b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe7340fb4b0 0x7fe73410e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:16:39.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.825+0000 7fe738d5b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7341014f0 0x7fe73410e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:16:39.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.825+0000 7fe738d5b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe73410ece0 con 0x7fe7341014f0 2024-09-17T07:16:39.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.825+0000 7fe738d5b640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe73410ee50 con 0x7fe7340fb4b0 2024-09-17T07:16:39.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.825+0000 7fe731d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7341014f0 0x7fe73410e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:16:39.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.825+0000 7fe731d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7341014f0 0x7fe73410e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46690/0 (socket says 172.21.15.87:46690) 2024-09-17T07:16:39.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.825+0000 7fe731d9b640 1 -- 172.21.15.87:0/2244015082 learned_addr learned my addr 172.21.15.87:0/2244015082 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:16:39.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.825+0000 7fe73259c640 1 --2- 172.21.15.87:0/2244015082 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe7340fb4b0 0x7fe73410e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:16:39.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.825+0000 7fe731d9b640 1 -- 172.21.15.87:0/2244015082 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe7340fb4b0 msgr2=0x7fe73410e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:39.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.825+0000 7fe731d9b640 1 --2- 172.21.15.87:0/2244015082 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe7340fb4b0 0x7fe73410e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:39.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.825+0000 7fe731d9b640 1 -- 172.21.15.87:0/2244015082 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe72c005040 con 0x7fe7341014f0 2024-09-17T07:16:39.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.825+0000 7fe731d9b640 1 --2- 172.21.15.87:0/2244015082 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7341014f0 0x7fe73410e650 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe72800b790 tx=0x7fe7280091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:16:39.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.825+0000 7fe722ffd640 1 -- 172.21.15.87:0/2244015082 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe72800c700 con 0x7fe7341014f0 2024-09-17T07:16:39.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.826+0000 7fe722ffd640 1 -- 172.21.15.87:0/2244015082 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fe72800cce0 con 0x7fe7341014f0 2024-09-17T07:16:39.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.826+0000 7fe722ffd640 1 -- 172.21.15.87:0/2244015082 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe728015e10 con 0x7fe7341014f0 2024-09-17T07:16:39.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.826+0000 7fe738d5b640 1 -- 172.21.15.87:0/2244015082 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7341171e0 con 0x7fe7341014f0 2024-09-17T07:16:39.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.826+0000 7fe738d5b640 1 -- 172.21.15.87:0/2244015082 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe734117680 con 0x7fe7341014f0 2024-09-17T07:16:39.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.827+0000 7fe738d5b640 1 -- 172.21.15.87:0/2244015082 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7340fcbf0 con 0x7fe7341014f0 2024-09-17T07:16:39.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.827+0000 7fe722ffd640 1 -- 172.21.15.87:0/2244015082 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fe728012070 con 0x7fe7341014f0 2024-09-17T07:16:39.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.828+0000 7fe722ffd640 1 --2- 172.21.15.87:0/2244015082 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fe71c06ed60 0x7fe71c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:16:39.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.828+0000 7fe722ffd640 1 -- 172.21.15.87:0/2244015082 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fe72808d9e0 con 0x7fe7341014f0 2024-09-17T07:16:39.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.828+0000 7fe73259c640 1 --2- 172.21.15.87:0/2244015082 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fe71c06ed60 0x7fe71c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:16:39.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.828+0000 7fe73259c640 1 --2- 172.21.15.87:0/2244015082 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fe71c06ed60 0x7fe71c071210 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe72c009ac0 tx=0x7fe72c035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:16:39.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.832+0000 7fe722ffd640 1 -- 172.21.15.87:0/2244015082 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fe72805ae40 con 0x7fe7341014f0 2024-09-17T07:16:39.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.991+0000 7fe738d5b640 1 -- 172.21.15.87:0/2244015082 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe734108410 con 0x7fe7341014f0 2024-09-17T07:16:39.992 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:16:39 smithi087 ceph-mon[27636]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T07:16:39.992 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:16:39 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/1221057724' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-17T07:16:39.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.992+0000 7fe722ffd640 1 -- 172.21.15.87:0/2244015082 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe72805a7e0 con 0x7fe7341014f0 2024-09-17T07:16:39.993 INFO:teuthology.orchestra.run.smithi087.stdout:111669149717 2024-09-17T07:16:39.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.994+0000 7fe738d5b640 1 -- 172.21.15.87:0/2244015082 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fe71c06ed60 msgr2=0x7fe71c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:39.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.994+0000 7fe738d5b640 1 --2- 172.21.15.87:0/2244015082 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fe71c06ed60 0x7fe71c071210 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe72c009ac0 tx=0x7fe72c035040 comp rx=0 tx=0).stop 2024-09-17T07:16:39.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.994+0000 7fe738d5b640 1 -- 172.21.15.87:0/2244015082 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7341014f0 msgr2=0x7fe73410e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:39.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.994+0000 7fe738d5b640 1 --2- 172.21.15.87:0/2244015082 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7341014f0 0x7fe73410e650 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe72800b790 tx=0x7fe7280091d0 comp rx=0 tx=0).stop 2024-09-17T07:16:39.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.994+0000 7fe738d5b640 1 -- 172.21.15.87:0/2244015082 shutdown_connections 2024-09-17T07:16:39.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.994+0000 7fe738d5b640 1 --2- 172.21.15.87:0/2244015082 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7341014f0 0x7fe73410e650 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:39.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.994+0000 7fe738d5b640 1 --2- 172.21.15.87:0/2244015082 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fe71c06ed60 0x7fe71c071210 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:39.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.994+0000 7fe738d5b640 1 --2- 172.21.15.87:0/2244015082 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe7340fb4b0 0x7fe73410e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:39.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.994+0000 7fe738d5b640 1 -- 172.21.15.87:0/2244015082 >> 172.21.15.87:0/2244015082 conn(0x7fe7340f7090 msgr2=0x7fe7340f8aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:16:39.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.994+0000 7fe738d5b640 1 -- 172.21.15.87:0/2244015082 shutdown_connections 2024-09-17T07:16:39.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:39.994+0000 7fe738d5b640 1 -- 172.21.15.87:0/2244015082 wait complete. 2024-09-17T07:16:40.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:16:39 smithi139 ceph-mon[34403]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T07:16:40.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:16:39 smithi139 ceph-mon[34403]: from='client.? 172.21.15.87:0/1221057724' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-17T07:16:40.753 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149716 got 111669149717 for osd.3 2024-09-17T07:16:40.753 DEBUG:teuthology.parallel:result is None 2024-09-17T07:16:40.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:40.906+0000 7f8e13673640 1 -- 172.21.15.87:0/98119010 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e0c1014b0 msgr2=0x7f8e0c101880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:40.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:40.906+0000 7f8e13673640 1 --2- 172.21.15.87:0/98119010 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e0c1014b0 0x7f8e0c101880 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8e080048d0 tx=0x7f8e08009da0 comp rx=0 tx=0).stop 2024-09-17T07:16:40.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:40.906+0000 7f8e13673640 1 -- 172.21.15.87:0/98119010 shutdown_connections 2024-09-17T07:16:40.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:40.906+0000 7f8e13673640 1 --2- 172.21.15.87:0/98119010 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8e0c0fb470 0x7f8e0c0fb8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:40.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:40.906+0000 7f8e13673640 1 --2- 172.21.15.87:0/98119010 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e0c1014b0 0x7f8e0c101880 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:40.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:40.906+0000 7f8e13673640 1 -- 172.21.15.87:0/98119010 >> 172.21.15.87:0/98119010 conn(0x7f8e0c0f6ff0 msgr2=0x7f8e0c0f9400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:16:40.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:40.906+0000 7f8e13673640 1 -- 172.21.15.87:0/98119010 shutdown_connections 2024-09-17T07:16:40.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:40.906+0000 7f8e13673640 1 -- 172.21.15.87:0/98119010 wait complete. 2024-09-17T07:16:40.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:40.906+0000 7f8e13673640 1 Processor -- start 2024-09-17T07:16:40.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:40.906+0000 7f8e13673640 1 -- start start 2024-09-17T07:16:40.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:40.906+0000 7f8e13673640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e0c0fb470 0x7f8e0c111fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:16:40.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:40.907+0000 7f8e13673640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8e0c1014b0 0x7f8e0c112510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:16:40.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:40.907+0000 7f8e13673640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e0c112b10 con 0x7f8e0c0fb470 2024-09-17T07:16:40.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:40.907+0000 7f8e13673640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e0c10bf50 con 0x7f8e0c1014b0 2024-09-17T07:16:40.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:40.907+0000 7f8e1140f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e0c0fb470 0x7f8e0c111fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:16:40.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:40.907+0000 7f8e1140f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e0c0fb470 0x7f8e0c111fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46712/0 (socket says 172.21.15.87:46712) 2024-09-17T07:16:40.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:40.907+0000 7f8e1140f640 1 -- 172.21.15.87:0/1306646023 learned_addr learned my addr 172.21.15.87:0/1306646023 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:16:40.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:40.907+0000 7f8e10c0e640 1 --2- 172.21.15.87:0/1306646023 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8e0c1014b0 0x7f8e0c112510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:16:40.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:40.907+0000 7f8e1140f640 1 -- 172.21.15.87:0/1306646023 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8e0c1014b0 msgr2=0x7f8e0c112510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:40.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:40.907+0000 7f8e1140f640 1 --2- 172.21.15.87:0/1306646023 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8e0c1014b0 0x7f8e0c112510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:40.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:40.907+0000 7f8e1140f640 1 -- 172.21.15.87:0/1306646023 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e08005040 con 0x7f8e0c0fb470 2024-09-17T07:16:40.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:40.907+0000 7f8e1140f640 1 --2- 172.21.15.87:0/1306646023 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e0c0fb470 0x7f8e0c111fd0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8e08004930 tx=0x7f8e08009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:16:40.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:40.907+0000 7f8e01ffb640 1 -- 172.21.15.87:0/1306646023 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e08038070 con 0x7f8e0c0fb470 2024-09-17T07:16:40.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:40.907+0000 7f8e01ffb640 1 -- 172.21.15.87:0/1306646023 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f8e0802ade0 con 0x7f8e0c0fb470 2024-09-17T07:16:40.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:40.907+0000 7f8e13673640 1 -- 172.21.15.87:0/1306646023 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e0c10c1d0 con 0x7f8e0c0fb470 2024-09-17T07:16:40.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:40.907+0000 7f8e01ffb640 1 -- 172.21.15.87:0/1306646023 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e0802c770 con 0x7f8e0c0fb470 2024-09-17T07:16:40.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:40.908+0000 7f8e13673640 1 -- 172.21.15.87:0/1306646023 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e0c10c710 con 0x7f8e0c0fb470 2024-09-17T07:16:40.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:40.908+0000 7f8e13673640 1 -- 172.21.15.87:0/1306646023 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e0c0fcbb0 con 0x7f8e0c0fb470 2024-09-17T07:16:40.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:40.909+0000 7f8e01ffb640 1 -- 172.21.15.87:0/1306646023 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f8e08030020 con 0x7f8e0c0fb470 2024-09-17T07:16:40.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:40.909+0000 7f8e01ffb640 1 --2- 172.21.15.87:0/1306646023 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f8df806ed60 0x7f8df8071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:16:40.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:40.910+0000 7f8e10c0e640 1 --2- 172.21.15.87:0/1306646023 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f8df806ed60 0x7f8df8071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:16:40.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:40.910+0000 7f8e01ffb640 1 -- 172.21.15.87:0/1306646023 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f8e080ae1c0 con 0x7f8e0c0fb470 2024-09-17T07:16:40.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:40.910+0000 7f8e10c0e640 1 --2- 172.21.15.87:0/1306646023 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f8df806ed60 0x7f8df8071210 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c10d890 tx=0x7f8dfc00b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:16:40.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:40.915+0000 7f8e01ffb640 1 -- 172.21.15.87:0/1306646023 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f8e0807b6a0 con 0x7f8e0c0fb470 2024-09-17T07:16:40.919 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/mon.smithi087/config 2024-09-17T07:16:41.017 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:16:40 smithi139 ceph-mon[34403]: from='client.? 172.21.15.87:0/2244015082' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-17T07:16:41.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:41.075+0000 7f8e13673640 1 -- 172.21.15.87:0/1306646023 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f8e0c0fac30 con 0x7f8e0c0fb470 2024-09-17T07:16:41.076 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:16:40 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/2244015082' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-17T07:16:41.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:41.076+0000 7f8e01ffb640 1 -- 172.21.15.87:0/1306646023 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8e0807b040 con 0x7f8e0c0fb470 2024-09-17T07:16:41.076 INFO:teuthology.orchestra.run.smithi087.stdout:137438953488 2024-09-17T07:16:41.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:41.078+0000 7f8e13673640 1 -- 172.21.15.87:0/1306646023 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f8df806ed60 msgr2=0x7f8df8071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:41.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:41.078+0000 7f8e13673640 1 --2- 172.21.15.87:0/1306646023 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f8df806ed60 0x7f8df8071210 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c10d890 tx=0x7f8dfc00b040 comp rx=0 tx=0).stop 2024-09-17T07:16:41.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:41.078+0000 7f8e13673640 1 -- 172.21.15.87:0/1306646023 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e0c0fb470 msgr2=0x7f8e0c111fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:41.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:41.078+0000 7f8e13673640 1 --2- 172.21.15.87:0/1306646023 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e0c0fb470 0x7f8e0c111fd0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8e08004930 tx=0x7f8e08009da0 comp rx=0 tx=0).stop 2024-09-17T07:16:41.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:41.078+0000 7f8e13673640 1 -- 172.21.15.87:0/1306646023 shutdown_connections 2024-09-17T07:16:41.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:41.078+0000 7f8e13673640 1 --2- 172.21.15.87:0/1306646023 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f8df806ed60 0x7f8df8071210 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:41.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:41.078+0000 7f8e13673640 1 --2- 172.21.15.87:0/1306646023 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8e0c1014b0 0x7f8e0c112510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:41.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:41.078+0000 7f8e13673640 1 --2- 172.21.15.87:0/1306646023 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e0c0fb470 0x7f8e0c111fd0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:41.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:41.078+0000 7f8e13673640 1 -- 172.21.15.87:0/1306646023 >> 172.21.15.87:0/1306646023 conn(0x7f8e0c0f6ff0 msgr2=0x7f8e0c0f89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:16:41.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:41.078+0000 7f8e13673640 1 -- 172.21.15.87:0/1306646023 shutdown_connections 2024-09-17T07:16:41.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:41.078+0000 7f8e13673640 1 -- 172.21.15.87:0/1306646023 wait complete. 2024-09-17T07:16:41.862 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:16:41 smithi087 ceph-mon[27636]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T07:16:41.862 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:16:41 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/1306646023' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-17T07:16:42.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:16:41 smithi139 ceph-mon[34403]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T07:16:42.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:16:41 smithi139 ceph-mon[34403]: from='client.? 172.21.15.87:0/1306646023' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-17T07:16:42.534 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542173 got 60129542176 for osd.1 2024-09-17T07:16:42.534 DEBUG:teuthology.parallel:result is None 2024-09-17T07:16:42.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:42.906+0000 7fa7db953640 1 -- 172.21.15.87:0/3105956959 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7d4102550 msgr2=0x7fa7d4102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:42.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:42.906+0000 7fa7db953640 1 --2- 172.21.15.87:0/3105956959 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7d4102550 0x7fa7d4102920 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa7d00048d0 tx=0x7fa7d0009da0 comp rx=0 tx=0).stop 2024-09-17T07:16:42.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:42.906+0000 7fa7db953640 1 -- 172.21.15.87:0/3105956959 shutdown_connections 2024-09-17T07:16:42.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:42.906+0000 7fa7db953640 1 --2- 172.21.15.87:0/3105956959 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa7d4102ef0 0x7fa7d40fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:42.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:42.906+0000 7fa7db953640 1 --2- 172.21.15.87:0/3105956959 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7d4102550 0x7fa7d4102920 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:42.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:42.906+0000 7fa7db953640 1 -- 172.21.15.87:0/3105956959 >> 172.21.15.87:0/3105956959 conn(0x7fa7d40f80f0 msgr2=0x7fa7d40fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:16:42.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:42.906+0000 7fa7db953640 1 -- 172.21.15.87:0/3105956959 shutdown_connections 2024-09-17T07:16:42.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:42.906+0000 7fa7db953640 1 -- 172.21.15.87:0/3105956959 wait complete. 2024-09-17T07:16:42.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:42.907+0000 7fa7db953640 1 Processor -- start 2024-09-17T07:16:42.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:42.907+0000 7fa7db953640 1 -- start start 2024-09-17T07:16:42.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:42.907+0000 7fa7db953640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa7d4102550 0x7fa7d4113420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:16:42.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:42.907+0000 7fa7db953640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7d4102ef0 0x7fa7d4113960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:16:42.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:42.907+0000 7fa7db953640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d4113f60 con 0x7fa7d4102ef0 2024-09-17T07:16:42.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:42.907+0000 7fa7db953640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d41140d0 con 0x7fa7d4102550 2024-09-17T07:16:42.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:42.907+0000 7fa7d8eee640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7d4102ef0 0x7fa7d4113960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:16:42.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:42.907+0000 7fa7d8eee640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7d4102ef0 0x7fa7d4113960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46736/0 (socket says 172.21.15.87:46736) 2024-09-17T07:16:42.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:42.907+0000 7fa7d8eee640 1 -- 172.21.15.87:0/3665953301 learned_addr learned my addr 172.21.15.87:0/3665953301 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:16:42.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:42.907+0000 7fa7d96ef640 1 --2- 172.21.15.87:0/3665953301 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa7d4102550 0x7fa7d4113420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:16:42.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:42.907+0000 7fa7d8eee640 1 -- 172.21.15.87:0/3665953301 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa7d4102550 msgr2=0x7fa7d4113420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:42.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:42.907+0000 7fa7d8eee640 1 --2- 172.21.15.87:0/3665953301 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa7d4102550 0x7fa7d4113420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:42.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:42.907+0000 7fa7d8eee640 1 -- 172.21.15.87:0/3665953301 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7d0005040 con 0x7fa7d4102ef0 2024-09-17T07:16:42.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:42.907+0000 7fa7d96ef640 1 --2- 172.21.15.87:0/3665953301 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa7d4102550 0x7fa7d4113420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T07:16:42.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:42.907+0000 7fa7d8eee640 1 --2- 172.21.15.87:0/3665953301 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7d4102ef0 0x7fa7d4113960 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa7c800c740 tx=0x7fa7c80043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:16:42.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:42.908+0000 7fa7c5ffb640 1 -- 172.21.15.87:0/3665953301 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7c8012810 con 0x7fa7d4102ef0 2024-09-17T07:16:42.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:42.908+0000 7fa7c5ffb640 1 -- 172.21.15.87:0/3665953301 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fa7c8012df0 con 0x7fa7d4102ef0 2024-09-17T07:16:42.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:42.908+0000 7fa7c5ffb640 1 -- 172.21.15.87:0/3665953301 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7c8011e70 con 0x7fa7d4102ef0 2024-09-17T07:16:42.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:42.908+0000 7fa7db953640 1 -- 172.21.15.87:0/3665953301 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7d410d550 con 0x7fa7d4102ef0 2024-09-17T07:16:42.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:42.908+0000 7fa7db953640 1 -- 172.21.15.87:0/3665953301 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7d410daf0 con 0x7fa7d4102ef0 2024-09-17T07:16:42.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:42.909+0000 7fa7db953640 1 -- 172.21.15.87:0/3665953301 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7d40fdcd0 con 0x7fa7d4102ef0 2024-09-17T07:16:42.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:42.909+0000 7fa7c5ffb640 1 -- 172.21.15.87:0/3665953301 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fa7c8012970 con 0x7fa7d4102ef0 2024-09-17T07:16:42.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:42.910+0000 7fa7c5ffb640 1 --2- 172.21.15.87:0/3665953301 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fa7c006ed60 0x7fa7c0071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:16:42.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:42.910+0000 7fa7d96ef640 1 --2- 172.21.15.87:0/3665953301 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fa7c006ed60 0x7fa7c0071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:16:42.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:42.910+0000 7fa7c5ffb640 1 -- 172.21.15.87:0/3665953301 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fa7c808e2f0 con 0x7fa7d4102ef0 2024-09-17T07:16:42.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:42.910+0000 7fa7d96ef640 1 --2- 172.21.15.87:0/3665953301 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fa7c006ed60 0x7fa7c0071210 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa7d0007ac0 tx=0x7fa7d0035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:16:42.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:42.914+0000 7fa7c5ffb640 1 -- 172.21.15.87:0/3665953301 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fa7c805b7d0 con 0x7fa7d4102ef0 2024-09-17T07:16:43.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:43.071+0000 7fa7db953640 1 -- 172.21.15.87:0/3665953301 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fa7d40fbd50 con 0x7fa7d4102ef0 2024-09-17T07:16:43.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:43.072+0000 7fa7c5ffb640 1 -- 172.21.15.87:0/3665953301 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa7c8016020 con 0x7fa7d4102ef0 2024-09-17T07:16:43.072 INFO:teuthology.orchestra.run.smithi087.stdout:158913789963 2024-09-17T07:16:43.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:43.073+0000 7fa7db953640 1 -- 172.21.15.87:0/3665953301 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fa7c006ed60 msgr2=0x7fa7c0071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:43.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:43.073+0000 7fa7db953640 1 --2- 172.21.15.87:0/3665953301 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fa7c006ed60 0x7fa7c0071210 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa7d0007ac0 tx=0x7fa7d0035040 comp rx=0 tx=0).stop 2024-09-17T07:16:43.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:43.074+0000 7fa7db953640 1 -- 172.21.15.87:0/3665953301 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7d4102ef0 msgr2=0x7fa7d4113960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:43.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:43.074+0000 7fa7db953640 1 --2- 172.21.15.87:0/3665953301 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7d4102ef0 0x7fa7d4113960 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa7c800c740 tx=0x7fa7c80043c0 comp rx=0 tx=0).stop 2024-09-17T07:16:43.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:43.074+0000 7fa7db953640 1 -- 172.21.15.87:0/3665953301 shutdown_connections 2024-09-17T07:16:43.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:43.074+0000 7fa7db953640 1 --2- 172.21.15.87:0/3665953301 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7d4102ef0 0x7fa7d4113960 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:43.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:43.074+0000 7fa7db953640 1 --2- 172.21.15.87:0/3665953301 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fa7c006ed60 0x7fa7c0071210 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:43.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:43.074+0000 7fa7db953640 1 --2- 172.21.15.87:0/3665953301 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa7d4102550 0x7fa7d4113420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:43.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:43.074+0000 7fa7db953640 1 -- 172.21.15.87:0/3665953301 >> 172.21.15.87:0/3665953301 conn(0x7fa7d40f80f0 msgr2=0x7fa7d40f9230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:16:43.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:43.074+0000 7fa7db953640 1 -- 172.21.15.87:0/3665953301 shutdown_connections 2024-09-17T07:16:43.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:43.074+0000 7fa7db953640 1 -- 172.21.15.87:0/3665953301 wait complete. 2024-09-17T07:16:43.329 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953484 got 137438953488 for osd.4 2024-09-17T07:16:43.329 DEBUG:teuthology.parallel:result is None 2024-09-17T07:16:43.918 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:16:43 smithi087 ceph-mon[27636]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T07:16:43.918 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:16:43 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/3665953301' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-17T07:16:43.941 INFO:tasks.cephadm.ceph_manager.ceph:need seq 158913789959 got 158913789963 for osd.5 2024-09-17T07:16:43.942 DEBUG:teuthology.parallel:result is None 2024-09-17T07:16:44.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:16:43 smithi139 ceph-mon[34403]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T07:16:44.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:16:43 smithi139 ceph-mon[34403]: from='client.? 172.21.15.87:0/3665953301' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-17T07:16:44.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:44.564+0000 7f8471e72640 1 -- 172.21.15.87:0/2333096756 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f846c102530 msgr2=0x7f846c102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:44.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:44.564+0000 7f8471e72640 1 --2- 172.21.15.87:0/2333096756 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f846c102530 0x7f846c102900 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f845c0048d0 tx=0x7f845c009da0 comp rx=0 tx=0).stop 2024-09-17T07:16:44.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:44.564+0000 7f8471e72640 1 -- 172.21.15.87:0/2333096756 shutdown_connections 2024-09-17T07:16:44.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:44.564+0000 7f8471e72640 1 --2- 172.21.15.87:0/2333096756 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f846c102ed0 0x7f846c0fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:44.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:44.564+0000 7f8471e72640 1 --2- 172.21.15.87:0/2333096756 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f846c102530 0x7f846c102900 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:44.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:44.564+0000 7f8471e72640 1 -- 172.21.15.87:0/2333096756 >> 172.21.15.87:0/2333096756 conn(0x7f846c0f8110 msgr2=0x7f846c0fa520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:16:44.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:44.564+0000 7f8471e72640 1 -- 172.21.15.87:0/2333096756 shutdown_connections 2024-09-17T07:16:44.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:44.564+0000 7f8471e72640 1 -- 172.21.15.87:0/2333096756 wait complete. 2024-09-17T07:16:44.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:44.565+0000 7f8471e72640 1 Processor -- start 2024-09-17T07:16:44.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:44.565+0000 7f8471e72640 1 -- start start 2024-09-17T07:16:44.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:44.565+0000 7f8471e72640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f846c102530 0x7f846c1131c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:16:44.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:44.565+0000 7f8471e72640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f846c102ed0 0x7f846c113700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:16:44.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:44.565+0000 7f8471e72640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f846c113d00 con 0x7f846c102530 2024-09-17T07:16:44.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:44.565+0000 7f8471e72640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f846c10d140 con 0x7f846c102ed0 2024-09-17T07:16:44.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:44.565+0000 7f846b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f846c102530 0x7f846c1131c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:16:44.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:44.565+0000 7f846b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f846c102530 0x7f846c1131c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39618/0 (socket says 172.21.15.87:39618) 2024-09-17T07:16:44.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:44.565+0000 7f846b7fe640 1 -- 172.21.15.87:0/3905538219 learned_addr learned my addr 172.21.15.87:0/3905538219 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:16:44.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:44.566+0000 7f846affd640 1 --2- 172.21.15.87:0/3905538219 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f846c102ed0 0x7f846c113700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:16:44.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:44.566+0000 7f846b7fe640 1 -- 172.21.15.87:0/3905538219 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f846c102ed0 msgr2=0x7f846c113700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:44.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:44.566+0000 7f846b7fe640 1 --2- 172.21.15.87:0/3905538219 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f846c102ed0 0x7f846c113700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:44.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:44.566+0000 7f846b7fe640 1 -- 172.21.15.87:0/3905538219 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f845c005040 con 0x7f846c102530 2024-09-17T07:16:44.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:44.566+0000 7f846affd640 1 --2- 172.21.15.87:0/3905538219 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f846c102ed0 0x7f846c113700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T07:16:44.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:44.566+0000 7f846b7fe640 1 --2- 172.21.15.87:0/3905538219 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f846c102530 0x7f846c1131c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f845c003080 tx=0x7f845c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:16:44.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:44.566+0000 7f8453fff640 1 -- 172.21.15.87:0/3905538219 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f845c038070 con 0x7f846c102530 2024-09-17T07:16:44.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:44.566+0000 7f8453fff640 1 -- 172.21.15.87:0/3905538219 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f845c0097c0 con 0x7f846c102530 2024-09-17T07:16:44.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:44.566+0000 7f8471e72640 1 -- 172.21.15.87:0/3905538219 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f846c10d3c0 con 0x7f846c102530 2024-09-17T07:16:44.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:44.566+0000 7f8453fff640 1 -- 172.21.15.87:0/3905538219 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f845c03d420 con 0x7f846c102530 2024-09-17T07:16:44.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:44.566+0000 7f8471e72640 1 -- 172.21.15.87:0/3905538219 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f846c10d880 con 0x7f846c102530 2024-09-17T07:16:44.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:44.567+0000 7f8471e72640 1 -- 172.21.15.87:0/3905538219 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f846c0fdcb0 con 0x7f846c102530 2024-09-17T07:16:44.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:44.567+0000 7f8453fff640 1 -- 172.21.15.87:0/3905538219 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f845c030020 con 0x7f846c102530 2024-09-17T07:16:44.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:44.568+0000 7f8453fff640 1 --2- 172.21.15.87:0/3905538219 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f845406ed60 0x7f8454071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:16:44.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:44.568+0000 7f8453fff640 1 -- 172.21.15.87:0/3905538219 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f845c0ae3a0 con 0x7f846c102530 2024-09-17T07:16:44.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:44.568+0000 7f846affd640 1 --2- 172.21.15.87:0/3905538219 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f845406ed60 0x7f8454071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:16:44.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:44.568+0000 7f846affd640 1 --2- 172.21.15.87:0/3905538219 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f845406ed60 0x7f8454071210 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f846c10ea80 tx=0x7f8460009040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:16:44.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:44.572+0000 7f8453fff640 1 -- 172.21.15.87:0/3905538219 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f845c07b880 con 0x7f846c102530 2024-09-17T07:16:44.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:44.731+0000 7f8471e72640 1 -- 172.21.15.87:0/3905538219 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f846c0fbd30 con 0x7f846c102530 2024-09-17T07:16:44.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:44.731+0000 7f8453fff640 1 -- 172.21.15.87:0/3905538219 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f845c07b220 con 0x7f846c102530 2024-09-17T07:16:44.732 INFO:teuthology.orchestra.run.smithi087.stdout:38654705702 2024-09-17T07:16:44.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:44.733+0000 7f8471e72640 1 -- 172.21.15.87:0/3905538219 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f845406ed60 msgr2=0x7f8454071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:44.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:44.733+0000 7f8471e72640 1 --2- 172.21.15.87:0/3905538219 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f845406ed60 0x7f8454071210 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f846c10ea80 tx=0x7f8460009040 comp rx=0 tx=0).stop 2024-09-17T07:16:44.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:44.733+0000 7f8471e72640 1 -- 172.21.15.87:0/3905538219 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f846c102530 msgr2=0x7f846c1131c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:44.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:44.733+0000 7f8471e72640 1 --2- 172.21.15.87:0/3905538219 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f846c102530 0x7f846c1131c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f845c003080 tx=0x7f845c009da0 comp rx=0 tx=0).stop 2024-09-17T07:16:44.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:44.733+0000 7f8471e72640 1 -- 172.21.15.87:0/3905538219 shutdown_connections 2024-09-17T07:16:44.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:44.733+0000 7f8471e72640 1 --2- 172.21.15.87:0/3905538219 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f845406ed60 0x7f8454071210 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:44.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:44.733+0000 7f8471e72640 1 --2- 172.21.15.87:0/3905538219 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f846c102ed0 0x7f846c113700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:44.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:44.733+0000 7f8471e72640 1 --2- 172.21.15.87:0/3905538219 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f846c102530 0x7f846c1131c0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:44.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:44.733+0000 7f8471e72640 1 -- 172.21.15.87:0/3905538219 >> 172.21.15.87:0/3905538219 conn(0x7f846c0f8110 msgr2=0x7f846c0f9270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:16:44.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:44.733+0000 7f8471e72640 1 -- 172.21.15.87:0/3905538219 shutdown_connections 2024-09-17T07:16:44.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:44.733+0000 7f8471e72640 1 -- 172.21.15.87:0/3905538219 wait complete. 2024-09-17T07:16:45.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:16:45 smithi087 ceph-mon[27636]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T07:16:45.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:16:45 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/3905538219' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-17T07:16:46.054 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705699 got 38654705702 for osd.0 2024-09-17T07:16:46.055 DEBUG:teuthology.parallel:result is None 2024-09-17T07:16:46.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:16:45 smithi139 ceph-mon[34403]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T07:16:46.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:16:45 smithi139 ceph-mon[34403]: from='client.? 172.21.15.87:0/3905538219' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-17T07:16:46.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:46.233+0000 7fb0980a8640 1 -- 172.21.15.87:0/4257590758 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb090102530 msgr2=0x7fb090102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:46.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:46.233+0000 7fb0980a8640 1 --2- 172.21.15.87:0/4257590758 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb090102530 0x7fb090102900 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb08c0048d0 tx=0x7fb08c009da0 comp rx=0 tx=0).stop 2024-09-17T07:16:46.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:46.233+0000 7fb0980a8640 1 -- 172.21.15.87:0/4257590758 shutdown_connections 2024-09-17T07:16:46.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:46.233+0000 7fb0980a8640 1 --2- 172.21.15.87:0/4257590758 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb090102ed0 0x7fb0900fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:46.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:46.233+0000 7fb0980a8640 1 --2- 172.21.15.87:0/4257590758 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb090102530 0x7fb090102900 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:46.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:46.233+0000 7fb0980a8640 1 -- 172.21.15.87:0/4257590758 >> 172.21.15.87:0/4257590758 conn(0x7fb0900f80f0 msgr2=0x7fb0900fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:16:46.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:46.233+0000 7fb0980a8640 1 -- 172.21.15.87:0/4257590758 shutdown_connections 2024-09-17T07:16:46.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:46.233+0000 7fb0980a8640 1 -- 172.21.15.87:0/4257590758 wait complete. 2024-09-17T07:16:46.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:46.234+0000 7fb0980a8640 1 Processor -- start 2024-09-17T07:16:46.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:46.234+0000 7fb0980a8640 1 -- start start 2024-09-17T07:16:46.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:46.234+0000 7fb0980a8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb090102530 0x7fb090113190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:16:46.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:46.234+0000 7fb0980a8640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb090102ed0 0x7fb0901136d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:16:46.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:46.234+0000 7fb0980a8640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb090113d60 con 0x7fb090102530 2024-09-17T07:16:46.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:46.234+0000 7fb0980a8640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb09010d110 con 0x7fb090102ed0 2024-09-17T07:16:46.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:46.234+0000 7fb095e44640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb090102530 0x7fb090113190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:16:46.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:46.234+0000 7fb095e44640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb090102530 0x7fb090113190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39630/0 (socket says 172.21.15.87:39630) 2024-09-17T07:16:46.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:46.234+0000 7fb095e44640 1 -- 172.21.15.87:0/2590659370 learned_addr learned my addr 172.21.15.87:0/2590659370 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:16:46.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:46.234+0000 7fb095e44640 1 -- 172.21.15.87:0/2590659370 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb090102ed0 msgr2=0x7fb0901136d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:46.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:46.234+0000 7fb095e44640 1 --2- 172.21.15.87:0/2590659370 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb090102ed0 0x7fb0901136d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:46.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:46.234+0000 7fb095e44640 1 -- 172.21.15.87:0/2590659370 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb08c005040 con 0x7fb090102530 2024-09-17T07:16:46.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:46.235+0000 7fb095e44640 1 --2- 172.21.15.87:0/2590659370 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb090102530 0x7fb090113190 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb08c000c00 tx=0x7fb08c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:16:46.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:46.235+0000 7fb0867fc640 1 -- 172.21.15.87:0/2590659370 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb08c038070 con 0x7fb090102530 2024-09-17T07:16:46.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:46.235+0000 7fb0980a8640 1 -- 172.21.15.87:0/2590659370 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb09010d390 con 0x7fb090102530 2024-09-17T07:16:46.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:46.235+0000 7fb0867fc640 1 -- 172.21.15.87:0/2590659370 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fb08c009880 con 0x7fb090102530 2024-09-17T07:16:46.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:46.235+0000 7fb0867fc640 1 -- 172.21.15.87:0/2590659370 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb08c03d420 con 0x7fb090102530 2024-09-17T07:16:46.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:46.235+0000 7fb0980a8640 1 -- 172.21.15.87:0/2590659370 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb09010d850 con 0x7fb090102530 2024-09-17T07:16:46.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:46.236+0000 7fb0980a8640 1 -- 172.21.15.87:0/2590659370 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0900fdcb0 con 0x7fb090102530 2024-09-17T07:16:46.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:46.236+0000 7fb0867fc640 1 -- 172.21.15.87:0/2590659370 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fb08c030020 con 0x7fb090102530 2024-09-17T07:16:46.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:46.237+0000 7fb0867fc640 1 --2- 172.21.15.87:0/2590659370 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fb07c06ed60 0x7fb07c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:16:46.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:46.237+0000 7fb0867fc640 1 -- 172.21.15.87:0/2590659370 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fb08c0ae540 con 0x7fb090102530 2024-09-17T07:16:46.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:46.237+0000 7fb095643640 1 --2- 172.21.15.87:0/2590659370 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fb07c06ed60 0x7fb07c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:16:46.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:46.237+0000 7fb095643640 1 --2- 172.21.15.87:0/2590659370 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fb07c06ed60 0x7fb07c071210 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb09010ea50 tx=0x7fb080006d20 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:16:46.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:46.241+0000 7fb0867fc640 1 -- 172.21.15.87:0/2590659370 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fb08c07b9a0 con 0x7fb090102530 2024-09-17T07:16:46.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:46.396+0000 7fb0980a8640 1 -- 172.21.15.87:0/2590659370 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb0901094a0 con 0x7fb090102530 2024-09-17T07:16:46.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:46.396+0000 7fb0867fc640 1 -- 172.21.15.87:0/2590659370 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb08c07b340 con 0x7fb090102530 2024-09-17T07:16:46.397 INFO:teuthology.orchestra.run.smithi087.stdout:81604378651 2024-09-17T07:16:46.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:46.398+0000 7fb0980a8640 1 -- 172.21.15.87:0/2590659370 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fb07c06ed60 msgr2=0x7fb07c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:46.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:46.398+0000 7fb0980a8640 1 --2- 172.21.15.87:0/2590659370 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fb07c06ed60 0x7fb07c071210 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb09010ea50 tx=0x7fb080006d20 comp rx=0 tx=0).stop 2024-09-17T07:16:46.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:46.398+0000 7fb0980a8640 1 -- 172.21.15.87:0/2590659370 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb090102530 msgr2=0x7fb090113190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:46.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:46.398+0000 7fb0980a8640 1 --2- 172.21.15.87:0/2590659370 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb090102530 0x7fb090113190 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb08c000c00 tx=0x7fb08c009da0 comp rx=0 tx=0).stop 2024-09-17T07:16:46.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:46.398+0000 7fb0980a8640 1 -- 172.21.15.87:0/2590659370 shutdown_connections 2024-09-17T07:16:46.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:46.398+0000 7fb0980a8640 1 --2- 172.21.15.87:0/2590659370 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fb07c06ed60 0x7fb07c071210 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:46.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:46.398+0000 7fb0980a8640 1 --2- 172.21.15.87:0/2590659370 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb090102ed0 0x7fb0901136d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:46.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:46.398+0000 7fb0980a8640 1 --2- 172.21.15.87:0/2590659370 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb090102530 0x7fb090113190 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:46.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:46.398+0000 7fb0980a8640 1 -- 172.21.15.87:0/2590659370 >> 172.21.15.87:0/2590659370 conn(0x7fb0900f80f0 msgr2=0x7fb0900f9230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:16:46.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:46.399+0000 7fb0980a8640 1 -- 172.21.15.87:0/2590659370 shutdown_connections 2024-09-17T07:16:46.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:46.399+0000 7fb0980a8640 1 -- 172.21.15.87:0/2590659370 wait complete. 2024-09-17T07:16:47.101 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:16:46 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/2590659370' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-17T07:16:47.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:16:46 smithi139 ceph-mon[34403]: from='client.? 172.21.15.87:0/2590659370' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-17T07:16:47.129 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378648 got 81604378651 for osd.2 2024-09-17T07:16:47.130 DEBUG:teuthology.parallel:result is None 2024-09-17T07:16:47.130 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-17T07:16:47.130 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-17T07:16:47.378 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/mon.smithi087/config 2024-09-17T07:16:47.750 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:16:47 smithi087 ceph-mon[27636]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T07:16:48.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:16:47 smithi139 ceph-mon[34403]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T07:16:49.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:49.046+0000 7f2055547640 1 -- 172.21.15.87:0/2940178096 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20500fcf80 msgr2=0x7f20500fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:49.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:49.046+0000 7f2055547640 1 --2- 172.21.15.87:0/2940178096 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20500fcf80 0x7f20500fd3d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f20440048d0 tx=0x7f2044009da0 comp rx=0 tx=0).stop 2024-09-17T07:16:49.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:49.046+0000 7f2055547640 1 -- 172.21.15.87:0/2940178096 shutdown_connections 2024-09-17T07:16:49.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:49.046+0000 7f2055547640 1 --2- 172.21.15.87:0/2940178096 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20500fcf80 0x7f20500fd3d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:49.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:49.046+0000 7f2055547640 1 --2- 172.21.15.87:0/2940178096 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f20500fb810 0x7f20500fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:49.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:49.046+0000 7f2055547640 1 -- 172.21.15.87:0/2940178096 >> 172.21.15.87:0/2940178096 conn(0x7f20500723b0 msgr2=0x7f20500727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:16:49.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:49.046+0000 7f2055547640 1 -- 172.21.15.87:0/2940178096 shutdown_connections 2024-09-17T07:16:49.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:49.046+0000 7f2055547640 1 -- 172.21.15.87:0/2940178096 wait complete. 2024-09-17T07:16:49.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:49.047+0000 7f2055547640 1 Processor -- start 2024-09-17T07:16:49.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:49.047+0000 7f2055547640 1 -- start start 2024-09-17T07:16:49.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:49.047+0000 7f2055547640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f20500fb810 0x7f20500f8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:16:49.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:49.047+0000 7f2055547640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20500fcf80 0x7f20500f8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:16:49.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:49.047+0000 7f2055547640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20500f8fc0 con 0x7f20500fcf80 2024-09-17T07:16:49.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:49.047+0000 7f2055547640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20500f9130 con 0x7f20500fb810 2024-09-17T07:16:49.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:49.047+0000 7f204e7fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20500fcf80 0x7f20500f8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:16:49.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:49.047+0000 7f204e7fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20500fcf80 0x7f20500f8a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39648/0 (socket says 172.21.15.87:39648) 2024-09-17T07:16:49.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:49.047+0000 7f204e7fc640 1 -- 172.21.15.87:0/2062410707 learned_addr learned my addr 172.21.15.87:0/2062410707 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:16:49.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:49.047+0000 7f204effd640 1 --2- 172.21.15.87:0/2062410707 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f20500fb810 0x7f20500f8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:16:49.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:49.048+0000 7f204e7fc640 1 -- 172.21.15.87:0/2062410707 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f20500fb810 msgr2=0x7f20500f8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:49.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:49.048+0000 7f204e7fc640 1 --2- 172.21.15.87:0/2062410707 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f20500fb810 0x7f20500f8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:49.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:49.048+0000 7f204e7fc640 1 -- 172.21.15.87:0/2062410707 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2044005040 con 0x7f20500fcf80 2024-09-17T07:16:49.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:49.048+0000 7f204e7fc640 1 --2- 172.21.15.87:0/2062410707 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20500fcf80 0x7f20500f8a80 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2044003080 tx=0x7f2044009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:16:49.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:49.048+0000 7f20377fe640 1 -- 172.21.15.87:0/2062410707 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2044038070 con 0x7f20500fcf80 2024-09-17T07:16:49.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:49.048+0000 7f2055547640 1 -- 172.21.15.87:0/2062410707 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20500f9360 con 0x7f20500fcf80 2024-09-17T07:16:49.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:49.048+0000 7f20377fe640 1 -- 172.21.15.87:0/2062410707 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f20440097c0 con 0x7f20500fcf80 2024-09-17T07:16:49.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:49.048+0000 7f20377fe640 1 -- 172.21.15.87:0/2062410707 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f204403d420 con 0x7f20500fcf80 2024-09-17T07:16:49.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:49.048+0000 7f2055547640 1 -- 172.21.15.87:0/2062410707 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2050119750 con 0x7f20500fcf80 2024-09-17T07:16:49.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:49.049+0000 7f2055547640 1 -- 172.21.15.87:0/2062410707 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20500fcbc0 con 0x7f20500fcf80 2024-09-17T07:16:49.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:49.049+0000 7f20377fe640 1 -- 172.21.15.87:0/2062410707 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f2044030020 con 0x7f20500fcf80 2024-09-17T07:16:49.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:49.050+0000 7f20377fe640 1 --2- 172.21.15.87:0/2062410707 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f203806ed60 0x7f2038071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:16:49.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:49.050+0000 7f20377fe640 1 -- 172.21.15.87:0/2062410707 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f20440ae380 con 0x7f20500fcf80 2024-09-17T07:16:49.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:49.050+0000 7f204effd640 1 --2- 172.21.15.87:0/2062410707 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f203806ed60 0x7f2038071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:16:49.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:49.050+0000 7f204effd640 1 --2- 172.21.15.87:0/2062410707 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f203806ed60 0x7f2038071210 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2040007fd0 tx=0x7f2040009040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:16:49.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:49.054+0000 7f20377fe640 1 -- 172.21.15.87:0/2062410707 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f204407b7e0 con 0x7f20500fcf80 2024-09-17T07:16:49.208 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:49.207+0000 7f2055547640 1 -- 172.21.15.87:0/2062410707 --> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f205004b720 con 0x7f203806ed60 2024-09-17T07:16:49.209 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:49.208+0000 7f20377fe640 1 -- 172.21.15.87:0/2062410707 <== mgr.14208 v2:172.21.15.87:6800/611048628 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+28200 (secure 0 0 0) 0x7f205004b720 con 0x7f203806ed60 2024-09-17T07:16:49.209 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:16:49.210 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-09-17T07:16:49.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:49.210+0000 7f2055547640 1 -- 172.21.15.87:0/2062410707 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f203806ed60 msgr2=0x7f2038071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:49.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:49.210+0000 7f2055547640 1 --2- 172.21.15.87:0/2062410707 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f203806ed60 0x7f2038071210 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2040007fd0 tx=0x7f2040009040 comp rx=0 tx=0).stop 2024-09-17T07:16:49.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:49.210+0000 7f2055547640 1 -- 172.21.15.87:0/2062410707 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20500fcf80 msgr2=0x7f20500f8a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:49.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:49.210+0000 7f2055547640 1 --2- 172.21.15.87:0/2062410707 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20500fcf80 0x7f20500f8a80 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2044003080 tx=0x7f2044009da0 comp rx=0 tx=0).stop 2024-09-17T07:16:49.211 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:49.210+0000 7f2055547640 1 -- 172.21.15.87:0/2062410707 shutdown_connections 2024-09-17T07:16:49.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:49.210+0000 7f2055547640 1 --2- 172.21.15.87:0/2062410707 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20500fcf80 0x7f20500f8a80 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:49.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:49.210+0000 7f2055547640 1 --2- 172.21.15.87:0/2062410707 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f203806ed60 0x7f2038071210 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:49.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:49.210+0000 7f2055547640 1 --2- 172.21.15.87:0/2062410707 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f20500fb810 0x7f20500f8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:49.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:49.210+0000 7f2055547640 1 -- 172.21.15.87:0/2062410707 >> 172.21.15.87:0/2062410707 conn(0x7f20500723b0 msgr2=0x7f20500fa960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:16:49.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:49.210+0000 7f2055547640 1 -- 172.21.15.87:0/2062410707 shutdown_connections 2024-09-17T07:16:49.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:49.210+0000 7f2055547640 1 -- 172.21.15.87:0/2062410707 wait complete. 2024-09-17T07:16:49.901 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:16:49 smithi087 ceph-mon[27636]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T07:16:49.901 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:16:49 smithi087 ceph-mon[27636]: from='client.14418 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-17T07:16:49.926 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":152,"stamp":"2024-09-17T07:16:48.600731+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1787932,"kb_used_data":3780,"kb_used_omap":9,"kb_used_meta":1784054,"kb_avail":560682980,"statfs":{"total":575970213888,"available":574139371520,"internally_reserved":0,"allocated":3870720,"data_stored":2558100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10224,"internal_metadata":1826871312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002192"},"pg_stats":[{"pgid":"1.0","version":"23'72","reported_seq":130,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T07:16:00.612388+0000","last_change":"2024-09-17T07:15:35.215627+0000","last_active":"2024-09-17T07:16:00.612388+0000","last_peered":"2024-09-17T07:16:00.612388+0000","last_clean":"2024-09-17T07:16:00.612388+0000","last_became_active":"2024-09-17T07:15:35.215227+0000","last_became_peered":"2024-09-17T07:15:35.215227+0000","last_unstale":"2024-09-17T07:16:00.612388+0000","last_undegraded":"2024-09-17T07:16:00.612388+0000","last_fullsized":"2024-09-17T07:16:00.612388+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:14:47.411046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:14:47.411046+0000","last_clean_scrub_stamp":"2024-09-17T07:14:47.411046+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:52:51.762152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":37,"seq":158913789964,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297696,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447456,"statfs":{"total":95995035648,"available":95690194944,"internally_reserved":0,"allocated":348160,"data_stored":131166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]}]},{"osd":4,"up_from":32,"seq":137438953489,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297704,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447448,"statfs":{"total":95995035648,"available":95690186752,"internally_reserved":0,"allocated":348160,"data_stored":131166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 07:16:36 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.46000000000000002}]},{"osd":1,"last update":"Tue Sep 17 07:16:36 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.626}]},{"osd":2,"last update":"Tue Sep 17 07:16:36 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.59299999999999997}]},{"osd":3,"last update":"Tue Sep 17 07:16:36 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.316}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]}]},{"osd":3,"up_from":26,"seq":111669149719,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298276,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446876,"statfs":{"total":95995035648,"available":95689601024,"internally_reserved":0,"allocated":942080,"data_stored":721534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 07:16:11 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.438}]},{"osd":1,"last update":"Tue Sep 17 07:16:11 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.36899999999999999}]},{"osd":2,"last update":"Tue Sep 17 07:16:11 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.45800000000000002}]},{"osd":4,"last update":"Tue Sep 17 07:16:35 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.363,"5min":1.363,"15min":1.363},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.34999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]}]},{"osd":2,"up_from":19,"seq":81604378652,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297704,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447448,"statfs":{"total":95995035648,"available":95690186752,"internally_reserved":0,"allocated":348160,"data_stored":131166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 07:15:47 2024","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.29699999999999999}]},{"osd":1,"last update":"Tue Sep 17 07:15:47 2024","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"last":0.26800000000000002}]},{"osd":3,"last update":"Tue Sep 17 07:16:10 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.63900000000000001}]},{"osd":4,"last update":"Tue Sep 17 07:16:37 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.57199999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]}]},{"osd":1,"up_from":14,"seq":60129542178,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298276,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446876,"statfs":{"total":95995035648,"available":95689601024,"internally_reserved":0,"allocated":942080,"data_stored":721534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 07:16:19 2024","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.29999999999999999,"15min":0.29699999999999999},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"last":0.24299999999999999},{"interface":"front","average":{"1min":0.32800000000000001,"5min":0.29499999999999998,"15min":0.28899999999999998},"min":{"1min":0.25700000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.27200000000000002}]},{"osd":2,"last update":"Tue Sep 17 07:15:48 2024","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"last":0.28799999999999998}]},{"osd":3,"last update":"Tue Sep 17 07:16:10 2024","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.376},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.32200000000000001}]},{"osd":4,"last update":"Tue Sep 17 07:16:39 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.41799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705703,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298276,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446876,"statfs":{"total":95995035648,"available":95689601024,"internally_reserved":0,"allocated":942080,"data_stored":721534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Sep 17 07:16:23 2024","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.315,"15min":0.315},"min":{"1min":0.22600000000000001,"5min":0.183,"15min":0.183},"max":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.315,"5min":0.32100000000000001,"15min":0.32200000000000001},"min":{"1min":0.26000000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.42999999999999999,"5min":0.48099999999999998,"15min":0.48099999999999998},"last":0.24099999999999999}]},{"osd":2,"last update":"Tue Sep 17 07:15:49 2024","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"last":0.22800000000000001},{"interface":"front","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"last":0.26400000000000001}]},{"osd":3,"last update":"Tue Sep 17 07:16:11 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.51000000000000001}]},{"osd":4,"last update":"Tue Sep 17 07:16:37 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.46899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T07:16:49.928 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-17T07:16:50.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:16:49 smithi139 ceph-mon[34403]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T07:16:50.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:16:49 smithi139 ceph-mon[34403]: from='client.14418 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-17T07:16:50.172 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/mon.smithi087/config 2024-09-17T07:16:51.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:51.843+0000 7f9c58042640 1 -- 172.21.15.87:0/932742792 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9c500fb4a0 msgr2=0x7f9c500fb910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:51.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:51.843+0000 7f9c58042640 1 --2- 172.21.15.87:0/932742792 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9c500fb4a0 0x7f9c500fb910 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9c400048d0 tx=0x7f9c40009da0 comp rx=0 tx=0).stop 2024-09-17T07:16:51.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:51.843+0000 7f9c58042640 1 -- 172.21.15.87:0/932742792 shutdown_connections 2024-09-17T07:16:51.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:51.843+0000 7f9c58042640 1 --2- 172.21.15.87:0/932742792 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9c500fb4a0 0x7f9c500fb910 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:51.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:51.843+0000 7f9c58042640 1 --2- 172.21.15.87:0/932742792 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9c501014e0 0x7f9c501018b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:51.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:51.843+0000 7f9c58042640 1 -- 172.21.15.87:0/932742792 >> 172.21.15.87:0/932742792 conn(0x7f9c500f7060 msgr2=0x7f9c500f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:16:51.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:51.843+0000 7f9c58042640 1 -- 172.21.15.87:0/932742792 shutdown_connections 2024-09-17T07:16:51.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:51.843+0000 7f9c58042640 1 -- 172.21.15.87:0/932742792 wait complete. 2024-09-17T07:16:51.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:51.844+0000 7f9c58042640 1 Processor -- start 2024-09-17T07:16:51.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:51.844+0000 7f9c58042640 1 -- start start 2024-09-17T07:16:51.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:51.844+0000 7f9c58042640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9c500fb4a0 0x7f9c5010e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:16:51.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:51.844+0000 7f9c58042640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9c501014e0 0x7f9c5010e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:16:51.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:51.844+0000 7f9c58042640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5010ebf0 con 0x7f9c500fb4a0 2024-09-17T07:16:51.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:51.844+0000 7f9c58042640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5010ed60 con 0x7f9c501014e0 2024-09-17T07:16:51.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:51.844+0000 7f9c55dde640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9c500fb4a0 0x7f9c5010e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:16:51.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:51.844+0000 7f9c55dde640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9c500fb4a0 0x7f9c5010e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39666/0 (socket says 172.21.15.87:39666) 2024-09-17T07:16:51.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:51.844+0000 7f9c55dde640 1 -- 172.21.15.87:0/2257833548 learned_addr learned my addr 172.21.15.87:0/2257833548 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:16:51.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:51.844+0000 7f9c555dd640 1 --2- 172.21.15.87:0/2257833548 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9c501014e0 0x7f9c5010e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:16:51.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:51.844+0000 7f9c55dde640 1 -- 172.21.15.87:0/2257833548 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9c501014e0 msgr2=0x7f9c5010e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:51.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:51.844+0000 7f9c55dde640 1 --2- 172.21.15.87:0/2257833548 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9c501014e0 0x7f9c5010e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:51.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:51.844+0000 7f9c55dde640 1 -- 172.21.15.87:0/2257833548 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c40005040 con 0x7f9c500fb4a0 2024-09-17T07:16:51.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:51.844+0000 7f9c555dd640 1 --2- 172.21.15.87:0/2257833548 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9c501014e0 0x7f9c5010e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T07:16:51.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:51.845+0000 7f9c55dde640 1 --2- 172.21.15.87:0/2257833548 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9c500fb4a0 0x7f9c5010e060 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c00c830 tx=0x7f9c4c004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:16:51.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:51.845+0000 7f9c467fc640 1 -- 172.21.15.87:0/2257833548 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c4c00a850 con 0x7f9c500fb4a0 2024-09-17T07:16:51.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:51.845+0000 7f9c467fc640 1 -- 172.21.15.87:0/2257833548 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f9c4c00ae30 con 0x7f9c500fb4a0 2024-09-17T07:16:51.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:51.845+0000 7f9c58042640 1 -- 172.21.15.87:0/2257833548 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c501170d0 con 0x7f9c500fb4a0 2024-09-17T07:16:51.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:51.845+0000 7f9c467fc640 1 -- 172.21.15.87:0/2257833548 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c4c0113a0 con 0x7f9c500fb4a0 2024-09-17T07:16:51.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:51.845+0000 7f9c58042640 1 -- 172.21.15.87:0/2257833548 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c501175e0 con 0x7f9c500fb4a0 2024-09-17T07:16:51.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:51.846+0000 7f9c58042640 1 -- 172.21.15.87:0/2257833548 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c500fcbe0 con 0x7f9c500fb4a0 2024-09-17T07:16:51.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:51.846+0000 7f9c467fc640 1 -- 172.21.15.87:0/2257833548 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f9c4c012400 con 0x7f9c500fb4a0 2024-09-17T07:16:51.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:51.847+0000 7f9c467fc640 1 --2- 172.21.15.87:0/2257833548 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f9c3c06ed60 0x7f9c3c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:16:51.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:51.847+0000 7f9c555dd640 1 --2- 172.21.15.87:0/2257833548 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f9c3c06ed60 0x7f9c3c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:16:51.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:51.847+0000 7f9c467fc640 1 -- 172.21.15.87:0/2257833548 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f9c4c08dfe0 con 0x7f9c500fb4a0 2024-09-17T07:16:51.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:51.847+0000 7f9c555dd640 1 --2- 172.21.15.87:0/2257833548 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f9c3c06ed60 0x7f9c3c071210 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9c40004540 tx=0x7f9c40009da0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:16:51.855 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:16:51 smithi087 ceph-mon[27636]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T07:16:51.855 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:16:51 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:16:51.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:51.851+0000 7f9c467fc640 1 -- 172.21.15.87:0/2257833548 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f9c4c05b4c0 con 0x7f9c500fb4a0 2024-09-17T07:16:52.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:52.004+0000 7f9c58042640 1 -- 172.21.15.87:0/2257833548 --> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9c50066220 con 0x7f9c3c06ed60 2024-09-17T07:16:52.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:52.006+0000 7f9c467fc640 1 -- 172.21.15.87:0/2257833548 <== mgr.14208 v2:172.21.15.87:6800/611048628 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+28228 (secure 0 0 0) 0x7f9c50066220 con 0x7f9c3c06ed60 2024-09-17T07:16:52.007 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:16:52.007 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-09-17T07:16:52.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:52.008+0000 7f9c58042640 1 -- 172.21.15.87:0/2257833548 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f9c3c06ed60 msgr2=0x7f9c3c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:52.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:52.008+0000 7f9c58042640 1 --2- 172.21.15.87:0/2257833548 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f9c3c06ed60 0x7f9c3c071210 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9c40004540 tx=0x7f9c40009da0 comp rx=0 tx=0).stop 2024-09-17T07:16:52.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:52.008+0000 7f9c58042640 1 -- 172.21.15.87:0/2257833548 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9c500fb4a0 msgr2=0x7f9c5010e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:52.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:52.008+0000 7f9c58042640 1 --2- 172.21.15.87:0/2257833548 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9c500fb4a0 0x7f9c5010e060 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c00c830 tx=0x7f9c4c004430 comp rx=0 tx=0).stop 2024-09-17T07:16:52.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:52.008+0000 7f9c58042640 1 -- 172.21.15.87:0/2257833548 shutdown_connections 2024-09-17T07:16:52.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:52.008+0000 7f9c58042640 1 --2- 172.21.15.87:0/2257833548 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f9c3c06ed60 0x7f9c3c071210 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:52.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:52.008+0000 7f9c58042640 1 --2- 172.21.15.87:0/2257833548 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9c501014e0 0x7f9c5010e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:52.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:52.008+0000 7f9c58042640 1 --2- 172.21.15.87:0/2257833548 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9c500fb4a0 0x7f9c5010e060 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:52.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:52.008+0000 7f9c58042640 1 -- 172.21.15.87:0/2257833548 >> 172.21.15.87:0/2257833548 conn(0x7f9c500f7060 msgr2=0x7f9c500f8a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:16:52.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:52.008+0000 7f9c58042640 1 -- 172.21.15.87:0/2257833548 shutdown_connections 2024-09-17T07:16:52.010 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:52.008+0000 7f9c58042640 1 -- 172.21.15.87:0/2257833548 wait complete. 2024-09-17T07:16:52.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:16:51 smithi139 ceph-mon[34403]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T07:16:52.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:16:51 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:16:52.572 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":153,"stamp":"2024-09-17T07:16:50.601146+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1787932,"kb_used_data":3780,"kb_used_omap":9,"kb_used_meta":1784054,"kb_avail":560682980,"statfs":{"total":575970213888,"available":574139371520,"internally_reserved":0,"allocated":3870720,"data_stored":2558100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10224,"internal_metadata":1826871312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002250"},"pg_stats":[{"pgid":"1.0","version":"23'72","reported_seq":130,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T07:16:00.612388+0000","last_change":"2024-09-17T07:15:35.215627+0000","last_active":"2024-09-17T07:16:00.612388+0000","last_peered":"2024-09-17T07:16:00.612388+0000","last_clean":"2024-09-17T07:16:00.612388+0000","last_became_active":"2024-09-17T07:15:35.215227+0000","last_became_peered":"2024-09-17T07:15:35.215227+0000","last_unstale":"2024-09-17T07:16:00.612388+0000","last_undegraded":"2024-09-17T07:16:00.612388+0000","last_fullsized":"2024-09-17T07:16:00.612388+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:14:47.411046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:14:47.411046+0000","last_clean_scrub_stamp":"2024-09-17T07:14:47.411046+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:52:51.762152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":37,"seq":158913789964,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297696,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447456,"statfs":{"total":95995035648,"available":95690194944,"internally_reserved":0,"allocated":348160,"data_stored":131166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]}]},{"osd":4,"up_from":32,"seq":137438953490,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297704,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447448,"statfs":{"total":95995035648,"available":95690186752,"internally_reserved":0,"allocated":348160,"data_stored":131166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 07:16:36 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.48299999999999998}]},{"osd":1,"last update":"Tue Sep 17 07:16:36 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.58099999999999996}]},{"osd":2,"last update":"Tue Sep 17 07:16:36 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.46200000000000002}]},{"osd":3,"last update":"Tue Sep 17 07:16:36 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.29499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]}]},{"osd":3,"up_from":26,"seq":111669149719,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298276,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446876,"statfs":{"total":95995035648,"available":95689601024,"internally_reserved":0,"allocated":942080,"data_stored":721534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 07:16:11 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.438}]},{"osd":1,"last update":"Tue Sep 17 07:16:11 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.36899999999999999}]},{"osd":2,"last update":"Tue Sep 17 07:16:11 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.45800000000000002}]},{"osd":4,"last update":"Tue Sep 17 07:16:35 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.363,"5min":1.363,"15min":1.363},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.34999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]}]},{"osd":2,"up_from":19,"seq":81604378652,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297704,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447448,"statfs":{"total":95995035648,"available":95690186752,"internally_reserved":0,"allocated":348160,"data_stored":131166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 07:15:47 2024","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.29699999999999999}]},{"osd":1,"last update":"Tue Sep 17 07:15:47 2024","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"last":0.26800000000000002}]},{"osd":3,"last update":"Tue Sep 17 07:16:10 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.63900000000000001}]},{"osd":4,"last update":"Tue Sep 17 07:16:37 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.57199999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]}]},{"osd":1,"up_from":14,"seq":60129542178,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298276,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446876,"statfs":{"total":95995035648,"available":95689601024,"internally_reserved":0,"allocated":942080,"data_stored":721534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 07:16:19 2024","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.29999999999999999,"15min":0.29699999999999999},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"last":0.24299999999999999},{"interface":"front","average":{"1min":0.32800000000000001,"5min":0.29499999999999998,"15min":0.28899999999999998},"min":{"1min":0.25700000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.27200000000000002}]},{"osd":2,"last update":"Tue Sep 17 07:15:48 2024","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"last":0.28799999999999998}]},{"osd":3,"last update":"Tue Sep 17 07:16:10 2024","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.376},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.32200000000000001}]},{"osd":4,"last update":"Tue Sep 17 07:16:39 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.41799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705703,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298276,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446876,"statfs":{"total":95995035648,"available":95689601024,"internally_reserved":0,"allocated":942080,"data_stored":721534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Sep 17 07:16:23 2024","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.315,"15min":0.315},"min":{"1min":0.22600000000000001,"5min":0.183,"15min":0.183},"max":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.315,"5min":0.32100000000000001,"15min":0.32200000000000001},"min":{"1min":0.26000000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.42999999999999999,"5min":0.48099999999999998,"15min":0.48099999999999998},"last":0.24099999999999999}]},{"osd":2,"last update":"Tue Sep 17 07:15:49 2024","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"last":0.22800000000000001},{"interface":"front","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"last":0.26400000000000001}]},{"osd":3,"last update":"Tue Sep 17 07:16:11 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.51000000000000001}]},{"osd":4,"last update":"Tue Sep 17 07:16:37 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.46899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T07:16:52.573 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-17T07:16:52.573 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-17T07:16:52.573 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-17T07:16:52.573 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -- ceph health --format=json 2024-09-17T07:16:52.817 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/mon.smithi087/config 2024-09-17T07:16:52.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:16:52 smithi087 ceph-mon[27636]: from='client.14422 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-17T07:16:53.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:16:52 smithi139 ceph-mon[34403]: from='client.14422 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-17T07:16:53.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:16:53 smithi087 ceph-mon[27636]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T07:16:54.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:16:53 smithi139 ceph-mon[34403]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T07:16:54.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:54.531+0000 7f5bf9b81640 1 -- 172.21.15.87:0/165848843 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bf4102ef0 msgr2=0x7f5bf40fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:54.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:54.531+0000 7f5bf9b81640 1 --2- 172.21.15.87:0/165848843 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bf4102ef0 0x7f5bf40fc5b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc0048d0 tx=0x7f5bdc009da0 comp rx=0 tx=0).stop 2024-09-17T07:16:54.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:54.531+0000 7f5bf9b81640 1 -- 172.21.15.87:0/165848843 shutdown_connections 2024-09-17T07:16:54.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:54.531+0000 7f5bf9b81640 1 --2- 172.21.15.87:0/165848843 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bf4102ef0 0x7f5bf40fc5b0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:54.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:54.531+0000 7f5bf9b81640 1 --2- 172.21.15.87:0/165848843 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5bf4102550 0x7f5bf4102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:54.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:54.531+0000 7f5bf9b81640 1 -- 172.21.15.87:0/165848843 >> 172.21.15.87:0/165848843 conn(0x7f5bf40f80f0 msgr2=0x7f5bf40fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:16:54.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:54.531+0000 7f5bf9b81640 1 -- 172.21.15.87:0/165848843 shutdown_connections 2024-09-17T07:16:54.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:54.531+0000 7f5bf9b81640 1 -- 172.21.15.87:0/165848843 wait complete. 2024-09-17T07:16:54.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:54.532+0000 7f5bf9b81640 1 Processor -- start 2024-09-17T07:16:54.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:54.532+0000 7f5bf9b81640 1 -- start start 2024-09-17T07:16:54.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:54.532+0000 7f5bf9b81640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5bf4102550 0x7f5bf4113420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:16:54.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:54.532+0000 7f5bf9b81640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bf4102ef0 0x7f5bf4113960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:16:54.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:54.532+0000 7f5bf9b81640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf4113f60 con 0x7f5bf4102ef0 2024-09-17T07:16:54.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:54.532+0000 7f5bf9b81640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf41140d0 con 0x7f5bf4102550 2024-09-17T07:16:54.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:54.532+0000 7f5bebfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bf4102ef0 0x7f5bf4113960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:16:54.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:54.532+0000 7f5bebfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bf4102ef0 0x7f5bf4113960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:50706/0 (socket says 172.21.15.87:50706) 2024-09-17T07:16:54.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:54.532+0000 7f5bebfff640 1 -- 172.21.15.87:0/3543864676 learned_addr learned my addr 172.21.15.87:0/3543864676 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:16:54.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:54.532+0000 7f5bf37fe640 1 --2- 172.21.15.87:0/3543864676 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5bf4102550 0x7f5bf4113420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:16:54.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:54.532+0000 7f5bebfff640 1 -- 172.21.15.87:0/3543864676 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5bf4102550 msgr2=0x7f5bf4113420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:54.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:54.532+0000 7f5bebfff640 1 --2- 172.21.15.87:0/3543864676 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5bf4102550 0x7f5bf4113420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:54.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:54.532+0000 7f5bebfff640 1 -- 172.21.15.87:0/3543864676 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bdc005040 con 0x7f5bf4102ef0 2024-09-17T07:16:54.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:54.532+0000 7f5bf37fe640 1 --2- 172.21.15.87:0/3543864676 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5bf4102550 0x7f5bf4113420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T07:16:54.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:54.532+0000 7f5bebfff640 1 --2- 172.21.15.87:0/3543864676 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bf4102ef0 0x7f5bf4113960 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc0043d0 tx=0x7f5bdc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:16:54.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:54.533+0000 7f5bf0ff9640 1 -- 172.21.15.87:0/3543864676 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5bdc038070 con 0x7f5bf4102ef0 2024-09-17T07:16:54.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:54.533+0000 7f5bf0ff9640 1 -- 172.21.15.87:0/3543864676 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f5bdc0096c0 con 0x7f5bf4102ef0 2024-09-17T07:16:54.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:54.533+0000 7f5bf0ff9640 1 -- 172.21.15.87:0/3543864676 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5bdc02c710 con 0x7f5bf4102ef0 2024-09-17T07:16:54.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:54.533+0000 7f5bf9b81640 1 -- 172.21.15.87:0/3543864676 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bf410d4f0 con 0x7f5bf4102ef0 2024-09-17T07:16:54.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:54.533+0000 7f5bf9b81640 1 -- 172.21.15.87:0/3543864676 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bf410da30 con 0x7f5bf4102ef0 2024-09-17T07:16:54.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:54.534+0000 7f5bf9b81640 1 -- 172.21.15.87:0/3543864676 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bf40fdcd0 con 0x7f5bf4102ef0 2024-09-17T07:16:54.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:54.534+0000 7f5bf0ff9640 1 -- 172.21.15.87:0/3543864676 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f5bdc030020 con 0x7f5bf4102ef0 2024-09-17T07:16:54.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:54.534+0000 7f5bf0ff9640 1 --2- 172.21.15.87:0/3543864676 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f5be006ed60 0x7f5be0071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:16:54.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:54.535+0000 7f5bf0ff9640 1 -- 172.21.15.87:0/3543864676 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f5bdc0adc10 con 0x7f5bf4102ef0 2024-09-17T07:16:54.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:54.535+0000 7f5bf37fe640 1 --2- 172.21.15.87:0/3543864676 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f5be006ed60 0x7f5be0071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:16:54.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:54.535+0000 7f5bf37fe640 1 --2- 172.21.15.87:0/3543864676 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f5be006ed60 0x7f5be0071210 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5be4009fd0 tx=0x7f5be4009e50 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:16:54.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:54.539+0000 7f5bf0ff9640 1 -- 172.21.15.87:0/3543864676 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f5bdc07b070 con 0x7f5bf4102ef0 2024-09-17T07:16:54.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:54.727+0000 7f5bf9b81640 1 -- 172.21.15.87:0/3543864676 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f5bf40fbd50 con 0x7f5bf4102ef0 2024-09-17T07:16:54.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:54.728+0000 7f5bf0ff9640 1 -- 172.21.15.87:0/3543864676 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f5bdc02c870 con 0x7f5bf4102ef0 2024-09-17T07:16:54.729 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:16:54.729 INFO:teuthology.orchestra.run.smithi087.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-17T07:16:54.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:54.730+0000 7f5bf9b81640 1 -- 172.21.15.87:0/3543864676 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f5be006ed60 msgr2=0x7f5be0071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:54.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:54.730+0000 7f5bf9b81640 1 --2- 172.21.15.87:0/3543864676 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f5be006ed60 0x7f5be0071210 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5be4009fd0 tx=0x7f5be4009e50 comp rx=0 tx=0).stop 2024-09-17T07:16:54.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:54.730+0000 7f5bf9b81640 1 -- 172.21.15.87:0/3543864676 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bf4102ef0 msgr2=0x7f5bf4113960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:54.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:54.730+0000 7f5bf9b81640 1 --2- 172.21.15.87:0/3543864676 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bf4102ef0 0x7f5bf4113960 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc0043d0 tx=0x7f5bdc009da0 comp rx=0 tx=0).stop 2024-09-17T07:16:54.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:54.730+0000 7f5bf9b81640 1 -- 172.21.15.87:0/3543864676 shutdown_connections 2024-09-17T07:16:54.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:54.730+0000 7f5bf9b81640 1 --2- 172.21.15.87:0/3543864676 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bf4102ef0 0x7f5bf4113960 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:54.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:54.730+0000 7f5bf9b81640 1 --2- 172.21.15.87:0/3543864676 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f5be006ed60 0x7f5be0071210 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:54.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:54.730+0000 7f5bf9b81640 1 --2- 172.21.15.87:0/3543864676 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5bf4102550 0x7f5bf4113420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:54.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:54.730+0000 7f5bf9b81640 1 -- 172.21.15.87:0/3543864676 >> 172.21.15.87:0/3543864676 conn(0x7f5bf40f80f0 msgr2=0x7f5bf40f9200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:16:54.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:54.730+0000 7f5bf9b81640 1 -- 172.21.15.87:0/3543864676 shutdown_connections 2024-09-17T07:16:54.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:54.730+0000 7f5bf9b81640 1 -- 172.21.15.87:0/3543864676 wait complete. 2024-09-17T07:16:55.052 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:16:54 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/3543864676' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-17T07:16:55.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:16:54 smithi139 ceph-mon[34403]: from='client.? 172.21.15.87:0/3543864676' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-17T07:16:55.428 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-17T07:16:55.428 INFO:tasks.cephadm:Setup complete, yielding 2024-09-17T07:16:55.428 INFO:teuthology.run_tasks:Running task print... 2024-09-17T07:16:55.437 INFO:teuthology.task.print:**** done end installing quincy cephadm ... 2024-09-17T07:16:55.437 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-17T07:16:55.446 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi087.front.sepia.ceph.com 2024-09-17T07:16:55.447 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-09-17T07:16:55.688 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/mon.smithi087/config 2024-09-17T07:16:56.041 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:16:55 smithi087 ceph-mon[27636]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T07:16:56.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:16:55 smithi139 ceph-mon[34403]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T07:16:57.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:57.360+0000 7f86af39b640 1 -- 172.21.15.87:0/1531651606 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86a80fc700 msgr2=0x7f86a80fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:57.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:57.360+0000 7f86af39b640 1 --2- 172.21.15.87:0/1531651606 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86a80fc700 0x7f86a80fcb70 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f869c0048d0 tx=0x7f869c009da0 comp rx=0 tx=0).stop 2024-09-17T07:16:57.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:57.360+0000 7f86af39b640 1 -- 172.21.15.87:0/1531651606 shutdown_connections 2024-09-17T07:16:57.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:57.360+0000 7f86af39b640 1 --2- 172.21.15.87:0/1531651606 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86a80fc700 0x7f86a80fcb70 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:57.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:57.360+0000 7f86af39b640 1 --2- 172.21.15.87:0/1531651606 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f86a80fb430 0x7f86a80fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:57.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:57.360+0000 7f86af39b640 1 -- 172.21.15.87:0/1531651606 >> 172.21.15.87:0/1531651606 conn(0x7f86a80f6c10 msgr2=0x7f86a80f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:16:57.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:57.361+0000 7f86af39b640 1 -- 172.21.15.87:0/1531651606 shutdown_connections 2024-09-17T07:16:57.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:57.361+0000 7f86af39b640 1 -- 172.21.15.87:0/1531651606 wait complete. 2024-09-17T07:16:57.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:57.361+0000 7f86af39b640 1 Processor -- start 2024-09-17T07:16:57.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:57.361+0000 7f86af39b640 1 -- start start 2024-09-17T07:16:57.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:57.361+0000 7f86af39b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86a80fb430 0x7f86a810bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:16:57.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:57.361+0000 7f86af39b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f86a80fc700 0x7f86a810c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:16:57.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:57.361+0000 7f86af39b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a810d2b0 con 0x7f86a80fb430 2024-09-17T07:16:57.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:57.361+0000 7f86af39b640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a810d420 con 0x7f86a80fc700 2024-09-17T07:16:57.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:57.362+0000 7f86ad137640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86a80fb430 0x7f86a810bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:16:57.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:57.362+0000 7f86ad137640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86a80fb430 0x7f86a810bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:50716/0 (socket says 172.21.15.87:50716) 2024-09-17T07:16:57.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:57.362+0000 7f86ad137640 1 -- 172.21.15.87:0/4193891335 learned_addr learned my addr 172.21.15.87:0/4193891335 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:16:57.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:57.362+0000 7f86ac936640 1 --2- 172.21.15.87:0/4193891335 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f86a80fc700 0x7f86a810c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:16:57.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:57.362+0000 7f86ad137640 1 -- 172.21.15.87:0/4193891335 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f86a80fc700 msgr2=0x7f86a810c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:57.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:57.362+0000 7f86ad137640 1 --2- 172.21.15.87:0/4193891335 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f86a80fc700 0x7f86a810c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:57.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:57.362+0000 7f86ad137640 1 -- 172.21.15.87:0/4193891335 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f869c005040 con 0x7f86a80fb430 2024-09-17T07:16:57.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:57.362+0000 7f86ac936640 1 --2- 172.21.15.87:0/4193891335 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f86a80fc700 0x7f86a810c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T07:16:57.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:57.362+0000 7f86ad137640 1 --2- 172.21.15.87:0/4193891335 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86a80fb430 0x7f86a810bf00 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f86a400b790 tx=0x7f86a40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:16:57.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:57.362+0000 7f8699ffb640 1 -- 172.21.15.87:0/4193891335 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f86a400c700 con 0x7f86a80fb430 2024-09-17T07:16:57.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:57.362+0000 7f8699ffb640 1 -- 172.21.15.87:0/4193891335 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f86a400cce0 con 0x7f86a80fb430 2024-09-17T07:16:57.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:57.362+0000 7f86af39b640 1 -- 172.21.15.87:0/4193891335 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86a810d700 con 0x7f86a80fb430 2024-09-17T07:16:57.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:57.362+0000 7f8699ffb640 1 -- 172.21.15.87:0/4193891335 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f86a4015e10 con 0x7f86a80fb430 2024-09-17T07:16:57.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:57.363+0000 7f86af39b640 1 -- 172.21.15.87:0/4193891335 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86a810dc20 con 0x7f86a80fb430 2024-09-17T07:16:57.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:57.363+0000 7f86af39b640 1 -- 172.21.15.87:0/4193891335 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86a8104580 con 0x7f86a80fb430 2024-09-17T07:16:57.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:57.364+0000 7f8699ffb640 1 -- 172.21.15.87:0/4193891335 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f86a4012070 con 0x7f86a80fb430 2024-09-17T07:16:57.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:57.364+0000 7f8699ffb640 1 --2- 172.21.15.87:0/4193891335 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f869406ed60 0x7f8694071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:16:57.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:57.364+0000 7f8699ffb640 1 -- 172.21.15.87:0/4193891335 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f86a408da00 con 0x7f86a80fb430 2024-09-17T07:16:57.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:57.364+0000 7f86ac936640 1 --2- 172.21.15.87:0/4193891335 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f869406ed60 0x7f8694071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:16:57.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:57.365+0000 7f86ac936640 1 --2- 172.21.15.87:0/4193891335 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f869406ed60 0x7f8694071210 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f869c009ac0 tx=0x7f869c009da0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:16:57.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:57.368+0000 7f8699ffb640 1 -- 172.21.15.87:0/4193891335 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f86a405ae60 con 0x7f86a80fb430 2024-09-17T07:16:57.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:57.523+0000 7f86af39b640 1 -- 172.21.15.87:0/4193891335 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) v1 -- 0x7f86a80fa890 con 0x7f86a80fb430 2024-09-17T07:16:57.528 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:57.527+0000 7f8699ffb640 1 -- 172.21.15.87:0/4193891335 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v20)=0 v20) v1 ==== 143+0+0 (secure 0 0 0) 0x7f86a405a800 con 0x7f86a80fb430 2024-09-17T07:16:57.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:57.530+0000 7f86af39b640 1 -- 172.21.15.87:0/4193891335 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f869406ed60 msgr2=0x7f8694071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:57.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:57.530+0000 7f86af39b640 1 --2- 172.21.15.87:0/4193891335 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f869406ed60 0x7f8694071210 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f869c009ac0 tx=0x7f869c009da0 comp rx=0 tx=0).stop 2024-09-17T07:16:57.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:57.530+0000 7f86af39b640 1 -- 172.21.15.87:0/4193891335 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86a80fb430 msgr2=0x7f86a810bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:16:57.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:57.530+0000 7f86af39b640 1 --2- 172.21.15.87:0/4193891335 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86a80fb430 0x7f86a810bf00 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f86a400b790 tx=0x7f86a40091d0 comp rx=0 tx=0).stop 2024-09-17T07:16:57.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:57.530+0000 7f86af39b640 1 -- 172.21.15.87:0/4193891335 shutdown_connections 2024-09-17T07:16:57.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:57.530+0000 7f86af39b640 1 --2- 172.21.15.87:0/4193891335 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f869406ed60 0x7f8694071210 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:57.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:57.530+0000 7f86af39b640 1 --2- 172.21.15.87:0/4193891335 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f86a80fc700 0x7f86a810c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:57.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:57.530+0000 7f86af39b640 1 --2- 172.21.15.87:0/4193891335 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86a80fb430 0x7f86a810bf00 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:16:57.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:57.530+0000 7f86af39b640 1 -- 172.21.15.87:0/4193891335 >> 172.21.15.87:0/4193891335 conn(0x7f86a80f6c10 msgr2=0x7f86a80f8440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:16:57.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:57.530+0000 7f86af39b640 1 -- 172.21.15.87:0/4193891335 shutdown_connections 2024-09-17T07:16:57.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:16:57.530+0000 7f86af39b640 1 -- 172.21.15.87:0/4193891335 wait complete. 2024-09-17T07:16:57.834 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:16:57 smithi087 ceph-mon[27636]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T07:16:57.834 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:16:57 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/4193891335' entity='client.admin' 2024-09-17T07:16:57.834 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:16:57 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:16:58.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:16:57 smithi139 ceph-mon[34403]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T07:16:58.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:16:57 smithi139 ceph-mon[34403]: from='client.? 172.21.15.87:0/4193891335' entity='client.admin' 2024-09-17T07:16:58.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:16:57 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:16:58.166 INFO:teuthology.run_tasks:Running task print... 2024-09-17T07:16:58.177 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-09-17T07:16:58.177 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-17T07:16:58.198 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi087.front.sepia.ceph.com 2024-09-17T07:16:58.198 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -- bash -c 'ceph orch status' 2024-09-17T07:16:58.447 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/mon.smithi087/config 2024-09-17T07:16:59.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:16:58 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:16:59.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:16:58 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:16:59.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:16:58 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:16:59.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:16:58 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:16:59.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:16:58 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:16:59.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:16:58 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:17:00.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:00.049+0000 7f02f3521640 1 -- 172.21.15.87:0/3853921050 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f02ec0fca30 msgr2=0x7f02ec0fce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:00.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:00.049+0000 7f02f3521640 1 --2- 172.21.15.87:0/3853921050 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f02ec0fca30 0x7f02ec0fce40 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f02dc0048d0 tx=0x7f02dc009da0 comp rx=0 tx=0).stop 2024-09-17T07:17:00.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:00.049+0000 7f02f3521640 1 -- 172.21.15.87:0/3853921050 shutdown_connections 2024-09-17T07:17:00.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:00.049+0000 7f02f3521640 1 --2- 172.21.15.87:0/3853921050 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f02ec0fd380 0x7f02ec0fb7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:00.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:00.049+0000 7f02f3521640 1 --2- 172.21.15.87:0/3853921050 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f02ec0fca30 0x7f02ec0fce40 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:00.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:00.049+0000 7f02f3521640 1 -- 172.21.15.87:0/3853921050 >> 172.21.15.87:0/3853921050 conn(0x7f02ec0f6390 msgr2=0x7f02ec0f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:17:00.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:00.049+0000 7f02f3521640 1 -- 172.21.15.87:0/3853921050 shutdown_connections 2024-09-17T07:17:00.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:00.049+0000 7f02f3521640 1 -- 172.21.15.87:0/3853921050 wait complete. 2024-09-17T07:17:00.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:00.049+0000 7f02f3521640 1 Processor -- start 2024-09-17T07:17:00.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:00.049+0000 7f02f3521640 1 -- start start 2024-09-17T07:17:00.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:00.050+0000 7f02f3521640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f02ec0fca30 0x7f02ec10bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:17:00.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:00.050+0000 7f02f3521640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f02ec0fd380 0x7f02ec10c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:17:00.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:00.050+0000 7f02f3521640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02ec10cab0 con 0x7f02ec0fca30 2024-09-17T07:17:00.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:00.050+0000 7f02f3521640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02ec10d280 con 0x7f02ec0fd380 2024-09-17T07:17:00.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:00.050+0000 7f02f12bd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f02ec0fca30 0x7f02ec10bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:17:00.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:00.050+0000 7f02f12bd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f02ec0fca30 0x7f02ec10bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:50724/0 (socket says 172.21.15.87:50724) 2024-09-17T07:17:00.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:00.050+0000 7f02f12bd640 1 -- 172.21.15.87:0/2980304046 learned_addr learned my addr 172.21.15.87:0/2980304046 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:17:00.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:00.050+0000 7f02f0abc640 1 --2- 172.21.15.87:0/2980304046 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f02ec0fd380 0x7f02ec10c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:17:00.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:00.050+0000 7f02f12bd640 1 -- 172.21.15.87:0/2980304046 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f02ec0fd380 msgr2=0x7f02ec10c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:00.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:00.050+0000 7f02f12bd640 1 --2- 172.21.15.87:0/2980304046 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f02ec0fd380 0x7f02ec10c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:00.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:00.050+0000 7f02f12bd640 1 -- 172.21.15.87:0/2980304046 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02dc005040 con 0x7f02ec0fca30 2024-09-17T07:17:00.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:00.050+0000 7f02f12bd640 1 --2- 172.21.15.87:0/2980304046 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f02ec0fca30 0x7f02ec10bf20 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f02dc009ac0 tx=0x7f02dc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:17:00.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:00.050+0000 7f02e1ffb640 1 -- 172.21.15.87:0/2980304046 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f02dc03a070 con 0x7f02ec0fca30 2024-09-17T07:17:00.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:00.050+0000 7f02e1ffb640 1 -- 172.21.15.87:0/2980304046 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f02dc009750 con 0x7f02ec0fca30 2024-09-17T07:17:00.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:00.050+0000 7f02f3521640 1 -- 172.21.15.87:0/2980304046 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02ec10d4b0 con 0x7f02ec0fca30 2024-09-17T07:17:00.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:00.050+0000 7f02e1ffb640 1 -- 172.21.15.87:0/2980304046 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f02dc033930 con 0x7f02ec0fca30 2024-09-17T07:17:00.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:00.051+0000 7f02f3521640 1 -- 172.21.15.87:0/2980304046 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02ec10da50 con 0x7f02ec0fca30 2024-09-17T07:17:00.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:00.052+0000 7f02f3521640 1 -- 172.21.15.87:0/2980304046 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02ec04b720 con 0x7f02ec0fca30 2024-09-17T07:17:00.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:00.052+0000 7f02e1ffb640 1 -- 172.21.15.87:0/2980304046 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f02dc030020 con 0x7f02ec0fca30 2024-09-17T07:17:00.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:00.052+0000 7f02e1ffb640 1 --2- 172.21.15.87:0/2980304046 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f02d806ed60 0x7f02d8071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:17:00.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:00.053+0000 7f02e1ffb640 1 -- 172.21.15.87:0/2980304046 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f02dc0b05a0 con 0x7f02ec0fca30 2024-09-17T07:17:00.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:00.053+0000 7f02f0abc640 1 --2- 172.21.15.87:0/2980304046 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f02d806ed60 0x7f02d8071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:17:00.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:00.053+0000 7f02f0abc640 1 --2- 172.21.15.87:0/2980304046 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f02d806ed60 0x7f02d8071210 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f02ec10bcd0 tx=0x7f02e800b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:17:00.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:00.057+0000 7f02e1ffb640 1 -- 172.21.15.87:0/2980304046 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f02dc07da80 con 0x7f02ec0fca30 2024-09-17T07:17:00.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:00.232+0000 7f02f3521640 1 -- 172.21.15.87:0/2980304046 --> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f02ec10e100 con 0x7f02d806ed60 2024-09-17T07:17:00.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:00.234+0000 7f02e1ffb640 1 -- 172.21.15.87:0/2980304046 <== mgr.14208 v2:172.21.15.87:6800/611048628 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f02ec10e100 con 0x7f02d806ed60 2024-09-17T07:17:00.235 INFO:teuthology.orchestra.run.smithi087.stdout:Backend: cephadm 2024-09-17T07:17:00.235 INFO:teuthology.orchestra.run.smithi087.stdout:Available: Yes 2024-09-17T07:17:00.235 INFO:teuthology.orchestra.run.smithi087.stdout:Paused: No 2024-09-17T07:17:00.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:00.235+0000 7f02f3521640 1 -- 172.21.15.87:0/2980304046 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f02d806ed60 msgr2=0x7f02d8071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:00.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:00.235+0000 7f02f3521640 1 --2- 172.21.15.87:0/2980304046 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f02d806ed60 0x7f02d8071210 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f02ec10bcd0 tx=0x7f02e800b040 comp rx=0 tx=0).stop 2024-09-17T07:17:00.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:00.235+0000 7f02f3521640 1 -- 172.21.15.87:0/2980304046 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f02ec0fca30 msgr2=0x7f02ec10bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:00.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:00.235+0000 7f02f3521640 1 --2- 172.21.15.87:0/2980304046 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f02ec0fca30 0x7f02ec10bf20 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f02dc009ac0 tx=0x7f02dc009da0 comp rx=0 tx=0).stop 2024-09-17T07:17:00.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:00.236+0000 7f02f3521640 1 -- 172.21.15.87:0/2980304046 shutdown_connections 2024-09-17T07:17:00.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:00.236+0000 7f02f3521640 1 --2- 172.21.15.87:0/2980304046 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f02d806ed60 0x7f02d8071210 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:00.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:00.236+0000 7f02f3521640 1 --2- 172.21.15.87:0/2980304046 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f02ec0fd380 0x7f02ec10c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:00.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:00.236+0000 7f02f3521640 1 --2- 172.21.15.87:0/2980304046 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f02ec0fca30 0x7f02ec10bf20 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:00.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:00.236+0000 7f02f3521640 1 -- 172.21.15.87:0/2980304046 >> 172.21.15.87:0/2980304046 conn(0x7f02ec0f6390 msgr2=0x7f02ec0ffb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:17:00.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:00.236+0000 7f02f3521640 1 -- 172.21.15.87:0/2980304046 shutdown_connections 2024-09-17T07:17:00.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:00.236+0000 7f02f3521640 1 -- 172.21.15.87:0/2980304046 wait complete. 2024-09-17T07:17:00.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:00 smithi087 ceph-mon[27636]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T07:17:00.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:00 smithi139 ceph-mon[34403]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T07:17:00.968 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-17T07:17:01.215 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/mon.smithi087/config 2024-09-17T07:17:01.579 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:01 smithi087 ceph-mon[27636]: from='client.14434 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:17:01.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:01 smithi139 ceph-mon[34403]: from='client.14434 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:17:02.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:02 smithi139 ceph-mon[34403]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T07:17:02.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:02 smithi087 ceph-mon[27636]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T07:17:02.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:02.862+0000 7f1711681640 1 -- 172.21.15.87:0/2223298533 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f170c0fb430 msgr2=0x7f170c0fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:02.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:02.862+0000 7f1711681640 1 --2- 172.21.15.87:0/2223298533 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f170c0fb430 0x7f170c0fb840 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f16fc0048d0 tx=0x7f16fc009da0 comp rx=0 tx=0).stop 2024-09-17T07:17:02.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:02.862+0000 7f1711681640 1 -- 172.21.15.87:0/2223298533 shutdown_connections 2024-09-17T07:17:02.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:02.862+0000 7f1711681640 1 --2- 172.21.15.87:0/2223298533 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f170c0fc700 0x7f170c0fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:02.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:02.862+0000 7f1711681640 1 --2- 172.21.15.87:0/2223298533 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f170c0fb430 0x7f170c0fb840 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:02.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:02.862+0000 7f1711681640 1 -- 172.21.15.87:0/2223298533 >> 172.21.15.87:0/2223298533 conn(0x7f170c0f6c10 msgr2=0x7f170c0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:17:02.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:02.862+0000 7f1711681640 1 -- 172.21.15.87:0/2223298533 shutdown_connections 2024-09-17T07:17:02.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:02.862+0000 7f1711681640 1 -- 172.21.15.87:0/2223298533 wait complete. 2024-09-17T07:17:02.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:02.863+0000 7f1711681640 1 Processor -- start 2024-09-17T07:17:02.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:02.863+0000 7f1711681640 1 -- start start 2024-09-17T07:17:02.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:02.863+0000 7f1711681640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f170c0fb430 0x7f170c112140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:17:02.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:02.863+0000 7f1711681640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f170c0fc700 0x7f170c114690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:17:02.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:02.863+0000 7f1711681640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f170c065ba0 con 0x7f170c0fb430 2024-09-17T07:17:02.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:02.863+0000 7f1711681640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f170c065d10 con 0x7f170c0fc700 2024-09-17T07:17:02.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:02.863+0000 7f170affd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f170c0fb430 0x7f170c112140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:17:02.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:02.863+0000 7f170affd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f170c0fb430 0x7f170c112140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:50742/0 (socket says 172.21.15.87:50742) 2024-09-17T07:17:02.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:02.863+0000 7f170affd640 1 -- 172.21.15.87:0/3880839024 learned_addr learned my addr 172.21.15.87:0/3880839024 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:17:02.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:02.863+0000 7f170affd640 1 -- 172.21.15.87:0/3880839024 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f170c0fc700 msgr2=0x7f170c114690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:02.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:02.863+0000 7f170a7fc640 1 --2- 172.21.15.87:0/3880839024 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f170c0fc700 0x7f170c114690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:17:02.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:02.863+0000 7f170affd640 1 --2- 172.21.15.87:0/3880839024 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f170c0fc700 0x7f170c114690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:02.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:02.863+0000 7f170affd640 1 -- 172.21.15.87:0/3880839024 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16fc005040 con 0x7f170c0fb430 2024-09-17T07:17:02.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:02.863+0000 7f170a7fc640 1 --2- 172.21.15.87:0/3880839024 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f170c0fc700 0x7f170c114690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T07:17:02.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:02.864+0000 7f170affd640 1 --2- 172.21.15.87:0/3880839024 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f170c0fb430 0x7f170c112140 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f16fc009ac0 tx=0x7f16fc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:17:02.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:02.864+0000 7f16f37fe640 1 -- 172.21.15.87:0/3880839024 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16fc038070 con 0x7f170c0fb430 2024-09-17T07:17:02.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:02.864+0000 7f1711681640 1 -- 172.21.15.87:0/3880839024 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f170c114bd0 con 0x7f170c0fb430 2024-09-17T07:17:02.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:02.864+0000 7f16f37fe640 1 -- 172.21.15.87:0/3880839024 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f16fc02ae70 con 0x7f170c0fb430 2024-09-17T07:17:02.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:02.864+0000 7f16f37fe640 1 -- 172.21.15.87:0/3880839024 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16fc033420 con 0x7f170c0fb430 2024-09-17T07:17:02.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:02.864+0000 7f1711681640 1 -- 172.21.15.87:0/3880839024 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f170c114f50 con 0x7f170c0fb430 2024-09-17T07:17:02.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:02.865+0000 7f1711681640 1 -- 172.21.15.87:0/3880839024 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f170c0fa890 con 0x7f170c0fb430 2024-09-17T07:17:02.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:02.865+0000 7f16f37fe640 1 -- 172.21.15.87:0/3880839024 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f16fc030020 con 0x7f170c0fb430 2024-09-17T07:17:02.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:02.866+0000 7f16f37fe640 1 --2- 172.21.15.87:0/3880839024 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f16f406ed60 0x7f16f4071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:17:02.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:02.866+0000 7f16f37fe640 1 -- 172.21.15.87:0/3880839024 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f16fc0ade50 con 0x7f170c0fb430 2024-09-17T07:17:02.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:02.866+0000 7f170a7fc640 1 --2- 172.21.15.87:0/3880839024 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f16f406ed60 0x7f16f4071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:17:02.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:02.866+0000 7f170a7fc640 1 --2- 172.21.15.87:0/3880839024 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f16f406ed60 0x7f16f4071210 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1700006fd0 tx=0x7f1700008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:17:02.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:02.870+0000 7f16f37fe640 1 -- 172.21.15.87:0/3880839024 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f16fc07b2b0 con 0x7f170c0fb430 2024-09-17T07:17:03.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:03.033+0000 7f1711681640 1 -- 172.21.15.87:0/3880839024 --> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f170c100ba0 con 0x7f16f406ed60 2024-09-17T07:17:03.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:03.040+0000 7f16f37fe640 1 -- 172.21.15.87:0/3880839024 <== mgr.14208 v2:172.21.15.87:6800/611048628 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2808 (secure 0 0 0) 0x7f170c100ba0 con 0x7f16f406ed60 2024-09-17T07:17:03.042 INFO:teuthology.orchestra.run.smithi087.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T07:17:03.042 INFO:teuthology.orchestra.run.smithi087.stdout:alertmanager.smithi087 smithi087 *:9093,9094 running (3m) 2m ago 4m 26.7M - 0.25.0 c8568f914cd2 3495eb97bded 2024-09-17T07:17:03.042 INFO:teuthology.orchestra.run.smithi087.stdout:crash.smithi087 smithi087 running (5m) 2m ago 5m 6891k - 17.2.7-1635-g4a704134 f22ead590bad d9aaf9839ada 2024-09-17T07:17:03.042 INFO:teuthology.orchestra.run.smithi087.stdout:crash.smithi139 smithi139 running (4m) 65s ago 4m 6895k - 17.2.7-1635-g4a704134 f22ead590bad 354c853b318f 2024-09-17T07:17:03.042 INFO:teuthology.orchestra.run.smithi087.stdout:grafana.smithi087 smithi087 *:3000 running (3m) 2m ago 4m 79.7M - 9.4.7 954c08fa6188 738589686a89 2024-09-17T07:17:03.042 INFO:teuthology.orchestra.run.smithi087.stdout:mgr.smithi087.vuvjer smithi087 *:9283,8765,8443 running (6m) 2m ago 6m 441M - 17.2.7-1635-g4a704134 f22ead590bad 11130bf9b46c 2024-09-17T07:17:03.042 INFO:teuthology.orchestra.run.smithi087.stdout:mgr.smithi139.tuqnpn smithi139 *:8443,9283 running (4m) 65s ago 4m 399M - 17.2.7-1635-g4a704134 f22ead590bad c3789399d221 2024-09-17T07:17:03.042 INFO:teuthology.orchestra.run.smithi087.stdout:mon.smithi087 smithi087 running (6m) 2m ago 6m 45.6M 2048M 17.2.7-1635-g4a704134 f22ead590bad 175785e1fb86 2024-09-17T07:17:03.042 INFO:teuthology.orchestra.run.smithi087.stdout:mon.smithi139 smithi139 running (4m) 65s ago 4m 39.0M 2048M 17.2.7-1635-g4a704134 f22ead590bad a9a2552dc411 2024-09-17T07:17:03.042 INFO:teuthology.orchestra.run.smithi087.stdout:node-exporter.smithi087 smithi087 *:9100 running (5m) 2m ago 5m 14.0M - 1.5.0 0da6a335fe13 3e2035b992bc 2024-09-17T07:17:03.043 INFO:teuthology.orchestra.run.smithi087.stdout:node-exporter.smithi139 smithi139 *:9100 running (4m) 65s ago 4m 15.6M - 1.5.0 0da6a335fe13 291c1abbb415 2024-09-17T07:17:03.043 INFO:teuthology.orchestra.run.smithi087.stdout:osd.0 smithi087 running (3m) 2m ago 3m 38.2M 4288M 17.2.7-1635-g4a704134 f22ead590bad 396801f9b539 2024-09-17T07:17:03.043 INFO:teuthology.orchestra.run.smithi087.stdout:osd.1 smithi087 running (2m) 2m ago 2m 37.1M 4288M 17.2.7-1635-g4a704134 f22ead590bad 9446985bfcd1 2024-09-17T07:17:03.043 INFO:teuthology.orchestra.run.smithi087.stdout:osd.2 smithi087 running (2m) 2m ago 2m 37.3M 4288M 17.2.7-1635-g4a704134 f22ead590bad 8fe1428a6878 2024-09-17T07:17:03.043 INFO:teuthology.orchestra.run.smithi087.stdout:osd.3 smithi139 running (2m) 65s ago 119s 38.8M 5312M 17.2.7-1635-g4a704134 f22ead590bad 0801999b17c4 2024-09-17T07:17:03.043 INFO:teuthology.orchestra.run.smithi087.stdout:osd.4 smithi139 running (95s) 65s ago 94s 37.0M 5312M 17.2.7-1635-g4a704134 f22ead590bad 299a8dfc47f5 2024-09-17T07:17:03.043 INFO:teuthology.orchestra.run.smithi087.stdout:osd.5 smithi139 running (69s) 65s ago 69s 11.3M 5312M 17.2.7-1635-g4a704134 f22ead590bad 609cf74f32e7 2024-09-17T07:17:03.043 INFO:teuthology.orchestra.run.smithi087.stdout:prometheus.smithi087 smithi087 *:9095 running (3m) 2m ago 4m 37.8M - 2.43.0 a07b618ecd1d 2c4f73cf5937 2024-09-17T07:17:03.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:03.042+0000 7f1711681640 1 -- 172.21.15.87:0/3880839024 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f16f406ed60 msgr2=0x7f16f4071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:03.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:03.042+0000 7f1711681640 1 --2- 172.21.15.87:0/3880839024 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f16f406ed60 0x7f16f4071210 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1700006fd0 tx=0x7f1700008040 comp rx=0 tx=0).stop 2024-09-17T07:17:03.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:03.042+0000 7f1711681640 1 -- 172.21.15.87:0/3880839024 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f170c0fb430 msgr2=0x7f170c112140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:03.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:03.042+0000 7f1711681640 1 --2- 172.21.15.87:0/3880839024 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f170c0fb430 0x7f170c112140 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f16fc009ac0 tx=0x7f16fc009da0 comp rx=0 tx=0).stop 2024-09-17T07:17:03.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:03.042+0000 7f1711681640 1 -- 172.21.15.87:0/3880839024 shutdown_connections 2024-09-17T07:17:03.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:03.042+0000 7f1711681640 1 --2- 172.21.15.87:0/3880839024 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f16f406ed60 0x7f16f4071210 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:03.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:03.042+0000 7f1711681640 1 --2- 172.21.15.87:0/3880839024 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f170c0fc700 0x7f170c114690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:03.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:03.042+0000 7f1711681640 1 --2- 172.21.15.87:0/3880839024 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f170c0fb430 0x7f170c112140 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:03.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:03.042+0000 7f1711681640 1 -- 172.21.15.87:0/3880839024 >> 172.21.15.87:0/3880839024 conn(0x7f170c0f6c10 msgr2=0x7f170c0f8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:17:03.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:03.043+0000 7f1711681640 1 -- 172.21.15.87:0/3880839024 shutdown_connections 2024-09-17T07:17:03.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:03.043+0000 7f1711681640 1 -- 172.21.15.87:0/3880839024 wait complete. 2024-09-17T07:17:03.790 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-17T07:17:04.034 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/mon.smithi087/config 2024-09-17T07:17:04.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:04 smithi087 ceph-mon[27636]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T07:17:04.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:04 smithi087 ceph-mon[27636]: from='client.14438 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:17:04.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:04 smithi139 ceph-mon[34403]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T07:17:04.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:04 smithi139 ceph-mon[34403]: from='client.14438 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:17:05.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:05.565+0000 7fa56fdb0640 1 -- 172.21.15.87:0/3815229701 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa5680fc550 msgr2=0x7fa5680fc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:05.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:05.565+0000 7fa56fdb0640 1 --2- 172.21.15.87:0/3815229701 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa5680fc550 0x7fa5680fc960 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa5640048d0 tx=0x7fa564009da0 comp rx=0 tx=0).stop 2024-09-17T07:17:05.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:05.565+0000 7fa56fdb0640 1 -- 172.21.15.87:0/3815229701 shutdown_connections 2024-09-17T07:17:05.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:05.565+0000 7fa56fdb0640 1 --2- 172.21.15.87:0/3815229701 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa5680fd820 0x7fa5680fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:05.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:05.565+0000 7fa56fdb0640 1 --2- 172.21.15.87:0/3815229701 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa5680fc550 0x7fa5680fc960 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:05.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:05.565+0000 7fa56fdb0640 1 -- 172.21.15.87:0/3815229701 >> 172.21.15.87:0/3815229701 conn(0x7fa5680f7d30 msgr2=0x7fa5680fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:17:05.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:05.565+0000 7fa56fdb0640 1 -- 172.21.15.87:0/3815229701 shutdown_connections 2024-09-17T07:17:05.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:05.565+0000 7fa56fdb0640 1 -- 172.21.15.87:0/3815229701 wait complete. 2024-09-17T07:17:05.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:05.565+0000 7fa56fdb0640 1 Processor -- start 2024-09-17T07:17:05.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:05.566+0000 7fa56fdb0640 1 -- start start 2024-09-17T07:17:05.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:05.566+0000 7fa56fdb0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa5680fc550 0x7fa568071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:17:05.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:05.566+0000 7fa56fdb0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa5680fd820 0x7fa56806fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:17:05.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:05.566+0000 7fa56fdb0640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa56806fff0 con 0x7fa5680fc550 2024-09-17T07:17:05.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:05.566+0000 7fa56fdb0640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa568070130 con 0x7fa5680fd820 2024-09-17T07:17:05.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:05.566+0000 7fa56db4c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa5680fc550 0x7fa568071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:17:05.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:05.566+0000 7fa56db4c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa5680fc550 0x7fa568071570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:48884/0 (socket says 172.21.15.87:48884) 2024-09-17T07:17:05.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:05.566+0000 7fa56db4c640 1 -- 172.21.15.87:0/4162968676 learned_addr learned my addr 172.21.15.87:0/4162968676 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:17:05.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:05.566+0000 7fa56d34b640 1 --2- 172.21.15.87:0/4162968676 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa5680fd820 0x7fa56806fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:17:05.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:05.566+0000 7fa56db4c640 1 -- 172.21.15.87:0/4162968676 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa5680fd820 msgr2=0x7fa56806fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:05.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:05.566+0000 7fa56db4c640 1 --2- 172.21.15.87:0/4162968676 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa5680fd820 0x7fa56806fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:05.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:05.566+0000 7fa56db4c640 1 -- 172.21.15.87:0/4162968676 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa564005040 con 0x7fa5680fc550 2024-09-17T07:17:05.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:05.566+0000 7fa56db4c640 1 --2- 172.21.15.87:0/4162968676 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa5680fc550 0x7fa568071570 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa564009ac0 tx=0x7fa564009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:17:05.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:05.566+0000 7fa55e7fc640 1 -- 172.21.15.87:0/4162968676 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa564038070 con 0x7fa5680fc550 2024-09-17T07:17:05.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:05.566+0000 7fa56fdb0640 1 -- 172.21.15.87:0/4162968676 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5680703b0 con 0x7fa5680fc550 2024-09-17T07:17:05.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:05.566+0000 7fa55e7fc640 1 -- 172.21.15.87:0/4162968676 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fa56402ae70 con 0x7fa5680fc550 2024-09-17T07:17:05.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:05.567+0000 7fa55e7fc640 1 -- 172.21.15.87:0/4162968676 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa564033420 con 0x7fa5680fc550 2024-09-17T07:17:05.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:05.567+0000 7fa56fdb0640 1 -- 172.21.15.87:0/4162968676 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa568115010 con 0x7fa5680fc550 2024-09-17T07:17:05.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:05.568+0000 7fa56fdb0640 1 -- 172.21.15.87:0/4162968676 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5680fb9b0 con 0x7fa5680fc550 2024-09-17T07:17:05.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:05.568+0000 7fa55e7fc640 1 -- 172.21.15.87:0/4162968676 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fa564030020 con 0x7fa5680fc550 2024-09-17T07:17:05.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:05.568+0000 7fa55e7fc640 1 --2- 172.21.15.87:0/4162968676 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fa55406ed60 0x7fa554071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:17:05.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:05.568+0000 7fa55e7fc640 1 -- 172.21.15.87:0/4162968676 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fa5640ade50 con 0x7fa5680fc550 2024-09-17T07:17:05.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:05.568+0000 7fa56d34b640 1 --2- 172.21.15.87:0/4162968676 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fa55406ed60 0x7fa554071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:17:05.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:05.569+0000 7fa56d34b640 1 --2- 172.21.15.87:0/4162968676 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fa55406ed60 0x7fa554071210 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa5580041d0 tx=0x7fa558009040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:17:05.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:05.573+0000 7fa55e7fc640 1 -- 172.21.15.87:0/4162968676 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fa56407b2b0 con 0x7fa5680fc550 2024-09-17T07:17:05.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:05.735+0000 7fa56fdb0640 1 -- 172.21.15.87:0/4162968676 --> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fa568101d30 con 0x7fa55406ed60 2024-09-17T07:17:05.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:05.739+0000 7fa55e7fc640 1 -- 172.21.15.87:0/4162968676 <== mgr.14208 v2:172.21.15.87:6800/611048628 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1170 (secure 0 0 0) 0x7fa568101d30 con 0x7fa55406ed60 2024-09-17T07:17:05.740 INFO:teuthology.orchestra.run.smithi087.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-17T07:17:05.740 INFO:teuthology.orchestra.run.smithi087.stdout:alertmanager ?:9093,9094 1/1 2m ago 5m count:1 2024-09-17T07:17:05.740 INFO:teuthology.orchestra.run.smithi087.stdout:crash 2/2 2m ago 5m * 2024-09-17T07:17:05.741 INFO:teuthology.orchestra.run.smithi087.stdout:grafana ?:3000 1/1 2m ago 5m count:1 2024-09-17T07:17:05.741 INFO:teuthology.orchestra.run.smithi087.stdout:mgr 2/2 2m ago 5m count:2 2024-09-17T07:17:05.741 INFO:teuthology.orchestra.run.smithi087.stdout:mon 2/2 2m ago 4m smithi087:172.21.15.87=smithi087;smithi139:172.21.15.139=smithi139;count:2 2024-09-17T07:17:05.741 INFO:teuthology.orchestra.run.smithi087.stdout:node-exporter ?:9100 2/2 2m ago 5m * 2024-09-17T07:17:05.741 INFO:teuthology.orchestra.run.smithi087.stdout:osd 6 2m ago - 2024-09-17T07:17:05.742 INFO:teuthology.orchestra.run.smithi087.stdout:prometheus ?:9095 1/1 2m ago 5m count:1 2024-09-17T07:17:05.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:05.741+0000 7fa56fdb0640 1 -- 172.21.15.87:0/4162968676 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fa55406ed60 msgr2=0x7fa554071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:05.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:05.741+0000 7fa56fdb0640 1 --2- 172.21.15.87:0/4162968676 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fa55406ed60 0x7fa554071210 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa5580041d0 tx=0x7fa558009040 comp rx=0 tx=0).stop 2024-09-17T07:17:05.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:05.741+0000 7fa56fdb0640 1 -- 172.21.15.87:0/4162968676 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa5680fc550 msgr2=0x7fa568071570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:05.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:05.741+0000 7fa56fdb0640 1 --2- 172.21.15.87:0/4162968676 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa5680fc550 0x7fa568071570 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa564009ac0 tx=0x7fa564009da0 comp rx=0 tx=0).stop 2024-09-17T07:17:05.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:05.741+0000 7fa56fdb0640 1 -- 172.21.15.87:0/4162968676 shutdown_connections 2024-09-17T07:17:05.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:05.741+0000 7fa56fdb0640 1 --2- 172.21.15.87:0/4162968676 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fa55406ed60 0x7fa554071210 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:05.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:05.741+0000 7fa56fdb0640 1 --2- 172.21.15.87:0/4162968676 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa5680fd820 0x7fa56806fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:05.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:05.741+0000 7fa56fdb0640 1 --2- 172.21.15.87:0/4162968676 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa5680fc550 0x7fa568071570 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:05.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:05.741+0000 7fa56fdb0640 1 -- 172.21.15.87:0/4162968676 >> 172.21.15.87:0/4162968676 conn(0x7fa5680f7d30 msgr2=0x7fa5680f9640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:17:05.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:05.741+0000 7fa56fdb0640 1 -- 172.21.15.87:0/4162968676 shutdown_connections 2024-09-17T07:17:05.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:05.741+0000 7fa56fdb0640 1 -- 172.21.15.87:0/4162968676 wait complete. 2024-09-17T07:17:06.386 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-17T07:17:06.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:06 smithi139 ceph-mon[34403]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T07:17:06.638 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/mon.smithi087/config 2024-09-17T07:17:06.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:06 smithi087 ceph-mon[27636]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T07:17:07.618 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:07 smithi139 ceph-mon[34403]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:17:07.618 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:07 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:17:07.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:07 smithi087 ceph-mon[27636]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:17:07.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:07 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:17:08.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:08.179+0000 7f31a6df6640 1 -- 172.21.15.87:0/2591009393 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31a00fc520 msgr2=0x7f31a00fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:08.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:08.179+0000 7f31a6df6640 1 --2- 172.21.15.87:0/2591009393 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31a00fc520 0x7f31a00fc930 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3190009c50 tx=0x7f3190004d10 comp rx=0 tx=0).stop 2024-09-17T07:17:08.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:08.179+0000 7f31a6df6640 1 -- 172.21.15.87:0/2591009393 shutdown_connections 2024-09-17T07:17:08.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:08.179+0000 7f31a6df6640 1 --2- 172.21.15.87:0/2591009393 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f31a00fd7f0 0x7f31a00fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:08.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:08.179+0000 7f31a6df6640 1 --2- 172.21.15.87:0/2591009393 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31a00fc520 0x7f31a00fc930 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:08.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:08.179+0000 7f31a6df6640 1 -- 172.21.15.87:0/2591009393 >> 172.21.15.87:0/2591009393 conn(0x7f31a00f7ce0 msgr2=0x7f31a00fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:17:08.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:08.179+0000 7f31a6df6640 1 -- 172.21.15.87:0/2591009393 shutdown_connections 2024-09-17T07:17:08.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:08.179+0000 7f31a6df6640 1 -- 172.21.15.87:0/2591009393 wait complete. 2024-09-17T07:17:08.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:08.179+0000 7f31a6df6640 1 Processor -- start 2024-09-17T07:17:08.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:08.179+0000 7f31a6df6640 1 -- start start 2024-09-17T07:17:08.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:08.179+0000 7f31a6df6640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f31a00fc520 0x7f31a010cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:17:08.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:08.179+0000 7f31a6df6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31a00fd7f0 0x7f31a010d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:17:08.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:08.179+0000 7f31a6df6640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a010db80 con 0x7f31a00fd7f0 2024-09-17T07:17:08.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:08.179+0000 7f31a6df6640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a010e3a0 con 0x7f31a00fc520 2024-09-17T07:17:08.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:08.180+0000 7f319ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31a00fd7f0 0x7f31a010d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:17:08.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:08.180+0000 7f319ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31a00fd7f0 0x7f31a010d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:48904/0 (socket says 172.21.15.87:48904) 2024-09-17T07:17:08.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:08.180+0000 7f319ffff640 1 -- 172.21.15.87:0/4024475920 learned_addr learned my addr 172.21.15.87:0/4024475920 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:17:08.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:08.180+0000 7f31a4b92640 1 --2- 172.21.15.87:0/4024475920 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f31a00fc520 0x7f31a010cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:17:08.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:08.180+0000 7f319ffff640 1 -- 172.21.15.87:0/4024475920 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f31a00fc520 msgr2=0x7f31a010cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:08.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:08.180+0000 7f319ffff640 1 --2- 172.21.15.87:0/4024475920 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f31a00fc520 0x7f31a010cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:08.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:08.180+0000 7f319ffff640 1 -- 172.21.15.87:0/4024475920 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31900098b0 con 0x7f31a00fd7f0 2024-09-17T07:17:08.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:08.180+0000 7f319ffff640 1 --2- 172.21.15.87:0/4024475920 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31a00fd7f0 0x7f31a010d530 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3188002a50 tx=0x7f3188004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:17:08.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:08.180+0000 7f319d7fa640 1 -- 172.21.15.87:0/4024475920 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3188007c30 con 0x7f31a00fd7f0 2024-09-17T07:17:08.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:08.180+0000 7f319d7fa640 1 -- 172.21.15.87:0/4024475920 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f318800f040 con 0x7f31a00fd7f0 2024-09-17T07:17:08.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:08.180+0000 7f31a6df6640 1 -- 172.21.15.87:0/4024475920 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31a010e630 con 0x7f31a00fd7f0 2024-09-17T07:17:08.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:08.180+0000 7f319d7fa640 1 -- 172.21.15.87:0/4024475920 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f318800d990 con 0x7f31a00fd7f0 2024-09-17T07:17:08.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:08.180+0000 7f31a6df6640 1 -- 172.21.15.87:0/4024475920 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31a010ebd0 con 0x7f31a00fd7f0 2024-09-17T07:17:08.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:08.181+0000 7f31a6df6640 1 -- 172.21.15.87:0/4024475920 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31a00fb980 con 0x7f31a00fd7f0 2024-09-17T07:17:08.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:08.182+0000 7f319d7fa640 1 -- 172.21.15.87:0/4024475920 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f318800dc50 con 0x7f31a00fd7f0 2024-09-17T07:17:08.206 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:08.182+0000 7f319d7fa640 1 --2- 172.21.15.87:0/4024475920 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f318c06ed60 0x7f318c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:17:08.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:08.182+0000 7f319d7fa640 1 -- 172.21.15.87:0/4024475920 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f318808d780 con 0x7f31a00fd7f0 2024-09-17T07:17:08.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:08.182+0000 7f31a4b92640 1 --2- 172.21.15.87:0/4024475920 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f318c06ed60 0x7f318c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:17:08.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:08.183+0000 7f31a4b92640 1 --2- 172.21.15.87:0/4024475920 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f318c06ed60 0x7f318c071210 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3190000f80 tx=0x7f3190004d10 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:17:08.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:08.186+0000 7f319d7fa640 1 -- 172.21.15.87:0/4024475920 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f318804d2a0 con 0x7f31a00fd7f0 2024-09-17T07:17:08.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:08.348+0000 7f31a6df6640 1 -- 172.21.15.87:0/4024475920 --> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f31a010ef00 con 0x7f318c06ed60 2024-09-17T07:17:08.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:08.350+0000 7f319d7fa640 1 -- 172.21.15.87:0/4024475920 <== mgr.14208 v2:172.21.15.87:6800/611048628 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+148 (secure 0 0 0) 0x7f31a010ef00 con 0x7f318c06ed60 2024-09-17T07:17:08.351 INFO:teuthology.orchestra.run.smithi087.stdout:HOST ADDR LABELS STATUS 2024-09-17T07:17:08.351 INFO:teuthology.orchestra.run.smithi087.stdout:smithi087 172.21.15.87 2024-09-17T07:17:08.351 INFO:teuthology.orchestra.run.smithi087.stdout:smithi139 172.21.15.139 2024-09-17T07:17:08.351 INFO:teuthology.orchestra.run.smithi087.stdout:2 hosts in cluster 2024-09-17T07:17:08.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:08.352+0000 7f31a6df6640 1 -- 172.21.15.87:0/4024475920 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f318c06ed60 msgr2=0x7f318c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:08.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:08.352+0000 7f31a6df6640 1 --2- 172.21.15.87:0/4024475920 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f318c06ed60 0x7f318c071210 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3190000f80 tx=0x7f3190004d10 comp rx=0 tx=0).stop 2024-09-17T07:17:08.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:08.352+0000 7f31a6df6640 1 -- 172.21.15.87:0/4024475920 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31a00fd7f0 msgr2=0x7f31a010d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:08.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:08.352+0000 7f31a6df6640 1 --2- 172.21.15.87:0/4024475920 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31a00fd7f0 0x7f31a010d530 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3188002a50 tx=0x7f3188004600 comp rx=0 tx=0).stop 2024-09-17T07:17:08.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:08.352+0000 7f31a6df6640 1 -- 172.21.15.87:0/4024475920 shutdown_connections 2024-09-17T07:17:08.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:08.352+0000 7f31a6df6640 1 --2- 172.21.15.87:0/4024475920 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31a00fd7f0 0x7f31a010d530 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:08.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:08.352+0000 7f31a6df6640 1 --2- 172.21.15.87:0/4024475920 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f318c06ed60 0x7f318c071210 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:08.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:08.352+0000 7f31a6df6640 1 --2- 172.21.15.87:0/4024475920 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f31a00fc520 0x7f31a010cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:08.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:08.352+0000 7f31a6df6640 1 -- 172.21.15.87:0/4024475920 >> 172.21.15.87:0/4024475920 conn(0x7f31a00f7ce0 msgr2=0x7f31a00f9610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:17:08.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:08.352+0000 7f31a6df6640 1 -- 172.21.15.87:0/4024475920 shutdown_connections 2024-09-17T07:17:08.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:08.352+0000 7f31a6df6640 1 -- 172.21.15.87:0/4024475920 wait complete. 2024-09-17T07:17:08.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:08 smithi139 ceph-mon[34403]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T07:17:08.657 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:08 smithi087 ceph-mon[27636]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T07:17:08.998 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-17T07:17:09.241 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/mon.smithi087/config 2024-09-17T07:17:09.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:09 smithi139 ceph-mon[34403]: from='client.14446 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:17:09.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:09 smithi087 ceph-mon[27636]: from='client.14446 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:17:10.607 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:10 smithi087 ceph-mon[27636]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T07:17:10.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:10 smithi139 ceph-mon[34403]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T07:17:10.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:10.826+0000 7fb8bebfe640 1 -- 172.21.15.87:0/1482842745 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8b80fd820 msgr2=0x7fb8b80fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:10.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:10.826+0000 7fb8bebfe640 1 --2- 172.21.15.87:0/1482842745 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8b80fd820 0x7fb8b80fdc90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8009c50 tx=0x7fb8a8004d10 comp rx=0 tx=0).stop 2024-09-17T07:17:10.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:10.826+0000 7fb8bebfe640 1 -- 172.21.15.87:0/1482842745 shutdown_connections 2024-09-17T07:17:10.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:10.826+0000 7fb8bebfe640 1 --2- 172.21.15.87:0/1482842745 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8b80fd820 0x7fb8b80fdc90 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:10.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:10.826+0000 7fb8bebfe640 1 --2- 172.21.15.87:0/1482842745 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb8b80fc550 0x7fb8b80fc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:10.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:10.826+0000 7fb8bebfe640 1 -- 172.21.15.87:0/1482842745 >> 172.21.15.87:0/1482842745 conn(0x7fb8b80f7d30 msgr2=0x7fb8b80fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:17:10.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:10.826+0000 7fb8bebfe640 1 -- 172.21.15.87:0/1482842745 shutdown_connections 2024-09-17T07:17:10.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:10.826+0000 7fb8bebfe640 1 -- 172.21.15.87:0/1482842745 wait complete. 2024-09-17T07:17:10.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:10.826+0000 7fb8bebfe640 1 Processor -- start 2024-09-17T07:17:10.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:10.826+0000 7fb8bebfe640 1 -- start start 2024-09-17T07:17:10.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:10.826+0000 7fb8bebfe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8b80fc550 0x7fb8b810d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:17:10.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:10.826+0000 7fb8bebfe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb8b80fd820 0x7fb8b810d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:17:10.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:10.826+0000 7fb8bebfe640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b810e3f0 con 0x7fb8b80fc550 2024-09-17T07:17:10.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:10.826+0000 7fb8bebfe640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b810e560 con 0x7fb8b80fd820 2024-09-17T07:17:10.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:10.827+0000 7fb8bc99a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8b80fc550 0x7fb8b810d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:17:10.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:10.827+0000 7fb8bc99a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8b80fc550 0x7fb8b810d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:48922/0 (socket says 172.21.15.87:48922) 2024-09-17T07:17:10.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:10.827+0000 7fb8bc99a640 1 -- 172.21.15.87:0/1741727872 learned_addr learned my addr 172.21.15.87:0/1741727872 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:17:10.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:10.827+0000 7fb8b7fff640 1 --2- 172.21.15.87:0/1741727872 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb8b80fd820 0x7fb8b810d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:17:10.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:10.827+0000 7fb8bc99a640 1 -- 172.21.15.87:0/1741727872 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb8b80fd820 msgr2=0x7fb8b810d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:10.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:10.827+0000 7fb8bc99a640 1 --2- 172.21.15.87:0/1741727872 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb8b80fd820 0x7fb8b810d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:10.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:10.827+0000 7fb8bc99a640 1 -- 172.21.15.87:0/1741727872 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8a80098b0 con 0x7fb8b80fc550 2024-09-17T07:17:10.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:10.827+0000 7fb8bc99a640 1 --2- 172.21.15.87:0/1741727872 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8b80fc550 0x7fb8b810d040 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb8b000b790 tx=0x7fb8b00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:17:10.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:10.827+0000 7fb8b57fa640 1 -- 172.21.15.87:0/1741727872 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8b000c700 con 0x7fb8b80fc550 2024-09-17T07:17:10.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:10.827+0000 7fb8b57fa640 1 -- 172.21.15.87:0/1741727872 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fb8b000cce0 con 0x7fb8b80fc550 2024-09-17T07:17:10.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:10.827+0000 7fb8bebfe640 1 -- 172.21.15.87:0/1741727872 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8b810e840 con 0x7fb8b80fc550 2024-09-17T07:17:10.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:10.827+0000 7fb8b57fa640 1 -- 172.21.15.87:0/1741727872 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8b0015e10 con 0x7fb8b80fc550 2024-09-17T07:17:10.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:10.827+0000 7fb8bebfe640 1 -- 172.21.15.87:0/1741727872 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8b810ed60 con 0x7fb8b80fc550 2024-09-17T07:17:10.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:10.828+0000 7fb8bebfe640 1 -- 172.21.15.87:0/1741727872 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8b81056a0 con 0x7fb8b80fc550 2024-09-17T07:17:10.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:10.829+0000 7fb8b57fa640 1 -- 172.21.15.87:0/1741727872 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fb8b0012070 con 0x7fb8b80fc550 2024-09-17T07:17:10.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:10.829+0000 7fb8b57fa640 1 --2- 172.21.15.87:0/1741727872 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fb8a406ed60 0x7fb8a4071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:17:10.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:10.829+0000 7fb8b7fff640 1 --2- 172.21.15.87:0/1741727872 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fb8a406ed60 0x7fb8a4071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:17:10.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:10.829+0000 7fb8b57fa640 1 -- 172.21.15.87:0/1741727872 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fb8b008da00 con 0x7fb8b80fc550 2024-09-17T07:17:10.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:10.830+0000 7fb8b7fff640 1 --2- 172.21.15.87:0/1741727872 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fb8a406ed60 0x7fb8a4071210 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8032470 tx=0x7fb8a8004d10 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:17:10.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:10.834+0000 7fb8b57fa640 1 -- 172.21.15.87:0/1741727872 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fb8b005ae60 con 0x7fb8b80fc550 2024-09-17T07:17:10.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:10.995+0000 7fb8bebfe640 1 -- 172.21.15.87:0/1741727872 --> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fb8b810efe0 con 0x7fb8a406ed60 2024-09-17T07:17:10.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:10.996+0000 7fb8b57fa640 1 -- 172.21.15.87:0/1741727872 <== mgr.14208 v2:172.21.15.87:6800/611048628 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+399 (secure 0 0 0) 0x7fb8b810efe0 con 0x7fb8a406ed60 2024-09-17T07:17:10.997 INFO:teuthology.orchestra.run.smithi087.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-17T07:17:10.998 INFO:teuthology.orchestra.run.smithi087.stdout:smithi087 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400NQ400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-17T07:17:10.998 INFO:teuthology.orchestra.run.smithi087.stdout:smithi139 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620500N6400BGN 372G No 69s ago Has a FileSystem, LVM detected 2024-09-17T07:17:11.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:10.998+0000 7fb8bebfe640 1 -- 172.21.15.87:0/1741727872 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fb8a406ed60 msgr2=0x7fb8a4071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:11.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:10.998+0000 7fb8bebfe640 1 --2- 172.21.15.87:0/1741727872 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fb8a406ed60 0x7fb8a4071210 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8032470 tx=0x7fb8a8004d10 comp rx=0 tx=0).stop 2024-09-17T07:17:11.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:10.998+0000 7fb8bebfe640 1 -- 172.21.15.87:0/1741727872 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8b80fc550 msgr2=0x7fb8b810d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:11.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:10.998+0000 7fb8bebfe640 1 --2- 172.21.15.87:0/1741727872 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8b80fc550 0x7fb8b810d040 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb8b000b790 tx=0x7fb8b00091d0 comp rx=0 tx=0).stop 2024-09-17T07:17:11.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:10.998+0000 7fb8bebfe640 1 -- 172.21.15.87:0/1741727872 shutdown_connections 2024-09-17T07:17:11.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:10.998+0000 7fb8bebfe640 1 --2- 172.21.15.87:0/1741727872 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fb8a406ed60 0x7fb8a4071210 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:11.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:10.998+0000 7fb8bebfe640 1 --2- 172.21.15.87:0/1741727872 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb8b80fd820 0x7fb8b810d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:11.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:10.998+0000 7fb8bebfe640 1 --2- 172.21.15.87:0/1741727872 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8b80fc550 0x7fb8b810d040 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:11.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:10.998+0000 7fb8bebfe640 1 -- 172.21.15.87:0/1741727872 >> 172.21.15.87:0/1741727872 conn(0x7fb8b80f7d30 msgr2=0x7fb8b80f9590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:17:11.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:10.999+0000 7fb8bebfe640 1 -- 172.21.15.87:0/1741727872 shutdown_connections 2024-09-17T07:17:11.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:10.999+0000 7fb8bebfe640 1 -- 172.21.15.87:0/1741727872 wait complete. 2024-09-17T07:17:11.570 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-17T07:17:11.579 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi087.front.sepia.ceph.com 2024-09-17T07:17:11.579 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-09-17T07:17:11.823 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/mon.smithi087/config 2024-09-17T07:17:12.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:12 smithi139 ceph-mon[34403]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T07:17:12.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:12 smithi139 ceph-mon[34403]: from='client.14450 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:17:12.669 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:12 smithi087 ceph-mon[27636]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T07:17:12.670 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:12 smithi087 ceph-mon[27636]: from='client.14450 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:17:13.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:13.485+0000 7f0c49b51640 1 -- 172.21.15.87:0/3914937047 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0c440fd820 msgr2=0x7f0c440fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:13.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:13.485+0000 7f0c49b51640 1 --2- 172.21.15.87:0/3914937047 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0c440fd820 0x7f0c440fdc90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c0048d0 tx=0x7f0c2c009da0 comp rx=0 tx=0).stop 2024-09-17T07:17:13.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:13.485+0000 7f0c49b51640 1 -- 172.21.15.87:0/3914937047 shutdown_connections 2024-09-17T07:17:13.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:13.485+0000 7f0c49b51640 1 --2- 172.21.15.87:0/3914937047 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0c440fd820 0x7f0c440fdc90 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:13.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:13.485+0000 7f0c49b51640 1 --2- 172.21.15.87:0/3914937047 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0c440fc550 0x7f0c440fc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:13.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:13.485+0000 7f0c49b51640 1 -- 172.21.15.87:0/3914937047 >> 172.21.15.87:0/3914937047 conn(0x7f0c440f7d30 msgr2=0x7f0c440fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:17:13.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:13.485+0000 7f0c49b51640 1 -- 172.21.15.87:0/3914937047 shutdown_connections 2024-09-17T07:17:13.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:13.485+0000 7f0c49b51640 1 -- 172.21.15.87:0/3914937047 wait complete. 2024-09-17T07:17:13.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:13.485+0000 7f0c49b51640 1 Processor -- start 2024-09-17T07:17:13.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:13.486+0000 7f0c49b51640 1 -- start start 2024-09-17T07:17:13.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:13.486+0000 7f0c49b51640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0c440fc550 0x7f0c4410d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:17:13.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:13.486+0000 7f0c49b51640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0c440fd820 0x7f0c4410d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:17:13.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:13.486+0000 7f0c49b51640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4410e3f0 con 0x7f0c440fd820 2024-09-17T07:17:13.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:13.486+0000 7f0c49b51640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4410e560 con 0x7f0c440fc550 2024-09-17T07:17:13.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:13.486+0000 7f0c3affd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0c440fd820 0x7f0c4410d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:17:13.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:13.486+0000 7f0c3affd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0c440fd820 0x7f0c4410d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:48944/0 (socket says 172.21.15.87:48944) 2024-09-17T07:17:13.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:13.486+0000 7f0c3affd640 1 -- 172.21.15.87:0/1084245120 learned_addr learned my addr 172.21.15.87:0/1084245120 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:17:13.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:13.486+0000 7f0c437fe640 1 --2- 172.21.15.87:0/1084245120 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0c440fc550 0x7f0c4410d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:17:13.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:13.486+0000 7f0c3affd640 1 -- 172.21.15.87:0/1084245120 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0c440fc550 msgr2=0x7f0c4410d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:13.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:13.486+0000 7f0c3affd640 1 --2- 172.21.15.87:0/1084245120 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0c440fc550 0x7f0c4410d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:13.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:13.486+0000 7f0c3affd640 1 -- 172.21.15.87:0/1084245120 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c2c005040 con 0x7f0c440fd820 2024-09-17T07:17:13.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:13.486+0000 7f0c437fe640 1 --2- 172.21.15.87:0/1084245120 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0c440fc550 0x7f0c4410d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T07:17:13.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:13.486+0000 7f0c3affd640 1 --2- 172.21.15.87:0/1084245120 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0c440fd820 0x7f0c4410d580 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c009ac0 tx=0x7f0c2c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:17:13.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:13.487+0000 7f0c40ff9640 1 -- 172.21.15.87:0/1084245120 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c2c038070 con 0x7f0c440fd820 2024-09-17T07:17:13.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:13.487+0000 7f0c40ff9640 1 -- 172.21.15.87:0/1084245120 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f0c2c02ae70 con 0x7f0c440fd820 2024-09-17T07:17:13.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:13.487+0000 7f0c49b51640 1 -- 172.21.15.87:0/1084245120 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c4410e7e0 con 0x7f0c440fd820 2024-09-17T07:17:13.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:13.487+0000 7f0c40ff9640 1 -- 172.21.15.87:0/1084245120 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c2c033420 con 0x7f0c440fd820 2024-09-17T07:17:13.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:13.487+0000 7f0c49b51640 1 -- 172.21.15.87:0/1084245120 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c4410eca0 con 0x7f0c440fd820 2024-09-17T07:17:13.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:13.488+0000 7f0c49b51640 1 -- 172.21.15.87:0/1084245120 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c440fb9b0 con 0x7f0c440fd820 2024-09-17T07:17:13.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:13.488+0000 7f0c40ff9640 1 -- 172.21.15.87:0/1084245120 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f0c2c030020 con 0x7f0c440fd820 2024-09-17T07:17:13.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:13.489+0000 7f0c40ff9640 1 --2- 172.21.15.87:0/1084245120 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f0c3006ed60 0x7f0c30071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:17:13.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:13.489+0000 7f0c40ff9640 1 -- 172.21.15.87:0/1084245120 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f0c2c0addd0 con 0x7f0c440fd820 2024-09-17T07:17:13.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:13.489+0000 7f0c437fe640 1 --2- 172.21.15.87:0/1084245120 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f0c3006ed60 0x7f0c30071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:17:13.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:13.489+0000 7f0c437fe640 1 --2- 172.21.15.87:0/1084245120 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f0c3006ed60 0x7f0c30071210 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0c34006fd0 tx=0x7f0c34008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:17:13.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:13.493+0000 7f0c40ff9640 1 -- 172.21.15.87:0/1084245120 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f0c2c07b2b0 con 0x7f0c440fd820 2024-09-17T07:17:13.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:13.672+0000 7f0c49b51640 1 -- 172.21.15.87:0/1084245120 --> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f0c4410ef10 con 0x7f0c3006ed60 2024-09-17T07:17:14.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:14 smithi139 ceph-mon[34403]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T07:17:14.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:14 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-09-17T07:17:14.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:14 smithi087 ceph-mon[27636]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T07:17:14.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:14 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-09-17T07:17:15.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:15.390+0000 7f0c40ff9640 1 -- 172.21.15.87:0/1084245120 <== mgr.14208 v2:172.21.15.87:6800/611048628 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f0c4410ef10 con 0x7f0c3006ed60 2024-09-17T07:17:15.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:15.392+0000 7f0c49b51640 1 -- 172.21.15.87:0/1084245120 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f0c3006ed60 msgr2=0x7f0c30071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:15.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:15.392+0000 7f0c49b51640 1 --2- 172.21.15.87:0/1084245120 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f0c3006ed60 0x7f0c30071210 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0c34006fd0 tx=0x7f0c34008040 comp rx=0 tx=0).stop 2024-09-17T07:17:15.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:15.392+0000 7f0c49b51640 1 -- 172.21.15.87:0/1084245120 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0c440fd820 msgr2=0x7f0c4410d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:15.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:15.392+0000 7f0c49b51640 1 --2- 172.21.15.87:0/1084245120 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0c440fd820 0x7f0c4410d580 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c009ac0 tx=0x7f0c2c009da0 comp rx=0 tx=0).stop 2024-09-17T07:17:15.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:15.392+0000 7f0c49b51640 1 -- 172.21.15.87:0/1084245120 shutdown_connections 2024-09-17T07:17:15.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:15.392+0000 7f0c49b51640 1 --2- 172.21.15.87:0/1084245120 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0c440fd820 0x7f0c4410d580 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:15.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:15.392+0000 7f0c49b51640 1 --2- 172.21.15.87:0/1084245120 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f0c3006ed60 0x7f0c30071210 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:15.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:15.392+0000 7f0c49b51640 1 --2- 172.21.15.87:0/1084245120 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0c440fc550 0x7f0c4410d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:15.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:15.392+0000 7f0c49b51640 1 -- 172.21.15.87:0/1084245120 >> 172.21.15.87:0/1084245120 conn(0x7f0c440f7d30 msgr2=0x7f0c440f9590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:17:15.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:15.392+0000 7f0c49b51640 1 -- 172.21.15.87:0/1084245120 shutdown_connections 2024-09-17T07:17:15.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:15.392+0000 7f0c49b51640 1 -- 172.21.15.87:0/1084245120 wait complete. 2024-09-17T07:17:15.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:15 smithi139 ceph-mon[34403]: from='client.14454 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:17:15.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:15 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-17T07:17:15.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:15 smithi139 ceph-mon[34403]: osdmap e39: 6 total, 6 up, 6 in 2024-09-17T07:17:15.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:15 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-09-17T07:17:15.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:15 smithi087 ceph-mon[27636]: from='client.14454 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:17:15.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:15 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-17T07:17:15.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:15 smithi087 ceph-mon[27636]: osdmap e39: 6 total, 6 up, 6 in 2024-09-17T07:17:15.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:15 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-09-17T07:17:15.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:15 smithi087 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-mon-smithi087[27632]: 2024-09-17T07:17:15.368+0000 7f3da508c640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T07:17:16.195 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-17T07:17:16.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:16 smithi087 ceph-mon[27636]: pgmap v166: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T07:17:16.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:16 smithi087 ceph-mon[27636]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T07:17:16.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:16 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-17T07:17:16.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:16 smithi087 ceph-mon[27636]: osdmap e40: 6 total, 6 up, 6 in 2024-09-17T07:17:16.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:16 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-09-17T07:17:16.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:16 smithi087 ceph-mon[27636]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T07:17:16.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:16 smithi087 ceph-mon[27636]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-17T07:17:16.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:16 smithi087 ceph-mon[27636]: osdmap e41: 6 total, 6 up, 6 in 2024-09-17T07:17:16.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:16 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-17T07:17:16.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:16 smithi087 ceph-mon[27636]: fsmap cephfs:0 2024-09-17T07:17:16.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:16 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:17:16.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:16 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:17:16.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:16 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:17:16.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:16 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:17:16.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:16 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:17:16.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:16 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi087.vvbzss", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T07:17:16.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:16 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi087.vvbzss", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-17T07:17:16.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:16 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:17:16.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:16 smithi139 ceph-mon[34403]: pgmap v166: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T07:17:16.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:16 smithi139 ceph-mon[34403]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T07:17:16.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:16 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-17T07:17:16.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:16 smithi139 ceph-mon[34403]: osdmap e40: 6 total, 6 up, 6 in 2024-09-17T07:17:16.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:16 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-09-17T07:17:16.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:16 smithi139 ceph-mon[34403]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T07:17:16.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:16 smithi139 ceph-mon[34403]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-17T07:17:16.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:16 smithi139 ceph-mon[34403]: osdmap e41: 6 total, 6 up, 6 in 2024-09-17T07:17:16.618 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:16 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-17T07:17:16.618 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:16 smithi139 ceph-mon[34403]: fsmap cephfs:0 2024-09-17T07:17:16.618 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:16 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:17:16.618 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:16 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:17:16.618 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:16 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:17:16.618 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:16 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:17:16.618 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:16 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:17:16.618 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:16 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi087.vvbzss", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T07:17:16.618 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:16 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi087.vvbzss", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-17T07:17:16.618 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:16 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:17:17.384 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:17 smithi087 ceph-mon[27636]: Saving service mds.cephfs spec with placement count:4 2024-09-17T07:17:17.384 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:17 smithi087 ceph-mon[27636]: Deploying daemon mds.cephfs.smithi087.vvbzss on smithi087 2024-09-17T07:17:17.384 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:17 smithi087 ceph-mon[27636]: osdmap e42: 6 total, 6 up, 6 in 2024-09-17T07:17:17.425 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/mon.smithi087/config 2024-09-17T07:17:17.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:17 smithi139 ceph-mon[34403]: Saving service mds.cephfs spec with placement count:4 2024-09-17T07:17:17.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:17 smithi139 ceph-mon[34403]: Deploying daemon mds.cephfs.smithi087.vvbzss on smithi087 2024-09-17T07:17:17.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:17 smithi139 ceph-mon[34403]: osdmap e42: 6 total, 6 up, 6 in 2024-09-17T07:17:18.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:18 smithi139 ceph-mon[34403]: pgmap v170: 65 pgs: 23 active+clean, 9 creating+peering, 33 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T07:17:18.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:18 smithi139 ceph-mon[34403]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-17T07:17:18.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:18 smithi139 ceph-mon[34403]: osdmap e43: 6 total, 6 up, 6 in 2024-09-17T07:17:18.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:18 smithi087 ceph-mon[27636]: pgmap v170: 65 pgs: 23 active+clean, 9 creating+peering, 33 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T07:17:18.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:18 smithi087 ceph-mon[27636]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-17T07:17:18.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:18 smithi087 ceph-mon[27636]: osdmap e43: 6 total, 6 up, 6 in 2024-09-17T07:17:19.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:19.298+0000 7f5092182640 1 -- 172.21.15.87:0/2891329170 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f508c0fc550 msgr2=0x7f508c0fc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:19.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:19.298+0000 7f5092182640 1 --2- 172.21.15.87:0/2891329170 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f508c0fc550 0x7f508c0fc960 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f507c009c50 tx=0x7f507c004d10 comp rx=0 tx=0).stop 2024-09-17T07:17:19.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:19.298+0000 7f5092182640 1 -- 172.21.15.87:0/2891329170 shutdown_connections 2024-09-17T07:17:19.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:19.298+0000 7f5092182640 1 --2- 172.21.15.87:0/2891329170 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f508c0fd820 0x7f508c0fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:19.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:19.298+0000 7f5092182640 1 --2- 172.21.15.87:0/2891329170 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f508c0fc550 0x7f508c0fc960 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:19.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:19.298+0000 7f5092182640 1 -- 172.21.15.87:0/2891329170 >> 172.21.15.87:0/2891329170 conn(0x7f508c0f7d30 msgr2=0x7f508c0fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:17:19.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:19.298+0000 7f5092182640 1 -- 172.21.15.87:0/2891329170 shutdown_connections 2024-09-17T07:17:19.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:19.298+0000 7f5092182640 1 -- 172.21.15.87:0/2891329170 wait complete. 2024-09-17T07:17:19.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:19.298+0000 7f5092182640 1 Processor -- start 2024-09-17T07:17:19.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:19.298+0000 7f5092182640 1 -- start start 2024-09-17T07:17:19.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:19.298+0000 7f5092182640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f508c0fc550 0x7f508c10cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:17:19.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:19.298+0000 7f5092182640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f508c0fd820 0x7f508c10d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:17:19.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:19.299+0000 7f5092182640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f508c10db50 con 0x7f508c0fd820 2024-09-17T07:17:19.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:19.299+0000 7f5092182640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f508c10e370 con 0x7f508c0fc550 2024-09-17T07:17:19.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:19.299+0000 7f508affd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f508c0fd820 0x7f508c10d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:17:19.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:19.299+0000 7f508affd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f508c0fd820 0x7f508c10d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49774/0 (socket says 172.21.15.87:49774) 2024-09-17T07:17:19.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:19.299+0000 7f508affd640 1 -- 172.21.15.87:0/1614517868 learned_addr learned my addr 172.21.15.87:0/1614517868 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:17:19.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:19.299+0000 7f508b7fe640 1 --2- 172.21.15.87:0/1614517868 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f508c0fc550 0x7f508c10cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:17:19.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:19.299+0000 7f508affd640 1 -- 172.21.15.87:0/1614517868 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f508c0fc550 msgr2=0x7f508c10cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:19.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:19.299+0000 7f508affd640 1 --2- 172.21.15.87:0/1614517868 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f508c0fc550 0x7f508c10cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:19.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:19.299+0000 7f508affd640 1 -- 172.21.15.87:0/1614517868 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f507c0098b0 con 0x7f508c0fd820 2024-09-17T07:17:19.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:19.299+0000 7f508affd640 1 --2- 172.21.15.87:0/1614517868 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f508c0fd820 0x7f508c10d500 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5074002a50 tx=0x7f5074004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:17:19.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:19.299+0000 7f5083fff640 1 -- 172.21.15.87:0/1614517868 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5074007c30 con 0x7f508c0fd820 2024-09-17T07:17:19.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:19.299+0000 7f5083fff640 1 -- 172.21.15.87:0/1614517868 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f507400f040 con 0x7f508c0fd820 2024-09-17T07:17:19.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:19.299+0000 7f5092182640 1 -- 172.21.15.87:0/1614517868 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f508c10e600 con 0x7f508c0fd820 2024-09-17T07:17:19.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:19.299+0000 7f5083fff640 1 -- 172.21.15.87:0/1614517868 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f507400d990 con 0x7f508c0fd820 2024-09-17T07:17:19.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:19.299+0000 7f5092182640 1 -- 172.21.15.87:0/1614517868 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f508c10eba0 con 0x7f508c0fd820 2024-09-17T07:17:19.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:19.300+0000 7f5092182640 1 -- 172.21.15.87:0/1614517868 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f508c0fb9b0 con 0x7f508c0fd820 2024-09-17T07:17:19.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:19.301+0000 7f5083fff640 1 -- 172.21.15.87:0/1614517868 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f507400dc50 con 0x7f508c0fd820 2024-09-17T07:17:19.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:19.301+0000 7f5083fff640 1 --2- 172.21.15.87:0/1614517868 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f507806ed60 0x7f5078071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:17:19.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:19.301+0000 7f508b7fe640 1 --2- 172.21.15.87:0/1614517868 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f507806ed60 0x7f5078071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:17:19.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:19.301+0000 7f5083fff640 1 -- 172.21.15.87:0/1614517868 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f507408da10 con 0x7f508c0fd820 2024-09-17T07:17:19.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:19.302+0000 7f508b7fe640 1 --2- 172.21.15.87:0/1614517868 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f507806ed60 0x7f5078071210 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f507c000f80 tx=0x7f507c004d10 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:17:19.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:19.306+0000 7f5083fff640 1 -- 172.21.15.87:0/1614517868 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f507404d2a0 con 0x7f508c0fd820 2024-09-17T07:17:19.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:19.498+0000 7f5092182640 1 -- 172.21.15.87:0/1614517868 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f508c04b720 con 0x7f508c0fd820 2024-09-17T07:17:19.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:19.498+0000 7f5083fff640 1 -- 172.21.15.87:0/1614517868 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) v1 ==== 75+0+1076 (secure 0 0 0) 0x7f507405aca0 con 0x7f508c0fd820 2024-09-17T07:17:19.500 INFO:teuthology.orchestra.run.smithi087.stdout:e2 2024-09-17T07:17:19.500 INFO:teuthology.orchestra.run.smithi087.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T07:17:19.500 INFO:teuthology.orchestra.run.smithi087.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T07:17:19.500 INFO:teuthology.orchestra.run.smithi087.stdout:legacy client fscid: 1 2024-09-17T07:17:19.500 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:17:19.500 INFO:teuthology.orchestra.run.smithi087.stdout:Filesystem 'cephfs' (1) 2024-09-17T07:17:19.500 INFO:teuthology.orchestra.run.smithi087.stdout:fs_name cephfs 2024-09-17T07:17:19.500 INFO:teuthology.orchestra.run.smithi087.stdout:epoch 2 2024-09-17T07:17:19.500 INFO:teuthology.orchestra.run.smithi087.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-17T07:17:19.501 INFO:teuthology.orchestra.run.smithi087.stdout:created 2024-09-17T07:17:15.368053+0000 2024-09-17T07:17:19.501 INFO:teuthology.orchestra.run.smithi087.stdout:modified 2024-09-17T07:17:15.368115+0000 2024-09-17T07:17:19.501 INFO:teuthology.orchestra.run.smithi087.stdout:tableserver 0 2024-09-17T07:17:19.501 INFO:teuthology.orchestra.run.smithi087.stdout:root 0 2024-09-17T07:17:19.501 INFO:teuthology.orchestra.run.smithi087.stdout:session_timeout 60 2024-09-17T07:17:19.501 INFO:teuthology.orchestra.run.smithi087.stdout:session_autoclose 300 2024-09-17T07:17:19.501 INFO:teuthology.orchestra.run.smithi087.stdout:max_file_size 1099511627776 2024-09-17T07:17:19.501 INFO:teuthology.orchestra.run.smithi087.stdout:required_client_features {} 2024-09-17T07:17:19.501 INFO:teuthology.orchestra.run.smithi087.stdout:last_failure 0 2024-09-17T07:17:19.501 INFO:teuthology.orchestra.run.smithi087.stdout:last_failure_osd_epoch 0 2024-09-17T07:17:19.501 INFO:teuthology.orchestra.run.smithi087.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T07:17:19.501 INFO:teuthology.orchestra.run.smithi087.stdout:max_mds 1 2024-09-17T07:17:19.501 INFO:teuthology.orchestra.run.smithi087.stdout:in 2024-09-17T07:17:19.501 INFO:teuthology.orchestra.run.smithi087.stdout:up {} 2024-09-17T07:17:19.502 INFO:teuthology.orchestra.run.smithi087.stdout:failed 2024-09-17T07:17:19.502 INFO:teuthology.orchestra.run.smithi087.stdout:damaged 2024-09-17T07:17:19.502 INFO:teuthology.orchestra.run.smithi087.stdout:stopped 2024-09-17T07:17:19.502 INFO:teuthology.orchestra.run.smithi087.stdout:data_pools [3] 2024-09-17T07:17:19.502 INFO:teuthology.orchestra.run.smithi087.stdout:metadata_pool 2 2024-09-17T07:17:19.502 INFO:teuthology.orchestra.run.smithi087.stdout:inline_data disabled 2024-09-17T07:17:19.502 INFO:teuthology.orchestra.run.smithi087.stdout:balancer 2024-09-17T07:17:19.502 INFO:teuthology.orchestra.run.smithi087.stdout:standby_count_wanted 0 2024-09-17T07:17:19.502 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:17:19.502 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:17:19.503 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 2 2024-09-17T07:17:19.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:19.500+0000 7f5092182640 1 -- 172.21.15.87:0/1614517868 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f507806ed60 msgr2=0x7f5078071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:19.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:19.500+0000 7f5092182640 1 --2- 172.21.15.87:0/1614517868 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f507806ed60 0x7f5078071210 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f507c000f80 tx=0x7f507c004d10 comp rx=0 tx=0).stop 2024-09-17T07:17:19.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:19.500+0000 7f5092182640 1 -- 172.21.15.87:0/1614517868 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f508c0fd820 msgr2=0x7f508c10d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:19.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:19.500+0000 7f5092182640 1 --2- 172.21.15.87:0/1614517868 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f508c0fd820 0x7f508c10d500 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5074002a50 tx=0x7f5074004600 comp rx=0 tx=0).stop 2024-09-17T07:17:19.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:19.500+0000 7f5092182640 1 -- 172.21.15.87:0/1614517868 shutdown_connections 2024-09-17T07:17:19.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:19.500+0000 7f5092182640 1 --2- 172.21.15.87:0/1614517868 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f508c0fd820 0x7f508c10d500 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:19.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:19.500+0000 7f5092182640 1 --2- 172.21.15.87:0/1614517868 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f507806ed60 0x7f5078071210 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:19.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:19.500+0000 7f5092182640 1 --2- 172.21.15.87:0/1614517868 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f508c0fc550 0x7f508c10cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:19.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:19.500+0000 7f5092182640 1 -- 172.21.15.87:0/1614517868 >> 172.21.15.87:0/1614517868 conn(0x7f508c0f7d30 msgr2=0x7f508c0f95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:17:19.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:19.501+0000 7f5092182640 1 -- 172.21.15.87:0/1614517868 shutdown_connections 2024-09-17T07:17:19.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:19.501+0000 7f5092182640 1 -- 172.21.15.87:0/1614517868 wait complete. 2024-09-17T07:17:20.110 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-17T07:17:20.121 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi087.front.sepia.ceph.com 2024-09-17T07:17:20.121 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -- bash -c 'ceph fs set cephfs max_mds 2' 2024-09-17T07:17:20.368 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/mon.smithi087/config 2024-09-17T07:17:20.612 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:20 smithi139 ceph-mon[34403]: pgmap v172: 65 pgs: 53 active+clean, 9 creating+peering, 3 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T07:17:20.612 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:20 smithi139 ceph-mon[34403]: from='client.? 172.21.15.87:0/1614517868' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T07:17:20.612 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:20 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:17:20.612 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:20 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:17:20.612 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:20 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:17:20.612 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:20 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi139.gnwonz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T07:17:20.612 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:20 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi139.gnwonz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-17T07:17:20.613 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:20 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:17:20.624 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:20 smithi087 ceph-mon[27636]: pgmap v172: 65 pgs: 53 active+clean, 9 creating+peering, 3 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T07:17:20.624 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:20 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/1614517868' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T07:17:20.624 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:20 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:17:20.624 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:20 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:17:20.624 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:20 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:17:20.624 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:20 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi139.gnwonz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T07:17:20.624 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:20 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi139.gnwonz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-17T07:17:20.624 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:20 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:17:21.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:21 smithi087 ceph-mon[27636]: Deploying daemon mds.cephfs.smithi139.gnwonz on smithi139 2024-09-17T07:17:21.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:21 smithi087 ceph-mon[27636]: mds.? [v2:172.21.15.87:6826/3333749861,v1:172.21.15.87:6827/3333749861] up:boot 2024-09-17T07:17:21.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:21 smithi087 ceph-mon[27636]: daemon mds.cephfs.smithi087.vvbzss assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-17T07:17:21.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:21 smithi087 ceph-mon[27636]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-17T07:17:21.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:21 smithi087 ceph-mon[27636]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-17T07:17:21.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:21 smithi087 ceph-mon[27636]: Cluster is now healthy 2024-09-17T07:17:21.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:21 smithi087 ceph-mon[27636]: fsmap cephfs:0 1 up:standby 2024-09-17T07:17:21.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:21 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi087.vvbzss"}]: dispatch 2024-09-17T07:17:21.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:21 smithi087 ceph-mon[27636]: fsmap cephfs:1 {0=cephfs.smithi087.vvbzss=up:creating} 2024-09-17T07:17:21.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:21 smithi087 ceph-mon[27636]: daemon mds.cephfs.smithi087.vvbzss is now active in filesystem cephfs as rank 0 2024-09-17T07:17:21.705 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:21 smithi139 ceph-mon[34403]: Deploying daemon mds.cephfs.smithi139.gnwonz on smithi139 2024-09-17T07:17:21.705 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:21 smithi139 ceph-mon[34403]: mds.? [v2:172.21.15.87:6826/3333749861,v1:172.21.15.87:6827/3333749861] up:boot 2024-09-17T07:17:21.706 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:21 smithi139 ceph-mon[34403]: daemon mds.cephfs.smithi087.vvbzss assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-17T07:17:21.706 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:21 smithi139 ceph-mon[34403]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-17T07:17:21.706 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:21 smithi139 ceph-mon[34403]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-17T07:17:21.706 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:21 smithi139 ceph-mon[34403]: Cluster is now healthy 2024-09-17T07:17:21.706 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:21 smithi139 ceph-mon[34403]: fsmap cephfs:0 1 up:standby 2024-09-17T07:17:21.706 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:21 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi087.vvbzss"}]: dispatch 2024-09-17T07:17:21.706 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:21 smithi139 ceph-mon[34403]: fsmap cephfs:1 {0=cephfs.smithi087.vvbzss=up:creating} 2024-09-17T07:17:21.706 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:21 smithi139 ceph-mon[34403]: daemon mds.cephfs.smithi087.vvbzss is now active in filesystem cephfs as rank 0 2024-09-17T07:17:22.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:22.020+0000 7fb951439640 1 -- 172.21.15.87:0/2083434585 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb94c0fd840 msgr2=0x7fb94c0fdcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:22.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:22.020+0000 7fb951439640 1 --2- 172.21.15.87:0/2083434585 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb94c0fd840 0x7fb94c0fdcb0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb9400048d0 tx=0x7fb940009da0 comp rx=0 tx=0).stop 2024-09-17T07:17:22.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:22.020+0000 7fb951439640 1 -- 172.21.15.87:0/2083434585 shutdown_connections 2024-09-17T07:17:22.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:22.020+0000 7fb951439640 1 --2- 172.21.15.87:0/2083434585 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb94c0fd840 0x7fb94c0fdcb0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:22.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:22.020+0000 7fb951439640 1 --2- 172.21.15.87:0/2083434585 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb94c0fc570 0x7fb94c0fc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:22.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:22.020+0000 7fb951439640 1 -- 172.21.15.87:0/2083434585 >> 172.21.15.87:0/2083434585 conn(0x7fb94c0f7d30 msgr2=0x7fb94c0fa160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:17:22.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:22.020+0000 7fb951439640 1 -- 172.21.15.87:0/2083434585 shutdown_connections 2024-09-17T07:17:22.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:22.020+0000 7fb951439640 1 -- 172.21.15.87:0/2083434585 wait complete. 2024-09-17T07:17:22.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:22.021+0000 7fb951439640 1 Processor -- start 2024-09-17T07:17:22.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:22.021+0000 7fb951439640 1 -- start start 2024-09-17T07:17:22.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:22.021+0000 7fb951439640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb94c0fc570 0x7fb94c10d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:17:22.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:22.021+0000 7fb951439640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb94c0fd840 0x7fb94c10d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:17:22.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:22.021+0000 7fb951439640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb94c10e3d0 con 0x7fb94c0fc570 2024-09-17T07:17:22.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:22.021+0000 7fb951439640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb94c10e540 con 0x7fb94c0fd840 2024-09-17T07:17:22.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:22.021+0000 7fb94affd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb94c0fc570 0x7fb94c10d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:17:22.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:22.021+0000 7fb94affd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb94c0fc570 0x7fb94c10d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49800/0 (socket says 172.21.15.87:49800) 2024-09-17T07:17:22.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:22.021+0000 7fb94affd640 1 -- 172.21.15.87:0/2824256942 learned_addr learned my addr 172.21.15.87:0/2824256942 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:17:22.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:22.021+0000 7fb94a7fc640 1 --2- 172.21.15.87:0/2824256942 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb94c0fd840 0x7fb94c10d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:17:22.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:22.021+0000 7fb94affd640 1 -- 172.21.15.87:0/2824256942 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb94c0fd840 msgr2=0x7fb94c10d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:22.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:22.021+0000 7fb94affd640 1 --2- 172.21.15.87:0/2824256942 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb94c0fd840 0x7fb94c10d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:22.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:22.021+0000 7fb94affd640 1 -- 172.21.15.87:0/2824256942 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb940005040 con 0x7fb94c0fc570 2024-09-17T07:17:22.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:22.022+0000 7fb94affd640 1 --2- 172.21.15.87:0/2824256942 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb94c0fc570 0x7fb94c10d020 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb93c00b790 tx=0x7fb93c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:17:22.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:22.022+0000 7fb9337fe640 1 -- 172.21.15.87:0/2824256942 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb93c00c700 con 0x7fb94c0fc570 2024-09-17T07:17:22.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:22.022+0000 7fb9337fe640 1 -- 172.21.15.87:0/2824256942 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fb93c00cce0 con 0x7fb94c0fc570 2024-09-17T07:17:22.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:22.022+0000 7fb951439640 1 -- 172.21.15.87:0/2824256942 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb94c10e820 con 0x7fb94c0fc570 2024-09-17T07:17:22.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:22.022+0000 7fb9337fe640 1 -- 172.21.15.87:0/2824256942 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb93c015e30 con 0x7fb94c0fc570 2024-09-17T07:17:22.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:22.022+0000 7fb951439640 1 -- 172.21.15.87:0/2824256942 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb94c10ed10 con 0x7fb94c0fc570 2024-09-17T07:17:22.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:22.023+0000 7fb951439640 1 -- 172.21.15.87:0/2824256942 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb94c1056c0 con 0x7fb94c0fc570 2024-09-17T07:17:22.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:22.024+0000 7fb9337fe640 1 -- 172.21.15.87:0/2824256942 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fb93c012070 con 0x7fb94c0fc570 2024-09-17T07:17:22.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:22.024+0000 7fb9337fe640 1 --2- 172.21.15.87:0/2824256942 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fb93406ed60 0x7fb934071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:17:22.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:22.024+0000 7fb9337fe640 1 -- 172.21.15.87:0/2824256942 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fb93c08d980 con 0x7fb94c0fc570 2024-09-17T07:17:22.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:22.024+0000 7fb94a7fc640 1 --2- 172.21.15.87:0/2824256942 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fb93406ed60 0x7fb934071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:17:22.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:22.025+0000 7fb94a7fc640 1 --2- 172.21.15.87:0/2824256942 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fb93406ed60 0x7fb934071210 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb940000c00 tx=0x7fb940035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:17:22.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:22.029+0000 7fb9337fe640 1 -- 172.21.15.87:0/2824256942 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fb93c05ab20 con 0x7fb94c0fc570 2024-09-17T07:17:22.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:22.230+0000 7fb951439640 1 -- 172.21.15.87:0/2824256942 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) v1 -- 0x7fb94c04b720 con 0x7fb94c0fc570 2024-09-17T07:17:22.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:22.381+0000 7fb9337fe640 1 -- 172.21.15.87:0/2824256942 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v6) v1 ==== 105+0+0 (secure 0 0 0) 0x7fb93c05a4c0 con 0x7fb94c0fc570 2024-09-17T07:17:22.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:22.383+0000 7fb951439640 1 -- 172.21.15.87:0/2824256942 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fb93406ed60 msgr2=0x7fb934071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:22.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:22.383+0000 7fb951439640 1 --2- 172.21.15.87:0/2824256942 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fb93406ed60 0x7fb934071210 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb940000c00 tx=0x7fb940035040 comp rx=0 tx=0).stop 2024-09-17T07:17:22.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:22.383+0000 7fb951439640 1 -- 172.21.15.87:0/2824256942 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb94c0fc570 msgr2=0x7fb94c10d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:22.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:22.383+0000 7fb951439640 1 --2- 172.21.15.87:0/2824256942 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb94c0fc570 0x7fb94c10d020 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb93c00b790 tx=0x7fb93c0091d0 comp rx=0 tx=0).stop 2024-09-17T07:17:22.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:22.383+0000 7fb951439640 1 -- 172.21.15.87:0/2824256942 shutdown_connections 2024-09-17T07:17:22.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:22.383+0000 7fb951439640 1 --2- 172.21.15.87:0/2824256942 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fb93406ed60 0x7fb934071210 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:22.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:22.383+0000 7fb951439640 1 --2- 172.21.15.87:0/2824256942 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb94c0fd840 0x7fb94c10d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:22.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:22.383+0000 7fb951439640 1 --2- 172.21.15.87:0/2824256942 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb94c0fc570 0x7fb94c10d020 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:22.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:22.383+0000 7fb951439640 1 -- 172.21.15.87:0/2824256942 >> 172.21.15.87:0/2824256942 conn(0x7fb94c0f7d30 msgr2=0x7fb94c0f95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:17:22.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:22.383+0000 7fb951439640 1 -- 172.21.15.87:0/2824256942 shutdown_connections 2024-09-17T07:17:22.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:22.383+0000 7fb951439640 1 -- 172.21.15.87:0/2824256942 wait complete. 2024-09-17T07:17:22.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:22 smithi087 ceph-mon[27636]: pgmap v173: 65 pgs: 59 active+clean, 6 creating+peering; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T07:17:22.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:22 smithi087 ceph-mon[27636]: mds.? [v2:172.21.15.87:6826/3333749861,v1:172.21.15.87:6827/3333749861] up:active 2024-09-17T07:17:22.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:22 smithi087 ceph-mon[27636]: fsmap cephfs:1 {0=cephfs.smithi087.vvbzss=up:active} 2024-09-17T07:17:22.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:22 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:17:22.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:22 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:17:22.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:22 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:17:22.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:22 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:17:22.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:22 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi087.tjhpcs", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T07:17:22.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:22 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi087.tjhpcs", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-17T07:17:22.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:22 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:17:22.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:22 smithi087 ceph-mon[27636]: Deploying daemon mds.cephfs.smithi087.tjhpcs on smithi087 2024-09-17T07:17:22.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:22 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/2824256942' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-09-17T07:17:22.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:22 smithi139 ceph-mon[34403]: pgmap v173: 65 pgs: 59 active+clean, 6 creating+peering; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T07:17:22.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:22 smithi139 ceph-mon[34403]: mds.? [v2:172.21.15.87:6826/3333749861,v1:172.21.15.87:6827/3333749861] up:active 2024-09-17T07:17:22.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:22 smithi139 ceph-mon[34403]: fsmap cephfs:1 {0=cephfs.smithi087.vvbzss=up:active} 2024-09-17T07:17:22.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:22 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:17:22.868 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:22 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:17:22.868 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:22 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:17:22.868 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:22 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:17:22.868 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:22 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi087.tjhpcs", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T07:17:22.868 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:22 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi087.tjhpcs", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-17T07:17:22.868 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:22 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:17:22.868 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:22 smithi139 ceph-mon[34403]: Deploying daemon mds.cephfs.smithi087.tjhpcs on smithi087 2024-09-17T07:17:22.868 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:22 smithi139 ceph-mon[34403]: from='client.? 172.21.15.87:0/2824256942' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-09-17T07:17:23.134 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-17T07:17:23.146 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi087.front.sepia.ceph.com 2024-09-17T07:17:23.147 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -- bash -c 'ceph fs set cephfs allow_standby_replay true' 2024-09-17T07:17:23.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:23 smithi087 ceph-mon[27636]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-17T07:17:23.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:23 smithi087 ceph-mon[27636]: mds.? [v2:172.21.15.139:6824/3946792151,v1:172.21.15.139:6825/3946792151] up:boot 2024-09-17T07:17:23.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:23 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/2824256942' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-09-17T07:17:23.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:23 smithi087 ceph-mon[27636]: daemon mds.cephfs.smithi139.gnwonz assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-17T07:17:23.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:23 smithi087 ceph-mon[27636]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-09-17T07:17:23.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:23 smithi087 ceph-mon[27636]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-17T07:17:23.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:23 smithi087 ceph-mon[27636]: fsmap cephfs:1 {0=cephfs.smithi087.vvbzss=up:active} 1 up:standby 2024-09-17T07:17:23.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:23 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi139.gnwonz"}]: dispatch 2024-09-17T07:17:23.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:23 smithi087 ceph-mon[27636]: fsmap cephfs:2 {0=cephfs.smithi087.vvbzss=up:active,1=cephfs.smithi139.gnwonz=up:creating} 2024-09-17T07:17:23.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:23 smithi087 ceph-mon[27636]: daemon mds.cephfs.smithi139.gnwonz is now active in filesystem cephfs as rank 1 2024-09-17T07:17:23.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:23 smithi087 ceph-mon[27636]: pgmap v174: 65 pgs: 65 active+clean; 578 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 424 B/s wr, 4 op/s 2024-09-17T07:17:23.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:23 smithi139 ceph-mon[34403]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-17T07:17:23.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:23 smithi139 ceph-mon[34403]: mds.? [v2:172.21.15.139:6824/3946792151,v1:172.21.15.139:6825/3946792151] up:boot 2024-09-17T07:17:23.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:23 smithi139 ceph-mon[34403]: from='client.? 172.21.15.87:0/2824256942' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-09-17T07:17:23.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:23 smithi139 ceph-mon[34403]: daemon mds.cephfs.smithi139.gnwonz assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-17T07:17:23.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:23 smithi139 ceph-mon[34403]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-09-17T07:17:23.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:23 smithi139 ceph-mon[34403]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-17T07:17:23.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:23 smithi139 ceph-mon[34403]: fsmap cephfs:1 {0=cephfs.smithi087.vvbzss=up:active} 1 up:standby 2024-09-17T07:17:23.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:23 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi139.gnwonz"}]: dispatch 2024-09-17T07:17:23.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:23 smithi139 ceph-mon[34403]: fsmap cephfs:2 {0=cephfs.smithi087.vvbzss=up:active,1=cephfs.smithi139.gnwonz=up:creating} 2024-09-17T07:17:23.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:23 smithi139 ceph-mon[34403]: daemon mds.cephfs.smithi139.gnwonz is now active in filesystem cephfs as rank 1 2024-09-17T07:17:23.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:23 smithi139 ceph-mon[34403]: pgmap v174: 65 pgs: 65 active+clean; 578 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 424 B/s wr, 4 op/s 2024-09-17T07:17:24.139 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/mon.smithi087/config 2024-09-17T07:17:24.525 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:24 smithi087 ceph-mon[27636]: mds.? [v2:172.21.15.139:6824/3946792151,v1:172.21.15.139:6825/3946792151] up:active 2024-09-17T07:17:24.525 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:24 smithi087 ceph-mon[27636]: fsmap cephfs:2 {0=cephfs.smithi087.vvbzss=up:active,1=cephfs.smithi139.gnwonz=up:active} 2024-09-17T07:17:24.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:24 smithi139 ceph-mon[34403]: mds.? [v2:172.21.15.139:6824/3946792151,v1:172.21.15.139:6825/3946792151] up:active 2024-09-17T07:17:24.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:24 smithi139 ceph-mon[34403]: fsmap cephfs:2 {0=cephfs.smithi087.vvbzss=up:active,1=cephfs.smithi139.gnwonz=up:active} 2024-09-17T07:17:25.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:25 smithi139 ceph-mon[34403]: pgmap v175: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s wr, 6 op/s 2024-09-17T07:17:25.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:25.613+0000 7f31e54e8640 1 -- 172.21.15.87:0/3165198300 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31e0066650 msgr2=0x7f31e00ff1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:25.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:25.613+0000 7f31e54e8640 1 --2- 172.21.15.87:0/3165198300 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31e0066650 0x7f31e00ff1b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f31d0009c50 tx=0x7f31d0004d10 comp rx=0 tx=0).stop 2024-09-17T07:17:25.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:25.613+0000 7f31e54e8640 1 -- 172.21.15.87:0/3165198300 shutdown_connections 2024-09-17T07:17:25.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:25.613+0000 7f31e54e8640 1 --2- 172.21.15.87:0/3165198300 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f31e00ff6f0 0x7f31e0101ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:25.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:25.613+0000 7f31e54e8640 1 --2- 172.21.15.87:0/3165198300 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31e0066650 0x7f31e00ff1b0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:25.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:25.613+0000 7f31e54e8640 1 -- 172.21.15.87:0/3165198300 >> 172.21.15.87:0/3165198300 conn(0x7f31e00f6c20 msgr2=0x7f31e00f9030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:17:25.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:25.613+0000 7f31e54e8640 1 -- 172.21.15.87:0/3165198300 shutdown_connections 2024-09-17T07:17:25.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:25.613+0000 7f31e54e8640 1 -- 172.21.15.87:0/3165198300 wait complete. 2024-09-17T07:17:25.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:25.613+0000 7f31e54e8640 1 Processor -- start 2024-09-17T07:17:25.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:25.613+0000 7f31e54e8640 1 -- start start 2024-09-17T07:17:25.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:25.614+0000 7f31e54e8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31e0066650 0x7f31e010d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:17:25.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:25.614+0000 7f31e54e8640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f31e00ff6f0 0x7f31e010d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:17:25.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:25.614+0000 7f31e54e8640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e010e470 con 0x7f31e0066650 2024-09-17T07:17:25.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:25.614+0000 7f31e54e8640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e010e5e0 con 0x7f31e00ff6f0 2024-09-17T07:17:25.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:25.614+0000 7f31deffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31e0066650 0x7f31e010d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:17:25.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:25.614+0000 7f31deffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31e0066650 0x7f31e010d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46706/0 (socket says 172.21.15.87:46706) 2024-09-17T07:17:25.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:25.614+0000 7f31deffd640 1 -- 172.21.15.87:0/909080845 learned_addr learned my addr 172.21.15.87:0/909080845 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:17:25.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:25.614+0000 7f31de7fc640 1 --2- 172.21.15.87:0/909080845 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f31e00ff6f0 0x7f31e010d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:17:25.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:25.614+0000 7f31deffd640 1 -- 172.21.15.87:0/909080845 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f31e00ff6f0 msgr2=0x7f31e010d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:25.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:25.614+0000 7f31deffd640 1 --2- 172.21.15.87:0/909080845 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f31e00ff6f0 0x7f31e010d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:25.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:25.614+0000 7f31deffd640 1 -- 172.21.15.87:0/909080845 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31d00098b0 con 0x7f31e0066650 2024-09-17T07:17:25.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:25.614+0000 7f31deffd640 1 --2- 172.21.15.87:0/909080845 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31e0066650 0x7f31e010d0c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f31d0000f80 tx=0x7f31d0004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:17:25.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:25.614+0000 7f31c77fe640 1 -- 172.21.15.87:0/909080845 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f31d0032960 con 0x7f31e0066650 2024-09-17T07:17:25.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:25.614+0000 7f31c77fe640 1 -- 172.21.15.87:0/909080845 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f31d003d420 con 0x7f31e0066650 2024-09-17T07:17:25.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:25.614+0000 7f31e54e8640 1 -- 172.21.15.87:0/909080845 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31e010e860 con 0x7f31e0066650 2024-09-17T07:17:25.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:25.614+0000 7f31c77fe640 1 -- 172.21.15.87:0/909080845 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f31d0031610 con 0x7f31e0066650 2024-09-17T07:17:25.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:25.614+0000 7f31e54e8640 1 -- 172.21.15.87:0/909080845 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31e010ed80 con 0x7f31e0066650 2024-09-17T07:17:25.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:25.615+0000 7f31e54e8640 1 -- 172.21.15.87:0/909080845 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31e01056a0 con 0x7f31e0066650 2024-09-17T07:17:25.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:25.616+0000 7f31c77fe640 1 -- 172.21.15.87:0/909080845 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f31d002f030 con 0x7f31e0066650 2024-09-17T07:17:25.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:25.616+0000 7f31c77fe640 1 --2- 172.21.15.87:0/909080845 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f31c806ed60 0x7f31c8071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:17:25.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:25.616+0000 7f31de7fc640 1 --2- 172.21.15.87:0/909080845 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f31c806ed60 0x7f31c8071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:17:25.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:25.616+0000 7f31c77fe640 1 -- 172.21.15.87:0/909080845 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f31d00af650 con 0x7f31e0066650 2024-09-17T07:17:25.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:25.617+0000 7f31de7fc640 1 --2- 172.21.15.87:0/909080845 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f31c806ed60 0x7f31c8071210 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f31d4006fd0 tx=0x7f31d4008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:17:25.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:25.620+0000 7f31c77fe640 1 -- 172.21.15.87:0/909080845 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f31d007c770 con 0x7f31e0066650 2024-09-17T07:17:25.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:25 smithi087 ceph-mon[27636]: pgmap v175: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s wr, 6 op/s 2024-09-17T07:17:25.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:25.816+0000 7f31e54e8640 1 -- 172.21.15.87:0/909080845 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7f31e00fa8a0 con 0x7f31e0066650 2024-09-17T07:17:26.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:26.398+0000 7f31c77fe640 1 -- 172.21.15.87:0/909080845 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v9) v1 ==== 121+0+0 (secure 0 0 0) 0x7f31d00480c0 con 0x7f31e0066650 2024-09-17T07:17:26.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:26.401+0000 7f31e54e8640 1 -- 172.21.15.87:0/909080845 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f31c806ed60 msgr2=0x7f31c8071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:26.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:26.401+0000 7f31e54e8640 1 --2- 172.21.15.87:0/909080845 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f31c806ed60 0x7f31c8071210 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f31d4006fd0 tx=0x7f31d4008040 comp rx=0 tx=0).stop 2024-09-17T07:17:26.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:26.401+0000 7f31e54e8640 1 -- 172.21.15.87:0/909080845 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31e0066650 msgr2=0x7f31e010d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:26.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:26.401+0000 7f31e54e8640 1 --2- 172.21.15.87:0/909080845 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31e0066650 0x7f31e010d0c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f31d0000f80 tx=0x7f31d0004d10 comp rx=0 tx=0).stop 2024-09-17T07:17:26.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:26.401+0000 7f31e54e8640 1 -- 172.21.15.87:0/909080845 shutdown_connections 2024-09-17T07:17:26.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:26.401+0000 7f31e54e8640 1 --2- 172.21.15.87:0/909080845 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f31c806ed60 0x7f31c8071210 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:26.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:26.401+0000 7f31e54e8640 1 --2- 172.21.15.87:0/909080845 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f31e00ff6f0 0x7f31e010d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:26.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:26.401+0000 7f31e54e8640 1 --2- 172.21.15.87:0/909080845 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31e0066650 0x7f31e010d0c0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:26.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:26.401+0000 7f31e54e8640 1 -- 172.21.15.87:0/909080845 >> 172.21.15.87:0/909080845 conn(0x7f31e00f6c20 msgr2=0x7f31e00f6ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:17:26.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:26.401+0000 7f31e54e8640 1 -- 172.21.15.87:0/909080845 shutdown_connections 2024-09-17T07:17:26.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:26.402+0000 7f31e54e8640 1 -- 172.21.15.87:0/909080845 wait complete. 2024-09-17T07:17:26.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:26 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/909080845' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-17T07:17:26.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:26 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:17:26.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:26 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:17:26.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:26 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:17:26.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:26 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi139.ftvinf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T07:17:26.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:26 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi139.ftvinf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-17T07:17:26.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:26 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:17:26.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:26 smithi087 ceph-mon[27636]: Deploying daemon mds.cephfs.smithi139.ftvinf on smithi139 2024-09-17T07:17:26.693 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:26 smithi139 ceph-mon[34403]: from='client.? 172.21.15.87:0/909080845' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-17T07:17:26.693 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:26 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:17:26.693 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:26 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:17:26.693 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:26 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:17:26.693 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:26 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi139.ftvinf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T07:17:26.694 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:26 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi139.ftvinf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-17T07:17:26.694 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:26 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:17:26.694 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:26 smithi139 ceph-mon[34403]: Deploying daemon mds.cephfs.smithi139.ftvinf on smithi139 2024-09-17T07:17:26.996 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-17T07:17:27.012 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi087.front.sepia.ceph.com 2024-09-17T07:17:27.012 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -- bash -c 'ceph fs set cephfs inline_data true --yes-i-really-really-mean-it' 2024-09-17T07:17:27.257 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/mon.smithi087/config 2024-09-17T07:17:27.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:27 smithi087 ceph-mon[27636]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-09-17T07:17:27.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:27 smithi087 ceph-mon[27636]: Cluster is now healthy 2024-09-17T07:17:27.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:27 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/909080845' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-17T07:17:27.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:27 smithi087 ceph-mon[27636]: mds.? [v2:172.21.15.87:6828/2255237099,v1:172.21.15.87:6829/2255237099] up:boot 2024-09-17T07:17:27.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:27 smithi087 ceph-mon[27636]: fsmap cephfs:2 {0=cephfs.smithi087.vvbzss=up:active,1=cephfs.smithi139.gnwonz=up:active} 1 up:standby 2024-09-17T07:17:27.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:27 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi087.tjhpcs"}]: dispatch 2024-09-17T07:17:27.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:27 smithi087 ceph-mon[27636]: fsmap cephfs:2 {0=cephfs.smithi087.vvbzss=up:active,1=cephfs.smithi139.gnwonz=up:active} 1 up:standby-replay 2024-09-17T07:17:27.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:27 smithi087 ceph-mon[27636]: pgmap v176: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s wr, 8 op/s 2024-09-17T07:17:27.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:27 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:17:27.817 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:27 smithi139 ceph-mon[34403]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-09-17T07:17:27.818 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:27 smithi139 ceph-mon[34403]: Cluster is now healthy 2024-09-17T07:17:27.818 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:27 smithi139 ceph-mon[34403]: from='client.? 172.21.15.87:0/909080845' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-17T07:17:27.818 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:27 smithi139 ceph-mon[34403]: mds.? [v2:172.21.15.87:6828/2255237099,v1:172.21.15.87:6829/2255237099] up:boot 2024-09-17T07:17:27.818 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:27 smithi139 ceph-mon[34403]: fsmap cephfs:2 {0=cephfs.smithi087.vvbzss=up:active,1=cephfs.smithi139.gnwonz=up:active} 1 up:standby 2024-09-17T07:17:27.818 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:27 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi087.tjhpcs"}]: dispatch 2024-09-17T07:17:27.818 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:27 smithi139 ceph-mon[34403]: fsmap cephfs:2 {0=cephfs.smithi087.vvbzss=up:active,1=cephfs.smithi139.gnwonz=up:active} 1 up:standby-replay 2024-09-17T07:17:27.818 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:27 smithi139 ceph-mon[34403]: pgmap v176: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s wr, 8 op/s 2024-09-17T07:17:27.818 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:27 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:17:28.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:28.691+0000 7fe50a566640 1 -- 172.21.15.87:0/1743822723 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe5040fb430 msgr2=0x7fe5040fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:28.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:28.691+0000 7fe50a566640 1 --2- 172.21.15.87:0/1743822723 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe5040fb430 0x7fe5040fb840 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe4f40048d0 tx=0x7fe4f4009da0 comp rx=0 tx=0).stop 2024-09-17T07:17:28.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:28.691+0000 7fe50a566640 1 -- 172.21.15.87:0/1743822723 shutdown_connections 2024-09-17T07:17:28.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:28.691+0000 7fe50a566640 1 --2- 172.21.15.87:0/1743822723 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe5040fc700 0x7fe5040fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:28.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:28.691+0000 7fe50a566640 1 --2- 172.21.15.87:0/1743822723 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe5040fb430 0x7fe5040fb840 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:28.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:28.691+0000 7fe50a566640 1 -- 172.21.15.87:0/1743822723 >> 172.21.15.87:0/1743822723 conn(0x7fe5040f6c10 msgr2=0x7fe5040f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:17:28.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:28.691+0000 7fe50a566640 1 -- 172.21.15.87:0/1743822723 shutdown_connections 2024-09-17T07:17:28.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:28.691+0000 7fe50a566640 1 -- 172.21.15.87:0/1743822723 wait complete. 2024-09-17T07:17:28.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:28.691+0000 7fe50a566640 1 Processor -- start 2024-09-17T07:17:28.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:28.691+0000 7fe50a566640 1 -- start start 2024-09-17T07:17:28.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:28.692+0000 7fe50a566640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe5040fb430 0x7fe50410cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:17:28.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:28.692+0000 7fe50a566640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe5040fc700 0x7fe50410d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:17:28.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:28.692+0000 7fe50a566640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe50410db40 con 0x7fe5040fb430 2024-09-17T07:17:28.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:28.692+0000 7fe50a566640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe50410e360 con 0x7fe5040fc700 2024-09-17T07:17:28.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:28.692+0000 7fe503fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe5040fb430 0x7fe50410cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:17:28.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:28.692+0000 7fe503fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe5040fb430 0x7fe50410cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46726/0 (socket says 172.21.15.87:46726) 2024-09-17T07:17:28.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:28.692+0000 7fe503fff640 1 -- 172.21.15.87:0/2521570847 learned_addr learned my addr 172.21.15.87:0/2521570847 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:17:28.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:28.692+0000 7fe5037fe640 1 --2- 172.21.15.87:0/2521570847 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe5040fc700 0x7fe50410d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:17:28.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:28.692+0000 7fe503fff640 1 -- 172.21.15.87:0/2521570847 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe5040fc700 msgr2=0x7fe50410d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:28.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:28.692+0000 7fe503fff640 1 --2- 172.21.15.87:0/2521570847 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe5040fc700 0x7fe50410d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:28.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:28.692+0000 7fe503fff640 1 -- 172.21.15.87:0/2521570847 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4f4005040 con 0x7fe5040fb430 2024-09-17T07:17:28.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:28.692+0000 7fe503fff640 1 --2- 172.21.15.87:0/2521570847 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe5040fb430 0x7fe50410cfb0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe4f4009ac0 tx=0x7fe4f4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:17:28.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:28.692+0000 7fe500ff9640 1 -- 172.21.15.87:0/2521570847 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4f4038070 con 0x7fe5040fb430 2024-09-17T07:17:28.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:28.692+0000 7fe500ff9640 1 -- 172.21.15.87:0/2521570847 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fe4f40096c0 con 0x7fe5040fb430 2024-09-17T07:17:28.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:28.692+0000 7fe50a566640 1 -- 172.21.15.87:0/2521570847 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe50410e590 con 0x7fe5040fb430 2024-09-17T07:17:28.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:28.692+0000 7fe500ff9640 1 -- 172.21.15.87:0/2521570847 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4f403d420 con 0x7fe5040fb430 2024-09-17T07:17:28.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:28.692+0000 7fe50a566640 1 -- 172.21.15.87:0/2521570847 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe50410eb30 con 0x7fe5040fb430 2024-09-17T07:17:28.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:28.694+0000 7fe50a566640 1 -- 172.21.15.87:0/2521570847 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5040fa890 con 0x7fe5040fb430 2024-09-17T07:17:28.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:28.694+0000 7fe500ff9640 1 -- 172.21.15.87:0/2521570847 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fe4f4030020 con 0x7fe5040fb430 2024-09-17T07:17:28.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:28.695+0000 7fe500ff9640 1 --2- 172.21.15.87:0/2521570847 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fe4ec06ed60 0x7fe4ec071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:17:28.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:28.695+0000 7fe500ff9640 1 -- 172.21.15.87:0/2521570847 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fe4f40ae660 con 0x7fe5040fb430 2024-09-17T07:17:28.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:28.695+0000 7fe5037fe640 1 --2- 172.21.15.87:0/2521570847 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fe4ec06ed60 0x7fe4ec071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:17:28.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:28.695+0000 7fe5037fe640 1 --2- 172.21.15.87:0/2521570847 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fe4ec06ed60 0x7fe4ec071210 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe50410cd60 tx=0x7fe4f800b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:17:28.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:28.699+0000 7fe500ff9640 1 -- 172.21.15.87:0/2521570847 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fe4f407b8c0 con 0x7fe5040fb430 2024-09-17T07:17:28.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:28.899+0000 7fe50a566640 1 -- 172.21.15.87:0/2521570847 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe50404b720 con 0x7fe5040fb430 2024-09-17T07:17:29.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:29.599+0000 7fe500ff9640 1 -- 172.21.15.87:0/2521570847 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]=0 inline data enabled v13) v1 ==== 168+0+0 (secure 0 0 0) 0x7fe4f407b260 con 0x7fe5040fb430 2024-09-17T07:17:29.599 INFO:teuthology.orchestra.run.smithi087.stderr:inline data enabled 2024-09-17T07:17:29.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:29.601+0000 7fe50a566640 1 -- 172.21.15.87:0/2521570847 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fe4ec06ed60 msgr2=0x7fe4ec071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:29.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:29.601+0000 7fe50a566640 1 --2- 172.21.15.87:0/2521570847 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fe4ec06ed60 0x7fe4ec071210 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe50410cd60 tx=0x7fe4f800b040 comp rx=0 tx=0).stop 2024-09-17T07:17:29.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:29.601+0000 7fe50a566640 1 -- 172.21.15.87:0/2521570847 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe5040fb430 msgr2=0x7fe50410cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:29.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:29.601+0000 7fe50a566640 1 --2- 172.21.15.87:0/2521570847 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe5040fb430 0x7fe50410cfb0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe4f4009ac0 tx=0x7fe4f4009da0 comp rx=0 tx=0).stop 2024-09-17T07:17:29.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:29.601+0000 7fe50a566640 1 -- 172.21.15.87:0/2521570847 shutdown_connections 2024-09-17T07:17:29.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:29.601+0000 7fe50a566640 1 --2- 172.21.15.87:0/2521570847 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fe4ec06ed60 0x7fe4ec071210 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:29.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:29.601+0000 7fe50a566640 1 --2- 172.21.15.87:0/2521570847 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe5040fc700 0x7fe50410d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:29.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:29.601+0000 7fe50a566640 1 --2- 172.21.15.87:0/2521570847 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe5040fb430 0x7fe50410cfb0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:29.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:29.601+0000 7fe50a566640 1 -- 172.21.15.87:0/2521570847 >> 172.21.15.87:0/2521570847 conn(0x7fe5040f6c10 msgr2=0x7fe504064f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:17:29.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:29.601+0000 7fe50a566640 1 -- 172.21.15.87:0/2521570847 shutdown_connections 2024-09-17T07:17:29.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:29.601+0000 7fe50a566640 1 -- 172.21.15.87:0/2521570847 wait complete. 2024-09-17T07:17:29.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:29 smithi139 ceph-mon[34403]: mds.? [v2:172.21.15.139:6826/3292073323,v1:172.21.15.139:6827/3292073323] up:boot 2024-09-17T07:17:29.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:29 smithi139 ceph-mon[34403]: fsmap cephfs:2 {0=cephfs.smithi087.vvbzss=up:active,1=cephfs.smithi139.gnwonz=up:active} 1 up:standby-replay 1 up:standby 2024-09-17T07:17:29.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:29 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi139.ftvinf"}]: dispatch 2024-09-17T07:17:29.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:29 smithi139 ceph-mon[34403]: fsmap cephfs:2 {0=cephfs.smithi087.vvbzss=up:active,1=cephfs.smithi139.gnwonz=up:active} 2 up:standby-replay 2024-09-17T07:17:29.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:29 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:17:29.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:29 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:17:29.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:29 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:17:29.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:29 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:17:29.868 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:29 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:17:29.868 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:29 smithi139 ceph-mon[34403]: pgmap v177: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 273 B/s rd, 2.1 KiB/s wr, 7 op/s 2024-09-17T07:17:29.868 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:29 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:17:29.868 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:29 smithi139 ceph-mon[34403]: from='client.? 172.21.15.87:0/2521570847' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-17T07:17:29.875 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:29 smithi087 ceph-mon[27636]: mds.? [v2:172.21.15.139:6826/3292073323,v1:172.21.15.139:6827/3292073323] up:boot 2024-09-17T07:17:29.876 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:29 smithi087 ceph-mon[27636]: fsmap cephfs:2 {0=cephfs.smithi087.vvbzss=up:active,1=cephfs.smithi139.gnwonz=up:active} 1 up:standby-replay 1 up:standby 2024-09-17T07:17:29.876 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:29 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi139.ftvinf"}]: dispatch 2024-09-17T07:17:29.876 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:29 smithi087 ceph-mon[27636]: fsmap cephfs:2 {0=cephfs.smithi087.vvbzss=up:active,1=cephfs.smithi139.gnwonz=up:active} 2 up:standby-replay 2024-09-17T07:17:29.876 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:29 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:17:29.876 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:29 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:17:29.876 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:29 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:17:29.876 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:29 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:17:29.877 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:29 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:17:29.877 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:29 smithi087 ceph-mon[27636]: pgmap v177: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 273 B/s rd, 2.1 KiB/s wr, 7 op/s 2024-09-17T07:17:29.877 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:29 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:17:29.877 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:29 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/2521570847' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-17T07:17:30.445 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-17T07:17:30.454 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi087.front.sepia.ceph.com 2024-09-17T07:17:30.454 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-17T07:17:30.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:30 smithi087 ceph-mon[27636]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2024-09-17T07:17:30.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:30 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/2521570847' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2024-09-17T07:17:30.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:30 smithi087 ceph-mon[27636]: fsmap cephfs:2 {0=cephfs.smithi087.vvbzss=up:active,1=cephfs.smithi139.gnwonz=up:active} 2 up:standby-replay 2024-09-17T07:17:30.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:30 smithi087 ceph-mon[27636]: Dropping low affinity active daemon mds.cephfs.smithi087.vvbzss in favor of higher affinity standby. 2024-09-17T07:17:30.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:30 smithi087 ceph-mon[27636]: Replacing daemon mds.cephfs.smithi087.vvbzss as rank 0 with standby daemon mds.cephfs.smithi087.tjhpcs 2024-09-17T07:17:30.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:30 smithi087 ceph-mon[27636]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-17T07:17:30.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:30 smithi087 ceph-mon[27636]: osdmap e44: 6 total, 6 up, 6 in 2024-09-17T07:17:30.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:30 smithi087 ceph-mon[27636]: mds.? [v2:172.21.15.87:6828/2255237099,v1:172.21.15.87:6829/2255237099] up:standby-replay 2024-09-17T07:17:30.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:30 smithi087 ceph-mon[27636]: fsmap cephfs:2/2 {0=cephfs.smithi087.tjhpcs=up:replay,1=cephfs.smithi139.gnwonz=up:active} 1 up:standby-replay 2024-09-17T07:17:30.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:30 smithi139 ceph-mon[34403]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2024-09-17T07:17:30.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:30 smithi139 ceph-mon[34403]: from='client.? 172.21.15.87:0/2521570847' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2024-09-17T07:17:30.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:30 smithi139 ceph-mon[34403]: fsmap cephfs:2 {0=cephfs.smithi087.vvbzss=up:active,1=cephfs.smithi139.gnwonz=up:active} 2 up:standby-replay 2024-09-17T07:17:30.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:30 smithi139 ceph-mon[34403]: Dropping low affinity active daemon mds.cephfs.smithi087.vvbzss in favor of higher affinity standby. 2024-09-17T07:17:30.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:30 smithi139 ceph-mon[34403]: Replacing daemon mds.cephfs.smithi087.vvbzss as rank 0 with standby daemon mds.cephfs.smithi087.tjhpcs 2024-09-17T07:17:30.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:30 smithi139 ceph-mon[34403]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-17T07:17:30.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:30 smithi139 ceph-mon[34403]: osdmap e44: 6 total, 6 up, 6 in 2024-09-17T07:17:30.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:30 smithi139 ceph-mon[34403]: mds.? [v2:172.21.15.87:6828/2255237099,v1:172.21.15.87:6829/2255237099] up:standby-replay 2024-09-17T07:17:30.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:30 smithi139 ceph-mon[34403]: fsmap cephfs:2/2 {0=cephfs.smithi087.tjhpcs=up:replay,1=cephfs.smithi139.gnwonz=up:active} 1 up:standby-replay 2024-09-17T07:17:31.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:31 smithi087 ceph-mon[27636]: pgmap v179: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 409 B/s rd, 2.4 KiB/s wr, 8 op/s 2024-09-17T07:17:31.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:31 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:17:31.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:31 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:17:31.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:31 smithi087 ceph-mon[27636]: mds.? [v2:172.21.15.139:6824/3946792151,v1:172.21.15.139:6825/3946792151] up:active 2024-09-17T07:17:31.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:31 smithi087 ceph-mon[27636]: mds.? [v2:172.21.15.87:6826/4022268353,v1:172.21.15.87:6827/4022268353] up:boot 2024-09-17T07:17:31.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:31 smithi087 ceph-mon[27636]: mds.? [v2:172.21.15.87:6828/2255237099,v1:172.21.15.87:6829/2255237099] up:resolve 2024-09-17T07:17:31.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:31 smithi087 ceph-mon[27636]: fsmap cephfs:2/2 {0=cephfs.smithi087.tjhpcs=up:resolve,1=cephfs.smithi139.gnwonz=up:active} 1 up:standby-replay 1 up:standby 2024-09-17T07:17:31.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:31 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi087.vvbzss"}]: dispatch 2024-09-17T07:17:31.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:31 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:17:32.052 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/mon.smithi087/config 2024-09-17T07:17:32.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:31 smithi139 ceph-mon[34403]: pgmap v179: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 409 B/s rd, 2.4 KiB/s wr, 8 op/s 2024-09-17T07:17:32.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:31 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:17:32.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:31 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:17:32.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:31 smithi139 ceph-mon[34403]: mds.? [v2:172.21.15.139:6824/3946792151,v1:172.21.15.139:6825/3946792151] up:active 2024-09-17T07:17:32.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:31 smithi139 ceph-mon[34403]: mds.? [v2:172.21.15.87:6826/4022268353,v1:172.21.15.87:6827/4022268353] up:boot 2024-09-17T07:17:32.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:31 smithi139 ceph-mon[34403]: mds.? [v2:172.21.15.87:6828/2255237099,v1:172.21.15.87:6829/2255237099] up:resolve 2024-09-17T07:17:32.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:31 smithi139 ceph-mon[34403]: fsmap cephfs:2/2 {0=cephfs.smithi087.tjhpcs=up:resolve,1=cephfs.smithi139.gnwonz=up:active} 1 up:standby-replay 1 up:standby 2024-09-17T07:17:32.118 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:31 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi087.vvbzss"}]: dispatch 2024-09-17T07:17:32.118 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:31 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:17:33.581 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:33 smithi087 ceph-mon[27636]: mds.? [v2:172.21.15.87:6828/2255237099,v1:172.21.15.87:6829/2255237099] up:reconnect 2024-09-17T07:17:33.726 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:33 smithi087 ceph-mon[27636]: fsmap cephfs:2/2 {0=cephfs.smithi087.tjhpcs=up:reconnect,1=cephfs.smithi139.gnwonz=up:active} 1 up:standby-replay 1 up:standby 2024-09-17T07:17:33.726 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:33 smithi087 ceph-mon[27636]: pgmap v180: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 2.1 KiB/s wr, 7 op/s 2024-09-17T07:17:33.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:33 smithi139 ceph-mon[34403]: mds.? [v2:172.21.15.87:6828/2255237099,v1:172.21.15.87:6829/2255237099] up:reconnect 2024-09-17T07:17:33.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:33 smithi139 ceph-mon[34403]: fsmap cephfs:2/2 {0=cephfs.smithi087.tjhpcs=up:reconnect,1=cephfs.smithi139.gnwonz=up:active} 1 up:standby-replay 1 up:standby 2024-09-17T07:17:33.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:33 smithi139 ceph-mon[34403]: pgmap v180: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 2.1 KiB/s wr, 7 op/s 2024-09-17T07:17:34.666 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:34 smithi087 ceph-mon[27636]: mds.? [v2:172.21.15.87:6828/2255237099,v1:172.21.15.87:6829/2255237099] up:rejoin 2024-09-17T07:17:34.666 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:34 smithi087 ceph-mon[27636]: mds.? [v2:172.21.15.139:6826/3292073323,v1:172.21.15.139:6827/3292073323] up:standby-replay 2024-09-17T07:17:34.666 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:34 smithi087 ceph-mon[27636]: fsmap cephfs:2/2 {0=cephfs.smithi087.tjhpcs=up:rejoin,1=cephfs.smithi139.gnwonz=up:active} 1 up:standby-replay 1 up:standby 2024-09-17T07:17:34.666 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:34 smithi087 ceph-mon[27636]: daemon mds.cephfs.smithi087.tjhpcs is now active in filesystem cephfs as rank 0 2024-09-17T07:17:34.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:34.664+0000 7fac9da0a640 1 -- 172.21.15.87:0/2665809120 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac980fd840 msgr2=0x7fac980fdcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:34.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:34.664+0000 7fac9da0a640 1 --2- 172.21.15.87:0/2665809120 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac980fd840 0x7fac980fdcb0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fac800048d0 tx=0x7fac80009da0 comp rx=0 tx=0).stop 2024-09-17T07:17:34.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:34.664+0000 7fac9da0a640 1 -- 172.21.15.87:0/2665809120 shutdown_connections 2024-09-17T07:17:34.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:34.664+0000 7fac9da0a640 1 --2- 172.21.15.87:0/2665809120 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac980fd840 0x7fac980fdcb0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:34.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:34.664+0000 7fac9da0a640 1 --2- 172.21.15.87:0/2665809120 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fac980fc570 0x7fac980fc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:34.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:34.664+0000 7fac9da0a640 1 -- 172.21.15.87:0/2665809120 >> 172.21.15.87:0/2665809120 conn(0x7fac980f7d30 msgr2=0x7fac980fa160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:17:34.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:34.664+0000 7fac9da0a640 1 -- 172.21.15.87:0/2665809120 shutdown_connections 2024-09-17T07:17:34.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:34.664+0000 7fac9da0a640 1 -- 172.21.15.87:0/2665809120 wait complete. 2024-09-17T07:17:34.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:34.665+0000 7fac9da0a640 1 Processor -- start 2024-09-17T07:17:34.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:34.665+0000 7fac9da0a640 1 -- start start 2024-09-17T07:17:34.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:34.665+0000 7fac9da0a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fac980fc570 0x7fac9810d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:17:34.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:34.665+0000 7fac9da0a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac980fd840 0x7fac9810d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:17:34.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:34.665+0000 7fac9da0a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac9810e360 con 0x7fac980fd840 2024-09-17T07:17:34.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:34.665+0000 7fac9da0a640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac9810e4d0 con 0x7fac980fc570 2024-09-17T07:17:34.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:34.665+0000 7fac8e7fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac980fd840 0x7fac9810d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:17:34.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:34.665+0000 7fac8e7fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac980fd840 0x7fac9810d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40696/0 (socket says 172.21.15.87:40696) 2024-09-17T07:17:34.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:34.665+0000 7fac8e7fc640 1 -- 172.21.15.87:0/3637790414 learned_addr learned my addr 172.21.15.87:0/3637790414 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:17:34.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:34.666+0000 7fac8e7fc640 1 -- 172.21.15.87:0/3637790414 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fac980fc570 msgr2=0x7fac9810d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:34.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:34.666+0000 7fac96ffd640 1 --2- 172.21.15.87:0/3637790414 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fac980fc570 0x7fac9810d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:17:34.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:34.666+0000 7fac8e7fc640 1 --2- 172.21.15.87:0/3637790414 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fac980fc570 0x7fac9810d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:34.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:34.666+0000 7fac8e7fc640 1 -- 172.21.15.87:0/3637790414 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac80005040 con 0x7fac980fd840 2024-09-17T07:17:34.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:34.666+0000 7fac8e7fc640 1 --2- 172.21.15.87:0/3637790414 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac980fd840 0x7fac9810d560 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fac80009ac0 tx=0x7fac80009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:17:34.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:34.666+0000 7fac8ffff640 1 -- 172.21.15.87:0/3637790414 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac80038070 con 0x7fac980fd840 2024-09-17T07:17:34.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:34.666+0000 7fac8ffff640 1 -- 172.21.15.87:0/3637790414 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fac8002ae70 con 0x7fac980fd840 2024-09-17T07:17:34.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:34.666+0000 7fac9da0a640 1 -- 172.21.15.87:0/3637790414 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac9810e750 con 0x7fac980fd840 2024-09-17T07:17:34.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:34.666+0000 7fac8ffff640 1 -- 172.21.15.87:0/3637790414 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac80033420 con 0x7fac980fd840 2024-09-17T07:17:34.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:34.666+0000 7fac9da0a640 1 -- 172.21.15.87:0/3637790414 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac9810ec10 con 0x7fac980fd840 2024-09-17T07:17:34.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:34.667+0000 7fac9da0a640 1 -- 172.21.15.87:0/3637790414 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac980fb9d0 con 0x7fac980fd840 2024-09-17T07:17:34.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:34.667+0000 7fac8ffff640 1 -- 172.21.15.87:0/3637790414 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fac80030020 con 0x7fac980fd840 2024-09-17T07:17:34.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:34.668+0000 7fac8ffff640 1 --2- 172.21.15.87:0/3637790414 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fac8406ed60 0x7fac84071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:17:34.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:34.668+0000 7fac8ffff640 1 -- 172.21.15.87:0/3637790414 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fac800ae1e0 con 0x7fac980fd840 2024-09-17T07:17:34.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:34.668+0000 7fac96ffd640 1 --2- 172.21.15.87:0/3637790414 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fac8406ed60 0x7fac84071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:17:34.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:34.668+0000 7fac96ffd640 1 --2- 172.21.15.87:0/3637790414 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fac8406ed60 0x7fac84071210 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fac8800a900 tx=0x7fac88008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:17:34.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:34.672+0000 7fac8ffff640 1 -- 172.21.15.87:0/3637790414 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fac8007b2b0 con 0x7fac980fd840 2024-09-17T07:17:34.711 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:34 smithi139 ceph-mon[34403]: mds.? [v2:172.21.15.87:6828/2255237099,v1:172.21.15.87:6829/2255237099] up:rejoin 2024-09-17T07:17:34.711 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:34 smithi139 ceph-mon[34403]: mds.? [v2:172.21.15.139:6826/3292073323,v1:172.21.15.139:6827/3292073323] up:standby-replay 2024-09-17T07:17:34.711 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:34 smithi139 ceph-mon[34403]: fsmap cephfs:2/2 {0=cephfs.smithi087.tjhpcs=up:rejoin,1=cephfs.smithi139.gnwonz=up:active} 1 up:standby-replay 1 up:standby 2024-09-17T07:17:34.711 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:34 smithi139 ceph-mon[34403]: daemon mds.cephfs.smithi087.tjhpcs is now active in filesystem cephfs as rank 0 2024-09-17T07:17:34.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:34.873+0000 7fac9da0a640 1 -- 172.21.15.87:0/3637790414 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fac9804b720 con 0x7fac980fd840 2024-09-17T07:17:34.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:34.873+0000 7fac8ffff640 1 -- 172.21.15.87:0/3637790414 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1833 (secure 0 0 0) 0x7fac8007ac50 con 0x7fac980fd840 2024-09-17T07:17:34.875 INFO:teuthology.orchestra.run.smithi087.stdout:e19 2024-09-17T07:17:34.875 INFO:teuthology.orchestra.run.smithi087.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T07:17:34.875 INFO:teuthology.orchestra.run.smithi087.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T07:17:34.875 INFO:teuthology.orchestra.run.smithi087.stdout:legacy client fscid: 1 2024-09-17T07:17:34.875 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:17:34.875 INFO:teuthology.orchestra.run.smithi087.stdout:Filesystem 'cephfs' (1) 2024-09-17T07:17:34.875 INFO:teuthology.orchestra.run.smithi087.stdout:fs_name cephfs 2024-09-17T07:17:34.875 INFO:teuthology.orchestra.run.smithi087.stdout:epoch 19 2024-09-17T07:17:34.875 INFO:teuthology.orchestra.run.smithi087.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T07:17:34.875 INFO:teuthology.orchestra.run.smithi087.stdout:created 2024-09-17T07:17:15.368053+0000 2024-09-17T07:17:34.875 INFO:teuthology.orchestra.run.smithi087.stdout:modified 2024-09-17T07:17:34.399963+0000 2024-09-17T07:17:34.875 INFO:teuthology.orchestra.run.smithi087.stdout:tableserver 0 2024-09-17T07:17:34.875 INFO:teuthology.orchestra.run.smithi087.stdout:root 0 2024-09-17T07:17:34.876 INFO:teuthology.orchestra.run.smithi087.stdout:session_timeout 60 2024-09-17T07:17:34.876 INFO:teuthology.orchestra.run.smithi087.stdout:session_autoclose 300 2024-09-17T07:17:34.876 INFO:teuthology.orchestra.run.smithi087.stdout:max_file_size 1099511627776 2024-09-17T07:17:34.876 INFO:teuthology.orchestra.run.smithi087.stdout:required_client_features {} 2024-09-17T07:17:34.876 INFO:teuthology.orchestra.run.smithi087.stdout:last_failure 0 2024-09-17T07:17:34.876 INFO:teuthology.orchestra.run.smithi087.stdout:last_failure_osd_epoch 44 2024-09-17T07:17:34.876 INFO:teuthology.orchestra.run.smithi087.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T07:17:34.876 INFO:teuthology.orchestra.run.smithi087.stdout:max_mds 2 2024-09-17T07:17:34.876 INFO:teuthology.orchestra.run.smithi087.stdout:in 0,1 2024-09-17T07:17:34.876 INFO:teuthology.orchestra.run.smithi087.stdout:up {0=14478,1=24243} 2024-09-17T07:17:34.876 INFO:teuthology.orchestra.run.smithi087.stdout:failed 2024-09-17T07:17:34.876 INFO:teuthology.orchestra.run.smithi087.stdout:damaged 2024-09-17T07:17:34.876 INFO:teuthology.orchestra.run.smithi087.stdout:stopped 2024-09-17T07:17:34.877 INFO:teuthology.orchestra.run.smithi087.stdout:data_pools [3] 2024-09-17T07:17:34.877 INFO:teuthology.orchestra.run.smithi087.stdout:metadata_pool 2 2024-09-17T07:17:34.877 INFO:teuthology.orchestra.run.smithi087.stdout:inline_data enabled 2024-09-17T07:17:34.877 INFO:teuthology.orchestra.run.smithi087.stdout:balancer 2024-09-17T07:17:34.877 INFO:teuthology.orchestra.run.smithi087.stdout:standby_count_wanted 1 2024-09-17T07:17:34.877 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi087.tjhpcs{0:14478} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.87:6828/2255237099,v1:172.21.15.87:6829/2255237099] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:17:34.877 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi087.vvbzss{0:14490} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.87:6826/4022268353,v1:172.21.15.87:6827/4022268353] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:17:34.877 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi139.gnwonz{1:24243} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.139:6824/3946792151,v1:172.21.15.139:6825/3946792151] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:17:34.877 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi139.ftvinf{1:24253} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.139:6826/3292073323,v1:172.21.15.139:6827/3292073323] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:17:34.877 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:17:34.877 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:17:34.878 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 19 2024-09-17T07:17:34.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:34.875+0000 7fac9da0a640 1 -- 172.21.15.87:0/3637790414 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fac8406ed60 msgr2=0x7fac84071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:34.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:34.875+0000 7fac9da0a640 1 --2- 172.21.15.87:0/3637790414 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fac8406ed60 0x7fac84071210 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fac8800a900 tx=0x7fac88008040 comp rx=0 tx=0).stop 2024-09-17T07:17:34.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:34.875+0000 7fac9da0a640 1 -- 172.21.15.87:0/3637790414 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac980fd840 msgr2=0x7fac9810d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:34.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:34.875+0000 7fac9da0a640 1 --2- 172.21.15.87:0/3637790414 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac980fd840 0x7fac9810d560 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fac80009ac0 tx=0x7fac80009da0 comp rx=0 tx=0).stop 2024-09-17T07:17:34.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:34.875+0000 7fac9da0a640 1 -- 172.21.15.87:0/3637790414 shutdown_connections 2024-09-17T07:17:34.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:34.875+0000 7fac9da0a640 1 --2- 172.21.15.87:0/3637790414 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac980fd840 0x7fac9810d560 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:34.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:34.875+0000 7fac9da0a640 1 --2- 172.21.15.87:0/3637790414 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fac8406ed60 0x7fac84071210 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:34.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:34.875+0000 7fac9da0a640 1 --2- 172.21.15.87:0/3637790414 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fac980fc570 0x7fac9810d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:34.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:34.875+0000 7fac9da0a640 1 -- 172.21.15.87:0/3637790414 >> 172.21.15.87:0/3637790414 conn(0x7fac980f7d30 msgr2=0x7fac980f9570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:17:34.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:34.875+0000 7fac9da0a640 1 -- 172.21.15.87:0/3637790414 shutdown_connections 2024-09-17T07:17:34.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:34.876+0000 7fac9da0a640 1 -- 172.21.15.87:0/3637790414 wait complete. 2024-09-17T07:17:35.500 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:35 smithi087 ceph-mon[27636]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-17T07:17:35.501 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:35 smithi087 ceph-mon[27636]: mds.? [v2:172.21.15.87:6828/2255237099,v1:172.21.15.87:6829/2255237099] up:active 2024-09-17T07:17:35.501 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:35 smithi087 ceph-mon[27636]: fsmap cephfs:2 {0=cephfs.smithi087.tjhpcs=up:active,1=cephfs.smithi139.gnwonz=up:active} 1 up:standby-replay 1 up:standby 2024-09-17T07:17:35.501 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:35 smithi087 ceph-mon[27636]: fsmap cephfs:2 {0=cephfs.smithi087.tjhpcs=up:active,1=cephfs.smithi139.gnwonz=up:active} 2 up:standby-replay 2024-09-17T07:17:35.501 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:35 smithi087 ceph-mon[27636]: pgmap v181: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.6 KiB/s rd, 819 B/s wr, 6 op/s 2024-09-17T07:17:35.501 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:35 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/3637790414' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T07:17:35.501 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:35 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:17:35.501 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:35 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:17:35.501 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:35 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:17:35.501 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:35 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:17:35.501 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:35 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:17:35.501 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:35 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:17:35.526 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-09-17T07:17:35.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:35 smithi139 ceph-mon[34403]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-17T07:17:35.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:35 smithi139 ceph-mon[34403]: mds.? [v2:172.21.15.87:6828/2255237099,v1:172.21.15.87:6829/2255237099] up:active 2024-09-17T07:17:35.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:35 smithi139 ceph-mon[34403]: fsmap cephfs:2 {0=cephfs.smithi087.tjhpcs=up:active,1=cephfs.smithi139.gnwonz=up:active} 1 up:standby-replay 1 up:standby 2024-09-17T07:17:35.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:35 smithi139 ceph-mon[34403]: fsmap cephfs:2 {0=cephfs.smithi087.tjhpcs=up:active,1=cephfs.smithi139.gnwonz=up:active} 2 up:standby-replay 2024-09-17T07:17:35.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:35 smithi139 ceph-mon[34403]: pgmap v181: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.6 KiB/s rd, 819 B/s wr, 6 op/s 2024-09-17T07:17:35.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:35 smithi139 ceph-mon[34403]: from='client.? 172.21.15.87:0/3637790414' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T07:17:35.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:35 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:17:35.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:35 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:17:35.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:35 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:17:35.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:35 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:17:35.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:35 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:17:35.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:35 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:17:36.253 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/mon.smithi087/config 2024-09-17T07:17:37.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:37 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:17:37.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:37 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:17:37.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:37 smithi139 ceph-mon[34403]: pgmap v182: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.0 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-17T07:17:37.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:37 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:17:37.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:37 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:17:37.889 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:37 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:17:37.890 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:37 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:17:37.890 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:37 smithi087 ceph-mon[27636]: pgmap v182: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.0 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-17T07:17:37.890 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:37 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:17:37.890 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:37 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:17:38.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:37.966+0000 7f70d04a2640 1 -- 172.21.15.87:0/4069265707 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70c80fc570 msgr2=0x7f70c80fc980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:38.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:37.966+0000 7f70d04a2640 1 --2- 172.21.15.87:0/4069265707 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70c80fc570 0x7f70c80fc980 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f70c0004a10 tx=0x7f70c0009d40 comp rx=0 tx=0).stop 2024-09-17T07:17:38.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:37.966+0000 7f70d04a2640 1 -- 172.21.15.87:0/4069265707 shutdown_connections 2024-09-17T07:17:38.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:37.966+0000 7f70d04a2640 1 --2- 172.21.15.87:0/4069265707 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f70c80fd840 0x7f70c80fdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:38.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:37.966+0000 7f70d04a2640 1 --2- 172.21.15.87:0/4069265707 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70c80fc570 0x7f70c80fc980 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:38.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:37.966+0000 7f70d04a2640 1 -- 172.21.15.87:0/4069265707 >> 172.21.15.87:0/4069265707 conn(0x7f70c80f7d30 msgr2=0x7f70c80fa160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:17:38.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:37.966+0000 7f70d04a2640 1 -- 172.21.15.87:0/4069265707 shutdown_connections 2024-09-17T07:17:38.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:37.966+0000 7f70d04a2640 1 -- 172.21.15.87:0/4069265707 wait complete. 2024-09-17T07:17:38.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:37.966+0000 7f70d04a2640 1 Processor -- start 2024-09-17T07:17:38.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:37.966+0000 7f70d04a2640 1 -- start start 2024-09-17T07:17:38.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:37.966+0000 7f70d04a2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70c80fc570 0x7f70c810d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:17:38.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:37.966+0000 7f70d04a2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f70c80fd840 0x7f70c810d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:17:38.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:37.966+0000 7f70d04a2640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70c810e3c0 con 0x7f70c80fc570 2024-09-17T07:17:38.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:37.966+0000 7f70d04a2640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70c810e530 con 0x7f70c80fd840 2024-09-17T07:17:38.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:37.966+0000 7f70ce23e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70c80fc570 0x7f70c810d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:17:38.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:37.967+0000 7f70ce23e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70c80fc570 0x7f70c810d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40702/0 (socket says 172.21.15.87:40702) 2024-09-17T07:17:38.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:37.967+0000 7f70ce23e640 1 -- 172.21.15.87:0/742379570 learned_addr learned my addr 172.21.15.87:0/742379570 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:17:38.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:37.967+0000 7f70ce23e640 1 -- 172.21.15.87:0/742379570 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f70c80fd840 msgr2=0x7f70c810d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:38.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:37.967+0000 7f70cda3d640 1 --2- 172.21.15.87:0/742379570 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f70c80fd840 0x7f70c810d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:17:38.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:37.967+0000 7f70ce23e640 1 --2- 172.21.15.87:0/742379570 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f70c80fd840 0x7f70c810d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:38.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:37.967+0000 7f70ce23e640 1 -- 172.21.15.87:0/742379570 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70c00045d0 con 0x7f70c80fc570 2024-09-17T07:17:38.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:37.967+0000 7f70ce23e640 1 --2- 172.21.15.87:0/742379570 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70c80fc570 0x7f70c810d010 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f70c0000c00 tx=0x7f70c0009d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:17:38.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:37.967+0000 7f70c6ffd640 1 -- 172.21.15.87:0/742379570 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70c0038070 con 0x7f70c80fc570 2024-09-17T07:17:38.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:37.967+0000 7f70d04a2640 1 -- 172.21.15.87:0/742379570 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70c810e7b0 con 0x7f70c80fc570 2024-09-17T07:17:38.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:37.967+0000 7f70c6ffd640 1 -- 172.21.15.87:0/742379570 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f70c003dad0 con 0x7f70c80fc570 2024-09-17T07:17:38.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:37.967+0000 7f70c6ffd640 1 -- 172.21.15.87:0/742379570 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70c00338e0 con 0x7f70c80fc570 2024-09-17T07:17:38.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:37.967+0000 7f70d04a2640 1 -- 172.21.15.87:0/742379570 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70c810ecd0 con 0x7f70c80fc570 2024-09-17T07:17:38.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:37.968+0000 7f70d04a2640 1 -- 172.21.15.87:0/742379570 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70c81056c0 con 0x7f70c80fc570 2024-09-17T07:17:38.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:37.969+0000 7f70c6ffd640 1 -- 172.21.15.87:0/742379570 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f70c0030020 con 0x7f70c80fc570 2024-09-17T07:17:38.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:37.969+0000 7f70c6ffd640 1 --2- 172.21.15.87:0/742379570 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f70b006ed60 0x7f70b0071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:17:38.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:37.969+0000 7f70c6ffd640 1 -- 172.21.15.87:0/742379570 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f70c00ae460 con 0x7f70c80fc570 2024-09-17T07:17:38.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:37.969+0000 7f70cda3d640 1 --2- 172.21.15.87:0/742379570 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f70b006ed60 0x7f70b0071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:17:38.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:37.969+0000 7f70cda3d640 1 --2- 172.21.15.87:0/742379570 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f70b006ed60 0x7f70b0071210 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f70c810cdc0 tx=0x7f70bc008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:17:38.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:37.973+0000 7f70c6ffd640 1 -- 172.21.15.87:0/742379570 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f70c007b5b0 con 0x7f70c80fc570 2024-09-17T07:17:38.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:38.165+0000 7f70d04a2640 1 -- 172.21.15.87:0/742379570 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f70c80fb9d0 con 0x7f70c80fc570 2024-09-17T07:17:38.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:38.166+0000 7f70c6ffd640 1 -- 172.21.15.87:0/742379570 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4725 (secure 0 0 0) 0x7f70c007af50 con 0x7f70c80fc570 2024-09-17T07:17:38.167 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 19 2024-09-17T07:17:38.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:38.168+0000 7f70d04a2640 1 -- 172.21.15.87:0/742379570 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f70b006ed60 msgr2=0x7f70b0071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:38.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:38.168+0000 7f70d04a2640 1 --2- 172.21.15.87:0/742379570 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f70b006ed60 0x7f70b0071210 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f70c810cdc0 tx=0x7f70bc008040 comp rx=0 tx=0).stop 2024-09-17T07:17:38.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:38.168+0000 7f70d04a2640 1 -- 172.21.15.87:0/742379570 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70c80fc570 msgr2=0x7f70c810d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:38.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:38.168+0000 7f70d04a2640 1 --2- 172.21.15.87:0/742379570 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70c80fc570 0x7f70c810d010 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f70c0000c00 tx=0x7f70c0009d40 comp rx=0 tx=0).stop 2024-09-17T07:17:38.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:38.168+0000 7f70d04a2640 1 -- 172.21.15.87:0/742379570 shutdown_connections 2024-09-17T07:17:38.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:38.168+0000 7f70d04a2640 1 --2- 172.21.15.87:0/742379570 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f70b006ed60 0x7f70b0071210 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:38.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:38.168+0000 7f70d04a2640 1 --2- 172.21.15.87:0/742379570 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f70c80fd840 0x7f70c810d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:38.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:38.168+0000 7f70d04a2640 1 --2- 172.21.15.87:0/742379570 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70c80fc570 0x7f70c810d010 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:38.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:38.168+0000 7f70d04a2640 1 -- 172.21.15.87:0/742379570 >> 172.21.15.87:0/742379570 conn(0x7f70c80f7d30 msgr2=0x7f70c80f9590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:17:38.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:38.168+0000 7f70d04a2640 1 -- 172.21.15.87:0/742379570 shutdown_connections 2024-09-17T07:17:38.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:38.168+0000 7f70d04a2640 1 -- 172.21.15.87:0/742379570 wait complete. 2024-09-17T07:17:38.177 INFO:teuthology.orchestra.run.smithi087.stdout:true 2024-09-17T07:17:38.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:38 smithi139 ceph-mon[34403]: from='client.? 172.21.15.87:0/742379570' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-17T07:17:38.911 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:38 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/742379570' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-17T07:17:38.936 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-09-17T07:17:39.741 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/mon.smithi087/config 2024-09-17T07:17:39.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:39 smithi139 ceph-mon[34403]: pgmap v183: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 7.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-17T07:17:39.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:39 smithi087 ceph-mon[27636]: pgmap v183: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 7.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-17T07:17:41.660 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:41 smithi087 ceph-mon[27636]: pgmap v184: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 7.4 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-17T07:17:42.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:41 smithi139 ceph-mon[34403]: pgmap v184: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 7.4 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-17T07:17:42.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:42.464+0000 7fa50d487640 1 -- 172.21.15.87:0/970906794 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa5080fb450 msgr2=0x7fa5080fb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:42.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:42.464+0000 7fa50d487640 1 --2- 172.21.15.87:0/970906794 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa5080fb450 0x7fa5080fb860 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa500009c50 tx=0x7fa500004d10 comp rx=0 tx=0).stop 2024-09-17T07:17:42.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:42.465+0000 7fa50d487640 1 -- 172.21.15.87:0/970906794 shutdown_connections 2024-09-17T07:17:42.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:42.465+0000 7fa50d487640 1 --2- 172.21.15.87:0/970906794 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa5080fc720 0x7fa5080fcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:42.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:42.465+0000 7fa50d487640 1 --2- 172.21.15.87:0/970906794 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa5080fb450 0x7fa5080fb860 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:42.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:42.465+0000 7fa50d487640 1 -- 172.21.15.87:0/970906794 >> 172.21.15.87:0/970906794 conn(0x7fa5080f6c10 msgr2=0x7fa5080f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:17:42.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:42.465+0000 7fa50d487640 1 -- 172.21.15.87:0/970906794 shutdown_connections 2024-09-17T07:17:42.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:42.465+0000 7fa50d487640 1 -- 172.21.15.87:0/970906794 wait complete. 2024-09-17T07:17:42.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:42.465+0000 7fa50d487640 1 Processor -- start 2024-09-17T07:17:42.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:42.465+0000 7fa50d487640 1 -- start start 2024-09-17T07:17:42.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:42.465+0000 7fa50d487640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa5080fb450 0x7fa50810bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:17:42.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:42.465+0000 7fa50d487640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa5080fc720 0x7fa50810c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:17:42.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:42.465+0000 7fa50d487640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa50810d090 con 0x7fa5080fb450 2024-09-17T07:17:42.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:42.465+0000 7fa50d487640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa50810d200 con 0x7fa5080fc720 2024-09-17T07:17:42.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:42.466+0000 7fa506ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa5080fb450 0x7fa50810bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:17:42.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:42.466+0000 7fa506ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa5080fb450 0x7fa50810bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40714/0 (socket says 172.21.15.87:40714) 2024-09-17T07:17:42.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:42.466+0000 7fa506ffd640 1 -- 172.21.15.87:0/838605496 learned_addr learned my addr 172.21.15.87:0/838605496 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:17:42.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:42.466+0000 7fa506ffd640 1 -- 172.21.15.87:0/838605496 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa5080fc720 msgr2=0x7fa50810c300 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T07:17:42.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:42.466+0000 7fa506ffd640 1 --2- 172.21.15.87:0/838605496 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa5080fc720 0x7fa50810c300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:42.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:42.466+0000 7fa506ffd640 1 -- 172.21.15.87:0/838605496 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5000098b0 con 0x7fa5080fb450 2024-09-17T07:17:42.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:42.466+0000 7fa506ffd640 1 --2- 172.21.15.87:0/838605496 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa5080fb450 0x7fa50810bdc0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa500003400 tx=0x7fa500004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:17:42.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:42.466+0000 7fa4ff7fe640 1 -- 172.21.15.87:0/838605496 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa500032bb0 con 0x7fa5080fb450 2024-09-17T07:17:42.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:42.466+0000 7fa4ff7fe640 1 -- 172.21.15.87:0/838605496 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fa500032d10 con 0x7fa5080fb450 2024-09-17T07:17:42.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:42.466+0000 7fa50d487640 1 -- 172.21.15.87:0/838605496 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa50810d480 con 0x7fa5080fb450 2024-09-17T07:17:42.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:42.466+0000 7fa4ff7fe640 1 -- 172.21.15.87:0/838605496 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa500031610 con 0x7fa5080fb450 2024-09-17T07:17:42.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:42.466+0000 7fa50d487640 1 -- 172.21.15.87:0/838605496 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa50810d9a0 con 0x7fa5080fb450 2024-09-17T07:17:42.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:42.467+0000 7fa50d487640 1 -- 172.21.15.87:0/838605496 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5081045c0 con 0x7fa5080fb450 2024-09-17T07:17:42.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:42.468+0000 7fa4ff7fe640 1 -- 172.21.15.87:0/838605496 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fa50002f030 con 0x7fa5080fb450 2024-09-17T07:17:42.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:42.468+0000 7fa4ff7fe640 1 --2- 172.21.15.87:0/838605496 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fa4f406ed60 0x7fa4f4071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:17:42.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:42.468+0000 7fa4ff7fe640 1 -- 172.21.15.87:0/838605496 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fa5000afa00 con 0x7fa5080fb450 2024-09-17T07:17:42.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:42.468+0000 7fa5067fc640 1 --2- 172.21.15.87:0/838605496 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fa4f406ed60 0x7fa4f4071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:17:42.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:42.468+0000 7fa5067fc640 1 --2- 172.21.15.87:0/838605496 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fa4f406ed60 0x7fa4f4071210 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa4f00096c0 tx=0x7fa4f0006bd0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:17:42.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:42.472+0000 7fa4ff7fe640 1 -- 172.21.15.87:0/838605496 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fa50007cb50 con 0x7fa5080fb450 2024-09-17T07:17:42.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:42.702+0000 7fa50d487640 1 -- 172.21.15.87:0/838605496 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7fa5080fa8b0 con 0x7fa5080fb450 2024-09-17T07:17:42.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:42.702+0000 7fa4ff7fe640 1 -- 172.21.15.87:0/838605496 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v19) v1 ==== 78+0+100 (secure 0 0 0) 0x7fa5000480c0 con 0x7fa5080fb450 2024-09-17T07:17:42.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:42.704+0000 7fa50d487640 1 -- 172.21.15.87:0/838605496 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fa4f406ed60 msgr2=0x7fa4f4071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:42.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:42.704+0000 7fa50d487640 1 --2- 172.21.15.87:0/838605496 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fa4f406ed60 0x7fa4f4071210 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa4f00096c0 tx=0x7fa4f0006bd0 comp rx=0 tx=0).stop 2024-09-17T07:17:42.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:42.704+0000 7fa50d487640 1 -- 172.21.15.87:0/838605496 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa5080fb450 msgr2=0x7fa50810bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:42.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:42.704+0000 7fa50d487640 1 --2- 172.21.15.87:0/838605496 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa5080fb450 0x7fa50810bdc0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa500003400 tx=0x7fa500004d10 comp rx=0 tx=0).stop 2024-09-17T07:17:42.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:42.704+0000 7fa50d487640 1 -- 172.21.15.87:0/838605496 shutdown_connections 2024-09-17T07:17:42.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:42.704+0000 7fa50d487640 1 --2- 172.21.15.87:0/838605496 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fa4f406ed60 0x7fa4f4071210 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:42.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:42.704+0000 7fa50d487640 1 --2- 172.21.15.87:0/838605496 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa5080fc720 0x7fa50810c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:42.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:42.704+0000 7fa50d487640 1 --2- 172.21.15.87:0/838605496 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa5080fb450 0x7fa50810bdc0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:42.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:42.704+0000 7fa50d487640 1 -- 172.21.15.87:0/838605496 >> 172.21.15.87:0/838605496 conn(0x7fa5080f6c10 msgr2=0x7fa5080f8300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:17:42.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:42.704+0000 7fa50d487640 1 -- 172.21.15.87:0/838605496 shutdown_connections 2024-09-17T07:17:42.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:42.704+0000 7fa50d487640 1 -- 172.21.15.87:0/838605496 wait complete. 2024-09-17T07:17:42.714 INFO:teuthology.orchestra.run.smithi087.stdout:true 2024-09-17T07:17:43.352 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-09-17T07:17:43.378 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T07:17:43.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.484+0000 7f731639d640 1 -- 172.21.15.87:0/327238511 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f73100663d0 msgr2=0x7f73100ff080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:43.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.484+0000 7f731639d640 1 --2- 172.21.15.87:0/327238511 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f73100663d0 0x7f73100ff080 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f73000048d0 tx=0x7f7300009da0 comp rx=0 tx=0).stop 2024-09-17T07:17:43.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.484+0000 7f731639d640 1 -- 172.21.15.87:0/327238511 shutdown_connections 2024-09-17T07:17:43.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.484+0000 7f731639d640 1 --2- 172.21.15.87:0/327238511 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f73100ff5c0 0x7f73101019a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:43.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.484+0000 7f731639d640 1 --2- 172.21.15.87:0/327238511 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f73100663d0 0x7f73100ff080 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:43.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.484+0000 7f731639d640 1 -- 172.21.15.87:0/327238511 >> 172.21.15.87:0/327238511 conn(0x7f73100f6ab0 msgr2=0x7f73100f8f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:17:43.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.484+0000 7f731639d640 1 -- 172.21.15.87:0/327238511 shutdown_connections 2024-09-17T07:17:43.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.484+0000 7f731639d640 1 -- 172.21.15.87:0/327238511 wait complete. 2024-09-17T07:17:43.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.485+0000 7f731639d640 1 Processor -- start 2024-09-17T07:17:43.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.485+0000 7f731639d640 1 -- start start 2024-09-17T07:17:43.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.485+0000 7f731639d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f73100663d0 0x7f731010cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:17:43.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.485+0000 7f731639d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f73100ff5c0 0x7f731010d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:17:43.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.485+0000 7f731639d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f731010d960 con 0x7f73100ff5c0 2024-09-17T07:17:43.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.485+0000 7f731639d640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7310112320 con 0x7f73100663d0 2024-09-17T07:17:43.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.485+0000 7f730f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f73100ff5c0 0x7f731010d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:17:43.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.485+0000 7f730f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f73100ff5c0 0x7f731010d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40726/0 (socket says 172.21.15.87:40726) 2024-09-17T07:17:43.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.485+0000 7f730f7fe640 1 -- 172.21.15.87:0/2206683945 learned_addr learned my addr 172.21.15.87:0/2206683945 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:17:43.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.486+0000 7f730ffff640 1 --2- 172.21.15.87:0/2206683945 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f73100663d0 0x7f731010cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:17:43.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.486+0000 7f730f7fe640 1 -- 172.21.15.87:0/2206683945 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f73100663d0 msgr2=0x7f731010cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:43.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.486+0000 7f730f7fe640 1 --2- 172.21.15.87:0/2206683945 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f73100663d0 0x7f731010cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:43.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.486+0000 7f730f7fe640 1 -- 172.21.15.87:0/2206683945 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7300005040 con 0x7f73100ff5c0 2024-09-17T07:17:43.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.486+0000 7f730ffff640 1 --2- 172.21.15.87:0/2206683945 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f73100663d0 0x7f731010cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T07:17:43.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.486+0000 7f730f7fe640 1 --2- 172.21.15.87:0/2206683945 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f73100ff5c0 0x7f731010d310 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7304002a50 tx=0x7f7304004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:17:43.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.486+0000 7f730cff9640 1 -- 172.21.15.87:0/2206683945 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7304007c30 con 0x7f73100ff5c0 2024-09-17T07:17:43.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.486+0000 7f730cff9640 1 -- 172.21.15.87:0/2206683945 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f730400f040 con 0x7f73100ff5c0 2024-09-17T07:17:43.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.486+0000 7f731639d640 1 -- 172.21.15.87:0/2206683945 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73101124c0 con 0x7f73100ff5c0 2024-09-17T07:17:43.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.486+0000 7f730cff9640 1 -- 172.21.15.87:0/2206683945 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f730400d990 con 0x7f73100ff5c0 2024-09-17T07:17:43.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.486+0000 7f731639d640 1 -- 172.21.15.87:0/2206683945 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7310112a10 con 0x7f73100ff5c0 2024-09-17T07:17:43.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.487+0000 7f731639d640 1 -- 172.21.15.87:0/2206683945 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7310106690 con 0x7f73100ff5c0 2024-09-17T07:17:43.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.487+0000 7f730cff9640 1 -- 172.21.15.87:0/2206683945 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f730400dc00 con 0x7f73100ff5c0 2024-09-17T07:17:43.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.488+0000 7f730cff9640 1 --2- 172.21.15.87:0/2206683945 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f72f806ed60 0x7f72f8071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:17:43.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.488+0000 7f730ffff640 1 --2- 172.21.15.87:0/2206683945 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f72f806ed60 0x7f72f8071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:17:43.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.488+0000 7f730cff9640 1 -- 172.21.15.87:0/2206683945 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f730408da70 con 0x7f73100ff5c0 2024-09-17T07:17:43.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.488+0000 7f730ffff640 1 --2- 172.21.15.87:0/2206683945 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f72f806ed60 0x7f72f8071210 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f730002afd0 tx=0x7f7300035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:17:43.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.492+0000 7f730cff9640 1 -- 172.21.15.87:0/2206683945 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f730405ac80 con 0x7f73100ff5c0 2024-09-17T07:17:43.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.651+0000 7f731639d640 1 -- 172.21.15.87:0/2206683945 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7310104d00 con 0x7f73100ff5c0 2024-09-17T07:17:43.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.652+0000 7f730cff9640 1 -- 172.21.15.87:0/2206683945 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+14397 (secure 0 0 0) 0x7f7310104d00 con 0x7f73100ff5c0 2024-09-17T07:17:43.653 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:17:43.653 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":44,"fsid":"d5dbf8d6-74c3-11ef-bceb-c7b262605968","created":"2024-09-17T07:10:35.674251+0000","modified":"2024-09-17T07:17:30.381367+0000","last_up_change":"2024-09-17T07:16:00.493452+0000","last_in_change":"2024-09-17T07:15:41.556417+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T07:14:46.855001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-09-17T07:17:13.907561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-09-17T07:17:14.594643+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"aa28f635-8a58-48f8-bd4e-1626b8da9749","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":2205744672},{"type":"v1","addr":"172.21.15.87:6803","nonce":2205744672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":2205744672},{"type":"v1","addr":"172.21.15.87:6805","nonce":2205744672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2205744672},{"type":"v1","addr":"172.21.15.87:6809","nonce":2205744672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":2205744672},{"type":"v1","addr":"172.21.15.87:6807","nonce":2205744672}]},"public_addr":"172.21.15.87:6803/2205744672","cluster_addr":"172.21.15.87:6805/2205744672","heartbeat_back_addr":"172.21.15.87:6809/2205744672","heartbeat_front_addr":"172.21.15.87:6807/2205744672","state":["exists","up"]},{"osd":1,"uuid":"3a7464ee-c016-40fd-ab8a-9652397b193c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":3001772283},{"type":"v1","addr":"172.21.15.87:6811","nonce":3001772283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":3001772283},{"type":"v1","addr":"172.21.15.87:6813","nonce":3001772283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":3001772283},{"type":"v1","addr":"172.21.15.87:6817","nonce":3001772283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":3001772283},{"type":"v1","addr":"172.21.15.87:6815","nonce":3001772283}]},"public_addr":"172.21.15.87:6811/3001772283","cluster_addr":"172.21.15.87:6813/3001772283","heartbeat_back_addr":"172.21.15.87:6817/3001772283","heartbeat_front_addr":"172.21.15.87:6815/3001772283","state":["exists","up"]},{"osd":2,"uuid":"31ffe6e4-fa51-43ed-8887-022ad51fbd6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2282787545},{"type":"v1","addr":"172.21.15.87:6819","nonce":2282787545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2282787545},{"type":"v1","addr":"172.21.15.87:6821","nonce":2282787545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2282787545},{"type":"v1","addr":"172.21.15.87:6825","nonce":2282787545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2282787545},{"type":"v1","addr":"172.21.15.87:6823","nonce":2282787545}]},"public_addr":"172.21.15.87:6819/2282787545","cluster_addr":"172.21.15.87:6821/2282787545","heartbeat_back_addr":"172.21.15.87:6825/2282787545","heartbeat_front_addr":"172.21.15.87:6823/2282787545","state":["exists","up"]},{"osd":3,"uuid":"00b175ca-ddfd-41f9-b219-130321a7fbc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":796189750},{"type":"v1","addr":"172.21.15.139:6801","nonce":796189750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":796189750},{"type":"v1","addr":"172.21.15.139:6803","nonce":796189750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":796189750},{"type":"v1","addr":"172.21.15.139:6807","nonce":796189750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":796189750},{"type":"v1","addr":"172.21.15.139:6805","nonce":796189750}]},"public_addr":"172.21.15.139:6801/796189750","cluster_addr":"172.21.15.139:6803/796189750","heartbeat_back_addr":"172.21.15.139:6807/796189750","heartbeat_front_addr":"172.21.15.139:6805/796189750","state":["exists","up"]},{"osd":4,"uuid":"d318cab6-e472-472e-8805-d2ab7e04db2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":1310055282},{"type":"v1","addr":"172.21.15.139:6809","nonce":1310055282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":1310055282},{"type":"v1","addr":"172.21.15.139:6811","nonce":1310055282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":1310055282},{"type":"v1","addr":"172.21.15.139:6815","nonce":1310055282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":1310055282},{"type":"v1","addr":"172.21.15.139:6813","nonce":1310055282}]},"public_addr":"172.21.15.139:6809/1310055282","cluster_addr":"172.21.15.139:6811/1310055282","heartbeat_back_addr":"172.21.15.139:6815/1310055282","heartbeat_front_addr":"172.21.15.139:6813/1310055282","state":["exists","up"]},{"osd":5,"uuid":"37b86806-e559-401c-aedf-3d9de1ac347e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":1731614128},{"type":"v1","addr":"172.21.15.139:6817","nonce":1731614128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":1731614128},{"type":"v1","addr":"172.21.15.139:6819","nonce":1731614128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":1731614128},{"type":"v1","addr":"172.21.15.139:6823","nonce":1731614128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":1731614128},{"type":"v1","addr":"172.21.15.139:6821","nonce":1731614128}]},"public_addr":"172.21.15.139:6817/1731614128","cluster_addr":"172.21.15.139:6819/1731614128","heartbeat_back_addr":"172.21.15.139:6823/1731614128","heartbeat_front_addr":"172.21.15.139:6821/1731614128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T07:13:50.061288+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T07:14:15.941888+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T07:14:44.449653+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T07:15:08.229646+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T07:15:33.299519+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T07:15:58.647774+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.87:6827/3333749861":"2024-09-18T07:17:30.381338+0000","172.21.15.87:0/2357718754":"2024-09-18T07:12:36.550496+0000","172.21.15.87:0/1935417402":"2024-09-18T07:11:03.573097+0000","172.21.15.87:6826/3333749861":"2024-09-18T07:17:30.381338+0000","172.21.15.87:0/2382049370":"2024-09-18T07:11:03.573097+0000","172.21.15.87:6801/1735030430":"2024-09-18T07:11:32.590075+0000","172.21.15.87:0/228221666":"2024-09-18T07:11:32.590075+0000","172.21.15.87:0/853807276":"2024-09-18T07:11:03.573097+0000","172.21.15.87:6801/2633029569":"2024-09-18T07:11:03.573097+0000","172.21.15.87:0/2452100146":"2024-09-18T07:11:32.590075+0000","172.21.15.87:6800/1735030430":"2024-09-18T07:11:32.590075+0000","172.21.15.87:0/2629320129":"2024-09-18T07:11:32.590075+0000","172.21.15.87:6801/2341884603":"2024-09-18T07:12:36.550496+0000","172.21.15.87:0/443165441":"2024-09-18T07:12:36.550496+0000","172.21.15.87:0/2056368138":"2024-09-18T07:12:36.550496+0000","172.21.15.87:6800/2633029569":"2024-09-18T07:11:03.573097+0000","172.21.15.87:6800/2341884603":"2024-09-18T07:12:36.550496+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T07:17:43.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.654+0000 7f731639d640 1 -- 172.21.15.87:0/2206683945 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f72f806ed60 msgr2=0x7f72f8071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:43.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.654+0000 7f731639d640 1 --2- 172.21.15.87:0/2206683945 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f72f806ed60 0x7f72f8071210 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f730002afd0 tx=0x7f7300035040 comp rx=0 tx=0).stop 2024-09-17T07:17:43.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.654+0000 7f731639d640 1 -- 172.21.15.87:0/2206683945 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f73100ff5c0 msgr2=0x7f731010d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:43.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.654+0000 7f731639d640 1 --2- 172.21.15.87:0/2206683945 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f73100ff5c0 0x7f731010d310 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7304002a50 tx=0x7f7304004600 comp rx=0 tx=0).stop 2024-09-17T07:17:43.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.654+0000 7f731639d640 1 -- 172.21.15.87:0/2206683945 shutdown_connections 2024-09-17T07:17:43.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.654+0000 7f731639d640 1 --2- 172.21.15.87:0/2206683945 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f73100ff5c0 0x7f731010d310 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:43.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.654+0000 7f731639d640 1 --2- 172.21.15.87:0/2206683945 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f72f806ed60 0x7f72f8071210 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:43.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.654+0000 7f731639d640 1 --2- 172.21.15.87:0/2206683945 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f73100663d0 0x7f731010cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:43.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.654+0000 7f731639d640 1 -- 172.21.15.87:0/2206683945 >> 172.21.15.87:0/2206683945 conn(0x7f73100f6ab0 msgr2=0x7f73100f8f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:17:43.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.654+0000 7f731639d640 1 -- 172.21.15.87:0/2206683945 shutdown_connections 2024-09-17T07:17:43.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.654+0000 7f731639d640 1 -- 172.21.15.87:0/2206683945 wait complete. 2024-09-17T07:17:43.666 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T07:14:46.855001+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-09-17T07:17:13.907561+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-09-17T07:17:14.594643+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-17T07:17:43.666 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T07:17:43.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.764+0000 7ffa9119d640 1 -- 172.21.15.87:0/3826897301 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa8c0fb310 msgr2=0x7ffa8c0fb720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:43.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.764+0000 7ffa9119d640 1 --2- 172.21.15.87:0/3826897301 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa8c0fb310 0x7ffa8c0fb720 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c0048d0 tx=0x7ffa7c009da0 comp rx=0 tx=0).stop 2024-09-17T07:17:43.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.764+0000 7ffa9119d640 1 -- 172.21.15.87:0/3826897301 shutdown_connections 2024-09-17T07:17:43.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.764+0000 7ffa9119d640 1 --2- 172.21.15.87:0/3826897301 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffa8c0fc5e0 0x7ffa8c0fca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:43.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.764+0000 7ffa9119d640 1 --2- 172.21.15.87:0/3826897301 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa8c0fb310 0x7ffa8c0fb720 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:43.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.764+0000 7ffa9119d640 1 -- 172.21.15.87:0/3826897301 >> 172.21.15.87:0/3826897301 conn(0x7ffa8c0f6ad0 msgr2=0x7ffa8c0f8f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:17:43.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.764+0000 7ffa9119d640 1 -- 172.21.15.87:0/3826897301 shutdown_connections 2024-09-17T07:17:43.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.764+0000 7ffa9119d640 1 -- 172.21.15.87:0/3826897301 wait complete. 2024-09-17T07:17:43.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.765+0000 7ffa9119d640 1 Processor -- start 2024-09-17T07:17:43.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.765+0000 7ffa9119d640 1 -- start start 2024-09-17T07:17:43.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.765+0000 7ffa9119d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa8c0fb310 0x7ffa8c10cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:17:43.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.765+0000 7ffa9119d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffa8c0fc5e0 0x7ffa8c10d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:17:43.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.765+0000 7ffa9119d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8c10d960 con 0x7ffa8c0fb310 2024-09-17T07:17:43.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.765+0000 7ffa9119d640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8c112320 con 0x7ffa8c0fc5e0 2024-09-17T07:17:43.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.765+0000 7ffa8ad9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa8c0fb310 0x7ffa8c10cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:17:43.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.765+0000 7ffa8ad9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa8c0fb310 0x7ffa8c10cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40742/0 (socket says 172.21.15.87:40742) 2024-09-17T07:17:43.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.765+0000 7ffa8ad9d640 1 -- 172.21.15.87:0/2377235980 learned_addr learned my addr 172.21.15.87:0/2377235980 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:17:43.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.765+0000 7ffa8a59c640 1 --2- 172.21.15.87:0/2377235980 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffa8c0fc5e0 0x7ffa8c10d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:17:43.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.765+0000 7ffa8ad9d640 1 -- 172.21.15.87:0/2377235980 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffa8c0fc5e0 msgr2=0x7ffa8c10d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:43.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.765+0000 7ffa8ad9d640 1 --2- 172.21.15.87:0/2377235980 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffa8c0fc5e0 0x7ffa8c10d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:43.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.765+0000 7ffa8ad9d640 1 -- 172.21.15.87:0/2377235980 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa7c005040 con 0x7ffa8c0fb310 2024-09-17T07:17:43.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.765+0000 7ffa8a59c640 1 --2- 172.21.15.87:0/2377235980 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffa8c0fc5e0 0x7ffa8c10d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T07:17:43.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.765+0000 7ffa8ad9d640 1 --2- 172.21.15.87:0/2377235980 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa8c0fb310 0x7ffa8c10cdd0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c003080 tx=0x7ffa7c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:17:43.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.765+0000 7ffa737fe640 1 -- 172.21.15.87:0/2377235980 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa7c038070 con 0x7ffa8c0fb310 2024-09-17T07:17:43.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.766+0000 7ffa737fe640 1 -- 172.21.15.87:0/2377235980 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7ffa7c02ae70 con 0x7ffa8c0fb310 2024-09-17T07:17:43.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.766+0000 7ffa737fe640 1 -- 172.21.15.87:0/2377235980 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa7c03d420 con 0x7ffa8c0fb310 2024-09-17T07:17:43.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.766+0000 7ffa9119d640 1 -- 172.21.15.87:0/2377235980 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa8c112460 con 0x7ffa8c0fb310 2024-09-17T07:17:43.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.766+0000 7ffa9119d640 1 -- 172.21.15.87:0/2377235980 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa8c1129b0 con 0x7ffa8c0fb310 2024-09-17T07:17:43.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.766+0000 7ffa9119d640 1 -- 172.21.15.87:0/2377235980 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa8c04bf60 con 0x7ffa8c0fb310 2024-09-17T07:17:43.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.767+0000 7ffa737fe640 1 -- 172.21.15.87:0/2377235980 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7ffa7c030020 con 0x7ffa8c0fb310 2024-09-17T07:17:43.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.767+0000 7ffa737fe640 1 --2- 172.21.15.87:0/2377235980 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7ffa7406ed60 0x7ffa74071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:17:43.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.767+0000 7ffa8a59c640 1 --2- 172.21.15.87:0/2377235980 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7ffa7406ed60 0x7ffa74071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:17:43.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.767+0000 7ffa737fe640 1 -- 172.21.15.87:0/2377235980 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7ffa7c0ae9a0 con 0x7ffa8c0fb310 2024-09-17T07:17:43.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.768+0000 7ffa8a59c640 1 --2- 172.21.15.87:0/2377235980 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7ffa7406ed60 0x7ffa74071210 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ffa800041d0 tx=0x7ffa80009040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:17:43.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.771+0000 7ffa737fe640 1 -- 172.21.15.87:0/2377235980 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ffa7c07baf0 con 0x7ffa8c0fb310 2024-09-17T07:17:43.918 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:43 smithi139 ceph-mon[34403]: pgmap v185: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 7.2 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-17T07:17:43.918 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:43 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:17:43.918 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:43 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:17:43.919 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:43 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:17:43.919 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:43 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:17:43.919 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:43 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:17:43.919 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:43 smithi139 ceph-mon[34403]: from='client.? 172.21.15.87:0/838605496' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-09-17T07:17:43.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.925+0000 7ffa9119d640 1 -- 172.21.15.87:0/2377235980 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ffa8c103bd0 con 0x7ffa8c0fb310 2024-09-17T07:17:43.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:43 smithi087 ceph-mon[27636]: pgmap v185: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 7.2 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-17T07:17:43.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:43 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:17:43.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:43 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:17:43.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:43 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:17:43.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:43 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:17:43.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:43 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:17:43.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:43 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/838605496' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-09-17T07:17:43.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.925+0000 7ffa737fe640 1 -- 172.21.15.87:0/2377235980 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v44) v1 ==== 93+0+10 (secure 0 0 0) 0x7ffa7c07b490 con 0x7ffa8c0fb310 2024-09-17T07:17:43.927 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 1 2024-09-17T07:17:43.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.927+0000 7ffa9119d640 1 -- 172.21.15.87:0/2377235980 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7ffa7406ed60 msgr2=0x7ffa74071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:43.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.927+0000 7ffa9119d640 1 --2- 172.21.15.87:0/2377235980 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7ffa7406ed60 0x7ffa74071210 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ffa800041d0 tx=0x7ffa80009040 comp rx=0 tx=0).stop 2024-09-17T07:17:43.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.927+0000 7ffa9119d640 1 -- 172.21.15.87:0/2377235980 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa8c0fb310 msgr2=0x7ffa8c10cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:43.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.927+0000 7ffa9119d640 1 --2- 172.21.15.87:0/2377235980 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa8c0fb310 0x7ffa8c10cdd0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c003080 tx=0x7ffa7c009da0 comp rx=0 tx=0).stop 2024-09-17T07:17:43.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.927+0000 7ffa9119d640 1 -- 172.21.15.87:0/2377235980 shutdown_connections 2024-09-17T07:17:43.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.927+0000 7ffa9119d640 1 --2- 172.21.15.87:0/2377235980 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7ffa7406ed60 0x7ffa74071210 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:43.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.927+0000 7ffa9119d640 1 --2- 172.21.15.87:0/2377235980 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffa8c0fc5e0 0x7ffa8c10d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:43.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.927+0000 7ffa9119d640 1 --2- 172.21.15.87:0/2377235980 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa8c0fb310 0x7ffa8c10cdd0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:43.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.927+0000 7ffa9119d640 1 -- 172.21.15.87:0/2377235980 >> 172.21.15.87:0/2377235980 conn(0x7ffa8c0f6ad0 msgr2=0x7ffa8c0f8600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:17:43.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.927+0000 7ffa9119d640 1 -- 172.21.15.87:0/2377235980 shutdown_connections 2024-09-17T07:17:43.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:43.927+0000 7ffa9119d640 1 -- 172.21.15.87:0/2377235980 wait complete. 2024-09-17T07:17:43.938 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-09-17T07:17:44.037 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.034+0000 7f354a2c0640 1 -- 172.21.15.87:0/4146479032 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35440fb310 msgr2=0x7f35440fb720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:44.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.034+0000 7f354a2c0640 1 --2- 172.21.15.87:0/4146479032 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35440fb310 0x7f35440fb720 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f35340048d0 tx=0x7f3534009da0 comp rx=0 tx=0).stop 2024-09-17T07:17:44.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.034+0000 7f354a2c0640 1 -- 172.21.15.87:0/4146479032 shutdown_connections 2024-09-17T07:17:44.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.034+0000 7f354a2c0640 1 --2- 172.21.15.87:0/4146479032 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f35440fc5e0 0x7f35440fca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:44.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.034+0000 7f354a2c0640 1 --2- 172.21.15.87:0/4146479032 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35440fb310 0x7f35440fb720 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:44.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.034+0000 7f354a2c0640 1 -- 172.21.15.87:0/4146479032 >> 172.21.15.87:0/4146479032 conn(0x7f35440f6af0 msgr2=0x7f35440f8f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:17:44.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.035+0000 7f354a2c0640 1 -- 172.21.15.87:0/4146479032 shutdown_connections 2024-09-17T07:17:44.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.035+0000 7f354a2c0640 1 -- 172.21.15.87:0/4146479032 wait complete. 2024-09-17T07:17:44.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.035+0000 7f354a2c0640 1 Processor -- start 2024-09-17T07:17:44.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.035+0000 7f354a2c0640 1 -- start start 2024-09-17T07:17:44.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.035+0000 7f354a2c0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35440fb310 0x7f35440661c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:17:44.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.035+0000 7f354a2c0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f35440fc5e0 0x7f3544111be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:17:44.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.035+0000 7f354a2c0640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3544112120 con 0x7f35440fb310 2024-09-17T07:17:44.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.035+0000 7f354a2c0640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3544112260 con 0x7f35440fc5e0 2024-09-17T07:17:44.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.035+0000 7f3543fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35440fb310 0x7f35440661c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:17:44.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.035+0000 7f3543fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35440fb310 0x7f35440661c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40756/0 (socket says 172.21.15.87:40756) 2024-09-17T07:17:44.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.035+0000 7f3543fff640 1 -- 172.21.15.87:0/3613127333 learned_addr learned my addr 172.21.15.87:0/3613127333 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:17:44.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.036+0000 7f35437fe640 1 --2- 172.21.15.87:0/3613127333 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f35440fc5e0 0x7f3544111be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:17:44.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.036+0000 7f3543fff640 1 -- 172.21.15.87:0/3613127333 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f35440fc5e0 msgr2=0x7f3544111be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:44.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.036+0000 7f3543fff640 1 --2- 172.21.15.87:0/3613127333 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f35440fc5e0 0x7f3544111be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:44.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.036+0000 7f3543fff640 1 -- 172.21.15.87:0/3613127333 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3534005040 con 0x7f35440fb310 2024-09-17T07:17:44.039 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.036+0000 7f3543fff640 1 --2- 172.21.15.87:0/3613127333 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35440fb310 0x7f35440661c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f35340043d0 tx=0x7f3534009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:17:44.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.036+0000 7f3540ff9640 1 -- 172.21.15.87:0/3613127333 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3534038070 con 0x7f35440fb310 2024-09-17T07:17:44.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.036+0000 7f3540ff9640 1 -- 172.21.15.87:0/3613127333 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f35340096c0 con 0x7f35440fb310 2024-09-17T07:17:44.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.036+0000 7f354a2c0640 1 -- 172.21.15.87:0/3613127333 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3544112460 con 0x7f35440fb310 2024-09-17T07:17:44.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.036+0000 7f3540ff9640 1 -- 172.21.15.87:0/3613127333 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f353403d420 con 0x7f35440fb310 2024-09-17T07:17:44.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.036+0000 7f354a2c0640 1 -- 172.21.15.87:0/3613127333 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3544112980 con 0x7f35440fb310 2024-09-17T07:17:44.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.037+0000 7f354a2c0640 1 -- 172.21.15.87:0/3613127333 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f354404bf60 con 0x7f35440fb310 2024-09-17T07:17:44.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.037+0000 7f3540ff9640 1 -- 172.21.15.87:0/3613127333 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f3534030020 con 0x7f35440fb310 2024-09-17T07:17:44.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.038+0000 7f3540ff9640 1 --2- 172.21.15.87:0/3613127333 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f352c06ed50 0x7f352c071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:17:44.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.038+0000 7f3540ff9640 1 -- 172.21.15.87:0/3613127333 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f35340ae890 con 0x7f35440fb310 2024-09-17T07:17:44.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.038+0000 7f35437fe640 1 --2- 172.21.15.87:0/3613127333 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f352c06ed50 0x7f352c071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:17:44.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.038+0000 7f35437fe640 1 --2- 172.21.15.87:0/3613127333 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f352c06ed50 0x7f352c071200 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3544065f70 tx=0x7f353800b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:17:44.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.042+0000 7f3540ff9640 1 -- 172.21.15.87:0/3613127333 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f353407ba20 con 0x7f35440fb310 2024-09-17T07:17:44.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.209+0000 7f354a2c0640 1 -- 172.21.15.87:0/3613127333 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f3544103bd0 con 0x7f35440fb310 2024-09-17T07:17:44.210 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.209+0000 7f3540ff9640 1 -- 172.21.15.87:0/3613127333 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v44) v1 ==== 107+0+11 (secure 0 0 0) 0x7f353407b3c0 con 0x7f35440fb310 2024-09-17T07:17:44.211 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2024-09-17T07:17:44.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.212+0000 7f354a2c0640 1 -- 172.21.15.87:0/3613127333 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f352c06ed50 msgr2=0x7f352c071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:44.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.212+0000 7f354a2c0640 1 --2- 172.21.15.87:0/3613127333 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f352c06ed50 0x7f352c071200 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3544065f70 tx=0x7f353800b040 comp rx=0 tx=0).stop 2024-09-17T07:17:44.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.212+0000 7f354a2c0640 1 -- 172.21.15.87:0/3613127333 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35440fb310 msgr2=0x7f35440661c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:44.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.212+0000 7f354a2c0640 1 --2- 172.21.15.87:0/3613127333 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35440fb310 0x7f35440661c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f35340043d0 tx=0x7f3534009da0 comp rx=0 tx=0).stop 2024-09-17T07:17:44.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.212+0000 7f354a2c0640 1 -- 172.21.15.87:0/3613127333 shutdown_connections 2024-09-17T07:17:44.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.212+0000 7f354a2c0640 1 --2- 172.21.15.87:0/3613127333 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f352c06ed50 0x7f352c071200 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:44.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.212+0000 7f354a2c0640 1 --2- 172.21.15.87:0/3613127333 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f35440fc5e0 0x7f3544111be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:44.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.212+0000 7f354a2c0640 1 --2- 172.21.15.87:0/3613127333 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35440fb310 0x7f35440661c0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:44.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.212+0000 7f354a2c0640 1 -- 172.21.15.87:0/3613127333 >> 172.21.15.87:0/3613127333 conn(0x7f35440f6af0 msgr2=0x7f35440f83f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:17:44.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.212+0000 7f354a2c0640 1 -- 172.21.15.87:0/3613127333 shutdown_connections 2024-09-17T07:17:44.214 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.212+0000 7f354a2c0640 1 -- 172.21.15.87:0/3613127333 wait complete. 2024-09-17T07:17:44.225 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-09-17T07:17:44.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.321+0000 7fd12d0e8640 1 -- 172.21.15.87:0/3913430944 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1280fc5e0 msgr2=0x7fd1280fca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:44.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.321+0000 7fd12d0e8640 1 --2- 172.21.15.87:0/3913430944 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1280fc5e0 0x7fd1280fca50 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd11c0048d0 tx=0x7fd11c009da0 comp rx=0 tx=0).stop 2024-09-17T07:17:44.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.321+0000 7fd12d0e8640 1 -- 172.21.15.87:0/3913430944 shutdown_connections 2024-09-17T07:17:44.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.321+0000 7fd12d0e8640 1 --2- 172.21.15.87:0/3913430944 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1280fc5e0 0x7fd1280fca50 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:44.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.321+0000 7fd12d0e8640 1 --2- 172.21.15.87:0/3913430944 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd1280fb310 0x7fd1280fb720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:44.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.322+0000 7fd12d0e8640 1 -- 172.21.15.87:0/3913430944 >> 172.21.15.87:0/3913430944 conn(0x7fd1280f6ad0 msgr2=0x7fd1280f8f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:17:44.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.322+0000 7fd12d0e8640 1 -- 172.21.15.87:0/3913430944 shutdown_connections 2024-09-17T07:17:44.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.322+0000 7fd12d0e8640 1 -- 172.21.15.87:0/3913430944 wait complete. 2024-09-17T07:17:44.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.322+0000 7fd12d0e8640 1 Processor -- start 2024-09-17T07:17:44.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.322+0000 7fd12d0e8640 1 -- start start 2024-09-17T07:17:44.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.322+0000 7fd12d0e8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1280fb310 0x7fd128066230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:17:44.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.322+0000 7fd12d0e8640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd1280fc5e0 0x7fd128111ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:17:44.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.322+0000 7fd12d0e8640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1281120e0 con 0x7fd1280fb310 2024-09-17T07:17:44.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.322+0000 7fd12d0e8640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd128112220 con 0x7fd1280fc5e0 2024-09-17T07:17:44.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.322+0000 7fd126d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1280fb310 0x7fd128066230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:17:44.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.322+0000 7fd126d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1280fb310 0x7fd128066230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:43282/0 (socket says 172.21.15.87:43282) 2024-09-17T07:17:44.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.322+0000 7fd126d9d640 1 -- 172.21.15.87:0/610509114 learned_addr learned my addr 172.21.15.87:0/610509114 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:17:44.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.323+0000 7fd12659c640 1 --2- 172.21.15.87:0/610509114 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd1280fc5e0 0x7fd128111ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:17:44.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.323+0000 7fd126d9d640 1 -- 172.21.15.87:0/610509114 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd1280fc5e0 msgr2=0x7fd128111ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:44.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.323+0000 7fd126d9d640 1 --2- 172.21.15.87:0/610509114 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd1280fc5e0 0x7fd128111ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:44.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.323+0000 7fd126d9d640 1 -- 172.21.15.87:0/610509114 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd11c005040 con 0x7fd1280fb310 2024-09-17T07:17:44.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.323+0000 7fd126d9d640 1 --2- 172.21.15.87:0/610509114 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1280fb310 0x7fd128066230 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd118002a50 tx=0x7fd118004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:17:44.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.323+0000 7fd10f7fe640 1 -- 172.21.15.87:0/610509114 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd118007c30 con 0x7fd1280fb310 2024-09-17T07:17:44.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.323+0000 7fd10f7fe640 1 -- 172.21.15.87:0/610509114 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fd11800f040 con 0x7fd1280fb310 2024-09-17T07:17:44.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.323+0000 7fd10f7fe640 1 -- 172.21.15.87:0/610509114 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd11800d910 con 0x7fd1280fb310 2024-09-17T07:17:44.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.323+0000 7fd12d0e8640 1 -- 172.21.15.87:0/610509114 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd128112480 con 0x7fd1280fb310 2024-09-17T07:17:44.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.323+0000 7fd12d0e8640 1 -- 172.21.15.87:0/610509114 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1281129f0 con 0x7fd1280fb310 2024-09-17T07:17:44.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.324+0000 7fd12d0e8640 1 -- 172.21.15.87:0/610509114 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd12804bf60 con 0x7fd1280fb310 2024-09-17T07:17:44.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.325+0000 7fd10f7fe640 1 -- 172.21.15.87:0/610509114 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fd11800db80 con 0x7fd1280fb310 2024-09-17T07:17:44.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.325+0000 7fd10f7fe640 1 --2- 172.21.15.87:0/610509114 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fd11006ed50 0x7fd110071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:17:44.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.325+0000 7fd10f7fe640 1 -- 172.21.15.87:0/610509114 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fd11808d8c0 con 0x7fd1280fb310 2024-09-17T07:17:44.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.325+0000 7fd12659c640 1 --2- 172.21.15.87:0/610509114 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fd11006ed50 0x7fd110071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:17:44.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.325+0000 7fd12659c640 1 --2- 172.21.15.87:0/610509114 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fd11006ed50 0x7fd110071200 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd11c000c00 tx=0x7fd11c035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:17:44.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.329+0000 7fd10f7fe640 1 -- 172.21.15.87:0/610509114 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fd11804d2a0 con 0x7fd1280fb310 2024-09-17T07:17:44.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.482+0000 7fd12d0e8640 1 -- 172.21.15.87:0/610509114 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7fd128103bf0 con 0x7fd1280fb310 2024-09-17T07:17:44.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.483+0000 7fd10f7fe640 1 -- 172.21.15.87:0/610509114 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v44) v1 ==== 107+0+11 (secure 0 0 0) 0x7fd11805aac0 con 0x7fd1280fb310 2024-09-17T07:17:44.484 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2024-09-17T07:17:44.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.484+0000 7fd12d0e8640 1 -- 172.21.15.87:0/610509114 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fd11006ed50 msgr2=0x7fd110071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:44.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.484+0000 7fd12d0e8640 1 --2- 172.21.15.87:0/610509114 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fd11006ed50 0x7fd110071200 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd11c000c00 tx=0x7fd11c035040 comp rx=0 tx=0).stop 2024-09-17T07:17:44.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.484+0000 7fd12d0e8640 1 -- 172.21.15.87:0/610509114 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1280fb310 msgr2=0x7fd128066230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:44.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.484+0000 7fd12d0e8640 1 --2- 172.21.15.87:0/610509114 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1280fb310 0x7fd128066230 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd118002a50 tx=0x7fd118004600 comp rx=0 tx=0).stop 2024-09-17T07:17:44.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.484+0000 7fd12d0e8640 1 -- 172.21.15.87:0/610509114 shutdown_connections 2024-09-17T07:17:44.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.484+0000 7fd12d0e8640 1 --2- 172.21.15.87:0/610509114 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fd11006ed50 0x7fd110071200 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:44.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.484+0000 7fd12d0e8640 1 --2- 172.21.15.87:0/610509114 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd1280fc5e0 0x7fd128111ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:44.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.484+0000 7fd12d0e8640 1 --2- 172.21.15.87:0/610509114 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1280fb310 0x7fd128066230 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:44.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.484+0000 7fd12d0e8640 1 -- 172.21.15.87:0/610509114 >> 172.21.15.87:0/610509114 conn(0x7fd1280f6ad0 msgr2=0x7fd1280f8340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:17:44.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.485+0000 7fd12d0e8640 1 -- 172.21.15.87:0/610509114 shutdown_connections 2024-09-17T07:17:44.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.485+0000 7fd12d0e8640 1 -- 172.21.15.87:0/610509114 wait complete. 2024-09-17T07:17:44.496 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T07:17:44.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.589+0000 7f4129434640 1 -- 172.21.15.87:0/3315340182 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41240fb300 msgr2=0x7f41240fb710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:44.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.589+0000 7f4129434640 1 --2- 172.21.15.87:0/3315340182 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41240fb300 0x7f41240fb710 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4114009c50 tx=0x7f4114004d10 comp rx=0 tx=0).stop 2024-09-17T07:17:44.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.589+0000 7f4129434640 1 -- 172.21.15.87:0/3315340182 shutdown_connections 2024-09-17T07:17:44.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.589+0000 7f4129434640 1 --2- 172.21.15.87:0/3315340182 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f41240fc5d0 0x7f41240fca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:44.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.589+0000 7f4129434640 1 --2- 172.21.15.87:0/3315340182 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41240fb300 0x7f41240fb710 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:44.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.589+0000 7f4129434640 1 -- 172.21.15.87:0/3315340182 >> 172.21.15.87:0/3315340182 conn(0x7f41240f6ac0 msgr2=0x7f41240f8ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:17:44.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.589+0000 7f4129434640 1 -- 172.21.15.87:0/3315340182 shutdown_connections 2024-09-17T07:17:44.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.589+0000 7f4129434640 1 -- 172.21.15.87:0/3315340182 wait complete. 2024-09-17T07:17:44.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.590+0000 7f4129434640 1 Processor -- start 2024-09-17T07:17:44.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.590+0000 7f4129434640 1 -- start start 2024-09-17T07:17:44.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.590+0000 7f4129434640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41240fb300 0x7f412410bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:17:44.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.590+0000 7f4129434640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f41240fc5d0 0x7f412410c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:17:44.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.590+0000 7f4129434640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f412410c850 con 0x7f41240fb300 2024-09-17T07:17:44.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.590+0000 7f4129434640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4124111210 con 0x7f41240fc5d0 2024-09-17T07:17:44.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.590+0000 7f4122ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41240fb300 0x7f412410bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:17:44.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.590+0000 7f4122ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41240fb300 0x7f412410bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:43306/0 (socket says 172.21.15.87:43306) 2024-09-17T07:17:44.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.590+0000 7f4122ffd640 1 -- 172.21.15.87:0/2302468116 learned_addr learned my addr 172.21.15.87:0/2302468116 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:17:44.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.590+0000 7f41227fc640 1 --2- 172.21.15.87:0/2302468116 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f41240fc5d0 0x7f412410c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:17:44.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.591+0000 7f4122ffd640 1 -- 172.21.15.87:0/2302468116 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f41240fc5d0 msgr2=0x7f412410c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:44.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.591+0000 7f4122ffd640 1 --2- 172.21.15.87:0/2302468116 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f41240fc5d0 0x7f412410c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:44.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.591+0000 7f4122ffd640 1 -- 172.21.15.87:0/2302468116 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41140098b0 con 0x7f41240fb300 2024-09-17T07:17:44.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.591+0000 7f4122ffd640 1 --2- 172.21.15.87:0/2302468116 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41240fb300 0x7f412410bc90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4114032470 tx=0x7f4114004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:17:44.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.591+0000 7f410b7fe640 1 -- 172.21.15.87:0/2302468116 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4114032750 con 0x7f41240fb300 2024-09-17T07:17:44.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.591+0000 7f410b7fe640 1 -- 172.21.15.87:0/2302468116 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f4114009710 con 0x7f41240fb300 2024-09-17T07:17:44.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.591+0000 7f4129434640 1 -- 172.21.15.87:0/2302468116 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4124111350 con 0x7f41240fb300 2024-09-17T07:17:44.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.591+0000 7f410b7fe640 1 -- 172.21.15.87:0/2302468116 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f411403dab0 con 0x7f41240fb300 2024-09-17T07:17:44.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.591+0000 7f4129434640 1 -- 172.21.15.87:0/2302468116 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41241118c0 con 0x7f41240fb300 2024-09-17T07:17:44.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.592+0000 7f4129434640 1 -- 172.21.15.87:0/2302468116 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f412404bf60 con 0x7f41240fb300 2024-09-17T07:17:44.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.592+0000 7f410b7fe640 1 -- 172.21.15.87:0/2302468116 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f411402f030 con 0x7f41240fb300 2024-09-17T07:17:44.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.593+0000 7f410b7fe640 1 --2- 172.21.15.87:0/2302468116 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f410c06ed50 0x7f410c071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:17:44.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.593+0000 7f410b7fe640 1 -- 172.21.15.87:0/2302468116 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f41140af680 con 0x7f41240fb300 2024-09-17T07:17:44.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.593+0000 7f41227fc640 1 --2- 172.21.15.87:0/2302468116 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f410c06ed50 0x7f410c071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:17:44.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.593+0000 7f41227fc640 1 --2- 172.21.15.87:0/2302468116 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f410c06ed50 0x7f410c071200 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f412410d180 tx=0x7f411800b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:17:44.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.597+0000 7f410b7fe640 1 -- 172.21.15.87:0/2302468116 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f411407c7d0 con 0x7f41240fb300 2024-09-17T07:17:44.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.788+0000 7f4129434640 1 -- 172.21.15.87:0/2302468116 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4124111be0 con 0x7f41240fb300 2024-09-17T07:17:44.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.788+0000 7f410b7fe640 1 -- 172.21.15.87:0/2302468116 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4725 (secure 0 0 0) 0x7f411403f110 con 0x7f41240fb300 2024-09-17T07:17:44.789 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:17:44.789 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T07:17:15.368053+0000","modified":"2024-09-17T07:17:34.399963+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":44,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14478,"mds_1":24243},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14478":{"gid":14478,"name":"cephfs.smithi087.tjhpcs","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.87:6829/2255237099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2255237099},{"type":"v1","addr":"172.21.15.87:6829","nonce":2255237099}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14490":{"gid":14490,"name":"cephfs.smithi087.vvbzss","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6827/4022268353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":4022268353},{"type":"v1","addr":"172.21.15.87:6827","nonce":4022268353}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24243":{"gid":24243,"name":"cephfs.smithi139.gnwonz","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.139:6825/3946792151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":3946792151},{"type":"v1","addr":"172.21.15.139:6825","nonce":3946792151}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24253":{"gid":24253,"name":"cephfs.smithi139.ftvinf","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.139:6827/3292073323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":3292073323},{"type":"v1","addr":"172.21.15.139:6827","nonce":3292073323}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-09-17T07:17:44.790 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 19 2024-09-17T07:17:44.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.790+0000 7f4129434640 1 -- 172.21.15.87:0/2302468116 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f410c06ed50 msgr2=0x7f410c071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:44.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.790+0000 7f4129434640 1 --2- 172.21.15.87:0/2302468116 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f410c06ed50 0x7f410c071200 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f412410d180 tx=0x7f411800b040 comp rx=0 tx=0).stop 2024-09-17T07:17:44.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.790+0000 7f4129434640 1 -- 172.21.15.87:0/2302468116 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41240fb300 msgr2=0x7f412410bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:44.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.790+0000 7f4129434640 1 --2- 172.21.15.87:0/2302468116 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41240fb300 0x7f412410bc90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4114032470 tx=0x7f4114004d10 comp rx=0 tx=0).stop 2024-09-17T07:17:44.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.790+0000 7f4129434640 1 -- 172.21.15.87:0/2302468116 shutdown_connections 2024-09-17T07:17:44.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.790+0000 7f4129434640 1 --2- 172.21.15.87:0/2302468116 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f410c06ed50 0x7f410c071200 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:44.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.790+0000 7f4129434640 1 --2- 172.21.15.87:0/2302468116 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f41240fc5d0 0x7f412410c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:44.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.790+0000 7f4129434640 1 --2- 172.21.15.87:0/2302468116 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41240fb300 0x7f412410bc90 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:44.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.790+0000 7f4129434640 1 -- 172.21.15.87:0/2302468116 >> 172.21.15.87:0/2302468116 conn(0x7f41240f6ac0 msgr2=0x7f41240f83d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:17:44.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.790+0000 7f4129434640 1 -- 172.21.15.87:0/2302468116 shutdown_connections 2024-09-17T07:17:44.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:44.790+0000 7f4129434640 1 -- 172.21.15.87:0/2302468116 wait complete. 2024-09-17T07:17:44.800 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:44 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/2206683945' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-17T07:17:44.801 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:44 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/2377235980' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-17T07:17:44.801 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:44 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/3613127333' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-09-17T07:17:44.801 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:44 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/610509114' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-09-17T07:17:44.802 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 19, 'max_mds': 2, 'flags': 50} 2024-09-17T07:17:44.802 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-17T07:17:44.867 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-17T07:17:44.868 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.1': {}} 2024-09-17T07:17:44.868 INFO:tasks.ceph_fuse:client.0 config is {} 2024-09-17T07:17:44.868 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-17T07:17:44.868 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T07:17:44.868 INFO:tasks.ceph_fuse:client.1 config is {} 2024-09-17T07:17:44.868 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-17T07:17:44.868 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-17T07:17:44.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T07:17:44.869 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list 2024-09-17T07:17:44.885 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T07:17:44.885 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link delete ceph-brx 2024-09-17T07:17:44.951 INFO:teuthology.orchestra.run.smithi087.stderr:Cannot find device "ceph-brx" 2024-09-17T07:17:44.953 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T07:17:44.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T07:17:44.953 DEBUG:teuthology.orchestra.run.smithi139:> ip netns list 2024-09-17T07:17:44.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T07:17:44.971 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip link delete ceph-brx 2024-09-17T07:17:45.033 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:44 smithi139 ceph-mon[34403]: from='client.? 172.21.15.87:0/2206683945' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-17T07:17:45.033 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:44 smithi139 ceph-mon[34403]: from='client.? 172.21.15.87:0/2377235980' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-17T07:17:45.033 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:44 smithi139 ceph-mon[34403]: from='client.? 172.21.15.87:0/3613127333' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-09-17T07:17:45.033 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:44 smithi139 ceph-mon[34403]: from='client.? 172.21.15.87:0/610509114' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-09-17T07:17:45.039 INFO:teuthology.orchestra.run.smithi139.stderr:Cannot find device "ceph-brx" 2024-09-17T07:17:45.040 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T07:17:45.041 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-17T07:17:45.041 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-17T07:17:45.041 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-17T07:17:45.282 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/mon.smithi087/config 2024-09-17T07:17:45.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:45 smithi087 ceph-mon[27636]: pgmap v186: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-17T07:17:45.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:45 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/2302468116' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-17T07:17:46.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:45 smithi139 ceph-mon[34403]: pgmap v186: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-17T07:17:46.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:45 smithi139 ceph-mon[34403]: from='client.? 172.21.15.87:0/2302468116' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-17T07:17:46.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:46.729+0000 7f52d52cd640 1 -- 172.21.15.87:0/2914963401 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52d00fe790 msgr2=0x7f52d00fec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:46.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:46.729+0000 7f52d52cd640 1 --2- 172.21.15.87:0/2914963401 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52d00fe790 0x7f52d00fec00 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f52b80048d0 tx=0x7f52b8009da0 comp rx=0 tx=0).stop 2024-09-17T07:17:46.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:46.729+0000 7f52d52cd640 1 -- 172.21.15.87:0/2914963401 shutdown_connections 2024-09-17T07:17:46.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:46.729+0000 7f52d52cd640 1 --2- 172.21.15.87:0/2914963401 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52d00fe790 0x7f52d00fec00 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:46.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:46.729+0000 7f52d52cd640 1 --2- 172.21.15.87:0/2914963401 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f52d01047b0 0x7f52d0104b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:46.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:46.729+0000 7f52d52cd640 1 -- 172.21.15.87:0/2914963401 >> 172.21.15.87:0/2914963401 conn(0x7f52d00fa330 msgr2=0x7f52d00fc740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:17:46.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:46.729+0000 7f52d52cd640 1 -- 172.21.15.87:0/2914963401 shutdown_connections 2024-09-17T07:17:46.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:46.729+0000 7f52d52cd640 1 -- 172.21.15.87:0/2914963401 wait complete. 2024-09-17T07:17:46.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:46.730+0000 7f52d52cd640 1 Processor -- start 2024-09-17T07:17:46.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:46.730+0000 7f52d52cd640 1 -- start start 2024-09-17T07:17:46.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:46.730+0000 7f52d52cd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f52d00fe790 0x7f52d0115360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:17:46.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:46.730+0000 7f52d52cd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52d01047b0 0x7f52d01158a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:17:46.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:46.730+0000 7f52d52cd640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d0115f30 con 0x7f52d01047b0 2024-09-17T07:17:46.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:46.730+0000 7f52d52cd640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d010f2e0 con 0x7f52d00fe790 2024-09-17T07:17:46.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:46.730+0000 7f52c7fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52d01047b0 0x7f52d01158a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:17:46.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:46.730+0000 7f52c7fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52d01047b0 0x7f52d01158a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:43318/0 (socket says 172.21.15.87:43318) 2024-09-17T07:17:46.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:46.730+0000 7f52c7fff640 1 -- 172.21.15.87:0/680414460 learned_addr learned my addr 172.21.15.87:0/680414460 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:17:46.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:46.730+0000 7f52ceffd640 1 --2- 172.21.15.87:0/680414460 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f52d00fe790 0x7f52d0115360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:17:46.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:46.730+0000 7f52c7fff640 1 -- 172.21.15.87:0/680414460 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f52d00fe790 msgr2=0x7f52d0115360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:46.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:46.730+0000 7f52c7fff640 1 --2- 172.21.15.87:0/680414460 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f52d00fe790 0x7f52d0115360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:46.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:46.730+0000 7f52c7fff640 1 -- 172.21.15.87:0/680414460 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52b8005040 con 0x7f52d01047b0 2024-09-17T07:17:46.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:46.731+0000 7f52ceffd640 1 --2- 172.21.15.87:0/680414460 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f52d00fe790 0x7f52d0115360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T07:17:46.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:46.731+0000 7f52c7fff640 1 --2- 172.21.15.87:0/680414460 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52d01047b0 0x7f52d01158a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f52b8003080 tx=0x7f52b8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:17:46.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:46.731+0000 7f52c77fe640 1 -- 172.21.15.87:0/680414460 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52b8038070 con 0x7f52d01047b0 2024-09-17T07:17:46.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:46.731+0000 7f52c77fe640 1 -- 172.21.15.87:0/680414460 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f52b8009740 con 0x7f52d01047b0 2024-09-17T07:17:46.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:46.731+0000 7f52d52cd640 1 -- 172.21.15.87:0/680414460 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52d010f560 con 0x7f52d01047b0 2024-09-17T07:17:46.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:46.731+0000 7f52c77fe640 1 -- 172.21.15.87:0/680414460 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52b802c8a0 con 0x7f52d01047b0 2024-09-17T07:17:46.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:46.731+0000 7f52d52cd640 1 -- 172.21.15.87:0/680414460 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52d010fa20 con 0x7f52d01047b0 2024-09-17T07:17:46.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:46.732+0000 7f52d52cd640 1 -- 172.21.15.87:0/680414460 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52d00ffed0 con 0x7f52d01047b0 2024-09-17T07:17:46.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:46.732+0000 7f52c77fe640 1 -- 172.21.15.87:0/680414460 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f52b8030020 con 0x7f52d01047b0 2024-09-17T07:17:46.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:46.733+0000 7f52c77fe640 1 --2- 172.21.15.87:0/680414460 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f52bc06ed50 0x7f52bc071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:17:46.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:46.733+0000 7f52c77fe640 1 -- 172.21.15.87:0/680414460 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f52b80ae6c0 con 0x7f52d01047b0 2024-09-17T07:17:46.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:46.733+0000 7f52ceffd640 1 --2- 172.21.15.87:0/680414460 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f52bc06ed50 0x7f52bc071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:17:46.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:46.733+0000 7f52ceffd640 1 --2- 172.21.15.87:0/680414460 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f52bc06ed50 0x7f52bc071200 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f52c0006fd0 tx=0x7f52c0008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:17:46.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:46.737+0000 7f52c77fe640 1 -- 172.21.15.87:0/680414460 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f52b807b790 con 0x7f52d01047b0 2024-09-17T07:17:46.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:46.926+0000 7f52d52cd640 1 -- 172.21.15.87:0/680414460 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f52d010b6e0 con 0x7f52d01047b0 2024-09-17T07:17:46.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:46.926+0000 7f52c77fe640 1 -- 172.21.15.87:0/680414460 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v19) v1 ==== 53+0+83 (secure 0 0 0) 0x7f52b807b130 con 0x7f52d01047b0 2024-09-17T07:17:46.927 INFO:teuthology.orchestra.run.smithi087.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-09-17T07:17:46.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:46.929+0000 7f52d52cd640 1 -- 172.21.15.87:0/680414460 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f52bc06ed50 msgr2=0x7f52bc071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:46.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:46.929+0000 7f52d52cd640 1 --2- 172.21.15.87:0/680414460 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f52bc06ed50 0x7f52bc071200 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f52c0006fd0 tx=0x7f52c0008040 comp rx=0 tx=0).stop 2024-09-17T07:17:46.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:46.929+0000 7f52d52cd640 1 -- 172.21.15.87:0/680414460 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52d01047b0 msgr2=0x7f52d01158a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:46.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:46.929+0000 7f52d52cd640 1 --2- 172.21.15.87:0/680414460 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52d01047b0 0x7f52d01158a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f52b8003080 tx=0x7f52b8009da0 comp rx=0 tx=0).stop 2024-09-17T07:17:46.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:46.929+0000 7f52d52cd640 1 -- 172.21.15.87:0/680414460 shutdown_connections 2024-09-17T07:17:46.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:46.929+0000 7f52d52cd640 1 --2- 172.21.15.87:0/680414460 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52d01047b0 0x7f52d01158a0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:46.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:46.929+0000 7f52d52cd640 1 --2- 172.21.15.87:0/680414460 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f52bc06ed50 0x7f52bc071200 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:46.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:46.929+0000 7f52d52cd640 1 --2- 172.21.15.87:0/680414460 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f52d00fe790 0x7f52d0115360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:46.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:46.929+0000 7f52d52cd640 1 -- 172.21.15.87:0/680414460 >> 172.21.15.87:0/680414460 conn(0x7f52d00fa330 msgr2=0x7f52d00fb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:17:46.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:46.929+0000 7f52d52cd640 1 -- 172.21.15.87:0/680414460 shutdown_connections 2024-09-17T07:17:46.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:46.929+0000 7f52d52cd640 1 -- 172.21.15.87:0/680414460 wait complete. 2024-09-17T07:17:47.572 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T07:17:47.572 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T07:17:47.572 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi087.front.sepia.ceph.com 2024-09-17T07:17:47.572 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T07:17:47.572 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T07:17:47.572 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T07:17:47.572 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T07:17:47.572 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T07:17:47.572 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T07:17:47.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T07:17:47.573 DEBUG:teuthology.orchestra.run.smithi087:> ip addr 2024-09-17T07:17:47.589 INFO:teuthology.orchestra.run.smithi087.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T07:17:47.589 INFO:teuthology.orchestra.run.smithi087.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T07:17:47.589 INFO:teuthology.orchestra.run.smithi087.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T07:17:47.589 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-17T07:17:47.589 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 ::1/128 scope host 2024-09-17T07:17:47.589 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-17T07:17:47.589 INFO:teuthology.orchestra.run.smithi087.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T07:17:47.589 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fc brd ff:ff:ff:ff:ff:ff 2024-09-17T07:17:47.590 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f0 2024-09-17T07:17:47.590 INFO:teuthology.orchestra.run.smithi087.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T07:17:47.590 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fd brd ff:ff:ff:ff:ff:ff 2024-09-17T07:17:47.590 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f1 2024-09-17T07:17:47.590 INFO:teuthology.orchestra.run.smithi087.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T07:17:47.590 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f4 brd ff:ff:ff:ff:ff:ff 2024-09-17T07:17:47.590 INFO:teuthology.orchestra.run.smithi087.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T07:17:47.590 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f5 brd ff:ff:ff:ff:ff:ff 2024-09-17T07:17:47.590 INFO:teuthology.orchestra.run.smithi087.stdout: inet 172.21.15.87/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T07:17:47.590 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft 42353sec preferred_lft 42353sec 2024-09-17T07:17:47.590 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::ec4:7aff:fe8f:d5f5/64 scope link noprefixroute 2024-09-17T07:17:47.590 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-17T07:17:47.591 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-17T07:17:47.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T07:17:47.591 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec bash -c ' 2024-09-17T07:17:47.591 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-09-17T07:17:47.591 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link add name ceph-brx type bridge 2024-09-17T07:17:47.591 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip addr flush dev ceph-brx 2024-09-17T07:17:47.591 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link set ceph-brx up 2024-09-17T07:17:47.591 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-17T07:17:47.592 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-09-17T07:17:47.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T07:17:47.757 DEBUG:teuthology.orchestra.run.smithi087:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T07:17:47.781 INFO:teuthology.orchestra.run.smithi087.stdout:1 2024-09-17T07:17:47.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T07:17:47.782 DEBUG:teuthology.orchestra.run.smithi087:> route 2024-09-17T07:17:47.857 INFO:teuthology.orchestra.run.smithi087.stdout:Kernel IP routing table 2024-09-17T07:17:47.857 INFO:teuthology.orchestra.run.smithi087.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T07:17:47.857 INFO:teuthology.orchestra.run.smithi087.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T07:17:47.857 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T07:17:47.858 INFO:teuthology.orchestra.run.smithi087.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T07:17:47.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T07:17:47.858 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec bash -c ' 2024-09-17T07:17:47.858 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-09-17T07:17:47.858 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T07:17:47.858 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T07:17:47.858 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T07:17:47.859 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-09-17T07:17:47.920 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:47 smithi087 ceph-mon[27636]: pgmap v187: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 6.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-17T07:17:47.921 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:47 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/680414460' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-17T07:17:48.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:47 smithi139 ceph-mon[34403]: pgmap v187: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 6.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-17T07:17:48.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:47 smithi139 ceph-mon[34403]: from='client.? 172.21.15.87:0/680414460' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-17T07:17:48.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T07:17:48.147 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list 2024-09-17T07:17:48.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T07:17:48.203 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list-id 2024-09-17T07:17:48.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T07:17:48.258 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec bash -c ' 2024-09-17T07:17:48.258 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-09-17T07:17:48.258 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T07:17:48.258 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-17T07:17:48.258 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-09-17T07:17:48.335 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-17T07:17:48.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T07:17:48.335 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec bash -c ' 2024-09-17T07:17:48.335 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-09-17T07:17:48.335 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-17T07:17:48.335 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-17T07:17:48.335 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-17T07:17:48.335 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-17T07:17:48.335 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-17T07:17:48.336 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-09-17T07:17:48.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T07:17:48.461 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec bash -c ' 2024-09-17T07:17:48.461 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-09-17T07:17:48.461 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link set brx.0 up 2024-09-17T07:17:48.461 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link set dev brx.0 master ceph-brx 2024-09-17T07:17:48.461 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-09-17T07:17:48.497 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-17T07:17:48.497 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T07:17:48.498 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T07:17:48.553 INFO:teuthology.orchestra.run.smithi087.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T07:17:48.554 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T07:17:48.554 DEBUG:teuthology.orchestra.run.smithi087:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T07:17:48.609 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2024-09-17T07:17:48.675 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-17T07:17:48.675 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-17T07:17:48.739 INFO:teuthology.orchestra.run.smithi087.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-17T07:17:48.740 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-17T07:17:48.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T07:17:48.741 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2024-09-17T07:17:48.796 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-17T07:17:48.796 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-17T07:17:48.839 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2024-09-17T07:17:48.864 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-17T07:17:48.864 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-17T07:17:48.931 INFO:teuthology.orchestra.run.smithi087.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-17T07:17:48.932 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-17T07:17:48.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T07:17:48.932 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2024-09-17T07:17:48.956 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi087.stderr:2024-09-17T07:17:48.955+0000 7f7b4bec7300 -1 init, newargv = 0x55a52d5323c0 newargc=15 2024-09-17T07:17:48.956 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi087.stderr:ceph-fuse[74096]: starting ceph client 2024-09-17T07:17:48.963 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi087.stderr:ceph-fuse[74096]: starting fuse 2024-09-17T07:17:48.972 INFO:teuthology.orchestra.run.smithi087.stdout:122 2024-09-17T07:17:48.972 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [122] 2024-09-17T07:17:48.972 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-17T07:17:48.973 DEBUG:teuthology.orchestra.run.smithi087:> import glob 2024-09-17T07:17:48.973 DEBUG:teuthology.orchestra.run.smithi087:> import re 2024-09-17T07:17:48.973 DEBUG:teuthology.orchestra.run.smithi087:> import os 2024-09-17T07:17:48.973 DEBUG:teuthology.orchestra.run.smithi087:> import subprocess 2024-09-17T07:17:48.973 DEBUG:teuthology.orchestra.run.smithi087:> 2024-09-17T07:17:48.973 DEBUG:teuthology.orchestra.run.smithi087:> def _find_admin_socket(client_name): 2024-09-17T07:17:48.973 DEBUG:teuthology.orchestra.run.smithi087:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-17T07:17:48.974 DEBUG:teuthology.orchestra.run.smithi087:> files = glob.glob(asok_path) 2024-09-17T07:17:48.974 DEBUG:teuthology.orchestra.run.smithi087:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-17T07:17:48.974 DEBUG:teuthology.orchestra.run.smithi087:> 2024-09-17T07:17:48.974 DEBUG:teuthology.orchestra.run.smithi087:> # Given a non-glob path, it better be there 2024-09-17T07:17:48.974 DEBUG:teuthology.orchestra.run.smithi087:> if "*" not in asok_path: 2024-09-17T07:17:48.974 DEBUG:teuthology.orchestra.run.smithi087:> assert(len(files) == 1) 2024-09-17T07:17:48.974 DEBUG:teuthology.orchestra.run.smithi087:> return files[0] 2024-09-17T07:17:48.975 DEBUG:teuthology.orchestra.run.smithi087:> 2024-09-17T07:17:48.975 DEBUG:teuthology.orchestra.run.smithi087:> for f in files: 2024-09-17T07:17:48.975 DEBUG:teuthology.orchestra.run.smithi087:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-17T07:17:48.975 DEBUG:teuthology.orchestra.run.smithi087:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-17T07:17:48.975 DEBUG:teuthology.orchestra.run.smithi087:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-17T07:17:48.975 DEBUG:teuthology.orchestra.run.smithi087:> contents = proc_f.read() 2024-09-17T07:17:48.975 DEBUG:teuthology.orchestra.run.smithi087:> if mountpoint in contents: 2024-09-17T07:17:48.976 DEBUG:teuthology.orchestra.run.smithi087:> return f 2024-09-17T07:17:48.976 DEBUG:teuthology.orchestra.run.smithi087:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-17T07:17:48.976 DEBUG:teuthology.orchestra.run.smithi087:> 2024-09-17T07:17:48.976 DEBUG:teuthology.orchestra.run.smithi087:> print(_find_admin_socket("client.0")) 2024-09-17T07:17:48.976 DEBUG:teuthology.orchestra.run.smithi087:> ' 2024-09-17T07:17:49.086 INFO:teuthology.orchestra.run.smithi087.stdout:/var/run/ceph/ceph-client.0.74096.asok 2024-09-17T07:17:49.272 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.74096.asok 2024-09-17T07:17:49.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T07:17:49.273 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.74096.asok status 2024-09-17T07:17:49.401 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T07:17:49.401 INFO:teuthology.orchestra.run.smithi087.stdout: "metadata": { 2024-09-17T07:17:49.401 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_sha1": "4a704134aa895fa24b75bb03cb263f1e3316004e", 2024-09-17T07:17:49.401 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_version": "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)", 2024-09-17T07:17:49.401 INFO:teuthology.orchestra.run.smithi087.stdout: "entity_id": "0", 2024-09-17T07:17:49.401 INFO:teuthology.orchestra.run.smithi087.stdout: "hostname": "smithi087", 2024-09-17T07:17:49.402 INFO:teuthology.orchestra.run.smithi087.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-17T07:17:49.402 INFO:teuthology.orchestra.run.smithi087.stdout: "pid": "74096", 2024-09-17T07:17:49.402 INFO:teuthology.orchestra.run.smithi087.stdout: "root": "/" 2024-09-17T07:17:49.402 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:17:49.402 INFO:teuthology.orchestra.run.smithi087.stdout: "dentry_count": 0, 2024-09-17T07:17:49.402 INFO:teuthology.orchestra.run.smithi087.stdout: "dentry_pinned_count": 0, 2024-09-17T07:17:49.402 INFO:teuthology.orchestra.run.smithi087.stdout: "id": 14530, 2024-09-17T07:17:49.402 INFO:teuthology.orchestra.run.smithi087.stdout: "inst": { 2024-09-17T07:17:49.402 INFO:teuthology.orchestra.run.smithi087.stdout: "name": { 2024-09-17T07:17:49.402 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "client", 2024-09-17T07:17:49.402 INFO:teuthology.orchestra.run.smithi087.stdout: "num": 14530 2024-09-17T07:17:49.402 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:17:49.402 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": { 2024-09-17T07:17:49.403 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T07:17:49.403 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "192.168.0.1:0", 2024-09-17T07:17:49.403 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 1271707203 2024-09-17T07:17:49.403 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T07:17:49.403 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:17:49.403 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": { 2024-09-17T07:17:49.403 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-17T07:17:49.403 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "192.168.0.1:0", 2024-09-17T07:17:49.403 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 1271707203 2024-09-17T07:17:49.403 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:17:49.403 INFO:teuthology.orchestra.run.smithi087.stdout: "inst_str": "client.14530 192.168.0.1:0/1271707203", 2024-09-17T07:17:49.403 INFO:teuthology.orchestra.run.smithi087.stdout: "addr_str": "192.168.0.1:0/1271707203", 2024-09-17T07:17:49.403 INFO:teuthology.orchestra.run.smithi087.stdout: "inode_count": 1, 2024-09-17T07:17:49.403 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_epoch": 19, 2024-09-17T07:17:49.404 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_epoch": 44, 2024-09-17T07:17:49.404 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_epoch_barrier": 0, 2024-09-17T07:17:49.404 INFO:teuthology.orchestra.run.smithi087.stdout: "blocklisted": false, 2024-09-17T07:17:49.404 INFO:teuthology.orchestra.run.smithi087.stdout: "fs_name": "cephfs" 2024-09-17T07:17:49.404 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T07:17:49.409 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-17T07:17:49.410 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-17T07:17:49.653 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/mon.smithi087/config 2024-09-17T07:17:49.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:49 smithi087 ceph-mon[27636]: pgmap v188: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.2 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-17T07:17:50.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:49 smithi139 ceph-mon[34403]: pgmap v188: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.2 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-17T07:17:51.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:51.188+0000 7faea9d0c640 1 -- 172.21.15.87:0/951617093 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faea40fcf80 msgr2=0x7faea40fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:51.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:51.188+0000 7faea9d0c640 1 --2- 172.21.15.87:0/951617093 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faea40fcf80 0x7faea40fd3d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fae980048d0 tx=0x7fae98009da0 comp rx=0 tx=0).stop 2024-09-17T07:17:51.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:51.188+0000 7faea9d0c640 1 -- 172.21.15.87:0/951617093 shutdown_connections 2024-09-17T07:17:51.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:51.188+0000 7faea9d0c640 1 --2- 172.21.15.87:0/951617093 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faea40fcf80 0x7faea40fd3d0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:51.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:51.188+0000 7faea9d0c640 1 --2- 172.21.15.87:0/951617093 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faea40fb810 0x7faea40fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:51.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:51.188+0000 7faea9d0c640 1 -- 172.21.15.87:0/951617093 >> 172.21.15.87:0/951617093 conn(0x7faea40723b0 msgr2=0x7faea40727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:17:51.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:51.188+0000 7faea9d0c640 1 -- 172.21.15.87:0/951617093 shutdown_connections 2024-09-17T07:17:51.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:51.188+0000 7faea9d0c640 1 -- 172.21.15.87:0/951617093 wait complete. 2024-09-17T07:17:51.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:51.189+0000 7faea9d0c640 1 Processor -- start 2024-09-17T07:17:51.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:51.189+0000 7faea9d0c640 1 -- start start 2024-09-17T07:17:51.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:51.189+0000 7faea9d0c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faea40fb810 0x7faea4112050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:17:51.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:51.189+0000 7faea9d0c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faea40fcf80 0x7faea4112590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:17:51.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:51.189+0000 7faea9d0c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faea4112b90 con 0x7faea40fcf80 2024-09-17T07:17:51.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:51.189+0000 7faea9d0c640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faea410c020 con 0x7faea40fb810 2024-09-17T07:17:51.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:51.189+0000 7faea2ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faea40fcf80 0x7faea4112590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:17:51.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:51.189+0000 7faea2ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faea40fcf80 0x7faea4112590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:43344/0 (socket says 172.21.15.87:43344) 2024-09-17T07:17:51.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:51.189+0000 7faea2ffd640 1 -- 172.21.15.87:0/2973275493 learned_addr learned my addr 172.21.15.87:0/2973275493 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:17:51.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:51.190+0000 7faea2ffd640 1 -- 172.21.15.87:0/2973275493 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faea40fb810 msgr2=0x7faea4112050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:51.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:51.190+0000 7faea37fe640 1 --2- 172.21.15.87:0/2973275493 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faea40fb810 0x7faea4112050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:17:51.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:51.190+0000 7faea2ffd640 1 --2- 172.21.15.87:0/2973275493 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faea40fb810 0x7faea4112050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:51.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:51.190+0000 7faea2ffd640 1 -- 172.21.15.87:0/2973275493 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae98005040 con 0x7faea40fcf80 2024-09-17T07:17:51.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:51.190+0000 7faea2ffd640 1 --2- 172.21.15.87:0/2973275493 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faea40fcf80 0x7faea4112590 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fae98003080 tx=0x7fae98009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:17:51.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:51.190+0000 7fae8bfff640 1 -- 172.21.15.87:0/2973275493 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae98038070 con 0x7faea40fcf80 2024-09-17T07:17:51.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:51.190+0000 7fae8bfff640 1 -- 172.21.15.87:0/2973275493 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fae980097c0 con 0x7faea40fcf80 2024-09-17T07:17:51.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:51.190+0000 7faea9d0c640 1 -- 172.21.15.87:0/2973275493 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faea410c2a0 con 0x7faea40fcf80 2024-09-17T07:17:51.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:51.190+0000 7fae8bfff640 1 -- 172.21.15.87:0/2973275493 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae9803d420 con 0x7faea40fcf80 2024-09-17T07:17:51.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:51.190+0000 7faea9d0c640 1 -- 172.21.15.87:0/2973275493 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faea410c760 con 0x7faea40fcf80 2024-09-17T07:17:51.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:51.191+0000 7faea9d0c640 1 -- 172.21.15.87:0/2973275493 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faea40fcbc0 con 0x7faea40fcf80 2024-09-17T07:17:51.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:51.191+0000 7fae8bfff640 1 -- 172.21.15.87:0/2973275493 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fae98030020 con 0x7faea40fcf80 2024-09-17T07:17:51.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:51.192+0000 7fae8bfff640 1 --2- 172.21.15.87:0/2973275493 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fae8c06ed60 0x7fae8c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:17:51.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:51.192+0000 7faea37fe640 1 --2- 172.21.15.87:0/2973275493 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fae8c06ed60 0x7fae8c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:17:51.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:51.192+0000 7fae8bfff640 1 -- 172.21.15.87:0/2973275493 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fae980ae730 con 0x7faea40fcf80 2024-09-17T07:17:51.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:51.192+0000 7faea37fe640 1 --2- 172.21.15.87:0/2973275493 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fae8c06ed60 0x7fae8c071210 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fae94004bc0 tx=0x7fae94009040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:17:51.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:51.196+0000 7fae8bfff640 1 -- 172.21.15.87:0/2973275493 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fae9807b880 con 0x7faea40fcf80 2024-09-17T07:17:51.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:51.387+0000 7faea9d0c640 1 -- 172.21.15.87:0/2973275493 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7faea410d6c0 con 0x7faea40fcf80 2024-09-17T07:17:51.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:51.388+0000 7fae8bfff640 1 -- 172.21.15.87:0/2973275493 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v19) v1 ==== 53+0+83 (secure 0 0 0) 0x7fae9807b220 con 0x7faea40fcf80 2024-09-17T07:17:51.389 INFO:teuthology.orchestra.run.smithi087.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-09-17T07:17:51.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:51.390+0000 7faea9d0c640 1 -- 172.21.15.87:0/2973275493 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fae8c06ed60 msgr2=0x7fae8c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:51.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:51.390+0000 7faea9d0c640 1 --2- 172.21.15.87:0/2973275493 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fae8c06ed60 0x7fae8c071210 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fae94004bc0 tx=0x7fae94009040 comp rx=0 tx=0).stop 2024-09-17T07:17:51.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:51.390+0000 7faea9d0c640 1 -- 172.21.15.87:0/2973275493 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faea40fcf80 msgr2=0x7faea4112590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:51.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:51.390+0000 7faea9d0c640 1 --2- 172.21.15.87:0/2973275493 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faea40fcf80 0x7faea4112590 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fae98003080 tx=0x7fae98009da0 comp rx=0 tx=0).stop 2024-09-17T07:17:51.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:51.390+0000 7faea9d0c640 1 -- 172.21.15.87:0/2973275493 shutdown_connections 2024-09-17T07:17:51.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:51.390+0000 7faea9d0c640 1 --2- 172.21.15.87:0/2973275493 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faea40fcf80 0x7faea4112590 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:51.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:51.390+0000 7faea9d0c640 1 --2- 172.21.15.87:0/2973275493 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fae8c06ed60 0x7fae8c071210 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:51.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:51.390+0000 7faea9d0c640 1 --2- 172.21.15.87:0/2973275493 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faea40fb810 0x7faea4112050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:51.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:51.390+0000 7faea9d0c640 1 -- 172.21.15.87:0/2973275493 >> 172.21.15.87:0/2973275493 conn(0x7faea40723b0 msgr2=0x7faea40fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:17:51.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:51.390+0000 7faea9d0c640 1 -- 172.21.15.87:0/2973275493 shutdown_connections 2024-09-17T07:17:51.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:51.390+0000 7faea9d0c640 1 -- 172.21.15.87:0/2973275493 wait complete. 2024-09-17T07:17:51.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:51 smithi087 ceph-mon[27636]: pgmap v189: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:17:51.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:51 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/2973275493' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-17T07:17:51.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:51 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:17:51.986 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T07:17:51.986 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T07:17:51.986 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi139.front.sepia.ceph.com 2024-09-17T07:17:51.986 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-17T07:17:51.986 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-17T07:17:51.986 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T07:17:51.986 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T07:17:51.986 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T07:17:51.986 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T07:17:51.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T07:17:51.987 DEBUG:teuthology.orchestra.run.smithi139:> ip addr 2024-09-17T07:17:52.007 INFO:teuthology.orchestra.run.smithi139.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T07:17:52.007 INFO:teuthology.orchestra.run.smithi139.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T07:17:52.007 INFO:teuthology.orchestra.run.smithi139.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T07:17:52.008 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft forever preferred_lft forever 2024-09-17T07:17:52.008 INFO:teuthology.orchestra.run.smithi139.stdout: inet6 ::1/128 scope host 2024-09-17T07:17:52.008 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft forever preferred_lft forever 2024-09-17T07:17:52.008 INFO:teuthology.orchestra.run.smithi139.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T07:17:52.008 INFO:teuthology.orchestra.run.smithi139.stdout: link/ether 0c:c4:7a:d9:36:e8 brd ff:ff:ff:ff:ff:ff 2024-09-17T07:17:52.008 INFO:teuthology.orchestra.run.smithi139.stdout: altname enp7s0f0 2024-09-17T07:17:52.008 INFO:teuthology.orchestra.run.smithi139.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T07:17:52.008 INFO:teuthology.orchestra.run.smithi139.stdout: link/ether 0c:c4:7a:d9:36:e9 brd ff:ff:ff:ff:ff:ff 2024-09-17T07:17:52.009 INFO:teuthology.orchestra.run.smithi139.stdout: altname enp7s0f1 2024-09-17T07:17:52.009 INFO:teuthology.orchestra.run.smithi139.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T07:17:52.009 INFO:teuthology.orchestra.run.smithi139.stdout: link/ether 0c:c4:7a:88:7f:58 brd ff:ff:ff:ff:ff:ff 2024-09-17T07:17:52.009 INFO:teuthology.orchestra.run.smithi139.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T07:17:52.009 INFO:teuthology.orchestra.run.smithi139.stdout: link/ether 0c:c4:7a:88:7f:59 brd ff:ff:ff:ff:ff:ff 2024-09-17T07:17:52.009 INFO:teuthology.orchestra.run.smithi139.stdout: inet 172.21.15.139/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T07:17:52.009 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft 42370sec preferred_lft 42370sec 2024-09-17T07:17:52.009 INFO:teuthology.orchestra.run.smithi139.stdout: inet6 fe80::ec4:7aff:fe88:7f59/64 scope link noprefixroute 2024-09-17T07:17:52.009 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft forever preferred_lft forever 2024-09-17T07:17:52.009 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-17T07:17:52.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T07:17:52.010 DEBUG:teuthology.orchestra.run.smithi139:> (cd / && exec bash -c ' 2024-09-17T07:17:52.010 DEBUG:teuthology.orchestra.run.smithi139:> set -e 2024-09-17T07:17:52.010 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip link add name ceph-brx type bridge 2024-09-17T07:17:52.010 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip addr flush dev ceph-brx 2024-09-17T07:17:52.010 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip link set ceph-brx up 2024-09-17T07:17:52.010 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-17T07:17:52.010 DEBUG:teuthology.orchestra.run.smithi139:> ') 2024-09-17T07:17:52.074 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:51 smithi139 ceph-mon[34403]: pgmap v189: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:17:52.074 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:51 smithi139 ceph-mon[34403]: from='client.? 172.21.15.87:0/2973275493' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-17T07:17:52.074 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:51 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:17:52.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T07:17:52.309 DEBUG:teuthology.orchestra.run.smithi139:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T07:17:52.375 INFO:teuthology.orchestra.run.smithi139.stdout:1 2024-09-17T07:17:52.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T07:17:52.377 DEBUG:teuthology.orchestra.run.smithi139:> route 2024-09-17T07:17:52.444 INFO:teuthology.orchestra.run.smithi139.stdout:Kernel IP routing table 2024-09-17T07:17:52.444 INFO:teuthology.orchestra.run.smithi139.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T07:17:52.444 INFO:teuthology.orchestra.run.smithi139.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T07:17:52.444 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T07:17:52.445 INFO:teuthology.orchestra.run.smithi139.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T07:17:52.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T07:17:52.445 DEBUG:teuthology.orchestra.run.smithi139:> (cd / && exec bash -c ' 2024-09-17T07:17:52.445 DEBUG:teuthology.orchestra.run.smithi139:> set -e 2024-09-17T07:17:52.445 DEBUG:teuthology.orchestra.run.smithi139:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T07:17:52.445 DEBUG:teuthology.orchestra.run.smithi139:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T07:17:52.445 DEBUG:teuthology.orchestra.run.smithi139:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T07:17:52.445 DEBUG:teuthology.orchestra.run.smithi139:> ') 2024-09-17T07:17:52.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T07:17:52.695 DEBUG:teuthology.orchestra.run.smithi139:> ip netns list 2024-09-17T07:17:52.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T07:17:52.710 DEBUG:teuthology.orchestra.run.smithi139:> ip netns list-id 2024-09-17T07:17:52.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T07:17:52.767 DEBUG:teuthology.orchestra.run.smithi139:> (cd / && exec bash -c ' 2024-09-17T07:17:52.767 DEBUG:teuthology.orchestra.run.smithi139:> set -e 2024-09-17T07:17:52.767 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T07:17:52.768 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-17T07:17:52.768 DEBUG:teuthology.orchestra.run.smithi139:> ') 2024-09-17T07:17:52.845 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-17T07:17:52.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T07:17:52.845 DEBUG:teuthology.orchestra.run.smithi139:> (cd / && exec bash -c ' 2024-09-17T07:17:52.845 DEBUG:teuthology.orchestra.run.smithi139:> set -e 2024-09-17T07:17:52.845 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-17T07:17:52.845 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-17T07:17:52.845 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-17T07:17:52.845 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-17T07:17:52.845 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-17T07:17:52.845 DEBUG:teuthology.orchestra.run.smithi139:> ') 2024-09-17T07:17:52.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T07:17:52.968 DEBUG:teuthology.orchestra.run.smithi139:> (cd / && exec bash -c ' 2024-09-17T07:17:52.968 DEBUG:teuthology.orchestra.run.smithi139:> set -e 2024-09-17T07:17:52.968 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip link set brx.0 up 2024-09-17T07:17:52.968 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip link set dev brx.0 master ceph-brx 2024-09-17T07:17:52.968 DEBUG:teuthology.orchestra.run.smithi139:> ') 2024-09-17T07:17:53.004 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-17T07:17:53.005 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T07:17:53.005 DEBUG:teuthology.orchestra.run.smithi139:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-17T07:17:53.060 INFO:teuthology.orchestra.run.smithi139.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-17T07:17:53.061 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T07:17:53.061 DEBUG:teuthology.orchestra.run.smithi139:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-17T07:17:53.116 DEBUG:teuthology.orchestra.run.smithi139:> sudo modprobe fuse 2024-09-17T07:17:53.181 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-17T07:17:53.182 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-17T07:17:53.246 INFO:teuthology.orchestra.run.smithi139.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-17T07:17:53.247 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-17T07:17:53.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T07:17:53.248 DEBUG:teuthology.orchestra.run.smithi139:> ls /sys/fs/fuse/connections 2024-09-17T07:17:53.303 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-17T07:17:53.304 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-17T07:17:53.346 DEBUG:teuthology.orchestra.run.smithi139:> sudo modprobe fuse 2024-09-17T07:17:53.370 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-17T07:17:53.370 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-17T07:17:53.434 INFO:teuthology.orchestra.run.smithi139.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-17T07:17:53.435 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-17T07:17:53.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T07:17:53.436 DEBUG:teuthology.orchestra.run.smithi139:> ls /sys/fs/fuse/connections 2024-09-17T07:17:53.494 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi139.stderr:2024-09-17T07:17:53.494+0000 7f3b2eec9300 -1 init, newargv = 0x559f668e9560 newargc=15 2024-09-17T07:17:53.494 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi139.stderr:ceph-fuse[59615]: starting ceph client 2024-09-17T07:17:53.501 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi139.stderr:ceph-fuse[59615]: starting fuse 2024-09-17T07:17:53.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:53 smithi139 ceph-mon[34403]: pgmap v190: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-17T07:17:53.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:53 smithi087 ceph-mon[27636]: pgmap v190: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-17T07:17:54.593 DEBUG:teuthology.orchestra.run.smithi139:> sudo modprobe fuse 2024-09-17T07:17:54.625 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-17T07:17:54.626 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-17T07:17:54.697 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-17T07:17:54.698 INFO:teuthology.orchestra.run.smithi139.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-17T07:17:54.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T07:17:54.698 DEBUG:teuthology.orchestra.run.smithi139:> ls /sys/fs/fuse/connections 2024-09-17T07:17:54.756 INFO:teuthology.orchestra.run.smithi139.stdout:117 2024-09-17T07:17:54.757 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [117] 2024-09-17T07:17:54.757 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-17T07:17:54.757 DEBUG:teuthology.orchestra.run.smithi139:> import glob 2024-09-17T07:17:54.757 DEBUG:teuthology.orchestra.run.smithi139:> import re 2024-09-17T07:17:54.757 DEBUG:teuthology.orchestra.run.smithi139:> import os 2024-09-17T07:17:54.757 DEBUG:teuthology.orchestra.run.smithi139:> import subprocess 2024-09-17T07:17:54.757 DEBUG:teuthology.orchestra.run.smithi139:> 2024-09-17T07:17:54.758 DEBUG:teuthology.orchestra.run.smithi139:> def _find_admin_socket(client_name): 2024-09-17T07:17:54.758 DEBUG:teuthology.orchestra.run.smithi139:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-17T07:17:54.758 DEBUG:teuthology.orchestra.run.smithi139:> files = glob.glob(asok_path) 2024-09-17T07:17:54.758 DEBUG:teuthology.orchestra.run.smithi139:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-17T07:17:54.758 DEBUG:teuthology.orchestra.run.smithi139:> 2024-09-17T07:17:54.758 DEBUG:teuthology.orchestra.run.smithi139:> # Given a non-glob path, it better be there 2024-09-17T07:17:54.758 DEBUG:teuthology.orchestra.run.smithi139:> if "*" not in asok_path: 2024-09-17T07:17:54.758 DEBUG:teuthology.orchestra.run.smithi139:> assert(len(files) == 1) 2024-09-17T07:17:54.758 DEBUG:teuthology.orchestra.run.smithi139:> return files[0] 2024-09-17T07:17:54.758 DEBUG:teuthology.orchestra.run.smithi139:> 2024-09-17T07:17:54.758 DEBUG:teuthology.orchestra.run.smithi139:> for f in files: 2024-09-17T07:17:54.758 DEBUG:teuthology.orchestra.run.smithi139:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-17T07:17:54.758 DEBUG:teuthology.orchestra.run.smithi139:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-17T07:17:54.759 DEBUG:teuthology.orchestra.run.smithi139:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-17T07:17:54.759 DEBUG:teuthology.orchestra.run.smithi139:> contents = proc_f.read() 2024-09-17T07:17:54.759 DEBUG:teuthology.orchestra.run.smithi139:> if mountpoint in contents: 2024-09-17T07:17:54.759 DEBUG:teuthology.orchestra.run.smithi139:> return f 2024-09-17T07:17:54.759 DEBUG:teuthology.orchestra.run.smithi139:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-17T07:17:54.759 DEBUG:teuthology.orchestra.run.smithi139:> 2024-09-17T07:17:54.759 DEBUG:teuthology.orchestra.run.smithi139:> print(_find_admin_socket("client.1")) 2024-09-17T07:17:54.759 DEBUG:teuthology.orchestra.run.smithi139:> ' 2024-09-17T07:17:54.880 INFO:teuthology.orchestra.run.smithi139.stdout:/var/run/ceph/ceph-client.1.59615.asok 2024-09-17T07:17:55.063 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.59615.asok 2024-09-17T07:17:55.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T07:17:55.063 DEBUG:teuthology.orchestra.run.smithi139:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.59615.asok status 2024-09-17T07:17:55.195 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-17T07:17:55.195 INFO:teuthology.orchestra.run.smithi139.stdout: "metadata": { 2024-09-17T07:17:55.195 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_sha1": "4a704134aa895fa24b75bb03cb263f1e3316004e", 2024-09-17T07:17:55.195 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_version": "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)", 2024-09-17T07:17:55.195 INFO:teuthology.orchestra.run.smithi139.stdout: "entity_id": "1", 2024-09-17T07:17:55.195 INFO:teuthology.orchestra.run.smithi139.stdout: "hostname": "smithi139", 2024-09-17T07:17:55.195 INFO:teuthology.orchestra.run.smithi139.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-17T07:17:55.195 INFO:teuthology.orchestra.run.smithi139.stdout: "pid": "59615", 2024-09-17T07:17:55.195 INFO:teuthology.orchestra.run.smithi139.stdout: "root": "/" 2024-09-17T07:17:55.195 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-17T07:17:55.195 INFO:teuthology.orchestra.run.smithi139.stdout: "dentry_count": 0, 2024-09-17T07:17:55.196 INFO:teuthology.orchestra.run.smithi139.stdout: "dentry_pinned_count": 0, 2024-09-17T07:17:55.196 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 24283, 2024-09-17T07:17:55.196 INFO:teuthology.orchestra.run.smithi139.stdout: "inst": { 2024-09-17T07:17:55.196 INFO:teuthology.orchestra.run.smithi139.stdout: "name": { 2024-09-17T07:17:55.196 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "client", 2024-09-17T07:17:55.196 INFO:teuthology.orchestra.run.smithi139.stdout: "num": 24283 2024-09-17T07:17:55.196 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-17T07:17:55.196 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": { 2024-09-17T07:17:55.196 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "v1", 2024-09-17T07:17:55.196 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": "192.168.0.1:0", 2024-09-17T07:17:55.196 INFO:teuthology.orchestra.run.smithi139.stdout: "nonce": 2059462198 2024-09-17T07:17:55.196 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-17T07:17:55.197 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-17T07:17:55.197 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": { 2024-09-17T07:17:55.197 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "v1", 2024-09-17T07:17:55.197 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": "192.168.0.1:0", 2024-09-17T07:17:55.197 INFO:teuthology.orchestra.run.smithi139.stdout: "nonce": 2059462198 2024-09-17T07:17:55.197 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-17T07:17:55.197 INFO:teuthology.orchestra.run.smithi139.stdout: "inst_str": "client.24283 192.168.0.1:0/2059462198", 2024-09-17T07:17:55.197 INFO:teuthology.orchestra.run.smithi139.stdout: "addr_str": "192.168.0.1:0/2059462198", 2024-09-17T07:17:55.197 INFO:teuthology.orchestra.run.smithi139.stdout: "inode_count": 1, 2024-09-17T07:17:55.197 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_epoch": 19, 2024-09-17T07:17:55.198 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_epoch": 44, 2024-09-17T07:17:55.198 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_epoch_barrier": 0, 2024-09-17T07:17:55.198 INFO:teuthology.orchestra.run.smithi139.stdout: "blocklisted": false, 2024-09-17T07:17:55.198 INFO:teuthology.orchestra.run.smithi139.stdout: "fs_name": "cephfs" 2024-09-17T07:17:55.198 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-17T07:17:55.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T07:17:55.203 DEBUG:teuthology.orchestra.run.smithi087:> stat --file-system '--printf=%T 2024-09-17T07:17:55.203 DEBUG:teuthology.orchestra.run.smithi087:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-17T07:17:55.224 INFO:teuthology.orchestra.run.smithi087.stdout:fuseblk 2024-09-17T07:17:55.225 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-17T07:17:55.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T07:17:55.225 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T07:17:55.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T07:17:55.299 DEBUG:teuthology.orchestra.run.smithi139:> stat --file-system '--printf=%T 2024-09-17T07:17:55.299 DEBUG:teuthology.orchestra.run.smithi139:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-17T07:17:55.315 INFO:teuthology.orchestra.run.smithi139.stdout:fuseblk 2024-09-17T07:17:55.316 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-17T07:17:55.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T07:17:55.316 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-17T07:17:55.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:55 smithi087 ceph-mon[27636]: pgmap v191: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 341 B/s wr, 4 op/s 2024-09-17T07:17:56.030 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:55 smithi139 ceph-mon[34403]: pgmap v191: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 341 B/s wr, 4 op/s 2024-09-17T07:17:56.031 INFO:teuthology.run_tasks:Running task print... 2024-09-17T07:17:56.042 INFO:teuthology.task.print:**** done client 2024-09-17T07:17:56.043 INFO:teuthology.run_tasks:Running task parallel... 2024-09-17T07:17:56.052 INFO:teuthology.task.parallel:starting parallel... 2024-09-17T07:17:56.053 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-17T07:17:56.053 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-17T07:17:56.054 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi087.front.sepia.ceph.com 2024-09-17T07:17:56.054 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -e sha1=19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs false || true' 2024-09-17T07:17:56.054 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-17T07:17:56.055 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-09-17T07:17:56.059 INFO:tasks.workunit:Pulling workunits from ref 1cbdc9211df088cccbd94423c7cf3a2b85fe432b 2024-09-17T07:17:56.060 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-17T07:17:56.060 INFO:tasks.workunit:timeout=3h 2024-09-17T07:17:56.060 INFO:tasks.workunit:cleanup=True 2024-09-17T07:17:56.060 DEBUG:teuthology.orchestra.run.smithi087:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-17T07:17:56.081 INFO:teuthology.orchestra.run.smithi087.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-17T07:17:56.082 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-17T07:17:56.082 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 7ah/122d Inode: 1 Links: 2 2024-09-17T07:17:56.082 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T07:17:56.082 INFO:teuthology.orchestra.run.smithi087.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-17T07:17:56.082 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-17T07:17:56.082 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2024-09-17 07:17:20.374273808 +0000 2024-09-17T07:17:56.082 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2024-09-17 07:17:55.295545584 +0000 2024-09-17T07:17:56.082 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: - 2024-09-17T07:17:56.082 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-17T07:17:56.082 DEBUG:teuthology.orchestra.run.smithi087:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-17T07:17:56.154 DEBUG:teuthology.orchestra.run.smithi139:> stat -- /home/ubuntu/cephtest/mnt.1 2024-09-17T07:17:56.173 INFO:teuthology.orchestra.run.smithi139.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-09-17T07:17:56.173 INFO:teuthology.orchestra.run.smithi139.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-17T07:17:56.173 INFO:teuthology.orchestra.run.smithi139.stdout:Device: 75h/117d Inode: 1 Links: 3 2024-09-17T07:17:56.174 INFO:teuthology.orchestra.run.smithi139.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T07:17:56.174 INFO:teuthology.orchestra.run.smithi139.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-17T07:17:56.174 INFO:teuthology.orchestra.run.smithi139.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-17T07:17:56.174 INFO:teuthology.orchestra.run.smithi139.stdout:Modify: 2024-09-17 07:17:56.148790612 +0000 2024-09-17T07:17:56.174 INFO:teuthology.orchestra.run.smithi139.stdout:Change: 2024-09-17 07:17:56.148790612 +0000 2024-09-17T07:17:56.174 INFO:teuthology.orchestra.run.smithi139.stdout: Birth: - 2024-09-17T07:17:56.174 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-09-17T07:17:56.175 DEBUG:teuthology.orchestra.run.smithi139:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-09-17T07:17:56.246 DEBUG:teuthology.orchestra.run.smithi087:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1cbdc9211df088cccbd94423c7cf3a2b85fe432b 2024-09-17T07:17:56.247 DEBUG:teuthology.orchestra.run.smithi139:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout 1cbdc9211df088cccbd94423c7cf3a2b85fe432b 2024-09-17T07:17:56.263 INFO:tasks.workunit.client.0.smithi087.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-17T07:17:56.304 INFO:tasks.workunit.client.1.smithi139.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-09-17T07:17:56.320 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/mon.smithi087/config 2024-09-17T07:17:57.922 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:57 smithi087 ceph-mon[27636]: pgmap v192: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-17T07:17:57.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:57.913+0000 7f53aa5d3640 1 -- 172.21.15.87:0/3002955104 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53a40fc520 msgr2=0x7f53a40fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:57.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:57.913+0000 7f53aa5d3640 1 --2- 172.21.15.87:0/3002955104 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53a40fc520 0x7f53a40fc930 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f53940048d0 tx=0x7f5394009da0 comp rx=0 tx=0).stop 2024-09-17T07:17:57.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:57.913+0000 7f53aa5d3640 1 -- 172.21.15.87:0/3002955104 shutdown_connections 2024-09-17T07:17:57.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:57.913+0000 7f53aa5d3640 1 --2- 172.21.15.87:0/3002955104 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f53a40fd7f0 0x7f53a40fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:57.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:57.913+0000 7f53aa5d3640 1 --2- 172.21.15.87:0/3002955104 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53a40fc520 0x7f53a40fc930 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:57.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:57.913+0000 7f53aa5d3640 1 -- 172.21.15.87:0/3002955104 >> 172.21.15.87:0/3002955104 conn(0x7f53a40f7ce0 msgr2=0x7f53a40fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:17:57.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:57.913+0000 7f53aa5d3640 1 -- 172.21.15.87:0/3002955104 shutdown_connections 2024-09-17T07:17:57.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:57.913+0000 7f53aa5d3640 1 -- 172.21.15.87:0/3002955104 wait complete. 2024-09-17T07:17:57.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:57.913+0000 7f53aa5d3640 1 Processor -- start 2024-09-17T07:17:57.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:57.914+0000 7f53aa5d3640 1 -- start start 2024-09-17T07:17:57.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:57.914+0000 7f53aa5d3640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f53a40fc520 0x7f53a410cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:17:57.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:57.914+0000 7f53aa5d3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53a40fd7f0 0x7f53a410d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:17:57.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:57.914+0000 7f53aa5d3640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a410e3a0 con 0x7f53a40fd7f0 2024-09-17T07:17:57.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:57.914+0000 7f53aa5d3640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a410e510 con 0x7f53a40fc520 2024-09-17T07:17:57.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:57.914+0000 7f53a37fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53a40fd7f0 0x7f53a410d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:17:57.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:57.914+0000 7f53a37fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53a40fd7f0 0x7f53a410d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42800/0 (socket says 172.21.15.87:42800) 2024-09-17T07:17:57.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:57.914+0000 7f53a37fe640 1 -- 172.21.15.87:0/2365415996 learned_addr learned my addr 172.21.15.87:0/2365415996 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:17:57.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:57.914+0000 7f53a3fff640 1 --2- 172.21.15.87:0/2365415996 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f53a40fc520 0x7f53a410cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:17:57.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:57.914+0000 7f53a37fe640 1 -- 172.21.15.87:0/2365415996 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f53a40fc520 msgr2=0x7f53a410cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:17:57.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:57.914+0000 7f53a37fe640 1 --2- 172.21.15.87:0/2365415996 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f53a40fc520 0x7f53a410cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:17:57.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:57.914+0000 7f53a37fe640 1 -- 172.21.15.87:0/2365415996 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5394005040 con 0x7f53a40fd7f0 2024-09-17T07:17:57.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:57.914+0000 7f53a3fff640 1 --2- 172.21.15.87:0/2365415996 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f53a40fc520 0x7f53a410cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T07:17:57.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:57.914+0000 7f53a37fe640 1 --2- 172.21.15.87:0/2365415996 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53a40fd7f0 0x7f53a410d530 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f539800b790 tx=0x7f53980091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:17:57.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:57.914+0000 7f53a0ff9640 1 -- 172.21.15.87:0/2365415996 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f539800c700 con 0x7f53a40fd7f0 2024-09-17T07:17:57.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:57.914+0000 7f53a0ff9640 1 -- 172.21.15.87:0/2365415996 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f539800cce0 con 0x7f53a40fd7f0 2024-09-17T07:17:57.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:57.914+0000 7f53aa5d3640 1 -- 172.21.15.87:0/2365415996 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53a410e7f0 con 0x7f53a40fd7f0 2024-09-17T07:17:57.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:57.914+0000 7f53a0ff9640 1 -- 172.21.15.87:0/2365415996 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5398015e10 con 0x7f53a40fd7f0 2024-09-17T07:17:57.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:57.915+0000 7f53aa5d3640 1 -- 172.21.15.87:0/2365415996 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53a410ed10 con 0x7f53a40fd7f0 2024-09-17T07:17:57.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:57.915+0000 7f53aa5d3640 1 -- 172.21.15.87:0/2365415996 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53a40fb980 con 0x7f53a40fd7f0 2024-09-17T07:17:57.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:57.916+0000 7f53a0ff9640 1 -- 172.21.15.87:0/2365415996 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f5398012070 con 0x7f53a40fd7f0 2024-09-17T07:17:57.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:57.916+0000 7f53a0ff9640 1 --2- 172.21.15.87:0/2365415996 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f538c06ed60 0x7f538c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:17:57.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:57.916+0000 7f53a0ff9640 1 -- 172.21.15.87:0/2365415996 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f539808dd90 con 0x7f53a40fd7f0 2024-09-17T07:17:57.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:57.916+0000 7f53a3fff640 1 --2- 172.21.15.87:0/2365415996 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f538c06ed60 0x7f538c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:17:57.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:57.917+0000 7f53a3fff640 1 --2- 172.21.15.87:0/2365415996 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f538c06ed60 0x7f538c071210 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f539400b020 tx=0x7f5394035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:17:57.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:57.921+0000 7f53a0ff9640 1 -- 172.21.15.87:0/2365415996 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f539805ae60 con 0x7f53a40fd7f0 2024-09-17T07:17:58.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:58.077+0000 7f53aa5d3640 1 -- 172.21.15.87:0/2365415996 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) v1 -- 0x7f53a404b720 con 0x7f53a40fd7f0 2024-09-17T07:17:58.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:17:58.077+0000 7f53a0ff9640 1 -- 172.21.15.87:0/2365415996 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=-22 unrecognized config option 'mgr/orchestrator/fail_fs' v21)=-22 unrecognized config option 'mgr/orchestrator/fail_fs' v21) v1 ==== 179+0+0 (secure 0 0 0) 0x7f53a404b720 con 0x7f53a40fd7f0 2024-09-17T07:17:58.078 INFO:teuthology.orchestra.run.smithi087.stderr:Error EINVAL: unrecognized config option 'mgr/orchestrator/fail_fs' 2024-09-17T07:17:58.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:57 smithi139 ceph-mon[34403]: pgmap v192: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-17T07:17:58.730 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-17T07:17:58.731 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi087.front.sepia.ceph.com 2024-09-17T07:17:58.731 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -e sha1=19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-09-17T07:17:59.021 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/mon.smithi087/config 2024-09-17T07:17:59.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:17:59 smithi087 ceph-mon[27636]: pgmap v193: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 853 B/s wr, 4 op/s 2024-09-17T07:18:00.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:17:59 smithi139 ceph-mon[34403]: pgmap v193: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 853 B/s wr, 4 op/s 2024-09-17T07:18:00.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:00.545+0000 7f6b2fffe640 1 -- 172.21.15.87:0/2187005342 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b28070040 msgr2=0x7f6b280704b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:18:00.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:00.545+0000 7f6b2fffe640 1 --2- 172.21.15.87:0/2187005342 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b28070040 0x7f6b280704b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6b240048d0 tx=0x7f6b24009da0 comp rx=0 tx=0).stop 2024-09-17T07:18:00.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:00.545+0000 7f6b2fffe640 1 -- 172.21.15.87:0/2187005342 shutdown_connections 2024-09-17T07:18:00.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:00.545+0000 7f6b2fffe640 1 --2- 172.21.15.87:0/2187005342 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b28070040 0x7f6b280704b0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:00.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:00.545+0000 7f6b2fffe640 1 --2- 172.21.15.87:0/2187005342 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6b280715d0 0x7f6b2806fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:00.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:00.545+0000 7f6b2fffe640 1 -- 172.21.15.87:0/2187005342 >> 172.21.15.87:0/2187005342 conn(0x7f6b280f7d00 msgr2=0x7f6b280fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:18:00.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:00.545+0000 7f6b2fffe640 1 -- 172.21.15.87:0/2187005342 shutdown_connections 2024-09-17T07:18:00.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:00.545+0000 7f6b2fffe640 1 -- 172.21.15.87:0/2187005342 wait complete. 2024-09-17T07:18:00.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:00.546+0000 7f6b2fffe640 1 Processor -- start 2024-09-17T07:18:00.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:00.546+0000 7f6b2fffe640 1 -- start start 2024-09-17T07:18:00.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:00.546+0000 7f6b2fffe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b28070040 0x7f6b281135a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:18:00.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:00.546+0000 7f6b2fffe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6b280715d0 0x7f6b28113ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:18:00.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:00.546+0000 7f6b2fffe640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b28114130 con 0x7f6b28070040 2024-09-17T07:18:00.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:00.546+0000 7f6b2fffe640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b28114950 con 0x7f6b280715d0 2024-09-17T07:18:00.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:00.546+0000 7f6b2dd9a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b28070040 0x7f6b281135a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:18:00.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:00.546+0000 7f6b2dd9a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b28070040 0x7f6b281135a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42808/0 (socket says 172.21.15.87:42808) 2024-09-17T07:18:00.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:00.546+0000 7f6b2dd9a640 1 -- 172.21.15.87:0/1085970296 learned_addr learned my addr 172.21.15.87:0/1085970296 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:18:00.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:00.546+0000 7f6b2d599640 1 --2- 172.21.15.87:0/1085970296 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6b280715d0 0x7f6b28113ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:18:00.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:00.547+0000 7f6b2dd9a640 1 -- 172.21.15.87:0/1085970296 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6b280715d0 msgr2=0x7f6b28113ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:18:00.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:00.547+0000 7f6b2dd9a640 1 --2- 172.21.15.87:0/1085970296 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6b280715d0 0x7f6b28113ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:00.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:00.547+0000 7f6b2dd9a640 1 -- 172.21.15.87:0/1085970296 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b24005040 con 0x7f6b28070040 2024-09-17T07:18:00.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:00.547+0000 7f6b2dd9a640 1 --2- 172.21.15.87:0/1085970296 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b28070040 0x7f6b281135a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c00c7e0 tx=0x7f6b1c0043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:18:00.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:00.547+0000 7f6b1a7fc640 1 -- 172.21.15.87:0/1085970296 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b1c00a820 con 0x7f6b28070040 2024-09-17T07:18:00.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:00.547+0000 7f6b1a7fc640 1 -- 172.21.15.87:0/1085970296 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f6b1c00ae00 con 0x7f6b28070040 2024-09-17T07:18:00.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:00.547+0000 7f6b1a7fc640 1 -- 172.21.15.87:0/1085970296 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b1c0113a0 con 0x7f6b28070040 2024-09-17T07:18:00.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:00.547+0000 7f6b2fffe640 1 -- 172.21.15.87:0/1085970296 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b28114be0 con 0x7f6b28070040 2024-09-17T07:18:00.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:00.547+0000 7f6b2fffe640 1 -- 172.21.15.87:0/1085970296 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b28115130 con 0x7f6b28070040 2024-09-17T07:18:00.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:00.548+0000 7f6b2fffe640 1 -- 172.21.15.87:0/1085970296 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b280fb9a0 con 0x7f6b28070040 2024-09-17T07:18:00.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:00.549+0000 7f6b1a7fc640 1 -- 172.21.15.87:0/1085970296 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f6b1c012400 con 0x7f6b28070040 2024-09-17T07:18:00.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:00.549+0000 7f6b1a7fc640 1 --2- 172.21.15.87:0/1085970296 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f6b1406ed60 0x7f6b14071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:18:00.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:00.549+0000 7f6b1a7fc640 1 -- 172.21.15.87:0/1085970296 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f6b1c08e330 con 0x7f6b28070040 2024-09-17T07:18:00.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:00.549+0000 7f6b2d599640 1 --2- 172.21.15.87:0/1085970296 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f6b1406ed60 0x7f6b14071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:18:00.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:00.550+0000 7f6b2d599640 1 --2- 172.21.15.87:0/1085970296 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f6b1406ed60 0x7f6b14071210 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6b24009ac0 tx=0x7f6b24035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:18:00.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:00.553+0000 7f6b1a7fc640 1 -- 172.21.15.87:0/1085970296 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f6b1c05b000 con 0x7f6b28070040 2024-09-17T07:18:00.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:00.716+0000 7f6b2fffe640 1 -- 172.21.15.87:0/1085970296 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f6b2804b720 con 0x7f6b28070040 2024-09-17T07:18:00.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:00.717+0000 7f6b1a7fc640 1 -- 172.21.15.87:0/1085970296 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v21)=0 v21) v1 ==== 155+0+0 (secure 0 0 0) 0x7f6b1c05ae20 con 0x7f6b28070040 2024-09-17T07:18:00.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:00.719+0000 7f6b2fffe640 1 -- 172.21.15.87:0/1085970296 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f6b1406ed60 msgr2=0x7f6b14071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:18:00.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:00.719+0000 7f6b2fffe640 1 --2- 172.21.15.87:0/1085970296 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f6b1406ed60 0x7f6b14071210 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6b24009ac0 tx=0x7f6b24035040 comp rx=0 tx=0).stop 2024-09-17T07:18:00.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:00.719+0000 7f6b2fffe640 1 -- 172.21.15.87:0/1085970296 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b28070040 msgr2=0x7f6b281135a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:18:00.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:00.719+0000 7f6b2fffe640 1 --2- 172.21.15.87:0/1085970296 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b28070040 0x7f6b281135a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c00c7e0 tx=0x7f6b1c0043c0 comp rx=0 tx=0).stop 2024-09-17T07:18:00.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:00.719+0000 7f6b2fffe640 1 -- 172.21.15.87:0/1085970296 shutdown_connections 2024-09-17T07:18:00.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:00.719+0000 7f6b2fffe640 1 --2- 172.21.15.87:0/1085970296 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f6b1406ed60 0x7f6b14071210 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:00.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:00.719+0000 7f6b2fffe640 1 --2- 172.21.15.87:0/1085970296 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6b280715d0 0x7f6b28113ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:00.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:00.719+0000 7f6b2fffe640 1 --2- 172.21.15.87:0/1085970296 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b28070040 0x7f6b281135a0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:00.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:00.719+0000 7f6b2fffe640 1 -- 172.21.15.87:0/1085970296 >> 172.21.15.87:0/1085970296 conn(0x7f6b280f7d00 msgr2=0x7f6b280f95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:18:00.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:00.719+0000 7f6b2fffe640 1 -- 172.21.15.87:0/1085970296 shutdown_connections 2024-09-17T07:18:00.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:00.719+0000 7f6b2fffe640 1 -- 172.21.15.87:0/1085970296 wait complete. 2024-09-17T07:18:01.332 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -e sha1=19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-09-17T07:18:01.587 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/mon.smithi087/config 2024-09-17T07:18:01.829 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:18:01 smithi087 ceph-mon[27636]: pgmap v194: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 853 B/s wr, 4 op/s 2024-09-17T07:18:02.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:18:01 smithi139 ceph-mon[34403]: pgmap v194: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 853 B/s wr, 4 op/s 2024-09-17T07:18:02.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:02.983+0000 7fcc6de13640 1 -- 172.21.15.87:0/4241573653 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc68065bc0 msgr2=0x7fcc680ff1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:18:02.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:02.983+0000 7fcc6de13640 1 --2- 172.21.15.87:0/4241573653 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc68065bc0 0x7fcc680ff1c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fcc580048d0 tx=0x7fcc58009da0 comp rx=0 tx=0).stop 2024-09-17T07:18:02.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:02.983+0000 7fcc6de13640 1 -- 172.21.15.87:0/4241573653 shutdown_connections 2024-09-17T07:18:02.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:02.983+0000 7fcc6de13640 1 --2- 172.21.15.87:0/4241573653 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcc680ff700 0x7fcc68101ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:02.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:02.983+0000 7fcc6de13640 1 --2- 172.21.15.87:0/4241573653 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc68065bc0 0x7fcc680ff1c0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:02.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:02.983+0000 7fcc6de13640 1 -- 172.21.15.87:0/4241573653 >> 172.21.15.87:0/4241573653 conn(0x7fcc680f6c10 msgr2=0x7fcc680f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:18:02.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:02.983+0000 7fcc6de13640 1 -- 172.21.15.87:0/4241573653 shutdown_connections 2024-09-17T07:18:02.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:02.983+0000 7fcc6de13640 1 -- 172.21.15.87:0/4241573653 wait complete. 2024-09-17T07:18:02.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:02.983+0000 7fcc6de13640 1 Processor -- start 2024-09-17T07:18:02.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:02.984+0000 7fcc6de13640 1 -- start start 2024-09-17T07:18:02.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:02.984+0000 7fcc6de13640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc68065bc0 0x7fcc680fcbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:18:02.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:02.984+0000 7fcc6de13640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcc680ff700 0x7fcc680fb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:18:02.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:02.984+0000 7fcc6de13640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc680fb6e0 con 0x7fcc68065bc0 2024-09-17T07:18:02.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:02.984+0000 7fcc6de13640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc680fb820 con 0x7fcc680ff700 2024-09-17T07:18:02.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:02.984+0000 7fcc677fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc68065bc0 0x7fcc680fcbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:18:02.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:02.984+0000 7fcc677fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc68065bc0 0x7fcc680fcbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42828/0 (socket says 172.21.15.87:42828) 2024-09-17T07:18:02.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:02.984+0000 7fcc677fe640 1 -- 172.21.15.87:0/3482714256 learned_addr learned my addr 172.21.15.87:0/3482714256 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:18:02.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:02.984+0000 7fcc5effd640 1 --2- 172.21.15.87:0/3482714256 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcc680ff700 0x7fcc680fb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:18:02.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:02.984+0000 7fcc677fe640 1 -- 172.21.15.87:0/3482714256 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcc680ff700 msgr2=0x7fcc680fb0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:18:02.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:02.984+0000 7fcc677fe640 1 --2- 172.21.15.87:0/3482714256 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcc680ff700 0x7fcc680fb0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:02.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:02.984+0000 7fcc677fe640 1 -- 172.21.15.87:0/3482714256 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc58005040 con 0x7fcc68065bc0 2024-09-17T07:18:02.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:02.984+0000 7fcc5effd640 1 --2- 172.21.15.87:0/3482714256 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcc680ff700 0x7fcc680fb0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T07:18:02.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:02.984+0000 7fcc677fe640 1 --2- 172.21.15.87:0/3482714256 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc68065bc0 0x7fcc680fcbd0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fcc58009ac0 tx=0x7fcc58009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:18:02.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:02.985+0000 7fcc64ff9640 1 -- 172.21.15.87:0/3482714256 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc58038070 con 0x7fcc68065bc0 2024-09-17T07:18:02.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:02.985+0000 7fcc64ff9640 1 -- 172.21.15.87:0/3482714256 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fcc5802ae70 con 0x7fcc68065bc0 2024-09-17T07:18:02.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:02.985+0000 7fcc64ff9640 1 -- 172.21.15.87:0/3482714256 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc58033420 con 0x7fcc68065bc0 2024-09-17T07:18:02.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:02.985+0000 7fcc6de13640 1 -- 172.21.15.87:0/3482714256 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc680fbaa0 con 0x7fcc68065bc0 2024-09-17T07:18:02.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:02.985+0000 7fcc6de13640 1 -- 172.21.15.87:0/3482714256 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc680fbf10 con 0x7fcc68065bc0 2024-09-17T07:18:02.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:02.986+0000 7fcc6de13640 1 -- 172.21.15.87:0/3482714256 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc680fa890 con 0x7fcc68065bc0 2024-09-17T07:18:02.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:02.987+0000 7fcc64ff9640 1 -- 172.21.15.87:0/3482714256 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fcc58030020 con 0x7fcc68065bc0 2024-09-17T07:18:02.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:02.987+0000 7fcc64ff9640 1 --2- 172.21.15.87:0/3482714256 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fcc5406ed60 0x7fcc54071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:18:02.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:02.987+0000 7fcc64ff9640 1 -- 172.21.15.87:0/3482714256 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fcc580ae1f0 con 0x7fcc68065bc0 2024-09-17T07:18:02.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:02.987+0000 7fcc5effd640 1 --2- 172.21.15.87:0/3482714256 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fcc5406ed60 0x7fcc54071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:18:02.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:02.988+0000 7fcc5effd640 1 --2- 172.21.15.87:0/3482714256 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fcc5406ed60 0x7fcc54071210 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fcc50006fd0 tx=0x7fcc50008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:18:02.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:02.991+0000 7fcc64ff9640 1 -- 172.21.15.87:0/3482714256 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fcc5807b2c0 con 0x7fcc68065bc0 2024-09-17T07:18:03.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:03.145+0000 7fcc6de13640 1 -- 172.21.15.87:0/3482714256 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7fcc6804b720 con 0x7fcc68065bc0 2024-09-17T07:18:03.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:03.145+0000 7fcc64ff9640 1 -- 172.21.15.87:0/3482714256 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v21)=0 v21) v1 ==== 163+0+0 (secure 0 0 0) 0x7fcc5807ac60 con 0x7fcc68065bc0 2024-09-17T07:18:03.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:03.147+0000 7fcc6de13640 1 -- 172.21.15.87:0/3482714256 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fcc5406ed60 msgr2=0x7fcc54071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:18:03.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:03.147+0000 7fcc6de13640 1 --2- 172.21.15.87:0/3482714256 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fcc5406ed60 0x7fcc54071210 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fcc50006fd0 tx=0x7fcc50008040 comp rx=0 tx=0).stop 2024-09-17T07:18:03.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:03.147+0000 7fcc6de13640 1 -- 172.21.15.87:0/3482714256 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc68065bc0 msgr2=0x7fcc680fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:18:03.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:03.147+0000 7fcc6de13640 1 --2- 172.21.15.87:0/3482714256 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc68065bc0 0x7fcc680fcbd0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fcc58009ac0 tx=0x7fcc58009da0 comp rx=0 tx=0).stop 2024-09-17T07:18:03.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:03.147+0000 7fcc6de13640 1 -- 172.21.15.87:0/3482714256 shutdown_connections 2024-09-17T07:18:03.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:03.147+0000 7fcc6de13640 1 --2- 172.21.15.87:0/3482714256 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fcc5406ed60 0x7fcc54071210 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:03.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:03.147+0000 7fcc6de13640 1 --2- 172.21.15.87:0/3482714256 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcc680ff700 0x7fcc680fb0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:03.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:03.147+0000 7fcc6de13640 1 --2- 172.21.15.87:0/3482714256 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc68065bc0 0x7fcc680fcbd0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:03.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:03.147+0000 7fcc6de13640 1 -- 172.21.15.87:0/3482714256 >> 172.21.15.87:0/3482714256 conn(0x7fcc680f6c10 msgr2=0x7fcc680f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:18:03.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:03.147+0000 7fcc6de13640 1 -- 172.21.15.87:0/3482714256 shutdown_connections 2024-09-17T07:18:03.148 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:03.147+0000 7fcc6de13640 1 -- 172.21.15.87:0/3482714256 wait complete. 2024-09-17T07:18:03.833 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -e sha1=19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 -- bash -c 'ceph config set global log_to_journald false --force' 2024-09-17T07:18:04.080 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/mon.smithi087/config 2024-09-17T07:18:04.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:18:03 smithi139 ceph-mon[34403]: pgmap v195: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.2 KiB/s rd, 1023 B/s wr, 5 op/s 2024-09-17T07:18:04.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:18:03 smithi087 ceph-mon[27636]: pgmap v195: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.2 KiB/s rd, 1023 B/s wr, 5 op/s 2024-09-17T07:18:05.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:05.549+0000 7f796433a640 1 -- 172.21.15.87:0/2599602671 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f795c0fc530 msgr2=0x7f795c0fc940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:18:05.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:05.549+0000 7f796433a640 1 --2- 172.21.15.87:0/2599602671 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f795c0fc530 0x7f795c0fc940 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f79580048d0 tx=0x7f7958009da0 comp rx=0 tx=0).stop 2024-09-17T07:18:05.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:05.549+0000 7f796433a640 1 -- 172.21.15.87:0/2599602671 shutdown_connections 2024-09-17T07:18:05.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:05.549+0000 7f796433a640 1 --2- 172.21.15.87:0/2599602671 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f795c0fd800 0x7f795c0fdc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:05.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:05.549+0000 7f796433a640 1 --2- 172.21.15.87:0/2599602671 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f795c0fc530 0x7f795c0fc940 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:05.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:05.549+0000 7f796433a640 1 -- 172.21.15.87:0/2599602671 >> 172.21.15.87:0/2599602671 conn(0x7f795c0f7d10 msgr2=0x7f795c0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:18:05.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:05.549+0000 7f796433a640 1 -- 172.21.15.87:0/2599602671 shutdown_connections 2024-09-17T07:18:05.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:05.549+0000 7f796433a640 1 -- 172.21.15.87:0/2599602671 wait complete. 2024-09-17T07:18:05.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:05.550+0000 7f796433a640 1 Processor -- start 2024-09-17T07:18:05.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:05.550+0000 7f796433a640 1 -- start start 2024-09-17T07:18:05.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:05.550+0000 7f796433a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f795c0fc530 0x7f795c10cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:18:05.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:05.550+0000 7f796433a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f795c0fd800 0x7f795c10d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:18:05.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:05.550+0000 7f796433a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f795c10db10 con 0x7f795c0fc530 2024-09-17T07:18:05.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:05.550+0000 7f796433a640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f795c10e330 con 0x7f795c0fd800 2024-09-17T07:18:05.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:05.550+0000 7f79620d6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f795c0fc530 0x7f795c10cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:18:05.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:05.550+0000 7f79620d6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f795c0fc530 0x7f795c10cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35430/0 (socket says 172.21.15.87:35430) 2024-09-17T07:18:05.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:05.550+0000 7f79620d6640 1 -- 172.21.15.87:0/432423347 learned_addr learned my addr 172.21.15.87:0/432423347 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:18:05.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:05.550+0000 7f79618d5640 1 --2- 172.21.15.87:0/432423347 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f795c0fd800 0x7f795c10d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:18:05.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:05.550+0000 7f79620d6640 1 -- 172.21.15.87:0/432423347 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f795c0fd800 msgr2=0x7f795c10d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:18:05.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:05.550+0000 7f79620d6640 1 --2- 172.21.15.87:0/432423347 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f795c0fd800 0x7f795c10d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:05.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:05.550+0000 7f79620d6640 1 -- 172.21.15.87:0/432423347 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7958005040 con 0x7f795c0fc530 2024-09-17T07:18:05.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:05.550+0000 7f79618d5640 1 --2- 172.21.15.87:0/432423347 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f795c0fd800 0x7f795c10d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T07:18:05.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:05.550+0000 7f79620d6640 1 --2- 172.21.15.87:0/432423347 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f795c0fc530 0x7f795c10cf80 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f7958009ac0 tx=0x7f7958009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:18:05.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:05.551+0000 7f794effd640 1 -- 172.21.15.87:0/432423347 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7958038070 con 0x7f795c0fc530 2024-09-17T07:18:05.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:05.551+0000 7f794effd640 1 -- 172.21.15.87:0/432423347 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f795802ae70 con 0x7f795c0fc530 2024-09-17T07:18:05.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:05.551+0000 7f796433a640 1 -- 172.21.15.87:0/432423347 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f795c10e560 con 0x7f795c0fc530 2024-09-17T07:18:05.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:05.551+0000 7f794effd640 1 -- 172.21.15.87:0/432423347 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7958033420 con 0x7f795c0fc530 2024-09-17T07:18:05.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:05.551+0000 7f796433a640 1 -- 172.21.15.87:0/432423347 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f795c10eaa0 con 0x7f795c0fc530 2024-09-17T07:18:05.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:05.552+0000 7f796433a640 1 -- 172.21.15.87:0/432423347 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f795c0fb990 con 0x7f795c0fc530 2024-09-17T07:18:05.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:05.552+0000 7f794effd640 1 -- 172.21.15.87:0/432423347 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f7958030020 con 0x7f795c0fc530 2024-09-17T07:18:05.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:05.553+0000 7f794effd640 1 --2- 172.21.15.87:0/432423347 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f794806ed60 0x7f7948071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:18:05.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:05.553+0000 7f794effd640 1 -- 172.21.15.87:0/432423347 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f79580ae160 con 0x7f795c0fc530 2024-09-17T07:18:05.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:05.553+0000 7f79618d5640 1 --2- 172.21.15.87:0/432423347 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f794806ed60 0x7f7948071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:18:05.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:05.553+0000 7f79618d5640 1 --2- 172.21.15.87:0/432423347 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f794806ed60 0x7f7948071210 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f795c10cd30 tx=0x7f7950009040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:18:05.557 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:05.557+0000 7f794effd640 1 -- 172.21.15.87:0/432423347 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f795807b2b0 con 0x7f795c0fc530 2024-09-17T07:18:05.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:05.716+0000 7f796433a640 1 -- 172.21.15.87:0/432423347 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f795c04b720 con 0x7f795c0fc530 2024-09-17T07:18:05.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:05.716+0000 7f794effd640 1 -- 172.21.15.87:0/432423347 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v21)=0 v21) v1 ==== 135+0+0 (secure 0 0 0) 0x7f795807ac50 con 0x7f795c0fc530 2024-09-17T07:18:05.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:05.718+0000 7f796433a640 1 -- 172.21.15.87:0/432423347 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f794806ed60 msgr2=0x7f7948071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:18:05.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:05.718+0000 7f796433a640 1 --2- 172.21.15.87:0/432423347 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f794806ed60 0x7f7948071210 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f795c10cd30 tx=0x7f7950009040 comp rx=0 tx=0).stop 2024-09-17T07:18:05.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:05.718+0000 7f796433a640 1 -- 172.21.15.87:0/432423347 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f795c0fc530 msgr2=0x7f795c10cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:18:05.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:05.718+0000 7f796433a640 1 --2- 172.21.15.87:0/432423347 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f795c0fc530 0x7f795c10cf80 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f7958009ac0 tx=0x7f7958009da0 comp rx=0 tx=0).stop 2024-09-17T07:18:05.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:05.718+0000 7f796433a640 1 -- 172.21.15.87:0/432423347 shutdown_connections 2024-09-17T07:18:05.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:05.718+0000 7f796433a640 1 --2- 172.21.15.87:0/432423347 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f794806ed60 0x7f7948071210 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:05.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:05.718+0000 7f796433a640 1 --2- 172.21.15.87:0/432423347 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f795c0fd800 0x7f795c10d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:05.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:05.718+0000 7f796433a640 1 --2- 172.21.15.87:0/432423347 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f795c0fc530 0x7f795c10cf80 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:05.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:05.718+0000 7f796433a640 1 -- 172.21.15.87:0/432423347 >> 172.21.15.87:0/432423347 conn(0x7f795c0f7d10 msgr2=0x7f795c0f9530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:18:05.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:05.718+0000 7f796433a640 1 -- 172.21.15.87:0/432423347 shutdown_connections 2024-09-17T07:18:05.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:05.718+0000 7f796433a640 1 -- 172.21.15.87:0/432423347 wait complete. 2024-09-17T07:18:06.015 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:18:05 smithi087 ceph-mon[27636]: pgmap v196: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s rd, 853 B/s wr, 4 op/s 2024-09-17T07:18:06.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:18:05 smithi139 ceph-mon[34403]: pgmap v196: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s rd, 853 B/s wr, 4 op/s 2024-09-17T07:18:06.291 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -e sha1=19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-09-17T07:18:06.539 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/mon.smithi087/config 2024-09-17T07:18:06.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:18:06 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:18:07.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:18:06 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:18:07.974 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:18:07 smithi087 ceph-mon[27636]: pgmap v197: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.1 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-09-17T07:18:08.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:18:07 smithi139 ceph-mon[34403]: pgmap v197: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.1 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-09-17T07:18:08.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:08.175+0000 7fbf8e645640 1 -- 172.21.15.87:0/4082128038 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf880fd840 msgr2=0x7fbf880fdcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:18:08.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:08.175+0000 7fbf8e645640 1 --2- 172.21.15.87:0/4082128038 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf880fd840 0x7fbf880fdcb0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c0048d0 tx=0x7fbf7c009da0 comp rx=0 tx=0).stop 2024-09-17T07:18:08.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:08.175+0000 7fbf8e645640 1 -- 172.21.15.87:0/4082128038 shutdown_connections 2024-09-17T07:18:08.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:08.175+0000 7fbf8e645640 1 --2- 172.21.15.87:0/4082128038 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf880fd840 0x7fbf880fdcb0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:08.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:08.175+0000 7fbf8e645640 1 --2- 172.21.15.87:0/4082128038 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbf880fc570 0x7fbf880fc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:08.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:08.175+0000 7fbf8e645640 1 -- 172.21.15.87:0/4082128038 >> 172.21.15.87:0/4082128038 conn(0x7fbf880f7d30 msgr2=0x7fbf880fa160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:18:08.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:08.175+0000 7fbf8e645640 1 -- 172.21.15.87:0/4082128038 shutdown_connections 2024-09-17T07:18:08.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:08.175+0000 7fbf8e645640 1 -- 172.21.15.87:0/4082128038 wait complete. 2024-09-17T07:18:08.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:08.176+0000 7fbf8e645640 1 Processor -- start 2024-09-17T07:18:08.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:08.176+0000 7fbf8e645640 1 -- start start 2024-09-17T07:18:08.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:08.176+0000 7fbf8e645640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbf880fc570 0x7fbf8810cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:18:08.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:08.176+0000 7fbf8e645640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf880fd840 0x7fbf8810d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:18:08.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:08.176+0000 7fbf8e645640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8810db30 con 0x7fbf880fd840 2024-09-17T07:18:08.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:08.176+0000 7fbf8e645640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8810e350 con 0x7fbf880fc570 2024-09-17T07:18:08.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:08.176+0000 7fbf877fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf880fd840 0x7fbf8810d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:18:08.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:08.176+0000 7fbf877fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf880fd840 0x7fbf8810d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35454/0 (socket says 172.21.15.87:35454) 2024-09-17T07:18:08.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:08.176+0000 7fbf877fe640 1 -- 172.21.15.87:0/2801786890 learned_addr learned my addr 172.21.15.87:0/2801786890 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:18:08.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:08.176+0000 7fbf87fff640 1 --2- 172.21.15.87:0/2801786890 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbf880fc570 0x7fbf8810cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:18:08.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:08.177+0000 7fbf877fe640 1 -- 172.21.15.87:0/2801786890 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbf880fc570 msgr2=0x7fbf8810cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:18:08.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:08.177+0000 7fbf877fe640 1 --2- 172.21.15.87:0/2801786890 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbf880fc570 0x7fbf8810cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:08.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:08.177+0000 7fbf877fe640 1 -- 172.21.15.87:0/2801786890 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf7c005040 con 0x7fbf880fd840 2024-09-17T07:18:08.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:08.177+0000 7fbf877fe640 1 --2- 172.21.15.87:0/2801786890 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf880fd840 0x7fbf8810d4e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c009ac0 tx=0x7fbf7c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:18:08.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:08.177+0000 7fbf84ff9640 1 -- 172.21.15.87:0/2801786890 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf7c038070 con 0x7fbf880fd840 2024-09-17T07:18:08.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:08.177+0000 7fbf8e645640 1 -- 172.21.15.87:0/2801786890 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf8810e580 con 0x7fbf880fd840 2024-09-17T07:18:08.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:08.177+0000 7fbf84ff9640 1 -- 172.21.15.87:0/2801786890 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fbf7c02ae70 con 0x7fbf880fd840 2024-09-17T07:18:08.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:08.177+0000 7fbf84ff9640 1 -- 172.21.15.87:0/2801786890 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf7c033420 con 0x7fbf880fd840 2024-09-17T07:18:08.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:08.177+0000 7fbf8e645640 1 -- 172.21.15.87:0/2801786890 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf8810eac0 con 0x7fbf880fd840 2024-09-17T07:18:08.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:08.178+0000 7fbf8e645640 1 -- 172.21.15.87:0/2801786890 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf880fb9d0 con 0x7fbf880fd840 2024-09-17T07:18:08.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:08.178+0000 7fbf84ff9640 1 -- 172.21.15.87:0/2801786890 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fbf7c030020 con 0x7fbf880fd840 2024-09-17T07:18:08.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:08.179+0000 7fbf84ff9640 1 --2- 172.21.15.87:0/2801786890 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fbf7006ed60 0x7fbf70071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:18:08.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:08.179+0000 7fbf84ff9640 1 -- 172.21.15.87:0/2801786890 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fbf7c0ae130 con 0x7fbf880fd840 2024-09-17T07:18:08.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:08.179+0000 7fbf87fff640 1 --2- 172.21.15.87:0/2801786890 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fbf7006ed60 0x7fbf70071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:18:08.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:08.179+0000 7fbf87fff640 1 --2- 172.21.15.87:0/2801786890 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fbf7006ed60 0x7fbf70071210 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbf780041d0 tx=0x7fbf78004330 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:18:08.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:08.183+0000 7fbf84ff9640 1 -- 172.21.15.87:0/2801786890 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fbf7c07b2b0 con 0x7fbf880fd840 2024-09-17T07:18:08.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:08.349+0000 7fbf8e645640 1 -- 172.21.15.87:0/2801786890 --> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9", "target": ["mon-mgr", ""]}) v1 -- 0x7fbf8810eeb0 con 0x7fbf7006ed60 2024-09-17T07:18:08.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:08.355+0000 7fbf84ff9640 1 -- 172.21.15.87:0/2801786890 <== mgr.14208 v2:172.21.15.87:6800/611048628 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7fbf8810eeb0 con 0x7fbf7006ed60 2024-09-17T07:18:08.355 INFO:teuthology.orchestra.run.smithi087.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 2024-09-17T07:18:08.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:08.356+0000 7fbf8e645640 1 -- 172.21.15.87:0/2801786890 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fbf7006ed60 msgr2=0x7fbf70071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:18:08.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:08.356+0000 7fbf8e645640 1 --2- 172.21.15.87:0/2801786890 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fbf7006ed60 0x7fbf70071210 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbf780041d0 tx=0x7fbf78004330 comp rx=0 tx=0).stop 2024-09-17T07:18:08.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:08.357+0000 7fbf8e645640 1 -- 172.21.15.87:0/2801786890 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf880fd840 msgr2=0x7fbf8810d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:18:08.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:08.357+0000 7fbf8e645640 1 --2- 172.21.15.87:0/2801786890 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf880fd840 0x7fbf8810d4e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c009ac0 tx=0x7fbf7c009da0 comp rx=0 tx=0).stop 2024-09-17T07:18:08.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:08.357+0000 7fbf8e645640 1 -- 172.21.15.87:0/2801786890 shutdown_connections 2024-09-17T07:18:08.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:08.357+0000 7fbf8e645640 1 --2- 172.21.15.87:0/2801786890 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf880fd840 0x7fbf8810d4e0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:08.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:08.357+0000 7fbf8e645640 1 --2- 172.21.15.87:0/2801786890 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fbf7006ed60 0x7fbf70071210 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:08.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:08.357+0000 7fbf8e645640 1 --2- 172.21.15.87:0/2801786890 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbf880fc570 0x7fbf8810cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:08.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:08.357+0000 7fbf8e645640 1 -- 172.21.15.87:0/2801786890 >> 172.21.15.87:0/2801786890 conn(0x7fbf880f7d30 msgr2=0x7fbf880f9580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:18:08.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:08.357+0000 7fbf8e645640 1 -- 172.21.15.87:0/2801786890 shutdown_connections 2024-09-17T07:18:08.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:08.357+0000 7fbf8e645640 1 -- 172.21.15.87:0/2801786890 wait complete. 2024-09-17T07:18:09.118 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-17T07:18:09.119 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi087.front.sepia.ceph.com 2024-09-17T07:18:09.119 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -e sha1=19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-09-17T07:18:09.368 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/mon.smithi087/config 2024-09-17T07:18:09.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:18:09 smithi139 ceph-mon[34403]: from='client.14554 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:18:09.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:18:09 smithi139 ceph-mon[34403]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 2024-09-17T07:18:09.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:18:09 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:18:09.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:18:09 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:18:09.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:18:09 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:18:09.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:18:09 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:18:09.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:18:09 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:18:09.644 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:18:09 smithi087 ceph-mon[27636]: from='client.14554 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:18:09.644 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:18:09 smithi087 ceph-mon[27636]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 2024-09-17T07:18:09.644 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:18:09 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:18:09.644 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:18:09 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:18:09.644 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:18:09 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:18:09.644 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:18:09 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:18:09.644 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:18:09 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:18:10.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:18:10 smithi087 ceph-mon[27636]: pgmap v198: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 938 B/s wr, 4 op/s 2024-09-17T07:18:10.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:18:10 smithi087 ceph-mon[27636]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 2024-09-17T07:18:10.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:18:10 smithi139 ceph-mon[34403]: pgmap v198: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 938 B/s wr, 4 op/s 2024-09-17T07:18:10.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:18:10 smithi139 ceph-mon[34403]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 2024-09-17T07:18:11.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.268+0000 7f279bba0640 1 -- 172.21.15.87:0/4191813226 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27940fdb70 msgr2=0x7f27940fdf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:18:11.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.268+0000 7f279bba0640 1 --2- 172.21.15.87:0/4191813226 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27940fdb70 0x7f27940fdf80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f27900048d0 tx=0x7f2790009da0 comp rx=0 tx=0).stop 2024-09-17T07:18:11.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.268+0000 7f279bba0640 1 -- 172.21.15.87:0/4191813226 shutdown_connections 2024-09-17T07:18:11.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.268+0000 7f279bba0640 1 --2- 172.21.15.87:0/4191813226 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f27940fe4c0 0x7f27940fa620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:11.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.268+0000 7f279bba0640 1 --2- 172.21.15.87:0/4191813226 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27940fdb70 0x7f27940fdf80 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:11.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.268+0000 7f279bba0640 1 -- 172.21.15.87:0/4191813226 >> 172.21.15.87:0/4191813226 conn(0x7f27940f6390 msgr2=0x7f27940f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:18:11.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.268+0000 7f279bba0640 1 -- 172.21.15.87:0/4191813226 shutdown_connections 2024-09-17T07:18:11.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.268+0000 7f279bba0640 1 -- 172.21.15.87:0/4191813226 wait complete. 2024-09-17T07:18:11.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.268+0000 7f279bba0640 1 Processor -- start 2024-09-17T07:18:11.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.268+0000 7f279bba0640 1 -- start start 2024-09-17T07:18:11.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.268+0000 7f279bba0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f27940fdb70 0x7f27940fd360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:18:11.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.268+0000 7f279bba0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27940fe4c0 0x7f27940fb850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:18:11.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.269+0000 7f279bba0640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27940fbe70 con 0x7f27940fe4c0 2024-09-17T07:18:11.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.269+0000 7f279bba0640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27940fbfb0 con 0x7f27940fdb70 2024-09-17T07:18:11.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.269+0000 7f279913b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27940fe4c0 0x7f27940fb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:18:11.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.269+0000 7f279913b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27940fe4c0 0x7f27940fb850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35460/0 (socket says 172.21.15.87:35460) 2024-09-17T07:18:11.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.269+0000 7f279913b640 1 -- 172.21.15.87:0/313248659 learned_addr learned my addr 172.21.15.87:0/313248659 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:18:11.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.269+0000 7f279993c640 1 --2- 172.21.15.87:0/313248659 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f27940fdb70 0x7f27940fd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:18:11.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.269+0000 7f279913b640 1 -- 172.21.15.87:0/313248659 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f27940fdb70 msgr2=0x7f27940fd360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:18:11.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.269+0000 7f279913b640 1 --2- 172.21.15.87:0/313248659 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f27940fdb70 0x7f27940fd360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:11.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.269+0000 7f279913b640 1 -- 172.21.15.87:0/313248659 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2790005040 con 0x7f27940fe4c0 2024-09-17T07:18:11.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.269+0000 7f279913b640 1 --2- 172.21.15.87:0/313248659 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27940fe4c0 0x7f27940fb850 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f278400b580 tx=0x7f27840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:18:11.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.269+0000 7f278a7fc640 1 -- 172.21.15.87:0/313248659 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f278400f6f0 con 0x7f27940fe4c0 2024-09-17T07:18:11.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.269+0000 7f278a7fc640 1 -- 172.21.15.87:0/313248659 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f278400fcd0 con 0x7f27940fe4c0 2024-09-17T07:18:11.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.269+0000 7f279bba0640 1 -- 172.21.15.87:0/313248659 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27940fc290 con 0x7f27940fe4c0 2024-09-17T07:18:11.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.269+0000 7f278a7fc640 1 -- 172.21.15.87:0/313248659 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2784011e50 con 0x7f27940fe4c0 2024-09-17T07:18:11.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.269+0000 7f279bba0640 1 -- 172.21.15.87:0/313248659 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2794115080 con 0x7f27940fe4c0 2024-09-17T07:18:11.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.271+0000 7f279bba0640 1 -- 172.21.15.87:0/313248659 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27940fa010 con 0x7f27940fe4c0 2024-09-17T07:18:11.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.271+0000 7f278a7fc640 1 -- 172.21.15.87:0/313248659 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f278400f850 con 0x7f27940fe4c0 2024-09-17T07:18:11.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.272+0000 7f278a7fc640 1 --2- 172.21.15.87:0/313248659 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f278006ed60 0x7f2780071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:18:11.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.272+0000 7f279993c640 1 --2- 172.21.15.87:0/313248659 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f278006ed60 0x7f2780071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:18:11.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.272+0000 7f278a7fc640 1 -- 172.21.15.87:0/313248659 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f278408dfe0 con 0x7f27940fe4c0 2024-09-17T07:18:11.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.272+0000 7f279993c640 1 --2- 172.21.15.87:0/313248659 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f278006ed60 0x7f2780071210 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f27940fd110 tx=0x7f2790035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:18:11.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.276+0000 7f278a7fc640 1 -- 172.21.15.87:0/313248659 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f278405b150 con 0x7f27940fe4c0 2024-09-17T07:18:11.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.470+0000 7f279bba0640 1 -- 172.21.15.87:0/313248659 --> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2794101e30 con 0x7f278006ed60 2024-09-17T07:18:11.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.471+0000 7f278a7fc640 1 -- 172.21.15.87:0/313248659 <== mgr.14208 v2:172.21.15.87:6800/611048628 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f2794101e30 con 0x7f278006ed60 2024-09-17T07:18:11.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.473+0000 7f279bba0640 1 -- 172.21.15.87:0/313248659 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f278006ed60 msgr2=0x7f2780071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:18:11.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.473+0000 7f279bba0640 1 --2- 172.21.15.87:0/313248659 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f278006ed60 0x7f2780071210 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f27940fd110 tx=0x7f2790035040 comp rx=0 tx=0).stop 2024-09-17T07:18:11.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.473+0000 7f279bba0640 1 -- 172.21.15.87:0/313248659 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27940fe4c0 msgr2=0x7f27940fb850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:18:11.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.473+0000 7f279bba0640 1 --2- 172.21.15.87:0/313248659 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27940fe4c0 0x7f27940fb850 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f278400b580 tx=0x7f27840091a0 comp rx=0 tx=0).stop 2024-09-17T07:18:11.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.473+0000 7f279bba0640 1 -- 172.21.15.87:0/313248659 shutdown_connections 2024-09-17T07:18:11.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.473+0000 7f279bba0640 1 --2- 172.21.15.87:0/313248659 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27940fe4c0 0x7f27940fb850 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:11.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.473+0000 7f279bba0640 1 --2- 172.21.15.87:0/313248659 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f278006ed60 0x7f2780071210 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:11.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.473+0000 7f279bba0640 1 --2- 172.21.15.87:0/313248659 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f27940fdb70 0x7f27940fd360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:11.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.473+0000 7f279bba0640 1 -- 172.21.15.87:0/313248659 >> 172.21.15.87:0/313248659 conn(0x7f27940f6390 msgr2=0x7f27940f7bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:18:11.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.473+0000 7f279bba0640 1 -- 172.21.15.87:0/313248659 shutdown_connections 2024-09-17T07:18:11.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.473+0000 7f279bba0640 1 -- 172.21.15.87:0/313248659 wait complete. 2024-09-17T07:18:11.481 INFO:teuthology.orchestra.run.smithi087.stdout:true 2024-09-17T07:18:11.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.560+0000 7f2da5691640 1 -- 172.21.15.87:0/3772701260 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2da00fd840 msgr2=0x7f2da00fdcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:18:11.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.560+0000 7f2da5691640 1 --2- 172.21.15.87:0/3772701260 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2da00fd840 0x7f2da00fdcb0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f2d940048d0 tx=0x7f2d94009da0 comp rx=0 tx=0).stop 2024-09-17T07:18:11.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.560+0000 7f2da5691640 1 -- 172.21.15.87:0/3772701260 shutdown_connections 2024-09-17T07:18:11.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.560+0000 7f2da5691640 1 --2- 172.21.15.87:0/3772701260 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2da00fd840 0x7f2da00fdcb0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:11.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.560+0000 7f2da5691640 1 --2- 172.21.15.87:0/3772701260 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2da00fc570 0x7f2da00fc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:11.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.560+0000 7f2da5691640 1 -- 172.21.15.87:0/3772701260 >> 172.21.15.87:0/3772701260 conn(0x7f2da00f7d30 msgr2=0x7f2da00fa160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:18:11.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.561+0000 7f2da5691640 1 -- 172.21.15.87:0/3772701260 shutdown_connections 2024-09-17T07:18:11.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.561+0000 7f2da5691640 1 -- 172.21.15.87:0/3772701260 wait complete. 2024-09-17T07:18:11.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.561+0000 7f2da5691640 1 Processor -- start 2024-09-17T07:18:11.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.561+0000 7f2da5691640 1 -- start start 2024-09-17T07:18:11.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.562+0000 7f2da5691640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2da00fc570 0x7f2da010d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:18:11.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.562+0000 7f2da5691640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2da00fd840 0x7f2da010d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:18:11.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.562+0000 7f2da5691640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2da010e3d0 con 0x7f2da00fd840 2024-09-17T07:18:11.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.562+0000 7f2da5691640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2da010e540 con 0x7f2da00fc570 2024-09-17T07:18:11.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.562+0000 7f2d9e7fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2da00fd840 0x7f2da010d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:18:11.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.562+0000 7f2d9e7fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2da00fd840 0x7f2da010d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35478/0 (socket says 172.21.15.87:35478) 2024-09-17T07:18:11.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.562+0000 7f2d9e7fc640 1 -- 172.21.15.87:0/2331064590 learned_addr learned my addr 172.21.15.87:0/2331064590 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:18:11.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.562+0000 7f2d9effd640 1 --2- 172.21.15.87:0/2331064590 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2da00fc570 0x7f2da010d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:18:11.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.562+0000 7f2d9e7fc640 1 -- 172.21.15.87:0/2331064590 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2da00fc570 msgr2=0x7f2da010d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:18:11.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.562+0000 7f2d9e7fc640 1 --2- 172.21.15.87:0/2331064590 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2da00fc570 0x7f2da010d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:11.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.562+0000 7f2d9e7fc640 1 -- 172.21.15.87:0/2331064590 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d94005040 con 0x7f2da00fd840 2024-09-17T07:18:11.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.562+0000 7f2d9e7fc640 1 --2- 172.21.15.87:0/2331064590 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2da00fd840 0x7f2da010d560 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2d94009ac0 tx=0x7f2d94009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:18:11.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.563+0000 7f2d877fe640 1 -- 172.21.15.87:0/2331064590 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d94038070 con 0x7f2da00fd840 2024-09-17T07:18:11.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.563+0000 7f2d877fe640 1 -- 172.21.15.87:0/2331064590 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f2d9402ae70 con 0x7f2da00fd840 2024-09-17T07:18:11.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.563+0000 7f2da5691640 1 -- 172.21.15.87:0/2331064590 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2da010e7c0 con 0x7f2da00fd840 2024-09-17T07:18:11.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.563+0000 7f2d877fe640 1 -- 172.21.15.87:0/2331064590 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d94033420 con 0x7f2da00fd840 2024-09-17T07:18:11.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.563+0000 7f2da5691640 1 -- 172.21.15.87:0/2331064590 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2da010ec80 con 0x7f2da00fd840 2024-09-17T07:18:11.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.564+0000 7f2da5691640 1 -- 172.21.15.87:0/2331064590 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2da00fb9d0 con 0x7f2da00fd840 2024-09-17T07:18:11.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.564+0000 7f2d877fe640 1 -- 172.21.15.87:0/2331064590 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f2d94030020 con 0x7f2da00fd840 2024-09-17T07:18:11.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.565+0000 7f2d877fe640 1 --2- 172.21.15.87:0/2331064590 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f2d8806ed60 0x7f2d88071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:18:11.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.565+0000 7f2d9effd640 1 --2- 172.21.15.87:0/2331064590 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f2d8806ed60 0x7f2d88071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:18:11.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.565+0000 7f2d877fe640 1 -- 172.21.15.87:0/2331064590 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f2d940ae0b0 con 0x7f2da00fd840 2024-09-17T07:18:11.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.566+0000 7f2d9effd640 1 --2- 172.21.15.87:0/2331064590 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f2d8806ed60 0x7f2d88071210 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2d90009b40 tx=0x7f2d900090f0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:18:11.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.569+0000 7f2d877fe640 1 -- 172.21.15.87:0/2331064590 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f2d9407b2b0 con 0x7f2da00fd840 2024-09-17T07:18:11.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.768+0000 7f2da5691640 1 -- 172.21.15.87:0/2331064590 --> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2da010eef0 con 0x7f2d8806ed60 2024-09-17T07:18:11.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.769+0000 7f2d877fe640 1 -- 172.21.15.87:0/2331064590 <== mgr.14208 v2:172.21.15.87:6800/611048628 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f2da010eef0 con 0x7f2d8806ed60 2024-09-17T07:18:11.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.771+0000 7f2da5691640 1 -- 172.21.15.87:0/2331064590 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f2d8806ed60 msgr2=0x7f2d88071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:18:11.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.771+0000 7f2da5691640 1 --2- 172.21.15.87:0/2331064590 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f2d8806ed60 0x7f2d88071210 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2d90009b40 tx=0x7f2d900090f0 comp rx=0 tx=0).stop 2024-09-17T07:18:11.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.771+0000 7f2da5691640 1 -- 172.21.15.87:0/2331064590 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2da00fd840 msgr2=0x7f2da010d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:18:11.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.771+0000 7f2da5691640 1 --2- 172.21.15.87:0/2331064590 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2da00fd840 0x7f2da010d560 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2d94009ac0 tx=0x7f2d94009da0 comp rx=0 tx=0).stop 2024-09-17T07:18:11.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.772+0000 7f2da5691640 1 -- 172.21.15.87:0/2331064590 shutdown_connections 2024-09-17T07:18:11.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.772+0000 7f2da5691640 1 --2- 172.21.15.87:0/2331064590 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2da00fd840 0x7f2da010d560 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:11.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.772+0000 7f2da5691640 1 --2- 172.21.15.87:0/2331064590 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f2d8806ed60 0x7f2d88071210 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:11.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.772+0000 7f2da5691640 1 --2- 172.21.15.87:0/2331064590 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2da00fc570 0x7f2da010d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:11.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.772+0000 7f2da5691640 1 -- 172.21.15.87:0/2331064590 >> 172.21.15.87:0/2331064590 conn(0x7f2da00f7d30 msgr2=0x7f2da00f9570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:18:11.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.772+0000 7f2da5691640 1 -- 172.21.15.87:0/2331064590 shutdown_connections 2024-09-17T07:18:11.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.772+0000 7f2da5691640 1 -- 172.21.15.87:0/2331064590 wait complete. 2024-09-17T07:18:11.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.858+0000 7f1df18ce640 1 -- 172.21.15.87:0/129021427 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1dec0fb430 msgr2=0x7f1dec0fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:18:11.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.858+0000 7f1df18ce640 1 --2- 172.21.15.87:0/129021427 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1dec0fb430 0x7f1dec0fb840 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc0048d0 tx=0x7f1ddc009da0 comp rx=0 tx=0).stop 2024-09-17T07:18:11.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.858+0000 7f1df18ce640 1 -- 172.21.15.87:0/129021427 shutdown_connections 2024-09-17T07:18:11.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.858+0000 7f1df18ce640 1 --2- 172.21.15.87:0/129021427 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1dec0fc700 0x7f1dec0fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:11.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.858+0000 7f1df18ce640 1 --2- 172.21.15.87:0/129021427 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1dec0fb430 0x7f1dec0fb840 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:11.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.858+0000 7f1df18ce640 1 -- 172.21.15.87:0/129021427 >> 172.21.15.87:0/129021427 conn(0x7f1dec0f6c10 msgr2=0x7f1dec0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:18:11.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.858+0000 7f1df18ce640 1 -- 172.21.15.87:0/129021427 shutdown_connections 2024-09-17T07:18:11.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.858+0000 7f1df18ce640 1 -- 172.21.15.87:0/129021427 wait complete. 2024-09-17T07:18:11.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.859+0000 7f1df18ce640 1 Processor -- start 2024-09-17T07:18:11.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.859+0000 7f1df18ce640 1 -- start start 2024-09-17T07:18:11.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.859+0000 7f1df18ce640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1dec0fb430 0x7f1dec10cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:18:11.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.859+0000 7f1df18ce640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1dec0fc700 0x7f1dec10d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:18:11.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.859+0000 7f1df18ce640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dec10db40 con 0x7f1dec0fb430 2024-09-17T07:18:11.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.859+0000 7f1df18ce640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dec10e360 con 0x7f1dec0fc700 2024-09-17T07:18:11.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.859+0000 7f1deaffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1dec0fb430 0x7f1dec10cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:18:11.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.859+0000 7f1deaffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1dec0fb430 0x7f1dec10cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35492/0 (socket says 172.21.15.87:35492) 2024-09-17T07:18:11.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.859+0000 7f1deaffd640 1 -- 172.21.15.87:0/349594527 learned_addr learned my addr 172.21.15.87:0/349594527 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:18:11.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.860+0000 7f1de3fff640 1 --2- 172.21.15.87:0/349594527 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1dec0fc700 0x7f1dec10d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:18:11.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.860+0000 7f1deaffd640 1 -- 172.21.15.87:0/349594527 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1dec0fc700 msgr2=0x7f1dec10d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:18:11.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.860+0000 7f1deaffd640 1 --2- 172.21.15.87:0/349594527 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1dec0fc700 0x7f1dec10d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:11.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.860+0000 7f1deaffd640 1 -- 172.21.15.87:0/349594527 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ddc005040 con 0x7f1dec0fb430 2024-09-17T07:18:11.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.860+0000 7f1deaffd640 1 --2- 172.21.15.87:0/349594527 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1dec0fb430 0x7f1dec10cfb0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc009ac0 tx=0x7f1ddc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:18:11.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.860+0000 7f1de37fe640 1 -- 172.21.15.87:0/349594527 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ddc038070 con 0x7f1dec0fb430 2024-09-17T07:18:11.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.860+0000 7f1de37fe640 1 -- 172.21.15.87:0/349594527 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f1ddc02ae70 con 0x7f1dec0fb430 2024-09-17T07:18:11.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.860+0000 7f1df18ce640 1 -- 172.21.15.87:0/349594527 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dec10e590 con 0x7f1dec0fb430 2024-09-17T07:18:11.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.860+0000 7f1de37fe640 1 -- 172.21.15.87:0/349594527 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ddc033420 con 0x7f1dec0fb430 2024-09-17T07:18:11.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.860+0000 7f1df18ce640 1 -- 172.21.15.87:0/349594527 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dec10ead0 con 0x7f1dec0fb430 2024-09-17T07:18:11.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.861+0000 7f1df18ce640 1 -- 172.21.15.87:0/349594527 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dec0fa890 con 0x7f1dec0fb430 2024-09-17T07:18:11.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.862+0000 7f1de37fe640 1 -- 172.21.15.87:0/349594527 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f1ddc030020 con 0x7f1dec0fb430 2024-09-17T07:18:11.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.863+0000 7f1de37fe640 1 --2- 172.21.15.87:0/349594527 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f1dd806ed60 0x7f1dd8071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:18:11.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.863+0000 7f1de37fe640 1 -- 172.21.15.87:0/349594527 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f1ddc0ae0b0 con 0x7f1dec0fb430 2024-09-17T07:18:11.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.863+0000 7f1de3fff640 1 --2- 172.21.15.87:0/349594527 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f1dd806ed60 0x7f1dd8071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:18:11.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.863+0000 7f1de3fff640 1 --2- 172.21.15.87:0/349594527 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f1dd806ed60 0x7f1dd8071210 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1dec10cd60 tx=0x7f1dd4004330 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:18:11.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:11.867+0000 7f1de37fe640 1 -- 172.21.15.87:0/349594527 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f1ddc07b2b0 con 0x7f1dec0fb430 2024-09-17T07:18:12.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.053+0000 7f1df18ce640 1 -- 172.21.15.87:0/349594527 --> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1dec10ee50 con 0x7f1dd806ed60 2024-09-17T07:18:12.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.063+0000 7f1de37fe640 1 -- 172.21.15.87:0/349594527 <== mgr.14208 v2:172.21.15.87:6800/611048628 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f1dec10ee50 con 0x7f1dd806ed60 2024-09-17T07:18:12.063 INFO:teuthology.orchestra.run.smithi087.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T07:18:12.063 INFO:teuthology.orchestra.run.smithi087.stdout:alertmanager.smithi087 smithi087 *:9093,9094 running (4m) 29s ago 6m 25.5M - 0.25.0 c8568f914cd2 3495eb97bded 2024-09-17T07:18:12.064 INFO:teuthology.orchestra.run.smithi087.stdout:crash.smithi087 smithi087 running (6m) 29s ago 6m 6891k - 17.2.7-1635-g4a704134 f22ead590bad d9aaf9839ada 2024-09-17T07:18:12.064 INFO:teuthology.orchestra.run.smithi087.stdout:crash.smithi139 smithi139 running (5m) 34s ago 5m 6895k - 17.2.7-1635-g4a704134 f22ead590bad 354c853b318f 2024-09-17T07:18:12.064 INFO:teuthology.orchestra.run.smithi087.stdout:grafana.smithi087 smithi087 *:3000 running (4m) 29s ago 5m 87.3M - 9.4.7 954c08fa6188 738589686a89 2024-09-17T07:18:12.064 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi087.tjhpcs smithi087 running (46s) 29s ago 45s 15.5M - 17.2.7-1635-g4a704134 f22ead590bad f7142ad971ed 2024-09-17T07:18:12.064 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi087.vvbzss smithi087 running (53s) 29s ago 52s 11.6M - 17.2.7-1635-g4a704134 f22ead590bad 2dd82ff293d1 2024-09-17T07:18:12.064 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi139.ftvinf smithi139 running (43s) 34s ago 43s 14.8M - 17.2.7-1635-g4a704134 f22ead590bad d11edb295ad3 2024-09-17T07:18:12.065 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi139.gnwonz smithi139 running (50s) 34s ago 50s 17.4M - 17.2.7-1635-g4a704134 f22ead590bad 3b3d884aef02 2024-09-17T07:18:12.065 INFO:teuthology.orchestra.run.smithi087.stdout:mgr.smithi087.vuvjer smithi087 *:9283,8765,8443 running (7m) 29s ago 7m 449M - 17.2.7-1635-g4a704134 f22ead590bad 11130bf9b46c 2024-09-17T07:18:12.065 INFO:teuthology.orchestra.run.smithi087.stdout:mgr.smithi139.tuqnpn smithi139 *:8443,9283 running (5m) 34s ago 5m 400M - 17.2.7-1635-g4a704134 f22ead590bad c3789399d221 2024-09-17T07:18:12.065 INFO:teuthology.orchestra.run.smithi087.stdout:mon.smithi087 smithi087 running (7m) 29s ago 7m 49.9M 2048M 17.2.7-1635-g4a704134 f22ead590bad 175785e1fb86 2024-09-17T07:18:12.065 INFO:teuthology.orchestra.run.smithi087.stdout:mon.smithi139 smithi139 running (5m) 34s ago 5m 44.8M 2048M 17.2.7-1635-g4a704134 f22ead590bad a9a2552dc411 2024-09-17T07:18:12.065 INFO:teuthology.orchestra.run.smithi087.stdout:node-exporter.smithi087 smithi087 *:9100 running (6m) 29s ago 6m 14.4M - 1.5.0 0da6a335fe13 3e2035b992bc 2024-09-17T07:18:12.065 INFO:teuthology.orchestra.run.smithi087.stdout:node-exporter.smithi139 smithi139 *:9100 running (5m) 34s ago 5m 15.3M - 1.5.0 0da6a335fe13 291c1abbb415 2024-09-17T07:18:12.065 INFO:teuthology.orchestra.run.smithi087.stdout:osd.0 smithi087 running (4m) 29s ago 4m 45.2M 4288M 17.2.7-1635-g4a704134 f22ead590bad 396801f9b539 2024-09-17T07:18:12.066 INFO:teuthology.orchestra.run.smithi087.stdout:osd.1 smithi087 running (4m) 29s ago 4m 45.5M 4288M 17.2.7-1635-g4a704134 f22ead590bad 9446985bfcd1 2024-09-17T07:18:12.066 INFO:teuthology.orchestra.run.smithi087.stdout:osd.2 smithi087 running (3m) 29s ago 3m 44.9M 4288M 17.2.7-1635-g4a704134 f22ead590bad 8fe1428a6878 2024-09-17T07:18:12.066 INFO:teuthology.orchestra.run.smithi087.stdout:osd.3 smithi139 running (3m) 34s ago 3m 44.5M 5312M 17.2.7-1635-g4a704134 f22ead590bad 0801999b17c4 2024-09-17T07:18:12.066 INFO:teuthology.orchestra.run.smithi087.stdout:osd.4 smithi139 running (2m) 34s ago 2m 42.2M 5312M 17.2.7-1635-g4a704134 f22ead590bad 299a8dfc47f5 2024-09-17T07:18:12.066 INFO:teuthology.orchestra.run.smithi087.stdout:osd.5 smithi139 running (2m) 34s ago 2m 42.9M 5312M 17.2.7-1635-g4a704134 f22ead590bad 609cf74f32e7 2024-09-17T07:18:12.066 INFO:teuthology.orchestra.run.smithi087.stdout:prometheus.smithi087 smithi087 *:9095 running (4m) 29s ago 5m 52.1M - 2.43.0 a07b618ecd1d 2c4f73cf5937 2024-09-17T07:18:12.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.065+0000 7f1df18ce640 1 -- 172.21.15.87:0/349594527 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f1dd806ed60 msgr2=0x7f1dd8071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:18:12.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.065+0000 7f1df18ce640 1 --2- 172.21.15.87:0/349594527 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f1dd806ed60 0x7f1dd8071210 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1dec10cd60 tx=0x7f1dd4004330 comp rx=0 tx=0).stop 2024-09-17T07:18:12.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.065+0000 7f1df18ce640 1 -- 172.21.15.87:0/349594527 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1dec0fb430 msgr2=0x7f1dec10cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:18:12.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.065+0000 7f1df18ce640 1 --2- 172.21.15.87:0/349594527 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1dec0fb430 0x7f1dec10cfb0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc009ac0 tx=0x7f1ddc009da0 comp rx=0 tx=0).stop 2024-09-17T07:18:12.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.065+0000 7f1df18ce640 1 -- 172.21.15.87:0/349594527 shutdown_connections 2024-09-17T07:18:12.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.065+0000 7f1df18ce640 1 --2- 172.21.15.87:0/349594527 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f1dd806ed60 0x7f1dd8071210 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:12.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.065+0000 7f1df18ce640 1 --2- 172.21.15.87:0/349594527 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1dec0fc700 0x7f1dec10d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:12.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.065+0000 7f1df18ce640 1 --2- 172.21.15.87:0/349594527 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1dec0fb430 0x7f1dec10cfb0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:12.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.065+0000 7f1df18ce640 1 -- 172.21.15.87:0/349594527 >> 172.21.15.87:0/349594527 conn(0x7f1dec0f6c10 msgr2=0x7f1dec064f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:18:12.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.065+0000 7f1df18ce640 1 -- 172.21.15.87:0/349594527 shutdown_connections 2024-09-17T07:18:12.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.065+0000 7f1df18ce640 1 -- 172.21.15.87:0/349594527 wait complete. 2024-09-17T07:18:12.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.154+0000 7faffd883640 1 -- 172.21.15.87:0/4092314577 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faff80fc710 msgr2=0x7faff80fcb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:18:12.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.154+0000 7faffd883640 1 --2- 172.21.15.87:0/4092314577 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faff80fc710 0x7faff80fcb80 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fafec0048d0 tx=0x7fafec009da0 comp rx=0 tx=0).stop 2024-09-17T07:18:12.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.154+0000 7faffd883640 1 -- 172.21.15.87:0/4092314577 shutdown_connections 2024-09-17T07:18:12.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.154+0000 7faffd883640 1 --2- 172.21.15.87:0/4092314577 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faff80fc710 0x7faff80fcb80 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:12.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.154+0000 7faffd883640 1 --2- 172.21.15.87:0/4092314577 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faff80fb440 0x7faff80fb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:12.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.154+0000 7faffd883640 1 -- 172.21.15.87:0/4092314577 >> 172.21.15.87:0/4092314577 conn(0x7faff80f6c20 msgr2=0x7faff80f9030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:18:12.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.154+0000 7faffd883640 1 -- 172.21.15.87:0/4092314577 shutdown_connections 2024-09-17T07:18:12.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.154+0000 7faffd883640 1 -- 172.21.15.87:0/4092314577 wait complete. 2024-09-17T07:18:12.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.155+0000 7faffd883640 1 Processor -- start 2024-09-17T07:18:12.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.155+0000 7faffd883640 1 -- start start 2024-09-17T07:18:12.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.155+0000 7faffd883640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faff80fb440 0x7faff810d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:18:12.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.155+0000 7faffd883640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faff80fc710 0x7faff810d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:18:12.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.155+0000 7faffd883640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faff810dc40 con 0x7faff80fb440 2024-09-17T07:18:12.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.155+0000 7faffd883640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faff810e410 con 0x7faff80fc710 2024-09-17T07:18:12.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.155+0000 7faff6ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faff80fb440 0x7faff810d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:18:12.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.155+0000 7faff6ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faff80fb440 0x7faff810d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35510/0 (socket says 172.21.15.87:35510) 2024-09-17T07:18:12.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.155+0000 7faff6ffd640 1 -- 172.21.15.87:0/2455510714 learned_addr learned my addr 172.21.15.87:0/2455510714 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:18:12.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.156+0000 7faff6ffd640 1 -- 172.21.15.87:0/2455510714 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faff80fc710 msgr2=0x7faff810d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:18:12.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.156+0000 7faff67fc640 1 --2- 172.21.15.87:0/2455510714 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faff80fc710 0x7faff810d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:18:12.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.156+0000 7faff6ffd640 1 --2- 172.21.15.87:0/2455510714 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faff80fc710 0x7faff810d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:12.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.156+0000 7faff6ffd640 1 -- 172.21.15.87:0/2455510714 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafec005040 con 0x7faff80fb440 2024-09-17T07:18:12.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.156+0000 7faff67fc640 1 --2- 172.21.15.87:0/2455510714 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faff80fc710 0x7faff810d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T07:18:12.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.156+0000 7faff6ffd640 1 --2- 172.21.15.87:0/2455510714 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faff80fb440 0x7faff810d0b0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fafe8002a50 tx=0x7fafe8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:18:12.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.156+0000 7fafdf7fe640 1 -- 172.21.15.87:0/2455510714 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fafe8007c30 con 0x7faff80fb440 2024-09-17T07:18:12.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.156+0000 7fafdf7fe640 1 -- 172.21.15.87:0/2455510714 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fafe800f040 con 0x7faff80fb440 2024-09-17T07:18:12.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.156+0000 7faffd883640 1 -- 172.21.15.87:0/2455510714 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faff810e6a0 con 0x7faff80fb440 2024-09-17T07:18:12.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.156+0000 7fafdf7fe640 1 -- 172.21.15.87:0/2455510714 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fafe800d990 con 0x7faff80fb440 2024-09-17T07:18:12.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.156+0000 7faffd883640 1 -- 172.21.15.87:0/2455510714 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faff810ec40 con 0x7faff80fb440 2024-09-17T07:18:12.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.157+0000 7faffd883640 1 -- 172.21.15.87:0/2455510714 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faff80fa8a0 con 0x7faff80fb440 2024-09-17T07:18:12.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.158+0000 7fafdf7fe640 1 -- 172.21.15.87:0/2455510714 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fafe800dc50 con 0x7faff80fb440 2024-09-17T07:18:12.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.158+0000 7fafdf7fe640 1 --2- 172.21.15.87:0/2455510714 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fafe006ed60 0x7fafe0071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:18:12.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.158+0000 7fafdf7fe640 1 -- 172.21.15.87:0/2455510714 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fafe808dbf0 con 0x7faff80fb440 2024-09-17T07:18:12.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.158+0000 7faff67fc640 1 --2- 172.21.15.87:0/2455510714 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fafe006ed60 0x7fafe0071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:18:12.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.159+0000 7faff67fc640 1 --2- 172.21.15.87:0/2455510714 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fafe006ed60 0x7fafe0071210 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fafec0043d0 tx=0x7fafec009da0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:18:12.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.163+0000 7fafdf7fe640 1 -- 172.21.15.87:0/2455510714 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fafe805ad80 con 0x7faff80fb440 2024-09-17T07:18:12.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.417+0000 7faffd883640 1 -- 172.21.15.87:0/2455510714 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7faff804b720 con 0x7faff80fb440 2024-09-17T07:18:12.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.417+0000 7fafdf7fe640 1 -- 172.21.15.87:0/2455510714 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+643 (secure 0 0 0) 0x7fafe805a720 con 0x7faff80fb440 2024-09-17T07:18:12.418 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T07:18:12.418 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": { 2024-09-17T07:18:12.418 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 2 2024-09-17T07:18:12.418 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:18:12.419 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr": { 2024-09-17T07:18:12.419 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 2 2024-09-17T07:18:12.419 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:18:12.419 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": { 2024-09-17T07:18:12.419 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 6 2024-09-17T07:18:12.419 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:18:12.419 INFO:teuthology.orchestra.run.smithi087.stdout: "mds": { 2024-09-17T07:18:12.419 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 4 2024-09-17T07:18:12.419 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:18:12.419 INFO:teuthology.orchestra.run.smithi087.stdout: "overall": { 2024-09-17T07:18:12.419 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 14 2024-09-17T07:18:12.419 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T07:18:12.419 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T07:18:12.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.420+0000 7faffd883640 1 -- 172.21.15.87:0/2455510714 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fafe006ed60 msgr2=0x7fafe0071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:18:12.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.420+0000 7faffd883640 1 --2- 172.21.15.87:0/2455510714 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fafe006ed60 0x7fafe0071210 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fafec0043d0 tx=0x7fafec009da0 comp rx=0 tx=0).stop 2024-09-17T07:18:12.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.420+0000 7faffd883640 1 -- 172.21.15.87:0/2455510714 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faff80fb440 msgr2=0x7faff810d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:18:12.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.420+0000 7faffd883640 1 --2- 172.21.15.87:0/2455510714 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faff80fb440 0x7faff810d0b0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fafe8002a50 tx=0x7fafe8004600 comp rx=0 tx=0).stop 2024-09-17T07:18:12.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.420+0000 7faffd883640 1 -- 172.21.15.87:0/2455510714 shutdown_connections 2024-09-17T07:18:12.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.420+0000 7faffd883640 1 --2- 172.21.15.87:0/2455510714 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fafe006ed60 0x7fafe0071210 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:12.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.420+0000 7faffd883640 1 --2- 172.21.15.87:0/2455510714 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faff80fc710 0x7faff810d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:12.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.420+0000 7faffd883640 1 --2- 172.21.15.87:0/2455510714 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faff80fb440 0x7faff810d0b0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:12.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.420+0000 7faffd883640 1 -- 172.21.15.87:0/2455510714 >> 172.21.15.87:0/2455510714 conn(0x7faff80f6c20 msgr2=0x7faff8065ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:18:12.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.420+0000 7faffd883640 1 -- 172.21.15.87:0/2455510714 shutdown_connections 2024-09-17T07:18:12.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.420+0000 7faffd883640 1 -- 172.21.15.87:0/2455510714 wait complete. 2024-09-17T07:18:12.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.504+0000 7fe02d164640 1 -- 172.21.15.87:0/2795425319 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0280fc700 msgr2=0x7fe0280fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:18:12.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.504+0000 7fe02d164640 1 --2- 172.21.15.87:0/2795425319 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0280fc700 0x7fe0280fcb70 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe01c0048d0 tx=0x7fe01c009da0 comp rx=0 tx=0).stop 2024-09-17T07:18:12.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.504+0000 7fe02d164640 1 -- 172.21.15.87:0/2795425319 shutdown_connections 2024-09-17T07:18:12.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.504+0000 7fe02d164640 1 --2- 172.21.15.87:0/2795425319 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0280fc700 0x7fe0280fcb70 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:12.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.504+0000 7fe02d164640 1 --2- 172.21.15.87:0/2795425319 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe0280fb430 0x7fe0280fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:12.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.504+0000 7fe02d164640 1 -- 172.21.15.87:0/2795425319 >> 172.21.15.87:0/2795425319 conn(0x7fe0280f6c10 msgr2=0x7fe0280f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:18:12.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.504+0000 7fe02d164640 1 -- 172.21.15.87:0/2795425319 shutdown_connections 2024-09-17T07:18:12.506 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.504+0000 7fe02d164640 1 -- 172.21.15.87:0/2795425319 wait complete. 2024-09-17T07:18:12.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.505+0000 7fe02d164640 1 Processor -- start 2024-09-17T07:18:12.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.505+0000 7fe02d164640 1 -- start start 2024-09-17T07:18:12.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.505+0000 7fe02d164640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0280fb430 0x7fe0280ff550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:18:12.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.505+0000 7fe02d164640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe0280fc700 0x7fe0280fda40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:18:12.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.505+0000 7fe02d164640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0280fe060 con 0x7fe0280fb430 2024-09-17T07:18:12.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.505+0000 7fe02d164640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0280fe1a0 con 0x7fe0280fc700 2024-09-17T07:18:12.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.505+0000 7fe026d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0280fb430 0x7fe0280ff550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:18:12.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.506+0000 7fe026d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0280fb430 0x7fe0280ff550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35522/0 (socket says 172.21.15.87:35522) 2024-09-17T07:18:12.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.506+0000 7fe026d9d640 1 -- 172.21.15.87:0/2843134991 learned_addr learned my addr 172.21.15.87:0/2843134991 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:18:12.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.506+0000 7fe02659c640 1 --2- 172.21.15.87:0/2843134991 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe0280fc700 0x7fe0280fda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:18:12.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.506+0000 7fe026d9d640 1 -- 172.21.15.87:0/2843134991 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe0280fc700 msgr2=0x7fe0280fda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:18:12.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.506+0000 7fe026d9d640 1 --2- 172.21.15.87:0/2843134991 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe0280fc700 0x7fe0280fda40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:12.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.506+0000 7fe026d9d640 1 -- 172.21.15.87:0/2843134991 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe01c005040 con 0x7fe0280fb430 2024-09-17T07:18:12.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.506+0000 7fe02659c640 1 --2- 172.21.15.87:0/2843134991 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe0280fc700 0x7fe0280fda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T07:18:12.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.506+0000 7fe026d9d640 1 --2- 172.21.15.87:0/2843134991 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0280fb430 0x7fe0280ff550 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe01800b790 tx=0x7fe0180091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:18:12.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.506+0000 7fe00f7fe640 1 -- 172.21.15.87:0/2843134991 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe01800c700 con 0x7fe0280fb430 2024-09-17T07:18:12.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.506+0000 7fe00f7fe640 1 -- 172.21.15.87:0/2843134991 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fe01800cce0 con 0x7fe0280fb430 2024-09-17T07:18:12.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.506+0000 7fe02d164640 1 -- 172.21.15.87:0/2843134991 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0280fe480 con 0x7fe0280fb430 2024-09-17T07:18:12.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.506+0000 7fe00f7fe640 1 -- 172.21.15.87:0/2843134991 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe018015e10 con 0x7fe0280fb430 2024-09-17T07:18:12.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.506+0000 7fe02d164640 1 -- 172.21.15.87:0/2843134991 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe028115080 con 0x7fe0280fb430 2024-09-17T07:18:12.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.507+0000 7fe02d164640 1 -- 172.21.15.87:0/2843134991 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0280fa890 con 0x7fe0280fb430 2024-09-17T07:18:12.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.508+0000 7fe00f7fe640 1 -- 172.21.15.87:0/2843134991 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fe018012070 con 0x7fe0280fb430 2024-09-17T07:18:12.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.508+0000 7fe00f7fe640 1 --2- 172.21.15.87:0/2843134991 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fe01006ed60 0x7fe010071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:18:12.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.509+0000 7fe00f7fe640 1 -- 172.21.15.87:0/2843134991 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fe01808db70 con 0x7fe0280fb430 2024-09-17T07:18:12.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.509+0000 7fe02659c640 1 --2- 172.21.15.87:0/2843134991 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fe01006ed60 0x7fe010071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:18:12.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.509+0000 7fe02659c640 1 --2- 172.21.15.87:0/2843134991 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fe01006ed60 0x7fe010071210 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe01c00b020 tx=0x7fe01c035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:18:12.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.513+0000 7fe00f7fe640 1 -- 172.21.15.87:0/2843134991 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fe01805ac40 con 0x7fe0280fb430 2024-09-17T07:18:12.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:18:12 smithi139 ceph-mon[34403]: pgmap v199: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 767 B/s wr, 3 op/s 2024-09-17T07:18:12.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:18:12 smithi087 ceph-mon[27636]: pgmap v199: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 767 B/s wr, 3 op/s 2024-09-17T07:18:12.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.739+0000 7fe02d164640 1 -- 172.21.15.87:0/2843134991 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe028103e10 con 0x7fe0280fb430 2024-09-17T07:18:12.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.740+0000 7fe00f7fe640 1 -- 172.21.15.87:0/2843134991 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1833 (secure 0 0 0) 0x7fe01808f740 con 0x7fe0280fb430 2024-09-17T07:18:12.741 INFO:teuthology.orchestra.run.smithi087.stdout:e19 2024-09-17T07:18:12.741 INFO:teuthology.orchestra.run.smithi087.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T07:18:12.741 INFO:teuthology.orchestra.run.smithi087.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T07:18:12.741 INFO:teuthology.orchestra.run.smithi087.stdout:legacy client fscid: 1 2024-09-17T07:18:12.741 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:18:12.741 INFO:teuthology.orchestra.run.smithi087.stdout:Filesystem 'cephfs' (1) 2024-09-17T07:18:12.741 INFO:teuthology.orchestra.run.smithi087.stdout:fs_name cephfs 2024-09-17T07:18:12.741 INFO:teuthology.orchestra.run.smithi087.stdout:epoch 19 2024-09-17T07:18:12.741 INFO:teuthology.orchestra.run.smithi087.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T07:18:12.742 INFO:teuthology.orchestra.run.smithi087.stdout:created 2024-09-17T07:17:15.368053+0000 2024-09-17T07:18:12.742 INFO:teuthology.orchestra.run.smithi087.stdout:modified 2024-09-17T07:17:34.399963+0000 2024-09-17T07:18:12.742 INFO:teuthology.orchestra.run.smithi087.stdout:tableserver 0 2024-09-17T07:18:12.742 INFO:teuthology.orchestra.run.smithi087.stdout:root 0 2024-09-17T07:18:12.742 INFO:teuthology.orchestra.run.smithi087.stdout:session_timeout 60 2024-09-17T07:18:12.742 INFO:teuthology.orchestra.run.smithi087.stdout:session_autoclose 300 2024-09-17T07:18:12.742 INFO:teuthology.orchestra.run.smithi087.stdout:max_file_size 1099511627776 2024-09-17T07:18:12.742 INFO:teuthology.orchestra.run.smithi087.stdout:required_client_features {} 2024-09-17T07:18:12.742 INFO:teuthology.orchestra.run.smithi087.stdout:last_failure 0 2024-09-17T07:18:12.742 INFO:teuthology.orchestra.run.smithi087.stdout:last_failure_osd_epoch 44 2024-09-17T07:18:12.742 INFO:teuthology.orchestra.run.smithi087.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T07:18:12.742 INFO:teuthology.orchestra.run.smithi087.stdout:max_mds 2 2024-09-17T07:18:12.742 INFO:teuthology.orchestra.run.smithi087.stdout:in 0,1 2024-09-17T07:18:12.743 INFO:teuthology.orchestra.run.smithi087.stdout:up {0=14478,1=24243} 2024-09-17T07:18:12.743 INFO:teuthology.orchestra.run.smithi087.stdout:failed 2024-09-17T07:18:12.743 INFO:teuthology.orchestra.run.smithi087.stdout:damaged 2024-09-17T07:18:12.743 INFO:teuthology.orchestra.run.smithi087.stdout:stopped 2024-09-17T07:18:12.743 INFO:teuthology.orchestra.run.smithi087.stdout:data_pools [3] 2024-09-17T07:18:12.743 INFO:teuthology.orchestra.run.smithi087.stdout:metadata_pool 2 2024-09-17T07:18:12.743 INFO:teuthology.orchestra.run.smithi087.stdout:inline_data enabled 2024-09-17T07:18:12.743 INFO:teuthology.orchestra.run.smithi087.stdout:balancer 2024-09-17T07:18:12.743 INFO:teuthology.orchestra.run.smithi087.stdout:standby_count_wanted 1 2024-09-17T07:18:12.743 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi087.tjhpcs{0:14478} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.87:6828/2255237099,v1:172.21.15.87:6829/2255237099] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:18:12.743 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi087.vvbzss{0:14490} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.87:6826/4022268353,v1:172.21.15.87:6827/4022268353] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:18:12.743 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi139.gnwonz{1:24243} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.139:6824/3946792151,v1:172.21.15.139:6825/3946792151] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:18:12.743 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi139.ftvinf{1:24253} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.139:6826/3292073323,v1:172.21.15.139:6827/3292073323] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:18:12.744 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:18:12.744 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:18:12.744 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 19 2024-09-17T07:18:12.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.742+0000 7fe02d164640 1 -- 172.21.15.87:0/2843134991 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fe01006ed60 msgr2=0x7fe010071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:18:12.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.742+0000 7fe02d164640 1 --2- 172.21.15.87:0/2843134991 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fe01006ed60 0x7fe010071210 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe01c00b020 tx=0x7fe01c035040 comp rx=0 tx=0).stop 2024-09-17T07:18:12.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.742+0000 7fe02d164640 1 -- 172.21.15.87:0/2843134991 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0280fb430 msgr2=0x7fe0280ff550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:18:12.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.742+0000 7fe02d164640 1 --2- 172.21.15.87:0/2843134991 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0280fb430 0x7fe0280ff550 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe01800b790 tx=0x7fe0180091d0 comp rx=0 tx=0).stop 2024-09-17T07:18:12.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.742+0000 7fe02d164640 1 -- 172.21.15.87:0/2843134991 shutdown_connections 2024-09-17T07:18:12.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.742+0000 7fe02d164640 1 --2- 172.21.15.87:0/2843134991 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fe01006ed60 0x7fe010071210 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:12.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.742+0000 7fe02d164640 1 --2- 172.21.15.87:0/2843134991 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe0280fc700 0x7fe0280fda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:12.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.742+0000 7fe02d164640 1 --2- 172.21.15.87:0/2843134991 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0280fb430 0x7fe0280ff550 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:12.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.742+0000 7fe02d164640 1 -- 172.21.15.87:0/2843134991 >> 172.21.15.87:0/2843134991 conn(0x7fe0280f6c10 msgr2=0x7fe028065710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:18:12.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.742+0000 7fe02d164640 1 -- 172.21.15.87:0/2843134991 shutdown_connections 2024-09-17T07:18:12.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.742+0000 7fe02d164640 1 -- 172.21.15.87:0/2843134991 wait complete. 2024-09-17T07:18:12.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.832+0000 7f6b9094a640 1 -- 172.21.15.87:0/1546533257 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b8c0fd7f0 msgr2=0x7f6b8c0fdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:18:12.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.832+0000 7f6b9094a640 1 --2- 172.21.15.87:0/1546533257 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b8c0fd7f0 0x7f6b8c0fdc60 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6b800048d0 tx=0x7f6b80009da0 comp rx=0 tx=0).stop 2024-09-17T07:18:12.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.832+0000 7f6b9094a640 1 -- 172.21.15.87:0/1546533257 shutdown_connections 2024-09-17T07:18:12.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.832+0000 7f6b9094a640 1 --2- 172.21.15.87:0/1546533257 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b8c0fd7f0 0x7f6b8c0fdc60 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:12.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.832+0000 7f6b9094a640 1 --2- 172.21.15.87:0/1546533257 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6b8c0fc520 0x7f6b8c0fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:12.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.832+0000 7f6b9094a640 1 -- 172.21.15.87:0/1546533257 >> 172.21.15.87:0/1546533257 conn(0x7f6b8c0f7ce0 msgr2=0x7f6b8c0fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:18:12.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.832+0000 7f6b9094a640 1 -- 172.21.15.87:0/1546533257 shutdown_connections 2024-09-17T07:18:12.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.832+0000 7f6b9094a640 1 -- 172.21.15.87:0/1546533257 wait complete. 2024-09-17T07:18:12.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.833+0000 7f6b9094a640 1 Processor -- start 2024-09-17T07:18:12.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.833+0000 7f6b9094a640 1 -- start start 2024-09-17T07:18:12.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.833+0000 7f6b9094a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b8c0fc520 0x7f6b8c10cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:18:12.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.833+0000 7f6b9094a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6b8c0fd7f0 0x7f6b8c10d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:18:12.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.833+0000 7f6b9094a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b8c10db10 con 0x7f6b8c0fc520 2024-09-17T07:18:12.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.833+0000 7f6b9094a640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b8c10e330 con 0x7f6b8c0fd7f0 2024-09-17T07:18:12.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.833+0000 7f6b8a59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b8c0fc520 0x7f6b8c10cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:18:12.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.833+0000 7f6b8a59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b8c0fc520 0x7f6b8c10cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35542/0 (socket says 172.21.15.87:35542) 2024-09-17T07:18:12.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.833+0000 7f6b8a59c640 1 -- 172.21.15.87:0/2925612790 learned_addr learned my addr 172.21.15.87:0/2925612790 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:18:12.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.834+0000 7f6b89d9b640 1 --2- 172.21.15.87:0/2925612790 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6b8c0fd7f0 0x7f6b8c10d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:18:12.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.834+0000 7f6b8a59c640 1 -- 172.21.15.87:0/2925612790 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6b8c0fd7f0 msgr2=0x7f6b8c10d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:18:12.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.834+0000 7f6b8a59c640 1 --2- 172.21.15.87:0/2925612790 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6b8c0fd7f0 0x7f6b8c10d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:12.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.834+0000 7f6b8a59c640 1 -- 172.21.15.87:0/2925612790 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b80005040 con 0x7f6b8c0fc520 2024-09-17T07:18:12.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.834+0000 7f6b89d9b640 1 --2- 172.21.15.87:0/2925612790 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6b8c0fd7f0 0x7f6b8c10d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T07:18:12.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.834+0000 7f6b8a59c640 1 --2- 172.21.15.87:0/2925612790 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b8c0fc520 0x7f6b8c10cf80 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c002a50 tx=0x7f6b7c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:18:12.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.834+0000 7f6b7affd640 1 -- 172.21.15.87:0/2925612790 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b7c007c30 con 0x7f6b8c0fc520 2024-09-17T07:18:12.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.834+0000 7f6b7affd640 1 -- 172.21.15.87:0/2925612790 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f6b7c00f040 con 0x7f6b8c0fc520 2024-09-17T07:18:12.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.834+0000 7f6b9094a640 1 -- 172.21.15.87:0/2925612790 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b8c10e5c0 con 0x7f6b8c0fc520 2024-09-17T07:18:12.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.834+0000 7f6b7affd640 1 -- 172.21.15.87:0/2925612790 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b7c00dab0 con 0x7f6b8c0fc520 2024-09-17T07:18:12.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.834+0000 7f6b9094a640 1 -- 172.21.15.87:0/2925612790 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b8c10eb60 con 0x7f6b8c0fc520 2024-09-17T07:18:12.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.835+0000 7f6b9094a640 1 -- 172.21.15.87:0/2925612790 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b8c0fb980 con 0x7f6b8c0fc520 2024-09-17T07:18:12.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.836+0000 7f6b7affd640 1 -- 172.21.15.87:0/2925612790 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f6b7c00dc10 con 0x7f6b8c0fc520 2024-09-17T07:18:12.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.836+0000 7f6b7affd640 1 --2- 172.21.15.87:0/2925612790 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f6b7406ed60 0x7f6b74071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:18:12.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.837+0000 7f6b7affd640 1 -- 172.21.15.87:0/2925612790 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f6b7c08e0c0 con 0x7f6b8c0fc520 2024-09-17T07:18:12.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.837+0000 7f6b89d9b640 1 --2- 172.21.15.87:0/2925612790 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f6b7406ed60 0x7f6b74071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:18:12.839 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.837+0000 7f6b89d9b640 1 --2- 172.21.15.87:0/2925612790 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f6b7406ed60 0x7f6b74071210 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6b80009ac0 tx=0x7f6b80009da0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:18:12.842 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:12.841+0000 7f6b7affd640 1 -- 172.21.15.87:0/2925612790 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f6b7c05b210 con 0x7f6b8c0fc520 2024-09-17T07:18:13.041 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:13.040+0000 7f6b9094a640 1 -- 172.21.15.87:0/2925612790 --> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6b8c10ef50 con 0x7f6b7406ed60 2024-09-17T07:18:13.042 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:13.041+0000 7f6b7affd640 1 -- 172.21.15.87:0/2925612790 <== mgr.14208 v2:172.21.15.87:6800/611048628 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f6b8c10ef50 con 0x7f6b7406ed60 2024-09-17T07:18:13.042 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T07:18:13.042 INFO:teuthology.orchestra.run.smithi087.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9", 2024-09-17T07:18:13.043 INFO:teuthology.orchestra.run.smithi087.stdout: "in_progress": true, 2024-09-17T07:18:13.043 INFO:teuthology.orchestra.run.smithi087.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T07:18:13.043 INFO:teuthology.orchestra.run.smithi087.stdout: "services_complete": [], 2024-09-17T07:18:13.043 INFO:teuthology.orchestra.run.smithi087.stdout: "progress": "", 2024-09-17T07:18:13.043 INFO:teuthology.orchestra.run.smithi087.stdout: "message": "Doing first pull of quay.ceph.io/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 image", 2024-09-17T07:18:13.043 INFO:teuthology.orchestra.run.smithi087.stdout: "is_paused": false 2024-09-17T07:18:13.043 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T07:18:13.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:13.043+0000 7f6b9094a640 1 -- 172.21.15.87:0/2925612790 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f6b7406ed60 msgr2=0x7f6b74071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:18:13.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:13.043+0000 7f6b9094a640 1 --2- 172.21.15.87:0/2925612790 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f6b7406ed60 0x7f6b74071210 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6b80009ac0 tx=0x7f6b80009da0 comp rx=0 tx=0).stop 2024-09-17T07:18:13.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:13.043+0000 7f6b9094a640 1 -- 172.21.15.87:0/2925612790 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b8c0fc520 msgr2=0x7f6b8c10cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:18:13.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:13.044+0000 7f6b9094a640 1 --2- 172.21.15.87:0/2925612790 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b8c0fc520 0x7f6b8c10cf80 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c002a50 tx=0x7f6b7c004600 comp rx=0 tx=0).stop 2024-09-17T07:18:13.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:13.044+0000 7f6b9094a640 1 -- 172.21.15.87:0/2925612790 shutdown_connections 2024-09-17T07:18:13.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:13.044+0000 7f6b9094a640 1 --2- 172.21.15.87:0/2925612790 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f6b7406ed60 0x7f6b74071210 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:13.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:13.044+0000 7f6b9094a640 1 --2- 172.21.15.87:0/2925612790 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6b8c0fd7f0 0x7f6b8c10d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:13.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:13.044+0000 7f6b9094a640 1 --2- 172.21.15.87:0/2925612790 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b8c0fc520 0x7f6b8c10cf80 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:13.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:13.044+0000 7f6b9094a640 1 -- 172.21.15.87:0/2925612790 >> 172.21.15.87:0/2925612790 conn(0x7f6b8c0f7ce0 msgr2=0x7f6b8c0f9530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:18:13.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:13.044+0000 7f6b9094a640 1 -- 172.21.15.87:0/2925612790 shutdown_connections 2024-09-17T07:18:13.045 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:13.044+0000 7f6b9094a640 1 -- 172.21.15.87:0/2925612790 wait complete. 2024-09-17T07:18:13.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:13.131+0000 7f982bc20640 1 -- 172.21.15.87:0/1862376338 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98240fc520 msgr2=0x7f98240fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:18:13.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:13.131+0000 7f982bc20640 1 --2- 172.21.15.87:0/1862376338 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98240fc520 0x7f98240fc930 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f98140048d0 tx=0x7f9814009da0 comp rx=0 tx=0).stop 2024-09-17T07:18:13.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:13.132+0000 7f982bc20640 1 -- 172.21.15.87:0/1862376338 shutdown_connections 2024-09-17T07:18:13.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:13.132+0000 7f982bc20640 1 --2- 172.21.15.87:0/1862376338 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f98240fd7f0 0x7f98240fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:13.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:13.132+0000 7f982bc20640 1 --2- 172.21.15.87:0/1862376338 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98240fc520 0x7f98240fc930 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:13.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:13.132+0000 7f982bc20640 1 -- 172.21.15.87:0/1862376338 >> 172.21.15.87:0/1862376338 conn(0x7f98240f7ce0 msgr2=0x7f98240fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:18:13.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:13.132+0000 7f982bc20640 1 -- 172.21.15.87:0/1862376338 shutdown_connections 2024-09-17T07:18:13.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:13.132+0000 7f982bc20640 1 -- 172.21.15.87:0/1862376338 wait complete. 2024-09-17T07:18:13.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:13.132+0000 7f982bc20640 1 Processor -- start 2024-09-17T07:18:13.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:13.132+0000 7f982bc20640 1 -- start start 2024-09-17T07:18:13.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:13.132+0000 7f982bc20640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f98240fc520 0x7f9824071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:18:13.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:13.132+0000 7f982bc20640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98240fd7f0 0x7f982406fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:18:13.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:13.132+0000 7f982bc20640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f982406fff0 con 0x7f98240fd7f0 2024-09-17T07:18:13.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:13.132+0000 7f982bc20640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9824070130 con 0x7f98240fc520 2024-09-17T07:18:13.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:13.133+0000 7f98291bb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98240fd7f0 0x7f982406fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:18:13.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:13.133+0000 7f98299bc640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f98240fc520 0x7f9824071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:18:13.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:13.133+0000 7f98291bb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98240fd7f0 0x7f982406fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35560/0 (socket says 172.21.15.87:35560) 2024-09-17T07:18:13.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:13.133+0000 7f98291bb640 1 -- 172.21.15.87:0/2935272743 learned_addr learned my addr 172.21.15.87:0/2935272743 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:18:13.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:13.133+0000 7f98291bb640 1 -- 172.21.15.87:0/2935272743 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f98240fc520 msgr2=0x7f9824071570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:18:13.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:13.133+0000 7f98291bb640 1 --2- 172.21.15.87:0/2935272743 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f98240fc520 0x7f9824071570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:13.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:13.133+0000 7f98291bb640 1 -- 172.21.15.87:0/2935272743 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9814005040 con 0x7f98240fd7f0 2024-09-17T07:18:13.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:13.133+0000 7f98291bb640 1 --2- 172.21.15.87:0/2935272743 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98240fd7f0 0x7f982406fa60 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f982000eb70 tx=0x7f982000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:18:13.136 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:13.133+0000 7f981a7fc640 1 -- 172.21.15.87:0/2935272743 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9820007c30 con 0x7f98240fd7f0 2024-09-17T07:18:13.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:13.133+0000 7f981a7fc640 1 -- 172.21.15.87:0/2935272743 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f982000f040 con 0x7f98240fd7f0 2024-09-17T07:18:13.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:13.133+0000 7f982bc20640 1 -- 172.21.15.87:0/2935272743 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98240703b0 con 0x7f98240fd7f0 2024-09-17T07:18:13.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:13.133+0000 7f981a7fc640 1 -- 172.21.15.87:0/2935272743 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f982000c930 con 0x7f98240fd7f0 2024-09-17T07:18:13.137 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:13.134+0000 7f982bc20640 1 -- 172.21.15.87:0/2935272743 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9824115040 con 0x7f98240fd7f0 2024-09-17T07:18:13.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:13.135+0000 7f982bc20640 1 -- 172.21.15.87:0/2935272743 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98240fb980 con 0x7f98240fd7f0 2024-09-17T07:18:13.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:13.135+0000 7f981a7fc640 1 -- 172.21.15.87:0/2935272743 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f982000cba0 con 0x7f98240fd7f0 2024-09-17T07:18:13.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:13.135+0000 7f981a7fc640 1 --2- 172.21.15.87:0/2935272743 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f981006ed60 0x7f9810071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:18:13.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:13.136+0000 7f981a7fc640 1 -- 172.21.15.87:0/2935272743 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f982008deb0 con 0x7f98240fd7f0 2024-09-17T07:18:13.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:13.136+0000 7f98299bc640 1 --2- 172.21.15.87:0/2935272743 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f981006ed60 0x7f9810071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:18:13.138 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:13.136+0000 7f98299bc640 1 --2- 172.21.15.87:0/2935272743 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f981006ed60 0x7f9810071210 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9814000c00 tx=0x7f9814035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:18:13.141 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:13.140+0000 7f981a7fc640 1 -- 172.21.15.87:0/2935272743 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f982005b0f0 con 0x7f98240fd7f0 2024-09-17T07:18:13.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:13.409+0000 7f982bc20640 1 -- 172.21.15.87:0/2935272743 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f982404b720 con 0x7f98240fd7f0 2024-09-17T07:18:13.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:13.409+0000 7f981a7fc640 1 -- 172.21.15.87:0/2935272743 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f982005aa90 con 0x7f98240fd7f0 2024-09-17T07:18:13.410 INFO:teuthology.orchestra.run.smithi087.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T07:18:13.410 INFO:teuthology.orchestra.run.smithi087.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T07:18:13.410 INFO:teuthology.orchestra.run.smithi087.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T07:18:13.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:13.411+0000 7f982bc20640 1 -- 172.21.15.87:0/2935272743 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f981006ed60 msgr2=0x7f9810071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:18:13.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:13.411+0000 7f982bc20640 1 --2- 172.21.15.87:0/2935272743 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f981006ed60 0x7f9810071210 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9814000c00 tx=0x7f9814035040 comp rx=0 tx=0).stop 2024-09-17T07:18:13.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:13.411+0000 7f982bc20640 1 -- 172.21.15.87:0/2935272743 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98240fd7f0 msgr2=0x7f982406fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:18:13.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:13.411+0000 7f982bc20640 1 --2- 172.21.15.87:0/2935272743 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98240fd7f0 0x7f982406fa60 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f982000eb70 tx=0x7f982000b040 comp rx=0 tx=0).stop 2024-09-17T07:18:13.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:13.411+0000 7f982bc20640 1 -- 172.21.15.87:0/2935272743 shutdown_connections 2024-09-17T07:18:13.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:13.411+0000 7f982bc20640 1 --2- 172.21.15.87:0/2935272743 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98240fd7f0 0x7f982406fa60 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:13.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:13.411+0000 7f982bc20640 1 --2- 172.21.15.87:0/2935272743 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f981006ed60 0x7f9810071210 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:13.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:13.411+0000 7f982bc20640 1 --2- 172.21.15.87:0/2935272743 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f98240fc520 0x7f9824071570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:13.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:13.411+0000 7f982bc20640 1 -- 172.21.15.87:0/2935272743 >> 172.21.15.87:0/2935272743 conn(0x7f98240f7ce0 msgr2=0x7f98240f9610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:18:13.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:13.412+0000 7f982bc20640 1 -- 172.21.15.87:0/2935272743 shutdown_connections 2024-09-17T07:18:13.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:13.412+0000 7f982bc20640 1 -- 172.21.15.87:0/2935272743 wait complete. 2024-09-17T07:18:13.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:18:13 smithi087 ceph-mon[27636]: from='client.14558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:18:13.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:18:13 smithi087 ceph-mon[27636]: from='client.14562 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:18:13.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:18:13 smithi087 ceph-mon[27636]: from='client.14566 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:18:13.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:18:13 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/2455510714' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:18:13.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:18:13 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/2843134991' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T07:18:13.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:18:13 smithi139 ceph-mon[34403]: from='client.14558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:18:13.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:18:13 smithi139 ceph-mon[34403]: from='client.14562 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:18:13.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:18:13 smithi139 ceph-mon[34403]: from='client.14566 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:18:13.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:18:13 smithi139 ceph-mon[34403]: from='client.? 172.21.15.87:0/2455510714' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:18:13.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:18:13 smithi139 ceph-mon[34403]: from='client.? 172.21.15.87:0/2843134991' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T07:18:14.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:18:14 smithi087 ceph-mon[27636]: pgmap v200: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.2 KiB/s rd, 767 B/s wr, 5 op/s 2024-09-17T07:18:14.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:18:14 smithi087 ceph-mon[27636]: from='client.14578 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:18:14.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:18:14 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/2935272743' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T07:18:14.774 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:18:14 smithi139 ceph-mon[34403]: pgmap v200: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.2 KiB/s rd, 767 B/s wr, 5 op/s 2024-09-17T07:18:14.774 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:18:14 smithi139 ceph-mon[34403]: from='client.14578 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:18:14.775 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:18:14 smithi139 ceph-mon[34403]: from='client.? 172.21.15.87:0/2935272743' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T07:18:16.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:18:16 smithi087 ceph-mon[27636]: pgmap v201: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 597 B/s wr, 4 op/s 2024-09-17T07:18:16.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:18:16 smithi139 ceph-mon[34403]: pgmap v201: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 597 B/s wr, 4 op/s 2024-09-17T07:18:18.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:18:18 smithi087 ceph-mon[27636]: pgmap v202: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.8 KiB/s rd, 511 B/s wr, 4 op/s 2024-09-17T07:18:18.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:18:18 smithi139 ceph-mon[34403]: pgmap v202: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.8 KiB/s rd, 511 B/s wr, 4 op/s 2024-09-17T07:18:20.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:18:20 smithi087 ceph-mon[27636]: pgmap v203: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 85 B/s wr, 3 op/s 2024-09-17T07:18:20.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:18:20 smithi139 ceph-mon[34403]: pgmap v203: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 85 B/s wr, 3 op/s 2024-09-17T07:18:22.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:18:22 smithi087 ceph-mon[27636]: pgmap v204: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-17T07:18:22.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:18:22 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:18:22.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:18:22 smithi139 ceph-mon[34403]: pgmap v204: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-17T07:18:22.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:18:22 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:18:24.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:18:24 smithi087 ceph-mon[27636]: pgmap v205: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.8 KiB/s rd, 4 op/s 2024-09-17T07:18:24.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:18:24 smithi139 ceph-mon[34403]: pgmap v205: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.8 KiB/s rd, 4 op/s 2024-09-17T07:18:26.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:18:26 smithi087 ceph-mon[27636]: pgmap v206: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:18:26.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:18:26 smithi139 ceph-mon[34403]: pgmap v206: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:18:28.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:18:28 smithi087 ceph-mon[27636]: pgmap v207: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:18:28.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:18:28 smithi139 ceph-mon[34403]: pgmap v207: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:18:29.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:18:29 smithi087 ceph-mon[27636]: pgmap v208: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:18:29.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:18:29 smithi139 ceph-mon[34403]: pgmap v208: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:18:31.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:18:31 smithi087 ceph-mon[27636]: pgmap v209: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:18:32.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:18:31 smithi139 ceph-mon[34403]: pgmap v209: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:18:34.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:18:33 smithi139 ceph-mon[34403]: pgmap v210: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:18:34.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:18:33 smithi087 ceph-mon[27636]: pgmap v210: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:18:35.964 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:18:35 smithi087 ceph-mon[27636]: pgmap v211: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:18:36.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:18:35 smithi139 ceph-mon[34403]: pgmap v211: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:18:37.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:18:37 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:18:37.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:18:37 smithi139 ceph-mon[34403]: Upgrade: Target is version 18.2.4-855-g19e2a2be (unknown) 2024-09-17T07:18:37.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:18:37 smithi139 ceph-mon[34403]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, digests ['quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9'] 2024-09-17T07:18:37.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:18:37 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:18:37.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:18:37 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:18:37.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:18:37 smithi139 ceph-mon[34403]: Upgrade: Need to upgrade myself (mgr.smithi087.vuvjer) 2024-09-17T07:18:37.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:18:37 smithi139 ceph-mon[34403]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9 on smithi139 2024-09-17T07:18:37.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:18:37 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:18:37.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:18:36 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:18:37.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:18:36 smithi087 ceph-mon[27636]: Upgrade: Target is version 18.2.4-855-g19e2a2be (unknown) 2024-09-17T07:18:37.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:18:36 smithi087 ceph-mon[27636]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, digests ['quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9'] 2024-09-17T07:18:37.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:18:36 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:18:37.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:18:36 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:18:37.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:18:36 smithi087 ceph-mon[27636]: Upgrade: Need to upgrade myself (mgr.smithi087.vuvjer) 2024-09-17T07:18:37.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:18:36 smithi087 ceph-mon[27636]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9 on smithi139 2024-09-17T07:18:37.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:18:36 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:18:38.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:18:38 smithi139 ceph-mon[34403]: pgmap v212: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:18:38.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:18:38 smithi087 ceph-mon[27636]: pgmap v212: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:18:40.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:18:40 smithi139 ceph-mon[34403]: pgmap v213: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:18:40.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:18:40 smithi087 ceph-mon[27636]: pgmap v213: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:18:41.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:18:41 smithi087 ceph-mon[27636]: pgmap v214: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:18:41.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:18:41 smithi139 ceph-mon[34403]: pgmap v214: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:18:43.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.534+0000 7f7b2815d640 1 -- 172.21.15.87:0/158255749 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b200fb430 msgr2=0x7f7b200fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:18:43.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.534+0000 7f7b2815d640 1 --2- 172.21.15.87:0/158255749 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b200fb430 0x7f7b200fb840 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c0048d0 tx=0x7f7b1c009da0 comp rx=0 tx=0).stop 2024-09-17T07:18:43.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.534+0000 7f7b2815d640 1 -- 172.21.15.87:0/158255749 shutdown_connections 2024-09-17T07:18:43.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.534+0000 7f7b2815d640 1 --2- 172.21.15.87:0/158255749 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7b200fc700 0x7f7b200fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:43.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.534+0000 7f7b2815d640 1 --2- 172.21.15.87:0/158255749 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b200fb430 0x7f7b200fb840 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:43.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.534+0000 7f7b2815d640 1 -- 172.21.15.87:0/158255749 >> 172.21.15.87:0/158255749 conn(0x7f7b200f6c10 msgr2=0x7f7b200f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:18:43.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.535+0000 7f7b2815d640 1 -- 172.21.15.87:0/158255749 shutdown_connections 2024-09-17T07:18:43.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.535+0000 7f7b2815d640 1 -- 172.21.15.87:0/158255749 wait complete. 2024-09-17T07:18:43.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.535+0000 7f7b2815d640 1 Processor -- start 2024-09-17T07:18:43.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.536+0000 7f7b2815d640 1 -- start start 2024-09-17T07:18:43.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.536+0000 7f7b2815d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b200fb430 0x7f7b2010bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:18:43.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.536+0000 7f7b2815d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7b200fc700 0x7f7b2010c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:18:43.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.536+0000 7f7b2815d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b2010ca30 con 0x7f7b200fb430 2024-09-17T07:18:43.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.536+0000 7f7b2815d640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b2010d250 con 0x7f7b200fc700 2024-09-17T07:18:43.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.536+0000 7f7b256f8640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7b200fc700 0x7f7b2010c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:18:43.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.536+0000 7f7b256f8640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7b200fc700 0x7f7b2010c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.87:44800/0 (socket says 172.21.15.87:44800) 2024-09-17T07:18:43.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.536+0000 7f7b256f8640 1 -- 172.21.15.87:0/980876023 learned_addr learned my addr 172.21.15.87:0/980876023 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:18:43.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.536+0000 7f7b25ef9640 1 --2- 172.21.15.87:0/980876023 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b200fb430 0x7f7b2010bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:18:43.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.536+0000 7f7b256f8640 1 -- 172.21.15.87:0/980876023 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b200fb430 msgr2=0x7f7b2010bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:18:43.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.536+0000 7f7b256f8640 1 --2- 172.21.15.87:0/980876023 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b200fb430 0x7f7b2010bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:43.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.536+0000 7f7b256f8640 1 -- 172.21.15.87:0/980876023 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b1c005040 con 0x7f7b200fc700 2024-09-17T07:18:43.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.537+0000 7f7b256f8640 1 --2- 172.21.15.87:0/980876023 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7b200fc700 0x7f7b2010c3e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7b1000eb70 tx=0x7f7b1000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:18:43.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.537+0000 7f7b167fc640 1 -- 172.21.15.87:0/980876023 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b10007c30 con 0x7f7b200fc700 2024-09-17T07:18:43.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.537+0000 7f7b2815d640 1 -- 172.21.15.87:0/980876023 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b2010d4d0 con 0x7f7b200fc700 2024-09-17T07:18:43.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.537+0000 7f7b167fc640 1 -- 172.21.15.87:0/980876023 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f7b1000f040 con 0x7f7b200fc700 2024-09-17T07:18:43.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.537+0000 7f7b2815d640 1 -- 172.21.15.87:0/980876023 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b2010d9f0 con 0x7f7b200fc700 2024-09-17T07:18:43.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.537+0000 7f7b167fc640 1 -- 172.21.15.87:0/980876023 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b10009430 con 0x7f7b200fc700 2024-09-17T07:18:43.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.538+0000 7f7b2815d640 1 -- 172.21.15.87:0/980876023 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b2004b720 con 0x7f7b200fc700 2024-09-17T07:18:43.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.541+0000 7f7b167fc640 1 -- 172.21.15.87:0/980876023 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f7b10009590 con 0x7f7b200fc700 2024-09-17T07:18:43.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.541+0000 7f7b167fc640 1 --2- 172.21.15.87:0/980876023 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f7b0c06edb0 0x7f7b0c071260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:18:43.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.541+0000 7f7b167fc640 1 -- 172.21.15.87:0/980876023 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f7b1008e150 con 0x7f7b200fc700 2024-09-17T07:18:43.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.542+0000 7f7b25ef9640 1 --2- 172.21.15.87:0/980876023 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f7b0c06edb0 0x7f7b0c071260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:18:43.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.542+0000 7f7b25ef9640 1 --2- 172.21.15.87:0/980876023 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f7b0c06edb0 0x7f7b0c071260 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c009ac0 tx=0x7f7b1c035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:18:43.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.546+0000 7f7b167fc640 1 -- 172.21.15.87:0/980876023 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f7b1005b2c0 con 0x7f7b200fc700 2024-09-17T07:18:43.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.876+0000 7f7b2815d640 1 -- 172.21.15.87:0/980876023 --> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7b2010dd70 con 0x7f7b0c06edb0 2024-09-17T07:18:43.877 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:18:43 smithi087 ceph-mon[27636]: pgmap v215: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:18:43.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.877+0000 7f7b167fc640 1 -- 172.21.15.87:0/980876023 <== mgr.14208 v2:172.21.15.87:6800/611048628 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f7b2010dd70 con 0x7f7b0c06edb0 2024-09-17T07:18:43.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.880+0000 7f7b2815d640 1 -- 172.21.15.87:0/980876023 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f7b0c06edb0 msgr2=0x7f7b0c071260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:18:43.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.880+0000 7f7b2815d640 1 --2- 172.21.15.87:0/980876023 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f7b0c06edb0 0x7f7b0c071260 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c009ac0 tx=0x7f7b1c035040 comp rx=0 tx=0).stop 2024-09-17T07:18:43.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.880+0000 7f7b2815d640 1 -- 172.21.15.87:0/980876023 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7b200fc700 msgr2=0x7f7b2010c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:18:43.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.880+0000 7f7b2815d640 1 --2- 172.21.15.87:0/980876023 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7b200fc700 0x7f7b2010c3e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7b1000eb70 tx=0x7f7b1000b040 comp rx=0 tx=0).stop 2024-09-17T07:18:43.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.880+0000 7f7b2815d640 1 -- 172.21.15.87:0/980876023 shutdown_connections 2024-09-17T07:18:43.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.880+0000 7f7b2815d640 1 --2- 172.21.15.87:0/980876023 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f7b0c06edb0 0x7f7b0c071260 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:43.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.880+0000 7f7b2815d640 1 --2- 172.21.15.87:0/980876023 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7b200fc700 0x7f7b2010c3e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:43.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.880+0000 7f7b2815d640 1 --2- 172.21.15.87:0/980876023 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b200fb430 0x7f7b2010bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:43.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.880+0000 7f7b2815d640 1 -- 172.21.15.87:0/980876023 >> 172.21.15.87:0/980876023 conn(0x7f7b200f6c10 msgr2=0x7f7b200ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:18:43.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.880+0000 7f7b2815d640 1 -- 172.21.15.87:0/980876023 shutdown_connections 2024-09-17T07:18:43.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.880+0000 7f7b2815d640 1 -- 172.21.15.87:0/980876023 wait complete. 2024-09-17T07:18:43.890 INFO:teuthology.orchestra.run.smithi087.stdout:true 2024-09-17T07:18:43.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.965+0000 7fe748647640 1 -- 172.21.15.87:0/29847292 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7400fdb70 msgr2=0x7fe7400fdf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:18:43.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.965+0000 7fe748647640 1 --2- 172.21.15.87:0/29847292 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7400fdb70 0x7fe7400fdf80 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe73c0048d0 tx=0x7fe73c009da0 comp rx=0 tx=0).stop 2024-09-17T07:18:43.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.965+0000 7fe748647640 1 -- 172.21.15.87:0/29847292 shutdown_connections 2024-09-17T07:18:43.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.965+0000 7fe748647640 1 --2- 172.21.15.87:0/29847292 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe7400fe4c0 0x7fe7400fa620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:43.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.965+0000 7fe748647640 1 --2- 172.21.15.87:0/29847292 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7400fdb70 0x7fe7400fdf80 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:43.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.965+0000 7fe748647640 1 -- 172.21.15.87:0/29847292 >> 172.21.15.87:0/29847292 conn(0x7fe7400f6390 msgr2=0x7fe7400f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:18:43.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.965+0000 7fe748647640 1 -- 172.21.15.87:0/29847292 shutdown_connections 2024-09-17T07:18:43.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.965+0000 7fe748647640 1 -- 172.21.15.87:0/29847292 wait complete. 2024-09-17T07:18:43.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.966+0000 7fe748647640 1 Processor -- start 2024-09-17T07:18:43.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.966+0000 7fe748647640 1 -- start start 2024-09-17T07:18:43.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.966+0000 7fe748647640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7400fdb70 0x7fe74010cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:18:43.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.966+0000 7fe748647640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe7400fe4c0 0x7fe74010d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:18:43.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.966+0000 7fe748647640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe74010db80 con 0x7fe7400fdb70 2024-09-17T07:18:43.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.966+0000 7fe748647640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe74010e3a0 con 0x7fe7400fe4c0 2024-09-17T07:18:43.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.966+0000 7fe7463e3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7400fdb70 0x7fe74010cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:18:43.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.966+0000 7fe7463e3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7400fdb70 0x7fe74010cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:58522/0 (socket says 172.21.15.87:58522) 2024-09-17T07:18:43.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.967+0000 7fe7463e3640 1 -- 172.21.15.87:0/332166988 learned_addr learned my addr 172.21.15.87:0/332166988 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:18:43.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.967+0000 7fe745be2640 1 --2- 172.21.15.87:0/332166988 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe7400fe4c0 0x7fe74010d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:18:43.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.967+0000 7fe7463e3640 1 -- 172.21.15.87:0/332166988 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe7400fe4c0 msgr2=0x7fe74010d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:18:43.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.967+0000 7fe7463e3640 1 --2- 172.21.15.87:0/332166988 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe7400fe4c0 0x7fe74010d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:43.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.967+0000 7fe7463e3640 1 -- 172.21.15.87:0/332166988 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe73c005040 con 0x7fe7400fdb70 2024-09-17T07:18:43.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.967+0000 7fe745be2640 1 --2- 172.21.15.87:0/332166988 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe7400fe4c0 0x7fe74010d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T07:18:43.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.967+0000 7fe7463e3640 1 --2- 172.21.15.87:0/332166988 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7400fdb70 0x7fe74010cff0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe73c009ac0 tx=0x7fe73c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:18:43.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.968+0000 7fe736ffd640 1 -- 172.21.15.87:0/332166988 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe73c038070 con 0x7fe7400fdb70 2024-09-17T07:18:43.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.968+0000 7fe736ffd640 1 -- 172.21.15.87:0/332166988 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fe73c0096c0 con 0x7fe7400fdb70 2024-09-17T07:18:43.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.968+0000 7fe736ffd640 1 -- 172.21.15.87:0/332166988 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe73c03d420 con 0x7fe7400fdb70 2024-09-17T07:18:43.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.968+0000 7fe748647640 1 -- 172.21.15.87:0/332166988 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe74010e5d0 con 0x7fe7400fdb70 2024-09-17T07:18:43.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.968+0000 7fe748647640 1 -- 172.21.15.87:0/332166988 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe74010eb70 con 0x7fe7400fdb70 2024-09-17T07:18:43.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.969+0000 7fe748647640 1 -- 172.21.15.87:0/332166988 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7400fa010 con 0x7fe7400fdb70 2024-09-17T07:18:43.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.970+0000 7fe736ffd640 1 -- 172.21.15.87:0/332166988 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fe73c030020 con 0x7fe7400fdb70 2024-09-17T07:18:43.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.970+0000 7fe736ffd640 1 --2- 172.21.15.87:0/332166988 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fe72c06ed60 0x7fe72c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:18:43.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.971+0000 7fe736ffd640 1 -- 172.21.15.87:0/332166988 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fe73c0ae6c0 con 0x7fe7400fdb70 2024-09-17T07:18:43.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.971+0000 7fe745be2640 1 --2- 172.21.15.87:0/332166988 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fe72c06ed60 0x7fe72c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:18:43.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.971+0000 7fe745be2640 1 --2- 172.21.15.87:0/332166988 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fe72c06ed60 0x7fe72c071210 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe730004fd0 tx=0x7fe73000b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:18:43.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:43.978+0000 7fe736ffd640 1 -- 172.21.15.87:0/332166988 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fe73c07b810 con 0x7fe7400fdb70 2024-09-17T07:18:44.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:18:43 smithi139 ceph-mon[34403]: pgmap v215: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:18:44.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.155+0000 7fe748647640 1 -- 172.21.15.87:0/332166988 --> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe74010eef0 con 0x7fe72c06ed60 2024-09-17T07:18:44.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.156+0000 7fe736ffd640 1 -- 172.21.15.87:0/332166988 <== mgr.14208 v2:172.21.15.87:6800/611048628 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7fe74010eef0 con 0x7fe72c06ed60 2024-09-17T07:18:44.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.158+0000 7fe748647640 1 -- 172.21.15.87:0/332166988 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fe72c06ed60 msgr2=0x7fe72c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:18:44.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.158+0000 7fe748647640 1 --2- 172.21.15.87:0/332166988 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fe72c06ed60 0x7fe72c071210 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe730004fd0 tx=0x7fe73000b040 comp rx=0 tx=0).stop 2024-09-17T07:18:44.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.158+0000 7fe748647640 1 -- 172.21.15.87:0/332166988 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7400fdb70 msgr2=0x7fe74010cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:18:44.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.158+0000 7fe748647640 1 --2- 172.21.15.87:0/332166988 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7400fdb70 0x7fe74010cff0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe73c009ac0 tx=0x7fe73c009da0 comp rx=0 tx=0).stop 2024-09-17T07:18:44.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.158+0000 7fe748647640 1 -- 172.21.15.87:0/332166988 shutdown_connections 2024-09-17T07:18:44.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.158+0000 7fe748647640 1 --2- 172.21.15.87:0/332166988 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fe72c06ed60 0x7fe72c071210 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:44.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.158+0000 7fe748647640 1 --2- 172.21.15.87:0/332166988 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe7400fe4c0 0x7fe74010d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:44.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.158+0000 7fe748647640 1 --2- 172.21.15.87:0/332166988 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7400fdb70 0x7fe74010cff0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:44.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.158+0000 7fe748647640 1 -- 172.21.15.87:0/332166988 >> 172.21.15.87:0/332166988 conn(0x7fe7400f6390 msgr2=0x7fe7400f7be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:18:44.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.159+0000 7fe748647640 1 -- 172.21.15.87:0/332166988 shutdown_connections 2024-09-17T07:18:44.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.159+0000 7fe748647640 1 -- 172.21.15.87:0/332166988 wait complete. 2024-09-17T07:18:44.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.246+0000 7f6890206640 1 -- 172.21.15.87:0/2645177550 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f68880fcb60 msgr2=0x7f68880fcf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:18:44.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.246+0000 7f6890206640 1 --2- 172.21.15.87:0/2645177550 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f68880fcb60 0x7f68880fcf70 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6884004900 tx=0x7f6884009da0 comp rx=0 tx=0).stop 2024-09-17T07:18:44.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.246+0000 7f6890206640 1 -- 172.21.15.87:0/2645177550 shutdown_connections 2024-09-17T07:18:44.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.246+0000 7f6890206640 1 --2- 172.21.15.87:0/2645177550 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f68880fd4b0 0x7f6888103e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:44.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.246+0000 7f6890206640 1 --2- 172.21.15.87:0/2645177550 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f68880fcb60 0x7f68880fcf70 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:44.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.246+0000 7f6890206640 1 -- 172.21.15.87:0/2645177550 >> 172.21.15.87:0/2645177550 conn(0x7f68880f6390 msgr2=0x7f68880f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:18:44.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.246+0000 7f6890206640 1 -- 172.21.15.87:0/2645177550 shutdown_connections 2024-09-17T07:18:44.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.246+0000 7f6890206640 1 -- 172.21.15.87:0/2645177550 wait complete. 2024-09-17T07:18:44.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.247+0000 7f6890206640 1 Processor -- start 2024-09-17T07:18:44.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.247+0000 7f6890206640 1 -- start start 2024-09-17T07:18:44.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.247+0000 7f6890206640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f68880fcb60 0x7f688810f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:18:44.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.247+0000 7f6890206640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f68880fd4b0 0x7f688810f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:18:44.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.247+0000 7f688dfa2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f68880fcb60 0x7f688810f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:18:44.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.247+0000 7f688dfa2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f68880fcb60 0x7f688810f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:32946/0 (socket says 172.21.15.87:32946) 2024-09-17T07:18:44.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.248+0000 7f6890206640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f688810fd90 con 0x7f68880fcb60 2024-09-17T07:18:44.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.248+0000 7f688dfa2640 1 -- 172.21.15.87:0/2238612186 learned_addr learned my addr 172.21.15.87:0/2238612186 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:18:44.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.248+0000 7f6890206640 1 -- 172.21.15.87:0/2238612186 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68881105b0 con 0x7f68880fd4b0 2024-09-17T07:18:44.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.248+0000 7f688d7a1640 1 --2- 172.21.15.87:0/2238612186 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f68880fd4b0 0x7f688810f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:18:44.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.248+0000 7f688d7a1640 1 -- 172.21.15.87:0/2238612186 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f68880fcb60 msgr2=0x7f688810f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:18:44.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.248+0000 7f688d7a1640 1 --2- 172.21.15.87:0/2238612186 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f68880fcb60 0x7f688810f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:44.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.248+0000 7f688d7a1640 1 -- 172.21.15.87:0/2238612186 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6884005040 con 0x7f68880fd4b0 2024-09-17T07:18:44.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.248+0000 7f688dfa2640 1 --2- 172.21.15.87:0/2238612186 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f68880fcb60 0x7f688810f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T07:18:44.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.248+0000 7f688d7a1640 1 --2- 172.21.15.87:0/2238612186 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f68880fd4b0 0x7f688810f740 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f687800eb40 tx=0x7f687800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:18:44.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.248+0000 7f687e7fc640 1 -- 172.21.15.87:0/2238612186 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6878007c30 con 0x7f68880fd4b0 2024-09-17T07:18:44.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.248+0000 7f687e7fc640 1 -- 172.21.15.87:0/2238612186 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f687800f040 con 0x7f68880fd4b0 2024-09-17T07:18:44.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.249+0000 7f6890206640 1 -- 172.21.15.87:0/2238612186 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68881107e0 con 0x7f68880fd4b0 2024-09-17T07:18:44.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.249+0000 7f6890206640 1 -- 172.21.15.87:0/2238612186 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6888110cc0 con 0x7f68880fd4b0 2024-09-17T07:18:44.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.249+0000 7f687e7fc640 1 -- 172.21.15.87:0/2238612186 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6878009430 con 0x7f68880fd4b0 2024-09-17T07:18:44.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.250+0000 7f6890206640 1 -- 172.21.15.87:0/2238612186 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68880fa010 con 0x7f68880fd4b0 2024-09-17T07:18:44.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.250+0000 7f687e7fc640 1 -- 172.21.15.87:0/2238612186 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f687800c6a0 con 0x7f68880fd4b0 2024-09-17T07:18:44.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.251+0000 7f687e7fc640 1 --2- 172.21.15.87:0/2238612186 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f687406ed60 0x7f6874071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:18:44.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.251+0000 7f687e7fc640 1 -- 172.21.15.87:0/2238612186 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f687808deb0 con 0x7f68880fd4b0 2024-09-17T07:18:44.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.251+0000 7f688dfa2640 1 --2- 172.21.15.87:0/2238612186 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f687406ed60 0x7f6874071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:18:44.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.252+0000 7f688dfa2640 1 --2- 172.21.15.87:0/2238612186 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f687406ed60 0x7f6874071210 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f68840043d0 tx=0x7f6884035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:18:44.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.257+0000 7f687e7fc640 1 -- 172.21.15.87:0/2238612186 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f687805af90 con 0x7f68880fd4b0 2024-09-17T07:18:44.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.431+0000 7f6890206640 1 -- 172.21.15.87:0/2238612186 --> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6888111030 con 0x7f687406ed60 2024-09-17T07:18:44.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.447+0000 7f687e7fc640 1 -- 172.21.15.87:0/2238612186 <== mgr.14208 v2:172.21.15.87:6800/611048628 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f6888111030 con 0x7f687406ed60 2024-09-17T07:18:44.448 INFO:teuthology.orchestra.run.smithi087.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T07:18:44.448 INFO:teuthology.orchestra.run.smithi087.stdout:alertmanager.smithi087 smithi087 *:9093,9094 running (5m) 61s ago 6m 25.5M - 0.25.0 c8568f914cd2 3495eb97bded 2024-09-17T07:18:44.448 INFO:teuthology.orchestra.run.smithi087.stdout:crash.smithi087 smithi087 running (6m) 61s ago 6m 6891k - 17.2.7-1635-g4a704134 f22ead590bad d9aaf9839ada 2024-09-17T07:18:44.449 INFO:teuthology.orchestra.run.smithi087.stdout:crash.smithi139 smithi139 running (5m) 67s ago 5m 6895k - 17.2.7-1635-g4a704134 f22ead590bad 354c853b318f 2024-09-17T07:18:44.449 INFO:teuthology.orchestra.run.smithi087.stdout:grafana.smithi087 smithi087 *:3000 running (5m) 61s ago 6m 87.3M - 9.4.7 954c08fa6188 738589686a89 2024-09-17T07:18:44.449 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi087.tjhpcs smithi087 running (79s) 61s ago 78s 15.5M - 17.2.7-1635-g4a704134 f22ead590bad f7142ad971ed 2024-09-17T07:18:44.449 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi087.vvbzss smithi087 running (85s) 61s ago 84s 11.6M - 17.2.7-1635-g4a704134 f22ead590bad 2dd82ff293d1 2024-09-17T07:18:44.449 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi139.ftvinf smithi139 running (76s) 67s ago 75s 14.8M - 17.2.7-1635-g4a704134 f22ead590bad d11edb295ad3 2024-09-17T07:18:44.449 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi139.gnwonz smithi139 running (82s) 67s ago 82s 17.4M - 17.2.7-1635-g4a704134 f22ead590bad 3b3d884aef02 2024-09-17T07:18:44.449 INFO:teuthology.orchestra.run.smithi087.stdout:mgr.smithi087.vuvjer smithi087 *:9283,8765,8443 running (8m) 61s ago 8m 449M - 17.2.7-1635-g4a704134 f22ead590bad 11130bf9b46c 2024-09-17T07:18:44.449 INFO:teuthology.orchestra.run.smithi087.stdout:mgr.smithi139.tuqnpn smithi139 *:8443,9283 running (5m) 67s ago 5m 400M - 17.2.7-1635-g4a704134 f22ead590bad c3789399d221 2024-09-17T07:18:44.449 INFO:teuthology.orchestra.run.smithi087.stdout:mon.smithi087 smithi087 running (8m) 61s ago 8m 49.9M 2048M 17.2.7-1635-g4a704134 f22ead590bad 175785e1fb86 2024-09-17T07:18:44.449 INFO:teuthology.orchestra.run.smithi087.stdout:mon.smithi139 smithi139 running (5m) 67s ago 5m 44.8M 2048M 17.2.7-1635-g4a704134 f22ead590bad a9a2552dc411 2024-09-17T07:18:44.449 INFO:teuthology.orchestra.run.smithi087.stdout:node-exporter.smithi087 smithi087 *:9100 running (6m) 61s ago 6m 14.4M - 1.5.0 0da6a335fe13 3e2035b992bc 2024-09-17T07:18:44.449 INFO:teuthology.orchestra.run.smithi087.stdout:node-exporter.smithi139 smithi139 *:9100 running (5m) 67s ago 5m 15.3M - 1.5.0 0da6a335fe13 291c1abbb415 2024-09-17T07:18:44.449 INFO:teuthology.orchestra.run.smithi087.stdout:osd.0 smithi087 running (5m) 61s ago 4m 45.2M 4288M 17.2.7-1635-g4a704134 f22ead590bad 396801f9b539 2024-09-17T07:18:44.450 INFO:teuthology.orchestra.run.smithi087.stdout:osd.1 smithi087 running (4m) 61s ago 4m 45.5M 4288M 17.2.7-1635-g4a704134 f22ead590bad 9446985bfcd1 2024-09-17T07:18:44.450 INFO:teuthology.orchestra.run.smithi087.stdout:osd.2 smithi087 running (4m) 61s ago 4m 44.9M 4288M 17.2.7-1635-g4a704134 f22ead590bad 8fe1428a6878 2024-09-17T07:18:44.450 INFO:teuthology.orchestra.run.smithi087.stdout:osd.3 smithi139 running (3m) 67s ago 3m 44.5M 5312M 17.2.7-1635-g4a704134 f22ead590bad 0801999b17c4 2024-09-17T07:18:44.450 INFO:teuthology.orchestra.run.smithi087.stdout:osd.4 smithi139 running (3m) 67s ago 3m 42.2M 5312M 17.2.7-1635-g4a704134 f22ead590bad 299a8dfc47f5 2024-09-17T07:18:44.450 INFO:teuthology.orchestra.run.smithi087.stdout:osd.5 smithi139 running (2m) 67s ago 2m 42.9M 5312M 17.2.7-1635-g4a704134 f22ead590bad 609cf74f32e7 2024-09-17T07:18:44.450 INFO:teuthology.orchestra.run.smithi087.stdout:prometheus.smithi087 smithi087 *:9095 running (5m) 61s ago 6m 52.1M - 2.43.0 a07b618ecd1d 2c4f73cf5937 2024-09-17T07:18:44.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.449+0000 7f6890206640 1 -- 172.21.15.87:0/2238612186 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f687406ed60 msgr2=0x7f6874071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:18:44.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.449+0000 7f6890206640 1 --2- 172.21.15.87:0/2238612186 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f687406ed60 0x7f6874071210 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f68840043d0 tx=0x7f6884035040 comp rx=0 tx=0).stop 2024-09-17T07:18:44.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.449+0000 7f6890206640 1 -- 172.21.15.87:0/2238612186 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f68880fd4b0 msgr2=0x7f688810f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:18:44.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.449+0000 7f6890206640 1 --2- 172.21.15.87:0/2238612186 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f68880fd4b0 0x7f688810f740 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f687800eb40 tx=0x7f687800b040 comp rx=0 tx=0).stop 2024-09-17T07:18:44.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.449+0000 7f6890206640 1 -- 172.21.15.87:0/2238612186 shutdown_connections 2024-09-17T07:18:44.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.449+0000 7f6890206640 1 --2- 172.21.15.87:0/2238612186 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f687406ed60 0x7f6874071210 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:44.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.449+0000 7f6890206640 1 --2- 172.21.15.87:0/2238612186 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f68880fd4b0 0x7f688810f740 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:44.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.449+0000 7f6890206640 1 --2- 172.21.15.87:0/2238612186 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f68880fcb60 0x7f688810f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:44.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.449+0000 7f6890206640 1 -- 172.21.15.87:0/2238612186 >> 172.21.15.87:0/2238612186 conn(0x7f68880f6390 msgr2=0x7f68880f6760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:18:44.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.449+0000 7f6890206640 1 -- 172.21.15.87:0/2238612186 shutdown_connections 2024-09-17T07:18:44.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.449+0000 7f6890206640 1 -- 172.21.15.87:0/2238612186 wait complete. 2024-09-17T07:18:44.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.530+0000 7f950622c640 1 -- 172.21.15.87:0/137215176 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95000fb430 msgr2=0x7f95000fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:18:44.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.530+0000 7f950622c640 1 --2- 172.21.15.87:0/137215176 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95000fb430 0x7f95000fb840 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f94f00048d0 tx=0x7f94f0009da0 comp rx=0 tx=0).stop 2024-09-17T07:18:44.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.530+0000 7f950622c640 1 -- 172.21.15.87:0/137215176 shutdown_connections 2024-09-17T07:18:44.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.530+0000 7f950622c640 1 --2- 172.21.15.87:0/137215176 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f95000fc700 0x7f95000fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:44.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.530+0000 7f950622c640 1 --2- 172.21.15.87:0/137215176 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95000fb430 0x7f95000fb840 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:44.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.530+0000 7f950622c640 1 -- 172.21.15.87:0/137215176 >> 172.21.15.87:0/137215176 conn(0x7f95000f6c10 msgr2=0x7f95000f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:18:44.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.530+0000 7f950622c640 1 -- 172.21.15.87:0/137215176 shutdown_connections 2024-09-17T07:18:44.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.530+0000 7f950622c640 1 -- 172.21.15.87:0/137215176 wait complete. 2024-09-17T07:18:44.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.531+0000 7f950622c640 1 Processor -- start 2024-09-17T07:18:44.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.531+0000 7f950622c640 1 -- start start 2024-09-17T07:18:44.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.531+0000 7f950622c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95000fb430 0x7f950010cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:18:44.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.531+0000 7f950622c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f95000fc700 0x7f950010d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:18:44.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.532+0000 7f950622c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f950010db10 con 0x7f95000fb430 2024-09-17T07:18:44.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.532+0000 7f950622c640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f950010e330 con 0x7f95000fc700 2024-09-17T07:18:44.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.532+0000 7f94ff7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95000fb430 0x7f950010cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:18:44.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.532+0000 7f94ff7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95000fb430 0x7f950010cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:32960/0 (socket says 172.21.15.87:32960) 2024-09-17T07:18:44.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.532+0000 7f94ff7fe640 1 -- 172.21.15.87:0/2540494867 learned_addr learned my addr 172.21.15.87:0/2540494867 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:18:44.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.532+0000 7f94feffd640 1 --2- 172.21.15.87:0/2540494867 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f95000fc700 0x7f950010d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:18:44.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.532+0000 7f94feffd640 1 -- 172.21.15.87:0/2540494867 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95000fb430 msgr2=0x7f950010cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:18:44.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.532+0000 7f94feffd640 1 --2- 172.21.15.87:0/2540494867 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95000fb430 0x7f950010cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:44.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.532+0000 7f94feffd640 1 -- 172.21.15.87:0/2540494867 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94f0005040 con 0x7f95000fc700 2024-09-17T07:18:44.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.532+0000 7f94feffd640 1 --2- 172.21.15.87:0/2540494867 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f95000fc700 0x7f950010d4c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f94e800fbb0 tx=0x7f94e8009f30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:18:44.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.533+0000 7f94f7fff640 1 -- 172.21.15.87:0/2540494867 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94e8014070 con 0x7f95000fc700 2024-09-17T07:18:44.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.533+0000 7f950622c640 1 -- 172.21.15.87:0/2540494867 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f950010e560 con 0x7f95000fc700 2024-09-17T07:18:44.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.533+0000 7f950622c640 1 -- 172.21.15.87:0/2540494867 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f950010eb00 con 0x7f95000fc700 2024-09-17T07:18:44.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.533+0000 7f94f7fff640 1 -- 172.21.15.87:0/2540494867 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f94e8007e10 con 0x7f95000fc700 2024-09-17T07:18:44.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.533+0000 7f94f7fff640 1 -- 172.21.15.87:0/2540494867 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94e8018410 con 0x7f95000fc700 2024-09-17T07:18:44.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.534+0000 7f950622c640 1 -- 172.21.15.87:0/2540494867 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94e0005240 con 0x7f95000fc700 2024-09-17T07:18:44.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.534+0000 7f94f7fff640 1 -- 172.21.15.87:0/2540494867 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f94e8002820 con 0x7f95000fc700 2024-09-17T07:18:44.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.535+0000 7f94f7fff640 1 --2- 172.21.15.87:0/2540494867 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f94ec06ed60 0x7f94ec071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:18:44.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.535+0000 7f94ff7fe640 1 --2- 172.21.15.87:0/2540494867 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f94ec06ed60 0x7f94ec071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:18:44.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.535+0000 7f94f7fff640 1 -- 172.21.15.87:0/2540494867 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f94e8091e40 con 0x7f95000fc700 2024-09-17T07:18:44.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.537+0000 7f94ff7fe640 1 --2- 172.21.15.87:0/2540494867 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f94ec06ed60 0x7f94ec071210 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f94f0004540 tx=0x7f94f0035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:18:44.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.540+0000 7f94f7fff640 1 -- 172.21.15.87:0/2540494867 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f94e80522a0 con 0x7f95000fc700 2024-09-17T07:18:44.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.770+0000 7f950622c640 1 -- 172.21.15.87:0/2540494867 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f94e0005d00 con 0x7f95000fc700 2024-09-17T07:18:44.771 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:18:44 smithi087 ceph-mon[27636]: from='client.24311 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:18:44.771 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:18:44 smithi087 ceph-mon[27636]: from='client.14590 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:18:44.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.771+0000 7f94f7fff640 1 -- 172.21.15.87:0/2540494867 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+643 (secure 0 0 0) 0x7f94e805f0a0 con 0x7f95000fc700 2024-09-17T07:18:44.771 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T07:18:44.772 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": { 2024-09-17T07:18:44.772 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 2 2024-09-17T07:18:44.772 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:18:44.772 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr": { 2024-09-17T07:18:44.772 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 2 2024-09-17T07:18:44.772 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:18:44.772 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": { 2024-09-17T07:18:44.772 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 6 2024-09-17T07:18:44.772 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:18:44.773 INFO:teuthology.orchestra.run.smithi087.stdout: "mds": { 2024-09-17T07:18:44.773 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 4 2024-09-17T07:18:44.773 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:18:44.773 INFO:teuthology.orchestra.run.smithi087.stdout: "overall": { 2024-09-17T07:18:44.773 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 14 2024-09-17T07:18:44.774 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T07:18:44.774 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T07:18:44.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.773+0000 7f950622c640 1 -- 172.21.15.87:0/2540494867 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f94ec06ed60 msgr2=0x7f94ec071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:18:44.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.773+0000 7f950622c640 1 --2- 172.21.15.87:0/2540494867 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f94ec06ed60 0x7f94ec071210 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f94f0004540 tx=0x7f94f0035040 comp rx=0 tx=0).stop 2024-09-17T07:18:44.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.773+0000 7f950622c640 1 -- 172.21.15.87:0/2540494867 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f95000fc700 msgr2=0x7f950010d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:18:44.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.773+0000 7f950622c640 1 --2- 172.21.15.87:0/2540494867 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f95000fc700 0x7f950010d4c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f94e800fbb0 tx=0x7f94e8009f30 comp rx=0 tx=0).stop 2024-09-17T07:18:44.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.773+0000 7f950622c640 1 -- 172.21.15.87:0/2540494867 shutdown_connections 2024-09-17T07:18:44.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.773+0000 7f950622c640 1 --2- 172.21.15.87:0/2540494867 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f94ec06ed60 0x7f94ec071210 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:44.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.773+0000 7f950622c640 1 --2- 172.21.15.87:0/2540494867 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f95000fc700 0x7f950010d4c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:44.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.773+0000 7f950622c640 1 --2- 172.21.15.87:0/2540494867 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95000fb430 0x7f950010cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:44.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.773+0000 7f950622c640 1 -- 172.21.15.87:0/2540494867 >> 172.21.15.87:0/2540494867 conn(0x7f95000f6c10 msgr2=0x7f95000f8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:18:44.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.774+0000 7f950622c640 1 -- 172.21.15.87:0/2540494867 shutdown_connections 2024-09-17T07:18:44.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.774+0000 7f950622c640 1 -- 172.21.15.87:0/2540494867 wait complete. 2024-09-17T07:18:44.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.854+0000 7f3bc54d6640 1 -- 172.21.15.87:0/697817167 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3bc00fb430 msgr2=0x7f3bc00fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:18:44.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.854+0000 7f3bc54d6640 1 --2- 172.21.15.87:0/697817167 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3bc00fb430 0x7f3bc00fb840 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f3bb00048d0 tx=0x7f3bb0009da0 comp rx=0 tx=0).stop 2024-09-17T07:18:44.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.854+0000 7f3bc54d6640 1 -- 172.21.15.87:0/697817167 shutdown_connections 2024-09-17T07:18:44.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.854+0000 7f3bc54d6640 1 --2- 172.21.15.87:0/697817167 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3bc00fc700 0x7f3bc00fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:44.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.854+0000 7f3bc54d6640 1 --2- 172.21.15.87:0/697817167 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3bc00fb430 0x7f3bc00fb840 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:44.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.854+0000 7f3bc54d6640 1 -- 172.21.15.87:0/697817167 >> 172.21.15.87:0/697817167 conn(0x7f3bc00f6c10 msgr2=0x7f3bc00f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:18:44.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.854+0000 7f3bc54d6640 1 -- 172.21.15.87:0/697817167 shutdown_connections 2024-09-17T07:18:44.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.854+0000 7f3bc54d6640 1 -- 172.21.15.87:0/697817167 wait complete. 2024-09-17T07:18:44.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.855+0000 7f3bc54d6640 1 Processor -- start 2024-09-17T07:18:44.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.855+0000 7f3bc54d6640 1 -- start start 2024-09-17T07:18:44.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.855+0000 7f3bc54d6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3bc00fb430 0x7f3bc010cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:18:44.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.855+0000 7f3bc54d6640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3bc00fc700 0x7f3bc010d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:18:44.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.855+0000 7f3bc54d6640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc010db40 con 0x7f3bc00fb430 2024-09-17T07:18:44.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.855+0000 7f3bc54d6640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc010e360 con 0x7f3bc00fc700 2024-09-17T07:18:44.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.855+0000 7f3bbeffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3bc00fb430 0x7f3bc010cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:18:44.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.855+0000 7f3bbe7fc640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3bc00fc700 0x7f3bc010d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:18:44.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.855+0000 7f3bbeffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3bc00fb430 0x7f3bc010cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:32984/0 (socket says 172.21.15.87:32984) 2024-09-17T07:18:44.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.855+0000 7f3bbeffd640 1 -- 172.21.15.87:0/1606762487 learned_addr learned my addr 172.21.15.87:0/1606762487 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:18:44.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.855+0000 7f3bbeffd640 1 -- 172.21.15.87:0/1606762487 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3bc00fc700 msgr2=0x7f3bc010d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:18:44.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.856+0000 7f3bbeffd640 1 --2- 172.21.15.87:0/1606762487 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3bc00fc700 0x7f3bc010d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:44.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.856+0000 7f3bbeffd640 1 -- 172.21.15.87:0/1606762487 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb0005040 con 0x7f3bc00fb430 2024-09-17T07:18:44.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.856+0000 7f3bbeffd640 1 --2- 172.21.15.87:0/1606762487 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3bc00fb430 0x7f3bc010cfb0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f3bb0009ac0 tx=0x7f3bb0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:18:44.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.856+0000 7f3ba77fe640 1 -- 172.21.15.87:0/1606762487 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3bb0038070 con 0x7f3bc00fb430 2024-09-17T07:18:44.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.856+0000 7f3ba77fe640 1 -- 172.21.15.87:0/1606762487 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f3bb00096c0 con 0x7f3bc00fb430 2024-09-17T07:18:44.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.856+0000 7f3ba77fe640 1 -- 172.21.15.87:0/1606762487 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3bb003d420 con 0x7f3bc00fb430 2024-09-17T07:18:44.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.856+0000 7f3bc54d6640 1 -- 172.21.15.87:0/1606762487 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bc010e590 con 0x7f3bc00fb430 2024-09-17T07:18:44.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.856+0000 7f3bc54d6640 1 -- 172.21.15.87:0/1606762487 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bc010eb30 con 0x7f3bc00fb430 2024-09-17T07:18:44.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.857+0000 7f3bc54d6640 1 -- 172.21.15.87:0/1606762487 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bc00fa890 con 0x7f3bc00fb430 2024-09-17T07:18:44.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.859+0000 7f3ba77fe640 1 -- 172.21.15.87:0/1606762487 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f3bb0030020 con 0x7f3bc00fb430 2024-09-17T07:18:44.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.859+0000 7f3ba77fe640 1 --2- 172.21.15.87:0/1606762487 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f3ba806ed60 0x7f3ba8071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:18:44.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.859+0000 7f3ba77fe640 1 -- 172.21.15.87:0/1606762487 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f3bb00ae9e0 con 0x7f3bc00fb430 2024-09-17T07:18:44.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.860+0000 7f3bbe7fc640 1 --2- 172.21.15.87:0/1606762487 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f3ba806ed60 0x7f3ba8071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:18:44.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.860+0000 7f3bbe7fc640 1 --2- 172.21.15.87:0/1606762487 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f3ba806ed60 0x7f3ba8071210 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3bc010cd60 tx=0x7f3bb400b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:18:44.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:44.863+0000 7f3ba77fe640 1 -- 172.21.15.87:0/1606762487 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f3bb007bbd0 con 0x7f3bc00fb430 2024-09-17T07:18:45.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.059+0000 7f3bc54d6640 1 -- 172.21.15.87:0/1606762487 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3bc0103d10 con 0x7f3bc00fb430 2024-09-17T07:18:45.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.060+0000 7f3ba77fe640 1 -- 172.21.15.87:0/1606762487 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1833 (secure 0 0 0) 0x7f3bb007b570 con 0x7f3bc00fb430 2024-09-17T07:18:45.061 INFO:teuthology.orchestra.run.smithi087.stdout:e19 2024-09-17T07:18:45.061 INFO:teuthology.orchestra.run.smithi087.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T07:18:45.061 INFO:teuthology.orchestra.run.smithi087.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T07:18:45.061 INFO:teuthology.orchestra.run.smithi087.stdout:legacy client fscid: 1 2024-09-17T07:18:45.061 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:18:45.061 INFO:teuthology.orchestra.run.smithi087.stdout:Filesystem 'cephfs' (1) 2024-09-17T07:18:45.061 INFO:teuthology.orchestra.run.smithi087.stdout:fs_name cephfs 2024-09-17T07:18:45.061 INFO:teuthology.orchestra.run.smithi087.stdout:epoch 19 2024-09-17T07:18:45.061 INFO:teuthology.orchestra.run.smithi087.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T07:18:45.061 INFO:teuthology.orchestra.run.smithi087.stdout:created 2024-09-17T07:17:15.368053+0000 2024-09-17T07:18:45.062 INFO:teuthology.orchestra.run.smithi087.stdout:modified 2024-09-17T07:17:34.399963+0000 2024-09-17T07:18:45.062 INFO:teuthology.orchestra.run.smithi087.stdout:tableserver 0 2024-09-17T07:18:45.062 INFO:teuthology.orchestra.run.smithi087.stdout:root 0 2024-09-17T07:18:45.062 INFO:teuthology.orchestra.run.smithi087.stdout:session_timeout 60 2024-09-17T07:18:45.062 INFO:teuthology.orchestra.run.smithi087.stdout:session_autoclose 300 2024-09-17T07:18:45.062 INFO:teuthology.orchestra.run.smithi087.stdout:max_file_size 1099511627776 2024-09-17T07:18:45.062 INFO:teuthology.orchestra.run.smithi087.stdout:required_client_features {} 2024-09-17T07:18:45.062 INFO:teuthology.orchestra.run.smithi087.stdout:last_failure 0 2024-09-17T07:18:45.062 INFO:teuthology.orchestra.run.smithi087.stdout:last_failure_osd_epoch 44 2024-09-17T07:18:45.062 INFO:teuthology.orchestra.run.smithi087.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T07:18:45.062 INFO:teuthology.orchestra.run.smithi087.stdout:max_mds 2 2024-09-17T07:18:45.063 INFO:teuthology.orchestra.run.smithi087.stdout:in 0,1 2024-09-17T07:18:45.063 INFO:teuthology.orchestra.run.smithi087.stdout:up {0=14478,1=24243} 2024-09-17T07:18:45.063 INFO:teuthology.orchestra.run.smithi087.stdout:failed 2024-09-17T07:18:45.063 INFO:teuthology.orchestra.run.smithi087.stdout:damaged 2024-09-17T07:18:45.063 INFO:teuthology.orchestra.run.smithi087.stdout:stopped 2024-09-17T07:18:45.063 INFO:teuthology.orchestra.run.smithi087.stdout:data_pools [3] 2024-09-17T07:18:45.063 INFO:teuthology.orchestra.run.smithi087.stdout:metadata_pool 2 2024-09-17T07:18:45.063 INFO:teuthology.orchestra.run.smithi087.stdout:inline_data enabled 2024-09-17T07:18:45.063 INFO:teuthology.orchestra.run.smithi087.stdout:balancer 2024-09-17T07:18:45.063 INFO:teuthology.orchestra.run.smithi087.stdout:standby_count_wanted 1 2024-09-17T07:18:45.063 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi087.tjhpcs{0:14478} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.87:6828/2255237099,v1:172.21.15.87:6829/2255237099] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:18:45.063 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi087.vvbzss{0:14490} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.87:6826/4022268353,v1:172.21.15.87:6827/4022268353] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:18:45.064 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi139.gnwonz{1:24243} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.139:6824/3946792151,v1:172.21.15.139:6825/3946792151] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:18:45.064 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi139.ftvinf{1:24253} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.139:6826/3292073323,v1:172.21.15.139:6827/3292073323] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:18:45.064 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:18:45.064 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:18:45.065 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 19 2024-09-17T07:18:45.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.063+0000 7f3bc54d6640 1 -- 172.21.15.87:0/1606762487 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f3ba806ed60 msgr2=0x7f3ba8071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:18:45.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.063+0000 7f3bc54d6640 1 --2- 172.21.15.87:0/1606762487 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f3ba806ed60 0x7f3ba8071210 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3bc010cd60 tx=0x7f3bb400b040 comp rx=0 tx=0).stop 2024-09-17T07:18:45.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.063+0000 7f3bc54d6640 1 -- 172.21.15.87:0/1606762487 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3bc00fb430 msgr2=0x7f3bc010cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:18:45.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.063+0000 7f3bc54d6640 1 --2- 172.21.15.87:0/1606762487 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3bc00fb430 0x7f3bc010cfb0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f3bb0009ac0 tx=0x7f3bb0009da0 comp rx=0 tx=0).stop 2024-09-17T07:18:45.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.064+0000 7f3bc54d6640 1 -- 172.21.15.87:0/1606762487 shutdown_connections 2024-09-17T07:18:45.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.064+0000 7f3bc54d6640 1 --2- 172.21.15.87:0/1606762487 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f3ba806ed60 0x7f3ba8071210 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:45.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.064+0000 7f3bc54d6640 1 --2- 172.21.15.87:0/1606762487 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3bc00fc700 0x7f3bc010d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:45.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.064+0000 7f3bc54d6640 1 --2- 172.21.15.87:0/1606762487 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3bc00fb430 0x7f3bc010cfb0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:45.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.064+0000 7f3bc54d6640 1 -- 172.21.15.87:0/1606762487 >> 172.21.15.87:0/1606762487 conn(0x7f3bc00f6c10 msgr2=0x7f3bc0065000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:18:45.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.064+0000 7f3bc54d6640 1 -- 172.21.15.87:0/1606762487 shutdown_connections 2024-09-17T07:18:45.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.064+0000 7f3bc54d6640 1 -- 172.21.15.87:0/1606762487 wait complete. 2024-09-17T07:18:45.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:18:44 smithi139 ceph-mon[34403]: from='client.24311 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:18:45.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:18:44 smithi139 ceph-mon[34403]: from='client.14590 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:18:45.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.145+0000 7f1bbb168640 1 -- 172.21.15.87:0/3393059240 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1bb40ff680 msgr2=0x7f1bb4101a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:18:45.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.145+0000 7f1bbb168640 1 --2- 172.21.15.87:0/3393059240 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1bb40ff680 0x7f1bb4101a60 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f1ba00048d0 tx=0x7f1ba0009da0 comp rx=0 tx=0).stop 2024-09-17T07:18:45.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.146+0000 7f1bbb168640 1 -- 172.21.15.87:0/3393059240 shutdown_connections 2024-09-17T07:18:45.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.146+0000 7f1bbb168640 1 --2- 172.21.15.87:0/3393059240 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1bb40ff680 0x7f1bb4101a60 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:45.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.146+0000 7f1bbb168640 1 --2- 172.21.15.87:0/3393059240 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1bb4065c40 0x7f1bb40ff140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:45.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.146+0000 7f1bbb168640 1 -- 172.21.15.87:0/3393059240 >> 172.21.15.87:0/3393059240 conn(0x7f1bb40f6c10 msgr2=0x7f1bb40f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:18:45.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.146+0000 7f1bbb168640 1 -- 172.21.15.87:0/3393059240 shutdown_connections 2024-09-17T07:18:45.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.146+0000 7f1bbb168640 1 -- 172.21.15.87:0/3393059240 wait complete. 2024-09-17T07:18:45.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.146+0000 7f1bbb168640 1 Processor -- start 2024-09-17T07:18:45.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.147+0000 7f1bbb168640 1 -- start start 2024-09-17T07:18:45.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.147+0000 7f1bbb168640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1bb4065c40 0x7f1bb40fcb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:18:45.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.147+0000 7f1bbb168640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1bb40ff680 0x7f1bb40fb040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:18:45.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.147+0000 7f1bbb168640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb40fb580 con 0x7f1bb40ff680 2024-09-17T07:18:45.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.147+0000 7f1bbb168640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb40fb6c0 con 0x7f1bb4065c40 2024-09-17T07:18:45.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.147+0000 7f1bb8f04640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1bb4065c40 0x7f1bb40fcb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:18:45.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.147+0000 7f1bb3fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1bb40ff680 0x7f1bb40fb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:18:45.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.147+0000 7f1bb8f04640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1bb4065c40 0x7f1bb40fcb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.87:37558/0 (socket says 172.21.15.87:37558) 2024-09-17T07:18:45.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.147+0000 7f1bb8f04640 1 -- 172.21.15.87:0/477153687 learned_addr learned my addr 172.21.15.87:0/477153687 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:18:45.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.148+0000 7f1bb3fff640 1 -- 172.21.15.87:0/477153687 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1bb4065c40 msgr2=0x7f1bb40fcb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:18:45.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.148+0000 7f1bb3fff640 1 --2- 172.21.15.87:0/477153687 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1bb4065c40 0x7f1bb40fcb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:45.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.148+0000 7f1bb3fff640 1 -- 172.21.15.87:0/477153687 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ba0005040 con 0x7f1bb40ff680 2024-09-17T07:18:45.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.148+0000 7f1bb3fff640 1 --2- 172.21.15.87:0/477153687 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1bb40ff680 0x7f1bb40fb040 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f1ba00043d0 tx=0x7f1ba0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:18:45.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.148+0000 7f1bb17fa640 1 -- 172.21.15.87:0/477153687 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ba0038070 con 0x7f1bb40ff680 2024-09-17T07:18:45.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.148+0000 7f1bb17fa640 1 -- 172.21.15.87:0/477153687 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f1ba00096c0 con 0x7f1bb40ff680 2024-09-17T07:18:45.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.148+0000 7f1bb17fa640 1 -- 172.21.15.87:0/477153687 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ba003d420 con 0x7f1bb40ff680 2024-09-17T07:18:45.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.148+0000 7f1bbb168640 1 -- 172.21.15.87:0/477153687 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bb40fb940 con 0x7f1bb40ff680 2024-09-17T07:18:45.150 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.148+0000 7f1bbb168640 1 -- 172.21.15.87:0/477153687 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bb40fbeb0 con 0x7f1bb40ff680 2024-09-17T07:18:45.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.149+0000 7f1bbb168640 1 -- 172.21.15.87:0/477153687 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bb40fa890 con 0x7f1bb40ff680 2024-09-17T07:18:45.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.150+0000 7f1bb17fa640 1 -- 172.21.15.87:0/477153687 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f1ba0030020 con 0x7f1bb40ff680 2024-09-17T07:18:45.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.151+0000 7f1bb17fa640 1 --2- 172.21.15.87:0/477153687 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f1ba406ed60 0x7f1ba4071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:18:45.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.151+0000 7f1bb17fa640 1 -- 172.21.15.87:0/477153687 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f1ba00ae5b0 con 0x7f1bb40ff680 2024-09-17T07:18:45.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.151+0000 7f1bb8f04640 1 --2- 172.21.15.87:0/477153687 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f1ba406ed60 0x7f1ba4071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:18:45.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.152+0000 7f1bb8f04640 1 --2- 172.21.15.87:0/477153687 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f1ba406ed60 0x7f1ba4071210 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1bb40fc8b0 tx=0x7f1ba800b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:18:45.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.158+0000 7f1bb17fa640 1 -- 172.21.15.87:0/477153687 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f1ba007b660 con 0x7f1bb40ff680 2024-09-17T07:18:45.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.345+0000 7f1bbb168640 1 -- 172.21.15.87:0/477153687 --> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1bb40fbeb0 con 0x7f1ba406ed60 2024-09-17T07:18:45.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.346+0000 7f1bb17fa640 1 -- 172.21.15.87:0/477153687 <== mgr.14208 v2:172.21.15.87:6800/611048628 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f1bb40fbeb0 con 0x7f1ba406ed60 2024-09-17T07:18:45.346 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T07:18:45.346 INFO:teuthology.orchestra.run.smithi087.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9", 2024-09-17T07:18:45.346 INFO:teuthology.orchestra.run.smithi087.stdout: "in_progress": true, 2024-09-17T07:18:45.346 INFO:teuthology.orchestra.run.smithi087.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T07:18:45.347 INFO:teuthology.orchestra.run.smithi087.stdout: "services_complete": [], 2024-09-17T07:18:45.347 INFO:teuthology.orchestra.run.smithi087.stdout: "progress": "0/21 daemons upgraded", 2024-09-17T07:18:45.347 INFO:teuthology.orchestra.run.smithi087.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9 image on host smithi139", 2024-09-17T07:18:45.347 INFO:teuthology.orchestra.run.smithi087.stdout: "is_paused": false 2024-09-17T07:18:45.347 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T07:18:45.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.349+0000 7f1bbb168640 1 -- 172.21.15.87:0/477153687 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f1ba406ed60 msgr2=0x7f1ba4071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:18:45.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.349+0000 7f1bbb168640 1 --2- 172.21.15.87:0/477153687 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f1ba406ed60 0x7f1ba4071210 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1bb40fc8b0 tx=0x7f1ba800b040 comp rx=0 tx=0).stop 2024-09-17T07:18:45.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.349+0000 7f1bbb168640 1 -- 172.21.15.87:0/477153687 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1bb40ff680 msgr2=0x7f1bb40fb040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:18:45.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.349+0000 7f1bbb168640 1 --2- 172.21.15.87:0/477153687 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1bb40ff680 0x7f1bb40fb040 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f1ba00043d0 tx=0x7f1ba0009da0 comp rx=0 tx=0).stop 2024-09-17T07:18:45.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.349+0000 7f1bbb168640 1 -- 172.21.15.87:0/477153687 shutdown_connections 2024-09-17T07:18:45.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.349+0000 7f1bbb168640 1 --2- 172.21.15.87:0/477153687 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1bb40ff680 0x7f1bb40fb040 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:45.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.349+0000 7f1bbb168640 1 --2- 172.21.15.87:0/477153687 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f1ba406ed60 0x7f1ba4071210 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:45.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.349+0000 7f1bbb168640 1 --2- 172.21.15.87:0/477153687 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1bb4065c40 0x7f1bb40fcb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:45.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.349+0000 7f1bbb168640 1 -- 172.21.15.87:0/477153687 >> 172.21.15.87:0/477153687 conn(0x7f1bb40f6c10 msgr2=0x7f1bb40f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:18:45.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.349+0000 7f1bbb168640 1 -- 172.21.15.87:0/477153687 shutdown_connections 2024-09-17T07:18:45.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.349+0000 7f1bbb168640 1 -- 172.21.15.87:0/477153687 wait complete. 2024-09-17T07:18:45.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.432+0000 7efd42f13640 1 -- 172.21.15.87:0/3150278673 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd3c065b80 msgr2=0x7efd3c0ff200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:18:45.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.432+0000 7efd42f13640 1 --2- 172.21.15.87:0/3150278673 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd3c065b80 0x7efd3c0ff200 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7efd300048d0 tx=0x7efd30009da0 comp rx=0 tx=0).stop 2024-09-17T07:18:45.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.432+0000 7efd42f13640 1 -- 172.21.15.87:0/3150278673 shutdown_connections 2024-09-17T07:18:45.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.432+0000 7efd42f13640 1 --2- 172.21.15.87:0/3150278673 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efd3c0ff740 0x7efd3c101b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:45.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.432+0000 7efd42f13640 1 --2- 172.21.15.87:0/3150278673 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd3c065b80 0x7efd3c0ff200 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:45.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.432+0000 7efd42f13640 1 -- 172.21.15.87:0/3150278673 >> 172.21.15.87:0/3150278673 conn(0x7efd3c0f6c10 msgr2=0x7efd3c0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:18:45.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.432+0000 7efd42f13640 1 -- 172.21.15.87:0/3150278673 shutdown_connections 2024-09-17T07:18:45.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.432+0000 7efd42f13640 1 -- 172.21.15.87:0/3150278673 wait complete. 2024-09-17T07:18:45.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.433+0000 7efd42f13640 1 Processor -- start 2024-09-17T07:18:45.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.433+0000 7efd42f13640 1 -- start start 2024-09-17T07:18:45.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.433+0000 7efd42f13640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd3c065b80 0x7efd3c10cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:18:45.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.433+0000 7efd42f13640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efd3c0ff740 0x7efd3c10d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:18:45.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.433+0000 7efd42f13640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd3c10db60 con 0x7efd3c065b80 2024-09-17T07:18:45.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.433+0000 7efd42f13640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd3c10e380 con 0x7efd3c0ff740 2024-09-17T07:18:45.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.433+0000 7efd40caf640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd3c065b80 0x7efd3c10cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:18:45.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.433+0000 7efd40caf640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd3c065b80 0x7efd3c10cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33030/0 (socket says 172.21.15.87:33030) 2024-09-17T07:18:45.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.433+0000 7efd40caf640 1 -- 172.21.15.87:0/783857372 learned_addr learned my addr 172.21.15.87:0/783857372 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:18:45.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.433+0000 7efd3bfff640 1 --2- 172.21.15.87:0/783857372 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efd3c0ff740 0x7efd3c10d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:18:45.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.434+0000 7efd40caf640 1 -- 172.21.15.87:0/783857372 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efd3c0ff740 msgr2=0x7efd3c10d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:18:45.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.434+0000 7efd40caf640 1 --2- 172.21.15.87:0/783857372 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efd3c0ff740 0x7efd3c10d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:45.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.434+0000 7efd40caf640 1 -- 172.21.15.87:0/783857372 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd30005040 con 0x7efd3c065b80 2024-09-17T07:18:45.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.434+0000 7efd3bfff640 1 --2- 172.21.15.87:0/783857372 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efd3c0ff740 0x7efd3c10d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T07:18:45.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.434+0000 7efd40caf640 1 --2- 172.21.15.87:0/783857372 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd3c065b80 0x7efd3c10cfd0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7efd30009ac0 tx=0x7efd30009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:18:45.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.434+0000 7efd397fa640 1 -- 172.21.15.87:0/783857372 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd30038070 con 0x7efd3c065b80 2024-09-17T07:18:45.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.434+0000 7efd397fa640 1 -- 172.21.15.87:0/783857372 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7efd300096c0 con 0x7efd3c065b80 2024-09-17T07:18:45.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.434+0000 7efd397fa640 1 -- 172.21.15.87:0/783857372 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd3003d420 con 0x7efd3c065b80 2024-09-17T07:18:45.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.434+0000 7efd42f13640 1 -- 172.21.15.87:0/783857372 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd3c10e5b0 con 0x7efd3c065b80 2024-09-17T07:18:45.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.434+0000 7efd42f13640 1 -- 172.21.15.87:0/783857372 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd3c10ea10 con 0x7efd3c065b80 2024-09-17T07:18:45.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.436+0000 7efd42f13640 1 -- 172.21.15.87:0/783857372 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd3c0fa890 con 0x7efd3c065b80 2024-09-17T07:18:45.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.437+0000 7efd397fa640 1 -- 172.21.15.87:0/783857372 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7efd30030020 con 0x7efd3c065b80 2024-09-17T07:18:45.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.438+0000 7efd397fa640 1 --2- 172.21.15.87:0/783857372 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7efd2c06ed60 0x7efd2c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:18:45.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.438+0000 7efd397fa640 1 -- 172.21.15.87:0/783857372 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7efd300ae7e0 con 0x7efd3c065b80 2024-09-17T07:18:45.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.438+0000 7efd3bfff640 1 --2- 172.21.15.87:0/783857372 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7efd2c06ed60 0x7efd2c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:18:45.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.439+0000 7efd3bfff640 1 --2- 172.21.15.87:0/783857372 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7efd2c06ed60 0x7efd2c071210 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7efd28004fd0 tx=0x7efd2800b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:18:45.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.442+0000 7efd397fa640 1 -- 172.21.15.87:0/783857372 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7efd3007b8d0 con 0x7efd3c065b80 2024-09-17T07:18:45.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.715+0000 7efd42f13640 1 -- 172.21.15.87:0/783857372 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7efd3c04b720 con 0x7efd3c065b80 2024-09-17T07:18:45.716 INFO:teuthology.orchestra.run.smithi087.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T07:18:45.716 INFO:teuthology.orchestra.run.smithi087.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T07:18:45.716 INFO:teuthology.orchestra.run.smithi087.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T07:18:45.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.716+0000 7efd397fa640 1 -- 172.21.15.87:0/783857372 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7efd3007b270 con 0x7efd3c065b80 2024-09-17T07:18:45.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.718+0000 7efd42f13640 1 -- 172.21.15.87:0/783857372 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7efd2c06ed60 msgr2=0x7efd2c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:18:45.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.718+0000 7efd42f13640 1 --2- 172.21.15.87:0/783857372 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7efd2c06ed60 0x7efd2c071210 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7efd28004fd0 tx=0x7efd2800b040 comp rx=0 tx=0).stop 2024-09-17T07:18:45.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.718+0000 7efd42f13640 1 -- 172.21.15.87:0/783857372 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd3c065b80 msgr2=0x7efd3c10cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:18:45.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.718+0000 7efd42f13640 1 --2- 172.21.15.87:0/783857372 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd3c065b80 0x7efd3c10cfd0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7efd30009ac0 tx=0x7efd30009da0 comp rx=0 tx=0).stop 2024-09-17T07:18:45.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.718+0000 7efd42f13640 1 -- 172.21.15.87:0/783857372 shutdown_connections 2024-09-17T07:18:45.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.718+0000 7efd42f13640 1 --2- 172.21.15.87:0/783857372 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7efd2c06ed60 0x7efd2c071210 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:45.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.718+0000 7efd42f13640 1 --2- 172.21.15.87:0/783857372 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efd3c0ff740 0x7efd3c10d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:45.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.718+0000 7efd42f13640 1 --2- 172.21.15.87:0/783857372 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd3c065b80 0x7efd3c10cfd0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:18:45.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.718+0000 7efd42f13640 1 -- 172.21.15.87:0/783857372 >> 172.21.15.87:0/783857372 conn(0x7efd3c0f6c10 msgr2=0x7efd3c0f8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:18:45.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.718+0000 7efd42f13640 1 -- 172.21.15.87:0/783857372 shutdown_connections 2024-09-17T07:18:45.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:18:45.718+0000 7efd42f13640 1 -- 172.21.15.87:0/783857372 wait complete. 2024-09-17T07:18:46.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:18:45 smithi139 ceph-mon[34403]: from='client.24319 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:18:46.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:18:45 smithi139 ceph-mon[34403]: pgmap v216: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:18:46.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:18:45 smithi139 ceph-mon[34403]: from='client.? 172.21.15.87:0/2540494867' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:18:46.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:18:45 smithi139 ceph-mon[34403]: from='client.? 172.21.15.87:0/1606762487' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T07:18:46.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:18:45 smithi139 ceph-mon[34403]: from='client.14606 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:18:46.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:18:45 smithi087 ceph-mon[27636]: from='client.24319 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:18:46.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:18:45 smithi087 ceph-mon[27636]: pgmap v216: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:18:46.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:18:45 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/2540494867' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:18:46.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:18:45 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/1606762487' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T07:18:46.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:18:45 smithi087 ceph-mon[27636]: from='client.14606 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:18:47.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:18:46 smithi139 ceph-mon[34403]: from='client.? 172.21.15.87:0/783857372' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T07:18:47.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:18:46 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/783857372' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T07:18:48.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:18:47 smithi139 ceph-mon[34403]: pgmap v217: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:18:48.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:18:47 smithi087 ceph-mon[27636]: pgmap v217: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:18:50.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:18:49 smithi139 ceph-mon[34403]: pgmap v218: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:18:50.118 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:18:49 smithi087 ceph-mon[27636]: pgmap v218: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:18:52.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:18:51 smithi139 ceph-mon[34403]: pgmap v219: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:18:52.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:18:51 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:18:52.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:18:51 smithi087 ceph-mon[27636]: pgmap v219: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:18:52.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:18:51 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:18:54.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:18:53 smithi139 ceph-mon[34403]: pgmap v220: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:18:54.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:18:53 smithi087 ceph-mon[27636]: pgmap v220: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:18:56.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:18:55 smithi139 ceph-mon[34403]: pgmap v221: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:18:56.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:18:55 smithi087 ceph-mon[27636]: pgmap v221: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:18:57.515 INFO:tasks.workunit.client.0.smithi087.stderr:Note: switching to '1cbdc9211df088cccbd94423c7cf3a2b85fe432b'. 2024-09-17T07:18:57.515 INFO:tasks.workunit.client.0.smithi087.stderr: 2024-09-17T07:18:57.515 INFO:tasks.workunit.client.0.smithi087.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-17T07:18:57.515 INFO:tasks.workunit.client.0.smithi087.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-17T07:18:57.515 INFO:tasks.workunit.client.0.smithi087.stderr:state without impacting any branches by switching back to a branch. 2024-09-17T07:18:57.515 INFO:tasks.workunit.client.0.smithi087.stderr: 2024-09-17T07:18:57.515 INFO:tasks.workunit.client.0.smithi087.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-17T07:18:57.515 INFO:tasks.workunit.client.0.smithi087.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-17T07:18:57.515 INFO:tasks.workunit.client.0.smithi087.stderr: 2024-09-17T07:18:57.515 INFO:tasks.workunit.client.0.smithi087.stderr: git switch -c 2024-09-17T07:18:57.515 INFO:tasks.workunit.client.0.smithi087.stderr: 2024-09-17T07:18:57.516 INFO:tasks.workunit.client.0.smithi087.stderr:Or undo this operation with: 2024-09-17T07:18:57.516 INFO:tasks.workunit.client.0.smithi087.stderr: 2024-09-17T07:18:57.516 INFO:tasks.workunit.client.0.smithi087.stderr: git switch - 2024-09-17T07:18:57.516 INFO:tasks.workunit.client.0.smithi087.stderr: 2024-09-17T07:18:57.516 INFO:tasks.workunit.client.0.smithi087.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-17T07:18:57.516 INFO:tasks.workunit.client.0.smithi087.stderr: 2024-09-17T07:18:57.516 INFO:tasks.workunit.client.0.smithi087.stderr:HEAD is now at 1cbdc9211df Merge pull request #56819 from cbodley/wip-65410-reef 2024-09-17T07:18:57.521 DEBUG:teuthology.orchestra.run.smithi087:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-17T07:18:57.542 INFO:tasks.workunit.client.0.smithi087.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-17T07:18:57.544 INFO:tasks.workunit.client.0.smithi087.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-17T07:18:57.544 INFO:tasks.workunit.client.0.smithi087.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-17T07:18:58.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:18:57 smithi139 ceph-mon[34403]: pgmap v222: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:18:58.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:18:57 smithi087 ceph-mon[27636]: pgmap v222: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:18:58.273 INFO:tasks.workunit.client.0.smithi087.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-17T07:18:58.346 INFO:tasks.workunit.client.0.smithi087.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-17T07:18:58.387 INFO:tasks.workunit.client.0.smithi087.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-17T07:18:58.388 INFO:tasks.workunit.client.0.smithi087.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-17T07:18:58.388 INFO:tasks.workunit.client.0.smithi087.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-17T07:18:58.428 INFO:tasks.workunit.client.0.smithi087.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-17T07:18:58.431 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-17T07:18:58.431 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-17T07:18:58.487 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-09-17T07:18:58.489 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-17T07:18:58.489 DEBUG:teuthology.orchestra.run.smithi087:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1cbdc9211df088cccbd94423c7cf3a2b85fe432b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-09-17T07:18:58.553 INFO:tasks.workunit.client.0.smithi087.stderr:+ mkdir -p fsstress 2024-09-17T07:18:58.555 INFO:tasks.workunit.client.0.smithi087.stderr:+ pushd fsstress 2024-09-17T07:18:58.557 INFO:tasks.workunit.client.0.smithi087.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-17T07:18:58.557 INFO:tasks.workunit.client.0.smithi087.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-17T07:18:59.078 INFO:tasks.workunit.client.0.smithi087.stderr:+ tar xzf ltp-full.tgz 2024-09-17T07:18:59.977 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:18:59 smithi087 ceph-mon[27636]: pgmap v223: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:19:00.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:18:59 smithi139 ceph-mon[34403]: pgmap v223: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:19:00.229 INFO:tasks.workunit.client.1.smithi139.stderr:Updating files: 79% (10305/12893) Updating files: 80% (10315/12893) Updating files: 81% (10444/12893) Updating files: 82% (10573/12893) Updating files: 83% (10702/12893) Updating files: 84% (10831/12893) Updating files: 85% (10960/12893) Updating files: 86% (11088/12893) Updating files: 87% (11217/12893) Updating files: 88% (11346/12893) Updating files: 89% (11475/12893) Updating files: 90% (11604/12893) Updating files: 91% (11733/12893) Updating files: 92% (11862/12893) Updating files: 93% (11991/12893) Updating files: 94% (12120/12893) Updating files: 95% (12249/12893) Updating files: 96% (12378/12893) Updating files: 97% (12507/12893) Updating files: 98% (12636/12893) Updating files: 99% (12765/12893) Updating files: 100% (12893/12893) Updating files: 100% (12893/12893), done. 2024-09-17T07:19:00.988 INFO:tasks.workunit.client.1.smithi139.stderr:Note: switching to '1cbdc9211df088cccbd94423c7cf3a2b85fe432b'. 2024-09-17T07:19:00.988 INFO:tasks.workunit.client.1.smithi139.stderr: 2024-09-17T07:19:00.988 INFO:tasks.workunit.client.1.smithi139.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-17T07:19:00.988 INFO:tasks.workunit.client.1.smithi139.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-17T07:19:00.988 INFO:tasks.workunit.client.1.smithi139.stderr:state without impacting any branches by switching back to a branch. 2024-09-17T07:19:00.988 INFO:tasks.workunit.client.1.smithi139.stderr: 2024-09-17T07:19:00.988 INFO:tasks.workunit.client.1.smithi139.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-17T07:19:00.988 INFO:tasks.workunit.client.1.smithi139.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-17T07:19:00.988 INFO:tasks.workunit.client.1.smithi139.stderr: 2024-09-17T07:19:00.988 INFO:tasks.workunit.client.1.smithi139.stderr: git switch -c 2024-09-17T07:19:00.989 INFO:tasks.workunit.client.1.smithi139.stderr: 2024-09-17T07:19:00.989 INFO:tasks.workunit.client.1.smithi139.stderr:Or undo this operation with: 2024-09-17T07:19:00.989 INFO:tasks.workunit.client.1.smithi139.stderr: 2024-09-17T07:19:00.989 INFO:tasks.workunit.client.1.smithi139.stderr: git switch - 2024-09-17T07:19:00.989 INFO:tasks.workunit.client.1.smithi139.stderr: 2024-09-17T07:19:00.989 INFO:tasks.workunit.client.1.smithi139.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-17T07:19:00.989 INFO:tasks.workunit.client.1.smithi139.stderr: 2024-09-17T07:19:00.989 INFO:tasks.workunit.client.1.smithi139.stderr:HEAD is now at 1cbdc9211df Merge pull request #56819 from cbodley/wip-65410-reef 2024-09-17T07:19:00.996 DEBUG:teuthology.orchestra.run.smithi139:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-09-17T07:19:01.062 INFO:tasks.workunit.client.1.smithi139.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-17T07:19:01.065 INFO:tasks.workunit.client.1.smithi139.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-17T07:19:01.065 INFO:tasks.workunit.client.1.smithi139.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-17T07:19:01.790 INFO:tasks.workunit.client.1.smithi139.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-17T07:19:01.885 INFO:tasks.workunit.client.1.smithi139.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-17T07:19:01.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:01 smithi087 ceph-mon[27636]: pgmap v224: 65 pgs: 65 active+clean; 688 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 8.6 KiB/s wr, 4 op/s 2024-09-17T07:19:01.928 INFO:tasks.workunit.client.1.smithi139.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-17T07:19:01.930 INFO:tasks.workunit.client.1.smithi139.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-17T07:19:01.930 INFO:tasks.workunit.client.1.smithi139.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-17T07:19:01.976 INFO:tasks.workunit.client.1.smithi139.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-17T07:19:01.979 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-17T07:19:01.979 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-09-17T07:19:02.038 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-09-17T07:19:02.039 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-17T07:19:02.039 DEBUG:teuthology.orchestra.run.smithi139:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1cbdc9211df088cccbd94423c7cf3a2b85fe432b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-09-17T07:19:02.106 INFO:tasks.workunit.client.1.smithi139.stderr:+ mkdir -p fsstress 2024-09-17T07:19:02.108 INFO:tasks.workunit.client.1.smithi139.stderr:+ pushd fsstress 2024-09-17T07:19:02.110 INFO:tasks.workunit.client.1.smithi139.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-17T07:19:02.110 INFO:tasks.workunit.client.1.smithi139.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-17T07:19:02.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:01 smithi139 ceph-mon[34403]: pgmap v224: 65 pgs: 65 active+clean; 688 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 8.6 KiB/s wr, 4 op/s 2024-09-17T07:19:02.708 INFO:tasks.workunit.client.1.smithi139.stderr:+ tar xzf ltp-full.tgz 2024-09-17T07:19:03.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:03 smithi139 ceph-mon[34403]: pgmap v225: 65 pgs: 65 active+clean; 10 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 84 KiB/s rd, 811 KiB/s wr, 27 op/s 2024-09-17T07:19:04.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:03 smithi087 ceph-mon[27636]: pgmap v225: 65 pgs: 65 active+clean; 10 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 84 KiB/s rd, 811 KiB/s wr, 27 op/s 2024-09-17T07:19:05.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:05 smithi087 ceph-mon[27636]: pgmap v226: 65 pgs: 65 active+clean; 22 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 83 KiB/s rd, 1.8 MiB/s wr, 47 op/s 2024-09-17T07:19:05.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:05 smithi087 ceph-mon[27636]: Upgrade: Updating mgr.smithi139.tuqnpn 2024-09-17T07:19:05.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:05 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:19:05.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:05 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi139.tuqnpn", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T07:19:05.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:05 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T07:19:05.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:05 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:19:05.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:05 smithi087 ceph-mon[27636]: Deploying daemon mgr.smithi139.tuqnpn on smithi139 2024-09-17T07:19:06.096 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:05 smithi139 ceph-mon[34403]: pgmap v226: 65 pgs: 65 active+clean; 22 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 83 KiB/s rd, 1.8 MiB/s wr, 47 op/s 2024-09-17T07:19:06.096 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:05 smithi139 ceph-mon[34403]: Upgrade: Updating mgr.smithi139.tuqnpn 2024-09-17T07:19:06.096 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:05 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:19:06.096 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:05 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi139.tuqnpn", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T07:19:06.096 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:05 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T07:19:06.096 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:05 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:19:06.096 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:05 smithi139 ceph-mon[34403]: Deploying daemon mgr.smithi139.tuqnpn on smithi139 2024-09-17T07:19:06.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:06 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:19:06.952 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:06 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:19:07.923 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:07 smithi139 ceph-mon[34403]: pgmap v227: 65 pgs: 65 active+clean; 32 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 343 KiB/s rd, 2.6 MiB/s wr, 91 op/s 2024-09-17T07:19:07.924 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:07 smithi139 ceph-mon[34403]: fsmap cephfs:2 {0=cephfs.smithi087.tjhpcs=up:active,1=cephfs.smithi139.gnwonz=up:active} 2 up:standby-replay 2024-09-17T07:19:07.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:07 smithi087 ceph-mon[27636]: pgmap v227: 65 pgs: 65 active+clean; 32 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 343 KiB/s rd, 2.6 MiB/s wr, 91 op/s 2024-09-17T07:19:07.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:07 smithi087 ceph-mon[27636]: fsmap cephfs:2 {0=cephfs.smithi087.tjhpcs=up:active,1=cephfs.smithi139.gnwonz=up:active} 2 up:standby-replay 2024-09-17T07:19:09.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:09 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:19:09.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:09 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:19:09.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:09 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:19:09.704 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:09 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:19:09.704 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:09 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:19:09.704 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:09 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:19:10.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:10 smithi087 ceph-mon[27636]: pgmap v228: 65 pgs: 65 active+clean; 40 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 706 KiB/s rd, 3.4 MiB/s wr, 138 op/s 2024-09-17T07:19:10.774 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:10 smithi139 ceph-mon[34403]: pgmap v228: 65 pgs: 65 active+clean; 40 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 706 KiB/s rd, 3.4 MiB/s wr, 138 op/s 2024-09-17T07:19:12.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:12 smithi139 ceph-mon[34403]: pgmap v229: 65 pgs: 65 active+clean; 42 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 706 KiB/s rd, 3.5 MiB/s wr, 145 op/s 2024-09-17T07:19:12.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:12 smithi087 ceph-mon[27636]: pgmap v229: 65 pgs: 65 active+clean; 42 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 706 KiB/s rd, 3.5 MiB/s wr, 145 op/s 2024-09-17T07:19:14.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:14 smithi139 ceph-mon[34403]: pgmap v230: 65 pgs: 65 active+clean; 60 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 5.0 MiB/s wr, 200 op/s 2024-09-17T07:19:14.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:14 smithi139 ceph-mon[34403]: Standby manager daemon smithi139.tuqnpn restarted 2024-09-17T07:19:14.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:14 smithi139 ceph-mon[34403]: Standby manager daemon smithi139.tuqnpn started 2024-09-17T07:19:14.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:14 smithi139 ceph-mon[34403]: from='mgr.? 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi139.tuqnpn/crt"}]: dispatch 2024-09-17T07:19:14.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:14 smithi139 ceph-mon[34403]: from='mgr.? 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T07:19:14.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:14 smithi139 ceph-mon[34403]: from='mgr.? 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi139.tuqnpn/key"}]: dispatch 2024-09-17T07:19:14.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:14 smithi139 ceph-mon[34403]: from='mgr.? 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T07:19:14.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:14 smithi087 ceph-mon[27636]: pgmap v230: 65 pgs: 65 active+clean; 60 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 5.0 MiB/s wr, 200 op/s 2024-09-17T07:19:14.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:14 smithi087 ceph-mon[27636]: Standby manager daemon smithi139.tuqnpn restarted 2024-09-17T07:19:14.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:14 smithi087 ceph-mon[27636]: Standby manager daemon smithi139.tuqnpn started 2024-09-17T07:19:14.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:14 smithi087 ceph-mon[27636]: from='mgr.? 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi139.tuqnpn/crt"}]: dispatch 2024-09-17T07:19:14.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:14 smithi087 ceph-mon[27636]: from='mgr.? 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T07:19:14.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:14 smithi087 ceph-mon[27636]: from='mgr.? 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi139.tuqnpn/key"}]: dispatch 2024-09-17T07:19:14.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:14 smithi087 ceph-mon[27636]: from='mgr.? 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T07:19:15.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:15 smithi139 ceph-mon[34403]: mgrmap e20: smithi087.vuvjer(active, since 6m), standbys: smithi139.tuqnpn 2024-09-17T07:19:15.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:15 smithi139 ceph-mon[34403]: pgmap v231: 65 pgs: 65 active+clean; 73 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 2.3 MiB/s rd, 5.3 MiB/s wr, 206 op/s 2024-09-17T07:19:15.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:15 smithi087 ceph-mon[27636]: mgrmap e20: smithi087.vuvjer(active, since 6m), standbys: smithi139.tuqnpn 2024-09-17T07:19:15.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:15 smithi087 ceph-mon[27636]: pgmap v231: 65 pgs: 65 active+clean; 73 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 2.3 MiB/s rd, 5.3 MiB/s wr, 206 op/s 2024-09-17T07:19:15.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:15.825+0000 7eff0e0e0640 1 -- 172.21.15.87:0/1217520261 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff080fb430 msgr2=0x7eff080fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:19:15.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:15.825+0000 7eff0e0e0640 1 --2- 172.21.15.87:0/1217520261 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff080fb430 0x7eff080fb840 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7efef80048d0 tx=0x7efef8009da0 comp rx=0 tx=0).stop 2024-09-17T07:19:15.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:15.825+0000 7eff0e0e0640 1 -- 172.21.15.87:0/1217520261 shutdown_connections 2024-09-17T07:19:15.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:15.825+0000 7eff0e0e0640 1 --2- 172.21.15.87:0/1217520261 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7eff080fc700 0x7eff080fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:15.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:15.825+0000 7eff0e0e0640 1 --2- 172.21.15.87:0/1217520261 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff080fb430 0x7eff080fb840 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:15.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:15.825+0000 7eff0e0e0640 1 -- 172.21.15.87:0/1217520261 >> 172.21.15.87:0/1217520261 conn(0x7eff080f6c10 msgr2=0x7eff080f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:19:15.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:15.825+0000 7eff0e0e0640 1 -- 172.21.15.87:0/1217520261 shutdown_connections 2024-09-17T07:19:15.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:15.826+0000 7eff0e0e0640 1 -- 172.21.15.87:0/1217520261 wait complete. 2024-09-17T07:19:15.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:15.826+0000 7eff0e0e0640 1 Processor -- start 2024-09-17T07:19:15.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:15.826+0000 7eff0e0e0640 1 -- start start 2024-09-17T07:19:15.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:15.826+0000 7eff0e0e0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7eff080fb430 0x7eff0810f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:19:15.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:15.826+0000 7eff0e0e0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff080fc700 0x7eff0810f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:19:15.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:15.827+0000 7eff0e0e0640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff0810fd20 con 0x7eff080fc700 2024-09-17T07:19:15.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:15.827+0000 7eff0e0e0640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff08110540 con 0x7eff080fb430 2024-09-17T07:19:15.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:15.827+0000 7eff06ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff080fc700 0x7eff0810f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:19:15.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:15.827+0000 7eff06ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff080fc700 0x7eff0810f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39014/0 (socket says 172.21.15.87:39014) 2024-09-17T07:19:15.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:15.827+0000 7eff06ffd640 1 -- 172.21.15.87:0/1150692026 learned_addr learned my addr 172.21.15.87:0/1150692026 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:19:15.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:15.827+0000 7eff077fe640 1 --2- 172.21.15.87:0/1150692026 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7eff080fb430 0x7eff0810f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:19:15.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:15.827+0000 7eff06ffd640 1 -- 172.21.15.87:0/1150692026 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7eff080fb430 msgr2=0x7eff0810f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:19:15.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:15.827+0000 7eff06ffd640 1 --2- 172.21.15.87:0/1150692026 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7eff080fb430 0x7eff0810f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:15.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:15.827+0000 7eff06ffd640 1 -- 172.21.15.87:0/1150692026 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efef8005040 con 0x7eff080fc700 2024-09-17T07:19:15.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:15.827+0000 7eff06ffd640 1 --2- 172.21.15.87:0/1150692026 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff080fc700 0x7eff0810f6d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7efefc002a80 tx=0x7efefc004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:19:15.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:15.827+0000 7efeeffff640 1 -- 172.21.15.87:0/1150692026 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efefc007c30 con 0x7eff080fc700 2024-09-17T07:19:15.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:15.828+0000 7efeeffff640 1 -- 172.21.15.87:0/1150692026 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7efefc00f040 con 0x7eff080fc700 2024-09-17T07:19:15.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:15.828+0000 7eff0e0e0640 1 -- 172.21.15.87:0/1150692026 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff081107d0 con 0x7eff080fc700 2024-09-17T07:19:15.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:15.828+0000 7efeeffff640 1 -- 172.21.15.87:0/1150692026 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efefc00d9b0 con 0x7eff080fc700 2024-09-17T07:19:15.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:15.828+0000 7eff0e0e0640 1 -- 172.21.15.87:0/1150692026 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff08110cf0 con 0x7eff080fc700 2024-09-17T07:19:15.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:15.829+0000 7eff0e0e0640 1 -- 172.21.15.87:0/1150692026 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff080fa890 con 0x7eff080fc700 2024-09-17T07:19:15.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:15.829+0000 7efeeffff640 1 -- 172.21.15.87:0/1150692026 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 20) v1 ==== 90801+0+0 (secure 0 0 0) 0x7efefc00db30 con 0x7eff080fc700 2024-09-17T07:19:15.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:15.830+0000 7efeeffff640 1 --2- 172.21.15.87:0/1150692026 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7efef006db80 0x7efef0070030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:19:15.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:15.830+0000 7efeeffff640 1 -- 172.21.15.87:0/1150692026 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7efefc08c690 con 0x7eff080fc700 2024-09-17T07:19:15.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:15.830+0000 7eff077fe640 1 --2- 172.21.15.87:0/1150692026 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7efef006db80 0x7efef0070030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:19:15.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:15.831+0000 7eff077fe640 1 --2- 172.21.15.87:0/1150692026 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7efef006db80 0x7efef0070030 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7efef8000c00 tx=0x7efef8035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:19:15.836 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:15.835+0000 7efeeffff640 1 -- 172.21.15.87:0/1150692026 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7efefc0597f0 con 0x7eff080fc700 2024-09-17T07:19:16.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.061+0000 7eff0e0e0640 1 -- 172.21.15.87:0/1150692026 --> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7eff08111020 con 0x7efef006db80 2024-09-17T07:19:16.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.063+0000 7efeeffff640 1 -- 172.21.15.87:0/1150692026 <== mgr.14208 v2:172.21.15.87:6800/611048628 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+328 (secure 0 0 0) 0x7eff08111020 con 0x7efef006db80 2024-09-17T07:19:16.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.065+0000 7eff0e0e0640 1 -- 172.21.15.87:0/1150692026 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7efef006db80 msgr2=0x7efef0070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:19:16.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.066+0000 7eff0e0e0640 1 --2- 172.21.15.87:0/1150692026 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7efef006db80 0x7efef0070030 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7efef8000c00 tx=0x7efef8035040 comp rx=0 tx=0).stop 2024-09-17T07:19:16.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.066+0000 7eff0e0e0640 1 -- 172.21.15.87:0/1150692026 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff080fc700 msgr2=0x7eff0810f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:19:16.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.066+0000 7eff0e0e0640 1 --2- 172.21.15.87:0/1150692026 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff080fc700 0x7eff0810f6d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7efefc002a80 tx=0x7efefc004600 comp rx=0 tx=0).stop 2024-09-17T07:19:16.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.066+0000 7eff0e0e0640 1 -- 172.21.15.87:0/1150692026 shutdown_connections 2024-09-17T07:19:16.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.066+0000 7eff0e0e0640 1 --2- 172.21.15.87:0/1150692026 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff080fc700 0x7eff0810f6d0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:16.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.066+0000 7eff0e0e0640 1 --2- 172.21.15.87:0/1150692026 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7efef006db80 0x7efef0070030 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:16.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.066+0000 7eff0e0e0640 1 --2- 172.21.15.87:0/1150692026 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7eff080fb430 0x7eff0810f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:16.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.066+0000 7eff0e0e0640 1 -- 172.21.15.87:0/1150692026 >> 172.21.15.87:0/1150692026 conn(0x7eff080f6c10 msgr2=0x7eff08064f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:19:16.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.066+0000 7eff0e0e0640 1 -- 172.21.15.87:0/1150692026 shutdown_connections 2024-09-17T07:19:16.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.066+0000 7eff0e0e0640 1 -- 172.21.15.87:0/1150692026 wait complete. 2024-09-17T07:19:16.077 INFO:teuthology.orchestra.run.smithi087.stdout:true 2024-09-17T07:19:16.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.182+0000 7f56859de640 1 -- 172.21.15.87:0/261211907 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56800664d0 msgr2=0x7f56800ff130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:19:16.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.182+0000 7f56859de640 1 --2- 172.21.15.87:0/261211907 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56800664d0 0x7f56800ff130 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f56700048d0 tx=0x7f5670009da0 comp rx=0 tx=0).stop 2024-09-17T07:19:16.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.183+0000 7f56859de640 1 -- 172.21.15.87:0/261211907 shutdown_connections 2024-09-17T07:19:16.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.183+0000 7f56859de640 1 --2- 172.21.15.87:0/261211907 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56800ff670 0x7f5680101a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:16.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.183+0000 7f56859de640 1 --2- 172.21.15.87:0/261211907 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56800664d0 0x7f56800ff130 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:16.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.183+0000 7f56859de640 1 -- 172.21.15.87:0/261211907 >> 172.21.15.87:0/261211907 conn(0x7f56800f6c00 msgr2=0x7f56800f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:19:16.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.183+0000 7f56859de640 1 -- 172.21.15.87:0/261211907 shutdown_connections 2024-09-17T07:19:16.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.183+0000 7f56859de640 1 -- 172.21.15.87:0/261211907 wait complete. 2024-09-17T07:19:16.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.184+0000 7f56859de640 1 Processor -- start 2024-09-17T07:19:16.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.184+0000 7f56859de640 1 -- start start 2024-09-17T07:19:16.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.184+0000 7f56859de640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56800664d0 0x7f56800fcb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:19:16.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.184+0000 7f56859de640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56800ff670 0x7f56800fb030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:19:16.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.184+0000 7f56859de640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5680110c70 con 0x7f56800ff670 2024-09-17T07:19:16.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.184+0000 7f56859de640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5680110db0 con 0x7f56800664d0 2024-09-17T07:19:16.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.185+0000 7f567effd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56800664d0 0x7f56800fcb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:19:16.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.185+0000 7f567effd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56800664d0 0x7f56800fcb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.87:57182/0 (socket says 172.21.15.87:57182) 2024-09-17T07:19:16.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.185+0000 7f567effd640 1 -- 172.21.15.87:0/3470939440 learned_addr learned my addr 172.21.15.87:0/3470939440 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:19:16.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.185+0000 7f567e7fc640 1 --2- 172.21.15.87:0/3470939440 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56800ff670 0x7f56800fb030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:19:16.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.185+0000 7f567effd640 1 -- 172.21.15.87:0/3470939440 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56800ff670 msgr2=0x7f56800fb030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:19:16.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.185+0000 7f567effd640 1 --2- 172.21.15.87:0/3470939440 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56800ff670 0x7f56800fb030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:16.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.185+0000 7f567effd640 1 -- 172.21.15.87:0/3470939440 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5670005040 con 0x7f56800664d0 2024-09-17T07:19:16.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.185+0000 7f567effd640 1 --2- 172.21.15.87:0/3470939440 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56800664d0 0x7f56800fcb40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5670009ac0 tx=0x7f5670009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:19:16.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.186+0000 7f56677fe640 1 -- 172.21.15.87:0/3470939440 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5670038070 con 0x7f56800664d0 2024-09-17T07:19:16.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.186+0000 7f56677fe640 1 -- 172.21.15.87:0/3470939440 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f5670008ed0 con 0x7f56800664d0 2024-09-17T07:19:16.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.186+0000 7f56677fe640 1 -- 172.21.15.87:0/3470939440 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5670032ba0 con 0x7f56800664d0 2024-09-17T07:19:16.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.186+0000 7f56859de640 1 -- 172.21.15.87:0/3470939440 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56800fb5d0 con 0x7f56800664d0 2024-09-17T07:19:16.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.187+0000 7f56859de640 1 -- 172.21.15.87:0/3470939440 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56800fbab0 con 0x7f56800664d0 2024-09-17T07:19:16.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.188+0000 7f56859de640 1 -- 172.21.15.87:0/3470939440 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56800fa880 con 0x7f56800664d0 2024-09-17T07:19:16.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.188+0000 7f56677fe640 1 -- 172.21.15.87:0/3470939440 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 20) v1 ==== 90801+0+0 (secure 0 0 0) 0x7f5670030020 con 0x7f56800664d0 2024-09-17T07:19:16.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.189+0000 7f56677fe640 1 --2- 172.21.15.87:0/3470939440 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f566806db70 0x7f5668070020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:19:16.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.189+0000 7f56677fe640 1 -- 172.21.15.87:0/3470939440 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f56700acb80 con 0x7f56800664d0 2024-09-17T07:19:16.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.189+0000 7f567e7fc640 1 --2- 172.21.15.87:0/3470939440 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f566806db70 0x7f5668070020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:19:16.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.189+0000 7f567e7fc640 1 --2- 172.21.15.87:0/3470939440 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f566806db70 0x7f5668070020 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5674009af0 tx=0x7f567400b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:19:16.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.193+0000 7f56677fe640 1 -- 172.21.15.87:0/3470939440 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f5670079cf0 con 0x7f56800664d0 2024-09-17T07:19:16.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.446+0000 7f56859de640 1 -- 172.21.15.87:0/3470939440 --> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5680104fa0 con 0x7f566806db70 2024-09-17T07:19:16.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.447+0000 7f56677fe640 1 -- 172.21.15.87:0/3470939440 <== mgr.14208 v2:172.21.15.87:6800/611048628 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+328 (secure 0 0 0) 0x7f5680104fa0 con 0x7f566806db70 2024-09-17T07:19:16.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.449+0000 7f56859de640 1 -- 172.21.15.87:0/3470939440 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f566806db70 msgr2=0x7f5668070020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:19:16.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.449+0000 7f56859de640 1 --2- 172.21.15.87:0/3470939440 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f566806db70 0x7f5668070020 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5674009af0 tx=0x7f567400b040 comp rx=0 tx=0).stop 2024-09-17T07:19:16.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.449+0000 7f56859de640 1 -- 172.21.15.87:0/3470939440 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56800664d0 msgr2=0x7f56800fcb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:19:16.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.449+0000 7f56859de640 1 --2- 172.21.15.87:0/3470939440 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56800664d0 0x7f56800fcb40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5670009ac0 tx=0x7f5670009da0 comp rx=0 tx=0).stop 2024-09-17T07:19:16.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.450+0000 7f56859de640 1 -- 172.21.15.87:0/3470939440 shutdown_connections 2024-09-17T07:19:16.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.450+0000 7f56859de640 1 --2- 172.21.15.87:0/3470939440 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56800ff670 0x7f56800fb030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:16.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.450+0000 7f56859de640 1 --2- 172.21.15.87:0/3470939440 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f566806db70 0x7f5668070020 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:16.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.450+0000 7f56859de640 1 --2- 172.21.15.87:0/3470939440 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56800664d0 0x7f56800fcb40 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:16.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.450+0000 7f56859de640 1 -- 172.21.15.87:0/3470939440 >> 172.21.15.87:0/3470939440 conn(0x7f56800f6c00 msgr2=0x7f56800f6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:19:16.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.450+0000 7f56859de640 1 -- 172.21.15.87:0/3470939440 shutdown_connections 2024-09-17T07:19:16.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.450+0000 7f56859de640 1 -- 172.21.15.87:0/3470939440 wait complete. 2024-09-17T07:19:16.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.541+0000 7fe1d9d53640 1 -- 172.21.15.87:0/3325852525 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1d40fb430 msgr2=0x7fe1d40fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:19:16.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.541+0000 7fe1d9d53640 1 --2- 172.21.15.87:0/3325852525 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1d40fb430 0x7fe1d40fb840 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fe1c40048d0 tx=0x7fe1c4009da0 comp rx=0 tx=0).stop 2024-09-17T07:19:16.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.541+0000 7fe1d9d53640 1 -- 172.21.15.87:0/3325852525 shutdown_connections 2024-09-17T07:19:16.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.541+0000 7fe1d9d53640 1 --2- 172.21.15.87:0/3325852525 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe1d40fc700 0x7fe1d40fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:16.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.541+0000 7fe1d9d53640 1 --2- 172.21.15.87:0/3325852525 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1d40fb430 0x7fe1d40fb840 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:16.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.541+0000 7fe1d9d53640 1 -- 172.21.15.87:0/3325852525 >> 172.21.15.87:0/3325852525 conn(0x7fe1d40f6c10 msgr2=0x7fe1d40f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:19:16.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.541+0000 7fe1d9d53640 1 -- 172.21.15.87:0/3325852525 shutdown_connections 2024-09-17T07:19:16.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.541+0000 7fe1d9d53640 1 -- 172.21.15.87:0/3325852525 wait complete. 2024-09-17T07:19:16.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.541+0000 7fe1d9d53640 1 Processor -- start 2024-09-17T07:19:16.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.542+0000 7fe1d9d53640 1 -- start start 2024-09-17T07:19:16.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.542+0000 7fe1d9d53640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1d40fb430 0x7fe1d410f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:19:16.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.542+0000 7fe1d9d53640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe1d40fc700 0x7fe1d410f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:19:16.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.542+0000 7fe1d9d53640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d410fd40 con 0x7fe1d40fb430 2024-09-17T07:19:16.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.542+0000 7fe1d9d53640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d4110560 con 0x7fe1d40fc700 2024-09-17T07:19:16.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.542+0000 7fe1d37fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1d40fb430 0x7fe1d410f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:19:16.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.542+0000 7fe1d37fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1d40fb430 0x7fe1d410f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39042/0 (socket says 172.21.15.87:39042) 2024-09-17T07:19:16.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.542+0000 7fe1d37fe640 1 -- 172.21.15.87:0/2988674405 learned_addr learned my addr 172.21.15.87:0/2988674405 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:19:16.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.542+0000 7fe1d2ffd640 1 --2- 172.21.15.87:0/2988674405 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe1d40fc700 0x7fe1d410f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:19:16.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.542+0000 7fe1d37fe640 1 -- 172.21.15.87:0/2988674405 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe1d40fc700 msgr2=0x7fe1d410f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:19:16.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.542+0000 7fe1d37fe640 1 --2- 172.21.15.87:0/2988674405 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe1d40fc700 0x7fe1d410f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:16.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.542+0000 7fe1d37fe640 1 -- 172.21.15.87:0/2988674405 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1c4005040 con 0x7fe1d40fb430 2024-09-17T07:19:16.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.543+0000 7fe1d37fe640 1 --2- 172.21.15.87:0/2988674405 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1d40fb430 0x7fe1d410f1b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fe1c4009ac0 tx=0x7fe1c4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:19:16.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.543+0000 7fe1bbfff640 1 -- 172.21.15.87:0/2988674405 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1c4038070 con 0x7fe1d40fb430 2024-09-17T07:19:16.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.543+0000 7fe1d9d53640 1 -- 172.21.15.87:0/2988674405 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1d4110790 con 0x7fe1d40fb430 2024-09-17T07:19:16.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.543+0000 7fe1bbfff640 1 -- 172.21.15.87:0/2988674405 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fe1c40096c0 con 0x7fe1d40fb430 2024-09-17T07:19:16.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.543+0000 7fe1bbfff640 1 -- 172.21.15.87:0/2988674405 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1c403d420 con 0x7fe1d40fb430 2024-09-17T07:19:16.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.543+0000 7fe1d9d53640 1 -- 172.21.15.87:0/2988674405 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1d4110d30 con 0x7fe1d40fb430 2024-09-17T07:19:16.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.544+0000 7fe1d9d53640 1 -- 172.21.15.87:0/2988674405 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1d40fa890 con 0x7fe1d40fb430 2024-09-17T07:19:16.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.545+0000 7fe1bbfff640 1 -- 172.21.15.87:0/2988674405 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 20) v1 ==== 90801+0+0 (secure 0 0 0) 0x7fe1c4030020 con 0x7fe1d40fb430 2024-09-17T07:19:16.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.545+0000 7fe1bbfff640 1 --2- 172.21.15.87:0/2988674405 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fe1bc06dab0 0x7fe1bc06ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:19:16.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.545+0000 7fe1bbfff640 1 -- 172.21.15.87:0/2988674405 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fe1c40ad370 con 0x7fe1d40fb430 2024-09-17T07:19:16.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.545+0000 7fe1d2ffd640 1 --2- 172.21.15.87:0/2988674405 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fe1bc06dab0 0x7fe1bc06ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:19:16.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.546+0000 7fe1d2ffd640 1 --2- 172.21.15.87:0/2988674405 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fe1bc06dab0 0x7fe1bc06ff60 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe1d410ef60 tx=0x7fe1c800b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:19:16.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.550+0000 7fe1bbfff640 1 -- 172.21.15.87:0/2988674405 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fe1c407a440 con 0x7fe1d40fb430 2024-09-17T07:19:16.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:16 smithi087 ceph-mon[27636]: from='client.14618 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:19:16.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.752+0000 7fe1d9d53640 1 -- 172.21.15.87:0/2988674405 --> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe1d4111080 con 0x7fe1bc06dab0 2024-09-17T07:19:16.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.763+0000 7fe1bbfff640 1 -- 172.21.15.87:0/2988674405 <== mgr.14208 v2:172.21.15.87:6800/611048628 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3542 (secure 0 0 0) 0x7fe1d4111080 con 0x7fe1bc06dab0 2024-09-17T07:19:16.764 INFO:teuthology.orchestra.run.smithi087.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T07:19:16.764 INFO:teuthology.orchestra.run.smithi087.stdout:alertmanager.smithi087 smithi087 *:9093,9094 running (5m) 94s ago 7m 25.5M - 0.25.0 c8568f914cd2 3495eb97bded 2024-09-17T07:19:16.764 INFO:teuthology.orchestra.run.smithi087.stdout:crash.smithi087 smithi087 running (7m) 94s ago 7m 6891k - 17.2.7-1635-g4a704134 f22ead590bad d9aaf9839ada 2024-09-17T07:19:16.765 INFO:teuthology.orchestra.run.smithi087.stdout:crash.smithi139 smithi139 running (6m) 99s ago 6m 6895k - 17.2.7-1635-g4a704134 f22ead590bad 354c853b318f 2024-09-17T07:19:16.765 INFO:teuthology.orchestra.run.smithi087.stdout:grafana.smithi087 smithi087 *:3000 running (5m) 94s ago 7m 87.3M - 9.4.7 954c08fa6188 738589686a89 2024-09-17T07:19:16.765 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi087.tjhpcs smithi087 running (111s) 94s ago 110s 15.5M - 17.2.7-1635-g4a704134 f22ead590bad f7142ad971ed 2024-09-17T07:19:16.765 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi087.vvbzss smithi087 running (117s) 94s ago 117s 11.6M - 17.2.7-1635-g4a704134 f22ead590bad 2dd82ff293d1 2024-09-17T07:19:16.765 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi139.ftvinf smithi139 running (108s) 99s ago 108s 14.8M - 17.2.7-1635-g4a704134 f22ead590bad d11edb295ad3 2024-09-17T07:19:16.765 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi139.gnwonz smithi139 running (115s) 99s ago 114s 17.4M - 17.2.7-1635-g4a704134 f22ead590bad 3b3d884aef02 2024-09-17T07:19:16.765 INFO:teuthology.orchestra.run.smithi087.stdout:mgr.smithi087.vuvjer smithi087 *:9283,8765,8443 running (8m) 94s ago 8m 449M - 17.2.7-1635-g4a704134 f22ead590bad 11130bf9b46c 2024-09-17T07:19:16.765 INFO:teuthology.orchestra.run.smithi087.stdout:mgr.smithi139.tuqnpn smithi139 *:8443,9283 starting - - - - 2024-09-17T07:19:16.765 INFO:teuthology.orchestra.run.smithi087.stdout:mon.smithi087 smithi087 running (8m) 94s ago 8m 49.9M 2048M 17.2.7-1635-g4a704134 f22ead590bad 175785e1fb86 2024-09-17T07:19:16.765 INFO:teuthology.orchestra.run.smithi087.stdout:mon.smithi139 smithi139 running (6m) 99s ago 6m 44.8M 2048M 17.2.7-1635-g4a704134 f22ead590bad a9a2552dc411 2024-09-17T07:19:16.765 INFO:teuthology.orchestra.run.smithi087.stdout:node-exporter.smithi087 smithi087 *:9100 running (7m) 94s ago 7m 14.4M - 1.5.0 0da6a335fe13 3e2035b992bc 2024-09-17T07:19:16.765 INFO:teuthology.orchestra.run.smithi087.stdout:node-exporter.smithi139 smithi139 *:9100 running (6m) 99s ago 6m 15.3M - 1.5.0 0da6a335fe13 291c1abbb415 2024-09-17T07:19:16.765 INFO:teuthology.orchestra.run.smithi087.stdout:osd.0 smithi087 running (5m) 94s ago 5m 45.2M 4288M 17.2.7-1635-g4a704134 f22ead590bad 396801f9b539 2024-09-17T07:19:16.766 INFO:teuthology.orchestra.run.smithi087.stdout:osd.1 smithi087 running (5m) 94s ago 5m 45.5M 4288M 17.2.7-1635-g4a704134 f22ead590bad 9446985bfcd1 2024-09-17T07:19:16.766 INFO:teuthology.orchestra.run.smithi087.stdout:osd.2 smithi087 running (4m) 94s ago 4m 44.9M 4288M 17.2.7-1635-g4a704134 f22ead590bad 8fe1428a6878 2024-09-17T07:19:16.766 INFO:teuthology.orchestra.run.smithi087.stdout:osd.3 smithi139 running (4m) 99s ago 4m 44.5M 5312M 17.2.7-1635-g4a704134 f22ead590bad 0801999b17c4 2024-09-17T07:19:16.766 INFO:teuthology.orchestra.run.smithi087.stdout:osd.4 smithi139 running (3m) 99s ago 3m 42.2M 5312M 17.2.7-1635-g4a704134 f22ead590bad 299a8dfc47f5 2024-09-17T07:19:16.766 INFO:teuthology.orchestra.run.smithi087.stdout:osd.5 smithi139 running (3m) 99s ago 3m 42.9M 5312M 17.2.7-1635-g4a704134 f22ead590bad 609cf74f32e7 2024-09-17T07:19:16.766 INFO:teuthology.orchestra.run.smithi087.stdout:prometheus.smithi087 smithi087 *:9095 running (5m) 94s ago 6m 52.1M - 2.43.0 a07b618ecd1d 2c4f73cf5937 2024-09-17T07:19:16.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.765+0000 7fe1d9d53640 1 -- 172.21.15.87:0/2988674405 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fe1bc06dab0 msgr2=0x7fe1bc06ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:19:16.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.765+0000 7fe1d9d53640 1 --2- 172.21.15.87:0/2988674405 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fe1bc06dab0 0x7fe1bc06ff60 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe1d410ef60 tx=0x7fe1c800b040 comp rx=0 tx=0).stop 2024-09-17T07:19:16.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.765+0000 7fe1d9d53640 1 -- 172.21.15.87:0/2988674405 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1d40fb430 msgr2=0x7fe1d410f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:19:16.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.765+0000 7fe1d9d53640 1 --2- 172.21.15.87:0/2988674405 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1d40fb430 0x7fe1d410f1b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fe1c4009ac0 tx=0x7fe1c4009da0 comp rx=0 tx=0).stop 2024-09-17T07:19:16.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.765+0000 7fe1d9d53640 1 -- 172.21.15.87:0/2988674405 shutdown_connections 2024-09-17T07:19:16.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.765+0000 7fe1d9d53640 1 --2- 172.21.15.87:0/2988674405 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fe1bc06dab0 0x7fe1bc06ff60 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:16.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.765+0000 7fe1d9d53640 1 --2- 172.21.15.87:0/2988674405 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe1d40fc700 0x7fe1d410f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:16.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.765+0000 7fe1d9d53640 1 --2- 172.21.15.87:0/2988674405 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1d40fb430 0x7fe1d410f1b0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:16.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.765+0000 7fe1d9d53640 1 -- 172.21.15.87:0/2988674405 >> 172.21.15.87:0/2988674405 conn(0x7fe1d40f6c10 msgr2=0x7fe1d4064f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:19:16.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.766+0000 7fe1d9d53640 1 -- 172.21.15.87:0/2988674405 shutdown_connections 2024-09-17T07:19:16.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.766+0000 7fe1d9d53640 1 -- 172.21.15.87:0/2988674405 wait complete. 2024-09-17T07:19:16.868 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:16 smithi139 ceph-mon[34403]: from='client.14618 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:19:16.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.867+0000 7fec62590640 1 -- 172.21.15.87:0/2741491844 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec5c065be0 msgr2=0x7fec5c0ff1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:19:16.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.867+0000 7fec62590640 1 --2- 172.21.15.87:0/2741491844 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec5c065be0 0x7fec5c0ff1a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fec4c0048d0 tx=0x7fec4c009da0 comp rx=0 tx=0).stop 2024-09-17T07:19:16.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.867+0000 7fec62590640 1 -- 172.21.15.87:0/2741491844 shutdown_connections 2024-09-17T07:19:16.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.867+0000 7fec62590640 1 --2- 172.21.15.87:0/2741491844 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fec5c0ff6e0 0x7fec5c101ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:16.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.867+0000 7fec62590640 1 --2- 172.21.15.87:0/2741491844 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec5c065be0 0x7fec5c0ff1a0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:16.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.867+0000 7fec62590640 1 -- 172.21.15.87:0/2741491844 >> 172.21.15.87:0/2741491844 conn(0x7fec5c0f6c10 msgr2=0x7fec5c0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:19:16.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.868+0000 7fec62590640 1 -- 172.21.15.87:0/2741491844 shutdown_connections 2024-09-17T07:19:16.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.868+0000 7fec62590640 1 -- 172.21.15.87:0/2741491844 wait complete. 2024-09-17T07:19:16.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.868+0000 7fec62590640 1 Processor -- start 2024-09-17T07:19:16.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.869+0000 7fec62590640 1 -- start start 2024-09-17T07:19:16.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.869+0000 7fec62590640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fec5c065be0 0x7fec5c10f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:19:16.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.869+0000 7fec62590640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec5c0ff6e0 0x7fec5c10f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:19:16.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.869+0000 7fec62590640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec5c10fd80 con 0x7fec5c0ff6e0 2024-09-17T07:19:16.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.869+0000 7fec62590640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec5c1105a0 con 0x7fec5c065be0 2024-09-17T07:19:16.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.869+0000 7fec5bfff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fec5c065be0 0x7fec5c10f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:19:16.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.869+0000 7fec5b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec5c0ff6e0 0x7fec5c10f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:19:16.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.869+0000 7fec5b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec5c0ff6e0 0x7fec5c10f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39062/0 (socket says 172.21.15.87:39062) 2024-09-17T07:19:16.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.869+0000 7fec5b7fe640 1 -- 172.21.15.87:0/1111477134 learned_addr learned my addr 172.21.15.87:0/1111477134 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:19:16.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.870+0000 7fec5b7fe640 1 -- 172.21.15.87:0/1111477134 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fec5c065be0 msgr2=0x7fec5c10f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:19:16.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.870+0000 7fec5b7fe640 1 --2- 172.21.15.87:0/1111477134 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fec5c065be0 0x7fec5c10f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:16.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.870+0000 7fec5b7fe640 1 -- 172.21.15.87:0/1111477134 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec4c005040 con 0x7fec5c0ff6e0 2024-09-17T07:19:16.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.870+0000 7fec5bfff640 1 --2- 172.21.15.87:0/1111477134 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fec5c065be0 0x7fec5c10f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T07:19:16.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.870+0000 7fec5b7fe640 1 --2- 172.21.15.87:0/1111477134 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec5c0ff6e0 0x7fec5c10f730 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fec5000eb70 tx=0x7fec5000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:19:16.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.871+0000 7fec58ff9640 1 -- 172.21.15.87:0/1111477134 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec50007c30 con 0x7fec5c0ff6e0 2024-09-17T07:19:16.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.871+0000 7fec62590640 1 -- 172.21.15.87:0/1111477134 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec5c1107d0 con 0x7fec5c0ff6e0 2024-09-17T07:19:16.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.871+0000 7fec62590640 1 -- 172.21.15.87:0/1111477134 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec5c110cf0 con 0x7fec5c0ff6e0 2024-09-17T07:19:16.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.871+0000 7fec58ff9640 1 -- 172.21.15.87:0/1111477134 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fec5000f040 con 0x7fec5c0ff6e0 2024-09-17T07:19:16.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.871+0000 7fec58ff9640 1 -- 172.21.15.87:0/1111477134 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec50009310 con 0x7fec5c0ff6e0 2024-09-17T07:19:16.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.873+0000 7fec62590640 1 -- 172.21.15.87:0/1111477134 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec48005240 con 0x7fec5c0ff6e0 2024-09-17T07:19:16.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.873+0000 7fec58ff9640 1 -- 172.21.15.87:0/1111477134 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 20) v1 ==== 90801+0+0 (secure 0 0 0) 0x7fec500095b0 con 0x7fec5c0ff6e0 2024-09-17T07:19:16.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.874+0000 7fec58ff9640 1 --2- 172.21.15.87:0/1111477134 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fec4406dab0 0x7fec4406ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:19:16.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.874+0000 7fec58ff9640 1 -- 172.21.15.87:0/1111477134 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fec5008c880 con 0x7fec5c0ff6e0 2024-09-17T07:19:16.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.874+0000 7fec5bfff640 1 --2- 172.21.15.87:0/1111477134 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fec4406dab0 0x7fec4406ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:19:16.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.875+0000 7fec5bfff640 1 --2- 172.21.15.87:0/1111477134 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fec4406dab0 0x7fec4406ff60 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fec4c0048a0 tx=0x7fec4c035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:19:16.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:16.879+0000 7fec58ff9640 1 -- 172.21.15.87:0/1111477134 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fec50059a80 con 0x7fec5c0ff6e0 2024-09-17T07:19:17.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.160+0000 7fec62590640 1 -- 172.21.15.87:0/1111477134 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fec48005d00 con 0x7fec5c0ff6e0 2024-09-17T07:19:17.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.160+0000 7fec58ff9640 1 -- 172.21.15.87:0/1111477134 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+853 (secure 0 0 0) 0x7fec50059420 con 0x7fec5c0ff6e0 2024-09-17T07:19:17.162 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T07:19:17.162 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": { 2024-09-17T07:19:17.162 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 2 2024-09-17T07:19:17.162 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:19:17.162 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr": { 2024-09-17T07:19:17.162 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 1, 2024-09-17T07:19:17.162 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 1 2024-09-17T07:19:17.162 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:19:17.162 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": { 2024-09-17T07:19:17.162 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 6 2024-09-17T07:19:17.162 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:19:17.162 INFO:teuthology.orchestra.run.smithi087.stdout: "mds": { 2024-09-17T07:19:17.162 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 4 2024-09-17T07:19:17.162 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:19:17.162 INFO:teuthology.orchestra.run.smithi087.stdout: "overall": { 2024-09-17T07:19:17.163 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 13, 2024-09-17T07:19:17.163 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 1 2024-09-17T07:19:17.163 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T07:19:17.163 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T07:19:17.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.163+0000 7fec62590640 1 -- 172.21.15.87:0/1111477134 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fec4406dab0 msgr2=0x7fec4406ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:19:17.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.163+0000 7fec62590640 1 --2- 172.21.15.87:0/1111477134 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fec4406dab0 0x7fec4406ff60 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fec4c0048a0 tx=0x7fec4c035040 comp rx=0 tx=0).stop 2024-09-17T07:19:17.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.163+0000 7fec62590640 1 -- 172.21.15.87:0/1111477134 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec5c0ff6e0 msgr2=0x7fec5c10f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:19:17.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.163+0000 7fec62590640 1 --2- 172.21.15.87:0/1111477134 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec5c0ff6e0 0x7fec5c10f730 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fec5000eb70 tx=0x7fec5000b040 comp rx=0 tx=0).stop 2024-09-17T07:19:17.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.163+0000 7fec62590640 1 -- 172.21.15.87:0/1111477134 shutdown_connections 2024-09-17T07:19:17.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.163+0000 7fec62590640 1 --2- 172.21.15.87:0/1111477134 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec5c0ff6e0 0x7fec5c10f730 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:17.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.163+0000 7fec62590640 1 --2- 172.21.15.87:0/1111477134 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7fec4406dab0 0x7fec4406ff60 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:17.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.163+0000 7fec62590640 1 --2- 172.21.15.87:0/1111477134 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fec5c065be0 0x7fec5c10f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:17.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.163+0000 7fec62590640 1 -- 172.21.15.87:0/1111477134 >> 172.21.15.87:0/1111477134 conn(0x7fec5c0f6c10 msgr2=0x7fec5c0fb420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:19:17.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.163+0000 7fec62590640 1 -- 172.21.15.87:0/1111477134 shutdown_connections 2024-09-17T07:19:17.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.163+0000 7fec62590640 1 -- 172.21.15.87:0/1111477134 wait complete. 2024-09-17T07:19:17.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.253+0000 7f3a45cbe640 1 -- 172.21.15.87:0/3207696870 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a400fc700 msgr2=0x7f3a400fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:19:17.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.253+0000 7f3a45cbe640 1 --2- 172.21.15.87:0/3207696870 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a400fc700 0x7f3a400fcb70 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3a340048d0 tx=0x7f3a34009da0 comp rx=0 tx=0).stop 2024-09-17T07:19:17.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.253+0000 7f3a45cbe640 1 -- 172.21.15.87:0/3207696870 shutdown_connections 2024-09-17T07:19:17.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.253+0000 7f3a45cbe640 1 --2- 172.21.15.87:0/3207696870 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a400fc700 0x7f3a400fcb70 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:17.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.253+0000 7f3a45cbe640 1 --2- 172.21.15.87:0/3207696870 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a400fb430 0x7f3a400fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:17.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.253+0000 7f3a45cbe640 1 -- 172.21.15.87:0/3207696870 >> 172.21.15.87:0/3207696870 conn(0x7f3a400f6c10 msgr2=0x7f3a400f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:19:17.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.253+0000 7f3a45cbe640 1 -- 172.21.15.87:0/3207696870 shutdown_connections 2024-09-17T07:19:17.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.253+0000 7f3a45cbe640 1 -- 172.21.15.87:0/3207696870 wait complete. 2024-09-17T07:19:17.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.253+0000 7f3a45cbe640 1 Processor -- start 2024-09-17T07:19:17.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.254+0000 7f3a45cbe640 1 -- start start 2024-09-17T07:19:17.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.254+0000 7f3a45cbe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a400fb430 0x7f3a4010bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:19:17.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.254+0000 7f3a45cbe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a400fc700 0x7f3a4010c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:19:17.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.254+0000 7f3a45cbe640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4010ca90 con 0x7f3a400fb430 2024-09-17T07:19:17.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.254+0000 7f3a45cbe640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4010d260 con 0x7f3a400fc700 2024-09-17T07:19:17.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.254+0000 7f3a3f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a400fb430 0x7f3a4010bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:19:17.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.254+0000 7f3a3f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a400fb430 0x7f3a4010bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39084/0 (socket says 172.21.15.87:39084) 2024-09-17T07:19:17.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.254+0000 7f3a3f7fe640 1 -- 172.21.15.87:0/3636835822 learned_addr learned my addr 172.21.15.87:0/3636835822 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:19:17.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.254+0000 7f3a3effd640 1 --2- 172.21.15.87:0/3636835822 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a400fc700 0x7f3a4010c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:19:17.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.254+0000 7f3a3f7fe640 1 -- 172.21.15.87:0/3636835822 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a400fc700 msgr2=0x7f3a4010c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:19:17.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.254+0000 7f3a3f7fe640 1 --2- 172.21.15.87:0/3636835822 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a400fc700 0x7f3a4010c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:17.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.254+0000 7f3a3f7fe640 1 -- 172.21.15.87:0/3636835822 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a34005040 con 0x7f3a400fb430 2024-09-17T07:19:17.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.254+0000 7f3a3effd640 1 --2- 172.21.15.87:0/3636835822 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a400fc700 0x7f3a4010c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T07:19:17.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.255+0000 7f3a3f7fe640 1 --2- 172.21.15.87:0/3636835822 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a400fb430 0x7f3a4010bf00 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f3a3000eb70 tx=0x7f3a3000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:19:17.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.255+0000 7f3a27fff640 1 -- 172.21.15.87:0/3636835822 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a30007c30 con 0x7f3a400fb430 2024-09-17T07:19:17.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.255+0000 7f3a45cbe640 1 -- 172.21.15.87:0/3636835822 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a4010d490 con 0x7f3a400fb430 2024-09-17T07:19:17.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.255+0000 7f3a27fff640 1 -- 172.21.15.87:0/3636835822 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f3a3000f040 con 0x7f3a400fb430 2024-09-17T07:19:17.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.255+0000 7f3a27fff640 1 -- 172.21.15.87:0/3636835822 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a300093c0 con 0x7f3a400fb430 2024-09-17T07:19:17.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.255+0000 7f3a45cbe640 1 -- 172.21.15.87:0/3636835822 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a4010da00 con 0x7f3a400fb430 2024-09-17T07:19:17.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.256+0000 7f3a45cbe640 1 -- 172.21.15.87:0/3636835822 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a400fa890 con 0x7f3a400fb430 2024-09-17T07:19:17.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.257+0000 7f3a27fff640 1 -- 172.21.15.87:0/3636835822 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 20) v1 ==== 90801+0+0 (secure 0 0 0) 0x7f3a30009630 con 0x7f3a400fb430 2024-09-17T07:19:17.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.257+0000 7f3a27fff640 1 --2- 172.21.15.87:0/3636835822 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f3a2806dab0 0x7f3a2806ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:19:17.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.257+0000 7f3a27fff640 1 -- 172.21.15.87:0/3636835822 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f3a3008c980 con 0x7f3a400fb430 2024-09-17T07:19:17.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.257+0000 7f3a3effd640 1 --2- 172.21.15.87:0/3636835822 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f3a2806dab0 0x7f3a2806ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:19:17.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.258+0000 7f3a3effd640 1 --2- 172.21.15.87:0/3636835822 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f3a2806dab0 0x7f3a2806ff60 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3a3400b020 tx=0x7f3a34035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:19:17.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.262+0000 7f3a27fff640 1 -- 172.21.15.87:0/3636835822 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f3a30059b00 con 0x7f3a400fb430 2024-09-17T07:19:17.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:17 smithi087 ceph-mon[27636]: from='client.24347 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:19:17.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:17 smithi087 ceph-mon[27636]: pgmap v232: 65 pgs: 65 active+clean; 90 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 3.2 MiB/s rd, 5.8 MiB/s wr, 239 op/s 2024-09-17T07:19:17.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:17 smithi087 ceph-mon[27636]: from='client.14626 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:19:17.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:17 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/1111477134' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:19:17.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.518+0000 7f3a45cbe640 1 -- 172.21.15.87:0/3636835822 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3a400008d0 con 0x7f3a400fb430 2024-09-17T07:19:17.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.518+0000 7f3a27fff640 1 -- 172.21.15.87:0/3636835822 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1850 (secure 0 0 0) 0x7f3a300594a0 con 0x7f3a400fb430 2024-09-17T07:19:17.519 INFO:teuthology.orchestra.run.smithi087.stdout:e20 2024-09-17T07:19:17.519 INFO:teuthology.orchestra.run.smithi087.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T07:19:17.519 INFO:teuthology.orchestra.run.smithi087.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T07:19:17.520 INFO:teuthology.orchestra.run.smithi087.stdout:legacy client fscid: 1 2024-09-17T07:19:17.520 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:19:17.520 INFO:teuthology.orchestra.run.smithi087.stdout:Filesystem 'cephfs' (1) 2024-09-17T07:19:17.520 INFO:teuthology.orchestra.run.smithi087.stdout:fs_name cephfs 2024-09-17T07:19:17.520 INFO:teuthology.orchestra.run.smithi087.stdout:epoch 20 2024-09-17T07:19:17.520 INFO:teuthology.orchestra.run.smithi087.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T07:19:17.520 INFO:teuthology.orchestra.run.smithi087.stdout:created 2024-09-17T07:17:15.368053+0000 2024-09-17T07:19:17.520 INFO:teuthology.orchestra.run.smithi087.stdout:modified 2024-09-17T07:19:06.657406+0000 2024-09-17T07:19:17.520 INFO:teuthology.orchestra.run.smithi087.stdout:tableserver 0 2024-09-17T07:19:17.520 INFO:teuthology.orchestra.run.smithi087.stdout:root 0 2024-09-17T07:19:17.520 INFO:teuthology.orchestra.run.smithi087.stdout:session_timeout 60 2024-09-17T07:19:17.520 INFO:teuthology.orchestra.run.smithi087.stdout:session_autoclose 300 2024-09-17T07:19:17.520 INFO:teuthology.orchestra.run.smithi087.stdout:max_file_size 1099511627776 2024-09-17T07:19:17.520 INFO:teuthology.orchestra.run.smithi087.stdout:required_client_features {} 2024-09-17T07:19:17.520 INFO:teuthology.orchestra.run.smithi087.stdout:last_failure 0 2024-09-17T07:19:17.521 INFO:teuthology.orchestra.run.smithi087.stdout:last_failure_osd_epoch 44 2024-09-17T07:19:17.521 INFO:teuthology.orchestra.run.smithi087.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T07:19:17.521 INFO:teuthology.orchestra.run.smithi087.stdout:max_mds 2 2024-09-17T07:19:17.521 INFO:teuthology.orchestra.run.smithi087.stdout:in 0,1 2024-09-17T07:19:17.521 INFO:teuthology.orchestra.run.smithi087.stdout:up {0=14478,1=24243} 2024-09-17T07:19:17.521 INFO:teuthology.orchestra.run.smithi087.stdout:failed 2024-09-17T07:19:17.521 INFO:teuthology.orchestra.run.smithi087.stdout:damaged 2024-09-17T07:19:17.521 INFO:teuthology.orchestra.run.smithi087.stdout:stopped 2024-09-17T07:19:17.521 INFO:teuthology.orchestra.run.smithi087.stdout:data_pools [3] 2024-09-17T07:19:17.522 INFO:teuthology.orchestra.run.smithi087.stdout:metadata_pool 2 2024-09-17T07:19:17.522 INFO:teuthology.orchestra.run.smithi087.stdout:inline_data enabled 2024-09-17T07:19:17.522 INFO:teuthology.orchestra.run.smithi087.stdout:balancer 2024-09-17T07:19:17.522 INFO:teuthology.orchestra.run.smithi087.stdout:standby_count_wanted 1 2024-09-17T07:19:17.522 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi087.tjhpcs{0:14478} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.87:6828/2255237099,v1:172.21.15.87:6829/2255237099] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:19:17.522 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi087.vvbzss{0:14490} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.87:6826/4022268353,v1:172.21.15.87:6827/4022268353] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:19:17.522 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi139.gnwonz{1:24243} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.139:6824/3946792151,v1:172.21.15.139:6825/3946792151] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:19:17.522 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi139.ftvinf{1:24253} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.139:6826/3292073323,v1:172.21.15.139:6827/3292073323] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:19:17.522 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:19:17.522 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:19:17.523 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 20 2024-09-17T07:19:17.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.520+0000 7f3a45cbe640 1 -- 172.21.15.87:0/3636835822 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f3a2806dab0 msgr2=0x7f3a2806ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:19:17.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.520+0000 7f3a45cbe640 1 --2- 172.21.15.87:0/3636835822 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f3a2806dab0 0x7f3a2806ff60 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3a3400b020 tx=0x7f3a34035040 comp rx=0 tx=0).stop 2024-09-17T07:19:17.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.520+0000 7f3a45cbe640 1 -- 172.21.15.87:0/3636835822 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a400fb430 msgr2=0x7f3a4010bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:19:17.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.520+0000 7f3a45cbe640 1 --2- 172.21.15.87:0/3636835822 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a400fb430 0x7f3a4010bf00 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f3a3000eb70 tx=0x7f3a3000b040 comp rx=0 tx=0).stop 2024-09-17T07:19:17.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.521+0000 7f3a45cbe640 1 -- 172.21.15.87:0/3636835822 shutdown_connections 2024-09-17T07:19:17.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.521+0000 7f3a45cbe640 1 --2- 172.21.15.87:0/3636835822 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f3a2806dab0 0x7f3a2806ff60 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:17.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.521+0000 7f3a45cbe640 1 --2- 172.21.15.87:0/3636835822 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a400fc700 0x7f3a4010c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:17.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.521+0000 7f3a45cbe640 1 --2- 172.21.15.87:0/3636835822 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a400fb430 0x7f3a4010bf00 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:17.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.521+0000 7f3a45cbe640 1 -- 172.21.15.87:0/3636835822 >> 172.21.15.87:0/3636835822 conn(0x7f3a400f6c10 msgr2=0x7f3a400ffa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:19:17.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.521+0000 7f3a45cbe640 1 -- 172.21.15.87:0/3636835822 shutdown_connections 2024-09-17T07:19:17.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.521+0000 7f3a45cbe640 1 -- 172.21.15.87:0/3636835822 wait complete. 2024-09-17T07:19:17.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.614+0000 7f653abec640 1 -- 172.21.15.87:0/2116151917 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65340fc520 msgr2=0x7f65340fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:19:17.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.614+0000 7f653abec640 1 --2- 172.21.15.87:0/2116151917 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65340fc520 0x7f65340fc930 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f65280048d0 tx=0x7f6528009da0 comp rx=0 tx=0).stop 2024-09-17T07:19:17.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.615+0000 7f653abec640 1 -- 172.21.15.87:0/2116151917 shutdown_connections 2024-09-17T07:19:17.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.615+0000 7f653abec640 1 --2- 172.21.15.87:0/2116151917 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f65340fd7f0 0x7f65340fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:17.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.615+0000 7f653abec640 1 --2- 172.21.15.87:0/2116151917 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65340fc520 0x7f65340fc930 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:17.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.615+0000 7f653abec640 1 -- 172.21.15.87:0/2116151917 >> 172.21.15.87:0/2116151917 conn(0x7f65340f7ce0 msgr2=0x7f65340fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:19:17.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.615+0000 7f653abec640 1 -- 172.21.15.87:0/2116151917 shutdown_connections 2024-09-17T07:19:17.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.615+0000 7f653abec640 1 -- 172.21.15.87:0/2116151917 wait complete. 2024-09-17T07:19:17.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.615+0000 7f653abec640 1 Processor -- start 2024-09-17T07:19:17.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.615+0000 7f653abec640 1 -- start start 2024-09-17T07:19:17.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.616+0000 7f653abec640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65340fc520 0x7f653410cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:19:17.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.616+0000 7f653abec640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f65340fd7f0 0x7f653410d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:19:17.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.616+0000 7f653abec640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f653410db80 con 0x7f65340fc520 2024-09-17T07:19:17.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.616+0000 7f653abec640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f653410e3a0 con 0x7f65340fd7f0 2024-09-17T07:19:17.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.616+0000 7f6538988640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65340fc520 0x7f653410cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:19:17.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.616+0000 7f6538988640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65340fc520 0x7f653410cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39110/0 (socket says 172.21.15.87:39110) 2024-09-17T07:19:17.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.616+0000 7f6538988640 1 -- 172.21.15.87:0/75559976 learned_addr learned my addr 172.21.15.87:0/75559976 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:19:17.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.616+0000 7f6533fff640 1 --2- 172.21.15.87:0/75559976 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f65340fd7f0 0x7f653410d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:19:17.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.616+0000 7f6538988640 1 -- 172.21.15.87:0/75559976 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f65340fd7f0 msgr2=0x7f653410d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:19:17.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.616+0000 7f6538988640 1 --2- 172.21.15.87:0/75559976 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f65340fd7f0 0x7f653410d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:17.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.616+0000 7f6538988640 1 -- 172.21.15.87:0/75559976 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6528005040 con 0x7f65340fc520 2024-09-17T07:19:17.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.616+0000 7f6538988640 1 --2- 172.21.15.87:0/75559976 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65340fc520 0x7f653410cff0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f6528009ac0 tx=0x7f6528009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:19:17.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.617+0000 7f65317fa640 1 -- 172.21.15.87:0/75559976 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6528038070 con 0x7f65340fc520 2024-09-17T07:19:17.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.617+0000 7f65317fa640 1 -- 172.21.15.87:0/75559976 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f65280096c0 con 0x7f65340fc520 2024-09-17T07:19:17.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.617+0000 7f653abec640 1 -- 172.21.15.87:0/75559976 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f653410e5d0 con 0x7f65340fc520 2024-09-17T07:19:17.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.617+0000 7f65317fa640 1 -- 172.21.15.87:0/75559976 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f652803d420 con 0x7f65340fc520 2024-09-17T07:19:17.620 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.617+0000 7f653abec640 1 -- 172.21.15.87:0/75559976 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f653410eb70 con 0x7f65340fc520 2024-09-17T07:19:17.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.618+0000 7f653abec640 1 -- 172.21.15.87:0/75559976 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65340fb980 con 0x7f65340fc520 2024-09-17T07:19:17.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.618+0000 7f65317fa640 1 -- 172.21.15.87:0/75559976 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 20) v1 ==== 90801+0+0 (secure 0 0 0) 0x7f6528030020 con 0x7f65340fc520 2024-09-17T07:19:17.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.619+0000 7f65317fa640 1 --2- 172.21.15.87:0/75559976 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f652406dab0 0x7f652406ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:19:17.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.619+0000 7f65317fa640 1 -- 172.21.15.87:0/75559976 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f65280ad260 con 0x7f65340fc520 2024-09-17T07:19:17.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.619+0000 7f6533fff640 1 --2- 172.21.15.87:0/75559976 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f652406dab0 0x7f652406ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:19:17.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.619+0000 7f6533fff640 1 --2- 172.21.15.87:0/75559976 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f652406dab0 0x7f652406ff60 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f653410cda0 tx=0x7f652000b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:19:17.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.623+0000 7f65317fa640 1 -- 172.21.15.87:0/75559976 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f652807a3b0 con 0x7f65340fc520 2024-09-17T07:19:17.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.864+0000 7f653abec640 1 -- 172.21.15.87:0/75559976 --> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f653410eef0 con 0x7f652406dab0 2024-09-17T07:19:17.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:17 smithi139 ceph-mon[34403]: from='client.24347 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:19:17.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:17 smithi139 ceph-mon[34403]: pgmap v232: 65 pgs: 65 active+clean; 90 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 3.2 MiB/s rd, 5.8 MiB/s wr, 239 op/s 2024-09-17T07:19:17.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:17 smithi139 ceph-mon[34403]: from='client.14626 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:19:17.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:17 smithi139 ceph-mon[34403]: from='client.? 172.21.15.87:0/1111477134' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:19:17.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.865+0000 7f65317fa640 1 -- 172.21.15.87:0/75559976 <== mgr.14208 v2:172.21.15.87:6800/611048628 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+328 (secure 0 0 0) 0x7f653410eef0 con 0x7f652406dab0 2024-09-17T07:19:17.867 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T07:19:17.867 INFO:teuthology.orchestra.run.smithi087.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9", 2024-09-17T07:19:17.867 INFO:teuthology.orchestra.run.smithi087.stdout: "in_progress": true, 2024-09-17T07:19:17.867 INFO:teuthology.orchestra.run.smithi087.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T07:19:17.867 INFO:teuthology.orchestra.run.smithi087.stdout: "services_complete": [], 2024-09-17T07:19:17.867 INFO:teuthology.orchestra.run.smithi087.stdout: "progress": "", 2024-09-17T07:19:17.867 INFO:teuthology.orchestra.run.smithi087.stdout: "message": "Currently upgrading mgr daemons", 2024-09-17T07:19:17.867 INFO:teuthology.orchestra.run.smithi087.stdout: "is_paused": false 2024-09-17T07:19:17.867 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T07:19:17.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.868+0000 7f653abec640 1 -- 172.21.15.87:0/75559976 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f652406dab0 msgr2=0x7f652406ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:19:17.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.868+0000 7f653abec640 1 --2- 172.21.15.87:0/75559976 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f652406dab0 0x7f652406ff60 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f653410cda0 tx=0x7f652000b040 comp rx=0 tx=0).stop 2024-09-17T07:19:17.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.868+0000 7f653abec640 1 -- 172.21.15.87:0/75559976 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65340fc520 msgr2=0x7f653410cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:19:17.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.868+0000 7f653abec640 1 --2- 172.21.15.87:0/75559976 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65340fc520 0x7f653410cff0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f6528009ac0 tx=0x7f6528009da0 comp rx=0 tx=0).stop 2024-09-17T07:19:17.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.868+0000 7f653abec640 1 -- 172.21.15.87:0/75559976 shutdown_connections 2024-09-17T07:19:17.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.868+0000 7f653abec640 1 --2- 172.21.15.87:0/75559976 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f652406dab0 0x7f652406ff60 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:17.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.868+0000 7f653abec640 1 --2- 172.21.15.87:0/75559976 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f65340fd7f0 0x7f653410d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:17.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.868+0000 7f653abec640 1 --2- 172.21.15.87:0/75559976 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65340fc520 0x7f653410cff0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:17.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.868+0000 7f653abec640 1 -- 172.21.15.87:0/75559976 >> 172.21.15.87:0/75559976 conn(0x7f65340f7ce0 msgr2=0x7f65340f9610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:19:17.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.868+0000 7f653abec640 1 -- 172.21.15.87:0/75559976 shutdown_connections 2024-09-17T07:19:17.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.868+0000 7f653abec640 1 -- 172.21.15.87:0/75559976 wait complete. 2024-09-17T07:19:17.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.981+0000 7f62f3e13640 1 -- 172.21.15.87:0/656425256 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62ec065be0 msgr2=0x7f62ec0ff1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:19:17.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.981+0000 7f62f3e13640 1 --2- 172.21.15.87:0/656425256 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62ec065be0 0x7f62ec0ff1a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f62e80048d0 tx=0x7f62e8009da0 comp rx=0 tx=0).stop 2024-09-17T07:19:17.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.981+0000 7f62f3e13640 1 -- 172.21.15.87:0/656425256 shutdown_connections 2024-09-17T07:19:17.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.981+0000 7f62f3e13640 1 --2- 172.21.15.87:0/656425256 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f62ec0ff6e0 0x7f62ec101ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:17.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.981+0000 7f62f3e13640 1 --2- 172.21.15.87:0/656425256 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62ec065be0 0x7f62ec0ff1a0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:17.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.981+0000 7f62f3e13640 1 -- 172.21.15.87:0/656425256 >> 172.21.15.87:0/656425256 conn(0x7f62ec0f6c10 msgr2=0x7f62ec0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:19:17.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.981+0000 7f62f3e13640 1 -- 172.21.15.87:0/656425256 shutdown_connections 2024-09-17T07:19:17.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.981+0000 7f62f3e13640 1 -- 172.21.15.87:0/656425256 wait complete. 2024-09-17T07:19:17.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.982+0000 7f62f3e13640 1 Processor -- start 2024-09-17T07:19:17.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.982+0000 7f62f3e13640 1 -- start start 2024-09-17T07:19:17.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.982+0000 7f62f3e13640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f62ec065be0 0x7f62ec0fcb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:19:17.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.982+0000 7f62f3e13640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62ec0ff6e0 0x7f62ec0fb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:19:17.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.982+0000 7f62f3e13640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62ec0fb5e0 con 0x7f62ec0ff6e0 2024-09-17T07:19:17.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.982+0000 7f62f3e13640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62ec0fb720 con 0x7f62ec065be0 2024-09-17T07:19:17.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.982+0000 7f62f13ae640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62ec0ff6e0 0x7f62ec0fb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:19:17.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.983+0000 7f62f13ae640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62ec0ff6e0 0x7f62ec0fb0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39122/0 (socket says 172.21.15.87:39122) 2024-09-17T07:19:17.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.983+0000 7f62f13ae640 1 -- 172.21.15.87:0/602845635 learned_addr learned my addr 172.21.15.87:0/602845635 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:19:17.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.983+0000 7f62f1baf640 1 --2- 172.21.15.87:0/602845635 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f62ec065be0 0x7f62ec0fcb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:19:17.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.983+0000 7f62f13ae640 1 -- 172.21.15.87:0/602845635 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f62ec065be0 msgr2=0x7f62ec0fcb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:19:17.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.983+0000 7f62f13ae640 1 --2- 172.21.15.87:0/602845635 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f62ec065be0 0x7f62ec0fcb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:17.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.983+0000 7f62f13ae640 1 -- 172.21.15.87:0/602845635 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62e8005040 con 0x7f62ec0ff6e0 2024-09-17T07:19:17.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.983+0000 7f62f13ae640 1 --2- 172.21.15.87:0/602845635 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62ec0ff6e0 0x7f62ec0fb0a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f62dc00eb70 tx=0x7f62dc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:19:17.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.983+0000 7f62e27fc640 1 -- 172.21.15.87:0/602845635 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62dc007c30 con 0x7f62ec0ff6e0 2024-09-17T07:19:17.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.983+0000 7f62e27fc640 1 -- 172.21.15.87:0/602845635 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f62dc00f040 con 0x7f62ec0ff6e0 2024-09-17T07:19:17.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.984+0000 7f62e27fc640 1 -- 172.21.15.87:0/602845635 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62dc00c930 con 0x7f62ec0ff6e0 2024-09-17T07:19:17.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.984+0000 7f62f3e13640 1 -- 172.21.15.87:0/602845635 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62ec0fb9a0 con 0x7f62ec0ff6e0 2024-09-17T07:19:17.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.984+0000 7f62f3e13640 1 -- 172.21.15.87:0/602845635 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62ec0fbf10 con 0x7f62ec0ff6e0 2024-09-17T07:19:17.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.985+0000 7f62f3e13640 1 -- 172.21.15.87:0/602845635 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62ec0fa890 con 0x7f62ec0ff6e0 2024-09-17T07:19:17.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.986+0000 7f62e27fc640 1 -- 172.21.15.87:0/602845635 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 20) v1 ==== 90801+0+0 (secure 0 0 0) 0x7f62dc00ca90 con 0x7f62ec0ff6e0 2024-09-17T07:19:17.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.987+0000 7f62e27fc640 1 --2- 172.21.15.87:0/602845635 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f62d806dab0 0x7f62d806ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:19:17.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.987+0000 7f62e27fc640 1 -- 172.21.15.87:0/602845635 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f62dc08c570 con 0x7f62ec0ff6e0 2024-09-17T07:19:17.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.987+0000 7f62f1baf640 1 --2- 172.21.15.87:0/602845635 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f62d806dab0 0x7f62d806ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:19:17.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.988+0000 7f62f1baf640 1 --2- 172.21.15.87:0/602845635 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f62d806dab0 0x7f62d806ff60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f62e8009ac0 tx=0x7f62e8035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:19:17.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:17.992+0000 7f62e27fc640 1 -- 172.21.15.87:0/602845635 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f62dc059770 con 0x7f62ec0ff6e0 2024-09-17T07:19:18.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:18.273+0000 7f62f3e13640 1 -- 172.21.15.87:0/602845635 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f62ec04b720 con 0x7f62ec0ff6e0 2024-09-17T07:19:18.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:18.273+0000 7f62e27fc640 1 -- 172.21.15.87:0/602845635 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f62dc059110 con 0x7f62ec0ff6e0 2024-09-17T07:19:18.275 INFO:teuthology.orchestra.run.smithi087.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T07:19:18.275 INFO:teuthology.orchestra.run.smithi087.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T07:19:18.275 INFO:teuthology.orchestra.run.smithi087.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T07:19:18.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:18.276+0000 7f62f3e13640 1 -- 172.21.15.87:0/602845635 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f62d806dab0 msgr2=0x7f62d806ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:19:18.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:18.276+0000 7f62f3e13640 1 --2- 172.21.15.87:0/602845635 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f62d806dab0 0x7f62d806ff60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f62e8009ac0 tx=0x7f62e8035040 comp rx=0 tx=0).stop 2024-09-17T07:19:18.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:18.276+0000 7f62f3e13640 1 -- 172.21.15.87:0/602845635 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62ec0ff6e0 msgr2=0x7f62ec0fb0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:19:18.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:18.276+0000 7f62f3e13640 1 --2- 172.21.15.87:0/602845635 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62ec0ff6e0 0x7f62ec0fb0a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f62dc00eb70 tx=0x7f62dc00b040 comp rx=0 tx=0).stop 2024-09-17T07:19:18.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:18.276+0000 7f62f3e13640 1 -- 172.21.15.87:0/602845635 shutdown_connections 2024-09-17T07:19:18.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:18.276+0000 7f62f3e13640 1 --2- 172.21.15.87:0/602845635 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62ec0ff6e0 0x7f62ec0fb0a0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:18.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:18.276+0000 7f62f3e13640 1 --2- 172.21.15.87:0/602845635 >> [v2:172.21.15.87:6800/611048628,v1:172.21.15.87:6801/611048628] conn(0x7f62d806dab0 0x7f62d806ff60 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:18.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:18.276+0000 7f62f3e13640 1 --2- 172.21.15.87:0/602845635 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f62ec065be0 0x7f62ec0fcb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:18.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:18.276+0000 7f62f3e13640 1 -- 172.21.15.87:0/602845635 >> 172.21.15.87:0/602845635 conn(0x7f62ec0f6c10 msgr2=0x7f62ec0f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:19:18.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:18.276+0000 7f62f3e13640 1 -- 172.21.15.87:0/602845635 shutdown_connections 2024-09-17T07:19:18.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:18.277+0000 7f62f3e13640 1 -- 172.21.15.87:0/602845635 wait complete. 2024-09-17T07:19:18.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:18 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/3636835822' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T07:19:18.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:18 smithi087 ceph-mon[27636]: from='client.14638 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:19:18.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:18 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/602845635' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T07:19:18.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:18 smithi139 ceph-mon[34403]: from='client.? 172.21.15.87:0/3636835822' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T07:19:18.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:18 smithi139 ceph-mon[34403]: from='client.14638 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:19:18.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:18 smithi139 ceph-mon[34403]: from='client.? 172.21.15.87:0/602845635' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T07:19:19.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:19 smithi087 ceph-mon[27636]: pgmap v233: 65 pgs: 65 active+clean; 100 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 3.3 MiB/s rd, 5.8 MiB/s wr, 245 op/s 2024-09-17T07:19:19.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:19 smithi139 ceph-mon[34403]: pgmap v233: 65 pgs: 65 active+clean; 100 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 3.3 MiB/s rd, 5.8 MiB/s wr, 245 op/s 2024-09-17T07:19:22.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:21 smithi139 ceph-mon[34403]: pgmap v234: 65 pgs: 65 active+clean; 100 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 3.0 MiB/s rd, 5.1 MiB/s wr, 207 op/s 2024-09-17T07:19:22.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:21 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:19:22.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:21 smithi087 ceph-mon[27636]: pgmap v234: 65 pgs: 65 active+clean; 100 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 3.0 MiB/s rd, 5.1 MiB/s wr, 207 op/s 2024-09-17T07:19:22.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:21 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:19:24.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:23 smithi139 ceph-mon[34403]: pgmap v235: 65 pgs: 65 active+clean; 113 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 4.0 MiB/s rd, 6.0 MiB/s wr, 263 op/s 2024-09-17T07:19:24.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:23 smithi087 ceph-mon[27636]: pgmap v235: 65 pgs: 65 active+clean; 113 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 4.0 MiB/s rd, 6.0 MiB/s wr, 263 op/s 2024-09-17T07:19:26.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:26 smithi139 ceph-mon[34403]: pgmap v236: 65 pgs: 65 active+clean; 120 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 3.3 MiB/s rd, 5.1 MiB/s wr, 240 op/s 2024-09-17T07:19:26.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:26 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:19:26.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:26 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:19:26.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:26 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:19:26.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:26 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:19:26.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:26 smithi087 ceph-mon[27636]: pgmap v236: 65 pgs: 65 active+clean; 120 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 3.3 MiB/s rd, 5.1 MiB/s wr, 240 op/s 2024-09-17T07:19:26.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:26 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:19:26.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:26 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:19:26.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:26 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:19:26.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:26 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:19:28.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:28 smithi087 ceph-mon[27636]: pgmap v237: 65 pgs: 65 active+clean; 138 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 3.6 MiB/s rd, 5.5 MiB/s wr, 290 op/s 2024-09-17T07:19:28.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:28 smithi139 ceph-mon[34403]: pgmap v237: 65 pgs: 65 active+clean; 138 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 3.6 MiB/s rd, 5.5 MiB/s wr, 290 op/s 2024-09-17T07:19:30.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:30 smithi087 ceph-mon[27636]: pgmap v238: 65 pgs: 65 active+clean; 147 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 2.9 MiB/s rd, 4.9 MiB/s wr, 313 op/s 2024-09-17T07:19:30.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:30 smithi139 ceph-mon[34403]: pgmap v238: 65 pgs: 65 active+clean; 147 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 2.9 MiB/s rd, 4.9 MiB/s wr, 313 op/s 2024-09-17T07:19:32.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:32 smithi087 ceph-mon[27636]: pgmap v239: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 2.9 MiB/s rd, 4.4 MiB/s wr, 278 op/s 2024-09-17T07:19:32.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:32 smithi139 ceph-mon[34403]: pgmap v239: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 2.9 MiB/s rd, 4.4 MiB/s wr, 278 op/s 2024-09-17T07:19:34.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:34 smithi087 ceph-mon[27636]: pgmap v240: 65 pgs: 65 active+clean; 169 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 3.5 MiB/s rd, 5.8 MiB/s wr, 393 op/s 2024-09-17T07:19:34.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:34 smithi139 ceph-mon[34403]: pgmap v240: 65 pgs: 65 active+clean; 169 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 3.5 MiB/s rd, 5.8 MiB/s wr, 393 op/s 2024-09-17T07:19:35.619 INFO:tasks.workunit.client.0.smithi087.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-17T07:19:35.627 INFO:tasks.workunit.client.0.smithi087.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-17T07:19:35.627 INFO:tasks.workunit.client.0.smithi087.stderr:+ make 2024-09-17T07:19:35.973 INFO:tasks.workunit.client.0.smithi087.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-17T07:19:36.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:36 smithi087 ceph-mon[27636]: pgmap v241: 65 pgs: 65 active+clean; 176 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 3.0 MiB/s rd, 5.4 MiB/s wr, 403 op/s 2024-09-17T07:19:36.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:36 smithi139 ceph-mon[34403]: pgmap v241: 65 pgs: 65 active+clean; 176 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 3.0 MiB/s rd, 5.4 MiB/s wr, 403 op/s 2024-09-17T07:19:37.604 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:37 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:19:37.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:37 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:19:38.094 INFO:tasks.workunit.client.0.smithi087.stderr:++ readlink -f fsstress 2024-09-17T07:19:38.096 INFO:tasks.workunit.client.0.smithi087.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-17T07:19:38.096 INFO:tasks.workunit.client.0.smithi087.stderr:+ popd 2024-09-17T07:19:38.097 INFO:tasks.workunit.client.0.smithi087.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-17T07:19:38.097 INFO:tasks.workunit.client.0.smithi087.stderr:+ popd 2024-09-17T07:19:38.097 INFO:tasks.workunit.client.0.smithi087.stdout:~/cephtest/mnt.0/client.0/tmp 2024-09-17T07:19:38.098 INFO:tasks.workunit.client.0.smithi087.stderr:++ mktemp -d -p . 2024-09-17T07:19:38.099 INFO:tasks.workunit.client.0.smithi087.stderr:+ T=./tmp.v7LFrnt2kC 2024-09-17T07:19:38.100 INFO:tasks.workunit.client.0.smithi087.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.v7LFrnt2kC -l 1 -n 1000 -p 10 -v 2024-09-17T07:19:38.102 INFO:tasks.workunit.client.0.smithi087.stdout:seed = 1726529171 2024-09-17T07:19:38.105 INFO:tasks.workunit.client.0.smithi087.stdout:0/0: unlink - no file 2024-09-17T07:19:38.106 INFO:tasks.workunit.client.0.smithi087.stdout:1/0: rmdir - no directory 2024-09-17T07:19:38.106 INFO:tasks.workunit.client.0.smithi087.stdout:0/1: creat f0 x:0 0 0 2024-09-17T07:19:38.108 INFO:tasks.workunit.client.0.smithi087.stdout:0/2: creat f1 x:0 0 0 2024-09-17T07:19:38.109 INFO:tasks.workunit.client.0.smithi087.stdout:1/1: mknod c0 0 2024-09-17T07:19:38.109 INFO:tasks.workunit.client.0.smithi087.stdout:1/2: rmdir - no directory 2024-09-17T07:19:38.109 INFO:tasks.workunit.client.0.smithi087.stdout:1/3: write - no filename 2024-09-17T07:19:38.109 INFO:tasks.workunit.client.0.smithi087.stdout:0/3: stat f1 0 2024-09-17T07:19:38.109 INFO:tasks.workunit.client.0.smithi087.stdout:0/4: rmdir - no directory 2024-09-17T07:19:38.109 INFO:tasks.workunit.client.0.smithi087.stdout:1/4: stat c0 0 2024-09-17T07:19:38.109 INFO:tasks.workunit.client.0.smithi087.stdout:1/5: rmdir - no directory 2024-09-17T07:19:38.109 INFO:tasks.workunit.client.0.smithi087.stdout:1/6: dwrite - no filename 2024-09-17T07:19:38.110 INFO:tasks.workunit.client.0.smithi087.stdout:3/0: read - no filename 2024-09-17T07:19:38.110 INFO:tasks.workunit.client.0.smithi087.stdout:3/1: dread - no filename 2024-09-17T07:19:38.110 INFO:tasks.workunit.client.0.smithi087.stdout:3/2: dread - no filename 2024-09-17T07:19:38.110 INFO:tasks.workunit.client.0.smithi087.stdout:3/3: fsync - no filename 2024-09-17T07:19:38.110 INFO:tasks.workunit.client.0.smithi087.stdout:1/7: mknod c1 0 2024-09-17T07:19:38.110 INFO:tasks.workunit.client.0.smithi087.stdout:1/8: write - no filename 2024-09-17T07:19:38.110 INFO:tasks.workunit.client.0.smithi087.stdout:1/9: rmdir - no directory 2024-09-17T07:19:38.110 INFO:tasks.workunit.client.0.smithi087.stdout:1/10: stat c0 0 2024-09-17T07:19:38.111 INFO:tasks.workunit.client.0.smithi087.stdout:1/11: write - no filename 2024-09-17T07:19:38.111 INFO:tasks.workunit.client.0.smithi087.stdout:0/5: rename f0 to f2 0 2024-09-17T07:19:38.111 INFO:tasks.workunit.client.0.smithi087.stdout:2/0: symlink l0 0 2024-09-17T07:19:38.113 INFO:tasks.workunit.client.0.smithi087.stdout:0/6: symlink l3 0 2024-09-17T07:19:38.114 INFO:tasks.workunit.client.0.smithi087.stdout:2/1: mknod c1 0 2024-09-17T07:19:38.115 INFO:tasks.workunit.client.0.smithi087.stdout:2/2: fdatasync - no filename 2024-09-17T07:19:38.115 INFO:tasks.workunit.client.0.smithi087.stdout:3/4: mknod c0 0 2024-09-17T07:19:38.116 INFO:tasks.workunit.client.0.smithi087.stdout:5/0: write - no filename 2024-09-17T07:19:38.116 INFO:tasks.workunit.client.0.smithi087.stdout:5/1: chown . 45757 1 2024-09-17T07:19:38.116 INFO:tasks.workunit.client.0.smithi087.stdout:0/7: rename f1 to f4 0 2024-09-17T07:19:38.116 INFO:tasks.workunit.client.0.smithi087.stdout:0/8: readlink l3 0 2024-09-17T07:19:38.117 INFO:tasks.workunit.client.0.smithi087.stdout:2/3: mkdir d2 0 2024-09-17T07:19:38.117 INFO:tasks.workunit.client.0.smithi087.stdout:3/5: mknod c1 0 2024-09-17T07:19:38.117 INFO:tasks.workunit.client.0.smithi087.stdout:3/6: dwrite - no filename 2024-09-17T07:19:38.121 INFO:tasks.workunit.client.0.smithi087.stdout:3/7: unlink c0 0 2024-09-17T07:19:38.123 INFO:tasks.workunit.client.0.smithi087.stdout:5/2: symlink l0 0 2024-09-17T07:19:38.123 INFO:tasks.workunit.client.0.smithi087.stdout:5/3: dread - no filename 2024-09-17T07:19:38.123 INFO:tasks.workunit.client.0.smithi087.stdout:5/4: write - no filename 2024-09-17T07:19:38.124 INFO:tasks.workunit.client.0.smithi087.stdout:2/4: getdents d2 0 2024-09-17T07:19:38.124 INFO:tasks.workunit.client.0.smithi087.stdout:2/5: dread - no filename 2024-09-17T07:19:38.125 INFO:tasks.workunit.client.0.smithi087.stdout:2/6: readlink l0 0 2024-09-17T07:19:38.125 INFO:tasks.workunit.client.0.smithi087.stdout:2/7: dwrite - no filename 2024-09-17T07:19:38.125 INFO:tasks.workunit.client.0.smithi087.stdout:2/8: dread - no filename 2024-09-17T07:19:38.125 INFO:tasks.workunit.client.0.smithi087.stdout:2/9: write - no filename 2024-09-17T07:19:38.125 INFO:tasks.workunit.client.0.smithi087.stdout:2/10: truncate - no filename 2024-09-17T07:19:38.125 INFO:tasks.workunit.client.0.smithi087.stdout:2/11: write - no filename 2024-09-17T07:19:38.125 INFO:tasks.workunit.client.0.smithi087.stdout:2/12: dwrite - no filename 2024-09-17T07:19:38.126 INFO:tasks.workunit.client.0.smithi087.stdout:3/8: rename c1 to c2 0 2024-09-17T07:19:38.126 INFO:tasks.workunit.client.0.smithi087.stdout:5/5: creat f1 x:0 0 0 2024-09-17T07:19:38.128 INFO:tasks.workunit.client.0.smithi087.stdout:6/0: creat f0 x:0 0 0 2024-09-17T07:19:38.130 INFO:tasks.workunit.client.0.smithi087.stdout:5/6: chown f1 896491 1 2024-09-17T07:19:38.130 INFO:tasks.workunit.client.0.smithi087.stdout:8/0: readlink - no filename 2024-09-17T07:19:38.131 INFO:tasks.workunit.client.0.smithi087.stdout:2/13: creat d2/f3 x:0 0 0 2024-09-17T07:19:38.131 INFO:tasks.workunit.client.0.smithi087.stdout:0/9: dwrite f2 [0,4194304] 0 2024-09-17T07:19:38.132 INFO:tasks.workunit.client.0.smithi087.stdout:2/14: dread - d2/f3 zero size 2024-09-17T07:19:38.132 INFO:tasks.workunit.client.0.smithi087.stdout:0/10: chown l3 9 1 2024-09-17T07:19:38.133 INFO:tasks.workunit.client.0.smithi087.stdout:6/1: mkdir d1 0 2024-09-17T07:19:38.133 INFO:tasks.workunit.client.0.smithi087.stdout:6/2: readlink - no filename 2024-09-17T07:19:38.134 INFO:tasks.workunit.client.0.smithi087.stdout:6/3: dread - f0 zero size 2024-09-17T07:19:38.134 INFO:tasks.workunit.client.0.smithi087.stdout:6/4: chown f0 243037 1 2024-09-17T07:19:38.134 INFO:tasks.workunit.client.0.smithi087.stdout:9/0: readlink - no filename 2024-09-17T07:19:38.134 INFO:tasks.workunit.client.0.smithi087.stdout:9/1: dread - no filename 2024-09-17T07:19:38.135 INFO:tasks.workunit.client.0.smithi087.stdout:9/2: write - no filename 2024-09-17T07:19:38.135 INFO:tasks.workunit.client.0.smithi087.stdout:9/3: dwrite - no filename 2024-09-17T07:19:38.135 INFO:tasks.workunit.client.0.smithi087.stdout:6/5: stat f0 0 2024-09-17T07:19:38.135 INFO:tasks.workunit.client.0.smithi087.stdout:6/6: write f0 [357444,12999] 0 2024-09-17T07:19:38.136 INFO:tasks.workunit.client.0.smithi087.stdout:7/0: getdents . 0 2024-09-17T07:19:38.137 INFO:tasks.workunit.client.0.smithi087.stdout:2/15: mknod d2/c4 0 2024-09-17T07:19:38.139 INFO:tasks.workunit.client.0.smithi087.stdout:8/1: symlink l0 0 2024-09-17T07:19:38.139 INFO:tasks.workunit.client.0.smithi087.stdout:8/2: write - no filename 2024-09-17T07:19:38.142 INFO:tasks.workunit.client.0.smithi087.stdout:2/16: creat d2/f5 x:0 0 0 2024-09-17T07:19:38.144 INFO:tasks.workunit.client.0.smithi087.stdout:9/4: creat f0 x:0 0 0 2024-09-17T07:19:38.144 INFO:tasks.workunit.client.0.smithi087.stdout:8/3: mkdir d1 0 2024-09-17T07:19:38.144 INFO:tasks.workunit.client.0.smithi087.stdout:8/4: truncate - no filename 2024-09-17T07:19:38.145 INFO:tasks.workunit.client.0.smithi087.stdout:7/1: mkdir d0 0 2024-09-17T07:19:38.145 INFO:tasks.workunit.client.0.smithi087.stdout:7/2: unlink - no file 2024-09-17T07:19:38.145 INFO:tasks.workunit.client.0.smithi087.stdout:7/3: truncate - no filename 2024-09-17T07:19:38.147 INFO:tasks.workunit.client.0.smithi087.stdout:7/4: chown d0 0 1 2024-09-17T07:19:38.147 INFO:tasks.workunit.client.0.smithi087.stdout:7/5: readlink - no filename 2024-09-17T07:19:38.147 INFO:tasks.workunit.client.0.smithi087.stdout:7/6: dwrite - no filename 2024-09-17T07:19:38.147 INFO:tasks.workunit.client.0.smithi087.stdout:7/7: fdatasync - no filename 2024-09-17T07:19:38.148 INFO:tasks.workunit.client.0.smithi087.stdout:9/5: chown f0 19 1 2024-09-17T07:19:38.149 INFO:tasks.workunit.client.0.smithi087.stdout:2/17: rename l0 to d2/l6 0 2024-09-17T07:19:38.149 INFO:tasks.workunit.client.0.smithi087.stdout:9/6: stat f0 0 2024-09-17T07:19:38.151 INFO:tasks.workunit.client.0.smithi087.stdout:6/7: dwrite f0 [0,4194304] 0 2024-09-17T07:19:38.154 INFO:tasks.workunit.client.0.smithi087.stdout:7/8: creat d0/f1 x:0 0 0 2024-09-17T07:19:38.155 INFO:tasks.workunit.client.0.smithi087.stdout:0/11: dwrite f4 [0,4194304] 0 2024-09-17T07:19:38.155 INFO:tasks.workunit.client.0.smithi087.stdout:2/18: unlink c1 0 2024-09-17T07:19:38.155 INFO:tasks.workunit.client.0.smithi087.stdout:6/8: read f0 [3706835,15855] 0 2024-09-17T07:19:38.161 INFO:tasks.workunit.client.0.smithi087.stdout:9/7: rename f0 to f1 0 2024-09-17T07:19:38.161 INFO:tasks.workunit.client.0.smithi087.stdout:8/5: link l0 d1/l2 0 2024-09-17T07:19:38.161 INFO:tasks.workunit.client.0.smithi087.stdout:7/9: creat d0/f2 x:0 0 0 2024-09-17T07:19:38.166 INFO:tasks.workunit.client.0.smithi087.stdout:6/9: symlink d1/l2 0 2024-09-17T07:19:38.169 INFO:tasks.workunit.client.0.smithi087.stdout:2/19: dwrite d2/f5 [0,4194304] 0 2024-09-17T07:19:38.171 INFO:tasks.workunit.client.0.smithi087.stdout:2/20: chown d2/f5 192 1 2024-09-17T07:19:38.172 INFO:tasks.workunit.client.0.smithi087.stdout:6/10: creat d1/f3 x:0 0 0 2024-09-17T07:19:38.173 INFO:tasks.workunit.client.0.smithi087.stdout:2/21: dread - d2/f3 zero size 2024-09-17T07:19:38.176 INFO:tasks.workunit.client.0.smithi087.stdout:7/10: dwrite d0/f1 [0,4194304] 0 2024-09-17T07:19:38.186 INFO:tasks.workunit.client.0.smithi087.stdout:7/11: dread d0/f1 [0,4194304] 0 2024-09-17T07:19:38.186 INFO:tasks.workunit.client.0.smithi087.stdout:2/22: dwrite d2/f3 [0,4194304] 0 2024-09-17T07:19:38.279 INFO:tasks.workunit.client.0.smithi087.stdout:1/12: getdents . 0 2024-09-17T07:19:38.279 INFO:tasks.workunit.client.0.smithi087.stdout:1/13: dwrite - no filename 2024-09-17T07:19:38.280 INFO:tasks.workunit.client.0.smithi087.stdout:1/14: chown c1 6615850 1 2024-09-17T07:19:38.281 INFO:tasks.workunit.client.0.smithi087.stdout:1/15: unlink c1 0 2024-09-17T07:19:38.283 INFO:tasks.workunit.client.0.smithi087.stdout:1/16: unlink c0 0 2024-09-17T07:19:38.283 INFO:tasks.workunit.client.0.smithi087.stdout:1/17: dwrite - no filename 2024-09-17T07:19:38.285 INFO:tasks.workunit.client.0.smithi087.stdout:1/18: mkdir d2 0 2024-09-17T07:19:38.285 INFO:tasks.workunit.client.0.smithi087.stdout:1/19: rename d2 to d2/d3 22 2024-09-17T07:19:38.285 INFO:tasks.workunit.client.0.smithi087.stdout:1/20: rename d2 to d2/d4 22 2024-09-17T07:19:38.287 INFO:tasks.workunit.client.0.smithi087.stdout:1/21: mkdir d2/d5 0 2024-09-17T07:19:38.288 INFO:tasks.workunit.client.0.smithi087.stdout:3/9: stat c2 0 2024-09-17T07:19:38.289 INFO:tasks.workunit.client.0.smithi087.stdout:5/7: fsync f1 0 2024-09-17T07:19:38.290 INFO:tasks.workunit.client.0.smithi087.stdout:1/22: mkdir d2/d5/d6 0 2024-09-17T07:19:38.291 INFO:tasks.workunit.client.0.smithi087.stdout:3/10: rename c2 to c3 0 2024-09-17T07:19:38.291 INFO:tasks.workunit.client.0.smithi087.stdout:3/11: dwrite - no filename 2024-09-17T07:19:38.293 INFO:tasks.workunit.client.0.smithi087.stdout:1/23: mkdir d2/d7 0 2024-09-17T07:19:38.293 INFO:tasks.workunit.client.0.smithi087.stdout:1/24: chown d2/d5/d6 25033 1 2024-09-17T07:19:38.293 INFO:tasks.workunit.client.0.smithi087.stdout:1/25: dread - no filename 2024-09-17T07:19:38.294 INFO:tasks.workunit.client.0.smithi087.stdout:3/12: creat f4 x:0 0 0 2024-09-17T07:19:38.295 INFO:tasks.workunit.client.0.smithi087.stdout:3/13: write f4 [358477,76016] 0 2024-09-17T07:19:38.296 INFO:tasks.workunit.client.0.smithi087.stdout:1/26: mknod d2/d5/c8 0 2024-09-17T07:19:38.299 INFO:tasks.workunit.client.0.smithi087.stdout:5/8: getdents . 0 2024-09-17T07:19:38.301 INFO:tasks.workunit.client.0.smithi087.stdout:1/27: creat d2/d7/f9 x:0 0 0 2024-09-17T07:19:38.302 INFO:tasks.workunit.client.0.smithi087.stdout:5/9: creat f2 x:0 0 0 2024-09-17T07:19:38.304 INFO:tasks.workunit.client.0.smithi087.stdout:3/14: dwrite f4 [0,4194304] 0 2024-09-17T07:19:38.304 INFO:tasks.workunit.client.0.smithi087.stdout:5/10: symlink l3 0 2024-09-17T07:19:38.306 INFO:tasks.workunit.client.0.smithi087.stdout:1/28: rename d2/d5/d6 to d2/da 0 2024-09-17T07:19:38.309 INFO:tasks.workunit.client.0.smithi087.stdout:1/29: dread - d2/d7/f9 zero size 2024-09-17T07:19:38.309 INFO:tasks.workunit.client.0.smithi087.stdout:8/6: getdents d1 0 2024-09-17T07:19:38.309 INFO:tasks.workunit.client.0.smithi087.stdout:8/7: dread - no filename 2024-09-17T07:19:38.309 INFO:tasks.workunit.client.0.smithi087.stdout:8/8: dread - no filename 2024-09-17T07:19:38.311 INFO:tasks.workunit.client.0.smithi087.stdout:9/8: rename f1 to f2 0 2024-09-17T07:19:38.312 INFO:tasks.workunit.client.0.smithi087.stdout:3/15: dread f4 [0,4194304] 0 2024-09-17T07:19:38.314 INFO:tasks.workunit.client.0.smithi087.stdout:9/9: chown f2 4009 1 2024-09-17T07:19:38.314 INFO:tasks.workunit.client.0.smithi087.stdout:7/12: rmdir d0 39 2024-09-17T07:19:38.314 INFO:tasks.workunit.client.0.smithi087.stdout:8/9: chown d1/l2 1270 1 2024-09-17T07:19:38.316 INFO:tasks.workunit.client.0.smithi087.stdout:5/11: dwrite f2 [0,4194304] 0 2024-09-17T07:19:38.316 INFO:tasks.workunit.client.0.smithi087.stdout:1/30: creat d2/d5/fb x:0 0 0 2024-09-17T07:19:38.317 INFO:tasks.workunit.client.0.smithi087.stdout:0/12: truncate f4 386036 0 2024-09-17T07:19:38.318 INFO:tasks.workunit.client.0.smithi087.stdout:8/10: rmdir d1 39 2024-09-17T07:19:38.319 INFO:tasks.workunit.client.0.smithi087.stdout:1/31: mkdir d2/dc 0 2024-09-17T07:19:38.319 INFO:tasks.workunit.client.0.smithi087.stdout:6/11: rmdir d1 39 2024-09-17T07:19:38.320 INFO:tasks.workunit.client.0.smithi087.stdout:0/13: write f2 [2532646,39748] 0 2024-09-17T07:19:38.322 INFO:tasks.workunit.client.0.smithi087.stdout:0/14: chown f2 461 1 2024-09-17T07:19:38.322 INFO:tasks.workunit.client.0.smithi087.stdout:7/13: mkdir d0/d3 0 2024-09-17T07:19:38.324 INFO:tasks.workunit.client.0.smithi087.stdout:3/16: dread f4 [0,4194304] 0 2024-09-17T07:19:38.327 INFO:tasks.workunit.client.0.smithi087.stdout:5/12: dwrite f2 [0,4194304] 0 2024-09-17T07:19:38.328 INFO:tasks.workunit.client.0.smithi087.stdout:5/13: chown f1 75747376 1 2024-09-17T07:19:38.330 INFO:tasks.workunit.client.0.smithi087.stdout:3/17: symlink l5 0 2024-09-17T07:19:38.332 INFO:tasks.workunit.client.0.smithi087.stdout:8/11: rename l0 to d1/l3 0 2024-09-17T07:19:38.334 INFO:tasks.workunit.client.0.smithi087.stdout:5/14: creat f4 x:0 0 0 2024-09-17T07:19:38.335 INFO:tasks.workunit.client.0.smithi087.stdout:7/14: getdents d0/d3 0 2024-09-17T07:19:38.335 INFO:tasks.workunit.client.0.smithi087.stdout:7/15: dread - d0/f2 zero size 2024-09-17T07:19:38.336 INFO:tasks.workunit.client.0.smithi087.stdout:3/18: mkdir d6 0 2024-09-17T07:19:38.343 INFO:tasks.workunit.client.0.smithi087.stdout:7/16: creat d0/d3/f4 x:0 0 0 2024-09-17T07:19:38.344 INFO:tasks.workunit.client.0.smithi087.stdout:5/15: dwrite f1 [0,4194304] 0 2024-09-17T07:19:38.346 INFO:tasks.workunit.client.0.smithi087.stdout:0/15: write f4 [440362,89403] 0 2024-09-17T07:19:38.347 INFO:tasks.workunit.client.0.smithi087.stdout:3/19: dread f4 [0,4194304] 0 2024-09-17T07:19:38.347 INFO:tasks.workunit.client.0.smithi087.stdout:1/32: getdents d2 0 2024-09-17T07:19:38.348 INFO:tasks.workunit.client.0.smithi087.stdout:8/12: link d1/l2 d1/l4 0 2024-09-17T07:19:38.348 INFO:tasks.workunit.client.0.smithi087.stdout:0/16: write f4 [1364603,36584] 0 2024-09-17T07:19:38.349 INFO:tasks.workunit.client.0.smithi087.stdout:3/20: read f4 [1099768,18426] 0 2024-09-17T07:19:38.350 INFO:tasks.workunit.client.0.smithi087.stdout:7/17: fsync d0/f1 0 2024-09-17T07:19:38.351 INFO:tasks.workunit.client.0.smithi087.stdout:1/33: write d2/d5/fb [937121,52851] 0 2024-09-17T07:19:38.352 INFO:tasks.workunit.client.0.smithi087.stdout:8/13: symlink d1/l5 0 2024-09-17T07:19:38.354 INFO:tasks.workunit.client.0.smithi087.stdout:5/16: dread f1 [0,4194304] 0 2024-09-17T07:19:38.355 INFO:tasks.workunit.client.0.smithi087.stdout:0/17: creat f5 x:0 0 0 2024-09-17T07:19:38.355 INFO:tasks.workunit.client.0.smithi087.stdout:6/12: truncate f0 336246 0 2024-09-17T07:19:38.357 INFO:tasks.workunit.client.0.smithi087.stdout:0/18: write f5 [889110,45309] 0 2024-09-17T07:19:38.357 INFO:tasks.workunit.client.0.smithi087.stdout:1/34: mkdir d2/d5/dd 0 2024-09-17T07:19:38.358 INFO:tasks.workunit.client.0.smithi087.stdout:3/21: dread f4 [0,4194304] 0 2024-09-17T07:19:38.359 INFO:tasks.workunit.client.0.smithi087.stdout:3/22: read f4 [2780547,76973] 0 2024-09-17T07:19:38.360 INFO:tasks.workunit.client.0.smithi087.stdout:7/18: dread d0/f1 [0,4194304] 0 2024-09-17T07:19:38.361 INFO:tasks.workunit.client.0.smithi087.stdout:1/35: read d2/d5/fb [683910,50050] 0 2024-09-17T07:19:38.362 INFO:tasks.workunit.client.0.smithi087.stdout:8/14: rename d1/l2 to d1/l6 0 2024-09-17T07:19:38.362 INFO:tasks.workunit.client.0.smithi087.stdout:8/15: write - no filename 2024-09-17T07:19:38.366 INFO:tasks.workunit.client.0.smithi087.stdout:1/36: mkdir d2/da/de 0 2024-09-17T07:19:38.366 INFO:tasks.workunit.client.0.smithi087.stdout:5/17: dwrite f1 [0,4194304] 0 2024-09-17T07:19:38.366 INFO:tasks.workunit.client.0.smithi087.stdout:8/16: mkdir d1/d7 0 2024-09-17T07:19:38.367 INFO:tasks.workunit.client.0.smithi087.stdout:5/18: write f1 [2126692,87838] 0 2024-09-17T07:19:38.373 INFO:tasks.workunit.client.0.smithi087.stdout:8/17: creat d1/f8 x:0 0 0 2024-09-17T07:19:38.374 INFO:tasks.workunit.client.0.smithi087.stdout:1/37: dwrite d2/d7/f9 [0,4194304] 0 2024-09-17T07:19:38.375 INFO:tasks.workunit.client.0.smithi087.stdout:8/18: write d1/f8 [585623,24552] 0 2024-09-17T07:19:38.375 INFO:tasks.workunit.client.0.smithi087.stdout:5/19: mkdir d5 0 2024-09-17T07:19:38.379 INFO:tasks.workunit.client.0.smithi087.stdout:8/19: readlink d1/l4 0 2024-09-17T07:19:38.380 INFO:tasks.workunit.client.0.smithi087.stdout:0/19: truncate f2 2734394 0 2024-09-17T07:19:38.381 INFO:tasks.workunit.client.0.smithi087.stdout:5/20: dread f1 [0,4194304] 0 2024-09-17T07:19:38.382 INFO:tasks.workunit.client.0.smithi087.stdout:6/13: write f0 [143176,112408] 0 2024-09-17T07:19:38.382 INFO:tasks.workunit.client.0.smithi087.stdout:0/20: creat f6 x:0 0 0 2024-09-17T07:19:38.383 INFO:tasks.workunit.client.0.smithi087.stdout:5/21: write f4 [359217,10527] 0 2024-09-17T07:19:38.384 INFO:tasks.workunit.client.0.smithi087.stdout:8/20: getdents d1/d7 0 2024-09-17T07:19:38.385 INFO:tasks.workunit.client.0.smithi087.stdout:0/21: mknod c7 0 2024-09-17T07:19:38.386 INFO:tasks.workunit.client.0.smithi087.stdout:5/22: write f1 [2575193,42259] 0 2024-09-17T07:19:38.388 INFO:tasks.workunit.client.0.smithi087.stdout:6/14: rename f0 to d1/f4 0 2024-09-17T07:19:38.393 INFO:tasks.workunit.client.0.smithi087.stdout:6/15: symlink d1/l5 0 2024-09-17T07:19:38.393 INFO:tasks.workunit.client.0.smithi087.stdout:8/21: dwrite d1/f8 [0,4194304] 0 2024-09-17T07:19:38.395 INFO:tasks.workunit.client.0.smithi087.stdout:5/23: creat d5/f6 x:0 0 0 2024-09-17T07:19:38.396 INFO:tasks.workunit.client.0.smithi087.stdout:8/22: readlink d1/l4 0 2024-09-17T07:19:38.401 INFO:tasks.workunit.client.0.smithi087.stdout:5/24: rename f1 to d5/f7 0 2024-09-17T07:19:38.402 INFO:tasks.workunit.client.0.smithi087.stdout:1/38: dwrite d2/d5/fb [0,4194304] 0 2024-09-17T07:19:38.406 INFO:tasks.workunit.client.0.smithi087.stdout:5/25: mkdir d5/d8 0 2024-09-17T07:19:38.409 INFO:tasks.workunit.client.0.smithi087.stdout:6/16: getdents d1 0 2024-09-17T07:19:38.411 INFO:tasks.workunit.client.0.smithi087.stdout:6/17: fdatasync d1/f3 0 2024-09-17T07:19:38.411 INFO:tasks.workunit.client.0.smithi087.stdout:1/39: creat d2/d5/dd/ff x:0 0 0 2024-09-17T07:19:38.413 INFO:tasks.workunit.client.0.smithi087.stdout:0/22: write f2 [1230309,79142] 0 2024-09-17T07:19:38.415 INFO:tasks.workunit.client.0.smithi087.stdout:6/18: dread d1/f4 [0,4194304] 0 2024-09-17T07:19:38.417 INFO:tasks.workunit.client.0.smithi087.stdout:1/40: rmdir d2/da/de 0 2024-09-17T07:19:38.418 INFO:tasks.workunit.client.0.smithi087.stdout:5/26: dwrite f2 [4194304,4194304] 0 2024-09-17T07:19:38.418 INFO:tasks.workunit.client.0.smithi087.stdout:1/41: read - d2/d5/dd/ff zero size 2024-09-17T07:19:38.419 INFO:tasks.workunit.client.0.smithi087.stdout:0/23: unlink f2 0 2024-09-17T07:19:38.420 INFO:tasks.workunit.client.0.smithi087.stdout:0/24: chown f4 0 1 2024-09-17T07:19:38.421 INFO:tasks.workunit.client.0.smithi087.stdout:1/42: write d2/d5/fb [1873370,119676] 0 2024-09-17T07:19:38.423 INFO:tasks.workunit.client.0.smithi087.stdout:8/23: truncate d1/f8 1684351 0 2024-09-17T07:19:38.430 INFO:tasks.workunit.client.0.smithi087.stdout:5/27: dwrite f2 [4194304,4194304] 0 2024-09-17T07:19:38.433 INFO:tasks.workunit.client.0.smithi087.stdout:8/24: write d1/f8 [134564,110871] 0 2024-09-17T07:19:38.434 INFO:tasks.workunit.client.0.smithi087.stdout:5/28: dread - d5/f6 zero size 2024-09-17T07:19:38.436 INFO:tasks.workunit.client.0.smithi087.stdout:8/25: read d1/f8 [179862,21706] 0 2024-09-17T07:19:38.437 INFO:tasks.workunit.client.0.smithi087.stdout:5/29: chown d5/f7 29 1 2024-09-17T07:19:38.437 INFO:tasks.workunit.client.0.smithi087.stdout:0/25: dwrite f4 [0,4194304] 0 2024-09-17T07:19:38.438 INFO:tasks.workunit.client.0.smithi087.stdout:0/26: rmdir - no directory 2024-09-17T07:19:38.438 INFO:tasks.workunit.client.0.smithi087.stdout:1/43: dwrite d2/d5/dd/ff [0,4194304] 0 2024-09-17T07:19:38.440 INFO:tasks.workunit.client.0.smithi087.stdout:0/27: write f6 [746170,83880] 0 2024-09-17T07:19:38.440 INFO:tasks.workunit.client.0.smithi087.stdout:8/26: write d1/f8 [2017572,116698] 0 2024-09-17T07:19:38.442 INFO:tasks.workunit.client.0.smithi087.stdout:5/30: mkdir d5/d9 0 2024-09-17T07:19:38.443 INFO:tasks.workunit.client.0.smithi087.stdout:1/44: mknod d2/c10 0 2024-09-17T07:19:38.445 INFO:tasks.workunit.client.0.smithi087.stdout:1/45: stat d2/d7/f9 0 2024-09-17T07:19:38.451 INFO:tasks.workunit.client.0.smithi087.stdout:5/31: creat d5/d9/fa x:0 0 0 2024-09-17T07:19:38.451 INFO:tasks.workunit.client.0.smithi087.stdout:1/46: mknod d2/dc/c11 0 2024-09-17T07:19:38.454 INFO:tasks.workunit.client.0.smithi087.stdout:8/27: dwrite d1/f8 [0,4194304] 0 2024-09-17T07:19:38.454 INFO:tasks.workunit.client.0.smithi087.stdout:0/28: dwrite f4 [0,4194304] 0 2024-09-17T07:19:38.455 INFO:tasks.workunit.client.0.smithi087.stdout:0/29: fdatasync f5 0 2024-09-17T07:19:38.456 INFO:tasks.workunit.client.0.smithi087.stdout:1/47: rename d2/c10 to d2/d7/c12 0 2024-09-17T07:19:38.459 INFO:tasks.workunit.client.0.smithi087.stdout:1/48: symlink d2/l13 0 2024-09-17T07:19:38.460 INFO:tasks.workunit.client.0.smithi087.stdout:8/28: dread d1/f8 [0,4194304] 0 2024-09-17T07:19:38.462 INFO:tasks.workunit.client.0.smithi087.stdout:8/29: rmdir d1 39 2024-09-17T07:19:38.470 INFO:tasks.workunit.client.0.smithi087.stdout:1/49: unlink d2/d7/c12 0 2024-09-17T07:19:38.470 INFO:tasks.workunit.client.0.smithi087.stdout:1/50: stat d2/d5/dd/ff 0 2024-09-17T07:19:38.472 INFO:tasks.workunit.client.0.smithi087.stdout:1/51: rename d2/d5 to d2/d14 0 2024-09-17T07:19:38.473 INFO:tasks.workunit.client.0.smithi087.stdout:1/52: write d2/d14/fb [3165698,86117] 0 2024-09-17T07:19:38.479 INFO:tasks.workunit.client.0.smithi087.stdout:8/30: fdatasync d1/f8 0 2024-09-17T07:19:38.479 INFO:tasks.workunit.client.0.smithi087.stdout:1/53: dwrite d2/d7/f9 [0,4194304] 0 2024-09-17T07:19:38.480 INFO:tasks.workunit.client.0.smithi087.stdout:1/54: write d2/d14/dd/ff [2535319,10728] 0 2024-09-17T07:19:38.483 INFO:tasks.workunit.client.0.smithi087.stdout:8/31: mkdir d1/d7/d9 0 2024-09-17T07:19:38.484 INFO:tasks.workunit.client.0.smithi087.stdout:8/32: write d1/f8 [1124449,66062] 0 2024-09-17T07:19:38.485 INFO:tasks.workunit.client.0.smithi087.stdout:1/55: rename d2/d14/c8 to d2/c15 0 2024-09-17T07:19:38.485 INFO:tasks.workunit.client.0.smithi087.stdout:1/56: chown d2 14 1 2024-09-17T07:19:38.487 INFO:tasks.workunit.client.0.smithi087.stdout:8/33: rename d1/l3 to d1/la 0 2024-09-17T07:19:38.487 INFO:tasks.workunit.client.0.smithi087.stdout:1/57: creat d2/da/f16 x:0 0 0 2024-09-17T07:19:38.491 INFO:tasks.workunit.client.0.smithi087.stdout:8/34: dread d1/f8 [0,4194304] 0 2024-09-17T07:19:38.491 INFO:tasks.workunit.client.0.smithi087.stdout:8/35: rename d1 to d1/d7/db 22 2024-09-17T07:19:38.491 INFO:tasks.workunit.client.0.smithi087.stdout:8/36: stat d1 0 2024-09-17T07:19:38.493 INFO:tasks.workunit.client.0.smithi087.stdout:1/58: fsync d2/da/f16 0 2024-09-17T07:19:38.495 INFO:tasks.workunit.client.0.smithi087.stdout:8/37: creat d1/d7/d9/fc x:0 0 0 2024-09-17T07:19:38.496 INFO:tasks.workunit.client.0.smithi087.stdout:1/59: unlink d2/dc/c11 0 2024-09-17T07:19:38.496 INFO:tasks.workunit.client.0.smithi087.stdout:8/38: chown d1/l4 9686 1 2024-09-17T07:19:38.497 INFO:tasks.workunit.client.0.smithi087.stdout:1/60: dread - d2/da/f16 zero size 2024-09-17T07:19:38.498 INFO:tasks.workunit.client.0.smithi087.stdout:8/39: write d1/f8 [617887,53495] 0 2024-09-17T07:19:38.498 INFO:tasks.workunit.client.0.smithi087.stdout:8/40: readlink d1/la 0 2024-09-17T07:19:38.499 INFO:tasks.workunit.client.0.smithi087.stdout:1/61: rename d2/l13 to d2/d7/l17 0 2024-09-17T07:19:38.500 INFO:tasks.workunit.client.0.smithi087.stdout:8/41: write d1/d7/d9/fc [119451,112197] 0 2024-09-17T07:19:38.500 INFO:tasks.workunit.client.0.smithi087.stdout:1/62: write d2/d7/f9 [825428,66782] 0 2024-09-17T07:19:38.502 INFO:tasks.workunit.client.0.smithi087.stdout:1/63: creat d2/d14/dd/f18 x:0 0 0 2024-09-17T07:19:38.503 INFO:tasks.workunit.client.0.smithi087.stdout:8/42: dread d1/d7/d9/fc [0,4194304] 0 2024-09-17T07:19:38.504 INFO:tasks.workunit.client.0.smithi087.stdout:1/64: mknod d2/dc/c19 0 2024-09-17T07:19:38.504 INFO:tasks.workunit.client.0.smithi087.stdout:1/65: fdatasync d2/d7/f9 0 2024-09-17T07:19:38.505 INFO:tasks.workunit.client.0.smithi087.stdout:8/43: mknod d1/d7/cd 0 2024-09-17T07:19:38.507 INFO:tasks.workunit.client.0.smithi087.stdout:1/66: mkdir d2/d1a 0 2024-09-17T07:19:38.507 INFO:tasks.workunit.client.0.smithi087.stdout:8/44: symlink d1/d7/le 0 2024-09-17T07:19:38.509 INFO:tasks.workunit.client.0.smithi087.stdout:8/45: creat d1/ff x:0 0 0 2024-09-17T07:19:38.510 INFO:tasks.workunit.client.0.smithi087.stdout:1/67: link d2/dc/c19 d2/d1a/c1b 0 2024-09-17T07:19:38.510 INFO:tasks.workunit.client.0.smithi087.stdout:8/46: write d1/ff [661775,33071] 0 2024-09-17T07:19:38.511 INFO:tasks.workunit.client.0.smithi087.stdout:1/68: dread - d2/da/f16 zero size 2024-09-17T07:19:38.512 INFO:tasks.workunit.client.0.smithi087.stdout:1/69: truncate d2/da/f16 485899 0 2024-09-17T07:19:38.512 INFO:tasks.workunit.client.0.smithi087.stdout:8/47: unlink d1/la 0 2024-09-17T07:19:38.514 INFO:tasks.workunit.client.0.smithi087.stdout:8/48: write d1/d7/d9/fc [706017,41219] 0 2024-09-17T07:19:38.514 INFO:tasks.workunit.client.0.smithi087.stdout:1/70: creat d2/d1a/f1c x:0 0 0 2024-09-17T07:19:38.515 INFO:tasks.workunit.client.0.smithi087.stdout:8/49: mkdir d1/d10 0 2024-09-17T07:19:38.516 INFO:tasks.workunit.client.0.smithi087.stdout:8/50: readlink d1/l6 0 2024-09-17T07:19:38.518 INFO:tasks.workunit.client.0.smithi087.stdout:8/51: unlink d1/d7/cd 0 2024-09-17T07:19:38.520 INFO:tasks.workunit.client.0.smithi087.stdout:1/71: readlink d2/d7/l17 0 2024-09-17T07:19:38.522 INFO:tasks.workunit.client.0.smithi087.stdout:1/72: dread - d2/d14/dd/f18 zero size 2024-09-17T07:19:38.524 INFO:tasks.workunit.client.0.smithi087.stdout:1/73: readlink d2/d7/l17 0 2024-09-17T07:19:38.525 INFO:tasks.workunit.client.0.smithi087.stdout:8/52: dwrite d1/ff [0,4194304] 0 2024-09-17T07:19:38.525 INFO:tasks.workunit.client.0.smithi087.stdout:1/74: dread - d2/d14/dd/f18 zero size 2024-09-17T07:19:38.530 INFO:tasks.workunit.client.0.smithi087.stdout:1/75: mkdir d2/d7/d1d 0 2024-09-17T07:19:38.534 INFO:tasks.workunit.client.0.smithi087.stdout:1/76: dread d2/d7/f9 [0,4194304] 0 2024-09-17T07:19:38.536 INFO:tasks.workunit.client.0.smithi087.stdout:1/77: symlink d2/da/l1e 0 2024-09-17T07:19:38.540 INFO:tasks.workunit.client.0.smithi087.stdout:1/78: dread d2/d14/fb [0,4194304] 0 2024-09-17T07:19:38.542 INFO:tasks.workunit.client.0.smithi087.stdout:1/79: rename d2/d7/d1d to d2/d14/d1f 0 2024-09-17T07:19:38.543 INFO:tasks.workunit.client.0.smithi087.stdout:1/80: fsync d2/d14/dd/ff 0 2024-09-17T07:19:38.546 INFO:tasks.workunit.client.0.smithi087.stdout:1/81: creat d2/d14/dd/f20 x:0 0 0 2024-09-17T07:19:38.549 INFO:tasks.workunit.client.0.smithi087.stdout:8/53: dwrite d1/ff [4194304,4194304] 0 2024-09-17T07:19:38.551 INFO:tasks.workunit.client.0.smithi087.stdout:8/54: chown d1/f8 12949 1 2024-09-17T07:19:38.551 INFO:tasks.workunit.client.0.smithi087.stdout:1/82: fsync d2/d14/dd/f20 0 2024-09-17T07:19:38.554 INFO:tasks.workunit.client.0.smithi087.stdout:1/83: truncate d2/d1a/f1c 1031981 0 2024-09-17T07:19:38.557 INFO:tasks.workunit.client.0.smithi087.stdout:1/84: rmdir d2/d1a 39 2024-09-17T07:19:38.557 INFO:tasks.workunit.client.0.smithi087.stdout:1/85: stat d2 0 2024-09-17T07:19:38.559 INFO:tasks.workunit.client.0.smithi087.stdout:8/55: dwrite d1/ff [0,4194304] 0 2024-09-17T07:19:38.559 INFO:tasks.workunit.client.0.smithi087.stdout:1/86: truncate d2/d14/dd/f18 699579 0 2024-09-17T07:19:38.561 INFO:tasks.workunit.client.0.smithi087.stdout:8/56: chown d1/d7/le 106 1 2024-09-17T07:19:38.562 INFO:tasks.workunit.client.0.smithi087.stdout:1/87: creat d2/d7/f21 x:0 0 0 2024-09-17T07:19:38.562 INFO:tasks.workunit.client.0.smithi087.stdout:8/57: chown d1/d10 111479665 1 2024-09-17T07:19:38.563 INFO:tasks.workunit.client.0.smithi087.stdout:1/88: mknod d2/d14/d1f/c22 0 2024-09-17T07:19:38.565 INFO:tasks.workunit.client.0.smithi087.stdout:1/89: write d2/d14/dd/ff [4962814,52394] 0 2024-09-17T07:19:38.569 INFO:tasks.workunit.client.0.smithi087.stdout:8/58: link d1/d7/d9/fc d1/d10/f11 0 2024-09-17T07:19:38.569 INFO:tasks.workunit.client.0.smithi087.stdout:1/90: creat d2/dc/f23 x:0 0 0 2024-09-17T07:19:38.575 INFO:tasks.workunit.client.0.smithi087.stdout:1/91: dwrite d2/d14/dd/f20 [0,4194304] 0 2024-09-17T07:19:38.578 INFO:tasks.workunit.client.0.smithi087.stdout:8/59: truncate d1/f8 1321088 0 2024-09-17T07:19:38.589 INFO:tasks.workunit.client.0.smithi087.stdout:8/60: dread d1/f8 [0,4194304] 0 2024-09-17T07:19:38.593 INFO:tasks.workunit.client.0.smithi087.stdout:8/61: link d1/l5 d1/d7/d9/l12 0 2024-09-17T07:19:38.594 INFO:tasks.workunit.client.0.smithi087.stdout:8/62: creat d1/d7/f13 x:0 0 0 2024-09-17T07:19:38.594 INFO:tasks.workunit.client.0.smithi087.stdout:8/63: dread - d1/d7/f13 zero size 2024-09-17T07:19:38.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:38 smithi139 ceph-mon[34403]: pgmap v242: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 3.4 MiB/s rd, 6.3 MiB/s wr, 484 op/s 2024-09-17T07:19:38.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:38 smithi087 ceph-mon[27636]: pgmap v242: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 3.4 MiB/s rd, 6.3 MiB/s wr, 484 op/s 2024-09-17T07:19:40.200 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:39 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:19:40.200 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:39 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:19:40.200 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:39 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:19:40.200 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:39 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:19:40.200 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:39 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:19:40.200 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:39 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:19:40.201 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:39 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mgr fail", "who": "smithi087.vuvjer"}]: dispatch 2024-09-17T07:19:40.201 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:39 smithi087 ceph-mon[27636]: Activating manager daemon smithi139.tuqnpn 2024-09-17T07:19:40.201 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:39 smithi087 ceph-mon[27636]: osdmap e45: 6 total, 6 up, 6 in 2024-09-17T07:19:40.201 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:39 smithi087 ceph-mon[27636]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "mgr fail", "who": "smithi087.vuvjer"}]': finished 2024-09-17T07:19:40.201 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:39 smithi087 ceph-mon[27636]: mgrmap e21: smithi139.tuqnpn(active, starting, since 0.00941095s) 2024-09-17T07:19:40.201 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:39 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "mon metadata", "id": "smithi087"}]: dispatch 2024-09-17T07:19:40.201 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:39 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "mon metadata", "id": "smithi139"}]: dispatch 2024-09-17T07:19:40.201 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:39 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi087.tjhpcs"}]: dispatch 2024-09-17T07:19:40.201 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:39 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi087.vvbzss"}]: dispatch 2024-09-17T07:19:40.201 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:39 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi139.gnwonz"}]: dispatch 2024-09-17T07:19:40.201 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:39 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi139.ftvinf"}]: dispatch 2024-09-17T07:19:40.201 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:39 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "mgr metadata", "who": "smithi139.tuqnpn", "id": "smithi139.tuqnpn"}]: dispatch 2024-09-17T07:19:40.201 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:39 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T07:19:40.201 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:39 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T07:19:40.202 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:39 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T07:19:40.202 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:39 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T07:19:40.202 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:39 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T07:19:40.202 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:39 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T07:19:40.202 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:39 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T07:19:40.202 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:39 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T07:19:40.202 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:39 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T07:19:40.202 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:39 smithi087 ceph-mon[27636]: Manager daemon smithi139.tuqnpn is now available 2024-09-17T07:19:40.202 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:39 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:19:40.202 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:39 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:19:40.202 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:39 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi139.tuqnpn/mirror_snapshot_schedule"}]: dispatch 2024-09-17T07:19:40.202 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:39 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi139.tuqnpn/trash_purge_schedule"}]: dispatch 2024-09-17T07:19:40.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:39 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:19:40.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:39 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:19:40.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:39 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:19:40.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:39 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:19:40.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:39 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' 2024-09-17T07:19:40.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:39 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:19:40.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:39 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mgr fail", "who": "smithi087.vuvjer"}]: dispatch 2024-09-17T07:19:40.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:39 smithi139 ceph-mon[34403]: Activating manager daemon smithi139.tuqnpn 2024-09-17T07:19:40.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:39 smithi139 ceph-mon[34403]: osdmap e45: 6 total, 6 up, 6 in 2024-09-17T07:19:40.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:39 smithi139 ceph-mon[34403]: from='mgr.14208 172.21.15.87:0/3971422060' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "mgr fail", "who": "smithi087.vuvjer"}]': finished 2024-09-17T07:19:40.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:39 smithi139 ceph-mon[34403]: mgrmap e21: smithi139.tuqnpn(active, starting, since 0.00941095s) 2024-09-17T07:19:40.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:39 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "mon metadata", "id": "smithi087"}]: dispatch 2024-09-17T07:19:40.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:39 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "mon metadata", "id": "smithi139"}]: dispatch 2024-09-17T07:19:40.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:39 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi087.tjhpcs"}]: dispatch 2024-09-17T07:19:40.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:39 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi087.vvbzss"}]: dispatch 2024-09-17T07:19:40.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:39 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi139.gnwonz"}]: dispatch 2024-09-17T07:19:40.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:39 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi139.ftvinf"}]: dispatch 2024-09-17T07:19:40.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:39 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "mgr metadata", "who": "smithi139.tuqnpn", "id": "smithi139.tuqnpn"}]: dispatch 2024-09-17T07:19:40.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:39 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T07:19:40.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:39 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T07:19:40.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:39 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T07:19:40.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:39 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T07:19:40.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:39 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T07:19:40.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:39 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T07:19:40.369 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:39 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T07:19:40.369 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:39 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T07:19:40.369 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:39 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T07:19:40.369 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:39 smithi139 ceph-mon[34403]: Manager daemon smithi139.tuqnpn is now available 2024-09-17T07:19:40.369 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:39 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:19:40.369 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:39 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:19:40.369 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:39 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi139.tuqnpn/mirror_snapshot_schedule"}]: dispatch 2024-09-17T07:19:40.369 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:39 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi139.tuqnpn/trash_purge_schedule"}]: dispatch 2024-09-17T07:19:41.092 INFO:tasks.workunit.client.1.smithi139.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-17T07:19:41.107 INFO:tasks.workunit.client.1.smithi139.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-17T07:19:41.108 INFO:tasks.workunit.client.1.smithi139.stderr:+ make 2024-09-17T07:19:41.245 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:40 smithi087 ceph-mon[27636]: Deploying cephadm binary to smithi139 2024-09-17T07:19:41.245 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:40 smithi087 ceph-mon[27636]: Deploying cephadm binary to smithi087 2024-09-17T07:19:41.245 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:40 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:19:41.245 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:40 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:19:41.245 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:40 smithi087 ceph-mon[27636]: mgrmap e22: smithi139.tuqnpn(active, since 1.32919s) 2024-09-17T07:19:41.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:40 smithi139 ceph-mon[34403]: Deploying cephadm binary to smithi139 2024-09-17T07:19:41.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:40 smithi139 ceph-mon[34403]: Deploying cephadm binary to smithi087 2024-09-17T07:19:41.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:40 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:19:41.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:40 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:19:41.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:40 smithi139 ceph-mon[34403]: mgrmap e22: smithi139.tuqnpn(active, since 1.32919s) 2024-09-17T07:19:41.470 INFO:tasks.workunit.client.1.smithi139.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-17T07:19:42.269 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:41 smithi087 ceph-mon[27636]: pgmap v3: 65 pgs: 65 active+clean; 285 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-09-17T07:19:42.269 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:41 smithi087 ceph-mon[27636]: pgmap v4: 65 pgs: 65 active+clean; 285 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-09-17T07:19:42.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:41 smithi139 ceph-mon[34403]: pgmap v3: 65 pgs: 65 active+clean; 285 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-09-17T07:19:42.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:41 smithi139 ceph-mon[34403]: pgmap v4: 65 pgs: 65 active+clean; 285 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-09-17T07:19:42.884 INFO:tasks.workunit.client.1.smithi139.stderr:++ readlink -f fsstress 2024-09-17T07:19:42.886 INFO:tasks.workunit.client.1.smithi139.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-17T07:19:42.886 INFO:tasks.workunit.client.1.smithi139.stderr:+ popd 2024-09-17T07:19:42.886 INFO:tasks.workunit.client.1.smithi139.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-17T07:19:42.887 INFO:tasks.workunit.client.1.smithi139.stderr:+ popd 2024-09-17T07:19:42.887 INFO:tasks.workunit.client.1.smithi139.stdout:~/cephtest/mnt.1/client.1/tmp 2024-09-17T07:19:42.887 INFO:tasks.workunit.client.1.smithi139.stderr:++ mktemp -d -p . 2024-09-17T07:19:42.890 INFO:tasks.workunit.client.1.smithi139.stderr:+ T=./tmp.KTEkRAiRQN 2024-09-17T07:19:42.890 INFO:tasks.workunit.client.1.smithi139.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.KTEkRAiRQN -l 1 -n 1000 -p 10 -v 2024-09-17T07:19:42.893 INFO:tasks.workunit.client.1.smithi139.stdout:seed = 1726254718 2024-09-17T07:19:42.896 INFO:tasks.workunit.client.1.smithi139.stdout:0/0: chown . 68207244 1 2024-09-17T07:19:42.896 INFO:tasks.workunit.client.1.smithi139.stdout:0/1: dread - no filename 2024-09-17T07:19:42.896 INFO:tasks.workunit.client.1.smithi139.stdout:0/2: dread - no filename 2024-09-17T07:19:42.896 INFO:tasks.workunit.client.1.smithi139.stdout:0/3: chown . 1085047 1 2024-09-17T07:19:42.896 INFO:tasks.workunit.client.1.smithi139.stdout:0/4: rmdir - no directory 2024-09-17T07:19:42.896 INFO:tasks.workunit.client.1.smithi139.stdout:0/5: dwrite - no filename 2024-09-17T07:19:42.896 INFO:tasks.workunit.client.1.smithi139.stdout:0/6: dread - no filename 2024-09-17T07:19:42.896 INFO:tasks.workunit.client.1.smithi139.stdout:0/7: truncate - no filename 2024-09-17T07:19:42.897 INFO:tasks.workunit.client.1.smithi139.stdout:0/8: mknod c0 0 2024-09-17T07:19:42.898 INFO:tasks.workunit.client.1.smithi139.stdout:2/0: link - no file 2024-09-17T07:19:42.899 INFO:tasks.workunit.client.1.smithi139.stdout:0/9: mkdir d1 0 2024-09-17T07:19:42.899 INFO:tasks.workunit.client.1.smithi139.stdout:1/0: creat f0 x:0 0 0 2024-09-17T07:19:42.900 INFO:tasks.workunit.client.1.smithi139.stdout:1/1: truncate f0 625112 0 2024-09-17T07:19:42.900 INFO:tasks.workunit.client.1.smithi139.stdout:3/0: dwrite - no filename 2024-09-17T07:19:42.901 INFO:tasks.workunit.client.1.smithi139.stdout:3/1: readlink - no filename 2024-09-17T07:19:42.901 INFO:tasks.workunit.client.1.smithi139.stdout:1/2: read f0 [454589,9293] 0 2024-09-17T07:19:42.901 INFO:tasks.workunit.client.1.smithi139.stdout:3/2: chown . 4434231 1 2024-09-17T07:19:42.901 INFO:tasks.workunit.client.1.smithi139.stdout:2/1: mkdir d0 0 2024-09-17T07:19:42.901 INFO:tasks.workunit.client.1.smithi139.stdout:2/2: dwrite - no filename 2024-09-17T07:19:42.901 INFO:tasks.workunit.client.1.smithi139.stdout:2/3: dwrite - no filename 2024-09-17T07:19:42.901 INFO:tasks.workunit.client.1.smithi139.stdout:2/4: write - no filename 2024-09-17T07:19:42.901 INFO:tasks.workunit.client.1.smithi139.stdout:2/5: write - no filename 2024-09-17T07:19:42.902 INFO:tasks.workunit.client.1.smithi139.stdout:0/10: mknod d1/c2 0 2024-09-17T07:19:42.902 INFO:tasks.workunit.client.1.smithi139.stdout:0/11: dwrite - no filename 2024-09-17T07:19:42.902 INFO:tasks.workunit.client.1.smithi139.stdout:0/12: dwrite - no filename 2024-09-17T07:19:42.902 INFO:tasks.workunit.client.1.smithi139.stdout:0/13: write - no filename 2024-09-17T07:19:42.903 INFO:tasks.workunit.client.1.smithi139.stdout:4/0: readlink - no filename 2024-09-17T07:19:42.903 INFO:tasks.workunit.client.1.smithi139.stdout:4/1: rename - no filename 2024-09-17T07:19:42.903 INFO:tasks.workunit.client.1.smithi139.stdout:4/2: write - no filename 2024-09-17T07:19:42.903 INFO:tasks.workunit.client.1.smithi139.stdout:1/3: creat f1 x:0 0 0 2024-09-17T07:19:42.904 INFO:tasks.workunit.client.1.smithi139.stdout:1/4: truncate f1 1016386 0 2024-09-17T07:19:42.904 INFO:tasks.workunit.client.1.smithi139.stdout:1/5: chown f0 476 1 2024-09-17T07:19:42.904 INFO:tasks.workunit.client.1.smithi139.stdout:0/14: creat d1/f3 x:0 0 0 2024-09-17T07:19:42.905 INFO:tasks.workunit.client.1.smithi139.stdout:0/15: chown d1/c2 240375814 1 2024-09-17T07:19:42.905 INFO:tasks.workunit.client.1.smithi139.stdout:3/3: mknod c0 0 2024-09-17T07:19:42.907 INFO:tasks.workunit.client.1.smithi139.stdout:2/6: mknod d0/c1 0 2024-09-17T07:19:42.907 INFO:tasks.workunit.client.1.smithi139.stdout:2/7: write - no filename 2024-09-17T07:19:42.907 INFO:tasks.workunit.client.1.smithi139.stdout:2/8: chown d0 16231 1 2024-09-17T07:19:42.908 INFO:tasks.workunit.client.1.smithi139.stdout:1/6: mkdir d2 0 2024-09-17T07:19:42.908 INFO:tasks.workunit.client.1.smithi139.stdout:4/3: mkdir d0 0 2024-09-17T07:19:42.908 INFO:tasks.workunit.client.1.smithi139.stdout:4/4: read - no filename 2024-09-17T07:19:42.908 INFO:tasks.workunit.client.1.smithi139.stdout:4/5: dwrite - no filename 2024-09-17T07:19:42.908 INFO:tasks.workunit.client.1.smithi139.stdout:4/6: write - no filename 2024-09-17T07:19:42.909 INFO:tasks.workunit.client.1.smithi139.stdout:4/7: write - no filename 2024-09-17T07:19:42.910 INFO:tasks.workunit.client.1.smithi139.stdout:2/9: rename d0/c1 to d0/c2 0 2024-09-17T07:19:42.911 INFO:tasks.workunit.client.1.smithi139.stdout:5/0: creat f0 x:0 0 0 2024-09-17T07:19:42.912 INFO:tasks.workunit.client.1.smithi139.stdout:7/0: write - no filename 2024-09-17T07:19:42.914 INFO:tasks.workunit.client.1.smithi139.stdout:2/10: creat d0/f3 x:0 0 0 2024-09-17T07:19:42.914 INFO:tasks.workunit.client.1.smithi139.stdout:1/7: mknod d2/c3 0 2024-09-17T07:19:42.915 INFO:tasks.workunit.client.1.smithi139.stdout:6/0: symlink l0 0 2024-09-17T07:19:42.915 INFO:tasks.workunit.client.1.smithi139.stdout:6/1: write - no filename 2024-09-17T07:19:42.915 INFO:tasks.workunit.client.1.smithi139.stdout:6/2: dread - no filename 2024-09-17T07:19:42.915 INFO:tasks.workunit.client.1.smithi139.stdout:6/3: write - no filename 2024-09-17T07:19:42.915 INFO:tasks.workunit.client.1.smithi139.stdout:6/4: read - no filename 2024-09-17T07:19:42.915 INFO:tasks.workunit.client.1.smithi139.stdout:6/5: truncate - no filename 2024-09-17T07:19:42.915 INFO:tasks.workunit.client.1.smithi139.stdout:6/6: dread - no filename 2024-09-17T07:19:42.916 INFO:tasks.workunit.client.1.smithi139.stdout:1/8: chown d2/c3 517151 1 2024-09-17T07:19:42.917 INFO:tasks.workunit.client.1.smithi139.stdout:8/0: unlink - no file 2024-09-17T07:19:42.917 INFO:tasks.workunit.client.1.smithi139.stdout:8/1: read - no filename 2024-09-17T07:19:42.917 INFO:tasks.workunit.client.1.smithi139.stdout:8/2: dwrite - no filename 2024-09-17T07:19:42.917 INFO:tasks.workunit.client.1.smithi139.stdout:8/3: dwrite - no filename 2024-09-17T07:19:42.917 INFO:tasks.workunit.client.1.smithi139.stdout:8/4: dread - no filename 2024-09-17T07:19:42.917 INFO:tasks.workunit.client.1.smithi139.stdout:8/5: dwrite - no filename 2024-09-17T07:19:42.917 INFO:tasks.workunit.client.1.smithi139.stdout:1/9: chown f0 1378114662 1 2024-09-17T07:19:42.918 INFO:tasks.workunit.client.1.smithi139.stdout:1/10: fdatasync f1 0 2024-09-17T07:19:42.918 INFO:tasks.workunit.client.1.smithi139.stdout:2/11: creat d0/f4 x:0 0 0 2024-09-17T07:19:42.918 INFO:tasks.workunit.client.1.smithi139.stdout:1/11: chown f1 18741924 1 2024-09-17T07:19:42.918 INFO:tasks.workunit.client.1.smithi139.stdout:6/7: creat f1 x:0 0 0 2024-09-17T07:19:42.919 INFO:tasks.workunit.client.1.smithi139.stdout:2/12: truncate d0/f3 885394 0 2024-09-17T07:19:42.919 INFO:tasks.workunit.client.1.smithi139.stdout:7/1: getdents . 0 2024-09-17T07:19:42.919 INFO:tasks.workunit.client.1.smithi139.stdout:7/2: write - no filename 2024-09-17T07:19:42.919 INFO:tasks.workunit.client.1.smithi139.stdout:1/12: write f1 [1587014,73877] 0 2024-09-17T07:19:42.920 INFO:tasks.workunit.client.1.smithi139.stdout:6/8: write f1 [835643,55893] 0 2024-09-17T07:19:42.921 INFO:tasks.workunit.client.1.smithi139.stdout:6/9: stat l0 0 2024-09-17T07:19:42.921 INFO:tasks.workunit.client.1.smithi139.stdout:1/13: write f1 [545958,126031] 0 2024-09-17T07:19:42.921 INFO:tasks.workunit.client.1.smithi139.stdout:9/0: read - no filename 2024-09-17T07:19:42.922 INFO:tasks.workunit.client.1.smithi139.stdout:9/1: rmdir - no directory 2024-09-17T07:19:42.922 INFO:tasks.workunit.client.1.smithi139.stdout:9/2: truncate - no filename 2024-09-17T07:19:42.922 INFO:tasks.workunit.client.1.smithi139.stdout:9/3: stat - no entries 2024-09-17T07:19:42.922 INFO:tasks.workunit.client.1.smithi139.stdout:9/4: write - no filename 2024-09-17T07:19:42.922 INFO:tasks.workunit.client.1.smithi139.stdout:9/5: dwrite - no filename 2024-09-17T07:19:42.922 INFO:tasks.workunit.client.1.smithi139.stdout:9/6: rename - no filename 2024-09-17T07:19:42.922 INFO:tasks.workunit.client.1.smithi139.stdout:9/7: unlink - no file 2024-09-17T07:19:42.923 INFO:tasks.workunit.client.1.smithi139.stdout:2/13: creat d0/f5 x:0 0 0 2024-09-17T07:19:42.924 INFO:tasks.workunit.client.1.smithi139.stdout:2/14: write d0/f4 [677299,44891] 0 2024-09-17T07:19:42.924 INFO:tasks.workunit.client.1.smithi139.stdout:8/6: mkdir d0 0 2024-09-17T07:19:42.925 INFO:tasks.workunit.client.1.smithi139.stdout:8/7: chown d0 2 1 2024-09-17T07:19:42.925 INFO:tasks.workunit.client.1.smithi139.stdout:2/15: write d0/f3 [128135,73511] 0 2024-09-17T07:19:42.925 INFO:tasks.workunit.client.1.smithi139.stdout:6/10: creat f2 x:0 0 0 2024-09-17T07:19:42.927 INFO:tasks.workunit.client.1.smithi139.stdout:1/14: creat d2/f4 x:0 0 0 2024-09-17T07:19:42.928 INFO:tasks.workunit.client.1.smithi139.stdout:1/15: chown d2/c3 14488599 1 2024-09-17T07:19:42.928 INFO:tasks.workunit.client.1.smithi139.stdout:1/16: chown f1 481679501 1 2024-09-17T07:19:42.929 INFO:tasks.workunit.client.1.smithi139.stdout:6/11: mknod c3 0 2024-09-17T07:19:42.930 INFO:tasks.workunit.client.1.smithi139.stdout:9/8: creat f0 x:0 0 0 2024-09-17T07:19:42.931 INFO:tasks.workunit.client.1.smithi139.stdout:8/8: mknod d0/c1 0 2024-09-17T07:19:42.931 INFO:tasks.workunit.client.1.smithi139.stdout:9/9: chown f0 2012202 1 2024-09-17T07:19:42.932 INFO:tasks.workunit.client.1.smithi139.stdout:9/10: truncate f0 972831 0 2024-09-17T07:19:42.932 INFO:tasks.workunit.client.1.smithi139.stdout:9/11: chown f0 12818 1 2024-09-17T07:19:42.934 INFO:tasks.workunit.client.1.smithi139.stdout:6/12: mknod c4 0 2024-09-17T07:19:42.936 INFO:tasks.workunit.client.1.smithi139.stdout:6/13: write f2 [546298,7391] 0 2024-09-17T07:19:42.936 INFO:tasks.workunit.client.1.smithi139.stdout:8/9: rename d0/c1 to d0/c2 0 2024-09-17T07:19:42.936 INFO:tasks.workunit.client.1.smithi139.stdout:8/10: write - no filename 2024-09-17T07:19:42.936 INFO:tasks.workunit.client.1.smithi139.stdout:8/11: fsync - no filename 2024-09-17T07:19:42.939 INFO:tasks.workunit.client.1.smithi139.stdout:6/14: unlink l0 0 2024-09-17T07:19:42.940 INFO:tasks.workunit.client.1.smithi139.stdout:8/12: symlink d0/l3 0 2024-09-17T07:19:42.941 INFO:tasks.workunit.client.1.smithi139.stdout:6/15: write f1 [1754075,127426] 0 2024-09-17T07:19:42.942 INFO:tasks.workunit.client.1.smithi139.stdout:1/17: dwrite f0 [0,4194304] 0 2024-09-17T07:19:42.943 INFO:tasks.workunit.client.1.smithi139.stdout:6/16: chown f1 40153 1 2024-09-17T07:19:42.946 INFO:tasks.workunit.client.1.smithi139.stdout:1/18: unlink f1 0 2024-09-17T07:19:42.948 INFO:tasks.workunit.client.1.smithi139.stdout:6/17: link f1 f5 0 2024-09-17T07:19:42.949 INFO:tasks.workunit.client.1.smithi139.stdout:6/18: chown f1 15 1 2024-09-17T07:19:42.949 INFO:tasks.workunit.client.1.smithi139.stdout:1/19: creat d2/f5 x:0 0 0 2024-09-17T07:19:42.949 INFO:tasks.workunit.client.1.smithi139.stdout:8/13: link d0/l3 d0/l4 0 2024-09-17T07:19:42.951 INFO:tasks.workunit.client.1.smithi139.stdout:6/19: rename c3 to c6 0 2024-09-17T07:19:42.952 INFO:tasks.workunit.client.1.smithi139.stdout:1/20: creat d2/f6 x:0 0 0 2024-09-17T07:19:42.953 INFO:tasks.workunit.client.1.smithi139.stdout:1/21: write d2/f5 [23492,123919] 0 2024-09-17T07:19:42.953 INFO:tasks.workunit.client.1.smithi139.stdout:8/14: symlink d0/l5 0 2024-09-17T07:19:42.956 INFO:tasks.workunit.client.1.smithi139.stdout:1/22: creat d2/f7 x:0 0 0 2024-09-17T07:19:42.957 INFO:tasks.workunit.client.1.smithi139.stdout:1/23: chown d2/f4 2 1 2024-09-17T07:19:42.960 INFO:tasks.workunit.client.1.smithi139.stdout:8/15: chown d0/l4 16625871 1 2024-09-17T07:19:42.964 INFO:tasks.workunit.client.1.smithi139.stdout:8/16: chown d0/l4 478549656 1 2024-09-17T07:19:42.964 INFO:tasks.workunit.client.1.smithi139.stdout:8/17: write - no filename 2024-09-17T07:19:42.966 INFO:tasks.workunit.client.1.smithi139.stdout:1/24: dwrite d2/f7 [0,4194304] 0 2024-09-17T07:19:42.969 INFO:tasks.workunit.client.1.smithi139.stdout:1/25: mknod d2/c8 0 2024-09-17T07:19:42.986 INFO:tasks.workunit.client.1.smithi139.stdout:1/26: fdatasync d2/f7 0 2024-09-17T07:19:42.987 INFO:tasks.workunit.client.1.smithi139.stdout:1/27: chown d2/c8 1562 1 2024-09-17T07:19:42.987 INFO:tasks.workunit.client.1.smithi139.stdout:1/28: stat d2 0 2024-09-17T07:19:42.988 INFO:tasks.workunit.client.1.smithi139.stdout:1/29: write f0 [3945373,78838] 0 2024-09-17T07:19:42.994 INFO:tasks.workunit.client.1.smithi139.stdout:0/16: getdents d1 0 2024-09-17T07:19:42.995 INFO:tasks.workunit.client.1.smithi139.stdout:3/4: getdents . 0 2024-09-17T07:19:42.995 INFO:tasks.workunit.client.1.smithi139.stdout:3/5: chown c0 26 1 2024-09-17T07:19:42.997 INFO:tasks.workunit.client.1.smithi139.stdout:3/6: symlink l1 0 2024-09-17T07:19:42.997 INFO:tasks.workunit.client.1.smithi139.stdout:3/7: write - no filename 2024-09-17T07:19:42.998 INFO:tasks.workunit.client.1.smithi139.stdout:3/8: creat f2 x:0 0 0 2024-09-17T07:19:42.998 INFO:tasks.workunit.client.1.smithi139.stdout:3/9: readlink l1 0 2024-09-17T07:19:43.004 INFO:tasks.workunit.client.1.smithi139.stdout:9/12: getdents . 0 2024-09-17T07:19:43.005 INFO:tasks.workunit.client.1.smithi139.stdout:9/13: rename f0 to f1 0 2024-09-17T07:19:43.007 INFO:tasks.workunit.client.1.smithi139.stdout:2/16: truncate d0/f3 619645 0 2024-09-17T07:19:43.007 INFO:tasks.workunit.client.1.smithi139.stdout:9/14: mkdir d2 0 2024-09-17T07:19:43.010 INFO:tasks.workunit.client.1.smithi139.stdout:2/17: dread d0/f4 [0,4194304] 0 2024-09-17T07:19:43.010 INFO:tasks.workunit.client.1.smithi139.stdout:9/15: getdents d2 0 2024-09-17T07:19:43.011 INFO:tasks.workunit.client.1.smithi139.stdout:9/16: truncate f1 1215835 0 2024-09-17T07:19:43.016 INFO:tasks.workunit.client.1.smithi139.stdout:6/20: getdents . 0 2024-09-17T07:19:43.017 INFO:tasks.workunit.client.1.smithi139.stdout:8/18: getdents d0 0 2024-09-17T07:19:43.019 INFO:tasks.workunit.client.1.smithi139.stdout:8/19: mknod d0/c6 0 2024-09-17T07:19:43.019 INFO:tasks.workunit.client.1.smithi139.stdout:8/20: chown d0/l5 1532026 1 2024-09-17T07:19:43.019 INFO:tasks.workunit.client.1.smithi139.stdout:8/21: dread - no filename 2024-09-17T07:19:43.019 INFO:tasks.workunit.client.1.smithi139.stdout:8/22: dread - no filename 2024-09-17T07:19:43.020 INFO:tasks.workunit.client.1.smithi139.stdout:8/23: fsync - no filename 2024-09-17T07:19:43.020 INFO:tasks.workunit.client.1.smithi139.stdout:8/24: write - no filename 2024-09-17T07:19:43.020 INFO:tasks.workunit.client.1.smithi139.stdout:8/25: stat d0 0 2024-09-17T07:19:43.020 INFO:tasks.workunit.client.1.smithi139.stdout:3/10: fsync f2 0 2024-09-17T07:19:43.021 INFO:tasks.workunit.client.1.smithi139.stdout:8/26: creat d0/f7 x:0 0 0 2024-09-17T07:19:43.022 INFO:tasks.workunit.client.1.smithi139.stdout:8/27: dread - d0/f7 zero size 2024-09-17T07:19:43.023 INFO:tasks.workunit.client.1.smithi139.stdout:8/28: dread - d0/f7 zero size 2024-09-17T07:19:43.023 INFO:tasks.workunit.client.1.smithi139.stdout:3/11: creat f3 x:0 0 0 2024-09-17T07:19:43.023 INFO:tasks.workunit.client.1.smithi139.stdout:3/12: rmdir - no directory 2024-09-17T07:19:43.025 INFO:tasks.workunit.client.1.smithi139.stdout:3/13: creat f4 x:0 0 0 2024-09-17T07:19:43.025 INFO:tasks.workunit.client.1.smithi139.stdout:2/18: read d0/f3 [586678,15790] 0 2024-09-17T07:19:43.025 INFO:tasks.workunit.client.1.smithi139.stdout:9/17: fsync f1 0 2024-09-17T07:19:43.026 INFO:tasks.workunit.client.1.smithi139.stdout:6/21: write f1 [2412375,62218] 0 2024-09-17T07:19:43.027 INFO:tasks.workunit.client.1.smithi139.stdout:9/18: stat d2 0 2024-09-17T07:19:43.029 INFO:tasks.workunit.client.1.smithi139.stdout:2/19: fdatasync d0/f3 0 2024-09-17T07:19:43.029 INFO:tasks.workunit.client.1.smithi139.stdout:6/22: chown f5 3084263 1 2024-09-17T07:19:43.030 INFO:tasks.workunit.client.1.smithi139.stdout:9/19: write f1 [359016,41580] 0 2024-09-17T07:19:43.030 INFO:tasks.workunit.client.1.smithi139.stdout:3/14: fsync f4 0 2024-09-17T07:19:43.035 INFO:tasks.workunit.client.1.smithi139.stdout:3/15: write f4 [591183,5683] 0 2024-09-17T07:19:43.037 INFO:tasks.workunit.client.1.smithi139.stdout:8/29: dwrite d0/f7 [0,4194304] 0 2024-09-17T07:19:43.037 INFO:tasks.workunit.client.1.smithi139.stdout:9/20: rmdir d2 0 2024-09-17T07:19:43.039 INFO:tasks.workunit.client.1.smithi139.stdout:3/16: mkdir d5 0 2024-09-17T07:19:43.042 INFO:tasks.workunit.client.1.smithi139.stdout:8/30: symlink d0/l8 0 2024-09-17T07:19:43.043 INFO:tasks.workunit.client.1.smithi139.stdout:6/23: dread f1 [0,4194304] 0 2024-09-17T07:19:43.044 INFO:tasks.workunit.client.1.smithi139.stdout:3/17: getdents d5 0 2024-09-17T07:19:43.046 INFO:tasks.workunit.client.1.smithi139.stdout:3/18: dread - f2 zero size 2024-09-17T07:19:43.046 INFO:tasks.workunit.client.1.smithi139.stdout:2/20: dwrite d0/f3 [0,4194304] 0 2024-09-17T07:19:43.046 INFO:tasks.workunit.client.1.smithi139.stdout:8/31: chown d0/l3 16 1 2024-09-17T07:19:43.047 INFO:tasks.workunit.client.1.smithi139.stdout:6/24: creat f7 x:0 0 0 2024-09-17T07:19:43.051 INFO:tasks.workunit.client.1.smithi139.stdout:6/25: creat f8 x:0 0 0 2024-09-17T07:19:43.051 INFO:tasks.workunit.client.1.smithi139.stdout:2/21: write d0/f3 [3717038,22317] 0 2024-09-17T07:19:43.052 INFO:tasks.workunit.client.0.smithi087.stdout:4/0: sync 2024-09-17T07:19:43.052 INFO:tasks.workunit.client.0.smithi087.stdout:4/1: write - no filename 2024-09-17T07:19:43.055 INFO:tasks.workunit.client.0.smithi087.stdout:4/2: creat f0 x:0 0 0 2024-09-17T07:19:43.059 INFO:tasks.workunit.client.1.smithi139.stdout:2/22: unlink d0/c2 0 2024-09-17T07:19:43.060 INFO:tasks.workunit.client.0.smithi087.stdout:4/3: link f0 f1 0 2024-09-17T07:19:43.060 INFO:tasks.workunit.client.1.smithi139.stdout:9/21: dwrite f1 [0,4194304] 0 2024-09-17T07:19:43.062 INFO:tasks.workunit.client.0.smithi087.stdout:4/4: mkdir d2 0 2024-09-17T07:19:43.064 INFO:tasks.workunit.client.0.smithi087.stdout:4/5: write f0 [154416,98414] 0 2024-09-17T07:19:43.067 INFO:tasks.workunit.client.0.smithi087.stdout:4/6: creat d2/f3 x:0 0 0 2024-09-17T07:19:43.070 INFO:tasks.workunit.client.0.smithi087.stdout:4/7: creat d2/f4 x:0 0 0 2024-09-17T07:19:43.071 INFO:tasks.workunit.client.1.smithi139.stdout:2/23: write d0/f4 [1272890,85659] 0 2024-09-17T07:19:43.072 INFO:tasks.workunit.client.1.smithi139.stdout:3/19: dwrite f4 [0,4194304] 0 2024-09-17T07:19:43.074 INFO:tasks.workunit.client.1.smithi139.stdout:8/32: dwrite d0/f7 [4194304,4194304] 0 2024-09-17T07:19:43.077 INFO:tasks.workunit.client.0.smithi087.stdout:4/8: dwrite f1 [0,4194304] 0 2024-09-17T07:19:43.078 INFO:tasks.workunit.client.0.smithi087.stdout:4/9: chown f0 303 1 2024-09-17T07:19:43.078 INFO:tasks.workunit.client.0.smithi087.stdout:4/10: dread - d2/f3 zero size 2024-09-17T07:19:43.081 INFO:tasks.workunit.client.0.smithi087.stdout:4/11: mkdir d2/d5 0 2024-09-17T07:19:43.083 INFO:tasks.workunit.client.0.smithi087.stdout:4/12: creat d2/f6 x:0 0 0 2024-09-17T07:19:43.086 INFO:tasks.workunit.client.0.smithi087.stdout:4/13: link d2/f6 d2/f7 0 2024-09-17T07:19:43.089 INFO:tasks.workunit.client.0.smithi087.stdout:4/14: rename d2/f3 to d2/d5/f8 0 2024-09-17T07:19:43.097 INFO:tasks.workunit.client.0.smithi087.stdout:4/15: dwrite d2/d5/f8 [0,4194304] 0 2024-09-17T07:19:43.099 INFO:tasks.workunit.client.0.smithi087.stdout:4/16: write d2/f6 [542579,48011] 0 2024-09-17T07:19:43.108 INFO:tasks.workunit.client.0.smithi087.stdout:6/19: sync 2024-09-17T07:19:43.108 INFO:tasks.workunit.client.0.smithi087.stdout:3/23: sync 2024-09-17T07:19:43.108 INFO:tasks.workunit.client.0.smithi087.stdout:1/92: sync 2024-09-17T07:19:43.108 INFO:tasks.workunit.client.0.smithi087.stdout:7/19: sync 2024-09-17T07:19:43.108 INFO:tasks.workunit.client.0.smithi087.stdout:2/23: sync 2024-09-17T07:19:43.108 INFO:tasks.workunit.client.0.smithi087.stdout:5/32: sync 2024-09-17T07:19:43.108 INFO:tasks.workunit.client.0.smithi087.stdout:9/10: sync 2024-09-17T07:19:43.109 INFO:tasks.workunit.client.0.smithi087.stdout:0/30: sync 2024-09-17T07:19:43.109 INFO:tasks.workunit.client.0.smithi087.stdout:8/64: sync 2024-09-17T07:19:43.110 INFO:tasks.workunit.client.0.smithi087.stdout:2/24: write d2/f3 [1997438,6387] 0 2024-09-17T07:19:43.111 INFO:tasks.workunit.client.0.smithi087.stdout:7/20: unlink d0/f1 0 2024-09-17T07:19:43.111 INFO:tasks.workunit.client.0.smithi087.stdout:7/21: fsync d0/f2 0 2024-09-17T07:19:43.111 INFO:tasks.workunit.client.0.smithi087.stdout:9/11: mkdir d3 0 2024-09-17T07:19:43.112 INFO:tasks.workunit.client.0.smithi087.stdout:7/22: chown d0/d3 1 1 2024-09-17T07:19:43.114 INFO:tasks.workunit.client.0.smithi087.stdout:6/20: mkdir d1/d6 0 2024-09-17T07:19:43.116 INFO:tasks.workunit.client.0.smithi087.stdout:8/65: readlink d1/d7/d9/l12 0 2024-09-17T07:19:43.116 INFO:tasks.workunit.client.0.smithi087.stdout:1/93: symlink d2/dc/l24 0 2024-09-17T07:19:43.117 INFO:tasks.workunit.client.0.smithi087.stdout:2/25: mkdir d2/d7 0 2024-09-17T07:19:43.118 INFO:tasks.workunit.client.0.smithi087.stdout:5/33: mknod d5/d8/cb 0 2024-09-17T07:19:43.118 INFO:tasks.workunit.client.0.smithi087.stdout:5/34: readlink l3 0 2024-09-17T07:19:43.120 INFO:tasks.workunit.client.0.smithi087.stdout:3/24: creat d6/f7 x:0 0 0 2024-09-17T07:19:43.121 INFO:tasks.workunit.client.0.smithi087.stdout:2/26: write d2/f3 [640178,7370] 0 2024-09-17T07:19:43.121 INFO:tasks.workunit.client.0.smithi087.stdout:0/31: creat f8 x:0 0 0 2024-09-17T07:19:43.122 INFO:tasks.workunit.client.0.smithi087.stdout:9/12: mkdir d3/d4 0 2024-09-17T07:19:43.122 INFO:tasks.workunit.client.0.smithi087.stdout:5/35: rename d5 to d5/d9/dc 22 2024-09-17T07:19:43.123 INFO:tasks.workunit.client.0.smithi087.stdout:1/94: mknod d2/d14/dd/c25 0 2024-09-17T07:19:43.123 INFO:tasks.workunit.client.0.smithi087.stdout:8/66: mknod d1/d7/c14 0 2024-09-17T07:19:43.124 INFO:tasks.workunit.client.0.smithi087.stdout:6/21: mknod d1/d6/c7 0 2024-09-17T07:19:43.125 INFO:tasks.workunit.client.0.smithi087.stdout:7/23: dwrite d0/f2 [0,4194304] 0 2024-09-17T07:19:43.136 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:42 smithi087 ceph-mon[27636]: [17/Sep/2024:07:19:41] ENGINE Bus STARTING 2024-09-17T07:19:43.136 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:42 smithi087 ceph-mon[27636]: [17/Sep/2024:07:19:41] ENGINE Serving on https://172.21.15.139:7150 2024-09-17T07:19:43.136 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:42 smithi087 ceph-mon[27636]: [17/Sep/2024:07:19:41] ENGINE Error in HTTPServer.serve 2024-09-17T07:19:43.136 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Traceback (most recent call last): 2024-09-17T07:19:43.136 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T07:19:43.136 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: self._connections.run(self.expiration_interval) 2024-09-17T07:19:43.136 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T07:19:43.136 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: self._run(expiration_interval) 2024-09-17T07:19:43.136 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T07:19:43.136 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T07:19:43.136 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T07:19:43.137 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T07:19:43.137 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T07:19:43.137 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: s = self.context.wrap_socket( 2024-09-17T07:19:43.137 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T07:19:43.137 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: return self.sslsocket_class._create( 2024-09-17T07:19:43.137 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T07:19:43.137 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: self.do_handshake() 2024-09-17T07:19:43.137 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T07:19:43.137 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: self._sslobj.do_handshake() 2024-09-17T07:19:43.137 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T07:19:43.137 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:42 smithi087 ceph-mon[27636]: [17/Sep/2024:07:19:41] ENGINE Serving on http://172.21.15.139:8765 2024-09-17T07:19:43.137 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:42 smithi087 ceph-mon[27636]: [17/Sep/2024:07:19:41] ENGINE Bus STARTED 2024-09-17T07:19:43.178 INFO:tasks.workunit.client.0.smithi087.stdout:5/36: unlink l0 0 2024-09-17T07:19:43.179 INFO:tasks.workunit.client.0.smithi087.stdout:6/22: symlink d1/l8 0 2024-09-17T07:19:43.180 INFO:tasks.workunit.client.0.smithi087.stdout:8/67: unlink d1/d10/f11 0 2024-09-17T07:19:43.181 INFO:tasks.workunit.client.0.smithi087.stdout:6/23: truncate d1/f3 488485 0 2024-09-17T07:19:43.181 INFO:tasks.workunit.client.0.smithi087.stdout:7/24: creat d0/d3/f5 x:0 0 0 2024-09-17T07:19:43.182 INFO:tasks.workunit.client.0.smithi087.stdout:7/25: stat d0/d3 0 2024-09-17T07:19:43.183 INFO:tasks.workunit.client.0.smithi087.stdout:2/27: dread d2/f3 [0,4194304] 0 2024-09-17T07:19:43.183 INFO:tasks.workunit.client.0.smithi087.stdout:1/95: dread d2/d14/dd/ff [0,4194304] 0 2024-09-17T07:19:43.183 INFO:tasks.workunit.client.0.smithi087.stdout:5/37: unlink f2 0 2024-09-17T07:19:43.184 INFO:tasks.workunit.client.0.smithi087.stdout:2/28: fsync d2/f5 0 2024-09-17T07:19:43.184 INFO:tasks.workunit.client.0.smithi087.stdout:7/26: dread - d0/d3/f5 zero size 2024-09-17T07:19:43.185 INFO:tasks.workunit.client.0.smithi087.stdout:2/29: chown d2/d7 83678 1 2024-09-17T07:19:43.185 INFO:tasks.workunit.client.0.smithi087.stdout:6/24: symlink d1/l9 0 2024-09-17T07:19:43.186 INFO:tasks.workunit.client.0.smithi087.stdout:8/68: mkdir d1/d15 0 2024-09-17T07:19:43.187 INFO:tasks.workunit.client.0.smithi087.stdout:5/38: mkdir d5/d8/dd 0 2024-09-17T07:19:43.189 INFO:tasks.workunit.client.0.smithi087.stdout:1/96: rename d2/d7 to d2/dc/d26 0 2024-09-17T07:19:43.190 INFO:tasks.workunit.client.0.smithi087.stdout:6/25: creat d1/d6/fa x:0 0 0 2024-09-17T07:19:43.190 INFO:tasks.workunit.client.0.smithi087.stdout:8/69: readlink d1/l4 0 2024-09-17T07:19:43.191 INFO:tasks.workunit.client.0.smithi087.stdout:5/39: symlink d5/d8/le 0 2024-09-17T07:19:43.192 INFO:tasks.workunit.client.0.smithi087.stdout:6/26: dread d1/f4 [0,4194304] 0 2024-09-17T07:19:43.192 INFO:tasks.workunit.client.0.smithi087.stdout:5/40: dread - d5/d9/fa zero size 2024-09-17T07:19:43.193 INFO:tasks.workunit.client.0.smithi087.stdout:7/27: link d0/f2 d0/f6 0 2024-09-17T07:19:43.193 INFO:tasks.workunit.client.0.smithi087.stdout:7/28: readlink - no filename 2024-09-17T07:19:43.194 INFO:tasks.workunit.client.0.smithi087.stdout:2/30: creat d2/d7/f8 x:0 0 0 2024-09-17T07:19:43.195 INFO:tasks.workunit.client.0.smithi087.stdout:5/41: mknod d5/cf 0 2024-09-17T07:19:43.197 INFO:tasks.workunit.client.0.smithi087.stdout:8/70: dread d1/ff [4194304,4194304] 0 2024-09-17T07:19:43.198 INFO:tasks.workunit.client.0.smithi087.stdout:8/71: dread - d1/d7/f13 zero size 2024-09-17T07:19:43.198 INFO:tasks.workunit.client.0.smithi087.stdout:1/97: link d2/d14/fb d2/d1a/f27 0 2024-09-17T07:19:43.199 INFO:tasks.workunit.client.0.smithi087.stdout:1/98: chown d2/dc/d26/l17 104328784 1 2024-09-17T07:19:43.200 INFO:tasks.workunit.client.0.smithi087.stdout:5/42: dread d5/f7 [0,4194304] 0 2024-09-17T07:19:43.201 INFO:tasks.workunit.client.0.smithi087.stdout:8/72: dread d1/f8 [0,4194304] 0 2024-09-17T07:19:43.202 INFO:tasks.workunit.client.0.smithi087.stdout:1/99: write d2/d14/fb [519192,59263] 0 2024-09-17T07:19:43.202 INFO:tasks.workunit.client.0.smithi087.stdout:5/43: creat d5/d8/f10 x:0 0 0 2024-09-17T07:19:43.204 INFO:tasks.workunit.client.0.smithi087.stdout:8/73: dread d1/ff [0,4194304] 0 2024-09-17T07:19:43.205 INFO:tasks.workunit.client.0.smithi087.stdout:5/44: rename d5/cf to d5/d9/c11 0 2024-09-17T07:19:43.206 INFO:tasks.workunit.client.0.smithi087.stdout:1/100: link d2/d1a/f1c d2/dc/d26/f28 0 2024-09-17T07:19:43.207 INFO:tasks.workunit.client.0.smithi087.stdout:8/74: rename d1/l4 to d1/d7/d9/l16 0 2024-09-17T07:19:43.209 INFO:tasks.workunit.client.0.smithi087.stdout:8/75: unlink d1/ff 0 2024-09-17T07:19:43.210 INFO:tasks.workunit.client.0.smithi087.stdout:8/76: write d1/d7/f13 [488270,20760] 0 2024-09-17T07:19:43.265 INFO:tasks.workunit.client.0.smithi087.stdout:5/45: dread f4 [0,4194304] 0 2024-09-17T07:19:43.266 INFO:tasks.workunit.client.0.smithi087.stdout:5/46: mkdir d5/d12 0 2024-09-17T07:19:43.267 INFO:tasks.workunit.client.0.smithi087.stdout:5/47: dread - d5/f6 zero size 2024-09-17T07:19:43.271 INFO:tasks.workunit.client.1.smithi139.stdout:8/33: unlink d0/l8 0 2024-09-17T07:19:43.272 INFO:tasks.workunit.client.1.smithi139.stdout:2/24: write d0/f3 [873593,271] 0 2024-09-17T07:19:43.275 INFO:tasks.workunit.client.0.smithi087.stdout:5/48: dwrite d5/d8/f10 [0,4194304] 0 2024-09-17T07:19:43.275 INFO:tasks.workunit.client.1.smithi139.stdout:6/26: dwrite f5 [0,4194304] 0 2024-09-17T07:19:43.277 INFO:tasks.workunit.client.1.smithi139.stdout:8/34: chown d0/c2 0 1 2024-09-17T07:19:43.279 INFO:tasks.workunit.client.1.smithi139.stdout:2/25: write d0/f3 [411187,66636] 0 2024-09-17T07:19:43.279 INFO:tasks.workunit.client.0.smithi087.stdout:4/17: fsync f1 0 2024-09-17T07:19:43.280 INFO:tasks.workunit.client.0.smithi087.stdout:4/18: truncate d2/f4 875290 0 2024-09-17T07:19:43.280 INFO:tasks.workunit.client.0.smithi087.stdout:4/19: fdatasync f1 0 2024-09-17T07:19:43.280 INFO:tasks.workunit.client.0.smithi087.stdout:4/20: readlink - no filename 2024-09-17T07:19:43.281 INFO:tasks.workunit.client.0.smithi087.stdout:4/21: mknod d2/c9 0 2024-09-17T07:19:43.285 INFO:tasks.workunit.client.1.smithi139.stdout:9/22: dwrite f1 [0,4194304] 0 2024-09-17T07:19:43.285 INFO:tasks.workunit.client.0.smithi087.stdout:4/22: chown d2/d5/f8 222722222 1 2024-09-17T07:19:43.288 INFO:tasks.workunit.client.1.smithi139.stdout:3/20: dwrite f2 [0,4194304] 0 2024-09-17T07:19:43.290 INFO:tasks.workunit.client.0.smithi087.stdout:4/23: dwrite d2/f6 [0,4194304] 0 2024-09-17T07:19:43.294 INFO:tasks.workunit.client.1.smithi139.stdout:2/26: dread d0/f3 [0,4194304] 0 2024-09-17T07:19:43.295 INFO:tasks.workunit.client.0.smithi087.stdout:4/24: dread d2/f6 [0,4194304] 0 2024-09-17T07:19:43.297 INFO:tasks.workunit.client.1.smithi139.stdout:9/23: dwrite f1 [0,4194304] 0 2024-09-17T07:19:43.298 INFO:tasks.workunit.client.0.smithi087.stdout:4/25: symlink d2/la 0 2024-09-17T07:19:43.298 INFO:tasks.workunit.client.0.smithi087.stdout:4/26: readlink d2/la 0 2024-09-17T07:19:43.299 INFO:tasks.workunit.client.1.smithi139.stdout:9/24: write f1 [3373800,3370] 0 2024-09-17T07:19:43.300 INFO:tasks.workunit.client.0.smithi087.stdout:4/27: truncate d2/f7 4877871 0 2024-09-17T07:19:43.303 INFO:tasks.workunit.client.0.smithi087.stdout:4/28: mkdir d2/d5/db 0 2024-09-17T07:19:43.304 INFO:tasks.workunit.client.0.smithi087.stdout:4/29: chown d2/f7 4449023 1 2024-09-17T07:19:43.305 INFO:tasks.workunit.client.0.smithi087.stdout:9/13: getdents d3 0 2024-09-17T07:19:43.307 INFO:tasks.workunit.client.0.smithi087.stdout:4/30: creat d2/fc x:0 0 0 2024-09-17T07:19:43.307 INFO:tasks.workunit.client.0.smithi087.stdout:4/31: fsync f0 0 2024-09-17T07:19:43.308 INFO:tasks.workunit.client.0.smithi087.stdout:4/32: write f0 [2026646,25184] 0 2024-09-17T07:19:43.309 INFO:tasks.workunit.client.0.smithi087.stdout:4/33: chown d2/d5/db 10892 1 2024-09-17T07:19:43.310 INFO:tasks.workunit.client.0.smithi087.stdout:9/14: mknod d3/d4/c5 0 2024-09-17T07:19:43.317 INFO:tasks.workunit.client.0.smithi087.stdout:9/15: getdents d3 0 2024-09-17T07:19:43.320 INFO:tasks.workunit.client.0.smithi087.stdout:9/16: mkdir d3/d4/d6 0 2024-09-17T07:19:43.324 INFO:tasks.workunit.client.0.smithi087.stdout:7/29: fsync d0/f6 0 2024-09-17T07:19:43.325 INFO:tasks.workunit.client.0.smithi087.stdout:2/31: rmdir d2/d7 39 2024-09-17T07:19:43.327 INFO:tasks.workunit.client.0.smithi087.stdout:2/32: fsync d2/f5 0 2024-09-17T07:19:43.328 INFO:tasks.workunit.client.0.smithi087.stdout:7/30: write d0/f6 [4821196,94213] 0 2024-09-17T07:19:43.329 INFO:tasks.workunit.client.0.smithi087.stdout:6/27: truncate d1/f4 22818 0 2024-09-17T07:19:43.333 INFO:tasks.workunit.client.0.smithi087.stdout:9/17: dwrite f2 [0,4194304] 0 2024-09-17T07:19:43.334 INFO:tasks.workunit.client.0.smithi087.stdout:6/28: write d1/d6/fa [498878,108433] 0 2024-09-17T07:19:43.334 INFO:tasks.workunit.client.0.smithi087.stdout:5/49: getdents d5/d8 0 2024-09-17T07:19:43.338 INFO:tasks.workunit.client.0.smithi087.stdout:6/29: write d1/d6/fa [49215,80926] 0 2024-09-17T07:19:43.341 INFO:tasks.workunit.client.0.smithi087.stdout:2/33: dwrite d2/f5 [0,4194304] 0 2024-09-17T07:19:43.342 INFO:tasks.workunit.client.0.smithi087.stdout:2/34: chown d2/f3 306 1 2024-09-17T07:19:43.343 INFO:tasks.workunit.client.0.smithi087.stdout:9/18: link f2 d3/f7 0 2024-09-17T07:19:43.344 INFO:tasks.workunit.client.0.smithi087.stdout:7/31: getdents d0/d3 0 2024-09-17T07:19:43.345 INFO:tasks.workunit.client.0.smithi087.stdout:7/32: write d0/d3/f4 [960232,73811] 0 2024-09-17T07:19:43.346 INFO:tasks.workunit.client.0.smithi087.stdout:7/33: fdatasync d0/d3/f5 0 2024-09-17T07:19:43.348 INFO:tasks.workunit.client.0.smithi087.stdout:4/34: truncate d2/f4 275100 0 2024-09-17T07:19:43.351 INFO:tasks.workunit.client.0.smithi087.stdout:7/34: symlink d0/d3/l7 0 2024-09-17T07:19:43.353 INFO:tasks.workunit.client.0.smithi087.stdout:2/35: mknod d2/c9 0 2024-09-17T07:19:43.355 INFO:tasks.workunit.client.0.smithi087.stdout:9/19: mkdir d3/d4/d6/d8 0 2024-09-17T07:19:43.357 INFO:tasks.workunit.client.0.smithi087.stdout:7/35: dread d0/d3/f4 [0,4194304] 0 2024-09-17T07:19:43.357 INFO:tasks.workunit.client.0.smithi087.stdout:4/35: creat d2/d5/db/fd x:0 0 0 2024-09-17T07:19:43.359 INFO:tasks.workunit.client.0.smithi087.stdout:4/36: write d2/d5/db/fd [378565,107009] 0 2024-09-17T07:19:43.359 INFO:tasks.workunit.client.0.smithi087.stdout:7/36: creat d0/f8 x:0 0 0 2024-09-17T07:19:43.360 INFO:tasks.workunit.client.0.smithi087.stdout:5/50: truncate d5/d8/f10 2777280 0 2024-09-17T07:19:43.360 INFO:tasks.workunit.client.0.smithi087.stdout:4/37: chown f1 37724 1 2024-09-17T07:19:43.361 INFO:tasks.workunit.client.0.smithi087.stdout:5/51: truncate f4 1118297 0 2024-09-17T07:19:43.363 INFO:tasks.workunit.client.0.smithi087.stdout:9/20: creat d3/d4/d6/d8/f9 x:0 0 0 2024-09-17T07:19:43.363 INFO:tasks.workunit.client.0.smithi087.stdout:6/30: truncate d1/d6/fa 53450 0 2024-09-17T07:19:43.363 INFO:tasks.workunit.client.0.smithi087.stdout:9/21: chown d3/d4 12126399 1 2024-09-17T07:19:43.364 INFO:tasks.workunit.client.0.smithi087.stdout:4/38: symlink d2/d5/le 0 2024-09-17T07:19:43.365 INFO:tasks.workunit.client.0.smithi087.stdout:4/39: write f0 [2260772,13989] 0 2024-09-17T07:19:43.366 INFO:tasks.workunit.client.0.smithi087.stdout:7/37: rename d0/d3/f5 to d0/f9 0 2024-09-17T07:19:43.366 INFO:tasks.workunit.client.0.smithi087.stdout:4/40: write f0 [5231164,12570] 0 2024-09-17T07:19:43.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:42 smithi139 ceph-mon[34403]: [17/Sep/2024:07:19:41] ENGINE Bus STARTING 2024-09-17T07:19:43.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:42 smithi139 ceph-mon[34403]: [17/Sep/2024:07:19:41] ENGINE Serving on https://172.21.15.139:7150 2024-09-17T07:19:43.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:42 smithi139 ceph-mon[34403]: [17/Sep/2024:07:19:41] ENGINE Error in HTTPServer.serve 2024-09-17T07:19:43.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: Traceback (most recent call last): 2024-09-17T07:19:43.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T07:19:43.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: self._connections.run(self.expiration_interval) 2024-09-17T07:19:43.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T07:19:43.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: self._run(expiration_interval) 2024-09-17T07:19:43.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T07:19:43.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T07:19:43.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T07:19:43.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T07:19:43.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T07:19:43.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: s = self.context.wrap_socket( 2024-09-17T07:19:43.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T07:19:43.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: return self.sslsocket_class._create( 2024-09-17T07:19:43.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T07:19:43.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: self.do_handshake() 2024-09-17T07:19:43.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T07:19:43.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: self._sslobj.do_handshake() 2024-09-17T07:19:43.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T07:19:43.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:42 smithi139 ceph-mon[34403]: [17/Sep/2024:07:19:41] ENGINE Serving on http://172.21.15.139:8765 2024-09-17T07:19:43.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:42 smithi139 ceph-mon[34403]: [17/Sep/2024:07:19:41] ENGINE Bus STARTED 2024-09-17T07:19:43.369 INFO:tasks.workunit.client.0.smithi087.stdout:5/52: rename d5 to d5/d13 22 2024-09-17T07:19:43.369 INFO:tasks.workunit.client.0.smithi087.stdout:7/38: write d0/f6 [3595241,60957] 0 2024-09-17T07:19:43.369 INFO:tasks.workunit.client.0.smithi087.stdout:4/41: write f0 [5119750,52229] 0 2024-09-17T07:19:43.370 INFO:tasks.workunit.client.0.smithi087.stdout:4/42: truncate d2/f6 5144299 0 2024-09-17T07:19:43.371 INFO:tasks.workunit.client.0.smithi087.stdout:7/39: fdatasync d0/f6 0 2024-09-17T07:19:43.375 INFO:tasks.workunit.client.0.smithi087.stdout:2/36: truncate d2/f5 1251120 0 2024-09-17T07:19:43.376 INFO:tasks.workunit.client.0.smithi087.stdout:9/22: dwrite d3/f7 [4194304,4194304] 0 2024-09-17T07:19:43.376 INFO:tasks.workunit.client.0.smithi087.stdout:5/53: write d5/f7 [2860885,69291] 0 2024-09-17T07:19:43.377 INFO:tasks.workunit.client.0.smithi087.stdout:2/37: read d2/f3 [1349254,37705] 0 2024-09-17T07:19:43.378 INFO:tasks.workunit.client.0.smithi087.stdout:4/43: write d2/f6 [282066,2430] 0 2024-09-17T07:19:43.380 INFO:tasks.workunit.client.0.smithi087.stdout:7/40: write d0/f9 [55855,126099] 0 2024-09-17T07:19:43.382 INFO:tasks.workunit.client.0.smithi087.stdout:4/44: fsync d2/d5/f8 0 2024-09-17T07:19:43.384 INFO:tasks.workunit.client.0.smithi087.stdout:9/23: mkdir d3/d4/da 0 2024-09-17T07:19:43.389 INFO:tasks.workunit.client.0.smithi087.stdout:5/54: dwrite d5/f7 [4194304,4194304] 0 2024-09-17T07:19:43.389 INFO:tasks.workunit.client.0.smithi087.stdout:7/41: rename d0/f9 to d0/fa 0 2024-09-17T07:19:43.392 INFO:tasks.workunit.client.0.smithi087.stdout:7/42: stat d0/fa 0 2024-09-17T07:19:43.392 INFO:tasks.workunit.client.0.smithi087.stdout:4/45: symlink d2/lf 0 2024-09-17T07:19:43.395 INFO:tasks.workunit.client.0.smithi087.stdout:4/46: write d2/f6 [4815984,90344] 0 2024-09-17T07:19:43.398 INFO:tasks.workunit.client.0.smithi087.stdout:5/55: mkdir d5/d12/d14 0 2024-09-17T07:19:43.401 INFO:tasks.workunit.client.0.smithi087.stdout:4/47: write f1 [2450259,67389] 0 2024-09-17T07:19:43.403 INFO:tasks.workunit.client.0.smithi087.stdout:9/24: dwrite d3/d4/d6/d8/f9 [0,4194304] 0 2024-09-17T07:19:43.403 INFO:tasks.workunit.client.0.smithi087.stdout:5/56: creat d5/f15 x:0 0 0 2024-09-17T07:19:43.409 INFO:tasks.workunit.client.0.smithi087.stdout:2/38: dwrite d2/f5 [0,4194304] 0 2024-09-17T07:19:43.411 INFO:tasks.workunit.client.0.smithi087.stdout:7/43: dread d0/f6 [0,4194304] 0 2024-09-17T07:19:43.414 INFO:tasks.workunit.client.0.smithi087.stdout:2/39: write d2/f5 [4621484,12589] 0 2024-09-17T07:19:43.415 INFO:tasks.workunit.client.0.smithi087.stdout:5/57: creat d5/d12/d14/f16 x:0 0 0 2024-09-17T07:19:43.415 INFO:tasks.workunit.client.0.smithi087.stdout:7/44: fsync d0/f2 0 2024-09-17T07:19:43.421 INFO:tasks.workunit.client.0.smithi087.stdout:2/40: mknod d2/ca 0 2024-09-17T07:19:43.422 INFO:tasks.workunit.client.0.smithi087.stdout:7/45: symlink d0/lb 0 2024-09-17T07:19:43.423 INFO:tasks.workunit.client.0.smithi087.stdout:4/48: dread d2/f6 [0,4194304] 0 2024-09-17T07:19:43.425 INFO:tasks.workunit.client.0.smithi087.stdout:6/31: dwrite d1/f4 [0,4194304] 0 2024-09-17T07:19:43.425 INFO:tasks.workunit.client.0.smithi087.stdout:9/25: dwrite f2 [4194304,4194304] 0 2024-09-17T07:19:43.426 INFO:tasks.workunit.client.1.smithi139.stdout:6/27: symlink l9 0 2024-09-17T07:19:43.427 INFO:tasks.workunit.client.0.smithi087.stdout:2/41: write d2/d7/f8 [206337,114523] 0 2024-09-17T07:19:43.428 INFO:tasks.workunit.client.0.smithi087.stdout:2/42: stat d2 0 2024-09-17T07:19:43.430 INFO:tasks.workunit.client.0.smithi087.stdout:5/58: dread d5/f7 [4194304,4194304] 0 2024-09-17T07:19:43.430 INFO:tasks.workunit.client.1.smithi139.stdout:9/25: rename f1 to f3 0 2024-09-17T07:19:43.430 INFO:tasks.workunit.client.0.smithi087.stdout:6/32: rmdir d1 39 2024-09-17T07:19:43.431 INFO:tasks.workunit.client.1.smithi139.stdout:9/26: chown f3 812192 1 2024-09-17T07:19:43.431 INFO:tasks.workunit.client.1.smithi139.stdout:9/27: chown f3 104 1 2024-09-17T07:19:43.431 INFO:tasks.workunit.client.0.smithi087.stdout:9/26: creat d3/d4/fb x:0 0 0 2024-09-17T07:19:43.432 INFO:tasks.workunit.client.0.smithi087.stdout:2/43: fdatasync d2/d7/f8 0 2024-09-17T07:19:43.435 INFO:tasks.workunit.client.0.smithi087.stdout:4/49: rename d2/f4 to d2/d5/f10 0 2024-09-17T07:19:43.437 INFO:tasks.workunit.client.0.smithi087.stdout:9/27: creat d3/fc x:0 0 0 2024-09-17T07:19:43.437 INFO:tasks.workunit.client.0.smithi087.stdout:4/50: fsync d2/d5/db/fd 0 2024-09-17T07:19:43.438 INFO:tasks.workunit.client.0.smithi087.stdout:2/44: dread d2/f5 [0,4194304] 0 2024-09-17T07:19:43.440 INFO:tasks.workunit.client.0.smithi087.stdout:2/45: chown d2/f5 54 1 2024-09-17T07:19:43.441 INFO:tasks.workunit.client.0.smithi087.stdout:5/59: rename f4 to d5/f17 0 2024-09-17T07:19:43.442 INFO:tasks.workunit.client.1.smithi139.stdout:9/28: dwrite f3 [0,4194304] 0 2024-09-17T07:19:43.444 INFO:tasks.workunit.client.0.smithi087.stdout:4/51: mknod d2/c11 0 2024-09-17T07:19:43.445 INFO:tasks.workunit.client.1.smithi139.stdout:9/29: creat f4 x:0 0 0 2024-09-17T07:19:43.446 INFO:tasks.workunit.client.1.smithi139.stdout:9/30: dread - f4 zero size 2024-09-17T07:19:43.446 INFO:tasks.workunit.client.0.smithi087.stdout:9/28: creat d3/d4/d6/d8/fd x:0 0 0 2024-09-17T07:19:43.446 INFO:tasks.workunit.client.0.smithi087.stdout:6/33: truncate d1/d6/fa 898114 0 2024-09-17T07:19:43.447 INFO:tasks.workunit.client.0.smithi087.stdout:2/46: mkdir d2/d7/db 0 2024-09-17T07:19:43.448 INFO:tasks.workunit.client.0.smithi087.stdout:5/60: mkdir d5/d18 0 2024-09-17T07:19:43.449 INFO:tasks.workunit.client.0.smithi087.stdout:6/34: write d1/f4 [1818067,101965] 0 2024-09-17T07:19:43.450 INFO:tasks.workunit.client.0.smithi087.stdout:9/29: truncate d3/d4/fb 862306 0 2024-09-17T07:19:43.452 INFO:tasks.workunit.client.0.smithi087.stdout:6/35: read d1/f3 [340558,65959] 0 2024-09-17T07:19:43.453 INFO:tasks.workunit.client.0.smithi087.stdout:5/61: creat d5/f19 x:0 0 0 2024-09-17T07:19:43.453 INFO:tasks.workunit.client.0.smithi087.stdout:2/47: mknod d2/d7/db/cc 0 2024-09-17T07:19:43.454 INFO:tasks.workunit.client.0.smithi087.stdout:4/52: dread d2/d5/f8 [0,4194304] 0 2024-09-17T07:19:43.455 INFO:tasks.workunit.client.0.smithi087.stdout:6/36: write d1/f3 [1400299,36958] 0 2024-09-17T07:19:43.459 INFO:tasks.workunit.client.0.smithi087.stdout:6/37: rename d1/f3 to d1/fb 0 2024-09-17T07:19:43.460 INFO:tasks.workunit.client.0.smithi087.stdout:2/48: getdents d2 0 2024-09-17T07:19:43.461 INFO:tasks.workunit.client.1.smithi139.stdout:9/31: fdatasync f3 0 2024-09-17T07:19:43.463 INFO:tasks.workunit.client.0.smithi087.stdout:2/49: write d2/f5 [2110650,855] 0 2024-09-17T07:19:43.464 INFO:tasks.workunit.client.0.smithi087.stdout:2/50: write d2/f5 [405111,39372] 0 2024-09-17T07:19:43.467 INFO:tasks.workunit.client.0.smithi087.stdout:2/51: mkdir d2/d7/dd 0 2024-09-17T07:19:43.467 INFO:tasks.workunit.client.0.smithi087.stdout:6/38: dread d1/d6/fa [0,4194304] 0 2024-09-17T07:19:43.468 INFO:tasks.workunit.client.0.smithi087.stdout:6/39: read d1/f4 [990947,110322] 0 2024-09-17T07:19:43.471 INFO:tasks.workunit.client.0.smithi087.stdout:2/52: dread d2/f3 [0,4194304] 0 2024-09-17T07:19:43.472 INFO:tasks.workunit.client.0.smithi087.stdout:6/40: dread d1/f4 [0,4194304] 0 2024-09-17T07:19:43.474 INFO:tasks.workunit.client.0.smithi087.stdout:6/41: rmdir d1/d6 39 2024-09-17T07:19:43.480 INFO:tasks.workunit.client.0.smithi087.stdout:6/42: dwrite d1/f4 [0,4194304] 0 2024-09-17T07:19:43.484 INFO:tasks.workunit.client.0.smithi087.stdout:6/43: write d1/fb [531310,2273] 0 2024-09-17T07:19:43.487 INFO:tasks.workunit.client.0.smithi087.stdout:6/44: creat d1/d6/fc x:0 0 0 2024-09-17T07:19:43.487 INFO:tasks.workunit.client.0.smithi087.stdout:6/45: chown d1/l9 49508006 1 2024-09-17T07:19:43.494 INFO:tasks.workunit.client.0.smithi087.stdout:6/46: dwrite d1/d6/fc [0,4194304] 0 2024-09-17T07:19:43.494 INFO:tasks.workunit.client.0.smithi087.stdout:6/47: chown d1/l8 261312 1 2024-09-17T07:19:43.500 INFO:tasks.workunit.client.0.smithi087.stdout:6/48: truncate d1/fb 731778 0 2024-09-17T07:19:43.502 INFO:tasks.workunit.client.0.smithi087.stdout:6/49: creat d1/fd x:0 0 0 2024-09-17T07:19:43.503 INFO:tasks.workunit.client.0.smithi087.stdout:6/50: truncate d1/f4 4276750 0 2024-09-17T07:19:43.514 INFO:tasks.workunit.client.0.smithi087.stdout:6/51: truncate d1/fb 1476363 0 2024-09-17T07:19:43.515 INFO:tasks.workunit.client.1.smithi139.stdout:6/28: getdents . 0 2024-09-17T07:19:43.516 INFO:tasks.workunit.client.0.smithi087.stdout:6/52: symlink d1/d6/le 0 2024-09-17T07:19:43.516 INFO:tasks.workunit.client.1.smithi139.stdout:9/32: fsync f3 0 2024-09-17T07:19:43.517 INFO:tasks.workunit.client.1.smithi139.stdout:6/29: write f7 [114220,120361] 0 2024-09-17T07:19:43.517 INFO:tasks.workunit.client.0.smithi087.stdout:6/53: fdatasync d1/d6/fa 0 2024-09-17T07:19:43.517 INFO:tasks.workunit.client.1.smithi139.stdout:9/33: read f3 [476159,113535] 0 2024-09-17T07:19:43.518 INFO:tasks.workunit.client.1.smithi139.stdout:8/35: truncate d0/f7 4201217 0 2024-09-17T07:19:43.518 INFO:tasks.workunit.client.1.smithi139.stdout:2/27: truncate d0/f4 739029 0 2024-09-17T07:19:43.519 INFO:tasks.workunit.client.1.smithi139.stdout:2/28: dread - d0/f5 zero size 2024-09-17T07:19:43.520 INFO:tasks.workunit.client.1.smithi139.stdout:6/30: rename c6 to ca 0 2024-09-17T07:19:43.521 INFO:tasks.workunit.client.1.smithi139.stdout:8/36: creat d0/f9 x:0 0 0 2024-09-17T07:19:43.522 INFO:tasks.workunit.client.1.smithi139.stdout:2/29: fdatasync d0/f3 0 2024-09-17T07:19:43.522 INFO:tasks.workunit.client.1.smithi139.stdout:2/30: readlink - no filename 2024-09-17T07:19:43.522 INFO:tasks.workunit.client.0.smithi087.stdout:6/54: truncate d1/d6/fa 375728 0 2024-09-17T07:19:43.523 INFO:tasks.workunit.client.1.smithi139.stdout:8/37: creat d0/fa x:0 0 0 2024-09-17T07:19:43.523 INFO:tasks.workunit.client.1.smithi139.stdout:8/38: chown d0/fa 0 1 2024-09-17T07:19:43.524 INFO:tasks.workunit.client.1.smithi139.stdout:8/39: chown d0/c6 12 1 2024-09-17T07:19:43.527 INFO:tasks.workunit.client.0.smithi087.stdout:6/55: rmdir d1/d6 39 2024-09-17T07:19:43.528 INFO:tasks.workunit.client.0.smithi087.stdout:6/56: write d1/f4 [4183833,114717] 0 2024-09-17T07:19:43.532 INFO:tasks.workunit.client.1.smithi139.stdout:2/31: rename d0/f4 to d0/f6 0 2024-09-17T07:19:43.533 INFO:tasks.workunit.client.1.smithi139.stdout:2/32: write d0/f5 [832228,100573] 0 2024-09-17T07:19:43.533 INFO:tasks.workunit.client.1.smithi139.stdout:6/31: getdents . 0 2024-09-17T07:19:43.533 INFO:tasks.workunit.client.1.smithi139.stdout:8/40: fsync d0/fa 0 2024-09-17T07:19:43.534 INFO:tasks.workunit.client.1.smithi139.stdout:6/32: write f5 [303000,93670] 0 2024-09-17T07:19:43.535 INFO:tasks.workunit.client.1.smithi139.stdout:8/41: truncate d0/f9 937982 0 2024-09-17T07:19:43.536 INFO:tasks.workunit.client.0.smithi087.stdout:6/57: dwrite d1/fd [0,4194304] 0 2024-09-17T07:19:43.536 INFO:tasks.workunit.client.1.smithi139.stdout:8/42: write d0/f9 [282969,108260] 0 2024-09-17T07:19:43.537 INFO:tasks.workunit.client.1.smithi139.stdout:8/43: truncate d0/f9 1855189 0 2024-09-17T07:19:43.537 INFO:tasks.workunit.client.1.smithi139.stdout:6/33: mkdir db 0 2024-09-17T07:19:43.539 INFO:tasks.workunit.client.1.smithi139.stdout:6/34: fdatasync f1 0 2024-09-17T07:19:43.542 INFO:tasks.workunit.client.1.smithi139.stdout:6/35: symlink db/lc 0 2024-09-17T07:19:43.543 INFO:tasks.workunit.client.0.smithi087.stdout:6/58: link d1/d6/fc d1/d6/ff 0 2024-09-17T07:19:43.544 INFO:tasks.workunit.client.1.smithi139.stdout:6/36: creat db/fd x:0 0 0 2024-09-17T07:19:43.548 INFO:tasks.workunit.client.1.smithi139.stdout:8/44: dread d0/f7 [0,4194304] 0 2024-09-17T07:19:43.549 INFO:tasks.workunit.client.1.smithi139.stdout:2/33: dwrite d0/f3 [0,4194304] 0 2024-09-17T07:19:43.553 INFO:tasks.workunit.client.1.smithi139.stdout:2/34: mkdir d0/d7 0 2024-09-17T07:19:43.553 INFO:tasks.workunit.client.1.smithi139.stdout:6/37: dwrite db/fd [0,4194304] 0 2024-09-17T07:19:43.554 INFO:tasks.workunit.client.1.smithi139.stdout:2/35: stat d0/f5 0 2024-09-17T07:19:43.555 INFO:tasks.workunit.client.0.smithi087.stdout:6/59: dwrite d1/fb [0,4194304] 0 2024-09-17T07:19:43.555 INFO:tasks.workunit.client.1.smithi139.stdout:6/38: read - f8 zero size 2024-09-17T07:19:43.556 INFO:tasks.workunit.client.0.smithi087.stdout:6/60: rename d1 to d1/d6/d10 22 2024-09-17T07:19:43.557 INFO:tasks.workunit.client.0.smithi087.stdout:6/61: chown d1/fb 12247 1 2024-09-17T07:19:43.560 INFO:tasks.workunit.client.1.smithi139.stdout:8/45: dwrite d0/fa [0,4194304] 0 2024-09-17T07:19:43.562 INFO:tasks.workunit.client.0.smithi087.stdout:6/62: creat d1/f11 x:0 0 0 2024-09-17T07:19:43.563 INFO:tasks.workunit.client.1.smithi139.stdout:6/39: truncate f5 555180 0 2024-09-17T07:19:43.565 INFO:tasks.workunit.client.1.smithi139.stdout:2/36: dread d0/f5 [0,4194304] 0 2024-09-17T07:19:43.565 INFO:tasks.workunit.client.0.smithi087.stdout:6/63: creat d1/d6/f12 x:0 0 0 2024-09-17T07:19:43.567 INFO:tasks.workunit.client.1.smithi139.stdout:6/40: dread f7 [0,4194304] 0 2024-09-17T07:19:43.567 INFO:tasks.workunit.client.0.smithi087.stdout:6/64: mknod d1/d6/c13 0 2024-09-17T07:19:43.569 INFO:tasks.workunit.client.0.smithi087.stdout:6/65: write d1/d6/f12 [565332,10420] 0 2024-09-17T07:19:43.569 INFO:tasks.workunit.client.1.smithi139.stdout:2/37: creat d0/f8 x:0 0 0 2024-09-17T07:19:43.570 INFO:tasks.workunit.client.1.smithi139.stdout:6/41: creat db/fe x:0 0 0 2024-09-17T07:19:43.571 INFO:tasks.workunit.client.1.smithi139.stdout:2/38: symlink d0/l9 0 2024-09-17T07:19:43.573 INFO:tasks.workunit.client.1.smithi139.stdout:2/39: creat d0/fa x:0 0 0 2024-09-17T07:19:43.584 INFO:tasks.workunit.client.1.smithi139.stdout:6/42: fsync f1 0 2024-09-17T07:19:43.589 INFO:tasks.workunit.client.1.smithi139.stdout:8/46: truncate d0/fa 1019035 0 2024-09-17T07:19:43.590 INFO:tasks.workunit.client.1.smithi139.stdout:6/43: dwrite f8 [0,4194304] 0 2024-09-17T07:19:43.591 INFO:tasks.workunit.client.1.smithi139.stdout:2/40: fsync d0/f8 0 2024-09-17T07:19:43.592 INFO:tasks.workunit.client.1.smithi139.stdout:8/47: creat d0/fb x:0 0 0 2024-09-17T07:19:43.593 INFO:tasks.workunit.client.1.smithi139.stdout:8/48: readlink d0/l3 0 2024-09-17T07:19:43.597 INFO:tasks.workunit.client.0.smithi087.stdout:6/66: dwrite d1/d6/fa [0,4194304] 0 2024-09-17T07:19:43.598 INFO:tasks.workunit.client.0.smithi087.stdout:6/67: chown d1/d6/le 455 1 2024-09-17T07:19:43.598 INFO:tasks.workunit.client.0.smithi087.stdout:6/68: readlink d1/l2 0 2024-09-17T07:19:43.600 INFO:tasks.workunit.client.1.smithi139.stdout:8/49: fsync d0/fb 0 2024-09-17T07:19:43.601 INFO:tasks.workunit.client.0.smithi087.stdout:6/69: unlink d1/d6/ff 0 2024-09-17T07:19:43.602 INFO:tasks.workunit.client.0.smithi087.stdout:6/70: mknod d1/c14 0 2024-09-17T07:19:43.604 INFO:tasks.workunit.client.1.smithi139.stdout:6/44: dwrite f8 [0,4194304] 0 2024-09-17T07:19:43.604 INFO:tasks.workunit.client.0.smithi087.stdout:6/71: symlink d1/d6/l15 0 2024-09-17T07:19:43.605 INFO:tasks.workunit.client.1.smithi139.stdout:8/50: rmdir d0 39 2024-09-17T07:19:43.606 INFO:tasks.workunit.client.0.smithi087.stdout:6/72: write d1/f4 [4472782,90422] 0 2024-09-17T07:19:43.608 INFO:tasks.workunit.client.1.smithi139.stdout:6/45: truncate db/fe 802194 0 2024-09-17T07:19:43.609 INFO:tasks.workunit.client.0.smithi087.stdout:6/73: creat d1/f16 x:0 0 0 2024-09-17T07:19:43.612 INFO:tasks.workunit.client.1.smithi139.stdout:2/41: dwrite d0/f5 [0,4194304] 0 2024-09-17T07:19:43.613 INFO:tasks.workunit.client.0.smithi087.stdout:6/74: link d1/d6/l15 d1/d6/l17 0 2024-09-17T07:19:43.617 INFO:tasks.workunit.client.1.smithi139.stdout:8/51: mkdir d0/dc 0 2024-09-17T07:19:43.617 INFO:tasks.workunit.client.1.smithi139.stdout:8/52: chown d0/c6 41 1 2024-09-17T07:19:43.617 INFO:tasks.workunit.client.0.smithi087.stdout:6/75: dread d1/d6/f12 [0,4194304] 0 2024-09-17T07:19:43.618 INFO:tasks.workunit.client.0.smithi087.stdout:6/76: chown d1/fb 1331 1 2024-09-17T07:19:43.618 INFO:tasks.workunit.client.1.smithi139.stdout:8/53: fdatasync d0/fa 0 2024-09-17T07:19:43.620 INFO:tasks.workunit.client.1.smithi139.stdout:8/54: chown d0/dc 52889059 1 2024-09-17T07:19:43.620 INFO:tasks.workunit.client.0.smithi087.stdout:0/32: sync 2024-09-17T07:19:43.620 INFO:tasks.workunit.client.0.smithi087.stdout:3/25: sync 2024-09-17T07:19:43.621 INFO:tasks.workunit.client.0.smithi087.stdout:3/26: chown f4 1957 1 2024-09-17T07:19:43.621 INFO:tasks.workunit.client.0.smithi087.stdout:0/33: truncate f8 1006699 0 2024-09-17T07:19:43.621 INFO:tasks.workunit.client.0.smithi087.stdout:0/34: chown f4 1019 1 2024-09-17T07:19:43.622 INFO:tasks.workunit.client.1.smithi139.stdout:6/46: dread f2 [0,4194304] 0 2024-09-17T07:19:43.622 INFO:tasks.workunit.client.0.smithi087.stdout:6/77: rename d1/d6/fa to d1/f18 0 2024-09-17T07:19:43.623 INFO:tasks.workunit.client.1.smithi139.stdout:8/55: creat d0/fd x:0 0 0 2024-09-17T07:19:43.624 INFO:tasks.workunit.client.1.smithi139.stdout:2/42: dwrite d0/f5 [0,4194304] 0 2024-09-17T07:19:43.624 INFO:tasks.workunit.client.1.smithi139.stdout:8/56: chown d0/c2 797318 1 2024-09-17T07:19:43.625 INFO:tasks.workunit.client.0.smithi087.stdout:6/78: write d1/f16 [627417,65921] 0 2024-09-17T07:19:43.625 INFO:tasks.workunit.client.1.smithi139.stdout:2/43: readlink d0/l9 0 2024-09-17T07:19:43.625 INFO:tasks.workunit.client.1.smithi139.stdout:8/57: dread - d0/fb zero size 2024-09-17T07:19:43.626 INFO:tasks.workunit.client.1.smithi139.stdout:6/47: mkdir db/df 0 2024-09-17T07:19:43.627 INFO:tasks.workunit.client.1.smithi139.stdout:2/44: creat d0/fb x:0 0 0 2024-09-17T07:19:43.628 INFO:tasks.workunit.client.0.smithi087.stdout:3/27: dread f4 [0,4194304] 0 2024-09-17T07:19:43.629 INFO:tasks.workunit.client.0.smithi087.stdout:6/79: mknod d1/c19 0 2024-09-17T07:19:43.629 INFO:tasks.workunit.client.1.smithi139.stdout:2/45: truncate d0/fb 487643 0 2024-09-17T07:19:43.630 INFO:tasks.workunit.client.1.smithi139.stdout:2/46: fdatasync d0/f3 0 2024-09-17T07:19:43.631 INFO:tasks.workunit.client.1.smithi139.stdout:8/58: link d0/l3 d0/le 0 2024-09-17T07:19:43.632 INFO:tasks.workunit.client.0.smithi087.stdout:3/28: mknod d6/c8 0 2024-09-17T07:19:43.632 INFO:tasks.workunit.client.0.smithi087.stdout:0/35: dwrite f5 [0,4194304] 0 2024-09-17T07:19:43.632 INFO:tasks.workunit.client.1.smithi139.stdout:6/48: dread f8 [0,4194304] 0 2024-09-17T07:19:43.633 INFO:tasks.workunit.client.0.smithi087.stdout:6/80: mkdir d1/d6/d1a 0 2024-09-17T07:19:43.633 INFO:tasks.workunit.client.0.smithi087.stdout:3/29: truncate f4 4974341 0 2024-09-17T07:19:43.634 INFO:tasks.workunit.client.1.smithi139.stdout:8/59: dread d0/fa [0,4194304] 0 2024-09-17T07:19:43.635 INFO:tasks.workunit.client.0.smithi087.stdout:0/36: mknod c9 0 2024-09-17T07:19:43.638 INFO:tasks.workunit.client.1.smithi139.stdout:2/47: dread d0/f3 [0,4194304] 0 2024-09-17T07:19:43.639 INFO:tasks.workunit.client.0.smithi087.stdout:0/37: dread f5 [0,4194304] 0 2024-09-17T07:19:43.642 INFO:tasks.workunit.client.1.smithi139.stdout:8/60: chown d0/le 1817 1 2024-09-17T07:19:43.643 INFO:tasks.workunit.client.1.smithi139.stdout:6/49: dwrite f8 [0,4194304] 0 2024-09-17T07:19:43.645 INFO:tasks.workunit.client.0.smithi087.stdout:6/81: truncate d1/f16 614891 0 2024-09-17T07:19:43.646 INFO:tasks.workunit.client.1.smithi139.stdout:6/50: symlink db/l10 0 2024-09-17T07:19:43.646 INFO:tasks.workunit.client.0.smithi087.stdout:6/82: mknod d1/d6/d1a/c1b 0 2024-09-17T07:19:43.648 INFO:tasks.workunit.client.1.smithi139.stdout:6/51: fdatasync f2 0 2024-09-17T07:19:43.650 INFO:tasks.workunit.client.1.smithi139.stdout:2/48: fsync d0/fb 0 2024-09-17T07:19:43.652 INFO:tasks.workunit.client.1.smithi139.stdout:2/49: truncate d0/fa 282117 0 2024-09-17T07:19:43.655 INFO:tasks.workunit.client.1.smithi139.stdout:2/50: mkdir d0/dc 0 2024-09-17T07:19:43.657 INFO:tasks.workunit.client.1.smithi139.stdout:8/61: dwrite d0/fa [0,4194304] 0 2024-09-17T07:19:43.658 INFO:tasks.workunit.client.1.smithi139.stdout:8/62: fsync d0/fd 0 2024-09-17T07:19:43.658 INFO:tasks.workunit.client.1.smithi139.stdout:2/51: dread d0/fa [0,4194304] 0 2024-09-17T07:19:43.661 INFO:tasks.workunit.client.1.smithi139.stdout:6/52: dread db/fd [0,4194304] 0 2024-09-17T07:19:43.662 INFO:tasks.workunit.client.1.smithi139.stdout:2/52: creat d0/d7/fd x:0 0 0 2024-09-17T07:19:43.662 INFO:tasks.workunit.client.1.smithi139.stdout:6/53: dread f1 [0,4194304] 0 2024-09-17T07:19:43.664 INFO:tasks.workunit.client.1.smithi139.stdout:8/63: getdents d0 0 2024-09-17T07:19:43.664 INFO:tasks.workunit.client.1.smithi139.stdout:8/64: fdatasync d0/fd 0 2024-09-17T07:19:43.664 INFO:tasks.workunit.client.1.smithi139.stdout:2/53: mkdir d0/de 0 2024-09-17T07:19:43.665 INFO:tasks.workunit.client.1.smithi139.stdout:6/54: truncate f1 304406 0 2024-09-17T07:19:43.665 INFO:tasks.workunit.client.1.smithi139.stdout:2/54: write d0/f5 [4768048,109945] 0 2024-09-17T07:19:43.666 INFO:tasks.workunit.client.1.smithi139.stdout:6/55: chown db 310185837 1 2024-09-17T07:19:43.668 INFO:tasks.workunit.client.0.smithi087.stdout:0/38: truncate f4 1647375 0 2024-09-17T07:19:43.669 INFO:tasks.workunit.client.0.smithi087.stdout:6/83: rmdir d1/d6 39 2024-09-17T07:19:43.670 INFO:tasks.workunit.client.1.smithi139.stdout:8/65: rename d0/l3 to d0/lf 0 2024-09-17T07:19:43.670 INFO:tasks.workunit.client.1.smithi139.stdout:6/56: mknod db/df/c11 0 2024-09-17T07:19:43.671 INFO:tasks.workunit.client.0.smithi087.stdout:0/39: rename f8 to fa 0 2024-09-17T07:19:43.671 INFO:tasks.workunit.client.1.smithi139.stdout:2/55: mkdir d0/de/df 0 2024-09-17T07:19:43.672 INFO:tasks.workunit.client.0.smithi087.stdout:6/84: write d1/f18 [2635080,59743] 0 2024-09-17T07:19:43.673 INFO:tasks.workunit.client.0.smithi087.stdout:0/40: mkdir db 0 2024-09-17T07:19:43.676 INFO:tasks.workunit.client.0.smithi087.stdout:6/85: dread d1/d6/f12 [0,4194304] 0 2024-09-17T07:19:43.676 INFO:tasks.workunit.client.0.smithi087.stdout:6/86: fdatasync d1/f11 0 2024-09-17T07:19:43.676 INFO:tasks.workunit.client.0.smithi087.stdout:0/41: mknod db/cc 0 2024-09-17T07:19:43.677 INFO:tasks.workunit.client.1.smithi139.stdout:8/66: creat d0/dc/f10 x:0 0 0 2024-09-17T07:19:43.677 INFO:tasks.workunit.client.0.smithi087.stdout:6/87: dread - d1/f11 zero size 2024-09-17T07:19:43.678 INFO:tasks.workunit.client.1.smithi139.stdout:2/56: creat d0/dc/f10 x:0 0 0 2024-09-17T07:19:43.680 INFO:tasks.workunit.client.1.smithi139.stdout:2/57: mkdir d0/de/d11 0 2024-09-17T07:19:43.680 INFO:tasks.workunit.client.0.smithi087.stdout:0/42: rename l3 to db/ld 0 2024-09-17T07:19:43.681 INFO:tasks.workunit.client.0.smithi087.stdout:0/43: write f6 [319879,100607] 0 2024-09-17T07:19:43.681 INFO:tasks.workunit.client.1.smithi139.stdout:2/58: unlink d0/dc/f10 0 2024-09-17T07:19:43.682 INFO:tasks.workunit.client.0.smithi087.stdout:6/88: dread d1/fb [0,4194304] 0 2024-09-17T07:19:43.684 INFO:tasks.workunit.client.0.smithi087.stdout:6/89: creat d1/d6/f1c x:0 0 0 2024-09-17T07:19:43.684 INFO:tasks.workunit.client.1.smithi139.stdout:2/59: mkdir d0/de/d11/d12 0 2024-09-17T07:19:43.684 INFO:tasks.workunit.client.1.smithi139.stdout:8/67: fsync d0/dc/f10 0 2024-09-17T07:19:43.687 INFO:tasks.workunit.client.1.smithi139.stdout:8/68: symlink d0/l11 0 2024-09-17T07:19:43.689 INFO:tasks.workunit.client.0.smithi087.stdout:6/90: rename d1/d6/fc to d1/f1d 0 2024-09-17T07:19:43.693 INFO:tasks.workunit.client.1.smithi139.stdout:6/57: dwrite f1 [0,4194304] 0 2024-09-17T07:19:43.694 INFO:tasks.workunit.client.0.smithi087.stdout:6/91: link d1/d6/l15 d1/d6/d1a/l1e 0 2024-09-17T07:19:43.694 INFO:tasks.workunit.client.0.smithi087.stdout:6/92: stat d1/d6/d1a 0 2024-09-17T07:19:43.695 INFO:tasks.workunit.client.1.smithi139.stdout:2/60: dwrite d0/d7/fd [0,4194304] 0 2024-09-17T07:19:43.696 INFO:tasks.workunit.client.0.smithi087.stdout:0/44: write f4 [673136,36047] 0 2024-09-17T07:19:43.696 INFO:tasks.workunit.client.1.smithi139.stdout:8/69: truncate d0/f9 1621524 0 2024-09-17T07:19:43.700 INFO:tasks.workunit.client.1.smithi139.stdout:8/70: creat d0/dc/f12 x:0 0 0 2024-09-17T07:19:43.700 INFO:tasks.workunit.client.0.smithi087.stdout:0/45: fdatasync f4 0 2024-09-17T07:19:43.702 INFO:tasks.workunit.client.1.smithi139.stdout:6/58: dread f8 [0,4194304] 0 2024-09-17T07:19:43.703 INFO:tasks.workunit.client.0.smithi087.stdout:6/93: dwrite d1/d6/f1c [0,4194304] 0 2024-09-17T07:19:43.703 INFO:tasks.workunit.client.1.smithi139.stdout:8/71: rename d0/c2 to d0/c13 0 2024-09-17T07:19:43.703 INFO:tasks.workunit.client.0.smithi087.stdout:0/46: write f5 [2891703,20605] 0 2024-09-17T07:19:43.704 INFO:tasks.workunit.client.1.smithi139.stdout:8/72: write d0/dc/f12 [1017475,75877] 0 2024-09-17T07:19:43.704 INFO:tasks.workunit.client.1.smithi139.stdout:6/59: creat db/f12 x:0 0 0 2024-09-17T07:19:43.705 INFO:tasks.workunit.client.0.smithi087.stdout:0/47: write f4 [878009,31596] 0 2024-09-17T07:19:43.707 INFO:tasks.workunit.client.1.smithi139.stdout:8/73: symlink d0/l14 0 2024-09-17T07:19:43.709 INFO:tasks.workunit.client.0.smithi087.stdout:0/48: creat db/fe x:0 0 0 2024-09-17T07:19:43.709 INFO:tasks.workunit.client.1.smithi139.stdout:8/74: write d0/fa [4816236,130355] 0 2024-09-17T07:19:43.710 INFO:tasks.workunit.client.0.smithi087.stdout:0/49: write db/fe [510093,52342] 0 2024-09-17T07:19:43.710 INFO:tasks.workunit.client.1.smithi139.stdout:6/60: dread f1 [0,4194304] 0 2024-09-17T07:19:43.711 INFO:tasks.workunit.client.0.smithi087.stdout:0/50: chown db/cc 86717 1 2024-09-17T07:19:43.712 INFO:tasks.workunit.client.0.smithi087.stdout:0/51: creat db/ff x:0 0 0 2024-09-17T07:19:43.714 INFO:tasks.workunit.client.0.smithi087.stdout:0/52: write f5 [3400747,68542] 0 2024-09-17T07:19:43.715 INFO:tasks.workunit.client.1.smithi139.stdout:6/61: fsync f7 0 2024-09-17T07:19:43.716 INFO:tasks.workunit.client.1.smithi139.stdout:2/61: write d0/f6 [394599,74815] 0 2024-09-17T07:19:43.718 INFO:tasks.workunit.client.0.smithi087.stdout:0/53: symlink db/l10 0 2024-09-17T07:19:43.719 INFO:tasks.workunit.client.1.smithi139.stdout:6/62: write db/fd [4966824,83075] 0 2024-09-17T07:19:43.720 INFO:tasks.workunit.client.1.smithi139.stdout:6/63: readlink db/l10 0 2024-09-17T07:19:43.721 INFO:tasks.workunit.client.1.smithi139.stdout:6/64: write f2 [758700,67769] 0 2024-09-17T07:19:43.721 INFO:tasks.workunit.client.0.smithi087.stdout:6/94: dwrite d1/d6/f1c [4194304,4194304] 0 2024-09-17T07:19:43.722 INFO:tasks.workunit.client.1.smithi139.stdout:2/62: getdents d0 0 2024-09-17T07:19:43.724 INFO:tasks.workunit.client.0.smithi087.stdout:6/95: rmdir d1/d6 39 2024-09-17T07:19:43.725 INFO:tasks.workunit.client.1.smithi139.stdout:6/65: rename f5 to db/df/f13 0 2024-09-17T07:19:43.727 INFO:tasks.workunit.client.1.smithi139.stdout:2/63: link d0/fb d0/dc/f13 0 2024-09-17T07:19:43.727 INFO:tasks.workunit.client.0.smithi087.stdout:6/96: creat d1/d6/f1f x:0 0 0 2024-09-17T07:19:43.727 INFO:tasks.workunit.client.1.smithi139.stdout:6/66: symlink db/df/l14 0 2024-09-17T07:19:43.727 INFO:tasks.workunit.client.1.smithi139.stdout:2/64: dread - d0/f8 zero size 2024-09-17T07:19:43.728 INFO:tasks.workunit.client.0.smithi087.stdout:6/97: mknod d1/d6/c20 0 2024-09-17T07:19:43.730 INFO:tasks.workunit.client.1.smithi139.stdout:6/67: fsync f7 0 2024-09-17T07:19:43.730 INFO:tasks.workunit.client.0.smithi087.stdout:6/98: unlink d1/d6/c7 0 2024-09-17T07:19:43.731 INFO:tasks.workunit.client.1.smithi139.stdout:2/65: creat d0/de/f14 x:0 0 0 2024-09-17T07:19:43.731 INFO:tasks.workunit.client.1.smithi139.stdout:6/68: write f2 [1676022,116846] 0 2024-09-17T07:19:43.732 INFO:tasks.workunit.client.0.smithi087.stdout:6/99: mknod d1/c21 0 2024-09-17T07:19:43.733 INFO:tasks.workunit.client.0.smithi087.stdout:6/100: dread - d1/d6/f1f zero size 2024-09-17T07:19:43.733 INFO:tasks.workunit.client.1.smithi139.stdout:2/66: mkdir d0/dc/d15 0 2024-09-17T07:19:43.733 INFO:tasks.workunit.client.1.smithi139.stdout:6/69: mknod db/df/c15 0 2024-09-17T07:19:43.734 INFO:tasks.workunit.client.0.smithi087.stdout:0/54: getdents db 0 2024-09-17T07:19:43.734 INFO:tasks.workunit.client.1.smithi139.stdout:6/70: read f1 [782563,72866] 0 2024-09-17T07:19:43.735 INFO:tasks.workunit.client.0.smithi087.stdout:6/101: write d1/d6/f1f [849384,42132] 0 2024-09-17T07:19:43.735 INFO:tasks.workunit.client.1.smithi139.stdout:2/67: fdatasync d0/fa 0 2024-09-17T07:19:43.735 INFO:tasks.workunit.client.0.smithi087.stdout:0/55: write f4 [1913101,73399] 0 2024-09-17T07:19:43.735 INFO:tasks.workunit.client.0.smithi087.stdout:6/102: stat d1/d6/c13 0 2024-09-17T07:19:43.736 INFO:tasks.workunit.client.1.smithi139.stdout:2/68: write d0/f3 [4617733,122419] 0 2024-09-17T07:19:43.736 INFO:tasks.workunit.client.0.smithi087.stdout:0/56: mkdir db/d11 0 2024-09-17T07:19:43.737 INFO:tasks.workunit.client.1.smithi139.stdout:6/71: rename db/fd to db/f16 0 2024-09-17T07:19:43.739 INFO:tasks.workunit.client.0.smithi087.stdout:6/103: truncate d1/f16 1057626 0 2024-09-17T07:19:43.740 INFO:tasks.workunit.client.1.smithi139.stdout:6/72: symlink db/df/l17 0 2024-09-17T07:19:43.740 INFO:tasks.workunit.client.1.smithi139.stdout:2/69: symlink d0/de/df/l16 0 2024-09-17T07:19:43.740 INFO:tasks.workunit.client.1.smithi139.stdout:6/73: fdatasync db/fe 0 2024-09-17T07:19:43.740 INFO:tasks.workunit.client.0.smithi087.stdout:6/104: write d1/d6/f1f [1045545,106212] 0 2024-09-17T07:19:43.742 INFO:tasks.workunit.client.1.smithi139.stdout:2/70: creat d0/dc/d15/f17 x:0 0 0 2024-09-17T07:19:43.743 INFO:tasks.workunit.client.0.smithi087.stdout:6/105: rename d1/l5 to d1/d6/d1a/l22 0 2024-09-17T07:19:43.743 INFO:tasks.workunit.client.1.smithi139.stdout:6/74: dread db/f16 [0,4194304] 0 2024-09-17T07:19:43.746 INFO:tasks.workunit.client.1.smithi139.stdout:6/75: dread db/fe [0,4194304] 0 2024-09-17T07:19:43.748 INFO:tasks.workunit.client.0.smithi087.stdout:0/57: dread db/fe [0,4194304] 0 2024-09-17T07:19:43.750 INFO:tasks.workunit.client.1.smithi139.stdout:8/75: write d0/f9 [1152651,66140] 0 2024-09-17T07:19:43.750 INFO:tasks.workunit.client.1.smithi139.stdout:2/71: dwrite d0/f5 [0,4194304] 0 2024-09-17T07:19:43.750 INFO:tasks.workunit.client.0.smithi087.stdout:0/58: write db/fe [529686,8321] 0 2024-09-17T07:19:43.752 INFO:tasks.workunit.client.0.smithi087.stdout:0/59: chown db/ff 97601090 1 2024-09-17T07:19:43.752 INFO:tasks.workunit.client.0.smithi087.stdout:6/106: dwrite d1/fb [0,4194304] 0 2024-09-17T07:19:43.755 INFO:tasks.workunit.client.1.smithi139.stdout:6/76: dwrite db/fe [0,4194304] 0 2024-09-17T07:19:43.755 INFO:tasks.workunit.client.0.smithi087.stdout:0/60: creat db/f12 x:0 0 0 2024-09-17T07:19:43.763 INFO:tasks.workunit.client.0.smithi087.stdout:1/101: sync 2024-09-17T07:19:43.764 INFO:tasks.workunit.client.0.smithi087.stdout:6/107: dwrite d1/d6/f1c [4194304,4194304] 0 2024-09-17T07:19:43.764 INFO:tasks.workunit.client.0.smithi087.stdout:0/61: getdents db/d11 0 2024-09-17T07:19:43.769 INFO:tasks.workunit.client.0.smithi087.stdout:1/102: creat d2/d1a/f29 x:0 0 0 2024-09-17T07:19:43.770 INFO:tasks.workunit.client.0.smithi087.stdout:0/62: rmdir db/d11 0 2024-09-17T07:19:43.835 INFO:tasks.workunit.client.1.smithi139.stdout:8/76: dread d0/fa [0,4194304] 0 2024-09-17T07:19:43.836 INFO:tasks.workunit.client.1.smithi139.stdout:8/77: chown d0/f7 905 1 2024-09-17T07:19:43.837 INFO:tasks.workunit.client.1.smithi139.stdout:8/78: chown d0/l5 248 1 2024-09-17T07:19:43.837 INFO:tasks.workunit.client.1.smithi139.stdout:8/79: chown d0/fb 1998366 1 2024-09-17T07:19:43.839 INFO:tasks.workunit.client.1.smithi139.stdout:6/77: mkdir db/d18 0 2024-09-17T07:19:43.841 INFO:tasks.workunit.client.0.smithi087.stdout:6/108: fsync d1/f16 0 2024-09-17T07:19:43.842 INFO:tasks.workunit.client.0.smithi087.stdout:6/109: chown d1/f4 1755545 1 2024-09-17T07:19:43.842 INFO:tasks.workunit.client.1.smithi139.stdout:6/78: creat db/df/f19 x:0 0 0 2024-09-17T07:19:43.844 INFO:tasks.workunit.client.0.smithi087.stdout:6/110: creat d1/d6/d1a/f23 x:0 0 0 2024-09-17T07:19:43.846 INFO:tasks.workunit.client.0.smithi087.stdout:6/111: symlink d1/l24 0 2024-09-17T07:19:43.847 INFO:tasks.workunit.client.1.smithi139.stdout:6/79: rename db/f12 to db/d18/f1a 0 2024-09-17T07:19:43.848 INFO:tasks.workunit.client.0.smithi087.stdout:6/112: read d1/d6/f1f [792045,58392] 0 2024-09-17T07:19:43.849 INFO:tasks.workunit.client.1.smithi139.stdout:8/80: dwrite d0/fa [0,4194304] 0 2024-09-17T07:19:43.849 INFO:tasks.workunit.client.1.smithi139.stdout:6/80: mkdir db/d18/d1b 0 2024-09-17T07:19:43.850 INFO:tasks.workunit.client.0.smithi087.stdout:6/113: chown d1/d6/l15 4013 1 2024-09-17T07:19:43.851 INFO:tasks.workunit.client.1.smithi139.stdout:8/81: symlink d0/l15 0 2024-09-17T07:19:43.852 INFO:tasks.workunit.client.1.smithi139.stdout:2/72: dwrite d0/fb [0,4194304] 0 2024-09-17T07:19:43.856 INFO:tasks.workunit.client.1.smithi139.stdout:2/73: mknod d0/de/d11/c18 0 2024-09-17T07:19:43.858 INFO:tasks.workunit.client.1.smithi139.stdout:6/81: link db/df/l14 db/d18/d1b/l1c 0 2024-09-17T07:19:43.858 INFO:tasks.workunit.client.1.smithi139.stdout:2/74: creat d0/d7/f19 x:0 0 0 2024-09-17T07:19:43.859 INFO:tasks.workunit.client.1.smithi139.stdout:2/75: fdatasync d0/d7/f19 0 2024-09-17T07:19:43.860 INFO:tasks.workunit.client.1.smithi139.stdout:2/76: stat d0/d7 0 2024-09-17T07:19:43.860 INFO:tasks.workunit.client.1.smithi139.stdout:6/82: write db/d18/f1a [511764,60087] 0 2024-09-17T07:19:43.862 INFO:tasks.workunit.client.0.smithi087.stdout:6/114: dwrite d1/f11 [0,4194304] 0 2024-09-17T07:19:43.865 INFO:tasks.workunit.client.0.smithi087.stdout:1/103: dwrite d2/d1a/f1c [0,4194304] 0 2024-09-17T07:19:43.867 INFO:tasks.workunit.client.1.smithi139.stdout:6/83: dwrite db/d18/f1a [0,4194304] 0 2024-09-17T07:19:43.868 INFO:tasks.workunit.client.0.smithi087.stdout:6/115: fsync d1/f16 0 2024-09-17T07:19:43.871 INFO:tasks.workunit.client.0.smithi087.stdout:1/104: getdents d2/d14 0 2024-09-17T07:19:43.871 INFO:tasks.workunit.client.1.smithi139.stdout:6/84: dread f1 [0,4194304] 0 2024-09-17T07:19:43.873 INFO:tasks.workunit.client.0.smithi087.stdout:1/105: mknod d2/dc/d26/c2a 0 2024-09-17T07:19:43.874 INFO:tasks.workunit.client.0.smithi087.stdout:6/116: dread d1/f16 [0,4194304] 0 2024-09-17T07:19:43.875 INFO:tasks.workunit.client.0.smithi087.stdout:6/117: write d1/fb [3413971,28924] 0 2024-09-17T07:19:43.876 INFO:tasks.workunit.client.0.smithi087.stdout:6/118: read d1/f1d [3187705,18450] 0 2024-09-17T07:19:43.878 INFO:tasks.workunit.client.0.smithi087.stdout:6/119: read d1/f16 [254631,70266] 0 2024-09-17T07:19:43.879 INFO:tasks.workunit.client.0.smithi087.stdout:1/106: link d2/dc/f23 d2/da/f2b 0 2024-09-17T07:19:43.880 INFO:tasks.workunit.client.1.smithi139.stdout:6/85: dwrite db/df/f19 [0,4194304] 0 2024-09-17T07:19:43.881 INFO:tasks.workunit.client.1.smithi139.stdout:6/86: read db/df/f19 [3591226,126067] 0 2024-09-17T07:19:43.883 INFO:tasks.workunit.client.0.smithi087.stdout:6/120: creat d1/f25 x:0 0 0 2024-09-17T07:19:43.884 INFO:tasks.workunit.client.0.smithi087.stdout:6/121: stat d1/d6/d1a/l1e 0 2024-09-17T07:19:43.887 INFO:tasks.workunit.client.0.smithi087.stdout:6/122: creat d1/f26 x:0 0 0 2024-09-17T07:19:43.892 INFO:tasks.workunit.client.0.smithi087.stdout:6/123: rename d1/d6/d1a/l22 to d1/l27 0 2024-09-17T07:19:43.893 INFO:tasks.workunit.client.0.smithi087.stdout:6/124: creat d1/d6/d1a/f28 x:0 0 0 2024-09-17T07:19:43.895 INFO:tasks.workunit.client.0.smithi087.stdout:6/125: read d1/f4 [4371384,94163] 0 2024-09-17T07:19:43.897 INFO:tasks.workunit.client.0.smithi087.stdout:6/126: write d1/d6/f12 [959761,68833] 0 2024-09-17T07:19:43.898 INFO:tasks.workunit.client.0.smithi087.stdout:6/127: mknod d1/d6/d1a/c29 0 2024-09-17T07:19:43.899 INFO:tasks.workunit.client.0.smithi087.stdout:6/128: dread - d1/d6/d1a/f23 zero size 2024-09-17T07:19:43.900 INFO:tasks.workunit.client.0.smithi087.stdout:6/129: creat d1/d6/f2a x:0 0 0 2024-09-17T07:19:43.938 INFO:tasks.workunit.client.0.smithi087.stdout:2/53: sync 2024-09-17T07:19:43.938 INFO:tasks.workunit.client.0.smithi087.stdout:8/77: sync 2024-09-17T07:19:43.938 INFO:tasks.workunit.client.0.smithi087.stdout:7/46: sync 2024-09-17T07:19:43.938 INFO:tasks.workunit.client.0.smithi087.stdout:3/30: sync 2024-09-17T07:19:43.938 INFO:tasks.workunit.client.0.smithi087.stdout:4/53: sync 2024-09-17T07:19:43.938 INFO:tasks.workunit.client.0.smithi087.stdout:0/63: sync 2024-09-17T07:19:43.938 INFO:tasks.workunit.client.0.smithi087.stdout:5/62: sync 2024-09-17T07:19:43.938 INFO:tasks.workunit.client.0.smithi087.stdout:9/30: sync 2024-09-17T07:19:43.939 INFO:tasks.workunit.client.0.smithi087.stdout:3/31: fsync d6/f7 0 2024-09-17T07:19:43.939 INFO:tasks.workunit.client.0.smithi087.stdout:4/54: stat d2/lf 0 2024-09-17T07:19:43.940 INFO:tasks.workunit.client.0.smithi087.stdout:5/63: readlink d5/d8/le 0 2024-09-17T07:19:43.941 INFO:tasks.workunit.client.0.smithi087.stdout:3/32: truncate f4 5282639 0 2024-09-17T07:19:43.942 INFO:tasks.workunit.client.0.smithi087.stdout:7/47: dread d0/f2 [4194304,4194304] 0 2024-09-17T07:19:43.944 INFO:tasks.workunit.client.0.smithi087.stdout:4/55: creat d2/d5/f12 x:0 0 0 2024-09-17T07:19:43.945 INFO:tasks.workunit.client.0.smithi087.stdout:3/33: write d6/f7 [965743,52223] 0 2024-09-17T07:19:43.945 INFO:tasks.workunit.client.0.smithi087.stdout:7/48: creat d0/fc x:0 0 0 2024-09-17T07:19:43.947 INFO:tasks.workunit.client.0.smithi087.stdout:5/64: symlink d5/d18/l1a 0 2024-09-17T07:19:43.949 INFO:tasks.workunit.client.0.smithi087.stdout:4/56: symlink d2/d5/l13 0 2024-09-17T07:19:43.950 INFO:tasks.workunit.client.0.smithi087.stdout:2/54: dread d2/f5 [0,4194304] 0 2024-09-17T07:19:43.950 INFO:tasks.workunit.client.0.smithi087.stdout:0/64: dwrite f6 [0,4194304] 0 2024-09-17T07:19:43.950 INFO:tasks.workunit.client.0.smithi087.stdout:7/49: truncate d0/fc 704511 0 2024-09-17T07:19:43.951 INFO:tasks.workunit.client.0.smithi087.stdout:9/31: dread f2 [0,4194304] 0 2024-09-17T07:19:43.951 INFO:tasks.workunit.client.0.smithi087.stdout:4/57: fdatasync d2/d5/f12 0 2024-09-17T07:19:43.954 INFO:tasks.workunit.client.0.smithi087.stdout:7/50: chown d0/fa 11447441 1 2024-09-17T07:19:43.954 INFO:tasks.workunit.client.0.smithi087.stdout:2/55: creat d2/d7/fe x:0 0 0 2024-09-17T07:19:43.954 INFO:tasks.workunit.client.0.smithi087.stdout:9/32: stat d3/d4/c5 0 2024-09-17T07:19:43.955 INFO:tasks.workunit.client.0.smithi087.stdout:0/65: dread db/fe [0,4194304] 0 2024-09-17T07:19:43.956 INFO:tasks.workunit.client.0.smithi087.stdout:4/58: mknod d2/d5/db/c14 0 2024-09-17T07:19:43.957 INFO:tasks.workunit.client.0.smithi087.stdout:2/56: read d2/f5 [1991322,4557] 0 2024-09-17T07:19:43.957 INFO:tasks.workunit.client.0.smithi087.stdout:7/51: creat d0/fd x:0 0 0 2024-09-17T07:19:43.958 INFO:tasks.workunit.client.0.smithi087.stdout:9/33: chown d3/d4/d6/d8 110 1 2024-09-17T07:19:43.959 INFO:tasks.workunit.client.0.smithi087.stdout:0/66: fsync db/fe 0 2024-09-17T07:19:43.960 INFO:tasks.workunit.client.0.smithi087.stdout:3/34: dread f4 [0,4194304] 0 2024-09-17T07:19:43.962 INFO:tasks.workunit.client.0.smithi087.stdout:5/65: dwrite d5/f17 [0,4194304] 0 2024-09-17T07:19:43.964 INFO:tasks.workunit.client.0.smithi087.stdout:0/67: dread fa [0,4194304] 0 2024-09-17T07:19:43.964 INFO:tasks.workunit.client.0.smithi087.stdout:7/52: creat d0/d3/fe x:0 0 0 2024-09-17T07:19:43.964 INFO:tasks.workunit.client.0.smithi087.stdout:9/34: unlink d3/d4/d6/d8/f9 0 2024-09-17T07:19:43.965 INFO:tasks.workunit.client.0.smithi087.stdout:7/53: dread - d0/f8 zero size 2024-09-17T07:19:43.966 INFO:tasks.workunit.client.0.smithi087.stdout:3/35: symlink d6/l9 0 2024-09-17T07:19:43.966 INFO:tasks.workunit.client.0.smithi087.stdout:0/68: write db/ff [294339,65840] 0 2024-09-17T07:19:43.968 INFO:tasks.workunit.client.0.smithi087.stdout:5/66: creat d5/f1b x:0 0 0 2024-09-17T07:19:43.968 INFO:tasks.workunit.client.0.smithi087.stdout:0/69: read f6 [2247171,8367] 0 2024-09-17T07:19:43.969 INFO:tasks.workunit.client.0.smithi087.stdout:0/70: readlink db/l10 0 2024-09-17T07:19:43.969 INFO:tasks.workunit.client.0.smithi087.stdout:2/57: link d2/d7/fe d2/d7/dd/ff 0 2024-09-17T07:19:43.970 INFO:tasks.workunit.client.0.smithi087.stdout:9/35: mknod d3/d4/ce 0 2024-09-17T07:19:43.971 INFO:tasks.workunit.client.0.smithi087.stdout:7/54: mknod d0/d3/cf 0 2024-09-17T07:19:43.973 INFO:tasks.workunit.client.0.smithi087.stdout:9/36: write d3/fc [244207,106169] 0 2024-09-17T07:19:43.975 INFO:tasks.workunit.client.0.smithi087.stdout:3/36: dwrite d6/f7 [0,4194304] 0 2024-09-17T07:19:43.975 INFO:tasks.workunit.client.0.smithi087.stdout:7/55: dread d0/d3/f4 [0,4194304] 0 2024-09-17T07:19:43.976 INFO:tasks.workunit.client.0.smithi087.stdout:0/71: creat db/f13 x:0 0 0 2024-09-17T07:19:43.976 INFO:tasks.workunit.client.0.smithi087.stdout:9/37: chown d3/d4/d6/d8/fd 84651156 1 2024-09-17T07:19:43.977 INFO:tasks.workunit.client.0.smithi087.stdout:0/72: chown f4 486009499 1 2024-09-17T07:19:43.977 INFO:tasks.workunit.client.0.smithi087.stdout:3/37: write d6/f7 [507495,35705] 0 2024-09-17T07:19:43.977 INFO:tasks.workunit.client.0.smithi087.stdout:9/38: chown d3/d4/fb 1 1 2024-09-17T07:19:43.978 INFO:tasks.workunit.client.0.smithi087.stdout:2/58: mkdir d2/d7/dd/d10 0 2024-09-17T07:19:43.979 INFO:tasks.workunit.client.0.smithi087.stdout:2/59: fdatasync d2/d7/f8 0 2024-09-17T07:19:43.979 INFO:tasks.workunit.client.0.smithi087.stdout:7/56: mkdir d0/d3/d10 0 2024-09-17T07:19:43.980 INFO:tasks.workunit.client.0.smithi087.stdout:0/73: write fa [1121230,31475] 0 2024-09-17T07:19:43.980 INFO:tasks.workunit.client.0.smithi087.stdout:3/38: creat d6/fa x:0 0 0 2024-09-17T07:19:43.981 INFO:tasks.workunit.client.0.smithi087.stdout:0/74: write f4 [1584894,80512] 0 2024-09-17T07:19:43.983 INFO:tasks.workunit.client.0.smithi087.stdout:9/39: symlink d3/d4/da/lf 0 2024-09-17T07:19:43.986 INFO:tasks.workunit.client.0.smithi087.stdout:9/40: write f2 [206386,68545] 0 2024-09-17T07:19:43.987 INFO:tasks.workunit.client.0.smithi087.stdout:3/39: link d6/f7 d6/fb 0 2024-09-17T07:19:43.989 INFO:tasks.workunit.client.0.smithi087.stdout:2/60: dwrite d2/f5 [0,4194304] 0 2024-09-17T07:19:43.989 INFO:tasks.workunit.client.0.smithi087.stdout:3/40: dread - d6/fa zero size 2024-09-17T07:19:43.989 INFO:tasks.workunit.client.0.smithi087.stdout:0/75: dread f5 [0,4194304] 0 2024-09-17T07:19:43.993 INFO:tasks.workunit.client.0.smithi087.stdout:0/76: mknod db/c14 0 2024-09-17T07:19:43.994 INFO:tasks.workunit.client.0.smithi087.stdout:2/61: dread d2/f5 [0,4194304] 0 2024-09-17T07:19:43.994 INFO:tasks.workunit.client.0.smithi087.stdout:3/41: dread d6/f7 [0,4194304] 0 2024-09-17T07:19:43.996 INFO:tasks.workunit.client.0.smithi087.stdout:3/42: creat d6/fc x:0 0 0 2024-09-17T07:19:43.997 INFO:tasks.workunit.client.0.smithi087.stdout:2/62: fdatasync d2/d7/dd/ff 0 2024-09-17T07:19:43.999 INFO:tasks.workunit.client.0.smithi087.stdout:3/43: rename d6/fb to d6/fd 0 2024-09-17T07:19:44.000 INFO:tasks.workunit.client.0.smithi087.stdout:3/44: mknod d6/ce 0 2024-09-17T07:19:44.000 INFO:tasks.workunit.client.0.smithi087.stdout:3/45: chown d6/f7 5 1 2024-09-17T07:19:44.046 INFO:tasks.workunit.client.1.smithi139.stdout:6/87: read f2 [1267593,108746] 0 2024-09-17T07:19:44.049 INFO:tasks.workunit.client.1.smithi139.stdout:8/82: getdents d0 0 2024-09-17T07:19:44.052 INFO:tasks.workunit.client.1.smithi139.stdout:6/88: creat db/d18/d1b/f1d x:0 0 0 2024-09-17T07:19:44.054 INFO:tasks.workunit.client.1.smithi139.stdout:8/83: mknod d0/c16 0 2024-09-17T07:19:44.077 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:43 smithi087 ceph-mon[27636]: mgrmap e23: smithi139.tuqnpn(active, since 3s) 2024-09-17T07:19:44.077 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:43 smithi087 ceph-mon[27636]: pgmap v5: 65 pgs: 65 active+clean; 285 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-09-17T07:19:44.159 INFO:tasks.workunit.client.0.smithi087.stdout:5/67: sync 2024-09-17T07:19:44.160 INFO:tasks.workunit.client.0.smithi087.stdout:5/68: mkdir d5/d12/d1c 0 2024-09-17T07:19:44.162 INFO:tasks.workunit.client.0.smithi087.stdout:5/69: symlink d5/d12/d1c/l1d 0 2024-09-17T07:19:44.162 INFO:tasks.workunit.client.0.smithi087.stdout:5/70: chown d5/d8 237090 1 2024-09-17T07:19:44.164 INFO:tasks.workunit.client.0.smithi087.stdout:5/71: rmdir d5/d8/dd 0 2024-09-17T07:19:44.168 INFO:tasks.workunit.client.1.smithi139.stdout:8/84: mknod d0/c17 0 2024-09-17T07:19:44.170 INFO:tasks.workunit.client.1.smithi139.stdout:8/85: mkdir d0/dc/d18 0 2024-09-17T07:19:44.172 INFO:tasks.workunit.client.0.smithi087.stdout:1/107: write d2/dc/f23 [1033351,35604] 0 2024-09-17T07:19:44.175 INFO:tasks.workunit.client.1.smithi139.stdout:6/89: truncate db/fe 2918397 0 2024-09-17T07:19:44.176 INFO:tasks.workunit.client.0.smithi087.stdout:6/130: getdents d1/d6 0 2024-09-17T07:19:44.176 INFO:tasks.workunit.client.0.smithi087.stdout:8/78: write d1/f8 [912680,12254] 0 2024-09-17T07:19:44.177 INFO:tasks.workunit.client.1.smithi139.stdout:8/86: dwrite d0/fa [0,4194304] 0 2024-09-17T07:19:44.179 INFO:tasks.workunit.client.1.smithi139.stdout:6/90: rename db/df/l14 to db/d18/d1b/l1e 0 2024-09-17T07:19:44.179 INFO:tasks.workunit.client.1.smithi139.stdout:8/87: getdents d0/dc/d18 0 2024-09-17T07:19:44.183 INFO:tasks.workunit.client.1.smithi139.stdout:8/88: dread d0/f7 [0,4194304] 0 2024-09-17T07:19:44.184 INFO:tasks.workunit.client.0.smithi087.stdout:8/79: dread d1/f8 [0,4194304] 0 2024-09-17T07:19:44.185 INFO:tasks.workunit.client.0.smithi087.stdout:4/59: write d2/d5/f10 [1104209,84291] 0 2024-09-17T07:19:44.187 INFO:tasks.workunit.client.1.smithi139.stdout:8/89: link d0/l15 d0/dc/d18/l19 0 2024-09-17T07:19:44.188 INFO:tasks.workunit.client.0.smithi087.stdout:1/108: dwrite d2/d14/dd/ff [4194304,4194304] 0 2024-09-17T07:19:44.189 INFO:tasks.workunit.client.0.smithi087.stdout:9/41: getdents d3/d4/d6/d8 0 2024-09-17T07:19:44.189 INFO:tasks.workunit.client.1.smithi139.stdout:8/90: mkdir d0/d1a 0 2024-09-17T07:19:44.192 INFO:tasks.workunit.client.0.smithi087.stdout:8/80: mknod d1/d10/c17 0 2024-09-17T07:19:44.193 INFO:tasks.workunit.client.0.smithi087.stdout:6/131: dwrite d1/f16 [0,4194304] 0 2024-09-17T07:19:44.193 INFO:tasks.workunit.client.1.smithi139.stdout:8/91: creat d0/f1b x:0 0 0 2024-09-17T07:19:44.193 INFO:tasks.workunit.client.1.smithi139.stdout:6/91: dwrite db/d18/f1a [4194304,4194304] 0 2024-09-17T07:19:44.194 INFO:tasks.workunit.client.1.smithi139.stdout:8/92: readlink d0/l11 0 2024-09-17T07:19:44.194 INFO:tasks.workunit.client.1.smithi139.stdout:6/92: chown db/df/c11 44698 1 2024-09-17T07:19:44.194 INFO:tasks.workunit.client.1.smithi139.stdout:8/93: stat d0/dc 0 2024-09-17T07:19:44.195 INFO:tasks.workunit.client.0.smithi087.stdout:4/60: mkdir d2/d5/db/d15 0 2024-09-17T07:19:44.196 INFO:tasks.workunit.client.1.smithi139.stdout:6/93: rmdir db/df 39 2024-09-17T07:19:44.199 INFO:tasks.workunit.client.0.smithi087.stdout:9/42: symlink d3/d4/l10 0 2024-09-17T07:19:44.199 INFO:tasks.workunit.client.1.smithi139.stdout:8/94: creat d0/dc/d18/f1c x:0 0 0 2024-09-17T07:19:44.200 INFO:tasks.workunit.client.0.smithi087.stdout:1/109: symlink d2/d14/dd/l2c 0 2024-09-17T07:19:44.200 INFO:tasks.workunit.client.0.smithi087.stdout:2/63: getdents d2/d7/dd 0 2024-09-17T07:19:44.201 INFO:tasks.workunit.client.0.smithi087.stdout:6/132: dread d1/f11 [0,4194304] 0 2024-09-17T07:19:44.201 INFO:tasks.workunit.client.0.smithi087.stdout:9/43: write f2 [1628769,76478] 0 2024-09-17T07:19:44.202 INFO:tasks.workunit.client.0.smithi087.stdout:7/57: rmdir d0 39 2024-09-17T07:19:44.204 INFO:tasks.workunit.client.0.smithi087.stdout:9/44: write d3/d4/fb [556918,53318] 0 2024-09-17T07:19:44.205 INFO:tasks.workunit.client.0.smithi087.stdout:4/61: unlink d2/la 0 2024-09-17T07:19:44.206 INFO:tasks.workunit.client.1.smithi139.stdout:6/94: dread db/fe [0,4194304] 0 2024-09-17T07:19:44.208 INFO:tasks.workunit.client.0.smithi087.stdout:2/64: dread d2/d7/f8 [0,4194304] 0 2024-09-17T07:19:44.209 INFO:tasks.workunit.client.1.smithi139.stdout:6/95: mknod db/df/c1f 0 2024-09-17T07:19:44.209 INFO:tasks.workunit.client.0.smithi087.stdout:4/62: write d2/fc [326018,43941] 0 2024-09-17T07:19:44.209 INFO:tasks.workunit.client.0.smithi087.stdout:8/81: mkdir d1/d15/d18 0 2024-09-17T07:19:44.210 INFO:tasks.workunit.client.0.smithi087.stdout:3/46: truncate d6/fd 530488 0 2024-09-17T07:19:44.211 INFO:tasks.workunit.client.1.smithi139.stdout:6/96: link db/df/c1f db/d18/c20 0 2024-09-17T07:19:44.213 INFO:tasks.workunit.client.0.smithi087.stdout:3/47: read f4 [2518671,7670] 0 2024-09-17T07:19:44.214 INFO:tasks.workunit.client.1.smithi139.stdout:6/97: mkdir db/d21 0 2024-09-17T07:19:44.214 INFO:tasks.workunit.client.1.smithi139.stdout:6/98: read db/df/f13 [1460976,104549] 0 2024-09-17T07:19:44.215 INFO:tasks.workunit.client.0.smithi087.stdout:0/77: truncate fa 557485 0 2024-09-17T07:19:44.215 INFO:tasks.workunit.client.0.smithi087.stdout:7/58: read - d0/d3/fe zero size 2024-09-17T07:19:44.217 INFO:tasks.workunit.client.1.smithi139.stdout:6/99: dread db/d18/f1a [0,4194304] 0 2024-09-17T07:19:44.218 INFO:tasks.workunit.client.0.smithi087.stdout:2/65: symlink d2/d7/l11 0 2024-09-17T07:19:44.218 INFO:tasks.workunit.client.0.smithi087.stdout:6/133: dwrite d1/d6/f2a [0,4194304] 0 2024-09-17T07:19:44.219 INFO:tasks.workunit.client.0.smithi087.stdout:8/82: dread d1/d7/f13 [0,4194304] 0 2024-09-17T07:19:44.220 INFO:tasks.workunit.client.0.smithi087.stdout:0/78: read - db/f13 zero size 2024-09-17T07:19:44.222 INFO:tasks.workunit.client.0.smithi087.stdout:1/110: creat d2/f2d x:0 0 0 2024-09-17T07:19:44.223 INFO:tasks.workunit.client.0.smithi087.stdout:6/134: stat d1/l24 0 2024-09-17T07:19:44.224 INFO:tasks.workunit.client.0.smithi087.stdout:7/59: write d0/f8 [939449,123239] 0 2024-09-17T07:19:44.225 INFO:tasks.workunit.client.0.smithi087.stdout:9/45: dwrite d3/d4/d6/d8/fd [0,4194304] 0 2024-09-17T07:19:44.227 INFO:tasks.workunit.client.0.smithi087.stdout:5/72: write d5/d8/f10 [3714079,31011] 0 2024-09-17T07:19:44.228 INFO:tasks.workunit.client.0.smithi087.stdout:1/111: dread - d2/f2d zero size 2024-09-17T07:19:44.228 INFO:tasks.workunit.client.0.smithi087.stdout:2/66: mkdir d2/d12 0 2024-09-17T07:19:44.231 INFO:tasks.workunit.client.0.smithi087.stdout:8/83: rmdir d1/d15 39 2024-09-17T07:19:44.235 INFO:tasks.workunit.client.0.smithi087.stdout:9/46: fdatasync d3/f7 0 2024-09-17T07:19:44.236 INFO:tasks.workunit.client.0.smithi087.stdout:4/63: dwrite d2/d5/f10 [0,4194304] 0 2024-09-17T07:19:44.238 INFO:tasks.workunit.client.0.smithi087.stdout:9/47: readlink d3/d4/da/lf 0 2024-09-17T07:19:44.239 INFO:tasks.workunit.client.0.smithi087.stdout:3/48: fsync d6/f7 0 2024-09-17T07:19:44.243 INFO:tasks.workunit.client.0.smithi087.stdout:1/112: symlink d2/dc/l2e 0 2024-09-17T07:19:44.244 INFO:tasks.workunit.client.0.smithi087.stdout:4/64: truncate d2/d5/db/fd 885385 0 2024-09-17T07:19:44.245 INFO:tasks.workunit.client.0.smithi087.stdout:0/79: dwrite db/f13 [0,4194304] 0 2024-09-17T07:19:44.245 INFO:tasks.workunit.client.0.smithi087.stdout:8/84: mkdir d1/d7/d9/d19 0 2024-09-17T07:19:44.248 INFO:tasks.workunit.client.0.smithi087.stdout:7/60: mkdir d0/d3/d10/d11 0 2024-09-17T07:19:44.248 INFO:tasks.workunit.client.0.smithi087.stdout:9/48: mknod d3/d4/d6/d8/c11 0 2024-09-17T07:19:44.249 INFO:tasks.workunit.client.0.smithi087.stdout:0/80: fsync f5 0 2024-09-17T07:19:44.250 INFO:tasks.workunit.client.0.smithi087.stdout:5/73: link d5/d8/f10 d5/d9/f1e 0 2024-09-17T07:19:44.250 INFO:tasks.workunit.client.0.smithi087.stdout:1/113: creat d2/dc/d26/f2f x:0 0 0 2024-09-17T07:19:44.251 INFO:tasks.workunit.client.0.smithi087.stdout:7/61: read d0/f6 [4271279,120943] 0 2024-09-17T07:19:44.251 INFO:tasks.workunit.client.0.smithi087.stdout:4/65: creat d2/d5/f16 x:0 0 0 2024-09-17T07:19:44.254 INFO:tasks.workunit.client.0.smithi087.stdout:6/135: dwrite d1/d6/f2a [4194304,4194304] 0 2024-09-17T07:19:44.255 INFO:tasks.workunit.client.0.smithi087.stdout:0/81: write f4 [3011754,62711] 0 2024-09-17T07:19:44.255 INFO:tasks.workunit.client.0.smithi087.stdout:7/62: chown d0/f8 176036 1 2024-09-17T07:19:44.256 INFO:tasks.workunit.client.0.smithi087.stdout:8/85: rename d1/d7/c14 to d1/d7/d9/d19/c1a 0 2024-09-17T07:19:44.256 INFO:tasks.workunit.client.0.smithi087.stdout:5/74: write d5/f19 [619368,76076] 0 2024-09-17T07:19:44.258 INFO:tasks.workunit.client.0.smithi087.stdout:8/86: chown d1/d7/le 1376619975 1 2024-09-17T07:19:44.258 INFO:tasks.workunit.client.0.smithi087.stdout:3/49: link d6/l9 d6/lf 0 2024-09-17T07:19:44.259 INFO:tasks.workunit.client.0.smithi087.stdout:0/82: read db/fe [558803,88259] 0 2024-09-17T07:19:44.260 INFO:tasks.workunit.client.0.smithi087.stdout:9/49: truncate f2 3472431 0 2024-09-17T07:19:44.261 INFO:tasks.workunit.client.0.smithi087.stdout:0/83: stat f6 0 2024-09-17T07:19:44.261 INFO:tasks.workunit.client.0.smithi087.stdout:4/66: rename d2/c9 to d2/d5/db/c17 0 2024-09-17T07:19:44.261 INFO:tasks.workunit.client.0.smithi087.stdout:5/75: write d5/f19 [2827,2368] 0 2024-09-17T07:19:44.263 INFO:tasks.workunit.client.0.smithi087.stdout:6/136: creat d1/d6/f2b x:0 0 0 2024-09-17T07:19:44.264 INFO:tasks.workunit.client.0.smithi087.stdout:3/50: write d6/fc [423501,82215] 0 2024-09-17T07:19:44.265 INFO:tasks.workunit.client.0.smithi087.stdout:4/67: chown d2/lf 3 1 2024-09-17T07:19:44.266 INFO:tasks.workunit.client.0.smithi087.stdout:5/76: truncate d5/f19 1342903 0 2024-09-17T07:19:44.266 INFO:tasks.workunit.client.0.smithi087.stdout:0/84: creat db/f15 x:0 0 0 2024-09-17T07:19:44.266 INFO:tasks.workunit.client.0.smithi087.stdout:8/87: chown d1/d7/d9/fc 15 1 2024-09-17T07:19:44.266 INFO:tasks.workunit.client.0.smithi087.stdout:9/50: mkdir d3/d4/d6/d8/d12 0 2024-09-17T07:19:44.268 INFO:tasks.workunit.client.0.smithi087.stdout:6/137: mkdir d1/d6/d1a/d2c 0 2024-09-17T07:19:44.269 INFO:tasks.workunit.client.0.smithi087.stdout:9/51: fsync d3/fc 0 2024-09-17T07:19:44.270 INFO:tasks.workunit.client.0.smithi087.stdout:2/67: dread d2/f3 [0,4194304] 0 2024-09-17T07:19:44.270 INFO:tasks.workunit.client.0.smithi087.stdout:3/51: write d6/fa [95441,60824] 0 2024-09-17T07:19:44.272 INFO:tasks.workunit.client.0.smithi087.stdout:1/114: dread d2/dc/d26/f28 [0,4194304] 0 2024-09-17T07:19:44.272 INFO:tasks.workunit.client.0.smithi087.stdout:6/138: write d1/fd [4378565,95069] 0 2024-09-17T07:19:44.274 INFO:tasks.workunit.client.0.smithi087.stdout:5/77: mkdir d5/d8/d1f 0 2024-09-17T07:19:44.275 INFO:tasks.workunit.client.0.smithi087.stdout:7/63: getdents d0/d3/d10 0 2024-09-17T07:19:44.275 INFO:tasks.workunit.client.0.smithi087.stdout:9/52: truncate d3/fc 1156933 0 2024-09-17T07:19:44.277 INFO:tasks.workunit.client.0.smithi087.stdout:3/52: unlink d6/f7 0 2024-09-17T07:19:44.282 INFO:tasks.workunit.client.0.smithi087.stdout:0/85: dwrite db/f15 [0,4194304] 0 2024-09-17T07:19:44.283 INFO:tasks.workunit.client.0.smithi087.stdout:9/53: write d3/d4/d6/d8/fd [3668884,96876] 0 2024-09-17T07:19:44.284 INFO:tasks.workunit.client.0.smithi087.stdout:3/53: unlink d6/c8 0 2024-09-17T07:19:44.285 INFO:tasks.workunit.client.0.smithi087.stdout:1/115: truncate d2/d14/dd/f20 1521463 0 2024-09-17T07:19:44.287 INFO:tasks.workunit.client.0.smithi087.stdout:2/68: dread d2/f3 [0,4194304] 0 2024-09-17T07:19:44.288 INFO:tasks.workunit.client.0.smithi087.stdout:4/68: rename d2/d5/db/c17 to d2/c18 0 2024-09-17T07:19:44.289 INFO:tasks.workunit.client.0.smithi087.stdout:0/86: symlink db/l16 0 2024-09-17T07:19:44.290 INFO:tasks.workunit.client.0.smithi087.stdout:7/64: dwrite d0/fc [0,4194304] 0 2024-09-17T07:19:44.292 INFO:tasks.workunit.client.0.smithi087.stdout:3/54: mknod d6/c10 0 2024-09-17T07:19:44.294 INFO:tasks.workunit.client.0.smithi087.stdout:2/69: stat d2/l6 0 2024-09-17T07:19:44.299 INFO:tasks.workunit.client.0.smithi087.stdout:5/78: getdents d5/d12 0 2024-09-17T07:19:44.301 INFO:tasks.workunit.client.0.smithi087.stdout:0/87: creat db/f17 x:0 0 0 2024-09-17T07:19:44.304 INFO:tasks.workunit.client.0.smithi087.stdout:7/65: dwrite d0/fd [0,4194304] 0 2024-09-17T07:19:44.305 INFO:tasks.workunit.client.0.smithi087.stdout:3/55: creat d6/f11 x:0 0 0 2024-09-17T07:19:44.305 INFO:tasks.workunit.client.0.smithi087.stdout:0/88: write f4 [3375698,30128] 0 2024-09-17T07:19:44.306 INFO:tasks.workunit.client.0.smithi087.stdout:0/89: fsync db/f12 0 2024-09-17T07:19:44.306 INFO:tasks.workunit.client.0.smithi087.stdout:8/88: rename d1/d15 to d1/d7/d9/d19/d1b 0 2024-09-17T07:19:44.307 INFO:tasks.workunit.client.0.smithi087.stdout:9/54: link d3/d4/d6/d8/fd d3/d4/d6/f13 0 2024-09-17T07:19:44.309 INFO:tasks.workunit.client.0.smithi087.stdout:8/89: dread d1/f8 [0,4194304] 0 2024-09-17T07:19:44.310 INFO:tasks.workunit.client.0.smithi087.stdout:4/69: mknod d2/d5/db/d15/c19 0 2024-09-17T07:19:44.311 INFO:tasks.workunit.client.0.smithi087.stdout:7/66: dread d0/fd [0,4194304] 0 2024-09-17T07:19:44.311 INFO:tasks.workunit.client.0.smithi087.stdout:9/55: truncate d3/fc 2040372 0 2024-09-17T07:19:44.311 INFO:tasks.workunit.client.0.smithi087.stdout:5/79: fdatasync d5/d9/f1e 0 2024-09-17T07:19:44.313 INFO:tasks.workunit.client.0.smithi087.stdout:9/56: stat d3/d4/d6/d8/fd 0 2024-09-17T07:19:44.313 INFO:tasks.workunit.client.0.smithi087.stdout:7/67: write d0/f8 [853493,20772] 0 2024-09-17T07:19:44.316 INFO:tasks.workunit.client.0.smithi087.stdout:2/70: mknod d2/d7/dd/c13 0 2024-09-17T07:19:44.318 INFO:tasks.workunit.client.0.smithi087.stdout:6/139: rename d1/fd to d1/d6/d1a/d2c/f2d 0 2024-09-17T07:19:44.320 INFO:tasks.workunit.client.0.smithi087.stdout:4/70: creat d2/f1a x:0 0 0 2024-09-17T07:19:44.322 INFO:tasks.workunit.client.0.smithi087.stdout:4/71: write d2/d5/f12 [824735,55800] 0 2024-09-17T07:19:44.323 INFO:tasks.workunit.client.0.smithi087.stdout:4/72: truncate f0 5348018 0 2024-09-17T07:19:44.324 INFO:tasks.workunit.client.0.smithi087.stdout:8/90: creat d1/d7/d9/d19/d1b/f1c x:0 0 0 2024-09-17T07:19:44.326 INFO:tasks.workunit.client.0.smithi087.stdout:9/57: read d3/f7 [2333221,79049] 0 2024-09-17T07:19:44.327 INFO:tasks.workunit.client.0.smithi087.stdout:7/68: write d0/d3/f4 [632033,11607] 0 2024-09-17T07:19:44.327 INFO:tasks.workunit.client.0.smithi087.stdout:2/71: rmdir d2/d7/db 39 2024-09-17T07:19:44.331 INFO:tasks.workunit.client.0.smithi087.stdout:8/91: fdatasync d1/f8 0 2024-09-17T07:19:44.333 INFO:tasks.workunit.client.0.smithi087.stdout:8/92: chown d1/l5 8133 1 2024-09-17T07:19:44.334 INFO:tasks.workunit.client.0.smithi087.stdout:0/90: rename f4 to db/f18 0 2024-09-17T07:19:44.335 INFO:tasks.workunit.client.0.smithi087.stdout:7/69: dwrite d0/d3/fe [0,4194304] 0 2024-09-17T07:19:44.337 INFO:tasks.workunit.client.0.smithi087.stdout:0/91: write db/fe [550885,35546] 0 2024-09-17T07:19:44.338 INFO:tasks.workunit.client.0.smithi087.stdout:4/73: link d2/d5/f10 d2/d5/db/f1b 0 2024-09-17T07:19:44.341 INFO:tasks.workunit.client.0.smithi087.stdout:9/58: write d3/d4/d6/d8/fd [2265864,78171] 0 2024-09-17T07:19:44.342 INFO:tasks.workunit.client.0.smithi087.stdout:4/74: chown d2/d5/db/d15 23 1 2024-09-17T07:19:44.342 INFO:tasks.workunit.client.0.smithi087.stdout:8/93: creat d1/d7/d9/d19/f1d x:0 0 0 2024-09-17T07:19:44.345 INFO:tasks.workunit.client.0.smithi087.stdout:3/56: creat d6/f12 x:0 0 0 2024-09-17T07:19:44.345 INFO:tasks.workunit.client.0.smithi087.stdout:8/94: stat d1/d10/c17 0 2024-09-17T07:19:44.345 INFO:tasks.workunit.client.0.smithi087.stdout:4/75: stat d2/d5/db/c14 0 2024-09-17T07:19:44.346 INFO:tasks.workunit.client.0.smithi087.stdout:5/80: rename d5/d9 to d5/d18/d20 0 2024-09-17T07:19:44.348 INFO:tasks.workunit.client.0.smithi087.stdout:0/92: unlink fa 0 2024-09-17T07:19:44.348 INFO:tasks.workunit.client.0.smithi087.stdout:5/81: read - d5/f1b zero size 2024-09-17T07:19:44.349 INFO:tasks.workunit.client.0.smithi087.stdout:7/70: dwrite d0/d3/fe [0,4194304] 0 2024-09-17T07:19:44.350 INFO:tasks.workunit.client.0.smithi087.stdout:0/93: read db/f15 [3547345,74151] 0 2024-09-17T07:19:44.351 INFO:tasks.workunit.client.0.smithi087.stdout:2/72: truncate d2/f3 1468481 0 2024-09-17T07:19:44.356 INFO:tasks.workunit.client.0.smithi087.stdout:9/59: creat d3/d4/d6/d8/f14 x:0 0 0 2024-09-17T07:19:44.360 INFO:tasks.workunit.client.0.smithi087.stdout:8/95: write d1/d7/d9/fc [636166,8284] 0 2024-09-17T07:19:44.360 INFO:tasks.workunit.client.0.smithi087.stdout:8/96: chown d1/d7 50 1 2024-09-17T07:19:44.363 INFO:tasks.workunit.client.0.smithi087.stdout:9/60: creat d3/d4/da/f15 x:0 0 0 2024-09-17T07:19:44.365 INFO:tasks.workunit.client.0.smithi087.stdout:5/82: mknod d5/d8/d1f/c21 0 2024-09-17T07:19:44.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:43 smithi139 ceph-mon[34403]: mgrmap e23: smithi139.tuqnpn(active, since 3s) 2024-09-17T07:19:44.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:43 smithi139 ceph-mon[34403]: pgmap v5: 65 pgs: 65 active+clean; 285 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-09-17T07:19:44.366 INFO:tasks.workunit.client.0.smithi087.stdout:8/97: readlink d1/l6 0 2024-09-17T07:19:44.373 INFO:tasks.workunit.client.0.smithi087.stdout:5/83: symlink d5/d12/l22 0 2024-09-17T07:19:44.373 INFO:tasks.workunit.client.0.smithi087.stdout:7/71: getdents d0/d3/d10 0 2024-09-17T07:19:44.373 INFO:tasks.workunit.client.0.smithi087.stdout:0/94: dwrite db/f18 [0,4194304] 0 2024-09-17T07:19:44.375 INFO:tasks.workunit.client.0.smithi087.stdout:8/98: unlink d1/l6 0 2024-09-17T07:19:44.376 INFO:tasks.workunit.client.0.smithi087.stdout:7/72: dread d0/d3/f4 [0,4194304] 0 2024-09-17T07:19:44.376 INFO:tasks.workunit.client.0.smithi087.stdout:3/57: write d6/fd [1015332,31896] 0 2024-09-17T07:19:44.377 INFO:tasks.workunit.client.0.smithi087.stdout:7/73: chown d0/f8 41 1 2024-09-17T07:19:44.377 INFO:tasks.workunit.client.0.smithi087.stdout:2/73: creat d2/f14 x:0 0 0 2024-09-17T07:19:44.379 INFO:tasks.workunit.client.0.smithi087.stdout:4/76: link d2/c18 d2/d5/db/d15/c1c 0 2024-09-17T07:19:44.381 INFO:tasks.workunit.client.0.smithi087.stdout:0/95: mknod db/c19 0 2024-09-17T07:19:44.385 INFO:tasks.workunit.client.0.smithi087.stdout:3/58: fsync d6/fa 0 2024-09-17T07:19:44.387 INFO:tasks.workunit.client.0.smithi087.stdout:2/74: mkdir d2/d15 0 2024-09-17T07:19:44.388 INFO:tasks.workunit.client.0.smithi087.stdout:7/74: symlink d0/d3/d10/d11/l12 0 2024-09-17T07:19:44.389 INFO:tasks.workunit.client.0.smithi087.stdout:3/59: dread - d6/f11 zero size 2024-09-17T07:19:44.389 INFO:tasks.workunit.client.0.smithi087.stdout:9/61: dwrite f2 [0,4194304] 0 2024-09-17T07:19:44.393 INFO:tasks.workunit.client.0.smithi087.stdout:7/75: write d0/d3/fe [4397231,12453] 0 2024-09-17T07:19:44.394 INFO:tasks.workunit.client.0.smithi087.stdout:8/99: rmdir d1 39 2024-09-17T07:19:44.395 INFO:tasks.workunit.client.0.smithi087.stdout:5/84: dwrite d5/f7 [0,4194304] 0 2024-09-17T07:19:44.397 INFO:tasks.workunit.client.0.smithi087.stdout:4/77: dwrite d2/d5/f8 [4194304,4194304] 0 2024-09-17T07:19:44.397 INFO:tasks.workunit.client.0.smithi087.stdout:0/96: dread f5 [0,4194304] 0 2024-09-17T07:19:44.398 INFO:tasks.workunit.client.0.smithi087.stdout:5/85: fdatasync d5/f19 0 2024-09-17T07:19:44.398 INFO:tasks.workunit.client.0.smithi087.stdout:9/62: mkdir d3/d4/d16 0 2024-09-17T07:19:44.399 INFO:tasks.workunit.client.0.smithi087.stdout:0/97: chown f5 63925 1 2024-09-17T07:19:44.402 INFO:tasks.workunit.client.0.smithi087.stdout:3/60: dread f4 [0,4194304] 0 2024-09-17T07:19:44.403 INFO:tasks.workunit.client.0.smithi087.stdout:7/76: symlink d0/d3/l13 0 2024-09-17T07:19:44.403 INFO:tasks.workunit.client.0.smithi087.stdout:3/61: chown f4 15355717 1 2024-09-17T07:19:44.404 INFO:tasks.workunit.client.0.smithi087.stdout:4/78: creat d2/d5/f1d x:0 0 0 2024-09-17T07:19:44.405 INFO:tasks.workunit.client.0.smithi087.stdout:7/77: write d0/d3/fe [3965416,26496] 0 2024-09-17T07:19:44.405 INFO:tasks.workunit.client.0.smithi087.stdout:0/98: rmdir db 39 2024-09-17T07:19:44.406 INFO:tasks.workunit.client.0.smithi087.stdout:5/86: symlink d5/d8/l23 0 2024-09-17T07:19:44.410 INFO:tasks.workunit.client.0.smithi087.stdout:0/99: truncate db/f12 769300 0 2024-09-17T07:19:44.410 INFO:tasks.workunit.client.0.smithi087.stdout:5/87: rmdir d5/d12/d14 39 2024-09-17T07:19:44.414 INFO:tasks.workunit.client.0.smithi087.stdout:3/62: creat d6/f13 x:0 0 0 2024-09-17T07:19:44.416 INFO:tasks.workunit.client.0.smithi087.stdout:0/100: creat db/f1a x:0 0 0 2024-09-17T07:19:44.417 INFO:tasks.workunit.client.0.smithi087.stdout:5/88: symlink d5/l24 0 2024-09-17T07:19:44.419 INFO:tasks.workunit.client.0.smithi087.stdout:7/78: getdents d0 0 2024-09-17T07:19:44.420 INFO:tasks.workunit.client.0.smithi087.stdout:0/101: chown db/f12 3959613 1 2024-09-17T07:19:44.423 INFO:tasks.workunit.client.0.smithi087.stdout:5/89: write d5/d12/d14/f16 [945300,6416] 0 2024-09-17T07:19:44.423 INFO:tasks.workunit.client.0.smithi087.stdout:0/102: creat db/f1b x:0 0 0 2024-09-17T07:19:44.426 INFO:tasks.workunit.client.0.smithi087.stdout:2/75: dwrite d2/f3 [0,4194304] 0 2024-09-17T07:19:44.427 INFO:tasks.workunit.client.0.smithi087.stdout:7/79: link d0/fc d0/d3/d10/f14 0 2024-09-17T07:19:44.428 INFO:tasks.workunit.client.0.smithi087.stdout:0/103: mknod db/c1c 0 2024-09-17T07:19:44.429 INFO:tasks.workunit.client.0.smithi087.stdout:3/63: dwrite d6/f11 [0,4194304] 0 2024-09-17T07:19:44.430 INFO:tasks.workunit.client.0.smithi087.stdout:0/104: dread - db/f1a zero size 2024-09-17T07:19:44.431 INFO:tasks.workunit.client.0.smithi087.stdout:3/64: dread - d6/f13 zero size 2024-09-17T07:19:44.431 INFO:tasks.workunit.client.0.smithi087.stdout:4/79: write d2/d5/f10 [4936653,45548] 0 2024-09-17T07:19:44.433 INFO:tasks.workunit.client.0.smithi087.stdout:4/80: dread - d2/d5/f1d zero size 2024-09-17T07:19:44.433 INFO:tasks.workunit.client.0.smithi087.stdout:2/76: write d2/f5 [1607668,34707] 0 2024-09-17T07:19:44.434 INFO:tasks.workunit.client.0.smithi087.stdout:5/90: dread d5/f7 [0,4194304] 0 2024-09-17T07:19:44.435 INFO:tasks.workunit.client.0.smithi087.stdout:7/80: getdents d0 0 2024-09-17T07:19:44.438 INFO:tasks.workunit.client.0.smithi087.stdout:3/65: symlink d6/l14 0 2024-09-17T07:19:44.438 INFO:tasks.workunit.client.0.smithi087.stdout:4/81: creat d2/d5/db/d15/f1e x:0 0 0 2024-09-17T07:19:44.439 INFO:tasks.workunit.client.0.smithi087.stdout:5/91: creat d5/d12/d14/f25 x:0 0 0 2024-09-17T07:19:44.440 INFO:tasks.workunit.client.0.smithi087.stdout:4/82: readlink d2/d5/l13 0 2024-09-17T07:19:44.440 INFO:tasks.workunit.client.0.smithi087.stdout:7/81: truncate d0/d3/f4 592045 0 2024-09-17T07:19:44.442 INFO:tasks.workunit.client.0.smithi087.stdout:2/77: unlink d2/d7/dd/c13 0 2024-09-17T07:19:44.446 INFO:tasks.workunit.client.0.smithi087.stdout:7/82: symlink d0/d3/d10/d11/l15 0 2024-09-17T07:19:44.448 INFO:tasks.workunit.client.0.smithi087.stdout:7/83: rmdir d0/d3 39 2024-09-17T07:19:44.449 INFO:tasks.workunit.client.0.smithi087.stdout:2/78: rename d2/f5 to d2/f16 0 2024-09-17T07:19:44.450 INFO:tasks.workunit.client.0.smithi087.stdout:3/66: dwrite d6/f11 [0,4194304] 0 2024-09-17T07:19:44.454 INFO:tasks.workunit.client.0.smithi087.stdout:4/83: dwrite d2/d5/f12 [0,4194304] 0 2024-09-17T07:19:44.454 INFO:tasks.workunit.client.0.smithi087.stdout:3/67: mkdir d6/d15 0 2024-09-17T07:19:44.456 INFO:tasks.workunit.client.0.smithi087.stdout:4/84: stat d2/d5/le 0 2024-09-17T07:19:44.458 INFO:tasks.workunit.client.0.smithi087.stdout:3/68: mkdir d6/d16 0 2024-09-17T07:19:44.463 INFO:tasks.workunit.client.0.smithi087.stdout:7/84: dread d0/d3/d10/f14 [0,4194304] 0 2024-09-17T07:19:44.465 INFO:tasks.workunit.client.0.smithi087.stdout:5/92: truncate d5/f7 866150 0 2024-09-17T07:19:44.465 INFO:tasks.workunit.client.0.smithi087.stdout:2/79: dwrite d2/f3 [0,4194304] 0 2024-09-17T07:19:44.465 INFO:tasks.workunit.client.0.smithi087.stdout:4/85: getdents d2/d5/db 0 2024-09-17T07:19:44.467 INFO:tasks.workunit.client.0.smithi087.stdout:5/93: write d5/f17 [3253924,96664] 0 2024-09-17T07:19:44.467 INFO:tasks.workunit.client.0.smithi087.stdout:3/69: mknod d6/c17 0 2024-09-17T07:19:44.468 INFO:tasks.workunit.client.0.smithi087.stdout:4/86: dread - d2/d5/db/d15/f1e zero size 2024-09-17T07:19:44.468 INFO:tasks.workunit.client.0.smithi087.stdout:3/70: fdatasync d6/f13 0 2024-09-17T07:19:44.469 INFO:tasks.workunit.client.0.smithi087.stdout:5/94: write d5/f19 [2238445,35418] 0 2024-09-17T07:19:44.471 INFO:tasks.workunit.client.0.smithi087.stdout:2/80: mknod d2/d12/c17 0 2024-09-17T07:19:44.472 INFO:tasks.workunit.client.0.smithi087.stdout:2/81: dread - d2/f14 zero size 2024-09-17T07:19:44.473 INFO:tasks.workunit.client.0.smithi087.stdout:3/71: unlink d6/f11 0 2024-09-17T07:19:44.474 INFO:tasks.workunit.client.0.smithi087.stdout:3/72: chown l5 5931466 1 2024-09-17T07:19:44.479 INFO:tasks.workunit.client.0.smithi087.stdout:4/87: rename d2/d5/db/d15 to d2/d5/d1f 0 2024-09-17T07:19:44.480 INFO:tasks.workunit.client.0.smithi087.stdout:2/82: dwrite d2/d7/dd/ff [0,4194304] 0 2024-09-17T07:19:44.482 INFO:tasks.workunit.client.0.smithi087.stdout:4/88: write d2/d5/d1f/f1e [455151,97806] 0 2024-09-17T07:19:44.483 INFO:tasks.workunit.client.0.smithi087.stdout:4/89: fdatasync d2/d5/f10 0 2024-09-17T07:19:44.484 INFO:tasks.workunit.client.0.smithi087.stdout:4/90: dread - d2/d5/f1d zero size 2024-09-17T07:19:44.486 INFO:tasks.workunit.client.0.smithi087.stdout:7/85: truncate d0/fd 2376496 0 2024-09-17T07:19:44.486 INFO:tasks.workunit.client.0.smithi087.stdout:2/83: write d2/f16 [4769318,20831] 0 2024-09-17T07:19:44.489 INFO:tasks.workunit.client.0.smithi087.stdout:3/73: rename d6/c10 to d6/d15/c18 0 2024-09-17T07:19:44.490 INFO:tasks.workunit.client.0.smithi087.stdout:7/86: mknod d0/d3/c16 0 2024-09-17T07:19:44.493 INFO:tasks.workunit.client.0.smithi087.stdout:4/91: dread d2/d5/f10 [0,4194304] 0 2024-09-17T07:19:44.493 INFO:tasks.workunit.client.0.smithi087.stdout:2/84: dread d2/d7/fe [0,4194304] 0 2024-09-17T07:19:44.494 INFO:tasks.workunit.client.0.smithi087.stdout:3/74: fdatasync f4 0 2024-09-17T07:19:44.495 INFO:tasks.workunit.client.0.smithi087.stdout:3/75: fdatasync f4 0 2024-09-17T07:19:44.495 INFO:tasks.workunit.client.0.smithi087.stdout:7/87: mkdir d0/d3/d10/d11/d17 0 2024-09-17T07:19:44.501 INFO:tasks.workunit.client.0.smithi087.stdout:4/92: link d2/f1a d2/d5/d1f/f20 0 2024-09-17T07:19:44.502 INFO:tasks.workunit.client.0.smithi087.stdout:7/88: symlink d0/l18 0 2024-09-17T07:19:44.502 INFO:tasks.workunit.client.0.smithi087.stdout:5/95: dwrite d5/f7 [0,4194304] 0 2024-09-17T07:19:44.503 INFO:tasks.workunit.client.0.smithi087.stdout:3/76: link d6/f12 d6/d15/f19 0 2024-09-17T07:19:44.506 INFO:tasks.workunit.client.0.smithi087.stdout:5/96: rename d5/d8/d1f/c21 to d5/d18/d20/c26 0 2024-09-17T07:19:44.507 INFO:tasks.workunit.client.0.smithi087.stdout:5/97: readlink d5/d18/l1a 0 2024-09-17T07:19:44.508 INFO:tasks.workunit.client.0.smithi087.stdout:2/85: rename d2/c4 to d2/c18 0 2024-09-17T07:19:44.509 INFO:tasks.workunit.client.0.smithi087.stdout:3/77: mknod d6/c1a 0 2024-09-17T07:19:44.511 INFO:tasks.workunit.client.0.smithi087.stdout:5/98: mkdir d5/d8/d27 0 2024-09-17T07:19:44.515 INFO:tasks.workunit.client.0.smithi087.stdout:2/86: write d2/d7/dd/ff [208595,74065] 0 2024-09-17T07:19:44.516 INFO:tasks.workunit.client.0.smithi087.stdout:2/87: write d2/f3 [2109964,40779] 0 2024-09-17T07:19:44.516 INFO:tasks.workunit.client.0.smithi087.stdout:3/78: mkdir d6/d1b 0 2024-09-17T07:19:44.518 INFO:tasks.workunit.client.0.smithi087.stdout:5/99: dwrite d5/f17 [0,4194304] 0 2024-09-17T07:19:44.519 INFO:tasks.workunit.client.0.smithi087.stdout:3/79: symlink d6/d1b/l1c 0 2024-09-17T07:19:44.522 INFO:tasks.workunit.client.0.smithi087.stdout:2/88: getdents d2/d7/dd 0 2024-09-17T07:19:44.523 INFO:tasks.workunit.client.0.smithi087.stdout:2/89: stat d2/d7/dd/ff 0 2024-09-17T07:19:44.524 INFO:tasks.workunit.client.0.smithi087.stdout:5/100: dwrite d5/f7 [0,4194304] 0 2024-09-17T07:19:44.526 INFO:tasks.workunit.client.0.smithi087.stdout:2/90: rename d2/d7/l11 to d2/d15/l19 0 2024-09-17T07:19:44.526 INFO:tasks.workunit.client.0.smithi087.stdout:2/91: fdatasync d2/f14 0 2024-09-17T07:19:44.527 INFO:tasks.workunit.client.0.smithi087.stdout:2/92: dread - d2/f14 zero size 2024-09-17T07:19:44.529 INFO:tasks.workunit.client.0.smithi087.stdout:2/93: creat d2/d15/f1a x:0 0 0 2024-09-17T07:19:44.531 INFO:tasks.workunit.client.0.smithi087.stdout:5/101: dwrite d5/f19 [0,4194304] 0 2024-09-17T07:19:44.539 INFO:tasks.workunit.client.0.smithi087.stdout:5/102: dwrite d5/f15 [0,4194304] 0 2024-09-17T07:19:44.542 INFO:tasks.workunit.client.0.smithi087.stdout:5/103: creat d5/d12/f28 x:0 0 0 2024-09-17T07:19:44.542 INFO:tasks.workunit.client.0.smithi087.stdout:5/104: read - d5/d12/d14/f25 zero size 2024-09-17T07:19:44.545 INFO:tasks.workunit.client.0.smithi087.stdout:5/105: mknod d5/d12/d14/c29 0 2024-09-17T07:19:44.547 INFO:tasks.workunit.client.0.smithi087.stdout:5/106: unlink d5/d8/le 0 2024-09-17T07:19:44.548 INFO:tasks.workunit.client.0.smithi087.stdout:5/107: mknod d5/d18/c2a 0 2024-09-17T07:19:44.556 INFO:tasks.workunit.client.0.smithi087.stdout:5/108: getdents d5/d18/d20 0 2024-09-17T07:19:44.560 INFO:tasks.workunit.client.0.smithi087.stdout:2/94: fsync d2/d7/dd/ff 0 2024-09-17T07:19:44.560 INFO:tasks.workunit.client.0.smithi087.stdout:5/109: getdents d5/d8/d1f 0 2024-09-17T07:19:44.561 INFO:tasks.workunit.client.0.smithi087.stdout:2/95: write d2/d7/f8 [283710,104721] 0 2024-09-17T07:19:44.561 INFO:tasks.workunit.client.0.smithi087.stdout:5/110: chown d5/d8/f10 186096 1 2024-09-17T07:19:44.562 INFO:tasks.workunit.client.0.smithi087.stdout:5/111: readlink l3 0 2024-09-17T07:19:44.562 INFO:tasks.workunit.client.0.smithi087.stdout:3/80: write d6/f12 [707918,47909] 0 2024-09-17T07:19:44.562 INFO:tasks.workunit.client.0.smithi087.stdout:7/89: dread d0/fd [0,4194304] 0 2024-09-17T07:19:44.564 INFO:tasks.workunit.client.0.smithi087.stdout:7/90: stat d0/fd 0 2024-09-17T07:19:44.565 INFO:tasks.workunit.client.0.smithi087.stdout:3/81: write d6/f13 [465603,87564] 0 2024-09-17T07:19:44.568 INFO:tasks.workunit.client.0.smithi087.stdout:2/96: unlink d2/d15/f1a 0 2024-09-17T07:19:44.570 INFO:tasks.workunit.client.0.smithi087.stdout:7/91: creat d0/d3/d10/d11/f19 x:0 0 0 2024-09-17T07:19:44.572 INFO:tasks.workunit.client.0.smithi087.stdout:5/112: link d5/f19 d5/d12/d14/f2b 0 2024-09-17T07:19:44.612 INFO:tasks.workunit.client.0.smithi087.stdout:3/82: fsync d6/f12 0 2024-09-17T07:19:44.613 INFO:tasks.workunit.client.0.smithi087.stdout:7/92: creat d0/d3/d10/f1a x:0 0 0 2024-09-17T07:19:44.617 INFO:tasks.workunit.client.0.smithi087.stdout:2/97: dwrite d2/d7/dd/ff [0,4194304] 0 2024-09-17T07:19:44.621 INFO:tasks.workunit.client.0.smithi087.stdout:7/93: link d0/d3/d10/d11/l12 d0/d3/d10/d11/d17/l1b 0 2024-09-17T07:19:44.622 INFO:tasks.workunit.client.0.smithi087.stdout:2/98: mknod d2/d7/dd/c1b 0 2024-09-17T07:19:44.623 INFO:tasks.workunit.client.0.smithi087.stdout:5/113: dwrite d5/f1b [0,4194304] 0 2024-09-17T07:19:44.626 INFO:tasks.workunit.client.0.smithi087.stdout:3/83: dwrite f4 [0,4194304] 0 2024-09-17T07:19:44.628 INFO:tasks.workunit.client.0.smithi087.stdout:7/94: truncate d0/fd 1650013 0 2024-09-17T07:19:44.632 INFO:tasks.workunit.client.0.smithi087.stdout:3/84: mknod d6/c1d 0 2024-09-17T07:19:44.633 INFO:tasks.workunit.client.0.smithi087.stdout:7/95: creat d0/d3/f1c x:0 0 0 2024-09-17T07:19:44.633 INFO:tasks.workunit.client.0.smithi087.stdout:5/114: getdents d5/d18 0 2024-09-17T07:19:44.635 INFO:tasks.workunit.client.0.smithi087.stdout:7/96: write d0/f6 [4994295,67457] 0 2024-09-17T07:19:44.636 INFO:tasks.workunit.client.0.smithi087.stdout:2/99: dwrite d2/d7/dd/ff [0,4194304] 0 2024-09-17T07:19:44.636 INFO:tasks.workunit.client.0.smithi087.stdout:3/85: write d6/fd [401812,124959] 0 2024-09-17T07:19:44.637 INFO:tasks.workunit.client.0.smithi087.stdout:3/86: chown l5 14 1 2024-09-17T07:19:44.638 INFO:tasks.workunit.client.0.smithi087.stdout:7/97: truncate d0/fa 489742 0 2024-09-17T07:19:44.641 INFO:tasks.workunit.client.0.smithi087.stdout:2/100: rename d2/ca to d2/d12/c1c 0 2024-09-17T07:19:44.642 INFO:tasks.workunit.client.0.smithi087.stdout:5/115: getdents d5/d12/d14 0 2024-09-17T07:19:44.643 INFO:tasks.workunit.client.0.smithi087.stdout:3/87: dread d6/f13 [0,4194304] 0 2024-09-17T07:19:44.646 INFO:tasks.workunit.client.0.smithi087.stdout:7/98: rename d0/d3/d10/d11/l15 to d0/d3/l1d 0 2024-09-17T07:19:44.648 INFO:tasks.workunit.client.0.smithi087.stdout:3/88: write d6/f13 [557575,119741] 0 2024-09-17T07:19:44.648 INFO:tasks.workunit.client.0.smithi087.stdout:5/116: getdents d5/d12/d14 0 2024-09-17T07:19:44.649 INFO:tasks.workunit.client.0.smithi087.stdout:7/99: write d0/f6 [1810101,78746] 0 2024-09-17T07:19:44.651 INFO:tasks.workunit.client.0.smithi087.stdout:3/89: write d6/f12 [125728,36211] 0 2024-09-17T07:19:44.651 INFO:tasks.workunit.client.0.smithi087.stdout:5/117: dread - d5/d18/d20/fa zero size 2024-09-17T07:19:44.652 INFO:tasks.workunit.client.0.smithi087.stdout:2/101: dwrite d2/f14 [0,4194304] 0 2024-09-17T07:19:44.652 INFO:tasks.workunit.client.0.smithi087.stdout:3/90: chown d6 356853 1 2024-09-17T07:19:44.657 INFO:tasks.workunit.client.0.smithi087.stdout:5/118: symlink d5/d12/l2c 0 2024-09-17T07:19:44.657 INFO:tasks.workunit.client.0.smithi087.stdout:7/100: dread d0/fc [0,4194304] 0 2024-09-17T07:19:44.658 INFO:tasks.workunit.client.0.smithi087.stdout:5/119: chown d5/d18/d20/c26 414 1 2024-09-17T07:19:44.658 INFO:tasks.workunit.client.0.smithi087.stdout:2/102: dread d2/d7/fe [0,4194304] 0 2024-09-17T07:19:44.658 INFO:tasks.workunit.client.0.smithi087.stdout:5/120: chown l3 248145 1 2024-09-17T07:19:44.659 INFO:tasks.workunit.client.0.smithi087.stdout:3/91: link d6/lf d6/d1b/l1e 0 2024-09-17T07:19:44.660 INFO:tasks.workunit.client.0.smithi087.stdout:5/121: write d5/f17 [4783572,11674] 0 2024-09-17T07:19:44.665 INFO:tasks.workunit.client.0.smithi087.stdout:2/103: dwrite d2/d7/f8 [0,4194304] 0 2024-09-17T07:19:44.666 INFO:tasks.workunit.client.0.smithi087.stdout:5/122: dread d5/f7 [0,4194304] 0 2024-09-17T07:19:44.668 INFO:tasks.workunit.client.0.smithi087.stdout:5/123: symlink d5/d12/d14/l2d 0 2024-09-17T07:19:44.669 INFO:tasks.workunit.client.0.smithi087.stdout:5/124: chown d5/d18/l1a 13660836 1 2024-09-17T07:19:44.669 INFO:tasks.workunit.client.0.smithi087.stdout:5/125: fsync d5/f7 0 2024-09-17T07:19:44.670 INFO:tasks.workunit.client.0.smithi087.stdout:5/126: read d5/f1b [2187924,33552] 0 2024-09-17T07:19:44.671 INFO:tasks.workunit.client.0.smithi087.stdout:3/92: fsync d6/d15/f19 0 2024-09-17T07:19:44.673 INFO:tasks.workunit.client.0.smithi087.stdout:5/127: creat d5/d8/d1f/f2e x:0 0 0 2024-09-17T07:19:44.673 INFO:tasks.workunit.client.0.smithi087.stdout:3/93: fsync d6/fa 0 2024-09-17T07:19:44.676 INFO:tasks.workunit.client.0.smithi087.stdout:5/128: mkdir d5/d18/d20/d2f 0 2024-09-17T07:19:44.677 INFO:tasks.workunit.client.0.smithi087.stdout:5/129: truncate d5/d12/d14/f25 825150 0 2024-09-17T07:19:44.677 INFO:tasks.workunit.client.0.smithi087.stdout:3/94: symlink d6/d15/l1f 0 2024-09-17T07:19:44.678 INFO:tasks.workunit.client.0.smithi087.stdout:5/130: chown d5/d12/f28 1298 1 2024-09-17T07:19:44.679 INFO:tasks.workunit.client.0.smithi087.stdout:5/131: symlink d5/d18/d20/l30 0 2024-09-17T07:19:44.681 INFO:tasks.workunit.client.0.smithi087.stdout:5/132: mknod d5/c31 0 2024-09-17T07:19:44.683 INFO:tasks.workunit.client.0.smithi087.stdout:5/133: write d5/f6 [779961,61566] 0 2024-09-17T07:19:44.683 INFO:tasks.workunit.client.0.smithi087.stdout:2/104: chown d2/d12/c1c 52 1 2024-09-17T07:19:44.684 INFO:tasks.workunit.client.0.smithi087.stdout:2/105: chown d2 170142 1 2024-09-17T07:19:44.688 INFO:tasks.workunit.client.0.smithi087.stdout:5/134: dread d5/f15 [0,4194304] 0 2024-09-17T07:19:44.688 INFO:tasks.workunit.client.0.smithi087.stdout:2/106: creat d2/d7/dd/d10/f1d x:0 0 0 2024-09-17T07:19:44.690 INFO:tasks.workunit.client.0.smithi087.stdout:5/135: symlink d5/d18/d20/l32 0 2024-09-17T07:19:44.691 INFO:tasks.workunit.client.0.smithi087.stdout:2/107: creat d2/d7/dd/d10/f1e x:0 0 0 2024-09-17T07:19:44.692 INFO:tasks.workunit.client.0.smithi087.stdout:2/108: fsync d2/f3 0 2024-09-17T07:19:44.693 INFO:tasks.workunit.client.0.smithi087.stdout:5/136: rename d5/d12/l2c to d5/d12/d1c/l33 0 2024-09-17T07:19:44.696 INFO:tasks.workunit.client.0.smithi087.stdout:5/137: dread d5/f7 [0,4194304] 0 2024-09-17T07:19:44.696 INFO:tasks.workunit.client.0.smithi087.stdout:5/138: chown d5/d8/l23 0 1 2024-09-17T07:19:44.697 INFO:tasks.workunit.client.0.smithi087.stdout:5/139: write d5/d12/d14/f25 [972884,16509] 0 2024-09-17T07:19:44.699 INFO:tasks.workunit.client.0.smithi087.stdout:2/109: truncate d2/f16 1652558 0 2024-09-17T07:19:44.700 INFO:tasks.workunit.client.0.smithi087.stdout:5/140: getdents d5/d8/d27 0 2024-09-17T07:19:44.700 INFO:tasks.workunit.client.0.smithi087.stdout:2/110: fsync d2/d7/dd/d10/f1d 0 2024-09-17T07:19:44.702 INFO:tasks.workunit.client.0.smithi087.stdout:2/111: unlink d2/c9 0 2024-09-17T07:19:44.704 INFO:tasks.workunit.client.0.smithi087.stdout:5/141: write d5/d18/d20/f1e [132906,25284] 0 2024-09-17T07:19:44.706 INFO:tasks.workunit.client.0.smithi087.stdout:5/142: creat d5/d12/f34 x:0 0 0 2024-09-17T07:19:44.708 INFO:tasks.workunit.client.0.smithi087.stdout:5/143: creat d5/d18/d20/f35 x:0 0 0 2024-09-17T07:19:44.713 INFO:tasks.workunit.client.0.smithi087.stdout:5/144: symlink d5/d12/d14/l36 0 2024-09-17T07:19:44.713 INFO:tasks.workunit.client.0.smithi087.stdout:5/145: creat d5/d12/d14/f37 x:0 0 0 2024-09-17T07:19:44.713 INFO:tasks.workunit.client.0.smithi087.stdout:5/146: creat d5/d18/f38 x:0 0 0 2024-09-17T07:19:44.713 INFO:tasks.workunit.client.0.smithi087.stdout:5/147: stat d5/f7 0 2024-09-17T07:19:44.714 INFO:tasks.workunit.client.0.smithi087.stdout:5/148: unlink d5/d12/d14/f37 0 2024-09-17T07:19:44.720 INFO:tasks.workunit.client.0.smithi087.stdout:5/149: getdents d5/d12/d14 0 2024-09-17T07:19:44.727 INFO:tasks.workunit.client.0.smithi087.stdout:5/150: dwrite d5/f1b [0,4194304] 0 2024-09-17T07:19:44.732 INFO:tasks.workunit.client.0.smithi087.stdout:5/151: dread d5/f6 [0,4194304] 0 2024-09-17T07:19:44.732 INFO:tasks.workunit.client.0.smithi087.stdout:5/152: fdatasync d5/d12/f34 0 2024-09-17T07:19:44.734 INFO:tasks.workunit.client.0.smithi087.stdout:5/153: symlink d5/d8/d1f/l39 0 2024-09-17T07:19:44.943 INFO:tasks.workunit.client.0.smithi087.stdout:1/116: sync 2024-09-17T07:19:44.944 INFO:tasks.workunit.client.0.smithi087.stdout:1/117: write d2/d14/fb [2358921,62499] 0 2024-09-17T07:19:44.946 INFO:tasks.workunit.client.0.smithi087.stdout:1/118: creat d2/da/f30 x:0 0 0 2024-09-17T07:19:44.949 INFO:tasks.workunit.client.0.smithi087.stdout:1/119: dread d2/d1a/f1c [0,4194304] 0 2024-09-17T07:19:44.950 INFO:tasks.workunit.client.0.smithi087.stdout:1/120: mknod d2/c31 0 2024-09-17T07:19:44.955 INFO:tasks.workunit.client.0.smithi087.stdout:1/121: truncate d2/d1a/f1c 3990380 0 2024-09-17T07:19:44.956 INFO:tasks.workunit.client.0.smithi087.stdout:1/122: dread d2/da/f16 [0,4194304] 0 2024-09-17T07:19:44.956 INFO:tasks.workunit.client.0.smithi087.stdout:1/123: chown d2/dc 892 1 2024-09-17T07:19:44.960 INFO:tasks.workunit.client.0.smithi087.stdout:1/124: write d2/da/f16 [975574,88684] 0 2024-09-17T07:19:44.962 INFO:tasks.workunit.client.0.smithi087.stdout:1/125: rename d2/dc/l24 to d2/dc/l32 0 2024-09-17T07:19:44.963 INFO:tasks.workunit.client.0.smithi087.stdout:1/126: read d2/dc/d26/f9 [128788,52470] 0 2024-09-17T07:19:44.965 INFO:tasks.workunit.client.0.smithi087.stdout:1/127: mkdir d2/d1a/d33 0 2024-09-17T07:19:44.967 INFO:tasks.workunit.client.0.smithi087.stdout:1/128: creat d2/d1a/f34 x:0 0 0 2024-09-17T07:19:44.968 INFO:tasks.workunit.client.0.smithi087.stdout:1/129: fdatasync d2/dc/d26/f21 0 2024-09-17T07:19:44.988 INFO:tasks.workunit.client.0.smithi087.stdout:6/140: sync 2024-09-17T07:19:44.988 INFO:tasks.workunit.client.0.smithi087.stdout:6/141: chown d1/d6 9 1 2024-09-17T07:19:44.988 INFO:tasks.workunit.client.0.smithi087.stdout:6/142: chown d1/d6/f2a 1771 1 2024-09-17T07:19:44.993 INFO:tasks.workunit.client.0.smithi087.stdout:6/143: dwrite d1/f4 [0,4194304] 0 2024-09-17T07:19:44.998 INFO:tasks.workunit.client.0.smithi087.stdout:6/144: dwrite d1/f25 [0,4194304] 0 2024-09-17T07:19:44.999 INFO:tasks.workunit.client.0.smithi087.stdout:6/145: chown d1/f1d 2892179 1 2024-09-17T07:19:45.061 INFO:tasks.workunit.client.0.smithi087.stdout:0/105: sync 2024-09-17T07:19:45.061 INFO:tasks.workunit.client.0.smithi087.stdout:5/154: sync 2024-09-17T07:19:45.061 INFO:tasks.workunit.client.0.smithi087.stdout:4/93: sync 2024-09-17T07:19:45.061 INFO:tasks.workunit.client.0.smithi087.stdout:2/112: sync 2024-09-17T07:19:45.061 INFO:tasks.workunit.client.0.smithi087.stdout:7/101: sync 2024-09-17T07:19:45.061 INFO:tasks.workunit.client.0.smithi087.stdout:3/95: sync 2024-09-17T07:19:45.061 INFO:tasks.workunit.client.0.smithi087.stdout:8/100: sync 2024-09-17T07:19:45.062 INFO:tasks.workunit.client.0.smithi087.stdout:9/63: sync 2024-09-17T07:19:45.062 INFO:tasks.workunit.client.0.smithi087.stdout:4/94: readlink d2/lf 0 2024-09-17T07:19:45.063 INFO:tasks.workunit.client.0.smithi087.stdout:0/106: write db/f13 [277848,125957] 0 2024-09-17T07:19:45.065 INFO:tasks.workunit.client.0.smithi087.stdout:5/155: write d5/d12/f34 [929347,37823] 0 2024-09-17T07:19:45.066 INFO:tasks.workunit.client.0.smithi087.stdout:2/113: write d2/d7/f8 [2090946,77000] 0 2024-09-17T07:19:45.066 INFO:tasks.workunit.client.0.smithi087.stdout:0/107: dread - db/f1a zero size 2024-09-17T07:19:45.067 INFO:tasks.workunit.client.0.smithi087.stdout:0/108: readlink db/l10 0 2024-09-17T07:19:45.068 INFO:tasks.workunit.client.0.smithi087.stdout:7/102: creat d0/d3/d10/d11/d17/f1e x:0 0 0 2024-09-17T07:19:45.070 INFO:tasks.workunit.client.0.smithi087.stdout:8/101: mknod d1/d7/d9/c1e 0 2024-09-17T07:19:45.070 INFO:tasks.workunit.client.0.smithi087.stdout:9/64: dread d3/d4/d6/d8/fd [0,4194304] 0 2024-09-17T07:19:45.070 INFO:tasks.workunit.client.0.smithi087.stdout:4/95: dread d2/d5/f12 [0,4194304] 0 2024-09-17T07:19:45.070 INFO:tasks.workunit.client.0.smithi087.stdout:0/109: creat db/f1d x:0 0 0 2024-09-17T07:19:45.071 INFO:tasks.workunit.client.0.smithi087.stdout:4/96: chown d2/d5/d1f/c1c 86 1 2024-09-17T07:19:45.071 INFO:tasks.workunit.client.0.smithi087.stdout:0/110: write db/f17 [200835,30086] 0 2024-09-17T07:19:45.078 INFO:tasks.workunit.client.0.smithi087.stdout:4/97: dwrite d2/d5/f10 [4194304,4194304] 0 2024-09-17T07:19:45.083 INFO:tasks.workunit.client.0.smithi087.stdout:3/96: dread d6/fc [0,4194304] 0 2024-09-17T07:19:45.105 INFO:tasks.workunit.client.0.smithi087.stdout:7/103: creat d0/d3/f1f x:0 0 0 2024-09-17T07:19:45.105 INFO:tasks.workunit.client.0.smithi087.stdout:7/104: stat d0 0 2024-09-17T07:19:45.106 INFO:tasks.workunit.client.0.smithi087.stdout:0/111: creat db/f1e x:0 0 0 2024-09-17T07:19:45.108 INFO:tasks.workunit.client.0.smithi087.stdout:4/98: mkdir d2/d5/db/d21 0 2024-09-17T07:19:45.108 INFO:tasks.workunit.client.0.smithi087.stdout:0/112: fsync db/f12 0 2024-09-17T07:19:45.109 INFO:tasks.workunit.client.0.smithi087.stdout:4/99: chown d2 382016 1 2024-09-17T07:19:45.109 INFO:tasks.workunit.client.0.smithi087.stdout:7/105: creat d0/d3/d10/f20 x:0 0 0 2024-09-17T07:19:45.110 INFO:tasks.workunit.client.0.smithi087.stdout:3/97: mkdir d6/d20 0 2024-09-17T07:19:45.110 INFO:tasks.workunit.client.0.smithi087.stdout:0/113: creat db/f1f x:0 0 0 2024-09-17T07:19:45.112 INFO:tasks.workunit.client.0.smithi087.stdout:4/100: write d2/d5/f16 [277884,65805] 0 2024-09-17T07:19:45.112 INFO:tasks.workunit.client.0.smithi087.stdout:7/106: creat d0/d3/d10/f21 x:0 0 0 2024-09-17T07:19:45.114 INFO:tasks.workunit.client.0.smithi087.stdout:4/101: chown d2/fc 1 1 2024-09-17T07:19:45.115 INFO:tasks.workunit.client.0.smithi087.stdout:9/65: dwrite d3/d4/d6/f13 [0,4194304] 0 2024-09-17T07:19:45.115 INFO:tasks.workunit.client.0.smithi087.stdout:3/98: symlink d6/d16/l21 0 2024-09-17T07:19:45.116 INFO:tasks.workunit.client.0.smithi087.stdout:7/107: creat d0/d3/f22 x:0 0 0 2024-09-17T07:19:45.116 INFO:tasks.workunit.client.0.smithi087.stdout:7/108: chown d0/d3 19 1 2024-09-17T07:19:45.121 INFO:tasks.workunit.client.0.smithi087.stdout:4/102: mkdir d2/d22 0 2024-09-17T07:19:45.121 INFO:tasks.workunit.client.0.smithi087.stdout:4/103: readlink d2/d5/le 0 2024-09-17T07:19:45.121 INFO:tasks.workunit.client.0.smithi087.stdout:1/130: truncate d2/dc/d26/f28 441866 0 2024-09-17T07:19:45.121 INFO:tasks.workunit.client.0.smithi087.stdout:7/109: readlink d0/d3/l13 0 2024-09-17T07:19:45.121 INFO:tasks.workunit.client.0.smithi087.stdout:3/99: rename d6/d16/l21 to d6/d16/l22 0 2024-09-17T07:19:45.122 INFO:tasks.workunit.client.0.smithi087.stdout:6/146: truncate d1/fb 1600968 0 2024-09-17T07:19:45.122 INFO:tasks.workunit.client.0.smithi087.stdout:9/66: mknod d3/d4/d16/c17 0 2024-09-17T07:19:45.123 INFO:tasks.workunit.client.0.smithi087.stdout:0/114: dread db/f15 [0,4194304] 0 2024-09-17T07:19:45.123 INFO:tasks.workunit.client.0.smithi087.stdout:3/100: stat d6/c1d 0 2024-09-17T07:19:45.124 INFO:tasks.workunit.client.0.smithi087.stdout:0/115: fdatasync db/f13 0 2024-09-17T07:19:45.124 INFO:tasks.workunit.client.0.smithi087.stdout:4/104: rename d2/f1a to d2/d5/d1f/f23 0 2024-09-17T07:19:45.125 INFO:tasks.workunit.client.0.smithi087.stdout:9/67: read d3/d4/fb [118466,11453] 0 2024-09-17T07:19:45.126 INFO:tasks.workunit.client.0.smithi087.stdout:1/131: mkdir d2/dc/d26/d35 0 2024-09-17T07:19:45.127 INFO:tasks.workunit.client.0.smithi087.stdout:4/105: fsync d2/d5/f16 0 2024-09-17T07:19:45.131 INFO:tasks.workunit.client.0.smithi087.stdout:4/106: fdatasync d2/d5/f16 0 2024-09-17T07:19:45.131 INFO:tasks.workunit.client.0.smithi087.stdout:0/116: dread db/ff [0,4194304] 0 2024-09-17T07:19:45.133 INFO:tasks.workunit.client.0.smithi087.stdout:3/101: symlink d6/d20/l23 0 2024-09-17T07:19:45.134 INFO:tasks.workunit.client.0.smithi087.stdout:7/110: dwrite d0/d3/d10/d11/f19 [0,4194304] 0 2024-09-17T07:19:45.134 INFO:tasks.workunit.client.0.smithi087.stdout:3/102: fdatasync f4 0 2024-09-17T07:19:45.135 INFO:tasks.workunit.client.0.smithi087.stdout:8/102: write d1/d7/d9/fc [529225,52466] 0 2024-09-17T07:19:45.136 INFO:tasks.workunit.client.0.smithi087.stdout:3/103: chown d6/d15/l1f 2606 1 2024-09-17T07:19:45.141 INFO:tasks.workunit.client.0.smithi087.stdout:9/68: link d3/f7 d3/d4/d6/d8/f18 0 2024-09-17T07:19:45.142 INFO:tasks.workunit.client.0.smithi087.stdout:6/147: link d1/d6/d1a/c29 d1/c2e 0 2024-09-17T07:19:45.145 INFO:tasks.workunit.client.0.smithi087.stdout:4/107: creat d2/d5/db/d21/f24 x:0 0 0 2024-09-17T07:19:45.145 INFO:tasks.workunit.client.0.smithi087.stdout:4/108: stat d2/d5/f12 0 2024-09-17T07:19:45.146 INFO:tasks.workunit.client.0.smithi087.stdout:6/148: dread d1/f1d [0,4194304] 0 2024-09-17T07:19:45.146 INFO:tasks.workunit.client.0.smithi087.stdout:4/109: chown d2/d5/f1d 2780 1 2024-09-17T07:19:45.147 INFO:tasks.workunit.client.0.smithi087.stdout:7/111: rename d0/d3/d10/d11 to d0/d3/d23 0 2024-09-17T07:19:45.147 INFO:tasks.workunit.client.0.smithi087.stdout:4/110: stat d2/fc 0 2024-09-17T07:19:45.147 INFO:tasks.workunit.client.0.smithi087.stdout:7/112: chown d0/d3/fe 39510019 1 2024-09-17T07:19:45.152 INFO:tasks.workunit.client.0.smithi087.stdout:9/69: mknod d3/d4/d16/c19 0 2024-09-17T07:19:45.154 INFO:tasks.workunit.client.0.smithi087.stdout:4/111: creat d2/f25 x:0 0 0 2024-09-17T07:19:45.155 INFO:tasks.workunit.client.0.smithi087.stdout:7/113: symlink d0/d3/d23/d17/l24 0 2024-09-17T07:19:45.157 INFO:tasks.workunit.client.0.smithi087.stdout:8/103: creat d1/d7/d9/d19/d1b/f1f x:0 0 0 2024-09-17T07:19:45.157 INFO:tasks.workunit.client.0.smithi087.stdout:6/149: dread d1/f11 [0,4194304] 0 2024-09-17T07:19:45.157 INFO:tasks.workunit.client.0.smithi087.stdout:7/114: read - d0/d3/d10/f21 zero size 2024-09-17T07:19:45.158 INFO:tasks.workunit.client.0.smithi087.stdout:1/132: getdents d2/da 0 2024-09-17T07:19:45.158 INFO:tasks.workunit.client.0.smithi087.stdout:9/70: mknod d3/d4/d6/c1a 0 2024-09-17T07:19:45.160 INFO:tasks.workunit.client.0.smithi087.stdout:7/115: read - d0/d3/d10/f1a zero size 2024-09-17T07:19:45.161 INFO:tasks.workunit.client.0.smithi087.stdout:6/150: unlink d1/d6/c13 0 2024-09-17T07:19:45.163 INFO:tasks.workunit.client.0.smithi087.stdout:3/104: getdents d6/d1b 0 2024-09-17T07:19:45.163 INFO:tasks.workunit.client.0.smithi087.stdout:7/116: truncate d0/f6 5473479 0 2024-09-17T07:19:45.163 INFO:tasks.workunit.client.0.smithi087.stdout:4/112: dwrite d2/d5/db/f1b [0,4194304] 0 2024-09-17T07:19:45.164 INFO:tasks.workunit.client.0.smithi087.stdout:3/105: stat d6/fc 0 2024-09-17T07:19:45.164 INFO:tasks.workunit.client.0.smithi087.stdout:1/133: symlink d2/d14/dd/l36 0 2024-09-17T07:19:45.166 INFO:tasks.workunit.client.0.smithi087.stdout:9/71: creat d3/d4/d16/f1b x:0 0 0 2024-09-17T07:19:45.169 INFO:tasks.workunit.client.0.smithi087.stdout:6/151: rename d1/f25 to d1/d6/f2f 0 2024-09-17T07:19:45.173 INFO:tasks.workunit.client.0.smithi087.stdout:0/117: truncate f6 582392 0 2024-09-17T07:19:45.175 INFO:tasks.workunit.client.0.smithi087.stdout:4/113: dwrite d2/d5/f16 [0,4194304] 0 2024-09-17T07:19:45.176 INFO:tasks.workunit.client.0.smithi087.stdout:0/118: write db/f13 [413349,1902] 0 2024-09-17T07:19:45.176 INFO:tasks.workunit.client.0.smithi087.stdout:7/117: dwrite d0/d3/d10/f20 [0,4194304] 0 2024-09-17T07:19:45.178 INFO:tasks.workunit.client.0.smithi087.stdout:3/106: rename d6/f13 to d6/d15/f24 0 2024-09-17T07:19:45.180 INFO:tasks.workunit.client.0.smithi087.stdout:9/72: dread d3/d4/fb [0,4194304] 0 2024-09-17T07:19:45.181 INFO:tasks.workunit.client.0.smithi087.stdout:8/104: link d1/d7/le d1/d7/d9/d19/l20 0 2024-09-17T07:19:45.182 INFO:tasks.workunit.client.0.smithi087.stdout:6/152: rmdir d1/d6/d1a 39 2024-09-17T07:19:45.182 INFO:tasks.workunit.client.0.smithi087.stdout:3/107: write d6/d15/f19 [686619,58441] 0 2024-09-17T07:19:45.184 INFO:tasks.workunit.client.0.smithi087.stdout:8/105: write d1/f8 [1289516,123665] 0 2024-09-17T07:19:45.185 INFO:tasks.workunit.client.0.smithi087.stdout:4/114: creat d2/d5/f26 x:0 0 0 2024-09-17T07:19:45.188 INFO:tasks.workunit.client.0.smithi087.stdout:3/108: dread d6/fc [0,4194304] 0 2024-09-17T07:19:45.190 INFO:tasks.workunit.client.0.smithi087.stdout:0/119: dwrite f5 [0,4194304] 0 2024-09-17T07:19:45.190 INFO:tasks.workunit.client.0.smithi087.stdout:4/115: readlink d2/lf 0 2024-09-17T07:19:45.193 INFO:tasks.workunit.client.0.smithi087.stdout:1/134: rename d2/d14/d1f to d2/d14/dd/d37 0 2024-09-17T07:19:45.193 INFO:tasks.workunit.client.0.smithi087.stdout:8/106: write d1/d7/d9/fc [1471583,1978] 0 2024-09-17T07:19:45.193 INFO:tasks.workunit.client.0.smithi087.stdout:4/116: readlink d2/d5/le 0 2024-09-17T07:19:45.195 INFO:tasks.workunit.client.0.smithi087.stdout:0/120: chown db/l16 2138982129 1 2024-09-17T07:19:45.195 INFO:tasks.workunit.client.0.smithi087.stdout:9/73: dread d3/fc [0,4194304] 0 2024-09-17T07:19:45.197 INFO:tasks.workunit.client.0.smithi087.stdout:0/121: write db/f17 [1144008,21906] 0 2024-09-17T07:19:45.199 INFO:tasks.workunit.client.0.smithi087.stdout:6/153: creat d1/d6/d1a/f30 x:0 0 0 2024-09-17T07:19:45.202 INFO:tasks.workunit.client.0.smithi087.stdout:8/107: mkdir d1/d10/d21 0 2024-09-17T07:19:45.202 INFO:tasks.workunit.client.0.smithi087.stdout:7/118: creat d0/f25 x:0 0 0 2024-09-17T07:19:45.202 INFO:tasks.workunit.client.0.smithi087.stdout:4/117: dread d2/d5/db/fd [0,4194304] 0 2024-09-17T07:19:45.202 INFO:tasks.workunit.client.0.smithi087.stdout:1/135: creat d2/d14/dd/d37/f38 x:0 0 0 2024-09-17T07:19:45.203 INFO:tasks.workunit.client.0.smithi087.stdout:9/74: truncate d3/d4/d16/f1b 917492 0 2024-09-17T07:19:45.203 INFO:tasks.workunit.client.0.smithi087.stdout:0/122: mknod db/c20 0 2024-09-17T07:19:45.206 INFO:tasks.workunit.client.0.smithi087.stdout:7/119: chown d0/d3/l1d 3638 1 2024-09-17T07:19:45.207 INFO:tasks.workunit.client.0.smithi087.stdout:4/118: fsync d2/d5/db/d21/f24 0 2024-09-17T07:19:45.207 INFO:tasks.workunit.client.0.smithi087.stdout:0/123: readlink db/l10 0 2024-09-17T07:19:45.208 INFO:tasks.workunit.client.0.smithi087.stdout:1/136: write d2/f2d [365671,116240] 0 2024-09-17T07:19:45.211 INFO:tasks.workunit.client.0.smithi087.stdout:9/75: fdatasync d3/d4/d6/d8/fd 0 2024-09-17T07:19:45.212 INFO:tasks.workunit.client.0.smithi087.stdout:3/109: dwrite d6/d15/f24 [0,4194304] 0 2024-09-17T07:19:45.212 INFO:tasks.workunit.client.0.smithi087.stdout:0/124: read - db/f1e zero size 2024-09-17T07:19:45.215 INFO:tasks.workunit.client.0.smithi087.stdout:8/108: truncate d1/d7/d9/d19/d1b/f1c 292750 0 2024-09-17T07:19:45.217 INFO:tasks.workunit.client.0.smithi087.stdout:4/119: write d2/d5/f12 [4281468,5166] 0 2024-09-17T07:19:45.218 INFO:tasks.workunit.client.0.smithi087.stdout:6/154: dwrite d1/d6/d1a/f30 [0,4194304] 0 2024-09-17T07:19:45.219 INFO:tasks.workunit.client.0.smithi087.stdout:4/120: stat d2/c18 0 2024-09-17T07:19:45.219 INFO:tasks.workunit.client.0.smithi087.stdout:0/125: creat db/f21 x:0 0 0 2024-09-17T07:19:45.220 INFO:tasks.workunit.client.0.smithi087.stdout:8/109: dread - d1/d7/d9/d19/d1b/f1f zero size 2024-09-17T07:19:45.221 INFO:tasks.workunit.client.0.smithi087.stdout:0/126: readlink db/l10 0 2024-09-17T07:19:45.222 INFO:tasks.workunit.client.0.smithi087.stdout:9/76: mkdir d3/d4/da/d1c 0 2024-09-17T07:19:45.223 INFO:tasks.workunit.client.0.smithi087.stdout:0/127: write db/f21 [775419,128996] 0 2024-09-17T07:19:45.223 INFO:tasks.workunit.client.0.smithi087.stdout:7/120: creat d0/f26 x:0 0 0 2024-09-17T07:19:45.224 INFO:tasks.workunit.client.0.smithi087.stdout:8/110: truncate d1/d7/d9/d19/d1b/f1c 1253150 0 2024-09-17T07:19:45.226 INFO:tasks.workunit.client.0.smithi087.stdout:6/155: creat d1/d6/d1a/f31 x:0 0 0 2024-09-17T07:19:45.226 INFO:tasks.workunit.client.0.smithi087.stdout:3/110: dread d6/f12 [0,4194304] 0 2024-09-17T07:19:45.227 INFO:tasks.workunit.client.0.smithi087.stdout:7/121: creat d0/d3/d10/f27 x:0 0 0 2024-09-17T07:19:45.228 INFO:tasks.workunit.client.0.smithi087.stdout:4/121: mkdir d2/d22/d27 0 2024-09-17T07:19:45.230 INFO:tasks.workunit.client.0.smithi087.stdout:3/111: read d6/d15/f24 [3346790,52103] 0 2024-09-17T07:19:45.230 INFO:tasks.workunit.client.0.smithi087.stdout:8/111: chown d1/d7/d9/d19/c1a 1 1 2024-09-17T07:19:45.233 INFO:tasks.workunit.client.0.smithi087.stdout:1/137: dwrite d2/dc/d26/f21 [0,4194304] 0 2024-09-17T07:19:45.233 INFO:tasks.workunit.client.0.smithi087.stdout:8/112: write d1/d7/d9/d19/f1d [527234,68461] 0 2024-09-17T07:19:45.235 INFO:tasks.workunit.client.0.smithi087.stdout:6/156: rename d1/d6/f2f to d1/d6/d1a/d2c/f32 0 2024-09-17T07:19:45.238 INFO:tasks.workunit.client.0.smithi087.stdout:3/112: symlink d6/d16/l25 0 2024-09-17T07:19:45.239 INFO:tasks.workunit.client.0.smithi087.stdout:0/128: fdatasync f6 0 2024-09-17T07:19:45.241 INFO:tasks.workunit.client.0.smithi087.stdout:8/113: creat d1/d7/f22 x:0 0 0 2024-09-17T07:19:45.241 INFO:tasks.workunit.client.0.smithi087.stdout:6/157: mkdir d1/d6/d1a/d2c/d33 0 2024-09-17T07:19:45.244 INFO:tasks.workunit.client.0.smithi087.stdout:1/138: dwrite d2/d14/dd/d37/f38 [0,4194304] 0 2024-09-17T07:19:45.244 INFO:tasks.workunit.client.0.smithi087.stdout:4/122: creat d2/d22/d27/f28 x:0 0 0 2024-09-17T07:19:45.247 INFO:tasks.workunit.client.0.smithi087.stdout:6/158: write d1/f16 [5025273,127528] 0 2024-09-17T07:19:45.248 INFO:tasks.workunit.client.0.smithi087.stdout:3/113: creat d6/d16/f26 x:0 0 0 2024-09-17T07:19:45.251 INFO:tasks.workunit.client.0.smithi087.stdout:8/114: mkdir d1/d7/d9/d19/d1b/d18/d23 0 2024-09-17T07:19:45.252 INFO:tasks.workunit.client.0.smithi087.stdout:0/129: dread f5 [0,4194304] 0 2024-09-17T07:19:45.253 INFO:tasks.workunit.client.0.smithi087.stdout:6/159: unlink d1/c14 0 2024-09-17T07:19:45.256 INFO:tasks.workunit.client.0.smithi087.stdout:1/139: truncate d2/d14/dd/f18 433063 0 2024-09-17T07:19:45.256 INFO:tasks.workunit.client.0.smithi087.stdout:7/122: dwrite d0/fc [4194304,4194304] 0 2024-09-17T07:19:45.257 INFO:tasks.workunit.client.0.smithi087.stdout:3/114: creat d6/f27 x:0 0 0 2024-09-17T07:19:45.259 INFO:tasks.workunit.client.0.smithi087.stdout:0/130: symlink db/l22 0 2024-09-17T07:19:45.259 INFO:tasks.workunit.client.0.smithi087.stdout:7/123: write d0/f25 [1020452,12468] 0 2024-09-17T07:19:45.260 INFO:tasks.workunit.client.0.smithi087.stdout:4/123: dwrite d2/d5/f8 [0,4194304] 0 2024-09-17T07:19:45.261 INFO:tasks.workunit.client.0.smithi087.stdout:8/115: mknod d1/d7/d9/c24 0 2024-09-17T07:19:45.261 INFO:tasks.workunit.client.0.smithi087.stdout:1/140: chown d2/d14/dd/d37/f38 427830 1 2024-09-17T07:19:45.264 INFO:tasks.workunit.client.0.smithi087.stdout:3/115: symlink d6/d16/l28 0 2024-09-17T07:19:45.264 INFO:tasks.workunit.client.0.smithi087.stdout:1/141: dread - d2/dc/d26/f2f zero size 2024-09-17T07:19:45.266 INFO:tasks.workunit.client.0.smithi087.stdout:0/131: rename db/c1c to db/c23 0 2024-09-17T07:19:45.269 INFO:tasks.workunit.client.0.smithi087.stdout:6/160: dwrite d1/d6/d1a/f28 [0,4194304] 0 2024-09-17T07:19:45.269 INFO:tasks.workunit.client.0.smithi087.stdout:4/124: creat d2/d5/db/f29 x:0 0 0 2024-09-17T07:19:45.271 INFO:tasks.workunit.client.0.smithi087.stdout:3/116: write d6/f12 [1227215,84199] 0 2024-09-17T07:19:45.272 INFO:tasks.workunit.client.0.smithi087.stdout:6/161: write d1/d6/f1c [1451328,113700] 0 2024-09-17T07:19:45.272 INFO:tasks.workunit.client.0.smithi087.stdout:0/132: mknod db/c24 0 2024-09-17T07:19:45.275 INFO:tasks.workunit.client.0.smithi087.stdout:8/116: mknod d1/d7/d9/d19/d1b/c25 0 2024-09-17T07:19:45.276 INFO:tasks.workunit.client.0.smithi087.stdout:1/142: dread d2/dc/d26/f21 [0,4194304] 0 2024-09-17T07:19:45.277 INFO:tasks.workunit.client.0.smithi087.stdout:3/117: creat d6/d15/f29 x:0 0 0 2024-09-17T07:19:45.277 INFO:tasks.workunit.client.0.smithi087.stdout:3/118: chown d6/d16 26596 1 2024-09-17T07:19:45.278 INFO:tasks.workunit.client.0.smithi087.stdout:0/133: rename db/f15 to db/f25 0 2024-09-17T07:19:45.278 INFO:tasks.workunit.client.0.smithi087.stdout:6/162: write d1/d6/d1a/d2c/f32 [1513622,24926] 0 2024-09-17T07:19:45.279 INFO:tasks.workunit.client.0.smithi087.stdout:1/143: mknod d2/da/c39 0 2024-09-17T07:19:45.280 INFO:tasks.workunit.client.0.smithi087.stdout:8/117: mknod d1/d7/d9/d19/d1b/d18/c26 0 2024-09-17T07:19:45.281 INFO:tasks.workunit.client.0.smithi087.stdout:1/144: dread - d2/da/f30 zero size 2024-09-17T07:19:45.283 INFO:tasks.workunit.client.0.smithi087.stdout:1/145: fdatasync d2/f2d 0 2024-09-17T07:19:45.285 INFO:tasks.workunit.client.0.smithi087.stdout:8/118: truncate d1/d7/d9/d19/d1b/f1f 615655 0 2024-09-17T07:19:45.285 INFO:tasks.workunit.client.0.smithi087.stdout:0/134: dwrite db/f18 [0,4194304] 0 2024-09-17T07:19:45.287 INFO:tasks.workunit.client.0.smithi087.stdout:6/163: link d1/l8 d1/d6/l34 0 2024-09-17T07:19:45.288 INFO:tasks.workunit.client.0.smithi087.stdout:6/164: readlink d1/l2 0 2024-09-17T07:19:45.288 INFO:tasks.workunit.client.0.smithi087.stdout:0/135: unlink db/c14 0 2024-09-17T07:19:45.289 INFO:tasks.workunit.client.0.smithi087.stdout:3/119: link d6/ce d6/d20/c2a 0 2024-09-17T07:19:45.289 INFO:tasks.workunit.client.0.smithi087.stdout:6/165: truncate d1/d6/f1f 1901543 0 2024-09-17T07:19:45.294 INFO:tasks.workunit.client.0.smithi087.stdout:6/166: dread d1/fb [0,4194304] 0 2024-09-17T07:19:45.296 INFO:tasks.workunit.client.0.smithi087.stdout:6/167: chown d1/d6/d1a/f28 761 1 2024-09-17T07:19:45.296 INFO:tasks.workunit.client.0.smithi087.stdout:0/136: dwrite db/f1e [0,4194304] 0 2024-09-17T07:19:45.299 INFO:tasks.workunit.client.0.smithi087.stdout:6/168: chown d1/d6/d1a/c29 111 1 2024-09-17T07:19:45.301 INFO:tasks.workunit.client.0.smithi087.stdout:6/169: truncate d1/d6/d1a/f23 203075 0 2024-09-17T07:19:45.302 INFO:tasks.workunit.client.0.smithi087.stdout:0/137: dwrite db/f18 [0,4194304] 0 2024-09-17T07:19:45.306 INFO:tasks.workunit.client.0.smithi087.stdout:0/138: rename db/cc to db/c26 0 2024-09-17T07:19:45.308 INFO:tasks.workunit.client.0.smithi087.stdout:0/139: creat db/f27 x:0 0 0 2024-09-17T07:19:45.308 INFO:tasks.workunit.client.0.smithi087.stdout:6/170: dwrite d1/d6/f12 [0,4194304] 0 2024-09-17T07:19:45.309 INFO:tasks.workunit.client.0.smithi087.stdout:0/140: dread - db/f1b zero size 2024-09-17T07:19:45.311 INFO:tasks.workunit.client.0.smithi087.stdout:6/171: chown d1/l8 1320716 1 2024-09-17T07:19:45.313 INFO:tasks.workunit.client.0.smithi087.stdout:0/141: creat db/f28 x:0 0 0 2024-09-17T07:19:45.315 INFO:tasks.workunit.client.0.smithi087.stdout:0/142: creat db/f29 x:0 0 0 2024-09-17T07:19:45.316 INFO:tasks.workunit.client.0.smithi087.stdout:6/172: creat d1/f35 x:0 0 0 2024-09-17T07:19:45.317 INFO:tasks.workunit.client.0.smithi087.stdout:6/173: write d1/f35 [663752,61110] 0 2024-09-17T07:19:45.317 INFO:tasks.workunit.client.0.smithi087.stdout:6/174: stat d1/f35 0 2024-09-17T07:19:45.318 INFO:tasks.workunit.client.0.smithi087.stdout:6/175: chown d1/l8 92165 1 2024-09-17T07:19:45.319 INFO:tasks.workunit.client.0.smithi087.stdout:6/176: creat d1/d6/d1a/f36 x:0 0 0 2024-09-17T07:19:45.320 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:45 smithi139 ceph-mon[34403]: Standby manager daemon smithi087.vuvjer started 2024-09-17T07:19:45.320 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:45 smithi139 ceph-mon[34403]: from='mgr.? 172.21.15.87:0/1706007138' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi087.vuvjer/crt"}]: dispatch 2024-09-17T07:19:45.321 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:45 smithi139 ceph-mon[34403]: from='mgr.? 172.21.15.87:0/1706007138' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T07:19:45.321 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:45 smithi139 ceph-mon[34403]: from='mgr.? 172.21.15.87:0/1706007138' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi087.vuvjer/key"}]: dispatch 2024-09-17T07:19:45.321 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:45 smithi139 ceph-mon[34403]: from='mgr.? 172.21.15.87:0/1706007138' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T07:19:45.321 INFO:tasks.workunit.client.0.smithi087.stdout:6/177: unlink d1/l24 0 2024-09-17T07:19:45.322 INFO:tasks.workunit.client.0.smithi087.stdout:6/178: write d1/f4 [3139462,71505] 0 2024-09-17T07:19:45.323 INFO:tasks.workunit.client.0.smithi087.stdout:6/179: creat d1/d6/d1a/d2c/f37 x:0 0 0 2024-09-17T07:19:45.328 INFO:tasks.workunit.client.0.smithi087.stdout:0/143: fsync db/f29 0 2024-09-17T07:19:45.330 INFO:tasks.workunit.client.0.smithi087.stdout:6/180: dwrite d1/d6/f1f [0,4194304] 0 2024-09-17T07:19:45.330 INFO:tasks.workunit.client.0.smithi087.stdout:0/144: mkdir db/d2a 0 2024-09-17T07:19:45.332 INFO:tasks.workunit.client.0.smithi087.stdout:0/145: dread db/fe [0,4194304] 0 2024-09-17T07:19:45.334 INFO:tasks.workunit.client.0.smithi087.stdout:6/181: rename d1/c19 to d1/d6/d1a/d2c/d33/c38 0 2024-09-17T07:19:45.336 INFO:tasks.workunit.client.0.smithi087.stdout:6/182: mknod d1/d6/d1a/d2c/c39 0 2024-09-17T07:19:45.337 INFO:tasks.workunit.client.0.smithi087.stdout:0/146: link db/l10 db/l2b 0 2024-09-17T07:19:45.339 INFO:tasks.workunit.client.0.smithi087.stdout:0/147: mknod db/c2c 0 2024-09-17T07:19:45.343 INFO:tasks.workunit.client.0.smithi087.stdout:6/183: dwrite d1/f18 [0,4194304] 0 2024-09-17T07:19:45.347 INFO:tasks.workunit.client.0.smithi087.stdout:0/148: dwrite db/f18 [4194304,4194304] 0 2024-09-17T07:19:45.350 INFO:tasks.workunit.client.0.smithi087.stdout:0/149: rename c9 to db/c2d 0 2024-09-17T07:19:45.351 INFO:tasks.workunit.client.0.smithi087.stdout:0/150: write db/f29 [837000,42242] 0 2024-09-17T07:19:45.352 INFO:tasks.workunit.client.0.smithi087.stdout:0/151: dread - db/f1f zero size 2024-09-17T07:19:45.352 INFO:tasks.workunit.client.0.smithi087.stdout:0/152: fsync db/f1b 0 2024-09-17T07:19:45.355 INFO:tasks.workunit.client.0.smithi087.stdout:0/153: rmdir db/d2a 0 2024-09-17T07:19:45.358 INFO:tasks.workunit.client.0.smithi087.stdout:0/154: chown db/l10 443392 1 2024-09-17T07:19:45.359 INFO:tasks.workunit.client.0.smithi087.stdout:0/155: creat db/f2e x:0 0 0 2024-09-17T07:19:45.360 INFO:tasks.workunit.client.0.smithi087.stdout:0/156: symlink db/l2f 0 2024-09-17T07:19:45.367 INFO:tasks.workunit.client.0.smithi087.stdout:0/157: dwrite db/f1f [0,4194304] 0 2024-09-17T07:19:45.368 INFO:tasks.workunit.client.0.smithi087.stdout:0/158: dread - db/f27 zero size 2024-09-17T07:19:45.369 INFO:tasks.workunit.client.0.smithi087.stdout:6/184: fdatasync d1/f18 0 2024-09-17T07:19:45.369 INFO:tasks.workunit.client.0.smithi087.stdout:0/159: readlink db/l10 0 2024-09-17T07:19:45.374 INFO:tasks.workunit.client.0.smithi087.stdout:6/185: symlink d1/l3a 0 2024-09-17T07:19:45.377 INFO:tasks.workunit.client.0.smithi087.stdout:6/186: truncate d1/f1d 1399886 0 2024-09-17T07:19:45.378 INFO:tasks.workunit.client.0.smithi087.stdout:0/160: dwrite f5 [0,4194304] 0 2024-09-17T07:19:45.380 INFO:tasks.workunit.client.0.smithi087.stdout:6/187: mknod d1/d6/c3b 0 2024-09-17T07:19:45.385 INFO:tasks.workunit.client.0.smithi087.stdout:0/161: dwrite db/f18 [0,4194304] 0 2024-09-17T07:19:45.388 INFO:tasks.workunit.client.0.smithi087.stdout:6/188: dread d1/d6/d1a/f30 [0,4194304] 0 2024-09-17T07:19:45.388 INFO:tasks.workunit.client.0.smithi087.stdout:6/189: chown d1/d6/f2a 44589 1 2024-09-17T07:19:45.393 INFO:tasks.workunit.client.0.smithi087.stdout:6/190: rename d1/d6/d1a/l1e to d1/d6/d1a/d2c/l3c 0 2024-09-17T07:19:45.396 INFO:tasks.workunit.client.0.smithi087.stdout:0/162: dwrite db/ff [0,4194304] 0 2024-09-17T07:19:45.397 INFO:tasks.workunit.client.0.smithi087.stdout:0/163: stat db/f18 0 2024-09-17T07:19:45.397 INFO:tasks.workunit.client.0.smithi087.stdout:0/164: chown db/f17 7429912 1 2024-09-17T07:19:45.398 INFO:tasks.workunit.client.0.smithi087.stdout:6/191: creat d1/d6/d1a/d2c/d33/f3d x:0 0 0 2024-09-17T07:19:45.399 INFO:tasks.workunit.client.0.smithi087.stdout:6/192: write d1/d6/f1c [1767065,126709] 0 2024-09-17T07:19:45.401 INFO:tasks.workunit.client.0.smithi087.stdout:6/193: write d1/d6/f2a [3524792,116736] 0 2024-09-17T07:19:45.401 INFO:tasks.workunit.client.0.smithi087.stdout:0/165: symlink db/l30 0 2024-09-17T07:19:45.406 INFO:tasks.workunit.client.0.smithi087.stdout:6/194: dread d1/f35 [0,4194304] 0 2024-09-17T07:19:45.409 INFO:tasks.workunit.client.0.smithi087.stdout:6/195: creat d1/d6/f3e x:0 0 0 2024-09-17T07:19:45.415 INFO:tasks.workunit.client.0.smithi087.stdout:6/196: dwrite d1/d6/d1a/f30 [0,4194304] 0 2024-09-17T07:19:45.417 INFO:tasks.workunit.client.0.smithi087.stdout:0/166: write f6 [1132222,24219] 0 2024-09-17T07:19:45.418 INFO:tasks.workunit.client.0.smithi087.stdout:6/197: creat d1/d6/d1a/d2c/d33/f3f x:0 0 0 2024-09-17T07:19:45.419 INFO:tasks.workunit.client.0.smithi087.stdout:0/167: creat db/f31 x:0 0 0 2024-09-17T07:19:45.420 INFO:tasks.workunit.client.0.smithi087.stdout:0/168: chown db/c20 6 1 2024-09-17T07:19:45.420 INFO:tasks.workunit.client.0.smithi087.stdout:6/198: mkdir d1/d6/d1a/d2c/d40 0 2024-09-17T07:19:45.421 INFO:tasks.workunit.client.0.smithi087.stdout:0/169: unlink db/ld 0 2024-09-17T07:19:45.422 INFO:tasks.workunit.client.0.smithi087.stdout:6/199: creat d1/d6/d1a/f41 x:0 0 0 2024-09-17T07:19:45.422 INFO:tasks.workunit.client.0.smithi087.stdout:0/170: write db/f1b [167092,18117] 0 2024-09-17T07:19:45.423 INFO:tasks.workunit.client.0.smithi087.stdout:0/171: write db/f12 [1682146,9129] 0 2024-09-17T07:19:45.425 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:45 smithi087 ceph-mon[27636]: Standby manager daemon smithi087.vuvjer started 2024-09-17T07:19:45.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:45 smithi087 ceph-mon[27636]: from='mgr.? 172.21.15.87:0/1706007138' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi087.vuvjer/crt"}]: dispatch 2024-09-17T07:19:45.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:45 smithi087 ceph-mon[27636]: from='mgr.? 172.21.15.87:0/1706007138' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T07:19:45.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:45 smithi087 ceph-mon[27636]: from='mgr.? 172.21.15.87:0/1706007138' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi087.vuvjer/key"}]: dispatch 2024-09-17T07:19:45.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:45 smithi087 ceph-mon[27636]: from='mgr.? 172.21.15.87:0/1706007138' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T07:19:45.439 INFO:tasks.workunit.client.0.smithi087.stdout:6/200: getdents d1/d6/d1a 0 2024-09-17T07:19:45.440 INFO:tasks.workunit.client.0.smithi087.stdout:6/201: rmdir d1/d6/d1a/d2c/d33 39 2024-09-17T07:19:45.447 INFO:tasks.workunit.client.0.smithi087.stdout:6/202: dwrite d1/f11 [0,4194304] 0 2024-09-17T07:19:45.449 INFO:tasks.workunit.client.1.smithi139.stdout:4/8: sync 2024-09-17T07:19:45.449 INFO:tasks.workunit.client.1.smithi139.stdout:4/9: dwrite - no filename 2024-09-17T07:19:45.449 INFO:tasks.workunit.client.0.smithi087.stdout:6/203: write d1/d6/d1a/d2c/d33/f3d [624123,126398] 0 2024-09-17T07:19:45.451 INFO:tasks.workunit.client.0.smithi087.stdout:6/204: readlink d1/d6/d1a/d2c/l3c 0 2024-09-17T07:19:45.451 INFO:tasks.workunit.client.0.smithi087.stdout:6/205: chown d1/f35 126 1 2024-09-17T07:19:45.453 INFO:tasks.workunit.client.0.smithi087.stdout:6/206: creat d1/f42 x:0 0 0 2024-09-17T07:19:45.456 INFO:tasks.workunit.client.0.smithi087.stdout:6/207: creat d1/d6/d1a/d2c/f43 x:0 0 0 2024-09-17T07:19:45.459 INFO:tasks.workunit.client.0.smithi087.stdout:6/208: dread d1/d6/f1f [0,4194304] 0 2024-09-17T07:19:45.461 INFO:tasks.workunit.client.0.smithi087.stdout:6/209: mknod d1/c44 0 2024-09-17T07:19:45.462 INFO:tasks.workunit.client.0.smithi087.stdout:6/210: rmdir d1/d6 39 2024-09-17T07:19:45.465 INFO:tasks.workunit.client.0.smithi087.stdout:6/211: creat d1/d6/d1a/d2c/d40/f45 x:0 0 0 2024-09-17T07:19:45.466 INFO:tasks.workunit.client.0.smithi087.stdout:6/212: truncate d1/d6/d1a/d2c/f43 433023 0 2024-09-17T07:19:45.467 INFO:tasks.workunit.client.0.smithi087.stdout:6/213: creat d1/d6/d1a/d2c/d33/f46 x:0 0 0 2024-09-17T07:19:45.469 INFO:tasks.workunit.client.0.smithi087.stdout:6/214: symlink d1/d6/d1a/l47 0 2024-09-17T07:19:45.470 INFO:tasks.workunit.client.0.smithi087.stdout:6/215: rmdir d1/d6/d1a/d2c 39 2024-09-17T07:19:45.470 INFO:tasks.workunit.client.0.smithi087.stdout:6/216: fsync d1/f11 0 2024-09-17T07:19:45.471 INFO:tasks.workunit.client.0.smithi087.stdout:6/217: readlink d1/d6/l17 0 2024-09-17T07:19:45.474 INFO:tasks.workunit.client.0.smithi087.stdout:6/218: mkdir d1/d6/d1a/d2c/d48 0 2024-09-17T07:19:45.478 INFO:tasks.workunit.client.0.smithi087.stdout:6/219: link d1/d6/d1a/f36 d1/d6/d1a/d2c/d40/f49 0 2024-09-17T07:19:45.481 INFO:tasks.workunit.client.0.smithi087.stdout:6/220: rename d1/l3a to d1/d6/d1a/l4a 0 2024-09-17T07:19:45.483 INFO:tasks.workunit.client.0.smithi087.stdout:6/221: creat d1/f4b x:0 0 0 2024-09-17T07:19:45.488 INFO:tasks.workunit.client.0.smithi087.stdout:6/222: getdents d1/d6/d1a/d2c 0 2024-09-17T07:19:45.488 INFO:tasks.workunit.client.0.smithi087.stdout:6/223: dread - d1/d6/d1a/f31 zero size 2024-09-17T07:19:45.489 INFO:tasks.workunit.client.0.smithi087.stdout:6/224: chown d1/f18 1003960640 1 2024-09-17T07:19:45.492 INFO:tasks.workunit.client.0.smithi087.stdout:6/225: dread d1/d6/d1a/d2c/f32 [0,4194304] 0 2024-09-17T07:19:45.493 INFO:tasks.workunit.client.0.smithi087.stdout:6/226: dread - d1/d6/d1a/d2c/d40/f45 zero size 2024-09-17T07:19:45.494 INFO:tasks.workunit.client.0.smithi087.stdout:6/227: write d1/d6/d1a/d2c/f2d [2657148,82425] 0 2024-09-17T07:19:45.494 INFO:tasks.workunit.client.0.smithi087.stdout:6/228: chown d1/l9 3 1 2024-09-17T07:19:45.495 INFO:tasks.workunit.client.0.smithi087.stdout:6/229: write d1/f16 [4296063,50128] 0 2024-09-17T07:19:45.496 INFO:tasks.workunit.client.0.smithi087.stdout:6/230: fdatasync d1/f42 0 2024-09-17T07:19:45.497 INFO:tasks.workunit.client.0.smithi087.stdout:6/231: chown d1/d6/l34 1596050 1 2024-09-17T07:19:45.498 INFO:tasks.workunit.client.0.smithi087.stdout:6/232: read d1/d6/d1a/d2c/f32 [1800467,20967] 0 2024-09-17T07:19:45.498 INFO:tasks.workunit.client.0.smithi087.stdout:6/233: chown d1/d6/d1a/d2c/f37 4276493 1 2024-09-17T07:19:45.505 INFO:tasks.workunit.client.0.smithi087.stdout:6/234: dwrite d1/d6/d1a/d2c/d40/f49 [0,4194304] 0 2024-09-17T07:19:45.508 INFO:tasks.workunit.client.0.smithi087.stdout:6/235: mkdir d1/d6/d1a/d2c/d40/d4c 0 2024-09-17T07:19:45.511 INFO:tasks.workunit.client.0.smithi087.stdout:6/236: link d1/d6/d1a/d2c/d40/f45 d1/d6/d1a/d2c/d40/f4d 0 2024-09-17T07:19:45.512 INFO:tasks.workunit.client.0.smithi087.stdout:6/237: fdatasync d1/d6/d1a/f23 0 2024-09-17T07:19:45.514 INFO:tasks.workunit.client.0.smithi087.stdout:6/238: mkdir d1/d6/d1a/d4e 0 2024-09-17T07:19:45.521 INFO:tasks.workunit.client.0.smithi087.stdout:6/239: dwrite d1/d6/f3e [0,4194304] 0 2024-09-17T07:19:45.524 INFO:tasks.workunit.client.0.smithi087.stdout:6/240: rename d1/d6/d1a/d2c/f43 to d1/d6/d1a/d2c/d33/f4f 0 2024-09-17T07:19:45.533 INFO:tasks.workunit.client.0.smithi087.stdout:6/241: dread d1/d6/d1a/f36 [0,4194304] 0 2024-09-17T07:19:45.533 INFO:tasks.workunit.client.0.smithi087.stdout:6/242: chown d1/f35 5254 1 2024-09-17T07:19:45.533 INFO:tasks.workunit.client.0.smithi087.stdout:6/243: rmdir d1/d6 39 2024-09-17T07:19:45.533 INFO:tasks.workunit.client.0.smithi087.stdout:6/244: creat d1/d6/d1a/d4e/f50 x:0 0 0 2024-09-17T07:19:45.536 INFO:tasks.workunit.client.0.smithi087.stdout:6/245: unlink d1/d6/d1a/d2c/d33/f46 0 2024-09-17T07:19:45.558 INFO:tasks.workunit.client.0.smithi087.stdout:2/114: sync 2024-09-17T07:19:45.558 INFO:tasks.workunit.client.0.smithi087.stdout:5/156: sync 2024-09-17T07:19:45.560 INFO:tasks.workunit.client.0.smithi087.stdout:2/115: mkdir d2/d7/dd/d1f 0 2024-09-17T07:19:45.561 INFO:tasks.workunit.client.0.smithi087.stdout:2/116: readlink d2/l6 0 2024-09-17T07:19:45.562 INFO:tasks.workunit.client.0.smithi087.stdout:5/157: dread d5/f15 [0,4194304] 0 2024-09-17T07:19:45.563 INFO:tasks.workunit.client.0.smithi087.stdout:5/158: write d5/d12/d14/f16 [1690561,64591] 0 2024-09-17T07:19:45.564 INFO:tasks.workunit.client.0.smithi087.stdout:5/159: stat d5/d12/l22 0 2024-09-17T07:19:45.565 INFO:tasks.workunit.client.0.smithi087.stdout:2/117: dread d2/d7/f8 [0,4194304] 0 2024-09-17T07:19:45.566 INFO:tasks.workunit.client.0.smithi087.stdout:2/118: chown d2/l6 7975129 1 2024-09-17T07:19:45.566 INFO:tasks.workunit.client.0.smithi087.stdout:5/160: unlink d5/f6 0 2024-09-17T07:19:45.567 INFO:tasks.workunit.client.0.smithi087.stdout:2/119: write d2/f14 [1921394,2704] 0 2024-09-17T07:19:45.569 INFO:tasks.workunit.client.0.smithi087.stdout:5/161: creat d5/d8/d27/f3a x:0 0 0 2024-09-17T07:19:45.570 INFO:tasks.workunit.client.0.smithi087.stdout:5/162: chown d5/d18/d20/f35 1357438 1 2024-09-17T07:19:45.572 INFO:tasks.workunit.client.0.smithi087.stdout:5/163: symlink d5/d12/d1c/l3b 0 2024-09-17T07:19:45.573 INFO:tasks.workunit.client.0.smithi087.stdout:5/164: chown d5/d8/f10 5 1 2024-09-17T07:19:45.574 INFO:tasks.workunit.client.0.smithi087.stdout:5/165: write d5/f1b [868210,7717] 0 2024-09-17T07:19:45.576 INFO:tasks.workunit.client.0.smithi087.stdout:5/166: getdents d5/d18/d20/d2f 0 2024-09-17T07:19:45.577 INFO:tasks.workunit.client.0.smithi087.stdout:5/167: write d5/d8/d27/f3a [104556,68257] 0 2024-09-17T07:19:45.577 INFO:tasks.workunit.client.0.smithi087.stdout:2/120: truncate d2/f14 1040789 0 2024-09-17T07:19:45.580 INFO:tasks.workunit.client.0.smithi087.stdout:5/168: rename d5/d8/d1f/l39 to d5/d18/d20/d2f/l3c 0 2024-09-17T07:19:45.582 INFO:tasks.workunit.client.0.smithi087.stdout:5/169: mknod d5/d18/c3d 0 2024-09-17T07:19:45.584 INFO:tasks.workunit.client.0.smithi087.stdout:2/121: dwrite d2/f3 [4194304,4194304] 0 2024-09-17T07:19:45.587 INFO:tasks.workunit.client.0.smithi087.stdout:5/170: rename d5/d12/d1c/l1d to d5/d12/d14/l3e 0 2024-09-17T07:19:45.590 INFO:tasks.workunit.client.0.smithi087.stdout:5/171: rename d5/f7 to d5/d8/f3f 0 2024-09-17T07:19:45.592 INFO:tasks.workunit.client.0.smithi087.stdout:2/122: creat d2/d7/f20 x:0 0 0 2024-09-17T07:19:45.594 INFO:tasks.workunit.client.0.smithi087.stdout:2/123: creat d2/d15/f21 x:0 0 0 2024-09-17T07:19:45.595 INFO:tasks.workunit.client.0.smithi087.stdout:2/124: write d2/d15/f21 [865058,39371] 0 2024-09-17T07:19:45.596 INFO:tasks.workunit.client.0.smithi087.stdout:5/172: getdents d5/d18/d20/d2f 0 2024-09-17T07:19:45.603 INFO:tasks.workunit.client.0.smithi087.stdout:2/125: dwrite d2/d7/dd/d10/f1e [0,4194304] 0 2024-09-17T07:19:45.603 INFO:tasks.workunit.client.0.smithi087.stdout:5/173: truncate d5/d12/f34 123433 0 2024-09-17T07:19:45.604 INFO:tasks.workunit.client.0.smithi087.stdout:2/126: dread - d2/d7/dd/d10/f1d zero size 2024-09-17T07:19:45.605 INFO:tasks.workunit.client.0.smithi087.stdout:2/127: write d2/d7/dd/d10/f1d [218958,50580] 0 2024-09-17T07:19:45.608 INFO:tasks.workunit.client.1.smithi139.stdout:7/3: sync 2024-09-17T07:19:45.608 INFO:tasks.workunit.client.1.smithi139.stdout:5/1: sync 2024-09-17T07:19:45.608 INFO:tasks.workunit.client.1.smithi139.stdout:7/4: stat - no entries 2024-09-17T07:19:45.608 INFO:tasks.workunit.client.0.smithi087.stdout:2/128: fdatasync d2/d7/f8 0 2024-09-17T07:19:45.611 INFO:tasks.workunit.client.0.smithi087.stdout:2/129: creat d2/d7/f22 x:0 0 0 2024-09-17T07:19:45.612 INFO:tasks.workunit.client.0.smithi087.stdout:5/174: dwrite d5/d8/d1f/f2e [0,4194304] 0 2024-09-17T07:19:45.613 INFO:tasks.workunit.client.0.smithi087.stdout:2/130: fsync d2/f3 0 2024-09-17T07:19:45.614 INFO:tasks.workunit.client.0.smithi087.stdout:2/131: chown d2/d7/dd/d1f 2462007 1 2024-09-17T07:19:45.614 INFO:tasks.workunit.client.0.smithi087.stdout:2/132: stat d2/d15 0 2024-09-17T07:19:45.616 INFO:tasks.workunit.client.0.smithi087.stdout:2/133: creat d2/d15/f23 x:0 0 0 2024-09-17T07:19:45.616 INFO:tasks.workunit.client.0.smithi087.stdout:5/175: getdents d5/d12/d1c 0 2024-09-17T07:19:45.617 INFO:tasks.workunit.client.0.smithi087.stdout:5/176: stat d5/d18/d20/c26 0 2024-09-17T07:19:45.618 INFO:tasks.workunit.client.0.smithi087.stdout:5/177: write d5/d8/d1f/f2e [3262862,66472] 0 2024-09-17T07:19:45.618 INFO:tasks.workunit.client.0.smithi087.stdout:2/134: mkdir d2/d24 0 2024-09-17T07:19:45.619 INFO:tasks.workunit.client.0.smithi087.stdout:2/135: fdatasync d2/d7/f20 0 2024-09-17T07:19:45.637 INFO:tasks.workunit.client.0.smithi087.stdout:2/136: getdents d2/d15 0 2024-09-17T07:19:45.638 INFO:tasks.workunit.client.0.smithi087.stdout:5/178: truncate d5/d8/f3f 1330605 0 2024-09-17T07:19:45.639 INFO:tasks.workunit.client.0.smithi087.stdout:5/179: stat d5/d12/d1c/l3b 0 2024-09-17T07:19:45.639 INFO:tasks.workunit.client.0.smithi087.stdout:2/137: creat d2/f25 x:0 0 0 2024-09-17T07:19:45.642 INFO:tasks.workunit.client.0.smithi087.stdout:5/180: link d5/d18/d20/c11 d5/d18/d20/c40 0 2024-09-17T07:19:45.643 INFO:tasks.workunit.client.0.smithi087.stdout:5/181: truncate d5/d12/d14/f16 1881329 0 2024-09-17T07:19:45.645 INFO:tasks.workunit.client.0.smithi087.stdout:2/138: dwrite d2/d15/f21 [0,4194304] 0 2024-09-17T07:19:45.649 INFO:tasks.workunit.client.0.smithi087.stdout:2/139: dread d2/d7/f8 [0,4194304] 0 2024-09-17T07:19:45.682 INFO:tasks.workunit.client.1.smithi139.stdout:5/2: symlink l1 0 2024-09-17T07:19:45.682 INFO:tasks.workunit.client.1.smithi139.stdout:1/30: sync 2024-09-17T07:19:45.682 INFO:tasks.workunit.client.1.smithi139.stdout:0/17: sync 2024-09-17T07:19:45.683 INFO:tasks.workunit.client.1.smithi139.stdout:4/10: mkdir d0/d1 0 2024-09-17T07:19:45.684 INFO:tasks.workunit.client.1.smithi139.stdout:7/5: symlink l0 0 2024-09-17T07:19:45.686 INFO:tasks.workunit.client.1.smithi139.stdout:0/18: creat d1/f4 x:0 0 0 2024-09-17T07:19:45.688 INFO:tasks.workunit.client.1.smithi139.stdout:5/3: rename l1 to l2 0 2024-09-17T07:19:45.689 INFO:tasks.workunit.client.1.smithi139.stdout:4/11: creat d0/f2 x:0 0 0 2024-09-17T07:19:45.689 INFO:tasks.workunit.client.1.smithi139.stdout:5/4: truncate f0 1026025 0 2024-09-17T07:19:45.690 INFO:tasks.workunit.client.1.smithi139.stdout:1/31: dwrite d2/f7 [0,4194304] 0 2024-09-17T07:19:45.690 INFO:tasks.workunit.client.1.smithi139.stdout:7/6: creat f1 x:0 0 0 2024-09-17T07:19:45.693 INFO:tasks.workunit.client.1.smithi139.stdout:0/19: symlink d1/l5 0 2024-09-17T07:19:45.697 INFO:tasks.workunit.client.1.smithi139.stdout:1/32: rename d2/c3 to d2/c9 0 2024-09-17T07:19:45.701 INFO:tasks.workunit.client.1.smithi139.stdout:7/7: dwrite f1 [0,4194304] 0 2024-09-17T07:19:45.703 INFO:tasks.workunit.client.1.smithi139.stdout:0/20: symlink d1/l6 0 2024-09-17T07:19:45.704 INFO:tasks.workunit.client.1.smithi139.stdout:4/12: mknod d0/d1/c3 0 2024-09-17T07:19:45.704 INFO:tasks.workunit.client.1.smithi139.stdout:0/21: read - d1/f3 zero size 2024-09-17T07:19:45.705 INFO:tasks.workunit.client.1.smithi139.stdout:1/33: mknod d2/ca 0 2024-09-17T07:19:45.706 INFO:tasks.workunit.client.1.smithi139.stdout:0/22: fdatasync d1/f3 0 2024-09-17T07:19:45.708 INFO:tasks.workunit.client.1.smithi139.stdout:4/13: write d0/f2 [214253,1594] 0 2024-09-17T07:19:45.714 INFO:tasks.workunit.client.1.smithi139.stdout:7/8: dwrite f1 [0,4194304] 0 2024-09-17T07:19:45.717 INFO:tasks.workunit.client.1.smithi139.stdout:4/14: read d0/f2 [123653,28156] 0 2024-09-17T07:19:45.717 INFO:tasks.workunit.client.1.smithi139.stdout:1/34: dread f0 [0,4194304] 0 2024-09-17T07:19:45.720 INFO:tasks.workunit.client.1.smithi139.stdout:0/23: link d1/f3 d1/f7 0 2024-09-17T07:19:45.721 INFO:tasks.workunit.client.1.smithi139.stdout:4/15: dread d0/f2 [0,4194304] 0 2024-09-17T07:19:45.724 INFO:tasks.workunit.client.1.smithi139.stdout:0/24: symlink d1/l8 0 2024-09-17T07:19:45.726 INFO:tasks.workunit.client.1.smithi139.stdout:4/16: creat d0/f4 x:0 0 0 2024-09-17T07:19:45.728 INFO:tasks.workunit.client.1.smithi139.stdout:1/35: dwrite d2/f6 [0,4194304] 0 2024-09-17T07:19:45.729 INFO:tasks.workunit.client.1.smithi139.stdout:6/100: sync 2024-09-17T07:19:45.729 INFO:tasks.workunit.client.1.smithi139.stdout:2/77: sync 2024-09-17T07:19:45.730 INFO:tasks.workunit.client.1.smithi139.stdout:3/21: sync 2024-09-17T07:19:45.730 INFO:tasks.workunit.client.1.smithi139.stdout:9/34: sync 2024-09-17T07:19:45.730 INFO:tasks.workunit.client.1.smithi139.stdout:8/95: sync 2024-09-17T07:19:45.731 INFO:tasks.workunit.client.1.smithi139.stdout:2/78: fdatasync d0/dc/d15/f17 0 2024-09-17T07:19:45.731 INFO:tasks.workunit.client.1.smithi139.stdout:4/17: creat d0/f5 x:0 0 0 2024-09-17T07:19:45.733 INFO:tasks.workunit.client.1.smithi139.stdout:4/18: chown d0/d1 2661 1 2024-09-17T07:19:45.736 INFO:tasks.workunit.client.1.smithi139.stdout:2/79: truncate d0/de/f14 80121 0 2024-09-17T07:19:45.737 INFO:tasks.workunit.client.1.smithi139.stdout:9/35: mkdir d5 0 2024-09-17T07:19:45.739 INFO:tasks.workunit.client.1.smithi139.stdout:6/101: symlink db/d18/l22 0 2024-09-17T07:19:45.741 INFO:tasks.workunit.client.1.smithi139.stdout:2/80: write d0/d7/f19 [687388,88893] 0 2024-09-17T07:19:45.741 INFO:tasks.workunit.client.1.smithi139.stdout:0/25: dwrite d1/f4 [0,4194304] 0 2024-09-17T07:19:45.742 INFO:tasks.workunit.client.1.smithi139.stdout:4/19: creat d0/d1/f6 x:0 0 0 2024-09-17T07:19:45.743 INFO:tasks.workunit.client.0.smithi087.stdout:9/77: sync 2024-09-17T07:19:45.743 INFO:tasks.workunit.client.0.smithi087.stdout:5/182: truncate d5/f15 2926493 0 2024-09-17T07:19:45.745 INFO:tasks.workunit.client.0.smithi087.stdout:2/140: symlink d2/d7/l26 0 2024-09-17T07:19:45.747 INFO:tasks.workunit.client.1.smithi139.stdout:0/26: read d1/f4 [2463266,83938] 0 2024-09-17T07:19:45.748 INFO:tasks.workunit.client.0.smithi087.stdout:2/141: creat d2/d7/dd/f27 x:0 0 0 2024-09-17T07:19:45.749 INFO:tasks.workunit.client.1.smithi139.stdout:3/22: mknod d5/c6 0 2024-09-17T07:19:45.749 INFO:tasks.workunit.client.1.smithi139.stdout:6/102: symlink db/d18/l23 0 2024-09-17T07:19:45.751 INFO:tasks.workunit.client.0.smithi087.stdout:5/183: link d5/d12/l22 d5/d8/l41 0 2024-09-17T07:19:45.752 INFO:tasks.workunit.client.0.smithi087.stdout:2/142: mknod d2/d24/c28 0 2024-09-17T07:19:45.752 INFO:tasks.workunit.client.1.smithi139.stdout:9/36: dwrite f4 [0,4194304] 0 2024-09-17T07:19:45.753 INFO:tasks.workunit.client.1.smithi139.stdout:2/81: fsync d0/fa 0 2024-09-17T07:19:45.760 INFO:tasks.workunit.client.1.smithi139.stdout:2/82: dread - d0/dc/d15/f17 zero size 2024-09-17T07:19:45.762 INFO:tasks.workunit.client.1.smithi139.stdout:4/20: rename d0/d1/f6 to d0/f7 0 2024-09-17T07:19:45.765 INFO:tasks.workunit.client.1.smithi139.stdout:6/103: dread db/d18/f1a [0,4194304] 0 2024-09-17T07:19:45.766 INFO:tasks.workunit.client.1.smithi139.stdout:0/27: write d1/f3 [67231,108900] 0 2024-09-17T07:19:45.767 INFO:tasks.workunit.client.1.smithi139.stdout:3/23: dwrite f3 [0,4194304] 0 2024-09-17T07:19:45.769 INFO:tasks.workunit.client.1.smithi139.stdout:9/37: dwrite f3 [0,4194304] 0 2024-09-17T07:19:45.773 INFO:tasks.workunit.client.1.smithi139.stdout:3/24: rename f3 to d5/f7 0 2024-09-17T07:19:45.775 INFO:tasks.workunit.client.1.smithi139.stdout:0/28: unlink d1/c2 0 2024-09-17T07:19:45.776 INFO:tasks.workunit.client.1.smithi139.stdout:0/29: write d1/f3 [325777,12288] 0 2024-09-17T07:19:45.778 INFO:tasks.workunit.client.1.smithi139.stdout:0/30: readlink d1/l8 0 2024-09-17T07:19:45.781 INFO:tasks.workunit.client.1.smithi139.stdout:9/38: rmdir d5 0 2024-09-17T07:19:45.782 INFO:tasks.workunit.client.1.smithi139.stdout:2/83: getdents d0/dc 0 2024-09-17T07:19:45.783 INFO:tasks.workunit.client.1.smithi139.stdout:0/31: symlink d1/l9 0 2024-09-17T07:19:45.784 INFO:tasks.workunit.client.1.smithi139.stdout:6/104: dwrite f2 [0,4194304] 0 2024-09-17T07:19:45.787 INFO:tasks.workunit.client.1.smithi139.stdout:2/84: mkdir d0/d7/d1a 0 2024-09-17T07:19:45.789 INFO:tasks.workunit.client.1.smithi139.stdout:6/105: unlink db/fe 0 2024-09-17T07:19:45.791 INFO:tasks.workunit.client.1.smithi139.stdout:9/39: link f4 f6 0 2024-09-17T07:19:45.794 INFO:tasks.workunit.client.1.smithi139.stdout:6/106: write db/f16 [5099064,110083] 0 2024-09-17T07:19:45.795 INFO:tasks.workunit.client.1.smithi139.stdout:9/40: write f4 [2846097,32037] 0 2024-09-17T07:19:45.797 INFO:tasks.workunit.client.1.smithi139.stdout:6/107: creat db/df/f24 x:0 0 0 2024-09-17T07:19:45.798 INFO:tasks.workunit.client.1.smithi139.stdout:6/108: readlink db/lc 0 2024-09-17T07:19:45.800 INFO:tasks.workunit.client.1.smithi139.stdout:9/41: link f4 f7 0 2024-09-17T07:19:45.801 INFO:tasks.workunit.client.1.smithi139.stdout:9/42: chown f4 1230 1 2024-09-17T07:19:45.802 INFO:tasks.workunit.client.1.smithi139.stdout:9/43: chown f6 15 1 2024-09-17T07:19:45.806 INFO:tasks.workunit.client.1.smithi139.stdout:6/109: dwrite db/d18/d1b/f1d [0,4194304] 0 2024-09-17T07:19:45.813 INFO:tasks.workunit.client.1.smithi139.stdout:9/44: dwrite f6 [0,4194304] 0 2024-09-17T07:19:45.817 INFO:tasks.workunit.client.1.smithi139.stdout:9/45: unlink f3 0 2024-09-17T07:19:45.817 INFO:tasks.workunit.client.1.smithi139.stdout:9/46: write f7 [196834,95571] 0 2024-09-17T07:19:45.819 INFO:tasks.workunit.client.1.smithi139.stdout:9/47: mknod c8 0 2024-09-17T07:19:45.821 INFO:tasks.workunit.client.1.smithi139.stdout:9/48: creat f9 x:0 0 0 2024-09-17T07:19:45.823 INFO:tasks.workunit.client.1.smithi139.stdout:9/49: mknod ca 0 2024-09-17T07:19:45.824 INFO:tasks.workunit.client.1.smithi139.stdout:9/50: write f7 [1109004,117832] 0 2024-09-17T07:19:45.825 INFO:tasks.workunit.client.1.smithi139.stdout:9/51: creat fb x:0 0 0 2024-09-17T07:19:45.826 INFO:tasks.workunit.client.1.smithi139.stdout:9/52: chown f9 982 1 2024-09-17T07:19:45.827 INFO:tasks.workunit.client.1.smithi139.stdout:9/53: truncate f6 4779790 0 2024-09-17T07:19:45.827 INFO:tasks.workunit.client.1.smithi139.stdout:9/54: truncate fb 592504 0 2024-09-17T07:19:45.829 INFO:tasks.workunit.client.1.smithi139.stdout:9/55: mkdir dc 0 2024-09-17T07:19:45.831 INFO:tasks.workunit.client.1.smithi139.stdout:9/56: symlink dc/ld 0 2024-09-17T07:19:45.832 INFO:tasks.workunit.client.1.smithi139.stdout:9/57: readlink dc/ld 0 2024-09-17T07:19:45.833 INFO:tasks.workunit.client.1.smithi139.stdout:9/58: mknod dc/ce 0 2024-09-17T07:19:45.839 INFO:tasks.workunit.client.1.smithi139.stdout:9/59: dwrite f6 [0,4194304] 0 2024-09-17T07:19:45.841 INFO:tasks.workunit.client.0.smithi087.stdout:9/78: write d3/d4/fb [619435,103316] 0 2024-09-17T07:19:45.842 INFO:tasks.workunit.client.0.smithi087.stdout:2/143: rename d2/d7/f20 to d2/d7/dd/f29 0 2024-09-17T07:19:45.844 INFO:tasks.workunit.client.0.smithi087.stdout:9/79: read d3/d4/fb [560155,2364] 0 2024-09-17T07:19:45.846 INFO:tasks.workunit.client.0.smithi087.stdout:5/184: dwrite d5/d8/d27/f3a [0,4194304] 0 2024-09-17T07:19:45.850 INFO:tasks.workunit.client.0.smithi087.stdout:9/80: creat d3/d4/d16/f1d x:0 0 0 2024-09-17T07:19:45.850 INFO:tasks.workunit.client.0.smithi087.stdout:2/144: dread d2/f3 [4194304,4194304] 0 2024-09-17T07:19:45.852 INFO:tasks.workunit.client.0.smithi087.stdout:5/185: unlink d5/d12/d14/f25 0 2024-09-17T07:19:45.854 INFO:tasks.workunit.client.0.smithi087.stdout:2/145: creat d2/d12/f2a x:0 0 0 2024-09-17T07:19:45.855 INFO:tasks.workunit.client.0.smithi087.stdout:9/81: mkdir d3/d4/da/d1c/d1e 0 2024-09-17T07:19:45.856 INFO:tasks.workunit.client.0.smithi087.stdout:5/186: symlink d5/d12/l42 0 2024-09-17T07:19:45.857 INFO:tasks.workunit.client.0.smithi087.stdout:9/82: creat d3/f1f x:0 0 0 2024-09-17T07:19:45.857 INFO:tasks.workunit.client.0.smithi087.stdout:5/187: read d5/d8/d27/f3a [1996430,22417] 0 2024-09-17T07:19:45.857 INFO:tasks.workunit.client.0.smithi087.stdout:2/146: mknod d2/d7/c2b 0 2024-09-17T07:19:45.858 INFO:tasks.workunit.client.0.smithi087.stdout:9/83: fdatasync d3/d4/d6/f13 0 2024-09-17T07:19:45.859 INFO:tasks.workunit.client.0.smithi087.stdout:5/188: creat d5/d18/d20/d2f/f43 x:0 0 0 2024-09-17T07:19:45.860 INFO:tasks.workunit.client.0.smithi087.stdout:2/147: write d2/d7/dd/f29 [173561,95404] 0 2024-09-17T07:19:45.862 INFO:tasks.workunit.client.0.smithi087.stdout:5/189: creat d5/d12/d14/f44 x:0 0 0 2024-09-17T07:19:45.863 INFO:tasks.workunit.client.0.smithi087.stdout:5/190: rmdir d5/d12/d1c 39 2024-09-17T07:19:45.864 INFO:tasks.workunit.client.0.smithi087.stdout:2/148: dread d2/d7/dd/ff [0,4194304] 0 2024-09-17T07:19:45.867 INFO:tasks.workunit.client.0.smithi087.stdout:5/191: dread d5/f17 [0,4194304] 0 2024-09-17T07:19:45.867 INFO:tasks.workunit.client.0.smithi087.stdout:2/149: creat d2/d15/f2c x:0 0 0 2024-09-17T07:19:45.870 INFO:tasks.workunit.client.0.smithi087.stdout:5/192: mknod d5/d12/d1c/c45 0 2024-09-17T07:19:45.871 INFO:tasks.workunit.client.0.smithi087.stdout:5/193: readlink d5/d18/d20/l32 0 2024-09-17T07:19:45.872 INFO:tasks.workunit.client.0.smithi087.stdout:5/194: write d5/d12/d14/f44 [818238,87303] 0 2024-09-17T07:19:45.875 INFO:tasks.workunit.client.0.smithi087.stdout:2/150: dwrite d2/f25 [0,4194304] 0 2024-09-17T07:19:45.877 INFO:tasks.workunit.client.0.smithi087.stdout:5/195: dread d5/d8/f3f [0,4194304] 0 2024-09-17T07:19:45.878 INFO:tasks.workunit.client.0.smithi087.stdout:2/151: mknod d2/d7/db/c2d 0 2024-09-17T07:19:45.878 INFO:tasks.workunit.client.0.smithi087.stdout:5/196: fsync d5/d8/d1f/f2e 0 2024-09-17T07:19:45.879 INFO:tasks.workunit.client.0.smithi087.stdout:2/152: stat d2/d7/dd/d1f 0 2024-09-17T07:19:45.880 INFO:tasks.workunit.client.0.smithi087.stdout:5/197: symlink d5/d18/l46 0 2024-09-17T07:19:45.883 INFO:tasks.workunit.client.0.smithi087.stdout:2/153: getdents d2/d15 0 2024-09-17T07:19:45.884 INFO:tasks.workunit.client.0.smithi087.stdout:5/198: getdents d5 0 2024-09-17T07:19:45.884 INFO:tasks.workunit.client.0.smithi087.stdout:2/154: symlink d2/d15/l2e 0 2024-09-17T07:19:45.888 INFO:tasks.workunit.client.0.smithi087.stdout:5/199: dread d5/d12/d14/f44 [0,4194304] 0 2024-09-17T07:19:45.889 INFO:tasks.workunit.client.0.smithi087.stdout:5/200: rmdir d5/d8/d1f 39 2024-09-17T07:19:45.890 INFO:tasks.workunit.client.0.smithi087.stdout:5/201: write d5/d18/d20/d2f/f43 [898498,107472] 0 2024-09-17T07:19:45.890 INFO:tasks.workunit.client.0.smithi087.stdout:2/155: truncate d2/d7/dd/d10/f1e 1761363 0 2024-09-17T07:19:45.891 INFO:tasks.workunit.client.0.smithi087.stdout:5/202: rmdir d5 39 2024-09-17T07:19:45.893 INFO:tasks.workunit.client.0.smithi087.stdout:5/203: write d5/d18/d20/f35 [929867,62762] 0 2024-09-17T07:19:45.893 INFO:tasks.workunit.client.0.smithi087.stdout:7/124: sync 2024-09-17T07:19:45.895 INFO:tasks.workunit.client.0.smithi087.stdout:2/156: link d2/d7/c2b d2/d7/db/c2f 0 2024-09-17T07:19:45.896 INFO:tasks.workunit.client.0.smithi087.stdout:5/204: dread d5/d12/f34 [0,4194304] 0 2024-09-17T07:19:45.896 INFO:tasks.workunit.client.0.smithi087.stdout:2/157: chown d2/f3 1196162099 1 2024-09-17T07:19:45.898 INFO:tasks.workunit.client.0.smithi087.stdout:7/125: rename d0/d3/d23/f19 to d0/f28 0 2024-09-17T07:19:45.898 INFO:tasks.workunit.client.0.smithi087.stdout:2/158: read d2/d7/dd/d10/f1d [79508,94180] 0 2024-09-17T07:19:45.899 INFO:tasks.workunit.client.0.smithi087.stdout:5/205: creat d5/d8/d27/f47 x:0 0 0 2024-09-17T07:19:45.901 INFO:tasks.workunit.client.0.smithi087.stdout:7/126: rename d0/d3/fe to d0/d3/d10/f29 0 2024-09-17T07:19:45.904 INFO:tasks.workunit.client.0.smithi087.stdout:2/159: mkdir d2/d7/d30 0 2024-09-17T07:19:45.905 INFO:tasks.workunit.client.1.smithi139.stdout:5/5: truncate f0 452578 0 2024-09-17T07:19:45.907 INFO:tasks.workunit.client.0.smithi087.stdout:5/206: rename d5/d12/d14/f16 to d5/d18/d20/d2f/f48 0 2024-09-17T07:19:45.910 INFO:tasks.workunit.client.0.smithi087.stdout:5/207: creat d5/d8/d27/f49 x:0 0 0 2024-09-17T07:19:45.912 INFO:tasks.workunit.client.0.smithi087.stdout:7/127: link d0/d3/f22 d0/d3/f2a 0 2024-09-17T07:19:45.913 INFO:tasks.workunit.client.1.smithi139.stdout:7/9: dwrite f1 [4194304,4194304] 0 2024-09-17T07:19:45.914 INFO:tasks.workunit.client.0.smithi087.stdout:5/208: chown d5/d18/d20/c11 6775469 1 2024-09-17T07:19:45.917 INFO:tasks.workunit.client.0.smithi087.stdout:5/209: rmdir d5/d8/d1f 39 2024-09-17T07:19:45.917 INFO:tasks.workunit.client.1.smithi139.stdout:4/21: rmdir d0 39 2024-09-17T07:19:45.918 INFO:tasks.workunit.client.0.smithi087.stdout:2/160: write d2/f14 [134457,35179] 0 2024-09-17T07:19:45.920 INFO:tasks.workunit.client.1.smithi139.stdout:7/10: link f1 f2 0 2024-09-17T07:19:45.922 INFO:tasks.workunit.client.0.smithi087.stdout:2/161: symlink d2/d7/l31 0 2024-09-17T07:19:45.923 INFO:tasks.workunit.client.0.smithi087.stdout:7/128: dwrite d0/fa [0,4194304] 0 2024-09-17T07:19:45.926 INFO:tasks.workunit.client.1.smithi139.stdout:7/11: write f1 [4900693,65599] 0 2024-09-17T07:19:45.926 INFO:tasks.workunit.client.0.smithi087.stdout:2/162: write d2/d7/fe [3497394,63144] 0 2024-09-17T07:19:45.929 INFO:tasks.workunit.client.0.smithi087.stdout:5/210: dwrite d5/d18/f38 [0,4194304] 0 2024-09-17T07:19:45.929 INFO:tasks.workunit.client.1.smithi139.stdout:0/32: getdents d1 0 2024-09-17T07:19:45.930 INFO:tasks.workunit.client.0.smithi087.stdout:2/163: write d2/d15/f21 [3886204,11567] 0 2024-09-17T07:19:45.931 INFO:tasks.workunit.client.1.smithi139.stdout:4/22: creat d0/d1/f8 x:0 0 0 2024-09-17T07:19:45.932 INFO:tasks.workunit.client.1.smithi139.stdout:7/12: dread f2 [0,4194304] 0 2024-09-17T07:19:45.933 INFO:tasks.workunit.client.0.smithi087.stdout:5/211: creat d5/d18/f4a x:0 0 0 2024-09-17T07:19:45.934 INFO:tasks.workunit.client.1.smithi139.stdout:4/23: truncate d0/f5 497194 0 2024-09-17T07:19:45.935 INFO:tasks.workunit.client.1.smithi139.stdout:0/33: dread d1/f7 [0,4194304] 0 2024-09-17T07:19:45.936 INFO:tasks.workunit.client.0.smithi087.stdout:7/129: dwrite d0/d3/d10/f29 [4194304,4194304] 0 2024-09-17T07:19:45.937 INFO:tasks.workunit.client.0.smithi087.stdout:7/130: truncate d0/d3/f1f 873777 0 2024-09-17T07:19:45.937 INFO:tasks.workunit.client.0.smithi087.stdout:2/164: rmdir d2/d7 39 2024-09-17T07:19:45.938 INFO:tasks.workunit.client.0.smithi087.stdout:5/212: rename d5/d18/d20/d2f/l3c to d5/d18/d20/d2f/l4b 0 2024-09-17T07:19:45.940 INFO:tasks.workunit.client.0.smithi087.stdout:2/165: write d2/f14 [372937,105323] 0 2024-09-17T07:19:45.942 INFO:tasks.workunit.client.0.smithi087.stdout:5/213: rmdir d5/d12 39 2024-09-17T07:19:45.942 INFO:tasks.workunit.client.1.smithi139.stdout:0/34: mkdir d1/da 0 2024-09-17T07:19:45.943 INFO:tasks.workunit.client.0.smithi087.stdout:2/166: readlink d2/d7/l31 0 2024-09-17T07:19:45.944 INFO:tasks.workunit.client.1.smithi139.stdout:2/85: dwrite d0/fa [0,4194304] 0 2024-09-17T07:19:45.946 INFO:tasks.workunit.client.0.smithi087.stdout:7/131: dwrite d0/d3/f1f [0,4194304] 0 2024-09-17T07:19:45.948 INFO:tasks.workunit.client.0.smithi087.stdout:5/214: rename d5/d18/d20/l32 to d5/l4c 0 2024-09-17T07:19:45.949 INFO:tasks.workunit.client.1.smithi139.stdout:0/35: symlink d1/lb 0 2024-09-17T07:19:45.950 INFO:tasks.workunit.client.1.smithi139.stdout:9/60: fsync f7 0 2024-09-17T07:19:45.951 INFO:tasks.workunit.client.0.smithi087.stdout:2/167: link d2/d7/f22 d2/d15/f32 0 2024-09-17T07:19:45.952 INFO:tasks.workunit.client.1.smithi139.stdout:0/36: chown d1/f4 32 1 2024-09-17T07:19:45.952 INFO:tasks.workunit.client.0.smithi087.stdout:5/215: fdatasync d5/f19 0 2024-09-17T07:19:45.954 INFO:tasks.workunit.client.0.smithi087.stdout:5/216: read - d5/d12/f28 zero size 2024-09-17T07:19:45.955 INFO:tasks.workunit.client.0.smithi087.stdout:2/168: getdents d2/d12 0 2024-09-17T07:19:45.955 INFO:tasks.workunit.client.1.smithi139.stdout:9/61: write fb [1180126,111488] 0 2024-09-17T07:19:45.957 INFO:tasks.workunit.client.1.smithi139.stdout:4/24: getdents d0 0 2024-09-17T07:19:45.957 INFO:tasks.workunit.client.1.smithi139.stdout:2/86: dwrite d0/f8 [0,4194304] 0 2024-09-17T07:19:45.958 INFO:tasks.workunit.client.0.smithi087.stdout:2/169: dread d2/d7/dd/f29 [0,4194304] 0 2024-09-17T07:19:45.959 INFO:tasks.workunit.client.0.smithi087.stdout:2/170: truncate d2/d15/f21 4197432 0 2024-09-17T07:19:45.960 INFO:tasks.workunit.client.0.smithi087.stdout:5/217: rename d5/d8/d27 to d5/d12/d4d 0 2024-09-17T07:19:45.962 INFO:tasks.workunit.client.1.smithi139.stdout:9/62: symlink dc/lf 0 2024-09-17T07:19:45.962 INFO:tasks.workunit.client.1.smithi139.stdout:9/63: chown dc 24465645 1 2024-09-17T07:19:45.963 INFO:tasks.workunit.client.0.smithi087.stdout:2/171: mkdir d2/d7/d33 0 2024-09-17T07:19:45.964 INFO:tasks.workunit.client.0.smithi087.stdout:5/218: mkdir d5/d8/d1f/d4e 0 2024-09-17T07:19:45.965 INFO:tasks.workunit.client.1.smithi139.stdout:9/64: creat dc/f10 x:0 0 0 2024-09-17T07:19:45.966 INFO:tasks.workunit.client.0.smithi087.stdout:2/172: mkdir d2/d15/d34 0 2024-09-17T07:19:45.967 INFO:tasks.workunit.client.1.smithi139.stdout:2/87: mkdir d0/d7/d1a/d1b 0 2024-09-17T07:19:45.967 INFO:tasks.workunit.client.0.smithi087.stdout:2/173: dread - d2/d15/f2c zero size 2024-09-17T07:19:45.969 INFO:tasks.workunit.client.0.smithi087.stdout:2/174: write d2/f3 [5959235,84870] 0 2024-09-17T07:19:45.969 INFO:tasks.workunit.client.1.smithi139.stdout:4/25: link d0/f7 d0/d1/f9 0 2024-09-17T07:19:45.970 INFO:tasks.workunit.client.1.smithi139.stdout:4/26: rename d0 to d0/d1/da 22 2024-09-17T07:19:45.971 INFO:tasks.workunit.client.1.smithi139.stdout:2/88: mknod d0/d7/d1a/d1b/c1c 0 2024-09-17T07:19:45.972 INFO:tasks.workunit.client.0.smithi087.stdout:5/219: dwrite d5/d8/f10 [0,4194304] 0 2024-09-17T07:19:45.974 INFO:tasks.workunit.client.1.smithi139.stdout:4/27: write d0/f4 [491711,6925] 0 2024-09-17T07:19:45.975 INFO:tasks.workunit.client.0.smithi087.stdout:5/220: mknod d5/d18/c4f 0 2024-09-17T07:19:45.975 INFO:tasks.workunit.client.0.smithi087.stdout:5/221: write d5/d8/f10 [1895717,94218] 0 2024-09-17T07:19:45.976 INFO:tasks.workunit.client.1.smithi139.stdout:9/65: dwrite dc/f10 [0,4194304] 0 2024-09-17T07:19:45.977 INFO:tasks.workunit.client.1.smithi139.stdout:9/66: truncate f4 5040921 0 2024-09-17T07:19:45.979 INFO:tasks.workunit.client.0.smithi087.stdout:7/132: write d0/d3/f2a [1011653,20501] 0 2024-09-17T07:19:45.980 INFO:tasks.workunit.client.0.smithi087.stdout:5/222: truncate d5/f19 1801477 0 2024-09-17T07:19:45.983 INFO:tasks.workunit.client.1.smithi139.stdout:9/67: unlink f9 0 2024-09-17T07:19:45.984 INFO:tasks.workunit.client.1.smithi139.stdout:7/13: truncate f2 2503124 0 2024-09-17T07:19:45.988 INFO:tasks.workunit.client.1.smithi139.stdout:0/37: truncate d1/f3 153067 0 2024-09-17T07:19:45.989 INFO:tasks.workunit.client.0.smithi087.stdout:5/223: dwrite d5/d12/d4d/f49 [0,4194304] 0 2024-09-17T07:19:45.990 INFO:tasks.workunit.client.1.smithi139.stdout:4/28: dwrite d0/d1/f9 [0,4194304] 0 2024-09-17T07:19:45.990 INFO:tasks.workunit.client.1.smithi139.stdout:9/68: mkdir dc/d11 0 2024-09-17T07:19:45.991 INFO:tasks.workunit.client.1.smithi139.stdout:9/69: fsync f4 0 2024-09-17T07:19:45.991 INFO:tasks.workunit.client.1.smithi139.stdout:2/89: link d0/de/df/l16 d0/dc/d15/l1d 0 2024-09-17T07:19:45.992 INFO:tasks.workunit.client.0.smithi087.stdout:2/175: truncate d2/f14 850625 0 2024-09-17T07:19:45.993 INFO:tasks.workunit.client.0.smithi087.stdout:5/224: symlink d5/d8/l50 0 2024-09-17T07:19:45.995 INFO:tasks.workunit.client.0.smithi087.stdout:7/133: truncate d0/fc 6550372 0 2024-09-17T07:19:45.996 INFO:tasks.workunit.client.1.smithi139.stdout:5/6: write f0 [351464,111418] 0 2024-09-17T07:19:45.997 INFO:tasks.workunit.client.1.smithi139.stdout:5/7: stat f0 0 2024-09-17T07:19:45.999 INFO:tasks.workunit.client.1.smithi139.stdout:4/29: write d0/f2 [172383,13179] 0 2024-09-17T07:19:46.000 INFO:tasks.workunit.client.1.smithi139.stdout:5/8: write f0 [840815,88866] 0 2024-09-17T07:19:46.001 INFO:tasks.workunit.client.1.smithi139.stdout:4/30: dread - d0/d1/f8 zero size 2024-09-17T07:19:46.001 INFO:tasks.workunit.client.1.smithi139.stdout:4/31: readlink - no filename 2024-09-17T07:19:46.001 INFO:tasks.workunit.client.1.smithi139.stdout:2/90: rename d0/f8 to d0/d7/d1a/f1e 0 2024-09-17T07:19:46.002 INFO:tasks.workunit.client.1.smithi139.stdout:9/70: creat dc/d11/f12 x:0 0 0 2024-09-17T07:19:46.002 INFO:tasks.workunit.client.1.smithi139.stdout:2/91: stat d0/de 0 2024-09-17T07:19:46.005 INFO:tasks.workunit.client.0.smithi087.stdout:2/176: dwrite d2/d15/f23 [0,4194304] 0 2024-09-17T07:19:46.005 INFO:tasks.workunit.client.0.smithi087.stdout:5/225: dwrite d5/d18/d20/d2f/f43 [0,4194304] 0 2024-09-17T07:19:46.007 INFO:tasks.workunit.client.1.smithi139.stdout:2/92: symlink d0/l1f 0 2024-09-17T07:19:46.009 INFO:tasks.workunit.client.0.smithi087.stdout:2/177: symlink d2/d12/l35 0 2024-09-17T07:19:46.009 INFO:tasks.workunit.client.1.smithi139.stdout:9/71: dread f7 [0,4194304] 0 2024-09-17T07:19:46.010 INFO:tasks.workunit.client.1.smithi139.stdout:2/93: write d0/d7/fd [485677,80383] 0 2024-09-17T07:19:46.011 INFO:tasks.workunit.client.1.smithi139.stdout:4/32: dwrite d0/f2 [0,4194304] 0 2024-09-17T07:19:46.012 INFO:tasks.workunit.client.1.smithi139.stdout:2/94: fsync d0/dc/f13 0 2024-09-17T07:19:46.014 INFO:tasks.workunit.client.0.smithi087.stdout:5/226: link d5/d18/d20/c26 d5/c51 0 2024-09-17T07:19:46.016 INFO:tasks.workunit.client.1.smithi139.stdout:9/72: mknod dc/c13 0 2024-09-17T07:19:46.020 INFO:tasks.workunit.client.0.smithi087.stdout:2/178: getdents d2/d7/dd 0 2024-09-17T07:19:46.021 INFO:tasks.workunit.client.1.smithi139.stdout:4/33: dread d0/f4 [0,4194304] 0 2024-09-17T07:19:46.021 INFO:tasks.workunit.client.1.smithi139.stdout:5/9: fsync f0 0 2024-09-17T07:19:46.022 INFO:tasks.workunit.client.0.smithi087.stdout:2/179: write d2/d7/f8 [2132043,11616] 0 2024-09-17T07:19:46.023 INFO:tasks.workunit.client.0.smithi087.stdout:5/227: getdents d5/d8 0 2024-09-17T07:19:46.023 INFO:tasks.workunit.client.1.smithi139.stdout:7/14: rename f1 to f3 0 2024-09-17T07:19:46.024 INFO:tasks.workunit.client.1.smithi139.stdout:2/95: creat d0/dc/f20 x:0 0 0 2024-09-17T07:19:46.025 INFO:tasks.workunit.client.1.smithi139.stdout:2/96: write d0/fa [79951,101532] 0 2024-09-17T07:19:46.026 INFO:tasks.workunit.client.1.smithi139.stdout:9/73: symlink dc/l14 0 2024-09-17T07:19:46.028 INFO:tasks.workunit.client.1.smithi139.stdout:4/34: dread d0/f7 [0,4194304] 0 2024-09-17T07:19:46.030 INFO:tasks.workunit.client.0.smithi087.stdout:5/228: dwrite d5/d8/d1f/f2e [0,4194304] 0 2024-09-17T07:19:46.032 INFO:tasks.workunit.client.1.smithi139.stdout:9/74: mkdir dc/d11/d15 0 2024-09-17T07:19:46.034 INFO:tasks.workunit.client.0.smithi087.stdout:7/134: dread d0/f2 [0,4194304] 0 2024-09-17T07:19:46.035 INFO:tasks.workunit.client.1.smithi139.stdout:4/35: mkdir d0/db 0 2024-09-17T07:19:46.038 INFO:tasks.workunit.client.0.smithi087.stdout:5/229: mkdir d5/d18/d20/d2f/d52 0 2024-09-17T07:19:46.041 INFO:tasks.workunit.client.1.smithi139.stdout:2/97: dwrite d0/f6 [0,4194304] 0 2024-09-17T07:19:46.042 INFO:tasks.workunit.client.1.smithi139.stdout:5/10: truncate f0 884752 0 2024-09-17T07:19:46.042 INFO:tasks.workunit.client.0.smithi087.stdout:7/135: dwrite d0/d3/d10/f21 [0,4194304] 0 2024-09-17T07:19:46.044 INFO:tasks.workunit.client.0.smithi087.stdout:5/230: symlink d5/d12/d1c/l53 0 2024-09-17T07:19:46.045 INFO:tasks.workunit.client.0.smithi087.stdout:2/180: write d2/d7/f22 [93641,112554] 0 2024-09-17T07:19:46.046 INFO:tasks.workunit.client.1.smithi139.stdout:9/75: dwrite f4 [4194304,4194304] 0 2024-09-17T07:19:46.049 INFO:tasks.workunit.client.0.smithi087.stdout:2/181: mkdir d2/d24/d36 0 2024-09-17T07:19:46.052 INFO:tasks.workunit.client.0.smithi087.stdout:7/136: link d0/d3/d10/f21 d0/d3/d23/f2b 0 2024-09-17T07:19:46.053 INFO:tasks.workunit.client.0.smithi087.stdout:7/137: chown d0/d3/d23/d17 1 1 2024-09-17T07:19:46.054 INFO:tasks.workunit.client.0.smithi087.stdout:4/125: sync 2024-09-17T07:19:46.055 INFO:tasks.workunit.client.0.smithi087.stdout:5/231: unlink d5/d12/l22 0 2024-09-17T07:19:46.057 INFO:tasks.workunit.client.0.smithi087.stdout:7/138: creat d0/d3/f2c x:0 0 0 2024-09-17T07:19:46.059 INFO:tasks.workunit.client.0.smithi087.stdout:2/182: dwrite d2/d7/dd/ff [0,4194304] 0 2024-09-17T07:19:46.060 INFO:tasks.workunit.client.0.smithi087.stdout:5/232: unlink d5/d12/d14/f2b 0 2024-09-17T07:19:46.061 INFO:tasks.workunit.client.0.smithi087.stdout:7/139: mkdir d0/d3/d23/d2d 0 2024-09-17T07:19:46.064 INFO:tasks.workunit.client.0.smithi087.stdout:5/233: write d5/d12/d4d/f3a [2460973,42825] 0 2024-09-17T07:19:46.066 INFO:tasks.workunit.client.0.smithi087.stdout:2/183: creat d2/f37 x:0 0 0 2024-09-17T07:19:46.067 INFO:tasks.workunit.client.0.smithi087.stdout:5/234: rename d5/d8/d1f to d5/d8/d1f/d54 22 2024-09-17T07:19:46.069 INFO:tasks.workunit.client.1.smithi139.stdout:5/11: getdents . 0 2024-09-17T07:19:46.070 INFO:tasks.workunit.client.0.smithi087.stdout:7/140: dwrite d0/d3/f1f [0,4194304] 0 2024-09-17T07:19:46.071 INFO:tasks.workunit.client.0.smithi087.stdout:2/184: creat d2/d24/d36/f38 x:0 0 0 2024-09-17T07:19:46.071 INFO:tasks.workunit.client.0.smithi087.stdout:1/146: sync 2024-09-17T07:19:46.071 INFO:tasks.workunit.client.0.smithi087.stdout:8/119: sync 2024-09-17T07:19:46.072 INFO:tasks.workunit.client.1.smithi139.stdout:2/98: dwrite d0/d7/fd [0,4194304] 0 2024-09-17T07:19:46.072 INFO:tasks.workunit.client.1.smithi139.stdout:9/76: dwrite dc/f10 [4194304,4194304] 0 2024-09-17T07:19:46.074 INFO:tasks.workunit.client.0.smithi087.stdout:8/120: write d1/d7/d9/d19/d1b/f1c [2097095,19716] 0 2024-09-17T07:19:46.074 INFO:tasks.workunit.client.0.smithi087.stdout:2/185: creat d2/d24/d36/f39 x:0 0 0 2024-09-17T07:19:46.074 INFO:tasks.workunit.client.0.smithi087.stdout:1/147: creat d2/dc/f3a x:0 0 0 2024-09-17T07:19:46.075 INFO:tasks.workunit.client.0.smithi087.stdout:2/186: chown d2/d7 200369 1 2024-09-17T07:19:46.075 INFO:tasks.workunit.client.0.smithi087.stdout:8/121: stat d1/d7/d9 0 2024-09-17T07:19:46.075 INFO:tasks.workunit.client.1.smithi139.stdout:4/36: dwrite d0/f2 [0,4194304] 0 2024-09-17T07:19:46.076 INFO:tasks.workunit.client.0.smithi087.stdout:2/187: dread - d2/d15/f2c zero size 2024-09-17T07:19:46.076 INFO:tasks.workunit.client.1.smithi139.stdout:4/37: dread - d0/d1/f8 zero size 2024-09-17T07:19:46.077 INFO:tasks.workunit.client.0.smithi087.stdout:2/188: write d2/d7/f22 [773131,5556] 0 2024-09-17T07:19:46.077 INFO:tasks.workunit.client.1.smithi139.stdout:4/38: chown d0/db 578669574 1 2024-09-17T07:19:46.078 INFO:tasks.workunit.client.0.smithi087.stdout:2/189: readlink d2/d15/l19 0 2024-09-17T07:19:46.082 INFO:tasks.workunit.client.0.smithi087.stdout:2/190: mkdir d2/d7/dd/d1f/d3a 0 2024-09-17T07:19:46.092 INFO:tasks.workunit.client.0.smithi087.stdout:1/148: dread d2/d1a/f1c [0,4194304] 0 2024-09-17T07:19:46.092 INFO:tasks.workunit.client.1.smithi139.stdout:2/99: dread d0/d7/fd [0,4194304] 0 2024-09-17T07:19:46.093 INFO:tasks.workunit.client.0.smithi087.stdout:1/149: read - d2/dc/f3a zero size 2024-09-17T07:19:46.093 INFO:tasks.workunit.client.1.smithi139.stdout:5/12: rename f0 to f3 0 2024-09-17T07:19:46.094 INFO:tasks.workunit.client.0.smithi087.stdout:1/150: creat d2/dc/f3b x:0 0 0 2024-09-17T07:19:46.096 INFO:tasks.workunit.client.0.smithi087.stdout:1/151: read d2/dc/d26/f21 [13504,89239] 0 2024-09-17T07:19:46.096 INFO:tasks.workunit.client.1.smithi139.stdout:4/39: dwrite d0/d1/f9 [0,4194304] 0 2024-09-17T07:19:46.097 INFO:tasks.workunit.client.1.smithi139.stdout:9/77: dwrite f4 [0,4194304] 0 2024-09-17T07:19:46.098 INFO:tasks.workunit.client.1.smithi139.stdout:2/100: creat d0/dc/f21 x:0 0 0 2024-09-17T07:19:46.098 INFO:tasks.workunit.client.0.smithi087.stdout:1/152: symlink d2/dc/d26/d35/l3c 0 2024-09-17T07:19:46.100 INFO:tasks.workunit.client.1.smithi139.stdout:4/40: write d0/f5 [927332,17866] 0 2024-09-17T07:19:46.100 INFO:tasks.workunit.client.1.smithi139.stdout:5/13: mkdir d4 0 2024-09-17T07:19:46.100 INFO:tasks.workunit.client.1.smithi139.stdout:9/78: write dc/f10 [5974823,123738] 0 2024-09-17T07:19:46.103 INFO:tasks.workunit.client.1.smithi139.stdout:2/101: chown d0/dc/d15/f17 2 1 2024-09-17T07:19:46.107 INFO:tasks.workunit.client.1.smithi139.stdout:4/41: fsync d0/f2 0 2024-09-17T07:19:46.111 INFO:tasks.workunit.client.0.smithi087.stdout:4/126: truncate d2/d5/db/f1b 8325654 0 2024-09-17T07:19:46.112 INFO:tasks.workunit.client.0.smithi087.stdout:8/122: rmdir d1/d7 39 2024-09-17T07:19:46.112 INFO:tasks.workunit.client.1.smithi139.stdout:2/102: dwrite d0/d7/f19 [0,4194304] 0 2024-09-17T07:19:46.113 INFO:tasks.workunit.client.1.smithi139.stdout:2/103: stat d0/d7/f19 0 2024-09-17T07:19:46.114 INFO:tasks.workunit.client.1.smithi139.stdout:4/42: dread d0/f2 [0,4194304] 0 2024-09-17T07:19:46.114 INFO:tasks.workunit.client.1.smithi139.stdout:4/43: readlink - no filename 2024-09-17T07:19:46.114 INFO:tasks.workunit.client.0.smithi087.stdout:4/127: unlink d2/d5/d1f/f23 0 2024-09-17T07:19:46.118 INFO:tasks.workunit.client.0.smithi087.stdout:4/128: read d2/f7 [542108,39358] 0 2024-09-17T07:19:46.118 INFO:tasks.workunit.client.0.smithi087.stdout:8/123: write d1/d7/d9/fc [1563312,76192] 0 2024-09-17T07:19:46.121 INFO:tasks.workunit.client.0.smithi087.stdout:4/129: creat d2/d5/f2a x:0 0 0 2024-09-17T07:19:46.121 INFO:tasks.workunit.client.0.smithi087.stdout:8/124: dread d1/d7/d9/d19/d1b/f1f [0,4194304] 0 2024-09-17T07:19:46.121 INFO:tasks.workunit.client.0.smithi087.stdout:4/130: fsync d2/d5/f12 0 2024-09-17T07:19:46.123 INFO:tasks.workunit.client.0.smithi087.stdout:8/125: chown d1/d7/d9/d19/d1b/d18/c26 203 1 2024-09-17T07:19:46.123 INFO:tasks.workunit.client.0.smithi087.stdout:4/131: mkdir d2/d5/d1f/d2b 0 2024-09-17T07:19:46.125 INFO:tasks.workunit.client.0.smithi087.stdout:8/126: mkdir d1/d7/d9/d27 0 2024-09-17T07:19:46.126 INFO:tasks.workunit.client.1.smithi139.stdout:2/104: dwrite d0/dc/f13 [4194304,4194304] 0 2024-09-17T07:19:46.126 INFO:tasks.workunit.client.0.smithi087.stdout:8/127: truncate d1/d7/d9/d19/d1b/f1f 1349916 0 2024-09-17T07:19:46.127 INFO:tasks.workunit.client.1.smithi139.stdout:4/44: dwrite d0/f5 [0,4194304] 0 2024-09-17T07:19:46.127 INFO:tasks.workunit.client.0.smithi087.stdout:8/128: stat d1/f8 0 2024-09-17T07:19:46.129 INFO:tasks.workunit.client.0.smithi087.stdout:8/129: fdatasync d1/d7/d9/d19/d1b/f1f 0 2024-09-17T07:19:46.130 INFO:tasks.workunit.client.1.smithi139.stdout:4/45: mknod d0/d1/cc 0 2024-09-17T07:19:46.131 INFO:tasks.workunit.client.0.smithi087.stdout:3/120: sync 2024-09-17T07:19:46.131 INFO:tasks.workunit.client.0.smithi087.stdout:0/172: sync 2024-09-17T07:19:46.131 INFO:tasks.workunit.client.0.smithi087.stdout:6/246: sync 2024-09-17T07:19:46.131 INFO:tasks.workunit.client.0.smithi087.stdout:9/84: sync 2024-09-17T07:19:46.132 INFO:tasks.workunit.client.0.smithi087.stdout:8/130: unlink d1/d7/d9/l12 0 2024-09-17T07:19:46.132 INFO:tasks.workunit.client.0.smithi087.stdout:9/85: readlink d3/d4/da/lf 0 2024-09-17T07:19:46.136 INFO:tasks.workunit.client.1.smithi139.stdout:2/105: dwrite d0/fa [4194304,4194304] 0 2024-09-17T07:19:46.136 INFO:tasks.workunit.client.1.smithi139.stdout:9/79: fdatasync dc/f10 0 2024-09-17T07:19:46.137 INFO:tasks.workunit.client.0.smithi087.stdout:8/131: symlink d1/d7/d9/d19/d1b/l28 0 2024-09-17T07:19:46.138 INFO:tasks.workunit.client.1.smithi139.stdout:9/80: write f7 [2460671,44641] 0 2024-09-17T07:19:46.139 INFO:tasks.workunit.client.1.smithi139.stdout:2/106: dread - d0/dc/f20 zero size 2024-09-17T07:19:46.139 INFO:tasks.workunit.client.1.smithi139.stdout:4/46: dread d0/d1/f9 [0,4194304] 0 2024-09-17T07:19:46.140 INFO:tasks.workunit.client.0.smithi087.stdout:2/191: write d2/d7/dd/d10/f1d [588406,45251] 0 2024-09-17T07:19:46.140 INFO:tasks.workunit.client.0.smithi087.stdout:5/235: rmdir d5/d12 39 2024-09-17T07:19:46.140 INFO:tasks.workunit.client.1.smithi139.stdout:4/47: stat d0 0 2024-09-17T07:19:46.141 INFO:tasks.workunit.client.1.smithi139.stdout:9/81: write f6 [3338335,249] 0 2024-09-17T07:19:46.144 INFO:tasks.workunit.client.0.smithi087.stdout:6/247: creat d1/d6/d1a/d2c/f51 x:0 0 0 2024-09-17T07:19:46.145 INFO:tasks.workunit.client.1.smithi139.stdout:7/15: write f3 [2035031,43578] 0 2024-09-17T07:19:46.145 INFO:tasks.workunit.client.1.smithi139.stdout:2/107: mkdir d0/de/d22 0 2024-09-17T07:19:46.145 INFO:tasks.workunit.client.0.smithi087.stdout:8/132: creat d1/d10/f29 x:0 0 0 2024-09-17T07:19:46.145 INFO:tasks.workunit.client.0.smithi087.stdout:0/173: dwrite db/ff [0,4194304] 0 2024-09-17T07:19:46.147 INFO:tasks.workunit.client.1.smithi139.stdout:7/16: chown f3 3361 1 2024-09-17T07:19:46.149 INFO:tasks.workunit.client.1.smithi139.stdout:2/108: readlink d0/de/df/l16 0 2024-09-17T07:19:46.154 INFO:tasks.workunit.client.1.smithi139.stdout:9/82: dwrite dc/f10 [4194304,4194304] 0 2024-09-17T07:19:46.154 INFO:tasks.workunit.client.1.smithi139.stdout:4/48: dread d0/f5 [0,4194304] 0 2024-09-17T07:19:46.155 INFO:tasks.workunit.client.0.smithi087.stdout:1/153: rename d2/dc/d26 to d2/d3d 0 2024-09-17T07:19:46.155 INFO:tasks.workunit.client.1.smithi139.stdout:7/17: dread f3 [0,4194304] 0 2024-09-17T07:19:46.156 INFO:tasks.workunit.client.1.smithi139.stdout:2/109: creat d0/dc/d15/f23 x:0 0 0 2024-09-17T07:19:46.156 INFO:tasks.workunit.client.0.smithi087.stdout:2/192: unlink d2/d7/dd/ff 0 2024-09-17T07:19:46.158 INFO:tasks.workunit.client.1.smithi139.stdout:4/49: creat d0/d1/fd x:0 0 0 2024-09-17T07:19:46.158 INFO:tasks.workunit.client.0.smithi087.stdout:7/141: creat d0/f2e x:0 0 0 2024-09-17T07:19:46.158 INFO:tasks.workunit.client.1.smithi139.stdout:7/18: mknod c4 0 2024-09-17T07:19:46.159 INFO:tasks.workunit.client.1.smithi139.stdout:4/50: stat d0/d1/cc 0 2024-09-17T07:19:46.159 INFO:tasks.workunit.client.0.smithi087.stdout:3/121: rename d6/d20 to d6/d1b/d2b 0 2024-09-17T07:19:46.161 INFO:tasks.workunit.client.0.smithi087.stdout:1/154: creat d2/d1a/f3e x:0 0 0 2024-09-17T07:19:46.161 INFO:tasks.workunit.client.1.smithi139.stdout:9/83: creat dc/d11/f16 x:0 0 0 2024-09-17T07:19:46.164 INFO:tasks.workunit.client.0.smithi087.stdout:5/236: mknod d5/d12/d14/c55 0 2024-09-17T07:19:46.167 INFO:tasks.workunit.client.1.smithi139.stdout:9/84: creat dc/d11/d15/f17 x:0 0 0 2024-09-17T07:19:46.168 INFO:tasks.workunit.client.0.smithi087.stdout:4/132: dread d2/d5/f8 [4194304,4194304] 0 2024-09-17T07:19:46.170 INFO:tasks.workunit.client.0.smithi087.stdout:7/142: symlink d0/d3/d23/d17/l2f 0 2024-09-17T07:19:46.171 INFO:tasks.workunit.client.0.smithi087.stdout:7/143: rename d0 to d0/d3/d23/d30 22 2024-09-17T07:19:46.171 INFO:tasks.workunit.client.0.smithi087.stdout:3/122: write d6/fc [1493644,129123] 0 2024-09-17T07:19:46.171 INFO:tasks.workunit.client.1.smithi139.stdout:7/19: dwrite f3 [0,4194304] 0 2024-09-17T07:19:46.172 INFO:tasks.workunit.client.0.smithi087.stdout:1/155: mknod d2/d14/c3f 0 2024-09-17T07:19:46.174 INFO:tasks.workunit.client.0.smithi087.stdout:7/144: write d0/d3/f2a [355704,3521] 0 2024-09-17T07:19:46.176 INFO:tasks.workunit.client.0.smithi087.stdout:9/86: write d3/fc [2987136,129455] 0 2024-09-17T07:19:46.177 INFO:tasks.workunit.client.1.smithi139.stdout:9/85: dread f7 [4194304,4194304] 0 2024-09-17T07:19:46.179 INFO:tasks.workunit.client.1.smithi139.stdout:5/14: write f3 [1622638,130712] 0 2024-09-17T07:19:46.180 INFO:tasks.workunit.client.0.smithi087.stdout:9/87: chown d3/d4/c5 3 1 2024-09-17T07:19:46.181 INFO:tasks.workunit.client.0.smithi087.stdout:6/248: link d1/f18 d1/d6/d1a/d2c/f52 0 2024-09-17T07:19:46.181 INFO:tasks.workunit.client.1.smithi139.stdout:2/110: truncate d0/fb 1561055 0 2024-09-17T07:19:46.181 INFO:tasks.workunit.client.1.smithi139.stdout:5/15: chown l2 10 1 2024-09-17T07:19:46.183 INFO:tasks.workunit.client.0.smithi087.stdout:4/133: rename d2/d22/d27 to d2/d22/d2c 0 2024-09-17T07:19:46.184 INFO:tasks.workunit.client.0.smithi087.stdout:3/123: dread d6/f12 [0,4194304] 0 2024-09-17T07:19:46.185 INFO:tasks.workunit.client.1.smithi139.stdout:9/86: rename f6 to dc/d11/d15/f18 0 2024-09-17T07:19:46.185 INFO:tasks.workunit.client.1.smithi139.stdout:4/51: truncate d0/d1/f9 3015769 0 2024-09-17T07:19:46.187 INFO:tasks.workunit.client.1.smithi139.stdout:9/87: rename dc to dc/d11/d15/d19 22 2024-09-17T07:19:46.188 INFO:tasks.workunit.client.0.smithi087.stdout:1/156: creat d2/dc/f40 x:0 0 0 2024-09-17T07:19:46.188 INFO:tasks.workunit.client.0.smithi087.stdout:7/145: dwrite d0/d3/d23/d17/f1e [0,4194304] 0 2024-09-17T07:19:46.188 INFO:tasks.workunit.client.0.smithi087.stdout:5/237: mkdir d5/d12/d56 0 2024-09-17T07:19:46.189 INFO:tasks.workunit.client.1.smithi139.stdout:4/52: mknod d0/db/ce 0 2024-09-17T07:19:46.190 INFO:tasks.workunit.client.0.smithi087.stdout:8/133: getdents d1/d7/d9/d19/d1b/d18 0 2024-09-17T07:19:46.191 INFO:tasks.workunit.client.1.smithi139.stdout:9/88: symlink dc/d11/d15/l1a 0 2024-09-17T07:19:46.192 INFO:tasks.workunit.client.1.smithi139.stdout:4/53: symlink d0/lf 0 2024-09-17T07:19:46.193 INFO:tasks.workunit.client.1.smithi139.stdout:4/54: stat d0/f5 0 2024-09-17T07:19:46.194 INFO:tasks.workunit.client.1.smithi139.stdout:7/20: fsync f3 0 2024-09-17T07:19:46.195 INFO:tasks.workunit.client.0.smithi087.stdout:5/238: dread d5/f15 [0,4194304] 0 2024-09-17T07:19:46.195 INFO:tasks.workunit.client.1.smithi139.stdout:7/21: rmdir - no directory 2024-09-17T07:19:46.196 INFO:tasks.workunit.client.0.smithi087.stdout:3/124: dwrite d6/fc [0,4194304] 0 2024-09-17T07:19:46.197 INFO:tasks.workunit.client.1.smithi139.stdout:9/89: creat dc/d11/f1b x:0 0 0 2024-09-17T07:19:46.197 INFO:tasks.workunit.client.1.smithi139.stdout:5/16: dwrite f3 [0,4194304] 0 2024-09-17T07:19:46.200 INFO:tasks.workunit.client.1.smithi139.stdout:7/22: mkdir d5 0 2024-09-17T07:19:46.200 INFO:tasks.workunit.client.0.smithi087.stdout:1/157: symlink d2/d14/l41 0 2024-09-17T07:19:46.200 INFO:tasks.workunit.client.1.smithi139.stdout:2/111: dwrite d0/d7/fd [0,4194304] 0 2024-09-17T07:19:46.201 INFO:tasks.workunit.client.0.smithi087.stdout:7/146: write d0/d3/d23/f2b [3241880,19827] 0 2024-09-17T07:19:46.201 INFO:tasks.workunit.client.1.smithi139.stdout:9/90: readlink dc/d11/d15/l1a 0 2024-09-17T07:19:46.202 INFO:tasks.workunit.client.1.smithi139.stdout:2/112: fdatasync d0/fa 0 2024-09-17T07:19:46.203 INFO:tasks.workunit.client.0.smithi087.stdout:1/158: write d2/f2d [1424807,69957] 0 2024-09-17T07:19:46.204 INFO:tasks.workunit.client.1.smithi139.stdout:4/55: write d0/f4 [1293259,73830] 0 2024-09-17T07:19:46.204 INFO:tasks.workunit.client.1.smithi139.stdout:5/17: write f3 [1782068,31600] 0 2024-09-17T07:19:46.204 INFO:tasks.workunit.client.0.smithi087.stdout:9/88: symlink d3/d4/da/d1c/d1e/l20 0 2024-09-17T07:19:46.206 INFO:tasks.workunit.client.0.smithi087.stdout:2/193: dwrite d2/f16 [0,4194304] 0 2024-09-17T07:19:46.207 INFO:tasks.workunit.client.1.smithi139.stdout:5/18: chown l2 4562550 1 2024-09-17T07:19:46.207 INFO:tasks.workunit.client.1.smithi139.stdout:5/19: rename d4 to d4/d5 22 2024-09-17T07:19:46.207 INFO:tasks.workunit.client.1.smithi139.stdout:7/23: unlink f3 0 2024-09-17T07:19:46.209 INFO:tasks.workunit.client.1.smithi139.stdout:2/113: mknod d0/c24 0 2024-09-17T07:19:46.213 INFO:tasks.workunit.client.1.smithi139.stdout:2/114: write d0/f5 [2755640,105180] 0 2024-09-17T07:19:46.215 INFO:tasks.workunit.client.1.smithi139.stdout:7/24: symlink d5/l6 0 2024-09-17T07:19:46.215 INFO:tasks.workunit.client.0.smithi087.stdout:3/125: dread d6/d15/f19 [0,4194304] 0 2024-09-17T07:19:46.216 INFO:tasks.workunit.client.0.smithi087.stdout:7/147: unlink d0/fa 0 2024-09-17T07:19:46.218 INFO:tasks.workunit.client.0.smithi087.stdout:2/194: dwrite d2/f37 [0,4194304] 0 2024-09-17T07:19:46.222 INFO:tasks.workunit.client.0.smithi087.stdout:4/134: rename d2/d5/d1f/d2b to d2/d5/db/d2d 0 2024-09-17T07:19:46.223 INFO:tasks.workunit.client.1.smithi139.stdout:9/91: dwrite f4 [4194304,4194304] 0 2024-09-17T07:19:46.227 INFO:tasks.workunit.client.0.smithi087.stdout:6/249: getdents d1/d6/d1a/d2c 0 2024-09-17T07:19:46.227 INFO:tasks.workunit.client.1.smithi139.stdout:5/20: dwrite f3 [0,4194304] 0 2024-09-17T07:19:46.227 INFO:tasks.workunit.client.1.smithi139.stdout:9/92: mknod dc/d11/d15/c1c 0 2024-09-17T07:19:46.228 INFO:tasks.workunit.client.0.smithi087.stdout:5/239: link d5/d18/d20/f1e d5/d18/d20/d2f/f57 0 2024-09-17T07:19:46.230 INFO:tasks.workunit.client.0.smithi087.stdout:5/240: chown d5/f15 120456753 1 2024-09-17T07:19:46.231 INFO:tasks.workunit.client.0.smithi087.stdout:8/134: rename d1/f8 to d1/f2a 0 2024-09-17T07:19:46.233 INFO:tasks.workunit.client.0.smithi087.stdout:7/148: mkdir d0/d3/d10/d31 0 2024-09-17T07:19:46.234 INFO:tasks.workunit.client.0.smithi087.stdout:3/126: mknod d6/d1b/c2c 0 2024-09-17T07:19:46.235 INFO:tasks.workunit.client.0.smithi087.stdout:2/195: unlink d2/d7/f22 0 2024-09-17T07:19:46.237 INFO:tasks.workunit.client.1.smithi139.stdout:2/115: dwrite d0/d7/d1a/f1e [0,4194304] 0 2024-09-17T07:19:46.238 INFO:tasks.workunit.client.0.smithi087.stdout:7/149: dread - d0/d3/f2c zero size 2024-09-17T07:19:46.239 INFO:tasks.workunit.client.0.smithi087.stdout:3/127: dread - d6/d16/f26 zero size 2024-09-17T07:19:46.239 INFO:tasks.workunit.client.0.smithi087.stdout:7/150: chown d0/d3 622737380 1 2024-09-17T07:19:46.241 INFO:tasks.workunit.client.1.smithi139.stdout:4/56: getdents d0 0 2024-09-17T07:19:46.241 INFO:tasks.workunit.client.0.smithi087.stdout:4/135: rename d2/d5/f16 to d2/d5/db/d21/f2e 0 2024-09-17T07:19:46.243 INFO:tasks.workunit.client.1.smithi139.stdout:9/93: dread f4 [0,4194304] 0 2024-09-17T07:19:46.245 INFO:tasks.workunit.client.0.smithi087.stdout:6/250: dwrite d1/d6/d1a/d2c/f51 [0,4194304] 0 2024-09-17T07:19:46.247 INFO:tasks.workunit.client.0.smithi087.stdout:6/251: chown d1/l8 48265 1 2024-09-17T07:19:46.247 INFO:tasks.workunit.client.0.smithi087.stdout:6/252: chown d1/l9 1 1 2024-09-17T07:19:46.249 INFO:tasks.workunit.client.1.smithi139.stdout:9/94: symlink dc/d11/l1d 0 2024-09-17T07:19:46.250 INFO:tasks.workunit.client.0.smithi087.stdout:6/253: write d1/d6/d1a/f23 [128289,16536] 0 2024-09-17T07:19:46.250 INFO:tasks.workunit.client.0.smithi087.stdout:6/254: readlink d1/l9 0 2024-09-17T07:19:46.252 INFO:tasks.workunit.client.1.smithi139.stdout:1/36: sync 2024-09-17T07:19:46.252 INFO:tasks.workunit.client.0.smithi087.stdout:1/159: link d2/d14/l41 d2/da/l42 0 2024-09-17T07:19:46.253 INFO:tasks.workunit.client.0.smithi087.stdout:4/136: mkdir d2/d5/db/d21/d2f 0 2024-09-17T07:19:46.254 INFO:tasks.workunit.client.1.smithi139.stdout:2/116: rmdir d0/de/d22 0 2024-09-17T07:19:46.255 INFO:tasks.workunit.client.0.smithi087.stdout:4/137: write d2/d5/db/f29 [495590,127227] 0 2024-09-17T07:19:46.256 INFO:tasks.workunit.client.1.smithi139.stdout:9/95: mkdir dc/d11/d15/d1e 0 2024-09-17T07:19:46.259 INFO:tasks.workunit.client.0.smithi087.stdout:1/160: mkdir d2/d14/dd/d43 0 2024-09-17T07:19:46.259 INFO:tasks.workunit.client.1.smithi139.stdout:7/25: dread f2 [0,4194304] 0 2024-09-17T07:19:46.260 INFO:tasks.workunit.client.0.smithi087.stdout:7/151: dread d0/d3/f4 [0,4194304] 0 2024-09-17T07:19:46.262 INFO:tasks.workunit.client.1.smithi139.stdout:1/37: dread d2/f7 [0,4194304] 0 2024-09-17T07:19:46.263 INFO:tasks.workunit.client.0.smithi087.stdout:8/135: rename d1/d10 to d1/d2b 0 2024-09-17T07:19:46.265 INFO:tasks.workunit.client.0.smithi087.stdout:2/196: link d2/l6 d2/d7/dd/l3b 0 2024-09-17T07:19:46.266 INFO:tasks.workunit.client.0.smithi087.stdout:5/241: getdents d5/d8/d1f/d4e 0 2024-09-17T07:19:46.266 INFO:tasks.workunit.client.1.smithi139.stdout:9/96: dread f4 [4194304,4194304] 0 2024-09-17T07:19:46.267 INFO:tasks.workunit.client.1.smithi139.stdout:1/38: mknod d2/cb 0 2024-09-17T07:19:46.268 INFO:tasks.workunit.client.1.smithi139.stdout:9/97: truncate fb 1976376 0 2024-09-17T07:19:46.269 INFO:tasks.workunit.client.0.smithi087.stdout:9/89: dread f2 [0,4194304] 0 2024-09-17T07:19:46.269 INFO:tasks.workunit.client.1.smithi139.stdout:1/39: chown d2/cb 3489 1 2024-09-17T07:19:46.270 INFO:tasks.workunit.client.1.smithi139.stdout:2/117: dwrite d0/f6 [0,4194304] 0 2024-09-17T07:19:46.272 INFO:tasks.workunit.client.1.smithi139.stdout:5/21: truncate f3 3355835 0 2024-09-17T07:19:46.272 INFO:tasks.workunit.client.0.smithi087.stdout:3/128: rename d6/d16/l28 to d6/l2d 0 2024-09-17T07:19:46.275 INFO:tasks.workunit.client.1.smithi139.stdout:2/118: mkdir d0/de/d25 0 2024-09-17T07:19:46.275 INFO:tasks.workunit.client.0.smithi087.stdout:5/242: creat d5/d8/d1f/f58 x:0 0 0 2024-09-17T07:19:46.278 INFO:tasks.workunit.client.1.smithi139.stdout:9/98: link dc/ld dc/l1f 0 2024-09-17T07:19:46.279 INFO:tasks.workunit.client.0.smithi087.stdout:3/129: write d6/d15/f29 [218567,70282] 0 2024-09-17T07:19:46.279 INFO:tasks.workunit.client.0.smithi087.stdout:5/243: dread d5/d12/f34 [0,4194304] 0 2024-09-17T07:19:46.280 INFO:tasks.workunit.client.1.smithi139.stdout:5/22: creat d4/f6 x:0 0 0 2024-09-17T07:19:46.281 INFO:tasks.workunit.client.0.smithi087.stdout:9/90: creat d3/d4/da/d1c/f21 x:0 0 0 2024-09-17T07:19:46.281 INFO:tasks.workunit.client.0.smithi087.stdout:7/152: dwrite d0/f6 [4194304,4194304] 0 2024-09-17T07:19:46.282 INFO:tasks.workunit.client.1.smithi139.stdout:9/99: creat dc/f20 x:0 0 0 2024-09-17T07:19:46.284 INFO:tasks.workunit.client.1.smithi139.stdout:2/119: dwrite d0/dc/d15/f17 [0,4194304] 0 2024-09-17T07:19:46.285 INFO:tasks.workunit.client.1.smithi139.stdout:9/100: write dc/d11/f1b [834582,121861] 0 2024-09-17T07:19:46.286 INFO:tasks.workunit.client.0.smithi087.stdout:5/244: mkdir d5/d18/d59 0 2024-09-17T07:19:46.288 INFO:tasks.workunit.client.1.smithi139.stdout:5/23: symlink d4/l7 0 2024-09-17T07:19:46.288 INFO:tasks.workunit.client.0.smithi087.stdout:4/138: rename d2/d5/d1f/c19 to d2/d22/d2c/c30 0 2024-09-17T07:19:46.288 INFO:tasks.workunit.client.0.smithi087.stdout:4/139: readlink d2/d5/le 0 2024-09-17T07:19:46.289 INFO:tasks.workunit.client.0.smithi087.stdout:7/153: rmdir d0/d3/d10 39 2024-09-17T07:19:46.291 INFO:tasks.workunit.client.0.smithi087.stdout:3/130: unlink d6/c1a 0 2024-09-17T07:19:46.291 INFO:tasks.workunit.client.1.smithi139.stdout:9/101: chown dc/d11/l1d 15 1 2024-09-17T07:19:46.293 INFO:tasks.workunit.client.0.smithi087.stdout:9/91: mkdir d3/d4/d6/d8/d22 0 2024-09-17T07:19:46.293 INFO:tasks.workunit.client.0.smithi087.stdout:8/136: getdents d1/d2b 0 2024-09-17T07:19:46.295 INFO:tasks.workunit.client.1.smithi139.stdout:2/120: mknod d0/de/c26 0 2024-09-17T07:19:46.295 INFO:tasks.workunit.client.0.smithi087.stdout:1/161: rename d2/d14/dd/c25 to d2/d1a/d33/c44 0 2024-09-17T07:19:46.297 INFO:tasks.workunit.client.1.smithi139.stdout:2/121: write d0/d7/d1a/f1e [3531008,25116] 0 2024-09-17T07:19:46.298 INFO:tasks.workunit.client.1.smithi139.stdout:2/122: stat d0/dc 0 2024-09-17T07:19:46.299 INFO:tasks.workunit.client.0.smithi087.stdout:2/197: getdents d2/d12 0 2024-09-17T07:19:46.300 INFO:tasks.workunit.client.0.smithi087.stdout:9/92: mknod d3/d4/d6/c23 0 2024-09-17T07:19:46.301 INFO:tasks.workunit.client.0.smithi087.stdout:5/245: rename d5/d12/f34 to d5/d12/d4d/f5a 0 2024-09-17T07:19:46.303 INFO:tasks.workunit.client.0.smithi087.stdout:5/246: stat d5/d18/l1a 0 2024-09-17T07:19:46.303 INFO:tasks.workunit.client.0.smithi087.stdout:9/93: write d3/d4/d6/f13 [1930887,27790] 0 2024-09-17T07:19:46.303 INFO:tasks.workunit.client.0.smithi087.stdout:4/140: unlink d2/d5/db/f1b 0 2024-09-17T07:19:46.303 INFO:tasks.workunit.client.0.smithi087.stdout:7/154: dread d0/d3/f2a [0,4194304] 0 2024-09-17T07:19:46.304 INFO:tasks.workunit.client.0.smithi087.stdout:3/131: dwrite d6/d16/f26 [0,4194304] 0 2024-09-17T07:19:46.305 INFO:tasks.workunit.client.0.smithi087.stdout:2/198: write d2/d7/dd/f27 [161164,121104] 0 2024-09-17T07:19:46.306 INFO:tasks.workunit.client.1.smithi139.stdout:2/123: dwrite d0/f6 [0,4194304] 0 2024-09-17T07:19:46.307 INFO:tasks.workunit.client.0.smithi087.stdout:1/162: write d2/d3d/f21 [1437452,102280] 0 2024-09-17T07:19:46.309 INFO:tasks.workunit.client.0.smithi087.stdout:5/247: chown d5/l4c 300 1 2024-09-17T07:19:46.310 INFO:tasks.workunit.client.1.smithi139.stdout:2/124: getdents d0/de/d11/d12 0 2024-09-17T07:19:46.314 INFO:tasks.workunit.client.0.smithi087.stdout:2/199: mknod d2/d7/dd/c3c 0 2024-09-17T07:19:46.314 INFO:tasks.workunit.client.0.smithi087.stdout:3/132: readlink d6/d1b/l1e 0 2024-09-17T07:19:46.315 INFO:tasks.workunit.client.0.smithi087.stdout:9/94: write f2 [123885,90336] 0 2024-09-17T07:19:46.316 INFO:tasks.workunit.client.0.smithi087.stdout:5/248: fdatasync d5/d18/f4a 0 2024-09-17T07:19:46.316 INFO:tasks.workunit.client.0.smithi087.stdout:4/141: write d2/d5/d1f/f1e [805424,54306] 0 2024-09-17T07:19:46.318 INFO:tasks.workunit.client.0.smithi087.stdout:7/155: mkdir d0/d3/d10/d32 0 2024-09-17T07:19:46.319 INFO:tasks.workunit.client.0.smithi087.stdout:8/137: dwrite d1/d7/d9/d19/d1b/f1c [0,4194304] 0 2024-09-17T07:19:46.323 INFO:tasks.workunit.client.0.smithi087.stdout:1/163: truncate d2/d3d/f28 313540 0 2024-09-17T07:19:46.325 INFO:tasks.workunit.client.0.smithi087.stdout:2/200: chown d2/d15 253483603 1 2024-09-17T07:19:46.326 INFO:tasks.workunit.client.0.smithi087.stdout:2/201: chown d2/d24/d36/f38 5482076 1 2024-09-17T07:19:46.327 INFO:tasks.workunit.client.0.smithi087.stdout:8/138: chown d1/l5 27 1 2024-09-17T07:19:46.333 INFO:tasks.workunit.client.0.smithi087.stdout:9/95: symlink d3/d4/d6/d8/d12/l24 0 2024-09-17T07:19:46.334 INFO:tasks.workunit.client.0.smithi087.stdout:4/142: dread d2/d5/d1f/f1e [0,4194304] 0 2024-09-17T07:19:46.334 INFO:tasks.workunit.client.0.smithi087.stdout:7/156: fdatasync d0/fc 0 2024-09-17T07:19:46.335 INFO:tasks.workunit.client.0.smithi087.stdout:8/139: symlink d1/d2b/l2c 0 2024-09-17T07:19:46.336 INFO:tasks.workunit.client.0.smithi087.stdout:4/143: fdatasync d2/d5/db/d21/f24 0 2024-09-17T07:19:46.338 INFO:tasks.workunit.client.0.smithi087.stdout:9/96: mkdir d3/d25 0 2024-09-17T07:19:46.339 INFO:tasks.workunit.client.0.smithi087.stdout:9/97: write d3/fc [1902406,2400] 0 2024-09-17T07:19:46.340 INFO:tasks.workunit.client.1.smithi139.stdout:9/102: dread dc/d11/f1b [0,4194304] 0 2024-09-17T07:19:46.342 INFO:tasks.workunit.client.1.smithi139.stdout:2/125: dread d0/d7/f19 [0,4194304] 0 2024-09-17T07:19:46.343 INFO:tasks.workunit.client.0.smithi087.stdout:9/98: creat d3/d4/f26 x:0 0 0 2024-09-17T07:19:46.345 INFO:tasks.workunit.client.1.smithi139.stdout:5/24: truncate f3 967088 0 2024-09-17T07:19:46.345 INFO:tasks.workunit.client.0.smithi087.stdout:7/157: creat d0/d3/d10/d31/f33 x:0 0 0 2024-09-17T07:19:46.345 INFO:tasks.workunit.client.0.smithi087.stdout:1/164: dread d2/d14/dd/ff [0,4194304] 0 2024-09-17T07:19:46.346 INFO:tasks.workunit.client.1.smithi139.stdout:7/26: dwrite f2 [0,4194304] 0 2024-09-17T07:19:46.347 INFO:tasks.workunit.client.1.smithi139.stdout:2/126: chown d0/de/c26 1263 1 2024-09-17T07:19:46.348 INFO:tasks.workunit.client.0.smithi087.stdout:1/165: chown d2/d14/dd 1 1 2024-09-17T07:19:46.348 INFO:tasks.workunit.client.0.smithi087.stdout:9/99: write d3/d4/da/d1c/f21 [139544,83825] 0 2024-09-17T07:19:46.348 INFO:tasks.workunit.client.1.smithi139.stdout:4/57: dwrite d0/f7 [0,4194304] 0 2024-09-17T07:19:46.350 INFO:tasks.workunit.client.1.smithi139.stdout:2/127: write d0/fa [6289068,103572] 0 2024-09-17T07:19:46.351 INFO:tasks.workunit.client.0.smithi087.stdout:2/202: truncate d2/f25 2750899 0 2024-09-17T07:19:46.352 INFO:tasks.workunit.client.1.smithi139.stdout:2/128: fsync d0/dc/f20 0 2024-09-17T07:19:46.354 INFO:tasks.workunit.client.0.smithi087.stdout:7/158: creat d0/d3/d23/d17/f34 x:0 0 0 2024-09-17T07:19:46.357 INFO:tasks.workunit.client.1.smithi139.stdout:4/58: dwrite d0/f4 [0,4194304] 0 2024-09-17T07:19:46.362 INFO:tasks.workunit.client.0.smithi087.stdout:3/133: dwrite d6/f12 [0,4194304] 0 2024-09-17T07:19:46.363 INFO:tasks.workunit.client.0.smithi087.stdout:7/159: write d0/f2 [2646909,113839] 0 2024-09-17T07:19:46.363 INFO:tasks.workunit.client.0.smithi087.stdout:4/144: dwrite d2/d5/db/d21/f2e [0,4194304] 0 2024-09-17T07:19:46.365 INFO:tasks.workunit.client.0.smithi087.stdout:8/140: truncate d1/d7/f13 341740 0 2024-09-17T07:19:46.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:46 smithi139 ceph-mon[34403]: mgrmap e24: smithi139.tuqnpn(active, since 5s), standbys: smithi087.vuvjer 2024-09-17T07:19:46.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:46 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "mgr metadata", "who": "smithi087.vuvjer", "id": "smithi087.vuvjer"}]: dispatch 2024-09-17T07:19:46.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:46 smithi139 ceph-mon[34403]: pgmap v6: 65 pgs: 65 active+clean; 285 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-09-17T07:19:46.366 INFO:tasks.workunit.client.0.smithi087.stdout:3/134: chown d6/d16/f26 1611565 1 2024-09-17T07:19:46.368 INFO:tasks.workunit.client.0.smithi087.stdout:5/249: dwrite d5/d8/f10 [0,4194304] 0 2024-09-17T07:19:46.371 INFO:tasks.workunit.client.0.smithi087.stdout:3/135: write d6/d15/f29 [751305,87747] 0 2024-09-17T07:19:46.372 INFO:tasks.workunit.client.0.smithi087.stdout:3/136: write f4 [6008567,109360] 0 2024-09-17T07:19:46.373 INFO:tasks.workunit.client.0.smithi087.stdout:9/100: rmdir d3/d4/da 39 2024-09-17T07:19:46.375 INFO:tasks.workunit.client.0.smithi087.stdout:1/166: rename d2/d1a/d33 to d2/d3d/d45 0 2024-09-17T07:19:46.375 INFO:tasks.workunit.client.0.smithi087.stdout:2/203: symlink d2/d24/d36/l3d 0 2024-09-17T07:19:46.375 INFO:tasks.workunit.client.0.smithi087.stdout:3/137: rename d6/d15 to d6/d15/d2e 22 2024-09-17T07:19:46.376 INFO:tasks.workunit.client.0.smithi087.stdout:1/167: stat d2/dc 0 2024-09-17T07:19:46.378 INFO:tasks.workunit.client.0.smithi087.stdout:4/145: creat d2/d22/d2c/f31 x:0 0 0 2024-09-17T07:19:46.378 INFO:tasks.workunit.client.0.smithi087.stdout:5/250: unlink d5/d12/d4d/f49 0 2024-09-17T07:19:46.381 INFO:tasks.workunit.client.0.smithi087.stdout:9/101: mknod d3/d4/d6/c27 0 2024-09-17T07:19:46.382 INFO:tasks.workunit.client.0.smithi087.stdout:8/141: creat d1/d7/f2d x:0 0 0 2024-09-17T07:19:46.382 INFO:tasks.workunit.client.0.smithi087.stdout:3/138: mknod d6/d15/c2f 0 2024-09-17T07:19:46.384 INFO:tasks.workunit.client.0.smithi087.stdout:2/204: symlink d2/d24/l3e 0 2024-09-17T07:19:46.386 INFO:tasks.workunit.client.0.smithi087.stdout:8/142: readlink d1/d2b/l2c 0 2024-09-17T07:19:46.390 INFO:tasks.workunit.client.0.smithi087.stdout:9/102: readlink d3/d4/da/d1c/d1e/l20 0 2024-09-17T07:19:46.391 INFO:tasks.workunit.client.0.smithi087.stdout:3/139: unlink f4 0 2024-09-17T07:19:46.392 INFO:tasks.workunit.client.0.smithi087.stdout:1/168: dwrite d2/dc/f40 [0,4194304] 0 2024-09-17T07:19:46.394 INFO:tasks.workunit.client.0.smithi087.stdout:4/146: dwrite d2/f25 [0,4194304] 0 2024-09-17T07:19:46.395 INFO:tasks.workunit.client.0.smithi087.stdout:5/251: mkdir d5/d12/d56/d5b 0 2024-09-17T07:19:46.397 INFO:tasks.workunit.client.0.smithi087.stdout:1/169: chown d2/d14/dd/d43 60784011 1 2024-09-17T07:19:46.397 INFO:tasks.workunit.client.0.smithi087.stdout:9/103: creat d3/f28 x:0 0 0 2024-09-17T07:19:46.400 INFO:tasks.workunit.client.0.smithi087.stdout:7/160: getdents d0/d3 0 2024-09-17T07:19:46.404 INFO:tasks.workunit.client.0.smithi087.stdout:4/147: creat d2/f32 x:0 0 0 2024-09-17T07:19:46.407 INFO:tasks.workunit.client.0.smithi087.stdout:8/143: dwrite d1/d2b/f29 [0,4194304] 0 2024-09-17T07:19:46.410 INFO:tasks.workunit.client.0.smithi087.stdout:4/148: dread - d2/d5/f2a zero size 2024-09-17T07:19:46.411 INFO:tasks.workunit.client.0.smithi087.stdout:9/104: rename d3/d4/d16 to d3/d4/d16/d29 22 2024-09-17T07:19:46.413 INFO:tasks.workunit.client.0.smithi087.stdout:7/161: link d0/f28 d0/d3/d23/d2d/f35 0 2024-09-17T07:19:46.414 INFO:tasks.workunit.client.0.smithi087.stdout:9/105: readlink d3/d4/l10 0 2024-09-17T07:19:46.415 INFO:tasks.workunit.client.0.smithi087.stdout:8/144: fsync d1/d7/d9/d19/d1b/f1c 0 2024-09-17T07:19:46.415 INFO:tasks.workunit.client.0.smithi087.stdout:2/205: dwrite d2/d15/f21 [0,4194304] 0 2024-09-17T07:19:46.416 INFO:tasks.workunit.client.0.smithi087.stdout:3/140: dwrite d6/f27 [0,4194304] 0 2024-09-17T07:19:46.422 INFO:tasks.workunit.client.0.smithi087.stdout:9/106: fdatasync d3/d4/d16/f1d 0 2024-09-17T07:19:46.422 INFO:tasks.workunit.client.0.smithi087.stdout:3/141: write d6/d16/f26 [3931246,33183] 0 2024-09-17T07:19:46.422 INFO:tasks.workunit.client.0.smithi087.stdout:7/162: mkdir d0/d36 0 2024-09-17T07:19:46.422 INFO:tasks.workunit.client.0.smithi087.stdout:7/163: fdatasync d0/f2e 0 2024-09-17T07:19:46.422 INFO:tasks.workunit.client.0.smithi087.stdout:3/142: chown d6/d15/c2f 134027467 1 2024-09-17T07:19:46.422 INFO:tasks.workunit.client.0.smithi087.stdout:2/206: readlink d2/d15/l2e 0 2024-09-17T07:19:46.422 INFO:tasks.workunit.client.0.smithi087.stdout:9/107: fsync d3/d4/f26 0 2024-09-17T07:19:46.422 INFO:tasks.workunit.client.0.smithi087.stdout:8/145: symlink d1/d2b/d21/l2e 0 2024-09-17T07:19:46.424 INFO:tasks.workunit.client.0.smithi087.stdout:9/108: readlink d3/d4/da/lf 0 2024-09-17T07:19:46.425 INFO:tasks.workunit.client.0.smithi087.stdout:3/143: write d6/f12 [1640712,123785] 0 2024-09-17T07:19:46.426 INFO:tasks.workunit.client.0.smithi087.stdout:9/109: chown d3/d4/d6/c27 18087739 1 2024-09-17T07:19:46.426 INFO:tasks.workunit.client.0.smithi087.stdout:7/164: mknod d0/d3/d23/d2d/c37 0 2024-09-17T07:19:46.428 INFO:tasks.workunit.client.0.smithi087.stdout:5/252: write d5/f15 [641007,62288] 0 2024-09-17T07:19:46.428 INFO:tasks.workunit.client.0.smithi087.stdout:2/207: mkdir d2/d7/d30/d3f 0 2024-09-17T07:19:46.429 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:46 smithi087 ceph-mon[27636]: mgrmap e24: smithi139.tuqnpn(active, since 5s), standbys: smithi087.vuvjer 2024-09-17T07:19:46.430 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:46 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "mgr metadata", "who": "smithi087.vuvjer", "id": "smithi087.vuvjer"}]: dispatch 2024-09-17T07:19:46.430 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:46 smithi087 ceph-mon[27636]: pgmap v6: 65 pgs: 65 active+clean; 285 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-09-17T07:19:46.430 INFO:tasks.workunit.client.0.smithi087.stdout:8/146: creat d1/d7/f2f x:0 0 0 2024-09-17T07:19:46.432 INFO:tasks.workunit.client.0.smithi087.stdout:2/208: mknod d2/d24/c40 0 2024-09-17T07:19:46.432 INFO:tasks.workunit.client.0.smithi087.stdout:8/147: write d1/d7/d9/fc [234376,4010] 0 2024-09-17T07:19:46.432 INFO:tasks.workunit.client.0.smithi087.stdout:7/165: creat d0/d3/d10/f38 x:0 0 0 2024-09-17T07:19:46.434 INFO:tasks.workunit.client.0.smithi087.stdout:4/149: getdents d2 0 2024-09-17T07:19:46.435 INFO:tasks.workunit.client.0.smithi087.stdout:2/209: chown d2/d7/dd/d10/f1d 7 1 2024-09-17T07:19:46.436 INFO:tasks.workunit.client.0.smithi087.stdout:3/144: dread d6/d15/f29 [0,4194304] 0 2024-09-17T07:19:46.436 INFO:tasks.workunit.client.0.smithi087.stdout:5/253: creat d5/d18/d20/d2f/f5c x:0 0 0 2024-09-17T07:19:46.437 INFO:tasks.workunit.client.0.smithi087.stdout:8/148: write d1/d7/f22 [904073,67080] 0 2024-09-17T07:19:46.445 INFO:tasks.workunit.client.0.smithi087.stdout:8/149: dread d1/d7/d9/d19/d1b/f1f [0,4194304] 0 2024-09-17T07:19:46.446 INFO:tasks.workunit.client.1.smithi139.stdout:6/110: sync 2024-09-17T07:19:46.446 INFO:tasks.workunit.client.1.smithi139.stdout:8/96: sync 2024-09-17T07:19:46.446 INFO:tasks.workunit.client.1.smithi139.stdout:0/38: sync 2024-09-17T07:19:46.446 INFO:tasks.workunit.client.1.smithi139.stdout:3/25: sync 2024-09-17T07:19:46.447 INFO:tasks.workunit.client.1.smithi139.stdout:3/26: stat c0 0 2024-09-17T07:19:46.447 INFO:tasks.workunit.client.1.smithi139.stdout:3/27: fdatasync f2 0 2024-09-17T07:19:46.448 INFO:tasks.workunit.client.0.smithi087.stdout:5/254: dread d5/d8/f3f [0,4194304] 0 2024-09-17T07:19:46.450 INFO:tasks.workunit.client.1.smithi139.stdout:3/28: dread f4 [0,4194304] 0 2024-09-17T07:19:46.450 INFO:tasks.workunit.client.1.smithi139.stdout:3/29: write f4 [3484709,11681] 0 2024-09-17T07:19:46.451 INFO:tasks.workunit.client.0.smithi087.stdout:7/166: dwrite d0/d3/d23/d17/f34 [0,4194304] 0 2024-09-17T07:19:46.451 INFO:tasks.workunit.client.0.smithi087.stdout:9/110: dread d3/fc [0,4194304] 0 2024-09-17T07:19:46.454 INFO:tasks.workunit.client.1.smithi139.stdout:3/30: fsync f4 0 2024-09-17T07:19:46.455 INFO:tasks.workunit.client.1.smithi139.stdout:3/31: fsync f2 0 2024-09-17T07:19:46.456 INFO:tasks.workunit.client.0.smithi087.stdout:9/111: dread - d3/f28 zero size 2024-09-17T07:19:46.456 INFO:tasks.workunit.client.0.smithi087.stdout:3/145: dwrite d6/d15/f29 [0,4194304] 0 2024-09-17T07:19:46.458 INFO:tasks.workunit.client.0.smithi087.stdout:9/112: dread - d3/f28 zero size 2024-09-17T07:19:46.461 INFO:tasks.workunit.client.0.smithi087.stdout:3/146: mkdir d6/d1b/d2b/d30 0 2024-09-17T07:19:46.464 INFO:tasks.workunit.client.1.smithi139.stdout:9/103: write dc/d11/f1b [115700,61170] 0 2024-09-17T07:19:46.465 INFO:tasks.workunit.client.1.smithi139.stdout:9/104: readlink dc/d11/l1d 0 2024-09-17T07:19:46.466 INFO:tasks.workunit.client.1.smithi139.stdout:5/25: rename l2 to d4/l8 0 2024-09-17T07:19:46.466 INFO:tasks.workunit.client.1.smithi139.stdout:6/111: rename db/d18/d1b to db/d18/d1b/d25 22 2024-09-17T07:19:46.467 INFO:tasks.workunit.client.0.smithi087.stdout:9/113: mkdir d3/d4/d6/d8/d22/d2a 0 2024-09-17T07:19:46.467 INFO:tasks.workunit.client.0.smithi087.stdout:9/114: stat d3/d4/d6/d8/d12 0 2024-09-17T07:19:46.467 INFO:tasks.workunit.client.0.smithi087.stdout:9/115: readlink d3/d4/l10 0 2024-09-17T07:19:46.467 INFO:tasks.workunit.client.0.smithi087.stdout:7/167: rename d0/d3/d23/d17/l1b to d0/d3/d23/d17/l39 0 2024-09-17T07:19:46.468 INFO:tasks.workunit.client.1.smithi139.stdout:4/59: rmdir d0 39 2024-09-17T07:19:46.468 INFO:tasks.workunit.client.1.smithi139.stdout:6/112: write db/f16 [3725289,110266] 0 2024-09-17T07:19:46.468 INFO:tasks.workunit.client.0.smithi087.stdout:3/147: dread d6/fa [0,4194304] 0 2024-09-17T07:19:46.469 INFO:tasks.workunit.client.1.smithi139.stdout:6/113: chown db/f16 88357690 1 2024-09-17T07:19:46.469 INFO:tasks.workunit.client.1.smithi139.stdout:8/97: unlink d0/l14 0 2024-09-17T07:19:46.471 INFO:tasks.workunit.client.1.smithi139.stdout:3/32: symlink d5/l8 0 2024-09-17T07:19:46.472 INFO:tasks.workunit.client.1.smithi139.stdout:7/27: symlink d5/l7 0 2024-09-17T07:19:46.473 INFO:tasks.workunit.client.1.smithi139.stdout:5/26: creat d4/f9 x:0 0 0 2024-09-17T07:19:46.474 INFO:tasks.workunit.client.0.smithi087.stdout:4/150: dread d2/f6 [0,4194304] 0 2024-09-17T07:19:46.474 INFO:tasks.workunit.client.0.smithi087.stdout:9/116: mknod d3/d4/d6/d8/d22/d2a/c2b 0 2024-09-17T07:19:46.475 INFO:tasks.workunit.client.1.smithi139.stdout:4/60: stat d0/d1/c3 0 2024-09-17T07:19:46.475 INFO:tasks.workunit.client.0.smithi087.stdout:4/151: rmdir d2 39 2024-09-17T07:19:46.476 INFO:tasks.workunit.client.1.smithi139.stdout:4/61: chown d0/d1/cc 0 1 2024-09-17T07:19:46.477 INFO:tasks.workunit.client.1.smithi139.stdout:3/33: symlink d5/l9 0 2024-09-17T07:19:46.478 INFO:tasks.workunit.client.1.smithi139.stdout:9/105: creat dc/d11/d15/d1e/f21 x:0 0 0 2024-09-17T07:19:46.480 INFO:tasks.workunit.client.1.smithi139.stdout:2/129: link d0/dc/d15/l1d d0/de/d11/l27 0 2024-09-17T07:19:46.481 INFO:tasks.workunit.client.0.smithi087.stdout:4/152: mknod d2/c33 0 2024-09-17T07:19:46.481 INFO:tasks.workunit.client.0.smithi087.stdout:8/150: dread d1/f2a [0,4194304] 0 2024-09-17T07:19:46.483 INFO:tasks.workunit.client.1.smithi139.stdout:6/114: dwrite db/d18/f1a [8388608,4194304] 0 2024-09-17T07:19:46.484 INFO:tasks.workunit.client.1.smithi139.stdout:4/62: unlink d0/d1/c3 0 2024-09-17T07:19:46.485 INFO:tasks.workunit.client.0.smithi087.stdout:4/153: fsync f1 0 2024-09-17T07:19:46.486 INFO:tasks.workunit.client.1.smithi139.stdout:3/34: write f4 [1991018,86233] 0 2024-09-17T07:19:46.487 INFO:tasks.workunit.client.0.smithi087.stdout:7/168: dwrite d0/f8 [0,4194304] 0 2024-09-17T07:19:46.488 INFO:tasks.workunit.client.1.smithi139.stdout:6/115: chown db/l10 7705574 1 2024-09-17T07:19:46.489 INFO:tasks.workunit.client.0.smithi087.stdout:4/154: dread - d2/f32 zero size 2024-09-17T07:19:46.489 INFO:tasks.workunit.client.0.smithi087.stdout:3/148: dwrite d6/d16/f26 [4194304,4194304] 0 2024-09-17T07:19:46.490 INFO:tasks.workunit.client.1.smithi139.stdout:7/28: dwrite f2 [0,4194304] 0 2024-09-17T07:19:46.491 INFO:tasks.workunit.client.0.smithi087.stdout:9/117: dwrite d3/f28 [0,4194304] 0 2024-09-17T07:19:46.492 INFO:tasks.workunit.client.0.smithi087.stdout:8/151: creat d1/d7/d9/d19/d1b/f30 x:0 0 0 2024-09-17T07:19:46.494 INFO:tasks.workunit.client.1.smithi139.stdout:3/35: write f2 [178797,110724] 0 2024-09-17T07:19:46.494 INFO:tasks.workunit.client.0.smithi087.stdout:3/149: truncate d6/fd 1146596 0 2024-09-17T07:19:46.495 INFO:tasks.workunit.client.1.smithi139.stdout:9/106: fsync f7 0 2024-09-17T07:19:46.497 INFO:tasks.workunit.client.1.smithi139.stdout:2/130: dread d0/f6 [0,4194304] 0 2024-09-17T07:19:46.497 INFO:tasks.workunit.client.1.smithi139.stdout:9/107: chown fb 317 1 2024-09-17T07:19:46.499 INFO:tasks.workunit.client.0.smithi087.stdout:9/118: symlink d3/d4/d6/d8/d22/l2c 0 2024-09-17T07:19:46.500 INFO:tasks.workunit.client.1.smithi139.stdout:6/116: dread db/df/f19 [0,4194304] 0 2024-09-17T07:19:46.504 INFO:tasks.workunit.client.1.smithi139.stdout:7/29: rename d5/l7 to d5/l8 0 2024-09-17T07:19:46.506 INFO:tasks.workunit.client.0.smithi087.stdout:8/152: mknod d1/d7/d9/d19/d1b/d18/d23/c31 0 2024-09-17T07:19:46.508 INFO:tasks.workunit.client.0.smithi087.stdout:9/119: creat d3/d4/d6/d8/d22/f2d x:0 0 0 2024-09-17T07:19:46.508 INFO:tasks.workunit.client.0.smithi087.stdout:7/169: dwrite d0/d3/d10/d31/f33 [0,4194304] 0 2024-09-17T07:19:46.509 INFO:tasks.workunit.client.1.smithi139.stdout:2/131: mkdir d0/de/d11/d28 0 2024-09-17T07:19:46.511 INFO:tasks.workunit.client.0.smithi087.stdout:3/150: dwrite d6/d16/f26 [4194304,4194304] 0 2024-09-17T07:19:46.511 INFO:tasks.workunit.client.0.smithi087.stdout:3/151: chown d6 92698493 1 2024-09-17T07:19:46.513 INFO:tasks.workunit.client.0.smithi087.stdout:8/153: chown d1/d7/d9/d19/d1b/f1f 1284724193 1 2024-09-17T07:19:46.513 INFO:tasks.workunit.client.1.smithi139.stdout:6/117: fdatasync f1 0 2024-09-17T07:19:46.515 INFO:tasks.workunit.client.1.smithi139.stdout:7/30: dwrite f2 [4194304,4194304] 0 2024-09-17T07:19:46.515 INFO:tasks.workunit.client.1.smithi139.stdout:2/132: readlink d0/de/d11/l27 0 2024-09-17T07:19:46.516 INFO:tasks.workunit.client.0.smithi087.stdout:3/152: read d6/f27 [1277809,12825] 0 2024-09-17T07:19:46.518 INFO:tasks.workunit.client.0.smithi087.stdout:7/170: link d0/d3/f22 d0/d3/d23/d17/f3a 0 2024-09-17T07:19:46.518 INFO:tasks.workunit.client.1.smithi139.stdout:6/118: chown db/d18/d1b 5202707 1 2024-09-17T07:19:46.519 INFO:tasks.workunit.client.1.smithi139.stdout:7/31: write f2 [3763326,62361] 0 2024-09-17T07:19:46.519 INFO:tasks.workunit.client.0.smithi087.stdout:3/153: rename l5 to d6/d1b/d2b/d30/l31 0 2024-09-17T07:19:46.520 INFO:tasks.workunit.client.1.smithi139.stdout:6/119: write f1 [1425685,19040] 0 2024-09-17T07:19:46.521 INFO:tasks.workunit.client.0.smithi087.stdout:3/154: mknod d6/d16/c32 0 2024-09-17T07:19:46.522 INFO:tasks.workunit.client.1.smithi139.stdout:2/133: mknod d0/de/d11/c29 0 2024-09-17T07:19:46.523 INFO:tasks.workunit.client.0.smithi087.stdout:7/171: rename d0/d3/d10/d31/f33 to d0/f3b 0 2024-09-17T07:19:46.524 INFO:tasks.workunit.client.1.smithi139.stdout:7/32: mknod d5/c9 0 2024-09-17T07:19:46.526 INFO:tasks.workunit.client.1.smithi139.stdout:7/33: read f2 [2307825,106394] 0 2024-09-17T07:19:46.527 INFO:tasks.workunit.client.1.smithi139.stdout:2/134: rename d0/de/d11/c29 to d0/de/c2a 0 2024-09-17T07:19:46.532 INFO:tasks.workunit.client.1.smithi139.stdout:7/34: rename d5/c9 to d5/ca 0 2024-09-17T07:19:46.534 INFO:tasks.workunit.client.1.smithi139.stdout:7/35: creat d5/fb x:0 0 0 2024-09-17T07:19:46.536 INFO:tasks.workunit.client.1.smithi139.stdout:6/120: rename db/d18/l23 to db/l26 0 2024-09-17T07:19:46.537 INFO:tasks.workunit.client.0.smithi087.stdout:8/154: dread d1/d7/d9/fc [0,4194304] 0 2024-09-17T07:19:46.538 INFO:tasks.workunit.client.1.smithi139.stdout:2/135: rename d0/d7/d1a/d1b/c1c to d0/dc/d15/c2b 0 2024-09-17T07:19:46.540 INFO:tasks.workunit.client.1.smithi139.stdout:6/121: write db/df/f19 [2177055,11740] 0 2024-09-17T07:19:46.540 INFO:tasks.workunit.client.0.smithi087.stdout:8/155: truncate d1/d7/d9/d19/d1b/f1c 2907576 0 2024-09-17T07:19:46.542 INFO:tasks.workunit.client.0.smithi087.stdout:8/156: creat d1/d2b/f32 x:0 0 0 2024-09-17T07:19:46.543 INFO:tasks.workunit.client.0.smithi087.stdout:8/157: mkdir d1/d2b/d21/d33 0 2024-09-17T07:19:46.544 INFO:tasks.workunit.client.0.smithi087.stdout:8/158: dread - d1/d7/f2f zero size 2024-09-17T07:19:46.545 INFO:tasks.workunit.client.1.smithi139.stdout:7/36: dwrite f2 [0,4194304] 0 2024-09-17T07:19:46.546 INFO:tasks.workunit.client.0.smithi087.stdout:8/159: creat d1/d7/d9/d19/d1b/f34 x:0 0 0 2024-09-17T07:19:46.546 INFO:tasks.workunit.client.1.smithi139.stdout:7/37: read - d5/fb zero size 2024-09-17T07:19:46.548 INFO:tasks.workunit.client.1.smithi139.stdout:7/38: chown d5/fb 4750564 1 2024-09-17T07:19:46.549 INFO:tasks.workunit.client.0.smithi087.stdout:8/160: getdents d1/d7 0 2024-09-17T07:19:46.553 INFO:tasks.workunit.client.1.smithi139.stdout:6/122: dwrite db/f16 [4194304,4194304] 0 2024-09-17T07:19:46.557 INFO:tasks.workunit.client.0.smithi087.stdout:9/120: truncate d3/d4/d6/f13 686998 0 2024-09-17T07:19:46.558 INFO:tasks.workunit.client.0.smithi087.stdout:9/121: stat d3/fc 0 2024-09-17T07:19:46.560 INFO:tasks.workunit.client.0.smithi087.stdout:9/122: rmdir d3/d4/d6 39 2024-09-17T07:19:46.563 INFO:tasks.workunit.client.0.smithi087.stdout:7/172: write d0/d3/d10/f14 [1254746,11433] 0 2024-09-17T07:19:46.563 INFO:tasks.workunit.client.0.smithi087.stdout:3/155: truncate d6/d15/f24 3435399 0 2024-09-17T07:19:46.568 INFO:tasks.workunit.client.0.smithi087.stdout:7/173: rename d0/d3/d23/d17/l24 to d0/d3/d10/d31/l3c 0 2024-09-17T07:19:46.571 INFO:tasks.workunit.client.0.smithi087.stdout:9/123: dwrite d3/d4/d6/d8/f18 [0,4194304] 0 2024-09-17T07:19:46.573 INFO:tasks.workunit.client.0.smithi087.stdout:3/156: dwrite d6/d16/f26 [4194304,4194304] 0 2024-09-17T07:19:46.575 INFO:tasks.workunit.client.0.smithi087.stdout:7/174: dread d0/d3/d23/d17/f3a [0,4194304] 0 2024-09-17T07:19:46.577 INFO:tasks.workunit.client.0.smithi087.stdout:8/161: dwrite d1/d7/d9/d19/d1b/f1f [0,4194304] 0 2024-09-17T07:19:46.577 INFO:tasks.workunit.client.0.smithi087.stdout:7/175: readlink d0/d3/d23/d17/l2f 0 2024-09-17T07:19:46.585 INFO:tasks.workunit.client.0.smithi087.stdout:8/162: fdatasync d1/d7/f13 0 2024-09-17T07:19:46.587 INFO:tasks.workunit.client.0.smithi087.stdout:3/157: dwrite d6/fc [0,4194304] 0 2024-09-17T07:19:46.588 INFO:tasks.workunit.client.0.smithi087.stdout:9/124: getdents d3/d4/d6/d8/d22/d2a 0 2024-09-17T07:19:46.590 INFO:tasks.workunit.client.0.smithi087.stdout:9/125: chown d3/d4/d6 1339 1 2024-09-17T07:19:46.591 INFO:tasks.workunit.client.0.smithi087.stdout:9/126: truncate d3/d4/d6/d8/f14 289536 0 2024-09-17T07:19:46.592 INFO:tasks.workunit.client.0.smithi087.stdout:8/163: link d1/d7/f2f d1/d2b/d21/f35 0 2024-09-17T07:19:46.592 INFO:tasks.workunit.client.0.smithi087.stdout:9/127: chown d3/d4/d16 3065981 1 2024-09-17T07:19:46.593 INFO:tasks.workunit.client.0.smithi087.stdout:3/158: mknod d6/d15/c33 0 2024-09-17T07:19:46.595 INFO:tasks.workunit.client.0.smithi087.stdout:8/164: creat d1/d7/d9/d19/f36 x:0 0 0 2024-09-17T07:19:46.596 INFO:tasks.workunit.client.0.smithi087.stdout:3/159: stat d6/l2d 0 2024-09-17T07:19:46.597 INFO:tasks.workunit.client.1.smithi139.stdout:8/98: write d0/f7 [1007923,56816] 0 2024-09-17T07:19:46.597 INFO:tasks.workunit.client.1.smithi139.stdout:9/108: rmdir dc/d11 39 2024-09-17T07:19:46.597 INFO:tasks.workunit.client.0.smithi087.stdout:9/128: dread d3/f28 [0,4194304] 0 2024-09-17T07:19:46.598 INFO:tasks.workunit.client.1.smithi139.stdout:5/27: dread f3 [0,4194304] 0 2024-09-17T07:19:46.599 INFO:tasks.workunit.client.1.smithi139.stdout:8/99: mknod d0/dc/c1d 0 2024-09-17T07:19:46.600 INFO:tasks.workunit.client.1.smithi139.stdout:8/100: fsync d0/f1b 0 2024-09-17T07:19:46.600 INFO:tasks.workunit.client.1.smithi139.stdout:1/40: sync 2024-09-17T07:19:46.601 INFO:tasks.workunit.client.0.smithi087.stdout:3/160: rename c3 to d6/c34 0 2024-09-17T07:19:46.601 INFO:tasks.workunit.client.1.smithi139.stdout:5/28: rmdir d4 39 2024-09-17T07:19:46.602 INFO:tasks.workunit.client.0.smithi087.stdout:8/165: rename d1/d7/d9 to d1/d7/d9/d19/d1b/d18/d37 22 2024-09-17T07:19:46.602 INFO:tasks.workunit.client.0.smithi087.stdout:3/161: chown d6/d1b/d2b/d30 0 1 2024-09-17T07:19:46.602 INFO:tasks.workunit.client.1.smithi139.stdout:8/101: rmdir d0/dc/d18 39 2024-09-17T07:19:46.603 INFO:tasks.workunit.client.0.smithi087.stdout:8/166: dread - d1/d2b/d21/f35 zero size 2024-09-17T07:19:46.604 INFO:tasks.workunit.client.1.smithi139.stdout:9/109: rename dc/ce to dc/c22 0 2024-09-17T07:19:46.605 INFO:tasks.workunit.client.1.smithi139.stdout:1/41: symlink d2/lc 0 2024-09-17T07:19:46.606 INFO:tasks.workunit.client.0.smithi087.stdout:8/167: symlink d1/d2b/d21/l38 0 2024-09-17T07:19:46.606 INFO:tasks.workunit.client.1.smithi139.stdout:5/29: chown d4/f6 3098550 1 2024-09-17T07:19:46.607 INFO:tasks.workunit.client.0.smithi087.stdout:3/162: dread d6/f27 [0,4194304] 0 2024-09-17T07:19:46.607 INFO:tasks.workunit.client.1.smithi139.stdout:5/30: chown d4/f9 739 1 2024-09-17T07:19:46.607 INFO:tasks.workunit.client.0.smithi087.stdout:9/129: dread d3/d4/fb [0,4194304] 0 2024-09-17T07:19:46.608 INFO:tasks.workunit.client.1.smithi139.stdout:2/136: rmdir d0/de 39 2024-09-17T07:19:46.609 INFO:tasks.workunit.client.0.smithi087.stdout:8/168: mknod d1/d2b/d21/c39 0 2024-09-17T07:19:46.609 INFO:tasks.workunit.client.1.smithi139.stdout:9/110: unlink f7 0 2024-09-17T07:19:46.609 INFO:tasks.workunit.client.0.smithi087.stdout:7/176: dread d0/d3/d23/d2d/f35 [0,4194304] 0 2024-09-17T07:19:46.611 INFO:tasks.workunit.client.1.smithi139.stdout:8/102: symlink d0/dc/l1e 0 2024-09-17T07:19:46.613 INFO:tasks.workunit.client.0.smithi087.stdout:3/163: read d6/d15/f24 [1253261,25908] 0 2024-09-17T07:19:46.614 INFO:tasks.workunit.client.1.smithi139.stdout:5/31: rename d4/l7 to d4/la 0 2024-09-17T07:19:46.614 INFO:tasks.workunit.client.1.smithi139.stdout:7/39: rmdir d5 39 2024-09-17T07:19:46.615 INFO:tasks.workunit.client.1.smithi139.stdout:6/123: getdents db/d18 0 2024-09-17T07:19:46.615 INFO:tasks.workunit.client.0.smithi087.stdout:7/177: dwrite d0/d3/d23/d17/f34 [0,4194304] 0 2024-09-17T07:19:46.616 INFO:tasks.workunit.client.0.smithi087.stdout:3/164: creat d6/d1b/d2b/d30/f35 x:0 0 0 2024-09-17T07:19:46.617 INFO:tasks.workunit.client.1.smithi139.stdout:1/42: dwrite f0 [0,4194304] 0 2024-09-17T07:19:46.617 INFO:tasks.workunit.client.0.smithi087.stdout:3/165: stat d6/l14 0 2024-09-17T07:19:46.617 INFO:tasks.workunit.client.0.smithi087.stdout:7/178: rmdir d0/d3/d23/d17 39 2024-09-17T07:19:46.621 INFO:tasks.workunit.client.0.smithi087.stdout:7/179: write d0/d3/d23/d17/f34 [4735987,67025] 0 2024-09-17T07:19:46.622 INFO:tasks.workunit.client.0.smithi087.stdout:7/180: readlink d0/d3/l1d 0 2024-09-17T07:19:46.622 INFO:tasks.workunit.client.0.smithi087.stdout:3/166: dread d6/f27 [0,4194304] 0 2024-09-17T07:19:46.623 INFO:tasks.workunit.client.1.smithi139.stdout:7/40: fsync d5/fb 0 2024-09-17T07:19:46.625 INFO:tasks.workunit.client.0.smithi087.stdout:7/181: getdents d0/d3/d10/d32 0 2024-09-17T07:19:46.626 INFO:tasks.workunit.client.0.smithi087.stdout:7/182: write d0/d3/f2c [888595,120022] 0 2024-09-17T07:19:46.628 INFO:tasks.workunit.client.0.smithi087.stdout:7/183: mknod d0/d3/d23/d2d/c3d 0 2024-09-17T07:19:46.629 INFO:tasks.workunit.client.0.smithi087.stdout:7/184: chown d0/d3/d10/f38 16 1 2024-09-17T07:19:46.629 INFO:tasks.workunit.client.0.smithi087.stdout:7/185: fsync d0/f8 0 2024-09-17T07:19:46.629 INFO:tasks.workunit.client.1.smithi139.stdout:7/41: symlink d5/lc 0 2024-09-17T07:19:46.630 INFO:tasks.workunit.client.1.smithi139.stdout:6/124: dwrite f2 [0,4194304] 0 2024-09-17T07:19:46.631 INFO:tasks.workunit.client.0.smithi087.stdout:7/186: readlink d0/d3/d23/l12 0 2024-09-17T07:19:46.631 INFO:tasks.workunit.client.0.smithi087.stdout:7/187: chown d0/d3/d23/d17/l39 96658797 1 2024-09-17T07:19:46.635 INFO:tasks.workunit.client.1.smithi139.stdout:2/137: getdents d0/d7 0 2024-09-17T07:19:46.638 INFO:tasks.workunit.client.1.smithi139.stdout:9/111: dwrite dc/d11/f1b [0,4194304] 0 2024-09-17T07:19:46.638 INFO:tasks.workunit.client.1.smithi139.stdout:1/43: dwrite f0 [0,4194304] 0 2024-09-17T07:19:46.638 INFO:tasks.workunit.client.0.smithi087.stdout:7/188: dread d0/d3/f2c [0,4194304] 0 2024-09-17T07:19:46.639 INFO:tasks.workunit.client.1.smithi139.stdout:8/103: getdents d0/dc/d18 0 2024-09-17T07:19:46.639 INFO:tasks.workunit.client.0.smithi087.stdout:0/174: sync 2024-09-17T07:19:46.641 INFO:tasks.workunit.client.0.smithi087.stdout:0/175: mknod db/c32 0 2024-09-17T07:19:46.644 INFO:tasks.workunit.client.1.smithi139.stdout:8/104: stat d0/dc/c1d 0 2024-09-17T07:19:46.644 INFO:tasks.workunit.client.1.smithi139.stdout:5/32: getdents d4 0 2024-09-17T07:19:46.644 INFO:tasks.workunit.client.0.smithi087.stdout:0/176: creat db/f33 x:0 0 0 2024-09-17T07:19:46.645 INFO:tasks.workunit.client.1.smithi139.stdout:8/105: chown d0/dc/d18 485442430 1 2024-09-17T07:19:46.646 INFO:tasks.workunit.client.1.smithi139.stdout:9/112: chown dc/d11/f1b 0 1 2024-09-17T07:19:46.646 INFO:tasks.workunit.client.1.smithi139.stdout:6/125: symlink db/d21/l27 0 2024-09-17T07:19:46.647 INFO:tasks.workunit.client.1.smithi139.stdout:7/42: dwrite f2 [4194304,4194304] 0 2024-09-17T07:19:46.647 INFO:tasks.workunit.client.1.smithi139.stdout:1/44: fsync d2/f7 0 2024-09-17T07:19:46.648 INFO:tasks.workunit.client.0.smithi087.stdout:7/189: dwrite d0/f26 [0,4194304] 0 2024-09-17T07:19:46.648 INFO:tasks.workunit.client.0.smithi087.stdout:0/177: creat db/f34 x:0 0 0 2024-09-17T07:19:46.653 INFO:tasks.workunit.client.1.smithi139.stdout:2/138: mknod d0/de/d11/d12/c2c 0 2024-09-17T07:19:46.653 INFO:tasks.workunit.client.0.smithi087.stdout:7/190: rename d0/d3/f2c to d0/d3/f3e 0 2024-09-17T07:19:46.654 INFO:tasks.workunit.client.1.smithi139.stdout:1/45: truncate d2/f6 5011690 0 2024-09-17T07:19:46.654 INFO:tasks.workunit.client.1.smithi139.stdout:1/46: readlink d2/lc 0 2024-09-17T07:19:46.656 INFO:tasks.workunit.client.1.smithi139.stdout:2/139: write d0/f5 [1344503,42470] 0 2024-09-17T07:19:46.657 INFO:tasks.workunit.client.1.smithi139.stdout:6/126: rename db/l10 to db/d21/l28 0 2024-09-17T07:19:46.657 INFO:tasks.workunit.client.0.smithi087.stdout:7/191: unlink d0/d3/f1c 0 2024-09-17T07:19:46.657 INFO:tasks.workunit.client.1.smithi139.stdout:5/33: link f3 d4/fb 0 2024-09-17T07:19:46.662 INFO:tasks.workunit.client.1.smithi139.stdout:6/127: read - db/df/f24 zero size 2024-09-17T07:19:46.662 INFO:tasks.workunit.client.0.smithi087.stdout:7/192: dread d0/d3/d23/d2d/f35 [0,4194304] 0 2024-09-17T07:19:46.663 INFO:tasks.workunit.client.1.smithi139.stdout:5/34: symlink d4/lc 0 2024-09-17T07:19:46.663 INFO:tasks.workunit.client.1.smithi139.stdout:8/106: dwrite d0/fb [0,4194304] 0 2024-09-17T07:19:46.666 INFO:tasks.workunit.client.0.smithi087.stdout:7/193: getdents d0/d3/d10 0 2024-09-17T07:19:46.667 INFO:tasks.workunit.client.0.smithi087.stdout:7/194: fdatasync d0/d3/d10/f21 0 2024-09-17T07:19:46.667 INFO:tasks.workunit.client.1.smithi139.stdout:5/35: creat d4/fd x:0 0 0 2024-09-17T07:19:46.668 INFO:tasks.workunit.client.1.smithi139.stdout:6/128: mknod db/d18/c29 0 2024-09-17T07:19:46.670 INFO:tasks.workunit.client.1.smithi139.stdout:5/36: mkdir d4/de 0 2024-09-17T07:19:46.671 INFO:tasks.workunit.client.1.smithi139.stdout:2/140: dwrite d0/fa [8388608,4194304] 0 2024-09-17T07:19:46.671 INFO:tasks.workunit.client.1.smithi139.stdout:6/129: mkdir db/df/d2a 0 2024-09-17T07:19:46.675 INFO:tasks.workunit.client.1.smithi139.stdout:5/37: chown d4/fb 13 1 2024-09-17T07:19:46.676 INFO:tasks.workunit.client.1.smithi139.stdout:6/130: creat db/df/d2a/f2b x:0 0 0 2024-09-17T07:19:46.678 INFO:tasks.workunit.client.1.smithi139.stdout:6/131: write db/d18/f1a [8331664,68698] 0 2024-09-17T07:19:46.679 INFO:tasks.workunit.client.1.smithi139.stdout:5/38: unlink d4/fb 0 2024-09-17T07:19:46.682 INFO:tasks.workunit.client.1.smithi139.stdout:2/141: dwrite d0/dc/f20 [0,4194304] 0 2024-09-17T07:19:46.683 INFO:tasks.workunit.client.1.smithi139.stdout:6/132: mknod db/d18/d1b/c2c 0 2024-09-17T07:19:46.684 INFO:tasks.workunit.client.1.smithi139.stdout:6/133: fdatasync db/df/f19 0 2024-09-17T07:19:46.688 INFO:tasks.workunit.client.0.smithi087.stdout:0/178: dread db/f13 [0,4194304] 0 2024-09-17T07:19:46.689 INFO:tasks.workunit.client.0.smithi087.stdout:0/179: write db/f1b [334104,108263] 0 2024-09-17T07:19:46.689 INFO:tasks.workunit.client.1.smithi139.stdout:1/47: fsync f0 0 2024-09-17T07:19:46.690 INFO:tasks.workunit.client.0.smithi087.stdout:0/180: chown db/f1d 11771156 1 2024-09-17T07:19:46.691 INFO:tasks.workunit.client.1.smithi139.stdout:1/48: write d2/f6 [59966,62488] 0 2024-09-17T07:19:46.692 INFO:tasks.workunit.client.1.smithi139.stdout:1/49: write d2/f5 [837377,73574] 0 2024-09-17T07:19:46.695 INFO:tasks.workunit.client.0.smithi087.stdout:0/181: getdents db 0 2024-09-17T07:19:46.698 INFO:tasks.workunit.client.0.smithi087.stdout:0/182: unlink db/f1f 0 2024-09-17T07:19:46.699 INFO:tasks.workunit.client.0.smithi087.stdout:0/183: fsync db/f13 0 2024-09-17T07:19:46.700 INFO:tasks.workunit.client.0.smithi087.stdout:0/184: creat db/f35 x:0 0 0 2024-09-17T07:19:46.700 INFO:tasks.workunit.client.0.smithi087.stdout:0/185: dread - db/f27 zero size 2024-09-17T07:19:46.702 INFO:tasks.workunit.client.0.smithi087.stdout:0/186: link db/l22 db/l36 0 2024-09-17T07:19:46.707 INFO:tasks.workunit.client.0.smithi087.stdout:0/187: dwrite db/f33 [0,4194304] 0 2024-09-17T07:19:46.708 INFO:tasks.workunit.client.0.smithi087.stdout:0/188: write f5 [2277282,25657] 0 2024-09-17T07:19:46.709 INFO:tasks.workunit.client.0.smithi087.stdout:0/189: write db/f1d [713275,75209] 0 2024-09-17T07:19:46.716 INFO:tasks.workunit.client.0.smithi087.stdout:0/190: dwrite db/f34 [0,4194304] 0 2024-09-17T07:19:46.718 INFO:tasks.workunit.client.0.smithi087.stdout:0/191: rmdir db 39 2024-09-17T07:19:46.721 INFO:tasks.workunit.client.0.smithi087.stdout:0/192: rename db/l22 to db/l37 0 2024-09-17T07:19:46.722 INFO:tasks.workunit.client.0.smithi087.stdout:0/193: creat db/f38 x:0 0 0 2024-09-17T07:19:46.735 INFO:tasks.workunit.client.0.smithi087.stdout:0/194: rmdir db 39 2024-09-17T07:19:46.737 INFO:tasks.workunit.client.0.smithi087.stdout:0/195: creat db/f39 x:0 0 0 2024-09-17T07:19:46.739 INFO:tasks.workunit.client.0.smithi087.stdout:0/196: rename db/ff to db/f3a 0 2024-09-17T07:19:46.740 INFO:tasks.workunit.client.0.smithi087.stdout:0/197: read - db/f38 zero size 2024-09-17T07:19:46.741 INFO:tasks.workunit.client.0.smithi087.stdout:0/198: symlink db/l3b 0 2024-09-17T07:19:46.745 INFO:tasks.workunit.client.0.smithi087.stdout:0/199: rmdir db 39 2024-09-17T07:19:46.746 INFO:tasks.workunit.client.0.smithi087.stdout:0/200: mknod db/c3c 0 2024-09-17T07:19:46.748 INFO:tasks.workunit.client.0.smithi087.stdout:0/201: symlink db/l3d 0 2024-09-17T07:19:46.749 INFO:tasks.workunit.client.0.smithi087.stdout:0/202: creat db/f3e x:0 0 0 2024-09-17T07:19:46.750 INFO:tasks.workunit.client.0.smithi087.stdout:0/203: creat db/f3f x:0 0 0 2024-09-17T07:19:46.751 INFO:tasks.workunit.client.0.smithi087.stdout:0/204: creat db/f40 x:0 0 0 2024-09-17T07:19:46.752 INFO:tasks.workunit.client.0.smithi087.stdout:0/205: rename db/f3a to db/f41 0 2024-09-17T07:19:46.753 INFO:tasks.workunit.client.0.smithi087.stdout:0/206: fsync db/f27 0 2024-09-17T07:19:46.757 INFO:tasks.workunit.client.0.smithi087.stdout:0/207: creat db/f42 x:0 0 0 2024-09-17T07:19:46.757 INFO:tasks.workunit.client.0.smithi087.stdout:0/208: write db/f13 [5019568,86212] 0 2024-09-17T07:19:46.757 INFO:tasks.workunit.client.0.smithi087.stdout:0/209: symlink db/l43 0 2024-09-17T07:19:46.757 INFO:tasks.workunit.client.0.smithi087.stdout:0/210: mknod db/c44 0 2024-09-17T07:19:46.758 INFO:tasks.workunit.client.0.smithi087.stdout:0/211: stat db/f1a 0 2024-09-17T07:19:46.758 INFO:tasks.workunit.client.0.smithi087.stdout:0/212: mkdir db/d45 0 2024-09-17T07:19:46.759 INFO:tasks.workunit.client.0.smithi087.stdout:0/213: write db/f18 [2194640,125218] 0 2024-09-17T07:19:46.769 INFO:tasks.workunit.client.1.smithi139.stdout:0/39: sync 2024-09-17T07:19:46.772 INFO:tasks.workunit.client.1.smithi139.stdout:6/134: symlink db/df/d2a/l2d 0 2024-09-17T07:19:46.774 INFO:tasks.workunit.client.0.smithi087.stdout:0/214: dread db/f25 [0,4194304] 0 2024-09-17T07:19:46.774 INFO:tasks.workunit.client.0.smithi087.stdout:0/215: readlink db/l3b 0 2024-09-17T07:19:46.775 INFO:tasks.workunit.client.1.smithi139.stdout:9/113: truncate dc/d11/f1b 1882348 0 2024-09-17T07:19:46.776 INFO:tasks.workunit.client.1.smithi139.stdout:9/114: fdatasync dc/d11/f12 0 2024-09-17T07:19:46.776 INFO:tasks.workunit.client.0.smithi087.stdout:0/216: readlink db/l37 0 2024-09-17T07:19:46.777 INFO:tasks.workunit.client.0.smithi087.stdout:0/217: creat db/f46 x:0 0 0 2024-09-17T07:19:46.777 INFO:tasks.workunit.client.1.smithi139.stdout:2/142: creat d0/de/d11/d28/f2d x:0 0 0 2024-09-17T07:19:46.779 INFO:tasks.workunit.client.1.smithi139.stdout:6/135: creat db/d18/f2e x:0 0 0 2024-09-17T07:19:46.780 INFO:tasks.workunit.client.1.smithi139.stdout:5/39: link d4/la d4/lf 0 2024-09-17T07:19:46.781 INFO:tasks.workunit.client.1.smithi139.stdout:6/136: write db/d18/f1a [1993937,112581] 0 2024-09-17T07:19:46.782 INFO:tasks.workunit.client.0.smithi087.stdout:0/218: dwrite db/f2e [0,4194304] 0 2024-09-17T07:19:46.782 INFO:tasks.workunit.client.1.smithi139.stdout:9/115: creat dc/d11/d15/d1e/f23 x:0 0 0 2024-09-17T07:19:46.783 INFO:tasks.workunit.client.1.smithi139.stdout:0/40: creat d1/da/fc x:0 0 0 2024-09-17T07:19:46.786 INFO:tasks.workunit.client.1.smithi139.stdout:6/137: creat db/df/d2a/f2f x:0 0 0 2024-09-17T07:19:46.787 INFO:tasks.workunit.client.0.smithi087.stdout:0/219: dread db/fe [0,4194304] 0 2024-09-17T07:19:46.788 INFO:tasks.workunit.client.1.smithi139.stdout:0/41: read d1/f7 [47709,91971] 0 2024-09-17T07:19:46.788 INFO:tasks.workunit.client.1.smithi139.stdout:6/138: write db/df/f24 [849900,120863] 0 2024-09-17T07:19:46.789 INFO:tasks.workunit.client.1.smithi139.stdout:6/139: fdatasync db/f16 0 2024-09-17T07:19:46.789 INFO:tasks.workunit.client.1.smithi139.stdout:9/116: creat dc/d11/f24 x:0 0 0 2024-09-17T07:19:46.790 INFO:tasks.workunit.client.0.smithi087.stdout:0/220: mknod db/d45/c47 0 2024-09-17T07:19:46.791 INFO:tasks.workunit.client.0.smithi087.stdout:0/221: rename db/f3f to db/f48 0 2024-09-17T07:19:46.792 INFO:tasks.workunit.client.0.smithi087.stdout:0/222: readlink db/l16 0 2024-09-17T07:19:46.794 INFO:tasks.workunit.client.1.smithi139.stdout:0/42: rename c0 to d1/da/cd 0 2024-09-17T07:19:46.797 INFO:tasks.workunit.client.1.smithi139.stdout:5/40: dread f3 [0,4194304] 0 2024-09-17T07:19:46.798 INFO:tasks.workunit.client.1.smithi139.stdout:6/140: symlink db/df/d2a/l30 0 2024-09-17T07:19:46.798 INFO:tasks.workunit.client.1.smithi139.stdout:5/41: read - d4/fd zero size 2024-09-17T07:19:46.798 INFO:tasks.workunit.client.1.smithi139.stdout:0/43: mknod d1/ce 0 2024-09-17T07:19:46.799 INFO:tasks.workunit.client.1.smithi139.stdout:6/141: fdatasync db/d18/d1b/f1d 0 2024-09-17T07:19:46.800 INFO:tasks.workunit.client.0.smithi087.stdout:0/223: getdents db 0 2024-09-17T07:19:46.802 INFO:tasks.workunit.client.0.smithi087.stdout:0/224: getdents db/d45 0 2024-09-17T07:19:46.803 INFO:tasks.workunit.client.1.smithi139.stdout:0/44: mkdir d1/df 0 2024-09-17T07:19:46.805 INFO:tasks.workunit.client.1.smithi139.stdout:6/142: creat db/d21/f31 x:0 0 0 2024-09-17T07:19:46.806 INFO:tasks.workunit.client.1.smithi139.stdout:6/143: dread - db/d21/f31 zero size 2024-09-17T07:19:46.806 INFO:tasks.workunit.client.1.smithi139.stdout:5/42: mkdir d4/de/d10 0 2024-09-17T07:19:46.807 INFO:tasks.workunit.client.0.smithi087.stdout:0/225: truncate db/f18 2813904 0 2024-09-17T07:19:46.808 INFO:tasks.workunit.client.1.smithi139.stdout:6/144: symlink db/d21/l32 0 2024-09-17T07:19:46.809 INFO:tasks.workunit.client.0.smithi087.stdout:0/226: getdents db 0 2024-09-17T07:19:46.810 INFO:tasks.workunit.client.0.smithi087.stdout:0/227: unlink db/c2d 0 2024-09-17T07:19:46.810 INFO:tasks.workunit.client.1.smithi139.stdout:6/145: mkdir db/df/d33 0 2024-09-17T07:19:46.811 INFO:tasks.workunit.client.1.smithi139.stdout:6/146: read db/df/f19 [873365,35908] 0 2024-09-17T07:19:46.812 INFO:tasks.workunit.client.1.smithi139.stdout:6/147: write db/d18/d1b/f1d [4977969,97119] 0 2024-09-17T07:19:46.815 INFO:tasks.workunit.client.0.smithi087.stdout:0/228: dwrite db/f3e [0,4194304] 0 2024-09-17T07:19:46.816 INFO:tasks.workunit.client.1.smithi139.stdout:9/117: dwrite dc/d11/d15/f18 [0,4194304] 0 2024-09-17T07:19:46.818 INFO:tasks.workunit.client.0.smithi087.stdout:0/229: creat db/f49 x:0 0 0 2024-09-17T07:19:46.820 INFO:tasks.workunit.client.1.smithi139.stdout:9/118: mknod dc/d11/d15/d1e/c25 0 2024-09-17T07:19:46.821 INFO:tasks.workunit.client.1.smithi139.stdout:6/148: dwrite db/f16 [0,4194304] 0 2024-09-17T07:19:46.822 INFO:tasks.workunit.client.0.smithi087.stdout:6/255: sync 2024-09-17T07:19:46.822 INFO:tasks.workunit.client.0.smithi087.stdout:0/230: chown db/l2b 120581171 1 2024-09-17T07:19:46.824 INFO:tasks.workunit.client.1.smithi139.stdout:9/119: write dc/d11/f1b [1985305,27777] 0 2024-09-17T07:19:46.825 INFO:tasks.workunit.client.0.smithi087.stdout:6/256: rmdir d1/d6/d1a/d2c/d33 39 2024-09-17T07:19:46.826 INFO:tasks.workunit.client.1.smithi139.stdout:9/120: read f4 [5556864,85441] 0 2024-09-17T07:19:46.826 INFO:tasks.workunit.client.0.smithi087.stdout:0/231: dread db/f3e [0,4194304] 0 2024-09-17T07:19:46.829 INFO:tasks.workunit.client.1.smithi139.stdout:6/149: dread db/d18/d1b/f1d [0,4194304] 0 2024-09-17T07:19:46.829 INFO:tasks.workunit.client.0.smithi087.stdout:0/232: rename db/c32 to db/d45/c4a 0 2024-09-17T07:19:46.830 INFO:tasks.workunit.client.1.smithi139.stdout:6/150: fdatasync db/d18/f2e 0 2024-09-17T07:19:46.830 INFO:tasks.workunit.client.1.smithi139.stdout:6/151: chown db/df 2204003 1 2024-09-17T07:19:46.832 INFO:tasks.workunit.client.0.smithi087.stdout:0/233: creat db/d45/f4b x:0 0 0 2024-09-17T07:19:46.834 INFO:tasks.workunit.client.0.smithi087.stdout:0/234: creat db/d45/f4c x:0 0 0 2024-09-17T07:19:46.836 INFO:tasks.workunit.client.0.smithi087.stdout:0/235: creat db/f4d x:0 0 0 2024-09-17T07:19:46.837 INFO:tasks.workunit.client.0.smithi087.stdout:0/236: creat db/f4e x:0 0 0 2024-09-17T07:19:46.838 INFO:tasks.workunit.client.0.smithi087.stdout:0/237: readlink db/l43 0 2024-09-17T07:19:46.838 INFO:tasks.workunit.client.0.smithi087.stdout:0/238: write db/f33 [1365269,74987] 0 2024-09-17T07:19:46.840 INFO:tasks.workunit.client.0.smithi087.stdout:0/239: fdatasync db/f3e 0 2024-09-17T07:19:46.841 INFO:tasks.workunit.client.1.smithi139.stdout:9/121: truncate dc/d11/d15/f18 8363571 0 2024-09-17T07:19:46.843 INFO:tasks.workunit.client.0.smithi087.stdout:0/240: mkdir db/d4f 0 2024-09-17T07:19:46.843 INFO:tasks.workunit.client.1.smithi139.stdout:6/152: write f7 [12032,125005] 0 2024-09-17T07:19:46.844 INFO:tasks.workunit.client.0.smithi087.stdout:0/241: mknod db/d45/c50 0 2024-09-17T07:19:46.845 INFO:tasks.workunit.client.1.smithi139.stdout:9/122: write dc/d11/d15/f18 [6101114,56359] 0 2024-09-17T07:19:46.846 INFO:tasks.workunit.client.0.smithi087.stdout:0/242: creat db/d45/f51 x:0 0 0 2024-09-17T07:19:46.846 INFO:tasks.workunit.client.0.smithi087.stdout:0/243: readlink db/l2f 0 2024-09-17T07:19:46.849 INFO:tasks.workunit.client.1.smithi139.stdout:9/123: rename dc/d11/d15/l1a to dc/d11/l26 0 2024-09-17T07:19:46.851 INFO:tasks.workunit.client.1.smithi139.stdout:9/124: mkdir dc/d27 0 2024-09-17T07:19:46.854 INFO:tasks.workunit.client.1.smithi139.stdout:9/125: rename dc/d11/f16 to dc/d11/d15/f28 0 2024-09-17T07:19:46.860 INFO:tasks.workunit.client.1.smithi139.stdout:9/126: dwrite dc/d11/f12 [0,4194304] 0 2024-09-17T07:19:46.862 INFO:tasks.workunit.client.0.smithi087.stdout:0/244: dread db/f1e [0,4194304] 0 2024-09-17T07:19:46.863 INFO:tasks.workunit.client.0.smithi087.stdout:0/245: fsync db/f29 0 2024-09-17T07:19:46.863 INFO:tasks.workunit.client.0.smithi087.stdout:0/246: readlink db/l3b 0 2024-09-17T07:19:46.864 INFO:tasks.workunit.client.1.smithi139.stdout:9/127: dread f4 [4194304,4194304] 0 2024-09-17T07:19:46.865 INFO:tasks.workunit.client.0.smithi087.stdout:0/247: creat db/d45/f52 x:0 0 0 2024-09-17T07:19:46.866 INFO:tasks.workunit.client.0.smithi087.stdout:0/248: creat db/d45/f53 x:0 0 0 2024-09-17T07:19:46.870 INFO:tasks.workunit.client.0.smithi087.stdout:0/249: dread db/f3e [0,4194304] 0 2024-09-17T07:19:46.872 INFO:tasks.workunit.client.0.smithi087.stdout:0/250: creat db/f54 x:0 0 0 2024-09-17T07:19:46.874 INFO:tasks.workunit.client.0.smithi087.stdout:0/251: creat db/d4f/f55 x:0 0 0 2024-09-17T07:19:46.880 INFO:tasks.workunit.client.0.smithi087.stdout:0/252: dwrite db/f1d [0,4194304] 0 2024-09-17T07:19:46.883 INFO:tasks.workunit.client.0.smithi087.stdout:0/253: dread db/f1e [0,4194304] 0 2024-09-17T07:19:46.885 INFO:tasks.workunit.client.0.smithi087.stdout:0/254: mknod db/d45/c56 0 2024-09-17T07:19:46.887 INFO:tasks.workunit.client.0.smithi087.stdout:0/255: creat db/d45/f57 x:0 0 0 2024-09-17T07:19:46.888 INFO:tasks.workunit.client.0.smithi087.stdout:0/256: truncate db/f42 560746 0 2024-09-17T07:19:46.888 INFO:tasks.workunit.client.0.smithi087.stdout:0/257: stat db/f54 0 2024-09-17T07:19:46.889 INFO:tasks.workunit.client.1.smithi139.stdout:9/128: creat dc/d11/d15/d1e/f29 x:0 0 0 2024-09-17T07:19:46.890 INFO:tasks.workunit.client.0.smithi087.stdout:0/258: mknod db/c58 0 2024-09-17T07:19:46.894 INFO:tasks.workunit.client.1.smithi139.stdout:9/129: rmdir dc/d27 0 2024-09-17T07:19:46.894 INFO:tasks.workunit.client.1.smithi139.stdout:9/130: dread - dc/d11/f24 zero size 2024-09-17T07:19:46.895 INFO:tasks.workunit.client.0.smithi087.stdout:0/259: dwrite db/f21 [0,4194304] 0 2024-09-17T07:19:46.897 INFO:tasks.workunit.client.0.smithi087.stdout:0/260: fdatasync db/f1d 0 2024-09-17T07:19:46.898 INFO:tasks.workunit.client.1.smithi139.stdout:9/131: mkdir dc/d2a 0 2024-09-17T07:19:46.900 INFO:tasks.workunit.client.0.smithi087.stdout:0/261: link db/f40 db/f59 0 2024-09-17T07:19:46.901 INFO:tasks.workunit.client.1.smithi139.stdout:9/132: symlink dc/d2a/l2b 0 2024-09-17T07:19:46.904 INFO:tasks.workunit.client.0.smithi087.stdout:0/262: link db/l10 db/d4f/l5a 0 2024-09-17T07:19:46.906 INFO:tasks.workunit.client.1.smithi139.stdout:9/133: dread f4 [4194304,4194304] 0 2024-09-17T07:19:46.909 INFO:tasks.workunit.client.0.smithi087.stdout:0/263: dread db/f17 [0,4194304] 0 2024-09-17T07:19:46.909 INFO:tasks.workunit.client.1.smithi139.stdout:9/134: mkdir dc/d2c 0 2024-09-17T07:19:46.911 INFO:tasks.workunit.client.0.smithi087.stdout:0/264: chown db/l2b 34812693 1 2024-09-17T07:19:46.912 INFO:tasks.workunit.client.0.smithi087.stdout:0/265: mkdir db/d45/d5b 0 2024-09-17T07:19:46.914 INFO:tasks.workunit.client.0.smithi087.stdout:0/266: symlink db/d45/d5b/l5c 0 2024-09-17T07:19:46.915 INFO:tasks.workunit.client.0.smithi087.stdout:0/267: mkdir db/d45/d5d 0 2024-09-17T07:19:46.915 INFO:tasks.workunit.client.1.smithi139.stdout:9/135: rmdir dc 39 2024-09-17T07:19:46.916 INFO:tasks.workunit.client.0.smithi087.stdout:0/268: read db/f1e [3927733,77911] 0 2024-09-17T07:19:46.917 INFO:tasks.workunit.client.0.smithi087.stdout:0/269: creat db/d45/d5b/f5e x:0 0 0 2024-09-17T07:19:46.917 INFO:tasks.workunit.client.1.smithi139.stdout:9/136: rmdir dc/d11 39 2024-09-17T07:19:46.918 INFO:tasks.workunit.client.0.smithi087.stdout:0/270: rename db/l2f to db/d45/l5f 0 2024-09-17T07:19:46.923 INFO:tasks.workunit.client.1.smithi139.stdout:9/137: dwrite f4 [4194304,4194304] 0 2024-09-17T07:19:46.923 INFO:tasks.workunit.client.0.smithi087.stdout:0/271: dwrite db/f29 [0,4194304] 0 2024-09-17T07:19:46.925 INFO:tasks.workunit.client.1.smithi139.stdout:9/138: symlink dc/d2a/l2d 0 2024-09-17T07:19:46.925 INFO:tasks.workunit.client.0.smithi087.stdout:0/272: mknod db/d45/d5b/c60 0 2024-09-17T07:19:46.926 INFO:tasks.workunit.client.1.smithi139.stdout:9/139: write fb [1798126,130384] 0 2024-09-17T07:19:46.926 INFO:tasks.workunit.client.0.smithi087.stdout:0/273: write db/f35 [1038306,64296] 0 2024-09-17T07:19:46.929 INFO:tasks.workunit.client.0.smithi087.stdout:0/274: mknod db/d45/d5b/c61 0 2024-09-17T07:19:46.930 INFO:tasks.workunit.client.1.smithi139.stdout:9/140: rmdir dc/d11/d15 39 2024-09-17T07:19:46.930 INFO:tasks.workunit.client.0.smithi087.stdout:0/275: write db/f35 [1516010,128361] 0 2024-09-17T07:19:46.932 INFO:tasks.workunit.client.0.smithi087.stdout:0/276: mknod db/d45/d5b/c62 0 2024-09-17T07:19:46.933 INFO:tasks.workunit.client.1.smithi139.stdout:9/141: fdatasync dc/d11/d15/d1e/f21 0 2024-09-17T07:19:46.935 INFO:tasks.workunit.client.0.smithi087.stdout:0/277: mkdir db/d45/d5d/d63 0 2024-09-17T07:19:46.936 INFO:tasks.workunit.client.1.smithi139.stdout:9/142: rename dc/f10 to dc/d11/d15/d1e/f2e 0 2024-09-17T07:19:46.937 INFO:tasks.workunit.client.0.smithi087.stdout:0/278: creat db/d45/d5d/d63/f64 x:0 0 0 2024-09-17T07:19:46.938 INFO:tasks.workunit.client.1.smithi139.stdout:9/143: unlink dc/d11/f24 0 2024-09-17T07:19:46.939 INFO:tasks.workunit.client.0.smithi087.stdout:0/279: symlink db/d45/d5b/l65 0 2024-09-17T07:19:46.939 INFO:tasks.workunit.client.1.smithi139.stdout:9/144: chown dc/d11/d15 9 1 2024-09-17T07:19:46.939 INFO:tasks.workunit.client.0.smithi087.stdout:0/280: creat db/d45/d5d/d63/f66 x:0 0 0 2024-09-17T07:19:46.941 INFO:tasks.workunit.client.1.smithi139.stdout:9/145: creat dc/d11/d15/d1e/f2f x:0 0 0 2024-09-17T07:19:46.943 INFO:tasks.workunit.client.1.smithi139.stdout:9/146: unlink dc/l14 0 2024-09-17T07:19:46.948 INFO:tasks.workunit.client.0.smithi087.stdout:0/281: rmdir db/d45 39 2024-09-17T07:19:46.950 INFO:tasks.workunit.client.0.smithi087.stdout:0/282: mknod db/d45/d5d/c67 0 2024-09-17T07:19:46.951 INFO:tasks.workunit.client.0.smithi087.stdout:0/283: creat db/d45/f68 x:0 0 0 2024-09-17T07:19:46.953 INFO:tasks.workunit.client.0.smithi087.stdout:0/284: write db/f48 [352192,59646] 0 2024-09-17T07:19:46.961 INFO:tasks.workunit.client.0.smithi087.stdout:0/285: dwrite db/f18 [0,4194304] 0 2024-09-17T07:19:46.961 INFO:tasks.workunit.client.0.smithi087.stdout:0/286: chown db/f1d 5712141 1 2024-09-17T07:19:46.962 INFO:tasks.workunit.client.0.smithi087.stdout:0/287: symlink db/d45/d5d/d63/l69 0 2024-09-17T07:19:46.962 INFO:tasks.workunit.client.0.smithi087.stdout:0/288: write db/f18 [4434800,84163] 0 2024-09-17T07:19:46.964 INFO:tasks.workunit.client.0.smithi087.stdout:1/170: sync 2024-09-17T07:19:46.964 INFO:tasks.workunit.client.0.smithi087.stdout:1/171: stat d2/dc/f3a 0 2024-09-17T07:19:46.966 INFO:tasks.workunit.client.0.smithi087.stdout:0/289: link db/f54 db/d45/d5b/f6a 0 2024-09-17T07:19:46.968 INFO:tasks.workunit.client.0.smithi087.stdout:0/290: creat db/d45/d5d/d63/f6b x:0 0 0 2024-09-17T07:19:47.135 INFO:tasks.workunit.client.0.smithi087.stdout:2/210: sync 2024-09-17T07:19:47.135 INFO:tasks.workunit.client.0.smithi087.stdout:5/255: sync 2024-09-17T07:19:47.136 INFO:tasks.workunit.client.0.smithi087.stdout:2/211: chown d2/d7/f8 21761 1 2024-09-17T07:19:47.137 INFO:tasks.workunit.client.0.smithi087.stdout:5/256: mknod d5/d18/d20/c5d 0 2024-09-17T07:19:47.139 INFO:tasks.workunit.client.0.smithi087.stdout:5/257: getdents d5/d12 0 2024-09-17T07:19:47.141 INFO:tasks.workunit.client.0.smithi087.stdout:5/258: truncate d5/d12/f28 150954 0 2024-09-17T07:19:47.141 INFO:tasks.workunit.client.0.smithi087.stdout:5/259: stat d5/d8/d1f 0 2024-09-17T07:19:47.142 INFO:tasks.workunit.client.0.smithi087.stdout:2/212: dwrite d2/d7/dd/f29 [0,4194304] 0 2024-09-17T07:19:47.143 INFO:tasks.workunit.client.0.smithi087.stdout:5/260: fdatasync d5/d18/d20/d2f/f5c 0 2024-09-17T07:19:47.143 INFO:tasks.workunit.client.0.smithi087.stdout:2/213: stat d2/d24/c28 0 2024-09-17T07:19:47.144 INFO:tasks.workunit.client.0.smithi087.stdout:5/261: chown d5/d18/f38 192100 1 2024-09-17T07:19:47.146 INFO:tasks.workunit.client.0.smithi087.stdout:5/262: fsync d5/f17 0 2024-09-17T07:19:47.150 INFO:tasks.workunit.client.0.smithi087.stdout:2/214: dwrite d2/d24/d36/f39 [0,4194304] 0 2024-09-17T07:19:47.151 INFO:tasks.workunit.client.0.smithi087.stdout:2/215: stat d2/d12/f2a 0 2024-09-17T07:19:47.153 INFO:tasks.workunit.client.0.smithi087.stdout:2/216: symlink d2/d12/l41 0 2024-09-17T07:19:47.156 INFO:tasks.workunit.client.1.smithi139.stdout:4/63: sync 2024-09-17T07:19:47.157 INFO:tasks.workunit.client.0.smithi087.stdout:2/217: dread d2/d7/dd/f29 [0,4194304] 0 2024-09-17T07:19:47.157 INFO:tasks.workunit.client.1.smithi139.stdout:4/64: truncate d0/d1/f8 317506 0 2024-09-17T07:19:47.158 INFO:tasks.workunit.client.0.smithi087.stdout:2/218: creat d2/d7/d30/f42 x:0 0 0 2024-09-17T07:19:47.165 INFO:tasks.workunit.client.1.smithi139.stdout:4/65: dread d0/f4 [0,4194304] 0 2024-09-17T07:19:47.165 INFO:tasks.workunit.client.1.smithi139.stdout:4/66: write d0/d1/f9 [4066053,19458] 0 2024-09-17T07:19:47.165 INFO:tasks.workunit.client.1.smithi139.stdout:4/67: mkdir d0/d10 0 2024-09-17T07:19:47.166 INFO:tasks.workunit.client.0.smithi087.stdout:2/219: dread d2/d7/dd/f29 [0,4194304] 0 2024-09-17T07:19:47.166 INFO:tasks.workunit.client.0.smithi087.stdout:2/220: creat d2/d7/dd/f43 x:0 0 0 2024-09-17T07:19:47.166 INFO:tasks.workunit.client.0.smithi087.stdout:2/221: symlink d2/d7/db/l44 0 2024-09-17T07:19:47.166 INFO:tasks.workunit.client.0.smithi087.stdout:2/222: dread - d2/d15/f2c zero size 2024-09-17T07:19:47.166 INFO:tasks.workunit.client.1.smithi139.stdout:4/68: symlink d0/l11 0 2024-09-17T07:19:47.168 INFO:tasks.workunit.client.1.smithi139.stdout:4/69: getdents d0/d10 0 2024-09-17T07:19:47.168 INFO:tasks.workunit.client.0.smithi087.stdout:2/223: creat d2/d15/f45 x:0 0 0 2024-09-17T07:19:47.168 INFO:tasks.workunit.client.1.smithi139.stdout:4/70: rmdir d0/db 39 2024-09-17T07:19:47.170 INFO:tasks.workunit.client.1.smithi139.stdout:4/71: mknod d0/d10/c12 0 2024-09-17T07:19:47.180 INFO:tasks.workunit.client.0.smithi087.stdout:2/224: dwrite d2/f25 [0,4194304] 0 2024-09-17T07:19:47.183 INFO:tasks.workunit.client.1.smithi139.stdout:4/72: dwrite d0/f4 [4194304,4194304] 0 2024-09-17T07:19:47.185 INFO:tasks.workunit.client.0.smithi087.stdout:2/225: dread d2/f37 [0,4194304] 0 2024-09-17T07:19:47.186 INFO:tasks.workunit.client.1.smithi139.stdout:4/73: creat d0/f13 x:0 0 0 2024-09-17T07:19:47.187 INFO:tasks.workunit.client.1.smithi139.stdout:4/74: truncate d0/d1/fd 340038 0 2024-09-17T07:19:47.187 INFO:tasks.workunit.client.0.smithi087.stdout:2/226: rmdir d2 39 2024-09-17T07:19:47.190 INFO:tasks.workunit.client.0.smithi087.stdout:2/227: mknod d2/d24/d36/c46 0 2024-09-17T07:19:47.190 INFO:tasks.workunit.client.1.smithi139.stdout:4/75: symlink d0/db/l14 0 2024-09-17T07:19:47.190 INFO:tasks.workunit.client.1.smithi139.stdout:4/76: chown d0/d1 7 1 2024-09-17T07:19:47.191 INFO:tasks.workunit.client.1.smithi139.stdout:4/77: write d0/f4 [6701298,33910] 0 2024-09-17T07:19:47.192 INFO:tasks.workunit.client.0.smithi087.stdout:2/228: rmdir d2/d24 39 2024-09-17T07:19:47.193 INFO:tasks.workunit.client.0.smithi087.stdout:2/229: truncate d2/d24/d36/f38 235198 0 2024-09-17T07:19:47.198 INFO:tasks.workunit.client.0.smithi087.stdout:2/230: dwrite d2/d7/f8 [0,4194304] 0 2024-09-17T07:19:47.199 INFO:tasks.workunit.client.1.smithi139.stdout:4/78: dwrite d0/f5 [4194304,4194304] 0 2024-09-17T07:19:47.199 INFO:tasks.workunit.client.1.smithi139.stdout:3/36: sync 2024-09-17T07:19:47.200 INFO:tasks.workunit.client.0.smithi087.stdout:2/231: write d2/d15/f23 [1986000,63380] 0 2024-09-17T07:19:47.203 INFO:tasks.workunit.client.1.smithi139.stdout:4/79: rename d0/d1/f9 to d0/d1/f15 0 2024-09-17T07:19:47.203 INFO:tasks.workunit.client.0.smithi087.stdout:2/232: symlink d2/d7/dd/d1f/d3a/l47 0 2024-09-17T07:19:47.205 INFO:tasks.workunit.client.1.smithi139.stdout:4/80: stat d0/d1/fd 0 2024-09-17T07:19:47.205 INFO:tasks.workunit.client.1.smithi139.stdout:3/37: dread d5/f7 [0,4194304] 0 2024-09-17T07:19:47.207 INFO:tasks.workunit.client.0.smithi087.stdout:9/130: sync 2024-09-17T07:19:47.207 INFO:tasks.workunit.client.0.smithi087.stdout:6/257: sync 2024-09-17T07:19:47.207 INFO:tasks.workunit.client.0.smithi087.stdout:0/291: sync 2024-09-17T07:19:47.207 INFO:tasks.workunit.client.0.smithi087.stdout:1/172: sync 2024-09-17T07:19:47.207 INFO:tasks.workunit.client.0.smithi087.stdout:4/155: sync 2024-09-17T07:19:47.207 INFO:tasks.workunit.client.0.smithi087.stdout:7/195: sync 2024-09-17T07:19:47.208 INFO:tasks.workunit.client.0.smithi087.stdout:3/167: sync 2024-09-17T07:19:47.208 INFO:tasks.workunit.client.0.smithi087.stdout:8/169: sync 2024-09-17T07:19:47.208 INFO:tasks.workunit.client.1.smithi139.stdout:4/81: unlink d0/db/ce 0 2024-09-17T07:19:47.208 INFO:tasks.workunit.client.1.smithi139.stdout:3/38: creat d5/fa x:0 0 0 2024-09-17T07:19:47.209 INFO:tasks.workunit.client.0.smithi087.stdout:6/258: chown d1/d6/d1a 32552 1 2024-09-17T07:19:47.209 INFO:tasks.workunit.client.1.smithi139.stdout:4/82: mknod d0/d10/c16 0 2024-09-17T07:19:47.209 INFO:tasks.workunit.client.0.smithi087.stdout:0/292: readlink db/d45/d5b/l65 0 2024-09-17T07:19:47.210 INFO:tasks.workunit.client.1.smithi139.stdout:3/39: write d5/fa [955180,100710] 0 2024-09-17T07:19:47.210 INFO:tasks.workunit.client.0.smithi087.stdout:1/173: dread - d2/d1a/f29 zero size 2024-09-17T07:19:47.211 INFO:tasks.workunit.client.0.smithi087.stdout:2/233: dread d2/d7/dd/d10/f1d [0,4194304] 0 2024-09-17T07:19:47.211 INFO:tasks.workunit.client.0.smithi087.stdout:4/156: fdatasync d2/d5/f2a 0 2024-09-17T07:19:47.211 INFO:tasks.workunit.client.1.smithi139.stdout:4/83: dread d0/d1/f8 [0,4194304] 0 2024-09-17T07:19:47.211 INFO:tasks.workunit.client.1.smithi139.stdout:4/84: stat d0/l11 0 2024-09-17T07:19:47.213 INFO:tasks.workunit.client.1.smithi139.stdout:3/40: rename l1 to d5/lb 0 2024-09-17T07:19:47.213 INFO:tasks.workunit.client.0.smithi087.stdout:3/168: creat d6/d16/f36 x:0 0 0 2024-09-17T07:19:47.213 INFO:tasks.workunit.client.0.smithi087.stdout:8/170: mkdir d1/d7/d9/d19/d3a 0 2024-09-17T07:19:47.214 INFO:tasks.workunit.client.1.smithi139.stdout:4/85: mkdir d0/db/d17 0 2024-09-17T07:19:47.214 INFO:tasks.workunit.client.1.smithi139.stdout:3/41: mknod d5/cc 0 2024-09-17T07:19:47.215 INFO:tasks.workunit.client.0.smithi087.stdout:6/259: dread - d1/d6/d1a/f41 zero size 2024-09-17T07:19:47.215 INFO:tasks.workunit.client.0.smithi087.stdout:1/174: symlink d2/d14/l46 0 2024-09-17T07:19:47.215 INFO:tasks.workunit.client.0.smithi087.stdout:0/293: truncate db/d45/f57 848382 0 2024-09-17T07:19:47.217 INFO:tasks.workunit.client.1.smithi139.stdout:4/86: rename d0/db/l14 to d0/db/d17/l18 0 2024-09-17T07:19:47.219 INFO:tasks.workunit.client.0.smithi087.stdout:1/175: stat d2/da/f30 0 2024-09-17T07:19:47.220 INFO:tasks.workunit.client.0.smithi087.stdout:0/294: truncate db/f13 6101924 0 2024-09-17T07:19:47.223 INFO:tasks.workunit.client.1.smithi139.stdout:4/87: dwrite d0/f7 [0,4194304] 0 2024-09-17T07:19:47.223 INFO:tasks.workunit.client.0.smithi087.stdout:1/176: rmdir d2/d1a 39 2024-09-17T07:19:47.224 INFO:tasks.workunit.client.0.smithi087.stdout:9/131: dwrite d3/d4/d6/d8/d22/f2d [0,4194304] 0 2024-09-17T07:19:47.225 INFO:tasks.workunit.client.1.smithi139.stdout:4/88: creat d0/db/f19 x:0 0 0 2024-09-17T07:19:47.226 INFO:tasks.workunit.client.0.smithi087.stdout:8/171: dread d1/d7/d9/d19/f1d [0,4194304] 0 2024-09-17T07:19:47.227 INFO:tasks.workunit.client.1.smithi139.stdout:4/89: write d0/d1/f15 [4845203,53337] 0 2024-09-17T07:19:47.230 INFO:tasks.workunit.client.0.smithi087.stdout:0/295: symlink db/d45/d5d/l6c 0 2024-09-17T07:19:47.231 INFO:tasks.workunit.client.1.smithi139.stdout:3/42: rmdir d5 39 2024-09-17T07:19:47.232 INFO:tasks.workunit.client.1.smithi139.stdout:4/90: dwrite d0/f4 [0,4194304] 0 2024-09-17T07:19:47.234 INFO:tasks.workunit.client.1.smithi139.stdout:3/43: chown d5/lb 9168 1 2024-09-17T07:19:47.235 INFO:tasks.workunit.client.1.smithi139.stdout:4/91: unlink d0/db/f19 0 2024-09-17T07:19:47.235 INFO:tasks.workunit.client.0.smithi087.stdout:3/169: dwrite d6/d15/f19 [4194304,4194304] 0 2024-09-17T07:19:47.237 INFO:tasks.workunit.client.1.smithi139.stdout:3/44: symlink d5/ld 0 2024-09-17T07:19:47.238 INFO:tasks.workunit.client.1.smithi139.stdout:3/45: rmdir d5 39 2024-09-17T07:19:47.239 INFO:tasks.workunit.client.0.smithi087.stdout:2/234: dwrite d2/d15/f45 [0,4194304] 0 2024-09-17T07:19:47.240 INFO:tasks.workunit.client.1.smithi139.stdout:2/143: sync 2024-09-17T07:19:47.240 INFO:tasks.workunit.client.1.smithi139.stdout:1/50: sync 2024-09-17T07:19:47.240 INFO:tasks.workunit.client.1.smithi139.stdout:7/43: sync 2024-09-17T07:19:47.240 INFO:tasks.workunit.client.1.smithi139.stdout:9/147: sync 2024-09-17T07:19:47.240 INFO:tasks.workunit.client.1.smithi139.stdout:8/107: sync 2024-09-17T07:19:47.240 INFO:tasks.workunit.client.1.smithi139.stdout:0/45: sync 2024-09-17T07:19:47.240 INFO:tasks.workunit.client.1.smithi139.stdout:6/153: sync 2024-09-17T07:19:47.240 INFO:tasks.workunit.client.1.smithi139.stdout:5/43: sync 2024-09-17T07:19:47.241 INFO:tasks.workunit.client.1.smithi139.stdout:7/44: chown d5 770197698 1 2024-09-17T07:19:47.242 INFO:tasks.workunit.client.1.smithi139.stdout:3/46: creat d5/fe x:0 0 0 2024-09-17T07:19:47.244 INFO:tasks.workunit.client.0.smithi087.stdout:8/172: rename d1/d2b/d21/d33 to d1/d2b/d3b 0 2024-09-17T07:19:47.244 INFO:tasks.workunit.client.1.smithi139.stdout:4/92: dread d0/f5 [4194304,4194304] 0 2024-09-17T07:19:47.245 INFO:tasks.workunit.client.1.smithi139.stdout:2/144: symlink d0/de/d25/l2e 0 2024-09-17T07:19:47.247 INFO:tasks.workunit.client.0.smithi087.stdout:0/296: rename db/d45/f52 to db/d45/f6d 0 2024-09-17T07:19:47.247 INFO:tasks.workunit.client.0.smithi087.stdout:3/170: mkdir d6/d15/d37 0 2024-09-17T07:19:47.247 INFO:tasks.workunit.client.0.smithi087.stdout:9/132: unlink d3/d4/d6/d8/d22/d2a/c2b 0 2024-09-17T07:19:47.247 INFO:tasks.workunit.client.1.smithi139.stdout:0/46: mknod d1/c10 0 2024-09-17T07:19:47.248 INFO:tasks.workunit.client.0.smithi087.stdout:9/133: read d3/d4/d6/d8/f18 [491592,13377] 0 2024-09-17T07:19:47.249 INFO:tasks.workunit.client.0.smithi087.stdout:6/260: link d1/l27 d1/d6/d1a/d2c/d48/l53 0 2024-09-17T07:19:47.249 INFO:tasks.workunit.client.1.smithi139.stdout:4/93: fdatasync d0/f13 0 2024-09-17T07:19:47.249 INFO:tasks.workunit.client.1.smithi139.stdout:5/44: mknod d4/de/c11 0 2024-09-17T07:19:47.250 INFO:tasks.workunit.client.1.smithi139.stdout:6/154: symlink db/df/d2a/l34 0 2024-09-17T07:19:47.250 INFO:tasks.workunit.client.0.smithi087.stdout:1/177: truncate d2/da/f16 107024 0 2024-09-17T07:19:47.252 INFO:tasks.workunit.client.1.smithi139.stdout:2/145: fsync d0/dc/d15/f17 0 2024-09-17T07:19:47.252 INFO:tasks.workunit.client.1.smithi139.stdout:0/47: fsync d1/da/fc 0 2024-09-17T07:19:47.254 INFO:tasks.workunit.client.0.smithi087.stdout:9/134: creat d3/d4/d6/d8/d22/f2e x:0 0 0 2024-09-17T07:19:47.255 INFO:tasks.workunit.client.0.smithi087.stdout:2/235: mkdir d2/d48 0 2024-09-17T07:19:47.256 INFO:tasks.workunit.client.1.smithi139.stdout:6/155: fdatasync db/df/f13 0 2024-09-17T07:19:47.258 INFO:tasks.workunit.client.0.smithi087.stdout:0/297: creat db/f6e x:0 0 0 2024-09-17T07:19:47.260 INFO:tasks.workunit.client.0.smithi087.stdout:1/178: dwrite d2/d14/fb [4194304,4194304] 0 2024-09-17T07:19:47.260 INFO:tasks.workunit.client.0.smithi087.stdout:9/135: mkdir d3/d4/d2f 0 2024-09-17T07:19:47.261 INFO:tasks.workunit.client.0.smithi087.stdout:2/236: write d2/d7/dd/f29 [4773204,6176] 0 2024-09-17T07:19:47.261 INFO:tasks.workunit.client.1.smithi139.stdout:2/146: unlink d0/l1f 0 2024-09-17T07:19:47.262 INFO:tasks.workunit.client.1.smithi139.stdout:9/148: dread fb [0,4194304] 0 2024-09-17T07:19:47.262 INFO:tasks.workunit.client.0.smithi087.stdout:0/298: symlink db/d45/d5d/l6f 0 2024-09-17T07:19:47.263 INFO:tasks.workunit.client.1.smithi139.stdout:0/48: rmdir d1 39 2024-09-17T07:19:47.263 INFO:tasks.workunit.client.0.smithi087.stdout:0/299: stat db/l30 0 2024-09-17T07:19:47.264 INFO:tasks.workunit.client.1.smithi139.stdout:5/45: rmdir d4/de/d10 0 2024-09-17T07:19:47.265 INFO:tasks.workunit.client.0.smithi087.stdout:6/261: rename d1/d6/d1a/d2c/d40/f45 to d1/d6/d1a/d2c/d33/f54 0 2024-09-17T07:19:47.268 INFO:tasks.workunit.client.0.smithi087.stdout:9/136: write d3/f7 [3306190,106941] 0 2024-09-17T07:19:47.269 INFO:tasks.workunit.client.1.smithi139.stdout:6/156: write db/d18/f1a [8990769,91322] 0 2024-09-17T07:19:47.270 INFO:tasks.workunit.client.1.smithi139.stdout:8/108: dwrite d0/f1b [0,4194304] 0 2024-09-17T07:19:47.271 INFO:tasks.workunit.client.1.smithi139.stdout:4/94: getdents d0/d1 0 2024-09-17T07:19:47.271 INFO:tasks.workunit.client.0.smithi087.stdout:1/179: rename d2/d3d/f9 to d2/d14/dd/f47 0 2024-09-17T07:19:47.272 INFO:tasks.workunit.client.0.smithi087.stdout:2/237: read d2/d15/f32 [381895,128925] 0 2024-09-17T07:19:47.272 INFO:tasks.workunit.client.0.smithi087.stdout:9/137: chown d3/d4/d6/d8/d22/l2c 2 1 2024-09-17T07:19:47.273 INFO:tasks.workunit.client.1.smithi139.stdout:7/45: dwrite d5/fb [0,4194304] 0 2024-09-17T07:19:47.274 INFO:tasks.workunit.client.1.smithi139.stdout:0/49: dread d1/f3 [0,4194304] 0 2024-09-17T07:19:47.274 INFO:tasks.workunit.client.0.smithi087.stdout:2/238: chown d2/d7/dd/f43 0 1 2024-09-17T07:19:47.274 INFO:tasks.workunit.client.0.smithi087.stdout:0/300: dwrite db/f6e [0,4194304] 0 2024-09-17T07:19:47.275 INFO:tasks.workunit.client.0.smithi087.stdout:6/262: mknod d1/d6/d1a/d4e/c55 0 2024-09-17T07:19:47.276 INFO:tasks.workunit.client.1.smithi139.stdout:1/51: dwrite d2/f6 [0,4194304] 0 2024-09-17T07:19:47.277 INFO:tasks.workunit.client.1.smithi139.stdout:5/46: symlink d4/de/l12 0 2024-09-17T07:19:47.278 INFO:tasks.workunit.client.0.smithi087.stdout:1/180: rmdir d2/da 39 2024-09-17T07:19:47.278 INFO:tasks.workunit.client.0.smithi087.stdout:3/171: truncate d6/f27 2680513 0 2024-09-17T07:19:47.281 INFO:tasks.workunit.client.0.smithi087.stdout:2/239: unlink d2/f37 0 2024-09-17T07:19:47.282 INFO:tasks.workunit.client.0.smithi087.stdout:5/263: sync 2024-09-17T07:19:47.284 INFO:tasks.workunit.client.0.smithi087.stdout:0/301: rename db/f46 to db/d45/d5d/f70 0 2024-09-17T07:19:47.284 INFO:tasks.workunit.client.0.smithi087.stdout:2/240: read - d2/d7/d30/f42 zero size 2024-09-17T07:19:47.284 INFO:tasks.workunit.client.1.smithi139.stdout:3/47: dwrite d5/fe [0,4194304] 0 2024-09-17T07:19:47.284 INFO:tasks.workunit.client.1.smithi139.stdout:4/95: write d0/f5 [1803304,12438] 0 2024-09-17T07:19:47.285 INFO:tasks.workunit.client.0.smithi087.stdout:9/138: link d3/f7 d3/d25/f30 0 2024-09-17T07:19:47.286 INFO:tasks.workunit.client.0.smithi087.stdout:3/172: creat d6/d16/f38 x:0 0 0 2024-09-17T07:19:47.286 INFO:tasks.workunit.client.1.smithi139.stdout:8/109: creat d0/dc/d18/f1f x:0 0 0 2024-09-17T07:19:47.287 INFO:tasks.workunit.client.1.smithi139.stdout:9/149: getdents dc/d11 0 2024-09-17T07:19:47.287 INFO:tasks.workunit.client.0.smithi087.stdout:0/302: dread - db/d45/f51 zero size 2024-09-17T07:19:47.287 INFO:tasks.workunit.client.0.smithi087.stdout:6/263: dwrite d1/f11 [0,4194304] 0 2024-09-17T07:19:47.287 INFO:tasks.workunit.client.0.smithi087.stdout:3/173: chown d6/d16 1098412846 1 2024-09-17T07:19:47.288 INFO:tasks.workunit.client.1.smithi139.stdout:2/147: link d0/dc/d15/f23 d0/dc/f2f 0 2024-09-17T07:19:47.288 INFO:tasks.workunit.client.0.smithi087.stdout:5/264: write d5/d18/d20/d2f/f48 [2103515,43631] 0 2024-09-17T07:19:47.288 INFO:tasks.workunit.client.1.smithi139.stdout:7/46: chown d5/l8 236475 1 2024-09-17T07:19:47.289 INFO:tasks.workunit.client.0.smithi087.stdout:1/181: fsync d2/d14/dd/f18 0 2024-09-17T07:19:47.289 INFO:tasks.workunit.client.1.smithi139.stdout:5/47: truncate d4/f9 336210 0 2024-09-17T07:19:47.289 INFO:tasks.workunit.client.1.smithi139.stdout:1/52: creat d2/fd x:0 0 0 2024-09-17T07:19:47.290 INFO:tasks.workunit.client.0.smithi087.stdout:2/241: truncate d2/d15/f2c 438881 0 2024-09-17T07:19:47.291 INFO:tasks.workunit.client.1.smithi139.stdout:6/157: chown db/f16 28 1 2024-09-17T07:19:47.291 INFO:tasks.workunit.client.1.smithi139.stdout:8/110: mkdir d0/d20 0 2024-09-17T07:19:47.294 INFO:tasks.workunit.client.0.smithi087.stdout:0/303: mknod db/d45/c71 0 2024-09-17T07:19:47.294 INFO:tasks.workunit.client.0.smithi087.stdout:1/182: mkdir d2/d48 0 2024-09-17T07:19:47.296 INFO:tasks.workunit.client.1.smithi139.stdout:6/158: fsync db/df/d2a/f2f 0 2024-09-17T07:19:47.297 INFO:tasks.workunit.client.1.smithi139.stdout:1/53: write d2/f7 [4965040,57534] 0 2024-09-17T07:19:47.299 INFO:tasks.workunit.client.1.smithi139.stdout:2/148: symlink d0/dc/d15/l30 0 2024-09-17T07:19:47.300 INFO:tasks.workunit.client.1.smithi139.stdout:5/48: truncate d4/f9 1323553 0 2024-09-17T07:19:47.300 INFO:tasks.workunit.client.1.smithi139.stdout:9/150: write dc/d11/f1b [3061401,5723] 0 2024-09-17T07:19:47.301 INFO:tasks.workunit.client.1.smithi139.stdout:0/50: creat d1/df/f11 x:0 0 0 2024-09-17T07:19:47.302 INFO:tasks.workunit.client.0.smithi087.stdout:1/183: creat d2/d3d/f49 x:0 0 0 2024-09-17T07:19:47.302 INFO:tasks.workunit.client.1.smithi139.stdout:7/47: link d5/lc d5/ld 0 2024-09-17T07:19:47.303 INFO:tasks.workunit.client.1.smithi139.stdout:4/96: dwrite d0/f13 [0,4194304] 0 2024-09-17T07:19:47.304 INFO:tasks.workunit.client.1.smithi139.stdout:7/48: write d5/fb [329815,11263] 0 2024-09-17T07:19:47.304 INFO:tasks.workunit.client.0.smithi087.stdout:5/265: dread d5/d18/d20/f35 [0,4194304] 0 2024-09-17T07:19:47.305 INFO:tasks.workunit.client.1.smithi139.stdout:6/159: link f7 db/d18/f35 0 2024-09-17T07:19:47.305 INFO:tasks.workunit.client.0.smithi087.stdout:0/304: dread db/f6e [0,4194304] 0 2024-09-17T07:19:47.306 INFO:tasks.workunit.client.0.smithi087.stdout:2/242: dwrite d2/d7/dd/f43 [0,4194304] 0 2024-09-17T07:19:47.307 INFO:tasks.workunit.client.0.smithi087.stdout:0/305: dread - db/d45/d5d/d63/f66 zero size 2024-09-17T07:19:47.309 INFO:tasks.workunit.client.0.smithi087.stdout:0/306: chown db/d45/d5b/l65 530336 1 2024-09-17T07:19:47.310 INFO:tasks.workunit.client.0.smithi087.stdout:1/184: write d2/d14/dd/ff [340506,18030] 0 2024-09-17T07:19:47.312 INFO:tasks.workunit.client.0.smithi087.stdout:9/139: link d3/d4/d6/f13 d3/d4/da/d1c/d1e/f31 0 2024-09-17T07:19:47.312 INFO:tasks.workunit.client.1.smithi139.stdout:7/49: write d5/fb [2321319,122570] 0 2024-09-17T07:19:47.312 INFO:tasks.workunit.client.1.smithi139.stdout:2/149: mknod d0/d7/d1a/d1b/c31 0 2024-09-17T07:19:47.313 INFO:tasks.workunit.client.0.smithi087.stdout:0/307: readlink db/d45/d5d/l6c 0 2024-09-17T07:19:47.314 INFO:tasks.workunit.client.0.smithi087.stdout:5/266: creat d5/d8/d1f/d4e/f5e x:0 0 0 2024-09-17T07:19:47.314 INFO:tasks.workunit.client.1.smithi139.stdout:0/51: mknod d1/df/c12 0 2024-09-17T07:19:47.316 INFO:tasks.workunit.client.0.smithi087.stdout:0/308: write db/f12 [423201,129527] 0 2024-09-17T07:19:47.317 INFO:tasks.workunit.client.0.smithi087.stdout:1/185: mkdir d2/da/d4a 0 2024-09-17T07:19:47.318 INFO:tasks.workunit.client.0.smithi087.stdout:9/140: mkdir d3/d4/d6/d8/d12/d32 0 2024-09-17T07:19:47.320 INFO:tasks.workunit.client.0.smithi087.stdout:2/243: dwrite d2/d7/f8 [0,4194304] 0 2024-09-17T07:19:47.320 INFO:tasks.workunit.client.0.smithi087.stdout:0/309: dread - db/d4f/f55 zero size 2024-09-17T07:19:47.321 INFO:tasks.workunit.client.1.smithi139.stdout:9/151: mknod dc/c30 0 2024-09-17T07:19:47.322 INFO:tasks.workunit.client.0.smithi087.stdout:0/310: stat db/d45/f6d 0 2024-09-17T07:19:47.322 INFO:tasks.workunit.client.1.smithi139.stdout:7/50: rename d5/l6 to d5/le 0 2024-09-17T07:19:47.322 INFO:tasks.workunit.client.0.smithi087.stdout:1/186: creat d2/d14/dd/d43/f4b x:0 0 0 2024-09-17T07:19:47.324 INFO:tasks.workunit.client.1.smithi139.stdout:2/150: mkdir d0/de/d11/d32 0 2024-09-17T07:19:47.324 INFO:tasks.workunit.client.1.smithi139.stdout:8/111: fdatasync d0/f1b 0 2024-09-17T07:19:47.324 INFO:tasks.workunit.client.0.smithi087.stdout:9/141: write d3/d4/d6/d8/f18 [4784731,59697] 0 2024-09-17T07:19:47.324 INFO:tasks.workunit.client.0.smithi087.stdout:2/244: creat d2/d24/d36/f49 x:0 0 0 2024-09-17T07:19:47.325 INFO:tasks.workunit.client.0.smithi087.stdout:5/267: dread d5/d8/f10 [0,4194304] 0 2024-09-17T07:19:47.326 INFO:tasks.workunit.client.0.smithi087.stdout:1/187: truncate d2/dc/f3b 1011127 0 2024-09-17T07:19:47.326 INFO:tasks.workunit.client.0.smithi087.stdout:0/311: mknod db/c72 0 2024-09-17T07:19:47.326 INFO:tasks.workunit.client.0.smithi087.stdout:9/142: write d3/d4/f26 [79828,107493] 0 2024-09-17T07:19:47.327 INFO:tasks.workunit.client.0.smithi087.stdout:5/268: dread - d5/d12/d4d/f47 zero size 2024-09-17T07:19:47.328 INFO:tasks.workunit.client.0.smithi087.stdout:2/245: unlink d2/d12/l35 0 2024-09-17T07:19:47.329 INFO:tasks.workunit.client.1.smithi139.stdout:0/52: symlink d1/df/l13 0 2024-09-17T07:19:47.329 INFO:tasks.workunit.client.1.smithi139.stdout:8/112: write d0/dc/d18/f1c [351918,108387] 0 2024-09-17T07:19:47.329 INFO:tasks.workunit.client.0.smithi087.stdout:0/312: mkdir db/d45/d73 0 2024-09-17T07:19:47.330 INFO:tasks.workunit.client.1.smithi139.stdout:4/97: mkdir d0/d1a 0 2024-09-17T07:19:47.331 INFO:tasks.workunit.client.0.smithi087.stdout:0/313: write db/f3e [4548768,64171] 0 2024-09-17T07:19:47.332 INFO:tasks.workunit.client.0.smithi087.stdout:0/314: readlink db/l43 0 2024-09-17T07:19:47.333 INFO:tasks.workunit.client.0.smithi087.stdout:5/269: creat d5/d18/d20/f5f x:0 0 0 2024-09-17T07:19:47.335 INFO:tasks.workunit.client.0.smithi087.stdout:5/270: fdatasync d5/d18/d20/d2f/f48 0 2024-09-17T07:19:47.335 INFO:tasks.workunit.client.0.smithi087.stdout:2/246: mknod d2/d7/d30/c4a 0 2024-09-17T07:19:47.336 INFO:tasks.workunit.client.0.smithi087.stdout:9/143: creat d3/d4/d6/d8/d12/d32/f33 x:0 0 0 2024-09-17T07:19:47.337 INFO:tasks.workunit.client.0.smithi087.stdout:0/315: write db/d45/d5d/f70 [216205,13611] 0 2024-09-17T07:19:47.338 INFO:tasks.workunit.client.1.smithi139.stdout:9/152: link dc/d11/d15/d1e/f21 dc/d2c/f31 0 2024-09-17T07:19:47.338 INFO:tasks.workunit.client.1.smithi139.stdout:4/98: read d0/f7 [2606208,27073] 0 2024-09-17T07:19:47.339 INFO:tasks.workunit.client.1.smithi139.stdout:7/51: dread f2 [4194304,4194304] 0 2024-09-17T07:19:47.339 INFO:tasks.workunit.client.1.smithi139.stdout:0/53: creat d1/da/f14 x:0 0 0 2024-09-17T07:19:47.339 INFO:tasks.workunit.client.0.smithi087.stdout:2/247: unlink d2/d15/f23 0 2024-09-17T07:19:47.340 INFO:tasks.workunit.client.0.smithi087.stdout:5/271: mkdir d5/d18/d20/d2f/d60 0 2024-09-17T07:19:47.341 INFO:tasks.workunit.client.0.smithi087.stdout:1/188: getdents d2/d3d/d35 0 2024-09-17T07:19:47.341 INFO:tasks.workunit.client.1.smithi139.stdout:2/151: dread d0/dc/f20 [0,4194304] 0 2024-09-17T07:19:47.342 INFO:tasks.workunit.client.0.smithi087.stdout:9/144: symlink d3/d4/da/d1c/d1e/l34 0 2024-09-17T07:19:47.342 INFO:tasks.workunit.client.1.smithi139.stdout:8/113: dread d0/dc/d18/f1c [0,4194304] 0 2024-09-17T07:19:47.343 INFO:tasks.workunit.client.0.smithi087.stdout:9/145: stat d3/d4 0 2024-09-17T07:19:47.343 INFO:tasks.workunit.client.0.smithi087.stdout:0/316: mknod db/d4f/c74 0 2024-09-17T07:19:47.345 INFO:tasks.workunit.client.1.smithi139.stdout:7/52: chown d5/ca 2 1 2024-09-17T07:19:47.346 INFO:tasks.workunit.client.1.smithi139.stdout:9/153: creat dc/d2a/f32 x:0 0 0 2024-09-17T07:19:47.347 INFO:tasks.workunit.client.0.smithi087.stdout:0/317: write db/d45/d5d/f70 [382512,44154] 0 2024-09-17T07:19:47.347 INFO:tasks.workunit.client.1.smithi139.stdout:9/154: chown dc/d2c/f31 276128 1 2024-09-17T07:19:47.347 INFO:tasks.workunit.client.1.smithi139.stdout:0/54: symlink d1/da/l15 0 2024-09-17T07:19:47.348 INFO:tasks.workunit.client.1.smithi139.stdout:3/48: truncate d5/f7 2045707 0 2024-09-17T07:19:47.349 INFO:tasks.workunit.client.0.smithi087.stdout:6/264: dwrite d1/d6/d1a/d2c/d40/f4d [0,4194304] 0 2024-09-17T07:19:47.349 INFO:tasks.workunit.client.0.smithi087.stdout:0/318: write db/f35 [1678584,87585] 0 2024-09-17T07:19:47.350 INFO:tasks.workunit.client.1.smithi139.stdout:2/152: symlink d0/de/d25/l33 0 2024-09-17T07:19:47.350 INFO:tasks.workunit.client.0.smithi087.stdout:1/189: dread d2/dc/f40 [0,4194304] 0 2024-09-17T07:19:47.352 INFO:tasks.workunit.client.1.smithi139.stdout:8/114: unlink d0/f1b 0 2024-09-17T07:19:47.352 INFO:tasks.workunit.client.0.smithi087.stdout:2/248: mkdir d2/d15/d4b 0 2024-09-17T07:19:47.352 INFO:tasks.workunit.client.0.smithi087.stdout:9/146: read d3/d4/da/d1c/d1e/f31 [111692,128278] 0 2024-09-17T07:19:47.356 INFO:tasks.workunit.client.1.smithi139.stdout:7/53: write f2 [7137650,105762] 0 2024-09-17T07:19:47.356 INFO:tasks.workunit.client.0.smithi087.stdout:6/265: creat d1/d6/d1a/d2c/d40/f56 x:0 0 0 2024-09-17T07:19:47.358 INFO:tasks.workunit.client.1.smithi139.stdout:9/155: creat dc/d11/d15/d1e/f33 x:0 0 0 2024-09-17T07:19:47.358 INFO:tasks.workunit.client.0.smithi087.stdout:2/249: mkdir d2/d7/dd/d10/d4c 0 2024-09-17T07:19:47.359 INFO:tasks.workunit.client.1.smithi139.stdout:3/49: mknod d5/cf 0 2024-09-17T07:19:47.361 INFO:tasks.workunit.client.1.smithi139.stdout:8/115: dread d0/dc/f12 [0,4194304] 0 2024-09-17T07:19:47.361 INFO:tasks.workunit.client.0.smithi087.stdout:5/272: rmdir d5/d18/d59 0 2024-09-17T07:19:47.362 INFO:tasks.workunit.client.0.smithi087.stdout:9/147: truncate d3/d4/da/d1c/d1e/f31 307309 0 2024-09-17T07:19:47.362 INFO:tasks.workunit.client.1.smithi139.stdout:2/153: mknod d0/d7/d1a/d1b/c34 0 2024-09-17T07:19:47.365 INFO:tasks.workunit.client.0.smithi087.stdout:6/266: dwrite d1/d6/d1a/d2c/d33/f3d [0,4194304] 0 2024-09-17T07:19:47.370 INFO:tasks.workunit.client.0.smithi087.stdout:9/148: truncate d3/f1f 337849 0 2024-09-17T07:19:47.370 INFO:tasks.workunit.client.0.smithi087.stdout:5/273: mkdir d5/d12/d14/d61 0 2024-09-17T07:19:47.370 INFO:tasks.workunit.client.0.smithi087.stdout:5/274: chown d5/d18/f4a 0 1 2024-09-17T07:19:47.370 INFO:tasks.workunit.client.1.smithi139.stdout:7/54: mknod d5/cf 0 2024-09-17T07:19:47.370 INFO:tasks.workunit.client.1.smithi139.stdout:9/156: mkdir dc/d11/d15/d1e/d34 0 2024-09-17T07:19:47.370 INFO:tasks.workunit.client.1.smithi139.stdout:3/50: dwrite d5/fa [0,4194304] 0 2024-09-17T07:19:47.371 INFO:tasks.workunit.client.1.smithi139.stdout:3/51: stat d5/cf 0 2024-09-17T07:19:47.372 INFO:tasks.workunit.client.1.smithi139.stdout:9/157: truncate dc/d11/d15/d1e/f29 35177 0 2024-09-17T07:19:47.372 INFO:tasks.workunit.client.0.smithi087.stdout:5/275: stat d5/d12/d56 0 2024-09-17T07:19:47.373 INFO:tasks.workunit.client.0.smithi087.stdout:2/250: symlink d2/d7/d33/l4d 0 2024-09-17T07:19:47.373 INFO:tasks.workunit.client.1.smithi139.stdout:5/49: truncate d4/f9 1263230 0 2024-09-17T07:19:47.373 INFO:tasks.workunit.client.1.smithi139.stdout:3/52: dread d5/fa [0,4194304] 0 2024-09-17T07:19:47.374 INFO:tasks.workunit.client.0.smithi087.stdout:2/251: chown d2/d24/d36/f39 460 1 2024-09-17T07:19:47.374 INFO:tasks.workunit.client.1.smithi139.stdout:9/158: dread fb [0,4194304] 0 2024-09-17T07:19:47.375 INFO:tasks.workunit.client.0.smithi087.stdout:9/149: rename d3/d4/d16/f1d to d3/d4/da/f35 0 2024-09-17T07:19:47.375 INFO:tasks.workunit.client.1.smithi139.stdout:6/160: truncate f8 456592 0 2024-09-17T07:19:47.376 INFO:tasks.workunit.client.1.smithi139.stdout:9/159: write dc/d11/d15/f18 [664750,10029] 0 2024-09-17T07:19:47.376 INFO:tasks.workunit.client.0.smithi087.stdout:9/150: chown d3/d4/d6/d8 49 1 2024-09-17T07:19:47.376 INFO:tasks.workunit.client.0.smithi087.stdout:0/319: getdents db/d45/d5d 0 2024-09-17T07:19:47.377 INFO:tasks.workunit.client.1.smithi139.stdout:4/99: getdents d0 0 2024-09-17T07:19:47.378 INFO:tasks.workunit.client.0.smithi087.stdout:5/276: unlink d5/d8/d1f/f2e 0 2024-09-17T07:19:47.379 INFO:tasks.workunit.client.0.smithi087.stdout:1/190: getdents d2/d3d 0 2024-09-17T07:19:47.381 INFO:tasks.workunit.client.0.smithi087.stdout:2/252: creat d2/d7/d30/f4e x:0 0 0 2024-09-17T07:19:47.383 INFO:tasks.workunit.client.0.smithi087.stdout:9/151: dread d3/d25/f30 [0,4194304] 0 2024-09-17T07:19:47.383 INFO:tasks.workunit.client.1.smithi139.stdout:0/55: link d1/lb d1/l16 0 2024-09-17T07:19:47.384 INFO:tasks.workunit.client.0.smithi087.stdout:2/253: write d2/d15/f2c [1002012,8696] 0 2024-09-17T07:19:47.384 INFO:tasks.workunit.client.0.smithi087.stdout:0/320: creat db/d45/f75 x:0 0 0 2024-09-17T07:19:47.385 INFO:tasks.workunit.client.0.smithi087.stdout:6/267: creat d1/d6/d1a/f57 x:0 0 0 2024-09-17T07:19:47.385 INFO:tasks.workunit.client.1.smithi139.stdout:8/116: creat d0/d1a/f21 x:0 0 0 2024-09-17T07:19:47.385 INFO:tasks.workunit.client.0.smithi087.stdout:9/152: dread - d3/d4/da/f15 zero size 2024-09-17T07:19:47.387 INFO:tasks.workunit.client.1.smithi139.stdout:9/160: dwrite dc/d11/f1b [0,4194304] 0 2024-09-17T07:19:47.387 INFO:tasks.workunit.client.1.smithi139.stdout:8/117: fdatasync d0/fd 0 2024-09-17T07:19:47.387 INFO:tasks.workunit.client.0.smithi087.stdout:2/254: chown d2/f16 5 1 2024-09-17T07:19:47.387 INFO:tasks.workunit.client.0.smithi087.stdout:1/191: mknod d2/d14/dd/d37/c4c 0 2024-09-17T07:19:47.388 INFO:tasks.workunit.client.0.smithi087.stdout:9/153: stat d3/d4/d6/d8/f18 0 2024-09-17T07:19:47.388 INFO:tasks.workunit.client.0.smithi087.stdout:2/255: fdatasync d2/d24/d36/f49 0 2024-09-17T07:19:47.388 INFO:tasks.workunit.client.1.smithi139.stdout:8/118: read d0/f7 [749207,55965] 0 2024-09-17T07:19:47.388 INFO:tasks.workunit.client.1.smithi139.stdout:3/53: mkdir d5/d10 0 2024-09-17T07:19:47.389 INFO:tasks.workunit.client.1.smithi139.stdout:3/54: readlink d5/l8 0 2024-09-17T07:19:47.389 INFO:tasks.workunit.client.0.smithi087.stdout:0/321: rmdir db/d4f 39 2024-09-17T07:19:47.394 INFO:tasks.workunit.client.1.smithi139.stdout:6/161: mknod db/d21/c36 0 2024-09-17T07:19:47.396 INFO:tasks.workunit.client.0.smithi087.stdout:9/154: rename d3/d4/ce to d3/d25/c36 0 2024-09-17T07:19:47.396 INFO:tasks.workunit.client.1.smithi139.stdout:7/55: unlink l0 0 2024-09-17T07:19:47.398 INFO:tasks.workunit.client.0.smithi087.stdout:9/155: write d3/d4/da/f15 [336485,31145] 0 2024-09-17T07:19:47.398 INFO:tasks.workunit.client.0.smithi087.stdout:0/322: creat db/d45/d5d/f76 x:0 0 0 2024-09-17T07:19:47.398 INFO:tasks.workunit.client.1.smithi139.stdout:0/56: mkdir d1/da/d17 0 2024-09-17T07:19:47.399 INFO:tasks.workunit.client.1.smithi139.stdout:0/57: dread d1/f3 [0,4194304] 0 2024-09-17T07:19:47.399 INFO:tasks.workunit.client.0.smithi087.stdout:6/268: mkdir d1/d6/d1a/d2c/d58 0 2024-09-17T07:19:47.400 INFO:tasks.workunit.client.1.smithi139.stdout:0/58: chown d1/f3 3 1 2024-09-17T07:19:47.401 INFO:tasks.workunit.client.1.smithi139.stdout:7/56: dread d5/fb [0,4194304] 0 2024-09-17T07:19:47.401 INFO:tasks.workunit.client.0.smithi087.stdout:6/269: truncate d1/d6/d1a/f41 860121 0 2024-09-17T07:19:47.402 INFO:tasks.workunit.client.0.smithi087.stdout:1/192: unlink d2/d1a/f27 0 2024-09-17T07:19:47.403 INFO:tasks.workunit.client.0.smithi087.stdout:1/193: dread - d2/da/f30 zero size 2024-09-17T07:19:47.403 INFO:tasks.workunit.client.0.smithi087.stdout:0/323: symlink db/d45/d5d/l77 0 2024-09-17T07:19:47.404 INFO:tasks.workunit.client.1.smithi139.stdout:3/55: rename d5/fa to d5/f11 0 2024-09-17T07:19:47.404 INFO:tasks.workunit.client.0.smithi087.stdout:0/324: dread - db/d45/f75 zero size 2024-09-17T07:19:47.405 INFO:tasks.workunit.client.1.smithi139.stdout:6/162: creat db/d18/d1b/f37 x:0 0 0 2024-09-17T07:19:47.405 INFO:tasks.workunit.client.0.smithi087.stdout:5/277: write d5/d8/f3f [1573573,36994] 0 2024-09-17T07:19:47.406 INFO:tasks.workunit.client.0.smithi087.stdout:5/278: fdatasync d5/d18/d20/fa 0 2024-09-17T07:19:47.406 INFO:tasks.workunit.client.1.smithi139.stdout:5/50: link d4/l8 d4/de/l13 0 2024-09-17T07:19:47.407 INFO:tasks.workunit.client.0.smithi087.stdout:2/256: mknod d2/d15/d34/c4f 0 2024-09-17T07:19:47.407 INFO:tasks.workunit.client.0.smithi087.stdout:5/279: write d5/f1b [3675737,63225] 0 2024-09-17T07:19:47.408 INFO:tasks.workunit.client.0.smithi087.stdout:1/194: creat d2/da/f4d x:0 0 0 2024-09-17T07:19:47.410 INFO:tasks.workunit.client.0.smithi087.stdout:9/156: link d3/d4/f26 d3/d4/d6/d8/d22/f37 0 2024-09-17T07:19:47.411 INFO:tasks.workunit.client.1.smithi139.stdout:6/163: dread db/d18/d1b/f1d [0,4194304] 0 2024-09-17T07:19:47.411 INFO:tasks.workunit.client.1.smithi139.stdout:0/59: chown d1/l16 919 1 2024-09-17T07:19:47.411 INFO:tasks.workunit.client.1.smithi139.stdout:6/164: readlink l9 0 2024-09-17T07:19:47.412 INFO:tasks.workunit.client.0.smithi087.stdout:9/157: chown d3/d4/da/d1c/d1e/l20 371993346 1 2024-09-17T07:19:47.413 INFO:tasks.workunit.client.1.smithi139.stdout:9/161: mkdir dc/d11/d15/d1e/d34/d35 0 2024-09-17T07:19:47.413 INFO:tasks.workunit.client.0.smithi087.stdout:1/195: dread d2/dc/f40 [0,4194304] 0 2024-09-17T07:19:47.413 INFO:tasks.workunit.client.0.smithi087.stdout:9/158: chown d3/d4/da/f15 0 1 2024-09-17T07:19:47.414 INFO:tasks.workunit.client.1.smithi139.stdout:7/57: mkdir d5/d10 0 2024-09-17T07:19:47.414 INFO:tasks.workunit.client.0.smithi087.stdout:5/280: creat d5/d12/f62 x:0 0 0 2024-09-17T07:19:47.415 INFO:tasks.workunit.client.0.smithi087.stdout:6/270: creat d1/d6/d1a/d2c/f59 x:0 0 0 2024-09-17T07:19:47.415 INFO:tasks.workunit.client.1.smithi139.stdout:5/51: dwrite d4/fd [0,4194304] 0 2024-09-17T07:19:47.416 INFO:tasks.workunit.client.0.smithi087.stdout:2/257: mkdir d2/d50 0 2024-09-17T07:19:47.417 INFO:tasks.workunit.client.0.smithi087.stdout:1/196: mknod d2/d3d/d35/c4e 0 2024-09-17T07:19:47.417 INFO:tasks.workunit.client.1.smithi139.stdout:6/165: mkdir db/d18/d38 0 2024-09-17T07:19:47.417 INFO:tasks.workunit.client.0.smithi087.stdout:9/159: mkdir d3/d4/d6/d8/d12/d38 0 2024-09-17T07:19:47.418 INFO:tasks.workunit.client.1.smithi139.stdout:2/154: truncate d0/fa 7460670 0 2024-09-17T07:19:47.418 INFO:tasks.workunit.client.0.smithi087.stdout:2/258: dread d2/d24/d36/f38 [0,4194304] 0 2024-09-17T07:19:47.418 INFO:tasks.workunit.client.0.smithi087.stdout:1/197: chown d2/c31 112 1 2024-09-17T07:19:47.419 INFO:tasks.workunit.client.1.smithi139.stdout:6/166: stat db/df/d2a/l2d 0 2024-09-17T07:19:47.420 INFO:tasks.workunit.client.0.smithi087.stdout:0/325: link db/d45/d5d/d63/f6b db/d4f/f78 0 2024-09-17T07:19:47.420 INFO:tasks.workunit.client.0.smithi087.stdout:5/281: symlink d5/d18/d20/l63 0 2024-09-17T07:19:47.420 INFO:tasks.workunit.client.1.smithi139.stdout:9/162: dread dc/d11/d15/d1e/f2e [4194304,4194304] 0 2024-09-17T07:19:47.421 INFO:tasks.workunit.client.1.smithi139.stdout:0/60: rename d1/f4 to d1/f18 0 2024-09-17T07:19:47.422 INFO:tasks.workunit.client.1.smithi139.stdout:9/163: chown dc/d11/d15/d1e/c25 107875563 1 2024-09-17T07:19:47.423 INFO:tasks.workunit.client.0.smithi087.stdout:2/259: write d2/d24/d36/f49 [142864,99990] 0 2024-09-17T07:19:47.423 INFO:tasks.workunit.client.0.smithi087.stdout:5/282: chown d5/l4c 331965 1 2024-09-17T07:19:47.423 INFO:tasks.workunit.client.0.smithi087.stdout:0/326: chown db/c58 28401 1 2024-09-17T07:19:47.424 INFO:tasks.workunit.client.0.smithi087.stdout:1/198: mkdir d2/d3d/d35/d4f 0 2024-09-17T07:19:47.424 INFO:tasks.workunit.client.1.smithi139.stdout:3/56: mknod d5/d10/c12 0 2024-09-17T07:19:47.426 INFO:tasks.workunit.client.1.smithi139.stdout:5/52: mknod d4/de/c14 0 2024-09-17T07:19:47.427 INFO:tasks.workunit.client.0.smithi087.stdout:9/160: rename d3/d4/da/f35 to d3/d4/d2f/f39 0 2024-09-17T07:19:47.428 INFO:tasks.workunit.client.0.smithi087.stdout:6/271: dwrite d1/d6/d1a/f41 [0,4194304] 0 2024-09-17T07:19:47.428 INFO:tasks.workunit.client.0.smithi087.stdout:0/327: write db/f1a [324678,52213] 0 2024-09-17T07:19:47.429 INFO:tasks.workunit.client.0.smithi087.stdout:1/199: symlink d2/d14/l50 0 2024-09-17T07:19:47.429 INFO:tasks.workunit.client.0.smithi087.stdout:2/260: mknod d2/d48/c51 0 2024-09-17T07:19:47.430 INFO:tasks.workunit.client.0.smithi087.stdout:7/196: sync 2024-09-17T07:19:47.430 INFO:tasks.workunit.client.0.smithi087.stdout:4/157: sync 2024-09-17T07:19:47.430 INFO:tasks.workunit.client.0.smithi087.stdout:8/173: sync 2024-09-17T07:19:47.431 INFO:tasks.workunit.client.0.smithi087.stdout:9/161: creat d3/d4/d16/f3a x:0 0 0 2024-09-17T07:19:47.431 INFO:tasks.workunit.client.0.smithi087.stdout:2/261: fdatasync d2/d24/d36/f49 0 2024-09-17T07:19:47.433 INFO:tasks.workunit.client.0.smithi087.stdout:2/262: readlink d2/d24/d36/l3d 0 2024-09-17T07:19:47.434 INFO:tasks.workunit.client.1.smithi139.stdout:2/155: dwrite d0/d7/d1a/f1e [0,4194304] 0 2024-09-17T07:19:47.435 INFO:tasks.workunit.client.1.smithi139.stdout:6/167: dwrite db/d18/d1b/f37 [0,4194304] 0 2024-09-17T07:19:47.435 INFO:tasks.workunit.client.1.smithi139.stdout:8/119: link d0/l15 d0/d1a/l22 0 2024-09-17T07:19:47.436 INFO:tasks.workunit.client.0.smithi087.stdout:1/200: write d2/d14/dd/d43/f4b [403507,49313] 0 2024-09-17T07:19:47.436 INFO:tasks.workunit.client.1.smithi139.stdout:7/58: creat d5/d10/f11 x:0 0 0 2024-09-17T07:19:47.439 INFO:tasks.workunit.client.0.smithi087.stdout:5/283: truncate d5/d18/d20/d2f/f48 2047078 0 2024-09-17T07:19:47.440 INFO:tasks.workunit.client.1.smithi139.stdout:5/53: mkdir d4/de/d15 0 2024-09-17T07:19:47.441 INFO:tasks.workunit.client.1.smithi139.stdout:2/156: unlink d0/dc/d15/f17 0 2024-09-17T07:19:47.442 INFO:tasks.workunit.client.0.smithi087.stdout:9/162: mknod d3/d4/d6/d8/d12/d32/c3b 0 2024-09-17T07:19:47.443 INFO:tasks.workunit.client.1.smithi139.stdout:5/54: write d4/f6 [28121,2186] 0 2024-09-17T07:19:47.443 INFO:tasks.workunit.client.1.smithi139.stdout:6/168: creat db/d18/f39 x:0 0 0 2024-09-17T07:19:47.444 INFO:tasks.workunit.client.1.smithi139.stdout:6/169: chown f7 1830081 1 2024-09-17T07:19:47.444 INFO:tasks.workunit.client.1.smithi139.stdout:7/59: write d5/d10/f11 [478908,52016] 0 2024-09-17T07:19:47.444 INFO:tasks.workunit.client.1.smithi139.stdout:5/55: write d4/f6 [446437,3047] 0 2024-09-17T07:19:47.448 INFO:tasks.workunit.client.0.smithi087.stdout:4/158: dwrite f0 [0,4194304] 0 2024-09-17T07:19:47.453 INFO:tasks.workunit.client.1.smithi139.stdout:8/120: mknod d0/d20/c23 0 2024-09-17T07:19:47.454 INFO:tasks.workunit.client.0.smithi087.stdout:6/272: dwrite d1/d6/d1a/d2c/f37 [0,4194304] 0 2024-09-17T07:19:47.454 INFO:tasks.workunit.client.1.smithi139.stdout:7/60: chown d5/le 4751 1 2024-09-17T07:19:47.455 INFO:tasks.workunit.client.0.smithi087.stdout:0/328: rename db/f1d to db/f79 0 2024-09-17T07:19:47.455 INFO:tasks.workunit.client.0.smithi087.stdout:8/174: dread d1/d2b/f29 [0,4194304] 0 2024-09-17T07:19:47.455 INFO:tasks.workunit.client.1.smithi139.stdout:3/57: rename d5/d10 to d5/d13 0 2024-09-17T07:19:47.457 INFO:tasks.workunit.client.1.smithi139.stdout:2/157: dwrite d0/de/d11/d28/f2d [0,4194304] 0 2024-09-17T07:19:47.457 INFO:tasks.workunit.client.1.smithi139.stdout:3/58: write f2 [2846845,53909] 0 2024-09-17T07:19:47.458 INFO:tasks.workunit.client.0.smithi087.stdout:9/163: unlink d3/d4/d6/d8/d12/l24 0 2024-09-17T07:19:47.458 INFO:tasks.workunit.client.1.smithi139.stdout:6/170: creat db/df/d2a/f3a x:0 0 0 2024-09-17T07:19:47.461 INFO:tasks.workunit.client.0.smithi087.stdout:0/329: truncate db/d45/f6d 596514 0 2024-09-17T07:19:47.462 INFO:tasks.workunit.client.1.smithi139.stdout:5/56: rename d4/de/d15 to d4/d16 0 2024-09-17T07:19:47.462 INFO:tasks.workunit.client.1.smithi139.stdout:9/164: link dc/lf dc/d11/l36 0 2024-09-17T07:19:47.463 INFO:tasks.workunit.client.1.smithi139.stdout:0/61: write d1/f3 [1103452,90326] 0 2024-09-17T07:19:47.465 INFO:tasks.workunit.client.1.smithi139.stdout:2/158: symlink d0/d7/l35 0 2024-09-17T07:19:47.465 INFO:tasks.workunit.client.0.smithi087.stdout:2/263: getdents d2/d7/dd/d10 0 2024-09-17T07:19:47.466 INFO:tasks.workunit.client.1.smithi139.stdout:3/59: mknod d5/d13/c14 0 2024-09-17T07:19:47.466 INFO:tasks.workunit.client.0.smithi087.stdout:5/284: dwrite d5/f15 [0,4194304] 0 2024-09-17T07:19:47.467 INFO:tasks.workunit.client.1.smithi139.stdout:2/159: chown d0/de/d11/d28/f2d 5 1 2024-09-17T07:19:47.468 INFO:tasks.workunit.client.1.smithi139.stdout:5/57: creat d4/f17 x:0 0 0 2024-09-17T07:19:47.469 INFO:tasks.workunit.client.1.smithi139.stdout:6/171: write db/d18/d1b/f1d [3349682,60729] 0 2024-09-17T07:19:47.469 INFO:tasks.workunit.client.1.smithi139.stdout:8/121: dwrite d0/fd [0,4194304] 0 2024-09-17T07:19:47.470 INFO:tasks.workunit.client.0.smithi087.stdout:8/175: mkdir d1/d7/d9/d3c 0 2024-09-17T07:19:47.477 INFO:tasks.workunit.client.1.smithi139.stdout:8/122: readlink d0/lf 0 2024-09-17T07:19:47.479 INFO:tasks.workunit.client.0.smithi087.stdout:9/164: rename d3/d4/da/f15 to d3/d4/d2f/f3c 0 2024-09-17T07:19:47.479 INFO:tasks.workunit.client.0.smithi087.stdout:0/330: dread db/f34 [0,4194304] 0 2024-09-17T07:19:47.480 INFO:tasks.workunit.client.1.smithi139.stdout:2/160: rmdir d0/d7/d1a/d1b 39 2024-09-17T07:19:47.481 INFO:tasks.workunit.client.0.smithi087.stdout:8/176: chown d1/d7/d9/d19/l20 308952672 1 2024-09-17T07:19:47.482 INFO:tasks.workunit.client.0.smithi087.stdout:2/264: creat d2/f52 x:0 0 0 2024-09-17T07:19:47.483 INFO:tasks.workunit.client.0.smithi087.stdout:5/285: getdents d5/d18/d20/d2f/d52 0 2024-09-17T07:19:47.484 INFO:tasks.workunit.client.0.smithi087.stdout:0/331: mknod db/d4f/c7a 0 2024-09-17T07:19:47.484 INFO:tasks.workunit.client.0.smithi087.stdout:8/177: fdatasync d1/f2a 0 2024-09-17T07:19:47.486 INFO:tasks.workunit.client.0.smithi087.stdout:9/165: mknod d3/d4/d6/d8/d12/d32/c3d 0 2024-09-17T07:19:47.487 INFO:tasks.workunit.client.1.smithi139.stdout:0/62: dwrite d1/da/fc [0,4194304] 0 2024-09-17T07:19:47.488 INFO:tasks.workunit.client.0.smithi087.stdout:0/332: truncate db/d45/d5b/f5e 971044 0 2024-09-17T07:19:47.488 INFO:tasks.workunit.client.0.smithi087.stdout:9/166: write d3/d4/d16/f3a [420554,111955] 0 2024-09-17T07:19:47.488 INFO:tasks.workunit.client.0.smithi087.stdout:8/178: rmdir d1/d2b/d21 39 2024-09-17T07:19:47.489 INFO:tasks.workunit.client.0.smithi087.stdout:2/265: creat d2/d7/dd/d10/f53 x:0 0 0 2024-09-17T07:19:47.489 INFO:tasks.workunit.client.1.smithi139.stdout:6/172: dwrite db/d21/f31 [0,4194304] 0 2024-09-17T07:19:47.491 INFO:tasks.workunit.client.0.smithi087.stdout:0/333: mkdir db/d45/d7b 0 2024-09-17T07:19:47.492 INFO:tasks.workunit.client.0.smithi087.stdout:8/179: symlink d1/d7/d9/d19/d1b/l3d 0 2024-09-17T07:19:47.492 INFO:tasks.workunit.client.1.smithi139.stdout:8/123: unlink d0/dc/f12 0 2024-09-17T07:19:47.494 INFO:tasks.workunit.client.0.smithi087.stdout:0/334: readlink db/d45/d5d/d63/l69 0 2024-09-17T07:19:47.494 INFO:tasks.workunit.client.0.smithi087.stdout:9/167: creat d3/d4/d6/f3e x:0 0 0 2024-09-17T07:19:47.496 INFO:tasks.workunit.client.1.smithi139.stdout:5/58: dwrite d4/fd [0,4194304] 0 2024-09-17T07:19:47.497 INFO:tasks.workunit.client.0.smithi087.stdout:2/266: dread d2/d7/dd/f29 [0,4194304] 0 2024-09-17T07:19:47.499 INFO:tasks.workunit.client.1.smithi139.stdout:8/124: write d0/d1a/f21 [253424,7083] 0 2024-09-17T07:19:47.499 INFO:tasks.workunit.client.1.smithi139.stdout:5/59: dread - d4/f17 zero size 2024-09-17T07:19:47.500 INFO:tasks.workunit.client.1.smithi139.stdout:9/165: write dc/d11/d15/d1e/f33 [431156,66867] 0 2024-09-17T07:19:47.500 INFO:tasks.workunit.client.1.smithi139.stdout:2/161: dread d0/fb [0,4194304] 0 2024-09-17T07:19:47.501 INFO:tasks.workunit.client.0.smithi087.stdout:8/180: mknod d1/d7/d9/d27/c3e 0 2024-09-17T07:19:47.501 INFO:tasks.workunit.client.1.smithi139.stdout:9/166: chown fb 0 1 2024-09-17T07:19:47.502 INFO:tasks.workunit.client.0.smithi087.stdout:2/267: creat d2/d7/d30/f54 x:0 0 0 2024-09-17T07:19:47.504 INFO:tasks.workunit.client.1.smithi139.stdout:6/173: creat db/df/d33/f3b x:0 0 0 2024-09-17T07:19:47.504 INFO:tasks.workunit.client.1.smithi139.stdout:2/162: creat d0/de/f36 x:0 0 0 2024-09-17T07:19:47.505 INFO:tasks.workunit.client.0.smithi087.stdout:5/286: link d5/d12/d1c/c45 d5/d12/d1c/c64 0 2024-09-17T07:19:47.505 INFO:tasks.workunit.client.0.smithi087.stdout:2/268: chown d2/d7/dd/c1b 202 1 2024-09-17T07:19:47.505 INFO:tasks.workunit.client.0.smithi087.stdout:0/335: dread db/f48 [0,4194304] 0 2024-09-17T07:19:47.505 INFO:tasks.workunit.client.1.smithi139.stdout:9/167: fdatasync fb 0 2024-09-17T07:19:47.506 INFO:tasks.workunit.client.1.smithi139.stdout:6/174: dread db/d18/d1b/f1d [4194304,4194304] 0 2024-09-17T07:19:47.507 INFO:tasks.workunit.client.0.smithi087.stdout:9/168: dread f2 [0,4194304] 0 2024-09-17T07:19:47.507 INFO:tasks.workunit.client.0.smithi087.stdout:4/159: write d2/d5/d1f/f20 [650429,102635] 0 2024-09-17T07:19:47.507 INFO:tasks.workunit.client.1.smithi139.stdout:5/60: creat d4/d16/f18 x:0 0 0 2024-09-17T07:19:47.510 INFO:tasks.workunit.client.0.smithi087.stdout:5/287: creat d5/d12/d1c/f65 x:0 0 0 2024-09-17T07:19:47.510 INFO:tasks.workunit.client.0.smithi087.stdout:6/273: dread d1/d6/f1c [0,4194304] 0 2024-09-17T07:19:47.511 INFO:tasks.workunit.client.1.smithi139.stdout:9/168: dread fb [0,4194304] 0 2024-09-17T07:19:47.511 INFO:tasks.workunit.client.1.smithi139.stdout:6/175: creat db/df/d33/f3c x:0 0 0 2024-09-17T07:19:47.512 INFO:tasks.workunit.client.0.smithi087.stdout:0/336: dread db/f18 [4194304,4194304] 0 2024-09-17T07:19:47.514 INFO:tasks.workunit.client.1.smithi139.stdout:5/61: dread d4/f6 [0,4194304] 0 2024-09-17T07:19:47.515 INFO:tasks.workunit.client.1.smithi139.stdout:9/169: write dc/d11/d15/d1e/f2f [485022,14115] 0 2024-09-17T07:19:47.516 INFO:tasks.workunit.client.0.smithi087.stdout:4/160: unlink d2/d5/le 0 2024-09-17T07:19:47.518 INFO:tasks.workunit.client.1.smithi139.stdout:2/163: dwrite d0/dc/f21 [0,4194304] 0 2024-09-17T07:19:47.518 INFO:tasks.workunit.client.0.smithi087.stdout:9/169: mknod d3/d25/c3f 0 2024-09-17T07:19:47.519 INFO:tasks.workunit.client.0.smithi087.stdout:9/170: stat d3/d4/d16/f3a 0 2024-09-17T07:19:47.520 INFO:tasks.workunit.client.1.smithi139.stdout:5/62: creat d4/d16/f19 x:0 0 0 2024-09-17T07:19:47.520 INFO:tasks.workunit.client.0.smithi087.stdout:0/337: rmdir db/d45/d5b 39 2024-09-17T07:19:47.522 INFO:tasks.workunit.client.1.smithi139.stdout:2/164: read d0/d7/fd [2465344,83636] 0 2024-09-17T07:19:47.666 INFO:tasks.workunit.client.1.smithi139.stdout:5/63: dread d4/f6 [0,4194304] 0 2024-09-17T07:19:47.666 INFO:tasks.workunit.client.1.smithi139.stdout:2/165: chown d0/dc/f20 63132334 1 2024-09-17T07:19:47.666 INFO:tasks.workunit.client.1.smithi139.stdout:6/176: dwrite db/d18/f1a [8388608,4194304] 0 2024-09-17T07:19:47.666 INFO:tasks.workunit.client.1.smithi139.stdout:2/166: read d0/d7/d1a/f1e [3967349,104723] 0 2024-09-17T07:19:47.666 INFO:tasks.workunit.client.1.smithi139.stdout:5/64: symlink d4/de/l1a 0 2024-09-17T07:19:47.666 INFO:tasks.workunit.client.1.smithi139.stdout:6/177: fsync db/df/f24 0 2024-09-17T07:19:47.666 INFO:tasks.workunit.client.1.smithi139.stdout:5/65: dread - d4/f17 zero size 2024-09-17T07:19:47.666 INFO:tasks.workunit.client.1.smithi139.stdout:2/167: write d0/d7/f19 [4640125,113333] 0 2024-09-17T07:19:47.666 INFO:tasks.workunit.client.1.smithi139.stdout:5/66: write d4/d16/f18 [612641,16436] 0 2024-09-17T07:19:47.667 INFO:tasks.workunit.client.1.smithi139.stdout:9/170: dwrite dc/d11/d15/f28 [0,4194304] 0 2024-09-17T07:19:47.667 INFO:tasks.workunit.client.1.smithi139.stdout:6/178: getdents db/d21 0 2024-09-17T07:19:47.667 INFO:tasks.workunit.client.1.smithi139.stdout:5/67: stat d4/lf 0 2024-09-17T07:19:47.667 INFO:tasks.workunit.client.1.smithi139.stdout:2/168: link d0/dc/f21 d0/de/d11/d28/f37 0 2024-09-17T07:19:47.667 INFO:tasks.workunit.client.1.smithi139.stdout:6/179: creat db/f3d x:0 0 0 2024-09-17T07:19:47.667 INFO:tasks.workunit.client.1.smithi139.stdout:6/180: symlink db/df/d2a/l3e 0 2024-09-17T07:19:47.667 INFO:tasks.workunit.client.1.smithi139.stdout:5/68: dwrite d4/f6 [0,4194304] 0 2024-09-17T07:19:47.667 INFO:tasks.workunit.client.1.smithi139.stdout:5/69: dread f3 [0,4194304] 0 2024-09-17T07:19:47.667 INFO:tasks.workunit.client.1.smithi139.stdout:6/181: chown db/df/c1f 11282 1 2024-09-17T07:19:47.667 INFO:tasks.workunit.client.1.smithi139.stdout:6/182: dread db/d18/f35 [0,4194304] 0 2024-09-17T07:19:47.667 INFO:tasks.workunit.client.1.smithi139.stdout:5/70: write d4/f9 [1977387,21439] 0 2024-09-17T07:19:47.667 INFO:tasks.workunit.client.1.smithi139.stdout:5/71: read - d4/f17 zero size 2024-09-17T07:19:47.667 INFO:tasks.workunit.client.1.smithi139.stdout:9/171: dwrite dc/d2c/f31 [0,4194304] 0 2024-09-17T07:19:47.667 INFO:tasks.workunit.client.1.smithi139.stdout:9/172: write dc/d11/d15/f18 [8519082,113883] 0 2024-09-17T07:19:47.668 INFO:tasks.workunit.client.1.smithi139.stdout:5/72: mkdir d4/d16/d1b 0 2024-09-17T07:19:47.668 INFO:tasks.workunit.client.1.smithi139.stdout:5/73: write d4/f17 [104857,4812] 0 2024-09-17T07:19:47.668 INFO:tasks.workunit.client.1.smithi139.stdout:9/173: write dc/d11/d15/d1e/f2e [5347934,42307] 0 2024-09-17T07:19:47.668 INFO:tasks.workunit.client.1.smithi139.stdout:5/74: truncate d4/d16/f19 527152 0 2024-09-17T07:19:47.668 INFO:tasks.workunit.client.1.smithi139.stdout:9/174: fdatasync dc/d11/d15/f28 0 2024-09-17T07:19:47.668 INFO:tasks.workunit.client.1.smithi139.stdout:5/75: truncate d4/d16/f18 1643937 0 2024-09-17T07:19:47.668 INFO:tasks.workunit.client.1.smithi139.stdout:6/183: dread f1 [0,4194304] 0 2024-09-17T07:19:47.668 INFO:tasks.workunit.client.1.smithi139.stdout:9/175: dwrite dc/d11/d15/d1e/f21 [0,4194304] 0 2024-09-17T07:19:47.668 INFO:tasks.workunit.client.1.smithi139.stdout:6/184: unlink db/d18/d1b/l1e 0 2024-09-17T07:19:47.668 INFO:tasks.workunit.client.1.smithi139.stdout:6/185: write f1 [1180897,35535] 0 2024-09-17T07:19:47.668 INFO:tasks.workunit.client.1.smithi139.stdout:6/186: write db/df/f19 [685213,15194] 0 2024-09-17T07:19:47.668 INFO:tasks.workunit.client.1.smithi139.stdout:5/76: fsync d4/f17 0 2024-09-17T07:19:47.668 INFO:tasks.workunit.client.1.smithi139.stdout:6/187: rename db/d18/f2e to db/d18/d1b/f3f 0 2024-09-17T07:19:47.668 INFO:tasks.workunit.client.1.smithi139.stdout:9/176: dwrite dc/d11/f12 [0,4194304] 0 2024-09-17T07:19:47.669 INFO:tasks.workunit.client.1.smithi139.stdout:9/177: dread dc/d11/d15/f18 [4194304,4194304] 0 2024-09-17T07:19:47.669 INFO:tasks.workunit.client.1.smithi139.stdout:6/188: dwrite db/df/d2a/f2f [0,4194304] 0 2024-09-17T07:19:47.669 INFO:tasks.workunit.client.1.smithi139.stdout:9/178: dread dc/d11/d15/d1e/f29 [0,4194304] 0 2024-09-17T07:19:47.669 INFO:tasks.workunit.client.1.smithi139.stdout:9/179: write dc/d11/d15/f28 [3235236,108089] 0 2024-09-17T07:19:47.669 INFO:tasks.workunit.client.1.smithi139.stdout:6/189: rename db/df/d33 to db/df/d2a/d40 0 2024-09-17T07:19:47.669 INFO:tasks.workunit.client.1.smithi139.stdout:6/190: fdatasync db/df/d2a/d40/f3b 0 2024-09-17T07:19:47.672 INFO:tasks.workunit.client.1.smithi139.stdout:9/180: rmdir dc/d2a 39 2024-09-17T07:19:47.673 INFO:tasks.workunit.client.1.smithi139.stdout:6/191: chown db/df/d2a/f2b 20 1 2024-09-17T07:19:47.673 INFO:tasks.workunit.client.1.smithi139.stdout:9/181: symlink dc/d11/d15/d1e/l37 0 2024-09-17T07:19:47.673 INFO:tasks.workunit.client.1.smithi139.stdout:6/192: mknod db/d18/d38/c41 0 2024-09-17T07:19:47.673 INFO:tasks.workunit.client.1.smithi139.stdout:9/182: readlink dc/d11/l36 0 2024-09-17T07:19:47.673 INFO:tasks.workunit.client.1.smithi139.stdout:6/193: write db/df/f24 [284500,114338] 0 2024-09-17T07:19:47.674 INFO:tasks.workunit.client.0.smithi087.stdout:2/269: rmdir d2/d15/d4b 0 2024-09-17T07:19:47.674 INFO:tasks.workunit.client.0.smithi087.stdout:4/161: chown d2/d22/d2c/c30 3 1 2024-09-17T07:19:47.674 INFO:tasks.workunit.client.0.smithi087.stdout:6/274: symlink d1/d6/d1a/d2c/d48/l5a 0 2024-09-17T07:19:47.674 INFO:tasks.workunit.client.0.smithi087.stdout:8/181: link d1/d7/d9/d19/d1b/l3d d1/d7/d9/d27/l3f 0 2024-09-17T07:19:47.674 INFO:tasks.workunit.client.0.smithi087.stdout:4/162: read d2/d5/d1f/f1e [292969,86447] 0 2024-09-17T07:19:47.674 INFO:tasks.workunit.client.0.smithi087.stdout:5/288: getdents d5/d18/d20 0 2024-09-17T07:19:47.674 INFO:tasks.workunit.client.0.smithi087.stdout:2/270: creat d2/d15/d34/f55 x:0 0 0 2024-09-17T07:19:47.674 INFO:tasks.workunit.client.0.smithi087.stdout:4/163: chown d2/d5/db/f29 24010936 1 2024-09-17T07:19:47.674 INFO:tasks.workunit.client.0.smithi087.stdout:6/275: truncate d1/d6/d1a/d2c/f59 1043336 0 2024-09-17T07:19:47.674 INFO:tasks.workunit.client.0.smithi087.stdout:5/289: chown d5/d8/d1f/d4e/f5e 207781153 1 2024-09-17T07:19:47.674 INFO:tasks.workunit.client.0.smithi087.stdout:4/164: dread - d2/d5/f26 zero size 2024-09-17T07:19:47.674 INFO:tasks.workunit.client.0.smithi087.stdout:5/290: stat d5/d18/d20/c5d 0 2024-09-17T07:19:47.675 INFO:tasks.workunit.client.0.smithi087.stdout:0/338: getdents db/d45/d5b 0 2024-09-17T07:19:47.675 INFO:tasks.workunit.client.0.smithi087.stdout:4/165: read d2/d5/db/f29 [380911,5651] 0 2024-09-17T07:19:47.675 INFO:tasks.workunit.client.0.smithi087.stdout:6/276: creat d1/d6/d1a/d2c/f5b x:0 0 0 2024-09-17T07:19:47.675 INFO:tasks.workunit.client.0.smithi087.stdout:2/271: dwrite d2/d7/dd/d10/f53 [0,4194304] 0 2024-09-17T07:19:47.675 INFO:tasks.workunit.client.0.smithi087.stdout:6/277: write d1/d6/d1a/f31 [1017955,22235] 0 2024-09-17T07:19:47.675 INFO:tasks.workunit.client.0.smithi087.stdout:0/339: creat db/d45/f7c x:0 0 0 2024-09-17T07:19:47.675 INFO:tasks.workunit.client.0.smithi087.stdout:2/272: dread - d2/d7/d30/f42 zero size 2024-09-17T07:19:47.675 INFO:tasks.workunit.client.0.smithi087.stdout:5/291: symlink d5/d8/l66 0 2024-09-17T07:19:47.675 INFO:tasks.workunit.client.0.smithi087.stdout:6/278: chown d1/d6/d1a/d2c/f52 27224 1 2024-09-17T07:19:47.675 INFO:tasks.workunit.client.0.smithi087.stdout:0/340: mkdir db/d45/d5d/d7d 0 2024-09-17T07:19:47.675 INFO:tasks.workunit.client.0.smithi087.stdout:4/166: creat d2/d5/d1f/f34 x:0 0 0 2024-09-17T07:19:47.675 INFO:tasks.workunit.client.0.smithi087.stdout:0/341: write db/d45/f6d [59565,37915] 0 2024-09-17T07:19:47.675 INFO:tasks.workunit.client.0.smithi087.stdout:5/292: symlink d5/d12/d56/d5b/l67 0 2024-09-17T07:19:47.676 INFO:tasks.workunit.client.0.smithi087.stdout:5/293: stat d5/d12/d1c/l53 0 2024-09-17T07:19:47.676 INFO:tasks.workunit.client.0.smithi087.stdout:2/273: getdents d2/d12 0 2024-09-17T07:19:47.676 INFO:tasks.workunit.client.0.smithi087.stdout:2/274: chown d2/d7/db/c2d 3765 1 2024-09-17T07:19:47.676 INFO:tasks.workunit.client.0.smithi087.stdout:4/167: creat d2/d5/d1f/f35 x:0 0 0 2024-09-17T07:19:47.676 INFO:tasks.workunit.client.0.smithi087.stdout:0/342: mkdir db/d45/d7b/d7e 0 2024-09-17T07:19:47.676 INFO:tasks.workunit.client.0.smithi087.stdout:2/275: chown d2/d48 14 1 2024-09-17T07:19:47.676 INFO:tasks.workunit.client.0.smithi087.stdout:0/343: fdatasync db/f1a 0 2024-09-17T07:19:47.676 INFO:tasks.workunit.client.0.smithi087.stdout:2/276: truncate d2/d7/d30/f54 57613 0 2024-09-17T07:19:47.676 INFO:tasks.workunit.client.0.smithi087.stdout:5/294: unlink d5/d12/d4d/f5a 0 2024-09-17T07:19:47.676 INFO:tasks.workunit.client.0.smithi087.stdout:5/295: write d5/d18/d20/d2f/f43 [2207938,51848] 0 2024-09-17T07:19:47.676 INFO:tasks.workunit.client.0.smithi087.stdout:2/277: rename d2/d24/l3e to d2/d12/l56 0 2024-09-17T07:19:47.676 INFO:tasks.workunit.client.0.smithi087.stdout:2/278: readlink d2/d12/l41 0 2024-09-17T07:19:47.676 INFO:tasks.workunit.client.0.smithi087.stdout:2/279: dread - d2/d12/f2a zero size 2024-09-17T07:19:47.677 INFO:tasks.workunit.client.0.smithi087.stdout:5/296: dread d5/d18/d20/f1e [0,4194304] 0 2024-09-17T07:19:47.677 INFO:tasks.workunit.client.0.smithi087.stdout:2/280: mknod d2/d12/c57 0 2024-09-17T07:19:47.677 INFO:tasks.workunit.client.0.smithi087.stdout:5/297: unlink d5/d8/d1f/d4e/f5e 0 2024-09-17T07:19:47.677 INFO:tasks.workunit.client.0.smithi087.stdout:5/298: mkdir d5/d8/d1f/d68 0 2024-09-17T07:19:47.677 INFO:tasks.workunit.client.0.smithi087.stdout:5/299: fdatasync d5/d12/d14/f44 0 2024-09-17T07:19:47.677 INFO:tasks.workunit.client.0.smithi087.stdout:5/300: write d5/d18/d20/f35 [730765,59919] 0 2024-09-17T07:19:47.677 INFO:tasks.workunit.client.0.smithi087.stdout:6/279: fsync d1/d6/d1a/f31 0 2024-09-17T07:19:47.677 INFO:tasks.workunit.client.0.smithi087.stdout:5/301: dwrite d5/d8/f3f [0,4194304] 0 2024-09-17T07:19:47.677 INFO:tasks.workunit.client.0.smithi087.stdout:5/302: chown d5/d18/d20/f35 0 1 2024-09-17T07:19:47.677 INFO:tasks.workunit.client.0.smithi087.stdout:6/280: mknod d1/d6/d1a/d2c/d58/c5c 0 2024-09-17T07:19:47.677 INFO:tasks.workunit.client.0.smithi087.stdout:5/303: dwrite d5/d18/f4a [0,4194304] 0 2024-09-17T07:19:47.677 INFO:tasks.workunit.client.0.smithi087.stdout:5/304: write d5/d18/d20/f1e [5077474,26937] 0 2024-09-17T07:19:47.677 INFO:tasks.workunit.client.0.smithi087.stdout:5/305: dwrite d5/d8/d1f/f58 [0,4194304] 0 2024-09-17T07:19:47.677 INFO:tasks.workunit.client.0.smithi087.stdout:4/168: truncate d2/d5/db/d21/f2e 2534965 0 2024-09-17T07:19:47.678 INFO:tasks.workunit.client.0.smithi087.stdout:4/169: dread f1 [0,4194304] 0 2024-09-17T07:19:47.678 INFO:tasks.workunit.client.0.smithi087.stdout:4/170: chown d2/d5/f2a 0 1 2024-09-17T07:19:47.678 INFO:tasks.workunit.client.0.smithi087.stdout:4/171: mknod d2/d5/db/c36 0 2024-09-17T07:19:47.678 INFO:tasks.workunit.client.0.smithi087.stdout:4/172: truncate d2/d5/db/f29 124008 0 2024-09-17T07:19:47.678 INFO:tasks.workunit.client.0.smithi087.stdout:4/173: mknod d2/d22/d2c/c37 0 2024-09-17T07:19:47.678 INFO:tasks.workunit.client.0.smithi087.stdout:4/174: write d2/fc [643413,108587] 0 2024-09-17T07:19:47.678 INFO:tasks.workunit.client.0.smithi087.stdout:4/175: creat d2/d5/db/d21/d2f/f38 x:0 0 0 2024-09-17T07:19:47.678 INFO:tasks.workunit.client.0.smithi087.stdout:2/281: write d2/d7/dd/d10/f1e [303550,6474] 0 2024-09-17T07:19:47.678 INFO:tasks.workunit.client.0.smithi087.stdout:6/281: truncate d1/d6/f1c 5778618 0 2024-09-17T07:19:47.678 INFO:tasks.workunit.client.0.smithi087.stdout:5/306: truncate d5/d18/d20/d2f/f43 1065176 0 2024-09-17T07:19:47.678 INFO:tasks.workunit.client.0.smithi087.stdout:4/176: dwrite d2/d5/f12 [0,4194304] 0 2024-09-17T07:19:47.678 INFO:tasks.workunit.client.0.smithi087.stdout:2/282: dwrite d2/d15/f45 [0,4194304] 0 2024-09-17T07:19:47.678 INFO:tasks.workunit.client.0.smithi087.stdout:6/282: rename d1/d6/d1a/f30 to d1/d6/d1a/d4e/f5d 0 2024-09-17T07:19:47.678 INFO:tasks.workunit.client.0.smithi087.stdout:5/307: mknod d5/d12/d56/d5b/c69 0 2024-09-17T07:19:47.679 INFO:tasks.workunit.client.0.smithi087.stdout:4/177: unlink d2/c33 0 2024-09-17T07:19:47.679 INFO:tasks.workunit.client.0.smithi087.stdout:4/178: rename d2 to d2/d5/db/d21/d39 22 2024-09-17T07:19:47.679 INFO:tasks.workunit.client.0.smithi087.stdout:5/308: mkdir d5/d18/d6a 0 2024-09-17T07:19:47.680 INFO:tasks.workunit.client.0.smithi087.stdout:6/283: mkdir d1/d6/d1a/d5e 0 2024-09-17T07:19:47.680 INFO:tasks.workunit.client.0.smithi087.stdout:6/284: chown d1/f4b 900 1 2024-09-17T07:19:47.680 INFO:tasks.workunit.client.0.smithi087.stdout:5/309: link d5/d18/l46 d5/d18/d20/d2f/l6b 0 2024-09-17T07:19:47.680 INFO:tasks.workunit.client.0.smithi087.stdout:5/310: creat d5/d12/d1c/f6c x:0 0 0 2024-09-17T07:19:47.680 INFO:tasks.workunit.client.1.smithi139.stdout:9/183: fdatasync dc/d11/d15/f17 0 2024-09-17T07:19:47.680 INFO:tasks.workunit.client.1.smithi139.stdout:6/194: write db/df/d2a/f2b [891556,127709] 0 2024-09-17T07:19:47.680 INFO:tasks.workunit.client.1.smithi139.stdout:6/195: write f1 [3587669,91618] 0 2024-09-17T07:19:47.680 INFO:tasks.workunit.client.1.smithi139.stdout:9/184: mkdir dc/d11/d15/d1e/d38 0 2024-09-17T07:19:47.685 INFO:tasks.workunit.client.1.smithi139.stdout:9/185: dwrite fb [0,4194304] 0 2024-09-17T07:19:47.690 INFO:tasks.workunit.client.1.smithi139.stdout:9/186: dread dc/d11/f12 [0,4194304] 0 2024-09-17T07:19:47.692 INFO:tasks.workunit.client.0.smithi087.stdout:5/311: dwrite d5/d18/d20/d2f/f43 [0,4194304] 0 2024-09-17T07:19:47.693 INFO:tasks.workunit.client.0.smithi087.stdout:5/312: chown d5/f17 831 1 2024-09-17T07:19:47.694 INFO:tasks.workunit.client.1.smithi139.stdout:6/196: truncate db/df/f13 2853996 0 2024-09-17T07:19:47.694 INFO:tasks.workunit.client.1.smithi139.stdout:9/187: symlink dc/d11/d15/d1e/l39 0 2024-09-17T07:19:47.694 INFO:tasks.workunit.client.0.smithi087.stdout:4/179: rename d2/d5/db/d21/f2e to d2/d5/d1f/f3a 0 2024-09-17T07:19:47.695 INFO:tasks.workunit.client.0.smithi087.stdout:3/174: sync 2024-09-17T07:19:47.696 INFO:tasks.workunit.client.0.smithi087.stdout:2/283: write d2/d24/d36/f38 [1205912,18624] 0 2024-09-17T07:19:47.696 INFO:tasks.workunit.client.0.smithi087.stdout:6/285: rename d1/d6/d1a to d1/d6/d1a/d2c/d5f 22 2024-09-17T07:19:47.697 INFO:tasks.workunit.client.1.smithi139.stdout:9/188: rmdir dc/d11/d15/d1e/d34/d35 0 2024-09-17T07:19:47.698 INFO:tasks.workunit.client.1.smithi139.stdout:6/197: getdents db/d18/d38 0 2024-09-17T07:19:47.699 INFO:tasks.workunit.client.1.smithi139.stdout:9/189: chown dc/d11/d15/d1e/f2e 26549 1 2024-09-17T07:19:47.700 INFO:tasks.workunit.client.0.smithi087.stdout:2/284: mknod d2/d7/dd/d10/c58 0 2024-09-17T07:19:47.701 INFO:tasks.workunit.client.1.smithi139.stdout:6/198: creat db/d21/f42 x:0 0 0 2024-09-17T07:19:47.702 INFO:tasks.workunit.client.0.smithi087.stdout:6/286: mknod d1/d6/d1a/d2c/d33/c60 0 2024-09-17T07:19:47.703 INFO:tasks.workunit.client.1.smithi139.stdout:9/190: symlink dc/d2c/l3a 0 2024-09-17T07:19:47.704 INFO:tasks.workunit.client.0.smithi087.stdout:4/180: dwrite d2/d5/f26 [0,4194304] 0 2024-09-17T07:19:47.704 INFO:tasks.workunit.client.1.smithi139.stdout:9/191: mknod dc/c3b 0 2024-09-17T07:19:47.706 INFO:tasks.workunit.client.0.smithi087.stdout:2/285: creat d2/d48/f59 x:0 0 0 2024-09-17T07:19:47.706 INFO:tasks.workunit.client.1.smithi139.stdout:9/192: write dc/d2a/f32 [131284,117794] 0 2024-09-17T07:19:47.707 INFO:tasks.workunit.client.1.smithi139.stdout:9/193: readlink dc/d11/l36 0 2024-09-17T07:19:47.707 INFO:tasks.workunit.client.0.smithi087.stdout:4/181: mkdir d2/d5/db/d21/d2f/d3b 0 2024-09-17T07:19:47.708 INFO:tasks.workunit.client.1.smithi139.stdout:9/194: write dc/d2a/f32 [1084157,92018] 0 2024-09-17T07:19:47.709 INFO:tasks.workunit.client.0.smithi087.stdout:6/287: creat d1/d6/f61 x:0 0 0 2024-09-17T07:19:47.709 INFO:tasks.workunit.client.0.smithi087.stdout:4/182: mknod d2/d5/c3c 0 2024-09-17T07:19:47.711 INFO:tasks.workunit.client.0.smithi087.stdout:6/288: mkdir d1/d6/d1a/d2c/d48/d62 0 2024-09-17T07:19:47.713 INFO:tasks.workunit.client.1.smithi139.stdout:9/195: dread fb [0,4194304] 0 2024-09-17T07:19:47.715 INFO:tasks.workunit.client.1.smithi139.stdout:9/196: dread dc/d11/f12 [0,4194304] 0 2024-09-17T07:19:47.716 INFO:tasks.workunit.client.0.smithi087.stdout:4/183: getdents d2/d22/d2c 0 2024-09-17T07:19:47.718 INFO:tasks.workunit.client.0.smithi087.stdout:4/184: creat d2/d5/db/f3d x:0 0 0 2024-09-17T07:19:47.719 INFO:tasks.workunit.client.1.smithi139.stdout:6/199: write f1 [33802,89903] 0 2024-09-17T07:19:47.719 INFO:tasks.workunit.client.0.smithi087.stdout:5/313: truncate d5/d8/d1f/f58 3062098 0 2024-09-17T07:19:47.722 INFO:tasks.workunit.client.1.smithi139.stdout:6/200: dread - db/d18/d1b/f3f zero size 2024-09-17T07:19:47.723 INFO:tasks.workunit.client.0.smithi087.stdout:6/289: write d1/d6/d1a/d2c/d33/f3d [4195665,69458] 0 2024-09-17T07:19:47.724 INFO:tasks.workunit.client.1.smithi139.stdout:6/201: creat db/d18/d38/f43 x:0 0 0 2024-09-17T07:19:47.725 INFO:tasks.workunit.client.1.smithi139.stdout:6/202: creat db/d18/f44 x:0 0 0 2024-09-17T07:19:47.726 INFO:tasks.workunit.client.0.smithi087.stdout:5/314: dread d5/d12/d14/f44 [0,4194304] 0 2024-09-17T07:19:47.726 INFO:tasks.workunit.client.0.smithi087.stdout:6/290: rename d1/d6/d1a/d2c/f5b to d1/d6/d1a/d4e/f63 0 2024-09-17T07:19:47.727 INFO:tasks.workunit.client.0.smithi087.stdout:5/315: chown d5/c31 38938 1 2024-09-17T07:19:47.728 INFO:tasks.workunit.client.0.smithi087.stdout:6/291: truncate d1/d6/d1a/d2c/d33/f3f 816332 0 2024-09-17T07:19:47.730 INFO:tasks.workunit.client.0.smithi087.stdout:4/185: getdents d2/d5/db 0 2024-09-17T07:19:47.732 INFO:tasks.workunit.client.0.smithi087.stdout:6/292: mkdir d1/d6/d1a/d2c/d48/d64 0 2024-09-17T07:19:47.733 INFO:tasks.workunit.client.0.smithi087.stdout:4/186: mkdir d2/d5/db/d3e 0 2024-09-17T07:19:47.734 INFO:tasks.workunit.client.0.smithi087.stdout:4/187: stat d2/d5/db/d21/d2f/f38 0 2024-09-17T07:19:47.734 INFO:tasks.workunit.client.0.smithi087.stdout:6/293: fdatasync d1/d6/d1a/d2c/d40/f49 0 2024-09-17T07:19:47.735 INFO:tasks.workunit.client.0.smithi087.stdout:5/316: dwrite d5/d18/d20/f1e [0,4194304] 0 2024-09-17T07:19:47.736 INFO:tasks.workunit.client.0.smithi087.stdout:4/188: mkdir d2/d22/d2c/d3f 0 2024-09-17T07:19:47.737 INFO:tasks.workunit.client.0.smithi087.stdout:4/189: fsync d2/f32 0 2024-09-17T07:19:47.737 INFO:tasks.workunit.client.0.smithi087.stdout:6/294: rmdir d1/d6/d1a/d2c/d48 39 2024-09-17T07:19:47.738 INFO:tasks.workunit.client.0.smithi087.stdout:5/317: mkdir d5/d6d 0 2024-09-17T07:19:47.739 INFO:tasks.workunit.client.0.smithi087.stdout:4/190: symlink d2/d5/db/l40 0 2024-09-17T07:19:47.740 INFO:tasks.workunit.client.0.smithi087.stdout:6/295: symlink d1/d6/d1a/d2c/d33/l65 0 2024-09-17T07:19:47.741 INFO:tasks.workunit.client.0.smithi087.stdout:5/318: symlink d5/d12/d1c/l6e 0 2024-09-17T07:19:47.741 INFO:tasks.workunit.client.0.smithi087.stdout:5/319: fsync d5/d8/f3f 0 2024-09-17T07:19:47.743 INFO:tasks.workunit.client.0.smithi087.stdout:5/320: chown d5/d18/d20/f35 2561 1 2024-09-17T07:19:47.745 INFO:tasks.workunit.client.0.smithi087.stdout:4/191: dread d2/d5/f26 [0,4194304] 0 2024-09-17T07:19:47.745 INFO:tasks.workunit.client.0.smithi087.stdout:5/321: read - d5/d12/d1c/f6c zero size 2024-09-17T07:19:47.747 INFO:tasks.workunit.client.0.smithi087.stdout:4/192: write d2/d5/d1f/f20 [15190,114643] 0 2024-09-17T07:19:47.749 INFO:tasks.workunit.client.0.smithi087.stdout:5/322: mkdir d5/d18/d6f 0 2024-09-17T07:19:47.749 INFO:tasks.workunit.client.0.smithi087.stdout:6/296: dwrite d1/f35 [0,4194304] 0 2024-09-17T07:19:47.754 INFO:tasks.workunit.client.1.smithi139.stdout:1/54: sync 2024-09-17T07:19:47.756 INFO:tasks.workunit.client.1.smithi139.stdout:1/55: mkdir d2/de 0 2024-09-17T07:19:47.757 INFO:tasks.workunit.client.0.smithi087.stdout:4/193: getdents d2/d5 0 2024-09-17T07:19:47.758 INFO:tasks.workunit.client.0.smithi087.stdout:4/194: stat d2/d5/f26 0 2024-09-17T07:19:47.759 INFO:tasks.workunit.client.0.smithi087.stdout:6/297: symlink d1/d6/d1a/d2c/d48/d62/l66 0 2024-09-17T07:19:47.760 INFO:tasks.workunit.client.0.smithi087.stdout:5/323: dwrite d5/d18/d20/f1e [4194304,4194304] 0 2024-09-17T07:19:47.762 INFO:tasks.workunit.client.0.smithi087.stdout:5/324: symlink d5/d12/l70 0 2024-09-17T07:19:47.763 INFO:tasks.workunit.client.0.smithi087.stdout:4/195: mknod d2/d5/db/d3e/c41 0 2024-09-17T07:19:47.765 INFO:tasks.workunit.client.0.smithi087.stdout:5/325: mkdir d5/d12/d1c/d71 0 2024-09-17T07:19:47.766 INFO:tasks.workunit.client.1.smithi139.stdout:1/56: rmdir d2 39 2024-09-17T07:19:47.767 INFO:tasks.workunit.client.0.smithi087.stdout:4/196: fdatasync d2/d5/d1f/f3a 0 2024-09-17T07:19:47.769 INFO:tasks.workunit.client.0.smithi087.stdout:4/197: mkdir d2/d5/db/d42 0 2024-09-17T07:19:47.770 INFO:tasks.workunit.client.0.smithi087.stdout:5/326: creat d5/d18/d20/d2f/d52/f72 x:0 0 0 2024-09-17T07:19:47.771 INFO:tasks.workunit.client.0.smithi087.stdout:5/327: dread - d5/d18/d20/d2f/f5c zero size 2024-09-17T07:19:47.772 INFO:tasks.workunit.client.0.smithi087.stdout:4/198: truncate d2/d5/f10 6333681 0 2024-09-17T07:19:47.773 INFO:tasks.workunit.client.1.smithi139.stdout:1/57: dwrite d2/f6 [0,4194304] 0 2024-09-17T07:19:47.773 INFO:tasks.workunit.client.0.smithi087.stdout:4/199: write d2/f25 [257687,115998] 0 2024-09-17T07:19:47.775 INFO:tasks.workunit.client.1.smithi139.stdout:1/58: creat d2/ff x:0 0 0 2024-09-17T07:19:47.776 INFO:tasks.workunit.client.1.smithi139.stdout:1/59: write f0 [2012847,2325] 0 2024-09-17T07:19:47.780 INFO:tasks.workunit.client.0.smithi087.stdout:4/200: dread f0 [0,4194304] 0 2024-09-17T07:19:47.781 INFO:tasks.workunit.client.1.smithi139.stdout:1/60: chown d2/f7 3686141 1 2024-09-17T07:19:47.781 INFO:tasks.workunit.client.1.smithi139.stdout:1/61: mkdir d2/d10 0 2024-09-17T07:19:47.790 INFO:tasks.workunit.client.0.smithi087.stdout:5/328: symlink d5/d12/d56/d5b/l73 0 2024-09-17T07:19:47.790 INFO:tasks.workunit.client.0.smithi087.stdout:6/298: dread d1/d6/d1a/d4e/f5d [0,4194304] 0 2024-09-17T07:19:47.791 INFO:tasks.workunit.client.0.smithi087.stdout:4/201: mknod d2/d5/db/d21/d2f/d3b/c43 0 2024-09-17T07:19:47.792 INFO:tasks.workunit.client.0.smithi087.stdout:4/202: unlink f1 0 2024-09-17T07:19:47.792 INFO:tasks.workunit.client.0.smithi087.stdout:5/329: getdents d5/d6d 0 2024-09-17T07:19:47.794 INFO:tasks.workunit.client.0.smithi087.stdout:4/203: mknod d2/d5/db/d21/c44 0 2024-09-17T07:19:47.795 INFO:tasks.workunit.client.0.smithi087.stdout:5/330: truncate d5/d12/d14/f44 1623335 0 2024-09-17T07:19:47.795 INFO:tasks.workunit.client.0.smithi087.stdout:5/331: write d5/d18/d20/d2f/d52/f72 [382876,65005] 0 2024-09-17T07:19:47.796 INFO:tasks.workunit.client.0.smithi087.stdout:4/204: creat d2/f45 x:0 0 0 2024-09-17T07:19:47.798 INFO:tasks.workunit.client.0.smithi087.stdout:5/332: symlink d5/d18/d20/d2f/d52/l74 0 2024-09-17T07:19:47.799 INFO:tasks.workunit.client.0.smithi087.stdout:5/333: creat d5/d12/d14/d61/f75 x:0 0 0 2024-09-17T07:19:47.800 INFO:tasks.workunit.client.0.smithi087.stdout:5/334: dread - d5/d18/d20/f5f zero size 2024-09-17T07:19:47.801 INFO:tasks.workunit.client.0.smithi087.stdout:5/335: truncate d5/d18/d20/f5f 512348 0 2024-09-17T07:19:47.803 INFO:tasks.workunit.client.0.smithi087.stdout:5/336: unlink d5/d12/d14/f44 0 2024-09-17T07:19:47.805 INFO:tasks.workunit.client.0.smithi087.stdout:5/337: creat d5/d12/f76 x:0 0 0 2024-09-17T07:19:47.808 INFO:tasks.workunit.client.0.smithi087.stdout:5/338: link d5/d18/d20/f5f d5/d12/f77 0 2024-09-17T07:19:47.808 INFO:tasks.workunit.client.0.smithi087.stdout:5/339: fdatasync d5/f15 0 2024-09-17T07:19:47.809 INFO:tasks.workunit.client.0.smithi087.stdout:5/340: chown d5/d12/l70 487 1 2024-09-17T07:19:47.809 INFO:tasks.workunit.client.0.smithi087.stdout:5/341: readlink d5/d18/d20/l63 0 2024-09-17T07:19:47.841 INFO:tasks.workunit.client.1.smithi139.stdout:1/62: truncate f0 3365978 0 2024-09-17T07:19:47.847 INFO:tasks.workunit.client.0.smithi087.stdout:5/342: truncate d5/d12/d4d/f3a 325365 0 2024-09-17T07:19:47.848 INFO:tasks.workunit.client.1.smithi139.stdout:1/63: dread d2/f5 [0,4194304] 0 2024-09-17T07:19:47.849 INFO:tasks.workunit.client.1.smithi139.stdout:1/64: truncate d2/fd 83484 0 2024-09-17T07:19:47.853 INFO:tasks.workunit.client.1.smithi139.stdout:1/65: dread d2/f7 [0,4194304] 0 2024-09-17T07:19:47.854 INFO:tasks.workunit.client.1.smithi139.stdout:1/66: dread d2/f5 [0,4194304] 0 2024-09-17T07:19:47.856 INFO:tasks.workunit.client.0.smithi087.stdout:5/343: dwrite d5/d12/f77 [0,4194304] 0 2024-09-17T07:19:47.857 INFO:tasks.workunit.client.1.smithi139.stdout:1/67: creat d2/f11 x:0 0 0 2024-09-17T07:19:47.859 INFO:tasks.workunit.client.1.smithi139.stdout:1/68: unlink d2/f5 0 2024-09-17T07:19:47.860 INFO:tasks.workunit.client.0.smithi087.stdout:4/205: dread d2/d5/f8 [4194304,4194304] 0 2024-09-17T07:19:47.861 INFO:tasks.workunit.client.1.smithi139.stdout:1/69: mkdir d2/d10/d12 0 2024-09-17T07:19:47.862 INFO:tasks.workunit.client.1.smithi139.stdout:1/70: write d2/ff [307527,3311] 0 2024-09-17T07:19:47.862 INFO:tasks.workunit.client.0.smithi087.stdout:4/206: rmdir d2/d22/d2c 39 2024-09-17T07:19:47.862 INFO:tasks.workunit.client.1.smithi139.stdout:1/71: fdatasync d2/fd 0 2024-09-17T07:19:47.864 INFO:tasks.workunit.client.0.smithi087.stdout:4/207: truncate d2/d5/db/f3d 300701 0 2024-09-17T07:19:47.864 INFO:tasks.workunit.client.0.smithi087.stdout:5/344: dwrite d5/d8/f10 [8388608,4194304] 0 2024-09-17T07:19:47.868 INFO:tasks.workunit.client.0.smithi087.stdout:4/208: mknod d2/d5/d1f/c46 0 2024-09-17T07:19:47.869 INFO:tasks.workunit.client.0.smithi087.stdout:5/345: dread d5/d18/d20/d2f/f57 [0,4194304] 0 2024-09-17T07:19:47.870 INFO:tasks.workunit.client.1.smithi139.stdout:1/72: dwrite d2/f11 [0,4194304] 0 2024-09-17T07:19:47.870 INFO:tasks.workunit.client.0.smithi087.stdout:5/346: write d5/f17 [2949045,53582] 0 2024-09-17T07:19:47.871 INFO:tasks.workunit.client.1.smithi139.stdout:1/73: readlink d2/lc 0 2024-09-17T07:19:47.872 INFO:tasks.workunit.client.0.smithi087.stdout:5/347: creat d5/d18/f78 x:0 0 0 2024-09-17T07:19:47.875 INFO:tasks.workunit.client.0.smithi087.stdout:5/348: truncate d5/d12/d1c/f65 583441 0 2024-09-17T07:19:47.877 INFO:tasks.workunit.client.0.smithi087.stdout:4/209: dwrite d2/d22/d2c/f28 [0,4194304] 0 2024-09-17T07:19:47.877 INFO:tasks.workunit.client.0.smithi087.stdout:5/349: dread - d5/d12/d14/d61/f75 zero size 2024-09-17T07:19:47.881 INFO:tasks.workunit.client.1.smithi139.stdout:1/74: getdents d2 0 2024-09-17T07:19:47.883 INFO:tasks.workunit.client.1.smithi139.stdout:1/75: mkdir d2/d10/d12/d13 0 2024-09-17T07:19:47.886 INFO:tasks.workunit.client.1.smithi139.stdout:1/76: mkdir d2/d10/d12/d13/d14 0 2024-09-17T07:19:47.886 INFO:tasks.workunit.client.1.smithi139.stdout:1/77: fdatasync d2/fd 0 2024-09-17T07:19:47.890 INFO:tasks.workunit.client.1.smithi139.stdout:1/78: dread d2/f11 [0,4194304] 0 2024-09-17T07:19:47.891 INFO:tasks.workunit.client.1.smithi139.stdout:1/79: creat d2/f15 x:0 0 0 2024-09-17T07:19:47.892 INFO:tasks.workunit.client.1.smithi139.stdout:1/80: readlink d2/lc 0 2024-09-17T07:19:47.892 INFO:tasks.workunit.client.1.smithi139.stdout:1/81: fsync d2/ff 0 2024-09-17T07:19:47.894 INFO:tasks.workunit.client.1.smithi139.stdout:1/82: creat d2/d10/d12/d13/f16 x:0 0 0 2024-09-17T07:19:47.895 INFO:tasks.workunit.client.1.smithi139.stdout:1/83: creat d2/d10/d12/d13/f17 x:0 0 0 2024-09-17T07:19:47.896 INFO:tasks.workunit.client.0.smithi087.stdout:4/210: truncate d2/f7 1334155 0 2024-09-17T07:19:47.897 INFO:tasks.workunit.client.0.smithi087.stdout:5/350: truncate d5/d12/f77 1368831 0 2024-09-17T07:19:47.897 INFO:tasks.workunit.client.1.smithi139.stdout:1/84: rename d2/ca to d2/c18 0 2024-09-17T07:19:47.898 INFO:tasks.workunit.client.0.smithi087.stdout:4/211: creat d2/d5/db/d21/d2f/f47 x:0 0 0 2024-09-17T07:19:47.898 INFO:tasks.workunit.client.1.smithi139.stdout:1/85: chown d2/d10/d12/d13/f17 701 1 2024-09-17T07:19:47.899 INFO:tasks.workunit.client.0.smithi087.stdout:4/212: creat d2/d5/db/f48 x:0 0 0 2024-09-17T07:19:47.901 INFO:tasks.workunit.client.0.smithi087.stdout:4/213: mknod d2/d5/db/d42/c49 0 2024-09-17T07:19:47.902 INFO:tasks.workunit.client.0.smithi087.stdout:4/214: mknod d2/d5/db/c4a 0 2024-09-17T07:19:47.902 INFO:tasks.workunit.client.0.smithi087.stdout:4/215: fdatasync d2/f25 0 2024-09-17T07:19:47.903 INFO:tasks.workunit.client.0.smithi087.stdout:4/216: rmdir d2/d5 39 2024-09-17T07:19:47.909 INFO:tasks.workunit.client.0.smithi087.stdout:4/217: dwrite d2/d5/db/d21/d2f/f47 [0,4194304] 0 2024-09-17T07:19:47.913 INFO:tasks.workunit.client.0.smithi087.stdout:4/218: symlink d2/d5/db/d3e/l4b 0 2024-09-17T07:19:47.921 INFO:tasks.workunit.client.0.smithi087.stdout:4/219: dwrite d2/d5/d1f/f1e [0,4194304] 0 2024-09-17T07:19:47.922 INFO:tasks.workunit.client.0.smithi087.stdout:4/220: dread - d2/d22/d2c/f31 zero size 2024-09-17T07:19:47.924 INFO:tasks.workunit.client.1.smithi139.stdout:4/100: sync 2024-09-17T07:19:47.925 INFO:tasks.workunit.client.0.smithi087.stdout:4/221: creat d2/d5/db/d21/f4c x:0 0 0 2024-09-17T07:19:47.925 INFO:tasks.workunit.client.1.smithi139.stdout:4/101: chown d0/f5 581549 1 2024-09-17T07:19:47.925 INFO:tasks.workunit.client.0.smithi087.stdout:4/222: truncate d2/f25 4999556 0 2024-09-17T07:19:47.931 INFO:tasks.workunit.client.1.smithi139.stdout:4/102: truncate d0/f5 970724 0 2024-09-17T07:19:47.931 INFO:tasks.workunit.client.0.smithi087.stdout:4/223: getdents d2/d5/db 0 2024-09-17T07:19:47.932 INFO:tasks.workunit.client.1.smithi139.stdout:4/103: creat d0/db/f1b x:0 0 0 2024-09-17T07:19:47.933 INFO:tasks.workunit.client.1.smithi139.stdout:4/104: chown d0/d10 21153 1 2024-09-17T07:19:47.933 INFO:tasks.workunit.client.1.smithi139.stdout:4/105: chown d0/db/d17 1547600 1 2024-09-17T07:19:47.935 INFO:tasks.workunit.client.0.smithi087.stdout:4/224: rename d2/d5/db to d2/d22/d2c/d3f/d4d 0 2024-09-17T07:19:47.937 INFO:tasks.workunit.client.1.smithi139.stdout:4/106: write d0/d1/f8 [102769,67956] 0 2024-09-17T07:19:47.937 INFO:tasks.workunit.client.0.smithi087.stdout:4/225: symlink d2/d22/d2c/d3f/d4d/d21/d2f/l4e 0 2024-09-17T07:19:47.939 INFO:tasks.workunit.client.0.smithi087.stdout:4/226: mkdir d2/d22/d2c/d3f/d4f 0 2024-09-17T07:19:47.940 INFO:tasks.workunit.client.1.smithi139.stdout:4/107: unlink d0/db/f1b 0 2024-09-17T07:19:47.940 INFO:tasks.workunit.client.1.smithi139.stdout:4/108: chown d0/d1/f15 78 1 2024-09-17T07:19:47.941 INFO:tasks.workunit.client.0.smithi087.stdout:4/227: truncate d2/d22/d2c/d3f/d4d/d21/f4c 288168 0 2024-09-17T07:19:47.943 INFO:tasks.workunit.client.0.smithi087.stdout:4/228: link d2/d22/d2c/d3f/d4d/d21/f4c d2/d22/d2c/d3f/d4f/f50 0 2024-09-17T07:19:47.945 INFO:tasks.workunit.client.0.smithi087.stdout:4/229: rmdir d2/d22/d2c/d3f/d4d/d21/d2f/d3b 39 2024-09-17T07:19:47.946 INFO:tasks.workunit.client.0.smithi087.stdout:4/230: creat d2/d22/d2c/d3f/f51 x:0 0 0 2024-09-17T07:19:47.946 INFO:tasks.workunit.client.0.smithi087.stdout:4/231: rmdir d2/d22 39 2024-09-17T07:19:47.948 INFO:tasks.workunit.client.0.smithi087.stdout:4/232: write d2/d5/f8 [3883724,25065] 0 2024-09-17T07:19:47.950 INFO:tasks.workunit.client.1.smithi139.stdout:4/109: dread d0/f2 [0,4194304] 0 2024-09-17T07:19:47.951 INFO:tasks.workunit.client.0.smithi087.stdout:4/233: rename d2/d5/f1d to d2/d22/d2c/d3f/d4d/d3e/f52 0 2024-09-17T07:19:47.952 INFO:tasks.workunit.client.1.smithi139.stdout:4/110: rmdir d0/db/d17 39 2024-09-17T07:19:47.952 INFO:tasks.workunit.client.0.smithi087.stdout:4/234: creat d2/d22/d2c/d3f/d4d/f53 x:0 0 0 2024-09-17T07:19:47.953 INFO:tasks.workunit.client.1.smithi139.stdout:4/111: dread d0/d1/fd [0,4194304] 0 2024-09-17T07:19:47.954 INFO:tasks.workunit.client.1.smithi139.stdout:4/112: read d0/d1/f15 [863276,123825] 0 2024-09-17T07:19:47.954 INFO:tasks.workunit.client.0.smithi087.stdout:4/235: rename d2/fc to d2/d22/d2c/d3f/d4f/f54 0 2024-09-17T07:19:47.955 INFO:tasks.workunit.client.1.smithi139.stdout:4/113: creat d0/db/f1c x:0 0 0 2024-09-17T07:19:47.966 INFO:tasks.workunit.client.1.smithi139.stdout:4/114: dread d0/f5 [0,4194304] 0 2024-09-17T07:19:47.967 INFO:tasks.workunit.client.0.smithi087.stdout:4/236: getdents d2/d5 0 2024-09-17T07:19:47.967 INFO:tasks.workunit.client.1.smithi139.stdout:4/115: write d0/f2 [3621243,90368] 0 2024-09-17T07:19:47.967 INFO:tasks.workunit.client.1.smithi139.stdout:4/116: chown d0/d1 50228 1 2024-09-17T07:19:47.968 INFO:tasks.workunit.client.0.smithi087.stdout:4/237: write d2/d22/d2c/d3f/d4d/f48 [346812,366] 0 2024-09-17T07:19:47.970 INFO:tasks.workunit.client.0.smithi087.stdout:4/238: write d2/d5/f26 [3518899,86884] 0 2024-09-17T07:19:47.972 INFO:tasks.workunit.client.0.smithi087.stdout:4/239: creat d2/d22/d2c/d3f/d4d/d42/f55 x:0 0 0 2024-09-17T07:19:48.021 INFO:tasks.workunit.client.0.smithi087.stdout:7/197: sync 2024-09-17T07:19:48.023 INFO:tasks.workunit.client.0.smithi087.stdout:7/198: creat d0/d3/f3f x:0 0 0 2024-09-17T07:19:48.024 INFO:tasks.workunit.client.0.smithi087.stdout:7/199: rmdir d0/d3/d23/d17 39 2024-09-17T07:19:48.029 INFO:tasks.workunit.client.0.smithi087.stdout:7/200: dwrite d0/d3/d23/f2b [0,4194304] 0 2024-09-17T07:19:48.031 INFO:tasks.workunit.client.0.smithi087.stdout:7/201: creat d0/d3/f40 x:0 0 0 2024-09-17T07:19:48.047 INFO:tasks.workunit.client.0.smithi087.stdout:7/202: creat d0/d3/d23/d17/f41 x:0 0 0 2024-09-17T07:19:48.048 INFO:tasks.workunit.client.0.smithi087.stdout:7/203: write d0/f25 [1410445,11195] 0 2024-09-17T07:19:48.048 INFO:tasks.workunit.client.0.smithi087.stdout:7/204: write d0/f25 [583708,15947] 0 2024-09-17T07:19:48.049 INFO:tasks.workunit.client.0.smithi087.stdout:7/205: dread - d0/d3/d10/f38 zero size 2024-09-17T07:19:48.088 INFO:tasks.workunit.client.1.smithi139.stdout:4/117: creat d0/f1d x:0 0 0 2024-09-17T07:19:48.090 INFO:tasks.workunit.client.1.smithi139.stdout:4/118: getdents d0/db/d17 0 2024-09-17T07:19:48.091 INFO:tasks.workunit.client.1.smithi139.stdout:4/119: chown d0/db/f1c 404 1 2024-09-17T07:19:48.096 INFO:tasks.workunit.client.1.smithi139.stdout:4/120: dwrite d0/f2 [0,4194304] 0 2024-09-17T07:19:48.097 INFO:tasks.workunit.client.1.smithi139.stdout:4/121: dread - d0/db/f1c zero size 2024-09-17T07:19:48.136 INFO:tasks.workunit.client.1.smithi139.stdout:7/61: sync 2024-09-17T07:19:48.137 INFO:tasks.workunit.client.1.smithi139.stdout:4/122: truncate d0/f13 1916189 0 2024-09-17T07:19:48.138 INFO:tasks.workunit.client.1.smithi139.stdout:4/123: truncate d0/db/f1c 925015 0 2024-09-17T07:19:48.139 INFO:tasks.workunit.client.1.smithi139.stdout:7/62: dread d5/d10/f11 [0,4194304] 0 2024-09-17T07:19:48.140 INFO:tasks.workunit.client.1.smithi139.stdout:4/124: creat d0/d1/f1e x:0 0 0 2024-09-17T07:19:48.142 INFO:tasks.workunit.client.1.smithi139.stdout:7/63: link d5/ca d5/d10/c12 0 2024-09-17T07:19:48.143 INFO:tasks.workunit.client.1.smithi139.stdout:7/64: symlink d5/l13 0 2024-09-17T07:19:48.143 INFO:tasks.workunit.client.1.smithi139.stdout:4/125: dread d0/f7 [0,4194304] 0 2024-09-17T07:19:48.143 INFO:tasks.workunit.client.1.smithi139.stdout:7/65: stat d5/d10/f11 0 2024-09-17T07:19:48.146 INFO:tasks.workunit.client.1.smithi139.stdout:4/126: creat d0/d1a/f1f x:0 0 0 2024-09-17T07:19:48.149 INFO:tasks.workunit.client.1.smithi139.stdout:4/127: creat d0/db/f20 x:0 0 0 2024-09-17T07:19:48.151 INFO:tasks.workunit.client.1.smithi139.stdout:4/128: creat d0/db/f21 x:0 0 0 2024-09-17T07:19:48.153 INFO:tasks.workunit.client.1.smithi139.stdout:4/129: write d0/d1a/f1f [948364,84482] 0 2024-09-17T07:19:48.153 INFO:tasks.workunit.client.1.smithi139.stdout:4/130: stat d0 0 2024-09-17T07:19:48.156 INFO:tasks.workunit.client.1.smithi139.stdout:7/66: dwrite d5/fb [0,4194304] 0 2024-09-17T07:19:48.161 INFO:tasks.workunit.client.1.smithi139.stdout:4/131: dwrite d0/db/f20 [0,4194304] 0 2024-09-17T07:19:48.162 INFO:tasks.workunit.client.1.smithi139.stdout:7/67: dread f2 [4194304,4194304] 0 2024-09-17T07:19:48.166 INFO:tasks.workunit.client.1.smithi139.stdout:7/68: creat d5/f14 x:0 0 0 2024-09-17T07:19:48.167 INFO:tasks.workunit.client.1.smithi139.stdout:7/69: chown d5/fb 489 1 2024-09-17T07:19:48.170 INFO:tasks.workunit.client.1.smithi139.stdout:4/132: dwrite d0/f4 [8388608,4194304] 0 2024-09-17T07:19:48.171 INFO:tasks.workunit.client.1.smithi139.stdout:4/133: dread - d0/f1d zero size 2024-09-17T07:19:48.173 INFO:tasks.workunit.client.1.smithi139.stdout:4/134: write d0/db/f21 [718928,46371] 0 2024-09-17T07:19:48.173 INFO:tasks.workunit.client.1.smithi139.stdout:7/70: fsync d5/f14 0 2024-09-17T07:19:48.175 INFO:tasks.workunit.client.1.smithi139.stdout:4/135: dread d0/f5 [0,4194304] 0 2024-09-17T07:19:48.175 INFO:tasks.workunit.client.1.smithi139.stdout:7/71: write d5/d10/f11 [1086777,83971] 0 2024-09-17T07:19:48.178 INFO:tasks.workunit.client.1.smithi139.stdout:7/72: readlink d5/lc 0 2024-09-17T07:19:48.179 INFO:tasks.workunit.client.1.smithi139.stdout:7/73: write d5/f14 [64388,82447] 0 2024-09-17T07:19:48.180 INFO:tasks.workunit.client.1.smithi139.stdout:4/136: link d0/d1/cc d0/db/d17/c22 0 2024-09-17T07:19:48.181 INFO:tasks.workunit.client.1.smithi139.stdout:7/74: write d5/f14 [1063328,100255] 0 2024-09-17T07:19:48.181 INFO:tasks.workunit.client.1.smithi139.stdout:4/137: readlink d0/lf 0 2024-09-17T07:19:48.182 INFO:tasks.workunit.client.1.smithi139.stdout:4/138: fsync d0/d1/f1e 0 2024-09-17T07:19:48.182 INFO:tasks.workunit.client.1.smithi139.stdout:7/75: mknod d5/c15 0 2024-09-17T07:19:48.184 INFO:tasks.workunit.client.1.smithi139.stdout:7/76: write d5/d10/f11 [979341,91443] 0 2024-09-17T07:19:48.184 INFO:tasks.workunit.client.1.smithi139.stdout:4/139: creat d0/db/d17/f23 x:0 0 0 2024-09-17T07:19:48.185 INFO:tasks.workunit.client.1.smithi139.stdout:7/77: symlink d5/l16 0 2024-09-17T07:19:48.192 INFO:tasks.workunit.client.1.smithi139.stdout:7/78: dwrite f2 [0,4194304] 0 2024-09-17T07:19:48.194 INFO:tasks.workunit.client.1.smithi139.stdout:7/79: unlink d5/f14 0 2024-09-17T07:19:48.201 INFO:tasks.workunit.client.1.smithi139.stdout:4/140: dwrite d0/f13 [0,4194304] 0 2024-09-17T07:19:48.203 INFO:tasks.workunit.client.1.smithi139.stdout:7/80: dwrite d5/d10/f11 [0,4194304] 0 2024-09-17T07:19:48.205 INFO:tasks.workunit.client.1.smithi139.stdout:7/81: write d5/fb [3884334,18583] 0 2024-09-17T07:19:48.206 INFO:tasks.workunit.client.1.smithi139.stdout:7/82: write d5/d10/f11 [2766179,5353] 0 2024-09-17T07:19:48.207 INFO:tasks.workunit.client.1.smithi139.stdout:4/141: unlink d0/lf 0 2024-09-17T07:19:48.208 INFO:tasks.workunit.client.1.smithi139.stdout:4/142: truncate d0/db/f1c 1554616 0 2024-09-17T07:19:48.211 INFO:tasks.workunit.client.1.smithi139.stdout:7/83: getdents d5 0 2024-09-17T07:19:48.213 INFO:tasks.workunit.client.1.smithi139.stdout:4/143: dread d0/f7 [0,4194304] 0 2024-09-17T07:19:48.213 INFO:tasks.workunit.client.1.smithi139.stdout:7/84: mkdir d5/d17 0 2024-09-17T07:19:48.216 INFO:tasks.workunit.client.1.smithi139.stdout:4/144: mknod d0/db/d17/c24 0 2024-09-17T07:19:48.219 INFO:tasks.workunit.client.1.smithi139.stdout:4/145: unlink d0/d10/c16 0 2024-09-17T07:19:48.221 INFO:tasks.workunit.client.1.smithi139.stdout:7/85: dwrite d5/fb [4194304,4194304] 0 2024-09-17T07:19:48.221 INFO:tasks.workunit.client.1.smithi139.stdout:4/146: dread d0/f5 [0,4194304] 0 2024-09-17T07:19:48.228 INFO:tasks.workunit.client.1.smithi139.stdout:4/147: write d0/f5 [969006,86385] 0 2024-09-17T07:19:48.229 INFO:tasks.workunit.client.1.smithi139.stdout:7/86: dwrite f2 [4194304,4194304] 0 2024-09-17T07:19:48.230 INFO:tasks.workunit.client.0.smithi087.stdout:1/201: sync 2024-09-17T07:19:48.230 INFO:tasks.workunit.client.0.smithi087.stdout:9/171: sync 2024-09-17T07:19:48.230 INFO:tasks.workunit.client.0.smithi087.stdout:8/182: sync 2024-09-17T07:19:48.230 INFO:tasks.workunit.client.1.smithi139.stdout:4/148: write d0/f4 [1540810,16392] 0 2024-09-17T07:19:48.231 INFO:tasks.workunit.client.1.smithi139.stdout:7/87: chown d5/c15 114 1 2024-09-17T07:19:48.231 INFO:tasks.workunit.client.0.smithi087.stdout:1/202: fsync d2/d14/dd/ff 0 2024-09-17T07:19:48.232 INFO:tasks.workunit.client.0.smithi087.stdout:8/183: creat d1/d7/d9/d19/f40 x:0 0 0 2024-09-17T07:19:48.232 INFO:tasks.workunit.client.0.smithi087.stdout:1/203: stat d2/d14/dd/d43/f4b 0 2024-09-17T07:19:48.233 INFO:tasks.workunit.client.1.smithi139.stdout:4/149: creat d0/d10/f25 x:0 0 0 2024-09-17T07:19:48.234 INFO:tasks.workunit.client.1.smithi139.stdout:7/88: creat d5/f18 x:0 0 0 2024-09-17T07:19:48.234 INFO:tasks.workunit.client.1.smithi139.stdout:7/89: chown f2 0 1 2024-09-17T07:19:48.235 INFO:tasks.workunit.client.1.smithi139.stdout:7/90: write d5/d10/f11 [2677078,71218] 0 2024-09-17T07:19:48.236 INFO:tasks.workunit.client.1.smithi139.stdout:4/150: creat d0/f26 x:0 0 0 2024-09-17T07:19:48.236 INFO:tasks.workunit.client.0.smithi087.stdout:1/204: rename d2/d14/l50 to d2/da/l51 0 2024-09-17T07:19:48.237 INFO:tasks.workunit.client.0.smithi087.stdout:1/205: chown d2/dc/f40 204563635 1 2024-09-17T07:19:48.237 INFO:tasks.workunit.client.0.smithi087.stdout:8/184: creat d1/d2b/f41 x:0 0 0 2024-09-17T07:19:48.238 INFO:tasks.workunit.client.0.smithi087.stdout:1/206: dread - d2/d3d/f49 zero size 2024-09-17T07:19:48.238 INFO:tasks.workunit.client.1.smithi139.stdout:4/151: dread d0/d1/fd [0,4194304] 0 2024-09-17T07:19:48.239 INFO:tasks.workunit.client.0.smithi087.stdout:8/185: write d1/d7/d9/d19/f40 [874903,56659] 0 2024-09-17T07:19:48.239 INFO:tasks.workunit.client.1.smithi139.stdout:4/152: truncate d0/f2 4877284 0 2024-09-17T07:19:48.241 INFO:tasks.workunit.client.0.smithi087.stdout:1/207: creat d2/d14/dd/d37/f52 x:0 0 0 2024-09-17T07:19:48.241 INFO:tasks.workunit.client.1.smithi139.stdout:4/153: mknod d0/d1/c27 0 2024-09-17T07:19:48.242 INFO:tasks.workunit.client.1.smithi139.stdout:7/91: dwrite d5/d10/f11 [0,4194304] 0 2024-09-17T07:19:48.242 INFO:tasks.workunit.client.0.smithi087.stdout:1/208: readlink d2/dc/l2e 0 2024-09-17T07:19:48.242 INFO:tasks.workunit.client.0.smithi087.stdout:8/186: dread d1/d7/f13 [0,4194304] 0 2024-09-17T07:19:48.242 INFO:tasks.workunit.client.0.smithi087.stdout:1/209: dread - d2/d1a/f29 zero size 2024-09-17T07:19:48.243 INFO:tasks.workunit.client.0.smithi087.stdout:9/172: dread d3/d4/da/d1c/d1e/f31 [0,4194304] 0 2024-09-17T07:19:48.244 INFO:tasks.workunit.client.0.smithi087.stdout:9/173: readlink d3/d4/da/lf 0 2024-09-17T07:19:48.245 INFO:tasks.workunit.client.1.smithi139.stdout:7/92: mknod d5/c19 0 2024-09-17T07:19:48.245 INFO:tasks.workunit.client.0.smithi087.stdout:1/210: creat d2/d3d/d35/f53 x:0 0 0 2024-09-17T07:19:48.245 INFO:tasks.workunit.client.1.smithi139.stdout:7/93: write d5/f18 [399809,85007] 0 2024-09-17T07:19:48.246 INFO:tasks.workunit.client.0.smithi087.stdout:1/211: chown d2/d3d/f28 673 1 2024-09-17T07:19:48.247 INFO:tasks.workunit.client.1.smithi139.stdout:4/154: dread d0/db/f21 [0,4194304] 0 2024-09-17T07:19:48.248 INFO:tasks.workunit.client.0.smithi087.stdout:1/212: truncate d2/d14/dd/d43/f4b 908763 0 2024-09-17T07:19:48.248 INFO:tasks.workunit.client.0.smithi087.stdout:9/174: dread d3/d4/d16/f3a [0,4194304] 0 2024-09-17T07:19:48.249 INFO:tasks.workunit.client.0.smithi087.stdout:1/213: fsync d2/da/f30 0 2024-09-17T07:19:48.250 INFO:tasks.workunit.client.1.smithi139.stdout:4/155: dread d0/db/f20 [0,4194304] 0 2024-09-17T07:19:48.251 INFO:tasks.workunit.client.1.smithi139.stdout:3/60: sync 2024-09-17T07:19:48.251 INFO:tasks.workunit.client.1.smithi139.stdout:0/63: sync 2024-09-17T07:19:48.253 INFO:tasks.workunit.client.0.smithi087.stdout:1/214: creat d2/d14/dd/d37/f54 x:0 0 0 2024-09-17T07:19:48.253 INFO:tasks.workunit.client.1.smithi139.stdout:4/156: mknod d0/d1a/c28 0 2024-09-17T07:19:48.253 INFO:tasks.workunit.client.1.smithi139.stdout:3/61: mkdir d5/d15 0 2024-09-17T07:19:48.254 INFO:tasks.workunit.client.1.smithi139.stdout:4/157: chown d0/db/f21 7974195 1 2024-09-17T07:19:48.255 INFO:tasks.workunit.client.0.smithi087.stdout:1/215: symlink d2/d3d/d35/d4f/l55 0 2024-09-17T07:19:48.256 INFO:tasks.workunit.client.1.smithi139.stdout:3/62: mkdir d5/d15/d16 0 2024-09-17T07:19:48.257 INFO:tasks.workunit.client.1.smithi139.stdout:4/158: write d0/d1a/f1f [1741459,77283] 0 2024-09-17T07:19:48.257 INFO:tasks.workunit.client.0.smithi087.stdout:9/175: dwrite d3/d4/d6/d8/d22/f2d [4194304,4194304] 0 2024-09-17T07:19:48.259 INFO:tasks.workunit.client.1.smithi139.stdout:0/64: dwrite d1/da/fc [0,4194304] 0 2024-09-17T07:19:48.260 INFO:tasks.workunit.client.1.smithi139.stdout:4/159: mkdir d0/d1/d29 0 2024-09-17T07:19:48.260 INFO:tasks.workunit.client.0.smithi087.stdout:1/216: mknod d2/d3d/d35/c56 0 2024-09-17T07:19:48.261 INFO:tasks.workunit.client.1.smithi139.stdout:3/63: creat d5/d15/d16/f17 x:0 0 0 2024-09-17T07:19:48.262 INFO:tasks.workunit.client.1.smithi139.stdout:7/94: fsync d5/d10/f11 0 2024-09-17T07:19:48.262 INFO:tasks.workunit.client.1.smithi139.stdout:0/65: mknod d1/c19 0 2024-09-17T07:19:48.263 INFO:tasks.workunit.client.1.smithi139.stdout:3/64: write d5/fe [4584952,33762] 0 2024-09-17T07:19:48.267 INFO:tasks.workunit.client.1.smithi139.stdout:4/160: symlink d0/d1/d29/l2a 0 2024-09-17T07:19:48.267 INFO:tasks.workunit.client.0.smithi087.stdout:9/176: truncate d3/d4/d16/f1b 277080 0 2024-09-17T07:19:48.268 INFO:tasks.workunit.client.0.smithi087.stdout:1/217: dread d2/d1a/f1c [0,4194304] 0 2024-09-17T07:19:48.270 INFO:tasks.workunit.client.0.smithi087.stdout:9/177: creat d3/d4/d6/d8/d12/f40 x:0 0 0 2024-09-17T07:19:48.270 INFO:tasks.workunit.client.0.smithi087.stdout:1/218: truncate d2/d14/dd/d37/f54 955793 0 2024-09-17T07:19:48.270 INFO:tasks.workunit.client.1.smithi139.stdout:3/65: unlink c0 0 2024-09-17T07:19:48.271 INFO:tasks.workunit.client.1.smithi139.stdout:0/66: rmdir d1/df 39 2024-09-17T07:19:48.272 INFO:tasks.workunit.client.0.smithi087.stdout:1/219: mkdir d2/d3d/d35/d57 0 2024-09-17T07:19:48.273 INFO:tasks.workunit.client.0.smithi087.stdout:9/178: fdatasync d3/d4/d6/d8/d22/f37 0 2024-09-17T07:19:48.274 INFO:tasks.workunit.client.1.smithi139.stdout:4/161: creat d0/d1/d29/f2b x:0 0 0 2024-09-17T07:19:48.274 INFO:tasks.workunit.client.0.smithi087.stdout:9/179: readlink d3/d4/l10 0 2024-09-17T07:19:48.274 INFO:tasks.workunit.client.1.smithi139.stdout:3/66: creat d5/d15/f18 x:0 0 0 2024-09-17T07:19:48.276 INFO:tasks.workunit.client.1.smithi139.stdout:7/95: mknod d5/d17/c1a 0 2024-09-17T07:19:48.276 INFO:tasks.workunit.client.0.smithi087.stdout:9/180: mknod d3/d4/d6/d8/d12/d32/c41 0 2024-09-17T07:19:48.277 INFO:tasks.workunit.client.0.smithi087.stdout:1/220: link d2/d3d/d35/d4f/l55 d2/d3d/l58 0 2024-09-17T07:19:48.277 INFO:tasks.workunit.client.0.smithi087.stdout:1/221: dread - d2/d1a/f3e zero size 2024-09-17T07:19:48.278 INFO:tasks.workunit.client.0.smithi087.stdout:1/222: dread - d2/d3d/f2f zero size 2024-09-17T07:19:48.278 INFO:tasks.workunit.client.1.smithi139.stdout:3/67: creat d5/d15/f19 x:0 0 0 2024-09-17T07:19:48.279 INFO:tasks.workunit.client.0.smithi087.stdout:9/181: unlink d3/d25/f30 0 2024-09-17T07:19:48.279 INFO:tasks.workunit.client.1.smithi139.stdout:0/67: rename d1/l16 to d1/df/l1a 0 2024-09-17T07:19:48.280 INFO:tasks.workunit.client.0.smithi087.stdout:9/182: fdatasync d3/d4/d6/f13 0 2024-09-17T07:19:48.281 INFO:tasks.workunit.client.1.smithi139.stdout:5/77: sync 2024-09-17T07:19:48.281 INFO:tasks.workunit.client.1.smithi139.stdout:9/197: sync 2024-09-17T07:19:48.281 INFO:tasks.workunit.client.1.smithi139.stdout:1/86: sync 2024-09-17T07:19:48.281 INFO:tasks.workunit.client.1.smithi139.stdout:6/203: sync 2024-09-17T07:19:48.281 INFO:tasks.workunit.client.1.smithi139.stdout:2/169: sync 2024-09-17T07:19:48.281 INFO:tasks.workunit.client.1.smithi139.stdout:8/125: sync 2024-09-17T07:19:48.283 INFO:tasks.workunit.client.0.smithi087.stdout:1/223: read d2/d3d/f21 [79933,81859] 0 2024-09-17T07:19:48.284 INFO:tasks.workunit.client.1.smithi139.stdout:5/78: read d4/d16/f19 [230668,24286] 0 2024-09-17T07:19:48.285 INFO:tasks.workunit.client.0.smithi087.stdout:1/224: read d2/d1a/f1c [104984,76429] 0 2024-09-17T07:19:48.285 INFO:tasks.workunit.client.1.smithi139.stdout:6/204: write db/df/f24 [252476,24086] 0 2024-09-17T07:19:48.286 INFO:tasks.workunit.client.0.smithi087.stdout:9/183: dread d3/d4/d6/d8/d22/f2d [0,4194304] 0 2024-09-17T07:19:48.286 INFO:tasks.workunit.client.0.smithi087.stdout:1/225: dread - d2/d1a/f3e zero size 2024-09-17T07:19:48.286 INFO:tasks.workunit.client.1.smithi139.stdout:8/126: mknod d0/c24 0 2024-09-17T07:19:48.287 INFO:tasks.workunit.client.1.smithi139.stdout:7/96: dwrite d5/d10/f11 [4194304,4194304] 0 2024-09-17T07:19:48.287 INFO:tasks.workunit.client.0.smithi087.stdout:1/226: chown d2/d1a/f29 1137599422 1 2024-09-17T07:19:48.288 INFO:tasks.workunit.client.1.smithi139.stdout:6/205: readlink db/df/d2a/l2d 0 2024-09-17T07:19:48.288 INFO:tasks.workunit.client.1.smithi139.stdout:5/79: dread d4/f17 [0,4194304] 0 2024-09-17T07:19:48.289 INFO:tasks.workunit.client.1.smithi139.stdout:7/97: write d5/fb [2819945,119354] 0 2024-09-17T07:19:48.290 INFO:tasks.workunit.client.1.smithi139.stdout:9/198: mkdir dc/d11/d15/d3c 0 2024-09-17T07:19:48.291 INFO:tasks.workunit.client.1.smithi139.stdout:6/206: truncate db/d18/f39 499408 0 2024-09-17T07:19:48.293 INFO:tasks.workunit.client.0.smithi087.stdout:9/184: link d3/d4/da/lf d3/d4/d6/d8/l42 0 2024-09-17T07:19:48.294 INFO:tasks.workunit.client.0.smithi087.stdout:1/227: dread d2/dc/f23 [0,4194304] 0 2024-09-17T07:19:48.295 INFO:tasks.workunit.client.1.smithi139.stdout:8/127: creat d0/f25 x:0 0 0 2024-09-17T07:19:48.295 INFO:tasks.workunit.client.0.smithi087.stdout:1/228: fdatasync d2/d3d/f2f 0 2024-09-17T07:19:48.296 INFO:tasks.workunit.client.1.smithi139.stdout:8/128: chown d0/l11 157 1 2024-09-17T07:19:48.298 INFO:tasks.workunit.client.1.smithi139.stdout:7/98: creat d5/f1b x:0 0 0 2024-09-17T07:19:48.298 INFO:tasks.workunit.client.0.smithi087.stdout:9/185: write d3/d4/d6/d8/d22/f37 [114947,127975] 0 2024-09-17T07:19:48.299 INFO:tasks.workunit.client.1.smithi139.stdout:0/68: rename d1/df to d1/da/d1b 0 2024-09-17T07:19:48.301 INFO:tasks.workunit.client.1.smithi139.stdout:6/207: creat db/d18/f45 x:0 0 0 2024-09-17T07:19:48.301 INFO:tasks.workunit.client.1.smithi139.stdout:7/99: stat d5/lc 0 2024-09-17T07:19:48.301 INFO:tasks.workunit.client.1.smithi139.stdout:3/68: truncate d5/fe 2054913 0 2024-09-17T07:19:48.302 INFO:tasks.workunit.client.0.smithi087.stdout:9/186: mkdir d3/d4/d6/d8/d22/d43 0 2024-09-17T07:19:48.302 INFO:tasks.workunit.client.1.smithi139.stdout:9/199: dwrite dc/d11/d15/d1e/f23 [0,4194304] 0 2024-09-17T07:19:48.304 INFO:tasks.workunit.client.1.smithi139.stdout:8/129: write d0/dc/d18/f1f [485540,112470] 0 2024-09-17T07:19:48.306 INFO:tasks.workunit.client.0.smithi087.stdout:9/187: getdents d3/d4/d6/d8/d12/d32 0 2024-09-17T07:19:48.307 INFO:tasks.workunit.client.1.smithi139.stdout:2/170: getdents d0/d7/d1a 0 2024-09-17T07:19:48.308 INFO:tasks.workunit.client.1.smithi139.stdout:8/130: stat d0/lf 0 2024-09-17T07:19:48.308 INFO:tasks.workunit.client.1.smithi139.stdout:7/100: symlink d5/l1c 0 2024-09-17T07:19:48.309 INFO:tasks.workunit.client.1.smithi139.stdout:6/208: mkdir db/d21/d46 0 2024-09-17T07:19:48.311 INFO:tasks.workunit.client.1.smithi139.stdout:0/69: mkdir d1/da/d1b/d1c 0 2024-09-17T07:19:48.311 INFO:tasks.workunit.client.0.smithi087.stdout:1/229: dwrite d2/d14/dd/f18 [0,4194304] 0 2024-09-17T07:19:48.313 INFO:tasks.workunit.client.1.smithi139.stdout:1/87: rename d2/c18 to d2/d10/d12/d13/c19 0 2024-09-17T07:19:48.313 INFO:tasks.workunit.client.1.smithi139.stdout:2/171: dread - d0/dc/d15/f23 zero size 2024-09-17T07:19:48.313 INFO:tasks.workunit.client.1.smithi139.stdout:4/162: dwrite d0/d1/f15 [4194304,4194304] 0 2024-09-17T07:19:48.314 INFO:tasks.workunit.client.1.smithi139.stdout:8/131: truncate d0/fb 4739214 0 2024-09-17T07:19:48.316 INFO:tasks.workunit.client.1.smithi139.stdout:5/80: getdents d4 0 2024-09-17T07:19:48.317 INFO:tasks.workunit.client.1.smithi139.stdout:7/101: unlink d5/fb 0 2024-09-17T07:19:48.318 INFO:tasks.workunit.client.0.smithi087.stdout:1/230: dwrite d2/d14/dd/d37/f52 [0,4194304] 0 2024-09-17T07:19:48.319 INFO:tasks.workunit.client.1.smithi139.stdout:8/132: write d0/fd [2345987,55722] 0 2024-09-17T07:19:48.319 INFO:tasks.workunit.client.1.smithi139.stdout:9/200: creat dc/d11/d15/d3c/f3d x:0 0 0 2024-09-17T07:19:48.322 INFO:tasks.workunit.client.1.smithi139.stdout:1/88: dread d2/ff [0,4194304] 0 2024-09-17T07:19:48.322 INFO:tasks.workunit.client.1.smithi139.stdout:3/69: dread d5/f11 [0,4194304] 0 2024-09-17T07:19:48.322 INFO:tasks.workunit.client.1.smithi139.stdout:8/133: write d0/dc/f10 [338910,45076] 0 2024-09-17T07:19:48.323 INFO:tasks.workunit.client.0.smithi087.stdout:6/299: sync 2024-09-17T07:19:48.323 INFO:tasks.workunit.client.0.smithi087.stdout:4/240: sync 2024-09-17T07:19:48.323 INFO:tasks.workunit.client.0.smithi087.stdout:7/206: sync 2024-09-17T07:19:48.323 INFO:tasks.workunit.client.0.smithi087.stdout:2/286: sync 2024-09-17T07:19:48.323 INFO:tasks.workunit.client.0.smithi087.stdout:3/175: sync 2024-09-17T07:19:48.323 INFO:tasks.workunit.client.0.smithi087.stdout:5/351: sync 2024-09-17T07:19:48.323 INFO:tasks.workunit.client.0.smithi087.stdout:0/344: sync 2024-09-17T07:19:48.324 INFO:tasks.workunit.client.1.smithi139.stdout:9/201: dread - dc/d11/d15/f17 zero size 2024-09-17T07:19:48.324 INFO:tasks.workunit.client.1.smithi139.stdout:7/102: write d5/f1b [54309,123825] 0 2024-09-17T07:19:48.326 INFO:tasks.workunit.client.1.smithi139.stdout:1/89: write d2/f4 [876829,21689] 0 2024-09-17T07:19:48.327 INFO:tasks.workunit.client.1.smithi139.stdout:5/81: dread d4/f6 [0,4194304] 0 2024-09-17T07:19:48.327 INFO:tasks.workunit.client.1.smithi139.stdout:8/134: chown d0/dc/l1e 13 1 2024-09-17T07:19:48.329 INFO:tasks.workunit.client.1.smithi139.stdout:6/209: creat db/df/d2a/f47 x:0 0 0 2024-09-17T07:19:48.329 INFO:tasks.workunit.client.1.smithi139.stdout:0/70: unlink d1/da/d1b/f11 0 2024-09-17T07:19:48.329 INFO:tasks.workunit.client.1.smithi139.stdout:5/82: chown d4/f6 42463098 1 2024-09-17T07:19:48.330 INFO:tasks.workunit.client.1.smithi139.stdout:6/210: readlink db/df/l17 0 2024-09-17T07:19:48.331 INFO:tasks.workunit.client.0.smithi087.stdout:2/287: dread - d2/d7/d30/f4e zero size 2024-09-17T07:19:48.331 INFO:tasks.workunit.client.0.smithi087.stdout:7/207: symlink d0/d3/d10/d31/l42 0 2024-09-17T07:19:48.331 INFO:tasks.workunit.client.0.smithi087.stdout:6/300: read d1/d6/d1a/d2c/d33/f3d [1701397,108923] 0 2024-09-17T07:19:48.331 INFO:tasks.workunit.client.1.smithi139.stdout:3/70: fsync d5/f11 0 2024-09-17T07:19:48.332 INFO:tasks.workunit.client.0.smithi087.stdout:2/288: dread - d2/d48/f59 zero size 2024-09-17T07:19:48.333 INFO:tasks.workunit.client.0.smithi087.stdout:7/208: chown d0/f26 305036 1 2024-09-17T07:19:48.334 INFO:tasks.workunit.client.0.smithi087.stdout:0/345: truncate db/d45/f53 387967 0 2024-09-17T07:19:48.335 INFO:tasks.workunit.client.1.smithi139.stdout:1/90: mkdir d2/d10/d12/d1a 0 2024-09-17T07:19:48.336 INFO:tasks.workunit.client.1.smithi139.stdout:0/71: write d1/da/fc [2609368,105061] 0 2024-09-17T07:19:48.336 INFO:tasks.workunit.client.1.smithi139.stdout:7/103: stat d5/ca 0 2024-09-17T07:19:48.336 INFO:tasks.workunit.client.0.smithi087.stdout:2/289: truncate d2/d7/f8 5084442 0 2024-09-17T07:19:48.338 INFO:tasks.workunit.client.0.smithi087.stdout:2/290: chown d2/d24/c40 3642 1 2024-09-17T07:19:48.339 INFO:tasks.workunit.client.0.smithi087.stdout:4/241: link d2/d5/d1f/f35 d2/d22/d2c/d3f/d4d/d21/d2f/d3b/f56 0 2024-09-17T07:19:48.339 INFO:tasks.workunit.client.0.smithi087.stdout:5/352: dread d5/d8/f10 [4194304,4194304] 0 2024-09-17T07:19:48.339 INFO:tasks.workunit.client.0.smithi087.stdout:0/346: readlink db/d4f/l5a 0 2024-09-17T07:19:48.340 INFO:tasks.workunit.client.1.smithi139.stdout:3/71: creat d5/d13/f1a x:0 0 0 2024-09-17T07:19:48.340 INFO:tasks.workunit.client.0.smithi087.stdout:5/353: readlink d5/d12/d56/d5b/l73 0 2024-09-17T07:19:48.341 INFO:tasks.workunit.client.1.smithi139.stdout:4/163: getdents d0 0 2024-09-17T07:19:48.341 INFO:tasks.workunit.client.1.smithi139.stdout:9/202: creat dc/f3e x:0 0 0 2024-09-17T07:19:48.343 INFO:tasks.workunit.client.1.smithi139.stdout:7/104: mknod d5/d10/c1d 0 2024-09-17T07:19:48.344 INFO:tasks.workunit.client.1.smithi139.stdout:3/72: mknod d5/c1b 0 2024-09-17T07:19:48.345 INFO:tasks.workunit.client.1.smithi139.stdout:8/135: dwrite d0/dc/d18/f1f [0,4194304] 0 2024-09-17T07:19:48.345 INFO:tasks.workunit.client.1.smithi139.stdout:5/83: link d4/de/l12 d4/d16/d1b/l1c 0 2024-09-17T07:19:48.347 INFO:tasks.workunit.client.0.smithi087.stdout:6/301: getdents d1 0 2024-09-17T07:19:48.347 INFO:tasks.workunit.client.1.smithi139.stdout:8/136: fdatasync d0/d1a/f21 0 2024-09-17T07:19:48.347 INFO:tasks.workunit.client.1.smithi139.stdout:3/73: chown d5/d15/f18 0 1 2024-09-17T07:19:48.348 INFO:tasks.workunit.client.1.smithi139.stdout:4/164: creat d0/db/d17/f2c x:0 0 0 2024-09-17T07:19:48.349 INFO:tasks.workunit.client.0.smithi087.stdout:4/242: symlink d2/l57 0 2024-09-17T07:19:48.351 INFO:tasks.workunit.client.1.smithi139.stdout:0/72: rmdir d1/da/d1b/d1c 0 2024-09-17T07:19:48.351 INFO:tasks.workunit.client.1.smithi139.stdout:7/105: fsync d5/f1b 0 2024-09-17T07:19:48.351 INFO:tasks.workunit.client.1.smithi139.stdout:4/165: readlink d0/d1/d29/l2a 0 2024-09-17T07:19:48.352 INFO:tasks.workunit.client.1.smithi139.stdout:8/137: chown d0/c16 0 1 2024-09-17T07:19:48.354 INFO:tasks.workunit.client.1.smithi139.stdout:1/91: dwrite d2/ff [0,4194304] 0 2024-09-17T07:19:48.355 INFO:tasks.workunit.client.0.smithi087.stdout:6/302: fdatasync d1/d6/d1a/f41 0 2024-09-17T07:19:48.355 INFO:tasks.workunit.client.0.smithi087.stdout:5/354: rename d5/d12/d14/c29 to d5/d6d/c79 0 2024-09-17T07:19:48.355 INFO:tasks.workunit.client.1.smithi139.stdout:8/138: write d0/d1a/f21 [1198604,92321] 0 2024-09-17T07:19:48.356 INFO:tasks.workunit.client.0.smithi087.stdout:2/291: dwrite d2/d15/d34/f55 [0,4194304] 0 2024-09-17T07:19:48.356 INFO:tasks.workunit.client.1.smithi139.stdout:9/203: unlink dc/c22 0 2024-09-17T07:19:48.357 INFO:tasks.workunit.client.1.smithi139.stdout:8/139: truncate d0/dc/f10 955591 0 2024-09-17T07:19:48.357 INFO:tasks.workunit.client.1.smithi139.stdout:8/140: chown d0/dc/f10 11 1 2024-09-17T07:19:48.358 INFO:tasks.workunit.client.1.smithi139.stdout:8/141: dread - d0/f25 zero size 2024-09-17T07:19:48.359 INFO:tasks.workunit.client.0.smithi087.stdout:1/231: write d2/d14/dd/f47 [2665929,53822] 0 2024-09-17T07:19:48.359 INFO:tasks.workunit.client.1.smithi139.stdout:5/84: creat d4/d16/f1d x:0 0 0 2024-09-17T07:19:48.359 INFO:tasks.workunit.client.0.smithi087.stdout:4/243: readlink d2/d22/d2c/d3f/d4d/d21/d2f/l4e 0 2024-09-17T07:19:48.360 INFO:tasks.workunit.client.1.smithi139.stdout:7/106: creat d5/f1e x:0 0 0 2024-09-17T07:19:48.361 INFO:tasks.workunit.client.1.smithi139.stdout:0/73: mkdir d1/da/d1b/d1d 0 2024-09-17T07:19:48.361 INFO:tasks.workunit.client.0.smithi087.stdout:6/303: fsync d1/d6/d1a/d2c/d33/f54 0 2024-09-17T07:19:48.362 INFO:tasks.workunit.client.1.smithi139.stdout:0/74: fsync d1/da/fc 0 2024-09-17T07:19:48.362 INFO:tasks.workunit.client.0.smithi087.stdout:5/355: truncate d5/d12/d4d/f47 547239 0 2024-09-17T07:19:48.363 INFO:tasks.workunit.client.1.smithi139.stdout:4/166: creat d0/db/d17/f2d x:0 0 0 2024-09-17T07:19:48.363 INFO:tasks.workunit.client.0.smithi087.stdout:3/176: dread d6/d15/f29 [0,4194304] 0 2024-09-17T07:19:48.364 INFO:tasks.workunit.client.1.smithi139.stdout:9/204: creat dc/d11/d15/d3c/f3f x:0 0 0 2024-09-17T07:19:48.364 INFO:tasks.workunit.client.0.smithi087.stdout:7/209: dwrite d0/f3b [0,4194304] 0 2024-09-17T07:19:48.364 INFO:tasks.workunit.client.0.smithi087.stdout:2/292: fsync d2/d7/dd/f43 0 2024-09-17T07:19:48.367 INFO:tasks.workunit.client.0.smithi087.stdout:6/304: chown d1/d6/d1a/l4a 4922506 1 2024-09-17T07:19:48.367 INFO:tasks.workunit.client.0.smithi087.stdout:2/293: dread - d2/d48/f59 zero size 2024-09-17T07:19:48.367 INFO:tasks.workunit.client.1.smithi139.stdout:7/107: mknod d5/d17/c1f 0 2024-09-17T07:19:48.369 INFO:tasks.workunit.client.0.smithi087.stdout:1/232: rename d2/d14/dd/d37/c4c to d2/d3d/c59 0 2024-09-17T07:19:48.371 INFO:tasks.workunit.client.1.smithi139.stdout:4/167: symlink d0/l2e 0 2024-09-17T07:19:48.371 INFO:tasks.workunit.client.0.smithi087.stdout:1/233: truncate d2/d14/dd/d37/f54 1341069 0 2024-09-17T07:19:48.372 INFO:tasks.workunit.client.1.smithi139.stdout:5/85: mkdir d4/d16/d1b/d1e 0 2024-09-17T07:19:48.373 INFO:tasks.workunit.client.1.smithi139.stdout:9/205: dwrite dc/d11/d15/d1e/f21 [4194304,4194304] 0 2024-09-17T07:19:48.373 INFO:tasks.workunit.client.0.smithi087.stdout:4/244: creat d2/d22/d2c/f58 x:0 0 0 2024-09-17T07:19:48.374 INFO:tasks.workunit.client.1.smithi139.stdout:5/86: chown d4/lc 4014712 1 2024-09-17T07:19:48.375 INFO:tasks.workunit.client.0.smithi087.stdout:1/234: stat d2/d14/dd/d43/f4b 0 2024-09-17T07:19:48.375 INFO:tasks.workunit.client.0.smithi087.stdout:3/177: write d6/d15/f29 [2596751,95716] 0 2024-09-17T07:19:48.376 INFO:tasks.workunit.client.0.smithi087.stdout:6/305: mkdir d1/d67 0 2024-09-17T07:19:48.377 INFO:tasks.workunit.client.0.smithi087.stdout:2/294: unlink d2/d7/dd/c1b 0 2024-09-17T07:19:48.377 INFO:tasks.workunit.client.1.smithi139.stdout:7/108: dread d5/f18 [0,4194304] 0 2024-09-17T07:19:48.378 INFO:tasks.workunit.client.0.smithi087.stdout:4/245: creat d2/d5/f59 x:0 0 0 2024-09-17T07:19:48.380 INFO:tasks.workunit.client.0.smithi087.stdout:3/178: rmdir d6/d1b/d2b/d30 39 2024-09-17T07:19:48.381 INFO:tasks.workunit.client.1.smithi139.stdout:0/75: mknod d1/da/d1b/d1d/c1e 0 2024-09-17T07:19:48.381 INFO:tasks.workunit.client.1.smithi139.stdout:0/76: chown d1 30 1 2024-09-17T07:19:48.381 INFO:tasks.workunit.client.1.smithi139.stdout:4/168: rmdir d0/d1/d29 39 2024-09-17T07:19:48.384 INFO:tasks.workunit.client.1.smithi139.stdout:4/169: write d0/d10/f25 [838475,103949] 0 2024-09-17T07:19:48.384 INFO:tasks.workunit.client.1.smithi139.stdout:8/142: link d0/l5 d0/dc/d18/l26 0 2024-09-17T07:19:48.385 INFO:tasks.workunit.client.1.smithi139.stdout:8/143: fsync d0/fd 0 2024-09-17T07:19:48.385 INFO:tasks.workunit.client.0.smithi087.stdout:2/295: creat d2/d7/dd/d10/f5a x:0 0 0 2024-09-17T07:19:48.385 INFO:tasks.workunit.client.1.smithi139.stdout:5/87: creat d4/de/f1f x:0 0 0 2024-09-17T07:19:48.386 INFO:tasks.workunit.client.0.smithi087.stdout:2/296: stat d2/d7/d30 0 2024-09-17T07:19:48.388 INFO:tasks.workunit.client.0.smithi087.stdout:5/356: getdents d5/d18/d20/d2f/d52 0 2024-09-17T07:19:48.389 INFO:tasks.workunit.client.0.smithi087.stdout:2/297: symlink d2/d24/l5b 0 2024-09-17T07:19:48.389 INFO:tasks.workunit.client.1.smithi139.stdout:7/109: creat d5/d17/f20 x:0 0 0 2024-09-17T07:19:48.389 INFO:tasks.workunit.client.1.smithi139.stdout:0/77: dread d1/da/fc [0,4194304] 0 2024-09-17T07:19:48.390 INFO:tasks.workunit.client.0.smithi087.stdout:2/298: write d2/d48/f59 [562481,40804] 0 2024-09-17T07:19:48.391 INFO:tasks.workunit.client.1.smithi139.stdout:9/206: mknod dc/d11/c40 0 2024-09-17T07:19:48.391 INFO:tasks.workunit.client.0.smithi087.stdout:5/357: mkdir d5/d18/d20/d7a 0 2024-09-17T07:19:48.392 INFO:tasks.workunit.client.0.smithi087.stdout:3/179: getdents d6/d1b/d2b 0 2024-09-17T07:19:48.393 INFO:tasks.workunit.client.0.smithi087.stdout:2/299: mknod d2/d12/c5c 0 2024-09-17T07:19:48.398 INFO:tasks.workunit.client.0.smithi087.stdout:3/180: creat d6/d1b/d2b/f39 x:0 0 0 2024-09-17T07:19:48.398 INFO:tasks.workunit.client.1.smithi139.stdout:4/170: dwrite d0/f4 [8388608,4194304] 0 2024-09-17T07:19:48.398 INFO:tasks.workunit.client.1.smithi139.stdout:4/171: write d0/f13 [691462,68050] 0 2024-09-17T07:19:48.398 INFO:tasks.workunit.client.1.smithi139.stdout:8/144: dread d0/fb [0,4194304] 0 2024-09-17T07:19:48.398 INFO:tasks.workunit.client.1.smithi139.stdout:7/110: rename d5/d10/f11 to d5/f21 0 2024-09-17T07:19:48.399 INFO:tasks.workunit.client.1.smithi139.stdout:4/172: write d0/d1/f8 [1159091,16587] 0 2024-09-17T07:19:48.399 INFO:tasks.workunit.client.0.smithi087.stdout:2/300: rename d2/d15/f32 to d2/d48/f5d 0 2024-09-17T07:19:48.401 INFO:tasks.workunit.client.1.smithi139.stdout:0/78: mknod d1/da/d17/c1f 0 2024-09-17T07:19:48.401 INFO:tasks.workunit.client.0.smithi087.stdout:3/181: symlink d6/d1b/l3a 0 2024-09-17T07:19:48.406 INFO:tasks.workunit.client.0.smithi087.stdout:2/301: mknod d2/d7/dd/d1f/d3a/c5e 0 2024-09-17T07:19:48.407 INFO:tasks.workunit.client.1.smithi139.stdout:7/111: dwrite f2 [4194304,4194304] 0 2024-09-17T07:19:48.407 INFO:tasks.workunit.client.0.smithi087.stdout:2/302: chown d2/f52 3237 1 2024-09-17T07:19:48.408 INFO:tasks.workunit.client.1.smithi139.stdout:8/145: dread d0/f9 [0,4194304] 0 2024-09-17T07:19:48.409 INFO:tasks.workunit.client.0.smithi087.stdout:5/358: getdents d5/d12/d14 0 2024-09-17T07:19:48.409 INFO:tasks.workunit.client.1.smithi139.stdout:5/88: rmdir d4/d16/d1b/d1e 0 2024-09-17T07:19:48.411 INFO:tasks.workunit.client.0.smithi087.stdout:1/235: truncate d2/d14/dd/f47 3769 0 2024-09-17T07:19:48.411 INFO:tasks.workunit.client.0.smithi087.stdout:6/306: readlink d1/l2 0 2024-09-17T07:19:48.412 INFO:tasks.workunit.client.1.smithi139.stdout:4/173: unlink d0/db/d17/f23 0 2024-09-17T07:19:48.412 INFO:tasks.workunit.client.0.smithi087.stdout:3/182: dwrite d6/fa [0,4194304] 0 2024-09-17T07:19:48.413 INFO:tasks.workunit.client.1.smithi139.stdout:4/174: chown d0/db/d17/l18 10273 1 2024-09-17T07:19:48.413 INFO:tasks.workunit.client.1.smithi139.stdout:4/175: readlink d0/l11 0 2024-09-17T07:19:48.414 INFO:tasks.workunit.client.0.smithi087.stdout:2/303: write d2/f3 [456975,23641] 0 2024-09-17T07:19:48.414 INFO:tasks.workunit.client.0.smithi087.stdout:5/359: chown d5/d18/d20/l63 1618641 1 2024-09-17T07:19:48.416 INFO:tasks.workunit.client.1.smithi139.stdout:3/74: dread d5/fe [0,4194304] 0 2024-09-17T07:19:48.417 INFO:tasks.workunit.client.0.smithi087.stdout:5/360: fsync d5/d12/d1c/f65 0 2024-09-17T07:19:48.418 INFO:tasks.workunit.client.1.smithi139.stdout:8/146: rmdir d0/dc 39 2024-09-17T07:19:48.418 INFO:tasks.workunit.client.0.smithi087.stdout:2/304: chown d2/d7/dd/f27 480206 1 2024-09-17T07:19:48.421 INFO:tasks.workunit.client.0.smithi087.stdout:4/246: dwrite d2/d5/d1f/f35 [0,4194304] 0 2024-09-17T07:19:48.425 INFO:tasks.workunit.client.1.smithi139.stdout:7/112: unlink c4 0 2024-09-17T07:19:48.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:48 smithi087 ceph-mon[27636]: pgmap v7: 65 pgs: 65 active+clean; 594 MiB data, 3.3 GiB used, 533 GiB / 536 GiB avail; 3.4 MiB/s rd, 74 MiB/s wr, 176 op/s 2024-09-17T07:19:48.426 INFO:tasks.workunit.client.1.smithi139.stdout:3/75: creat d5/d13/f1c x:0 0 0 2024-09-17T07:19:48.427 INFO:tasks.workunit.client.0.smithi087.stdout:5/361: creat d5/d12/d14/f7b x:0 0 0 2024-09-17T07:19:48.427 INFO:tasks.workunit.client.1.smithi139.stdout:3/76: readlink d5/ld 0 2024-09-17T07:19:48.427 INFO:tasks.workunit.client.1.smithi139.stdout:7/113: chown d5/f1b 196504 1 2024-09-17T07:19:48.428 INFO:tasks.workunit.client.0.smithi087.stdout:6/307: mkdir d1/d6/d68 0 2024-09-17T07:19:48.428 INFO:tasks.workunit.client.1.smithi139.stdout:0/79: rmdir d1/da 39 2024-09-17T07:19:48.429 INFO:tasks.workunit.client.1.smithi139.stdout:7/114: chown d5/d10/c1d 490450 1 2024-09-17T07:19:48.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.427+0000 7fba1c24e640 1 -- 172.21.15.87:0/745462862 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba140fe740 msgr2=0x7fba140feb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:19:48.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.428+0000 7fba1c24e640 1 --2- 172.21.15.87:0/745462862 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba140fe740 0x7fba140feb50 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fba0c0048d0 tx=0x7fba0c009da0 comp rx=0 tx=0).stop 2024-09-17T07:19:48.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.428+0000 7fba1c24e640 1 -- 172.21.15.87:0/745462862 shutdown_connections 2024-09-17T07:19:48.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.428+0000 7fba1c24e640 1 --2- 172.21.15.87:0/745462862 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fba140ffa10 0x7fba140ffe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:48.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.428+0000 7fba1c24e640 1 --2- 172.21.15.87:0/745462862 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba140fe740 0x7fba140feb50 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:48.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.428+0000 7fba1c24e640 1 -- 172.21.15.87:0/745462862 >> 172.21.15.87:0/745462862 conn(0x7fba140fa060 msgr2=0x7fba140fc440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:19:48.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.428+0000 7fba1c24e640 1 -- 172.21.15.87:0/745462862 shutdown_connections 2024-09-17T07:19:48.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.428+0000 7fba1c24e640 1 -- 172.21.15.87:0/745462862 wait complete. 2024-09-17T07:19:48.431 INFO:tasks.workunit.client.1.smithi139.stdout:7/115: dread d5/f1b [0,4194304] 0 2024-09-17T07:19:48.431 INFO:tasks.workunit.client.0.smithi087.stdout:5/362: stat d5/d8/cb 0 2024-09-17T07:19:48.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.430+0000 7fba1c24e640 1 Processor -- start 2024-09-17T07:19:48.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.430+0000 7fba1c24e640 1 -- start start 2024-09-17T07:19:48.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.430+0000 7fba1c24e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fba140fe740 0x7fba1410f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:19:48.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.430+0000 7fba1c24e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba140ffa10 0x7fba1410f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:19:48.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.430+0000 7fba1c24e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba1410fd70 con 0x7fba140ffa10 2024-09-17T07:19:48.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.430+0000 7fba197e9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba140ffa10 0x7fba1410f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:19:48.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.430+0000 7fba197e9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba140ffa10 0x7fba1410f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37048/0 (socket says 172.21.15.87:37048) 2024-09-17T07:19:48.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.431+0000 7fba197e9640 1 -- 172.21.15.87:0/1533911174 learned_addr learned my addr 172.21.15.87:0/1533911174 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:19:48.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.431+0000 7fba19fea640 1 --2- 172.21.15.87:0/1533911174 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fba140fe740 0x7fba1410f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:19:48.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.431+0000 7fba1c24e640 1 -- 172.21.15.87:0/1533911174 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba14110520 con 0x7fba140fe740 2024-09-17T07:19:48.433 INFO:tasks.workunit.client.1.smithi139.stdout:7/116: stat f2 0 2024-09-17T07:19:48.433 INFO:tasks.workunit.client.1.smithi139.stdout:9/207: getdents dc/d11/d15 0 2024-09-17T07:19:48.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.431+0000 7fba19fea640 1 -- 172.21.15.87:0/1533911174 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba140ffa10 msgr2=0x7fba1410f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:19:48.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.431+0000 7fba19fea640 1 --2- 172.21.15.87:0/1533911174 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba140ffa10 0x7fba1410f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:48.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.431+0000 7fba19fea640 1 -- 172.21.15.87:0/1533911174 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba0c005040 con 0x7fba140fe740 2024-09-17T07:19:48.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.431+0000 7fba19fea640 1 --2- 172.21.15.87:0/1533911174 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fba140fe740 0x7fba1410f1e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fba0c0043d0 tx=0x7fba0c009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:19:48.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.432+0000 7fba127fc640 1 -- 172.21.15.87:0/1533911174 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba0c038070 con 0x7fba140fe740 2024-09-17T07:19:48.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.432+0000 7fba127fc640 1 -- 172.21.15.87:0/1533911174 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fba0c0096c0 con 0x7fba140fe740 2024-09-17T07:19:48.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.432+0000 7fba127fc640 1 -- 172.21.15.87:0/1533911174 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba0c03d420 con 0x7fba140fe740 2024-09-17T07:19:48.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.432+0000 7fba1c24e640 1 -- 172.21.15.87:0/1533911174 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba14110750 con 0x7fba140fe740 2024-09-17T07:19:48.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.432+0000 7fba1c24e640 1 -- 172.21.15.87:0/1533911174 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba14110bb0 con 0x7fba140fe740 2024-09-17T07:19:48.435 INFO:tasks.workunit.client.0.smithi087.stdout:1/236: getdents d2/d14 0 2024-09-17T07:19:48.435 INFO:tasks.workunit.client.1.smithi139.stdout:4/176: rename d0/l11 to d0/d1/l2f 0 2024-09-17T07:19:48.435 INFO:tasks.workunit.client.1.smithi139.stdout:3/77: dread d5/f11 [0,4194304] 0 2024-09-17T07:19:48.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.434+0000 7fba1c24e640 1 -- 172.21.15.87:0/1533911174 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba140fdba0 con 0x7fba140fe740 2024-09-17T07:19:48.435 INFO:tasks.workunit.client.0.smithi087.stdout:6/308: creat d1/d67/f69 x:0 0 0 2024-09-17T07:19:48.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.434+0000 7fba127fc640 1 -- 172.21.15.87:0/1533911174 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 24) v1 ==== 90881+0+0 (secure 0 0 0) 0x7fba0c030020 con 0x7fba140fe740 2024-09-17T07:19:48.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.435+0000 7fba127fc640 1 --2- 172.21.15.87:0/1533911174 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7fb9fc06dbd0 0x7fb9fc070080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:19:48.436 INFO:tasks.workunit.client.1.smithi139.stdout:0/80: mkdir d1/d20 0 2024-09-17T07:19:48.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.435+0000 7fba127fc640 1 -- 172.21.15.87:0/1533911174 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fba0c0ad510 con 0x7fba140fe740 2024-09-17T07:19:48.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.435+0000 7fba197e9640 1 --2- 172.21.15.87:0/1533911174 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7fb9fc06dbd0 0x7fb9fc070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:19:48.437 INFO:tasks.workunit.client.0.smithi087.stdout:5/363: symlink d5/d18/d20/d7a/l7c 0 2024-09-17T07:19:48.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.436+0000 7fba197e9640 1 --2- 172.21.15.87:0/1533911174 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7fb9fc06dbd0 0x7fb9fc070080 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fba1410ef90 tx=0x7fba0800b040 comp rx=0 tx=0).ready entity=mgr.24339 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:19:48.438 INFO:tasks.workunit.client.1.smithi139.stdout:3/78: dread d5/fe [0,4194304] 0 2024-09-17T07:19:48.438 INFO:tasks.workunit.client.1.smithi139.stdout:7/117: unlink d5/f1b 0 2024-09-17T07:19:48.438 INFO:tasks.workunit.client.0.smithi087.stdout:2/305: dwrite d2/f14 [0,4194304] 0 2024-09-17T07:19:48.438 INFO:tasks.workunit.client.0.smithi087.stdout:3/183: link d6/d1b/d2b/d30/f35 d6/d1b/f3b 0 2024-09-17T07:19:48.438 INFO:tasks.workunit.client.0.smithi087.stdout:3/184: chown d6/fc 15 1 2024-09-17T07:19:48.439 INFO:tasks.workunit.client.1.smithi139.stdout:9/208: symlink dc/d11/d15/d1e/d34/l41 0 2024-09-17T07:19:48.441 INFO:tasks.workunit.client.0.smithi087.stdout:3/185: dread - d6/d16/f38 zero size 2024-09-17T07:19:48.442 INFO:tasks.workunit.client.1.smithi139.stdout:8/147: creat d0/dc/f27 x:0 0 0 2024-09-17T07:19:48.444 INFO:tasks.workunit.client.0.smithi087.stdout:5/364: dread d5/d18/d20/d2f/d52/f72 [0,4194304] 0 2024-09-17T07:19:48.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.443+0000 7fba127fc640 1 -- 172.21.15.87:0/1533911174 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182127 (secure 0 0 0) 0x7fba0c077970 con 0x7fba140fe740 2024-09-17T07:19:48.446 INFO:tasks.workunit.client.0.smithi087.stdout:2/306: fsync d2/d48/f5d 0 2024-09-17T07:19:48.446 INFO:tasks.workunit.client.0.smithi087.stdout:5/365: chown d5/d8/f10 5335361 1 2024-09-17T07:19:48.447 INFO:tasks.workunit.client.0.smithi087.stdout:4/247: write d2/d5/d1f/f3a [886965,20613] 0 2024-09-17T07:19:48.448 INFO:tasks.workunit.client.1.smithi139.stdout:3/79: creat d5/f1d x:0 0 0 2024-09-17T07:19:48.449 INFO:tasks.workunit.client.0.smithi087.stdout:3/186: chown d6/ce 220775032 1 2024-09-17T07:19:48.450 INFO:tasks.workunit.client.0.smithi087.stdout:4/248: dread - d2/d22/d2c/d3f/f51 zero size 2024-09-17T07:19:48.452 INFO:tasks.workunit.client.0.smithi087.stdout:1/237: dwrite d2/da/f2b [0,4194304] 0 2024-09-17T07:19:48.452 INFO:tasks.workunit.client.1.smithi139.stdout:9/209: mknod dc/c42 0 2024-09-17T07:19:48.454 INFO:tasks.workunit.client.0.smithi087.stdout:5/366: mkdir d5/d8/d1f/d68/d7d 0 2024-09-17T07:19:48.455 INFO:tasks.workunit.client.1.smithi139.stdout:5/89: dwrite d4/f6 [0,4194304] 0 2024-09-17T07:19:48.457 INFO:tasks.workunit.client.0.smithi087.stdout:3/187: mkdir d6/d15/d37/d3c 0 2024-09-17T07:19:48.457 INFO:tasks.workunit.client.1.smithi139.stdout:9/210: dread - dc/f20 zero size 2024-09-17T07:19:48.458 INFO:tasks.workunit.client.0.smithi087.stdout:1/238: creat d2/d14/f5a x:0 0 0 2024-09-17T07:19:48.458 INFO:tasks.workunit.client.1.smithi139.stdout:3/80: truncate d5/d13/f1a 749776 0 2024-09-17T07:19:48.461 INFO:tasks.workunit.client.0.smithi087.stdout:1/239: readlink d2/d14/l41 0 2024-09-17T07:19:48.461 INFO:tasks.workunit.client.1.smithi139.stdout:5/90: dread d4/d16/f19 [0,4194304] 0 2024-09-17T07:19:48.463 INFO:tasks.workunit.client.1.smithi139.stdout:8/148: dwrite d0/dc/f27 [0,4194304] 0 2024-09-17T07:19:48.464 INFO:tasks.workunit.client.0.smithi087.stdout:3/188: creat d6/d1b/d2b/d30/f3d x:0 0 0 2024-09-17T07:19:48.467 INFO:tasks.workunit.client.1.smithi139.stdout:7/118: dwrite d5/f21 [4194304,4194304] 0 2024-09-17T07:19:48.469 INFO:tasks.workunit.client.0.smithi087.stdout:6/309: dwrite d1/f18 [0,4194304] 0 2024-09-17T07:19:48.469 INFO:tasks.workunit.client.0.smithi087.stdout:1/240: fdatasync d2/da/f16 0 2024-09-17T07:19:48.470 INFO:tasks.workunit.client.1.smithi139.stdout:3/81: truncate d5/d15/f18 797650 0 2024-09-17T07:19:48.472 INFO:tasks.workunit.client.0.smithi087.stdout:2/307: dwrite d2/d48/f5d [0,4194304] 0 2024-09-17T07:19:48.472 INFO:tasks.workunit.client.0.smithi087.stdout:3/189: rmdir d6/d1b 39 2024-09-17T07:19:48.472 INFO:tasks.workunit.client.0.smithi087.stdout:5/367: dwrite d5/d12/d1c/f6c [0,4194304] 0 2024-09-17T07:19:48.473 INFO:tasks.workunit.client.1.smithi139.stdout:9/211: rename dc/d11/d15/d1e/c25 to dc/d2a/c43 0 2024-09-17T07:19:48.474 INFO:tasks.workunit.client.1.smithi139.stdout:8/149: write d0/dc/d18/f1f [3639705,12218] 0 2024-09-17T07:19:48.474 INFO:tasks.workunit.client.1.smithi139.stdout:0/81: dread d1/f18 [0,4194304] 0 2024-09-17T07:19:48.475 INFO:tasks.workunit.client.0.smithi087.stdout:3/190: write d6/d16/f26 [3504297,90187] 0 2024-09-17T07:19:48.476 INFO:tasks.workunit.client.0.smithi087.stdout:1/241: dread - d2/d1a/f3e zero size 2024-09-17T07:19:48.476 INFO:tasks.workunit.client.0.smithi087.stdout:6/310: chown d1/d6/d1a/l4a 128655326 1 2024-09-17T07:19:48.477 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:48 smithi139 ceph-mon[34403]: pgmap v7: 65 pgs: 65 active+clean; 594 MiB data, 3.3 GiB used, 533 GiB / 536 GiB avail; 3.4 MiB/s rd, 74 MiB/s wr, 176 op/s 2024-09-17T07:19:48.479 INFO:tasks.workunit.client.0.smithi087.stdout:6/311: chown d1/d6/d1a/l4a 59391 1 2024-09-17T07:19:48.479 INFO:tasks.workunit.client.1.smithi139.stdout:3/82: mknod d5/c1e 0 2024-09-17T07:19:48.482 INFO:tasks.workunit.client.0.smithi087.stdout:5/368: chown d5/d18/d20/c40 100900080 1 2024-09-17T07:19:48.484 INFO:tasks.workunit.client.1.smithi139.stdout:5/91: dwrite d4/fd [0,4194304] 0 2024-09-17T07:19:48.485 INFO:tasks.workunit.client.1.smithi139.stdout:5/92: stat d4/lc 0 2024-09-17T07:19:48.487 INFO:tasks.workunit.client.1.smithi139.stdout:7/119: rename d5/ca to d5/d17/c22 0 2024-09-17T07:19:48.487 INFO:tasks.workunit.client.1.smithi139.stdout:0/82: mkdir d1/da/d1b/d1d/d21 0 2024-09-17T07:19:48.487 INFO:tasks.workunit.client.1.smithi139.stdout:8/150: mkdir d0/d20/d28 0 2024-09-17T07:19:48.487 INFO:tasks.workunit.client.0.smithi087.stdout:6/312: chown d1/d6/d1a/d2c/f59 29 1 2024-09-17T07:19:48.488 INFO:tasks.workunit.client.0.smithi087.stdout:6/313: write d1/d6/d1a/f41 [3597584,24836] 0 2024-09-17T07:19:48.488 INFO:tasks.workunit.client.0.smithi087.stdout:2/308: dwrite d2/d7/d30/f54 [0,4194304] 0 2024-09-17T07:19:48.488 INFO:tasks.workunit.client.1.smithi139.stdout:4/177: dwrite d0/d1/fd [0,4194304] 0 2024-09-17T07:19:48.490 INFO:tasks.workunit.client.1.smithi139.stdout:5/93: write d4/f6 [4613931,110478] 0 2024-09-17T07:19:48.491 INFO:tasks.workunit.client.1.smithi139.stdout:7/120: fdatasync d5/d17/f20 0 2024-09-17T07:19:48.491 INFO:tasks.workunit.client.0.smithi087.stdout:6/314: read - d1/d6/f2b zero size 2024-09-17T07:19:48.491 INFO:tasks.workunit.client.0.smithi087.stdout:1/242: symlink d2/d3d/d35/d4f/l5b 0 2024-09-17T07:19:48.492 INFO:tasks.workunit.client.1.smithi139.stdout:3/83: truncate d5/f11 593267 0 2024-09-17T07:19:48.492 INFO:tasks.workunit.client.1.smithi139.stdout:4/178: write d0/f2 [110646,92889] 0 2024-09-17T07:19:48.493 INFO:tasks.workunit.client.1.smithi139.stdout:8/151: truncate d0/f25 426120 0 2024-09-17T07:19:48.494 INFO:tasks.workunit.client.0.smithi087.stdout:5/369: symlink d5/d12/d1c/l7e 0 2024-09-17T07:19:48.497 INFO:tasks.workunit.client.1.smithi139.stdout:4/179: stat d0/l2e 0 2024-09-17T07:19:48.497 INFO:tasks.workunit.client.1.smithi139.stdout:9/212: dread fb [0,4194304] 0 2024-09-17T07:19:48.497 INFO:tasks.workunit.client.0.smithi087.stdout:4/249: write d2/d22/d2c/d3f/d4d/fd [274741,10044] 0 2024-09-17T07:19:48.499 INFO:tasks.workunit.client.0.smithi087.stdout:1/243: creat d2/d14/dd/d37/f5c x:0 0 0 2024-09-17T07:19:48.499 INFO:tasks.workunit.client.0.smithi087.stdout:6/315: truncate d1/f16 6157215 0 2024-09-17T07:19:48.499 INFO:tasks.workunit.client.1.smithi139.stdout:3/84: dread d5/d15/f18 [0,4194304] 0 2024-09-17T07:19:48.499 INFO:tasks.workunit.client.1.smithi139.stdout:8/152: truncate d0/f9 2279643 0 2024-09-17T07:19:48.499 INFO:tasks.workunit.client.1.smithi139.stdout:7/121: rename d5/f21 to d5/f23 0 2024-09-17T07:19:48.501 INFO:tasks.workunit.client.0.smithi087.stdout:6/316: chown d1/d6/f61 118 1 2024-09-17T07:19:48.502 INFO:tasks.workunit.client.1.smithi139.stdout:5/94: mkdir d4/d16/d1b/d20 0 2024-09-17T07:19:48.502 INFO:tasks.workunit.client.1.smithi139.stdout:7/122: chown d5/ld 515455700 1 2024-09-17T07:19:48.505 INFO:tasks.workunit.client.0.smithi087.stdout:1/244: read - d2/d14/dd/d37/f5c zero size 2024-09-17T07:19:48.505 INFO:tasks.workunit.client.1.smithi139.stdout:4/180: truncate d0/db/f21 1714817 0 2024-09-17T07:19:48.505 INFO:tasks.workunit.client.0.smithi087.stdout:6/317: mkdir d1/d6a 0 2024-09-17T07:19:48.506 INFO:tasks.workunit.client.0.smithi087.stdout:5/370: mknod d5/d12/c7f 0 2024-09-17T07:19:48.508 INFO:tasks.workunit.client.0.smithi087.stdout:4/250: rename d2/d5/d1f/f3a to d2/d22/d2c/d3f/d4d/d42/f5a 0 2024-09-17T07:19:48.508 INFO:tasks.workunit.client.1.smithi139.stdout:8/153: dread d0/f25 [0,4194304] 0 2024-09-17T07:19:48.508 INFO:tasks.workunit.client.1.smithi139.stdout:5/95: chown d4/f17 0 1 2024-09-17T07:19:48.509 INFO:tasks.workunit.client.1.smithi139.stdout:7/123: mknod d5/d10/c24 0 2024-09-17T07:19:48.510 INFO:tasks.workunit.client.1.smithi139.stdout:0/83: dwrite d1/da/f14 [0,4194304] 0 2024-09-17T07:19:48.512 INFO:tasks.workunit.client.0.smithi087.stdout:8/187: sync 2024-09-17T07:19:48.514 INFO:tasks.workunit.client.0.smithi087.stdout:8/188: write d1/d2b/f32 [812164,39798] 0 2024-09-17T07:19:48.516 INFO:tasks.workunit.client.0.smithi087.stdout:1/245: rename d2/da/d4a to d2/d14/dd/d43/d5d 0 2024-09-17T07:19:48.517 INFO:tasks.workunit.client.1.smithi139.stdout:9/213: dread dc/d11/d15/d1e/f23 [0,4194304] 0 2024-09-17T07:19:48.518 INFO:tasks.workunit.client.0.smithi087.stdout:5/371: truncate d5/f15 840728 0 2024-09-17T07:19:48.518 INFO:tasks.workunit.client.1.smithi139.stdout:8/154: symlink d0/d20/l29 0 2024-09-17T07:19:48.521 INFO:tasks.workunit.client.0.smithi087.stdout:6/318: dwrite d1/d6/d1a/f36 [0,4194304] 0 2024-09-17T07:19:48.522 INFO:tasks.workunit.client.1.smithi139.stdout:0/84: rmdir d1/d20 0 2024-09-17T07:19:48.523 INFO:tasks.workunit.client.1.smithi139.stdout:9/214: write dc/d11/d15/d1e/f21 [1571003,123258] 0 2024-09-17T07:19:48.523 INFO:tasks.workunit.client.1.smithi139.stdout:3/85: dwrite d5/d13/f1c [0,4194304] 0 2024-09-17T07:19:48.524 INFO:tasks.workunit.client.1.smithi139.stdout:8/155: write d0/dc/f10 [501296,99363] 0 2024-09-17T07:19:48.527 INFO:tasks.workunit.client.1.smithi139.stdout:9/215: readlink dc/ld 0 2024-09-17T07:19:48.531 INFO:tasks.workunit.client.1.smithi139.stdout:4/181: dwrite d0/db/d17/f2d [0,4194304] 0 2024-09-17T07:19:48.531 INFO:tasks.workunit.client.0.smithi087.stdout:1/246: dwrite d2/d3d/f2f [0,4194304] 0 2024-09-17T07:19:48.533 INFO:tasks.workunit.client.1.smithi139.stdout:4/182: readlink d0/l2e 0 2024-09-17T07:19:48.533 INFO:tasks.workunit.client.1.smithi139.stdout:3/86: chown d5/cf 112765325 1 2024-09-17T07:19:48.533 INFO:tasks.workunit.client.0.smithi087.stdout:5/372: dwrite d5/f1b [0,4194304] 0 2024-09-17T07:19:48.533 INFO:tasks.workunit.client.0.smithi087.stdout:1/247: dread - d2/da/f30 zero size 2024-09-17T07:19:48.534 INFO:tasks.workunit.client.1.smithi139.stdout:4/183: stat d0/f7 0 2024-09-17T07:19:48.534 INFO:tasks.workunit.client.0.smithi087.stdout:5/373: dread - d5/d12/f76 zero size 2024-09-17T07:19:48.536 INFO:tasks.workunit.client.0.smithi087.stdout:5/374: fdatasync d5/d12/d14/d61/f75 0 2024-09-17T07:19:48.537 INFO:tasks.workunit.client.1.smithi139.stdout:5/96: fsync d4/f6 0 2024-09-17T07:19:48.537 INFO:tasks.workunit.client.1.smithi139.stdout:9/216: mknod dc/d11/d15/d3c/c44 0 2024-09-17T07:19:48.538 INFO:tasks.workunit.client.1.smithi139.stdout:3/87: rename d5/d13/f1c to d5/d15/d16/f1f 0 2024-09-17T07:19:48.539 INFO:tasks.workunit.client.0.smithi087.stdout:1/248: creat d2/d48/f5e x:0 0 0 2024-09-17T07:19:48.540 INFO:tasks.workunit.client.1.smithi139.stdout:0/85: creat d1/da/d1b/d1d/d21/f22 x:0 0 0 2024-09-17T07:19:48.541 INFO:tasks.workunit.client.1.smithi139.stdout:0/86: fsync d1/da/fc 0 2024-09-17T07:19:48.542 INFO:tasks.workunit.client.1.smithi139.stdout:4/184: creat d0/f30 x:0 0 0 2024-09-17T07:19:48.543 INFO:tasks.workunit.client.0.smithi087.stdout:1/249: mknod d2/d14/dd/d43/d5d/c5f 0 2024-09-17T07:19:48.544 INFO:tasks.workunit.client.1.smithi139.stdout:8/156: creat d0/f2a x:0 0 0 2024-09-17T07:19:48.545 INFO:tasks.workunit.client.1.smithi139.stdout:9/217: rmdir dc/d11/d15/d1e/d34 39 2024-09-17T07:19:48.547 INFO:tasks.workunit.client.0.smithi087.stdout:3/191: dread d6/f12 [0,4194304] 0 2024-09-17T07:19:48.547 INFO:tasks.workunit.client.0.smithi087.stdout:1/250: truncate d2/d3d/f28 1050365 0 2024-09-17T07:19:48.547 INFO:tasks.workunit.client.0.smithi087.stdout:5/375: link d5/d12/d14/d61/f75 d5/d6d/f80 0 2024-09-17T07:19:48.549 INFO:tasks.workunit.client.1.smithi139.stdout:0/87: symlink d1/da/d1b/d1d/d21/l23 0 2024-09-17T07:19:48.549 INFO:tasks.workunit.client.0.smithi087.stdout:5/376: fsync d5/d18/f78 0 2024-09-17T07:19:48.549 INFO:tasks.workunit.client.0.smithi087.stdout:3/192: write d6/d16/f38 [832075,47956] 0 2024-09-17T07:19:48.550 INFO:tasks.workunit.client.1.smithi139.stdout:3/88: dread d5/f7 [0,4194304] 0 2024-09-17T07:19:48.551 INFO:tasks.workunit.client.0.smithi087.stdout:5/377: dread - d5/d18/d20/d2f/f5c zero size 2024-09-17T07:19:48.551 INFO:tasks.workunit.client.0.smithi087.stdout:5/378: chown d5/d18 3917614 1 2024-09-17T07:19:48.552 INFO:tasks.workunit.client.0.smithi087.stdout:1/251: creat d2/d14/f60 x:0 0 0 2024-09-17T07:19:48.554 INFO:tasks.workunit.client.0.smithi087.stdout:1/252: write d2/d14/dd/d37/f38 [2256595,31510] 0 2024-09-17T07:19:48.555 INFO:tasks.workunit.client.1.smithi139.stdout:0/88: creat d1/da/f24 x:0 0 0 2024-09-17T07:19:48.555 INFO:tasks.workunit.client.0.smithi087.stdout:3/193: mknod d6/d1b/d2b/c3e 0 2024-09-17T07:19:48.557 INFO:tasks.workunit.client.1.smithi139.stdout:8/157: link d0/c24 d0/d20/c2b 0 2024-09-17T07:19:48.557 INFO:tasks.workunit.client.0.smithi087.stdout:1/253: mkdir d2/d48/d61 0 2024-09-17T07:19:48.559 INFO:tasks.workunit.client.1.smithi139.stdout:8/158: symlink d0/dc/d18/l2c 0 2024-09-17T07:19:48.560 INFO:tasks.workunit.client.1.smithi139.stdout:8/159: write d0/fa [1086247,48759] 0 2024-09-17T07:19:48.561 INFO:tasks.workunit.client.0.smithi087.stdout:3/194: mknod d6/d1b/d2b/c3f 0 2024-09-17T07:19:48.562 INFO:tasks.workunit.client.0.smithi087.stdout:3/195: rmdir d6/d15/d37 39 2024-09-17T07:19:48.562 INFO:tasks.workunit.client.1.smithi139.stdout:8/160: symlink d0/dc/l2d 0 2024-09-17T07:19:48.563 INFO:tasks.workunit.client.0.smithi087.stdout:3/196: dread - d6/d16/f36 zero size 2024-09-17T07:19:48.564 INFO:tasks.workunit.client.1.smithi139.stdout:8/161: symlink d0/l2e 0 2024-09-17T07:19:48.565 INFO:tasks.workunit.client.1.smithi139.stdout:8/162: write d0/f2a [47633,77781] 0 2024-09-17T07:19:48.567 INFO:tasks.workunit.client.1.smithi139.stdout:8/163: mknod d0/d20/c2f 0 2024-09-17T07:19:48.574 INFO:tasks.workunit.client.1.smithi139.stdout:0/89: getdents d1 0 2024-09-17T07:19:48.576 INFO:tasks.workunit.client.1.smithi139.stdout:0/90: write d1/f18 [4128441,115992] 0 2024-09-17T07:19:48.576 INFO:tasks.workunit.client.0.smithi087.stdout:4/251: rename d2/d22/d2c/d3f/d4d/d42/f5a to d2/d22/d2c/d3f/d4f/f5b 0 2024-09-17T07:19:48.578 INFO:tasks.workunit.client.0.smithi087.stdout:1/254: rmdir d2/da 39 2024-09-17T07:19:48.578 INFO:tasks.workunit.client.1.smithi139.stdout:0/91: symlink d1/da/d17/l25 0 2024-09-17T07:19:48.579 INFO:tasks.workunit.client.0.smithi087.stdout:1/255: dread - d2/d3d/f49 zero size 2024-09-17T07:19:48.579 INFO:tasks.workunit.client.1.smithi139.stdout:0/92: write d1/f18 [4027897,81575] 0 2024-09-17T07:19:48.580 INFO:tasks.workunit.client.0.smithi087.stdout:3/197: rename d6/d1b/l1e to d6/d15/d37/l40 0 2024-09-17T07:19:48.581 INFO:tasks.workunit.client.1.smithi139.stdout:4/185: truncate d0/f4 6426188 0 2024-09-17T07:19:48.583 INFO:tasks.workunit.client.0.smithi087.stdout:4/252: write f0 [5565777,48720] 0 2024-09-17T07:19:48.585 INFO:tasks.workunit.client.0.smithi087.stdout:1/256: symlink d2/dc/l62 0 2024-09-17T07:19:48.586 INFO:tasks.workunit.client.1.smithi139.stdout:9/218: truncate dc/d2c/f31 2813825 0 2024-09-17T07:19:48.587 INFO:tasks.workunit.client.1.smithi139.stdout:4/186: mknod d0/d1/c31 0 2024-09-17T07:19:48.588 INFO:tasks.workunit.client.1.smithi139.stdout:0/93: dwrite d1/f18 [0,4194304] 0 2024-09-17T07:19:48.590 INFO:tasks.workunit.client.1.smithi139.stdout:3/89: truncate f4 948168 0 2024-09-17T07:19:48.590 INFO:tasks.workunit.client.0.smithi087.stdout:1/257: creat d2/d14/f63 x:0 0 0 2024-09-17T07:19:48.592 INFO:tasks.workunit.client.0.smithi087.stdout:1/258: chown d2/d14/dd/d37 510033517 1 2024-09-17T07:19:48.592 INFO:tasks.workunit.client.1.smithi139.stdout:0/94: creat d1/f26 x:0 0 0 2024-09-17T07:19:48.593 INFO:tasks.workunit.client.0.smithi087.stdout:3/198: rename d6/d1b/d2b/l23 to d6/d1b/l41 0 2024-09-17T07:19:48.595 INFO:tasks.workunit.client.1.smithi139.stdout:9/219: fsync dc/d11/d15/d1e/f29 0 2024-09-17T07:19:48.595 INFO:tasks.workunit.client.1.smithi139.stdout:4/187: write d0/db/f21 [970197,60887] 0 2024-09-17T07:19:48.596 INFO:tasks.workunit.client.0.smithi087.stdout:4/253: truncate d2/f6 1322191 0 2024-09-17T07:19:48.597 INFO:tasks.workunit.client.0.smithi087.stdout:8/189: dwrite d1/d7/f2f [0,4194304] 0 2024-09-17T07:19:48.601 INFO:tasks.workunit.client.0.smithi087.stdout:5/379: truncate d5/d18/d20/d2f/f57 3854077 0 2024-09-17T07:19:48.602 INFO:tasks.workunit.client.0.smithi087.stdout:8/190: chown d1/d7/d9/c1e 57899 1 2024-09-17T07:19:48.602 INFO:tasks.workunit.client.1.smithi139.stdout:4/188: write d0/d1/f1e [528606,51990] 0 2024-09-17T07:19:48.602 INFO:tasks.workunit.client.1.smithi139.stdout:9/220: fdatasync fb 0 2024-09-17T07:19:48.602 INFO:tasks.workunit.client.1.smithi139.stdout:0/95: creat d1/da/d1b/f27 x:0 0 0 2024-09-17T07:19:48.602 INFO:tasks.workunit.client.1.smithi139.stdout:8/164: dwrite d0/dc/d18/f1c [0,4194304] 0 2024-09-17T07:19:48.603 INFO:tasks.workunit.client.1.smithi139.stdout:4/189: rename d0/db/d17/l18 to d0/d1a/l32 0 2024-09-17T07:19:48.604 INFO:tasks.workunit.client.0.smithi087.stdout:4/254: creat d2/d22/d2c/d3f/d4f/f5c x:0 0 0 2024-09-17T07:19:48.604 INFO:tasks.workunit.client.1.smithi139.stdout:0/96: rename d1 to d1/da/d1b/d1d/d21/d28 22 2024-09-17T07:19:48.606 INFO:tasks.workunit.client.0.smithi087.stdout:4/255: read d2/d22/d2c/d3f/d4f/f50 [208543,77427] 0 2024-09-17T07:19:48.607 INFO:tasks.workunit.client.1.smithi139.stdout:8/165: truncate d0/f7 5217163 0 2024-09-17T07:19:48.608 INFO:tasks.workunit.client.1.smithi139.stdout:0/97: mknod d1/c29 0 2024-09-17T07:19:48.609 INFO:tasks.workunit.client.0.smithi087.stdout:1/259: getdents d2/d3d/d35/d57 0 2024-09-17T07:19:48.609 INFO:tasks.workunit.client.0.smithi087.stdout:3/199: dwrite d6/f12 [4194304,4194304] 0 2024-09-17T07:19:48.611 INFO:tasks.workunit.client.0.smithi087.stdout:5/380: fdatasync d5/f15 0 2024-09-17T07:19:48.612 INFO:tasks.workunit.client.1.smithi139.stdout:4/190: creat d0/db/f33 x:0 0 0 2024-09-17T07:19:48.612 INFO:tasks.workunit.client.0.smithi087.stdout:8/191: link d1/d2b/f41 d1/d2b/f42 0 2024-09-17T07:19:48.613 INFO:tasks.workunit.client.1.smithi139.stdout:4/191: chown d0/d1 12417 1 2024-09-17T07:19:48.618 INFO:tasks.workunit.client.0.smithi087.stdout:5/381: creat d5/d6d/f81 x:0 0 0 2024-09-17T07:19:48.618 INFO:tasks.workunit.client.1.smithi139.stdout:9/221: unlink dc/d2c/f31 0 2024-09-17T07:19:48.619 INFO:tasks.workunit.client.1.smithi139.stdout:0/98: dwrite d1/da/fc [0,4194304] 0 2024-09-17T07:19:48.621 INFO:tasks.workunit.client.1.smithi139.stdout:0/99: read - d1/f26 zero size 2024-09-17T07:19:48.621 INFO:tasks.workunit.client.0.smithi087.stdout:8/192: dwrite d1/d7/d9/d19/d1b/f34 [0,4194304] 0 2024-09-17T07:19:48.623 INFO:tasks.workunit.client.0.smithi087.stdout:4/256: truncate d2/d22/d2c/d3f/d4d/d21/f4c 976982 0 2024-09-17T07:19:48.624 INFO:tasks.workunit.client.1.smithi139.stdout:9/222: creat dc/d11/d15/d3c/f45 x:0 0 0 2024-09-17T07:19:48.626 INFO:tasks.workunit.client.1.smithi139.stdout:0/100: write d1/da/fc [2730511,77874] 0 2024-09-17T07:19:48.627 INFO:tasks.workunit.client.1.smithi139.stdout:4/192: dwrite d0/db/d17/f2c [0,4194304] 0 2024-09-17T07:19:48.628 INFO:tasks.workunit.client.1.smithi139.stdout:9/223: symlink dc/d2a/l46 0 2024-09-17T07:19:48.630 INFO:tasks.workunit.client.0.smithi087.stdout:8/193: creat d1/d7/d9/d19/d1b/f43 x:0 0 0 2024-09-17T07:19:48.633 INFO:tasks.workunit.client.0.smithi087.stdout:1/260: unlink d2/da/f30 0 2024-09-17T07:19:48.633 INFO:tasks.workunit.client.0.smithi087.stdout:8/194: write d1/d7/d9/d19/f40 [137279,54213] 0 2024-09-17T07:19:48.633 INFO:tasks.workunit.client.1.smithi139.stdout:4/193: symlink d0/db/d17/l34 0 2024-09-17T07:19:48.634 INFO:tasks.workunit.client.1.smithi139.stdout:0/101: mkdir d1/da/d2a 0 2024-09-17T07:19:48.635 INFO:tasks.workunit.client.0.smithi087.stdout:9/188: sync 2024-09-17T07:19:48.635 INFO:tasks.workunit.client.0.smithi087.stdout:4/257: dwrite d2/d22/d2c/f58 [0,4194304] 0 2024-09-17T07:19:48.637 INFO:tasks.workunit.client.0.smithi087.stdout:9/189: write d3/d4/d6/f3e [683787,50137] 0 2024-09-17T07:19:48.637 INFO:tasks.workunit.client.0.smithi087.stdout:9/190: stat d3/d4/d6/f3e 0 2024-09-17T07:19:48.639 INFO:tasks.workunit.client.1.smithi139.stdout:0/102: creat d1/da/d1b/d1d/d21/f2b x:0 0 0 2024-09-17T07:19:48.640 INFO:tasks.workunit.client.1.smithi139.stdout:4/194: creat d0/db/f35 x:0 0 0 2024-09-17T07:19:48.641 INFO:tasks.workunit.client.0.smithi087.stdout:9/191: write d3/d4/da/d1c/f21 [1001396,65691] 0 2024-09-17T07:19:48.643 INFO:tasks.workunit.client.1.smithi139.stdout:4/195: dread d0/f5 [0,4194304] 0 2024-09-17T07:19:48.646 INFO:tasks.workunit.client.1.smithi139.stdout:0/103: getdents d1/da/d1b 0 2024-09-17T07:19:48.646 INFO:tasks.workunit.client.1.smithi139.stdout:4/196: dread - d0/d1/d29/f2b zero size 2024-09-17T07:19:48.647 INFO:tasks.workunit.client.0.smithi087.stdout:5/382: dwrite d5/f15 [0,4194304] 0 2024-09-17T07:19:48.649 INFO:tasks.workunit.client.1.smithi139.stdout:0/104: symlink d1/da/d1b/d1d/l2c 0 2024-09-17T07:19:48.650 INFO:tasks.workunit.client.0.smithi087.stdout:3/200: write d6/f27 [2103663,62670] 0 2024-09-17T07:19:48.650 INFO:tasks.workunit.client.0.smithi087.stdout:5/383: write d5/d6d/f81 [928089,117864] 0 2024-09-17T07:19:48.653 INFO:tasks.workunit.client.0.smithi087.stdout:4/258: unlink d2/d22/d2c/d3f/d4d/d21/d2f/f38 0 2024-09-17T07:19:48.653 INFO:tasks.workunit.client.0.smithi087.stdout:9/192: mknod d3/d4/da/c44 0 2024-09-17T07:19:48.655 INFO:tasks.workunit.client.1.smithi139.stdout:4/197: dwrite d0/db/d17/f2c [0,4194304] 0 2024-09-17T07:19:48.656 INFO:tasks.workunit.client.1.smithi139.stdout:4/198: write d0/d1/f1e [922614,20843] 0 2024-09-17T07:19:48.657 INFO:tasks.workunit.client.0.smithi087.stdout:4/259: creat d2/d22/d2c/d3f/d4d/d2d/f5d x:0 0 0 2024-09-17T07:19:48.658 INFO:tasks.workunit.client.0.smithi087.stdout:9/193: creat d3/d4/d6/d8/d22/d43/f45 x:0 0 0 2024-09-17T07:19:48.658 INFO:tasks.workunit.client.0.smithi087.stdout:1/261: link d2/da/c39 d2/d3d/d35/c64 0 2024-09-17T07:19:48.659 INFO:tasks.workunit.client.0.smithi087.stdout:9/194: stat d3/d4/d6/d8/d22/d43 0 2024-09-17T07:19:48.660 INFO:tasks.workunit.client.1.smithi139.stdout:4/199: creat d0/db/f36 x:0 0 0 2024-09-17T07:19:48.661 INFO:tasks.workunit.client.1.smithi139.stdout:4/200: mkdir d0/d37 0 2024-09-17T07:19:48.662 INFO:tasks.workunit.client.0.smithi087.stdout:9/195: write d3/d4/d6/d8/d12/f40 [1023834,129710] 0 2024-09-17T07:19:48.664 INFO:tasks.workunit.client.0.smithi087.stdout:9/196: chown d3/d4/d6/d8/d22/d43 93867 1 2024-09-17T07:19:48.664 INFO:tasks.workunit.client.0.smithi087.stdout:9/197: chown d3/d4 760852 1 2024-09-17T07:19:48.665 INFO:tasks.workunit.client.1.smithi139.stdout:4/201: dread d0/f7 [4194304,4194304] 0 2024-09-17T07:19:48.668 INFO:tasks.workunit.client.1.smithi139.stdout:4/202: rename d0/d1/f1e to d0/db/d17/f38 0 2024-09-17T07:19:48.669 INFO:tasks.workunit.client.1.smithi139.stdout:4/203: mkdir d0/d10/d39 0 2024-09-17T07:19:48.671 INFO:tasks.workunit.client.0.smithi087.stdout:1/262: dwrite d2/d14/dd/d37/f5c [0,4194304] 0 2024-09-17T07:19:48.672 INFO:tasks.workunit.client.1.smithi139.stdout:4/204: creat d0/d10/d39/f3a x:0 0 0 2024-09-17T07:19:48.674 INFO:tasks.workunit.client.1.smithi139.stdout:4/205: symlink d0/d10/l3b 0 2024-09-17T07:19:48.675 INFO:tasks.workunit.client.1.smithi139.stdout:0/105: getdents d1 0 2024-09-17T07:19:48.676 INFO:tasks.workunit.client.1.smithi139.stdout:4/206: write d0/f7 [3815031,80364] 0 2024-09-17T07:19:48.678 INFO:tasks.workunit.client.1.smithi139.stdout:0/106: dread - d1/da/f24 zero size 2024-09-17T07:19:48.678 INFO:tasks.workunit.client.0.smithi087.stdout:9/198: getdents d3/d4/d2f 0 2024-09-17T07:19:48.682 INFO:tasks.workunit.client.1.smithi139.stdout:0/107: mkdir d1/da/d2a/d2d 0 2024-09-17T07:19:48.682 INFO:tasks.workunit.client.1.smithi139.stdout:4/207: dread d0/db/f21 [0,4194304] 0 2024-09-17T07:19:48.683 INFO:tasks.workunit.client.0.smithi087.stdout:3/201: write d6/d15/f24 [2992335,62358] 0 2024-09-17T07:19:48.683 INFO:tasks.workunit.client.0.smithi087.stdout:5/384: dwrite d5/d8/f10 [0,4194304] 0 2024-09-17T07:19:48.685 INFO:tasks.workunit.client.1.smithi139.stdout:9/224: write dc/d11/d15/d1e/f29 [224797,10373] 0 2024-09-17T07:19:48.685 INFO:tasks.workunit.client.0.smithi087.stdout:4/260: truncate d2/d22/d2c/d3f/d4d/d21/d2f/d3b/f56 2415024 0 2024-09-17T07:19:48.686 INFO:tasks.workunit.client.0.smithi087.stdout:9/199: rename d3/d4/d6/d8/d12/d32/c3d to d3/d4/d6/d8/d12/c46 0 2024-09-17T07:19:48.688 INFO:tasks.workunit.client.0.smithi087.stdout:5/385: chown d5/d12/d1c/d71 471 1 2024-09-17T07:19:48.688 INFO:tasks.workunit.client.1.smithi139.stdout:3/90: dwrite f4 [0,4194304] 0 2024-09-17T07:19:48.689 INFO:tasks.workunit.client.0.smithi087.stdout:3/202: write d6/d1b/d2b/d30/f3d [446760,16426] 0 2024-09-17T07:19:48.691 INFO:tasks.workunit.client.0.smithi087.stdout:8/195: dwrite d1/d7/f13 [0,4194304] 0 2024-09-17T07:19:48.691 INFO:tasks.workunit.client.0.smithi087.stdout:9/200: creat d3/d4/da/f47 x:0 0 0 2024-09-17T07:19:48.691 INFO:tasks.workunit.client.1.smithi139.stdout:0/108: dread d1/f18 [0,4194304] 0 2024-09-17T07:19:48.693 INFO:tasks.workunit.client.1.smithi139.stdout:0/109: write d1/f7 [708655,52599] 0 2024-09-17T07:19:48.693 INFO:tasks.workunit.client.0.smithi087.stdout:1/263: truncate d2/d14/dd/f18 3061938 0 2024-09-17T07:19:48.695 INFO:tasks.workunit.client.1.smithi139.stdout:3/91: truncate d5/d15/f18 543002 0 2024-09-17T07:19:48.699 INFO:tasks.workunit.client.1.smithi139.stdout:8/166: write d0/f7 [3388475,31491] 0 2024-09-17T07:19:48.702 INFO:tasks.workunit.client.1.smithi139.stdout:3/92: dread d5/fe [0,4194304] 0 2024-09-17T07:19:48.703 INFO:tasks.workunit.client.1.smithi139.stdout:9/225: dread dc/d11/d15/d1e/f21 [0,4194304] 0 2024-09-17T07:19:48.703 INFO:tasks.workunit.client.1.smithi139.stdout:0/110: dread d1/da/f14 [0,4194304] 0 2024-09-17T07:19:48.705 INFO:tasks.workunit.client.1.smithi139.stdout:3/93: mkdir d5/d15/d20 0 2024-09-17T07:19:48.705 INFO:tasks.workunit.client.0.smithi087.stdout:1/264: mknod d2/d3d/d35/c65 0 2024-09-17T07:19:48.706 INFO:tasks.workunit.client.1.smithi139.stdout:0/111: creat d1/da/d2a/f2e x:0 0 0 2024-09-17T07:19:48.707 INFO:tasks.workunit.client.1.smithi139.stdout:3/94: chown d5/lb 8 1 2024-09-17T07:19:48.709 INFO:tasks.workunit.client.1.smithi139.stdout:9/226: rename dc/c30 to dc/d2c/c47 0 2024-09-17T07:19:48.709 INFO:tasks.workunit.client.1.smithi139.stdout:3/95: mkdir d5/d21 0 2024-09-17T07:19:48.710 INFO:tasks.workunit.client.0.smithi087.stdout:9/201: dwrite d3/d4/d2f/f39 [0,4194304] 0 2024-09-17T07:19:48.710 INFO:tasks.workunit.client.0.smithi087.stdout:4/261: rename d2/d22/d2c/d3f/d4f/f5b to d2/d5/d1f/f5e 0 2024-09-17T07:19:48.710 INFO:tasks.workunit.client.1.smithi139.stdout:9/227: stat dc/d11/d15 0 2024-09-17T07:19:48.711 INFO:tasks.workunit.client.1.smithi139.stdout:3/96: read f4 [2071717,100970] 0 2024-09-17T07:19:48.711 INFO:tasks.workunit.client.1.smithi139.stdout:8/167: dwrite d0/fa [4194304,4194304] 0 2024-09-17T07:19:48.711 INFO:tasks.workunit.client.0.smithi087.stdout:8/196: dwrite d1/d2b/f29 [0,4194304] 0 2024-09-17T07:19:48.713 INFO:tasks.workunit.client.1.smithi139.stdout:9/228: chown dc/d11/d15/d3c/c44 496 1 2024-09-17T07:19:48.713 INFO:tasks.workunit.client.1.smithi139.stdout:6/211: sync 2024-09-17T07:19:48.713 INFO:tasks.workunit.client.1.smithi139.stdout:2/172: sync 2024-09-17T07:19:48.714 INFO:tasks.workunit.client.1.smithi139.stdout:2/173: read - d0/dc/f2f zero size 2024-09-17T07:19:48.715 INFO:tasks.workunit.client.1.smithi139.stdout:9/229: chown dc/d11/d15/d1e/f29 660 1 2024-09-17T07:19:48.717 INFO:tasks.workunit.client.1.smithi139.stdout:0/112: rmdir d1/da/d2a/d2d 0 2024-09-17T07:19:48.719 INFO:tasks.workunit.client.1.smithi139.stdout:3/97: mkdir d5/d15/d20/d22 0 2024-09-17T07:19:48.720 INFO:tasks.workunit.client.1.smithi139.stdout:4/208: truncate d0/db/d17/f2d 3814072 0 2024-09-17T07:19:48.721 INFO:tasks.workunit.client.1.smithi139.stdout:0/113: write d1/da/d2a/f2e [1038056,33849] 0 2024-09-17T07:19:48.724 INFO:tasks.workunit.client.0.smithi087.stdout:8/197: rename d1/d7/d9/d19/f40 to d1/d7/d9/d19/d1b/d18/d23/f44 0 2024-09-17T07:19:48.725 INFO:tasks.workunit.client.0.smithi087.stdout:3/203: truncate d6/fc 4044133 0 2024-09-17T07:19:48.726 INFO:tasks.workunit.client.0.smithi087.stdout:4/262: dread f0 [0,4194304] 0 2024-09-17T07:19:48.726 INFO:tasks.workunit.client.1.smithi139.stdout:3/98: dread d5/d13/f1a [0,4194304] 0 2024-09-17T07:19:48.728 INFO:tasks.workunit.client.1.smithi139.stdout:8/168: dread d0/f7 [4194304,4194304] 0 2024-09-17T07:19:48.729 INFO:tasks.workunit.client.1.smithi139.stdout:2/174: symlink d0/de/d11/d32/l38 0 2024-09-17T07:19:48.730 INFO:tasks.workunit.client.0.smithi087.stdout:5/386: dwrite d5/d12/d4d/f3a [0,4194304] 0 2024-09-17T07:19:48.730 INFO:tasks.workunit.client.1.smithi139.stdout:3/99: fsync d5/d15/f19 0 2024-09-17T07:19:48.731 INFO:tasks.workunit.client.0.smithi087.stdout:8/198: creat d1/d7/d9/d27/f45 x:0 0 0 2024-09-17T07:19:48.732 INFO:tasks.workunit.client.1.smithi139.stdout:0/114: creat d1/da/d1b/d1d/d21/f2f x:0 0 0 2024-09-17T07:19:48.733 INFO:tasks.workunit.client.0.smithi087.stdout:4/263: truncate d2/d22/d2c/d3f/d4d/f53 799836 0 2024-09-17T07:19:48.733 INFO:tasks.workunit.client.1.smithi139.stdout:9/230: rename dc/c13 to dc/d11/c48 0 2024-09-17T07:19:48.734 INFO:tasks.workunit.client.1.smithi139.stdout:6/212: dwrite db/df/d2a/f2f [0,4194304] 0 2024-09-17T07:19:48.737 INFO:tasks.workunit.client.0.smithi087.stdout:3/204: dwrite d6/f12 [0,4194304] 0 2024-09-17T07:19:48.738 INFO:tasks.workunit.client.1.smithi139.stdout:3/100: write f4 [2820869,122037] 0 2024-09-17T07:19:48.738 INFO:tasks.workunit.client.0.smithi087.stdout:8/199: fdatasync d1/d2b/f41 0 2024-09-17T07:19:48.738 INFO:tasks.workunit.client.0.smithi087.stdout:4/264: rmdir d2/d22/d2c/d3f/d4d/d3e 39 2024-09-17T07:19:48.739 INFO:tasks.workunit.client.1.smithi139.stdout:3/101: read - d5/d15/f19 zero size 2024-09-17T07:19:48.740 INFO:tasks.workunit.client.1.smithi139.stdout:4/209: getdents d0/d1/d29 0 2024-09-17T07:19:48.740 INFO:tasks.workunit.client.1.smithi139.stdout:0/115: dread - d1/da/d1b/d1d/d21/f2b zero size 2024-09-17T07:19:48.742 INFO:tasks.workunit.client.0.smithi087.stdout:8/200: chown d1/d7/d9/fc 1113 1 2024-09-17T07:19:48.743 INFO:tasks.workunit.client.1.smithi139.stdout:4/210: fsync d0/f7 0 2024-09-17T07:19:48.744 INFO:tasks.workunit.client.0.smithi087.stdout:5/387: dwrite d5/d18/d20/fa [0,4194304] 0 2024-09-17T07:19:48.744 INFO:tasks.workunit.client.0.smithi087.stdout:3/205: fdatasync d6/d1b/f3b 0 2024-09-17T07:19:48.747 INFO:tasks.workunit.client.1.smithi139.stdout:3/102: mkdir d5/d21/d23 0 2024-09-17T07:19:48.747 INFO:tasks.workunit.client.1.smithi139.stdout:8/169: dwrite d0/dc/d18/f1c [0,4194304] 0 2024-09-17T07:19:48.750 INFO:tasks.workunit.client.1.smithi139.stdout:0/116: creat d1/da/d1b/d1d/d21/f30 x:0 0 0 2024-09-17T07:19:48.750 INFO:tasks.workunit.client.1.smithi139.stdout:2/175: dread d0/d7/fd [0,4194304] 0 2024-09-17T07:19:48.753 INFO:tasks.workunit.client.1.smithi139.stdout:8/170: symlink d0/dc/l30 0 2024-09-17T07:19:48.753 INFO:tasks.workunit.client.1.smithi139.stdout:4/211: read d0/d1a/f1f [316858,54775] 0 2024-09-17T07:19:48.753 INFO:tasks.workunit.client.1.smithi139.stdout:2/176: read - d0/de/f36 zero size 2024-09-17T07:19:48.754 INFO:tasks.workunit.client.1.smithi139.stdout:0/117: fdatasync d1/da/fc 0 2024-09-17T07:19:48.760 INFO:tasks.workunit.client.1.smithi139.stdout:9/231: getdents dc/d2c 0 2024-09-17T07:19:48.760 INFO:tasks.workunit.client.1.smithi139.stdout:4/212: dread - d0/d10/d39/f3a zero size 2024-09-17T07:19:48.760 INFO:tasks.workunit.client.1.smithi139.stdout:2/177: read d0/de/d11/d28/f2d [2065566,96733] 0 2024-09-17T07:19:48.762 INFO:tasks.workunit.client.1.smithi139.stdout:3/103: dwrite d5/d15/f19 [0,4194304] 0 2024-09-17T07:19:48.762 INFO:tasks.workunit.client.1.smithi139.stdout:0/118: unlink d1/f7 0 2024-09-17T07:19:48.764 INFO:tasks.workunit.client.1.smithi139.stdout:2/178: readlink d0/de/d25/l2e 0 2024-09-17T07:19:48.765 INFO:tasks.workunit.client.0.smithi087.stdout:4/265: dwrite d2/d22/d2c/d3f/d4d/d3e/f52 [0,4194304] 0 2024-09-17T07:19:48.766 INFO:tasks.workunit.client.1.smithi139.stdout:2/179: chown d0/d7/d1a/d1b/c34 604935 1 2024-09-17T07:19:48.767 INFO:tasks.workunit.client.0.smithi087.stdout:8/201: dread d1/d2b/f32 [0,4194304] 0 2024-09-17T07:19:48.769 INFO:tasks.workunit.client.0.smithi087.stdout:8/202: write d1/d7/d9/d19/d1b/f34 [2608383,129121] 0 2024-09-17T07:19:48.772 INFO:tasks.workunit.client.0.smithi087.stdout:5/388: dwrite d5/d18/d20/f1e [0,4194304] 0 2024-09-17T07:19:48.772 INFO:tasks.workunit.client.0.smithi087.stdout:9/202: write d3/d4/da/d1c/d1e/f31 [674640,17660] 0 2024-09-17T07:19:48.773 INFO:tasks.workunit.client.1.smithi139.stdout:6/213: dread f2 [0,4194304] 0 2024-09-17T07:19:48.773 INFO:tasks.workunit.client.1.smithi139.stdout:3/104: mknod d5/d13/c24 0 2024-09-17T07:19:48.774 INFO:tasks.workunit.client.0.smithi087.stdout:5/389: readlink d5/d18/d20/l30 0 2024-09-17T07:19:48.774 INFO:tasks.workunit.client.1.smithi139.stdout:6/214: write db/d18/f39 [1409038,26032] 0 2024-09-17T07:19:48.776 INFO:tasks.workunit.client.0.smithi087.stdout:5/390: write d5/d18/d20/d2f/f57 [2182925,10319] 0 2024-09-17T07:19:48.778 INFO:tasks.workunit.client.1.smithi139.stdout:7/124: sync 2024-09-17T07:19:48.778 INFO:tasks.workunit.client.1.smithi139.stdout:5/97: sync 2024-09-17T07:19:48.778 INFO:tasks.workunit.client.1.smithi139.stdout:1/92: sync 2024-09-17T07:19:48.780 INFO:tasks.workunit.client.1.smithi139.stdout:5/98: write d4/de/f1f [667968,60039] 0 2024-09-17T07:19:48.781 INFO:tasks.workunit.client.1.smithi139.stdout:0/119: rename d1/da/f24 to d1/da/d2a/f31 0 2024-09-17T07:19:48.781 INFO:tasks.workunit.client.1.smithi139.stdout:2/180: read d0/f6 [3265641,35551] 0 2024-09-17T07:19:48.782 INFO:tasks.workunit.client.0.smithi087.stdout:4/266: dread d2/d5/f8 [4194304,4194304] 0 2024-09-17T07:19:48.783 INFO:tasks.workunit.client.0.smithi087.stdout:9/203: mknod d3/d4/d6/d8/d12/c48 0 2024-09-17T07:19:48.785 INFO:tasks.workunit.client.1.smithi139.stdout:4/213: link d0/f1d d0/d10/d39/f3c 0 2024-09-17T07:19:48.787 INFO:tasks.workunit.client.1.smithi139.stdout:4/214: write d0/f30 [455691,101129] 0 2024-09-17T07:19:48.789 INFO:tasks.workunit.client.0.smithi087.stdout:8/203: creat d1/d2b/f46 x:0 0 0 2024-09-17T07:19:48.790 INFO:tasks.workunit.client.1.smithi139.stdout:8/171: link d0/dc/l1e d0/d20/l31 0 2024-09-17T07:19:48.790 INFO:tasks.workunit.client.1.smithi139.stdout:1/93: dwrite d2/f15 [0,4194304] 0 2024-09-17T07:19:48.791 INFO:tasks.workunit.client.0.smithi087.stdout:9/204: creat d3/d4/da/f49 x:0 0 0 2024-09-17T07:19:48.792 INFO:tasks.workunit.client.1.smithi139.stdout:7/125: mknod d5/c25 0 2024-09-17T07:19:48.793 INFO:tasks.workunit.client.0.smithi087.stdout:3/206: dwrite d6/d1b/d2b/d30/f35 [0,4194304] 0 2024-09-17T07:19:48.793 INFO:tasks.workunit.client.0.smithi087.stdout:4/267: creat d2/d22/d2c/d3f/f5f x:0 0 0 2024-09-17T07:19:48.796 INFO:tasks.workunit.client.0.smithi087.stdout:3/207: chown d6 19915 1 2024-09-17T07:19:48.796 INFO:tasks.workunit.client.1.smithi139.stdout:3/105: unlink d5/d15/f19 0 2024-09-17T07:19:48.797 INFO:tasks.workunit.client.0.smithi087.stdout:5/391: dwrite d5/d12/d1c/f6c [0,4194304] 0 2024-09-17T07:19:48.797 INFO:tasks.workunit.client.0.smithi087.stdout:8/204: chown d1/d7/d9/d19/d1b/l28 1 1 2024-09-17T07:19:48.798 INFO:tasks.workunit.client.1.smithi139.stdout:9/232: getdents dc/d11/d15 0 2024-09-17T07:19:48.800 INFO:tasks.workunit.client.1.smithi139.stdout:1/94: unlink d2/f4 0 2024-09-17T07:19:48.800 INFO:tasks.workunit.client.1.smithi139.stdout:8/172: dread d0/dc/d18/f1f [0,4194304] 0 2024-09-17T07:19:48.800 INFO:tasks.workunit.client.0.smithi087.stdout:3/208: read d6/fa [3301411,66587] 0 2024-09-17T07:19:48.800 INFO:tasks.workunit.client.0.smithi087.stdout:8/205: fdatasync d1/d7/d9/d19/d1b/f43 0 2024-09-17T07:19:48.801 INFO:tasks.workunit.client.1.smithi139.stdout:7/126: rename d5/ld to d5/l26 0 2024-09-17T07:19:48.807 INFO:tasks.workunit.client.0.smithi087.stdout:3/209: write d6/d1b/d2b/f39 [430794,32927] 0 2024-09-17T07:19:48.807 INFO:tasks.workunit.client.0.smithi087.stdout:4/268: symlink d2/d22/d2c/d3f/d4d/l60 0 2024-09-17T07:19:48.807 INFO:tasks.workunit.client.1.smithi139.stdout:8/173: write d0/f2a [1126319,2318] 0 2024-09-17T07:19:48.808 INFO:tasks.workunit.client.1.smithi139.stdout:5/99: truncate d4/f6 3466 0 2024-09-17T07:19:48.808 INFO:tasks.workunit.client.1.smithi139.stdout:5/100: chown d4/de 715923 1 2024-09-17T07:19:48.808 INFO:tasks.workunit.client.1.smithi139.stdout:9/233: creat dc/d2a/f49 x:0 0 0 2024-09-17T07:19:48.808 INFO:tasks.workunit.client.1.smithi139.stdout:9/234: fdatasync dc/f3e 0 2024-09-17T07:19:48.809 INFO:tasks.workunit.client.0.smithi087.stdout:3/210: chown d6/d16/f26 63221405 1 2024-09-17T07:19:48.809 INFO:tasks.workunit.client.1.smithi139.stdout:1/95: rmdir d2/d10/d12 39 2024-09-17T07:19:48.810 INFO:tasks.workunit.client.0.smithi087.stdout:5/392: mknod d5/d8/c82 0 2024-09-17T07:19:48.810 INFO:tasks.workunit.client.0.smithi087.stdout:3/211: write d6/f12 [1976569,122284] 0 2024-09-17T07:19:48.811 INFO:tasks.workunit.client.1.smithi139.stdout:8/174: dread d0/dc/f10 [0,4194304] 0 2024-09-17T07:19:48.812 INFO:tasks.workunit.client.1.smithi139.stdout:7/127: creat d5/d17/f27 x:0 0 0 2024-09-17T07:19:48.813 INFO:tasks.workunit.client.0.smithi087.stdout:4/269: write d2/d22/d2c/d3f/d4d/fd [60050,50698] 0 2024-09-17T07:19:48.813 INFO:tasks.workunit.client.0.smithi087.stdout:8/206: rename d1/d7/f2f to d1/d7/d9/d19/d3a/f47 0 2024-09-17T07:19:48.813 INFO:tasks.workunit.client.1.smithi139.stdout:5/101: dwrite d4/f9 [0,4194304] 0 2024-09-17T07:19:48.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.814+0000 7fba1c24e640 1 -- 172.21.15.87:0/1533911174 --> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fba14110ff0 con 0x7fb9fc06dbd0 2024-09-17T07:19:48.816 INFO:tasks.workunit.client.1.smithi139.stdout:3/106: fdatasync d5/f11 0 2024-09-17T07:19:48.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.817+0000 7fba127fc640 1 -- 172.21.15.87:0/1533911174 <== mgr.24339 v2:172.21.15.139:6828/3218632563 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7fba14110ff0 con 0x7fb9fc06dbd0 2024-09-17T07:19:48.818 INFO:tasks.workunit.client.0.smithi087.stdout:5/393: mkdir d5/d18/d20/d2f/d83 0 2024-09-17T07:19:48.820 INFO:tasks.workunit.client.0.smithi087.stdout:4/270: mknod d2/d22/d2c/d3f/d4d/d3e/c61 0 2024-09-17T07:19:48.821 INFO:tasks.workunit.client.0.smithi087.stdout:5/394: dread - d5/d12/f62 zero size 2024-09-17T07:19:48.822 INFO:tasks.workunit.client.0.smithi087.stdout:3/212: dwrite d6/d1b/d2b/f39 [0,4194304] 0 2024-09-17T07:19:48.822 INFO:tasks.workunit.client.1.smithi139.stdout:7/128: rmdir d5/d10 39 2024-09-17T07:19:48.823 INFO:tasks.workunit.client.1.smithi139.stdout:1/96: truncate d2/d10/d12/d13/f16 202561 0 2024-09-17T07:19:48.823 INFO:tasks.workunit.client.1.smithi139.stdout:8/175: dwrite d0/dc/d18/f1c [4194304,4194304] 0 2024-09-17T07:19:48.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.821+0000 7fba1c24e640 1 -- 172.21.15.87:0/1533911174 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7fb9fc06dbd0 msgr2=0x7fb9fc070080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:19:48.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.821+0000 7fba1c24e640 1 --2- 172.21.15.87:0/1533911174 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7fb9fc06dbd0 0x7fb9fc070080 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fba1410ef90 tx=0x7fba0800b040 comp rx=0 tx=0).stop 2024-09-17T07:19:48.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.822+0000 7fba1c24e640 1 -- 172.21.15.87:0/1533911174 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fba140fe740 msgr2=0x7fba1410f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:19:48.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.822+0000 7fba1c24e640 1 --2- 172.21.15.87:0/1533911174 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fba140fe740 0x7fba1410f1e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fba0c0043d0 tx=0x7fba0c009da0 comp rx=0 tx=0).stop 2024-09-17T07:19:48.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.822+0000 7fba1c24e640 1 -- 172.21.15.87:0/1533911174 shutdown_connections 2024-09-17T07:19:48.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.822+0000 7fba1c24e640 1 --2- 172.21.15.87:0/1533911174 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7fb9fc06dbd0 0x7fb9fc070080 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:48.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.822+0000 7fba1c24e640 1 --2- 172.21.15.87:0/1533911174 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba140ffa10 0x7fba1410f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:48.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.822+0000 7fba1c24e640 1 --2- 172.21.15.87:0/1533911174 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fba140fe740 0x7fba1410f1e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:48.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.822+0000 7fba1c24e640 1 -- 172.21.15.87:0/1533911174 >> 172.21.15.87:0/1533911174 conn(0x7fba140fa060 msgr2=0x7fba140fc930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:19:48.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.823+0000 7fba1c24e640 1 -- 172.21.15.87:0/1533911174 shutdown_connections 2024-09-17T07:19:48.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.823+0000 7fba1c24e640 1 -- 172.21.15.87:0/1533911174 wait complete. 2024-09-17T07:19:48.825 INFO:tasks.workunit.client.1.smithi139.stdout:8/176: write d0/fd [3352488,17690] 0 2024-09-17T07:19:48.825 INFO:tasks.workunit.client.0.smithi087.stdout:4/271: mkdir d2/d22/d62 0 2024-09-17T07:19:48.827 INFO:tasks.workunit.client.1.smithi139.stdout:9/235: mknod dc/d11/d15/d1e/c4a 0 2024-09-17T07:19:48.828 INFO:tasks.workunit.client.0.smithi087.stdout:3/213: read d6/fa [443249,123778] 0 2024-09-17T07:19:48.831 INFO:tasks.workunit.client.1.smithi139.stdout:6/215: truncate f1 2772366 0 2024-09-17T07:19:48.832 INFO:tasks.workunit.client.0.smithi087.stdout:8/207: dwrite d1/d7/d9/d19/f1d [0,4194304] 0 2024-09-17T07:19:48.833 INFO:tasks.workunit.client.1.smithi139.stdout:7/129: dwrite d5/d17/f27 [0,4194304] 0 2024-09-17T07:19:48.833 INFO:tasks.workunit.client.0.smithi087.stdout:9/205: write d3/d4/d6/d8/f18 [1767181,69183] 0 2024-09-17T07:19:48.836 INFO:tasks.workunit.client.1.smithi139.stdout:9/236: dread dc/d11/d15/f28 [0,4194304] 0 2024-09-17T07:19:48.836 INFO:tasks.workunit.client.0.smithi087.stdout:4/272: dread d2/d22/d2c/d3f/d4d/f53 [0,4194304] 0 2024-09-17T07:19:48.837 INFO:tasks.workunit.client.0.smithi087.stdout:3/214: rename d6/d1b/d2b/d30 to d6/d1b/d42 0 2024-09-17T07:19:48.839 INFO:tasks.workunit.client.0.smithi087.stdout:9/206: unlink d3/d4/d6/d8/d12/f40 0 2024-09-17T07:19:48.839 INFO:tasks.workunit.client.1.smithi139.stdout:1/97: rmdir d2/de 0 2024-09-17T07:19:48.844 INFO:tasks.workunit.client.0.smithi087.stdout:3/215: mkdir d6/d15/d37/d3c/d43 0 2024-09-17T07:19:48.845 INFO:tasks.workunit.client.0.smithi087.stdout:3/216: write d6/d16/f36 [243253,43152] 0 2024-09-17T07:19:48.845 INFO:tasks.workunit.client.0.smithi087.stdout:9/207: creat d3/d4/d6/f4a x:0 0 0 2024-09-17T07:19:48.845 INFO:tasks.workunit.client.1.smithi139.stdout:3/107: getdents d5 0 2024-09-17T07:19:48.845 INFO:tasks.workunit.client.1.smithi139.stdout:3/108: chown d5/c1e 57711 1 2024-09-17T07:19:48.846 INFO:teuthology.orchestra.run.smithi087.stdout:true 2024-09-17T07:19:48.848 INFO:tasks.workunit.client.1.smithi139.stdout:6/216: creat db/d18/f48 x:0 0 0 2024-09-17T07:19:48.848 INFO:tasks.workunit.client.1.smithi139.stdout:7/130: rmdir d5 39 2024-09-17T07:19:48.850 INFO:tasks.workunit.client.1.smithi139.stdout:9/237: fdatasync f4 0 2024-09-17T07:19:48.853 INFO:tasks.workunit.client.1.smithi139.stdout:0/120: dwrite d1/f3 [0,4194304] 0 2024-09-17T07:19:48.853 INFO:tasks.workunit.client.0.smithi087.stdout:3/217: dread d6/f12 [0,4194304] 0 2024-09-17T07:19:48.858 INFO:tasks.workunit.client.1.smithi139.stdout:4/215: dwrite d0/f4 [0,4194304] 0 2024-09-17T07:19:48.859 INFO:tasks.workunit.client.0.smithi087.stdout:3/218: creat d6/d1b/d42/f44 x:0 0 0 2024-09-17T07:19:48.859 INFO:tasks.workunit.client.1.smithi139.stdout:2/181: dread d0/fa [4194304,4194304] 0 2024-09-17T07:19:48.859 INFO:tasks.workunit.client.1.smithi139.stdout:1/98: rmdir d2/d10/d12/d13/d14 0 2024-09-17T07:19:48.860 INFO:tasks.workunit.client.1.smithi139.stdout:7/131: dread d5/f18 [0,4194304] 0 2024-09-17T07:19:48.860 INFO:tasks.workunit.client.0.smithi087.stdout:9/208: dwrite d3/d4/d16/f3a [0,4194304] 0 2024-09-17T07:19:48.861 INFO:tasks.workunit.client.1.smithi139.stdout:0/121: rename d1/da/d1b/d1d to d1/da/d1b/d32 0 2024-09-17T07:19:48.865 INFO:tasks.workunit.client.0.smithi087.stdout:9/209: mkdir d3/d4/da/d4b 0 2024-09-17T07:19:48.865 INFO:tasks.workunit.client.1.smithi139.stdout:7/132: chown d5/d17/c22 0 1 2024-09-17T07:19:48.866 INFO:tasks.workunit.client.0.smithi087.stdout:3/219: mknod d6/d15/c45 0 2024-09-17T07:19:48.866 INFO:tasks.workunit.client.1.smithi139.stdout:9/238: rename dc/d11/d15/c1c to dc/c4b 0 2024-09-17T07:19:48.867 INFO:tasks.workunit.client.1.smithi139.stdout:0/122: creat d1/da/d1b/f33 x:0 0 0 2024-09-17T07:19:48.870 INFO:tasks.workunit.client.1.smithi139.stdout:6/217: rename db/df/d2a/f47 to db/d18/d38/f49 0 2024-09-17T07:19:48.871 INFO:tasks.workunit.client.0.smithi087.stdout:3/220: dread d6/d1b/f3b [0,4194304] 0 2024-09-17T07:19:48.872 INFO:tasks.workunit.client.1.smithi139.stdout:9/239: rmdir dc/d11/d15 39 2024-09-17T07:19:48.873 INFO:tasks.workunit.client.0.smithi087.stdout:8/208: truncate d1/d7/f22 559998 0 2024-09-17T07:19:48.874 INFO:tasks.workunit.client.1.smithi139.stdout:9/240: fsync dc/f3e 0 2024-09-17T07:19:48.874 INFO:tasks.workunit.client.1.smithi139.stdout:0/123: chown d1/da/cd 646265 1 2024-09-17T07:19:48.876 INFO:tasks.workunit.client.1.smithi139.stdout:8/177: truncate d0/dc/f10 903274 0 2024-09-17T07:19:48.876 INFO:tasks.workunit.client.0.smithi087.stdout:8/209: symlink d1/d7/d9/d3c/l48 0 2024-09-17T07:19:48.877 INFO:tasks.workunit.client.1.smithi139.stdout:6/218: dread f2 [0,4194304] 0 2024-09-17T07:19:48.877 INFO:tasks.workunit.client.1.smithi139.stdout:7/133: creat d5/d10/f28 x:0 0 0 2024-09-17T07:19:48.878 INFO:tasks.workunit.client.0.smithi087.stdout:3/221: getdents d6 0 2024-09-17T07:19:48.878 INFO:tasks.workunit.client.1.smithi139.stdout:3/109: write d5/f7 [2791185,62621] 0 2024-09-17T07:19:48.878 INFO:tasks.workunit.client.0.smithi087.stdout:3/222: chown d6/fa 248 1 2024-09-17T07:19:48.878 INFO:tasks.workunit.client.1.smithi139.stdout:6/219: write db/d18/f44 [116888,50055] 0 2024-09-17T07:19:48.879 INFO:tasks.workunit.client.0.smithi087.stdout:8/210: symlink d1/d7/d9/l49 0 2024-09-17T07:19:48.879 INFO:tasks.workunit.client.1.smithi139.stdout:2/182: rename d0/dc/f21 to d0/de/df/f39 0 2024-09-17T07:19:48.880 INFO:tasks.workunit.client.1.smithi139.stdout:2/183: truncate d0/f5 5189349 0 2024-09-17T07:19:48.881 INFO:tasks.workunit.client.1.smithi139.stdout:6/220: chown db/f16 239 1 2024-09-17T07:19:48.881 INFO:tasks.workunit.client.0.smithi087.stdout:8/211: rmdir d1/d7/d9/d19/d1b 39 2024-09-17T07:19:48.882 INFO:tasks.workunit.client.1.smithi139.stdout:6/221: read - db/f3d zero size 2024-09-17T07:19:48.883 INFO:tasks.workunit.client.0.smithi087.stdout:8/212: rmdir d1/d7/d9/d19/d3a 39 2024-09-17T07:19:48.883 INFO:tasks.workunit.client.1.smithi139.stdout:6/222: readlink db/df/d2a/l2d 0 2024-09-17T07:19:48.883 INFO:tasks.workunit.client.0.smithi087.stdout:8/213: dread - d1/d7/d9/d27/f45 zero size 2024-09-17T07:19:48.884 INFO:tasks.workunit.client.1.smithi139.stdout:7/134: chown d5/l26 3679310 1 2024-09-17T07:19:48.884 INFO:tasks.workunit.client.1.smithi139.stdout:6/223: dread - db/df/d2a/f3a zero size 2024-09-17T07:19:48.885 INFO:tasks.workunit.client.0.smithi087.stdout:7/210: sync 2024-09-17T07:19:48.885 INFO:tasks.workunit.client.0.smithi087.stdout:0/347: sync 2024-09-17T07:19:48.885 INFO:tasks.workunit.client.1.smithi139.stdout:6/224: chown db/df/c15 61099 1 2024-09-17T07:19:48.885 INFO:tasks.workunit.client.1.smithi139.stdout:0/124: rename d1/da/d1b/d32/d21/f2f to d1/da/d17/f34 0 2024-09-17T07:19:48.886 INFO:tasks.workunit.client.1.smithi139.stdout:1/99: link d2/d10/d12/d13/c19 d2/d10/c1b 0 2024-09-17T07:19:48.887 INFO:tasks.workunit.client.0.smithi087.stdout:8/214: mknod d1/c4a 0 2024-09-17T07:19:48.888 INFO:tasks.workunit.client.1.smithi139.stdout:9/241: getdents dc/d2c 0 2024-09-17T07:19:48.888 INFO:tasks.workunit.client.1.smithi139.stdout:2/184: truncate d0/dc/d15/f23 13924 0 2024-09-17T07:19:48.890 INFO:tasks.workunit.client.1.smithi139.stdout:2/185: chown d0/d7/d1a 2 1 2024-09-17T07:19:48.892 INFO:tasks.workunit.client.1.smithi139.stdout:0/125: creat d1/da/d1b/d32/f35 x:0 0 0 2024-09-17T07:19:48.892 INFO:tasks.workunit.client.0.smithi087.stdout:7/211: dread d0/d3/d23/d17/f3a [0,4194304] 0 2024-09-17T07:19:48.893 INFO:tasks.workunit.client.0.smithi087.stdout:3/223: truncate d6/f12 3949012 0 2024-09-17T07:19:48.894 INFO:tasks.workunit.client.1.smithi139.stdout:7/135: dwrite d5/f1e [0,4194304] 0 2024-09-17T07:19:48.894 INFO:tasks.workunit.client.1.smithi139.stdout:2/186: mkdir d0/dc/d3a 0 2024-09-17T07:19:48.896 INFO:tasks.workunit.client.0.smithi087.stdout:0/348: dwrite db/d45/d5d/d63/f66 [0,4194304] 0 2024-09-17T07:19:48.897 INFO:tasks.workunit.client.1.smithi139.stdout:9/242: write dc/d11/d15/d3c/f3d [160600,85137] 0 2024-09-17T07:19:48.897 INFO:tasks.workunit.client.1.smithi139.stdout:1/100: mknod d2/d10/d12/d1a/c1c 0 2024-09-17T07:19:48.897 INFO:tasks.workunit.client.1.smithi139.stdout:0/126: stat d1/l9 0 2024-09-17T07:19:48.898 INFO:tasks.workunit.client.0.smithi087.stdout:0/349: write db/d4f/f55 [409657,84872] 0 2024-09-17T07:19:48.899 INFO:tasks.workunit.client.0.smithi087.stdout:3/224: chown d6/d16/l22 18 1 2024-09-17T07:19:48.899 INFO:tasks.workunit.client.1.smithi139.stdout:0/127: write d1/da/d2a/f2e [1776777,17019] 0 2024-09-17T07:19:48.900 INFO:tasks.workunit.client.1.smithi139.stdout:8/178: link d0/d20/l31 d0/dc/l32 0 2024-09-17T07:19:48.901 INFO:tasks.workunit.client.1.smithi139.stdout:1/101: write d2/d10/d12/d13/f17 [506574,80055] 0 2024-09-17T07:19:48.904 INFO:tasks.workunit.client.0.smithi087.stdout:0/350: mknod db/d45/d5b/c7f 0 2024-09-17T07:19:48.904 INFO:tasks.workunit.client.1.smithi139.stdout:1/102: truncate d2/d10/d12/d13/f17 621829 0 2024-09-17T07:19:48.904 INFO:tasks.workunit.client.1.smithi139.stdout:1/103: readlink d2/lc 0 2024-09-17T07:19:48.906 INFO:tasks.workunit.client.0.smithi087.stdout:8/215: rename d1/d7/d9/d19/d1b/f1f to d1/d7/d9/d19/f4b 0 2024-09-17T07:19:48.907 INFO:tasks.workunit.client.1.smithi139.stdout:7/136: creat d5/d10/f29 x:0 0 0 2024-09-17T07:19:48.907 INFO:tasks.workunit.client.1.smithi139.stdout:2/187: mkdir d0/d3b 0 2024-09-17T07:19:48.909 INFO:tasks.workunit.client.1.smithi139.stdout:0/128: chown d1/c29 5763361 1 2024-09-17T07:19:48.910 INFO:tasks.workunit.client.0.smithi087.stdout:3/225: link d6/d15/c33 d6/d1b/d42/c46 0 2024-09-17T07:19:48.911 INFO:tasks.workunit.client.1.smithi139.stdout:1/104: write d2/f7 [4538613,43440] 0 2024-09-17T07:19:48.912 INFO:tasks.workunit.client.0.smithi087.stdout:7/212: truncate d0/f6 3269 0 2024-09-17T07:19:48.912 INFO:tasks.workunit.client.1.smithi139.stdout:9/243: creat dc/d2a/f4c x:0 0 0 2024-09-17T07:19:48.912 INFO:tasks.workunit.client.0.smithi087.stdout:0/351: creat db/d45/d5d/d7d/f80 x:0 0 0 2024-09-17T07:19:48.913 INFO:tasks.workunit.client.1.smithi139.stdout:9/244: fdatasync dc/f3e 0 2024-09-17T07:19:48.913 INFO:tasks.workunit.client.1.smithi139.stdout:1/105: chown d2/d10/d12/d1a 676864 1 2024-09-17T07:19:48.913 INFO:tasks.workunit.client.1.smithi139.stdout:0/129: truncate d1/da/d2a/f2e 2422569 0 2024-09-17T07:19:48.914 INFO:tasks.workunit.client.0.smithi087.stdout:8/216: symlink d1/d7/d9/l4c 0 2024-09-17T07:19:48.914 INFO:tasks.workunit.client.1.smithi139.stdout:2/188: write d0/de/df/f39 [1750321,57083] 0 2024-09-17T07:19:48.915 INFO:tasks.workunit.client.0.smithi087.stdout:8/217: stat d1/d7/d9/d27/f45 0 2024-09-17T07:19:48.916 INFO:tasks.workunit.client.0.smithi087.stdout:3/226: rename d6/l14 to d6/d15/d37/l47 0 2024-09-17T07:19:48.917 INFO:tasks.workunit.client.1.smithi139.stdout:6/225: rename f1 to db/d18/f4a 0 2024-09-17T07:19:48.919 INFO:tasks.workunit.client.1.smithi139.stdout:1/106: rename d2/lc to d2/l1d 0 2024-09-17T07:19:48.919 INFO:tasks.workunit.client.1.smithi139.stdout:9/245: dread fb [0,4194304] 0 2024-09-17T07:19:48.920 INFO:tasks.workunit.client.0.smithi087.stdout:7/213: link d0/d3/d10/f29 d0/d3/d10/d31/f43 0 2024-09-17T07:19:48.920 INFO:tasks.workunit.client.0.smithi087.stdout:8/218: truncate d1/d7/f22 158241 0 2024-09-17T07:19:48.921 INFO:tasks.workunit.client.1.smithi139.stdout:9/246: fdatasync dc/d11/d15/d1e/f2e 0 2024-09-17T07:19:48.921 INFO:tasks.workunit.client.0.smithi087.stdout:0/352: dwrite db/d45/f57 [0,4194304] 0 2024-09-17T07:19:48.921 INFO:tasks.workunit.client.1.smithi139.stdout:0/130: symlink d1/da/d1b/d32/d21/l36 0 2024-09-17T07:19:48.922 INFO:tasks.workunit.client.0.smithi087.stdout:8/219: write d1/d7/d9/d19/f1d [215970,13058] 0 2024-09-17T07:19:48.925 INFO:tasks.workunit.client.0.smithi087.stdout:0/353: symlink db/d45/d7b/d7e/l81 0 2024-09-17T07:19:48.925 INFO:tasks.workunit.client.1.smithi139.stdout:7/137: link d5/f18 d5/d17/f2a 0 2024-09-17T07:19:48.926 INFO:tasks.workunit.client.0.smithi087.stdout:0/354: chown db/d45/c50 1508 1 2024-09-17T07:19:48.926 INFO:tasks.workunit.client.1.smithi139.stdout:7/138: write d5/d10/f28 [820135,65603] 0 2024-09-17T07:19:48.927 INFO:tasks.workunit.client.0.smithi087.stdout:0/355: chown db/d45/d5d/d7d/f80 195640 1 2024-09-17T07:19:48.929 INFO:tasks.workunit.client.0.smithi087.stdout:7/214: link d0/f28 d0/f44 0 2024-09-17T07:19:48.930 INFO:tasks.workunit.client.1.smithi139.stdout:0/131: creat d1/da/d1b/d32/f37 x:0 0 0 2024-09-17T07:19:48.930 INFO:tasks.workunit.client.1.smithi139.stdout:1/107: unlink d2/d10/c1b 0 2024-09-17T07:19:48.932 INFO:tasks.workunit.client.0.smithi087.stdout:0/356: mknod db/d45/d5d/c82 0 2024-09-17T07:19:48.936 INFO:tasks.workunit.client.1.smithi139.stdout:9/247: creat dc/d11/f4d x:0 0 0 2024-09-17T07:19:48.937 INFO:tasks.workunit.client.1.smithi139.stdout:9/248: read - dc/d11/d15/d3c/f45 zero size 2024-09-17T07:19:48.937 INFO:tasks.workunit.client.1.smithi139.stdout:0/132: link d1/da/f14 d1/da/d2a/f38 0 2024-09-17T07:19:48.940 INFO:tasks.workunit.client.1.smithi139.stdout:9/249: write dc/d11/d15/d3c/f45 [672528,31300] 0 2024-09-17T07:19:48.940 INFO:tasks.workunit.client.1.smithi139.stdout:7/139: truncate d5/d17/f2a 717486 0 2024-09-17T07:19:48.940 INFO:tasks.workunit.client.1.smithi139.stdout:2/189: dread d0/dc/f13 [0,4194304] 0 2024-09-17T07:19:48.942 INFO:tasks.workunit.client.1.smithi139.stdout:0/133: write d1/f18 [3787828,13792] 0 2024-09-17T07:19:48.943 INFO:tasks.workunit.client.1.smithi139.stdout:7/140: mkdir d5/d10/d2b 0 2024-09-17T07:19:48.943 INFO:tasks.workunit.client.1.smithi139.stdout:0/134: stat d1/l9 0 2024-09-17T07:19:48.945 INFO:tasks.workunit.client.1.smithi139.stdout:9/250: truncate dc/d11/d15/f28 3506202 0 2024-09-17T07:19:48.946 INFO:tasks.workunit.client.1.smithi139.stdout:2/190: truncate d0/dc/f13 710999 0 2024-09-17T07:19:48.946 INFO:tasks.workunit.client.1.smithi139.stdout:7/141: creat d5/d10/f2c x:0 0 0 2024-09-17T07:19:48.947 INFO:tasks.workunit.client.1.smithi139.stdout:7/142: chown d5/l1c 925602910 1 2024-09-17T07:19:48.947 INFO:tasks.workunit.client.1.smithi139.stdout:0/135: mknod d1/da/d1b/d32/d21/c39 0 2024-09-17T07:19:48.949 INFO:tasks.workunit.client.1.smithi139.stdout:2/191: rename d0/dc/f20 to d0/dc/d3a/f3c 0 2024-09-17T07:19:48.951 INFO:tasks.workunit.client.1.smithi139.stdout:0/136: creat d1/da/d1b/d32/f3a x:0 0 0 2024-09-17T07:19:48.953 INFO:tasks.workunit.client.1.smithi139.stdout:7/143: rename d5/le to d5/d17/l2d 0 2024-09-17T07:19:48.955 INFO:tasks.workunit.client.1.smithi139.stdout:2/192: fsync d0/de/d11/d28/f2d 0 2024-09-17T07:19:48.955 INFO:tasks.workunit.client.1.smithi139.stdout:7/144: chown d5/lc 2924 1 2024-09-17T07:19:48.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.954+0000 7f9675eee640 1 -- 172.21.15.87:0/1680383094 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9670065be0 msgr2=0x7f96700ff1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:19:48.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.954+0000 7f9675eee640 1 --2- 172.21.15.87:0/1680383094 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9670065be0 0x7f96700ff1a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f96600048d0 tx=0x7f9660009da0 comp rx=0 tx=0).stop 2024-09-17T07:19:48.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.954+0000 7f9675eee640 1 -- 172.21.15.87:0/1680383094 shutdown_connections 2024-09-17T07:19:48.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.954+0000 7f9675eee640 1 --2- 172.21.15.87:0/1680383094 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f96700ff6e0 0x7f9670101ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:48.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.954+0000 7f9675eee640 1 --2- 172.21.15.87:0/1680383094 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9670065be0 0x7f96700ff1a0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:48.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.954+0000 7f9675eee640 1 -- 172.21.15.87:0/1680383094 >> 172.21.15.87:0/1680383094 conn(0x7f96700f6c10 msgr2=0x7f96700f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:19:48.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.954+0000 7f9675eee640 1 -- 172.21.15.87:0/1680383094 shutdown_connections 2024-09-17T07:19:48.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.954+0000 7f9675eee640 1 -- 172.21.15.87:0/1680383094 wait complete. 2024-09-17T07:19:48.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.955+0000 7f9675eee640 1 Processor -- start 2024-09-17T07:19:48.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.955+0000 7f9675eee640 1 -- start start 2024-09-17T07:19:48.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.955+0000 7f9675eee640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9670065be0 0x7f967010f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:19:48.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.955+0000 7f9675eee640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f96700ff6e0 0x7f967010f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:19:48.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.955+0000 7f9675eee640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f967010fd80 con 0x7f9670065be0 2024-09-17T07:19:48.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.955+0000 7f9675eee640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96701105a0 con 0x7f96700ff6e0 2024-09-17T07:19:48.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.955+0000 7f966f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9670065be0 0x7f967010f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:19:48.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.955+0000 7f966f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9670065be0 0x7f967010f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37068/0 (socket says 172.21.15.87:37068) 2024-09-17T07:19:48.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.955+0000 7f966f7fe640 1 -- 172.21.15.87:0/1281840687 learned_addr learned my addr 172.21.15.87:0/1281840687 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:19:48.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.955+0000 7f966effd640 1 --2- 172.21.15.87:0/1281840687 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f96700ff6e0 0x7f967010f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:19:48.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.956+0000 7f966f7fe640 1 -- 172.21.15.87:0/1281840687 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f96700ff6e0 msgr2=0x7f967010f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:19:48.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.956+0000 7f966f7fe640 1 --2- 172.21.15.87:0/1281840687 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f96700ff6e0 0x7f967010f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:48.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.956+0000 7f966f7fe640 1 -- 172.21.15.87:0/1281840687 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9660005040 con 0x7f9670065be0 2024-09-17T07:19:48.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.956+0000 7f966f7fe640 1 --2- 172.21.15.87:0/1281840687 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9670065be0 0x7f967010f1f0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f9660009ac0 tx=0x7f9660009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:19:48.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.956+0000 7f9657fff640 1 -- 172.21.15.87:0/1281840687 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9660038070 con 0x7f9670065be0 2024-09-17T07:19:48.958 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.956+0000 7f9675eee640 1 -- 172.21.15.87:0/1281840687 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96701107d0 con 0x7f9670065be0 2024-09-17T07:19:48.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.956+0000 7f9657fff640 1 -- 172.21.15.87:0/1281840687 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f966003d8a0 con 0x7f9670065be0 2024-09-17T07:19:48.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.956+0000 7f9675eee640 1 -- 172.21.15.87:0/1281840687 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9670110d10 con 0x7f9670065be0 2024-09-17T07:19:48.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.956+0000 7f9657fff640 1 -- 172.21.15.87:0/1281840687 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9660033710 con 0x7f9670065be0 2024-09-17T07:19:48.960 INFO:tasks.workunit.client.1.smithi139.stdout:9/251: getdents dc/d11/d15/d1e 0 2024-09-17T07:19:48.960 INFO:tasks.workunit.client.1.smithi139.stdout:0/137: symlink d1/da/l3b 0 2024-09-17T07:19:48.960 INFO:tasks.workunit.client.1.smithi139.stdout:6/226: dwrite db/d18/d1b/f1d [0,4194304] 0 2024-09-17T07:19:48.960 INFO:tasks.workunit.client.1.smithi139.stdout:9/252: chown ca 14 1 2024-09-17T07:19:48.960 INFO:tasks.workunit.client.1.smithi139.stdout:2/193: stat d0/dc/d15/l30 0 2024-09-17T07:19:48.960 INFO:tasks.workunit.client.1.smithi139.stdout:0/138: fsync d1/f18 0 2024-09-17T07:19:48.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.957+0000 7f9675eee640 1 -- 172.21.15.87:0/1281840687 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96700fa890 con 0x7f9670065be0 2024-09-17T07:19:48.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.958+0000 7f9657fff640 1 -- 172.21.15.87:0/1281840687 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 24) v1 ==== 90881+0+0 (secure 0 0 0) 0x7f9660030020 con 0x7f9670065be0 2024-09-17T07:19:48.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.958+0000 7f9657fff640 1 --2- 172.21.15.87:0/1281840687 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f965806dbd0 0x7f9658070080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:19:48.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.958+0000 7f9657fff640 1 -- 172.21.15.87:0/1281840687 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f96600ad5a0 con 0x7f9670065be0 2024-09-17T07:19:48.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.959+0000 7f966effd640 1 --2- 172.21.15.87:0/1281840687 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f965806dbd0 0x7f9658070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:19:48.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.959+0000 7f966effd640 1 --2- 172.21.15.87:0/1281840687 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f965806dbd0 0x7f9658070080 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f967010efa0 tx=0x7f966400b040 comp rx=0 tx=0).ready entity=mgr.24339 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:19:48.961 INFO:tasks.workunit.client.1.smithi139.stdout:2/194: chown d0/de/d11 1 1 2024-09-17T07:19:48.966 INFO:tasks.workunit.client.1.smithi139.stdout:2/195: readlink d0/de/d25/l2e 0 2024-09-17T07:19:48.966 INFO:tasks.workunit.client.1.smithi139.stdout:7/145: dwrite d5/d17/f27 [0,4194304] 0 2024-09-17T07:19:48.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:48.966+0000 7f9657fff640 1 -- 172.21.15.87:0/1281840687 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182127 (secure 0 0 0) 0x7f9660077a80 con 0x7f9670065be0 2024-09-17T07:19:48.967 INFO:tasks.workunit.client.1.smithi139.stdout:0/139: mknod d1/da/c3c 0 2024-09-17T07:19:48.968 INFO:tasks.workunit.client.1.smithi139.stdout:2/196: dread - d0/de/f36 zero size 2024-09-17T07:19:48.969 INFO:tasks.workunit.client.1.smithi139.stdout:6/227: dread f2 [0,4194304] 0 2024-09-17T07:19:48.971 INFO:tasks.workunit.client.1.smithi139.stdout:0/140: mkdir d1/da/d1b/d3d 0 2024-09-17T07:19:48.971 INFO:tasks.workunit.client.1.smithi139.stdout:6/228: write db/df/d2a/d40/f3c [828322,50877] 0 2024-09-17T07:19:48.972 INFO:tasks.workunit.client.1.smithi139.stdout:9/253: rename dc/d11/c48 to dc/d11/d15/d1e/d34/c4e 0 2024-09-17T07:19:48.973 INFO:tasks.workunit.client.1.smithi139.stdout:0/141: read - d1/da/d1b/d32/f35 zero size 2024-09-17T07:19:48.974 INFO:tasks.workunit.client.1.smithi139.stdout:2/197: creat d0/dc/d3a/f3d x:0 0 0 2024-09-17T07:19:48.976 INFO:tasks.workunit.client.1.smithi139.stdout:7/146: dwrite d5/d17/f20 [0,4194304] 0 2024-09-17T07:19:48.978 INFO:tasks.workunit.client.1.smithi139.stdout:6/229: symlink db/d21/l4b 0 2024-09-17T07:19:48.981 INFO:tasks.workunit.client.1.smithi139.stdout:9/254: symlink dc/d11/l4f 0 2024-09-17T07:19:48.983 INFO:tasks.workunit.client.1.smithi139.stdout:9/255: chown c8 95 1 2024-09-17T07:19:48.986 INFO:tasks.workunit.client.1.smithi139.stdout:0/142: creat d1/f3e x:0 0 0 2024-09-17T07:19:48.986 INFO:tasks.workunit.client.1.smithi139.stdout:7/147: dwrite d5/d10/f2c [0,4194304] 0 2024-09-17T07:19:48.989 INFO:tasks.workunit.client.1.smithi139.stdout:9/256: creat dc/d11/d15/f50 x:0 0 0 2024-09-17T07:19:48.989 INFO:tasks.workunit.client.1.smithi139.stdout:0/143: read d1/da/fc [3452337,98839] 0 2024-09-17T07:19:48.991 INFO:tasks.workunit.client.1.smithi139.stdout:7/148: creat d5/d10/f2e x:0 0 0 2024-09-17T07:19:48.993 INFO:tasks.workunit.client.1.smithi139.stdout:6/230: dwrite db/d18/d1b/f37 [0,4194304] 0 2024-09-17T07:19:48.993 INFO:tasks.workunit.client.1.smithi139.stdout:9/257: write dc/d11/d15/d1e/f29 [301864,82362] 0 2024-09-17T07:19:48.996 INFO:tasks.workunit.client.0.smithi087.stdout:8/220: rename d1/d7/d9/d19/d3a to d1/d7/d9/d19/d4d 0 2024-09-17T07:19:48.996 INFO:tasks.workunit.client.1.smithi139.stdout:7/149: fdatasync d5/f18 0 2024-09-17T07:19:48.997 INFO:tasks.workunit.client.1.smithi139.stdout:6/231: write db/df/d2a/d40/f3c [791987,71895] 0 2024-09-17T07:19:48.997 INFO:tasks.workunit.client.0.smithi087.stdout:0/357: write db/f54 [22008,103064] 0 2024-09-17T07:19:48.998 INFO:tasks.workunit.client.1.smithi139.stdout:0/144: rename d1/da/d2a/f31 to d1/da/d1b/f3f 0 2024-09-17T07:19:48.998 INFO:tasks.workunit.client.0.smithi087.stdout:7/215: write d0/fd [918948,46232] 0 2024-09-17T07:19:48.999 INFO:tasks.workunit.client.0.smithi087.stdout:0/358: chown db/d45/f68 5100240 1 2024-09-17T07:19:49.001 INFO:tasks.workunit.client.1.smithi139.stdout:7/150: rmdir d5 39 2024-09-17T07:19:49.003 INFO:tasks.workunit.client.1.smithi139.stdout:6/232: mkdir db/df/d4c 0 2024-09-17T07:19:49.003 INFO:tasks.workunit.client.0.smithi087.stdout:0/359: creat db/d4f/f83 x:0 0 0 2024-09-17T07:19:49.004 INFO:tasks.workunit.client.0.smithi087.stdout:7/216: mknod d0/d36/c45 0 2024-09-17T07:19:49.004 INFO:tasks.workunit.client.1.smithi139.stdout:9/258: dwrite dc/d11/d15/d1e/f2f [0,4194304] 0 2024-09-17T07:19:49.005 INFO:tasks.workunit.client.0.smithi087.stdout:3/227: mkdir d6/d15/d37/d3c/d43/d48 0 2024-09-17T07:19:49.005 INFO:tasks.workunit.client.1.smithi139.stdout:0/145: chown d1/c10 3713870 1 2024-09-17T07:19:49.006 INFO:tasks.workunit.client.0.smithi087.stdout:8/221: creat d1/d7/d9/d19/f4e x:0 0 0 2024-09-17T07:19:49.006 INFO:tasks.workunit.client.0.smithi087.stdout:0/360: mknod db/d45/d7b/d7e/c84 0 2024-09-17T07:19:49.007 INFO:tasks.workunit.client.0.smithi087.stdout:7/217: symlink d0/d3/d23/d2d/l46 0 2024-09-17T07:19:49.008 INFO:tasks.workunit.client.0.smithi087.stdout:0/361: write db/d45/f51 [373780,47784] 0 2024-09-17T07:19:49.009 INFO:tasks.workunit.client.0.smithi087.stdout:7/218: stat d0/d3/d23/d17/f41 0 2024-09-17T07:19:49.012 INFO:tasks.workunit.client.1.smithi139.stdout:6/233: chown db/df/d2a/l34 985969 1 2024-09-17T07:19:49.012 INFO:tasks.workunit.client.1.smithi139.stdout:0/146: write d1/da/d1b/d32/f37 [273521,49031] 0 2024-09-17T07:19:49.012 INFO:tasks.workunit.client.1.smithi139.stdout:7/151: mknod d5/d10/c2f 0 2024-09-17T07:19:49.013 INFO:tasks.workunit.client.0.smithi087.stdout:7/219: write d0/d3/f3e [917445,129781] 0 2024-09-17T07:19:49.014 INFO:tasks.workunit.client.1.smithi139.stdout:2/198: dwrite d0/de/d11/d28/f2d [0,4194304] 0 2024-09-17T07:19:49.015 INFO:tasks.workunit.client.0.smithi087.stdout:0/362: rmdir db/d45/d73 0 2024-09-17T07:19:49.015 INFO:tasks.workunit.client.1.smithi139.stdout:9/259: truncate dc/d11/d15/f28 1328753 0 2024-09-17T07:19:49.015 INFO:tasks.workunit.client.0.smithi087.stdout:8/222: dwrite d1/d7/d9/d27/f45 [0,4194304] 0 2024-09-17T07:19:49.016 INFO:tasks.workunit.client.1.smithi139.stdout:9/260: readlink dc/d2c/l3a 0 2024-09-17T07:19:49.017 INFO:tasks.workunit.client.1.smithi139.stdout:0/147: mknod d1/da/d2a/c40 0 2024-09-17T07:19:49.018 INFO:tasks.workunit.client.1.smithi139.stdout:2/199: mknod d0/de/d11/d12/c3e 0 2024-09-17T07:19:49.018 INFO:tasks.workunit.client.1.smithi139.stdout:2/200: chown d0/c24 436529 1 2024-09-17T07:19:49.019 INFO:tasks.workunit.client.0.smithi087.stdout:0/363: mknod db/d45/c85 0 2024-09-17T07:19:49.020 INFO:tasks.workunit.client.0.smithi087.stdout:0/364: chown db/d4f 1025205432 1 2024-09-17T07:19:49.020 INFO:tasks.workunit.client.1.smithi139.stdout:6/234: creat db/d21/d46/f4d x:0 0 0 2024-09-17T07:19:49.020 INFO:tasks.workunit.client.0.smithi087.stdout:8/223: mknod d1/c4f 0 2024-09-17T07:19:49.021 INFO:tasks.workunit.client.1.smithi139.stdout:2/201: fdatasync d0/de/df/f39 0 2024-09-17T07:19:49.022 INFO:tasks.workunit.client.1.smithi139.stdout:0/148: symlink d1/da/d1b/d32/d21/l41 0 2024-09-17T07:19:49.022 INFO:tasks.workunit.client.1.smithi139.stdout:6/235: chown db/d21/l4b 1535 1 2024-09-17T07:19:49.022 INFO:tasks.workunit.client.1.smithi139.stdout:7/152: rename d5/d10/c2f to d5/c30 0 2024-09-17T07:19:49.023 INFO:tasks.workunit.client.0.smithi087.stdout:7/220: dread d0/d3/f4 [0,4194304] 0 2024-09-17T07:19:49.025 INFO:tasks.workunit.client.0.smithi087.stdout:0/365: mkdir db/d45/d5d/d63/d86 0 2024-09-17T07:19:49.025 INFO:tasks.workunit.client.1.smithi139.stdout:2/202: mkdir d0/de/d25/d3f 0 2024-09-17T07:19:49.027 INFO:tasks.workunit.client.0.smithi087.stdout:8/224: symlink d1/d2b/l50 0 2024-09-17T07:19:49.028 INFO:tasks.workunit.client.1.smithi139.stdout:9/261: rmdir dc/d11/d15/d1e/d38 0 2024-09-17T07:19:49.029 INFO:tasks.workunit.client.1.smithi139.stdout:9/262: readlink dc/d2a/l2d 0 2024-09-17T07:19:49.030 INFO:tasks.workunit.client.1.smithi139.stdout:7/153: creat d5/d17/f31 x:0 0 0 2024-09-17T07:19:49.030 INFO:tasks.workunit.client.1.smithi139.stdout:2/203: chown d0/de/d11/c18 452472404 1 2024-09-17T07:19:49.030 INFO:tasks.workunit.client.0.smithi087.stdout:0/366: rename db/d45/d5d/d63/l69 to db/d45/d5d/l87 0 2024-09-17T07:19:49.031 INFO:tasks.workunit.client.0.smithi087.stdout:0/367: fdatasync db/f33 0 2024-09-17T07:19:49.032 INFO:tasks.workunit.client.1.smithi139.stdout:6/236: dwrite db/f3d [0,4194304] 0 2024-09-17T07:19:49.032 INFO:tasks.workunit.client.1.smithi139.stdout:9/263: chown dc/d11 8120 1 2024-09-17T07:19:49.032 INFO:tasks.workunit.client.0.smithi087.stdout:0/368: fdatasync db/d4f/f83 0 2024-09-17T07:19:49.033 INFO:tasks.workunit.client.0.smithi087.stdout:8/225: write d1/d7/d9/fc [2648383,69894] 0 2024-09-17T07:19:49.033 INFO:tasks.workunit.client.1.smithi139.stdout:9/264: stat ca 0 2024-09-17T07:19:49.034 INFO:tasks.workunit.client.1.smithi139.stdout:7/154: creat d5/d17/f32 x:0 0 0 2024-09-17T07:19:49.036 INFO:tasks.workunit.client.0.smithi087.stdout:8/226: mknod d1/c51 0 2024-09-17T07:19:49.038 INFO:tasks.workunit.client.1.smithi139.stdout:2/204: truncate d0/f6 4961602 0 2024-09-17T07:19:49.038 INFO:tasks.workunit.client.0.smithi087.stdout:8/227: symlink d1/d7/d9/d3c/l52 0 2024-09-17T07:19:49.041 INFO:tasks.workunit.client.0.smithi087.stdout:3/228: dread d6/d15/f24 [0,4194304] 0 2024-09-17T07:19:49.041 INFO:tasks.workunit.client.0.smithi087.stdout:0/369: dwrite db/d45/f51 [0,4194304] 0 2024-09-17T07:19:49.042 INFO:tasks.workunit.client.1.smithi139.stdout:2/205: mknod d0/de/d11/d12/c40 0 2024-09-17T07:19:49.042 INFO:tasks.workunit.client.1.smithi139.stdout:9/265: dwrite dc/d11/d15/d3c/f3d [0,4194304] 0 2024-09-17T07:19:49.043 INFO:tasks.workunit.client.0.smithi087.stdout:0/370: write db/f28 [464861,8423] 0 2024-09-17T07:19:49.043 INFO:tasks.workunit.client.0.smithi087.stdout:8/228: mkdir d1/d2b/d3b/d53 0 2024-09-17T07:19:49.044 INFO:tasks.workunit.client.1.smithi139.stdout:9/266: readlink dc/lf 0 2024-09-17T07:19:49.046 INFO:tasks.workunit.client.0.smithi087.stdout:3/229: write d6/d15/f24 [1240852,90123] 0 2024-09-17T07:19:49.047 INFO:tasks.workunit.client.0.smithi087.stdout:7/221: write d0/d3/d23/d2d/f35 [2447261,105913] 0 2024-09-17T07:19:49.048 INFO:tasks.workunit.client.0.smithi087.stdout:8/229: mkdir d1/d7/d9/d19/d1b/d18/d23/d54 0 2024-09-17T07:19:49.049 INFO:tasks.workunit.client.0.smithi087.stdout:0/371: symlink db/d45/d5d/d63/d86/l88 0 2024-09-17T07:19:49.050 INFO:tasks.workunit.client.1.smithi139.stdout:6/237: dread f8 [0,4194304] 0 2024-09-17T07:19:49.050 INFO:tasks.workunit.client.0.smithi087.stdout:7/222: creat d0/d3/d23/d17/f47 x:0 0 0 2024-09-17T07:19:49.050 INFO:tasks.workunit.client.0.smithi087.stdout:0/372: write db/f38 [518942,2612] 0 2024-09-17T07:19:49.052 INFO:tasks.workunit.client.1.smithi139.stdout:6/238: mkdir db/df/d4e 0 2024-09-17T07:19:49.052 INFO:tasks.workunit.client.1.smithi139.stdout:6/239: readlink db/d21/l28 0 2024-09-17T07:19:49.053 INFO:tasks.workunit.client.1.smithi139.stdout:6/240: fdatasync db/df/d2a/d40/f3b 0 2024-09-17T07:19:49.055 INFO:tasks.workunit.client.0.smithi087.stdout:7/223: getdents d0/d3/d10/d32 0 2024-09-17T07:19:49.057 INFO:tasks.workunit.client.1.smithi139.stdout:6/241: mkdir db/df/d2a/d40/d4f 0 2024-09-17T07:19:49.057 INFO:tasks.workunit.client.0.smithi087.stdout:7/224: read d0/f3b [3737386,50992] 0 2024-09-17T07:19:49.060 INFO:tasks.workunit.client.0.smithi087.stdout:0/373: rename db/d45/d5d/d63/f66 to db/d45/d5b/f89 0 2024-09-17T07:19:49.061 INFO:tasks.workunit.client.0.smithi087.stdout:8/230: dwrite d1/d7/d9/d19/f4b [0,4194304] 0 2024-09-17T07:19:49.061 INFO:tasks.workunit.client.0.smithi087.stdout:0/374: dread - db/d45/f68 zero size 2024-09-17T07:19:49.062 INFO:tasks.workunit.client.0.smithi087.stdout:2/309: sync 2024-09-17T07:19:49.062 INFO:tasks.workunit.client.0.smithi087.stdout:6/319: sync 2024-09-17T07:19:49.063 INFO:tasks.workunit.client.1.smithi139.stdout:7/155: rmdir d5/d10 39 2024-09-17T07:19:49.063 INFO:tasks.workunit.client.0.smithi087.stdout:8/231: write d1/d7/f13 [1814747,122684] 0 2024-09-17T07:19:49.064 INFO:tasks.workunit.client.1.smithi139.stdout:7/156: write f2 [4498669,69092] 0 2024-09-17T07:19:49.064 INFO:tasks.workunit.client.1.smithi139.stdout:6/242: dwrite db/df/f19 [0,4194304] 0 2024-09-17T07:19:49.065 INFO:tasks.workunit.client.0.smithi087.stdout:0/375: creat db/d45/d5d/d7d/f8a x:0 0 0 2024-09-17T07:19:49.066 INFO:tasks.workunit.client.0.smithi087.stdout:2/310: chown d2/d7/d33/l4d 904609103 1 2024-09-17T07:19:49.067 INFO:tasks.workunit.client.0.smithi087.stdout:0/376: chown db/f79 31 1 2024-09-17T07:19:49.067 INFO:tasks.workunit.client.1.smithi139.stdout:7/157: creat d5/d17/f33 x:0 0 0 2024-09-17T07:19:49.072 INFO:tasks.workunit.client.1.smithi139.stdout:6/243: creat db/d18/d1b/f50 x:0 0 0 2024-09-17T07:19:49.073 INFO:tasks.workunit.client.0.smithi087.stdout:6/320: dwrite d1/d6/d1a/d2c/d33/f3f [0,4194304] 0 2024-09-17T07:19:49.074 INFO:tasks.workunit.client.0.smithi087.stdout:7/225: getdents d0/d3/d23/d2d 0 2024-09-17T07:19:49.074 INFO:tasks.workunit.client.0.smithi087.stdout:6/321: fdatasync d1/d6/f12 0 2024-09-17T07:19:49.074 INFO:tasks.workunit.client.0.smithi087.stdout:0/377: rmdir db/d4f 39 2024-09-17T07:19:49.075 INFO:tasks.workunit.client.0.smithi087.stdout:8/232: symlink d1/d2b/l55 0 2024-09-17T07:19:49.076 INFO:tasks.workunit.client.1.smithi139.stdout:7/158: symlink d5/d10/d2b/l34 0 2024-09-17T07:19:49.076 INFO:tasks.workunit.client.0.smithi087.stdout:6/322: chown d1/d6/d1a/f28 380 1 2024-09-17T07:19:49.078 INFO:tasks.workunit.client.1.smithi139.stdout:9/267: link dc/d11/d15/d1e/l37 dc/d2a/l51 0 2024-09-17T07:19:49.081 INFO:tasks.workunit.client.1.smithi139.stdout:2/206: dwrite d0/dc/f2f [0,4194304] 0 2024-09-17T07:19:49.082 INFO:tasks.workunit.client.0.smithi087.stdout:6/323: fdatasync d1/d6/d1a/f57 0 2024-09-17T07:19:49.083 INFO:tasks.workunit.client.1.smithi139.stdout:9/268: mkdir dc/d11/d52 0 2024-09-17T07:19:49.083 INFO:tasks.workunit.client.1.smithi139.stdout:6/244: dwrite db/d18/d1b/f37 [0,4194304] 0 2024-09-17T07:19:49.084 INFO:tasks.workunit.client.0.smithi087.stdout:2/311: mkdir d2/d7/dd/d10/d4c/d5f 0 2024-09-17T07:19:49.085 INFO:tasks.workunit.client.1.smithi139.stdout:6/245: stat db/d18/f44 0 2024-09-17T07:19:49.086 INFO:tasks.workunit.client.0.smithi087.stdout:8/233: mkdir d1/d56 0 2024-09-17T07:19:49.086 INFO:tasks.workunit.client.1.smithi139.stdout:9/269: write dc/d11/f4d [453923,52628] 0 2024-09-17T07:19:49.087 INFO:tasks.workunit.client.0.smithi087.stdout:7/226: dwrite d0/f8 [0,4194304] 0 2024-09-17T07:19:49.087 INFO:tasks.workunit.client.1.smithi139.stdout:2/207: truncate d0/dc/f13 133424 0 2024-09-17T07:19:49.087 INFO:tasks.workunit.client.0.smithi087.stdout:8/234: fdatasync d1/d7/d9/d19/f1d 0 2024-09-17T07:19:49.088 INFO:tasks.workunit.client.0.smithi087.stdout:0/378: rename db/f12 to db/d45/d7b/d7e/f8b 0 2024-09-17T07:19:49.090 INFO:tasks.workunit.client.1.smithi139.stdout:6/246: symlink db/df/d2a/l51 0 2024-09-17T07:19:49.090 INFO:tasks.workunit.client.0.smithi087.stdout:0/379: write f5 [848511,60460] 0 2024-09-17T07:19:49.093 INFO:tasks.workunit.client.1.smithi139.stdout:6/247: dread - db/d18/d1b/f50 zero size 2024-09-17T07:19:49.094 INFO:tasks.workunit.client.0.smithi087.stdout:3/230: truncate d6/d15/f29 1578046 0 2024-09-17T07:19:49.097 INFO:tasks.workunit.client.1.smithi139.stdout:9/270: dwrite dc/d11/d15/d3c/f3f [0,4194304] 0 2024-09-17T07:19:49.098 INFO:tasks.workunit.client.1.smithi139.stdout:9/271: readlink dc/ld 0 2024-09-17T07:19:49.098 INFO:tasks.workunit.client.1.smithi139.stdout:2/208: dread d0/dc/d15/f23 [0,4194304] 0 2024-09-17T07:19:49.101 INFO:tasks.workunit.client.1.smithi139.stdout:6/248: rmdir db/df/d2a/d40/d4f 0 2024-09-17T07:19:49.103 INFO:tasks.workunit.client.0.smithi087.stdout:6/324: symlink d1/d6/d68/l6b 0 2024-09-17T07:19:49.103 INFO:tasks.workunit.client.1.smithi139.stdout:9/272: mkdir dc/d11/d15/d1e/d53 0 2024-09-17T07:19:49.107 INFO:tasks.workunit.client.1.smithi139.stdout:9/273: symlink dc/d11/d15/l54 0 2024-09-17T07:19:49.108 INFO:tasks.workunit.client.0.smithi087.stdout:8/235: symlink d1/d7/d9/d19/d1b/d18/d23/d54/l57 0 2024-09-17T07:19:49.110 INFO:tasks.workunit.client.1.smithi139.stdout:7/159: getdents d5/d10/d2b 0 2024-09-17T07:19:49.111 INFO:tasks.workunit.client.1.smithi139.stdout:7/160: truncate d5/d17/f33 846585 0 2024-09-17T07:19:49.113 INFO:tasks.workunit.client.0.smithi087.stdout:8/236: creat d1/d7/d9/d27/f58 x:0 0 0 2024-09-17T07:19:49.114 INFO:tasks.workunit.client.1.smithi139.stdout:9/274: link dc/l1f dc/d11/d15/d1e/d53/l55 0 2024-09-17T07:19:49.115 INFO:tasks.workunit.client.0.smithi087.stdout:6/325: rename d1/d6/f1c to d1/d6/d1a/d2c/d33/f6c 0 2024-09-17T07:19:49.117 INFO:tasks.workunit.client.0.smithi087.stdout:0/380: rename db/f4e to db/f8c 0 2024-09-17T07:19:49.118 INFO:tasks.workunit.client.0.smithi087.stdout:3/231: symlink d6/d1b/d2b/l49 0 2024-09-17T07:19:49.119 INFO:tasks.workunit.client.0.smithi087.stdout:8/237: mknod d1/d7/d9/d19/d1b/d18/c59 0 2024-09-17T07:19:49.119 INFO:tasks.workunit.client.0.smithi087.stdout:7/227: dread d0/fc [0,4194304] 0 2024-09-17T07:19:49.120 INFO:tasks.workunit.client.1.smithi139.stdout:6/249: dread db/d18/f39 [0,4194304] 0 2024-09-17T07:19:49.121 INFO:tasks.workunit.client.0.smithi087.stdout:6/326: symlink d1/d6/d1a/d2c/d58/l6d 0 2024-09-17T07:19:49.121 INFO:tasks.workunit.client.0.smithi087.stdout:8/238: write d1/d7/d9/d19/d1b/f30 [635657,46401] 0 2024-09-17T07:19:49.121 INFO:tasks.workunit.client.1.smithi139.stdout:6/250: fsync db/d18/f44 0 2024-09-17T07:19:49.122 INFO:tasks.workunit.client.1.smithi139.stdout:7/161: dwrite d5/d17/f33 [0,4194304] 0 2024-09-17T07:19:49.123 INFO:tasks.workunit.client.1.smithi139.stdout:9/275: dread fb [0,4194304] 0 2024-09-17T07:19:49.124 INFO:tasks.workunit.client.0.smithi087.stdout:7/228: rename d0/l18 to d0/d3/d10/d31/l48 0 2024-09-17T07:19:49.124 INFO:tasks.workunit.client.0.smithi087.stdout:3/232: creat d6/d16/f4a x:0 0 0 2024-09-17T07:19:49.125 INFO:tasks.workunit.client.0.smithi087.stdout:8/239: mknod d1/d2b/d3b/c5a 0 2024-09-17T07:19:49.127 INFO:tasks.workunit.client.0.smithi087.stdout:7/229: mknod d0/d3/d10/d31/c49 0 2024-09-17T07:19:49.128 INFO:tasks.workunit.client.0.smithi087.stdout:3/233: readlink d6/lf 0 2024-09-17T07:19:49.129 INFO:tasks.workunit.client.1.smithi139.stdout:9/276: truncate dc/d11/d15/d1e/f2e 8556579 0 2024-09-17T07:19:49.131 INFO:tasks.workunit.client.0.smithi087.stdout:8/240: creat d1/d2b/d3b/d53/f5b x:0 0 0 2024-09-17T07:19:49.133 INFO:tasks.workunit.client.1.smithi139.stdout:9/277: mkdir dc/d11/d52/d56 0 2024-09-17T07:19:49.134 INFO:tasks.workunit.client.1.smithi139.stdout:6/251: dwrite db/d18/d1b/f3f [0,4194304] 0 2024-09-17T07:19:49.135 INFO:tasks.workunit.client.1.smithi139.stdout:6/252: dread - db/df/d2a/f3a zero size 2024-09-17T07:19:49.135 INFO:tasks.workunit.client.0.smithi087.stdout:3/234: mkdir d6/d15/d4b 0 2024-09-17T07:19:49.135 INFO:tasks.workunit.client.1.smithi139.stdout:9/278: symlink dc/d11/d52/l57 0 2024-09-17T07:19:49.136 INFO:tasks.workunit.client.1.smithi139.stdout:6/253: read - db/d18/d1b/f50 zero size 2024-09-17T07:19:49.138 INFO:tasks.workunit.client.0.smithi087.stdout:8/241: mknod d1/d7/d9/d19/d1b/d18/c5c 0 2024-09-17T07:19:49.138 INFO:tasks.workunit.client.1.smithi139.stdout:2/209: write d0/dc/f13 [343847,28353] 0 2024-09-17T07:19:49.138 INFO:tasks.workunit.client.1.smithi139.stdout:6/254: creat db/d21/d46/f52 x:0 0 0 2024-09-17T07:19:49.139 INFO:tasks.workunit.client.0.smithi087.stdout:3/235: dread d6/d1b/d42/f3d [0,4194304] 0 2024-09-17T07:19:49.140 INFO:tasks.workunit.client.1.smithi139.stdout:7/162: truncate d5/d17/f20 2700737 0 2024-09-17T07:19:49.141 INFO:tasks.workunit.client.1.smithi139.stdout:6/255: read db/df/d2a/f2f [1889952,101532] 0 2024-09-17T07:19:49.143 INFO:tasks.workunit.client.1.smithi139.stdout:7/163: chown d5/d10/f29 473536077 1 2024-09-17T07:19:49.143 INFO:tasks.workunit.client.1.smithi139.stdout:9/279: dread fb [0,4194304] 0 2024-09-17T07:19:49.143 INFO:tasks.workunit.client.1.smithi139.stdout:6/256: dread - db/d18/d38/f43 zero size 2024-09-17T07:19:49.143 INFO:tasks.workunit.client.0.smithi087.stdout:8/242: truncate d1/d2b/d3b/d53/f5b 295664 0 2024-09-17T07:19:49.143 INFO:tasks.workunit.client.0.smithi087.stdout:8/243: fsync d1/d7/d9/d27/f45 0 2024-09-17T07:19:49.148 INFO:tasks.workunit.client.1.smithi139.stdout:7/164: mknod d5/d17/c35 0 2024-09-17T07:19:49.148 INFO:tasks.workunit.client.1.smithi139.stdout:2/210: dwrite d0/dc/f2f [0,4194304] 0 2024-09-17T07:19:49.150 INFO:tasks.workunit.client.0.smithi087.stdout:3/236: creat d6/d15/d4b/f4c x:0 0 0 2024-09-17T07:19:49.151 INFO:tasks.workunit.client.1.smithi139.stdout:6/257: dread db/df/f19 [0,4194304] 0 2024-09-17T07:19:49.152 INFO:tasks.workunit.client.1.smithi139.stdout:2/211: mknod d0/de/d25/d3f/c41 0 2024-09-17T07:19:49.153 INFO:tasks.workunit.client.1.smithi139.stdout:6/258: read db/d18/f44 [110945,3009] 0 2024-09-17T07:19:49.153 INFO:tasks.workunit.client.1.smithi139.stdout:9/280: rename dc/d11/l1d to dc/d11/l58 0 2024-09-17T07:19:49.154 INFO:tasks.workunit.client.0.smithi087.stdout:6/327: dread d1/d6/d1a/f28 [0,4194304] 0 2024-09-17T07:19:49.156 INFO:tasks.workunit.client.1.smithi139.stdout:6/259: creat db/d18/f53 x:0 0 0 2024-09-17T07:19:49.157 INFO:tasks.workunit.client.1.smithi139.stdout:7/165: dread d5/d17/f2a [0,4194304] 0 2024-09-17T07:19:49.157 INFO:tasks.workunit.client.1.smithi139.stdout:9/281: creat dc/d11/f59 x:0 0 0 2024-09-17T07:19:49.158 INFO:tasks.workunit.client.0.smithi087.stdout:6/328: write d1/d6/d1a/d2c/f2d [3845553,120653] 0 2024-09-17T07:19:49.159 INFO:tasks.workunit.client.1.smithi139.stdout:9/282: write dc/f3e [556346,34961] 0 2024-09-17T07:19:49.159 INFO:tasks.workunit.client.1.smithi139.stdout:6/260: unlink db/d18/f53 0 2024-09-17T07:19:49.159 INFO:tasks.workunit.client.0.smithi087.stdout:7/230: getdents d0/d3/d10/d31 0 2024-09-17T07:19:49.161 INFO:tasks.workunit.client.1.smithi139.stdout:2/212: dwrite d0/de/d11/d28/f2d [0,4194304] 0 2024-09-17T07:19:49.161 INFO:tasks.workunit.client.1.smithi139.stdout:7/166: symlink d5/d17/l36 0 2024-09-17T07:19:49.161 INFO:tasks.workunit.client.0.smithi087.stdout:6/329: write d1/d6/d1a/d4e/f50 [1025407,45153] 0 2024-09-17T07:19:49.164 INFO:tasks.workunit.client.0.smithi087.stdout:7/231: write d0/d3/f1f [2328698,102380] 0 2024-09-17T07:19:49.164 INFO:tasks.workunit.client.1.smithi139.stdout:7/167: chown d5/c30 2341547 1 2024-09-17T07:19:49.165 INFO:tasks.workunit.client.1.smithi139.stdout:9/283: symlink dc/d11/d15/d1e/l5a 0 2024-09-17T07:19:49.166 INFO:tasks.workunit.client.1.smithi139.stdout:2/213: creat d0/d3b/f42 x:0 0 0 2024-09-17T07:19:49.169 INFO:tasks.workunit.client.1.smithi139.stdout:6/261: dwrite db/df/d2a/f3a [0,4194304] 0 2024-09-17T07:19:49.170 INFO:tasks.workunit.client.1.smithi139.stdout:2/214: symlink d0/d7/d1a/l43 0 2024-09-17T07:19:49.171 INFO:tasks.workunit.client.1.smithi139.stdout:9/284: creat dc/f5b x:0 0 0 2024-09-17T07:19:49.172 INFO:tasks.workunit.client.0.smithi087.stdout:7/232: mknod d0/d36/c4a 0 2024-09-17T07:19:49.172 INFO:tasks.workunit.client.0.smithi087.stdout:8/244: dwrite d1/d2b/f41 [0,4194304] 0 2024-09-17T07:19:49.173 INFO:tasks.workunit.client.0.smithi087.stdout:6/330: truncate d1/d6/d1a/d2c/d40/f4d 1983437 0 2024-09-17T07:19:49.175 INFO:tasks.workunit.client.1.smithi139.stdout:6/262: rename db/df/d2a to db/d21/d46/d54 0 2024-09-17T07:19:49.176 INFO:tasks.workunit.client.0.smithi087.stdout:3/237: dwrite d6/f12 [0,4194304] 0 2024-09-17T07:19:49.177 INFO:tasks.workunit.client.1.smithi139.stdout:9/285: creat dc/d11/d15/f5c x:0 0 0 2024-09-17T07:19:49.178 INFO:tasks.workunit.client.0.smithi087.stdout:3/238: chown d6/d1b/f3b 2324 1 2024-09-17T07:19:49.178 INFO:tasks.workunit.client.0.smithi087.stdout:8/245: creat d1/d7/d9/d3c/f5d x:0 0 0 2024-09-17T07:19:49.180 INFO:tasks.workunit.client.0.smithi087.stdout:3/239: truncate d6/d16/f36 329129 0 2024-09-17T07:19:49.180 INFO:tasks.workunit.client.0.smithi087.stdout:6/331: symlink d1/d6/d1a/d2c/d48/d64/l6e 0 2024-09-17T07:19:49.181 INFO:tasks.workunit.client.1.smithi139.stdout:9/286: creat dc/d11/d15/d3c/f5d x:0 0 0 2024-09-17T07:19:49.182 INFO:tasks.workunit.client.0.smithi087.stdout:8/246: creat d1/d2b/d3b/d53/f5e x:0 0 0 2024-09-17T07:19:49.183 INFO:tasks.workunit.client.1.smithi139.stdout:6/263: link db/d18/f45 db/df/d4e/f55 0 2024-09-17T07:19:49.184 INFO:tasks.workunit.client.1.smithi139.stdout:9/287: creat dc/d2c/f5e x:0 0 0 2024-09-17T07:19:49.186 INFO:tasks.workunit.client.1.smithi139.stdout:6/264: write f2 [1618214,48060] 0 2024-09-17T07:19:49.188 INFO:tasks.workunit.client.1.smithi139.stdout:6/265: write db/d18/d1b/f50 [512265,2730] 0 2024-09-17T07:19:49.190 INFO:tasks.workunit.client.1.smithi139.stdout:6/266: write db/f3d [2428904,102557] 0 2024-09-17T07:19:49.191 INFO:tasks.workunit.client.0.smithi087.stdout:8/247: dwrite d1/d2b/d3b/d53/f5b [0,4194304] 0 2024-09-17T07:19:49.192 INFO:tasks.workunit.client.1.smithi139.stdout:2/215: readlink d0/d7/d1a/l43 0 2024-09-17T07:19:49.192 INFO:tasks.workunit.client.0.smithi087.stdout:8/248: chown d1/d7/le 1 1 2024-09-17T07:19:49.193 INFO:tasks.workunit.client.0.smithi087.stdout:6/332: dread d1/d6/d1a/f23 [0,4194304] 0 2024-09-17T07:19:49.195 INFO:tasks.workunit.client.0.smithi087.stdout:6/333: stat d1/d6/d1a/d2c/f37 0 2024-09-17T07:19:49.195 INFO:tasks.workunit.client.1.smithi139.stdout:6/267: mkdir db/d21/d46/d56 0 2024-09-17T07:19:49.196 INFO:tasks.workunit.client.0.smithi087.stdout:3/240: link d6/d15/c18 d6/c4d 0 2024-09-17T07:19:49.197 INFO:tasks.workunit.client.1.smithi139.stdout:9/288: rename dc/d11/d15/d1e/c4a to dc/d11/d52/d56/c5f 0 2024-09-17T07:19:49.199 INFO:tasks.workunit.client.1.smithi139.stdout:2/216: mknod d0/de/d11/c44 0 2024-09-17T07:19:49.201 INFO:tasks.workunit.client.1.smithi139.stdout:6/268: symlink db/d21/d46/d54/l57 0 2024-09-17T07:19:49.205 INFO:tasks.workunit.client.1.smithi139.stdout:9/289: creat dc/d11/d15/d1e/f60 x:0 0 0 2024-09-17T07:19:49.206 INFO:tasks.workunit.client.1.smithi139.stdout:6/269: truncate db/df/f13 632398 0 2024-09-17T07:19:49.206 INFO:tasks.workunit.client.0.smithi087.stdout:8/249: rename d1/d7/d9/d3c to d1/d5f 0 2024-09-17T07:19:49.207 INFO:tasks.workunit.client.1.smithi139.stdout:9/290: stat dc/d2a/l46 0 2024-09-17T07:19:49.207 INFO:tasks.workunit.client.1.smithi139.stdout:2/217: dwrite d0/dc/d15/f23 [0,4194304] 0 2024-09-17T07:19:49.207 INFO:tasks.workunit.client.1.smithi139.stdout:9/291: chown f4 48062 1 2024-09-17T07:19:49.209 INFO:tasks.workunit.client.1.smithi139.stdout:6/270: rename l9 to db/df/d4e/l58 0 2024-09-17T07:19:49.210 INFO:tasks.workunit.client.1.smithi139.stdout:2/218: mkdir d0/de/d11/d12/d45 0 2024-09-17T07:19:49.210 INFO:tasks.workunit.client.0.smithi087.stdout:8/250: truncate d1/d7/d9/d19/d1b/f43 35107 0 2024-09-17T07:19:49.210 INFO:tasks.workunit.client.1.smithi139.stdout:6/271: dread - db/d18/d38/f49 zero size 2024-09-17T07:19:49.211 INFO:tasks.workunit.client.1.smithi139.stdout:6/272: dread - db/d21/d46/f52 zero size 2024-09-17T07:19:49.218 INFO:tasks.workunit.client.1.smithi139.stdout:6/273: stat db/df/f13 0 2024-09-17T07:19:49.218 INFO:tasks.workunit.client.1.smithi139.stdout:2/219: link d0/de/d11/d32/l38 d0/de/d11/d32/l46 0 2024-09-17T07:19:49.219 INFO:tasks.workunit.client.0.smithi087.stdout:3/241: dwrite d6/fa [0,4194304] 0 2024-09-17T07:19:49.219 INFO:tasks.workunit.client.0.smithi087.stdout:3/242: truncate d6/fa 5027882 0 2024-09-17T07:19:49.219 INFO:tasks.workunit.client.1.smithi139.stdout:2/220: truncate d0/de/df/f39 27441 0 2024-09-17T07:19:49.220 INFO:tasks.workunit.client.0.smithi087.stdout:3/243: chown d6/d15/f19 105162 1 2024-09-17T07:19:49.220 INFO:tasks.workunit.client.0.smithi087.stdout:6/334: dread d1/d6/d1a/d2c/d40/f4d [0,4194304] 0 2024-09-17T07:19:49.222 INFO:tasks.workunit.client.0.smithi087.stdout:6/335: chown d1/f26 273 1 2024-09-17T07:19:49.224 INFO:tasks.workunit.client.0.smithi087.stdout:3/244: unlink d6/d1b/d42/f35 0 2024-09-17T07:19:49.226 INFO:tasks.workunit.client.0.smithi087.stdout:6/336: creat d1/d6/d1a/d2c/d48/f6f x:0 0 0 2024-09-17T07:19:49.228 INFO:tasks.workunit.client.0.smithi087.stdout:6/337: creat d1/d6/d1a/d2c/d40/f70 x:0 0 0 2024-09-17T07:19:49.230 INFO:tasks.workunit.client.0.smithi087.stdout:3/245: link d6/d15/d37/l40 d6/d15/d37/l4e 0 2024-09-17T07:19:49.234 INFO:tasks.workunit.client.1.smithi139.stdout:6/274: readlink db/df/d4e/l58 0 2024-09-17T07:19:49.234 INFO:tasks.workunit.client.0.smithi087.stdout:8/251: write d1/d7/f22 [302944,94599] 0 2024-09-17T07:19:49.234 INFO:tasks.workunit.client.1.smithi139.stdout:6/275: dread - db/d18/d38/f49 zero size 2024-09-17T07:19:49.235 INFO:tasks.workunit.client.0.smithi087.stdout:5/395: sync 2024-09-17T07:19:49.236 INFO:tasks.workunit.client.0.smithi087.stdout:1/265: sync 2024-09-17T07:19:49.236 INFO:tasks.workunit.client.0.smithi087.stdout:6/338: getdents d1/d6/d1a 0 2024-09-17T07:19:49.237 INFO:tasks.workunit.client.0.smithi087.stdout:3/246: dread d6/d16/f36 [0,4194304] 0 2024-09-17T07:19:49.237 INFO:tasks.workunit.client.0.smithi087.stdout:8/252: unlink d1/d7/d9/d27/c3e 0 2024-09-17T07:19:49.237 INFO:tasks.workunit.client.1.smithi139.stdout:6/276: symlink db/df/d4c/l59 0 2024-09-17T07:19:49.238 INFO:tasks.workunit.client.0.smithi087.stdout:5/396: mknod d5/d18/c84 0 2024-09-17T07:19:49.239 INFO:tasks.workunit.client.0.smithi087.stdout:8/253: fsync d1/d5f/f5d 0 2024-09-17T07:19:49.240 INFO:tasks.workunit.client.0.smithi087.stdout:8/254: readlink d1/d2b/l50 0 2024-09-17T07:19:49.240 INFO:tasks.workunit.client.0.smithi087.stdout:5/397: read d5/d8/f10 [1605911,67447] 0 2024-09-17T07:19:49.242 INFO:tasks.workunit.client.0.smithi087.stdout:5/398: readlink d5/d18/d20/d7a/l7c 0 2024-09-17T07:19:49.243 INFO:tasks.workunit.client.1.smithi139.stdout:6/277: getdents db/df/d4c 0 2024-09-17T07:19:49.244 INFO:tasks.workunit.client.0.smithi087.stdout:6/339: symlink d1/d6/d1a/d5e/l71 0 2024-09-17T07:19:49.245 INFO:tasks.workunit.client.0.smithi087.stdout:8/255: symlink d1/d7/l60 0 2024-09-17T07:19:49.246 INFO:tasks.workunit.client.0.smithi087.stdout:6/340: dread - d1/d6/d1a/d2c/d40/f56 zero size 2024-09-17T07:19:49.247 INFO:tasks.workunit.client.1.smithi139.stdout:6/278: dread db/d18/f4a [0,4194304] 0 2024-09-17T07:19:49.248 INFO:tasks.workunit.client.0.smithi087.stdout:3/247: dwrite d6/fd [0,4194304] 0 2024-09-17T07:19:49.248 INFO:tasks.workunit.client.1.smithi139.stdout:2/221: dwrite d0/de/d11/d28/f37 [0,4194304] 0 2024-09-17T07:19:49.249 INFO:tasks.workunit.client.1.smithi139.stdout:6/279: fsync db/d18/f1a 0 2024-09-17T07:19:49.250 INFO:tasks.workunit.client.1.smithi139.stdout:2/222: chown d0/de/f36 68741532 1 2024-09-17T07:19:49.251 INFO:tasks.workunit.client.1.smithi139.stdout:6/280: write db/d18/f39 [406356,17608] 0 2024-09-17T07:19:49.252 INFO:tasks.workunit.client.1.smithi139.stdout:6/281: chown db/df/c15 8403 1 2024-09-17T07:19:49.254 INFO:tasks.workunit.client.0.smithi087.stdout:6/341: dread d1/d6/d1a/d2c/f52 [0,4194304] 0 2024-09-17T07:19:49.257 INFO:tasks.workunit.client.1.smithi139.stdout:6/282: dread db/d18/f35 [0,4194304] 0 2024-09-17T07:19:49.258 INFO:tasks.workunit.client.0.smithi087.stdout:8/256: creat d1/d7/d9/f61 x:0 0 0 2024-09-17T07:19:49.259 INFO:tasks.workunit.client.1.smithi139.stdout:6/283: write db/d21/d46/d54/d40/f3c [971441,103780] 0 2024-09-17T07:19:49.261 INFO:tasks.workunit.client.1.smithi139.stdout:6/284: fdatasync db/d18/d38/f49 0 2024-09-17T07:19:49.262 INFO:tasks.workunit.client.0.smithi087.stdout:1/266: truncate d2/d3d/f21 2181549 0 2024-09-17T07:19:49.263 INFO:tasks.workunit.client.0.smithi087.stdout:1/267: fsync d2/d14/dd/d43/f4b 0 2024-09-17T07:19:49.265 INFO:tasks.workunit.client.0.smithi087.stdout:1/268: chown d2/d14/dd/d37/f38 0 1 2024-09-17T07:19:49.266 INFO:tasks.workunit.client.0.smithi087.stdout:6/342: link d1/d6/d1a/f23 d1/d6/d1a/d2c/d48/f72 0 2024-09-17T07:19:49.268 INFO:tasks.workunit.client.0.smithi087.stdout:5/399: dread d5/d18/d20/d2f/f48 [0,4194304] 0 2024-09-17T07:19:49.269 INFO:tasks.workunit.client.1.smithi139.stdout:2/223: fsync d0/de/df/f39 0 2024-09-17T07:19:49.270 INFO:tasks.workunit.client.0.smithi087.stdout:1/269: creat d2/d14/dd/d43/f66 x:0 0 0 2024-09-17T07:19:49.271 INFO:tasks.workunit.client.0.smithi087.stdout:3/248: link d6/d15/d37/l47 d6/l4f 0 2024-09-17T07:19:49.271 INFO:tasks.workunit.client.0.smithi087.stdout:1/270: write d2/f2d [701915,124360] 0 2024-09-17T07:19:49.271 INFO:tasks.workunit.client.1.smithi139.stdout:6/285: truncate f2 3514061 0 2024-09-17T07:19:49.273 INFO:tasks.workunit.client.1.smithi139.stdout:6/286: fsync db/d18/f35 0 2024-09-17T07:19:49.274 INFO:tasks.workunit.client.1.smithi139.stdout:2/224: getdents d0/dc/d3a 0 2024-09-17T07:19:49.274 INFO:tasks.workunit.client.1.smithi139.stdout:6/287: chown db/d21/f42 932986 1 2024-09-17T07:19:49.275 INFO:tasks.workunit.client.1.smithi139.stdout:2/225: write d0/d3b/f42 [134146,39333] 0 2024-09-17T07:19:49.276 INFO:tasks.workunit.client.1.smithi139.stdout:2/226: chown d0/de/d25/d3f 15 1 2024-09-17T07:19:49.279 INFO:tasks.workunit.client.0.smithi087.stdout:5/400: creat d5/d18/d6f/f85 x:0 0 0 2024-09-17T07:19:49.279 INFO:tasks.workunit.client.1.smithi139.stdout:6/288: creat db/d18/d1b/f5a x:0 0 0 2024-09-17T07:19:49.280 INFO:tasks.workunit.client.0.smithi087.stdout:5/401: fsync d5/d12/d1c/f65 0 2024-09-17T07:19:49.280 INFO:tasks.workunit.client.0.smithi087.stdout:1/271: rename d2/dc/f40 to d2/da/f67 0 2024-09-17T07:19:49.281 INFO:tasks.workunit.client.0.smithi087.stdout:6/343: dwrite d1/f18 [0,4194304] 0 2024-09-17T07:19:49.283 INFO:tasks.workunit.client.1.smithi139.stdout:2/227: dwrite d0/d7/f19 [0,4194304] 0 2024-09-17T07:19:49.283 INFO:tasks.workunit.client.0.smithi087.stdout:8/257: truncate d1/d7/f22 273846 0 2024-09-17T07:19:49.285 INFO:tasks.workunit.client.0.smithi087.stdout:1/272: symlink d2/d14/l68 0 2024-09-17T07:19:49.286 INFO:tasks.workunit.client.1.smithi139.stdout:6/289: dwrite db/f16 [0,4194304] 0 2024-09-17T07:19:49.289 INFO:tasks.workunit.client.0.smithi087.stdout:6/344: creat d1/d6/d1a/d5e/f73 x:0 0 0 2024-09-17T07:19:49.289 INFO:tasks.workunit.client.0.smithi087.stdout:3/249: symlink d6/d1b/d2b/l50 0 2024-09-17T07:19:49.291 INFO:tasks.workunit.client.0.smithi087.stdout:5/402: dwrite d5/d18/d20/fa [0,4194304] 0 2024-09-17T07:19:49.292 INFO:tasks.workunit.client.0.smithi087.stdout:3/250: dread - d6/d1b/d42/f44 zero size 2024-09-17T07:19:49.295 INFO:tasks.workunit.client.1.smithi139.stdout:2/228: dwrite d0/dc/f2f [0,4194304] 0 2024-09-17T07:19:49.298 INFO:tasks.workunit.client.0.smithi087.stdout:1/273: read d2/d1a/f1c [301861,70260] 0 2024-09-17T07:19:49.299 INFO:tasks.workunit.client.0.smithi087.stdout:6/345: creat d1/d6/d1a/d4e/f74 x:0 0 0 2024-09-17T07:19:49.302 INFO:tasks.workunit.client.1.smithi139.stdout:2/229: dread d0/de/d11/d28/f2d [0,4194304] 0 2024-09-17T07:19:49.302 INFO:tasks.workunit.client.0.smithi087.stdout:3/251: creat d6/d15/d37/d3c/f51 x:0 0 0 2024-09-17T07:19:49.304 INFO:tasks.workunit.client.1.smithi139.stdout:2/230: dread d0/d3b/f42 [0,4194304] 0 2024-09-17T07:19:49.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.304+0000 7f9675eee640 1 -- 172.21.15.87:0/1281840687 --> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9670104fa0 con 0x7f965806dbd0 2024-09-17T07:19:49.307 INFO:tasks.workunit.client.1.smithi139.stdout:2/231: rename d0/f5 to d0/de/d11/d12/f47 0 2024-09-17T07:19:49.308 INFO:tasks.workunit.client.1.smithi139.stdout:2/232: write d0/de/f14 [769275,16545] 0 2024-09-17T07:19:49.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.307+0000 7f9657fff640 1 -- 172.21.15.87:0/1281840687 <== mgr.24339 v2:172.21.15.139:6828/3218632563 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f9670104fa0 con 0x7f965806dbd0 2024-09-17T07:19:49.310 INFO:tasks.workunit.client.0.smithi087.stdout:1/274: mkdir d2/d69 0 2024-09-17T07:19:49.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.310+0000 7f9675eee640 1 -- 172.21.15.87:0/1281840687 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f965806dbd0 msgr2=0x7f9658070080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:19:49.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.310+0000 7f9675eee640 1 --2- 172.21.15.87:0/1281840687 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f965806dbd0 0x7f9658070080 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f967010efa0 tx=0x7f966400b040 comp rx=0 tx=0).stop 2024-09-17T07:19:49.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.310+0000 7f9675eee640 1 -- 172.21.15.87:0/1281840687 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9670065be0 msgr2=0x7f967010f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:19:49.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.310+0000 7f9675eee640 1 --2- 172.21.15.87:0/1281840687 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9670065be0 0x7f967010f1f0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f9660009ac0 tx=0x7f9660009da0 comp rx=0 tx=0).stop 2024-09-17T07:19:49.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.310+0000 7f9675eee640 1 -- 172.21.15.87:0/1281840687 shutdown_connections 2024-09-17T07:19:49.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.311+0000 7f9675eee640 1 --2- 172.21.15.87:0/1281840687 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f965806dbd0 0x7f9658070080 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:49.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.311+0000 7f9675eee640 1 --2- 172.21.15.87:0/1281840687 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f96700ff6e0 0x7f967010f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:49.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.311+0000 7f9675eee640 1 --2- 172.21.15.87:0/1281840687 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9670065be0 0x7f967010f1f0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:49.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.311+0000 7f9675eee640 1 -- 172.21.15.87:0/1281840687 >> 172.21.15.87:0/1281840687 conn(0x7f96700f6c10 msgr2=0x7f96700fb420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:19:49.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.311+0000 7f9675eee640 1 -- 172.21.15.87:0/1281840687 shutdown_connections 2024-09-17T07:19:49.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.311+0000 7f9675eee640 1 -- 172.21.15.87:0/1281840687 wait complete. 2024-09-17T07:19:49.313 INFO:tasks.workunit.client.0.smithi087.stdout:8/258: dread d1/d7/d9/fc [0,4194304] 0 2024-09-17T07:19:49.313 INFO:tasks.workunit.client.0.smithi087.stdout:1/275: mkdir d2/d3d/d35/d57/d6a 0 2024-09-17T07:19:49.315 INFO:tasks.workunit.client.1.smithi139.stdout:2/233: dwrite d0/d7/f19 [0,4194304] 0 2024-09-17T07:19:49.315 INFO:tasks.workunit.client.0.smithi087.stdout:6/346: rename d1/d6/d1a/d2c/d33/f6c to d1/d6/d1a/d2c/f75 0 2024-09-17T07:19:49.317 INFO:tasks.workunit.client.0.smithi087.stdout:1/276: creat d2/da/f6b x:0 0 0 2024-09-17T07:19:49.318 INFO:tasks.workunit.client.0.smithi087.stdout:6/347: symlink d1/d67/l76 0 2024-09-17T07:19:49.320 INFO:tasks.workunit.client.0.smithi087.stdout:1/277: truncate d2/da/f2b 4505743 0 2024-09-17T07:19:49.321 INFO:tasks.workunit.client.0.smithi087.stdout:8/259: dwrite d1/d7/f13 [0,4194304] 0 2024-09-17T07:19:49.323 INFO:tasks.workunit.client.0.smithi087.stdout:6/348: mkdir d1/d6/d1a/d2c/d40/d4c/d77 0 2024-09-17T07:19:49.323 INFO:tasks.workunit.client.1.smithi139.stdout:2/234: dwrite d0/d3b/f42 [0,4194304] 0 2024-09-17T07:19:49.323 INFO:tasks.workunit.client.0.smithi087.stdout:8/260: chown d1/d7/d9/d19/d1b/d18/c59 213 1 2024-09-17T07:19:49.326 INFO:tasks.workunit.client.1.smithi139.stdout:2/235: fsync d0/d7/d1a/f1e 0 2024-09-17T07:19:49.327 INFO:tasks.workunit.client.0.smithi087.stdout:8/261: creat d1/d2b/d3b/f62 x:0 0 0 2024-09-17T07:19:49.328 INFO:tasks.workunit.client.0.smithi087.stdout:1/278: link d2/d14/l46 d2/d3d/d35/d57/d6a/l6c 0 2024-09-17T07:19:49.330 INFO:tasks.workunit.client.0.smithi087.stdout:6/349: creat d1/f78 x:0 0 0 2024-09-17T07:19:49.338 INFO:tasks.workunit.client.0.smithi087.stdout:6/350: creat d1/f79 x:0 0 0 2024-09-17T07:19:49.338 INFO:tasks.workunit.client.0.smithi087.stdout:1/279: dwrite d2/d14/dd/d37/f52 [0,4194304] 0 2024-09-17T07:19:49.339 INFO:tasks.workunit.client.0.smithi087.stdout:5/403: dread d5/d18/f38 [0,4194304] 0 2024-09-17T07:19:49.345 INFO:tasks.workunit.client.0.smithi087.stdout:5/404: creat d5/d18/d6a/f86 x:0 0 0 2024-09-17T07:19:49.345 INFO:tasks.workunit.client.0.smithi087.stdout:1/280: dread d2/d14/dd/f47 [0,4194304] 0 2024-09-17T07:19:49.345 INFO:tasks.workunit.client.1.smithi139.stdout:6/290: dwrite db/df/d4e/f55 [0,4194304] 0 2024-09-17T07:19:49.346 INFO:tasks.workunit.client.0.smithi087.stdout:5/405: read - d5/d12/d14/f7b zero size 2024-09-17T07:19:49.353 INFO:tasks.workunit.client.0.smithi087.stdout:1/281: link d2/da/l1e d2/l6d 0 2024-09-17T07:19:49.355 INFO:tasks.workunit.client.0.smithi087.stdout:1/282: symlink d2/d3d/l6e 0 2024-09-17T07:19:49.356 INFO:tasks.workunit.client.0.smithi087.stdout:1/283: mkdir d2/d48/d6f 0 2024-09-17T07:19:49.357 INFO:tasks.workunit.client.0.smithi087.stdout:1/284: readlink d2/d14/l68 0 2024-09-17T07:19:49.357 INFO:tasks.workunit.client.0.smithi087.stdout:1/285: write d2/d48/f5e [796479,64194] 0 2024-09-17T07:19:49.367 INFO:tasks.workunit.client.1.smithi139.stdout:6/291: truncate db/d18/d1b/f37 3323511 0 2024-09-17T07:19:49.368 INFO:tasks.workunit.client.0.smithi087.stdout:5/406: write d5/f19 [1772731,43779] 0 2024-09-17T07:19:49.369 INFO:tasks.workunit.client.1.smithi139.stdout:6/292: write db/df/f19 [1002479,52219] 0 2024-09-17T07:19:49.370 INFO:tasks.workunit.client.1.smithi139.stdout:6/293: write db/d18/d1b/f1d [4075906,93455] 0 2024-09-17T07:19:49.370 INFO:tasks.workunit.client.1.smithi139.stdout:6/294: stat db/df/c1f 0 2024-09-17T07:19:49.371 INFO:tasks.workunit.client.0.smithi087.stdout:5/407: mkdir d5/d12/d56/d5b/d87 0 2024-09-17T07:19:49.372 INFO:tasks.workunit.client.0.smithi087.stdout:5/408: stat d5/d18/d6a/f86 0 2024-09-17T07:19:49.373 INFO:tasks.workunit.client.0.smithi087.stdout:1/286: write d2/da/f16 [157213,37879] 0 2024-09-17T07:19:49.373 INFO:tasks.workunit.client.0.smithi087.stdout:5/409: dread - d5/d12/f62 zero size 2024-09-17T07:19:49.375 INFO:tasks.workunit.client.0.smithi087.stdout:6/351: dread d1/d6/d1a/d2c/f32 [0,4194304] 0 2024-09-17T07:19:49.377 INFO:tasks.workunit.client.0.smithi087.stdout:5/410: unlink d5/d12/d1c/f6c 0 2024-09-17T07:19:49.378 INFO:tasks.workunit.client.0.smithi087.stdout:1/287: creat d2/d69/f70 x:0 0 0 2024-09-17T07:19:49.378 INFO:tasks.workunit.client.0.smithi087.stdout:1/288: dread - d2/d14/dd/d43/f66 zero size 2024-09-17T07:19:49.379 INFO:tasks.workunit.client.0.smithi087.stdout:6/352: symlink d1/d6/d1a/d5e/l7a 0 2024-09-17T07:19:49.379 INFO:tasks.workunit.client.0.smithi087.stdout:5/411: readlink d5/d8/l23 0 2024-09-17T07:19:49.380 INFO:tasks.workunit.client.0.smithi087.stdout:5/412: stat d5/d12/l70 0 2024-09-17T07:19:49.380 INFO:tasks.workunit.client.0.smithi087.stdout:1/289: stat d2/dc/c19 0 2024-09-17T07:19:49.380 INFO:tasks.workunit.client.0.smithi087.stdout:6/353: dread - d1/d6/d1a/d4e/f63 zero size 2024-09-17T07:19:49.386 INFO:tasks.workunit.client.0.smithi087.stdout:6/354: link d1/d6/f1f d1/d6/d1a/d5e/f7b 0 2024-09-17T07:19:49.387 INFO:tasks.workunit.client.0.smithi087.stdout:1/290: dread d2/d3d/f2f [0,4194304] 0 2024-09-17T07:19:49.389 INFO:tasks.workunit.client.0.smithi087.stdout:5/413: dwrite d5/d12/d4d/f47 [0,4194304] 0 2024-09-17T07:19:49.390 INFO:tasks.workunit.client.0.smithi087.stdout:5/414: chown d5/d12/d1c/l7e 2879622 1 2024-09-17T07:19:49.391 INFO:tasks.workunit.client.0.smithi087.stdout:5/415: dread - d5/d18/d6f/f85 zero size 2024-09-17T07:19:49.395 INFO:tasks.workunit.client.0.smithi087.stdout:6/355: symlink d1/d6/d1a/d2c/d40/d4c/d77/l7c 0 2024-09-17T07:19:49.397 INFO:tasks.workunit.client.0.smithi087.stdout:5/416: creat d5/d12/f88 x:0 0 0 2024-09-17T07:19:49.400 INFO:tasks.workunit.client.0.smithi087.stdout:5/417: mknod d5/d12/d56/d5b/c89 0 2024-09-17T07:19:49.401 INFO:tasks.workunit.client.0.smithi087.stdout:6/356: rename d1/d6/d1a/d2c/d40/f70 to d1/d6/f7d 0 2024-09-17T07:19:49.402 INFO:tasks.workunit.client.0.smithi087.stdout:1/291: dwrite d2/d1a/f1c [0,4194304] 0 2024-09-17T07:19:49.403 INFO:tasks.workunit.client.0.smithi087.stdout:6/357: chown d1/d6/d1a/d4e/f5d 96417052 1 2024-09-17T07:19:49.404 INFO:tasks.workunit.client.0.smithi087.stdout:5/418: symlink d5/d12/d14/d61/l8a 0 2024-09-17T07:19:49.406 INFO:tasks.workunit.client.0.smithi087.stdout:1/292: creat d2/d14/dd/d43/d5d/f71 x:0 0 0 2024-09-17T07:19:49.407 INFO:tasks.workunit.client.0.smithi087.stdout:1/293: chown d2/da/f4d 1096 1 2024-09-17T07:19:49.409 INFO:tasks.workunit.client.0.smithi087.stdout:1/294: creat d2/d3d/d45/f72 x:0 0 0 2024-09-17T07:19:49.411 INFO:tasks.workunit.client.0.smithi087.stdout:5/419: creat d5/d12/f8b x:0 0 0 2024-09-17T07:19:49.416 INFO:tasks.workunit.client.0.smithi087.stdout:5/420: unlink d5/d18/d20/d2f/l6b 0 2024-09-17T07:19:49.416 INFO:tasks.workunit.client.0.smithi087.stdout:1/295: dwrite d2/d1a/f3e [0,4194304] 0 2024-09-17T07:19:49.418 INFO:tasks.workunit.client.0.smithi087.stdout:5/421: mkdir d5/d12/d4d/d8c 0 2024-09-17T07:19:49.420 INFO:tasks.workunit.client.0.smithi087.stdout:1/296: mkdir d2/d3d/d35/d57/d73 0 2024-09-17T07:19:49.425 INFO:tasks.workunit.client.0.smithi087.stdout:1/297: rmdir d2/d1a 39 2024-09-17T07:19:49.425 INFO:tasks.workunit.client.0.smithi087.stdout:1/298: chown d2/d3d 2542011 1 2024-09-17T07:19:49.426 INFO:tasks.workunit.client.0.smithi087.stdout:5/422: dwrite d5/d18/d20/fa [0,4194304] 0 2024-09-17T07:19:49.432 INFO:tasks.workunit.client.0.smithi087.stdout:5/423: dread d5/d18/d20/d2f/f57 [0,4194304] 0 2024-09-17T07:19:49.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.436+0000 7f64f6b67640 1 -- 172.21.15.87:0/1724069035 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f64f00fc700 msgr2=0x7f64f00fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:19:49.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.436+0000 7f64f6b67640 1 --2- 172.21.15.87:0/1724069035 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f64f00fc700 0x7f64f00fcb70 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f64dc0048d0 tx=0x7f64dc009da0 comp rx=0 tx=0).stop 2024-09-17T07:19:49.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.436+0000 7f64f6b67640 1 -- 172.21.15.87:0/1724069035 shutdown_connections 2024-09-17T07:19:49.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.436+0000 7f64f6b67640 1 --2- 172.21.15.87:0/1724069035 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f64f00fc700 0x7f64f00fcb70 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:49.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.436+0000 7f64f6b67640 1 --2- 172.21.15.87:0/1724069035 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f64f00fb430 0x7f64f00fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:49.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.436+0000 7f64f6b67640 1 -- 172.21.15.87:0/1724069035 >> 172.21.15.87:0/1724069035 conn(0x7f64f00f6c10 msgr2=0x7f64f00f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:19:49.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.436+0000 7f64f6b67640 1 -- 172.21.15.87:0/1724069035 shutdown_connections 2024-09-17T07:19:49.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.436+0000 7f64f6b67640 1 -- 172.21.15.87:0/1724069035 wait complete. 2024-09-17T07:19:49.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.437+0000 7f64f6b67640 1 Processor -- start 2024-09-17T07:19:49.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.437+0000 7f64f6b67640 1 -- start start 2024-09-17T07:19:49.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.438+0000 7f64f6b67640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f64f00fb430 0x7f64f010fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:19:49.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.438+0000 7f64f6b67640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f64f00fc700 0x7f64f0112250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:19:49.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.438+0000 7f64f6b67640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64f0065c30 con 0x7f64f00fb430 2024-09-17T07:19:49.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.438+0000 7f64f6b67640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64f0065da0 con 0x7f64f00fc700 2024-09-17T07:19:49.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.438+0000 7f64f4903640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f64f00fb430 0x7f64f010fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:19:49.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.438+0000 7f64f4903640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f64f00fb430 0x7f64f010fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37072/0 (socket says 172.21.15.87:37072) 2024-09-17T07:19:49.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.438+0000 7f64f4903640 1 -- 172.21.15.87:0/785971451 learned_addr learned my addr 172.21.15.87:0/785971451 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:19:49.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.438+0000 7f64effff640 1 --2- 172.21.15.87:0/785971451 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f64f00fc700 0x7f64f0112250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:19:49.440 INFO:tasks.workunit.client.0.smithi087.stdout:5/424: dwrite d5/d18/d20/d2f/d52/f72 [0,4194304] 0 2024-09-17T07:19:49.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.438+0000 7f64f4903640 1 -- 172.21.15.87:0/785971451 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f64f00fc700 msgr2=0x7f64f0112250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:19:49.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.438+0000 7f64f4903640 1 --2- 172.21.15.87:0/785971451 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f64f00fc700 0x7f64f0112250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:49.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.438+0000 7f64f4903640 1 -- 172.21.15.87:0/785971451 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64dc005040 con 0x7f64f00fb430 2024-09-17T07:19:49.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.438+0000 7f64f4903640 1 --2- 172.21.15.87:0/785971451 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f64f00fb430 0x7f64f010fd00 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f64e4002a80 tx=0x7f64e4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:19:49.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.439+0000 7f64ed7fa640 1 -- 172.21.15.87:0/785971451 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f64e4007c30 con 0x7f64f00fb430 2024-09-17T07:19:49.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.439+0000 7f64f6b67640 1 -- 172.21.15.87:0/785971451 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64f0112790 con 0x7f64f00fb430 2024-09-17T07:19:49.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.439+0000 7f64ed7fa640 1 -- 172.21.15.87:0/785971451 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f64e400f040 con 0x7f64f00fb430 2024-09-17T07:19:49.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.439+0000 7f64ed7fa640 1 -- 172.21.15.87:0/785971451 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f64e40094b0 con 0x7f64f00fb430 2024-09-17T07:19:49.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.439+0000 7f64f6b67640 1 -- 172.21.15.87:0/785971451 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64f0112cb0 con 0x7f64f00fb430 2024-09-17T07:19:49.442 INFO:tasks.workunit.client.1.smithi139.stdout:6/295: dwrite db/d21/f31 [0,4194304] 0 2024-09-17T07:19:49.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.441+0000 7f64f6b67640 1 -- 172.21.15.87:0/785971451 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64f004b720 con 0x7f64f00fb430 2024-09-17T07:19:49.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.442+0000 7f64ed7fa640 1 -- 172.21.15.87:0/785971451 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 24) v1 ==== 90881+0+0 (secure 0 0 0) 0x7f64e4009630 con 0x7f64f00fb430 2024-09-17T07:19:49.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.442+0000 7f64ed7fa640 1 --2- 172.21.15.87:0/785971451 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f64e006dbd0 0x7f64e0070080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:19:49.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.442+0000 7f64ed7fa640 1 -- 172.21.15.87:0/785971451 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f64e408ca00 con 0x7f64f00fb430 2024-09-17T07:19:49.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.443+0000 7f64effff640 1 --2- 172.21.15.87:0/785971451 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f64e006dbd0 0x7f64e0070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:19:49.445 INFO:tasks.workunit.client.1.smithi139.stdout:6/296: mkdir db/d18/d5b 0 2024-09-17T07:19:49.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.444+0000 7f64effff640 1 --2- 172.21.15.87:0/785971451 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f64e006dbd0 0x7f64e0070080 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f64dc000c00 tx=0x7f64dc035040 comp rx=0 tx=0).ready entity=mgr.24339 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:19:49.448 INFO:tasks.workunit.client.1.smithi139.stdout:6/297: symlink db/d21/d46/d54/l5c 0 2024-09-17T07:19:49.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.447+0000 7f64ed7fa640 1 -- 172.21.15.87:0/785971451 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182127 (secure 0 0 0) 0x7f64e404e780 con 0x7f64f00fb430 2024-09-17T07:19:49.449 INFO:tasks.workunit.client.0.smithi087.stdout:5/425: dwrite d5/d12/d14/f7b [0,4194304] 0 2024-09-17T07:19:49.450 INFO:tasks.workunit.client.1.smithi139.stdout:6/298: symlink db/d18/d5b/l5d 0 2024-09-17T07:19:49.451 INFO:tasks.workunit.client.0.smithi087.stdout:5/426: write d5/d18/d6a/f86 [505179,110516] 0 2024-09-17T07:19:49.451 INFO:tasks.workunit.client.1.smithi139.stdout:6/299: read db/d18/f39 [955520,78956] 0 2024-09-17T07:19:49.452 INFO:tasks.workunit.client.1.smithi139.stdout:6/300: stat db/d21/d46/d54 0 2024-09-17T07:19:49.454 INFO:tasks.workunit.client.1.smithi139.stdout:6/301: mkdir db/df/d4e/d5e 0 2024-09-17T07:19:49.454 INFO:tasks.workunit.client.1.smithi139.stdout:6/302: fsync db/f16 0 2024-09-17T07:19:49.455 INFO:tasks.workunit.client.1.smithi139.stdout:6/303: stat db/df/d4e/f55 0 2024-09-17T07:19:49.456 INFO:tasks.workunit.client.1.smithi139.stdout:6/304: symlink db/d18/l5f 0 2024-09-17T07:19:49.458 INFO:tasks.workunit.client.1.smithi139.stdout:6/305: mkdir db/d18/d38/d60 0 2024-09-17T07:19:49.473 INFO:tasks.workunit.client.1.smithi139.stdout:6/306: truncate db/d18/d1b/f37 2340755 0 2024-09-17T07:19:49.479 INFO:tasks.workunit.client.0.smithi087.stdout:5/427: dread d5/d18/f4a [0,4194304] 0 2024-09-17T07:19:49.485 INFO:tasks.workunit.client.0.smithi087.stdout:5/428: dwrite d5/d18/d20/fa [0,4194304] 0 2024-09-17T07:19:49.519 INFO:tasks.workunit.client.0.smithi087.stdout:9/210: sync 2024-09-17T07:19:49.519 INFO:tasks.workunit.client.0.smithi087.stdout:4/273: sync 2024-09-17T07:19:49.519 INFO:tasks.workunit.client.0.smithi087.stdout:9/211: chown d3/d4/d2f 13718261 1 2024-09-17T07:19:49.521 INFO:tasks.workunit.client.0.smithi087.stdout:4/274: rename d2/d22/d2c/d3f/d4d to d2/d22/d2c/d3f/d4d/d21/d2f/d63 22 2024-09-17T07:19:49.524 INFO:tasks.workunit.client.0.smithi087.stdout:4/275: creat d2/d22/d2c/d3f/d4d/f64 x:0 0 0 2024-09-17T07:19:49.530 INFO:tasks.workunit.client.0.smithi087.stdout:4/276: dwrite d2/d22/d2c/d3f/d4d/d21/f24 [0,4194304] 0 2024-09-17T07:19:49.537 INFO:tasks.workunit.client.0.smithi087.stdout:4/277: read d2/d5/d1f/f20 [227939,130014] 0 2024-09-17T07:19:49.542 INFO:tasks.workunit.client.0.smithi087.stdout:4/278: rename d2/d5/f10 to d2/d22/d2c/d3f/f65 0 2024-09-17T07:19:49.547 INFO:tasks.workunit.client.0.smithi087.stdout:4/279: dwrite f0 [4194304,4194304] 0 2024-09-17T07:19:49.552 INFO:tasks.workunit.client.0.smithi087.stdout:4/280: link d2/l57 d2/d22/d2c/d3f/d4d/d3e/l66 0 2024-09-17T07:19:49.554 INFO:tasks.workunit.client.0.smithi087.stdout:4/281: mknod d2/d22/c67 0 2024-09-17T07:19:49.559 INFO:tasks.workunit.client.0.smithi087.stdout:4/282: dwrite d2/d5/f26 [0,4194304] 0 2024-09-17T07:19:49.560 INFO:tasks.workunit.client.0.smithi087.stdout:4/283: write d2/f45 [346079,101546] 0 2024-09-17T07:19:49.591 INFO:tasks.workunit.client.0.smithi087.stdout:2/312: sync 2024-09-17T07:19:49.592 INFO:tasks.workunit.client.0.smithi087.stdout:2/313: write d2/d7/dd/f43 [2305034,72316] 0 2024-09-17T07:19:49.592 INFO:tasks.workunit.client.0.smithi087.stdout:2/314: chown d2/d12/c17 62 1 2024-09-17T07:19:49.593 INFO:tasks.workunit.client.0.smithi087.stdout:2/315: chown d2/d15/f45 185952 1 2024-09-17T07:19:49.593 INFO:tasks.workunit.client.0.smithi087.stdout:2/316: chown d2/d7/dd/d10/f1e 19 1 2024-09-17T07:19:49.595 INFO:tasks.workunit.client.0.smithi087.stdout:2/317: fdatasync d2/d7/dd/d10/f1d 0 2024-09-17T07:19:49.598 INFO:tasks.workunit.client.0.smithi087.stdout:2/318: dread d2/d24/d36/f38 [0,4194304] 0 2024-09-17T07:19:49.599 INFO:tasks.workunit.client.0.smithi087.stdout:2/319: stat d2/d7/d30/f4e 0 2024-09-17T07:19:49.600 INFO:tasks.workunit.client.0.smithi087.stdout:2/320: truncate d2/d12/f2a 134125 0 2024-09-17T07:19:49.607 INFO:tasks.workunit.client.0.smithi087.stdout:2/321: dwrite d2/d48/f59 [0,4194304] 0 2024-09-17T07:19:49.610 INFO:tasks.workunit.client.0.smithi087.stdout:2/322: mkdir d2/d7/d60 0 2024-09-17T07:19:49.611 INFO:tasks.workunit.client.0.smithi087.stdout:2/323: dread d2/d12/f2a [0,4194304] 0 2024-09-17T07:19:49.613 INFO:tasks.workunit.client.0.smithi087.stdout:2/324: creat d2/d50/f61 x:0 0 0 2024-09-17T07:19:49.615 INFO:tasks.workunit.client.0.smithi087.stdout:2/325: rename d2/d7/d30/f42 to d2/d15/d34/f62 0 2024-09-17T07:19:49.616 INFO:tasks.workunit.client.0.smithi087.stdout:2/326: stat d2/d15/d34 0 2024-09-17T07:19:49.617 INFO:tasks.workunit.client.0.smithi087.stdout:2/327: symlink d2/d15/l63 0 2024-09-17T07:19:49.619 INFO:tasks.workunit.client.0.smithi087.stdout:2/328: fsync d2/d24/d36/f38 0 2024-09-17T07:19:49.621 INFO:tasks.workunit.client.0.smithi087.stdout:2/329: getdents d2/d24/d36 0 2024-09-17T07:19:49.634 INFO:tasks.workunit.client.1.smithi139.stdout:5/102: sync 2024-09-17T07:19:49.636 INFO:tasks.workunit.client.1.smithi139.stdout:5/103: stat d4/d16/d1b/l1c 0 2024-09-17T07:19:49.636 INFO:tasks.workunit.client.1.smithi139.stdout:5/104: read d4/fd [2279344,42077] 0 2024-09-17T07:19:49.638 INFO:tasks.workunit.client.1.smithi139.stdout:5/105: symlink d4/l21 0 2024-09-17T07:19:49.639 INFO:tasks.workunit.client.1.smithi139.stdout:5/106: dread d4/d16/f19 [0,4194304] 0 2024-09-17T07:19:49.643 INFO:tasks.workunit.client.1.smithi139.stdout:5/107: dwrite d4/f17 [0,4194304] 0 2024-09-17T07:19:49.644 INFO:tasks.workunit.client.1.smithi139.stdout:5/108: readlink d4/d16/d1b/l1c 0 2024-09-17T07:19:49.646 INFO:tasks.workunit.client.1.smithi139.stdout:5/109: creat d4/d16/f22 x:0 0 0 2024-09-17T07:19:49.649 INFO:tasks.workunit.client.1.smithi139.stdout:5/110: truncate d4/d16/f19 1563571 0 2024-09-17T07:19:49.652 INFO:tasks.workunit.client.1.smithi139.stdout:5/111: mknod d4/d16/d1b/d20/c23 0 2024-09-17T07:19:49.656 INFO:tasks.workunit.client.1.smithi139.stdout:5/112: dread d4/d16/f18 [0,4194304] 0 2024-09-17T07:19:49.665 INFO:tasks.workunit.client.0.smithi087.stdout:2/330: creat d2/d24/f64 x:0 0 0 2024-09-17T07:19:49.665 INFO:tasks.workunit.client.0.smithi087.stdout:2/331: chown d2/d7/dd 13 1 2024-09-17T07:19:49.667 INFO:tasks.workunit.client.0.smithi087.stdout:2/332: truncate d2/d15/f2c 882482 0 2024-09-17T07:19:49.668 INFO:tasks.workunit.client.1.smithi139.stdout:5/113: dwrite d4/f6 [0,4194304] 0 2024-09-17T07:19:49.673 INFO:tasks.workunit.client.1.smithi139.stdout:5/114: dread d4/f17 [0,4194304] 0 2024-09-17T07:19:49.675 INFO:tasks.workunit.client.1.smithi139.stdout:5/115: creat d4/d16/d1b/d20/f24 x:0 0 0 2024-09-17T07:19:49.677 INFO:tasks.workunit.client.1.smithi139.stdout:5/116: creat d4/d16/d1b/f25 x:0 0 0 2024-09-17T07:19:49.678 INFO:tasks.workunit.client.1.smithi139.stdout:5/117: unlink f3 0 2024-09-17T07:19:49.679 INFO:tasks.workunit.client.1.smithi139.stdout:5/118: creat d4/de/f26 x:0 0 0 2024-09-17T07:19:49.684 INFO:tasks.workunit.client.1.smithi139.stdout:5/119: truncate d4/f6 176607 0 2024-09-17T07:19:49.684 INFO:tasks.workunit.client.1.smithi139.stdout:5/120: fdatasync d4/d16/d1b/d20/f24 0 2024-09-17T07:19:49.687 INFO:tasks.workunit.client.1.smithi139.stdout:5/121: dread d4/f17 [0,4194304] 0 2024-09-17T07:19:49.688 INFO:tasks.workunit.client.1.smithi139.stdout:4/216: sync 2024-09-17T07:19:49.688 INFO:tasks.workunit.client.1.smithi139.stdout:4/217: chown d0/db/f33 9 1 2024-09-17T07:19:49.690 INFO:tasks.workunit.client.1.smithi139.stdout:5/122: link d4/lf d4/d16/d1b/d20/l27 0 2024-09-17T07:19:49.691 INFO:tasks.workunit.client.1.smithi139.stdout:4/218: mkdir d0/d37/d3d 0 2024-09-17T07:19:49.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.690+0000 7f64f6b67640 1 -- 172.21.15.87:0/785971451 --> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f64f0105e90 con 0x7f64e006dbd0 2024-09-17T07:19:49.692 INFO:tasks.workunit.client.1.smithi139.stdout:5/123: chown d4/de/l13 87789 1 2024-09-17T07:19:49.693 INFO:tasks.workunit.client.1.smithi139.stdout:5/124: chown d4/la 44858 1 2024-09-17T07:19:49.694 INFO:tasks.workunit.client.1.smithi139.stdout:5/125: dread - d4/de/f26 zero size 2024-09-17T07:19:49.696 INFO:tasks.workunit.client.1.smithi139.stdout:5/126: dread - d4/d16/d1b/f25 zero size 2024-09-17T07:19:49.698 INFO:tasks.workunit.client.1.smithi139.stdout:4/219: dwrite d0/d10/d39/f3a [0,4194304] 0 2024-09-17T07:19:49.702 INFO:tasks.workunit.client.1.smithi139.stdout:4/220: creat d0/d1a/f3e x:0 0 0 2024-09-17T07:19:49.704 INFO:tasks.workunit.client.1.smithi139.stdout:5/127: write d4/d16/f19 [1055150,64690] 0 2024-09-17T07:19:49.706 INFO:tasks.workunit.client.1.smithi139.stdout:4/221: rmdir d0/d37/d3d 0 2024-09-17T07:19:49.707 INFO:tasks.workunit.client.1.smithi139.stdout:4/222: chown d0/db/d17 3310 1 2024-09-17T07:19:49.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.707+0000 7f64ed7fa640 1 -- 172.21.15.87:0/785971451 <== mgr.24339 v2:172.21.15.139:6828/3218632563 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f64f0105e90 con 0x7f64e006dbd0 2024-09-17T07:19:49.708 INFO:teuthology.orchestra.run.smithi087.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T07:19:49.708 INFO:teuthology.orchestra.run.smithi087.stdout:alertmanager.smithi087 smithi087 *:9093,9094 running (6m) 2m ago 7m 25.5M - 0.25.0 c8568f914cd2 3495eb97bded 2024-09-17T07:19:49.708 INFO:teuthology.orchestra.run.smithi087.stdout:crash.smithi087 smithi087 running (8m) 2m ago 8m 6891k - 17.2.7-1635-g4a704134 f22ead590bad d9aaf9839ada 2024-09-17T07:19:49.708 INFO:teuthology.orchestra.run.smithi087.stdout:crash.smithi139 smithi139 running (7m) 24s ago 7m 6895k - 17.2.7-1635-g4a704134 f22ead590bad 354c853b318f 2024-09-17T07:19:49.708 INFO:teuthology.orchestra.run.smithi087.stdout:grafana.smithi087 smithi087 *:3000 running (6m) 2m ago 7m 87.3M - 9.4.7 954c08fa6188 738589686a89 2024-09-17T07:19:49.708 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi087.tjhpcs smithi087 running (2m) 2m ago 2m 15.5M - 17.2.7-1635-g4a704134 f22ead590bad f7142ad971ed 2024-09-17T07:19:49.708 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi087.vvbzss smithi087 running (2m) 2m ago 2m 11.6M - 17.2.7-1635-g4a704134 f22ead590bad 2dd82ff293d1 2024-09-17T07:19:49.709 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi139.ftvinf smithi139 running (2m) 24s ago 2m 22.0M - 17.2.7-1635-g4a704134 f22ead590bad d11edb295ad3 2024-09-17T07:19:49.709 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi139.gnwonz smithi139 running (2m) 24s ago 2m 28.7M - 17.2.7-1635-g4a704134 f22ead590bad 3b3d884aef02 2024-09-17T07:19:49.709 INFO:teuthology.orchestra.run.smithi087.stdout:mgr.smithi087.vuvjer smithi087 *:9283,8765,8443 running (9m) 2m ago 9m 449M - 17.2.7-1635-g4a704134 f22ead590bad 11130bf9b46c 2024-09-17T07:19:49.709 INFO:teuthology.orchestra.run.smithi087.stdout:mgr.smithi139.tuqnpn smithi139 *:8443,9283 running (41s) 24s ago 6m 66.1M - 18.2.4-855-g19e2a2be 980a0bfcd684 ea12b2e696b5 2024-09-17T07:19:49.709 INFO:teuthology.orchestra.run.smithi087.stdout:mon.smithi087 smithi087 running (9m) 2m ago 9m 49.9M 2048M 17.2.7-1635-g4a704134 f22ead590bad 175785e1fb86 2024-09-17T07:19:49.709 INFO:teuthology.orchestra.run.smithi087.stdout:mon.smithi139 smithi139 running (6m) 24s ago 6m 37.6M 2048M 17.2.7-1635-g4a704134 f22ead590bad a9a2552dc411 2024-09-17T07:19:49.709 INFO:teuthology.orchestra.run.smithi087.stdout:node-exporter.smithi087 smithi087 *:9100 running (7m) 2m ago 7m 14.4M - 1.5.0 0da6a335fe13 3e2035b992bc 2024-09-17T07:19:49.709 INFO:teuthology.orchestra.run.smithi087.stdout:node-exporter.smithi139 smithi139 *:9100 running (6m) 24s ago 6m 15.3M - 1.5.0 0da6a335fe13 291c1abbb415 2024-09-17T07:19:49.709 INFO:teuthology.orchestra.run.smithi087.stdout:osd.0 smithi087 running (6m) 2m ago 6m 45.2M 4288M 17.2.7-1635-g4a704134 f22ead590bad 396801f9b539 2024-09-17T07:19:49.709 INFO:teuthology.orchestra.run.smithi087.stdout:osd.1 smithi087 running (5m) 2m ago 5m 45.5M 4288M 17.2.7-1635-g4a704134 f22ead590bad 9446985bfcd1 2024-09-17T07:19:49.709 INFO:teuthology.orchestra.run.smithi087.stdout:osd.2 smithi087 running (5m) 2m ago 5m 44.9M 4288M 17.2.7-1635-g4a704134 f22ead590bad 8fe1428a6878 2024-09-17T07:19:49.710 INFO:teuthology.orchestra.run.smithi087.stdout:osd.3 smithi139 running (4m) 24s ago 4m 66.7M 5312M 17.2.7-1635-g4a704134 f22ead590bad 0801999b17c4 2024-09-17T07:19:49.710 INFO:teuthology.orchestra.run.smithi087.stdout:osd.4 smithi139 running (4m) 24s ago 4m 63.8M 5312M 17.2.7-1635-g4a704134 f22ead590bad 299a8dfc47f5 2024-09-17T07:19:49.710 INFO:teuthology.orchestra.run.smithi087.stdout:osd.5 smithi139 running (3m) 24s ago 3m 55.8M 5312M 17.2.7-1635-g4a704134 f22ead590bad 609cf74f32e7 2024-09-17T07:19:49.710 INFO:teuthology.orchestra.run.smithi087.stdout:prometheus.smithi087 smithi087 *:9095 running (6m) 2m ago 7m 52.1M - 2.43.0 a07b618ecd1d 2c4f73cf5937 2024-09-17T07:19:49.711 INFO:tasks.workunit.client.1.smithi139.stdout:5/128: rename d4/de to d4/d16/d1b/d20/d28 0 2024-09-17T07:19:49.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.709+0000 7f64f6b67640 1 -- 172.21.15.87:0/785971451 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f64e006dbd0 msgr2=0x7f64e0070080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:19:49.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.709+0000 7f64f6b67640 1 --2- 172.21.15.87:0/785971451 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f64e006dbd0 0x7f64e0070080 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f64dc000c00 tx=0x7f64dc035040 comp rx=0 tx=0).stop 2024-09-17T07:19:49.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.709+0000 7f64f6b67640 1 -- 172.21.15.87:0/785971451 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f64f00fb430 msgr2=0x7f64f010fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:19:49.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.709+0000 7f64f6b67640 1 --2- 172.21.15.87:0/785971451 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f64f00fb430 0x7f64f010fd00 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f64e4002a80 tx=0x7f64e4004600 comp rx=0 tx=0).stop 2024-09-17T07:19:49.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.709+0000 7f64f6b67640 1 -- 172.21.15.87:0/785971451 shutdown_connections 2024-09-17T07:19:49.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.709+0000 7f64f6b67640 1 --2- 172.21.15.87:0/785971451 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f64e006dbd0 0x7f64e0070080 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:49.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.709+0000 7f64f6b67640 1 --2- 172.21.15.87:0/785971451 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f64f00fc700 0x7f64f0112250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:49.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.709+0000 7f64f6b67640 1 --2- 172.21.15.87:0/785971451 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f64f00fb430 0x7f64f010fd00 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:49.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.709+0000 7f64f6b67640 1 -- 172.21.15.87:0/785971451 >> 172.21.15.87:0/785971451 conn(0x7f64f00f6c10 msgr2=0x7f64f00ffa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:19:49.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.709+0000 7f64f6b67640 1 -- 172.21.15.87:0/785971451 shutdown_connections 2024-09-17T07:19:49.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.709+0000 7f64f6b67640 1 -- 172.21.15.87:0/785971451 wait complete. 2024-09-17T07:19:49.713 INFO:tasks.workunit.client.0.smithi087.stdout:7/233: sync 2024-09-17T07:19:49.714 INFO:tasks.workunit.client.0.smithi087.stdout:7/234: symlink d0/d3/l4b 0 2024-09-17T07:19:49.715 INFO:tasks.workunit.client.1.smithi139.stdout:5/129: dwrite d4/d16/f19 [0,4194304] 0 2024-09-17T07:19:49.717 INFO:tasks.workunit.client.1.smithi139.stdout:5/130: chown d4/lf 130 1 2024-09-17T07:19:49.718 INFO:tasks.workunit.client.1.smithi139.stdout:4/223: truncate d0/d10/d39/f3a 2795195 0 2024-09-17T07:19:49.719 INFO:tasks.workunit.client.1.smithi139.stdout:4/224: write d0/f2 [1364783,28885] 0 2024-09-17T07:19:49.720 INFO:tasks.workunit.client.1.smithi139.stdout:4/225: chown d0/d1a/f1f 1 1 2024-09-17T07:19:49.721 INFO:tasks.workunit.client.1.smithi139.stdout:4/226: rename d0/d1 to d0/d1/d29/d3f 22 2024-09-17T07:19:49.722 INFO:tasks.workunit.client.1.smithi139.stdout:5/131: link d4/lc d4/d16/l29 0 2024-09-17T07:19:49.723 INFO:tasks.workunit.client.1.smithi139.stdout:4/227: creat d0/d10/f40 x:0 0 0 2024-09-17T07:19:49.725 INFO:tasks.workunit.client.1.smithi139.stdout:4/228: rmdir d0/d1a 39 2024-09-17T07:19:49.727 INFO:tasks.workunit.client.1.smithi139.stdout:4/229: mkdir d0/d1/d29/d41 0 2024-09-17T07:19:49.729 INFO:tasks.workunit.client.1.smithi139.stdout:5/132: dwrite d4/d16/f1d [0,4194304] 0 2024-09-17T07:19:49.730 INFO:tasks.workunit.client.1.smithi139.stdout:8/179: sync 2024-09-17T07:19:49.730 INFO:tasks.workunit.client.1.smithi139.stdout:7/168: sync 2024-09-17T07:19:49.731 INFO:tasks.workunit.client.1.smithi139.stdout:3/110: sync 2024-09-17T07:19:49.731 INFO:tasks.workunit.client.1.smithi139.stdout:9/292: sync 2024-09-17T07:19:49.731 INFO:tasks.workunit.client.1.smithi139.stdout:6/307: sync 2024-09-17T07:19:49.731 INFO:tasks.workunit.client.1.smithi139.stdout:2/236: sync 2024-09-17T07:19:49.731 INFO:tasks.workunit.client.1.smithi139.stdout:1/108: sync 2024-09-17T07:19:49.731 INFO:tasks.workunit.client.1.smithi139.stdout:0/149: sync 2024-09-17T07:19:49.731 INFO:tasks.workunit.client.1.smithi139.stdout:4/230: write d0/db/f20 [4523454,9069] 0 2024-09-17T07:19:49.732 INFO:tasks.workunit.client.1.smithi139.stdout:7/169: dread - d5/d10/f2e zero size 2024-09-17T07:19:49.734 INFO:tasks.workunit.client.1.smithi139.stdout:5/133: chown d4/d16/f1d 371534620 1 2024-09-17T07:19:49.736 INFO:tasks.workunit.client.1.smithi139.stdout:4/231: unlink d0/db/f36 0 2024-09-17T07:19:49.737 INFO:tasks.workunit.client.1.smithi139.stdout:1/109: write d2/d10/d12/d13/f16 [725162,30058] 0 2024-09-17T07:19:49.739 INFO:tasks.workunit.client.1.smithi139.stdout:0/150: creat d1/da/d1b/f42 x:0 0 0 2024-09-17T07:19:49.739 INFO:tasks.workunit.client.1.smithi139.stdout:8/180: symlink d0/d1a/l33 0 2024-09-17T07:19:49.741 INFO:tasks.workunit.client.1.smithi139.stdout:9/293: mkdir dc/d11/d15/d3c/d61 0 2024-09-17T07:19:49.742 INFO:tasks.workunit.client.1.smithi139.stdout:5/134: creat d4/d16/d1b/d20/d28/f2a x:0 0 0 2024-09-17T07:19:49.744 INFO:tasks.workunit.client.0.smithi087.stdout:7/235: dread d0/d3/f1f [0,4194304] 0 2024-09-17T07:19:49.744 INFO:tasks.workunit.client.1.smithi139.stdout:5/135: dread - d4/d16/d1b/f25 zero size 2024-09-17T07:19:49.744 INFO:tasks.workunit.client.1.smithi139.stdout:4/232: creat d0/d37/f42 x:0 0 0 2024-09-17T07:19:49.747 INFO:tasks.workunit.client.1.smithi139.stdout:9/294: creat dc/d2c/f62 x:0 0 0 2024-09-17T07:19:49.749 INFO:tasks.workunit.client.1.smithi139.stdout:7/170: creat d5/f37 x:0 0 0 2024-09-17T07:19:49.749 INFO:tasks.workunit.client.1.smithi139.stdout:2/237: dwrite d0/dc/d3a/f3c [4194304,4194304] 0 2024-09-17T07:19:49.749 INFO:tasks.workunit.client.0.smithi087.stdout:7/236: dwrite d0/d3/d10/f14 [0,4194304] 0 2024-09-17T07:19:49.753 INFO:tasks.workunit.client.1.smithi139.stdout:7/171: fsync d5/d17/f33 0 2024-09-17T07:19:49.758 INFO:tasks.workunit.client.1.smithi139.stdout:7/172: dread d5/f18 [0,4194304] 0 2024-09-17T07:19:49.761 INFO:tasks.workunit.client.1.smithi139.stdout:4/233: creat d0/d1/d29/d41/f43 x:0 0 0 2024-09-17T07:19:49.765 INFO:tasks.workunit.client.1.smithi139.stdout:0/151: truncate d1/f3 1100899 0 2024-09-17T07:19:49.766 INFO:tasks.workunit.client.1.smithi139.stdout:8/181: dwrite d0/f9 [0,4194304] 0 2024-09-17T07:19:49.767 INFO:tasks.workunit.client.1.smithi139.stdout:9/295: dread dc/d2a/f32 [0,4194304] 0 2024-09-17T07:19:49.767 INFO:tasks.workunit.client.1.smithi139.stdout:5/136: dread d4/fd [0,4194304] 0 2024-09-17T07:19:49.769 INFO:tasks.workunit.client.1.smithi139.stdout:7/173: write d5/d17/f27 [5083364,117771] 0 2024-09-17T07:19:49.772 INFO:tasks.workunit.client.1.smithi139.stdout:9/296: write dc/f3e [211856,92218] 0 2024-09-17T07:19:49.772 INFO:tasks.workunit.client.1.smithi139.stdout:5/137: fsync d4/d16/f22 0 2024-09-17T07:19:49.773 INFO:tasks.workunit.client.1.smithi139.stdout:7/174: fdatasync d5/f37 0 2024-09-17T07:19:49.777 INFO:tasks.workunit.client.1.smithi139.stdout:0/152: creat d1/f43 x:0 0 0 2024-09-17T07:19:49.779 INFO:tasks.workunit.client.1.smithi139.stdout:8/182: creat d0/dc/f34 x:0 0 0 2024-09-17T07:19:49.779 INFO:tasks.workunit.client.1.smithi139.stdout:9/297: mknod dc/d11/d52/c63 0 2024-09-17T07:19:49.780 INFO:tasks.workunit.client.1.smithi139.stdout:3/111: dwrite d5/d15/f18 [0,4194304] 0 2024-09-17T07:19:49.781 INFO:tasks.workunit.client.1.smithi139.stdout:1/110: dread f0 [0,4194304] 0 2024-09-17T07:19:49.782 INFO:tasks.workunit.client.1.smithi139.stdout:5/138: creat d4/d16/f2b x:0 0 0 2024-09-17T07:19:49.783 INFO:tasks.workunit.client.1.smithi139.stdout:9/298: dread - dc/f5b zero size 2024-09-17T07:19:49.786 INFO:tasks.workunit.client.1.smithi139.stdout:3/112: mkdir d5/d15/d16/d25 0 2024-09-17T07:19:49.786 INFO:tasks.workunit.client.1.smithi139.stdout:2/238: dwrite d0/d7/d1a/f1e [0,4194304] 0 2024-09-17T07:19:49.788 INFO:tasks.workunit.client.1.smithi139.stdout:9/299: readlink dc/d2a/l46 0 2024-09-17T07:19:49.791 INFO:tasks.workunit.client.1.smithi139.stdout:0/153: creat d1/da/d1b/d3d/f44 x:0 0 0 2024-09-17T07:19:49.793 INFO:tasks.workunit.client.1.smithi139.stdout:0/154: dread - d1/f3e zero size 2024-09-17T07:19:49.793 INFO:tasks.workunit.client.1.smithi139.stdout:2/239: write d0/de/df/f39 [3477172,127938] 0 2024-09-17T07:19:49.794 INFO:tasks.workunit.client.1.smithi139.stdout:5/139: creat d4/d16/d1b/f2c x:0 0 0 2024-09-17T07:19:49.798 INFO:tasks.workunit.client.1.smithi139.stdout:7/175: dwrite d5/f23 [0,4194304] 0 2024-09-17T07:19:49.798 INFO:tasks.workunit.client.1.smithi139.stdout:4/234: truncate d0/db/f21 1486213 0 2024-09-17T07:19:49.801 INFO:tasks.workunit.client.1.smithi139.stdout:1/111: dwrite d2/f15 [0,4194304] 0 2024-09-17T07:19:49.802 INFO:tasks.workunit.client.1.smithi139.stdout:4/235: fsync d0/d1/d29/d41/f43 0 2024-09-17T07:19:49.805 INFO:tasks.workunit.client.1.smithi139.stdout:7/176: write d5/d17/f31 [55579,40802] 0 2024-09-17T07:19:49.808 INFO:tasks.workunit.client.1.smithi139.stdout:0/155: symlink d1/da/d17/l45 0 2024-09-17T07:19:49.810 INFO:tasks.workunit.client.1.smithi139.stdout:2/240: dread d0/dc/f13 [0,4194304] 0 2024-09-17T07:19:49.811 INFO:tasks.workunit.client.1.smithi139.stdout:1/112: fsync d2/f11 0 2024-09-17T07:19:49.811 INFO:tasks.workunit.client.0.smithi087.stdout:7/237: truncate d0/d3/f2a 987668 0 2024-09-17T07:19:49.814 INFO:tasks.workunit.client.1.smithi139.stdout:7/177: mknod d5/d10/d2b/c38 0 2024-09-17T07:19:49.815 INFO:tasks.workunit.client.1.smithi139.stdout:0/156: symlink d1/da/l46 0 2024-09-17T07:19:49.816 INFO:tasks.workunit.client.1.smithi139.stdout:1/113: rmdir d2/d10 39 2024-09-17T07:19:49.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.819+0000 7f38664c5640 1 -- 172.21.15.87:0/1062780608 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38600fb430 msgr2=0x7f38600fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:19:49.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.819+0000 7f38664c5640 1 --2- 172.21.15.87:0/1062780608 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38600fb430 0x7f38600fb840 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f38500048d0 tx=0x7f3850009da0 comp rx=0 tx=0).stop 2024-09-17T07:19:49.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.819+0000 7f38664c5640 1 -- 172.21.15.87:0/1062780608 shutdown_connections 2024-09-17T07:19:49.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.819+0000 7f38664c5640 1 --2- 172.21.15.87:0/1062780608 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f38600fc700 0x7f38600fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:49.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.819+0000 7f38664c5640 1 --2- 172.21.15.87:0/1062780608 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38600fb430 0x7f38600fb840 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:49.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.819+0000 7f38664c5640 1 -- 172.21.15.87:0/1062780608 >> 172.21.15.87:0/1062780608 conn(0x7f38600f6c10 msgr2=0x7f38600f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:19:49.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.819+0000 7f38664c5640 1 -- 172.21.15.87:0/1062780608 shutdown_connections 2024-09-17T07:19:49.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.819+0000 7f38664c5640 1 -- 172.21.15.87:0/1062780608 wait complete. 2024-09-17T07:19:49.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.820+0000 7f38664c5640 1 Processor -- start 2024-09-17T07:19:49.822 INFO:tasks.workunit.client.1.smithi139.stdout:3/113: dwrite d5/d13/f1a [0,4194304] 0 2024-09-17T07:19:49.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.820+0000 7f38664c5640 1 -- start start 2024-09-17T07:19:49.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.820+0000 7f38664c5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f38600fb430 0x7f386010f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:19:49.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.820+0000 7f38664c5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38600fc700 0x7f386010f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:19:49.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.820+0000 7f38664c5640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f386010fd60 con 0x7f38600fc700 2024-09-17T07:19:49.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.820+0000 7f38664c5640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3860110580 con 0x7f38600fb430 2024-09-17T07:19:49.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.821+0000 7f385f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38600fc700 0x7f386010f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:19:49.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.821+0000 7f385f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38600fc700 0x7f386010f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37088/0 (socket says 172.21.15.87:37088) 2024-09-17T07:19:49.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.821+0000 7f385f7fe640 1 -- 172.21.15.87:0/470862986 learned_addr learned my addr 172.21.15.87:0/470862986 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:19:49.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.821+0000 7f385ffff640 1 --2- 172.21.15.87:0/470862986 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f38600fb430 0x7f386010f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:19:49.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.821+0000 7f385f7fe640 1 -- 172.21.15.87:0/470862986 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f38600fb430 msgr2=0x7f386010f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:19:49.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.821+0000 7f385f7fe640 1 --2- 172.21.15.87:0/470862986 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f38600fb430 0x7f386010f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:49.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.821+0000 7f385f7fe640 1 -- 172.21.15.87:0/470862986 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3850005040 con 0x7f38600fc700 2024-09-17T07:19:49.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.821+0000 7f385f7fe640 1 --2- 172.21.15.87:0/470862986 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38600fc700 0x7f386010f710 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f3854002a80 tx=0x7f3854004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:19:49.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.821+0000 7f385cff9640 1 -- 172.21.15.87:0/470862986 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3854007c30 con 0x7f38600fc700 2024-09-17T07:19:49.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.822+0000 7f385cff9640 1 -- 172.21.15.87:0/470862986 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f385400f040 con 0x7f38600fc700 2024-09-17T07:19:49.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.822+0000 7f38664c5640 1 -- 172.21.15.87:0/470862986 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3860110810 con 0x7f38600fc700 2024-09-17T07:19:49.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.822+0000 7f385cff9640 1 -- 172.21.15.87:0/470862986 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f385400d9b0 con 0x7f38600fc700 2024-09-17T07:19:49.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.822+0000 7f38664c5640 1 -- 172.21.15.87:0/470862986 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3860110d30 con 0x7f38600fc700 2024-09-17T07:19:49.826 INFO:tasks.workunit.client.1.smithi139.stdout:4/236: link d0/db/f20 d0/d1/d29/d41/f44 0 2024-09-17T07:19:49.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.824+0000 7f38664c5640 1 -- 172.21.15.87:0/470862986 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38600fa890 con 0x7f38600fc700 2024-09-17T07:19:49.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.824+0000 7f385cff9640 1 -- 172.21.15.87:0/470862986 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 24) v1 ==== 90881+0+0 (secure 0 0 0) 0x7f385400dc20 con 0x7f38600fc700 2024-09-17T07:19:49.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.825+0000 7f385cff9640 1 --2- 172.21.15.87:0/470862986 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f384806dbd0 0x7f3848070080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:19:49.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.825+0000 7f385cff9640 1 -- 172.21.15.87:0/470862986 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f385408c9d0 con 0x7f38600fc700 2024-09-17T07:19:49.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.825+0000 7f385ffff640 1 --2- 172.21.15.87:0/470862986 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f384806dbd0 0x7f3848070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:19:49.827 INFO:tasks.workunit.client.1.smithi139.stdout:5/140: dwrite d4/d16/d1b/d20/f24 [0,4194304] 0 2024-09-17T07:19:49.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.826+0000 7f385ffff640 1 --2- 172.21.15.87:0/470862986 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f384806dbd0 0x7f3848070080 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3850000c00 tx=0x7f3850035040 comp rx=0 tx=0).ready entity=mgr.24339 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:19:49.832 INFO:tasks.workunit.client.1.smithi139.stdout:8/183: dread d0/f7 [0,4194304] 0 2024-09-17T07:19:49.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:49.832+0000 7f385cff9640 1 -- 172.21.15.87:0/470862986 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182127 (secure 0 0 0) 0x7f385404e780 con 0x7f38600fc700 2024-09-17T07:19:49.833 INFO:tasks.workunit.client.1.smithi139.stdout:7/178: symlink d5/d10/d2b/l39 0 2024-09-17T07:19:49.834 INFO:tasks.workunit.client.1.smithi139.stdout:9/300: dwrite dc/d11/d15/d1e/f21 [0,4194304] 0 2024-09-17T07:19:49.836 INFO:tasks.workunit.client.1.smithi139.stdout:5/141: read d4/d16/f18 [423407,97646] 0 2024-09-17T07:19:49.841 INFO:tasks.workunit.client.1.smithi139.stdout:2/241: dwrite d0/d7/d1a/f1e [0,4194304] 0 2024-09-17T07:19:49.843 INFO:tasks.workunit.client.1.smithi139.stdout:0/157: link d1/da/d1b/d32/f3a d1/da/d1b/d32/f47 0 2024-09-17T07:19:49.845 INFO:tasks.workunit.client.1.smithi139.stdout:7/179: truncate d5/d17/f2a 1765138 0 2024-09-17T07:19:49.846 INFO:tasks.workunit.client.1.smithi139.stdout:1/114: rename d2/cb to d2/d10/c1e 0 2024-09-17T07:19:49.848 INFO:tasks.workunit.client.1.smithi139.stdout:2/242: symlink d0/de/d25/d3f/l48 0 2024-09-17T07:19:49.849 INFO:tasks.workunit.client.1.smithi139.stdout:9/301: dread dc/d11/d15/d3c/f3d [0,4194304] 0 2024-09-17T07:19:49.851 INFO:tasks.workunit.client.1.smithi139.stdout:5/142: rename d4/d16/d1b/l1c to d4/d16/d1b/d20/d28/l2d 0 2024-09-17T07:19:49.851 INFO:tasks.workunit.client.1.smithi139.stdout:7/180: stat d5/d17/f2a 0 2024-09-17T07:19:49.851 INFO:tasks.workunit.client.1.smithi139.stdout:1/115: truncate d2/d10/d12/d13/f17 1095403 0 2024-09-17T07:19:49.853 INFO:tasks.workunit.client.1.smithi139.stdout:2/243: mkdir d0/de/d11/d32/d49 0 2024-09-17T07:19:49.854 INFO:tasks.workunit.client.1.smithi139.stdout:5/143: mknod d4/c2e 0 2024-09-17T07:19:49.858 INFO:tasks.workunit.client.1.smithi139.stdout:7/181: creat d5/d17/f3a x:0 0 0 2024-09-17T07:19:49.858 INFO:tasks.workunit.client.0.smithi087.stdout:7/238: dread d0/d3/d10/f20 [0,4194304] 0 2024-09-17T07:19:49.859 INFO:tasks.workunit.client.1.smithi139.stdout:4/237: rmdir d0/d1 39 2024-09-17T07:19:49.861 INFO:tasks.workunit.client.0.smithi087.stdout:7/239: creat d0/d3/d10/d32/f4c x:0 0 0 2024-09-17T07:19:49.861 INFO:tasks.workunit.client.1.smithi139.stdout:1/116: mknod d2/c1f 0 2024-09-17T07:19:49.862 INFO:tasks.workunit.client.0.smithi087.stdout:7/240: readlink d0/lb 0 2024-09-17T07:19:49.862 INFO:tasks.workunit.client.1.smithi139.stdout:5/144: dread d4/d16/f18 [0,4194304] 0 2024-09-17T07:19:49.862 INFO:tasks.workunit.client.1.smithi139.stdout:0/158: link d1/da/d1b/l1a d1/da/d2a/l48 0 2024-09-17T07:19:49.863 INFO:tasks.workunit.client.0.smithi087.stdout:7/241: rmdir d0/d3/d10 39 2024-09-17T07:19:49.863 INFO:tasks.workunit.client.1.smithi139.stdout:9/302: dwrite dc/d2a/f32 [0,4194304] 0 2024-09-17T07:19:49.865 INFO:tasks.workunit.client.0.smithi087.stdout:7/242: symlink d0/d3/d23/d17/l4d 0 2024-09-17T07:19:49.866 INFO:tasks.workunit.client.1.smithi139.stdout:7/182: unlink d5/d17/c1a 0 2024-09-17T07:19:49.866 INFO:tasks.workunit.client.1.smithi139.stdout:0/159: chown d1/da/cd 186880458 1 2024-09-17T07:19:49.867 INFO:tasks.workunit.client.0.smithi087.stdout:7/243: mkdir d0/d3/d23/d4e 0 2024-09-17T07:19:49.867 INFO:tasks.workunit.client.1.smithi139.stdout:2/244: dwrite d0/dc/d3a/f3c [4194304,4194304] 0 2024-09-17T07:19:49.870 INFO:tasks.workunit.client.1.smithi139.stdout:0/160: dread - d1/da/d17/f34 zero size 2024-09-17T07:19:49.871 INFO:tasks.workunit.client.1.smithi139.stdout:1/117: creat d2/d10/d12/f20 x:0 0 0 2024-09-17T07:19:49.872 INFO:tasks.workunit.client.1.smithi139.stdout:9/303: truncate dc/d11/d15/d1e/f60 596977 0 2024-09-17T07:19:49.876 INFO:tasks.workunit.client.1.smithi139.stdout:5/145: dread d4/d16/d1b/d20/f24 [0,4194304] 0 2024-09-17T07:19:49.876 INFO:tasks.workunit.client.1.smithi139.stdout:2/245: symlink d0/de/d11/d32/l4a 0 2024-09-17T07:19:49.878 INFO:tasks.workunit.client.1.smithi139.stdout:1/118: creat d2/d10/d12/d1a/f21 x:0 0 0 2024-09-17T07:19:49.880 INFO:tasks.workunit.client.1.smithi139.stdout:0/161: truncate d1/da/d1b/d32/f3a 117820 0 2024-09-17T07:19:49.883 INFO:tasks.workunit.client.1.smithi139.stdout:8/184: dwrite d0/dc/f10 [0,4194304] 0 2024-09-17T07:19:49.884 INFO:tasks.workunit.client.0.smithi087.stdout:0/381: sync 2024-09-17T07:19:49.884 INFO:tasks.workunit.client.1.smithi139.stdout:2/246: write d0/dc/d15/f23 [993587,97145] 0 2024-09-17T07:19:49.884 INFO:tasks.workunit.client.1.smithi139.stdout:9/304: mkdir dc/d11/d15/d3c/d61/d64 0 2024-09-17T07:19:49.885 INFO:tasks.workunit.client.0.smithi087.stdout:0/382: fdatasync db/f17 0 2024-09-17T07:19:49.885 INFO:tasks.workunit.client.1.smithi139.stdout:1/119: read d2/d10/d12/d13/f16 [229205,56229] 0 2024-09-17T07:19:49.888 INFO:tasks.workunit.client.1.smithi139.stdout:7/183: dwrite d5/d17/f33 [0,4194304] 0 2024-09-17T07:19:49.888 INFO:tasks.workunit.client.0.smithi087.stdout:0/383: rmdir db/d4f 39 2024-09-17T07:19:49.889 INFO:tasks.workunit.client.0.smithi087.stdout:0/384: truncate db/d4f/f83 348256 0 2024-09-17T07:19:49.891 INFO:tasks.workunit.client.1.smithi139.stdout:1/120: write f0 [2518736,113408] 0 2024-09-17T07:19:49.895 INFO:tasks.workunit.client.1.smithi139.stdout:8/185: symlink d0/dc/l35 0 2024-09-17T07:19:49.896 INFO:tasks.workunit.client.1.smithi139.stdout:2/247: symlink d0/d7/d1a/d1b/l4b 0 2024-09-17T07:19:49.897 INFO:tasks.workunit.client.1.smithi139.stdout:8/186: stat d0/d20/c23 0 2024-09-17T07:19:49.897 INFO:tasks.workunit.client.1.smithi139.stdout:0/162: truncate d1/da/f14 1669223 0 2024-09-17T07:19:49.897 INFO:tasks.workunit.client.0.smithi087.stdout:0/385: dwrite db/f31 [0,4194304] 0 2024-09-17T07:19:49.898 INFO:tasks.workunit.client.1.smithi139.stdout:2/248: chown d0/de/d11 1020 1 2024-09-17T07:19:49.899 INFO:tasks.workunit.client.1.smithi139.stdout:1/121: unlink d2/c9 0 2024-09-17T07:19:49.900 INFO:tasks.workunit.client.0.smithi087.stdout:0/386: mknod db/d45/d5d/c8d 0 2024-09-17T07:19:49.901 INFO:tasks.workunit.client.1.smithi139.stdout:7/184: dwrite d5/d17/f32 [0,4194304] 0 2024-09-17T07:19:49.901 INFO:tasks.workunit.client.1.smithi139.stdout:8/187: chown d0/d20/l31 21754 1 2024-09-17T07:19:49.901 INFO:tasks.workunit.client.1.smithi139.stdout:2/249: chown d0/de/df/f39 55348126 1 2024-09-17T07:19:49.902 INFO:tasks.workunit.client.1.smithi139.stdout:8/188: stat d0/fb 0 2024-09-17T07:19:49.902 INFO:tasks.workunit.client.1.smithi139.stdout:2/250: chown d0/dc 52537041 1 2024-09-17T07:19:49.903 INFO:tasks.workunit.client.1.smithi139.stdout:1/122: symlink d2/d10/d12/l22 0 2024-09-17T07:19:49.903 INFO:tasks.workunit.client.1.smithi139.stdout:8/189: chown d0/dc 226 1 2024-09-17T07:19:49.904 INFO:tasks.workunit.client.0.smithi087.stdout:0/387: rename db/d45/f57 to db/d45/d7b/d7e/f8e 0 2024-09-17T07:19:49.905 INFO:tasks.workunit.client.0.smithi087.stdout:0/388: chown db/d45/d5b/f6a 928 1 2024-09-17T07:19:49.906 INFO:tasks.workunit.client.0.smithi087.stdout:0/389: write db/f49 [52657,119248] 0 2024-09-17T07:19:49.906 INFO:tasks.workunit.client.1.smithi139.stdout:0/163: rename d1/da/c3c to d1/da/d1b/d3d/c49 0 2024-09-17T07:19:49.909 INFO:tasks.workunit.client.1.smithi139.stdout:1/123: creat d2/d10/d12/f23 x:0 0 0 2024-09-17T07:19:49.909 INFO:tasks.workunit.client.0.smithi087.stdout:0/390: rename db/d45/f51 to db/d45/d5d/f8f 0 2024-09-17T07:19:49.911 INFO:tasks.workunit.client.1.smithi139.stdout:8/190: rename d0/c17 to d0/dc/d18/c36 0 2024-09-17T07:19:49.911 INFO:tasks.workunit.client.1.smithi139.stdout:7/185: dread d5/d17/f20 [0,4194304] 0 2024-09-17T07:19:49.911 INFO:tasks.workunit.client.0.smithi087.stdout:0/391: rmdir db/d45/d5d/d63 39 2024-09-17T07:19:49.912 INFO:tasks.workunit.client.1.smithi139.stdout:0/164: unlink d1/da/d1b/f3f 0 2024-09-17T07:19:49.913 INFO:tasks.workunit.client.1.smithi139.stdout:1/124: mkdir d2/d10/d12/d24 0 2024-09-17T07:19:49.914 INFO:tasks.workunit.client.1.smithi139.stdout:8/191: read d0/d1a/f21 [883974,52460] 0 2024-09-17T07:19:49.914 INFO:tasks.workunit.client.0.smithi087.stdout:0/392: rename db/d45/d5d/d7d to db/d45/d7b/d90 0 2024-09-17T07:19:49.915 INFO:tasks.workunit.client.1.smithi139.stdout:8/192: chown d0/dc/c1d 3727720 1 2024-09-17T07:19:49.915 INFO:tasks.workunit.client.0.smithi087.stdout:0/393: dread - db/f8c zero size 2024-09-17T07:19:49.918 INFO:tasks.workunit.client.0.smithi087.stdout:0/394: getdents db/d45/d5d/d63/d86 0 2024-09-17T07:19:49.921 INFO:tasks.workunit.client.1.smithi139.stdout:5/146: truncate d4/f9 52810 0 2024-09-17T07:19:49.923 INFO:tasks.workunit.client.1.smithi139.stdout:5/147: read - d4/d16/d1b/d20/d28/f2a zero size 2024-09-17T07:19:49.924 INFO:tasks.workunit.client.1.smithi139.stdout:9/305: dread dc/d11/f12 [0,4194304] 0 2024-09-17T07:19:49.927 INFO:tasks.workunit.client.1.smithi139.stdout:9/306: truncate dc/d2a/f4c 199097 0 2024-09-17T07:19:49.927 INFO:tasks.workunit.client.1.smithi139.stdout:5/148: fsync d4/d16/d1b/d20/f24 0 2024-09-17T07:19:49.929 INFO:tasks.workunit.client.1.smithi139.stdout:8/193: getdents d0/dc/d18 0 2024-09-17T07:19:49.929 INFO:tasks.workunit.client.1.smithi139.stdout:8/194: fsync d0/f2a 0 2024-09-17T07:19:49.932 INFO:tasks.workunit.client.1.smithi139.stdout:2/251: dwrite d0/f6 [0,4194304] 0 2024-09-17T07:19:49.934 INFO:tasks.workunit.client.1.smithi139.stdout:2/252: write d0/dc/d15/f23 [972795,112571] 0 2024-09-17T07:19:49.935 INFO:tasks.workunit.client.1.smithi139.stdout:7/186: truncate d5/d10/f2c 2869893 0 2024-09-17T07:19:49.936 INFO:tasks.workunit.client.1.smithi139.stdout:1/125: truncate d2/f7 847387 0 2024-09-17T07:19:49.938 INFO:tasks.workunit.client.1.smithi139.stdout:9/307: creat dc/d11/d15/d1e/f65 x:0 0 0 2024-09-17T07:19:49.940 INFO:tasks.workunit.client.1.smithi139.stdout:9/308: write dc/d11/d15/f50 [409215,35889] 0 2024-09-17T07:19:49.940 INFO:tasks.workunit.client.0.smithi087.stdout:0/395: dread db/f18 [0,4194304] 0 2024-09-17T07:19:49.942 INFO:tasks.workunit.client.1.smithi139.stdout:8/195: dread d0/d1a/f21 [0,4194304] 0 2024-09-17T07:19:49.942 INFO:tasks.workunit.client.1.smithi139.stdout:9/309: read dc/d11/d15/d3c/f3f [1621319,21593] 0 2024-09-17T07:19:49.943 INFO:tasks.workunit.client.0.smithi087.stdout:0/396: write db/d45/d7b/d7e/f8e [2672261,89654] 0 2024-09-17T07:19:49.943 INFO:tasks.workunit.client.1.smithi139.stdout:7/187: rmdir d5/d17 39 2024-09-17T07:19:49.943 INFO:tasks.workunit.client.1.smithi139.stdout:2/253: symlink d0/de/d25/d3f/l4c 0 2024-09-17T07:19:49.944 INFO:tasks.workunit.client.1.smithi139.stdout:9/310: write dc/d2a/f4c [647705,11448] 0 2024-09-17T07:19:49.946 INFO:tasks.workunit.client.1.smithi139.stdout:5/149: getdents d4/d16/d1b/d20 0 2024-09-17T07:19:49.948 INFO:tasks.workunit.client.0.smithi087.stdout:0/397: write db/d45/d5d/d63/f6b [696185,13386] 0 2024-09-17T07:19:49.952 INFO:tasks.workunit.client.0.smithi087.stdout:0/398: rename db/d45/d5b/c60 to db/d45/d5d/d63/d86/c91 0 2024-09-17T07:19:49.953 INFO:tasks.workunit.client.0.smithi087.stdout:0/399: fdatasync db/f6e 0 2024-09-17T07:19:49.953 INFO:tasks.workunit.client.0.smithi087.stdout:0/400: readlink db/d45/d5b/l5c 0 2024-09-17T07:19:49.954 INFO:tasks.workunit.client.0.smithi087.stdout:0/401: write db/d45/d5d/d63/f6b [460766,60870] 0 2024-09-17T07:19:49.955 INFO:tasks.workunit.client.1.smithi139.stdout:1/126: getdents d2/d10/d12/d24 0 2024-09-17T07:19:49.956 INFO:tasks.workunit.client.0.smithi087.stdout:0/402: mkdir db/d45/d5b/d92 0 2024-09-17T07:19:49.957 INFO:tasks.workunit.client.0.smithi087.stdout:0/403: write db/d45/f75 [163454,64931] 0 2024-09-17T07:19:49.958 INFO:tasks.workunit.client.1.smithi139.stdout:7/188: unlink d5/cf 0 2024-09-17T07:19:49.959 INFO:tasks.workunit.client.1.smithi139.stdout:2/254: mknod d0/dc/c4d 0 2024-09-17T07:19:49.960 INFO:tasks.workunit.client.1.smithi139.stdout:9/311: symlink dc/d11/d15/d3c/d61/l66 0 2024-09-17T07:19:49.964 INFO:tasks.workunit.client.1.smithi139.stdout:5/150: mknod d4/d16/c2f 0 2024-09-17T07:19:49.965 INFO:tasks.workunit.client.1.smithi139.stdout:1/127: mkdir d2/d10/d12/d1a/d25 0 2024-09-17T07:19:49.966 INFO:tasks.workunit.client.1.smithi139.stdout:9/312: dread dc/d11/d15/d3c/f45 [0,4194304] 0 2024-09-17T07:19:49.968 INFO:tasks.workunit.client.1.smithi139.stdout:1/128: write d2/f15 [2162173,5948] 0 2024-09-17T07:19:49.968 INFO:tasks.workunit.client.1.smithi139.stdout:7/189: chown d5/d17/f3a 31 1 2024-09-17T07:19:49.969 INFO:tasks.workunit.client.0.smithi087.stdout:0/404: dwrite db/f59 [0,4194304] 0 2024-09-17T07:19:49.970 INFO:tasks.workunit.client.1.smithi139.stdout:2/255: dwrite d0/dc/d3a/f3c [8388608,4194304] 0 2024-09-17T07:19:49.970 INFO:tasks.workunit.client.1.smithi139.stdout:8/196: rename d0/c13 to d0/c37 0 2024-09-17T07:19:49.970 INFO:tasks.workunit.client.1.smithi139.stdout:9/313: chown ca 8017 1 2024-09-17T07:19:49.970 INFO:tasks.workunit.client.1.smithi139.stdout:7/190: readlink d5/l1c 0 2024-09-17T07:19:49.972 INFO:tasks.workunit.client.0.smithi087.stdout:0/405: symlink db/d45/d5b/d92/l93 0 2024-09-17T07:19:49.973 INFO:tasks.workunit.client.1.smithi139.stdout:1/129: write d2/d10/d12/d13/f17 [1826459,122419] 0 2024-09-17T07:19:49.973 INFO:tasks.workunit.client.1.smithi139.stdout:9/314: chown dc/d11/d15 1 1 2024-09-17T07:19:49.974 INFO:tasks.workunit.client.1.smithi139.stdout:5/151: truncate d4/d16/f18 2227539 0 2024-09-17T07:19:49.977 INFO:tasks.workunit.client.0.smithi087.stdout:0/406: link db/d45/c50 db/d45/d5d/d63/c94 0 2024-09-17T07:19:49.977 INFO:tasks.workunit.client.1.smithi139.stdout:8/197: write d0/fa [946930,115429] 0 2024-09-17T07:19:49.980 INFO:tasks.workunit.client.0.smithi087.stdout:0/407: mkdir db/d45/d5d/d63/d95 0 2024-09-17T07:19:49.982 INFO:tasks.workunit.client.1.smithi139.stdout:1/130: link d2/d10/d12/d13/f17 d2/d10/d12/d1a/d25/f26 0 2024-09-17T07:19:49.982 INFO:tasks.workunit.client.0.smithi087.stdout:0/408: creat db/d4f/f96 x:0 0 0 2024-09-17T07:19:49.984 INFO:tasks.workunit.client.1.smithi139.stdout:7/191: rename d5/d10/d2b/l39 to d5/l3b 0 2024-09-17T07:19:49.985 INFO:tasks.workunit.client.1.smithi139.stdout:2/256: dread d0/d7/f19 [0,4194304] 0 2024-09-17T07:19:49.985 INFO:tasks.workunit.client.0.smithi087.stdout:0/409: creat db/d45/f97 x:0 0 0 2024-09-17T07:19:49.985 INFO:tasks.workunit.client.1.smithi139.stdout:9/315: fdatasync dc/d11/d15/d1e/f23 0 2024-09-17T07:19:49.987 INFO:tasks.workunit.client.0.smithi087.stdout:0/410: creat db/d45/d5d/d63/d86/f98 x:0 0 0 2024-09-17T07:19:49.988 INFO:tasks.workunit.client.1.smithi139.stdout:8/198: creat d0/dc/d18/f38 x:0 0 0 2024-09-17T07:19:49.989 INFO:tasks.workunit.client.0.smithi087.stdout:3/252: sync 2024-09-17T07:19:49.989 INFO:tasks.workunit.client.0.smithi087.stdout:8/262: sync 2024-09-17T07:19:49.989 INFO:tasks.workunit.client.1.smithi139.stdout:5/152: dwrite d4/f17 [4194304,4194304] 0 2024-09-17T07:19:49.990 INFO:tasks.workunit.client.1.smithi139.stdout:7/192: creat d5/d10/d2b/f3c x:0 0 0 2024-09-17T07:19:49.993 INFO:tasks.workunit.client.1.smithi139.stdout:2/257: write d0/d7/d1a/f1e [1772803,66645] 0 2024-09-17T07:19:49.994 INFO:tasks.workunit.client.1.smithi139.stdout:9/316: dread dc/d11/d15/d1e/f60 [0,4194304] 0 2024-09-17T07:19:49.997 INFO:tasks.workunit.client.1.smithi139.stdout:5/153: write d4/d16/d1b/d20/f24 [95776,61494] 0 2024-09-17T07:19:49.997 INFO:tasks.workunit.client.0.smithi087.stdout:0/411: dwrite db/d45/d5d/d63/d86/f98 [0,4194304] 0 2024-09-17T07:19:49.998 INFO:tasks.workunit.client.1.smithi139.stdout:7/193: rename d5/c30 to d5/d17/c3d 0 2024-09-17T07:19:49.999 INFO:tasks.workunit.client.1.smithi139.stdout:1/131: dwrite d2/fd [0,4194304] 0 2024-09-17T07:19:50.000 INFO:tasks.workunit.client.1.smithi139.stdout:5/154: stat d4/d16/c2f 0 2024-09-17T07:19:50.000 INFO:tasks.workunit.client.0.smithi087.stdout:8/263: dwrite d1/d2b/f41 [0,4194304] 0 2024-09-17T07:19:50.001 INFO:tasks.workunit.client.1.smithi139.stdout:5/155: readlink d4/l21 0 2024-09-17T07:19:50.003 INFO:tasks.workunit.client.1.smithi139.stdout:5/156: readlink d4/d16/d1b/d20/d28/l13 0 2024-09-17T07:19:50.004 INFO:tasks.workunit.client.1.smithi139.stdout:5/157: chown d4/d16 5193 1 2024-09-17T07:19:50.005 INFO:tasks.workunit.client.1.smithi139.stdout:8/199: dwrite d0/dc/f10 [0,4194304] 0 2024-09-17T07:19:50.006 INFO:tasks.workunit.client.1.smithi139.stdout:9/317: dread dc/d11/d15/d3c/f45 [0,4194304] 0 2024-09-17T07:19:50.007 INFO:tasks.workunit.client.0.smithi087.stdout:8/264: mkdir d1/d7/d63 0 2024-09-17T07:19:50.007 INFO:tasks.workunit.client.0.smithi087.stdout:8/265: chown d1/d7/le 0 1 2024-09-17T07:19:50.008 INFO:tasks.workunit.client.1.smithi139.stdout:2/258: mkdir d0/d4e 0 2024-09-17T07:19:50.010 INFO:tasks.workunit.client.0.smithi087.stdout:3/253: write d6/d15/f29 [2066576,125817] 0 2024-09-17T07:19:50.012 INFO:tasks.workunit.client.1.smithi139.stdout:8/200: creat d0/d1a/f39 x:0 0 0 2024-09-17T07:19:50.013 INFO:tasks.workunit.client.1.smithi139.stdout:8/201: dread - d0/dc/f34 zero size 2024-09-17T07:19:50.016 INFO:tasks.workunit.client.1.smithi139.stdout:6/308: sync 2024-09-17T07:19:50.016 INFO:tasks.workunit.client.1.smithi139.stdout:1/132: creat d2/f27 x:0 0 0 2024-09-17T07:19:50.017 INFO:tasks.workunit.client.0.smithi087.stdout:3/254: mkdir d6/d15/d37/d3c/d52 0 2024-09-17T07:19:50.018 INFO:tasks.workunit.client.0.smithi087.stdout:8/266: dwrite d1/d7/d9/d19/f36 [0,4194304] 0 2024-09-17T07:19:50.021 INFO:tasks.workunit.client.0.smithi087.stdout:3/255: truncate d6/d15/d4b/f4c 16035 0 2024-09-17T07:19:50.022 INFO:tasks.workunit.client.1.smithi139.stdout:9/318: symlink dc/d11/d15/d1e/d53/l67 0 2024-09-17T07:19:50.023 INFO:tasks.workunit.client.1.smithi139.stdout:8/202: chown d0/dc/d18/l19 329493 1 2024-09-17T07:19:50.023 INFO:tasks.workunit.client.0.smithi087.stdout:3/256: symlink d6/d16/l53 0 2024-09-17T07:19:50.024 INFO:tasks.workunit.client.0.smithi087.stdout:8/267: rmdir d1/d7/d9/d19/d4d 39 2024-09-17T07:19:50.026 INFO:tasks.workunit.client.1.smithi139.stdout:9/319: mkdir dc/d11/d15/d3c/d68 0 2024-09-17T07:19:50.026 INFO:tasks.workunit.client.0.smithi087.stdout:3/257: creat d6/d15/d37/d3c/f54 x:0 0 0 2024-09-17T07:19:50.027 INFO:tasks.workunit.client.1.smithi139.stdout:8/203: unlink d0/l4 0 2024-09-17T07:19:50.028 INFO:tasks.workunit.client.1.smithi139.stdout:1/133: mknod d2/d10/c28 0 2024-09-17T07:19:50.029 INFO:tasks.workunit.client.0.smithi087.stdout:8/268: truncate d1/f2a 1321669 0 2024-09-17T07:19:50.029 INFO:tasks.workunit.client.1.smithi139.stdout:8/204: truncate d0/dc/f10 5032821 0 2024-09-17T07:19:50.029 INFO:tasks.workunit.client.1.smithi139.stdout:5/158: getdents d4/d16/d1b 0 2024-09-17T07:19:50.030 INFO:tasks.workunit.client.0.smithi087.stdout:8/269: read - d1/d7/d9/f61 zero size 2024-09-17T07:19:50.030 INFO:tasks.workunit.client.1.smithi139.stdout:9/320: mknod dc/d11/d15/d3c/c69 0 2024-09-17T07:19:50.032 INFO:tasks.workunit.client.1.smithi139.stdout:5/159: truncate d4/d16/d1b/d20/f24 4978676 0 2024-09-17T07:19:50.032 INFO:tasks.workunit.client.1.smithi139.stdout:8/205: mkdir d0/d1a/d3a 0 2024-09-17T07:19:50.033 INFO:tasks.workunit.client.0.smithi087.stdout:3/258: dread d6/d16/f38 [0,4194304] 0 2024-09-17T07:19:50.034 INFO:tasks.workunit.client.0.smithi087.stdout:0/412: truncate db/f59 1635975 0 2024-09-17T07:19:50.036 INFO:tasks.workunit.client.1.smithi139.stdout:5/160: readlink d4/d16/d1b/d20/d28/l2d 0 2024-09-17T07:19:50.036 INFO:tasks.workunit.client.1.smithi139.stdout:5/161: stat d4 0 2024-09-17T07:19:50.037 INFO:tasks.workunit.client.1.smithi139.stdout:9/321: link dc/d2a/l2b dc/d11/d15/d3c/l6a 0 2024-09-17T07:19:50.038 INFO:tasks.workunit.client.0.smithi087.stdout:8/270: dwrite d1/d7/d9/d19/f4e [0,4194304] 0 2024-09-17T07:19:50.038 INFO:tasks.workunit.client.1.smithi139.stdout:5/162: fdatasync d4/f6 0 2024-09-17T07:19:50.039 INFO:tasks.workunit.client.1.smithi139.stdout:9/322: write dc/d11/d15/d1e/f2e [5822011,83620] 0 2024-09-17T07:19:50.040 INFO:tasks.workunit.client.1.smithi139.stdout:5/163: write d4/d16/d1b/d20/d28/f2a [227216,118637] 0 2024-09-17T07:19:50.041 INFO:tasks.workunit.client.0.smithi087.stdout:0/413: getdents db/d45/d5b/d92 0 2024-09-17T07:19:50.041 INFO:tasks.workunit.client.1.smithi139.stdout:9/323: write dc/d11/d15/d1e/f2e [1099940,123630] 0 2024-09-17T07:19:50.042 INFO:tasks.workunit.client.1.smithi139.stdout:9/324: read - dc/d11/d15/d3c/f5d zero size 2024-09-17T07:19:50.045 INFO:tasks.workunit.client.0.smithi087.stdout:8/271: getdents d1/d7/d9 0 2024-09-17T07:19:50.046 INFO:tasks.workunit.client.0.smithi087.stdout:0/414: rename db/f6e to db/d45/f99 0 2024-09-17T07:19:50.047 INFO:tasks.workunit.client.0.smithi087.stdout:8/272: fdatasync d1/d2b/f32 0 2024-09-17T07:19:50.048 INFO:tasks.workunit.client.0.smithi087.stdout:0/415: symlink db/d45/d7b/d7e/l9a 0 2024-09-17T07:19:50.052 INFO:tasks.workunit.client.1.smithi139.stdout:9/325: dwrite dc/d11/d15/d1e/f2f [0,4194304] 0 2024-09-17T07:19:50.056 INFO:tasks.workunit.client.0.smithi087.stdout:3/259: write d6/d1b/d2b/f39 [4296384,20552] 0 2024-09-17T07:19:50.056 INFO:tasks.workunit.client.1.smithi139.stdout:9/326: creat dc/d11/d15/d1e/f6b x:0 0 0 2024-09-17T07:19:50.058 INFO:tasks.workunit.client.0.smithi087.stdout:8/273: dwrite d1/d7/d9/fc [0,4194304] 0 2024-09-17T07:19:50.059 INFO:tasks.workunit.client.0.smithi087.stdout:1/299: sync 2024-09-17T07:19:50.059 INFO:tasks.workunit.client.0.smithi087.stdout:5/429: sync 2024-09-17T07:19:50.059 INFO:tasks.workunit.client.0.smithi087.stdout:6/358: sync 2024-09-17T07:19:50.060 INFO:tasks.workunit.client.0.smithi087.stdout:6/359: chown d1/d6/d1a/c1b 100129 1 2024-09-17T07:19:50.060 INFO:tasks.workunit.client.0.smithi087.stdout:3/260: fsync d6/d1b/f3b 0 2024-09-17T07:19:50.062 INFO:tasks.workunit.client.0.smithi087.stdout:1/300: fsync d2/d3d/f2f 0 2024-09-17T07:19:50.062 INFO:tasks.workunit.client.0.smithi087.stdout:6/360: read d1/d6/d1a/d2c/d33/f4f [84457,106286] 0 2024-09-17T07:19:50.063 INFO:tasks.workunit.client.0.smithi087.stdout:8/274: mknod d1/d56/c64 0 2024-09-17T07:19:50.066 INFO:tasks.workunit.client.0.smithi087.stdout:8/275: fdatasync d1/d7/d9/d19/f1d 0 2024-09-17T07:19:50.067 INFO:tasks.workunit.client.1.smithi139.stdout:1/134: getdents d2 0 2024-09-17T07:19:50.067 INFO:tasks.workunit.client.0.smithi087.stdout:5/430: truncate d5/d18/d20/d2f/f57 4393942 0 2024-09-17T07:19:50.070 INFO:tasks.workunit.client.0.smithi087.stdout:8/276: write d1/d7/d9/fc [1926190,97011] 0 2024-09-17T07:19:50.070 INFO:tasks.workunit.client.1.smithi139.stdout:1/135: creat d2/d10/d12/f29 x:0 0 0 2024-09-17T07:19:50.072 INFO:tasks.workunit.client.0.smithi087.stdout:1/301: getdents d2 0 2024-09-17T07:19:50.073 INFO:tasks.workunit.client.0.smithi087.stdout:5/431: fdatasync d5/d18/d6a/f86 0 2024-09-17T07:19:50.073 INFO:tasks.workunit.client.1.smithi139.stdout:8/206: truncate d0/dc/f27 1524314 0 2024-09-17T07:19:50.074 INFO:tasks.workunit.client.0.smithi087.stdout:6/361: getdents d1/d6/d1a/d2c/d40 0 2024-09-17T07:19:50.075 INFO:tasks.workunit.client.1.smithi139.stdout:6/309: dwrite f7 [0,4194304] 0 2024-09-17T07:19:50.075 INFO:tasks.workunit.client.0.smithi087.stdout:3/261: dwrite d6/d15/d37/d3c/f51 [0,4194304] 0 2024-09-17T07:19:50.080 INFO:tasks.workunit.client.1.smithi139.stdout:6/310: creat db/d18/d5b/f61 x:0 0 0 2024-09-17T07:19:50.081 INFO:tasks.workunit.client.0.smithi087.stdout:8/277: mknod d1/d7/d9/d19/d1b/c65 0 2024-09-17T07:19:50.081 INFO:tasks.workunit.client.0.smithi087.stdout:1/302: symlink d2/d3d/d35/d57/d73/l74 0 2024-09-17T07:19:50.081 INFO:tasks.workunit.client.1.smithi139.stdout:1/136: dwrite d2/f11 [0,4194304] 0 2024-09-17T07:19:50.082 INFO:tasks.workunit.client.1.smithi139.stdout:8/207: creat d0/dc/f3b x:0 0 0 2024-09-17T07:19:50.082 INFO:tasks.workunit.client.1.smithi139.stdout:1/137: read - d2/f27 zero size 2024-09-17T07:19:50.082 INFO:tasks.workunit.client.0.smithi087.stdout:0/416: dread db/d45/f99 [0,4194304] 0 2024-09-17T07:19:50.083 INFO:tasks.workunit.client.0.smithi087.stdout:0/417: fsync db/f31 0 2024-09-17T07:19:50.083 INFO:tasks.workunit.client.0.smithi087.stdout:5/432: rmdir d5/d18/d20/d2f 39 2024-09-17T07:19:50.083 INFO:tasks.workunit.client.1.smithi139.stdout:9/327: rmdir dc/d11/d15 39 2024-09-17T07:19:50.083 INFO:tasks.workunit.client.1.smithi139.stdout:6/311: mknod db/df/d4c/c62 0 2024-09-17T07:19:50.086 INFO:tasks.workunit.client.1.smithi139.stdout:6/312: readlink db/d21/d46/d54/l3e 0 2024-09-17T07:19:50.087 INFO:tasks.workunit.client.1.smithi139.stdout:1/138: stat d2/d10/d12/d13/c19 0 2024-09-17T07:19:50.090 INFO:tasks.workunit.client.0.smithi087.stdout:0/418: rmdir db/d45 39 2024-09-17T07:19:50.091 INFO:tasks.workunit.client.1.smithi139.stdout:1/139: rename d2/d10/d12 to d2/d10/d12/d1a/d25/d2a 22 2024-09-17T07:19:50.091 INFO:tasks.workunit.client.1.smithi139.stdout:6/313: truncate db/d21/d46/f4d 759646 0 2024-09-17T07:19:50.091 INFO:tasks.workunit.client.1.smithi139.stdout:8/208: dread d0/dc/f10 [0,4194304] 0 2024-09-17T07:19:50.092 INFO:tasks.workunit.client.1.smithi139.stdout:1/140: readlink d2/l1d 0 2024-09-17T07:19:50.092 INFO:tasks.workunit.client.0.smithi087.stdout:6/362: dwrite d1/f78 [0,4194304] 0 2024-09-17T07:19:50.093 INFO:tasks.workunit.client.1.smithi139.stdout:8/209: stat d0/f9 0 2024-09-17T07:19:50.093 INFO:tasks.workunit.client.0.smithi087.stdout:0/419: fsync db/f1b 0 2024-09-17T07:19:50.094 INFO:tasks.workunit.client.1.smithi139.stdout:6/314: read db/d18/f35 [3546448,103567] 0 2024-09-17T07:19:50.095 INFO:tasks.workunit.client.0.smithi087.stdout:3/262: truncate d6/fc 2402569 0 2024-09-17T07:19:50.096 INFO:tasks.workunit.client.1.smithi139.stdout:9/328: dwrite dc/d11/d15/d1e/f65 [0,4194304] 0 2024-09-17T07:19:50.097 INFO:tasks.workunit.client.1.smithi139.stdout:6/315: mknod db/df/d4e/c63 0 2024-09-17T07:19:50.099 INFO:tasks.workunit.client.0.smithi087.stdout:5/433: dwrite d5/d18/f78 [0,4194304] 0 2024-09-17T07:19:50.100 INFO:tasks.workunit.client.1.smithi139.stdout:1/141: mkdir d2/d10/d12/d1a/d25/d2b 0 2024-09-17T07:19:50.100 INFO:tasks.workunit.client.1.smithi139.stdout:8/210: truncate d0/fb 1606648 0 2024-09-17T07:19:50.105 INFO:tasks.workunit.client.1.smithi139.stdout:8/211: symlink d0/dc/l3c 0 2024-09-17T07:19:50.107 INFO:tasks.workunit.client.0.smithi087.stdout:0/420: mknod db/d45/d5d/d63/d95/c9b 0 2024-09-17T07:19:50.109 INFO:tasks.workunit.client.0.smithi087.stdout:5/434: rename d5/d12/f28 to d5/d8/d1f/d68/f8d 0 2024-09-17T07:19:50.110 INFO:tasks.workunit.client.1.smithi139.stdout:9/329: dwrite dc/d11/d15/f17 [0,4194304] 0 2024-09-17T07:19:50.112 INFO:tasks.workunit.client.1.smithi139.stdout:8/212: unlink d0/dc/l1e 0 2024-09-17T07:19:50.113 INFO:tasks.workunit.client.0.smithi087.stdout:8/278: dwrite d1/d7/d9/d19/d4d/f47 [0,4194304] 0 2024-09-17T07:19:50.113 INFO:tasks.workunit.client.0.smithi087.stdout:0/421: mknod db/d45/d5d/d63/c9c 0 2024-09-17T07:19:50.114 INFO:tasks.workunit.client.0.smithi087.stdout:3/263: dwrite d6/d16/f4a [0,4194304] 0 2024-09-17T07:19:50.116 INFO:tasks.workunit.client.1.smithi139.stdout:9/330: write dc/d11/d15/d1e/f33 [1401018,103380] 0 2024-09-17T07:19:50.116 INFO:tasks.workunit.client.0.smithi087.stdout:8/279: creat d1/d2b/d3b/d53/f66 x:0 0 0 2024-09-17T07:19:50.116 INFO:tasks.workunit.client.0.smithi087.stdout:3/264: dread - d6/d1b/d42/f44 zero size 2024-09-17T07:19:50.116 INFO:tasks.workunit.client.1.smithi139.stdout:1/142: dwrite f0 [0,4194304] 0 2024-09-17T07:19:50.117 INFO:tasks.workunit.client.0.smithi087.stdout:8/280: write d1/d7/d9/f61 [945071,8844] 0 2024-09-17T07:19:50.119 INFO:tasks.workunit.client.1.smithi139.stdout:6/316: dread db/df/f24 [0,4194304] 0 2024-09-17T07:19:50.120 INFO:tasks.workunit.client.0.smithi087.stdout:0/422: link db/f8c db/d45/d7b/f9d 0 2024-09-17T07:19:50.121 INFO:tasks.workunit.client.0.smithi087.stdout:0/423: write db/f38 [127008,100544] 0 2024-09-17T07:19:50.122 INFO:tasks.workunit.client.0.smithi087.stdout:0/424: chown db/f41 0 1 2024-09-17T07:19:50.123 INFO:tasks.workunit.client.1.smithi139.stdout:1/143: unlink d2/d10/d12/d1a/d25/f26 0 2024-09-17T07:19:50.123 INFO:tasks.workunit.client.0.smithi087.stdout:0/425: write db/d45/d5b/f6a [751692,33730] 0 2024-09-17T07:19:50.125 INFO:tasks.workunit.client.1.smithi139.stdout:1/144: read - d2/d10/d12/f20 zero size 2024-09-17T07:19:50.125 INFO:tasks.workunit.client.0.smithi087.stdout:8/281: mknod d1/d56/c67 0 2024-09-17T07:19:50.126 INFO:tasks.workunit.client.0.smithi087.stdout:0/426: write db/f29 [3527030,21245] 0 2024-09-17T07:19:50.131 INFO:tasks.workunit.client.1.smithi139.stdout:9/331: dread dc/d11/d15/d1e/f29 [0,4194304] 0 2024-09-17T07:19:50.134 INFO:tasks.workunit.client.0.smithi087.stdout:8/282: mkdir d1/d2b/d21/d68 0 2024-09-17T07:19:50.134 INFO:tasks.workunit.client.1.smithi139.stdout:9/332: getdents dc/d11/d15/d3c/d68 0 2024-09-17T07:19:50.136 INFO:tasks.workunit.client.0.smithi087.stdout:6/363: dread d1/fb [0,4194304] 0 2024-09-17T07:19:50.136 INFO:tasks.workunit.client.1.smithi139.stdout:9/333: read dc/d11/d15/d1e/f60 [190781,30141] 0 2024-09-17T07:19:50.140 INFO:tasks.workunit.client.0.smithi087.stdout:8/283: creat d1/d7/d9/d27/f69 x:0 0 0 2024-09-17T07:19:50.141 INFO:tasks.workunit.client.1.smithi139.stdout:9/334: dread dc/d11/d15/d1e/f21 [0,4194304] 0 2024-09-17T07:19:50.143 INFO:tasks.workunit.client.0.smithi087.stdout:6/364: dwrite d1/d6/d1a/f41 [0,4194304] 0 2024-09-17T07:19:50.144 INFO:tasks.workunit.client.0.smithi087.stdout:6/365: readlink d1/d6/l17 0 2024-09-17T07:19:50.145 INFO:tasks.workunit.client.0.smithi087.stdout:8/284: creat d1/d7/d9/d19/d1b/d18/d23/d54/f6a x:0 0 0 2024-09-17T07:19:50.147 INFO:tasks.workunit.client.0.smithi087.stdout:6/366: read d1/d6/d1a/f36 [928338,84602] 0 2024-09-17T07:19:50.147 INFO:tasks.workunit.client.1.smithi139.stdout:9/335: unlink dc/d11/d15/f5c 0 2024-09-17T07:19:50.148 INFO:tasks.workunit.client.1.smithi139.stdout:8/213: dwrite d0/d1a/f21 [0,4194304] 0 2024-09-17T07:19:50.148 INFO:tasks.workunit.client.0.smithi087.stdout:8/285: mknod d1/d7/d9/d27/c6b 0 2024-09-17T07:19:50.149 INFO:tasks.workunit.client.1.smithi139.stdout:9/336: dread - dc/d2c/f62 zero size 2024-09-17T07:19:50.149 INFO:tasks.workunit.client.0.smithi087.stdout:6/367: symlink d1/d6/d1a/d2c/d40/d4c/l7e 0 2024-09-17T07:19:50.151 INFO:tasks.workunit.client.0.smithi087.stdout:8/286: creat d1/d2b/f6c x:0 0 0 2024-09-17T07:19:50.151 INFO:tasks.workunit.client.0.smithi087.stdout:6/368: symlink d1/d6/d1a/d4e/l7f 0 2024-09-17T07:19:50.153 INFO:tasks.workunit.client.1.smithi139.stdout:9/337: mknod dc/d11/d15/d3c/d68/c6c 0 2024-09-17T07:19:50.157 INFO:tasks.workunit.client.1.smithi139.stdout:9/338: symlink dc/d2c/l6d 0 2024-09-17T07:19:50.159 INFO:tasks.workunit.client.1.smithi139.stdout:9/339: rmdir dc/d11/d15/d3c/d68 39 2024-09-17T07:19:50.161 INFO:tasks.workunit.client.0.smithi087.stdout:6/369: dwrite d1/d6/d1a/d2c/f59 [0,4194304] 0 2024-09-17T07:19:50.161 INFO:tasks.workunit.client.0.smithi087.stdout:0/427: rename db/d45/d5d/d63 to db/d45/d9e 0 2024-09-17T07:19:50.161 INFO:tasks.workunit.client.1.smithi139.stdout:6/317: truncate db/df/d4e/f55 1486729 0 2024-09-17T07:19:50.162 INFO:tasks.workunit.client.1.smithi139.stdout:9/340: chown dc/d11/d15/d1e/l37 65186090 1 2024-09-17T07:19:50.163 INFO:tasks.workunit.client.1.smithi139.stdout:1/145: write d2/d10/d12/d13/f17 [1671426,116472] 0 2024-09-17T07:19:50.163 INFO:tasks.workunit.client.1.smithi139.stdout:9/341: stat dc/d11/d15/f50 0 2024-09-17T07:19:50.166 INFO:tasks.workunit.client.1.smithi139.stdout:9/342: fdatasync dc/d11/f1b 0 2024-09-17T07:19:50.166 INFO:tasks.workunit.client.0.smithi087.stdout:8/287: rename d1/d56 to d1/d2b/d21/d6d 0 2024-09-17T07:19:50.167 INFO:tasks.workunit.client.0.smithi087.stdout:0/428: creat db/d45/d7b/f9f x:0 0 0 2024-09-17T07:19:50.168 INFO:tasks.workunit.client.1.smithi139.stdout:1/146: link d2/fd d2/d10/d12/d1a/d25/d2b/f2c 0 2024-09-17T07:19:50.169 INFO:tasks.workunit.client.0.smithi087.stdout:6/370: mknod d1/d67/c80 0 2024-09-17T07:19:50.169 INFO:tasks.workunit.client.1.smithi139.stdout:9/343: symlink dc/d2a/l6e 0 2024-09-17T07:19:50.170 INFO:tasks.workunit.client.1.smithi139.stdout:6/318: dwrite db/df/f24 [0,4194304] 0 2024-09-17T07:19:50.172 INFO:tasks.workunit.client.0.smithi087.stdout:6/371: stat d1/d6/d1a/d2c/c39 0 2024-09-17T07:19:50.173 INFO:tasks.workunit.client.1.smithi139.stdout:1/147: creat d2/d10/d12/f2d x:0 0 0 2024-09-17T07:19:50.174 INFO:tasks.workunit.client.1.smithi139.stdout:1/148: stat f0 0 2024-09-17T07:19:50.175 INFO:tasks.workunit.client.0.smithi087.stdout:0/429: link db/f35 db/d45/d7b/d7e/fa0 0 2024-09-17T07:19:50.175 INFO:tasks.workunit.client.1.smithi139.stdout:6/319: rename db/d21/d46 to db/df/d4e/d64 0 2024-09-17T07:19:50.176 INFO:tasks.workunit.client.0.smithi087.stdout:0/430: chown db/f17 141 1 2024-09-17T07:19:50.177 INFO:tasks.workunit.client.1.smithi139.stdout:1/149: dread d2/f6 [4194304,4194304] 0 2024-09-17T07:19:50.178 INFO:tasks.workunit.client.1.smithi139.stdout:9/344: unlink dc/d11/d15/d1e/d53/l55 0 2024-09-17T07:19:50.179 INFO:tasks.workunit.client.0.smithi087.stdout:8/288: rename d1/d7/d9/d19/d1b/f34 to d1/d2b/f6e 0 2024-09-17T07:19:50.179 INFO:tasks.workunit.client.0.smithi087.stdout:3/265: write d6/fc [1306262,36577] 0 2024-09-17T07:19:50.180 INFO:tasks.workunit.client.1.smithi139.stdout:6/320: creat db/df/d4c/f65 x:0 0 0 2024-09-17T07:19:50.181 INFO:tasks.workunit.client.0.smithi087.stdout:6/372: write d1/f16 [3997956,8418] 0 2024-09-17T07:19:50.181 INFO:tasks.workunit.client.0.smithi087.stdout:3/266: write d6/d15/f19 [1161781,57293] 0 2024-09-17T07:19:50.182 INFO:tasks.workunit.client.0.smithi087.stdout:0/431: fdatasync db/f18 0 2024-09-17T07:19:50.183 INFO:tasks.workunit.client.0.smithi087.stdout:0/432: fsync db/f27 0 2024-09-17T07:19:50.184 INFO:tasks.workunit.client.0.smithi087.stdout:0/433: chown db/f42 1661 1 2024-09-17T07:19:50.188 INFO:tasks.workunit.client.0.smithi087.stdout:8/289: fdatasync d1/f2a 0 2024-09-17T07:19:50.190 INFO:tasks.workunit.client.1.smithi139.stdout:1/150: getdents d2/d10/d12/d24 0 2024-09-17T07:19:50.192 INFO:tasks.workunit.client.1.smithi139.stdout:9/345: creat dc/d11/d15/d3c/d68/f6f x:0 0 0 2024-09-17T07:19:50.194 INFO:tasks.workunit.client.1.smithi139.stdout:6/321: creat db/df/d4e/d64/d56/f66 x:0 0 0 2024-09-17T07:19:50.195 INFO:tasks.workunit.client.1.smithi139.stdout:8/214: truncate d0/dc/f10 4827386 0 2024-09-17T07:19:50.195 INFO:tasks.workunit.client.0.smithi087.stdout:0/434: link db/d45/d9e/d95/c9b db/d45/d5b/d92/ca1 0 2024-09-17T07:19:50.197 INFO:tasks.workunit.client.0.smithi087.stdout:6/373: getdents d1/d6 0 2024-09-17T07:19:50.197 INFO:tasks.workunit.client.1.smithi139.stdout:8/215: write d0/d1a/f39 [698510,70575] 0 2024-09-17T07:19:50.198 INFO:tasks.workunit.client.0.smithi087.stdout:6/374: write d1/d6/f12 [2755665,66307] 0 2024-09-17T07:19:50.199 INFO:tasks.workunit.client.0.smithi087.stdout:6/375: read - d1/f79 zero size 2024-09-17T07:19:50.199 INFO:tasks.workunit.client.0.smithi087.stdout:0/435: mknod db/d45/d7b/d7e/ca2 0 2024-09-17T07:19:50.199 INFO:tasks.workunit.client.1.smithi139.stdout:1/151: dwrite d2/d10/d12/d1a/f21 [0,4194304] 0 2024-09-17T07:19:50.200 INFO:tasks.workunit.client.1.smithi139.stdout:9/346: creat dc/d11/d15/d3c/d61/d64/f70 x:0 0 0 2024-09-17T07:19:50.202 INFO:tasks.workunit.client.0.smithi087.stdout:8/290: getdents d1/d7/d9/d19/d1b/d18/d23/d54 0 2024-09-17T07:19:50.203 INFO:tasks.workunit.client.1.smithi139.stdout:1/152: dread - d2/d10/d12/f23 zero size 2024-09-17T07:19:50.203 INFO:tasks.workunit.client.1.smithi139.stdout:9/347: creat dc/d2a/f71 x:0 0 0 2024-09-17T07:19:50.205 INFO:tasks.workunit.client.0.smithi087.stdout:0/436: getdents db/d45/d5d 0 2024-09-17T07:19:50.205 INFO:tasks.workunit.client.0.smithi087.stdout:6/376: getdents d1/d6/d1a/d2c/d48/d62 0 2024-09-17T07:19:50.206 INFO:tasks.workunit.client.1.smithi139.stdout:6/322: dwrite db/d18/f48 [0,4194304] 0 2024-09-17T07:19:50.207 INFO:tasks.workunit.client.0.smithi087.stdout:0/437: chown db/l3d 87884854 1 2024-09-17T07:19:50.210 INFO:tasks.workunit.client.0.smithi087.stdout:6/377: mknod d1/d6/d1a/d2c/d58/c81 0 2024-09-17T07:19:50.210 INFO:tasks.workunit.client.1.smithi139.stdout:1/153: truncate d2/f6 1031524 0 2024-09-17T07:19:50.212 INFO:tasks.workunit.client.1.smithi139.stdout:6/323: creat db/df/d4e/d64/d54/d40/f67 x:0 0 0 2024-09-17T07:19:50.213 INFO:tasks.workunit.client.0.smithi087.stdout:8/291: dwrite d1/d7/f2d [0,4194304] 0 2024-09-17T07:19:50.213 INFO:tasks.workunit.client.1.smithi139.stdout:9/348: dread dc/d11/d15/d3c/f3d [0,4194304] 0 2024-09-17T07:19:50.213 INFO:tasks.workunit.client.1.smithi139.stdout:1/154: mknod d2/c2e 0 2024-09-17T07:19:50.214 INFO:tasks.workunit.client.1.smithi139.stdout:6/324: chown db/d21/l4b 1 1 2024-09-17T07:19:50.215 INFO:tasks.workunit.client.0.smithi087.stdout:6/378: read - d1/f42 zero size 2024-09-17T07:19:50.216 INFO:tasks.workunit.client.0.smithi087.stdout:3/267: dread d6/d16/f26 [4194304,4194304] 0 2024-09-17T07:19:50.216 INFO:tasks.workunit.client.0.smithi087.stdout:8/292: fdatasync d1/d7/d9/d19/d1b/d18/d23/d54/f6a 0 2024-09-17T07:19:50.217 INFO:tasks.workunit.client.0.smithi087.stdout:8/293: fsync d1/d2b/d3b/d53/f5b 0 2024-09-17T07:19:50.218 INFO:tasks.workunit.client.1.smithi139.stdout:9/349: truncate dc/d11/d15/d1e/f23 1084039 0 2024-09-17T07:19:50.218 INFO:tasks.workunit.client.0.smithi087.stdout:8/294: stat d1/d7/d9/l49 0 2024-09-17T07:19:50.219 INFO:tasks.workunit.client.0.smithi087.stdout:6/379: creat d1/d6/d1a/d4e/f82 x:0 0 0 2024-09-17T07:19:50.220 INFO:tasks.workunit.client.0.smithi087.stdout:3/268: fdatasync d6/d1b/d42/f3d 0 2024-09-17T07:19:50.221 INFO:tasks.workunit.client.0.smithi087.stdout:6/380: chown d1/d6/d1a/d2c/c39 59587 1 2024-09-17T07:19:50.221 INFO:tasks.workunit.client.0.smithi087.stdout:0/438: truncate db/f3e 3300857 0 2024-09-17T07:19:50.223 INFO:tasks.workunit.client.0.smithi087.stdout:6/381: write d1/d6/f12 [2183874,101776] 0 2024-09-17T07:19:50.223 INFO:tasks.workunit.client.0.smithi087.stdout:8/295: mkdir d1/d2b/d21/d6d/d6f 0 2024-09-17T07:19:50.223 INFO:tasks.workunit.client.1.smithi139.stdout:6/325: getdents db/d18/d5b 0 2024-09-17T07:19:50.225 INFO:tasks.workunit.client.0.smithi087.stdout:3/269: write d6/f27 [1182045,96566] 0 2024-09-17T07:19:50.227 INFO:tasks.workunit.client.1.smithi139.stdout:6/326: creat db/df/d4e/f68 x:0 0 0 2024-09-17T07:19:50.227 INFO:tasks.workunit.client.0.smithi087.stdout:0/439: mkdir db/da3 0 2024-09-17T07:19:50.229 INFO:tasks.workunit.client.0.smithi087.stdout:0/440: write db/f21 [1688231,127823] 0 2024-09-17T07:19:50.230 INFO:tasks.workunit.client.0.smithi087.stdout:0/441: readlink db/l16 0 2024-09-17T07:19:50.231 INFO:tasks.workunit.client.1.smithi139.stdout:6/327: truncate db/df/d4e/d64/d54/d40/f67 408079 0 2024-09-17T07:19:50.232 INFO:tasks.workunit.client.1.smithi139.stdout:8/216: dwrite d0/dc/f27 [0,4194304] 0 2024-09-17T07:19:50.234 INFO:tasks.workunit.client.0.smithi087.stdout:8/296: dread d1/d7/d9/d19/d1b/d18/d23/f44 [0,4194304] 0 2024-09-17T07:19:50.234 INFO:tasks.workunit.client.0.smithi087.stdout:2/333: sync 2024-09-17T07:19:50.235 INFO:tasks.workunit.client.0.smithi087.stdout:7/244: sync 2024-09-17T07:19:50.235 INFO:tasks.workunit.client.0.smithi087.stdout:4/284: sync 2024-09-17T07:19:50.235 INFO:tasks.workunit.client.0.smithi087.stdout:9/212: sync 2024-09-17T07:19:50.235 INFO:tasks.workunit.client.0.smithi087.stdout:3/270: getdents d6/d15/d37/d3c 0 2024-09-17T07:19:50.236 INFO:tasks.workunit.client.0.smithi087.stdout:9/213: chown d3/d4/d16 118048 1 2024-09-17T07:19:50.237 INFO:tasks.workunit.client.1.smithi139.stdout:6/328: dread db/d21/f31 [0,4194304] 0 2024-09-17T07:19:50.239 INFO:tasks.workunit.client.0.smithi087.stdout:4/285: dread - d2/d22/d2c/d3f/d4d/f64 zero size 2024-09-17T07:19:50.239 INFO:tasks.workunit.client.1.smithi139.stdout:6/329: readlink db/df/d4c/l59 0 2024-09-17T07:19:50.239 INFO:tasks.workunit.client.0.smithi087.stdout:2/334: read - d2/d7/dd/d10/f5a zero size 2024-09-17T07:19:50.240 INFO:tasks.workunit.client.1.smithi139.stdout:9/350: truncate dc/d2a/f4c 422236 0 2024-09-17T07:19:50.243 INFO:tasks.workunit.client.1.smithi139.stdout:9/351: write dc/d11/d15/d1e/f21 [4188962,43139] 0 2024-09-17T07:19:50.243 INFO:tasks.workunit.client.0.smithi087.stdout:6/382: write d1/d6/d1a/d2c/d40/f4d [2452125,124085] 0 2024-09-17T07:19:50.244 INFO:tasks.workunit.client.1.smithi139.stdout:9/352: stat dc/f5b 0 2024-09-17T07:19:50.244 INFO:tasks.workunit.client.0.smithi087.stdout:9/214: mkdir d3/d25/d4c 0 2024-09-17T07:19:50.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.240+0000 7f38664c5640 1 -- 172.21.15.87:0/470862986 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3860100bd0 con 0x7f38600fc700 2024-09-17T07:19:50.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.241+0000 7f385cff9640 1 -- 172.21.15.87:0/470862986 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+853 (secure 0 0 0) 0x7f3854056f10 con 0x7f38600fc700 2024-09-17T07:19:50.245 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T07:19:50.245 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": { 2024-09-17T07:19:50.245 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 2 2024-09-17T07:19:50.245 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:19:50.245 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr": { 2024-09-17T07:19:50.245 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 1, 2024-09-17T07:19:50.245 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 1 2024-09-17T07:19:50.245 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:19:50.246 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": { 2024-09-17T07:19:50.246 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 6 2024-09-17T07:19:50.246 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:19:50.246 INFO:teuthology.orchestra.run.smithi087.stdout: "mds": { 2024-09-17T07:19:50.246 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 4 2024-09-17T07:19:50.246 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:19:50.246 INFO:teuthology.orchestra.run.smithi087.stdout: "overall": { 2024-09-17T07:19:50.246 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 13, 2024-09-17T07:19:50.246 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 1 2024-09-17T07:19:50.246 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T07:19:50.246 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T07:19:50.247 INFO:tasks.workunit.client.0.smithi087.stdout:7/245: mknod d0/d3/d10/d31/c4f 0 2024-09-17T07:19:50.247 INFO:tasks.workunit.client.0.smithi087.stdout:0/442: dwrite db/f38 [0,4194304] 0 2024-09-17T07:19:50.247 INFO:tasks.workunit.client.1.smithi139.stdout:6/330: truncate f7 3251057 0 2024-09-17T07:19:50.248 INFO:tasks.workunit.client.0.smithi087.stdout:3/271: creat d6/d15/d37/f55 x:0 0 0 2024-09-17T07:19:50.248 INFO:tasks.workunit.client.0.smithi087.stdout:9/215: creat d3/f4d x:0 0 0 2024-09-17T07:19:50.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.247+0000 7f38664c5640 1 -- 172.21.15.87:0/470862986 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f384806dbd0 msgr2=0x7f3848070080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:19:50.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.247+0000 7f38664c5640 1 --2- 172.21.15.87:0/470862986 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f384806dbd0 0x7f3848070080 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3850000c00 tx=0x7f3850035040 comp rx=0 tx=0).stop 2024-09-17T07:19:50.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.247+0000 7f38664c5640 1 -- 172.21.15.87:0/470862986 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38600fc700 msgr2=0x7f386010f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:19:50.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.247+0000 7f38664c5640 1 --2- 172.21.15.87:0/470862986 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38600fc700 0x7f386010f710 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f3854002a80 tx=0x7f3854004600 comp rx=0 tx=0).stop 2024-09-17T07:19:50.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.247+0000 7f38664c5640 1 -- 172.21.15.87:0/470862986 shutdown_connections 2024-09-17T07:19:50.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.247+0000 7f38664c5640 1 --2- 172.21.15.87:0/470862986 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f384806dbd0 0x7f3848070080 secure :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3850000c00 tx=0x7f3850035040 comp rx=0 tx=0).stop 2024-09-17T07:19:50.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.247+0000 7f38664c5640 1 --2- 172.21.15.87:0/470862986 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38600fc700 0x7f386010f710 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:50.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.247+0000 7f38664c5640 1 --2- 172.21.15.87:0/470862986 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f38600fb430 0x7f386010f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:50.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.247+0000 7f38664c5640 1 -- 172.21.15.87:0/470862986 >> 172.21.15.87:0/470862986 conn(0x7f38600f6c10 msgr2=0x7f38600f8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:19:50.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.248+0000 7f38664c5640 1 -- 172.21.15.87:0/470862986 shutdown_connections 2024-09-17T07:19:50.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.248+0000 7f38664c5640 1 -- 172.21.15.87:0/470862986 wait complete. 2024-09-17T07:19:50.250 INFO:tasks.workunit.client.1.smithi139.stdout:8/217: dwrite d0/dc/d18/f1f [0,4194304] 0 2024-09-17T07:19:50.251 INFO:tasks.workunit.client.0.smithi087.stdout:3/272: chown d6/d15/d37 1212 1 2024-09-17T07:19:50.252 INFO:tasks.workunit.client.1.smithi139.stdout:6/331: creat db/df/d4e/d64/d56/f69 x:0 0 0 2024-09-17T07:19:50.252 INFO:tasks.workunit.client.1.smithi139.stdout:9/353: link dc/lf dc/d11/d52/l72 0 2024-09-17T07:19:50.253 INFO:tasks.workunit.client.0.smithi087.stdout:4/286: dread d2/d22/d2c/d3f/d4d/f53 [0,4194304] 0 2024-09-17T07:19:50.253 INFO:tasks.workunit.client.0.smithi087.stdout:0/443: creat db/d45/d7b/d7e/fa4 x:0 0 0 2024-09-17T07:19:50.254 INFO:tasks.workunit.client.0.smithi087.stdout:9/216: mknod d3/d4/da/c4e 0 2024-09-17T07:19:50.254 INFO:tasks.workunit.client.0.smithi087.stdout:9/217: stat f2 0 2024-09-17T07:19:50.255 INFO:tasks.workunit.client.1.smithi139.stdout:9/354: chown dc/d2c/l3a 7324 1 2024-09-17T07:19:50.257 INFO:tasks.workunit.client.1.smithi139.stdout:9/355: rmdir dc/d11/d52 39 2024-09-17T07:19:50.257 INFO:tasks.workunit.client.1.smithi139.stdout:6/332: mknod db/df/d4e/d64/c6a 0 2024-09-17T07:19:50.257 INFO:tasks.workunit.client.0.smithi087.stdout:7/246: truncate d0/d3/f4 570512 0 2024-09-17T07:19:50.258 INFO:tasks.workunit.client.0.smithi087.stdout:3/273: readlink d6/d1b/l3a 0 2024-09-17T07:19:50.258 INFO:tasks.workunit.client.0.smithi087.stdout:7/247: chown d0/d36/c45 76160364 1 2024-09-17T07:19:50.259 INFO:tasks.workunit.client.0.smithi087.stdout:0/444: creat db/d45/d7b/fa5 x:0 0 0 2024-09-17T07:19:50.259 INFO:tasks.workunit.client.1.smithi139.stdout:8/218: dwrite d0/f2a [0,4194304] 0 2024-09-17T07:19:50.260 INFO:tasks.workunit.client.0.smithi087.stdout:3/274: write d6/d16/f4a [4265854,40852] 0 2024-09-17T07:19:50.260 INFO:tasks.workunit.client.1.smithi139.stdout:6/333: mknod db/df/c6b 0 2024-09-17T07:19:50.261 INFO:tasks.workunit.client.0.smithi087.stdout:0/445: readlink db/d45/d9e/d86/l88 0 2024-09-17T07:19:50.262 INFO:tasks.workunit.client.1.smithi139.stdout:8/219: fsync d0/d1a/f39 0 2024-09-17T07:19:50.263 INFO:tasks.workunit.client.0.smithi087.stdout:0/446: write db/d45/d9e/f6b [168246,15807] 0 2024-09-17T07:19:50.264 INFO:tasks.workunit.client.0.smithi087.stdout:0/447: fdatasync db/f4d 0 2024-09-17T07:19:50.265 INFO:tasks.workunit.client.1.smithi139.stdout:9/356: rename dc/d2c/l3a to dc/d2c/l73 0 2024-09-17T07:19:50.265 INFO:tasks.workunit.client.0.smithi087.stdout:7/248: rename d0/d3/d23/d2d/c3d to d0/d3/d23/d17/c50 0 2024-09-17T07:19:50.265 INFO:tasks.workunit.client.1.smithi139.stdout:9/357: fdatasync dc/d11/f4d 0 2024-09-17T07:19:50.266 INFO:tasks.workunit.client.0.smithi087.stdout:6/383: link d1/d6/l17 d1/d6/d1a/l83 0 2024-09-17T07:19:50.266 INFO:tasks.workunit.client.1.smithi139.stdout:6/334: read db/d18/f1a [11439572,109658] 0 2024-09-17T07:19:50.267 INFO:tasks.workunit.client.1.smithi139.stdout:8/220: chown d0/dc/l2d 126 1 2024-09-17T07:19:50.267 INFO:tasks.workunit.client.0.smithi087.stdout:7/249: truncate d0/f2e 811935 0 2024-09-17T07:19:50.267 INFO:tasks.workunit.client.0.smithi087.stdout:6/384: chown d1/f78 1731856 1 2024-09-17T07:19:50.268 INFO:tasks.workunit.client.0.smithi087.stdout:0/448: symlink db/d45/d7b/la6 0 2024-09-17T07:19:50.270 INFO:tasks.workunit.client.0.smithi087.stdout:0/449: creat db/d45/d5b/fa7 x:0 0 0 2024-09-17T07:19:50.272 INFO:tasks.workunit.client.1.smithi139.stdout:6/335: link db/d18/f48 db/d18/f6c 0 2024-09-17T07:19:50.272 INFO:tasks.workunit.client.0.smithi087.stdout:6/385: symlink d1/d6/d1a/d5e/l84 0 2024-09-17T07:19:50.273 INFO:tasks.workunit.client.0.smithi087.stdout:0/450: chown db/d4f/c74 634334 1 2024-09-17T07:19:50.274 INFO:tasks.workunit.client.1.smithi139.stdout:9/358: rename dc/d11/d52/c63 to dc/d11/c74 0 2024-09-17T07:19:50.274 INFO:tasks.workunit.client.1.smithi139.stdout:6/336: mknod db/df/d4e/d5e/c6d 0 2024-09-17T07:19:50.275 INFO:tasks.workunit.client.1.smithi139.stdout:9/359: write dc/d11/f1b [4606752,117924] 0 2024-09-17T07:19:50.276 INFO:tasks.workunit.client.0.smithi087.stdout:9/218: rmdir d3/d4 39 2024-09-17T07:19:50.276 INFO:tasks.workunit.client.0.smithi087.stdout:6/386: stat d1/d6/d1a/d2c/d58/l6d 0 2024-09-17T07:19:50.277 INFO:tasks.workunit.client.1.smithi139.stdout:6/337: creat db/d18/f6e x:0 0 0 2024-09-17T07:19:50.277 INFO:tasks.workunit.client.0.smithi087.stdout:2/335: truncate d2/f3 8260509 0 2024-09-17T07:19:50.279 INFO:tasks.workunit.client.1.smithi139.stdout:9/360: chown dc/d11/d15/d1e/d34/c4e 3030 1 2024-09-17T07:19:50.281 INFO:tasks.workunit.client.0.smithi087.stdout:2/336: fsync d2/d7/dd/f43 0 2024-09-17T07:19:50.281 INFO:tasks.workunit.client.0.smithi087.stdout:7/250: dwrite d0/d3/d10/f1a [0,4194304] 0 2024-09-17T07:19:50.281 INFO:tasks.workunit.client.0.smithi087.stdout:6/387: mknod d1/d6/d1a/d2c/d40/d4c/c85 0 2024-09-17T07:19:50.282 INFO:tasks.workunit.client.1.smithi139.stdout:9/361: mkdir dc/d11/d52/d56/d75 0 2024-09-17T07:19:50.284 INFO:tasks.workunit.client.1.smithi139.stdout:6/338: truncate db/d18/f48 2088043 0 2024-09-17T07:19:50.285 INFO:tasks.workunit.client.1.smithi139.stdout:8/221: dread d0/fb [0,4194304] 0 2024-09-17T07:19:50.287 INFO:tasks.workunit.client.0.smithi087.stdout:9/219: dread d3/d4/da/d1c/d1e/f31 [0,4194304] 0 2024-09-17T07:19:50.287 INFO:tasks.workunit.client.0.smithi087.stdout:3/275: dread d6/d1b/f3b [0,4194304] 0 2024-09-17T07:19:50.289 INFO:tasks.workunit.client.1.smithi139.stdout:6/339: symlink db/df/d4e/d64/d54/d40/l6f 0 2024-09-17T07:19:50.290 INFO:tasks.workunit.client.0.smithi087.stdout:6/388: creat d1/d6/d1a/d4e/f86 x:0 0 0 2024-09-17T07:19:50.290 INFO:tasks.workunit.client.0.smithi087.stdout:9/220: write d3/d4/d6/d8/d22/d43/f45 [345418,77480] 0 2024-09-17T07:19:50.290 INFO:tasks.workunit.client.0.smithi087.stdout:7/251: creat d0/d3/d23/d17/f51 x:0 0 0 2024-09-17T07:19:50.292 INFO:tasks.workunit.client.0.smithi087.stdout:7/252: stat d0/d3/d23/d17/f41 0 2024-09-17T07:19:50.293 INFO:tasks.workunit.client.1.smithi139.stdout:8/222: rename d0/f25 to d0/d20/d28/f3d 0 2024-09-17T07:19:50.293 INFO:tasks.workunit.client.0.smithi087.stdout:0/451: link db/d45/d7b/d7e/f8e db/d45/d5b/d92/fa8 0 2024-09-17T07:19:50.296 INFO:tasks.workunit.client.0.smithi087.stdout:2/337: creat d2/d7/d60/f65 x:0 0 0 2024-09-17T07:19:50.297 INFO:tasks.workunit.client.1.smithi139.stdout:8/223: mknod d0/dc/c3e 0 2024-09-17T07:19:50.299 INFO:tasks.workunit.client.0.smithi087.stdout:9/221: mknod d3/d4/d6/d8/d12/d32/c4f 0 2024-09-17T07:19:50.299 INFO:tasks.workunit.client.0.smithi087.stdout:0/452: chown db/d45/d9e/c94 851 1 2024-09-17T07:19:50.300 INFO:tasks.workunit.client.0.smithi087.stdout:7/253: mknod d0/d3/d23/d2d/c52 0 2024-09-17T07:19:50.301 INFO:tasks.workunit.client.1.smithi139.stdout:9/362: dwrite dc/d11/d15/d1e/f60 [0,4194304] 0 2024-09-17T07:19:50.301 INFO:tasks.workunit.client.0.smithi087.stdout:0/453: stat db/f31 0 2024-09-17T07:19:50.303 INFO:tasks.workunit.client.1.smithi139.stdout:9/363: write dc/d2c/f62 [674249,24826] 0 2024-09-17T07:19:50.303 INFO:tasks.workunit.client.0.smithi087.stdout:7/254: write d0/d3/d23/d17/f1e [4192056,110031] 0 2024-09-17T07:19:50.305 INFO:tasks.workunit.client.0.smithi087.stdout:2/338: mknod d2/d50/c66 0 2024-09-17T07:19:50.307 INFO:tasks.workunit.client.0.smithi087.stdout:0/454: truncate db/d45/f53 1327473 0 2024-09-17T07:19:50.307 INFO:tasks.workunit.client.0.smithi087.stdout:7/255: write d0/d3/d10/f14 [5834980,93058] 0 2024-09-17T07:19:50.310 INFO:tasks.workunit.client.1.smithi139.stdout:9/364: getdents dc/d11/d52 0 2024-09-17T07:19:50.310 INFO:tasks.workunit.client.0.smithi087.stdout:9/222: dwrite d3/f4d [0,4194304] 0 2024-09-17T07:19:50.311 INFO:tasks.workunit.client.1.smithi139.stdout:6/340: dwrite db/d18/f6c [0,4194304] 0 2024-09-17T07:19:50.313 INFO:tasks.workunit.client.1.smithi139.stdout:6/341: dread - db/df/d4e/d64/d56/f69 zero size 2024-09-17T07:19:50.313 INFO:tasks.workunit.client.1.smithi139.stdout:9/365: symlink dc/d11/d15/d1e/d34/l76 0 2024-09-17T07:19:50.314 INFO:tasks.workunit.client.0.smithi087.stdout:0/455: mknod db/d45/d5b/d92/ca9 0 2024-09-17T07:19:50.315 INFO:tasks.workunit.client.0.smithi087.stdout:0/456: chown db/d45/c85 67411 1 2024-09-17T07:19:50.315 INFO:tasks.workunit.client.0.smithi087.stdout:9/223: readlink d3/d4/da/lf 0 2024-09-17T07:19:50.317 INFO:tasks.workunit.client.1.smithi139.stdout:9/366: creat dc/d11/d52/f77 x:0 0 0 2024-09-17T07:19:50.317 INFO:tasks.workunit.client.0.smithi087.stdout:2/339: creat d2/f67 x:0 0 0 2024-09-17T07:19:50.317 INFO:tasks.workunit.client.0.smithi087.stdout:0/457: dread db/f42 [0,4194304] 0 2024-09-17T07:19:50.319 INFO:tasks.workunit.client.0.smithi087.stdout:2/340: write d2/d7/dd/d10/f5a [153749,79579] 0 2024-09-17T07:19:50.320 INFO:tasks.workunit.client.0.smithi087.stdout:2/341: readlink d2/d15/l63 0 2024-09-17T07:19:50.321 INFO:tasks.workunit.client.1.smithi139.stdout:9/367: link c8 dc/d11/d15/c78 0 2024-09-17T07:19:50.321 INFO:tasks.workunit.client.0.smithi087.stdout:9/224: unlink d3/d4/d16/c19 0 2024-09-17T07:19:50.322 INFO:tasks.workunit.client.1.smithi139.stdout:6/342: write f7 [2577939,96242] 0 2024-09-17T07:19:50.324 INFO:tasks.workunit.client.1.smithi139.stdout:9/368: creat dc/d11/d15/d1e/d53/f79 x:0 0 0 2024-09-17T07:19:50.324 INFO:tasks.workunit.client.0.smithi087.stdout:9/225: write d3/f7 [5017623,109364] 0 2024-09-17T07:19:50.324 INFO:tasks.workunit.client.0.smithi087.stdout:7/256: link d0/d3/d23/d17/f34 d0/d3/d23/f53 0 2024-09-17T07:19:50.327 INFO:tasks.workunit.client.0.smithi087.stdout:0/458: symlink db/d45/d7b/laa 0 2024-09-17T07:19:50.328 INFO:tasks.workunit.client.1.smithi139.stdout:9/369: dread dc/d11/d15/f50 [0,4194304] 0 2024-09-17T07:19:50.328 INFO:tasks.workunit.client.1.smithi139.stdout:8/224: dread d0/dc/d18/f1c [0,4194304] 0 2024-09-17T07:19:50.329 INFO:tasks.workunit.client.0.smithi087.stdout:3/276: truncate d6/fa 3954761 0 2024-09-17T07:19:50.329 INFO:tasks.workunit.client.1.smithi139.stdout:9/370: chown dc/d2c/l6d 3411 1 2024-09-17T07:19:50.329 INFO:tasks.workunit.client.1.smithi139.stdout:6/343: truncate db/d18/d1b/f37 977979 0 2024-09-17T07:19:50.330 INFO:tasks.workunit.client.1.smithi139.stdout:8/225: write d0/f2a [4835720,8630] 0 2024-09-17T07:19:50.331 INFO:tasks.workunit.client.1.smithi139.stdout:9/371: write dc/d2c/f5e [325052,47149] 0 2024-09-17T07:19:50.333 INFO:tasks.workunit.client.1.smithi139.stdout:9/372: write f4 [3153806,37535] 0 2024-09-17T07:19:50.333 INFO:tasks.workunit.client.0.smithi087.stdout:0/459: mknod db/d45/d9e/cab 0 2024-09-17T07:19:50.334 INFO:tasks.workunit.client.0.smithi087.stdout:9/226: write d3/d4/d2f/f3c [269055,79381] 0 2024-09-17T07:19:50.335 INFO:tasks.workunit.client.1.smithi139.stdout:9/373: mkdir dc/d11/d52/d56/d7a 0 2024-09-17T07:19:50.335 INFO:tasks.workunit.client.1.smithi139.stdout:9/374: dread - dc/f5b zero size 2024-09-17T07:19:50.336 INFO:tasks.workunit.client.1.smithi139.stdout:6/344: link db/df/c1f db/d18/c70 0 2024-09-17T07:19:50.337 INFO:tasks.workunit.client.0.smithi087.stdout:7/257: creat d0/d3/d23/f54 x:0 0 0 2024-09-17T07:19:50.337 INFO:tasks.workunit.client.0.smithi087.stdout:2/342: creat d2/d7/f68 x:0 0 0 2024-09-17T07:19:50.338 INFO:tasks.workunit.client.1.smithi139.stdout:6/345: symlink db/df/d4e/d64/d54/l71 0 2024-09-17T07:19:50.339 INFO:tasks.workunit.client.0.smithi087.stdout:3/277: symlink d6/d1b/l56 0 2024-09-17T07:19:50.340 INFO:tasks.workunit.client.1.smithi139.stdout:6/346: readlink db/df/d4e/d64/d54/l57 0 2024-09-17T07:19:50.340 INFO:tasks.workunit.client.0.smithi087.stdout:6/389: dwrite d1/f1d [0,4194304] 0 2024-09-17T07:19:50.343 INFO:tasks.workunit.client.0.smithi087.stdout:7/258: dread - d0/d3/d23/d17/f47 zero size 2024-09-17T07:19:50.344 INFO:tasks.workunit.client.0.smithi087.stdout:6/390: chown d1/d6/le 1234719 1 2024-09-17T07:19:50.345 INFO:tasks.workunit.client.0.smithi087.stdout:9/227: creat d3/d4/d6/d8/d22/f50 x:0 0 0 2024-09-17T07:19:50.346 INFO:tasks.workunit.client.1.smithi139.stdout:9/375: write dc/d2a/f4c [1146663,57510] 0 2024-09-17T07:19:50.347 INFO:tasks.workunit.client.0.smithi087.stdout:2/343: mkdir d2/d48/d69 0 2024-09-17T07:19:50.350 INFO:tasks.workunit.client.1.smithi139.stdout:9/376: truncate dc/f5b 476614 0 2024-09-17T07:19:50.350 INFO:tasks.workunit.client.1.smithi139.stdout:6/347: truncate db/df/d4e/f55 1598386 0 2024-09-17T07:19:50.353 INFO:tasks.workunit.client.0.smithi087.stdout:2/344: write d2/d24/d36/f39 [1392728,109511] 0 2024-09-17T07:19:50.354 INFO:tasks.workunit.client.1.smithi139.stdout:8/226: dwrite d0/fb [0,4194304] 0 2024-09-17T07:19:50.354 INFO:tasks.workunit.client.1.smithi139.stdout:6/348: creat db/d18/f72 x:0 0 0 2024-09-17T07:19:50.354 INFO:tasks.workunit.client.1.smithi139.stdout:8/227: chown d0/d1a/l33 27801 1 2024-09-17T07:19:50.355 INFO:tasks.workunit.client.0.smithi087.stdout:0/460: dwrite db/d45/f99 [0,4194304] 0 2024-09-17T07:19:50.356 INFO:tasks.workunit.client.0.smithi087.stdout:3/278: dread d6/f12 [0,4194304] 0 2024-09-17T07:19:50.357 INFO:tasks.workunit.client.1.smithi139.stdout:9/377: rename dc/c4b to dc/d11/d52/d56/d75/c7b 0 2024-09-17T07:19:50.359 INFO:tasks.workunit.client.0.smithi087.stdout:2/345: fdatasync d2/d24/d36/f49 0 2024-09-17T07:19:50.359 INFO:tasks.workunit.client.1.smithi139.stdout:8/228: creat d0/d1a/f3f x:0 0 0 2024-09-17T07:19:50.363 INFO:tasks.workunit.client.0.smithi087.stdout:0/461: creat db/d45/d5d/fac x:0 0 0 2024-09-17T07:19:50.363 INFO:tasks.workunit.client.0.smithi087.stdout:7/259: dwrite d0/f26 [0,4194304] 0 2024-09-17T07:19:50.365 INFO:tasks.workunit.client.0.smithi087.stdout:2/346: rmdir d2/d7/dd/d1f 39 2024-09-17T07:19:50.366 INFO:tasks.workunit.client.0.smithi087.stdout:9/228: dread d3/d4/fb [0,4194304] 0 2024-09-17T07:19:50.371 INFO:tasks.workunit.client.1.smithi139.stdout:8/229: truncate d0/dc/d18/f1f 1253124 0 2024-09-17T07:19:50.371 INFO:tasks.workunit.client.0.smithi087.stdout:9/229: creat d3/d4/da/d1c/f51 x:0 0 0 2024-09-17T07:19:50.372 INFO:tasks.workunit.client.0.smithi087.stdout:0/462: link db/f34 db/d45/d9e/d86/fad 0 2024-09-17T07:19:50.373 INFO:tasks.workunit.client.0.smithi087.stdout:3/279: creat d6/f57 x:0 0 0 2024-09-17T07:19:50.374 INFO:tasks.workunit.client.0.smithi087.stdout:7/260: symlink d0/d3/l55 0 2024-09-17T07:19:50.375 INFO:tasks.workunit.client.1.smithi139.stdout:9/378: dwrite dc/d11/d15/d1e/f23 [0,4194304] 0 2024-09-17T07:19:50.375 INFO:tasks.workunit.client.0.smithi087.stdout:2/347: mkdir d2/d7/dd/d6a 0 2024-09-17T07:19:50.378 INFO:tasks.workunit.client.1.smithi139.stdout:8/230: dread d0/dc/d18/f1c [0,4194304] 0 2024-09-17T07:19:50.379 INFO:tasks.workunit.client.1.smithi139.stdout:8/231: write d0/f2a [625508,124369] 0 2024-09-17T07:19:50.379 INFO:tasks.workunit.client.0.smithi087.stdout:2/348: rename d2/d7/l31 to d2/d7/d60/l6b 0 2024-09-17T07:19:50.380 INFO:tasks.workunit.client.1.smithi139.stdout:9/379: mkdir dc/d11/d15/d1e/d7c 0 2024-09-17T07:19:50.381 INFO:tasks.workunit.client.1.smithi139.stdout:8/232: symlink d0/d20/d28/l40 0 2024-09-17T07:19:50.382 INFO:tasks.workunit.client.0.smithi087.stdout:0/463: creat db/d45/fae x:0 0 0 2024-09-17T07:19:50.382 INFO:tasks.workunit.client.0.smithi087.stdout:9/230: dread d3/d4/d16/f1b [0,4194304] 0 2024-09-17T07:19:50.383 INFO:tasks.workunit.client.1.smithi139.stdout:8/233: mknod d0/dc/d18/c41 0 2024-09-17T07:19:50.385 INFO:tasks.workunit.client.1.smithi139.stdout:9/380: link ca dc/d11/d52/d56/d7a/c7d 0 2024-09-17T07:19:50.386 INFO:tasks.workunit.client.1.smithi139.stdout:8/234: creat d0/d1a/d3a/f42 x:0 0 0 2024-09-17T07:19:50.387 INFO:tasks.workunit.client.0.smithi087.stdout:2/349: mkdir d2/d7/dd/d10/d4c/d6c 0 2024-09-17T07:19:50.388 INFO:tasks.workunit.client.0.smithi087.stdout:6/391: dread d1/f16 [0,4194304] 0 2024-09-17T07:19:50.390 INFO:tasks.workunit.client.1.smithi139.stdout:9/381: dread dc/d11/d15/d1e/f21 [0,4194304] 0 2024-09-17T07:19:50.392 INFO:tasks.workunit.client.0.smithi087.stdout:0/464: creat db/faf x:0 0 0 2024-09-17T07:19:50.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.392+0000 7feb624aa640 1 -- 172.21.15.87:0/1803165843 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb5c0ff670 msgr2=0x7feb5c101a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:19:50.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.392+0000 7feb624aa640 1 --2- 172.21.15.87:0/1803165843 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb5c0ff670 0x7feb5c101a50 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7feb440048d0 tx=0x7feb44009da0 comp rx=0 tx=0).stop 2024-09-17T07:19:50.394 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:50 smithi087 ceph-mon[27636]: from='client.24399 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:19:50.394 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:50 smithi087 ceph-mon[27636]: pgmap v8: 65 pgs: 65 active+clean; 594 MiB data, 3.3 GiB used, 533 GiB / 536 GiB avail; 2.6 MiB/s rd, 57 MiB/s wr, 135 op/s 2024-09-17T07:19:50.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.392+0000 7feb624aa640 1 -- 172.21.15.87:0/1803165843 shutdown_connections 2024-09-17T07:19:50.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.392+0000 7feb624aa640 1 --2- 172.21.15.87:0/1803165843 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb5c0ff670 0x7feb5c101a50 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:50.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.392+0000 7feb624aa640 1 --2- 172.21.15.87:0/1803165843 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feb5c0664d0 0x7feb5c0ff130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:50.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.392+0000 7feb624aa640 1 -- 172.21.15.87:0/1803165843 >> 172.21.15.87:0/1803165843 conn(0x7feb5c0f6c00 msgr2=0x7feb5c0f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:19:50.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.393+0000 7feb624aa640 1 -- 172.21.15.87:0/1803165843 shutdown_connections 2024-09-17T07:19:50.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.393+0000 7feb624aa640 1 -- 172.21.15.87:0/1803165843 wait complete. 2024-09-17T07:19:50.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.393+0000 7feb624aa640 1 Processor -- start 2024-09-17T07:19:50.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.393+0000 7feb624aa640 1 -- start start 2024-09-17T07:19:50.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.393+0000 7feb624aa640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb5c0664d0 0x7feb5c10cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:19:50.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.393+0000 7feb624aa640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feb5c0ff670 0x7feb5c10d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:19:50.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.393+0000 7feb624aa640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb5c10db50 con 0x7feb5c0664d0 2024-09-17T07:19:50.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.394+0000 7feb624aa640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb5c10e370 con 0x7feb5c0ff670 2024-09-17T07:19:50.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.394+0000 7feb5bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb5c0664d0 0x7feb5c10cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:19:50.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.394+0000 7feb53fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feb5c0ff670 0x7feb5c10d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:19:50.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.394+0000 7feb53fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feb5c0ff670 0x7feb5c10d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.87:44854/0 (socket says 172.21.15.87:44854) 2024-09-17T07:19:50.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.394+0000 7feb53fff640 1 -- 172.21.15.87:0/3134113140 learned_addr learned my addr 172.21.15.87:0/3134113140 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:19:50.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.394+0000 7feb53fff640 1 -- 172.21.15.87:0/3134113140 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb5c0664d0 msgr2=0x7feb5c10cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:19:50.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.394+0000 7feb53fff640 1 --2- 172.21.15.87:0/3134113140 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb5c0664d0 0x7feb5c10cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:50.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.394+0000 7feb53fff640 1 -- 172.21.15.87:0/3134113140 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb44005040 con 0x7feb5c0ff670 2024-09-17T07:19:50.397 INFO:tasks.workunit.client.0.smithi087.stdout:6/392: rename d1/d6/d1a/c1b to d1/d6/d1a/d2c/d48/c87 0 2024-09-17T07:19:50.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.394+0000 7feb53fff640 1 --2- 172.21.15.87:0/3134113140 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feb5c0ff670 0x7feb5c10d500 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7feb44009ac0 tx=0x7feb44009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:19:50.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.395+0000 7feb597fa640 1 -- 172.21.15.87:0/3134113140 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb44038070 con 0x7feb5c0ff670 2024-09-17T07:19:50.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.395+0000 7feb624aa640 1 -- 172.21.15.87:0/3134113140 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb5c10e5a0 con 0x7feb5c0ff670 2024-09-17T07:19:50.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.395+0000 7feb597fa640 1 -- 172.21.15.87:0/3134113140 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7feb440096c0 con 0x7feb5c0ff670 2024-09-17T07:19:50.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.395+0000 7feb597fa640 1 -- 172.21.15.87:0/3134113140 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb4403d420 con 0x7feb5c0ff670 2024-09-17T07:19:50.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.395+0000 7feb624aa640 1 -- 172.21.15.87:0/3134113140 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb5c10eb40 con 0x7feb5c0ff670 2024-09-17T07:19:50.398 INFO:tasks.workunit.client.0.smithi087.stdout:9/231: getdents d3/d4/da 0 2024-09-17T07:19:50.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.396+0000 7feb624aa640 1 -- 172.21.15.87:0/3134113140 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb3c005240 con 0x7feb5c0ff670 2024-09-17T07:19:50.399 INFO:tasks.workunit.client.0.smithi087.stdout:3/280: truncate d6/f12 3929260 0 2024-09-17T07:19:50.400 INFO:tasks.workunit.client.1.smithi139.stdout:9/382: creat dc/d11/d15/d3c/f7e x:0 0 0 2024-09-17T07:19:50.400 INFO:tasks.workunit.client.1.smithi139.stdout:9/383: fdatasync dc/d11/d15/d1e/d53/f79 0 2024-09-17T07:19:50.400 INFO:tasks.workunit.client.1.smithi139.stdout:9/384: symlink dc/d11/l7f 0 2024-09-17T07:19:50.400 INFO:tasks.workunit.client.1.smithi139.stdout:8/235: truncate d0/d1a/f21 673200 0 2024-09-17T07:19:50.400 INFO:tasks.workunit.client.1.smithi139.stdout:8/236: fsync d0/d1a/f39 0 2024-09-17T07:19:50.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.397+0000 7feb597fa640 1 -- 172.21.15.87:0/3134113140 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 24) v1 ==== 90881+0+0 (secure 0 0 0) 0x7feb44030020 con 0x7feb5c0ff670 2024-09-17T07:19:50.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.398+0000 7feb597fa640 1 --2- 172.21.15.87:0/3134113140 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7feb4806dc40 0x7feb480700f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:19:50.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.398+0000 7feb597fa640 1 -- 172.21.15.87:0/3134113140 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7feb440ad450 con 0x7feb5c0ff670 2024-09-17T07:19:50.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.398+0000 7feb5bfff640 1 --2- 172.21.15.87:0/3134113140 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7feb4806dc40 0x7feb480700f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:19:50.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.399+0000 7feb5bfff640 1 --2- 172.21.15.87:0/3134113140 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7feb4806dc40 0x7feb480700f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7feb4c009af0 tx=0x7feb4c00b040 comp rx=0 tx=0).ready entity=mgr.24339 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:19:50.402 INFO:tasks.workunit.client.0.smithi087.stdout:7/261: truncate d0/d3/d10/f14 818202 0 2024-09-17T07:19:50.402 INFO:tasks.workunit.client.0.smithi087.stdout:9/232: unlink d3/d4/da/d1c/d1e/f31 0 2024-09-17T07:19:50.404 INFO:tasks.workunit.client.0.smithi087.stdout:9/233: write d3/d4/f26 [741082,118090] 0 2024-09-17T07:19:50.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.404+0000 7feb597fa640 1 -- 172.21.15.87:0/3134113140 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182127 (secure 0 0 0) 0x7feb440779f0 con 0x7feb5c0ff670 2024-09-17T07:19:50.406 INFO:tasks.workunit.client.1.smithi139.stdout:9/385: truncate dc/d11/d15/d1e/f21 3558663 0 2024-09-17T07:19:50.406 INFO:tasks.workunit.client.1.smithi139.stdout:8/237: truncate d0/f9 1023306 0 2024-09-17T07:19:50.407 INFO:tasks.workunit.client.0.smithi087.stdout:3/281: creat d6/d15/d37/d3c/d43/d48/f58 x:0 0 0 2024-09-17T07:19:50.407 INFO:tasks.workunit.client.1.smithi139.stdout:8/238: readlink d0/dc/d18/l2c 0 2024-09-17T07:19:50.411 INFO:tasks.workunit.client.1.smithi139.stdout:8/239: truncate d0/dc/d18/f1f 2114379 0 2024-09-17T07:19:50.412 INFO:tasks.workunit.client.1.smithi139.stdout:9/386: dread dc/d2a/f4c [0,4194304] 0 2024-09-17T07:19:50.412 INFO:tasks.workunit.client.1.smithi139.stdout:8/240: readlink d0/dc/l3c 0 2024-09-17T07:19:50.413 INFO:tasks.workunit.client.0.smithi087.stdout:3/282: fdatasync d6/d15/d37/d3c/d43/d48/f58 0 2024-09-17T07:19:50.413 INFO:tasks.workunit.client.0.smithi087.stdout:9/234: mknod d3/d4/da/d1c/c52 0 2024-09-17T07:19:50.414 INFO:tasks.workunit.client.0.smithi087.stdout:2/350: dwrite d2/d12/f2a [0,4194304] 0 2024-09-17T07:19:50.415 INFO:tasks.workunit.client.1.smithi139.stdout:9/387: symlink dc/d11/l80 0 2024-09-17T07:19:50.415 INFO:tasks.workunit.client.1.smithi139.stdout:8/241: truncate d0/dc/f10 3044372 0 2024-09-17T07:19:50.416 INFO:tasks.workunit.client.1.smithi139.stdout:8/242: readlink d0/d1a/l22 0 2024-09-17T07:19:50.416 INFO:tasks.workunit.client.0.smithi087.stdout:7/262: write d0/d3/d23/f53 [2380523,14752] 0 2024-09-17T07:19:50.416 INFO:tasks.workunit.client.0.smithi087.stdout:0/465: getdents db 0 2024-09-17T07:19:50.418 INFO:tasks.workunit.client.0.smithi087.stdout:6/393: dread d1/d6/d1a/d2c/f75 [0,4194304] 0 2024-09-17T07:19:50.420 INFO:tasks.workunit.client.1.smithi139.stdout:9/388: dread dc/d11/d15/d3c/f3f [0,4194304] 0 2024-09-17T07:19:50.420 INFO:tasks.workunit.client.0.smithi087.stdout:3/283: chown d6/d15/d37/l47 1604 1 2024-09-17T07:19:50.421 INFO:tasks.workunit.client.0.smithi087.stdout:2/351: chown d2/d7/d30 38145480 1 2024-09-17T07:19:50.422 INFO:tasks.workunit.client.0.smithi087.stdout:9/235: symlink d3/d25/l53 0 2024-09-17T07:19:50.422 INFO:tasks.workunit.client.0.smithi087.stdout:1/303: sync 2024-09-17T07:19:50.423 INFO:tasks.workunit.client.0.smithi087.stdout:6/394: rename d1/f79 to d1/d6/d1a/d2c/d48/f88 0 2024-09-17T07:19:50.424 INFO:tasks.workunit.client.1.smithi139.stdout:3/114: sync 2024-09-17T07:19:50.424 INFO:tasks.workunit.client.0.smithi087.stdout:7/263: truncate d0/f3b 3437621 0 2024-09-17T07:19:50.425 INFO:tasks.workunit.client.0.smithi087.stdout:9/236: rmdir d3/d4 39 2024-09-17T07:19:50.427 INFO:tasks.workunit.client.0.smithi087.stdout:1/304: symlink d2/l75 0 2024-09-17T07:19:50.428 INFO:tasks.workunit.client.0.smithi087.stdout:6/395: creat d1/d6/d1a/d2c/d33/f89 x:0 0 0 2024-09-17T07:19:50.429 INFO:tasks.workunit.client.1.smithi139.stdout:8/243: truncate d0/f7 3505223 0 2024-09-17T07:19:50.430 INFO:tasks.workunit.client.1.smithi139.stdout:8/244: chown d0/dc/d18/f38 727 1 2024-09-17T07:19:50.430 INFO:tasks.workunit.client.1.smithi139.stdout:9/389: write dc/d11/d15/d3c/f45 [1343332,58920] 0 2024-09-17T07:19:50.431 INFO:tasks.workunit.client.0.smithi087.stdout:7/264: dread d0/f2 [0,4194304] 0 2024-09-17T07:19:50.431 INFO:tasks.workunit.client.1.smithi139.stdout:8/245: dread - d0/d1a/f3f zero size 2024-09-17T07:19:50.432 INFO:tasks.workunit.client.0.smithi087.stdout:9/237: write d3/d4/da/d1c/f21 [1579148,63456] 0 2024-09-17T07:19:50.433 INFO:tasks.workunit.client.0.smithi087.stdout:2/352: getdents d2/d7/dd/d10/d4c/d5f 0 2024-09-17T07:19:50.433 INFO:tasks.workunit.client.1.smithi139.stdout:3/115: truncate f4 1037556 0 2024-09-17T07:19:50.434 INFO:tasks.workunit.client.1.smithi139.stdout:8/246: chown d0/dc/d18/l26 86 1 2024-09-17T07:19:50.435 INFO:tasks.workunit.client.0.smithi087.stdout:6/396: mkdir d1/d6/d1a/d8a 0 2024-09-17T07:19:50.435 INFO:tasks.workunit.client.1.smithi139.stdout:8/247: fsync d0/d1a/d3a/f42 0 2024-09-17T07:19:50.437 INFO:tasks.workunit.client.1.smithi139.stdout:3/116: creat d5/f26 x:0 0 0 2024-09-17T07:19:50.437 INFO:tasks.workunit.client.1.smithi139.stdout:3/117: stat d5/c1b 0 2024-09-17T07:19:50.439 INFO:tasks.workunit.client.1.smithi139.stdout:9/390: link dc/d11/c40 dc/d11/d52/d56/d7a/c81 0 2024-09-17T07:19:50.439 INFO:tasks.workunit.client.1.smithi139.stdout:8/248: link d0/d1a/l33 d0/d1a/l43 0 2024-09-17T07:19:50.440 INFO:tasks.workunit.client.0.smithi087.stdout:2/353: dwrite d2/d15/f21 [0,4194304] 0 2024-09-17T07:19:50.440 INFO:tasks.workunit.client.1.smithi139.stdout:8/249: chown d0/dc/c3e 1256 1 2024-09-17T07:19:50.446 INFO:tasks.workunit.client.0.smithi087.stdout:6/397: write d1/d6/d1a/d2c/d48/f88 [647761,90159] 0 2024-09-17T07:19:50.446 INFO:tasks.workunit.client.0.smithi087.stdout:9/238: mknod d3/d25/d4c/c54 0 2024-09-17T07:19:50.446 INFO:tasks.workunit.client.0.smithi087.stdout:7/265: rename d0/d3/f2a to d0/d3/d10/d32/f56 0 2024-09-17T07:19:50.447 INFO:tasks.workunit.client.1.smithi139.stdout:9/391: dwrite dc/f3e [0,4194304] 0 2024-09-17T07:19:50.450 INFO:tasks.workunit.client.1.smithi139.stdout:8/250: dwrite d0/dc/f27 [0,4194304] 0 2024-09-17T07:19:50.451 INFO:tasks.workunit.client.1.smithi139.stdout:9/392: chown dc/d2c/l73 775405403 1 2024-09-17T07:19:50.452 INFO:tasks.workunit.client.0.smithi087.stdout:9/239: rmdir d3/d4/d6/d8 39 2024-09-17T07:19:50.453 INFO:tasks.workunit.client.0.smithi087.stdout:1/305: read - d2/da/f6b zero size 2024-09-17T07:19:50.455 INFO:tasks.workunit.client.1.smithi139.stdout:8/251: symlink d0/dc/l44 0 2024-09-17T07:19:50.455 INFO:tasks.workunit.client.0.smithi087.stdout:7/266: mknod d0/d36/c57 0 2024-09-17T07:19:50.457 INFO:tasks.workunit.client.1.smithi139.stdout:8/252: read d0/f9 [470117,41837] 0 2024-09-17T07:19:50.459 INFO:tasks.workunit.client.0.smithi087.stdout:0/466: dwrite db/f59 [0,4194304] 0 2024-09-17T07:19:50.459 INFO:tasks.workunit.client.1.smithi139.stdout:9/393: getdents dc/d2c 0 2024-09-17T07:19:50.461 INFO:tasks.workunit.client.1.smithi139.stdout:9/394: write dc/d11/d15/d3c/f5d [537368,50604] 0 2024-09-17T07:19:50.461 INFO:tasks.workunit.client.1.smithi139.stdout:8/253: mknod d0/dc/d18/c45 0 2024-09-17T07:19:50.464 INFO:tasks.workunit.client.0.smithi087.stdout:6/398: dwrite d1/d6/d1a/d2c/f52 [4194304,4194304] 0 2024-09-17T07:19:50.465 INFO:tasks.workunit.client.1.smithi139.stdout:3/118: dread f4 [0,4194304] 0 2024-09-17T07:19:50.465 INFO:tasks.workunit.client.0.smithi087.stdout:0/467: write db/f2e [3672120,14062] 0 2024-09-17T07:19:50.465 INFO:tasks.workunit.client.1.smithi139.stdout:3/119: fsync d5/f1d 0 2024-09-17T07:19:50.467 INFO:tasks.workunit.client.0.smithi087.stdout:6/399: readlink d1/d67/l76 0 2024-09-17T07:19:50.467 INFO:tasks.workunit.client.1.smithi139.stdout:3/120: fsync d5/d13/f1a 0 2024-09-17T07:19:50.468 INFO:tasks.workunit.client.0.smithi087.stdout:9/240: fdatasync d3/d4/d6/d8/d22/f50 0 2024-09-17T07:19:50.469 INFO:tasks.workunit.client.1.smithi139.stdout:9/395: dwrite dc/d11/f1b [4194304,4194304] 0 2024-09-17T07:19:50.473 INFO:tasks.workunit.client.1.smithi139.stdout:9/396: creat dc/d11/d15/d3c/d61/d64/f82 x:0 0 0 2024-09-17T07:19:50.474 INFO:tasks.workunit.client.1.smithi139.stdout:9/397: dread dc/f5b [0,4194304] 0 2024-09-17T07:19:50.475 INFO:tasks.workunit.client.0.smithi087.stdout:0/468: mkdir db/d45/d7b/db0 0 2024-09-17T07:19:50.475 INFO:tasks.workunit.client.0.smithi087.stdout:9/241: rename d3/d4/d6/f4a to d3/d4/da/f55 0 2024-09-17T07:19:50.476 INFO:tasks.workunit.client.0.smithi087.stdout:7/267: mknod d0/d3/d23/d4e/c58 0 2024-09-17T07:19:50.476 INFO:tasks.workunit.client.1.smithi139.stdout:9/398: write dc/d11/d15/d1e/d53/f79 [89517,51791] 0 2024-09-17T07:19:50.477 INFO:tasks.workunit.client.0.smithi087.stdout:6/400: creat d1/d6/d1a/d2c/d48/d64/f8b x:0 0 0 2024-09-17T07:19:50.478 INFO:tasks.workunit.client.1.smithi139.stdout:9/399: readlink dc/d11/d15/l54 0 2024-09-17T07:19:50.479 INFO:tasks.workunit.client.0.smithi087.stdout:0/469: creat db/fb1 x:0 0 0 2024-09-17T07:19:50.481 INFO:tasks.workunit.client.1.smithi139.stdout:9/400: mkdir dc/d11/d15/d1e/d7c/d83 0 2024-09-17T07:19:50.481 INFO:tasks.workunit.client.1.smithi139.stdout:3/121: dread d5/f11 [0,4194304] 0 2024-09-17T07:19:50.482 INFO:tasks.workunit.client.0.smithi087.stdout:7/268: mknod d0/d36/c59 0 2024-09-17T07:19:50.482 INFO:tasks.workunit.client.0.smithi087.stdout:2/354: dread d2/d7/dd/d10/f53 [0,4194304] 0 2024-09-17T07:19:50.482 INFO:tasks.workunit.client.1.smithi139.stdout:3/122: readlink d5/ld 0 2024-09-17T07:19:50.483 INFO:tasks.workunit.client.1.smithi139.stdout:3/123: fsync f2 0 2024-09-17T07:19:50.484 INFO:tasks.workunit.client.1.smithi139.stdout:3/124: write f2 [2896657,39625] 0 2024-09-17T07:19:50.485 INFO:tasks.workunit.client.1.smithi139.stdout:9/401: creat dc/d11/d15/d1e/d7c/d83/f84 x:0 0 0 2024-09-17T07:19:50.485 INFO:tasks.workunit.client.0.smithi087.stdout:1/306: getdents d2/d3d/d35 0 2024-09-17T07:19:50.486 INFO:tasks.workunit.client.1.smithi139.stdout:3/125: unlink d5/c6 0 2024-09-17T07:19:50.486 INFO:tasks.workunit.client.1.smithi139.stdout:9/402: dread dc/d11/d15/f50 [0,4194304] 0 2024-09-17T07:19:50.488 INFO:tasks.workunit.client.0.smithi087.stdout:7/269: chown d0/d3/d23/d17/f34 13 1 2024-09-17T07:19:50.488 INFO:tasks.workunit.client.1.smithi139.stdout:9/403: write dc/d11/d15/d3c/f5d [794627,24452] 0 2024-09-17T07:19:50.488 INFO:tasks.workunit.client.1.smithi139.stdout:3/126: mknod d5/d21/c27 0 2024-09-17T07:19:50.490 INFO:tasks.workunit.client.0.smithi087.stdout:1/307: write d2/dc/f3b [1769481,122436] 0 2024-09-17T07:19:50.493 INFO:tasks.workunit.client.1.smithi139.stdout:3/127: mkdir d5/d15/d20/d22/d28 0 2024-09-17T07:19:50.493 INFO:tasks.workunit.client.1.smithi139.stdout:3/128: stat d5/cf 0 2024-09-17T07:19:50.494 INFO:tasks.workunit.client.0.smithi087.stdout:6/401: getdents d1/d6/d68 0 2024-09-17T07:19:50.495 INFO:tasks.workunit.client.0.smithi087.stdout:2/355: dwrite d2/d7/f8 [0,4194304] 0 2024-09-17T07:19:50.495 INFO:tasks.workunit.client.0.smithi087.stdout:1/308: rmdir d2/d3d/d35/d4f 39 2024-09-17T07:19:50.496 INFO:tasks.workunit.client.0.smithi087.stdout:7/270: read d0/d3/d10/d32/f56 [97581,107573] 0 2024-09-17T07:19:50.497 INFO:tasks.workunit.client.0.smithi087.stdout:2/356: write d2/d48/f59 [1737924,114279] 0 2024-09-17T07:19:50.499 INFO:tasks.workunit.client.0.smithi087.stdout:6/402: creat d1/d6/d1a/d2c/d48/f8c x:0 0 0 2024-09-17T07:19:50.502 INFO:tasks.workunit.client.0.smithi087.stdout:7/271: unlink d0/fc 0 2024-09-17T07:19:50.503 INFO:tasks.workunit.client.1.smithi139.stdout:3/129: getdents d5/d15/d20/d22 0 2024-09-17T07:19:50.504 INFO:tasks.workunit.client.1.smithi139.stdout:3/130: chown d5/d13/c12 0 1 2024-09-17T07:19:50.506 INFO:tasks.workunit.client.1.smithi139.stdout:3/131: write d5/d13/f1a [3499909,110601] 0 2024-09-17T07:19:50.508 INFO:tasks.workunit.client.0.smithi087.stdout:7/272: creat d0/d3/f5a x:0 0 0 2024-09-17T07:19:50.508 INFO:tasks.workunit.client.1.smithi139.stdout:3/132: creat d5/d13/f29 x:0 0 0 2024-09-17T07:19:50.508 INFO:tasks.workunit.client.0.smithi087.stdout:9/242: dread d3/d4/d2f/f39 [0,4194304] 0 2024-09-17T07:19:50.509 INFO:tasks.workunit.client.0.smithi087.stdout:7/273: write d0/f25 [1960467,127172] 0 2024-09-17T07:19:50.509 INFO:tasks.workunit.client.1.smithi139.stdout:3/133: dread d5/f11 [0,4194304] 0 2024-09-17T07:19:50.510 INFO:tasks.workunit.client.0.smithi087.stdout:7/274: chown d0/d3/f3f 533805 1 2024-09-17T07:19:50.511 INFO:tasks.workunit.client.1.smithi139.stdout:3/134: truncate d5/d13/f29 175120 0 2024-09-17T07:19:50.511 INFO:tasks.workunit.client.0.smithi087.stdout:9/243: fsync d3/d4/d16/f1b 0 2024-09-17T07:19:50.512 INFO:tasks.workunit.client.1.smithi139.stdout:3/135: mknod d5/c2a 0 2024-09-17T07:19:50.512 INFO:tasks.workunit.client.0.smithi087.stdout:7/275: mknod d0/d36/c5b 0 2024-09-17T07:19:50.513 INFO:tasks.workunit.client.1.smithi139.stdout:3/136: write f4 [1416853,16757] 0 2024-09-17T07:19:50.516 INFO:tasks.workunit.client.1.smithi139.stdout:3/137: rename d5/f26 to d5/f2b 0 2024-09-17T07:19:50.517 INFO:tasks.workunit.client.0.smithi087.stdout:9/244: rename d3/d4/d6/d8/d22/f2e to d3/d4/d6/d8/d12/d38/f56 0 2024-09-17T07:19:50.517 INFO:tasks.workunit.client.1.smithi139.stdout:9/404: dread dc/d11/d15/f18 [4194304,4194304] 0 2024-09-17T07:19:50.518 INFO:tasks.workunit.client.0.smithi087.stdout:9/245: write d3/d4/d6/d8/d22/d43/f45 [669770,114727] 0 2024-09-17T07:19:50.518 INFO:tasks.workunit.client.0.smithi087.stdout:7/276: symlink d0/l5c 0 2024-09-17T07:19:50.519 INFO:tasks.workunit.client.0.smithi087.stdout:9/246: dread - d3/d4/da/f55 zero size 2024-09-17T07:19:50.519 INFO:tasks.workunit.client.0.smithi087.stdout:7/277: chown d0/d3/f5a 3774 1 2024-09-17T07:19:50.520 INFO:tasks.workunit.client.1.smithi139.stdout:9/405: creat dc/d11/d15/d1e/d7c/f85 x:0 0 0 2024-09-17T07:19:50.521 INFO:tasks.workunit.client.0.smithi087.stdout:9/247: write d3/d4/f26 [1556427,86202] 0 2024-09-17T07:19:50.522 INFO:tasks.workunit.client.1.smithi139.stdout:3/138: dread d5/d13/f1a [0,4194304] 0 2024-09-17T07:19:50.523 INFO:tasks.workunit.client.0.smithi087.stdout:0/470: truncate db/f40 1428057 0 2024-09-17T07:19:50.524 INFO:tasks.workunit.client.0.smithi087.stdout:7/278: creat d0/d3/d10/f5d x:0 0 0 2024-09-17T07:19:50.525 INFO:tasks.workunit.client.1.smithi139.stdout:9/406: creat dc/d11/d15/d3c/f86 x:0 0 0 2024-09-17T07:19:50.525 INFO:tasks.workunit.client.0.smithi087.stdout:9/248: symlink d3/d4/d6/d8/d22/l57 0 2024-09-17T07:19:50.525 INFO:tasks.workunit.client.0.smithi087.stdout:7/279: fsync d0/d3/d23/d17/f47 0 2024-09-17T07:19:50.526 INFO:tasks.workunit.client.1.smithi139.stdout:9/407: chown dc/d11/f59 10 1 2024-09-17T07:19:50.527 INFO:tasks.workunit.client.0.smithi087.stdout:7/280: write d0/d3/d23/f54 [782025,82729] 0 2024-09-17T07:19:50.527 INFO:tasks.workunit.client.1.smithi139.stdout:9/408: rmdir dc/d11/d15/d1e 39 2024-09-17T07:19:50.528 INFO:tasks.workunit.client.1.smithi139.stdout:3/139: dwrite d5/f7 [0,4194304] 0 2024-09-17T07:19:50.530 INFO:tasks.workunit.client.1.smithi139.stdout:9/409: creat dc/d2a/f87 x:0 0 0 2024-09-17T07:19:50.530 INFO:tasks.workunit.client.1.smithi139.stdout:3/140: symlink d5/d15/l2c 0 2024-09-17T07:19:50.531 INFO:tasks.workunit.client.0.smithi087.stdout:9/249: creat d3/d4/d6/d8/d12/d32/f58 x:0 0 0 2024-09-17T07:19:50.533 INFO:tasks.workunit.client.1.smithi139.stdout:9/410: creat dc/d11/d15/d3c/d61/f88 x:0 0 0 2024-09-17T07:19:50.533 INFO:tasks.workunit.client.1.smithi139.stdout:3/141: mknod d5/c2d 0 2024-09-17T07:19:50.535 INFO:tasks.workunit.client.1.smithi139.stdout:3/142: readlink d5/d15/l2c 0 2024-09-17T07:19:50.536 INFO:tasks.workunit.client.1.smithi139.stdout:3/143: write d5/d15/f18 [1344927,17599] 0 2024-09-17T07:19:50.537 INFO:tasks.workunit.client.0.smithi087.stdout:6/403: dwrite d1/d6/d1a/d2c/d48/f72 [0,4194304] 0 2024-09-17T07:19:50.539 INFO:tasks.workunit.client.1.smithi139.stdout:3/144: unlink d5/d15/l2c 0 2024-09-17T07:19:50.539 INFO:tasks.workunit.client.0.smithi087.stdout:9/250: link d3/f1f d3/d4/d6/f59 0 2024-09-17T07:19:50.540 INFO:tasks.workunit.client.0.smithi087.stdout:0/471: dwrite db/d45/f4c [0,4194304] 0 2024-09-17T07:19:50.540 INFO:tasks.workunit.client.1.smithi139.stdout:9/411: dwrite dc/d11/d15/d3c/f45 [0,4194304] 0 2024-09-17T07:19:50.543 INFO:tasks.workunit.client.1.smithi139.stdout:9/412: fdatasync dc/d11/d15/d3c/f3d 0 2024-09-17T07:19:50.544 INFO:tasks.workunit.client.1.smithi139.stdout:3/145: dread d5/d13/f1a [0,4194304] 0 2024-09-17T07:19:50.547 INFO:tasks.workunit.client.1.smithi139.stdout:9/413: rmdir dc/d11/d15/d3c 39 2024-09-17T07:19:50.547 INFO:tasks.workunit.client.1.smithi139.stdout:9/414: stat dc/d2a/l46 0 2024-09-17T07:19:50.548 INFO:tasks.workunit.client.1.smithi139.stdout:3/146: symlink d5/d15/d20/d22/l2e 0 2024-09-17T07:19:50.550 INFO:tasks.workunit.client.1.smithi139.stdout:9/415: symlink dc/d2a/l89 0 2024-09-17T07:19:50.554 INFO:tasks.workunit.client.1.smithi139.stdout:9/416: rename dc/f5b to dc/d2a/f8a 0 2024-09-17T07:19:50.555 INFO:tasks.workunit.client.0.smithi087.stdout:6/404: rename d1/d6/d1a/d2c/d33/f54 to d1/d67/f8d 0 2024-09-17T07:19:50.555 INFO:tasks.workunit.client.0.smithi087.stdout:0/472: dwrite db/fb1 [0,4194304] 0 2024-09-17T07:19:50.557 INFO:tasks.workunit.client.1.smithi139.stdout:3/147: dwrite d5/d15/d16/f17 [0,4194304] 0 2024-09-17T07:19:50.558 INFO:tasks.workunit.client.1.smithi139.stdout:9/417: truncate dc/d11/d52/f77 813734 0 2024-09-17T07:19:50.558 INFO:tasks.workunit.client.0.smithi087.stdout:6/405: readlink d1/d6/d1a/l4a 0 2024-09-17T07:19:50.559 INFO:tasks.workunit.client.0.smithi087.stdout:9/251: symlink d3/d4/da/d4b/l5a 0 2024-09-17T07:19:50.559 INFO:tasks.workunit.client.0.smithi087.stdout:0/473: write db/d45/f7c [421286,68441] 0 2024-09-17T07:19:50.561 INFO:tasks.workunit.client.0.smithi087.stdout:7/281: dwrite d0/d3/d10/f21 [0,4194304] 0 2024-09-17T07:19:50.562 INFO:tasks.workunit.client.1.smithi139.stdout:9/418: truncate dc/d11/d15/d1e/f29 783600 0 2024-09-17T07:19:50.562 INFO:tasks.workunit.client.1.smithi139.stdout:3/148: symlink d5/d15/d16/d25/l2f 0 2024-09-17T07:19:50.563 INFO:tasks.workunit.client.0.smithi087.stdout:6/406: getdents d1/d6/d1a/d2c/d48/d62 0 2024-09-17T07:19:50.564 INFO:tasks.workunit.client.1.smithi139.stdout:9/419: rmdir dc/d11/d15/d1e 39 2024-09-17T07:19:50.571 INFO:tasks.workunit.client.1.smithi139.stdout:9/420: mkdir dc/d11/d8b 0 2024-09-17T07:19:50.574 INFO:tasks.workunit.client.1.smithi139.stdout:9/421: mknod dc/d11/c8c 0 2024-09-17T07:19:50.574 INFO:tasks.workunit.client.1.smithi139.stdout:9/422: dread - dc/d11/f59 zero size 2024-09-17T07:19:50.575 INFO:tasks.workunit.client.1.smithi139.stdout:9/423: chown dc/d2c/f62 96 1 2024-09-17T07:19:50.576 INFO:tasks.workunit.client.0.smithi087.stdout:9/252: dread d3/d4/d6/f3e [0,4194304] 0 2024-09-17T07:19:50.576 INFO:tasks.workunit.client.0.smithi087.stdout:0/474: dwrite db/f39 [0,4194304] 0 2024-09-17T07:19:50.576 INFO:tasks.workunit.client.1.smithi139.stdout:9/424: fdatasync dc/d11/d52/f77 0 2024-09-17T07:19:50.579 INFO:tasks.workunit.client.0.smithi087.stdout:7/282: dwrite d0/d3/d23/d17/f1e [0,4194304] 0 2024-09-17T07:19:50.581 INFO:tasks.workunit.client.0.smithi087.stdout:0/475: readlink db/l3b 0 2024-09-17T07:19:50.584 INFO:tasks.workunit.client.1.smithi139.stdout:9/425: dread dc/d11/d15/d1e/f21 [0,4194304] 0 2024-09-17T07:19:50.585 INFO:tasks.workunit.client.0.smithi087.stdout:6/407: getdents d1/d6/d1a/d2c/d33 0 2024-09-17T07:19:50.587 INFO:tasks.workunit.client.1.smithi139.stdout:3/149: truncate d5/d15/d16/f17 984013 0 2024-09-17T07:19:50.589 INFO:tasks.workunit.client.0.smithi087.stdout:7/283: dread - d0/d3/d10/f5d zero size 2024-09-17T07:19:50.590 INFO:tasks.workunit.client.0.smithi087.stdout:7/284: chown d0/d3/d23/d17/l4d 75 1 2024-09-17T07:19:50.590 INFO:tasks.workunit.client.0.smithi087.stdout:6/408: creat d1/d6/d1a/d2c/d33/f8e x:0 0 0 2024-09-17T07:19:50.591 INFO:tasks.workunit.client.1.smithi139.stdout:3/150: creat d5/d15/d20/d22/d28/f30 x:0 0 0 2024-09-17T07:19:50.591 INFO:tasks.workunit.client.0.smithi087.stdout:7/285: readlink d0/d3/l55 0 2024-09-17T07:19:50.591 INFO:tasks.workunit.client.0.smithi087.stdout:0/476: chown db/d45/d5d/f70 63602569 1 2024-09-17T07:19:50.592 INFO:tasks.workunit.client.0.smithi087.stdout:7/286: readlink d0/lb 0 2024-09-17T07:19:50.593 INFO:tasks.workunit.client.1.smithi139.stdout:3/151: symlink d5/d15/d20/d22/d28/l31 0 2024-09-17T07:19:50.593 INFO:tasks.workunit.client.1.smithi139.stdout:3/152: readlink d5/ld 0 2024-09-17T07:19:50.594 INFO:tasks.workunit.client.0.smithi087.stdout:0/477: creat db/d45/d7b/fb2 x:0 0 0 2024-09-17T07:19:50.595 INFO:tasks.workunit.client.0.smithi087.stdout:0/478: chown db/d45/d5d/f70 1650518 1 2024-09-17T07:19:50.595 INFO:tasks.workunit.client.1.smithi139.stdout:3/153: truncate d5/f11 1362248 0 2024-09-17T07:19:50.595 INFO:tasks.workunit.client.1.smithi139.stdout:3/154: chown d5/cf 1016454414 1 2024-09-17T07:19:50.596 INFO:tasks.workunit.client.1.smithi139.stdout:3/155: symlink d5/d15/l32 0 2024-09-17T07:19:50.597 INFO:tasks.workunit.client.0.smithi087.stdout:6/409: rename d1/d6/d1a/d2c/d48/d64 to d1/d6/d1a/d5e/d8f 0 2024-09-17T07:19:50.597 INFO:tasks.workunit.client.0.smithi087.stdout:9/253: rmdir d3 39 2024-09-17T07:19:50.597 INFO:tasks.workunit.client.1.smithi139.stdout:3/156: write d5/d13/f1a [4473656,3374] 0 2024-09-17T07:19:50.598 INFO:tasks.workunit.client.0.smithi087.stdout:7/287: mknod d0/d3/c5e 0 2024-09-17T07:19:50.601 INFO:tasks.workunit.client.1.smithi139.stdout:3/157: dread d5/d15/f18 [0,4194304] 0 2024-09-17T07:19:50.601 INFO:tasks.workunit.client.1.smithi139.stdout:3/158: readlink d5/d15/l32 0 2024-09-17T07:19:50.601 INFO:tasks.workunit.client.0.smithi087.stdout:6/410: mkdir d1/d6/d1a/d2c/d58/d90 0 2024-09-17T07:19:50.601 INFO:tasks.workunit.client.0.smithi087.stdout:9/254: write d3/d4/d6/d8/d12/d32/f58 [794517,85653] 0 2024-09-17T07:19:50.602 INFO:tasks.workunit.client.0.smithi087.stdout:7/288: readlink d0/d3/l13 0 2024-09-17T07:19:50.602 INFO:tasks.workunit.client.1.smithi139.stdout:3/159: creat d5/d15/f33 x:0 0 0 2024-09-17T07:19:50.603 INFO:tasks.workunit.client.0.smithi087.stdout:0/479: creat db/da3/fb3 x:0 0 0 2024-09-17T07:19:50.605 INFO:tasks.workunit.client.0.smithi087.stdout:7/289: stat d0/d3/d10/d31/c49 0 2024-09-17T07:19:50.607 INFO:tasks.workunit.client.0.smithi087.stdout:7/290: readlink d0/d3/d23/d17/l39 0 2024-09-17T07:19:50.609 INFO:tasks.workunit.client.0.smithi087.stdout:6/411: dread d1/d6/d1a/d2c/f59 [0,4194304] 0 2024-09-17T07:19:50.609 INFO:tasks.workunit.client.1.smithi139.stdout:3/160: dwrite d5/d15/f33 [0,4194304] 0 2024-09-17T07:19:50.609 INFO:tasks.workunit.client.0.smithi087.stdout:7/291: chown d0/d3/d23/d2d/f35 0 1 2024-09-17T07:19:50.610 INFO:tasks.workunit.client.1.smithi139.stdout:3/161: write d5/d13/f1a [2828312,105102] 0 2024-09-17T07:19:50.612 INFO:tasks.workunit.client.0.smithi087.stdout:9/255: dread d3/fc [0,4194304] 0 2024-09-17T07:19:50.612 INFO:tasks.workunit.client.0.smithi087.stdout:6/412: read d1/d6/d1a/d5e/f7b [2456698,57110] 0 2024-09-17T07:19:50.613 INFO:tasks.workunit.client.1.smithi139.stdout:3/162: mknod d5/d21/c34 0 2024-09-17T07:19:50.615 INFO:tasks.workunit.client.1.smithi139.stdout:3/163: chown d5/lb 1 1 2024-09-17T07:19:50.616 INFO:tasks.workunit.client.0.smithi087.stdout:0/480: dread db/d45/d7b/d7e/f8b [0,4194304] 0 2024-09-17T07:19:50.616 INFO:tasks.workunit.client.0.smithi087.stdout:6/413: creat d1/d6/d68/f91 x:0 0 0 2024-09-17T07:19:50.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:50 smithi139 ceph-mon[34403]: from='client.24399 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:19:50.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:50 smithi139 ceph-mon[34403]: pgmap v8: 65 pgs: 65 active+clean; 594 MiB data, 3.3 GiB used, 533 GiB / 536 GiB avail; 2.6 MiB/s rd, 57 MiB/s wr, 135 op/s 2024-09-17T07:19:50.618 INFO:tasks.workunit.client.1.smithi139.stdout:9/426: dwrite dc/d11/d15/f28 [0,4194304] 0 2024-09-17T07:19:50.622 INFO:tasks.workunit.client.0.smithi087.stdout:0/481: truncate db/f8c 928387 0 2024-09-17T07:19:50.623 INFO:tasks.workunit.client.0.smithi087.stdout:9/256: dwrite d3/d4/f26 [0,4194304] 0 2024-09-17T07:19:50.624 INFO:tasks.workunit.client.0.smithi087.stdout:6/414: creat d1/d6/d1a/d2c/d58/f92 x:0 0 0 2024-09-17T07:19:50.624 INFO:tasks.workunit.client.0.smithi087.stdout:0/482: truncate db/d45/f4b 45404 0 2024-09-17T07:19:50.625 INFO:tasks.workunit.client.1.smithi139.stdout:3/164: dwrite d5/f1d [0,4194304] 0 2024-09-17T07:19:50.625 INFO:tasks.workunit.client.1.smithi139.stdout:9/427: creat dc/d11/d15/f8d x:0 0 0 2024-09-17T07:19:50.626 INFO:tasks.workunit.client.0.smithi087.stdout:9/257: fsync d3/d4/d2f/f39 0 2024-09-17T07:19:50.628 INFO:tasks.workunit.client.1.smithi139.stdout:9/428: mkdir dc/d2a/d8e 0 2024-09-17T07:19:50.629 INFO:tasks.workunit.client.0.smithi087.stdout:6/415: chown d1/d6/d1a/d2c/d48/c87 575 1 2024-09-17T07:19:50.631 INFO:tasks.workunit.client.0.smithi087.stdout:9/258: creat d3/d4/d16/f5b x:0 0 0 2024-09-17T07:19:50.632 INFO:tasks.workunit.client.0.smithi087.stdout:0/483: creat db/fb4 x:0 0 0 2024-09-17T07:19:50.633 INFO:tasks.workunit.client.0.smithi087.stdout:6/416: creat d1/d6/d1a/d2c/d40/d4c/d77/f93 x:0 0 0 2024-09-17T07:19:50.637 INFO:tasks.workunit.client.0.smithi087.stdout:0/484: creat db/d45/d7b/db0/fb5 x:0 0 0 2024-09-17T07:19:50.640 INFO:tasks.workunit.client.0.smithi087.stdout:6/417: creat d1/d6/d1a/d8a/f94 x:0 0 0 2024-09-17T07:19:50.644 INFO:tasks.workunit.client.0.smithi087.stdout:9/259: dwrite d3/d4/d6/d8/fd [0,4194304] 0 2024-09-17T07:19:50.646 INFO:tasks.workunit.client.0.smithi087.stdout:9/260: chown d3/d25/d4c/c54 44027 1 2024-09-17T07:19:50.653 INFO:tasks.workunit.client.0.smithi087.stdout:6/418: dwrite d1/d6/d1a/d2c/d48/f88 [0,4194304] 0 2024-09-17T07:19:50.653 INFO:tasks.workunit.client.0.smithi087.stdout:9/261: dread d3/d4/d2f/f39 [0,4194304] 0 2024-09-17T07:19:50.656 INFO:tasks.workunit.client.1.smithi139.stdout:3/165: dread d5/fe [0,4194304] 0 2024-09-17T07:19:50.659 INFO:tasks.workunit.client.0.smithi087.stdout:6/419: dwrite d1/f18 [4194304,4194304] 0 2024-09-17T07:19:50.660 INFO:tasks.workunit.client.0.smithi087.stdout:9/262: rename d3/d4/c5 to d3/d4/d6/d8/d22/d2a/c5c 0 2024-09-17T07:19:50.663 INFO:tasks.workunit.client.0.smithi087.stdout:9/263: write d3/d4/d6/d8/d22/f50 [514556,10167] 0 2024-09-17T07:19:50.665 INFO:tasks.workunit.client.0.smithi087.stdout:6/420: read d1/d6/f3e [395150,47120] 0 2024-09-17T07:19:50.668 INFO:tasks.workunit.client.0.smithi087.stdout:6/421: readlink d1/l2 0 2024-09-17T07:19:50.674 INFO:tasks.workunit.client.1.smithi139.stdout:9/429: truncate dc/d11/d15/d1e/f2e 3042347 0 2024-09-17T07:19:50.675 INFO:tasks.workunit.client.1.smithi139.stdout:3/166: truncate f2 1385230 0 2024-09-17T07:19:50.676 INFO:tasks.workunit.client.1.smithi139.stdout:9/430: dread - dc/d2a/f71 zero size 2024-09-17T07:19:50.678 INFO:tasks.workunit.client.1.smithi139.stdout:9/431: fsync dc/d11/d15/d1e/f21 0 2024-09-17T07:19:50.679 INFO:tasks.workunit.client.1.smithi139.stdout:3/167: truncate d5/f11 1662187 0 2024-09-17T07:19:50.680 INFO:tasks.workunit.client.1.smithi139.stdout:3/168: readlink d5/d15/d16/d25/l2f 0 2024-09-17T07:19:50.680 INFO:tasks.workunit.client.1.smithi139.stdout:3/169: readlink d5/d15/d20/d22/l2e 0 2024-09-17T07:19:50.683 INFO:tasks.workunit.client.1.smithi139.stdout:3/170: mknod d5/d15/d20/d22/c35 0 2024-09-17T07:19:50.684 INFO:tasks.workunit.client.1.smithi139.stdout:3/171: dread - d5/d15/d20/d22/d28/f30 zero size 2024-09-17T07:19:50.685 INFO:tasks.workunit.client.1.smithi139.stdout:9/432: rename dc/d11/d15/d1e/f23 to dc/d11/f8f 0 2024-09-17T07:19:50.688 INFO:tasks.workunit.client.0.smithi087.stdout:9/264: dwrite d3/d4/da/d1c/f21 [0,4194304] 0 2024-09-17T07:19:50.689 INFO:tasks.workunit.client.0.smithi087.stdout:0/485: dread db/f21 [0,4194304] 0 2024-09-17T07:19:50.690 INFO:tasks.workunit.client.1.smithi139.stdout:9/433: fsync dc/d11/d15/d3c/f3d 0 2024-09-17T07:19:50.690 INFO:tasks.workunit.client.0.smithi087.stdout:6/422: rename d1/c44 to d1/d6/d1a/d2c/d48/c95 0 2024-09-17T07:19:50.690 INFO:tasks.workunit.client.0.smithi087.stdout:9/265: write d3/d4/d6/d8/d22/d43/f45 [1071274,120478] 0 2024-09-17T07:19:50.691 INFO:tasks.workunit.client.0.smithi087.stdout:0/486: fdatasync db/f21 0 2024-09-17T07:19:50.693 INFO:tasks.workunit.client.0.smithi087.stdout:9/266: chown d3/d4/d6/d8/f18 572742157 1 2024-09-17T07:19:50.694 INFO:tasks.workunit.client.1.smithi139.stdout:3/172: dread d5/f11 [0,4194304] 0 2024-09-17T07:19:50.695 INFO:tasks.workunit.client.1.smithi139.stdout:3/173: chown d5/l8 7797 1 2024-09-17T07:19:50.697 INFO:tasks.workunit.client.1.smithi139.stdout:3/174: chown d5/d15/d20/d22/d28 55 1 2024-09-17T07:19:50.699 INFO:tasks.workunit.client.1.smithi139.stdout:9/434: dwrite dc/d2a/f4c [0,4194304] 0 2024-09-17T07:19:50.702 INFO:tasks.workunit.client.1.smithi139.stdout:3/175: creat d5/d15/d20/d22/f36 x:0 0 0 2024-09-17T07:19:50.703 INFO:tasks.workunit.client.1.smithi139.stdout:9/435: creat dc/d11/d15/d3c/d68/f90 x:0 0 0 2024-09-17T07:19:50.705 INFO:tasks.workunit.client.1.smithi139.stdout:3/176: link d5/d15/l32 d5/l37 0 2024-09-17T07:19:50.706 INFO:tasks.workunit.client.1.smithi139.stdout:9/436: creat dc/d11/d8b/f91 x:0 0 0 2024-09-17T07:19:50.707 INFO:tasks.workunit.client.1.smithi139.stdout:9/437: stat dc/d11/d15/d3c/c69 0 2024-09-17T07:19:50.710 INFO:tasks.workunit.client.1.smithi139.stdout:3/177: dread d5/f7 [0,4194304] 0 2024-09-17T07:19:50.711 INFO:tasks.workunit.client.1.smithi139.stdout:3/178: chown d5/d15/d16/f1f 11 1 2024-09-17T07:19:50.713 INFO:tasks.workunit.client.1.smithi139.stdout:3/179: rmdir d5/d15/d20/d22/d28 39 2024-09-17T07:19:50.714 INFO:tasks.workunit.client.1.smithi139.stdout:3/180: truncate d5/f7 4485955 0 2024-09-17T07:19:50.715 INFO:tasks.workunit.client.1.smithi139.stdout:9/438: link dc/d2c/c47 dc/d11/d15/d1e/d34/c92 0 2024-09-17T07:19:50.716 INFO:tasks.workunit.client.1.smithi139.stdout:3/181: mkdir d5/d21/d23/d38 0 2024-09-17T07:19:50.720 INFO:tasks.workunit.client.1.smithi139.stdout:9/439: dwrite dc/d2a/f32 [0,4194304] 0 2024-09-17T07:19:50.721 INFO:tasks.workunit.client.1.smithi139.stdout:3/182: dread d5/d15/f18 [0,4194304] 0 2024-09-17T07:19:50.723 INFO:tasks.workunit.client.1.smithi139.stdout:9/440: symlink dc/d11/d15/d3c/l93 0 2024-09-17T07:19:50.725 INFO:tasks.workunit.client.1.smithi139.stdout:9/441: write dc/d11/f1b [6256307,36810] 0 2024-09-17T07:19:50.727 INFO:tasks.workunit.client.1.smithi139.stdout:9/442: symlink dc/d11/d52/l94 0 2024-09-17T07:19:50.731 INFO:tasks.workunit.client.1.smithi139.stdout:9/443: rename dc/d2a/f4c to dc/d11/d15/d3c/f95 0 2024-09-17T07:19:50.733 INFO:tasks.workunit.client.1.smithi139.stdout:9/444: rmdir dc/d11/d15/d1e/d53 39 2024-09-17T07:19:50.735 INFO:tasks.workunit.client.1.smithi139.stdout:9/445: fsync dc/d2a/f8a 0 2024-09-17T07:19:50.737 INFO:tasks.workunit.client.1.smithi139.stdout:9/446: write dc/d11/f8f [1692731,46117] 0 2024-09-17T07:19:50.738 INFO:tasks.workunit.client.1.smithi139.stdout:9/447: fdatasync dc/d11/d15/f28 0 2024-09-17T07:19:50.739 INFO:tasks.workunit.client.1.smithi139.stdout:9/448: fdatasync dc/d11/f12 0 2024-09-17T07:19:50.744 INFO:tasks.workunit.client.1.smithi139.stdout:9/449: dwrite dc/f3e [0,4194304] 0 2024-09-17T07:19:50.745 INFO:tasks.workunit.client.1.smithi139.stdout:9/450: dread - dc/d11/d15/d3c/d61/d64/f70 zero size 2024-09-17T07:19:50.748 INFO:tasks.workunit.client.1.smithi139.stdout:9/451: dread f4 [4194304,4194304] 0 2024-09-17T07:19:50.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.747+0000 7feb624aa640 1 -- 172.21.15.87:0/3134113140 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7feb3c0057c0 con 0x7feb5c0ff670 2024-09-17T07:19:50.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.747+0000 7feb597fa640 1 -- 172.21.15.87:0/3134113140 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1850 (secure 0 0 0) 0x7feb4407b010 con 0x7feb5c0ff670 2024-09-17T07:19:50.750 INFO:teuthology.orchestra.run.smithi087.stdout:e20 2024-09-17T07:19:50.750 INFO:teuthology.orchestra.run.smithi087.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T07:19:50.750 INFO:teuthology.orchestra.run.smithi087.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T07:19:50.750 INFO:teuthology.orchestra.run.smithi087.stdout:legacy client fscid: 1 2024-09-17T07:19:50.750 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:19:50.750 INFO:teuthology.orchestra.run.smithi087.stdout:Filesystem 'cephfs' (1) 2024-09-17T07:19:50.751 INFO:teuthology.orchestra.run.smithi087.stdout:fs_name cephfs 2024-09-17T07:19:50.751 INFO:teuthology.orchestra.run.smithi087.stdout:epoch 20 2024-09-17T07:19:50.751 INFO:teuthology.orchestra.run.smithi087.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T07:19:50.751 INFO:teuthology.orchestra.run.smithi087.stdout:created 2024-09-17T07:17:15.368053+0000 2024-09-17T07:19:50.751 INFO:teuthology.orchestra.run.smithi087.stdout:modified 2024-09-17T07:19:06.657406+0000 2024-09-17T07:19:50.751 INFO:teuthology.orchestra.run.smithi087.stdout:tableserver 0 2024-09-17T07:19:50.752 INFO:teuthology.orchestra.run.smithi087.stdout:root 0 2024-09-17T07:19:50.752 INFO:teuthology.orchestra.run.smithi087.stdout:session_timeout 60 2024-09-17T07:19:50.752 INFO:teuthology.orchestra.run.smithi087.stdout:session_autoclose 300 2024-09-17T07:19:50.752 INFO:teuthology.orchestra.run.smithi087.stdout:max_file_size 1099511627776 2024-09-17T07:19:50.752 INFO:teuthology.orchestra.run.smithi087.stdout:required_client_features {} 2024-09-17T07:19:50.753 INFO:teuthology.orchestra.run.smithi087.stdout:last_failure 0 2024-09-17T07:19:50.753 INFO:teuthology.orchestra.run.smithi087.stdout:last_failure_osd_epoch 44 2024-09-17T07:19:50.753 INFO:teuthology.orchestra.run.smithi087.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T07:19:50.753 INFO:teuthology.orchestra.run.smithi087.stdout:max_mds 2 2024-09-17T07:19:50.753 INFO:teuthology.orchestra.run.smithi087.stdout:in 0,1 2024-09-17T07:19:50.753 INFO:teuthology.orchestra.run.smithi087.stdout:up {0=14478,1=24243} 2024-09-17T07:19:50.753 INFO:teuthology.orchestra.run.smithi087.stdout:failed 2024-09-17T07:19:50.754 INFO:teuthology.orchestra.run.smithi087.stdout:damaged 2024-09-17T07:19:50.754 INFO:teuthology.orchestra.run.smithi087.stdout:stopped 2024-09-17T07:19:50.754 INFO:teuthology.orchestra.run.smithi087.stdout:data_pools [3] 2024-09-17T07:19:50.754 INFO:teuthology.orchestra.run.smithi087.stdout:metadata_pool 2 2024-09-17T07:19:50.754 INFO:teuthology.orchestra.run.smithi087.stdout:inline_data enabled 2024-09-17T07:19:50.754 INFO:teuthology.orchestra.run.smithi087.stdout:balancer 2024-09-17T07:19:50.755 INFO:teuthology.orchestra.run.smithi087.stdout:standby_count_wanted 1 2024-09-17T07:19:50.755 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi087.tjhpcs{0:14478} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.87:6828/2255237099,v1:172.21.15.87:6829/2255237099] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:19:50.755 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi087.vvbzss{0:14490} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.87:6826/4022268353,v1:172.21.15.87:6827/4022268353] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:19:50.755 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi139.gnwonz{1:24243} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.139:6824/3946792151,v1:172.21.15.139:6825/3946792151] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:19:50.755 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi139.ftvinf{1:24253} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.139:6826/3292073323,v1:172.21.15.139:6827/3292073323] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:19:50.755 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:19:50.755 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:19:50.756 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 20 2024-09-17T07:19:50.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.750+0000 7feb624aa640 1 -- 172.21.15.87:0/3134113140 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7feb4806dc40 msgr2=0x7feb480700f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:19:50.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.750+0000 7feb624aa640 1 --2- 172.21.15.87:0/3134113140 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7feb4806dc40 0x7feb480700f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7feb4c009af0 tx=0x7feb4c00b040 comp rx=0 tx=0).stop 2024-09-17T07:19:50.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.750+0000 7feb624aa640 1 -- 172.21.15.87:0/3134113140 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feb5c0ff670 msgr2=0x7feb5c10d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:19:50.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.750+0000 7feb624aa640 1 --2- 172.21.15.87:0/3134113140 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feb5c0ff670 0x7feb5c10d500 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7feb44009ac0 tx=0x7feb44009da0 comp rx=0 tx=0).stop 2024-09-17T07:19:50.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.750+0000 7feb624aa640 1 -- 172.21.15.87:0/3134113140 shutdown_connections 2024-09-17T07:19:50.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.750+0000 7feb624aa640 1 --2- 172.21.15.87:0/3134113140 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7feb4806dc40 0x7feb480700f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:50.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.750+0000 7feb624aa640 1 --2- 172.21.15.87:0/3134113140 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feb5c0ff670 0x7feb5c10d500 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:50.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.750+0000 7feb624aa640 1 --2- 172.21.15.87:0/3134113140 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb5c0664d0 0x7feb5c10cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:50.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.750+0000 7feb624aa640 1 -- 172.21.15.87:0/3134113140 >> 172.21.15.87:0/3134113140 conn(0x7feb5c0f6c00 msgr2=0x7feb5c0f6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:19:50.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.751+0000 7feb624aa640 1 -- 172.21.15.87:0/3134113140 shutdown_connections 2024-09-17T07:19:50.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.751+0000 7feb624aa640 1 -- 172.21.15.87:0/3134113140 wait complete. 2024-09-17T07:19:50.757 INFO:tasks.workunit.client.1.smithi139.stdout:9/452: dwrite dc/d11/f59 [0,4194304] 0 2024-09-17T07:19:50.758 INFO:tasks.workunit.client.1.smithi139.stdout:9/453: rename dc/d2a/d8e to dc/d11/d15/d3c/d61/d64/d96 0 2024-09-17T07:19:50.758 INFO:tasks.workunit.client.1.smithi139.stdout:9/454: chown dc/c42 457007 1 2024-09-17T07:19:50.759 INFO:tasks.workunit.client.1.smithi139.stdout:9/455: write dc/d11/d15/d3c/f86 [817445,52772] 0 2024-09-17T07:19:50.759 INFO:tasks.workunit.client.1.smithi139.stdout:9/456: stat dc/d11/d15/d1e/f21 0 2024-09-17T07:19:50.762 INFO:tasks.workunit.client.1.smithi139.stdout:9/457: creat dc/d11/f97 x:0 0 0 2024-09-17T07:19:50.768 INFO:tasks.workunit.client.1.smithi139.stdout:9/458: dwrite dc/d11/d15/d1e/f2f [4194304,4194304] 0 2024-09-17T07:19:50.769 INFO:tasks.workunit.client.0.smithi087.stdout:5/435: sync 2024-09-17T07:19:50.771 INFO:tasks.workunit.client.0.smithi087.stdout:8/297: sync 2024-09-17T07:19:50.776 INFO:tasks.workunit.client.1.smithi139.stdout:9/459: dwrite dc/d11/d15/f17 [0,4194304] 0 2024-09-17T07:19:50.792 INFO:tasks.workunit.client.0.smithi087.stdout:6/423: creat d1/d6/d1a/d2c/d40/d4c/f96 x:0 0 0 2024-09-17T07:19:50.793 INFO:tasks.workunit.client.0.smithi087.stdout:9/267: fsync d3/d4/d6/d8/fd 0 2024-09-17T07:19:50.797 INFO:tasks.workunit.client.0.smithi087.stdout:6/424: write d1/d67/f8d [102608,118755] 0 2024-09-17T07:19:50.797 INFO:tasks.workunit.client.0.smithi087.stdout:0/487: getdents db/d45/d7b/db0 0 2024-09-17T07:19:50.798 INFO:tasks.workunit.client.0.smithi087.stdout:9/268: creat d3/d4/d6/d8/d22/d43/f5d x:0 0 0 2024-09-17T07:19:50.802 INFO:tasks.workunit.client.0.smithi087.stdout:8/298: rename d1/d7/d9/d19/d1b/d18/d23 to d1/d2b/d70 0 2024-09-17T07:19:50.802 INFO:tasks.workunit.client.0.smithi087.stdout:5/436: dwrite d5/d12/d14/f7b [0,4194304] 0 2024-09-17T07:19:50.805 INFO:tasks.workunit.client.0.smithi087.stdout:8/299: fsync d1/d2b/f29 0 2024-09-17T07:19:50.807 INFO:tasks.workunit.client.0.smithi087.stdout:5/437: write d5/f17 [2004358,63207] 0 2024-09-17T07:19:50.808 INFO:tasks.workunit.client.0.smithi087.stdout:8/300: fdatasync d1/d7/d9/fc 0 2024-09-17T07:19:50.811 INFO:tasks.workunit.client.0.smithi087.stdout:6/425: rename d1/d6/d1a/l47 to d1/l97 0 2024-09-17T07:19:50.812 INFO:tasks.workunit.client.0.smithi087.stdout:0/488: dwrite db/d45/d5d/fac [0,4194304] 0 2024-09-17T07:19:50.819 INFO:tasks.workunit.client.0.smithi087.stdout:0/489: mknod db/d45/d5b/d92/cb6 0 2024-09-17T07:19:50.819 INFO:tasks.workunit.client.0.smithi087.stdout:6/426: dread d1/f78 [0,4194304] 0 2024-09-17T07:19:50.820 INFO:tasks.workunit.client.0.smithi087.stdout:5/438: truncate d5/d8/d1f/f58 3496429 0 2024-09-17T07:19:50.822 INFO:tasks.workunit.client.0.smithi087.stdout:0/490: write db/d45/d5b/fa7 [46138,114338] 0 2024-09-17T07:19:50.823 INFO:tasks.workunit.client.0.smithi087.stdout:6/427: creat d1/d6/d68/f98 x:0 0 0 2024-09-17T07:19:50.824 INFO:tasks.workunit.client.0.smithi087.stdout:6/428: dread - d1/d6/d1a/d5e/d8f/f8b zero size 2024-09-17T07:19:50.826 INFO:tasks.workunit.client.0.smithi087.stdout:5/439: creat d5/d18/d20/d2f/d52/f8e x:0 0 0 2024-09-17T07:19:50.826 INFO:tasks.workunit.client.0.smithi087.stdout:0/491: symlink db/d45/lb7 0 2024-09-17T07:19:50.828 INFO:tasks.workunit.client.0.smithi087.stdout:6/429: creat d1/d6/d1a/d2c/d48/f99 x:0 0 0 2024-09-17T07:19:50.828 INFO:tasks.workunit.client.0.smithi087.stdout:6/430: fdatasync d1/d6/f61 0 2024-09-17T07:19:50.829 INFO:tasks.workunit.client.0.smithi087.stdout:5/440: symlink d5/d18/d20/d2f/l8f 0 2024-09-17T07:19:50.832 INFO:tasks.workunit.client.0.smithi087.stdout:9/269: dread d3/d4/d16/f3a [0,4194304] 0 2024-09-17T07:19:50.833 INFO:tasks.workunit.client.0.smithi087.stdout:5/441: dread - d5/d12/f76 zero size 2024-09-17T07:19:50.833 INFO:tasks.workunit.client.0.smithi087.stdout:6/431: creat d1/d6/d1a/d2c/d48/f9a x:0 0 0 2024-09-17T07:19:50.834 INFO:tasks.workunit.client.0.smithi087.stdout:6/432: dread - d1/d67/f69 zero size 2024-09-17T07:19:50.835 INFO:tasks.workunit.client.0.smithi087.stdout:5/442: stat d5/d12/f77 0 2024-09-17T07:19:50.838 INFO:tasks.workunit.client.0.smithi087.stdout:5/443: creat d5/d6d/f90 x:0 0 0 2024-09-17T07:19:50.840 INFO:tasks.workunit.client.0.smithi087.stdout:9/270: link d3/d4/d6/d8/d12/c48 d3/d25/d4c/c5e 0 2024-09-17T07:19:50.840 INFO:tasks.workunit.client.0.smithi087.stdout:6/433: write d1/d6/d1a/d2c/d40/f49 [1325126,32087] 0 2024-09-17T07:19:50.841 INFO:tasks.workunit.client.0.smithi087.stdout:8/301: dread d1/d2b/d3b/d53/f5b [0,4194304] 0 2024-09-17T07:19:50.842 INFO:tasks.workunit.client.0.smithi087.stdout:0/492: dwrite db/d45/d5d/f8f [4194304,4194304] 0 2024-09-17T07:19:50.842 INFO:tasks.workunit.client.0.smithi087.stdout:5/444: mknod d5/d12/d14/c91 0 2024-09-17T07:19:50.846 INFO:tasks.workunit.client.0.smithi087.stdout:8/302: mkdir d1/d5f/d71 0 2024-09-17T07:19:50.847 INFO:tasks.workunit.client.0.smithi087.stdout:9/271: creat d3/d4/d6/d8/d22/d43/f5f x:0 0 0 2024-09-17T07:19:50.848 INFO:tasks.workunit.client.0.smithi087.stdout:0/493: creat db/d4f/fb8 x:0 0 0 2024-09-17T07:19:50.851 INFO:tasks.workunit.client.0.smithi087.stdout:8/303: rename d1/d2b/c17 to d1/d2b/d3b/c72 0 2024-09-17T07:19:50.851 INFO:tasks.workunit.client.0.smithi087.stdout:6/434: dread d1/d6/d1a/d2c/d48/f72 [0,4194304] 0 2024-09-17T07:19:50.861 INFO:tasks.workunit.client.0.smithi087.stdout:6/435: mkdir d1/d6/d1a/d2c/d48/d9b 0 2024-09-17T07:19:50.863 INFO:tasks.workunit.client.0.smithi087.stdout:0/494: dwrite db/d45/d7b/d7e/f8b [0,4194304] 0 2024-09-17T07:19:50.865 INFO:tasks.workunit.client.0.smithi087.stdout:0/495: symlink db/d45/d7b/lb9 0 2024-09-17T07:19:50.868 INFO:tasks.workunit.client.0.smithi087.stdout:0/496: write db/d45/d5d/fac [2153939,90978] 0 2024-09-17T07:19:50.870 INFO:tasks.workunit.client.0.smithi087.stdout:6/436: getdents d1/d6/d1a/d2c/d40/d4c/d77 0 2024-09-17T07:19:50.871 INFO:tasks.workunit.client.0.smithi087.stdout:9/272: truncate d3/d4/d6/d8/d12/d32/f58 704201 0 2024-09-17T07:19:50.873 INFO:tasks.workunit.client.0.smithi087.stdout:9/273: dread d3/d4/fb [0,4194304] 0 2024-09-17T07:19:50.874 INFO:tasks.workunit.client.0.smithi087.stdout:9/274: readlink d3/d4/da/d1c/d1e/l34 0 2024-09-17T07:19:50.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.874+0000 7f28114ae640 1 -- 172.21.15.87:0/3068943054 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f280c0fc700 msgr2=0x7f280c0fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:19:50.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.874+0000 7f28114ae640 1 --2- 172.21.15.87:0/3068943054 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f280c0fc700 0x7f280c0fcb70 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f28000048d0 tx=0x7f2800009da0 comp rx=0 tx=0).stop 2024-09-17T07:19:50.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.875+0000 7f28114ae640 1 -- 172.21.15.87:0/3068943054 shutdown_connections 2024-09-17T07:19:50.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.875+0000 7f28114ae640 1 --2- 172.21.15.87:0/3068943054 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f280c0fc700 0x7f280c0fcb70 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:50.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.875+0000 7f28114ae640 1 --2- 172.21.15.87:0/3068943054 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f280c0fb430 0x7f280c0fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:50.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.875+0000 7f28114ae640 1 -- 172.21.15.87:0/3068943054 >> 172.21.15.87:0/3068943054 conn(0x7f280c0f6c10 msgr2=0x7f280c0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:19:50.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.875+0000 7f28114ae640 1 -- 172.21.15.87:0/3068943054 shutdown_connections 2024-09-17T07:19:50.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.875+0000 7f28114ae640 1 -- 172.21.15.87:0/3068943054 wait complete. 2024-09-17T07:19:50.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.876+0000 7f28114ae640 1 Processor -- start 2024-09-17T07:19:50.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.876+0000 7f28114ae640 1 -- start start 2024-09-17T07:19:50.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.876+0000 7f28114ae640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f280c0fb430 0x7f280c10bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:19:50.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.876+0000 7f28114ae640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f280c0fc700 0x7f280c10c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:19:50.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.876+0000 7f28114ae640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f280c10cae0 con 0x7f280c0fb430 2024-09-17T07:19:50.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.876+0000 7f28114ae640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f280c10d1d0 con 0x7f280c0fc700 2024-09-17T07:19:50.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.876+0000 7f280affd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f280c0fb430 0x7f280c10bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:19:50.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.876+0000 7f280affd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f280c0fb430 0x7f280c10bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37120/0 (socket says 172.21.15.87:37120) 2024-09-17T07:19:50.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.876+0000 7f280affd640 1 -- 172.21.15.87:0/3874534488 learned_addr learned my addr 172.21.15.87:0/3874534488 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:19:50.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.876+0000 7f280a7fc640 1 --2- 172.21.15.87:0/3874534488 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f280c0fc700 0x7f280c10c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:19:50.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.876+0000 7f280affd640 1 -- 172.21.15.87:0/3874534488 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f280c0fc700 msgr2=0x7f280c10c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:19:50.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.876+0000 7f280affd640 1 --2- 172.21.15.87:0/3874534488 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f280c0fc700 0x7f280c10c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:50.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.876+0000 7f280affd640 1 -- 172.21.15.87:0/3874534488 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2800005040 con 0x7f280c0fb430 2024-09-17T07:19:50.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.877+0000 7f280affd640 1 --2- 172.21.15.87:0/3874534488 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f280c0fb430 0x7f280c10bf50 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f27fc00eb70 tx=0x7f27fc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:19:50.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.877+0000 7f27f37fe640 1 -- 172.21.15.87:0/3874534488 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27fc007c30 con 0x7f280c0fb430 2024-09-17T07:19:50.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.877+0000 7f27f37fe640 1 -- 172.21.15.87:0/3874534488 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f27fc00f040 con 0x7f280c0fb430 2024-09-17T07:19:50.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.877+0000 7f28114ae640 1 -- 172.21.15.87:0/3874534488 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f280c10d400 con 0x7f280c0fb430 2024-09-17T07:19:50.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.877+0000 7f27f37fe640 1 -- 172.21.15.87:0/3874534488 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27fc009420 con 0x7f280c0fb430 2024-09-17T07:19:50.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.877+0000 7f28114ae640 1 -- 172.21.15.87:0/3874534488 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f280c10d9a0 con 0x7f280c0fb430 2024-09-17T07:19:50.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.878+0000 7f28114ae640 1 -- 172.21.15.87:0/3874534488 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f280c04b720 con 0x7f280c0fb430 2024-09-17T07:19:50.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.879+0000 7f27f37fe640 1 -- 172.21.15.87:0/3874534488 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 24) v1 ==== 90881+0+0 (secure 0 0 0) 0x7f27fc009690 con 0x7f280c0fb430 2024-09-17T07:19:50.881 INFO:tasks.workunit.client.0.smithi087.stdout:6/437: link d1/d6/d1a/d2c/f37 d1/d6/d1a/d2c/d58/d90/f9c 0 2024-09-17T07:19:50.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.879+0000 7f27f37fe640 1 --2- 172.21.15.87:0/3874534488 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f27f406fde0 0x7f27f4072290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:19:50.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.880+0000 7f27f37fe640 1 -- 172.21.15.87:0/3874534488 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f27fc08cd20 con 0x7f280c0fb430 2024-09-17T07:19:50.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.880+0000 7f280a7fc640 1 --2- 172.21.15.87:0/3874534488 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f27f406fde0 0x7f27f4072290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:19:50.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.880+0000 7f280a7fc640 1 --2- 172.21.15.87:0/3874534488 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f27f406fde0 0x7f27f4072290 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f280000b020 tx=0x7f2800035040 comp rx=0 tx=0).ready entity=mgr.24339 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:19:50.884 INFO:tasks.workunit.client.0.smithi087.stdout:9/275: getdents d3/d4/d6/d8/d12/d38 0 2024-09-17T07:19:50.885 INFO:tasks.workunit.client.0.smithi087.stdout:9/276: truncate d3/d4/da/f49 137580 0 2024-09-17T07:19:50.885 INFO:tasks.workunit.client.0.smithi087.stdout:6/438: link d1/d6/d1a/f41 d1/d6/d1a/d2c/d58/d90/f9d 0 2024-09-17T07:19:50.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:50.886+0000 7f27f37fe640 1 -- 172.21.15.87:0/3874534488 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182127 (secure 0 0 0) 0x7f27fc04f780 con 0x7f280c0fb430 2024-09-17T07:19:50.888 INFO:tasks.workunit.client.0.smithi087.stdout:6/439: symlink d1/d6/d1a/d2c/d40/d4c/l9e 0 2024-09-17T07:19:50.888 INFO:tasks.workunit.client.0.smithi087.stdout:9/277: dread d3/fc [0,4194304] 0 2024-09-17T07:19:50.889 INFO:tasks.workunit.client.0.smithi087.stdout:6/440: read - d1/d6/d1a/d5e/d8f/f8b zero size 2024-09-17T07:19:50.891 INFO:tasks.workunit.client.0.smithi087.stdout:9/278: creat d3/d4/d6/d8/d12/f60 x:0 0 0 2024-09-17T07:19:50.892 INFO:tasks.workunit.client.0.smithi087.stdout:6/441: unlink d1/d6/d1a/d2c/d33/l65 0 2024-09-17T07:19:50.894 INFO:tasks.workunit.client.0.smithi087.stdout:9/279: creat d3/d4/d6/d8/d22/d43/f61 x:0 0 0 2024-09-17T07:19:50.895 INFO:tasks.workunit.client.0.smithi087.stdout:9/280: chown d3/d4/d6/d8/d22/d43 818 1 2024-09-17T07:19:50.895 INFO:tasks.workunit.client.0.smithi087.stdout:6/442: rename d1/d6/d1a/d8a/f94 to d1/d6/d1a/d2c/d40/d4c/f9f 0 2024-09-17T07:19:50.897 INFO:tasks.workunit.client.0.smithi087.stdout:6/443: creat d1/d6/d1a/d5e/fa0 x:0 0 0 2024-09-17T07:19:50.898 INFO:tasks.workunit.client.0.smithi087.stdout:6/444: chown d1/d6/d1a/d2c/f75 168681 1 2024-09-17T07:19:50.898 INFO:tasks.workunit.client.0.smithi087.stdout:9/281: link d3/d25/d4c/c54 d3/d4/d6/d8/d12/d32/c62 0 2024-09-17T07:19:50.899 INFO:tasks.workunit.client.1.smithi139.stdout:4/238: sync 2024-09-17T07:19:50.899 INFO:tasks.workunit.client.1.smithi139.stdout:0/165: sync 2024-09-17T07:19:50.900 INFO:tasks.workunit.client.0.smithi087.stdout:6/445: mkdir d1/d6/d1a/d2c/d40/d4c/da1 0 2024-09-17T07:19:50.900 INFO:tasks.workunit.client.1.smithi139.stdout:0/166: read - d1/da/d1b/f42 zero size 2024-09-17T07:19:50.901 INFO:tasks.workunit.client.0.smithi087.stdout:6/446: write d1/d6/f61 [156785,833] 0 2024-09-17T07:19:50.902 INFO:tasks.workunit.client.1.smithi139.stdout:4/239: readlink d0/d1a/l32 0 2024-09-17T07:19:50.903 INFO:tasks.workunit.client.0.smithi087.stdout:6/447: creat d1/d6/d1a/d2c/d48/d9b/fa2 x:0 0 0 2024-09-17T07:19:50.905 INFO:tasks.workunit.client.0.smithi087.stdout:6/448: getdents d1/d6 0 2024-09-17T07:19:50.906 INFO:tasks.workunit.client.0.smithi087.stdout:6/449: chown d1/d6/d1a/l83 255415 1 2024-09-17T07:19:50.906 INFO:tasks.workunit.client.1.smithi139.stdout:0/167: write d1/da/d2a/f38 [996175,98218] 0 2024-09-17T07:19:50.907 INFO:tasks.workunit.client.0.smithi087.stdout:6/450: fsync d1/d6/d1a/d4e/f50 0 2024-09-17T07:19:50.907 INFO:tasks.workunit.client.1.smithi139.stdout:4/240: dwrite d0/f2 [0,4194304] 0 2024-09-17T07:19:50.908 INFO:tasks.workunit.client.1.smithi139.stdout:0/168: write d1/da/d2a/f38 [122467,21105] 0 2024-09-17T07:19:50.908 INFO:tasks.workunit.client.0.smithi087.stdout:6/451: write d1/d6/d1a/d4e/f82 [703631,92155] 0 2024-09-17T07:19:50.911 INFO:tasks.workunit.client.1.smithi139.stdout:0/169: write d1/da/d17/f34 [659597,44586] 0 2024-09-17T07:19:50.915 INFO:tasks.workunit.client.1.smithi139.stdout:0/170: symlink d1/da/d1b/d32/l4a 0 2024-09-17T07:19:50.916 INFO:tasks.workunit.client.1.smithi139.stdout:0/171: read - d1/da/d1b/f27 zero size 2024-09-17T07:19:50.917 INFO:tasks.workunit.client.1.smithi139.stdout:0/172: creat d1/da/d1b/f4b x:0 0 0 2024-09-17T07:19:50.917 INFO:tasks.workunit.client.1.smithi139.stdout:0/173: readlink d1/da/l46 0 2024-09-17T07:19:50.918 INFO:tasks.workunit.client.1.smithi139.stdout:0/174: chown d1/da/d1b/d32/d21/l23 308823620 1 2024-09-17T07:19:50.924 INFO:tasks.workunit.client.1.smithi139.stdout:0/175: dwrite d1/da/d17/f34 [0,4194304] 0 2024-09-17T07:19:50.926 INFO:tasks.workunit.client.1.smithi139.stdout:0/176: mknod d1/da/d1b/d32/c4c 0 2024-09-17T07:19:50.927 INFO:tasks.workunit.client.1.smithi139.stdout:0/177: write d1/da/d1b/d32/d21/f2b [928743,125587] 0 2024-09-17T07:19:50.928 INFO:tasks.workunit.client.1.smithi139.stdout:4/241: dread d0/d1/d29/d41/f44 [0,4194304] 0 2024-09-17T07:19:50.929 INFO:tasks.workunit.client.1.smithi139.stdout:0/178: write d1/f43 [438950,44589] 0 2024-09-17T07:19:50.931 INFO:tasks.workunit.client.1.smithi139.stdout:4/242: mkdir d0/d1/d29/d45 0 2024-09-17T07:19:50.932 INFO:tasks.workunit.client.1.smithi139.stdout:4/243: write d0/d1/d29/d41/f43 [897493,75129] 0 2024-09-17T07:19:50.933 INFO:tasks.workunit.client.1.smithi139.stdout:0/179: rename d1/da/l15 to d1/da/d1b/l4d 0 2024-09-17T07:19:50.936 INFO:tasks.workunit.client.1.smithi139.stdout:4/244: link d0/d10/c12 d0/c46 0 2024-09-17T07:19:50.937 INFO:tasks.workunit.client.1.smithi139.stdout:0/180: getdents d1/da/d2a 0 2024-09-17T07:19:50.937 INFO:tasks.workunit.client.1.smithi139.stdout:4/245: read d0/d1/d29/d41/f44 [2831800,5649] 0 2024-09-17T07:19:50.938 INFO:tasks.workunit.client.1.smithi139.stdout:0/181: symlink d1/da/l4e 0 2024-09-17T07:19:50.940 INFO:tasks.workunit.client.1.smithi139.stdout:0/182: creat d1/da/d1b/d32/f4f x:0 0 0 2024-09-17T07:19:50.941 INFO:tasks.workunit.client.1.smithi139.stdout:4/246: rmdir d0/d1/d29/d45 0 2024-09-17T07:19:50.942 INFO:tasks.workunit.client.1.smithi139.stdout:0/183: mkdir d1/da/d1b/d3d/d50 0 2024-09-17T07:19:50.944 INFO:tasks.workunit.client.1.smithi139.stdout:4/247: creat d0/f47 x:0 0 0 2024-09-17T07:19:50.945 INFO:tasks.workunit.client.1.smithi139.stdout:4/248: chown d0/db/f20 11 1 2024-09-17T07:19:50.945 INFO:tasks.workunit.client.1.smithi139.stdout:4/249: chown d0/db 3092642 1 2024-09-17T07:19:50.947 INFO:tasks.workunit.client.1.smithi139.stdout:0/184: dwrite d1/f18 [0,4194304] 0 2024-09-17T07:19:50.948 INFO:tasks.workunit.client.1.smithi139.stdout:4/250: rename d0/f2 to d0/d10/d39/f48 0 2024-09-17T07:19:50.950 INFO:tasks.workunit.client.1.smithi139.stdout:0/185: creat d1/da/d2a/f51 x:0 0 0 2024-09-17T07:19:50.952 INFO:tasks.workunit.client.1.smithi139.stdout:4/251: mkdir d0/d49 0 2024-09-17T07:19:50.954 INFO:tasks.workunit.client.1.smithi139.stdout:4/252: dread - d0/db/f33 zero size 2024-09-17T07:19:50.955 INFO:tasks.workunit.client.1.smithi139.stdout:0/186: link d1/da/d1b/d32/l2c d1/da/d17/l52 0 2024-09-17T07:19:50.956 INFO:tasks.workunit.client.1.smithi139.stdout:0/187: write d1/da/d1b/d32/f37 [1039998,114016] 0 2024-09-17T07:19:50.956 INFO:tasks.workunit.client.1.smithi139.stdout:4/253: creat d0/db/f4a x:0 0 0 2024-09-17T07:19:50.961 INFO:tasks.workunit.client.1.smithi139.stdout:0/188: dread d1/f18 [0,4194304] 0 2024-09-17T07:19:50.962 INFO:tasks.workunit.client.1.smithi139.stdout:0/189: write d1/da/d2a/f2e [2993710,114664] 0 2024-09-17T07:19:50.963 INFO:tasks.workunit.client.1.smithi139.stdout:0/190: write d1/da/f14 [1105967,3371] 0 2024-09-17T07:19:50.965 INFO:tasks.workunit.client.1.smithi139.stdout:0/191: mknod d1/da/d17/c53 0 2024-09-17T07:19:50.972 INFO:tasks.workunit.client.1.smithi139.stdout:0/192: dwrite d1/da/d1b/d3d/f44 [0,4194304] 0 2024-09-17T07:19:50.975 INFO:tasks.workunit.client.1.smithi139.stdout:4/254: dwrite d0/d10/d39/f3c [0,4194304] 0 2024-09-17T07:19:50.976 INFO:tasks.workunit.client.1.smithi139.stdout:4/255: write d0/db/f1c [2103821,2149] 0 2024-09-17T07:19:50.977 INFO:tasks.workunit.client.1.smithi139.stdout:0/193: rename d1/da/d17/l45 to d1/da/d2a/l54 0 2024-09-17T07:19:50.985 INFO:tasks.workunit.client.1.smithi139.stdout:0/194: dwrite d1/da/f14 [0,4194304] 0 2024-09-17T07:19:50.989 INFO:tasks.workunit.client.1.smithi139.stdout:0/195: creat d1/da/d1b/d3d/d50/f55 x:0 0 0 2024-09-17T07:19:50.990 INFO:tasks.workunit.client.1.smithi139.stdout:0/196: rmdir d1/da/d17 39 2024-09-17T07:19:50.993 INFO:tasks.workunit.client.1.smithi139.stdout:0/197: truncate d1/da/d1b/d32/d21/f30 921216 0 2024-09-17T07:19:50.994 INFO:tasks.workunit.client.1.smithi139.stdout:0/198: mknod d1/da/d1b/d32/c56 0 2024-09-17T07:19:50.995 INFO:tasks.workunit.client.1.smithi139.stdout:0/199: dread - d1/da/d1b/d32/d21/f22 zero size 2024-09-17T07:19:50.995 INFO:tasks.workunit.client.1.smithi139.stdout:0/200: read - d1/f3e zero size 2024-09-17T07:19:50.997 INFO:tasks.workunit.client.1.smithi139.stdout:0/201: dread d1/da/d1b/d32/f47 [0,4194304] 0 2024-09-17T07:19:50.999 INFO:tasks.workunit.client.1.smithi139.stdout:0/202: chown d1/l5 162 1 2024-09-17T07:19:51.001 INFO:tasks.workunit.client.1.smithi139.stdout:0/203: mkdir d1/da/d1b/d57 0 2024-09-17T07:19:51.002 INFO:tasks.workunit.client.1.smithi139.stdout:0/204: mkdir d1/d58 0 2024-09-17T07:19:51.008 INFO:tasks.workunit.client.1.smithi139.stdout:4/256: dread d0/f7 [4194304,4194304] 0 2024-09-17T07:19:51.011 INFO:tasks.workunit.client.1.smithi139.stdout:0/205: dwrite d1/da/d1b/d3d/d50/f55 [0,4194304] 0 2024-09-17T07:19:51.015 INFO:tasks.workunit.client.1.smithi139.stdout:0/206: rename d1/da/d1b/d3d/f44 to d1/da/d2a/f59 0 2024-09-17T07:19:51.017 INFO:tasks.workunit.client.1.smithi139.stdout:4/257: link d0/d1/cc d0/db/c4b 0 2024-09-17T07:19:51.018 INFO:tasks.workunit.client.1.smithi139.stdout:7/194: sync 2024-09-17T07:19:51.018 INFO:tasks.workunit.client.1.smithi139.stdout:5/164: sync 2024-09-17T07:19:51.018 INFO:tasks.workunit.client.1.smithi139.stdout:8/254: sync 2024-09-17T07:19:51.018 INFO:tasks.workunit.client.1.smithi139.stdout:6/349: sync 2024-09-17T07:19:51.018 INFO:tasks.workunit.client.1.smithi139.stdout:1/155: sync 2024-09-17T07:19:51.019 INFO:tasks.workunit.client.1.smithi139.stdout:2/259: sync 2024-09-17T07:19:51.019 INFO:tasks.workunit.client.1.smithi139.stdout:7/195: stat f2 0 2024-09-17T07:19:51.019 INFO:tasks.workunit.client.1.smithi139.stdout:0/207: mkdir d1/da/d1b/d3d/d5a 0 2024-09-17T07:19:51.022 INFO:tasks.workunit.client.1.smithi139.stdout:7/196: stat d5/c25 0 2024-09-17T07:19:51.022 INFO:tasks.workunit.client.1.smithi139.stdout:8/255: write d0/d1a/d3a/f42 [808431,81727] 0 2024-09-17T07:19:51.024 INFO:tasks.workunit.client.1.smithi139.stdout:6/350: mkdir db/df/d73 0 2024-09-17T07:19:51.025 INFO:tasks.workunit.client.1.smithi139.stdout:5/165: symlink d4/d16/d1b/d20/l30 0 2024-09-17T07:19:51.027 INFO:tasks.workunit.client.1.smithi139.stdout:0/208: creat d1/da/d1b/d32/d21/f5b x:0 0 0 2024-09-17T07:19:51.028 INFO:tasks.workunit.client.1.smithi139.stdout:2/260: truncate d0/f3 3468210 0 2024-09-17T07:19:51.030 INFO:tasks.workunit.client.1.smithi139.stdout:2/261: truncate d0/f6 5832670 0 2024-09-17T07:19:51.030 INFO:tasks.workunit.client.1.smithi139.stdout:8/256: mknod d0/d20/d28/c46 0 2024-09-17T07:19:51.031 INFO:tasks.workunit.client.1.smithi139.stdout:6/351: creat db/df/d4c/f74 x:0 0 0 2024-09-17T07:19:51.031 INFO:tasks.workunit.client.1.smithi139.stdout:7/197: dread - d5/d17/f3a zero size 2024-09-17T07:19:51.034 INFO:tasks.workunit.client.1.smithi139.stdout:0/209: unlink d1/da/d1b/f4b 0 2024-09-17T07:19:51.038 INFO:tasks.workunit.client.1.smithi139.stdout:7/198: symlink d5/d17/l3e 0 2024-09-17T07:19:51.040 INFO:tasks.workunit.client.1.smithi139.stdout:1/156: getdents d2/d10/d12/d1a/d25 0 2024-09-17T07:19:51.041 INFO:tasks.workunit.client.1.smithi139.stdout:6/352: dread db/df/f24 [0,4194304] 0 2024-09-17T07:19:51.042 INFO:tasks.workunit.client.1.smithi139.stdout:0/210: mkdir d1/da/d2a/d5c 0 2024-09-17T07:19:51.042 INFO:tasks.workunit.client.1.smithi139.stdout:1/157: chown d2/d10/d12/l22 6 1 2024-09-17T07:19:51.045 INFO:tasks.workunit.client.1.smithi139.stdout:4/258: dread d0/f13 [0,4194304] 0 2024-09-17T07:19:51.045 INFO:tasks.workunit.client.1.smithi139.stdout:0/211: write d1/da/d1b/d32/f37 [495825,87856] 0 2024-09-17T07:19:51.045 INFO:tasks.workunit.client.1.smithi139.stdout:1/158: readlink d2/d10/d12/l22 0 2024-09-17T07:19:51.046 INFO:tasks.workunit.client.1.smithi139.stdout:4/259: fdatasync d0/db/f4a 0 2024-09-17T07:19:51.048 INFO:tasks.workunit.client.1.smithi139.stdout:8/257: rename d0/d1a/f21 to d0/d1a/d3a/f47 0 2024-09-17T07:19:51.048 INFO:tasks.workunit.client.1.smithi139.stdout:7/199: creat d5/d10/d2b/f3f x:0 0 0 2024-09-17T07:19:51.049 INFO:tasks.workunit.client.1.smithi139.stdout:2/262: getdents d0/dc/d3a 0 2024-09-17T07:19:51.051 INFO:tasks.workunit.client.1.smithi139.stdout:5/166: getdents d4/d16/d1b/d20/d28 0 2024-09-17T07:19:51.051 INFO:tasks.workunit.client.1.smithi139.stdout:8/258: fdatasync d0/fd 0 2024-09-17T07:19:51.054 INFO:tasks.workunit.client.1.smithi139.stdout:8/259: stat d0/dc/d18/c45 0 2024-09-17T07:19:51.054 INFO:tasks.workunit.client.1.smithi139.stdout:7/200: unlink d5/d10/f29 0 2024-09-17T07:19:51.055 INFO:tasks.workunit.client.1.smithi139.stdout:5/167: chown d4/d16/d1b 7235 1 2024-09-17T07:19:51.059 INFO:tasks.workunit.client.1.smithi139.stdout:7/201: write d5/d17/f3a [953289,114299] 0 2024-09-17T07:19:51.059 INFO:tasks.workunit.client.1.smithi139.stdout:1/159: dwrite d2/d10/d12/f29 [0,4194304] 0 2024-09-17T07:19:51.065 INFO:tasks.workunit.client.1.smithi139.stdout:4/260: write d0/d1/d29/d41/f44 [2310526,6426] 0 2024-09-17T07:19:51.065 INFO:tasks.workunit.client.1.smithi139.stdout:4/261: stat d0/db/f4a 0 2024-09-17T07:19:51.066 INFO:tasks.workunit.client.1.smithi139.stdout:6/353: rmdir db/df 39 2024-09-17T07:19:51.066 INFO:tasks.workunit.client.1.smithi139.stdout:4/262: write d0/d10/f25 [780346,86375] 0 2024-09-17T07:19:51.066 INFO:tasks.workunit.client.1.smithi139.stdout:7/202: write d5/d10/d2b/f3f [138296,77284] 0 2024-09-17T07:19:51.067 INFO:tasks.workunit.client.1.smithi139.stdout:3/183: sync 2024-09-17T07:19:51.067 INFO:tasks.workunit.client.1.smithi139.stdout:9/460: sync 2024-09-17T07:19:51.068 INFO:tasks.workunit.client.1.smithi139.stdout:4/263: chown d0/f1d 4203 1 2024-09-17T07:19:51.070 INFO:tasks.workunit.client.1.smithi139.stdout:4/264: dread - d0/d10/f40 zero size 2024-09-17T07:19:51.071 INFO:tasks.workunit.client.1.smithi139.stdout:7/203: readlink d5/lc 0 2024-09-17T07:19:51.073 INFO:tasks.workunit.client.0.smithi087.stdout:4/287: sync 2024-09-17T07:19:51.075 INFO:tasks.workunit.client.1.smithi139.stdout:1/160: dwrite d2/d10/d12/d13/f17 [0,4194304] 0 2024-09-17T07:19:51.077 INFO:tasks.workunit.client.1.smithi139.stdout:1/161: truncate d2/d10/d12/f2d 808462 0 2024-09-17T07:19:51.079 INFO:tasks.workunit.client.0.smithi087.stdout:4/288: rename d2/d22/d2c/f58 to d2/d5/d1f/f68 0 2024-09-17T07:19:51.079 INFO:tasks.workunit.client.1.smithi139.stdout:9/461: write f4 [5216697,126849] 0 2024-09-17T07:19:51.081 INFO:tasks.workunit.client.1.smithi139.stdout:5/168: getdents d4/d16/d1b/d20/d28 0 2024-09-17T07:19:51.081 INFO:tasks.workunit.client.1.smithi139.stdout:3/184: creat d5/f39 x:0 0 0 2024-09-17T07:19:51.082 INFO:tasks.workunit.client.1.smithi139.stdout:6/354: mknod db/df/d4e/d64/d56/c75 0 2024-09-17T07:19:51.084 INFO:tasks.workunit.client.0.smithi087.stdout:4/289: unlink d2/d22/d2c/d3f/d4f/f50 0 2024-09-17T07:19:51.084 INFO:tasks.workunit.client.1.smithi139.stdout:0/212: link d1/da/d1b/l4d d1/l5d 0 2024-09-17T07:19:51.085 INFO:tasks.workunit.client.1.smithi139.stdout:9/462: mkdir dc/d11/d15/d1e/d7c/d83/d98 0 2024-09-17T07:19:51.085 INFO:tasks.workunit.client.1.smithi139.stdout:3/185: dread - d5/d15/d20/d22/f36 zero size 2024-09-17T07:19:51.087 INFO:tasks.workunit.client.1.smithi139.stdout:1/162: symlink d2/d10/l2f 0 2024-09-17T07:19:51.087 INFO:tasks.workunit.client.1.smithi139.stdout:6/355: readlink db/df/d4e/d64/d54/l34 0 2024-09-17T07:19:51.088 INFO:tasks.workunit.client.1.smithi139.stdout:5/169: creat d4/d16/f31 x:0 0 0 2024-09-17T07:19:51.089 INFO:tasks.workunit.client.0.smithi087.stdout:4/290: creat d2/d5/d1f/f69 x:0 0 0 2024-09-17T07:19:51.089 INFO:tasks.workunit.client.1.smithi139.stdout:9/463: chown dc/d11/d15/d3c/l93 149172 1 2024-09-17T07:19:51.090 INFO:tasks.workunit.client.0.smithi087.stdout:4/291: rmdir d2 39 2024-09-17T07:19:51.092 INFO:tasks.workunit.client.1.smithi139.stdout:2/263: truncate d0/d7/d1a/f1e 4175533 0 2024-09-17T07:19:51.093 INFO:tasks.workunit.client.0.smithi087.stdout:4/292: fdatasync d2/d22/d2c/d3f/d4f/f54 0 2024-09-17T07:19:51.095 INFO:tasks.workunit.client.1.smithi139.stdout:7/204: getdents d5/d17 0 2024-09-17T07:19:51.095 INFO:tasks.workunit.client.0.smithi087.stdout:4/293: mkdir d2/d22/d2c/d3f/d4f/d6a 0 2024-09-17T07:19:51.097 INFO:tasks.workunit.client.0.smithi087.stdout:4/294: mkdir d2/d22/d2c/d3f/d4f/d6a/d6b 0 2024-09-17T07:19:51.097 INFO:tasks.workunit.client.1.smithi139.stdout:1/163: creat d2/d10/d12/d1a/f30 x:0 0 0 2024-09-17T07:19:51.098 INFO:tasks.workunit.client.1.smithi139.stdout:5/170: chown d4/d16/f18 1 1 2024-09-17T07:19:51.098 INFO:tasks.workunit.client.0.smithi087.stdout:4/295: read f0 [1166576,70230] 0 2024-09-17T07:19:51.100 INFO:tasks.workunit.client.0.smithi087.stdout:4/296: write d2/d22/d2c/d3f/d4d/d42/f55 [567073,35154] 0 2024-09-17T07:19:51.101 INFO:tasks.workunit.client.1.smithi139.stdout:2/264: creat d0/de/d11/d32/f4f x:0 0 0 2024-09-17T07:19:51.101 INFO:tasks.workunit.client.1.smithi139.stdout:4/265: dread d0/db/f21 [0,4194304] 0 2024-09-17T07:19:51.104 INFO:tasks.workunit.client.1.smithi139.stdout:9/464: truncate dc/d11/d15/d1e/f6b 536845 0 2024-09-17T07:19:51.105 INFO:tasks.workunit.client.1.smithi139.stdout:8/260: dwrite d0/d20/d28/f3d [0,4194304] 0 2024-09-17T07:19:51.105 INFO:tasks.workunit.client.1.smithi139.stdout:4/266: write d0/f47 [610832,9793] 0 2024-09-17T07:19:51.106 INFO:tasks.workunit.client.1.smithi139.stdout:1/164: creat d2/d10/d12/f31 x:0 0 0 2024-09-17T07:19:51.106 INFO:tasks.workunit.client.0.smithi087.stdout:4/297: dwrite d2/d5/d1f/f5e [0,4194304] 0 2024-09-17T07:19:51.108 INFO:tasks.workunit.client.1.smithi139.stdout:6/356: rename db/d18/d1b/c2c to db/c76 0 2024-09-17T07:19:51.109 INFO:tasks.workunit.client.0.smithi087.stdout:4/298: creat d2/d22/d2c/d3f/d4d/d21/f6c x:0 0 0 2024-09-17T07:19:51.109 INFO:tasks.workunit.client.1.smithi139.stdout:0/213: dwrite d1/da/d1b/d32/f37 [0,4194304] 0 2024-09-17T07:19:51.114 INFO:tasks.workunit.client.1.smithi139.stdout:9/465: write dc/d11/f8f [4563539,86105] 0 2024-09-17T07:19:51.116 INFO:tasks.workunit.client.1.smithi139.stdout:9/466: fdatasync dc/d2a/f87 0 2024-09-17T07:19:51.119 INFO:tasks.workunit.client.1.smithi139.stdout:8/261: mkdir d0/d20/d28/d48 0 2024-09-17T07:19:51.119 INFO:tasks.workunit.client.1.smithi139.stdout:0/214: chown d1/da/d2a/f51 0 1 2024-09-17T07:19:51.120 INFO:tasks.workunit.client.1.smithi139.stdout:9/467: read - dc/d11/d15/d3c/d61/f88 zero size 2024-09-17T07:19:51.122 INFO:tasks.workunit.client.1.smithi139.stdout:1/165: dwrite d2/d10/d12/f31 [0,4194304] 0 2024-09-17T07:19:51.122 INFO:tasks.workunit.client.1.smithi139.stdout:3/186: truncate d5/d13/f1a 847485 0 2024-09-17T07:19:51.123 INFO:tasks.workunit.client.1.smithi139.stdout:2/265: rename d0/dc/f2f to d0/de/d25/d3f/f50 0 2024-09-17T07:19:51.128 INFO:tasks.workunit.client.0.smithi087.stdout:4/299: write d2/d22/d2c/d3f/d4d/d21/d2f/d3b/f56 [3283020,93789] 0 2024-09-17T07:19:51.129 INFO:tasks.workunit.client.0.smithi087.stdout:4/300: write d2/f45 [854348,25545] 0 2024-09-17T07:19:51.129 INFO:tasks.workunit.client.1.smithi139.stdout:3/187: rename d5/l8 to d5/d21/d23/l3a 0 2024-09-17T07:19:51.130 INFO:tasks.workunit.client.1.smithi139.stdout:6/357: creat db/d18/d38/f77 x:0 0 0 2024-09-17T07:19:51.131 INFO:tasks.workunit.client.1.smithi139.stdout:9/468: dread dc/d11/d15/d3c/f3d [0,4194304] 0 2024-09-17T07:19:51.131 INFO:tasks.workunit.client.1.smithi139.stdout:3/188: chown d5/d21/c34 910869 1 2024-09-17T07:19:51.132 INFO:tasks.workunit.client.0.smithi087.stdout:4/301: read d2/d22/d2c/d3f/d4d/d21/f4c [711198,81121] 0 2024-09-17T07:19:51.132 INFO:tasks.workunit.client.1.smithi139.stdout:4/267: creat d0/f4c x:0 0 0 2024-09-17T07:19:51.133 INFO:tasks.workunit.client.1.smithi139.stdout:8/262: symlink d0/dc/l49 0 2024-09-17T07:19:51.137 INFO:tasks.workunit.client.0.smithi087.stdout:4/302: rmdir d2/d22/d2c/d3f/d4f/d6a/d6b 0 2024-09-17T07:19:51.137 INFO:tasks.workunit.client.1.smithi139.stdout:2/266: fdatasync d0/f3 0 2024-09-17T07:19:51.137 INFO:tasks.workunit.client.1.smithi139.stdout:2/267: read - d0/dc/d3a/f3d zero size 2024-09-17T07:19:51.138 INFO:tasks.workunit.client.1.smithi139.stdout:1/166: mkdir d2/d10/d12/d24/d32 0 2024-09-17T07:19:51.139 INFO:tasks.workunit.client.0.smithi087.stdout:4/303: mknod d2/d22/c6d 0 2024-09-17T07:19:51.140 INFO:tasks.workunit.client.1.smithi139.stdout:1/167: write f0 [4731922,40895] 0 2024-09-17T07:19:51.142 INFO:tasks.workunit.client.1.smithi139.stdout:4/268: stat d0/c46 0 2024-09-17T07:19:51.142 INFO:tasks.workunit.client.0.smithi087.stdout:4/304: mkdir d2/d22/d2c/d3f/d4d/d21/d2f/d6e 0 2024-09-17T07:19:51.142 INFO:tasks.workunit.client.1.smithi139.stdout:6/358: rename db/df/l17 to db/df/d4e/d64/d54/l78 0 2024-09-17T07:19:51.144 INFO:tasks.workunit.client.0.smithi087.stdout:4/305: creat d2/d22/d2c/d3f/f6f x:0 0 0 2024-09-17T07:19:51.146 INFO:tasks.workunit.client.0.smithi087.stdout:4/306: creat d2/d22/d2c/d3f/d4d/d21/f70 x:0 0 0 2024-09-17T07:19:51.146 INFO:tasks.workunit.client.1.smithi139.stdout:3/189: mkdir d5/d15/d20/d3b 0 2024-09-17T07:19:51.147 INFO:tasks.workunit.client.0.smithi087.stdout:4/307: mkdir d2/d22/d2c/d3f/d4d/d21/d2f/d3b/d71 0 2024-09-17T07:19:51.148 INFO:tasks.workunit.client.1.smithi139.stdout:0/215: rmdir d1/da/d1b/d57 0 2024-09-17T07:19:51.149 INFO:tasks.workunit.client.0.smithi087.stdout:4/308: truncate d2/d22/d2c/d3f/d4d/f64 780917 0 2024-09-17T07:19:51.149 INFO:tasks.workunit.client.1.smithi139.stdout:2/268: dwrite d0/de/df/f39 [4194304,4194304] 0 2024-09-17T07:19:51.149 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:51.149+0000 7f28114ae640 1 -- 172.21.15.87:0/3874534488 --> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f280c0008d0 con 0x7f27f406fde0 2024-09-17T07:19:51.150 INFO:tasks.workunit.client.0.smithi087.stdout:4/309: creat d2/d22/d62/f72 x:0 0 0 2024-09-17T07:19:51.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:51.150+0000 7f27f37fe640 1 -- 172.21.15.87:0/3874534488 <== mgr.24339 v2:172.21.15.139:6828/3218632563 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f280c0008d0 con 0x7f27f406fde0 2024-09-17T07:19:51.152 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T07:19:51.152 INFO:teuthology.orchestra.run.smithi087.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9", 2024-09-17T07:19:51.152 INFO:teuthology.orchestra.run.smithi087.stdout: "in_progress": true, 2024-09-17T07:19:51.152 INFO:teuthology.orchestra.run.smithi087.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T07:19:51.152 INFO:teuthology.orchestra.run.smithi087.stdout: "services_complete": [], 2024-09-17T07:19:51.152 INFO:teuthology.orchestra.run.smithi087.stdout: "progress": "1/21 daemons upgraded", 2024-09-17T07:19:51.152 INFO:teuthology.orchestra.run.smithi087.stdout: "message": "", 2024-09-17T07:19:51.152 INFO:teuthology.orchestra.run.smithi087.stdout: "is_paused": false 2024-09-17T07:19:51.152 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T07:19:51.153 INFO:tasks.workunit.client.0.smithi087.stdout:4/310: symlink d2/d5/d1f/l73 0 2024-09-17T07:19:51.153 INFO:tasks.workunit.client.1.smithi139.stdout:6/359: dread db/df/d4e/d64/d54/d40/f3c [0,4194304] 0 2024-09-17T07:19:51.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:51.153+0000 7f28114ae640 1 -- 172.21.15.87:0/3874534488 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f27f406fde0 msgr2=0x7f27f4072290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:19:51.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:51.153+0000 7f28114ae640 1 --2- 172.21.15.87:0/3874534488 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f27f406fde0 0x7f27f4072290 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f280000b020 tx=0x7f2800035040 comp rx=0 tx=0).stop 2024-09-17T07:19:51.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:51.153+0000 7f28114ae640 1 -- 172.21.15.87:0/3874534488 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f280c0fb430 msgr2=0x7f280c10bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:19:51.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:51.153+0000 7f28114ae640 1 --2- 172.21.15.87:0/3874534488 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f280c0fb430 0x7f280c10bf50 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f27fc00eb70 tx=0x7f27fc00b040 comp rx=0 tx=0).stop 2024-09-17T07:19:51.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:51.153+0000 7f28114ae640 1 -- 172.21.15.87:0/3874534488 shutdown_connections 2024-09-17T07:19:51.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:51.153+0000 7f28114ae640 1 --2- 172.21.15.87:0/3874534488 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f27f406fde0 0x7f27f4072290 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:51.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:51.153+0000 7f28114ae640 1 --2- 172.21.15.87:0/3874534488 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f280c0fc700 0x7f280c10c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:51.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:51.153+0000 7f28114ae640 1 --2- 172.21.15.87:0/3874534488 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f280c0fb430 0x7f280c10bf50 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:51.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:51.153+0000 7f28114ae640 1 -- 172.21.15.87:0/3874534488 >> 172.21.15.87:0/3874534488 conn(0x7f280c0f6c10 msgr2=0x7f280c0ffa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:19:51.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:51.153+0000 7f28114ae640 1 -- 172.21.15.87:0/3874534488 shutdown_connections 2024-09-17T07:19:51.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:51.153+0000 7f28114ae640 1 -- 172.21.15.87:0/3874534488 wait complete. 2024-09-17T07:19:51.155 INFO:tasks.workunit.client.0.smithi087.stdout:4/311: rmdir d2/d5 39 2024-09-17T07:19:51.156 INFO:tasks.workunit.client.1.smithi139.stdout:4/269: symlink d0/d1/d29/d41/l4d 0 2024-09-17T07:19:51.156 INFO:tasks.workunit.client.0.smithi087.stdout:4/312: mkdir d2/d22/d2c/d3f/d74 0 2024-09-17T07:19:51.157 INFO:tasks.workunit.client.1.smithi139.stdout:4/270: chown d0/d1/c31 21528 1 2024-09-17T07:19:51.157 INFO:tasks.workunit.client.0.smithi087.stdout:4/313: dread - d2/d22/d2c/f31 zero size 2024-09-17T07:19:51.158 INFO:tasks.workunit.client.1.smithi139.stdout:8/263: link d0/fa d0/d1a/f4a 0 2024-09-17T07:19:51.160 INFO:tasks.workunit.client.1.smithi139.stdout:9/469: getdents dc/d11/d15/d3c/d61/d64/d96 0 2024-09-17T07:19:51.160 INFO:tasks.workunit.client.0.smithi087.stdout:4/314: creat d2/d22/d2c/d3f/d4d/f75 x:0 0 0 2024-09-17T07:19:51.161 INFO:tasks.workunit.client.1.smithi139.stdout:3/190: rmdir d5/d15/d16 39 2024-09-17T07:19:51.163 INFO:tasks.workunit.client.0.smithi087.stdout:4/315: dread d2/d22/d2c/d3f/d4d/f48 [0,4194304] 0 2024-09-17T07:19:51.163 INFO:tasks.workunit.client.1.smithi139.stdout:2/269: unlink d0/de/d11/d12/f47 0 2024-09-17T07:19:51.164 INFO:tasks.workunit.client.0.smithi087.stdout:4/316: chown d2/d22/d2c/d3f/d74 265233696 1 2024-09-17T07:19:51.165 INFO:tasks.workunit.client.1.smithi139.stdout:1/168: read d2/f11 [1366844,128672] 0 2024-09-17T07:19:51.165 INFO:tasks.workunit.client.1.smithi139.stdout:6/360: symlink db/df/d4e/d64/d54/d40/l79 0 2024-09-17T07:19:51.166 INFO:tasks.workunit.client.0.smithi087.stdout:4/317: creat d2/d22/d2c/d3f/d4d/d21/f76 x:0 0 0 2024-09-17T07:19:51.166 INFO:tasks.workunit.client.1.smithi139.stdout:6/361: chown f8 1524 1 2024-09-17T07:19:51.167 INFO:tasks.workunit.client.0.smithi087.stdout:4/318: chown d2/d22/d2c/d3f/d4d/l60 29606490 1 2024-09-17T07:19:51.169 INFO:tasks.workunit.client.1.smithi139.stdout:8/264: chown d0/dc/c1d 4406885 1 2024-09-17T07:19:51.170 INFO:tasks.workunit.client.1.smithi139.stdout:8/265: write d0/dc/f27 [5078148,64219] 0 2024-09-17T07:19:51.171 INFO:tasks.workunit.client.1.smithi139.stdout:8/266: dread - d0/d1a/f3f zero size 2024-09-17T07:19:51.171 INFO:tasks.workunit.client.0.smithi087.stdout:4/319: link d2/f6 d2/d22/d2c/d3f/d4d/d21/d2f/d3b/f77 0 2024-09-17T07:19:51.172 INFO:tasks.workunit.client.1.smithi139.stdout:9/470: rename dc/d11/d15/d3c/f45 to dc/d11/d52/d56/f99 0 2024-09-17T07:19:51.173 INFO:tasks.workunit.client.1.smithi139.stdout:3/191: creat d5/f3c x:0 0 0 2024-09-17T07:19:51.174 INFO:tasks.workunit.client.1.smithi139.stdout:9/471: write dc/d11/d15/d1e/d7c/d83/f84 [957371,84540] 0 2024-09-17T07:19:51.175 INFO:tasks.workunit.client.0.smithi087.stdout:4/320: read d2/d22/d2c/d3f/f65 [6215944,34293] 0 2024-09-17T07:19:51.175 INFO:tasks.workunit.client.0.smithi087.stdout:4/321: read - d2/d22/d62/f72 zero size 2024-09-17T07:19:51.177 INFO:tasks.workunit.client.1.smithi139.stdout:0/216: creat d1/da/d2a/d5c/f5e x:0 0 0 2024-09-17T07:19:51.177 INFO:tasks.workunit.client.1.smithi139.stdout:2/270: rmdir d0/de/d11/d28 39 2024-09-17T07:19:51.177 INFO:tasks.workunit.client.0.smithi087.stdout:4/322: chown d2/d22/d2c/d3f/d4d/d21 162 1 2024-09-17T07:19:51.178 INFO:tasks.workunit.client.1.smithi139.stdout:0/217: read - d1/f3e zero size 2024-09-17T07:19:51.179 INFO:tasks.workunit.client.1.smithi139.stdout:1/169: chown d2/ff 10 1 2024-09-17T07:19:51.179 INFO:tasks.workunit.client.0.smithi087.stdout:4/323: creat d2/d22/d2c/d3f/d4d/d21/d2f/d6e/f78 x:0 0 0 2024-09-17T07:19:51.179 INFO:tasks.workunit.client.0.smithi087.stdout:3/284: sync 2024-09-17T07:19:51.180 INFO:tasks.workunit.client.0.smithi087.stdout:3/285: write d6/fc [57018,125626] 0 2024-09-17T07:19:51.184 INFO:tasks.workunit.client.0.smithi087.stdout:3/286: creat d6/f59 x:0 0 0 2024-09-17T07:19:51.186 INFO:tasks.workunit.client.0.smithi087.stdout:3/287: symlink d6/d1b/l5a 0 2024-09-17T07:19:51.187 INFO:tasks.workunit.client.1.smithi139.stdout:4/271: truncate d0/d10/f25 453203 0 2024-09-17T07:19:51.187 INFO:tasks.workunit.client.0.smithi087.stdout:3/288: write d6/d1b/d42/f44 [187122,114163] 0 2024-09-17T07:19:51.188 INFO:tasks.workunit.client.1.smithi139.stdout:9/472: mknod dc/d11/d52/d56/d75/c9a 0 2024-09-17T07:19:51.190 INFO:tasks.workunit.client.1.smithi139.stdout:2/271: write d0/de/d25/d3f/f50 [1539158,106626] 0 2024-09-17T07:19:51.190 INFO:tasks.workunit.client.0.smithi087.stdout:3/289: creat d6/d15/d37/f5b x:0 0 0 2024-09-17T07:19:51.191 INFO:tasks.workunit.client.1.smithi139.stdout:6/362: creat db/df/d73/f7a x:0 0 0 2024-09-17T07:19:51.192 INFO:tasks.workunit.client.0.smithi087.stdout:3/290: creat d6/d15/d37/f5c x:0 0 0 2024-09-17T07:19:51.192 INFO:tasks.workunit.client.0.smithi087.stdout:4/324: truncate d2/f25 2821847 0 2024-09-17T07:19:51.193 INFO:tasks.workunit.client.0.smithi087.stdout:3/291: mknod d6/d15/d37/c5d 0 2024-09-17T07:19:51.194 INFO:tasks.workunit.client.1.smithi139.stdout:0/218: mknod d1/da/d17/c5f 0 2024-09-17T07:19:51.195 INFO:tasks.workunit.client.0.smithi087.stdout:3/292: truncate d6/d15/d37/f55 861663 0 2024-09-17T07:19:51.196 INFO:tasks.workunit.client.1.smithi139.stdout:9/473: dread dc/d11/d15/d1e/f60 [0,4194304] 0 2024-09-17T07:19:51.196 INFO:tasks.workunit.client.0.smithi087.stdout:4/325: getdents d2/d22/d2c/d3f/d4d/d21/d2f 0 2024-09-17T07:19:51.197 INFO:tasks.workunit.client.0.smithi087.stdout:3/293: mkdir d6/d15/d37/d5e 0 2024-09-17T07:19:51.197 INFO:tasks.workunit.client.1.smithi139.stdout:3/192: rename d5/d15/d16/f1f to d5/d15/d20/d22/d28/f3d 0 2024-09-17T07:19:51.198 INFO:tasks.workunit.client.0.smithi087.stdout:4/326: creat d2/d22/d2c/d3f/d4d/d21/f79 x:0 0 0 2024-09-17T07:19:51.200 INFO:tasks.workunit.client.1.smithi139.stdout:4/272: symlink d0/l4e 0 2024-09-17T07:19:51.200 INFO:tasks.workunit.client.1.smithi139.stdout:6/363: symlink db/d18/d38/l7b 0 2024-09-17T07:19:51.203 INFO:tasks.workunit.client.1.smithi139.stdout:4/273: chown d0/f1d 24594 1 2024-09-17T07:19:51.203 INFO:tasks.workunit.client.1.smithi139.stdout:8/267: rename d0/dc/f10 to d0/dc/f4b 0 2024-09-17T07:19:51.204 INFO:tasks.workunit.client.0.smithi087.stdout:4/327: link d2/d22/c67 d2/d22/d2c/c7a 0 2024-09-17T07:19:51.206 INFO:tasks.workunit.client.0.smithi087.stdout:4/328: mkdir d2/d22/d2c/d3f/d4f/d7b 0 2024-09-17T07:19:51.211 INFO:tasks.workunit.client.0.smithi087.stdout:3/294: dread d6/d15/f24 [0,4194304] 0 2024-09-17T07:19:51.213 INFO:tasks.workunit.client.0.smithi087.stdout:3/295: read d6/fd [944736,51329] 0 2024-09-17T07:19:51.214 INFO:tasks.workunit.client.0.smithi087.stdout:4/329: dwrite d2/d5/d1f/f69 [0,4194304] 0 2024-09-17T07:19:51.218 INFO:tasks.workunit.client.0.smithi087.stdout:3/296: mknod d6/d15/d37/d3c/d52/c5f 0 2024-09-17T07:19:51.219 INFO:tasks.workunit.client.0.smithi087.stdout:3/297: write d6/d1b/d42/f3d [495104,129313] 0 2024-09-17T07:19:51.223 INFO:tasks.workunit.client.0.smithi087.stdout:3/298: rename d6/d15/d37/d3c/f51 to d6/d15/f60 0 2024-09-17T07:19:51.226 INFO:tasks.workunit.client.1.smithi139.stdout:3/193: mknod d5/d21/d23/d38/c3e 0 2024-09-17T07:19:51.227 INFO:tasks.workunit.client.0.smithi087.stdout:2/357: sync 2024-09-17T07:19:51.227 INFO:tasks.workunit.client.0.smithi087.stdout:1/309: sync 2024-09-17T07:19:51.227 INFO:tasks.workunit.client.0.smithi087.stdout:8/304: sync 2024-09-17T07:19:51.227 INFO:tasks.workunit.client.0.smithi087.stdout:0/497: sync 2024-09-17T07:19:51.227 INFO:tasks.workunit.client.0.smithi087.stdout:7/292: sync 2024-09-17T07:19:51.227 INFO:tasks.workunit.client.0.smithi087.stdout:5/445: sync 2024-09-17T07:19:51.227 INFO:tasks.workunit.client.0.smithi087.stdout:9/282: sync 2024-09-17T07:19:51.228 INFO:tasks.workunit.client.0.smithi087.stdout:6/452: sync 2024-09-17T07:19:51.228 INFO:tasks.workunit.client.1.smithi139.stdout:2/272: dwrite d0/de/d11/d28/f37 [0,4194304] 0 2024-09-17T07:19:51.229 INFO:tasks.workunit.client.0.smithi087.stdout:0/498: stat db/d45/f75 0 2024-09-17T07:19:51.229 INFO:tasks.workunit.client.1.smithi139.stdout:0/219: link d1/da/d1b/d32/d21/f30 d1/da/f60 0 2024-09-17T07:19:51.230 INFO:tasks.workunit.client.1.smithi139.stdout:8/268: chown d0/dc/d18/c41 279 1 2024-09-17T07:19:51.230 INFO:tasks.workunit.client.1.smithi139.stdout:9/474: dwrite dc/d11/d52/f77 [0,4194304] 0 2024-09-17T07:19:51.231 INFO:tasks.workunit.client.0.smithi087.stdout:2/358: stat d2/d7/dd/f27 0 2024-09-17T07:19:51.234 INFO:tasks.workunit.client.0.smithi087.stdout:4/330: dread d2/f6 [0,4194304] 0 2024-09-17T07:19:51.235 INFO:tasks.workunit.client.0.smithi087.stdout:7/293: truncate d0/d3/d10/f38 646147 0 2024-09-17T07:19:51.235 INFO:tasks.workunit.client.0.smithi087.stdout:0/499: truncate db/d45/f97 172278 0 2024-09-17T07:19:51.235 INFO:tasks.workunit.client.0.smithi087.stdout:6/453: mkdir d1/d6a/da3 0 2024-09-17T07:19:51.235 INFO:tasks.workunit.client.1.smithi139.stdout:6/364: getdents db/d18/d38/d60 0 2024-09-17T07:19:51.236 INFO:tasks.workunit.client.0.smithi087.stdout:9/283: readlink d3/d4/d6/d8/d22/l57 0 2024-09-17T07:19:51.236 INFO:tasks.workunit.client.1.smithi139.stdout:3/194: mknod d5/d15/d20/d3b/c3f 0 2024-09-17T07:19:51.237 INFO:tasks.workunit.client.1.smithi139.stdout:2/273: write d0/de/d11/d32/f4f [1028104,59346] 0 2024-09-17T07:19:51.239 INFO:tasks.workunit.client.0.smithi087.stdout:3/299: dwrite d6/d15/d37/f5b [0,4194304] 0 2024-09-17T07:19:51.239 INFO:tasks.workunit.client.0.smithi087.stdout:8/305: mkdir d1/d7/d9/d19/d73 0 2024-09-17T07:19:51.241 INFO:tasks.workunit.client.1.smithi139.stdout:4/274: dwrite d0/f26 [0,4194304] 0 2024-09-17T07:19:51.241 INFO:tasks.workunit.client.1.smithi139.stdout:9/475: read dc/d11/f12 [766112,30274] 0 2024-09-17T07:19:51.244 INFO:tasks.workunit.client.1.smithi139.stdout:6/365: unlink db/d18/d38/l7b 0 2024-09-17T07:19:51.245 INFO:tasks.workunit.client.0.smithi087.stdout:4/331: chown d2/d22/d2c/f31 1362 1 2024-09-17T07:19:51.246 INFO:tasks.workunit.client.0.smithi087.stdout:0/500: symlink db/lba 0 2024-09-17T07:19:51.246 INFO:tasks.workunit.client.0.smithi087.stdout:4/332: chown d2/d22/d2c/d3f/f51 20513163 1 2024-09-17T07:19:51.249 INFO:tasks.workunit.client.1.smithi139.stdout:0/220: truncate d1/da/d1b/d3d/d50/f55 5196233 0 2024-09-17T07:19:51.249 INFO:tasks.workunit.client.1.smithi139.stdout:2/274: rename d0/fa to d0/d3b/f51 0 2024-09-17T07:19:51.250 INFO:tasks.workunit.client.1.smithi139.stdout:9/476: fdatasync dc/d11/d15/d3c/d68/f90 0 2024-09-17T07:19:51.250 INFO:tasks.workunit.client.1.smithi139.stdout:4/275: chown d0/db/f21 343351 1 2024-09-17T07:19:51.251 INFO:tasks.workunit.client.1.smithi139.stdout:3/195: dread d5/f7 [0,4194304] 0 2024-09-17T07:19:51.253 INFO:tasks.workunit.client.1.smithi139.stdout:8/269: dwrite d0/d1a/f3f [0,4194304] 0 2024-09-17T07:19:51.253 INFO:tasks.workunit.client.1.smithi139.stdout:2/275: chown d0/de/d25/d3f/l48 200765102 1 2024-09-17T07:19:51.254 INFO:tasks.workunit.client.1.smithi139.stdout:0/221: truncate d1/da/d1b/f33 657281 0 2024-09-17T07:19:51.255 INFO:tasks.workunit.client.0.smithi087.stdout:7/294: rename d0/d3/d10/d31/c4f to d0/d3/d10/c5f 0 2024-09-17T07:19:51.256 INFO:tasks.workunit.client.0.smithi087.stdout:0/501: chown db/c2c 930548 1 2024-09-17T07:19:51.256 INFO:tasks.workunit.client.0.smithi087.stdout:4/333: truncate d2/d5/f2a 83228 0 2024-09-17T07:19:51.257 INFO:tasks.workunit.client.1.smithi139.stdout:9/477: write dc/d11/d15/d3c/f7e [114695,57702] 0 2024-09-17T07:19:51.257 INFO:tasks.workunit.client.1.smithi139.stdout:6/366: write db/df/d4e/d64/d54/d40/f3b [843781,79067] 0 2024-09-17T07:19:51.259 INFO:tasks.workunit.client.0.smithi087.stdout:3/300: dread - d6/d15/d37/d3c/d43/d48/f58 zero size 2024-09-17T07:19:51.260 INFO:tasks.workunit.client.1.smithi139.stdout:9/478: truncate dc/d11/d15/d3c/d61/d64/f70 101669 0 2024-09-17T07:19:51.260 INFO:tasks.workunit.client.1.smithi139.stdout:3/196: rename f4 to d5/d21/d23/d38/f40 0 2024-09-17T07:19:51.260 INFO:tasks.workunit.client.1.smithi139.stdout:8/270: rename d0 to d0/dc/d18/d4c 22 2024-09-17T07:19:51.261 INFO:tasks.workunit.client.1.smithi139.stdout:2/276: symlink d0/dc/l52 0 2024-09-17T07:19:51.261 INFO:tasks.workunit.client.0.smithi087.stdout:1/310: dwrite d2/dc/f23 [0,4194304] 0 2024-09-17T07:19:51.261 INFO:tasks.workunit.client.0.smithi087.stdout:0/502: chown db/d45/lb7 390402 1 2024-09-17T07:19:51.269 INFO:tasks.workunit.client.1.smithi139.stdout:4/276: creat d0/d1/f4f x:0 0 0 2024-09-17T07:19:51.269 INFO:tasks.workunit.client.0.smithi087.stdout:7/295: read d0/d3/d23/d2d/f35 [288073,80753] 0 2024-09-17T07:19:51.270 INFO:tasks.workunit.client.0.smithi087.stdout:8/306: dwrite d1/d5f/f5d [0,4194304] 0 2024-09-17T07:19:51.270 INFO:tasks.workunit.client.0.smithi087.stdout:0/503: mknod db/da3/cbb 0 2024-09-17T07:19:51.271 INFO:tasks.workunit.client.1.smithi139.stdout:3/197: mknod d5/d21/d23/c41 0 2024-09-17T07:19:51.272 INFO:tasks.workunit.client.1.smithi139.stdout:8/271: mkdir d0/d1a/d4d 0 2024-09-17T07:19:51.273 INFO:tasks.workunit.client.0.smithi087.stdout:1/311: readlink d2/d3d/d35/d57/d6a/l6c 0 2024-09-17T07:19:51.273 INFO:tasks.workunit.client.1.smithi139.stdout:2/277: symlink d0/dc/d3a/l53 0 2024-09-17T07:19:51.275 INFO:tasks.workunit.client.1.smithi139.stdout:9/479: mknod dc/d11/d52/d56/d7a/c9b 0 2024-09-17T07:19:51.275 INFO:tasks.workunit.client.0.smithi087.stdout:3/301: chown d6/d15/f19 0 1 2024-09-17T07:19:51.275 INFO:tasks.workunit.client.0.smithi087.stdout:5/446: dwrite d5/d6d/f80 [0,4194304] 0 2024-09-17T07:19:51.277 INFO:tasks.workunit.client.1.smithi139.stdout:3/198: creat d5/d15/d20/f42 x:0 0 0 2024-09-17T07:19:51.278 INFO:tasks.workunit.client.0.smithi087.stdout:6/454: write d1/f4 [4338554,4492] 0 2024-09-17T07:19:51.278 INFO:tasks.workunit.client.1.smithi139.stdout:2/278: mkdir d0/de/d54 0 2024-09-17T07:19:51.279 INFO:tasks.workunit.client.1.smithi139.stdout:4/277: dwrite d0/d1/f8 [0,4194304] 0 2024-09-17T07:19:51.279 INFO:tasks.workunit.client.0.smithi087.stdout:7/296: write d0/d3/d10/f1a [1137674,125950] 0 2024-09-17T07:19:51.279 INFO:tasks.workunit.client.0.smithi087.stdout:9/284: dwrite d3/f28 [0,4194304] 0 2024-09-17T07:19:51.280 INFO:tasks.workunit.client.1.smithi139.stdout:8/272: creat d0/dc/f4e x:0 0 0 2024-09-17T07:19:51.283 INFO:tasks.workunit.client.1.smithi139.stdout:9/480: creat dc/d11/d15/d1e/d7c/d83/f9c x:0 0 0 2024-09-17T07:19:51.285 INFO:tasks.workunit.client.0.smithi087.stdout:5/447: creat d5/d8/d1f/f92 x:0 0 0 2024-09-17T07:19:51.285 INFO:tasks.workunit.client.0.smithi087.stdout:3/302: truncate d6/d16/f38 1641097 0 2024-09-17T07:19:51.285 INFO:tasks.workunit.client.0.smithi087.stdout:7/297: dread - d0/d3/d10/d32/f4c zero size 2024-09-17T07:19:51.286 INFO:tasks.workunit.client.1.smithi139.stdout:3/199: fsync d5/fe 0 2024-09-17T07:19:51.290 INFO:tasks.workunit.client.1.smithi139.stdout:3/200: write d5/d15/d20/d22/d28/f30 [680876,18024] 0 2024-09-17T07:19:51.292 INFO:tasks.workunit.client.1.smithi139.stdout:2/279: symlink d0/l55 0 2024-09-17T07:19:51.292 INFO:tasks.workunit.client.1.smithi139.stdout:9/481: symlink dc/d11/d8b/l9d 0 2024-09-17T07:19:51.293 INFO:tasks.workunit.client.1.smithi139.stdout:8/273: truncate d0/fa 6100395 0 2024-09-17T07:19:51.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:51.291+0000 7f43b56f0640 1 -- 172.21.15.87:0/2940506142 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43b00fc1f0 msgr2=0x7f43b00fa620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:19:51.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:51.291+0000 7f43b56f0640 1 --2- 172.21.15.87:0/2940506142 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43b00fc1f0 0x7f43b00fa620 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f43a00048d0 tx=0x7f43a0009da0 comp rx=0 tx=0).stop 2024-09-17T07:19:51.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:51.292+0000 7f43b56f0640 1 -- 172.21.15.87:0/2940506142 shutdown_connections 2024-09-17T07:19:51.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:51.292+0000 7f43b56f0640 1 --2- 172.21.15.87:0/2940506142 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43b00fc1f0 0x7f43b00fa620 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:51.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:51.292+0000 7f43b56f0640 1 --2- 172.21.15.87:0/2940506142 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f43b00fb8a0 0x7f43b00fbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:51.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:51.292+0000 7f43b56f0640 1 -- 172.21.15.87:0/2940506142 >> 172.21.15.87:0/2940506142 conn(0x7f43b00f6390 msgr2=0x7f43b00f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:19:51.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:51.292+0000 7f43b56f0640 1 -- 172.21.15.87:0/2940506142 shutdown_connections 2024-09-17T07:19:51.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:51.292+0000 7f43b56f0640 1 -- 172.21.15.87:0/2940506142 wait complete. 2024-09-17T07:19:51.294 INFO:tasks.workunit.client.0.smithi087.stdout:7/298: chown d0/d3/d23/d2d/c52 94500089 1 2024-09-17T07:19:51.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:51.293+0000 7f43b56f0640 1 Processor -- start 2024-09-17T07:19:51.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:51.294+0000 7f43b56f0640 1 -- start start 2024-09-17T07:19:51.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:51.294+0000 7f43b56f0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f43b00fb8a0 0x7f43b0113610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:19:51.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:51.294+0000 7f43b56f0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43b00fc1f0 0x7f43b0113b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:19:51.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:51.294+0000 7f43b56f0640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b01149c0 con 0x7f43b00fc1f0 2024-09-17T07:19:51.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:51.294+0000 7f43b56f0640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b0114b30 con 0x7f43b00fb8a0 2024-09-17T07:19:51.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:51.294+0000 7f43ae7fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43b00fc1f0 0x7f43b0113b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:19:51.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:51.294+0000 7f43ae7fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43b00fc1f0 0x7f43b0113b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37140/0 (socket says 172.21.15.87:37140) 2024-09-17T07:19:51.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:51.294+0000 7f43ae7fc640 1 -- 172.21.15.87:0/3239058812 learned_addr learned my addr 172.21.15.87:0/3239058812 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:19:51.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:51.294+0000 7f43aeffd640 1 --2- 172.21.15.87:0/3239058812 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f43b00fb8a0 0x7f43b0113610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:19:51.296 INFO:tasks.workunit.client.1.smithi139.stdout:2/280: chown d0/de/c26 685945 1 2024-09-17T07:19:51.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:51.295+0000 7f43ae7fc640 1 -- 172.21.15.87:0/3239058812 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f43b00fb8a0 msgr2=0x7f43b0113610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:19:51.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:51.295+0000 7f43ae7fc640 1 --2- 172.21.15.87:0/3239058812 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f43b00fb8a0 0x7f43b0113610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:51.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:51.295+0000 7f43ae7fc640 1 -- 172.21.15.87:0/3239058812 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43a0005040 con 0x7f43b00fc1f0 2024-09-17T07:19:51.297 INFO:tasks.workunit.client.0.smithi087.stdout:1/312: dwrite d2/d3d/f2f [0,4194304] 0 2024-09-17T07:19:51.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:51.296+0000 7f43ae7fc640 1 --2- 172.21.15.87:0/3239058812 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43b00fc1f0 0x7f43b0113b50 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f43a0009ac0 tx=0x7f43a0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:19:51.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:51.296+0000 7f43a77fe640 1 -- 172.21.15.87:0/3239058812 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43a0038070 con 0x7f43b00fc1f0 2024-09-17T07:19:51.298 INFO:tasks.workunit.client.0.smithi087.stdout:6/455: creat d1/d6/d1a/d2c/d48/d62/fa4 x:0 0 0 2024-09-17T07:19:51.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:51.296+0000 7f43a77fe640 1 -- 172.21.15.87:0/3239058812 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f43a0009740 con 0x7f43b00fc1f0 2024-09-17T07:19:51.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:51.296+0000 7f43b56f0640 1 -- 172.21.15.87:0/3239058812 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43b0114db0 con 0x7f43b00fc1f0 2024-09-17T07:19:51.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:51.296+0000 7f43a77fe640 1 -- 172.21.15.87:0/3239058812 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43a0038070 con 0x7f43b00fc1f0 2024-09-17T07:19:51.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:51.296+0000 7f43b56f0640 1 -- 172.21.15.87:0/3239058812 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43b01152d0 con 0x7f43b00fc1f0 2024-09-17T07:19:51.299 INFO:tasks.workunit.client.0.smithi087.stdout:9/285: dread d3/d4/d6/d8/d22/f50 [0,4194304] 0 2024-09-17T07:19:51.299 INFO:tasks.workunit.client.0.smithi087.stdout:0/504: getdents db/d45/d7b/d7e 0 2024-09-17T07:19:51.300 INFO:tasks.workunit.client.0.smithi087.stdout:5/448: mknod d5/d8/d1f/d4e/c93 0 2024-09-17T07:19:51.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:51.298+0000 7f43b56f0640 1 -- 172.21.15.87:0/3239058812 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43b00fa010 con 0x7f43b00fc1f0 2024-09-17T07:19:51.300 INFO:tasks.workunit.client.0.smithi087.stdout:3/303: chown d6/d15/c18 49187 1 2024-09-17T07:19:51.301 INFO:tasks.workunit.client.1.smithi139.stdout:8/274: rename d0/dc/f27 to d0/dc/d18/f4f 0 2024-09-17T07:19:51.301 INFO:tasks.workunit.client.1.smithi139.stdout:9/482: creat dc/d11/d15/d3c/d61/d64/d96/f9e x:0 0 0 2024-09-17T07:19:51.301 INFO:tasks.workunit.client.1.smithi139.stdout:2/281: mkdir d0/de/df/d56 0 2024-09-17T07:19:51.301 INFO:tasks.workunit.client.1.smithi139.stdout:3/201: link d5/c1b d5/d15/d20/d22/c43 0 2024-09-17T07:19:51.302 INFO:tasks.workunit.client.1.smithi139.stdout:9/483: write dc/d11/d15/d1e/f65 [2336190,89359] 0 2024-09-17T07:19:51.302 INFO:tasks.workunit.client.0.smithi087.stdout:8/307: dwrite d1/d7/d9/d19/d1b/f30 [0,4194304] 0 2024-09-17T07:19:51.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:51.300+0000 7f43a77fe640 1 -- 172.21.15.87:0/3239058812 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 24) v1 ==== 90881+0+0 (secure 0 0 0) 0x7f43a0030020 con 0x7f43b00fc1f0 2024-09-17T07:19:51.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:51.301+0000 7f43a77fe640 1 --2- 172.21.15.87:0/3239058812 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f439c06dce0 0x7f439c070190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:19:51.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:51.301+0000 7f43a77fe640 1 -- 172.21.15.87:0/3239058812 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f43a00ad1d0 con 0x7f43b00fc1f0 2024-09-17T07:19:51.306 INFO:tasks.workunit.client.1.smithi139.stdout:8/275: dwrite d0/f2a [0,4194304] 0 2024-09-17T07:19:51.306 INFO:tasks.workunit.client.1.smithi139.stdout:2/282: rename d0/de/d11/c18 to d0/de/d11/d32/d49/c57 0 2024-09-17T07:19:51.306 INFO:tasks.workunit.client.0.smithi087.stdout:6/456: write d1/f42 [1042141,14480] 0 2024-09-17T07:19:51.307 INFO:tasks.workunit.client.0.smithi087.stdout:2/359: dread d2/d48/f59 [0,4194304] 0 2024-09-17T07:19:51.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:51.306+0000 7f43aeffd640 1 --2- 172.21.15.87:0/3239058812 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f439c06dce0 0x7f439c070190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:19:51.308 INFO:tasks.workunit.client.1.smithi139.stdout:9/484: mkdir dc/d11/d15/d1e/d7c/d9f 0 2024-09-17T07:19:51.309 INFO:tasks.workunit.client.1.smithi139.stdout:2/283: mknod d0/de/d11/d28/c58 0 2024-09-17T07:19:51.310 INFO:tasks.workunit.client.0.smithi087.stdout:9/286: mknod d3/d25/c63 0 2024-09-17T07:19:51.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:51.309+0000 7f43a77fe640 1 -- 172.21.15.87:0/3239058812 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182127 (secure 0 0 0) 0x7f43a00776b0 con 0x7f43b00fc1f0 2024-09-17T07:19:51.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:51.309+0000 7f43aeffd640 1 --2- 172.21.15.87:0/3239058812 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f439c06dce0 0x7f439c070190 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4398009b50 tx=0x7f4398009120 comp rx=0 tx=0).ready entity=mgr.24339 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:19:51.311 INFO:tasks.workunit.client.0.smithi087.stdout:0/505: write db/f18 [4446200,110474] 0 2024-09-17T07:19:51.311 INFO:tasks.workunit.client.1.smithi139.stdout:9/485: write dc/d11/f12 [113346,89002] 0 2024-09-17T07:19:51.312 INFO:tasks.workunit.client.0.smithi087.stdout:5/449: mkdir d5/d12/d14/d61/d94 0 2024-09-17T07:19:51.313 INFO:tasks.workunit.client.0.smithi087.stdout:6/457: rmdir d1/d6/d1a/d5e 39 2024-09-17T07:19:51.314 INFO:tasks.workunit.client.0.smithi087.stdout:6/458: chown d1/d6/d1a 0 1 2024-09-17T07:19:51.316 INFO:tasks.workunit.client.0.smithi087.stdout:9/287: read - d3/d4/da/d1c/f51 zero size 2024-09-17T07:19:51.318 INFO:tasks.workunit.client.0.smithi087.stdout:0/506: truncate db/d45/d7b/f9f 539024 0 2024-09-17T07:19:51.319 INFO:tasks.workunit.client.1.smithi139.stdout:2/284: mkdir d0/d7/d1a/d59 0 2024-09-17T07:19:51.320 INFO:tasks.workunit.client.0.smithi087.stdout:3/304: mknod d6/d1b/d2b/c61 0 2024-09-17T07:19:51.320 INFO:tasks.workunit.client.1.smithi139.stdout:3/202: dwrite d5/d15/d20/d22/f36 [0,4194304] 0 2024-09-17T07:19:51.321 INFO:tasks.workunit.client.1.smithi139.stdout:6/367: write db/d18/f45 [813768,50759] 0 2024-09-17T07:19:51.321 INFO:tasks.workunit.client.1.smithi139.stdout:9/486: rename dc/d11/d15/d1e/f60 to dc/d11/d15/d3c/d68/fa0 0 2024-09-17T07:19:51.321 INFO:tasks.workunit.client.1.smithi139.stdout:8/276: dwrite d0/d20/d28/f3d [0,4194304] 0 2024-09-17T07:19:51.322 INFO:tasks.workunit.client.0.smithi087.stdout:7/299: getdents d0/d3/d23/d2d 0 2024-09-17T07:19:51.325 INFO:tasks.workunit.client.0.smithi087.stdout:6/459: rmdir d1/d6/d1a/d2c/d33 39 2024-09-17T07:19:51.325 INFO:tasks.workunit.client.1.smithi139.stdout:3/203: truncate d5/d15/d16/f17 1421428 0 2024-09-17T07:19:51.327 INFO:tasks.workunit.client.1.smithi139.stdout:3/204: chown d5/d21/d23/d38/f40 413647 1 2024-09-17T07:19:51.327 INFO:tasks.workunit.client.1.smithi139.stdout:2/285: mknod d0/d7/d1a/c5a 0 2024-09-17T07:19:51.328 INFO:tasks.workunit.client.0.smithi087.stdout:0/507: creat db/d45/d7b/d7e/fbc x:0 0 0 2024-09-17T07:19:51.328 INFO:tasks.workunit.client.1.smithi139.stdout:2/286: fsync d0/dc/d3a/f3d 0 2024-09-17T07:19:51.329 INFO:tasks.workunit.client.1.smithi139.stdout:9/487: mkdir dc/d11/d52/d56/d7a/da1 0 2024-09-17T07:19:51.330 INFO:tasks.workunit.client.0.smithi087.stdout:1/313: dwrite d2/d14/dd/d37/f52 [0,4194304] 0 2024-09-17T07:19:51.330 INFO:tasks.workunit.client.0.smithi087.stdout:9/288: fdatasync d3/fc 0 2024-09-17T07:19:51.331 INFO:tasks.workunit.client.0.smithi087.stdout:3/305: mkdir d6/d1b/d42/d62 0 2024-09-17T07:19:51.331 INFO:tasks.workunit.client.1.smithi139.stdout:9/488: read dc/d11/d15/d3c/f3f [2949665,53768] 0 2024-09-17T07:19:51.331 INFO:tasks.workunit.client.1.smithi139.stdout:8/277: unlink d0/d1a/l22 0 2024-09-17T07:19:51.332 INFO:tasks.workunit.client.1.smithi139.stdout:8/278: readlink d0/d20/d28/l40 0 2024-09-17T07:19:51.333 INFO:tasks.workunit.client.1.smithi139.stdout:8/279: read d0/f2a [2677385,75728] 0 2024-09-17T07:19:51.333 INFO:tasks.workunit.client.0.smithi087.stdout:8/308: getdents d1/d7/d9/d19/d1b/d18 0 2024-09-17T07:19:51.336 INFO:tasks.workunit.client.1.smithi139.stdout:6/368: creat db/d18/d38/d60/f7c x:0 0 0 2024-09-17T07:19:51.337 INFO:tasks.workunit.client.0.smithi087.stdout:2/360: dwrite d2/d15/d34/f62 [0,4194304] 0 2024-09-17T07:19:51.339 INFO:tasks.workunit.client.1.smithi139.stdout:6/369: rename db/df to db/df/d4e/d64/d54/d40/d7d 22 2024-09-17T07:19:51.341 INFO:tasks.workunit.client.1.smithi139.stdout:8/280: mknod d0/d20/d28/c50 0 2024-09-17T07:19:51.342 INFO:tasks.workunit.client.1.smithi139.stdout:3/205: creat d5/d15/d20/d22/f44 x:0 0 0 2024-09-17T07:19:51.343 INFO:tasks.workunit.client.0.smithi087.stdout:8/309: chown d1/d2b/d3b/d53/f5b 24855 1 2024-09-17T07:19:51.343 INFO:tasks.workunit.client.1.smithi139.stdout:2/287: dwrite d0/de/d11/d28/f2d [0,4194304] 0 2024-09-17T07:19:51.344 INFO:tasks.workunit.client.0.smithi087.stdout:1/314: fsync d2/d1a/f29 0 2024-09-17T07:19:51.345 INFO:tasks.workunit.client.0.smithi087.stdout:0/508: creat db/d45/d7b/d7e/fbd x:0 0 0 2024-09-17T07:19:51.345 INFO:tasks.workunit.client.1.smithi139.stdout:9/489: dwrite dc/d11/d15/f8d [0,4194304] 0 2024-09-17T07:19:51.348 INFO:tasks.workunit.client.0.smithi087.stdout:9/289: mkdir d3/d4/d6/d8/d22/d64 0 2024-09-17T07:19:51.348 INFO:tasks.workunit.client.0.smithi087.stdout:3/306: symlink d6/d15/d37/d3c/d43/d48/l63 0 2024-09-17T07:19:51.349 INFO:tasks.workunit.client.0.smithi087.stdout:9/290: write d3/d4/d6/d8/d22/d43/f5d [835582,1424] 0 2024-09-17T07:19:51.349 INFO:tasks.workunit.client.1.smithi139.stdout:8/281: stat d0/d1a/l43 0 2024-09-17T07:19:51.349 INFO:tasks.workunit.client.1.smithi139.stdout:3/206: fsync d5/f3c 0 2024-09-17T07:19:51.349 INFO:tasks.workunit.client.1.smithi139.stdout:2/288: creat d0/d3b/f5b x:0 0 0 2024-09-17T07:19:51.350 INFO:tasks.workunit.client.1.smithi139.stdout:6/370: creat db/df/d4e/d64/d54/d40/f7e x:0 0 0 2024-09-17T07:19:51.351 INFO:tasks.workunit.client.0.smithi087.stdout:6/460: creat d1/fa5 x:0 0 0 2024-09-17T07:19:51.352 INFO:tasks.workunit.client.0.smithi087.stdout:2/361: mkdir d2/d7/dd/d6a/d6d 0 2024-09-17T07:19:51.353 INFO:tasks.workunit.client.1.smithi139.stdout:2/289: truncate d0/f3 897311 0 2024-09-17T07:19:51.354 INFO:tasks.workunit.client.0.smithi087.stdout:7/300: link d0/d3/d23/d17/f51 d0/d3/d23/f60 0 2024-09-17T07:19:51.354 INFO:tasks.workunit.client.1.smithi139.stdout:3/207: symlink d5/d15/d20/d22/d28/l45 0 2024-09-17T07:19:51.355 INFO:tasks.workunit.client.0.smithi087.stdout:0/509: mkdir db/dbe 0 2024-09-17T07:19:51.356 INFO:tasks.workunit.client.1.smithi139.stdout:3/208: write d5/d13/f29 [544625,113105] 0 2024-09-17T07:19:51.356 INFO:tasks.workunit.client.1.smithi139.stdout:9/490: rename dc/d11/f8f to dc/d11/d52/fa2 0 2024-09-17T07:19:51.358 INFO:tasks.workunit.client.0.smithi087.stdout:6/461: mknod d1/d6/d1a/d2c/d48/d62/ca6 0 2024-09-17T07:19:51.358 INFO:tasks.workunit.client.0.smithi087.stdout:3/307: symlink d6/d1b/d42/d62/l64 0 2024-09-17T07:19:51.359 INFO:tasks.workunit.client.0.smithi087.stdout:8/310: dwrite d1/d7/d9/d19/d4d/f47 [0,4194304] 0 2024-09-17T07:19:51.364 INFO:tasks.workunit.client.1.smithi139.stdout:6/371: dread f7 [0,4194304] 0 2024-09-17T07:19:51.364 INFO:tasks.workunit.client.0.smithi087.stdout:7/301: mkdir d0/d3/d23/d17/d61 0 2024-09-17T07:19:51.365 INFO:tasks.workunit.client.0.smithi087.stdout:6/462: symlink d1/d6/d1a/d2c/d48/la7 0 2024-09-17T07:19:51.365 INFO:tasks.workunit.client.1.smithi139.stdout:8/282: link d0/d20/c2b d0/d20/d28/c51 0 2024-09-17T07:19:51.365 INFO:tasks.workunit.client.0.smithi087.stdout:8/311: dread - d1/d2b/d70/d54/f6a zero size 2024-09-17T07:19:51.366 INFO:tasks.workunit.client.1.smithi139.stdout:9/491: truncate dc/d11/d15/d1e/f2e 3680048 0 2024-09-17T07:19:51.367 INFO:tasks.workunit.client.1.smithi139.stdout:2/290: rename d0/de/c26 to d0/d7/d1a/c5c 0 2024-09-17T07:19:51.368 INFO:tasks.workunit.client.1.smithi139.stdout:2/291: stat d0/de/d25/l33 0 2024-09-17T07:19:51.368 INFO:tasks.workunit.client.0.smithi087.stdout:3/308: symlink d6/d15/d4b/l65 0 2024-09-17T07:19:51.369 INFO:tasks.workunit.client.1.smithi139.stdout:6/372: symlink db/l7f 0 2024-09-17T07:19:51.370 INFO:tasks.workunit.client.1.smithi139.stdout:8/283: mkdir d0/d20/d28/d52 0 2024-09-17T07:19:51.370 INFO:tasks.workunit.client.0.smithi087.stdout:5/450: dread d5/d18/d20/f1e [0,4194304] 0 2024-09-17T07:19:51.371 INFO:tasks.workunit.client.1.smithi139.stdout:3/209: creat d5/d15/d20/d22/f46 x:0 0 0 2024-09-17T07:19:51.372 INFO:tasks.workunit.client.0.smithi087.stdout:8/312: creat d1/d2b/d21/d6d/f74 x:0 0 0 2024-09-17T07:19:51.372 INFO:tasks.workunit.client.1.smithi139.stdout:8/284: write d0/d1a/d3a/f42 [1338098,52610] 0 2024-09-17T07:19:51.374 INFO:tasks.workunit.client.0.smithi087.stdout:7/302: rename d0/d3/d23/d17/d61 to d0/d3/d10/d32/d62 0 2024-09-17T07:19:51.374 INFO:tasks.workunit.client.1.smithi139.stdout:2/292: creat d0/d3b/f5d x:0 0 0 2024-09-17T07:19:51.375 INFO:tasks.workunit.client.1.smithi139.stdout:9/492: mknod dc/d11/d15/d3c/d61/d64/d96/ca3 0 2024-09-17T07:19:51.375 INFO:tasks.workunit.client.0.smithi087.stdout:0/510: dwrite db/f1b [0,4194304] 0 2024-09-17T07:19:51.375 INFO:tasks.workunit.client.0.smithi087.stdout:3/309: truncate d6/f59 906383 0 2024-09-17T07:19:51.376 INFO:tasks.workunit.client.1.smithi139.stdout:8/285: readlink d0/l15 0 2024-09-17T07:19:51.376 INFO:tasks.workunit.client.0.smithi087.stdout:3/310: fsync d6/f27 0 2024-09-17T07:19:51.380 INFO:tasks.workunit.client.0.smithi087.stdout:3/311: read d6/d15/d37/f5b [3843084,125514] 0 2024-09-17T07:19:51.380 INFO:tasks.workunit.client.0.smithi087.stdout:8/313: mknod d1/c75 0 2024-09-17T07:19:51.380 INFO:tasks.workunit.client.1.smithi139.stdout:8/286: rmdir d0/d1a/d3a 39 2024-09-17T07:19:51.381 INFO:tasks.workunit.client.0.smithi087.stdout:8/314: fdatasync d1/d2b/f32 0 2024-09-17T07:19:51.383 INFO:tasks.workunit.client.0.smithi087.stdout:8/315: write d1/d7/d9/d19/f1d [4634467,82718] 0 2024-09-17T07:19:51.383 INFO:tasks.workunit.client.0.smithi087.stdout:3/312: unlink d6/l4f 0 2024-09-17T07:19:51.383 INFO:tasks.workunit.client.1.smithi139.stdout:9/493: dwrite dc/d11/d15/f28 [0,4194304] 0 2024-09-17T07:19:51.385 INFO:tasks.workunit.client.0.smithi087.stdout:0/511: rename db/f4d to db/dbe/fbf 0 2024-09-17T07:19:51.388 INFO:tasks.workunit.client.0.smithi087.stdout:3/313: dread d6/d1b/d42/f44 [0,4194304] 0 2024-09-17T07:19:51.389 INFO:tasks.workunit.client.1.smithi139.stdout:9/494: rename f4 to dc/d11/d15/d3c/d61/d64/d96/fa4 0 2024-09-17T07:19:51.391 INFO:tasks.workunit.client.1.smithi139.stdout:9/495: mknod dc/d2a/ca5 0 2024-09-17T07:19:51.392 INFO:tasks.workunit.client.0.smithi087.stdout:0/512: getdents db/d45/d7b 0 2024-09-17T07:19:51.393 INFO:tasks.workunit.client.1.smithi139.stdout:6/373: dread db/df/d4e/f55 [0,4194304] 0 2024-09-17T07:19:51.395 INFO:tasks.workunit.client.1.smithi139.stdout:6/374: fdatasync db/df/d4e/d64/d54/d40/f3b 0 2024-09-17T07:19:51.398 INFO:tasks.workunit.client.1.smithi139.stdout:9/496: link dc/d2a/f49 dc/d11/d52/d56/d75/fa6 0 2024-09-17T07:19:51.399 INFO:tasks.workunit.client.0.smithi087.stdout:3/314: dwrite d6/d15/f60 [0,4194304] 0 2024-09-17T07:19:51.399 INFO:tasks.workunit.client.0.smithi087.stdout:0/513: truncate db/f33 218282 0 2024-09-17T07:19:51.400 INFO:tasks.workunit.client.1.smithi139.stdout:6/375: mkdir db/df/d4e/d64/d80 0 2024-09-17T07:19:51.401 INFO:tasks.workunit.client.1.smithi139.stdout:6/376: write db/df/d4c/f65 [426372,67895] 0 2024-09-17T07:19:51.401 INFO:tasks.workunit.client.0.smithi087.stdout:0/514: write db/d45/d5b/f5e [220919,105669] 0 2024-09-17T07:19:51.402 INFO:tasks.workunit.client.0.smithi087.stdout:6/463: dread d1/d6/d1a/d2c/d58/d90/f9d [0,4194304] 0 2024-09-17T07:19:51.403 INFO:tasks.workunit.client.1.smithi139.stdout:6/377: unlink db/d18/f6e 0 2024-09-17T07:19:51.404 INFO:tasks.workunit.client.1.smithi139.stdout:3/210: write d5/d13/f1a [205724,85405] 0 2024-09-17T07:19:51.405 INFO:tasks.workunit.client.1.smithi139.stdout:2/293: truncate d0/de/df/f39 6778125 0 2024-09-17T07:19:51.406 INFO:tasks.workunit.client.1.smithi139.stdout:6/378: readlink db/df/d4e/d64/d54/l30 0 2024-09-17T07:19:51.406 INFO:tasks.workunit.client.1.smithi139.stdout:9/497: dwrite dc/d11/d15/d3c/d61/d64/f70 [0,4194304] 0 2024-09-17T07:19:51.408 INFO:tasks.workunit.client.0.smithi087.stdout:0/515: fdatasync db/f25 0 2024-09-17T07:19:51.410 INFO:tasks.workunit.client.1.smithi139.stdout:9/498: read dc/d11/d15/d3c/d68/fa0 [1829872,62139] 0 2024-09-17T07:19:51.411 INFO:tasks.workunit.client.0.smithi087.stdout:6/464: rename d1/d6/d1a/d2c/d58/l6d to d1/d6/d1a/d2c/d40/d4c/la8 0 2024-09-17T07:19:51.412 INFO:tasks.workunit.client.1.smithi139.stdout:3/211: creat d5/d21/d23/f47 x:0 0 0 2024-09-17T07:19:51.412 INFO:tasks.workunit.client.1.smithi139.stdout:9/499: dread - dc/d11/d15/d3c/d68/f6f zero size 2024-09-17T07:19:51.412 INFO:tasks.workunit.client.0.smithi087.stdout:6/465: chown d1/d6/d1a/d8a 7 1 2024-09-17T07:19:51.412 INFO:tasks.workunit.client.1.smithi139.stdout:6/379: rmdir db/df/d4e/d64/d54/d40 39 2024-09-17T07:19:51.414 INFO:tasks.workunit.client.1.smithi139.stdout:9/500: write dc/d11/d15/f17 [5017748,57433] 0 2024-09-17T07:19:51.415 INFO:tasks.workunit.client.1.smithi139.stdout:6/380: chown db/d18/l22 48 1 2024-09-17T07:19:51.415 INFO:tasks.workunit.client.0.smithi087.stdout:0/516: symlink db/d45/d9e/lc0 0 2024-09-17T07:19:51.417 INFO:tasks.workunit.client.1.smithi139.stdout:9/501: write dc/d11/d15/d3c/d68/f90 [484145,120362] 0 2024-09-17T07:19:51.417 INFO:tasks.workunit.client.1.smithi139.stdout:3/212: creat d5/d21/f48 x:0 0 0 2024-09-17T07:19:51.418 INFO:tasks.workunit.client.1.smithi139.stdout:9/502: read - dc/d11/d8b/f91 zero size 2024-09-17T07:19:51.419 INFO:tasks.workunit.client.0.smithi087.stdout:6/466: mkdir d1/d6/d1a/d2c/d58/d90/da9 0 2024-09-17T07:19:51.420 INFO:tasks.workunit.client.1.smithi139.stdout:8/287: dread d0/dc/f4b [0,4194304] 0 2024-09-17T07:19:51.422 INFO:tasks.workunit.client.0.smithi087.stdout:3/315: dread d6/d15/f29 [0,4194304] 0 2024-09-17T07:19:51.422 INFO:tasks.workunit.client.0.smithi087.stdout:0/517: creat db/d45/d5d/fc1 x:0 0 0 2024-09-17T07:19:51.424 INFO:tasks.workunit.client.1.smithi139.stdout:9/503: write dc/d11/d15/f18 [8940327,8659] 0 2024-09-17T07:19:51.424 INFO:tasks.workunit.client.0.smithi087.stdout:6/467: creat d1/d67/faa x:0 0 0 2024-09-17T07:19:51.424 INFO:tasks.workunit.client.0.smithi087.stdout:5/451: dread d5/d12/d4d/f3a [0,4194304] 0 2024-09-17T07:19:51.425 INFO:tasks.workunit.client.0.smithi087.stdout:0/518: chown db/d45/d7b/la6 4 1 2024-09-17T07:19:51.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:51 smithi087 ceph-mon[27636]: from='client.14676 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:19:51.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:51 smithi087 ceph-mon[27636]: from='client.14680 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:19:51.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:51 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/470862986' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:19:51.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:51 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/3134113140' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T07:19:51.427 INFO:tasks.workunit.client.1.smithi139.stdout:6/381: getdents db/df/d4e 0 2024-09-17T07:19:51.427 INFO:tasks.workunit.client.1.smithi139.stdout:9/504: creat dc/d2a/fa7 x:0 0 0 2024-09-17T07:19:51.428 INFO:tasks.workunit.client.1.smithi139.stdout:8/288: mkdir d0/d1a/d4d/d53 0 2024-09-17T07:19:51.430 INFO:tasks.workunit.client.1.smithi139.stdout:3/213: getdents d5 0 2024-09-17T07:19:51.430 INFO:tasks.workunit.client.0.smithi087.stdout:0/519: chown db/d45/d5b/d92/ca1 822970 1 2024-09-17T07:19:51.431 INFO:tasks.workunit.client.0.smithi087.stdout:5/452: creat d5/d8/d1f/f95 x:0 0 0 2024-09-17T07:19:51.432 INFO:tasks.workunit.client.0.smithi087.stdout:6/468: dwrite d1/f42 [0,4194304] 0 2024-09-17T07:19:51.434 INFO:tasks.workunit.client.1.smithi139.stdout:3/214: dread d5/d13/f29 [0,4194304] 0 2024-09-17T07:19:51.434 INFO:tasks.workunit.client.1.smithi139.stdout:6/382: rename db/df/d4e/d64/d54/d40 to db/df/d73/d81 0 2024-09-17T07:19:51.434 INFO:tasks.workunit.client.0.smithi087.stdout:5/453: rmdir d5/d18/d20 39 2024-09-17T07:19:51.435 INFO:tasks.workunit.client.1.smithi139.stdout:6/383: chown f7 8 1 2024-09-17T07:19:51.435 INFO:tasks.workunit.client.1.smithi139.stdout:8/289: mkdir d0/d20/d28/d52/d54 0 2024-09-17T07:19:51.435 INFO:tasks.workunit.client.1.smithi139.stdout:3/215: read - d5/f39 zero size 2024-09-17T07:19:51.436 INFO:tasks.workunit.client.0.smithi087.stdout:0/520: symlink db/d4f/lc2 0 2024-09-17T07:19:51.436 INFO:tasks.workunit.client.1.smithi139.stdout:8/290: chown d0/d20/c2f 8868 1 2024-09-17T07:19:51.437 INFO:tasks.workunit.client.1.smithi139.stdout:3/216: fdatasync d5/d21/d23/f47 0 2024-09-17T07:19:51.437 INFO:tasks.workunit.client.0.smithi087.stdout:6/469: creat d1/d6/d1a/d2c/d58/d90/fab x:0 0 0 2024-09-17T07:19:51.438 INFO:tasks.workunit.client.1.smithi139.stdout:9/505: write dc/d11/d52/d56/d75/fa6 [530300,97290] 0 2024-09-17T07:19:51.439 INFO:tasks.workunit.client.0.smithi087.stdout:5/454: symlink d5/d12/d1c/l96 0 2024-09-17T07:19:51.440 INFO:tasks.workunit.client.0.smithi087.stdout:6/470: mkdir d1/d6/d1a/d2c/d48/d9b/dac 0 2024-09-17T07:19:51.440 INFO:tasks.workunit.client.1.smithi139.stdout:8/291: write d0/d1a/f39 [932970,56467] 0 2024-09-17T07:19:51.441 INFO:tasks.workunit.client.0.smithi087.stdout:6/471: fsync d1/d6/d1a/d2c/d40/f4d 0 2024-09-17T07:19:51.442 INFO:tasks.workunit.client.0.smithi087.stdout:0/521: symlink db/d45/d7b/d90/lc3 0 2024-09-17T07:19:51.443 INFO:tasks.workunit.client.0.smithi087.stdout:8/316: truncate d1/d7/d9/d19/f4b 3344738 0 2024-09-17T07:19:51.443 INFO:tasks.workunit.client.1.smithi139.stdout:8/292: creat d0/dc/d18/f55 x:0 0 0 2024-09-17T07:19:51.444 INFO:tasks.workunit.client.1.smithi139.stdout:6/384: link db/d21/l4b db/d18/d38/d60/l82 0 2024-09-17T07:19:51.444 INFO:tasks.workunit.client.0.smithi087.stdout:6/472: read - d1/d6/d1a/d2c/d40/f56 zero size 2024-09-17T07:19:51.444 INFO:tasks.workunit.client.1.smithi139.stdout:8/293: write d0/fd [210835,108809] 0 2024-09-17T07:19:51.445 INFO:tasks.workunit.client.1.smithi139.stdout:6/385: read db/d18/f45 [249873,5594] 0 2024-09-17T07:19:51.446 INFO:tasks.workunit.client.0.smithi087.stdout:6/473: read - d1/d6/d1a/d2c/d58/d90/fab zero size 2024-09-17T07:19:51.447 INFO:tasks.workunit.client.1.smithi139.stdout:6/386: stat db/df/d4e/d64/c6a 0 2024-09-17T07:19:51.447 INFO:tasks.workunit.client.1.smithi139.stdout:2/294: dread d0/d3b/f42 [0,4194304] 0 2024-09-17T07:19:51.448 INFO:tasks.workunit.client.1.smithi139.stdout:9/506: rename dc/d11/d15/d1e/d7c/d83/f84 to dc/fa8 0 2024-09-17T07:19:51.448 INFO:tasks.workunit.client.1.smithi139.stdout:6/387: write db/d18/f44 [154987,81022] 0 2024-09-17T07:19:51.449 INFO:tasks.workunit.client.0.smithi087.stdout:6/474: unlink d1/d6/d1a/d2c/d48/f99 0 2024-09-17T07:19:51.451 INFO:tasks.workunit.client.0.smithi087.stdout:6/475: read - d1/d6/d1a/d2c/d40/d4c/d77/f93 zero size 2024-09-17T07:19:51.451 INFO:tasks.workunit.client.1.smithi139.stdout:9/507: rmdir dc/d11/d15/d3c 39 2024-09-17T07:19:51.452 INFO:tasks.workunit.client.1.smithi139.stdout:2/295: rename d0/l55 to d0/d7/l5e 0 2024-09-17T07:19:51.453 INFO:tasks.workunit.client.0.smithi087.stdout:0/522: link db/d45/d7b/f9d db/d45/d5b/fc4 0 2024-09-17T07:19:51.453 INFO:tasks.workunit.client.0.smithi087.stdout:0/523: stat db/d45/d7b/fa5 0 2024-09-17T07:19:51.455 INFO:tasks.workunit.client.1.smithi139.stdout:9/508: dread - dc/d11/d15/d3c/d68/f6f zero size 2024-09-17T07:19:51.456 INFO:tasks.workunit.client.1.smithi139.stdout:8/294: dwrite d0/dc/d18/f38 [0,4194304] 0 2024-09-17T07:19:51.457 INFO:tasks.workunit.client.0.smithi087.stdout:0/524: creat db/d45/d7b/fc5 x:0 0 0 2024-09-17T07:19:51.457 INFO:tasks.workunit.client.1.smithi139.stdout:8/295: chown d0/d1a/d4d 13 1 2024-09-17T07:19:51.458 INFO:tasks.workunit.client.1.smithi139.stdout:9/509: fdatasync dc/d11/d15/d3c/d61/d64/f82 0 2024-09-17T07:19:51.459 INFO:tasks.workunit.client.1.smithi139.stdout:3/217: dread f2 [0,4194304] 0 2024-09-17T07:19:51.460 INFO:tasks.workunit.client.0.smithi087.stdout:6/476: link d1/d6/d68/f98 d1/d6/d1a/d2c/d58/d90/fad 0 2024-09-17T07:19:51.462 INFO:tasks.workunit.client.0.smithi087.stdout:5/455: dread d5/f1b [0,4194304] 0 2024-09-17T07:19:51.462 INFO:tasks.workunit.client.0.smithi087.stdout:3/316: truncate d6/d15/f60 2608631 0 2024-09-17T07:19:51.463 INFO:tasks.workunit.client.0.smithi087.stdout:3/317: read d6/d15/f24 [516868,109590] 0 2024-09-17T07:19:51.464 INFO:tasks.workunit.client.0.smithi087.stdout:8/317: rename d1/d7/d9/l4c to d1/d7/d9/d19/l76 0 2024-09-17T07:19:51.465 INFO:tasks.workunit.client.1.smithi139.stdout:3/218: creat d5/d21/d23/f49 x:0 0 0 2024-09-17T07:19:51.466 INFO:tasks.workunit.client.1.smithi139.stdout:9/510: dwrite dc/d11/d15/d1e/f33 [0,4194304] 0 2024-09-17T07:19:51.466 INFO:tasks.workunit.client.1.smithi139.stdout:3/219: stat d5/d15/d16 0 2024-09-17T07:19:51.467 INFO:tasks.workunit.client.0.smithi087.stdout:8/318: truncate d1/d2b/d70/f44 1043426 0 2024-09-17T07:19:51.467 INFO:tasks.workunit.client.0.smithi087.stdout:5/456: stat d5/d12/d1c/c45 0 2024-09-17T07:19:51.468 INFO:tasks.workunit.client.0.smithi087.stdout:8/319: dread - d1/d2b/d3b/f62 zero size 2024-09-17T07:19:51.470 INFO:tasks.workunit.client.0.smithi087.stdout:6/477: creat d1/d6/d1a/d5e/fae x:0 0 0 2024-09-17T07:19:51.471 INFO:tasks.workunit.client.1.smithi139.stdout:6/388: write db/d18/f39 [1624633,16741] 0 2024-09-17T07:19:51.472 INFO:tasks.workunit.client.1.smithi139.stdout:9/511: fsync dc/d11/d15/d1e/f21 0 2024-09-17T07:19:51.474 INFO:tasks.workunit.client.1.smithi139.stdout:6/389: mkdir db/df/d4e/d64/d83 0 2024-09-17T07:19:51.475 INFO:tasks.workunit.client.1.smithi139.stdout:9/512: mknod dc/d11/d15/d3c/d61/d64/d96/ca9 0 2024-09-17T07:19:51.478 INFO:tasks.workunit.client.0.smithi087.stdout:3/318: dwrite d6/d15/d37/d3c/d43/d48/f58 [0,4194304] 0 2024-09-17T07:19:51.480 INFO:tasks.workunit.client.0.smithi087.stdout:6/478: truncate d1/d6/d1a/d2c/d48/d9b/fa2 38300 0 2024-09-17T07:19:51.480 INFO:tasks.workunit.client.0.smithi087.stdout:5/457: dwrite d5/d8/f3f [4194304,4194304] 0 2024-09-17T07:19:51.481 INFO:tasks.workunit.client.1.smithi139.stdout:9/513: rename c8 to dc/d2a/caa 0 2024-09-17T07:19:51.481 INFO:tasks.workunit.client.1.smithi139.stdout:2/296: write d0/d3b/f51 [8170595,84026] 0 2024-09-17T07:19:51.481 INFO:tasks.workunit.client.0.smithi087.stdout:3/319: chown d6/ce 40966663 1 2024-09-17T07:19:51.483 INFO:tasks.workunit.client.0.smithi087.stdout:5/458: read d5/d6d/f80 [4083536,95619] 0 2024-09-17T07:19:51.485 INFO:tasks.workunit.client.1.smithi139.stdout:9/514: rmdir dc/d11/d52/d56 39 2024-09-17T07:19:51.485 INFO:tasks.workunit.client.1.smithi139.stdout:6/390: dwrite db/d18/d38/f49 [0,4194304] 0 2024-09-17T07:19:51.485 INFO:tasks.workunit.client.0.smithi087.stdout:5/459: write d5/d12/d14/f7b [2549510,56350] 0 2024-09-17T07:19:51.487 INFO:tasks.workunit.client.0.smithi087.stdout:0/525: write db/f34 [5105157,74246] 0 2024-09-17T07:19:51.489 INFO:tasks.workunit.client.0.smithi087.stdout:6/479: creat d1/d6a/da3/faf x:0 0 0 2024-09-17T07:19:51.489 INFO:tasks.workunit.client.0.smithi087.stdout:0/526: write db/f34 [312585,94041] 0 2024-09-17T07:19:51.491 INFO:tasks.workunit.client.0.smithi087.stdout:5/460: mknod d5/d12/d56/c97 0 2024-09-17T07:19:51.491 INFO:tasks.workunit.client.1.smithi139.stdout:3/220: dwrite d5/d13/f29 [0,4194304] 0 2024-09-17T07:19:51.491 INFO:tasks.workunit.client.1.smithi139.stdout:6/391: creat db/df/f84 x:0 0 0 2024-09-17T07:19:51.494 INFO:tasks.workunit.client.0.smithi087.stdout:0/527: creat db/d45/d7b/d7e/fc6 x:0 0 0 2024-09-17T07:19:51.496 INFO:tasks.workunit.client.0.smithi087.stdout:3/320: dwrite d6/d15/f60 [0,4194304] 0 2024-09-17T07:19:51.497 INFO:tasks.workunit.client.0.smithi087.stdout:6/480: getdents d1/d6/d68 0 2024-09-17T07:19:51.498 INFO:tasks.workunit.client.0.smithi087.stdout:5/461: dread d5/d8/d1f/d68/f8d [0,4194304] 0 2024-09-17T07:19:51.498 INFO:tasks.workunit.client.1.smithi139.stdout:2/297: rmdir d0/d7/d1a/d1b 39 2024-09-17T07:19:51.501 INFO:tasks.workunit.client.1.smithi139.stdout:3/221: creat d5/d15/d20/d3b/f4a x:0 0 0 2024-09-17T07:19:51.502 INFO:tasks.workunit.client.1.smithi139.stdout:2/298: creat d0/dc/d15/f5f x:0 0 0 2024-09-17T07:19:51.502 INFO:tasks.workunit.client.1.smithi139.stdout:6/392: mknod db/df/d4e/d64/d83/c85 0 2024-09-17T07:19:51.502 INFO:tasks.workunit.client.1.smithi139.stdout:3/222: chown d5/d21/d23/d38 254 1 2024-09-17T07:19:51.504 INFO:tasks.workunit.client.1.smithi139.stdout:6/393: chown db/df/d4e/d64/d56/c75 176 1 2024-09-17T07:19:51.505 INFO:tasks.workunit.client.1.smithi139.stdout:2/299: readlink d0/d7/d1a/d1b/l4b 0 2024-09-17T07:19:51.506 INFO:tasks.workunit.client.1.smithi139.stdout:9/515: rename dc/d11/l26 to dc/d11/d52/lab 0 2024-09-17T07:19:51.506 INFO:tasks.workunit.client.0.smithi087.stdout:6/481: read d1/f11 [3732236,93134] 0 2024-09-17T07:19:51.508 INFO:tasks.workunit.client.1.smithi139.stdout:6/394: unlink db/df/d4e/d64/d56/c75 0 2024-09-17T07:19:51.508 INFO:tasks.workunit.client.1.smithi139.stdout:3/223: creat d5/d15/d20/d22/f4b x:0 0 0 2024-09-17T07:19:51.509 INFO:tasks.workunit.client.0.smithi087.stdout:0/528: dwrite db/d45/d7b/db0/fb5 [0,4194304] 0 2024-09-17T07:19:51.509 INFO:tasks.workunit.client.1.smithi139.stdout:2/300: rename d0/de/d11/d28/c58 to d0/de/d11/d32/d49/c60 0 2024-09-17T07:19:51.510 INFO:tasks.workunit.client.0.smithi087.stdout:6/482: rmdir d1/d67 39 2024-09-17T07:19:51.511 INFO:tasks.workunit.client.1.smithi139.stdout:6/395: symlink db/df/d4e/d64/d80/l86 0 2024-09-17T07:19:51.512 INFO:tasks.workunit.client.0.smithi087.stdout:5/462: dwrite d5/d12/f62 [0,4194304] 0 2024-09-17T07:19:51.512 INFO:tasks.workunit.client.1.smithi139.stdout:9/516: rename dc/d11/d15/d1e/f29 to dc/d11/d8b/fac 0 2024-09-17T07:19:51.513 INFO:tasks.workunit.client.0.smithi087.stdout:3/321: dwrite d6/d1b/d42/f3d [0,4194304] 0 2024-09-17T07:19:51.514 INFO:tasks.workunit.client.1.smithi139.stdout:6/396: write db/d18/d1b/f3f [317093,53927] 0 2024-09-17T07:19:51.515 INFO:tasks.workunit.client.1.smithi139.stdout:2/301: write d0/d3b/f42 [557986,56156] 0 2024-09-17T07:19:51.515 INFO:tasks.workunit.client.0.smithi087.stdout:6/483: mkdir d1/d6/d1a/d4e/db0 0 2024-09-17T07:19:51.516 INFO:tasks.workunit.client.1.smithi139.stdout:6/397: dread - db/d21/f42 zero size 2024-09-17T07:19:51.517 INFO:tasks.workunit.client.0.smithi087.stdout:0/529: dread db/f39 [0,4194304] 0 2024-09-17T07:19:51.518 INFO:tasks.workunit.client.0.smithi087.stdout:3/322: symlink d6/d15/d37/d3c/d43/l66 0 2024-09-17T07:19:51.522 INFO:tasks.workunit.client.1.smithi139.stdout:2/302: symlink d0/de/d54/l61 0 2024-09-17T07:19:51.522 INFO:tasks.workunit.client.1.smithi139.stdout:3/224: dwrite d5/d15/d20/d3b/f4a [0,4194304] 0 2024-09-17T07:19:51.523 INFO:tasks.workunit.client.0.smithi087.stdout:5/463: getdents d5/d12/d14/d61 0 2024-09-17T07:19:51.525 INFO:tasks.workunit.client.0.smithi087.stdout:6/484: dread d1/d6/d1a/f23 [0,4194304] 0 2024-09-17T07:19:51.525 INFO:tasks.workunit.client.1.smithi139.stdout:9/517: creat dc/d11/d15/d1e/d7c/d83/d98/fad x:0 0 0 2024-09-17T07:19:51.525 INFO:tasks.workunit.client.1.smithi139.stdout:2/303: write d0/de/f14 [781486,86487] 0 2024-09-17T07:19:51.526 INFO:tasks.workunit.client.0.smithi087.stdout:5/464: write d5/d8/f3f [4033285,117782] 0 2024-09-17T07:19:51.532 INFO:tasks.workunit.client.1.smithi139.stdout:6/398: dwrite db/df/d4e/d64/d54/f2b [0,4194304] 0 2024-09-17T07:19:51.533 INFO:tasks.workunit.client.0.smithi087.stdout:3/323: dwrite d6/d15/d37/d3c/f54 [0,4194304] 0 2024-09-17T07:19:51.534 INFO:tasks.workunit.client.0.smithi087.stdout:5/465: fdatasync d5/d8/d1f/d68/f8d 0 2024-09-17T07:19:51.534 INFO:tasks.workunit.client.1.smithi139.stdout:6/399: read db/d18/f45 [15340,90968] 0 2024-09-17T07:19:51.534 INFO:tasks.workunit.client.1.smithi139.stdout:9/518: mknod dc/d11/d15/d3c/d68/cae 0 2024-09-17T07:19:51.535 INFO:tasks.workunit.client.1.smithi139.stdout:2/304: creat d0/f62 x:0 0 0 2024-09-17T07:19:51.536 INFO:tasks.workunit.client.1.smithi139.stdout:2/305: chown d0/fb 0 1 2024-09-17T07:19:51.537 INFO:tasks.workunit.client.1.smithi139.stdout:6/400: write db/df/d4e/d64/d56/f69 [545680,71879] 0 2024-09-17T07:19:51.539 INFO:tasks.workunit.client.1.smithi139.stdout:9/519: unlink dc/d11/d15/d1e/f33 0 2024-09-17T07:19:51.543 INFO:tasks.workunit.client.1.smithi139.stdout:2/306: symlink d0/de/d11/l63 0 2024-09-17T07:19:51.543 INFO:tasks.workunit.client.0.smithi087.stdout:6/485: dwrite d1/d6/d1a/d2c/f52 [8388608,4194304] 0 2024-09-17T07:19:51.545 INFO:tasks.workunit.client.1.smithi139.stdout:9/520: rename dc/d11/d15/f50 to dc/d11/d8b/faf 0 2024-09-17T07:19:51.546 INFO:tasks.workunit.client.1.smithi139.stdout:2/307: creat d0/d3b/f64 x:0 0 0 2024-09-17T07:19:51.548 INFO:tasks.workunit.client.1.smithi139.stdout:9/521: symlink dc/lb0 0 2024-09-17T07:19:51.549 INFO:tasks.workunit.client.1.smithi139.stdout:2/308: stat d0/de/df/f39 0 2024-09-17T07:19:51.551 INFO:tasks.workunit.client.0.smithi087.stdout:8/320: write d1/d7/f22 [1256612,121459] 0 2024-09-17T07:19:51.551 INFO:tasks.workunit.client.1.smithi139.stdout:8/296: dread d0/fa [0,4194304] 0 2024-09-17T07:19:51.553 INFO:tasks.workunit.client.1.smithi139.stdout:9/522: rmdir dc/d2a 39 2024-09-17T07:19:51.553 INFO:tasks.workunit.client.0.smithi087.stdout:6/486: creat d1/d6/d1a/d2c/d40/d4c/fb1 x:0 0 0 2024-09-17T07:19:51.556 INFO:tasks.workunit.client.1.smithi139.stdout:2/309: symlink d0/de/d25/d3f/l65 0 2024-09-17T07:19:51.556 INFO:tasks.workunit.client.1.smithi139.stdout:8/297: symlink d0/d20/d28/d52/l56 0 2024-09-17T07:19:51.559 INFO:tasks.workunit.client.1.smithi139.stdout:8/298: dread - d0/dc/d18/f55 zero size 2024-09-17T07:19:51.559 INFO:tasks.workunit.client.0.smithi087.stdout:8/321: write d1/d7/d9/d19/f4e [1043235,33320] 0 2024-09-17T07:19:51.560 INFO:tasks.workunit.client.1.smithi139.stdout:8/299: readlink d0/dc/d18/l19 0 2024-09-17T07:19:51.561 INFO:tasks.workunit.client.1.smithi139.stdout:2/310: chown d0/de/d25/l33 6 1 2024-09-17T07:19:51.562 INFO:tasks.workunit.client.0.smithi087.stdout:8/322: chown d1/d5f/l48 28975 1 2024-09-17T07:19:51.563 INFO:tasks.workunit.client.0.smithi087.stdout:6/487: dwrite d1/d6a/da3/faf [0,4194304] 0 2024-09-17T07:19:51.564 INFO:tasks.workunit.client.1.smithi139.stdout:9/523: dwrite dc/d11/d15/d1e/f6b [0,4194304] 0 2024-09-17T07:19:51.564 INFO:tasks.workunit.client.1.smithi139.stdout:2/311: symlink d0/de/df/l66 0 2024-09-17T07:19:51.567 INFO:tasks.workunit.client.1.smithi139.stdout:9/524: creat dc/d2c/fb1 x:0 0 0 2024-09-17T07:19:51.568 INFO:tasks.workunit.client.0.smithi087.stdout:6/488: unlink d1/d6/d1a/d4e/f86 0 2024-09-17T07:19:51.568 INFO:tasks.workunit.client.1.smithi139.stdout:2/312: mkdir d0/d7/d67 0 2024-09-17T07:19:51.570 INFO:tasks.workunit.client.1.smithi139.stdout:9/525: symlink dc/d11/d8b/lb2 0 2024-09-17T07:19:51.571 INFO:tasks.workunit.client.0.smithi087.stdout:8/323: dwrite d1/d2b/d3b/f62 [0,4194304] 0 2024-09-17T07:19:51.573 INFO:tasks.workunit.client.0.smithi087.stdout:8/324: write d1/d2b/f41 [4695699,39046] 0 2024-09-17T07:19:51.576 INFO:tasks.workunit.client.1.smithi139.stdout:2/313: symlink d0/de/d11/d12/d45/l68 0 2024-09-17T07:19:51.577 INFO:tasks.workunit.client.0.smithi087.stdout:6/489: link d1/d6/d1a/d2c/f37 d1/d6/d1a/d2c/d40/fb2 0 2024-09-17T07:19:51.578 INFO:tasks.workunit.client.1.smithi139.stdout:9/526: unlink ca 0 2024-09-17T07:19:51.579 INFO:tasks.workunit.client.1.smithi139.stdout:2/314: rmdir d0/de/d54 39 2024-09-17T07:19:51.581 INFO:tasks.workunit.client.1.smithi139.stdout:2/315: fdatasync d0/de/d11/d28/f37 0 2024-09-17T07:19:51.581 INFO:tasks.workunit.client.0.smithi087.stdout:8/325: link d1/d5f/l48 d1/d7/d9/l77 0 2024-09-17T07:19:51.582 INFO:tasks.workunit.client.1.smithi139.stdout:9/527: mknod dc/d11/d52/d56/cb3 0 2024-09-17T07:19:51.584 INFO:tasks.workunit.client.1.smithi139.stdout:9/528: write dc/d11/d15/d3c/f5d [1331109,104697] 0 2024-09-17T07:19:51.584 INFO:tasks.workunit.client.0.smithi087.stdout:5/466: dread d5/d12/f77 [0,4194304] 0 2024-09-17T07:19:51.585 INFO:tasks.workunit.client.0.smithi087.stdout:6/490: chown d1/d6/d1a/d2c/d58/d90/f9c 439141896 1 2024-09-17T07:19:51.587 INFO:tasks.workunit.client.0.smithi087.stdout:6/491: fsync d1/d6/d1a/d2c/d40/d4c/f96 0 2024-09-17T07:19:51.587 INFO:tasks.workunit.client.0.smithi087.stdout:5/467: stat d5/d18/d20/d2f/f57 0 2024-09-17T07:19:51.589 INFO:tasks.workunit.client.0.smithi087.stdout:6/492: stat d1/d6/d1a/d2c/d58/c5c 0 2024-09-17T07:19:51.589 INFO:tasks.workunit.client.0.smithi087.stdout:5/468: readlink d5/d12/l42 0 2024-09-17T07:19:51.593 INFO:tasks.workunit.client.0.smithi087.stdout:0/530: truncate db/f1b 1489996 0 2024-09-17T07:19:51.594 INFO:tasks.workunit.client.0.smithi087.stdout:5/469: creat d5/d8/d1f/d68/f98 x:0 0 0 2024-09-17T07:19:51.599 INFO:tasks.workunit.client.0.smithi087.stdout:3/324: dwrite d6/d15/f19 [0,4194304] 0 2024-09-17T07:19:51.600 INFO:tasks.workunit.client.1.smithi139.stdout:2/316: rename d0/de/d11/d32/d49 to d0/de/d69 0 2024-09-17T07:19:51.603 INFO:tasks.workunit.client.1.smithi139.stdout:9/529: rename dc/d11/d52/d56/d7a/c9b to dc/d11/d15/d1e/d7c/d9f/cb4 0 2024-09-17T07:19:51.605 INFO:tasks.workunit.client.1.smithi139.stdout:2/317: creat d0/de/d69/f6a x:0 0 0 2024-09-17T07:19:51.606 INFO:tasks.workunit.client.0.smithi087.stdout:0/531: dwrite f5 [0,4194304] 0 2024-09-17T07:19:51.607 INFO:tasks.workunit.client.0.smithi087.stdout:6/493: truncate d1/d6/d1a/d2c/f2d 4255253 0 2024-09-17T07:19:51.609 INFO:tasks.workunit.client.1.smithi139.stdout:9/530: rename dc/d2c/l73 to dc/d11/d52/d56/lb5 0 2024-09-17T07:19:51.610 INFO:tasks.workunit.client.0.smithi087.stdout:5/470: dread d5/d12/d4d/f3a [0,4194304] 0 2024-09-17T07:19:51.610 INFO:tasks.workunit.client.0.smithi087.stdout:3/325: getdents d6/d1b/d2b 0 2024-09-17T07:19:51.613 INFO:tasks.workunit.client.1.smithi139.stdout:6/401: dwrite db/df/d73/d81/f3c [0,4194304] 0 2024-09-17T07:19:51.614 INFO:tasks.workunit.client.0.smithi087.stdout:0/532: unlink db/d45/d7b/d7e/fbc 0 2024-09-17T07:19:51.616 INFO:tasks.workunit.client.0.smithi087.stdout:6/494: creat d1/d6/d1a/d2c/d48/fb3 x:0 0 0 2024-09-17T07:19:51.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:51 smithi139 ceph-mon[34403]: from='client.14676 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:19:51.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:51 smithi139 ceph-mon[34403]: from='client.14680 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:19:51.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:51 smithi139 ceph-mon[34403]: from='client.? 172.21.15.87:0/470862986' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:19:51.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:51 smithi139 ceph-mon[34403]: from='client.? 172.21.15.87:0/3134113140' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T07:19:51.617 INFO:tasks.workunit.client.1.smithi139.stdout:9/531: mkdir dc/d11/d15/d3c/d61/d64/d96/db6 0 2024-09-17T07:19:51.617 INFO:tasks.workunit.client.1.smithi139.stdout:8/300: getdents d0/d20/d28/d52 0 2024-09-17T07:19:51.618 INFO:tasks.workunit.client.0.smithi087.stdout:5/471: rmdir d5/d12/d14/d61 39 2024-09-17T07:19:51.618 INFO:tasks.workunit.client.0.smithi087.stdout:0/533: creat db/d45/d5b/d92/fc7 x:0 0 0 2024-09-17T07:19:51.619 INFO:tasks.workunit.client.0.smithi087.stdout:5/472: write d5/d18/d6a/f86 [1439443,93344] 0 2024-09-17T07:19:51.624 INFO:tasks.workunit.client.0.smithi087.stdout:8/326: dread d1/d7/d9/d19/f4b [0,4194304] 0 2024-09-17T07:19:51.625 INFO:tasks.workunit.client.1.smithi139.stdout:6/402: truncate db/d18/d1b/f37 1742655 0 2024-09-17T07:19:51.626 INFO:tasks.workunit.client.1.smithi139.stdout:2/318: link d0/dc/d15/l1d d0/de/d25/d3f/l6b 0 2024-09-17T07:19:51.626 INFO:tasks.workunit.client.1.smithi139.stdout:8/301: dread d0/d1a/f3f [0,4194304] 0 2024-09-17T07:19:51.628 INFO:tasks.workunit.client.1.smithi139.stdout:6/403: chown db/df/d73/d81/l79 13 1 2024-09-17T07:19:51.628 INFO:tasks.workunit.client.1.smithi139.stdout:9/532: dwrite dc/d11/d15/f28 [0,4194304] 0 2024-09-17T07:19:51.631 INFO:tasks.workunit.client.0.smithi087.stdout:5/473: dwrite d5/d12/d4d/f47 [0,4194304] 0 2024-09-17T07:19:51.631 INFO:tasks.workunit.client.1.smithi139.stdout:8/302: symlink d0/d20/d28/d52/l57 0 2024-09-17T07:19:51.631 INFO:tasks.workunit.client.0.smithi087.stdout:6/495: dwrite d1/d6/d1a/f23 [0,4194304] 0 2024-09-17T07:19:51.632 INFO:tasks.workunit.client.1.smithi139.stdout:9/533: fdatasync dc/d11/d15/d1e/d7c/f85 0 2024-09-17T07:19:51.636 INFO:tasks.workunit.client.0.smithi087.stdout:5/474: write d5/d12/f62 [2871375,48182] 0 2024-09-17T07:19:51.636 INFO:tasks.workunit.client.0.smithi087.stdout:8/327: link d1/d7/d9/c24 d1/d5f/d71/c78 0 2024-09-17T07:19:51.636 INFO:tasks.workunit.client.0.smithi087.stdout:0/534: dread db/d45/d5b/f6a [0,4194304] 0 2024-09-17T07:19:51.637 INFO:tasks.workunit.client.1.smithi139.stdout:9/534: fdatasync dc/d11/d15/d3c/d61/d64/d96/fa4 0 2024-09-17T07:19:51.638 INFO:tasks.workunit.client.1.smithi139.stdout:8/303: creat d0/dc/f58 x:0 0 0 2024-09-17T07:19:51.640 INFO:tasks.workunit.client.0.smithi087.stdout:5/475: write d5/f19 [267699,43382] 0 2024-09-17T07:19:51.644 INFO:tasks.workunit.client.1.smithi139.stdout:2/319: dwrite d0/fb [0,4194304] 0 2024-09-17T07:19:51.647 INFO:tasks.workunit.client.1.smithi139.stdout:2/320: read d0/de/f14 [241052,89347] 0 2024-09-17T07:19:51.648 INFO:tasks.workunit.client.1.smithi139.stdout:8/304: symlink d0/dc/l59 0 2024-09-17T07:19:51.649 INFO:tasks.workunit.client.1.smithi139.stdout:2/321: read d0/d3b/f42 [256457,19043] 0 2024-09-17T07:19:51.650 INFO:tasks.workunit.client.1.smithi139.stdout:9/535: dread dc/d11/d15/d3c/d61/d64/f70 [0,4194304] 0 2024-09-17T07:19:51.651 INFO:tasks.workunit.client.0.smithi087.stdout:5/476: mknod d5/d18/d20/d2f/d60/c99 0 2024-09-17T07:19:51.653 INFO:tasks.workunit.client.1.smithi139.stdout:8/305: mkdir d0/d20/d5a 0 2024-09-17T07:19:51.654 INFO:tasks.workunit.client.0.smithi087.stdout:3/326: dread d6/fc [0,4194304] 0 2024-09-17T07:19:51.655 INFO:tasks.workunit.client.0.smithi087.stdout:0/535: dwrite db/d45/d5b/d92/fc7 [0,4194304] 0 2024-09-17T07:19:51.657 INFO:tasks.workunit.client.1.smithi139.stdout:9/536: dread dc/d11/d15/f28 [0,4194304] 0 2024-09-17T07:19:51.657 INFO:tasks.workunit.client.0.smithi087.stdout:8/328: dread d1/d2b/d3b/f62 [0,4194304] 0 2024-09-17T07:19:51.657 INFO:tasks.workunit.client.0.smithi087.stdout:6/496: dwrite d1/f16 [4194304,4194304] 0 2024-09-17T07:19:51.658 INFO:tasks.workunit.client.0.smithi087.stdout:5/477: symlink d5/d12/d14/l9a 0 2024-09-17T07:19:51.658 INFO:tasks.workunit.client.1.smithi139.stdout:8/306: mknod d0/d20/d28/d52/c5b 0 2024-09-17T07:19:51.659 INFO:tasks.workunit.client.0.smithi087.stdout:6/497: fdatasync d1/d6/d1a/d2c/d48/d62/fa4 0 2024-09-17T07:19:51.660 INFO:tasks.workunit.client.1.smithi139.stdout:9/537: mknod dc/d11/d15/d3c/cb7 0 2024-09-17T07:19:51.662 INFO:tasks.workunit.client.0.smithi087.stdout:3/327: creat d6/d1b/f67 x:0 0 0 2024-09-17T07:19:51.662 INFO:tasks.workunit.client.1.smithi139.stdout:8/307: mkdir d0/d5c 0 2024-09-17T07:19:51.663 INFO:tasks.workunit.client.0.smithi087.stdout:6/498: mknod d1/d6a/cb4 0 2024-09-17T07:19:51.670 INFO:tasks.workunit.client.0.smithi087.stdout:8/329: rename d1/d2b/l50 to d1/d2b/d3b/l79 0 2024-09-17T07:19:51.671 INFO:tasks.workunit.client.0.smithi087.stdout:5/478: truncate d5/d18/d20/d2f/f57 1203518 0 2024-09-17T07:19:51.672 INFO:tasks.workunit.client.0.smithi087.stdout:0/536: link db/d45/d5b/d92/fa8 db/d45/d5d/fc8 0 2024-09-17T07:19:51.672 INFO:tasks.workunit.client.1.smithi139.stdout:9/538: rename dc/d11/d15/d3c/d61/d64/d96/ca9 to dc/d11/d15/d1e/d34/cb8 0 2024-09-17T07:19:51.676 INFO:tasks.workunit.client.0.smithi087.stdout:8/330: creat d1/d7/d9/d27/f7a x:0 0 0 2024-09-17T07:19:51.677 INFO:tasks.workunit.client.0.smithi087.stdout:0/537: rename db/l37 to db/d45/d5b/lc9 0 2024-09-17T07:19:51.681 INFO:tasks.workunit.client.1.smithi139.stdout:6/404: dread db/d18/f6c [0,4194304] 0 2024-09-17T07:19:51.682 INFO:tasks.workunit.client.1.smithi139.stdout:6/405: write db/d21/f42 [685733,48683] 0 2024-09-17T07:19:51.682 INFO:tasks.workunit.client.1.smithi139.stdout:9/539: dread dc/d11/d15/d1e/d53/f79 [0,4194304] 0 2024-09-17T07:19:51.682 INFO:tasks.workunit.client.0.smithi087.stdout:8/331: write d1/d2b/d3b/d53/f5b [2035290,85307] 0 2024-09-17T07:19:51.682 INFO:tasks.workunit.client.0.smithi087.stdout:5/479: dread d5/d12/d4d/f3a [0,4194304] 0 2024-09-17T07:19:51.682 INFO:tasks.workunit.client.0.smithi087.stdout:8/332: creat d1/d2b/d70/f7b x:0 0 0 2024-09-17T07:19:51.683 INFO:tasks.workunit.client.0.smithi087.stdout:5/480: mkdir d5/d8/d1f/d9b 0 2024-09-17T07:19:51.683 INFO:tasks.workunit.client.1.smithi139.stdout:6/406: unlink f2 0 2024-09-17T07:19:51.684 INFO:tasks.workunit.client.1.smithi139.stdout:8/308: dread d0/f7 [0,4194304] 0 2024-09-17T07:19:51.685 INFO:tasks.workunit.client.1.smithi139.stdout:8/309: chown d0/d1a/f39 8 1 2024-09-17T07:19:51.685 INFO:tasks.workunit.client.1.smithi139.stdout:9/540: rename dc/d11/d52/f77 to dc/d11/d15/d3c/d68/fb9 0 2024-09-17T07:19:51.686 INFO:tasks.workunit.client.1.smithi139.stdout:6/407: mknod db/d21/c87 0 2024-09-17T07:19:51.686 INFO:tasks.workunit.client.0.smithi087.stdout:5/481: getdents d5/d18/d20 0 2024-09-17T07:19:51.689 INFO:tasks.workunit.client.1.smithi139.stdout:6/408: creat db/df/d4e/d64/d83/f88 x:0 0 0 2024-09-17T07:19:51.690 INFO:tasks.workunit.client.0.smithi087.stdout:8/333: dwrite d1/d2b/d21/f35 [0,4194304] 0 2024-09-17T07:19:51.692 INFO:tasks.workunit.client.1.smithi139.stdout:6/409: write db/df/d4e/f68 [701579,68812] 0 2024-09-17T07:19:51.692 INFO:tasks.workunit.client.0.smithi087.stdout:5/482: read d5/d18/d20/d2f/d52/f72 [1369529,95401] 0 2024-09-17T07:19:51.693 INFO:tasks.workunit.client.1.smithi139.stdout:6/410: stat db/df/d4e/d64/d56 0 2024-09-17T07:19:51.694 INFO:tasks.workunit.client.0.smithi087.stdout:0/538: write db/f33 [1031058,109792] 0 2024-09-17T07:19:51.694 INFO:tasks.workunit.client.0.smithi087.stdout:5/483: fdatasync d5/d18/d6f/f85 0 2024-09-17T07:19:51.696 INFO:tasks.workunit.client.1.smithi139.stdout:8/310: getdents d0/dc 0 2024-09-17T07:19:51.696 INFO:tasks.workunit.client.1.smithi139.stdout:6/411: truncate db/d18/f44 268735 0 2024-09-17T07:19:51.697 INFO:tasks.workunit.client.0.smithi087.stdout:8/334: creat d1/d7/d9/d27/f7c x:0 0 0 2024-09-17T07:19:51.697 INFO:tasks.workunit.client.1.smithi139.stdout:9/541: dwrite dc/d11/d15/d3c/f5d [0,4194304] 0 2024-09-17T07:19:51.698 INFO:tasks.workunit.client.0.smithi087.stdout:6/499: dwrite d1/f4b [0,4194304] 0 2024-09-17T07:19:51.699 INFO:tasks.workunit.client.1.smithi139.stdout:7/205: sync 2024-09-17T07:19:51.699 INFO:tasks.workunit.client.0.smithi087.stdout:0/539: truncate db/d45/d5b/fa7 1044426 0 2024-09-17T07:19:51.700 INFO:tasks.workunit.client.1.smithi139.stdout:6/412: truncate db/df/f84 947752 0 2024-09-17T07:19:51.701 INFO:tasks.workunit.client.0.smithi087.stdout:5/484: mknod d5/d18/d20/d2f/c9c 0 2024-09-17T07:19:51.701 INFO:tasks.workunit.client.0.smithi087.stdout:8/335: fdatasync d1/d2b/d70/f7b 0 2024-09-17T07:19:51.701 INFO:tasks.workunit.client.0.smithi087.stdout:8/336: chown d1/d2b/d21/l38 3 1 2024-09-17T07:19:51.702 INFO:tasks.workunit.client.0.smithi087.stdout:0/540: mknod db/d45/d9e/d95/cca 0 2024-09-17T07:19:51.703 INFO:tasks.workunit.client.0.smithi087.stdout:8/337: readlink d1/d2b/d70/d54/l57 0 2024-09-17T07:19:51.708 INFO:tasks.workunit.client.1.smithi139.stdout:7/206: mkdir d5/d10/d2b/d40 0 2024-09-17T07:19:51.709 INFO:tasks.workunit.client.0.smithi087.stdout:6/500: dwrite d1/d6/f2b [0,4194304] 0 2024-09-17T07:19:51.710 INFO:tasks.workunit.client.1.smithi139.stdout:6/413: rename db/df/d4e/d64/d54/l2d to db/df/d4e/d64/l89 0 2024-09-17T07:19:51.712 INFO:tasks.workunit.client.0.smithi087.stdout:8/338: unlink d1/d2b/d3b/d53/f66 0 2024-09-17T07:19:51.712 INFO:tasks.workunit.client.1.smithi139.stdout:6/414: chown db/d18/d38 26 1 2024-09-17T07:19:51.714 INFO:tasks.workunit.client.0.smithi087.stdout:0/541: dwrite db/f1e [0,4194304] 0 2024-09-17T07:19:51.714 INFO:tasks.workunit.client.1.smithi139.stdout:9/542: dwrite dc/d11/d15/d1e/d7c/d83/d98/fad [0,4194304] 0 2024-09-17T07:19:51.715 INFO:tasks.workunit.client.1.smithi139.stdout:7/207: getdents d5/d10/d2b/d40 0 2024-09-17T07:19:51.715 INFO:tasks.workunit.client.0.smithi087.stdout:6/501: mknod d1/d6/d1a/d2c/d48/d9b/cb5 0 2024-09-17T07:19:51.715 INFO:tasks.workunit.client.1.smithi139.stdout:7/208: write f2 [5205710,30929] 0 2024-09-17T07:19:51.719 INFO:tasks.workunit.client.0.smithi087.stdout:8/339: dread d1/d5f/f5d [0,4194304] 0 2024-09-17T07:19:51.720 INFO:tasks.workunit.client.0.smithi087.stdout:0/542: creat db/fcb x:0 0 0 2024-09-17T07:19:51.720 INFO:tasks.workunit.client.1.smithi139.stdout:7/209: unlink d5/l1c 0 2024-09-17T07:19:51.721 INFO:tasks.workunit.client.0.smithi087.stdout:6/502: mkdir d1/d6/d1a/d2c/d58/d90/da9/db6 0 2024-09-17T07:19:51.721 INFO:tasks.workunit.client.0.smithi087.stdout:8/340: write d1/d7/f2d [1128008,35453] 0 2024-09-17T07:19:51.723 INFO:tasks.workunit.client.0.smithi087.stdout:0/543: fsync db/f2e 0 2024-09-17T07:19:51.727 INFO:tasks.workunit.client.1.smithi139.stdout:7/210: symlink d5/d10/d2b/d40/l41 0 2024-09-17T07:19:51.727 INFO:tasks.workunit.client.1.smithi139.stdout:9/543: dwrite dc/d11/d15/d3c/d61/d64/f82 [0,4194304] 0 2024-09-17T07:19:51.729 INFO:tasks.workunit.client.0.smithi087.stdout:6/503: mkdir d1/d67/db7 0 2024-09-17T07:19:51.730 INFO:tasks.workunit.client.1.smithi139.stdout:7/211: read d5/d10/f28 [769728,14567] 0 2024-09-17T07:19:51.735 INFO:tasks.workunit.client.0.smithi087.stdout:6/504: rename d1/d6/d1a/d5e/d8f/f8b to d1/d6/d1a/d2c/d58/fb8 0 2024-09-17T07:19:51.738 INFO:tasks.workunit.client.0.smithi087.stdout:6/505: unlink d1/f26 0 2024-09-17T07:19:51.740 INFO:tasks.workunit.client.0.smithi087.stdout:5/485: write d5/d18/d20/d2f/f48 [783857,57774] 0 2024-09-17T07:19:51.741 INFO:tasks.workunit.client.1.smithi139.stdout:8/311: dwrite d0/f2a [0,4194304] 0 2024-09-17T07:19:51.742 INFO:tasks.workunit.client.0.smithi087.stdout:5/486: chown d5/d8/l41 106 1 2024-09-17T07:19:51.744 INFO:tasks.workunit.client.0.smithi087.stdout:6/506: link d1/d6/d1a/d2c/d48/d9b/fa2 d1/d6/d1a/d2c/d48/fb9 0 2024-09-17T07:19:51.746 INFO:tasks.workunit.client.0.smithi087.stdout:5/487: mknod d5/d18/d6a/c9d 0 2024-09-17T07:19:51.747 INFO:tasks.workunit.client.1.smithi139.stdout:8/312: fdatasync d0/d1a/d3a/f47 0 2024-09-17T07:19:51.748 INFO:tasks.workunit.client.1.smithi139.stdout:8/313: stat d0/d1a/f3f 0 2024-09-17T07:19:51.749 INFO:tasks.workunit.client.1.smithi139.stdout:6/415: truncate db/d21/f31 1077526 0 2024-09-17T07:19:51.749 INFO:tasks.workunit.client.1.smithi139.stdout:8/314: fdatasync d0/fb 0 2024-09-17T07:19:51.749 INFO:tasks.workunit.client.1.smithi139.stdout:9/544: fsync dc/d11/d15/d1e/d7c/d83/d98/fad 0 2024-09-17T07:19:51.750 INFO:tasks.workunit.client.1.smithi139.stdout:8/315: readlink d0/dc/l59 0 2024-09-17T07:19:51.751 INFO:tasks.workunit.client.1.smithi139.stdout:8/316: fdatasync d0/dc/d18/f38 0 2024-09-17T07:19:51.751 INFO:tasks.workunit.client.0.smithi087.stdout:6/507: dwrite d1/d6/f2b [0,4194304] 0 2024-09-17T07:19:51.752 INFO:tasks.workunit.client.0.smithi087.stdout:5/488: chown d5/d18/l46 7 1 2024-09-17T07:19:51.752 INFO:tasks.workunit.client.1.smithi139.stdout:6/416: mkdir db/df/d4e/d5e/d8a 0 2024-09-17T07:19:51.754 INFO:tasks.workunit.client.0.smithi087.stdout:5/489: readlink d5/d12/d1c/l96 0 2024-09-17T07:19:51.755 INFO:tasks.workunit.client.1.smithi139.stdout:9/545: mkdir dc/d11/dba 0 2024-09-17T07:19:51.757 INFO:tasks.workunit.client.0.smithi087.stdout:5/490: unlink d5/d12/d56/d5b/c69 0 2024-09-17T07:19:51.757 INFO:tasks.workunit.client.1.smithi139.stdout:6/417: write f7 [2455078,68396] 0 2024-09-17T07:19:51.758 INFO:tasks.workunit.client.0.smithi087.stdout:6/508: rmdir d1/d6/d1a/d2c/d58/d90 39 2024-09-17T07:19:51.759 INFO:tasks.workunit.client.1.smithi139.stdout:9/546: unlink dc/d11/d15/d1e/f2f 0 2024-09-17T07:19:51.759 INFO:tasks.workunit.client.0.smithi087.stdout:6/509: chown d1/d6/d1a/d2c/d58/fb8 129018 1 2024-09-17T07:19:51.760 INFO:tasks.workunit.client.0.smithi087.stdout:5/491: mkdir d5/d12/d56/d9e 0 2024-09-17T07:19:51.761 INFO:tasks.workunit.client.1.smithi139.stdout:8/317: rmdir d0/d5c 0 2024-09-17T07:19:51.762 INFO:tasks.workunit.client.0.smithi087.stdout:8/341: truncate d1/d7/d9/d19/d1b/f30 1965862 0 2024-09-17T07:19:51.762 INFO:tasks.workunit.client.0.smithi087.stdout:5/492: fsync d5/d18/d6f/f85 0 2024-09-17T07:19:51.764 INFO:tasks.workunit.client.1.smithi139.stdout:6/418: creat db/d18/d5b/f8b x:0 0 0 2024-09-17T07:19:51.765 INFO:tasks.workunit.client.1.smithi139.stdout:6/419: readlink db/d21/l28 0 2024-09-17T07:19:51.765 INFO:tasks.workunit.client.0.smithi087.stdout:8/342: truncate d1/d7/d9/d19/f1d 5130745 0 2024-09-17T07:19:51.768 INFO:tasks.workunit.client.1.smithi139.stdout:8/318: creat d0/d1a/d4d/d53/f5d x:0 0 0 2024-09-17T07:19:51.769 INFO:tasks.workunit.client.1.smithi139.stdout:7/212: dread d5/d17/f20 [0,4194304] 0 2024-09-17T07:19:51.770 INFO:tasks.workunit.client.0.smithi087.stdout:6/510: link d1/d6/d1a/d2c/d48/d62/fa4 d1/d6/d1a/d2c/d58/d90/da9/db6/fba 0 2024-09-17T07:19:51.770 INFO:tasks.workunit.client.0.smithi087.stdout:8/343: mknod d1/d7/d9/c7d 0 2024-09-17T07:19:51.771 INFO:tasks.workunit.client.1.smithi139.stdout:8/319: chown d0/dc/c1d 47865097 1 2024-09-17T07:19:51.771 INFO:tasks.workunit.client.1.smithi139.stdout:9/547: rename dc/d11/d15/d1e/d7c/f85 to dc/d11/d15/d3c/fbb 0 2024-09-17T07:19:51.772 INFO:tasks.workunit.client.0.smithi087.stdout:5/493: dwrite d5/d8/d1f/f92 [0,4194304] 0 2024-09-17T07:19:51.773 INFO:tasks.workunit.client.0.smithi087.stdout:6/511: creat d1/d6a/da3/fbb x:0 0 0 2024-09-17T07:19:51.773 INFO:tasks.workunit.client.0.smithi087.stdout:8/344: chown d1/d2b/d70/c31 72 1 2024-09-17T07:19:51.774 INFO:tasks.workunit.client.1.smithi139.stdout:6/420: dwrite db/df/d73/d81/f3c [0,4194304] 0 2024-09-17T07:19:51.775 INFO:tasks.workunit.client.1.smithi139.stdout:9/548: readlink dc/d11/d15/d1e/d34/l76 0 2024-09-17T07:19:51.775 INFO:tasks.workunit.client.0.smithi087.stdout:6/512: dread - d1/d6/d1a/d2c/d58/d90/da9/db6/fba zero size 2024-09-17T07:19:51.777 INFO:tasks.workunit.client.0.smithi087.stdout:6/513: fdatasync d1/d6/d1a/d2c/d58/f92 0 2024-09-17T07:19:51.778 INFO:tasks.workunit.client.0.smithi087.stdout:5/494: mknod d5/d18/c9f 0 2024-09-17T07:19:51.779 INFO:tasks.workunit.client.0.smithi087.stdout:8/345: truncate d1/d7/d9/d27/f7a 356677 0 2024-09-17T07:19:51.780 INFO:tasks.workunit.client.1.smithi139.stdout:6/421: write db/df/d4e/f68 [929970,90323] 0 2024-09-17T07:19:51.781 INFO:tasks.workunit.client.0.smithi087.stdout:8/346: chown d1/d2b/d70/f7b 2 1 2024-09-17T07:19:51.781 INFO:tasks.workunit.client.0.smithi087.stdout:6/514: rmdir d1/d6/d1a/d2c/d58/d90 39 2024-09-17T07:19:51.784 INFO:tasks.workunit.client.1.smithi139.stdout:7/213: dwrite d5/d17/f31 [0,4194304] 0 2024-09-17T07:19:51.784 INFO:tasks.workunit.client.1.smithi139.stdout:6/422: stat db/df/d4e/d64 0 2024-09-17T07:19:51.784 INFO:tasks.workunit.client.0.smithi087.stdout:5/495: creat d5/d8/d1f/d9b/fa0 x:0 0 0 2024-09-17T07:19:51.785 INFO:tasks.workunit.client.1.smithi139.stdout:9/549: rename dc/d11/d15/d3c/f3d to dc/d11/d15/d1e/d34/fbc 0 2024-09-17T07:19:51.785 INFO:tasks.workunit.client.1.smithi139.stdout:8/320: dwrite d0/dc/d18/f55 [0,4194304] 0 2024-09-17T07:19:51.787 INFO:tasks.workunit.client.1.smithi139.stdout:8/321: stat d0/dc/f58 0 2024-09-17T07:19:51.788 INFO:tasks.workunit.client.0.smithi087.stdout:5/496: chown d5/d18/d20/f5f 99896 1 2024-09-17T07:19:51.790 INFO:tasks.workunit.client.0.smithi087.stdout:6/515: creat d1/d6/d1a/d2c/d48/d9b/dac/fbc x:0 0 0 2024-09-17T07:19:51.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:51.789+0000 7f43b56f0640 1 -- 172.21.15.87:0/3239058812 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f43b004b720 con 0x7f43b00fc1f0 2024-09-17T07:19:51.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:51.791+0000 7f43a77fe640 1 -- 172.21.15.87:0/3239058812 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f43a00776b0 con 0x7f43b00fc1f0 2024-09-17T07:19:51.792 INFO:teuthology.orchestra.run.smithi087.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T07:19:51.792 INFO:teuthology.orchestra.run.smithi087.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T07:19:51.792 INFO:teuthology.orchestra.run.smithi087.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T07:19:51.793 INFO:tasks.workunit.client.0.smithi087.stdout:8/347: dwrite d1/d7/d9/d27/f45 [4194304,4194304] 0 2024-09-17T07:19:51.795 INFO:tasks.workunit.client.0.smithi087.stdout:8/348: write d1/d2b/d70/f7b [97041,65291] 0 2024-09-17T07:19:51.796 INFO:tasks.workunit.client.1.smithi139.stdout:8/322: rename d0/d20/d5a to d0/d1a/d4d/d5e 0 2024-09-17T07:19:51.796 INFO:tasks.workunit.client.1.smithi139.stdout:6/423: link db/d21/l27 db/df/d4e/d64/d80/l8c 0 2024-09-17T07:19:51.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:51.795+0000 7f43b56f0640 1 -- 172.21.15.87:0/3239058812 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f439c06dce0 msgr2=0x7f439c070190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:19:51.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:51.795+0000 7f43b56f0640 1 --2- 172.21.15.87:0/3239058812 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f439c06dce0 0x7f439c070190 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4398009b50 tx=0x7f4398009120 comp rx=0 tx=0).stop 2024-09-17T07:19:51.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:51.795+0000 7f43b56f0640 1 -- 172.21.15.87:0/3239058812 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43b00fc1f0 msgr2=0x7f43b0113b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:19:51.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:51.795+0000 7f43b56f0640 1 --2- 172.21.15.87:0/3239058812 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43b00fc1f0 0x7f43b0113b50 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f43a0009ac0 tx=0x7f43a0009da0 comp rx=0 tx=0).stop 2024-09-17T07:19:51.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:51.795+0000 7f43b56f0640 1 -- 172.21.15.87:0/3239058812 shutdown_connections 2024-09-17T07:19:51.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:51.795+0000 7f43b56f0640 1 --2- 172.21.15.87:0/3239058812 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f439c06dce0 0x7f439c070190 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:51.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:51.795+0000 7f43b56f0640 1 --2- 172.21.15.87:0/3239058812 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43b00fc1f0 0x7f43b0113b50 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:51.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:51.795+0000 7f43b56f0640 1 --2- 172.21.15.87:0/3239058812 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f43b00fb8a0 0x7f43b0113610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:19:51.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:51.795+0000 7f43b56f0640 1 -- 172.21.15.87:0/3239058812 >> 172.21.15.87:0/3239058812 conn(0x7f43b00f6390 msgr2=0x7f43b00f7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:19:51.798 INFO:tasks.workunit.client.0.smithi087.stdout:5/497: rename d5/d12/d56/d5b/c89 to d5/d18/d20/d2f/d83/ca1 0 2024-09-17T07:19:51.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:51.796+0000 7f43b56f0640 1 -- 172.21.15.87:0/3239058812 shutdown_connections 2024-09-17T07:19:51.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:19:51.797+0000 7f43b56f0640 1 -- 172.21.15.87:0/3239058812 wait complete. 2024-09-17T07:19:51.799 INFO:tasks.workunit.client.0.smithi087.stdout:8/349: stat d1/d2b/f6e 0 2024-09-17T07:19:51.804 INFO:tasks.workunit.client.1.smithi139.stdout:8/323: dwrite d0/dc/d18/f1c [0,4194304] 0 2024-09-17T07:19:51.807 INFO:tasks.workunit.client.0.smithi087.stdout:5/498: dread d5/d18/d20/f35 [0,4194304] 0 2024-09-17T07:19:51.808 INFO:tasks.workunit.client.1.smithi139.stdout:9/550: write dc/d11/d15/d1e/f21 [325724,35092] 0 2024-09-17T07:19:51.809 INFO:tasks.workunit.client.0.smithi087.stdout:5/499: stat d5/d6d/c79 0 2024-09-17T07:19:51.810 INFO:tasks.workunit.client.1.smithi139.stdout:5/171: sync 2024-09-17T07:19:51.811 INFO:tasks.workunit.client.1.smithi139.stdout:9/551: dread dc/d11/d15/d3c/f7e [0,4194304] 0 2024-09-17T07:19:51.812 INFO:tasks.workunit.client.0.smithi087.stdout:6/516: dread d1/d6/d1a/d2c/d40/f4d [0,4194304] 0 2024-09-17T07:19:51.812 INFO:tasks.workunit.client.1.smithi139.stdout:5/172: rmdir d4/d16/d1b 39 2024-09-17T07:19:51.813 INFO:tasks.workunit.client.0.smithi087.stdout:5/500: rename d5/d18/d20/f5f to d5/d12/d1c/fa2 0 2024-09-17T07:19:51.814 INFO:tasks.workunit.client.1.smithi139.stdout:5/173: chown d4/d16/d1b/d20/f24 187 1 2024-09-17T07:19:51.816 INFO:tasks.workunit.client.0.smithi087.stdout:5/501: mkdir d5/d8/d1f/d4e/da3 0 2024-09-17T07:19:51.817 INFO:tasks.workunit.client.0.smithi087.stdout:6/517: dread d1/f16 [4194304,4194304] 0 2024-09-17T07:19:51.817 INFO:tasks.workunit.client.1.smithi139.stdout:5/174: unlink d4/d16/d1b/d20/d28/l1a 0 2024-09-17T07:19:51.818 INFO:tasks.workunit.client.0.smithi087.stdout:5/502: fsync d5/d8/f3f 0 2024-09-17T07:19:51.818 INFO:tasks.workunit.client.1.smithi139.stdout:7/214: fsync d5/d17/f31 0 2024-09-17T07:19:51.819 INFO:tasks.workunit.client.1.smithi139.stdout:9/552: dwrite dc/d2a/fa7 [0,4194304] 0 2024-09-17T07:19:51.820 INFO:tasks.workunit.client.1.smithi139.stdout:6/424: truncate db/df/d4e/d64/f4d 258870 0 2024-09-17T07:19:51.821 INFO:tasks.workunit.client.1.smithi139.stdout:6/425: read - db/d18/d38/f77 zero size 2024-09-17T07:19:51.823 INFO:tasks.workunit.client.0.smithi087.stdout:5/503: rename d5/f17 to d5/d12/d14/d61/d94/fa4 0 2024-09-17T07:19:51.825 INFO:tasks.workunit.client.0.smithi087.stdout:5/504: fdatasync d5/d18/f4a 0 2024-09-17T07:19:51.828 INFO:tasks.workunit.client.0.smithi087.stdout:4/334: sync 2024-09-17T07:19:51.829 INFO:tasks.workunit.client.1.smithi139.stdout:9/553: creat dc/d11/fbd x:0 0 0 2024-09-17T07:19:51.832 INFO:tasks.workunit.client.1.smithi139.stdout:7/215: write d5/d10/f2c [1333350,29762] 0 2024-09-17T07:19:51.832 INFO:tasks.workunit.client.0.smithi087.stdout:5/505: dwrite d5/d18/f4a [0,4194304] 0 2024-09-17T07:19:51.833 INFO:tasks.workunit.client.0.smithi087.stdout:8/350: dread d1/d2b/f29 [0,4194304] 0 2024-09-17T07:19:51.833 INFO:tasks.workunit.client.1.smithi139.stdout:8/324: dwrite d0/f7 [0,4194304] 0 2024-09-17T07:19:51.833 INFO:tasks.workunit.client.1.smithi139.stdout:6/426: truncate db/f16 1338592 0 2024-09-17T07:19:51.835 INFO:tasks.workunit.client.1.smithi139.stdout:5/175: dwrite d4/d16/d1b/d20/d28/f26 [0,4194304] 0 2024-09-17T07:19:51.837 INFO:tasks.workunit.client.1.smithi139.stdout:7/216: write d5/d17/f27 [631861,61132] 0 2024-09-17T07:19:51.839 INFO:tasks.workunit.client.1.smithi139.stdout:8/325: creat d0/d20/f5f x:0 0 0 2024-09-17T07:19:51.840 INFO:tasks.workunit.client.1.smithi139.stdout:9/554: mkdir dc/d11/dbe 0 2024-09-17T07:19:51.841 INFO:tasks.workunit.client.1.smithi139.stdout:6/427: creat db/df/d73/f8d x:0 0 0 2024-09-17T07:19:51.842 INFO:tasks.workunit.client.1.smithi139.stdout:5/176: mkdir d4/d16/d1b/d20/d32 0 2024-09-17T07:19:51.842 INFO:tasks.workunit.client.1.smithi139.stdout:6/428: readlink db/df/d73/d81/l6f 0 2024-09-17T07:19:51.843 INFO:tasks.workunit.client.1.smithi139.stdout:7/217: unlink d5/c15 0 2024-09-17T07:19:51.845 INFO:tasks.workunit.client.1.smithi139.stdout:8/326: chown d0/d20/d28/c51 8 1 2024-09-17T07:19:51.846 INFO:tasks.workunit.client.1.smithi139.stdout:9/555: creat dc/d11/d52/d56/fbf x:0 0 0 2024-09-17T07:19:51.847 INFO:tasks.workunit.client.1.smithi139.stdout:9/556: stat dc/d11/d15/d3c/d68/fa0 0 2024-09-17T07:19:51.847 INFO:tasks.workunit.client.1.smithi139.stdout:5/177: mkdir d4/d33 0 2024-09-17T07:19:51.849 INFO:tasks.workunit.client.1.smithi139.stdout:9/557: read dc/f3e [2789198,99170] 0 2024-09-17T07:19:51.850 INFO:tasks.workunit.client.1.smithi139.stdout:7/218: creat d5/d10/f42 x:0 0 0 2024-09-17T07:19:51.850 INFO:tasks.workunit.client.1.smithi139.stdout:8/327: symlink d0/d1a/d4d/l60 0 2024-09-17T07:19:51.851 INFO:tasks.workunit.client.1.smithi139.stdout:7/219: fsync d5/d10/f2e 0 2024-09-17T07:19:51.851 INFO:tasks.workunit.client.0.smithi087.stdout:4/335: write d2/d22/d2c/d3f/d4d/d21/d2f/d3b/f77 [1819403,100258] 0 2024-09-17T07:19:51.853 INFO:tasks.workunit.client.0.smithi087.stdout:5/506: chown d5/d12/d1c/l6e 6 1 2024-09-17T07:19:51.854 INFO:tasks.workunit.client.1.smithi139.stdout:9/558: creat dc/d11/d15/d3c/d61/fc0 x:0 0 0 2024-09-17T07:19:51.854 INFO:tasks.workunit.client.1.smithi139.stdout:6/429: rmdir db/df 39 2024-09-17T07:19:51.855 INFO:tasks.workunit.client.0.smithi087.stdout:4/336: readlink d2/d22/d2c/d3f/d4d/l60 0 2024-09-17T07:19:51.856 INFO:tasks.workunit.client.1.smithi139.stdout:7/220: chown d5/l3b 14643 1 2024-09-17T07:19:51.856 INFO:tasks.workunit.client.0.smithi087.stdout:6/518: dwrite d1/d6/d1a/d2c/d48/fb9 [0,4194304] 0 2024-09-17T07:19:51.856 INFO:tasks.workunit.client.1.smithi139.stdout:7/221: chown d5/d10/f42 85982 1 2024-09-17T07:19:51.858 INFO:tasks.workunit.client.1.smithi139.stdout:7/222: truncate d5/d10/f2c 2983706 0 2024-09-17T07:19:51.860 INFO:tasks.workunit.client.1.smithi139.stdout:8/328: rename d0/dc/l30 to d0/d20/l61 0 2024-09-17T07:19:51.861 INFO:tasks.workunit.client.0.smithi087.stdout:8/351: rmdir d1/d7/d9/d19/d4d 39 2024-09-17T07:19:51.861 INFO:tasks.workunit.client.1.smithi139.stdout:5/178: dread d4/d16/f18 [0,4194304] 0 2024-09-17T07:19:51.862 INFO:tasks.workunit.client.0.smithi087.stdout:5/507: creat d5/d12/d1c/fa5 x:0 0 0 2024-09-17T07:19:51.863 INFO:tasks.workunit.client.1.smithi139.stdout:9/559: unlink dc/d11/d8b/faf 0 2024-09-17T07:19:51.863 INFO:tasks.workunit.client.1.smithi139.stdout:5/179: write d4/d16/d1b/f25 [280805,88098] 0 2024-09-17T07:19:51.863 INFO:tasks.workunit.client.0.smithi087.stdout:4/337: unlink d2/d5/f12 0 2024-09-17T07:19:51.864 INFO:tasks.workunit.client.0.smithi087.stdout:8/352: truncate d1/d7/d9/d27/f7a 533017 0 2024-09-17T07:19:51.864 INFO:tasks.workunit.client.0.smithi087.stdout:4/338: write d2/d22/d2c/d3f/d4d/d21/f70 [905334,128128] 0 2024-09-17T07:19:51.865 INFO:tasks.workunit.client.0.smithi087.stdout:8/353: dread - d1/d2b/d70/d54/f6a zero size 2024-09-17T07:19:51.865 INFO:tasks.workunit.client.0.smithi087.stdout:4/339: stat d2/d22/d2c/d3f/d4d/d21/f4c 0 2024-09-17T07:19:51.866 INFO:tasks.workunit.client.0.smithi087.stdout:5/508: symlink d5/d8/d1f/la6 0 2024-09-17T07:19:51.867 INFO:tasks.workunit.client.0.smithi087.stdout:6/519: dread d1/d6/d1a/d2c/d33/f4f [0,4194304] 0 2024-09-17T07:19:51.868 INFO:tasks.workunit.client.0.smithi087.stdout:8/354: mknod d1/d7/c7e 0 2024-09-17T07:19:51.870 INFO:tasks.workunit.client.0.smithi087.stdout:4/340: mknod d2/d22/d2c/d3f/d4d/c7c 0 2024-09-17T07:19:51.871 INFO:tasks.workunit.client.0.smithi087.stdout:6/520: mknod d1/d6/d1a/cbd 0 2024-09-17T07:19:51.873 INFO:tasks.workunit.client.0.smithi087.stdout:4/341: truncate d2/d22/d2c/d3f/d4d/d2d/f5d 568408 0 2024-09-17T07:19:51.874 INFO:tasks.workunit.client.0.smithi087.stdout:8/355: rename d1/d2b/d70 to d1/d2b/d21/d6d/d6f/d7f 0 2024-09-17T07:19:51.876 INFO:tasks.workunit.client.0.smithi087.stdout:6/521: mknod d1/d6/d1a/d2c/d33/cbe 0 2024-09-17T07:19:51.876 INFO:tasks.workunit.client.0.smithi087.stdout:6/522: readlink d1/d6/d1a/d2c/d48/la7 0 2024-09-17T07:19:51.877 INFO:tasks.workunit.client.0.smithi087.stdout:8/356: rename d1/d5f/l52 to d1/d2b/d3b/d53/l80 0 2024-09-17T07:19:51.878 INFO:tasks.workunit.client.0.smithi087.stdout:6/523: write d1/d6/d1a/d2c/f52 [3942219,71425] 0 2024-09-17T07:19:51.880 INFO:tasks.workunit.client.0.smithi087.stdout:6/524: write d1/d6/d1a/f36 [3491920,37104] 0 2024-09-17T07:19:51.880 INFO:tasks.workunit.client.0.smithi087.stdout:4/342: rename d2/f45 to d2/d22/d2c/d3f/d4d/d21/d2f/d3b/f7d 0 2024-09-17T07:19:51.886 INFO:tasks.workunit.client.0.smithi087.stdout:8/357: dwrite d1/d7/d9/d19/d1b/f43 [0,4194304] 0 2024-09-17T07:19:51.887 INFO:tasks.workunit.client.0.smithi087.stdout:4/343: mkdir d2/d22/d2c/d3f/d4d/d21/d2f/d3b/d7e 0 2024-09-17T07:19:51.888 INFO:tasks.workunit.client.1.smithi139.stdout:9/560: chown dc/d11/d52/l72 5902 1 2024-09-17T07:19:51.888 INFO:tasks.workunit.client.0.smithi087.stdout:8/358: dread - d1/d2b/d3b/d53/f5e zero size 2024-09-17T07:19:51.890 INFO:tasks.workunit.client.0.smithi087.stdout:4/344: fdatasync d2/d22/d2c/d3f/f65 0 2024-09-17T07:19:51.893 INFO:tasks.workunit.client.1.smithi139.stdout:8/329: dread - d0/dc/f34 zero size 2024-09-17T07:19:51.895 INFO:tasks.workunit.client.0.smithi087.stdout:6/525: dread d1/d6/d1a/d2c/f75 [4194304,4194304] 0 2024-09-17T07:19:51.895 INFO:tasks.workunit.client.0.smithi087.stdout:5/509: truncate d5/d18/f4a 2448428 0 2024-09-17T07:19:51.897 INFO:tasks.workunit.client.1.smithi139.stdout:7/223: creat d5/f43 x:0 0 0 2024-09-17T07:19:51.897 INFO:tasks.workunit.client.0.smithi087.stdout:4/345: chown d2/f25 213540232 1 2024-09-17T07:19:51.899 INFO:tasks.workunit.client.1.smithi139.stdout:7/224: write f2 [1476788,122016] 0 2024-09-17T07:19:51.900 INFO:tasks.workunit.client.0.smithi087.stdout:4/346: symlink d2/d22/d2c/d3f/d4d/d21/d2f/l7f 0 2024-09-17T07:19:51.901 INFO:tasks.workunit.client.0.smithi087.stdout:8/359: link d1/d7/d9/d19/l20 d1/d2b/d21/l81 0 2024-09-17T07:19:51.902 INFO:tasks.workunit.client.1.smithi139.stdout:8/330: creat d0/d1a/d3a/f62 x:0 0 0 2024-09-17T07:19:51.902 INFO:tasks.workunit.client.1.smithi139.stdout:6/430: getdents db/df/d4e 0 2024-09-17T07:19:51.902 INFO:tasks.workunit.client.1.smithi139.stdout:9/561: dwrite dc/d11/d15/d3c/fbb [0,4194304] 0 2024-09-17T07:19:51.904 INFO:tasks.workunit.client.0.smithi087.stdout:6/526: creat d1/d6/d1a/d2c/d58/fbf x:0 0 0 2024-09-17T07:19:51.905 INFO:tasks.workunit.client.0.smithi087.stdout:8/360: rmdir d1/d7/d9/d27 39 2024-09-17T07:19:51.907 INFO:tasks.workunit.client.0.smithi087.stdout:6/527: symlink d1/d6/d1a/d2c/d40/d4c/da1/lc0 0 2024-09-17T07:19:51.908 INFO:tasks.workunit.client.0.smithi087.stdout:8/361: creat d1/d2b/d21/d6d/d6f/f82 x:0 0 0 2024-09-17T07:19:51.908 INFO:tasks.workunit.client.1.smithi139.stdout:6/431: write db/df/f19 [4407813,76594] 0 2024-09-17T07:19:51.910 INFO:tasks.workunit.client.0.smithi087.stdout:6/528: rename d1/d6/d1a/d2c/d48/fb3 to d1/d6/fc1 0 2024-09-17T07:19:51.912 INFO:tasks.workunit.client.0.smithi087.stdout:8/362: truncate d1/d7/d9/fc 4885188 0 2024-09-17T07:19:51.914 INFO:tasks.workunit.client.1.smithi139.stdout:8/331: creat d0/d20/d28/d52/f63 x:0 0 0 2024-09-17T07:19:51.915 INFO:tasks.workunit.client.1.smithi139.stdout:7/225: dwrite d5/d17/f3a [0,4194304] 0 2024-09-17T07:19:51.915 INFO:tasks.workunit.client.1.smithi139.stdout:7/226: read - d5/f43 zero size 2024-09-17T07:19:51.916 INFO:tasks.workunit.client.1.smithi139.stdout:9/562: dread dc/d2c/f62 [0,4194304] 0 2024-09-17T07:19:51.917 INFO:tasks.workunit.client.1.smithi139.stdout:7/227: fsync d5/d10/d2b/f3c 0 2024-09-17T07:19:51.917 INFO:tasks.workunit.client.0.smithi087.stdout:4/347: creat d2/d22/d2c/d3f/d4d/d21/d2f/d3b/f80 x:0 0 0 2024-09-17T07:19:51.918 INFO:tasks.workunit.client.1.smithi139.stdout:7/228: chown d5/d17/f33 98696 1 2024-09-17T07:19:51.919 INFO:tasks.workunit.client.0.smithi087.stdout:8/363: creat d1/d7/d9/f83 x:0 0 0 2024-09-17T07:19:51.920 INFO:tasks.workunit.client.0.smithi087.stdout:4/348: truncate d2/d22/d2c/d3f/d4d/d21/f79 437996 0 2024-09-17T07:19:51.920 INFO:tasks.workunit.client.0.smithi087.stdout:8/364: chown d1/d7/d9/d19/f1d 60 1 2024-09-17T07:19:51.921 INFO:tasks.workunit.client.1.smithi139.stdout:6/432: creat db/d18/f8e x:0 0 0 2024-09-17T07:19:51.922 INFO:tasks.workunit.client.1.smithi139.stdout:8/332: creat d0/d20/d28/d52/f64 x:0 0 0 2024-09-17T07:19:51.923 INFO:tasks.workunit.client.0.smithi087.stdout:4/349: creat d2/d22/d2c/d3f/d4d/d21/d2f/d3b/d7e/f81 x:0 0 0 2024-09-17T07:19:51.925 INFO:tasks.workunit.client.0.smithi087.stdout:8/365: dread d1/f2a [0,4194304] 0 2024-09-17T07:19:51.925 INFO:tasks.workunit.client.0.smithi087.stdout:4/350: mknod d2/d22/d2c/d3f/d4f/d6a/c82 0 2024-09-17T07:19:51.926 INFO:tasks.workunit.client.1.smithi139.stdout:8/333: mkdir d0/d20/d28/d52/d65 0 2024-09-17T07:19:51.927 INFO:tasks.workunit.client.0.smithi087.stdout:8/366: creat d1/d7/d63/f84 x:0 0 0 2024-09-17T07:19:51.928 INFO:tasks.workunit.client.0.smithi087.stdout:4/351: symlink d2/d22/d2c/d3f/d4d/d3e/l83 0 2024-09-17T07:19:51.929 INFO:tasks.workunit.client.1.smithi139.stdout:7/229: getdents d5/d10/d2b/d40 0 2024-09-17T07:19:51.929 INFO:tasks.workunit.client.1.smithi139.stdout:7/230: chown d5/d10/c1d 518904469 1 2024-09-17T07:19:51.931 INFO:tasks.workunit.client.0.smithi087.stdout:8/367: creat d1/d7/d9/f85 x:0 0 0 2024-09-17T07:19:51.931 INFO:tasks.workunit.client.1.smithi139.stdout:8/334: symlink d0/d20/d28/d48/l66 0 2024-09-17T07:19:51.933 INFO:tasks.workunit.client.1.smithi139.stdout:7/231: rename d5/d17/f3a to d5/d10/d2b/f44 0 2024-09-17T07:19:51.934 INFO:tasks.workunit.client.1.smithi139.stdout:7/232: stat d5/d17/f33 0 2024-09-17T07:19:51.934 INFO:tasks.workunit.client.1.smithi139.stdout:6/433: dread db/df/f13 [0,4194304] 0 2024-09-17T07:19:51.934 INFO:tasks.workunit.client.1.smithi139.stdout:8/335: creat d0/d1a/d3a/f67 x:0 0 0 2024-09-17T07:19:51.935 INFO:tasks.workunit.client.0.smithi087.stdout:4/352: dwrite d2/d5/f2a [0,4194304] 0 2024-09-17T07:19:51.935 INFO:tasks.workunit.client.1.smithi139.stdout:7/233: dread - d5/f37 zero size 2024-09-17T07:19:51.935 INFO:tasks.workunit.client.0.smithi087.stdout:8/368: rename d1/d2b/f6e to d1/d2b/d21/d6d/d6f/d7f/d54/f86 0 2024-09-17T07:19:51.936 INFO:tasks.workunit.client.0.smithi087.stdout:4/353: chown d2/d5/c3c 8333954 1 2024-09-17T07:19:51.937 INFO:tasks.workunit.client.1.smithi139.stdout:8/336: write d0/d1a/d4d/d53/f5d [928153,12163] 0 2024-09-17T07:19:51.937 INFO:tasks.workunit.client.0.smithi087.stdout:8/369: write d1/d7/d9/d19/d1b/f43 [1633650,65240] 0 2024-09-17T07:19:51.938 INFO:tasks.workunit.client.1.smithi139.stdout:6/434: read db/df/f19 [2892099,24675] 0 2024-09-17T07:19:51.938 INFO:tasks.workunit.client.1.smithi139.stdout:7/234: write d5/d10/f2e [569963,125991] 0 2024-09-17T07:19:51.939 INFO:tasks.workunit.client.0.smithi087.stdout:4/354: unlink d2/d5/f2a 0 2024-09-17T07:19:51.939 INFO:tasks.workunit.client.1.smithi139.stdout:7/235: dread - d5/d10/f42 zero size 2024-09-17T07:19:51.939 INFO:tasks.workunit.client.0.smithi087.stdout:4/355: chown d2/c11 29 1 2024-09-17T07:19:51.940 INFO:tasks.workunit.client.1.smithi139.stdout:8/337: write d0/fb [4468731,16617] 0 2024-09-17T07:19:51.942 INFO:tasks.workunit.client.0.smithi087.stdout:8/370: fsync d1/d7/d9/d27/f58 0 2024-09-17T07:19:51.943 INFO:tasks.workunit.client.1.smithi139.stdout:6/435: rmdir db/df/d4e/d64/d80 39 2024-09-17T07:19:51.944 INFO:tasks.workunit.client.0.smithi087.stdout:4/356: rename f0 to d2/d22/d2c/d3f/d4d/d3e/f84 0 2024-09-17T07:19:51.946 INFO:tasks.workunit.client.0.smithi087.stdout:8/371: creat d1/d5f/f87 x:0 0 0 2024-09-17T07:19:51.946 INFO:tasks.workunit.client.0.smithi087.stdout:8/372: fdatasync d1/d2b/d3b/d53/f5e 0 2024-09-17T07:19:51.947 INFO:tasks.workunit.client.0.smithi087.stdout:4/357: symlink d2/d22/d2c/d3f/d74/l85 0 2024-09-17T07:19:51.947 INFO:tasks.workunit.client.1.smithi139.stdout:6/436: mknod db/df/d4e/d5e/c8f 0 2024-09-17T07:19:51.949 INFO:tasks.workunit.client.1.smithi139.stdout:7/236: dwrite d5/d10/f42 [0,4194304] 0 2024-09-17T07:19:51.950 INFO:tasks.workunit.client.0.smithi087.stdout:8/373: mknod d1/d2b/d21/c88 0 2024-09-17T07:19:51.951 INFO:tasks.workunit.client.1.smithi139.stdout:7/237: write d5/d17/f31 [2116458,7224] 0 2024-09-17T07:19:51.951 INFO:tasks.workunit.client.0.smithi087.stdout:8/374: truncate d1/d2b/d21/d6d/d6f/d7f/d54/f6a 531479 0 2024-09-17T07:19:51.953 INFO:tasks.workunit.client.1.smithi139.stdout:6/437: getdents db/d21 0 2024-09-17T07:19:51.954 INFO:tasks.workunit.client.1.smithi139.stdout:7/238: symlink d5/d10/l45 0 2024-09-17T07:19:51.954 INFO:tasks.workunit.client.1.smithi139.stdout:6/438: chown db/d18/l22 491565 1 2024-09-17T07:19:51.954 INFO:tasks.workunit.client.0.smithi087.stdout:8/375: rename d1/d7/d9/c24 to d1/d2b/d21/d6d/d6f/c89 0 2024-09-17T07:19:51.958 INFO:tasks.workunit.client.0.smithi087.stdout:8/376: creat d1/d7/d9/d19/d1b/f8a x:0 0 0 2024-09-17T07:19:51.959 INFO:tasks.workunit.client.0.smithi087.stdout:8/377: write d1/d7/f2d [1524846,51877] 0 2024-09-17T07:19:51.959 INFO:tasks.workunit.client.1.smithi139.stdout:7/239: link d5/l3b d5/d10/d2b/d40/l46 0 2024-09-17T07:19:51.960 INFO:tasks.workunit.client.0.smithi087.stdout:4/358: write d2/f25 [2226436,84501] 0 2024-09-17T07:19:51.961 INFO:tasks.workunit.client.0.smithi087.stdout:8/378: symlink d1/d2b/d3b/l8b 0 2024-09-17T07:19:51.961 INFO:tasks.workunit.client.0.smithi087.stdout:8/379: chown d1/d7/d9/d27 2582337 1 2024-09-17T07:19:51.962 INFO:tasks.workunit.client.0.smithi087.stdout:4/359: mkdir d2/d22/d2c/d3f/d86 0 2024-09-17T07:19:51.962 INFO:tasks.workunit.client.1.smithi139.stdout:7/240: mkdir d5/d10/d2b/d40/d47 0 2024-09-17T07:19:51.964 INFO:tasks.workunit.client.0.smithi087.stdout:4/360: write d2/d5/d1f/f20 [1205499,125523] 0 2024-09-17T07:19:51.964 INFO:tasks.workunit.client.1.smithi139.stdout:7/241: mknod d5/d10/d2b/c48 0 2024-09-17T07:19:51.965 INFO:tasks.workunit.client.1.smithi139.stdout:6/439: write db/f16 [703255,53275] 0 2024-09-17T07:19:51.965 INFO:tasks.workunit.client.0.smithi087.stdout:8/380: dread d1/d2b/f29 [0,4194304] 0 2024-09-17T07:19:51.966 INFO:tasks.workunit.client.0.smithi087.stdout:4/361: readlink d2/d22/d2c/d3f/d4d/d21/d2f/l7f 0 2024-09-17T07:19:51.966 INFO:tasks.workunit.client.1.smithi139.stdout:7/242: write d5/d17/f32 [1040698,122679] 0 2024-09-17T07:19:51.969 INFO:tasks.workunit.client.0.smithi087.stdout:4/362: unlink d2/d22/d2c/d3f/d74/l85 0 2024-09-17T07:19:51.969 INFO:tasks.workunit.client.1.smithi139.stdout:7/243: creat d5/d17/f49 x:0 0 0 2024-09-17T07:19:51.970 INFO:tasks.workunit.client.0.smithi087.stdout:8/381: rename d1/d7/d9/d19/d1b/f8a to d1/d7/d9/d19/d73/f8c 0 2024-09-17T07:19:51.973 INFO:tasks.workunit.client.0.smithi087.stdout:4/363: link d2/d5/l13 d2/d22/d2c/d3f/d4d/d21/l87 0 2024-09-17T07:19:51.973 INFO:tasks.workunit.client.1.smithi139.stdout:7/244: rename d5/d10/f2c to d5/d10/d2b/d40/f4a 0 2024-09-17T07:19:51.974 INFO:tasks.workunit.client.0.smithi087.stdout:8/382: dread d1/d2b/d3b/f62 [0,4194304] 0 2024-09-17T07:19:51.975 INFO:tasks.workunit.client.0.smithi087.stdout:8/383: write d1/d2b/f46 [73493,84438] 0 2024-09-17T07:19:51.976 INFO:tasks.workunit.client.1.smithi139.stdout:6/440: write db/df/d4e/d64/f4d [980568,56592] 0 2024-09-17T07:19:51.977 INFO:tasks.workunit.client.0.smithi087.stdout:8/384: fsync d1/d7/d9/d19/f4b 0 2024-09-17T07:19:51.978 INFO:tasks.workunit.client.1.smithi139.stdout:6/441: write db/df/d4e/d64/d54/f2b [480614,79828] 0 2024-09-17T07:19:51.980 INFO:tasks.workunit.client.0.smithi087.stdout:4/364: dwrite d2/d22/d2c/f28 [0,4194304] 0 2024-09-17T07:19:51.980 INFO:tasks.workunit.client.1.smithi139.stdout:6/442: symlink db/d18/l90 0 2024-09-17T07:19:51.981 INFO:tasks.workunit.client.1.smithi139.stdout:7/245: write d5/f18 [1554094,20107] 0 2024-09-17T07:19:51.981 INFO:tasks.workunit.client.1.smithi139.stdout:7/246: chown d5/d17/f20 261810489 1 2024-09-17T07:19:51.982 INFO:tasks.workunit.client.0.smithi087.stdout:8/385: mknod d1/d5f/d71/c8d 0 2024-09-17T07:19:51.983 INFO:tasks.workunit.client.1.smithi139.stdout:6/443: mknod db/d18/c91 0 2024-09-17T07:19:51.984 INFO:tasks.workunit.client.0.smithi087.stdout:8/386: symlink d1/d7/d9/d19/d73/l8e 0 2024-09-17T07:19:51.987 INFO:tasks.workunit.client.1.smithi139.stdout:6/444: rename db/d18/f45 to db/d18/d38/f92 0 2024-09-17T07:19:51.988 INFO:tasks.workunit.client.0.smithi087.stdout:8/387: getdents d1/d2b/d21 0 2024-09-17T07:19:51.989 INFO:tasks.workunit.client.1.smithi139.stdout:7/247: dwrite d5/d10/d2b/f3c [0,4194304] 0 2024-09-17T07:19:51.993 INFO:tasks.workunit.client.1.smithi139.stdout:7/248: rmdir d5/d17 39 2024-09-17T07:19:51.994 INFO:tasks.workunit.client.0.smithi087.stdout:8/388: dwrite d1/d2b/d3b/d53/f5b [0,4194304] 0 2024-09-17T07:19:51.996 INFO:tasks.workunit.client.1.smithi139.stdout:7/249: write d5/d17/f2a [1926650,99518] 0 2024-09-17T07:19:51.997 INFO:tasks.workunit.client.0.smithi087.stdout:8/389: creat d1/d7/d9/d27/f8f x:0 0 0 2024-09-17T07:19:51.997 INFO:tasks.workunit.client.1.smithi139.stdout:7/250: fdatasync d5/f1e 0 2024-09-17T07:19:51.998 INFO:tasks.workunit.client.1.smithi139.stdout:7/251: write d5/f1e [1978440,92004] 0 2024-09-17T07:19:51.999 INFO:tasks.workunit.client.0.smithi087.stdout:8/390: truncate d1/d7/d9/f61 1394827 0 2024-09-17T07:19:52.000 INFO:tasks.workunit.client.0.smithi087.stdout:8/391: chown d1/d2b/d21/d6d 1 1 2024-09-17T07:19:52.002 INFO:tasks.workunit.client.0.smithi087.stdout:8/392: write d1/d7/d9/d19/d73/f8c [960213,29900] 0 2024-09-17T07:19:52.003 INFO:tasks.workunit.client.1.smithi139.stdout:7/252: rename d5/l3b to d5/d17/l4b 0 2024-09-17T07:19:52.003 INFO:tasks.workunit.client.1.smithi139.stdout:6/445: write db/d21/f31 [915591,78303] 0 2024-09-17T07:19:52.005 INFO:tasks.workunit.client.1.smithi139.stdout:7/253: read d5/d10/f2e [22933,48538] 0 2024-09-17T07:19:52.006 INFO:tasks.workunit.client.0.smithi087.stdout:8/393: readlink d1/d7/d9/d27/l3f 0 2024-09-17T07:19:52.006 INFO:tasks.workunit.client.1.smithi139.stdout:7/254: write d5/d17/f2a [532962,17546] 0 2024-09-17T07:19:52.007 INFO:tasks.workunit.client.1.smithi139.stdout:6/446: symlink db/df/d4e/d64/l93 0 2024-09-17T07:19:52.010 INFO:tasks.workunit.client.0.smithi087.stdout:8/394: dread d1/d7/d9/d19/d1b/f43 [0,4194304] 0 2024-09-17T07:19:52.010 INFO:tasks.workunit.client.0.smithi087.stdout:8/395: chown d1/d7/d63 117 1 2024-09-17T07:19:52.015 INFO:tasks.workunit.client.0.smithi087.stdout:8/396: dwrite d1/d7/f2d [0,4194304] 0 2024-09-17T07:19:52.025 INFO:tasks.workunit.client.0.smithi087.stdout:8/397: dwrite d1/d7/d9/d19/f4b [0,4194304] 0 2024-09-17T07:19:52.027 INFO:tasks.workunit.client.0.smithi087.stdout:8/398: creat d1/d2b/d21/d6d/d6f/f90 x:0 0 0 2024-09-17T07:19:52.045 INFO:tasks.workunit.client.1.smithi139.stdout:6/447: rmdir db/df/d4e/d64 39 2024-09-17T07:19:52.048 INFO:tasks.workunit.client.1.smithi139.stdout:6/448: creat db/d18/d38/d60/f94 x:0 0 0 2024-09-17T07:19:52.052 INFO:tasks.workunit.client.1.smithi139.stdout:7/255: dread d5/d10/f28 [0,4194304] 0 2024-09-17T07:19:52.053 INFO:tasks.workunit.client.1.smithi139.stdout:7/256: symlink d5/d10/d2b/l4c 0 2024-09-17T07:19:52.055 INFO:tasks.workunit.client.1.smithi139.stdout:7/257: mkdir d5/d10/d4d 0 2024-09-17T07:19:52.056 INFO:tasks.workunit.client.1.smithi139.stdout:7/258: chown d5/f1e 34 1 2024-09-17T07:19:52.057 INFO:tasks.workunit.client.1.smithi139.stdout:7/259: read d5/d10/f2e [455493,32963] 0 2024-09-17T07:19:52.059 INFO:tasks.workunit.client.1.smithi139.stdout:7/260: mkdir d5/d17/d4e 0 2024-09-17T07:19:52.061 INFO:tasks.workunit.client.1.smithi139.stdout:7/261: symlink d5/d10/d2b/d40/l4f 0 2024-09-17T07:19:52.063 INFO:tasks.workunit.client.1.smithi139.stdout:7/262: unlink d5/l16 0 2024-09-17T07:19:52.063 INFO:tasks.workunit.client.1.smithi139.stdout:6/449: rmdir db/d18 39 2024-09-17T07:19:52.064 INFO:tasks.workunit.client.1.smithi139.stdout:7/263: fsync d5/d10/f42 0 2024-09-17T07:19:52.068 INFO:tasks.workunit.client.0.smithi087.stdout:8/399: dread d1/d7/d9/d19/d1b/f1c [0,4194304] 0 2024-09-17T07:19:52.068 INFO:tasks.workunit.client.0.smithi087.stdout:8/400: write d1/d7/d9/f85 [419409,118863] 0 2024-09-17T07:19:52.071 INFO:tasks.workunit.client.1.smithi139.stdout:6/450: write db/df/f13 [691081,20534] 0 2024-09-17T07:19:52.072 INFO:tasks.workunit.client.1.smithi139.stdout:7/264: dwrite d5/d10/d2b/f44 [0,4194304] 0 2024-09-17T07:19:52.074 INFO:tasks.workunit.client.0.smithi087.stdout:8/401: dwrite d1/d7/d9/fc [4194304,4194304] 0 2024-09-17T07:19:52.075 INFO:tasks.workunit.client.0.smithi087.stdout:8/402: fdatasync d1/d2b/f6c 0 2024-09-17T07:19:52.079 INFO:tasks.workunit.client.1.smithi139.stdout:6/451: link db/df/d73/d81/f3c db/df/d73/f95 0 2024-09-17T07:19:52.079 INFO:tasks.workunit.client.0.smithi087.stdout:8/403: rename d1/d2b/d3b/d53/f5b to d1/d2b/d21/d6d/d6f/d7f/d54/f91 0 2024-09-17T07:19:52.080 INFO:tasks.workunit.client.0.smithi087.stdout:8/404: fsync d1/d2b/f46 0 2024-09-17T07:19:52.082 INFO:tasks.workunit.client.0.smithi087.stdout:8/405: unlink d1/c4f 0 2024-09-17T07:19:52.084 INFO:tasks.workunit.client.0.smithi087.stdout:8/406: write d1/d2b/d21/d6d/d6f/d7f/d54/f6a [1520459,11201] 0 2024-09-17T07:19:52.084 INFO:tasks.workunit.client.1.smithi139.stdout:6/452: dread db/d18/f6c [0,4194304] 0 2024-09-17T07:19:52.088 INFO:tasks.workunit.client.0.smithi087.stdout:8/407: link d1/d2b/d3b/d53/l80 d1/d5f/d71/l92 0 2024-09-17T07:19:52.093 INFO:tasks.workunit.client.1.smithi139.stdout:6/453: truncate db/df/d4e/d64/d54/f2f 2153940 0 2024-09-17T07:19:52.093 INFO:tasks.workunit.client.1.smithi139.stdout:6/454: mkdir db/d21/d96 0 2024-09-17T07:19:52.093 INFO:tasks.workunit.client.1.smithi139.stdout:6/455: truncate db/d18/d38/d60/f94 402050 0 2024-09-17T07:19:52.094 INFO:tasks.workunit.client.0.smithi087.stdout:8/408: dwrite d1/d2b/f46 [0,4194304] 0 2024-09-17T07:19:52.094 INFO:tasks.workunit.client.1.smithi139.stdout:6/456: creat db/df/d73/f97 x:0 0 0 2024-09-17T07:19:52.095 INFO:tasks.workunit.client.0.smithi087.stdout:8/409: write d1/d7/d9/d27/f7c [628444,121637] 0 2024-09-17T07:19:52.096 INFO:tasks.workunit.client.1.smithi139.stdout:6/457: write db/d18/d5b/f61 [473625,80105] 0 2024-09-17T07:19:52.096 INFO:tasks.workunit.client.0.smithi087.stdout:8/410: read d1/d2b/f32 [460859,54357] 0 2024-09-17T07:19:52.099 INFO:tasks.workunit.client.1.smithi139.stdout:6/458: mkdir db/df/d4e/d64/d56/d98 0 2024-09-17T07:19:52.100 INFO:tasks.workunit.client.0.smithi087.stdout:8/411: dread d1/d2b/d21/d6d/d6f/d7f/d54/f6a [0,4194304] 0 2024-09-17T07:19:52.102 INFO:tasks.workunit.client.1.smithi139.stdout:6/459: symlink db/df/d4c/l99 0 2024-09-17T07:19:52.103 INFO:tasks.workunit.client.0.smithi087.stdout:8/412: rename d1/d7/d9/f61 to d1/d2b/d21/d6d/d6f/f93 0 2024-09-17T07:19:52.104 INFO:tasks.workunit.client.1.smithi139.stdout:6/460: chown db/d18/d5b/f8b 0 1 2024-09-17T07:19:52.105 INFO:tasks.workunit.client.1.smithi139.stdout:7/265: dread d5/d17/f32 [0,4194304] 0 2024-09-17T07:19:52.106 INFO:tasks.workunit.client.0.smithi087.stdout:8/413: read d1/d7/d9/d19/f4e [1654145,93798] 0 2024-09-17T07:19:52.108 INFO:tasks.workunit.client.1.smithi139.stdout:6/461: link db/df/c15 db/df/d4e/d64/c9a 0 2024-09-17T07:19:52.108 INFO:tasks.workunit.client.1.smithi139.stdout:6/462: readlink db/df/d4e/d64/d54/l5c 0 2024-09-17T07:19:52.109 INFO:tasks.workunit.client.1.smithi139.stdout:6/463: fsync db/df/d73/f8d 0 2024-09-17T07:19:52.111 INFO:tasks.workunit.client.1.smithi139.stdout:6/464: symlink db/df/d73/d81/l9b 0 2024-09-17T07:19:52.111 INFO:tasks.workunit.client.0.smithi087.stdout:8/414: chown d1/d2b/d21/l81 7297 1 2024-09-17T07:19:52.111 INFO:tasks.workunit.client.0.smithi087.stdout:8/415: readlink d1/d7/le 0 2024-09-17T07:19:52.112 INFO:tasks.workunit.client.1.smithi139.stdout:6/465: dread - db/df/d4e/d64/d56/f66 zero size 2024-09-17T07:19:52.112 INFO:tasks.workunit.client.0.smithi087.stdout:8/416: write d1/d2b/d21/d6d/d6f/d7f/f7b [131166,120925] 0 2024-09-17T07:19:52.112 INFO:tasks.workunit.client.0.smithi087.stdout:9/291: sync 2024-09-17T07:19:52.113 INFO:tasks.workunit.client.0.smithi087.stdout:1/315: sync 2024-09-17T07:19:52.114 INFO:tasks.workunit.client.1.smithi139.stdout:6/466: rmdir db/df/d4e/d64/d80 39 2024-09-17T07:19:52.116 INFO:tasks.workunit.client.0.smithi087.stdout:1/316: stat d2/d3d/d35/d4f 0 2024-09-17T07:19:52.117 INFO:tasks.workunit.client.0.smithi087.stdout:9/292: rmdir d3/d4/da/d4b 39 2024-09-17T07:19:52.118 INFO:tasks.workunit.client.0.smithi087.stdout:8/417: mknod d1/d7/d9/d19/c94 0 2024-09-17T07:19:52.119 INFO:tasks.workunit.client.1.smithi139.stdout:7/266: dread d5/d10/d2b/d40/f4a [0,4194304] 0 2024-09-17T07:19:52.122 INFO:tasks.workunit.client.1.smithi139.stdout:7/267: symlink d5/d17/d4e/l50 0 2024-09-17T07:19:52.125 INFO:tasks.workunit.client.1.smithi139.stdout:7/268: mknod d5/d10/d2b/d40/d47/c51 0 2024-09-17T07:19:52.125 INFO:tasks.workunit.client.1.smithi139.stdout:6/467: truncate db/df/d4e/d64/d54/f3a 634626 0 2024-09-17T07:19:52.125 INFO:tasks.workunit.client.1.smithi139.stdout:7/269: write d5/f18 [575593,113264] 0 2024-09-17T07:19:52.127 INFO:tasks.workunit.client.1.smithi139.stdout:6/468: chown db/df/d4e/d64/f52 27 1 2024-09-17T07:19:52.128 INFO:tasks.workunit.client.1.smithi139.stdout:6/469: write db/d18/d1b/f5a [26825,119957] 0 2024-09-17T07:19:52.135 INFO:tasks.workunit.client.1.smithi139.stdout:6/470: dwrite db/d18/d38/d60/f94 [0,4194304] 0 2024-09-17T07:19:52.136 INFO:tasks.workunit.client.1.smithi139.stdout:1/170: sync 2024-09-17T07:19:52.136 INFO:tasks.workunit.client.1.smithi139.stdout:3/225: sync 2024-09-17T07:19:52.137 INFO:tasks.workunit.client.1.smithi139.stdout:0/222: sync 2024-09-17T07:19:52.137 INFO:tasks.workunit.client.1.smithi139.stdout:9/563: sync 2024-09-17T07:19:52.137 INFO:tasks.workunit.client.1.smithi139.stdout:4/278: sync 2024-09-17T07:19:52.137 INFO:tasks.workunit.client.1.smithi139.stdout:2/322: sync 2024-09-17T07:19:52.137 INFO:tasks.workunit.client.1.smithi139.stdout:5/180: sync 2024-09-17T07:19:52.141 INFO:tasks.workunit.client.1.smithi139.stdout:0/223: dread - d1/da/d2a/d5c/f5e zero size 2024-09-17T07:19:52.141 INFO:tasks.workunit.client.1.smithi139.stdout:3/226: stat d5/f2b 0 2024-09-17T07:19:52.141 INFO:tasks.workunit.client.1.smithi139.stdout:5/181: rename d4/la to d4/d16/d1b/l34 0 2024-09-17T07:19:52.143 INFO:tasks.workunit.client.1.smithi139.stdout:0/224: chown d1/da/l4e 47193 1 2024-09-17T07:19:52.145 INFO:tasks.workunit.client.1.smithi139.stdout:6/471: dread db/df/d4c/f65 [0,4194304] 0 2024-09-17T07:19:52.145 INFO:tasks.workunit.client.1.smithi139.stdout:7/270: dread f2 [0,4194304] 0 2024-09-17T07:19:52.147 INFO:tasks.workunit.client.1.smithi139.stdout:1/171: rename d2/d10/d12/d13/c19 to d2/d10/d12/d1a/d25/d2b/c33 0 2024-09-17T07:19:52.149 INFO:tasks.workunit.client.1.smithi139.stdout:9/564: creat dc/d11/d15/d3c/d61/d64/fc1 x:0 0 0 2024-09-17T07:19:52.151 INFO:tasks.workunit.client.1.smithi139.stdout:5/182: rename d4/d16/d1b/d20/d28/l12 to d4/d16/d1b/d20/d28/l35 0 2024-09-17T07:19:52.152 INFO:tasks.workunit.client.1.smithi139.stdout:2/323: dread d0/de/d11/d32/f4f [0,4194304] 0 2024-09-17T07:19:52.152 INFO:tasks.workunit.client.1.smithi139.stdout:7/271: mknod d5/d10/d2b/d40/d47/c52 0 2024-09-17T07:19:52.158 INFO:tasks.workunit.client.1.smithi139.stdout:0/225: truncate d1/da/d1b/d32/d21/f30 586162 0 2024-09-17T07:19:52.160 INFO:tasks.workunit.client.1.smithi139.stdout:3/227: dwrite d5/d21/d23/f47 [0,4194304] 0 2024-09-17T07:19:52.160 INFO:tasks.workunit.client.1.smithi139.stdout:2/324: creat d0/d4e/f6c x:0 0 0 2024-09-17T07:19:52.163 INFO:tasks.workunit.client.1.smithi139.stdout:9/565: fdatasync dc/d11/d15/d3c/f95 0 2024-09-17T07:19:52.166 INFO:tasks.workunit.client.1.smithi139.stdout:6/472: dread db/d18/d1b/f37 [0,4194304] 0 2024-09-17T07:19:52.171 INFO:tasks.workunit.client.1.smithi139.stdout:7/272: dwrite d5/d17/f31 [4194304,4194304] 0 2024-09-17T07:19:52.172 INFO:tasks.workunit.client.1.smithi139.stdout:2/325: write d0/de/d25/d3f/f50 [421857,15056] 0 2024-09-17T07:19:52.172 INFO:tasks.workunit.client.1.smithi139.stdout:0/226: creat d1/da/d1b/d3d/d50/f61 x:0 0 0 2024-09-17T07:19:52.174 INFO:tasks.workunit.client.1.smithi139.stdout:9/566: fdatasync dc/d11/d15/d3c/f3f 0 2024-09-17T07:19:52.177 INFO:tasks.workunit.client.1.smithi139.stdout:9/567: fsync dc/d2c/fb1 0 2024-09-17T07:19:52.179 INFO:tasks.workunit.client.1.smithi139.stdout:1/172: dread d2/ff [0,4194304] 0 2024-09-17T07:19:52.180 INFO:tasks.workunit.client.1.smithi139.stdout:3/228: rename d5/d15/d20/d22 to d5/d15/d16/d4c 0 2024-09-17T07:19:52.180 INFO:tasks.workunit.client.1.smithi139.stdout:5/183: dwrite d4/d16/d1b/d20/d28/f26 [0,4194304] 0 2024-09-17T07:19:52.182 INFO:tasks.workunit.client.1.smithi139.stdout:7/273: mknod d5/d10/d2b/c53 0 2024-09-17T07:19:52.182 INFO:tasks.workunit.client.1.smithi139.stdout:0/227: rename d1/da/d2a/f59 to d1/da/d2a/f62 0 2024-09-17T07:19:52.183 INFO:tasks.workunit.client.1.smithi139.stdout:5/184: fsync d4/d16/d1b/f25 0 2024-09-17T07:19:52.183 INFO:tasks.workunit.client.1.smithi139.stdout:9/568: write dc/d11/d15/f28 [1573576,123851] 0 2024-09-17T07:19:52.185 INFO:tasks.workunit.client.1.smithi139.stdout:2/326: symlink d0/de/d11/d12/d45/l6d 0 2024-09-17T07:19:52.185 INFO:tasks.workunit.client.1.smithi139.stdout:0/228: write d1/da/d2a/f38 [1895196,66188] 0 2024-09-17T07:19:52.186 INFO:tasks.workunit.client.1.smithi139.stdout:6/473: rename db/df/d73/d81/f7e to db/df/f9c 0 2024-09-17T07:19:52.187 INFO:tasks.workunit.client.1.smithi139.stdout:2/327: chown d0/dc/d3a/f3c 14 1 2024-09-17T07:19:52.187 INFO:tasks.workunit.client.1.smithi139.stdout:1/173: creat d2/d10/d12/d1a/d25/d2b/f34 x:0 0 0 2024-09-17T07:19:52.187 INFO:tasks.workunit.client.1.smithi139.stdout:3/229: mknod d5/d21/d23/c4d 0 2024-09-17T07:19:52.189 INFO:tasks.workunit.client.1.smithi139.stdout:3/230: readlink d5/d15/d16/d4c/d28/l45 0 2024-09-17T07:19:52.191 INFO:tasks.workunit.client.1.smithi139.stdout:5/185: creat d4/f36 x:0 0 0 2024-09-17T07:19:52.192 INFO:tasks.workunit.client.1.smithi139.stdout:6/474: mkdir db/df/d4e/d64/d83/d9d 0 2024-09-17T07:19:52.193 INFO:tasks.workunit.client.1.smithi139.stdout:7/274: mknod d5/c54 0 2024-09-17T07:19:52.194 INFO:tasks.workunit.client.1.smithi139.stdout:2/328: symlink d0/d4e/l6e 0 2024-09-17T07:19:52.196 INFO:tasks.workunit.client.1.smithi139.stdout:2/329: write d0/dc/d3a/f3d [344570,36152] 0 2024-09-17T07:19:52.199 INFO:tasks.workunit.client.1.smithi139.stdout:3/231: creat d5/d21/f4e x:0 0 0 2024-09-17T07:19:52.199 INFO:tasks.workunit.client.1.smithi139.stdout:0/229: mknod d1/d58/c63 0 2024-09-17T07:19:52.199 INFO:tasks.workunit.client.1.smithi139.stdout:3/232: dread - d5/d15/d16/d4c/f46 zero size 2024-09-17T07:19:52.199 INFO:tasks.workunit.client.1.smithi139.stdout:9/569: symlink dc/d11/d15/d3c/lc2 0 2024-09-17T07:19:52.201 INFO:tasks.workunit.client.1.smithi139.stdout:5/186: mknod d4/d16/d1b/c37 0 2024-09-17T07:19:52.201 INFO:tasks.workunit.client.1.smithi139.stdout:9/570: read dc/d11/d15/d3c/d68/f90 [579622,17942] 0 2024-09-17T07:19:52.202 INFO:tasks.workunit.client.1.smithi139.stdout:6/475: mknod db/df/d4e/d5e/c9e 0 2024-09-17T07:19:52.204 INFO:tasks.workunit.client.1.smithi139.stdout:7/275: mkdir d5/d17/d4e/d55 0 2024-09-17T07:19:52.204 INFO:tasks.workunit.client.1.smithi139.stdout:6/476: chown db/df/d73/f97 226859 1 2024-09-17T07:19:52.205 INFO:tasks.workunit.client.1.smithi139.stdout:3/233: dread d5/d15/d20/d3b/f4a [0,4194304] 0 2024-09-17T07:19:52.206 INFO:tasks.workunit.client.1.smithi139.stdout:6/477: readlink db/df/d4e/d64/d54/l51 0 2024-09-17T07:19:52.207 INFO:tasks.workunit.client.1.smithi139.stdout:6/478: chown db/df/d73/f95 6 1 2024-09-17T07:19:52.208 INFO:tasks.workunit.client.1.smithi139.stdout:0/230: rename d1/da/d1b/d32/d21/f2b to d1/da/d1b/d3d/f64 0 2024-09-17T07:19:52.209 INFO:tasks.workunit.client.1.smithi139.stdout:6/479: dread - db/df/d73/f7a zero size 2024-09-17T07:19:52.211 INFO:tasks.workunit.client.1.smithi139.stdout:9/571: fsync dc/f3e 0 2024-09-17T07:19:52.212 INFO:tasks.workunit.client.1.smithi139.stdout:6/480: chown db/df/d4e/d5e/c8f 21413896 1 2024-09-17T07:19:52.212 INFO:tasks.workunit.client.1.smithi139.stdout:3/234: dread d5/d21/d23/d38/f40 [0,4194304] 0 2024-09-17T07:19:52.213 INFO:tasks.workunit.client.1.smithi139.stdout:7/276: write d5/d17/f32 [4656644,111940] 0 2024-09-17T07:19:52.213 INFO:tasks.workunit.client.1.smithi139.stdout:2/330: mknod d0/de/df/d56/c6f 0 2024-09-17T07:19:52.213 INFO:tasks.workunit.client.1.smithi139.stdout:9/572: readlink dc/d2a/l51 0 2024-09-17T07:19:52.214 INFO:tasks.workunit.client.1.smithi139.stdout:7/277: chown d5 5209 1 2024-09-17T07:19:52.214 INFO:tasks.workunit.client.1.smithi139.stdout:6/481: fdatasync db/d18/f35 0 2024-09-17T07:19:52.215 INFO:tasks.workunit.client.1.smithi139.stdout:9/573: dread - dc/f20 zero size 2024-09-17T07:19:52.216 INFO:tasks.workunit.client.1.smithi139.stdout:5/187: rename d4/d33 to d4/d16/d1b/d20/d38 0 2024-09-17T07:19:52.217 INFO:tasks.workunit.client.1.smithi139.stdout:1/174: dread d2/d10/d12/f31 [0,4194304] 0 2024-09-17T07:19:52.217 INFO:tasks.workunit.client.1.smithi139.stdout:3/235: truncate d5/d21/d23/f49 686560 0 2024-09-17T07:19:52.218 INFO:tasks.workunit.client.1.smithi139.stdout:9/574: write dc/d11/d15/d3c/f95 [617525,127444] 0 2024-09-17T07:19:52.218 INFO:tasks.workunit.client.1.smithi139.stdout:6/482: dread db/df/f84 [0,4194304] 0 2024-09-17T07:19:52.219 INFO:tasks.workunit.client.1.smithi139.stdout:0/231: mkdir d1/da/d17/d65 0 2024-09-17T07:19:52.219 INFO:tasks.workunit.client.1.smithi139.stdout:5/188: write d4/f6 [126420,100299] 0 2024-09-17T07:19:52.222 INFO:tasks.workunit.client.1.smithi139.stdout:0/232: write d1/da/fc [4410006,83371] 0 2024-09-17T07:19:52.222 INFO:tasks.workunit.client.1.smithi139.stdout:7/278: write f2 [4861535,52965] 0 2024-09-17T07:19:52.222 INFO:tasks.workunit.client.1.smithi139.stdout:2/331: symlink d0/dc/d3a/l70 0 2024-09-17T07:19:52.224 INFO:tasks.workunit.client.1.smithi139.stdout:7/279: fdatasync d5/d10/d2b/f3f 0 2024-09-17T07:19:52.225 INFO:tasks.workunit.client.1.smithi139.stdout:2/332: write d0/d3b/f5b [942302,69984] 0 2024-09-17T07:19:52.274 INFO:tasks.workunit.client.0.smithi087.stdout:8/418: rmdir d1 39 2024-09-17T07:19:52.275 INFO:tasks.workunit.client.0.smithi087.stdout:1/317: creat d2/d48/d61/f76 x:0 0 0 2024-09-17T07:19:52.277 INFO:tasks.workunit.client.0.smithi087.stdout:9/293: write d3/f1f [553337,113283] 0 2024-09-17T07:19:52.278 INFO:tasks.workunit.client.0.smithi087.stdout:8/419: mknod d1/d2b/d3b/c95 0 2024-09-17T07:19:52.281 INFO:tasks.workunit.client.0.smithi087.stdout:1/318: write d2/d1a/f34 [701734,15814] 0 2024-09-17T07:19:52.282 INFO:tasks.workunit.client.0.smithi087.stdout:8/420: write d1/d2b/d21/d6d/d6f/d7f/d54/f86 [2353976,65403] 0 2024-09-17T07:19:52.283 INFO:tasks.workunit.client.0.smithi087.stdout:9/294: getdents d3/d4/d6/d8/d22/d43 0 2024-09-17T07:19:52.285 INFO:tasks.workunit.client.0.smithi087.stdout:9/295: fsync d3/d4/d6/d8/d22/d43/f45 0 2024-09-17T07:19:52.285 INFO:tasks.workunit.client.0.smithi087.stdout:8/421: mknod d1/d2b/d3b/d53/c96 0 2024-09-17T07:19:52.286 INFO:tasks.workunit.client.0.smithi087.stdout:8/422: fsync d1/d7/d9/d27/f7a 0 2024-09-17T07:19:52.287 INFO:tasks.workunit.client.0.smithi087.stdout:1/319: dread d2/d14/dd/d37/f52 [0,4194304] 0 2024-09-17T07:19:52.287 INFO:tasks.workunit.client.0.smithi087.stdout:8/423: chown d1/d2b/d21/d6d/d6f 15847 1 2024-09-17T07:19:52.288 INFO:tasks.workunit.client.0.smithi087.stdout:9/296: symlink d3/d4/d6/d8/d22/d64/l65 0 2024-09-17T07:19:52.289 INFO:tasks.workunit.client.0.smithi087.stdout:8/424: creat d1/d7/d9/d19/d73/f97 x:0 0 0 2024-09-17T07:19:52.290 INFO:tasks.workunit.client.0.smithi087.stdout:9/297: mknod d3/d4/d2f/c66 0 2024-09-17T07:19:52.290 INFO:tasks.workunit.client.0.smithi087.stdout:9/298: dread - d3/d4/da/f55 zero size 2024-09-17T07:19:52.292 INFO:tasks.workunit.client.0.smithi087.stdout:9/299: write d3/d4/d6/f13 [1939016,83916] 0 2024-09-17T07:19:52.297 INFO:tasks.workunit.client.0.smithi087.stdout:9/300: write d3/fc [1517955,125030] 0 2024-09-17T07:19:52.297 INFO:tasks.workunit.client.0.smithi087.stdout:1/320: truncate d2/d3d/f28 2312912 0 2024-09-17T07:19:52.297 INFO:tasks.workunit.client.0.smithi087.stdout:9/301: symlink d3/d4/d2f/l67 0 2024-09-17T07:19:52.299 INFO:tasks.workunit.client.0.smithi087.stdout:8/425: dwrite d1/d2b/d21/d6d/d6f/d7f/f44 [0,4194304] 0 2024-09-17T07:19:52.299 INFO:tasks.workunit.client.0.smithi087.stdout:1/321: fsync d2/da/f67 0 2024-09-17T07:19:52.301 INFO:tasks.workunit.client.0.smithi087.stdout:1/322: write d2/d14/dd/d37/f54 [272090,70785] 0 2024-09-17T07:19:52.306 INFO:tasks.workunit.client.0.smithi087.stdout:1/323: creat d2/d3d/d35/d57/d73/f77 x:0 0 0 2024-09-17T07:19:52.307 INFO:tasks.workunit.client.0.smithi087.stdout:9/302: link d3/d4/d2f/f3c d3/d4/d6/f68 0 2024-09-17T07:19:52.307 INFO:tasks.workunit.client.0.smithi087.stdout:8/426: getdents d1/d7/d9/d19/d1b/d18 0 2024-09-17T07:19:52.308 INFO:tasks.workunit.client.1.smithi139.stdout:1/175: rename d2/d10/d12/d1a/d25 to d2/d10/d12/d35 0 2024-09-17T07:19:52.308 INFO:tasks.workunit.client.1.smithi139.stdout:8/338: sync 2024-09-17T07:19:52.308 INFO:tasks.workunit.client.1.smithi139.stdout:2/333: stat d0/de/d11/d28/f2d 0 2024-09-17T07:19:52.309 INFO:tasks.workunit.client.1.smithi139.stdout:0/233: mkdir d1/da/d1b/d32/d21/d66 0 2024-09-17T07:19:52.309 INFO:tasks.workunit.client.1.smithi139.stdout:9/575: symlink dc/d11/lc3 0 2024-09-17T07:19:52.310 INFO:tasks.workunit.client.0.smithi087.stdout:9/303: mkdir d3/d4/d16/d69 0 2024-09-17T07:19:52.310 INFO:tasks.workunit.client.0.smithi087.stdout:9/304: readlink d3/d4/d6/d8/l42 0 2024-09-17T07:19:52.311 INFO:tasks.workunit.client.1.smithi139.stdout:8/339: truncate d0/dc/f34 296148 0 2024-09-17T07:19:52.313 INFO:tasks.workunit.client.0.smithi087.stdout:1/324: link d2/d69/f70 d2/d14/dd/f78 0 2024-09-17T07:19:52.313 INFO:tasks.workunit.client.0.smithi087.stdout:9/305: symlink d3/d4/d6/d8/l6a 0 2024-09-17T07:19:52.314 INFO:tasks.workunit.client.0.smithi087.stdout:1/325: chown d2/d3d/d35/d57/d73 178 1 2024-09-17T07:19:52.314 INFO:tasks.workunit.client.0.smithi087.stdout:1/326: write d2/d48/f5e [1550591,36791] 0 2024-09-17T07:19:52.316 INFO:tasks.workunit.client.0.smithi087.stdout:9/306: unlink d3/d4/d16/f1b 0 2024-09-17T07:19:52.317 INFO:tasks.workunit.client.1.smithi139.stdout:3/236: link d5/lb d5/d15/d16/d4c/l4f 0 2024-09-17T07:19:52.318 INFO:tasks.workunit.client.1.smithi139.stdout:3/237: chown d5/d21 235 1 2024-09-17T07:19:52.319 INFO:tasks.workunit.client.0.smithi087.stdout:9/307: getdents d3/d25 0 2024-09-17T07:19:52.319 INFO:tasks.workunit.client.1.smithi139.stdout:9/576: unlink dc/d11/d15/d3c/d61/d64/f70 0 2024-09-17T07:19:52.319 INFO:tasks.workunit.client.1.smithi139.stdout:3/238: read - d5/d21/f48 zero size 2024-09-17T07:19:52.320 INFO:tasks.workunit.client.1.smithi139.stdout:0/234: symlink d1/da/d1b/d32/d21/d66/l67 0 2024-09-17T07:19:52.321 INFO:tasks.workunit.client.1.smithi139.stdout:3/239: stat d5/f3c 0 2024-09-17T07:19:52.321 INFO:tasks.workunit.client.0.smithi087.stdout:9/308: creat d3/d4/d16/d69/f6b x:0 0 0 2024-09-17T07:19:52.321 INFO:tasks.workunit.client.1.smithi139.stdout:5/189: dwrite d4/d16/f18 [0,4194304] 0 2024-09-17T07:19:52.322 INFO:tasks.workunit.client.1.smithi139.stdout:9/577: chown dc/d11/d15/d3c/d61/d64/d96/f9e 13 1 2024-09-17T07:19:52.324 INFO:tasks.workunit.client.0.smithi087.stdout:9/309: mkdir d3/d4/d6/d8/d12/d32/d6c 0 2024-09-17T07:19:52.324 INFO:tasks.workunit.client.1.smithi139.stdout:9/578: write dc/d2a/f49 [1512753,85494] 0 2024-09-17T07:19:52.325 INFO:tasks.workunit.client.0.smithi087.stdout:1/327: dread d2/d14/dd/f20 [0,4194304] 0 2024-09-17T07:19:52.325 INFO:tasks.workunit.client.1.smithi139.stdout:2/334: link d0/de/d11/d32/f4f d0/de/df/d56/f71 0 2024-09-17T07:19:52.326 INFO:tasks.workunit.client.0.smithi087.stdout:8/427: dread d1/d7/f13 [0,4194304] 0 2024-09-17T07:19:52.326 INFO:tasks.workunit.client.1.smithi139.stdout:7/280: truncate d5/d17/f31 2436191 0 2024-09-17T07:19:52.326 INFO:tasks.workunit.client.0.smithi087.stdout:8/428: fsync d1/d7/f22 0 2024-09-17T07:19:52.327 INFO:tasks.workunit.client.1.smithi139.stdout:0/235: mknod d1/da/d1b/c68 0 2024-09-17T07:19:52.327 INFO:tasks.workunit.client.0.smithi087.stdout:8/429: stat d1/d7/d9/d19/d1b 0 2024-09-17T07:19:52.328 INFO:tasks.workunit.client.0.smithi087.stdout:1/328: rmdir d2/d48/d61 39 2024-09-17T07:19:52.329 INFO:tasks.workunit.client.1.smithi139.stdout:3/240: creat d5/d15/d16/d4c/d28/f50 x:0 0 0 2024-09-17T07:19:52.330 INFO:tasks.workunit.client.0.smithi087.stdout:8/430: truncate d1/d7/d9/d27/f7c 1180750 0 2024-09-17T07:19:52.330 INFO:tasks.workunit.client.0.smithi087.stdout:1/329: truncate d2/d14/f60 792055 0 2024-09-17T07:19:52.330 INFO:tasks.workunit.client.1.smithi139.stdout:0/236: rename d1 to d1/da/d1b/d32/d21/d69 22 2024-09-17T07:19:52.330 INFO:tasks.workunit.client.1.smithi139.stdout:5/190: rename d4/d16/d1b/f25 to d4/d16/d1b/f39 0 2024-09-17T07:19:52.331 INFO:tasks.workunit.client.0.smithi087.stdout:8/431: read d1/d5f/f5d [1168267,110589] 0 2024-09-17T07:19:52.331 INFO:tasks.workunit.client.1.smithi139.stdout:1/176: dwrite d2/fd [0,4194304] 0 2024-09-17T07:19:52.332 INFO:tasks.workunit.client.0.smithi087.stdout:1/330: symlink d2/d3d/d35/d4f/l79 0 2024-09-17T07:19:52.333 INFO:tasks.workunit.client.0.smithi087.stdout:8/432: creat d1/d2b/d21/d6d/d6f/d7f/d54/f98 x:0 0 0 2024-09-17T07:19:52.334 INFO:tasks.workunit.client.1.smithi139.stdout:3/241: dread d5/d21/d23/d38/f40 [0,4194304] 0 2024-09-17T07:19:52.334 INFO:tasks.workunit.client.1.smithi139.stdout:9/579: creat dc/d11/d15/d3c/d68/fc4 x:0 0 0 2024-09-17T07:19:52.334 INFO:tasks.workunit.client.1.smithi139.stdout:3/242: stat d5 0 2024-09-17T07:19:52.335 INFO:tasks.workunit.client.1.smithi139.stdout:2/335: creat d0/de/d11/d32/f72 x:0 0 0 2024-09-17T07:19:52.337 INFO:tasks.workunit.client.1.smithi139.stdout:5/191: mknod d4/d16/d1b/d20/d38/c3a 0 2024-09-17T07:19:52.337 INFO:tasks.workunit.client.1.smithi139.stdout:7/281: write d5/d10/d2b/d40/f4a [2802898,110739] 0 2024-09-17T07:19:52.337 INFO:tasks.workunit.client.1.smithi139.stdout:2/336: dread - d0/d3b/f5d zero size 2024-09-17T07:19:52.338 INFO:tasks.workunit.client.0.smithi087.stdout:8/433: rename d1/d7/c7e to d1/d7/d9/d27/c99 0 2024-09-17T07:19:52.339 INFO:tasks.workunit.client.1.smithi139.stdout:5/192: dread - d4/f36 zero size 2024-09-17T07:19:52.340 INFO:tasks.workunit.client.1.smithi139.stdout:8/340: getdents d0/d20 0 2024-09-17T07:19:52.343 INFO:tasks.workunit.client.1.smithi139.stdout:1/177: read d2/f6 [604298,84165] 0 2024-09-17T07:19:52.347 INFO:tasks.workunit.client.1.smithi139.stdout:2/337: unlink d0/dc/d15/l30 0 2024-09-17T07:19:52.347 INFO:tasks.workunit.client.0.smithi087.stdout:1/331: truncate d2/dc/f23 1661300 0 2024-09-17T07:19:52.347 INFO:tasks.workunit.client.1.smithi139.stdout:7/282: mknod d5/d17/d4e/c56 0 2024-09-17T07:19:52.348 INFO:tasks.workunit.client.0.smithi087.stdout:8/434: truncate d1/d7/d9/d19/d73/f8c 168591 0 2024-09-17T07:19:52.349 INFO:tasks.workunit.client.0.smithi087.stdout:1/332: symlink d2/d14/dd/l7a 0 2024-09-17T07:19:52.350 INFO:tasks.workunit.client.0.smithi087.stdout:8/435: write d1/d2b/d21/d6d/d6f/d7f/d54/f86 [4244554,100896] 0 2024-09-17T07:19:52.351 INFO:tasks.workunit.client.0.smithi087.stdout:8/436: dread - d1/d7/d63/f84 zero size 2024-09-17T07:19:52.352 INFO:tasks.workunit.client.1.smithi139.stdout:7/283: fsync d5/d17/f49 0 2024-09-17T07:19:52.352 INFO:tasks.workunit.client.0.smithi087.stdout:1/333: creat d2/d3d/d35/d57/d6a/f7b x:0 0 0 2024-09-17T07:19:52.353 INFO:tasks.workunit.client.1.smithi139.stdout:5/193: readlink d4/lc 0 2024-09-17T07:19:52.353 INFO:tasks.workunit.client.0.smithi087.stdout:8/437: unlink d1/d7/f22 0 2024-09-17T07:19:52.354 INFO:tasks.workunit.client.1.smithi139.stdout:8/341: truncate d0/d1a/f4a 7136753 0 2024-09-17T07:19:52.354 INFO:tasks.workunit.client.1.smithi139.stdout:7/284: chown d5/d10/d2b/f3c 7546 1 2024-09-17T07:19:52.354 INFO:tasks.workunit.client.1.smithi139.stdout:0/237: link d1/c29 d1/da/d1b/d3d/d5a/c6a 0 2024-09-17T07:19:52.354 INFO:tasks.workunit.client.0.smithi087.stdout:1/334: dread d2/d14/f60 [0,4194304] 0 2024-09-17T07:19:52.354 INFO:tasks.workunit.client.0.smithi087.stdout:8/438: rmdir d1/d7/d9/d19 39 2024-09-17T07:19:52.355 INFO:tasks.workunit.client.1.smithi139.stdout:0/238: read - d1/da/d2a/d5c/f5e zero size 2024-09-17T07:19:52.355 INFO:tasks.workunit.client.1.smithi139.stdout:1/178: rename d2/d10/d12/f20 to d2/d10/d12/d1a/f36 0 2024-09-17T07:19:52.356 INFO:tasks.workunit.client.0.smithi087.stdout:1/335: unlink d2/da/f16 0 2024-09-17T07:19:52.357 INFO:tasks.workunit.client.1.smithi139.stdout:3/243: creat d5/d15/f51 x:0 0 0 2024-09-17T07:19:52.358 INFO:tasks.workunit.client.0.smithi087.stdout:1/336: fdatasync d2/d14/f60 0 2024-09-17T07:19:52.358 INFO:tasks.workunit.client.0.smithi087.stdout:8/439: truncate d1/d7/d9/d19/f4e 4969291 0 2024-09-17T07:19:52.359 INFO:tasks.workunit.client.0.smithi087.stdout:1/337: dread - d2/dc/f3a zero size 2024-09-17T07:19:52.360 INFO:tasks.workunit.client.1.smithi139.stdout:8/342: truncate d0/dc/f58 960741 0 2024-09-17T07:19:52.360 INFO:tasks.workunit.client.1.smithi139.stdout:5/194: dwrite d4/f17 [4194304,4194304] 0 2024-09-17T07:19:52.361 INFO:tasks.workunit.client.1.smithi139.stdout:5/195: chown d4/d16/f18 229112480 1 2024-09-17T07:19:52.361 INFO:tasks.workunit.client.1.smithi139.stdout:8/343: write d0/f7 [2107282,23697] 0 2024-09-17T07:19:52.363 INFO:tasks.workunit.client.0.smithi087.stdout:8/440: creat d1/d2b/f9a x:0 0 0 2024-09-17T07:19:52.363 INFO:tasks.workunit.client.1.smithi139.stdout:9/580: write dc/d2a/f8a [453702,20751] 0 2024-09-17T07:19:52.364 INFO:tasks.workunit.client.1.smithi139.stdout:2/338: rename d0/c24 to d0/d3b/c73 0 2024-09-17T07:19:52.365 INFO:tasks.workunit.client.0.smithi087.stdout:1/338: mknod d2/d14/dd/c7c 0 2024-09-17T07:19:52.365 INFO:tasks.workunit.client.1.smithi139.stdout:7/285: symlink d5/d10/d4d/l57 0 2024-09-17T07:19:52.366 INFO:tasks.workunit.client.1.smithi139.stdout:7/286: truncate d5/f18 3055224 0 2024-09-17T07:19:52.367 INFO:tasks.workunit.client.0.smithi087.stdout:8/441: rename d1/d7/d9/d19/c94 to d1/d7/d9/d19/d73/c9b 0 2024-09-17T07:19:52.369 INFO:tasks.workunit.client.1.smithi139.stdout:5/196: chown d4/f9 1558970 1 2024-09-17T07:19:52.369 INFO:tasks.workunit.client.0.smithi087.stdout:1/339: unlink d2/dc/c19 0 2024-09-17T07:19:52.370 INFO:tasks.workunit.client.0.smithi087.stdout:8/442: fdatasync d1/d5f/f5d 0 2024-09-17T07:19:52.374 INFO:tasks.workunit.client.1.smithi139.stdout:0/239: rename d1/da to d1/da/d6b 22 2024-09-17T07:19:52.376 INFO:tasks.workunit.client.1.smithi139.stdout:2/339: creat d0/de/d69/f74 x:0 0 0 2024-09-17T07:19:52.377 INFO:tasks.workunit.client.1.smithi139.stdout:7/287: fdatasync d5/d10/f2e 0 2024-09-17T07:19:52.377 INFO:tasks.workunit.client.0.smithi087.stdout:1/340: dwrite d2/d3d/d35/f53 [0,4194304] 0 2024-09-17T07:19:52.377 INFO:tasks.workunit.client.0.smithi087.stdout:1/341: stat d2 0 2024-09-17T07:19:52.377 INFO:tasks.workunit.client.0.smithi087.stdout:8/443: dread d1/d2b/d21/f35 [0,4194304] 0 2024-09-17T07:19:52.378 INFO:tasks.workunit.client.0.smithi087.stdout:1/342: chown d2/d14/f60 110 1 2024-09-17T07:19:52.378 INFO:tasks.workunit.client.0.smithi087.stdout:1/343: fdatasync d2/d1a/f29 0 2024-09-17T07:19:52.380 INFO:tasks.workunit.client.1.smithi139.stdout:5/197: creat d4/d16/d1b/d20/d38/f3b x:0 0 0 2024-09-17T07:19:52.380 INFO:tasks.workunit.client.0.smithi087.stdout:8/444: write d1/d2b/f46 [3847462,17938] 0 2024-09-17T07:19:52.381 INFO:tasks.workunit.client.0.smithi087.stdout:8/445: chown d1/d2b/d21/d6d/d6f/d7f/f7b 143198811 1 2024-09-17T07:19:52.382 INFO:tasks.workunit.client.0.smithi087.stdout:1/344: rmdir d2/d3d/d35/d57/d6a 39 2024-09-17T07:19:52.383 INFO:tasks.workunit.client.0.smithi087.stdout:1/345: truncate d2/d14/f5a 11249 0 2024-09-17T07:19:52.384 INFO:tasks.workunit.client.0.smithi087.stdout:8/446: creat d1/d2b/d21/f9c x:0 0 0 2024-09-17T07:19:52.384 INFO:tasks.workunit.client.1.smithi139.stdout:3/244: rename d5/f7 to d5/d15/d16/d4c/d28/f52 0 2024-09-17T07:19:52.385 INFO:tasks.workunit.client.1.smithi139.stdout:0/240: mkdir d1/da/d1b/d32/d21/d66/d6c 0 2024-09-17T07:19:52.387 INFO:tasks.workunit.client.1.smithi139.stdout:2/340: symlink d0/d7/l75 0 2024-09-17T07:19:52.387 INFO:tasks.workunit.client.0.smithi087.stdout:1/346: mknod d2/d48/d6f/c7d 0 2024-09-17T07:19:52.389 INFO:tasks.workunit.client.1.smithi139.stdout:5/198: chown d4/lf 1594 1 2024-09-17T07:19:52.389 INFO:tasks.workunit.client.1.smithi139.stdout:9/581: symlink dc/d11/d52/d56/d7a/lc5 0 2024-09-17T07:19:52.390 INFO:tasks.workunit.client.0.smithi087.stdout:1/347: truncate d2/d14/dd/d37/f54 1981665 0 2024-09-17T07:19:52.390 INFO:tasks.workunit.client.1.smithi139.stdout:1/179: dwrite d2/f7 [0,4194304] 0 2024-09-17T07:19:52.392 INFO:tasks.workunit.client.1.smithi139.stdout:8/344: link d0/dc/l32 d0/d20/d28/d52/l68 0 2024-09-17T07:19:52.392 INFO:tasks.workunit.client.1.smithi139.stdout:3/245: creat d5/d15/d20/d3b/f53 x:0 0 0 2024-09-17T07:19:52.392 INFO:tasks.workunit.client.0.smithi087.stdout:8/447: dwrite d1/d2b/d21/d6d/d6f/d7f/d54/f91 [0,4194304] 0 2024-09-17T07:19:52.393 INFO:tasks.workunit.client.1.smithi139.stdout:9/582: chown dc/d11/d15/d3c/d68/f90 13 1 2024-09-17T07:19:52.393 INFO:tasks.workunit.client.1.smithi139.stdout:3/246: readlink d5/ld 0 2024-09-17T07:19:52.393 INFO:tasks.workunit.client.0.smithi087.stdout:8/448: chown d1/d2b/d21/d6d/d6f/d7f/d54/f86 87630953 1 2024-09-17T07:19:52.393 INFO:tasks.workunit.client.1.smithi139.stdout:0/241: rmdir d1/da/d1b/d32/d21/d66 39 2024-09-17T07:19:52.394 INFO:tasks.workunit.client.1.smithi139.stdout:3/247: readlink d5/l9 0 2024-09-17T07:19:52.397 INFO:tasks.workunit.client.0.smithi087.stdout:1/348: write d2/d1a/f29 [17878,126483] 0 2024-09-17T07:19:52.398 INFO:tasks.workunit.client.0.smithi087.stdout:8/449: dread d1/d7/d9/d19/d1b/f43 [0,4194304] 0 2024-09-17T07:19:52.399 INFO:tasks.workunit.client.0.smithi087.stdout:1/349: mkdir d2/da/d7e 0 2024-09-17T07:19:52.401 INFO:tasks.workunit.client.1.smithi139.stdout:7/288: creat d5/f58 x:0 0 0 2024-09-17T07:19:52.401 INFO:tasks.workunit.client.1.smithi139.stdout:3/248: mkdir d5/d15/d16/d4c/d28/d54 0 2024-09-17T07:19:52.402 INFO:tasks.workunit.client.0.smithi087.stdout:8/450: creat d1/d7/d9/d19/f9d x:0 0 0 2024-09-17T07:19:52.402 INFO:tasks.workunit.client.1.smithi139.stdout:5/199: chown d4/d16/d1b/d20/d28/l2d 114891762 1 2024-09-17T07:19:52.402 INFO:tasks.workunit.client.0.smithi087.stdout:1/350: mknod d2/d3d/d35/d57/d73/c7f 0 2024-09-17T07:19:52.403 INFO:tasks.workunit.client.1.smithi139.stdout:0/242: symlink d1/da/l6d 0 2024-09-17T07:19:52.408 INFO:tasks.workunit.client.1.smithi139.stdout:7/289: read d5/d10/f2e [58241,57321] 0 2024-09-17T07:19:52.408 INFO:tasks.workunit.client.1.smithi139.stdout:8/345: dwrite d0/d1a/d3a/f67 [0,4194304] 0 2024-09-17T07:19:52.409 INFO:tasks.workunit.client.1.smithi139.stdout:7/290: stat d5/f1e 0 2024-09-17T07:19:52.409 INFO:tasks.workunit.client.0.smithi087.stdout:1/351: dwrite d2/d14/f5a [0,4194304] 0 2024-09-17T07:19:52.410 INFO:tasks.workunit.client.1.smithi139.stdout:0/243: chown d1/da/f60 4109205 1 2024-09-17T07:19:52.411 INFO:tasks.workunit.client.1.smithi139.stdout:3/249: truncate d5/f11 601797 0 2024-09-17T07:19:52.411 INFO:tasks.workunit.client.0.smithi087.stdout:1/352: fsync d2/f2d 0 2024-09-17T07:19:52.414 INFO:tasks.workunit.client.0.smithi087.stdout:1/353: mknod d2/c80 0 2024-09-17T07:19:52.417 INFO:tasks.workunit.client.1.smithi139.stdout:0/244: rmdir d1/da/d1b/d3d 39 2024-09-17T07:19:52.417 INFO:tasks.workunit.client.1.smithi139.stdout:5/200: dwrite d4/d16/d1b/d20/f24 [0,4194304] 0 2024-09-17T07:19:52.418 INFO:tasks.workunit.client.1.smithi139.stdout:1/180: write d2/f6 [1763478,94670] 0 2024-09-17T07:19:52.424 INFO:tasks.workunit.client.1.smithi139.stdout:8/346: rename d0/d20/d28/c51 to d0/d20/d28/d48/c69 0 2024-09-17T07:19:52.424 INFO:tasks.workunit.client.1.smithi139.stdout:1/181: stat d2/d10/d12/d1a/f36 0 2024-09-17T07:19:52.424 INFO:tasks.workunit.client.1.smithi139.stdout:0/245: dread d1/da/d1b/d32/d21/f30 [0,4194304] 0 2024-09-17T07:19:52.425 INFO:tasks.workunit.client.1.smithi139.stdout:3/250: rmdir d5/d15/d16/d4c 39 2024-09-17T07:19:52.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:52 smithi087 ceph-mon[27636]: pgmap v9: 65 pgs: 65 active+clean; 1.3 GiB data, 5.4 GiB used, 531 GiB / 536 GiB avail; 25 MiB/s rd, 194 MiB/s wr, 349 op/s 2024-09-17T07:19:52.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:52 smithi087 ceph-mon[27636]: from='client.14692 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:19:52.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:52 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/3239058812' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T07:19:52.426 INFO:tasks.workunit.client.0.smithi087.stdout:8/451: dwrite d1/f2a [0,4194304] 0 2024-09-17T07:19:52.427 INFO:tasks.workunit.client.1.smithi139.stdout:8/347: rmdir d0/dc 39 2024-09-17T07:19:52.429 INFO:tasks.workunit.client.0.smithi087.stdout:8/452: creat d1/d7/d9/d19/d73/f9e x:0 0 0 2024-09-17T07:19:52.430 INFO:tasks.workunit.client.0.smithi087.stdout:8/453: symlink d1/d5f/l9f 0 2024-09-17T07:19:52.431 INFO:tasks.workunit.client.1.smithi139.stdout:2/341: dwrite d0/de/d11/d32/f4f [0,4194304] 0 2024-09-17T07:19:52.431 INFO:tasks.workunit.client.0.smithi087.stdout:8/454: stat d1/d2b/d21/l2e 0 2024-09-17T07:19:52.432 INFO:tasks.workunit.client.1.smithi139.stdout:1/182: mknod d2/d10/c37 0 2024-09-17T07:19:52.433 INFO:tasks.workunit.client.0.smithi087.stdout:8/455: link d1/d7/d9/c1e d1/d2b/d21/d68/ca0 0 2024-09-17T07:19:52.434 INFO:tasks.workunit.client.1.smithi139.stdout:5/201: dread d4/d16/d1b/d20/d28/f26 [0,4194304] 0 2024-09-17T07:19:52.436 INFO:tasks.workunit.client.1.smithi139.stdout:0/246: creat d1/da/d17/d65/f6e x:0 0 0 2024-09-17T07:19:52.436 INFO:tasks.workunit.client.1.smithi139.stdout:3/251: symlink d5/d15/d16/l55 0 2024-09-17T07:19:52.438 INFO:tasks.workunit.client.1.smithi139.stdout:2/342: chown d0/de/d11/l27 116048098 1 2024-09-17T07:19:52.440 INFO:tasks.workunit.client.0.smithi087.stdout:2/362: sync 2024-09-17T07:19:52.441 INFO:tasks.workunit.client.1.smithi139.stdout:4/279: sync 2024-09-17T07:19:52.443 INFO:tasks.workunit.client.1.smithi139.stdout:8/348: dwrite d0/d20/d28/f3d [4194304,4194304] 0 2024-09-17T07:19:52.443 INFO:tasks.workunit.client.0.smithi087.stdout:2/363: mknod d2/d7/dd/c6e 0 2024-09-17T07:19:52.445 INFO:tasks.workunit.client.1.smithi139.stdout:9/583: dread dc/d11/d15/d1e/f65 [0,4194304] 0 2024-09-17T07:19:52.446 INFO:tasks.workunit.client.1.smithi139.stdout:5/202: creat d4/d16/d1b/d20/d32/f3c x:0 0 0 2024-09-17T07:19:52.446 INFO:tasks.workunit.client.1.smithi139.stdout:2/343: mkdir d0/d4e/d76 0 2024-09-17T07:19:52.447 INFO:tasks.workunit.client.1.smithi139.stdout:8/349: fsync d0/d1a/d3a/f62 0 2024-09-17T07:19:52.447 INFO:tasks.workunit.client.1.smithi139.stdout:2/344: readlink d0/d7/d1a/l43 0 2024-09-17T07:19:52.449 INFO:tasks.workunit.client.1.smithi139.stdout:3/252: rename d5/d13 to d5/d15/d56 0 2024-09-17T07:19:52.450 INFO:tasks.workunit.client.1.smithi139.stdout:9/584: creat dc/d11/d15/d1e/d53/fc6 x:0 0 0 2024-09-17T07:19:52.451 INFO:tasks.workunit.client.1.smithi139.stdout:7/291: truncate d5/d17/f27 5078961 0 2024-09-17T07:19:52.452 INFO:tasks.workunit.client.1.smithi139.stdout:3/253: chown d5/d21/d23/d38/c3e 5 1 2024-09-17T07:19:52.452 INFO:tasks.workunit.client.0.smithi087.stdout:2/364: rename d2/d15/d34/f62 to d2/d7/dd/d1f/d3a/f6f 0 2024-09-17T07:19:52.452 INFO:tasks.workunit.client.0.smithi087.stdout:1/354: dwrite d2/d3d/f28 [0,4194304] 0 2024-09-17T07:19:52.454 INFO:tasks.workunit.client.1.smithi139.stdout:2/345: creat d0/de/d11/d12/f77 x:0 0 0 2024-09-17T07:19:52.454 INFO:tasks.workunit.client.0.smithi087.stdout:2/365: write d2/d24/f64 [833620,128950] 0 2024-09-17T07:19:52.455 INFO:tasks.workunit.client.1.smithi139.stdout:5/203: mkdir d4/d16/d1b/d20/d32/d3d 0 2024-09-17T07:19:52.457 INFO:tasks.workunit.client.1.smithi139.stdout:0/247: rename d1/da/d17/c53 to d1/da/d1b/d32/d21/d66/c6f 0 2024-09-17T07:19:52.462 INFO:tasks.workunit.client.1.smithi139.stdout:9/585: dread dc/d2c/f5e [0,4194304] 0 2024-09-17T07:19:52.462 INFO:tasks.workunit.client.1.smithi139.stdout:7/292: mkdir d5/d10/d4d/d59 0 2024-09-17T07:19:52.463 INFO:tasks.workunit.client.1.smithi139.stdout:7/293: stat d5/d10/l45 0 2024-09-17T07:19:52.467 INFO:tasks.workunit.client.1.smithi139.stdout:5/204: write d4/d16/d1b/d20/d28/f26 [1298176,102346] 0 2024-09-17T07:19:52.469 INFO:tasks.workunit.client.1.smithi139.stdout:0/248: creat d1/da/d1b/d3d/f70 x:0 0 0 2024-09-17T07:19:52.470 INFO:tasks.workunit.client.1.smithi139.stdout:7/294: rename d5/d10/c24 to d5/d17/d4e/d55/c5a 0 2024-09-17T07:19:52.471 INFO:tasks.workunit.client.1.smithi139.stdout:3/254: dread d5/d15/d16/d4c/d28/f30 [0,4194304] 0 2024-09-17T07:19:52.471 INFO:tasks.workunit.client.1.smithi139.stdout:8/350: link d0/dc/f58 d0/dc/f6a 0 2024-09-17T07:19:52.473 INFO:tasks.workunit.client.1.smithi139.stdout:0/249: symlink d1/d58/l71 0 2024-09-17T07:19:52.474 INFO:tasks.workunit.client.1.smithi139.stdout:4/280: dread d0/d10/d39/f48 [0,4194304] 0 2024-09-17T07:19:52.475 INFO:tasks.workunit.client.1.smithi139.stdout:5/205: write d4/f6 [361488,8745] 0 2024-09-17T07:19:52.476 INFO:tasks.workunit.client.1.smithi139.stdout:7/295: symlink d5/d17/d4e/d55/l5b 0 2024-09-17T07:19:52.480 INFO:tasks.workunit.client.1.smithi139.stdout:0/250: fsync d1/da/d1b/d3d/d50/f55 0 2024-09-17T07:19:52.481 INFO:tasks.workunit.client.1.smithi139.stdout:9/586: dwrite dc/d11/d15/d3c/d61/fc0 [0,4194304] 0 2024-09-17T07:19:52.485 INFO:tasks.workunit.client.1.smithi139.stdout:0/251: readlink d1/l5 0 2024-09-17T07:19:52.485 INFO:tasks.workunit.client.1.smithi139.stdout:2/346: dwrite d0/d7/f19 [4194304,4194304] 0 2024-09-17T07:19:52.490 INFO:tasks.workunit.client.1.smithi139.stdout:4/281: creat d0/d1/d29/f50 x:0 0 0 2024-09-17T07:19:52.494 INFO:tasks.workunit.client.1.smithi139.stdout:2/347: fdatasync d0/f62 0 2024-09-17T07:19:52.494 INFO:tasks.workunit.client.1.smithi139.stdout:3/255: dwrite d5/d15/f33 [0,4194304] 0 2024-09-17T07:19:52.501 INFO:tasks.workunit.client.1.smithi139.stdout:2/348: chown d0/d7/l35 35784441 1 2024-09-17T07:19:52.501 INFO:tasks.workunit.client.1.smithi139.stdout:0/252: rename d1/da/d1b/d32/d21 to d1/da/d17/d72 0 2024-09-17T07:19:52.504 INFO:tasks.workunit.client.1.smithi139.stdout:5/206: dwrite d4/d16/f19 [0,4194304] 0 2024-09-17T07:19:52.506 INFO:tasks.workunit.client.1.smithi139.stdout:7/296: dwrite d5/f18 [0,4194304] 0 2024-09-17T07:19:52.506 INFO:tasks.workunit.client.1.smithi139.stdout:3/256: creat d5/d21/d23/f57 x:0 0 0 2024-09-17T07:19:52.507 INFO:tasks.workunit.client.1.smithi139.stdout:5/207: readlink d4/l21 0 2024-09-17T07:19:52.511 INFO:tasks.workunit.client.1.smithi139.stdout:7/297: write d5/d10/d2b/f3c [1574454,23288] 0 2024-09-17T07:19:52.514 INFO:tasks.workunit.client.1.smithi139.stdout:4/282: dwrite d0/f4 [0,4194304] 0 2024-09-17T07:19:52.518 INFO:tasks.workunit.client.1.smithi139.stdout:0/253: creat d1/da/d1b/d32/f73 x:0 0 0 2024-09-17T07:19:52.518 INFO:tasks.workunit.client.1.smithi139.stdout:2/349: creat d0/d4e/d76/f78 x:0 0 0 2024-09-17T07:19:52.520 INFO:tasks.workunit.client.1.smithi139.stdout:9/587: getdents dc/d11/d15/d3c/d61/d64/d96 0 2024-09-17T07:19:52.520 INFO:tasks.workunit.client.1.smithi139.stdout:4/283: symlink d0/d10/l51 0 2024-09-17T07:19:52.521 INFO:tasks.workunit.client.1.smithi139.stdout:3/257: mkdir d5/d15/d16/d4c/d28/d54/d58 0 2024-09-17T07:19:52.523 INFO:tasks.workunit.client.1.smithi139.stdout:2/350: rmdir d0/de/d11/d28 39 2024-09-17T07:19:52.523 INFO:tasks.workunit.client.1.smithi139.stdout:0/254: dread - d1/f26 zero size 2024-09-17T07:19:52.524 INFO:tasks.workunit.client.1.smithi139.stdout:3/258: chown d5/d15/d16/d4c/d28 792 1 2024-09-17T07:19:52.525 INFO:tasks.workunit.client.1.smithi139.stdout:8/351: rename d0/fa to d0/dc/f6b 0 2024-09-17T07:19:52.526 INFO:tasks.workunit.client.1.smithi139.stdout:3/259: readlink d5/l9 0 2024-09-17T07:19:52.527 INFO:tasks.workunit.client.1.smithi139.stdout:9/588: mkdir dc/d11/d8b/dc7 0 2024-09-17T07:19:52.527 INFO:tasks.workunit.client.1.smithi139.stdout:7/298: dwrite d5/f1e [0,4194304] 0 2024-09-17T07:19:52.528 INFO:tasks.workunit.client.1.smithi139.stdout:4/284: creat d0/d49/f52 x:0 0 0 2024-09-17T07:19:52.531 INFO:tasks.workunit.client.1.smithi139.stdout:5/208: rename d4/d16/f31 to d4/d16/d1b/d20/d28/f3e 0 2024-09-17T07:19:52.531 INFO:tasks.workunit.client.1.smithi139.stdout:3/260: stat d5/d15/d16/d4c/d28 0 2024-09-17T07:19:52.535 INFO:tasks.workunit.client.1.smithi139.stdout:7/299: write d5/d10/d2b/f3f [188196,42391] 0 2024-09-17T07:19:52.536 INFO:tasks.workunit.client.0.smithi087.stdout:2/366: unlink d2/d7/dd/l3b 0 2024-09-17T07:19:52.536 INFO:tasks.workunit.client.1.smithi139.stdout:4/285: creat d0/d10/f53 x:0 0 0 2024-09-17T07:19:52.540 INFO:tasks.workunit.client.1.smithi139.stdout:2/351: dwrite d0/f62 [0,4194304] 0 2024-09-17T07:19:52.541 INFO:tasks.workunit.client.1.smithi139.stdout:5/209: chown d4/d16/d1b/d20/l27 32254693 1 2024-09-17T07:19:52.542 INFO:tasks.workunit.client.1.smithi139.stdout:4/286: chown d0/c46 99 1 2024-09-17T07:19:52.546 INFO:tasks.workunit.client.1.smithi139.stdout:9/589: truncate dc/d11/d15/f18 7315326 0 2024-09-17T07:19:52.547 INFO:tasks.workunit.client.1.smithi139.stdout:0/255: dwrite d1/da/d17/d72/f5b [0,4194304] 0 2024-09-17T07:19:52.549 INFO:tasks.workunit.client.1.smithi139.stdout:7/300: symlink d5/d17/d4e/l5c 0 2024-09-17T07:19:52.550 INFO:tasks.workunit.client.1.smithi139.stdout:5/210: mkdir d4/d16/d1b/d20/d28/d3f 0 2024-09-17T07:19:52.552 INFO:tasks.workunit.client.1.smithi139.stdout:8/352: dwrite d0/dc/d18/f4f [0,4194304] 0 2024-09-17T07:19:52.557 INFO:tasks.workunit.client.0.smithi087.stdout:2/367: dread d2/d15/d34/f55 [0,4194304] 0 2024-09-17T07:19:52.559 INFO:tasks.workunit.client.1.smithi139.stdout:0/256: mknod d1/da/d1b/d3d/d50/c74 0 2024-09-17T07:19:52.559 INFO:tasks.workunit.client.1.smithi139.stdout:2/352: mknod d0/c79 0 2024-09-17T07:19:52.559 INFO:tasks.workunit.client.1.smithi139.stdout:4/287: mkdir d0/d1/d54 0 2024-09-17T07:19:52.562 INFO:tasks.workunit.client.1.smithi139.stdout:3/261: getdents d5/d15 0 2024-09-17T07:19:52.562 INFO:tasks.workunit.client.1.smithi139.stdout:4/288: readlink d0/l4e 0 2024-09-17T07:19:52.562 INFO:tasks.workunit.client.1.smithi139.stdout:9/590: dwrite dc/d11/d15/d3c/f95 [0,4194304] 0 2024-09-17T07:19:52.563 INFO:tasks.workunit.client.1.smithi139.stdout:5/211: symlink d4/d16/d1b/d20/d32/l40 0 2024-09-17T07:19:52.566 INFO:tasks.workunit.client.1.smithi139.stdout:2/353: creat d0/de/df/d56/f7a x:0 0 0 2024-09-17T07:19:52.567 INFO:tasks.workunit.client.1.smithi139.stdout:7/301: dread d5/f1e [0,4194304] 0 2024-09-17T07:19:52.567 INFO:tasks.workunit.client.1.smithi139.stdout:4/289: write d0/db/f20 [697416,73951] 0 2024-09-17T07:19:52.567 INFO:tasks.workunit.client.1.smithi139.stdout:5/212: chown d4/d16/f19 3198 1 2024-09-17T07:19:52.567 INFO:tasks.workunit.client.1.smithi139.stdout:0/257: mkdir d1/da/d1b/d3d/d5a/d75 0 2024-09-17T07:19:52.569 INFO:tasks.workunit.client.1.smithi139.stdout:5/213: dread - d4/d16/f2b zero size 2024-09-17T07:19:52.569 INFO:tasks.workunit.client.1.smithi139.stdout:3/262: symlink d5/d15/d16/d25/l59 0 2024-09-17T07:19:52.569 INFO:tasks.workunit.client.1.smithi139.stdout:2/354: stat d0/de/d11/d12/c3e 0 2024-09-17T07:19:52.570 INFO:tasks.workunit.client.1.smithi139.stdout:6/483: sync 2024-09-17T07:19:52.570 INFO:tasks.workunit.client.1.smithi139.stdout:0/258: read - d1/da/d1b/d32/f73 zero size 2024-09-17T07:19:52.570 INFO:tasks.workunit.client.1.smithi139.stdout:4/290: creat d0/d1a/f55 x:0 0 0 2024-09-17T07:19:52.572 INFO:tasks.workunit.client.1.smithi139.stdout:8/353: rename d0/d20/l31 to d0/d1a/d4d/d53/l6c 0 2024-09-17T07:19:52.573 INFO:tasks.workunit.client.1.smithi139.stdout:3/263: truncate d5/d21/d23/f47 4858669 0 2024-09-17T07:19:52.573 INFO:tasks.workunit.client.1.smithi139.stdout:7/302: symlink d5/d17/d4e/l5d 0 2024-09-17T07:19:52.575 INFO:tasks.workunit.client.1.smithi139.stdout:5/214: creat d4/f41 x:0 0 0 2024-09-17T07:19:52.578 INFO:tasks.workunit.client.1.smithi139.stdout:4/291: unlink d0/f13 0 2024-09-17T07:19:52.579 INFO:tasks.workunit.client.0.smithi087.stdout:2/368: dread d2/d7/dd/f29 [0,4194304] 0 2024-09-17T07:19:52.579 INFO:tasks.workunit.client.1.smithi139.stdout:6/484: write db/df/d4e/f55 [2411828,15795] 0 2024-09-17T07:19:52.580 INFO:tasks.workunit.client.1.smithi139.stdout:6/485: dread - db/df/d73/f97 zero size 2024-09-17T07:19:52.580 INFO:tasks.workunit.client.1.smithi139.stdout:6/486: chown db/d18/d38/c41 3569 1 2024-09-17T07:19:52.581 INFO:tasks.workunit.client.0.smithi087.stdout:2/369: rename d2/d12/c17 to d2/d7/dd/d6a/c70 0 2024-09-17T07:19:52.582 INFO:tasks.workunit.client.1.smithi139.stdout:9/591: rename dc/d11/d15/d1e/d7c to dc/d11/d15/d3c/d61/dc8 0 2024-09-17T07:19:52.583 INFO:tasks.workunit.client.1.smithi139.stdout:8/354: symlink d0/d20/d28/l6d 0 2024-09-17T07:19:52.584 INFO:tasks.workunit.client.0.smithi087.stdout:2/370: read d2/d24/d36/f39 [3845030,103365] 0 2024-09-17T07:19:52.585 INFO:tasks.workunit.client.1.smithi139.stdout:7/303: symlink d5/d17/d4e/d55/l5e 0 2024-09-17T07:19:52.587 INFO:tasks.workunit.client.1.smithi139.stdout:2/355: mknod d0/de/d11/c7b 0 2024-09-17T07:19:52.588 INFO:tasks.workunit.client.1.smithi139.stdout:5/215: symlink d4/d16/d1b/d20/d38/l42 0 2024-09-17T07:19:52.589 INFO:tasks.workunit.client.1.smithi139.stdout:4/292: symlink d0/d10/d39/l56 0 2024-09-17T07:19:52.590 INFO:tasks.workunit.client.0.smithi087.stdout:2/371: dread d2/d7/dd/f27 [0,4194304] 0 2024-09-17T07:19:52.590 INFO:tasks.workunit.client.1.smithi139.stdout:6/487: mkdir db/d18/d9f 0 2024-09-17T07:19:52.591 INFO:tasks.workunit.client.1.smithi139.stdout:6/488: chown db/df/d4e/d5e/c8f 30 1 2024-09-17T07:19:52.594 INFO:tasks.workunit.client.1.smithi139.stdout:9/592: creat dc/d11/d15/d3c/d61/d64/fc9 x:0 0 0 2024-09-17T07:19:52.598 INFO:tasks.workunit.client.1.smithi139.stdout:2/356: read d0/d3b/f42 [2422026,102381] 0 2024-09-17T07:19:52.599 INFO:tasks.workunit.client.1.smithi139.stdout:2/357: chown d0/de/d11/d32 20 1 2024-09-17T07:19:52.599 INFO:tasks.workunit.client.1.smithi139.stdout:2/358: chown d0/de/d11/l27 44057171 1 2024-09-17T07:19:52.600 INFO:tasks.workunit.client.1.smithi139.stdout:2/359: write d0/de/d69/f6a [201589,16109] 0 2024-09-17T07:19:52.601 INFO:tasks.workunit.client.1.smithi139.stdout:5/216: unlink d4/d16/d1b/f2c 0 2024-09-17T07:19:52.601 INFO:tasks.workunit.client.0.smithi087.stdout:7/303: sync 2024-09-17T07:19:52.601 INFO:tasks.workunit.client.0.smithi087.stdout:3/328: sync 2024-09-17T07:19:52.602 INFO:tasks.workunit.client.0.smithi087.stdout:7/304: truncate d0/fd 2030108 0 2024-09-17T07:19:52.602 INFO:tasks.workunit.client.1.smithi139.stdout:8/355: symlink d0/l6e 0 2024-09-17T07:19:52.604 INFO:tasks.workunit.client.0.smithi087.stdout:2/372: rename d2/d24/d36/f49 to d2/d7/f71 0 2024-09-17T07:19:52.604 INFO:tasks.workunit.client.0.smithi087.stdout:2/373: chown d2/d7/dd/d1f/d3a/c5e 0 1 2024-09-17T07:19:52.605 INFO:tasks.workunit.client.1.smithi139.stdout:7/304: link d5/d10/f2e d5/d10/d4d/d59/f5f 0 2024-09-17T07:19:52.606 INFO:tasks.workunit.client.0.smithi087.stdout:7/305: link d0/d3/d23/f54 d0/d3/d10/d31/f63 0 2024-09-17T07:19:52.608 INFO:tasks.workunit.client.1.smithi139.stdout:4/293: mknod d0/d1/d54/c57 0 2024-09-17T07:19:52.608 INFO:tasks.workunit.client.0.smithi087.stdout:2/374: creat d2/d7/d33/f72 x:0 0 0 2024-09-17T07:19:52.608 INFO:tasks.workunit.client.0.smithi087.stdout:3/329: getdents d6/d15/d37/d3c/d52 0 2024-09-17T07:19:52.608 INFO:tasks.workunit.client.0.smithi087.stdout:7/306: dread d0/f6 [0,4194304] 0 2024-09-17T07:19:52.608 INFO:tasks.workunit.client.1.smithi139.stdout:5/217: unlink d4/f41 0 2024-09-17T07:19:52.609 INFO:tasks.workunit.client.0.smithi087.stdout:7/307: fdatasync d0/f8 0 2024-09-17T07:19:52.609 INFO:tasks.workunit.client.1.smithi139.stdout:6/489: symlink db/d18/d9f/la0 0 2024-09-17T07:19:52.610 INFO:tasks.workunit.client.0.smithi087.stdout:7/308: stat d0/d3/d23/d4e 0 2024-09-17T07:19:52.610 INFO:tasks.workunit.client.1.smithi139.stdout:5/218: chown d4/d16/d1b/d20/d32/f3c 293883 1 2024-09-17T07:19:52.610 INFO:tasks.workunit.client.1.smithi139.stdout:6/490: dread - db/d18/d38/f43 zero size 2024-09-17T07:19:52.611 INFO:tasks.workunit.client.1.smithi139.stdout:6/491: chown db/df/d4e/c63 1 1 2024-09-17T07:19:52.612 INFO:tasks.workunit.client.1.smithi139.stdout:3/264: getdents d5/d15/d20 0 2024-09-17T07:19:52.612 INFO:tasks.workunit.client.1.smithi139.stdout:0/259: truncate d1/f43 351453 0 2024-09-17T07:19:52.613 INFO:tasks.workunit.client.0.smithi087.stdout:7/309: truncate d0/d3/d23/d17/f41 772504 0 2024-09-17T07:19:52.613 INFO:tasks.workunit.client.1.smithi139.stdout:3/265: truncate d5/d21/f48 1007791 0 2024-09-17T07:19:52.613 INFO:tasks.workunit.client.1.smithi139.stdout:8/356: symlink d0/d20/d28/d48/l6f 0 2024-09-17T07:19:52.614 INFO:tasks.workunit.client.1.smithi139.stdout:7/305: write d5/d10/f28 [1496676,20878] 0 2024-09-17T07:19:52.616 INFO:tasks.workunit.client.1.smithi139.stdout:7/306: fsync f2 0 2024-09-17T07:19:52.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:52 smithi139 ceph-mon[34403]: pgmap v9: 65 pgs: 65 active+clean; 1.3 GiB data, 5.4 GiB used, 531 GiB / 536 GiB avail; 25 MiB/s rd, 194 MiB/s wr, 349 op/s 2024-09-17T07:19:52.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:52 smithi139 ceph-mon[34403]: from='client.14692 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:19:52.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:52 smithi139 ceph-mon[34403]: from='client.? 172.21.15.87:0/3239058812' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T07:19:52.617 INFO:tasks.workunit.client.0.smithi087.stdout:3/330: dwrite d6/f59 [0,4194304] 0 2024-09-17T07:19:52.618 INFO:tasks.workunit.client.1.smithi139.stdout:5/219: creat d4/f43 x:0 0 0 2024-09-17T07:19:52.618 INFO:tasks.workunit.client.1.smithi139.stdout:7/307: write d5/d17/f49 [784524,85486] 0 2024-09-17T07:19:52.619 INFO:tasks.workunit.client.0.smithi087.stdout:7/310: symlink d0/d3/d23/d4e/l64 0 2024-09-17T07:19:52.619 INFO:tasks.workunit.client.0.smithi087.stdout:2/375: dwrite d2/d7/f71 [0,4194304] 0 2024-09-17T07:19:52.619 INFO:tasks.workunit.client.0.smithi087.stdout:3/331: chown d6/d15/c2f 4 1 2024-09-17T07:19:52.619 INFO:tasks.workunit.client.1.smithi139.stdout:6/492: symlink db/df/la1 0 2024-09-17T07:19:52.620 INFO:tasks.workunit.client.0.smithi087.stdout:3/332: read d6/d15/d37/d3c/f54 [3422130,104754] 0 2024-09-17T07:19:52.621 INFO:tasks.workunit.client.0.smithi087.stdout:7/311: creat d0/d3/d23/d17/f65 x:0 0 0 2024-09-17T07:19:52.621 INFO:tasks.workunit.client.1.smithi139.stdout:3/266: creat d5/d15/d20/f5a x:0 0 0 2024-09-17T07:19:52.622 INFO:tasks.workunit.client.0.smithi087.stdout:7/312: chown d0/f26 2 1 2024-09-17T07:19:52.622 INFO:tasks.workunit.client.1.smithi139.stdout:5/220: readlink d4/d16/d1b/d20/d28/l13 0 2024-09-17T07:19:52.623 INFO:tasks.workunit.client.1.smithi139.stdout:2/360: write d0/de/df/f39 [5977524,119930] 0 2024-09-17T07:19:52.626 INFO:tasks.workunit.client.0.smithi087.stdout:3/333: creat d6/d16/f68 x:0 0 0 2024-09-17T07:19:52.627 INFO:tasks.workunit.client.1.smithi139.stdout:4/294: mkdir d0/db/d58 0 2024-09-17T07:19:52.627 INFO:tasks.workunit.client.1.smithi139.stdout:0/260: dwrite d1/da/d2a/d5c/f5e [0,4194304] 0 2024-09-17T07:19:52.627 INFO:tasks.workunit.client.1.smithi139.stdout:5/221: write d4/d16/f22 [264397,29938] 0 2024-09-17T07:19:52.629 INFO:tasks.workunit.client.1.smithi139.stdout:1/183: sync 2024-09-17T07:19:52.629 INFO:tasks.workunit.client.0.smithi087.stdout:3/334: creat d6/d16/f69 x:0 0 0 2024-09-17T07:19:52.630 INFO:tasks.workunit.client.0.smithi087.stdout:3/335: fsync d6/d15/d4b/f4c 0 2024-09-17T07:19:52.631 INFO:tasks.workunit.client.1.smithi139.stdout:9/593: truncate dc/fa8 533844 0 2024-09-17T07:19:52.631 INFO:tasks.workunit.client.0.smithi087.stdout:2/376: getdents d2/d7 0 2024-09-17T07:19:52.632 INFO:tasks.workunit.client.1.smithi139.stdout:8/357: creat d0/d20/d28/d52/d65/f70 x:0 0 0 2024-09-17T07:19:52.632 INFO:tasks.workunit.client.1.smithi139.stdout:6/493: mknod db/d18/d38/ca2 0 2024-09-17T07:19:52.632 INFO:tasks.workunit.client.0.smithi087.stdout:2/377: chown d2/d7/d30/d3f 0 1 2024-09-17T07:19:52.633 INFO:tasks.workunit.client.0.smithi087.stdout:3/336: stat d6/d1b/d42/c46 0 2024-09-17T07:19:52.633 INFO:tasks.workunit.client.1.smithi139.stdout:1/184: write d2/f7 [4608344,85920] 0 2024-09-17T07:19:52.634 INFO:tasks.workunit.client.0.smithi087.stdout:3/337: fdatasync d6/f12 0 2024-09-17T07:19:52.635 INFO:tasks.workunit.client.1.smithi139.stdout:4/295: rename d0/d1a/c28 to d0/d1a/c59 0 2024-09-17T07:19:52.635 INFO:tasks.workunit.client.0.smithi087.stdout:2/378: creat d2/d7/dd/d1f/f73 x:0 0 0 2024-09-17T07:19:52.636 INFO:tasks.workunit.client.0.smithi087.stdout:3/338: fdatasync d6/fd 0 2024-09-17T07:19:52.638 INFO:tasks.workunit.client.0.smithi087.stdout:2/379: creat d2/d50/f74 x:0 0 0 2024-09-17T07:19:52.638 INFO:tasks.workunit.client.1.smithi139.stdout:8/358: mkdir d0/d1a/d3a/d71 0 2024-09-17T07:19:52.639 INFO:tasks.workunit.client.1.smithi139.stdout:9/594: truncate dc/d11/d15/d3c/d68/f6f 8805 0 2024-09-17T07:19:52.639 INFO:tasks.workunit.client.0.smithi087.stdout:3/339: creat d6/d1b/d42/d62/f6a x:0 0 0 2024-09-17T07:19:52.639 INFO:tasks.workunit.client.1.smithi139.stdout:4/296: mkdir d0/d1a/d5a 0 2024-09-17T07:19:52.641 INFO:tasks.workunit.client.0.smithi087.stdout:3/340: mknod d6/d1b/d2b/c6b 0 2024-09-17T07:19:52.642 INFO:tasks.workunit.client.1.smithi139.stdout:7/308: dwrite d5/f18 [0,4194304] 0 2024-09-17T07:19:52.644 INFO:tasks.workunit.client.0.smithi087.stdout:2/380: dwrite d2/d50/f61 [0,4194304] 0 2024-09-17T07:19:52.646 INFO:tasks.workunit.client.1.smithi139.stdout:3/267: link d5/d15/d20/d3b/f4a d5/d15/d16/d4c/d28/f5b 0 2024-09-17T07:19:52.650 INFO:tasks.workunit.client.1.smithi139.stdout:4/297: read d0/d1/fd [2165754,19718] 0 2024-09-17T07:19:52.650 INFO:tasks.workunit.client.1.smithi139.stdout:7/309: write d5/d10/d2b/f3c [93296,6490] 0 2024-09-17T07:19:52.655 INFO:tasks.workunit.client.1.smithi139.stdout:6/494: dwrite db/d18/d38/f49 [0,4194304] 0 2024-09-17T07:19:52.657 INFO:tasks.workunit.client.1.smithi139.stdout:9/595: write dc/d11/d15/d3c/d68/fa0 [2352503,38111] 0 2024-09-17T07:19:52.662 INFO:tasks.workunit.client.1.smithi139.stdout:9/596: read dc/d11/d15/d3c/f7e [47492,53955] 0 2024-09-17T07:19:52.662 INFO:tasks.workunit.client.0.smithi087.stdout:7/313: dwrite d0/d3/d10/f29 [4194304,4194304] 0 2024-09-17T07:19:52.664 INFO:tasks.workunit.client.1.smithi139.stdout:4/298: creat d0/d1/d54/f5b x:0 0 0 2024-09-17T07:19:52.665 INFO:tasks.workunit.client.1.smithi139.stdout:3/268: rename d5/d21/d23/d38/c3e to d5/d15/d16/d4c/d28/d54/c5c 0 2024-09-17T07:19:52.665 INFO:tasks.workunit.client.1.smithi139.stdout:2/361: dread d0/f3 [0,4194304] 0 2024-09-17T07:19:52.665 INFO:tasks.workunit.client.0.smithi087.stdout:2/381: dwrite d2/d15/f2c [0,4194304] 0 2024-09-17T07:19:52.666 INFO:tasks.workunit.client.1.smithi139.stdout:8/359: dread d0/d1a/f39 [0,4194304] 0 2024-09-17T07:19:52.667 INFO:tasks.workunit.client.0.smithi087.stdout:2/382: chown d2/d12/l56 6018 1 2024-09-17T07:19:52.668 INFO:tasks.workunit.client.1.smithi139.stdout:4/299: dread - d0/d1/d29/f50 zero size 2024-09-17T07:19:52.671 INFO:tasks.workunit.client.0.smithi087.stdout:2/383: creat d2/d48/d69/f75 x:0 0 0 2024-09-17T07:19:52.675 INFO:tasks.workunit.client.1.smithi139.stdout:5/222: dread d4/d16/f1d [0,4194304] 0 2024-09-17T07:19:52.675 INFO:tasks.workunit.client.0.smithi087.stdout:7/314: write d0/d3/d10/f14 [8632,74811] 0 2024-09-17T07:19:52.676 INFO:tasks.workunit.client.0.smithi087.stdout:2/384: dread d2/d7/dd/f29 [0,4194304] 0 2024-09-17T07:19:52.676 INFO:tasks.workunit.client.0.smithi087.stdout:7/315: fsync d0/d3/d23/d17/f47 0 2024-09-17T07:19:52.677 INFO:tasks.workunit.client.1.smithi139.stdout:1/185: truncate d2/fd 497208 0 2024-09-17T07:19:52.678 INFO:tasks.workunit.client.1.smithi139.stdout:0/261: dwrite d1/da/d1b/d32/f47 [0,4194304] 0 2024-09-17T07:19:52.679 INFO:tasks.workunit.client.0.smithi087.stdout:2/385: symlink d2/d7/d33/l76 0 2024-09-17T07:19:52.679 INFO:tasks.workunit.client.0.smithi087.stdout:7/316: creat d0/d3/d23/d17/f66 x:0 0 0 2024-09-17T07:19:52.679 INFO:tasks.workunit.client.0.smithi087.stdout:2/386: chown d2/d24/d36/l3d 267663 1 2024-09-17T07:19:52.681 INFO:tasks.workunit.client.0.smithi087.stdout:7/317: mkdir d0/d3/d10/d32/d67 0 2024-09-17T07:19:52.681 INFO:tasks.workunit.client.1.smithi139.stdout:2/362: rmdir d0/d4e/d76 39 2024-09-17T07:19:52.683 INFO:tasks.workunit.client.0.smithi087.stdout:2/387: dread d2/d15/d34/f55 [0,4194304] 0 2024-09-17T07:19:52.684 INFO:tasks.workunit.client.1.smithi139.stdout:2/363: write d0/de/d69/f6a [235969,10371] 0 2024-09-17T07:19:52.684 INFO:tasks.workunit.client.0.smithi087.stdout:2/388: chown d2/d48/d69 135 1 2024-09-17T07:19:52.687 INFO:tasks.workunit.client.0.smithi087.stdout:2/389: write d2/d7/d33/f72 [993261,88508] 0 2024-09-17T07:19:52.688 INFO:tasks.workunit.client.1.smithi139.stdout:4/300: unlink d0/db/f20 0 2024-09-17T07:19:52.689 INFO:tasks.workunit.client.0.smithi087.stdout:7/318: dwrite d0/d3/d23/d17/f34 [4194304,4194304] 0 2024-09-17T07:19:52.690 INFO:tasks.workunit.client.1.smithi139.stdout:7/310: dwrite d5/f43 [0,4194304] 0 2024-09-17T07:19:52.691 INFO:tasks.workunit.client.1.smithi139.stdout:9/597: creat dc/d11/d15/fca x:0 0 0 2024-09-17T07:19:52.692 INFO:tasks.workunit.client.0.smithi087.stdout:2/390: creat d2/d7/dd/d6a/d6d/f77 x:0 0 0 2024-09-17T07:19:52.693 INFO:tasks.workunit.client.1.smithi139.stdout:3/269: rmdir d5/d21 39 2024-09-17T07:19:52.694 INFO:tasks.workunit.client.0.smithi087.stdout:7/319: link d0/d3/d10/f27 d0/d3/d23/d17/f68 0 2024-09-17T07:19:52.695 INFO:tasks.workunit.client.1.smithi139.stdout:5/223: rename d4/lf to d4/l44 0 2024-09-17T07:19:52.696 INFO:tasks.workunit.client.0.smithi087.stdout:2/391: link d2/d7/db/cc d2/d24/d36/c78 0 2024-09-17T07:19:52.697 INFO:tasks.workunit.client.0.smithi087.stdout:2/392: stat d2/d7/dd/d10/d4c/d6c 0 2024-09-17T07:19:52.697 INFO:tasks.workunit.client.1.smithi139.stdout:7/311: write d5/d10/f42 [3933,120899] 0 2024-09-17T07:19:52.700 INFO:tasks.workunit.client.1.smithi139.stdout:3/270: chown d5/d15/d16/d4c/d28/d54/d58 100 1 2024-09-17T07:19:52.701 INFO:tasks.workunit.client.0.smithi087.stdout:2/393: unlink d2/d7/dd/f43 0 2024-09-17T07:19:52.701 INFO:tasks.workunit.client.0.smithi087.stdout:7/320: link d0/d3/d23/d4e/l64 d0/d36/l69 0 2024-09-17T07:19:52.704 INFO:tasks.workunit.client.1.smithi139.stdout:4/301: dread d0/f4 [0,4194304] 0 2024-09-17T07:19:52.704 INFO:tasks.workunit.client.1.smithi139.stdout:8/360: rmdir d0/d1a/d4d/d5e 0 2024-09-17T07:19:52.704 INFO:tasks.workunit.client.1.smithi139.stdout:6/495: dwrite db/d18/d1b/f37 [0,4194304] 0 2024-09-17T07:19:52.706 INFO:tasks.workunit.client.0.smithi087.stdout:7/321: mknod d0/d3/c6a 0 2024-09-17T07:19:52.707 INFO:tasks.workunit.client.1.smithi139.stdout:4/302: readlink d0/d10/l3b 0 2024-09-17T07:19:52.709 INFO:tasks.workunit.client.1.smithi139.stdout:7/312: dread d5/d10/f28 [0,4194304] 0 2024-09-17T07:19:52.709 INFO:tasks.workunit.client.0.smithi087.stdout:2/394: dwrite d2/d7/f8 [0,4194304] 0 2024-09-17T07:19:52.710 INFO:tasks.workunit.client.0.smithi087.stdout:2/395: truncate d2/d7/dd/d10/f5a 740239 0 2024-09-17T07:19:52.711 INFO:tasks.workunit.client.1.smithi139.stdout:5/224: creat d4/d16/d1b/d20/d38/f45 x:0 0 0 2024-09-17T07:19:52.713 INFO:tasks.workunit.client.1.smithi139.stdout:6/496: mknod db/d18/ca3 0 2024-09-17T07:19:52.716 INFO:tasks.workunit.client.1.smithi139.stdout:9/598: fdatasync dc/d11/d15/d1e/f2e 0 2024-09-17T07:19:52.716 INFO:tasks.workunit.client.0.smithi087.stdout:2/396: creat d2/d7/dd/f79 x:0 0 0 2024-09-17T07:19:52.717 INFO:tasks.workunit.client.1.smithi139.stdout:0/262: write d1/da/f60 [951334,72712] 0 2024-09-17T07:19:52.717 INFO:tasks.workunit.client.1.smithi139.stdout:7/313: creat d5/d10/d4d/f60 x:0 0 0 2024-09-17T07:19:52.721 INFO:tasks.workunit.client.1.smithi139.stdout:3/271: creat d5/d21/d23/f5d x:0 0 0 2024-09-17T07:19:52.726 INFO:tasks.workunit.client.1.smithi139.stdout:6/497: dread db/d21/f42 [0,4194304] 0 2024-09-17T07:19:52.727 INFO:tasks.workunit.client.1.smithi139.stdout:5/225: creat d4/d16/d1b/d20/d28/f46 x:0 0 0 2024-09-17T07:19:52.729 INFO:tasks.workunit.client.1.smithi139.stdout:9/599: creat dc/d11/d15/d3c/d68/fcb x:0 0 0 2024-09-17T07:19:52.730 INFO:tasks.workunit.client.1.smithi139.stdout:0/263: readlink d1/da/d17/l52 0 2024-09-17T07:19:52.731 INFO:tasks.workunit.client.0.smithi087.stdout:2/397: write d2/d7/dd/f27 [44971,71862] 0 2024-09-17T07:19:52.732 INFO:tasks.workunit.client.0.smithi087.stdout:2/398: write d2/f14 [3567955,28118] 0 2024-09-17T07:19:52.733 INFO:tasks.workunit.client.1.smithi139.stdout:5/226: truncate d4/d16/d1b/d20/d38/f3b 240184 0 2024-09-17T07:19:52.733 INFO:tasks.workunit.client.1.smithi139.stdout:1/186: dread d2/d10/d12/f29 [0,4194304] 0 2024-09-17T07:19:52.733 INFO:tasks.workunit.client.1.smithi139.stdout:3/272: mknod d5/d21/d23/c5e 0 2024-09-17T07:19:52.734 INFO:tasks.workunit.client.0.smithi087.stdout:2/399: rmdir d2/d50 39 2024-09-17T07:19:52.735 INFO:tasks.workunit.client.0.smithi087.stdout:2/400: truncate d2/d7/f68 307569 0 2024-09-17T07:19:52.735 INFO:tasks.workunit.client.1.smithi139.stdout:6/498: dwrite db/df/d73/d81/f3b [0,4194304] 0 2024-09-17T07:19:52.736 INFO:tasks.workunit.client.0.smithi087.stdout:2/401: read d2/d7/f68 [289898,104661] 0 2024-09-17T07:19:52.736 INFO:tasks.workunit.client.1.smithi139.stdout:5/227: chown d4/d16/d1b/d20/d28/f46 831058431 1 2024-09-17T07:19:52.737 INFO:tasks.workunit.client.0.smithi087.stdout:2/402: chown d2/d7/d30 65 1 2024-09-17T07:19:52.737 INFO:tasks.workunit.client.1.smithi139.stdout:4/303: link d0/f7 d0/d1/d29/d41/f5c 0 2024-09-17T07:19:52.738 INFO:tasks.workunit.client.0.smithi087.stdout:2/403: creat d2/d12/f7a x:0 0 0 2024-09-17T07:19:52.740 INFO:tasks.workunit.client.1.smithi139.stdout:4/304: readlink d0/l2e 0 2024-09-17T07:19:52.743 INFO:tasks.workunit.client.1.smithi139.stdout:1/187: write d2/d10/d12/f29 [3025704,128434] 0 2024-09-17T07:19:52.744 INFO:tasks.workunit.client.0.smithi087.stdout:2/404: dwrite d2/d7/d30/f4e [0,4194304] 0 2024-09-17T07:19:52.745 INFO:tasks.workunit.client.1.smithi139.stdout:7/314: link d5/d17/f32 d5/d10/d2b/d40/f61 0 2024-09-17T07:19:52.746 INFO:tasks.workunit.client.0.smithi087.stdout:2/405: dread - d2/d50/f74 zero size 2024-09-17T07:19:52.749 INFO:tasks.workunit.client.1.smithi139.stdout:9/600: dread dc/d11/f4d [0,4194304] 0 2024-09-17T07:19:52.749 INFO:tasks.workunit.client.0.smithi087.stdout:2/406: symlink d2/d7/d30/l7b 0 2024-09-17T07:19:52.749 INFO:tasks.workunit.client.1.smithi139.stdout:0/264: dwrite d1/da/d2a/d5c/f5e [0,4194304] 0 2024-09-17T07:19:52.750 INFO:tasks.workunit.client.0.smithi087.stdout:2/407: write d2/d15/f2c [1402234,35761] 0 2024-09-17T07:19:52.752 INFO:tasks.workunit.client.0.smithi087.stdout:2/408: write d2/d7/dd/d1f/d3a/f6f [3920965,82993] 0 2024-09-17T07:19:52.755 INFO:tasks.workunit.client.0.smithi087.stdout:0/544: sync 2024-09-17T07:19:52.756 INFO:tasks.workunit.client.0.smithi087.stdout:2/409: rename d2/d48/f5d to d2/f7c 0 2024-09-17T07:19:52.758 INFO:tasks.workunit.client.0.smithi087.stdout:2/410: creat d2/d24/f7d x:0 0 0 2024-09-17T07:19:52.761 INFO:tasks.workunit.client.1.smithi139.stdout:1/188: rmdir d2/d10/d12/d24/d32 0 2024-09-17T07:19:52.761 INFO:tasks.workunit.client.1.smithi139.stdout:8/361: dwrite d0/dc/f6b [4194304,4194304] 0 2024-09-17T07:19:52.761 INFO:tasks.workunit.client.0.smithi087.stdout:2/411: read d2/d7/dd/d10/f5a [216155,79115] 0 2024-09-17T07:19:52.762 INFO:tasks.workunit.client.1.smithi139.stdout:7/315: link d5/d10/d4d/f60 d5/d10/d2b/f62 0 2024-09-17T07:19:52.764 INFO:tasks.workunit.client.1.smithi139.stdout:6/499: dread db/df/d4e/d64/d54/f3a [0,4194304] 0 2024-09-17T07:19:52.767 INFO:tasks.workunit.client.0.smithi087.stdout:2/412: dwrite d2/d7/f71 [0,4194304] 0 2024-09-17T07:19:52.770 INFO:tasks.workunit.client.1.smithi139.stdout:8/362: read d0/d1a/f4a [6965341,40546] 0 2024-09-17T07:19:52.770 INFO:tasks.workunit.client.1.smithi139.stdout:9/601: write dc/d11/d15/d1e/f2e [2625971,102141] 0 2024-09-17T07:19:52.771 INFO:tasks.workunit.client.1.smithi139.stdout:7/316: write d5/d17/f49 [754759,89779] 0 2024-09-17T07:19:52.773 INFO:tasks.workunit.client.1.smithi139.stdout:3/273: dwrite d5/d15/d16/d4c/d28/f30 [0,4194304] 0 2024-09-17T07:19:52.773 INFO:tasks.workunit.client.1.smithi139.stdout:1/189: mkdir d2/d10/d12/d24/d38 0 2024-09-17T07:19:52.774 INFO:tasks.workunit.client.1.smithi139.stdout:0/265: dwrite d1/da/d2a/f51 [0,4194304] 0 2024-09-17T07:19:52.777 INFO:tasks.workunit.client.0.smithi087.stdout:2/413: dwrite d2/d7/d60/f65 [0,4194304] 0 2024-09-17T07:19:52.777 INFO:tasks.workunit.client.1.smithi139.stdout:8/363: fdatasync d0/d20/f5f 0 2024-09-17T07:19:52.778 INFO:tasks.workunit.client.1.smithi139.stdout:0/266: stat d1/da/d1b/d3d/f64 0 2024-09-17T07:19:52.781 INFO:tasks.workunit.client.0.smithi087.stdout:2/414: symlink d2/d7/dd/d6a/l7e 0 2024-09-17T07:19:52.782 INFO:tasks.workunit.client.0.smithi087.stdout:2/415: readlink d2/d7/dd/d6a/l7e 0 2024-09-17T07:19:52.782 INFO:tasks.workunit.client.1.smithi139.stdout:6/500: mkdir db/df/d73/da4 0 2024-09-17T07:19:52.782 INFO:tasks.workunit.client.1.smithi139.stdout:7/317: mkdir d5/d17/d4e/d63 0 2024-09-17T07:19:52.785 INFO:tasks.workunit.client.0.smithi087.stdout:2/416: mknod d2/d15/c7f 0 2024-09-17T07:19:52.788 INFO:tasks.workunit.client.1.smithi139.stdout:9/602: mkdir dc/d11/d8b/dc7/dcc 0 2024-09-17T07:19:52.788 INFO:tasks.workunit.client.0.smithi087.stdout:2/417: symlink d2/d12/l80 0 2024-09-17T07:19:52.789 INFO:tasks.workunit.client.0.smithi087.stdout:2/418: write d2/f14 [3234168,75163] 0 2024-09-17T07:19:52.789 INFO:tasks.workunit.client.1.smithi139.stdout:7/318: stat d5/d10/d2b/d40/d47 0 2024-09-17T07:19:52.790 INFO:tasks.workunit.client.1.smithi139.stdout:5/228: dread d4/f17 [0,4194304] 0 2024-09-17T07:19:52.792 INFO:tasks.workunit.client.1.smithi139.stdout:3/274: link d5/d15/d16/d4c/d28/f3d d5/d21/d23/d38/f5f 0 2024-09-17T07:19:52.793 INFO:tasks.workunit.client.0.smithi087.stdout:2/419: creat d2/d7/dd/d10/d4c/d6c/f81 x:0 0 0 2024-09-17T07:19:52.793 INFO:tasks.workunit.client.0.smithi087.stdout:2/420: chown d2/d7 123932 1 2024-09-17T07:19:52.793 INFO:tasks.workunit.client.0.smithi087.stdout:2/421: stat d2/d7/d33 0 2024-09-17T07:19:52.794 INFO:tasks.workunit.client.0.smithi087.stdout:2/422: symlink d2/d7/d60/l82 0 2024-09-17T07:19:52.795 INFO:tasks.workunit.client.1.smithi139.stdout:8/364: write d0/d1a/f39 [1273234,50127] 0 2024-09-17T07:19:52.796 INFO:tasks.workunit.client.1.smithi139.stdout:1/190: dwrite d2/d10/d12/f23 [0,4194304] 0 2024-09-17T07:19:52.796 INFO:tasks.workunit.client.1.smithi139.stdout:7/319: fdatasync d5/d17/f2a 0 2024-09-17T07:19:52.797 INFO:tasks.workunit.client.1.smithi139.stdout:6/501: creat db/df/d4e/d5e/d8a/fa5 x:0 0 0 2024-09-17T07:19:52.797 INFO:tasks.workunit.client.1.smithi139.stdout:8/365: stat d0/d20/f5f 0 2024-09-17T07:19:52.800 INFO:tasks.workunit.client.1.smithi139.stdout:5/229: chown d4/d16/d1b/d20/l27 5223254 1 2024-09-17T07:19:52.800 INFO:tasks.workunit.client.1.smithi139.stdout:5/230: truncate d4/f36 1037022 0 2024-09-17T07:19:52.802 INFO:tasks.workunit.client.1.smithi139.stdout:5/231: read d4/d16/d1b/d20/d38/f3b [130165,8431] 0 2024-09-17T07:19:52.803 INFO:tasks.workunit.client.1.smithi139.stdout:5/232: stat d4/c2e 0 2024-09-17T07:19:52.803 INFO:tasks.workunit.client.1.smithi139.stdout:3/275: read d5/d21/d23/f47 [3141778,116126] 0 2024-09-17T07:19:52.807 INFO:tasks.workunit.client.1.smithi139.stdout:9/603: rename dc/d11/d52/l57 to dc/d11/d8b/lcd 0 2024-09-17T07:19:52.807 INFO:tasks.workunit.client.1.smithi139.stdout:8/366: rmdir d0/d1a 39 2024-09-17T07:19:52.807 INFO:tasks.workunit.client.1.smithi139.stdout:5/233: symlink d4/d16/d1b/l47 0 2024-09-17T07:19:52.809 INFO:tasks.workunit.client.1.smithi139.stdout:1/191: mknod d2/d10/d12/d35/c39 0 2024-09-17T07:19:52.812 INFO:tasks.workunit.client.1.smithi139.stdout:7/320: unlink d5/d17/l4b 0 2024-09-17T07:19:52.813 INFO:tasks.workunit.client.1.smithi139.stdout:8/367: readlink d0/le 0 2024-09-17T07:19:52.814 INFO:tasks.workunit.client.1.smithi139.stdout:1/192: read d2/f6 [790637,100526] 0 2024-09-17T07:19:52.814 INFO:tasks.workunit.client.1.smithi139.stdout:3/276: unlink d5/c1b 0 2024-09-17T07:19:52.820 INFO:tasks.workunit.client.1.smithi139.stdout:5/234: dwrite d4/d16/f18 [4194304,4194304] 0 2024-09-17T07:19:52.823 INFO:tasks.workunit.client.1.smithi139.stdout:5/235: chown d4/f6 791009 1 2024-09-17T07:19:52.824 INFO:tasks.workunit.client.1.smithi139.stdout:1/193: symlink d2/d10/d12/d1a/l3a 0 2024-09-17T07:19:52.824 INFO:tasks.workunit.client.1.smithi139.stdout:9/604: dwrite dc/d11/d15/d3c/d61/dc8/d83/f9c [0,4194304] 0 2024-09-17T07:19:52.826 INFO:tasks.workunit.client.1.smithi139.stdout:1/194: stat d2/d10/d12/d13/f17 0 2024-09-17T07:19:52.826 INFO:tasks.workunit.client.1.smithi139.stdout:5/236: write d4/d16/f18 [4360497,74632] 0 2024-09-17T07:19:52.827 INFO:tasks.workunit.client.1.smithi139.stdout:5/237: stat d4/f9 0 2024-09-17T07:19:52.831 INFO:tasks.workunit.client.1.smithi139.stdout:5/238: chown d4/d16/c2f 26371279 1 2024-09-17T07:19:52.836 INFO:tasks.workunit.client.1.smithi139.stdout:8/368: creat d0/f72 x:0 0 0 2024-09-17T07:19:52.836 INFO:tasks.workunit.client.1.smithi139.stdout:0/267: dread d1/da/d1b/d3d/d50/f55 [0,4194304] 0 2024-09-17T07:19:52.839 INFO:tasks.workunit.client.1.smithi139.stdout:0/268: stat d1/da/d17/d72 0 2024-09-17T07:19:52.839 INFO:tasks.workunit.client.1.smithi139.stdout:1/195: dwrite d2/d10/d12/d13/f17 [0,4194304] 0 2024-09-17T07:19:52.852 INFO:tasks.workunit.client.1.smithi139.stdout:8/369: dwrite d0/f2a [0,4194304] 0 2024-09-17T07:19:52.853 INFO:tasks.workunit.client.1.smithi139.stdout:0/269: write d1/da/d1b/d3d/d50/f61 [661851,27765] 0 2024-09-17T07:19:52.855 INFO:tasks.workunit.client.1.smithi139.stdout:1/196: dwrite d2/d10/d12/f29 [0,4194304] 0 2024-09-17T07:19:52.858 INFO:tasks.workunit.client.1.smithi139.stdout:0/270: chown d1/f26 60497 1 2024-09-17T07:19:52.859 INFO:tasks.workunit.client.1.smithi139.stdout:9/605: dread dc/f3e [0,4194304] 0 2024-09-17T07:19:52.861 INFO:tasks.workunit.client.1.smithi139.stdout:1/197: symlink d2/d10/d12/d1a/l3b 0 2024-09-17T07:19:52.863 INFO:tasks.workunit.client.1.smithi139.stdout:0/271: mknod d1/da/d17/d65/c76 0 2024-09-17T07:19:52.863 INFO:tasks.workunit.client.1.smithi139.stdout:3/277: dwrite d5/f11 [0,4194304] 0 2024-09-17T07:19:52.865 INFO:tasks.workunit.client.1.smithi139.stdout:5/239: write d4/fd [4466593,117320] 0 2024-09-17T07:19:52.867 INFO:tasks.workunit.client.1.smithi139.stdout:9/606: symlink dc/d11/d8b/lce 0 2024-09-17T07:19:52.867 INFO:tasks.workunit.client.1.smithi139.stdout:1/198: write d2/f7 [854879,105420] 0 2024-09-17T07:19:52.869 INFO:tasks.workunit.client.1.smithi139.stdout:8/370: write d0/d1a/f3f [4061546,2757] 0 2024-09-17T07:19:52.870 INFO:tasks.workunit.client.1.smithi139.stdout:3/278: write d5/d21/d23/f5d [565382,106462] 0 2024-09-17T07:19:52.870 INFO:tasks.workunit.client.1.smithi139.stdout:0/272: rename d1/f18 to d1/da/d1b/d3d/d5a/d75/f77 0 2024-09-17T07:19:52.871 INFO:tasks.workunit.client.1.smithi139.stdout:9/607: readlink dc/d11/d15/d3c/lc2 0 2024-09-17T07:19:52.872 INFO:tasks.workunit.client.1.smithi139.stdout:9/608: stat dc/d2a/l89 0 2024-09-17T07:19:52.874 INFO:tasks.workunit.client.1.smithi139.stdout:9/609: write dc/d11/d15/d3c/d68/f6f [865263,19018] 0 2024-09-17T07:19:52.879 INFO:tasks.workunit.client.1.smithi139.stdout:8/371: symlink d0/d1a/l73 0 2024-09-17T07:19:52.881 INFO:tasks.workunit.client.1.smithi139.stdout:9/610: rename dc/d11/dba to dc/d11/d15/d3c/d61/dc8/d83/d98/dcf 0 2024-09-17T07:19:52.883 INFO:tasks.workunit.client.1.smithi139.stdout:0/273: creat d1/da/f78 x:0 0 0 2024-09-17T07:19:52.883 INFO:tasks.workunit.client.1.smithi139.stdout:9/611: fdatasync dc/d11/d52/fa2 0 2024-09-17T07:19:52.884 INFO:tasks.workunit.client.1.smithi139.stdout:8/372: symlink d0/d20/d28/d52/d54/l74 0 2024-09-17T07:19:52.885 INFO:tasks.workunit.client.1.smithi139.stdout:0/274: write d1/da/d1b/d3d/f64 [2097925,16423] 0 2024-09-17T07:19:52.885 INFO:tasks.workunit.client.0.smithi087.stdout:5/510: sync 2024-09-17T07:19:52.888 INFO:tasks.workunit.client.0.smithi087.stdout:5/511: mkdir d5/d8/da7 0 2024-09-17T07:19:52.891 INFO:tasks.workunit.client.0.smithi087.stdout:5/512: getdents d5/d8/d1f/d68 0 2024-09-17T07:19:52.893 INFO:tasks.workunit.client.1.smithi139.stdout:0/275: dwrite d1/da/d1b/d3d/f70 [0,4194304] 0 2024-09-17T07:19:52.894 INFO:tasks.workunit.client.1.smithi139.stdout:1/199: dread d2/d10/d12/d1a/f21 [0,4194304] 0 2024-09-17T07:19:52.898 INFO:tasks.workunit.client.0.smithi087.stdout:5/513: dwrite d5/d12/d1c/fa5 [0,4194304] 0 2024-09-17T07:19:52.918 INFO:tasks.workunit.client.1.smithi139.stdout:0/276: dread d1/da/d2a/f62 [0,4194304] 0 2024-09-17T07:19:52.920 INFO:tasks.workunit.client.1.smithi139.stdout:0/277: mknod d1/da/d1b/d32/c79 0 2024-09-17T07:19:52.921 INFO:tasks.workunit.client.1.smithi139.stdout:0/278: fsync d1/da/d2a/f51 0 2024-09-17T07:19:52.924 INFO:tasks.workunit.client.1.smithi139.stdout:0/279: link d1/da/d1b/d32/f3a d1/da/d1b/d32/f7a 0 2024-09-17T07:19:52.925 INFO:tasks.workunit.client.1.smithi139.stdout:0/280: chown d1/f3 61 1 2024-09-17T07:19:52.926 INFO:tasks.workunit.client.0.smithi087.stdout:5/514: dwrite d5/d12/d1c/fa2 [0,4194304] 0 2024-09-17T07:19:52.927 INFO:tasks.workunit.client.1.smithi139.stdout:0/281: mknod d1/da/d2a/c7b 0 2024-09-17T07:19:52.930 INFO:tasks.workunit.client.1.smithi139.stdout:0/282: creat d1/f7c x:0 0 0 2024-09-17T07:19:52.933 INFO:tasks.workunit.client.0.smithi087.stdout:5/515: dwrite d5/d12/d1c/f65 [0,4194304] 0 2024-09-17T07:19:52.937 INFO:tasks.workunit.client.1.smithi139.stdout:0/283: dwrite d1/da/d1b/d3d/f64 [0,4194304] 0 2024-09-17T07:19:52.940 INFO:tasks.workunit.client.0.smithi087.stdout:5/516: write d5/d8/d1f/f58 [2154346,43177] 0 2024-09-17T07:19:52.941 INFO:tasks.workunit.client.1.smithi139.stdout:0/284: write d1/da/d17/d72/f5b [3459418,66162] 0 2024-09-17T07:19:52.942 INFO:tasks.workunit.client.0.smithi087.stdout:6/529: sync 2024-09-17T07:19:52.942 INFO:tasks.workunit.client.0.smithi087.stdout:4/365: sync 2024-09-17T07:19:52.943 INFO:tasks.workunit.client.1.smithi139.stdout:0/285: fsync d1/da/d2a/f51 0 2024-09-17T07:19:52.943 INFO:tasks.workunit.client.0.smithi087.stdout:5/517: rename d5/d8/c82 to d5/d12/d56/d5b/ca8 0 2024-09-17T07:19:52.945 INFO:tasks.workunit.client.0.smithi087.stdout:6/530: mknod d1/d6/d1a/d2c/d48/d9b/cc2 0 2024-09-17T07:19:52.946 INFO:tasks.workunit.client.0.smithi087.stdout:4/366: mknod d2/c88 0 2024-09-17T07:19:52.953 INFO:tasks.workunit.client.0.smithi087.stdout:4/367: dread d2/d22/d2c/d3f/d4d/f48 [0,4194304] 0 2024-09-17T07:19:52.954 INFO:tasks.workunit.client.0.smithi087.stdout:4/368: dread - d2/d22/d2c/d3f/f6f zero size 2024-09-17T07:19:52.954 INFO:tasks.workunit.client.1.smithi139.stdout:3/279: write d5/d15/d16/d4c/d28/f30 [1885187,103168] 0 2024-09-17T07:19:52.959 INFO:tasks.workunit.client.1.smithi139.stdout:5/240: write d4/d16/d1b/d20/d38/f3b [691388,68959] 0 2024-09-17T07:19:52.962 INFO:tasks.workunit.client.1.smithi139.stdout:3/280: getdents d5/d15/d56 0 2024-09-17T07:19:52.963 INFO:tasks.workunit.client.1.smithi139.stdout:5/241: read d4/f9 [12638,9344] 0 2024-09-17T07:19:52.963 INFO:tasks.workunit.client.1.smithi139.stdout:8/373: truncate d0/dc/d18/f55 3814472 0 2024-09-17T07:19:52.964 INFO:tasks.workunit.client.0.smithi087.stdout:4/369: dread d2/d22/d2c/d3f/d4d/fd [0,4194304] 0 2024-09-17T07:19:52.965 INFO:tasks.workunit.client.1.smithi139.stdout:1/200: truncate d2/d10/d12/d13/f17 1904251 0 2024-09-17T07:19:52.967 INFO:tasks.workunit.client.0.smithi087.stdout:4/370: chown d2/d22/d2c/d3f/d4d/d21/f79 0 1 2024-09-17T07:19:52.967 INFO:tasks.workunit.client.0.smithi087.stdout:6/531: dwrite d1/fb [0,4194304] 0 2024-09-17T07:19:52.967 INFO:tasks.workunit.client.0.smithi087.stdout:4/371: readlink d2/lf 0 2024-09-17T07:19:52.968 INFO:tasks.workunit.client.0.smithi087.stdout:4/372: chown d2/d22/d2c/d3f/d4d/d42 321 1 2024-09-17T07:19:52.969 INFO:tasks.workunit.client.1.smithi139.stdout:1/201: symlink d2/d10/d12/d13/l3c 0 2024-09-17T07:19:52.969 INFO:tasks.workunit.client.0.smithi087.stdout:6/532: rmdir d1/d6a 39 2024-09-17T07:19:52.970 INFO:tasks.workunit.client.1.smithi139.stdout:5/242: mknod d4/d16/d1b/d20/d32/d3d/c48 0 2024-09-17T07:19:52.970 INFO:tasks.workunit.client.0.smithi087.stdout:4/373: dread - d2/d22/d2c/d3f/d4f/f5c zero size 2024-09-17T07:19:52.970 INFO:tasks.workunit.client.0.smithi087.stdout:5/518: dread d5/f1b [0,4194304] 0 2024-09-17T07:19:52.971 INFO:tasks.workunit.client.1.smithi139.stdout:3/281: link d5/d15/d16/l55 d5/d15/d16/d4c/d28/d54/l60 0 2024-09-17T07:19:52.971 INFO:tasks.workunit.client.0.smithi087.stdout:6/533: dread - d1/d67/f69 zero size 2024-09-17T07:19:52.974 INFO:tasks.workunit.client.0.smithi087.stdout:4/374: unlink d2/d22/d2c/d3f/d4d/d3e/f84 0 2024-09-17T07:19:52.975 INFO:tasks.workunit.client.0.smithi087.stdout:5/519: chown d5/d18/d20/d2f/f48 2602 1 2024-09-17T07:19:52.976 INFO:tasks.workunit.client.1.smithi139.stdout:5/243: mknod d4/d16/d1b/d20/d28/d3f/c49 0 2024-09-17T07:19:52.977 INFO:tasks.workunit.client.0.smithi087.stdout:4/375: symlink d2/d22/d2c/d3f/d4d/d21/l89 0 2024-09-17T07:19:52.978 INFO:tasks.workunit.client.0.smithi087.stdout:6/534: read d1/d6/d1a/d2c/d40/f49 [3042445,76949] 0 2024-09-17T07:19:52.979 INFO:tasks.workunit.client.0.smithi087.stdout:5/520: creat d5/fa9 x:0 0 0 2024-09-17T07:19:52.982 INFO:tasks.workunit.client.0.smithi087.stdout:5/521: unlink d5/d8/l41 0 2024-09-17T07:19:52.982 INFO:tasks.workunit.client.1.smithi139.stdout:5/244: symlink d4/d16/l4a 0 2024-09-17T07:19:52.982 INFO:tasks.workunit.client.1.smithi139.stdout:8/374: dread d0/dc/d18/f38 [0,4194304] 0 2024-09-17T07:19:52.983 INFO:tasks.workunit.client.1.smithi139.stdout:1/202: truncate d2/d10/d12/d1a/f21 1326838 0 2024-09-17T07:19:52.984 INFO:tasks.workunit.client.1.smithi139.stdout:5/245: truncate d4/f36 1101094 0 2024-09-17T07:19:52.986 INFO:tasks.workunit.client.0.smithi087.stdout:5/522: creat d5/d6d/faa x:0 0 0 2024-09-17T07:19:52.987 INFO:tasks.workunit.client.0.smithi087.stdout:4/376: dwrite d2/d22/d2c/d3f/f5f [0,4194304] 0 2024-09-17T07:19:52.989 INFO:tasks.workunit.client.0.smithi087.stdout:5/523: creat d5/d12/d1c/fab x:0 0 0 2024-09-17T07:19:52.990 INFO:tasks.workunit.client.1.smithi139.stdout:5/246: rename d4/fd to d4/d16/d1b/d20/d38/f4b 0 2024-09-17T07:19:52.990 INFO:tasks.workunit.client.0.smithi087.stdout:5/524: write d5/d8/f3f [6986704,51670] 0 2024-09-17T07:19:52.991 INFO:tasks.workunit.client.1.smithi139.stdout:3/282: dwrite d5/d15/d16/d4c/d28/f5b [0,4194304] 0 2024-09-17T07:19:52.992 INFO:tasks.workunit.client.0.smithi087.stdout:0/545: sync 2024-09-17T07:19:52.992 INFO:tasks.workunit.client.0.smithi087.stdout:1/355: sync 2024-09-17T07:19:52.992 INFO:tasks.workunit.client.0.smithi087.stdout:7/322: sync 2024-09-17T07:19:52.992 INFO:tasks.workunit.client.0.smithi087.stdout:8/456: sync 2024-09-17T07:19:52.992 INFO:tasks.workunit.client.0.smithi087.stdout:3/341: sync 2024-09-17T07:19:52.993 INFO:tasks.workunit.client.0.smithi087.stdout:2/423: sync 2024-09-17T07:19:52.993 INFO:tasks.workunit.client.0.smithi087.stdout:9/310: sync 2024-09-17T07:19:52.993 INFO:tasks.workunit.client.0.smithi087.stdout:4/377: rename d2/d22/d2c/d3f/d4f/f54 to d2/d22/d2c/d3f/d4d/f8a 0 2024-09-17T07:19:52.993 INFO:tasks.workunit.client.0.smithi087.stdout:8/457: fsync d1/d2b/d21/d6d/d6f/f90 0 2024-09-17T07:19:52.994 INFO:tasks.workunit.client.0.smithi087.stdout:6/535: truncate d1/d6/d1a/f28 1410480 0 2024-09-17T07:19:52.995 INFO:tasks.workunit.client.1.smithi139.stdout:1/203: unlink d2/f27 0 2024-09-17T07:19:52.995 INFO:tasks.workunit.client.0.smithi087.stdout:1/356: mknod d2/d3d/c81 0 2024-09-17T07:19:52.996 INFO:tasks.workunit.client.0.smithi087.stdout:2/424: fdatasync d2/d7/d30/f4e 0 2024-09-17T07:19:52.997 INFO:tasks.workunit.client.0.smithi087.stdout:0/546: creat db/dbe/fcc x:0 0 0 2024-09-17T07:19:53.000 INFO:tasks.workunit.client.0.smithi087.stdout:3/342: creat d6/d15/d37/d3c/f6c x:0 0 0 2024-09-17T07:19:53.002 INFO:tasks.workunit.client.0.smithi087.stdout:6/536: truncate d1/d6/f2b 5145793 0 2024-09-17T07:19:53.003 INFO:tasks.workunit.client.0.smithi087.stdout:2/425: truncate d2/d50/f74 715458 0 2024-09-17T07:19:53.005 INFO:tasks.workunit.client.1.smithi139.stdout:8/375: dwrite d0/f9 [0,4194304] 0 2024-09-17T07:19:53.006 INFO:tasks.workunit.client.1.smithi139.stdout:5/247: dwrite d4/d16/f1d [0,4194304] 0 2024-09-17T07:19:53.007 INFO:tasks.workunit.client.0.smithi087.stdout:9/311: symlink d3/d4/d6/d8/d22/d43/l6d 0 2024-09-17T07:19:53.010 INFO:tasks.workunit.client.1.smithi139.stdout:1/204: write d2/fd [1040667,111494] 0 2024-09-17T07:19:53.012 INFO:tasks.workunit.client.1.smithi139.stdout:8/376: creat d0/d1a/d3a/d71/f75 x:0 0 0 2024-09-17T07:19:53.012 INFO:tasks.workunit.client.0.smithi087.stdout:3/343: write d6/d16/f38 [837881,130863] 0 2024-09-17T07:19:53.014 INFO:tasks.workunit.client.1.smithi139.stdout:5/248: write d4/d16/d1b/d20/d28/f26 [5052267,18249] 0 2024-09-17T07:19:53.017 INFO:tasks.workunit.client.0.smithi087.stdout:4/378: rename d2/d22/d2c/d3f/d4d/d21/f76 to d2/d22/d2c/d3f/d4d/d3e/f8b 0 2024-09-17T07:19:53.017 INFO:tasks.workunit.client.1.smithi139.stdout:1/205: mkdir d2/d10/d12/d24/d38/d3d 0 2024-09-17T07:19:53.018 INFO:tasks.workunit.client.1.smithi139.stdout:5/249: chown d4/d16/d1b/d20/d38/l42 1284 1 2024-09-17T07:19:53.018 INFO:tasks.workunit.client.1.smithi139.stdout:3/283: dwrite d5/d21/d23/f47 [0,4194304] 0 2024-09-17T07:19:53.018 INFO:tasks.workunit.client.0.smithi087.stdout:1/357: write d2/d48/d61/f76 [854932,69618] 0 2024-09-17T07:19:53.020 INFO:tasks.workunit.client.1.smithi139.stdout:1/206: read d2/f7 [1016881,43206] 0 2024-09-17T07:19:53.020 INFO:tasks.workunit.client.1.smithi139.stdout:3/284: chown d5/d21/d23/f49 3694 1 2024-09-17T07:19:53.020 INFO:tasks.workunit.client.0.smithi087.stdout:5/525: dwrite d5/d18/f4a [0,4194304] 0 2024-09-17T07:19:53.020 INFO:tasks.workunit.client.0.smithi087.stdout:9/312: fsync d3/d4/fb 0 2024-09-17T07:19:53.020 INFO:tasks.workunit.client.0.smithi087.stdout:2/426: symlink d2/d7/dd/d10/d4c/l83 0 2024-09-17T07:19:53.021 INFO:tasks.workunit.client.1.smithi139.stdout:8/377: read d0/fb [1239543,72976] 0 2024-09-17T07:19:53.023 INFO:tasks.workunit.client.1.smithi139.stdout:3/285: mknod d5/d21/d23/c61 0 2024-09-17T07:19:53.024 INFO:tasks.workunit.client.1.smithi139.stdout:8/378: symlink d0/d20/l76 0 2024-09-17T07:19:53.025 INFO:tasks.workunit.client.1.smithi139.stdout:1/207: fsync d2/d10/d12/d1a/f36 0 2024-09-17T07:19:53.026 INFO:tasks.workunit.client.0.smithi087.stdout:2/427: chown d2/d15/d34 492449460 1 2024-09-17T07:19:53.026 INFO:tasks.workunit.client.1.smithi139.stdout:5/250: unlink d4/d16/d1b/d20/d28/c11 0 2024-09-17T07:19:53.027 INFO:tasks.workunit.client.0.smithi087.stdout:6/537: rename d1/d6/d1a/d4e/f5d to d1/d6/d1a/d2c/d40/d4c/da1/fc3 0 2024-09-17T07:19:53.027 INFO:tasks.workunit.client.1.smithi139.stdout:5/251: dread - d4/d16/f2b zero size 2024-09-17T07:19:53.029 INFO:tasks.workunit.client.0.smithi087.stdout:0/547: link db/da3/cbb db/d45/d7b/db0/ccd 0 2024-09-17T07:19:53.030 INFO:tasks.workunit.client.1.smithi139.stdout:8/379: creat d0/d1a/f77 x:0 0 0 2024-09-17T07:19:53.031 INFO:tasks.workunit.client.1.smithi139.stdout:3/286: getdents d5/d15/d20/d3b 0 2024-09-17T07:19:53.032 INFO:tasks.workunit.client.1.smithi139.stdout:3/287: write d5/f1d [3089845,18920] 0 2024-09-17T07:19:53.033 INFO:tasks.workunit.client.1.smithi139.stdout:8/380: mknod d0/d1a/c78 0 2024-09-17T07:19:53.034 INFO:tasks.workunit.client.1.smithi139.stdout:5/252: dread d4/d16/f19 [0,4194304] 0 2024-09-17T07:19:53.034 INFO:tasks.workunit.client.0.smithi087.stdout:1/358: symlink d2/d3d/d35/d4f/l82 0 2024-09-17T07:19:53.034 INFO:tasks.workunit.client.0.smithi087.stdout:5/526: write d5/d12/d14/f7b [3766068,43330] 0 2024-09-17T07:19:53.035 INFO:tasks.workunit.client.1.smithi139.stdout:3/288: read - d5/d15/d16/d4c/f4b zero size 2024-09-17T07:19:53.035 INFO:tasks.workunit.client.1.smithi139.stdout:8/381: creat d0/dc/d18/f79 x:0 0 0 2024-09-17T07:19:53.038 INFO:tasks.workunit.client.0.smithi087.stdout:2/428: truncate d2/d24/d36/f38 905367 0 2024-09-17T07:19:53.038 INFO:tasks.workunit.client.1.smithi139.stdout:5/253: write d4/f17 [7348357,96058] 0 2024-09-17T07:19:53.038 INFO:tasks.workunit.client.1.smithi139.stdout:3/289: fsync d5/f2b 0 2024-09-17T07:19:53.038 INFO:tasks.workunit.client.1.smithi139.stdout:8/382: write d0/d20/d28/d52/d65/f70 [770743,52200] 0 2024-09-17T07:19:53.039 INFO:tasks.workunit.client.0.smithi087.stdout:6/538: chown d1/d6/d1a/d2c/d40/d4c/l9e 5823801 1 2024-09-17T07:19:53.043 INFO:tasks.workunit.client.0.smithi087.stdout:5/527: unlink d5/d12/f88 0 2024-09-17T07:19:53.043 INFO:tasks.workunit.client.0.smithi087.stdout:7/323: dread d0/f44 [0,4194304] 0 2024-09-17T07:19:53.043 INFO:tasks.workunit.client.0.smithi087.stdout:9/313: dwrite d3/d4/d2f/f39 [0,4194304] 0 2024-09-17T07:19:53.044 INFO:tasks.workunit.client.0.smithi087.stdout:0/548: symlink db/d45/d7b/d90/lce 0 2024-09-17T07:19:53.046 INFO:tasks.workunit.client.0.smithi087.stdout:5/528: fdatasync d5/d12/d4d/f47 0 2024-09-17T07:19:53.046 INFO:tasks.workunit.client.0.smithi087.stdout:6/539: read d1/d6/d1a/d2c/d33/f3d [30942,38431] 0 2024-09-17T07:19:53.046 INFO:tasks.workunit.client.1.smithi139.stdout:8/383: creat d0/dc/f7a x:0 0 0 2024-09-17T07:19:53.048 INFO:tasks.workunit.client.0.smithi087.stdout:3/344: link d6/d1b/d2b/c6b d6/d15/d37/d3c/d43/c6d 0 2024-09-17T07:19:53.049 INFO:tasks.workunit.client.1.smithi139.stdout:3/290: getdents d5 0 2024-09-17T07:19:53.050 INFO:tasks.workunit.client.1.smithi139.stdout:5/254: dwrite d4/d16/d1b/d20/d28/f3e [0,4194304] 0 2024-09-17T07:19:53.050 INFO:tasks.workunit.client.0.smithi087.stdout:7/324: dread d0/f6 [0,4194304] 0 2024-09-17T07:19:53.051 INFO:tasks.workunit.client.0.smithi087.stdout:9/314: rmdir d3/d4/da 39 2024-09-17T07:19:53.051 INFO:tasks.workunit.client.1.smithi139.stdout:3/291: dread - d5/d15/d20/f42 zero size 2024-09-17T07:19:53.052 INFO:tasks.workunit.client.0.smithi087.stdout:0/549: write db/d45/f75 [67348,89954] 0 2024-09-17T07:19:53.052 INFO:tasks.workunit.client.1.smithi139.stdout:8/384: write d0/d1a/f39 [1373881,82495] 0 2024-09-17T07:19:53.053 INFO:tasks.workunit.client.1.smithi139.stdout:1/208: write d2/d10/d12/d1a/f30 [1253,75816] 0 2024-09-17T07:19:53.055 INFO:tasks.workunit.client.0.smithi087.stdout:1/359: rename d2/d14/dd/f78 to d2/da/d7e/f83 0 2024-09-17T07:19:53.058 INFO:tasks.workunit.client.1.smithi139.stdout:3/292: write d5/d15/d16/f17 [2332355,10415] 0 2024-09-17T07:19:53.058 INFO:tasks.workunit.client.1.smithi139.stdout:5/255: creat d4/d16/d1b/d20/d32/f4c x:0 0 0 2024-09-17T07:19:53.058 INFO:tasks.workunit.client.0.smithi087.stdout:3/345: write d6/d1b/d42/d62/f6a [589799,121663] 0 2024-09-17T07:19:53.058 INFO:tasks.workunit.client.0.smithi087.stdout:4/379: dwrite d2/d22/d2c/d3f/d4d/d2d/f5d [0,4194304] 0 2024-09-17T07:19:53.060 INFO:tasks.workunit.client.0.smithi087.stdout:6/540: write d1/d6/d1a/d2c/d48/f72 [4779569,73487] 0 2024-09-17T07:19:53.061 INFO:tasks.workunit.client.1.smithi139.stdout:5/256: read d4/d16/d1b/d20/f24 [440726,86675] 0 2024-09-17T07:19:53.061 INFO:tasks.workunit.client.0.smithi087.stdout:2/429: link d2/f67 d2/d7/dd/d10/d4c/d6c/f84 0 2024-09-17T07:19:53.063 INFO:tasks.workunit.client.0.smithi087.stdout:0/550: chown db/d45/d5b/c61 12323539 1 2024-09-17T07:19:53.065 INFO:tasks.workunit.client.0.smithi087.stdout:8/458: dread d1/d7/d9/d19/f4e [0,4194304] 0 2024-09-17T07:19:53.065 INFO:tasks.workunit.client.0.smithi087.stdout:3/346: fsync d6/fd 0 2024-09-17T07:19:53.065 INFO:tasks.workunit.client.0.smithi087.stdout:9/315: dread d3/f1f [0,4194304] 0 2024-09-17T07:19:53.066 INFO:tasks.workunit.client.1.smithi139.stdout:1/209: dwrite d2/ff [0,4194304] 0 2024-09-17T07:19:53.066 INFO:tasks.workunit.client.1.smithi139.stdout:3/293: dread d5/d21/d23/d38/f40 [0,4194304] 0 2024-09-17T07:19:53.066 INFO:tasks.workunit.client.1.smithi139.stdout:5/257: unlink d4/d16/d1b/d20/d38/f45 0 2024-09-17T07:19:53.068 INFO:tasks.workunit.client.1.smithi139.stdout:8/385: write d0/dc/f4b [89507,21060] 0 2024-09-17T07:19:53.069 INFO:tasks.workunit.client.0.smithi087.stdout:3/347: read d6/d15/d4b/f4c [14183,72595] 0 2024-09-17T07:19:53.070 INFO:tasks.workunit.client.1.smithi139.stdout:8/386: dread - d0/dc/f7a zero size 2024-09-17T07:19:53.070 INFO:tasks.workunit.client.0.smithi087.stdout:8/459: read d1/d2b/f46 [1683150,3803] 0 2024-09-17T07:19:53.071 INFO:tasks.workunit.client.1.smithi139.stdout:5/258: creat d4/d16/d1b/d20/d28/f4d x:0 0 0 2024-09-17T07:19:53.071 INFO:tasks.workunit.client.0.smithi087.stdout:8/460: chown d1/d2b/l55 0 1 2024-09-17T07:19:53.072 INFO:tasks.workunit.client.0.smithi087.stdout:8/461: readlink d1/d7/d9/d19/d1b/l3d 0 2024-09-17T07:19:53.073 INFO:tasks.workunit.client.1.smithi139.stdout:3/294: getdents d5 0 2024-09-17T07:19:53.074 INFO:tasks.workunit.client.0.smithi087.stdout:7/325: rename d0/d3/d10/d32/d67 to d0/d3/d10/d32/d62/d6b 0 2024-09-17T07:19:53.074 INFO:tasks.workunit.client.1.smithi139.stdout:5/259: write d4/d16/d1b/d20/d38/f3b [1685286,29517] 0 2024-09-17T07:19:53.074 INFO:tasks.workunit.client.1.smithi139.stdout:1/210: getdents d2/d10/d12/d35/d2b 0 2024-09-17T07:19:53.076 INFO:tasks.workunit.client.1.smithi139.stdout:8/387: rename d0/dc/d18/f55 to d0/d20/d28/d52/d65/f7b 0 2024-09-17T07:19:53.077 INFO:tasks.workunit.client.1.smithi139.stdout:1/211: mknod d2/d10/d12/d1a/c3e 0 2024-09-17T07:19:53.078 INFO:tasks.workunit.client.0.smithi087.stdout:2/430: mkdir d2/d12/d85 0 2024-09-17T07:19:53.079 INFO:tasks.workunit.client.1.smithi139.stdout:3/295: dread d5/d15/f33 [0,4194304] 0 2024-09-17T07:19:53.079 INFO:tasks.workunit.client.1.smithi139.stdout:1/212: write f0 [4576556,59995] 0 2024-09-17T07:19:53.079 INFO:tasks.workunit.client.1.smithi139.stdout:8/388: creat d0/d1a/d3a/f7c x:0 0 0 2024-09-17T07:19:53.082 INFO:tasks.workunit.client.0.smithi087.stdout:9/316: truncate d3/d4/d6/d8/d12/d32/f33 230844 0 2024-09-17T07:19:53.083 INFO:tasks.workunit.client.1.smithi139.stdout:3/296: readlink d5/d15/d16/d4c/l2e 0 2024-09-17T07:19:53.083 INFO:tasks.workunit.client.0.smithi087.stdout:6/541: rmdir d1/d6/d1a/d2c/d40/d4c/da1 39 2024-09-17T07:19:53.083 INFO:tasks.workunit.client.0.smithi087.stdout:9/317: dread - d3/d4/d6/d8/d12/d38/f56 zero size 2024-09-17T07:19:53.084 INFO:tasks.workunit.client.1.smithi139.stdout:8/389: unlink d0/d1a/d3a/f62 0 2024-09-17T07:19:53.085 INFO:tasks.workunit.client.0.smithi087.stdout:0/551: rename db/d45/d5b/d92/cb6 to db/d45/d9e/d86/ccf 0 2024-09-17T07:19:53.085 INFO:tasks.workunit.client.1.smithi139.stdout:3/297: dread d5/d21/f48 [0,4194304] 0 2024-09-17T07:19:53.086 INFO:tasks.workunit.client.0.smithi087.stdout:2/431: chown d2/d7/c2b 1116 1 2024-09-17T07:19:53.087 INFO:tasks.workunit.client.0.smithi087.stdout:6/542: symlink d1/d67/lc4 0 2024-09-17T07:19:53.088 INFO:tasks.workunit.client.1.smithi139.stdout:8/390: unlink d0/fb 0 2024-09-17T07:19:53.088 INFO:tasks.workunit.client.1.smithi139.stdout:1/213: dwrite d2/f15 [0,4194304] 0 2024-09-17T07:19:53.088 INFO:tasks.workunit.client.0.smithi087.stdout:2/432: dread - d2/d7/dd/d10/d4c/d6c/f84 zero size 2024-09-17T07:19:53.089 INFO:tasks.workunit.client.1.smithi139.stdout:1/214: fsync d2/d10/d12/d1a/f36 0 2024-09-17T07:19:53.089 INFO:tasks.workunit.client.0.smithi087.stdout:0/552: chown db/d45/d5b/d92/fa8 6646 1 2024-09-17T07:19:53.091 INFO:tasks.workunit.client.0.smithi087.stdout:4/380: creat d2/d22/d2c/d3f/d4d/d21/d2f/f8c x:0 0 0 2024-09-17T07:19:53.093 INFO:tasks.workunit.client.0.smithi087.stdout:6/543: rmdir d1/d6/d1a/d2c/d40/d4c 39 2024-09-17T07:19:53.094 INFO:tasks.workunit.client.0.smithi087.stdout:9/318: write d3/d4/da/f55 [632445,81519] 0 2024-09-17T07:19:53.096 INFO:tasks.workunit.client.0.smithi087.stdout:1/360: dread d2/d14/dd/ff [4194304,4194304] 0 2024-09-17T07:19:53.097 INFO:tasks.workunit.client.0.smithi087.stdout:2/433: creat d2/d7/dd/d6a/d6d/f86 x:0 0 0 2024-09-17T07:19:53.098 INFO:tasks.workunit.client.1.smithi139.stdout:8/391: dwrite d0/dc/f7a [0,4194304] 0 2024-09-17T07:19:53.101 INFO:tasks.workunit.client.0.smithi087.stdout:8/462: getdents d1/d2b/d21/d6d 0 2024-09-17T07:19:53.103 INFO:tasks.workunit.client.0.smithi087.stdout:5/529: truncate d5/f19 1391078 0 2024-09-17T07:19:53.103 INFO:tasks.workunit.client.1.smithi139.stdout:8/392: creat d0/f7d x:0 0 0 2024-09-17T07:19:53.104 INFO:tasks.workunit.client.0.smithi087.stdout:1/361: readlink d2/l6d 0 2024-09-17T07:19:53.104 INFO:tasks.workunit.client.1.smithi139.stdout:3/298: dread d5/d15/d16/f17 [0,4194304] 0 2024-09-17T07:19:53.104 INFO:tasks.workunit.client.1.smithi139.stdout:1/215: dread d2/fd [0,4194304] 0 2024-09-17T07:19:53.106 INFO:tasks.workunit.client.0.smithi087.stdout:2/434: creat d2/d15/d34/f87 x:0 0 0 2024-09-17T07:19:53.106 INFO:tasks.workunit.client.0.smithi087.stdout:9/319: symlink d3/d4/d6/d8/d22/d43/l6e 0 2024-09-17T07:19:53.107 INFO:tasks.workunit.client.1.smithi139.stdout:1/216: truncate d2/d10/d12/d1a/f36 109726 0 2024-09-17T07:19:53.107 INFO:tasks.workunit.client.0.smithi087.stdout:6/544: dwrite d1/d6/d1a/d4e/f50 [0,4194304] 0 2024-09-17T07:19:53.109 INFO:tasks.workunit.client.0.smithi087.stdout:1/362: write d2/d14/dd/d37/f54 [2214260,27950] 0 2024-09-17T07:19:53.109 INFO:tasks.workunit.client.0.smithi087.stdout:2/435: fsync d2/d7/dd/d10/d4c/d6c/f81 0 2024-09-17T07:19:53.109 INFO:tasks.workunit.client.1.smithi139.stdout:1/217: dread - d2/d10/d12/d35/d2b/f34 zero size 2024-09-17T07:19:53.110 INFO:tasks.workunit.client.0.smithi087.stdout:3/348: write d6/d15/d37/d3c/f54 [5036435,27295] 0 2024-09-17T07:19:53.111 INFO:tasks.workunit.client.0.smithi087.stdout:0/553: rmdir db/d45/d5b/d92 39 2024-09-17T07:19:53.112 INFO:tasks.workunit.client.1.smithi139.stdout:1/218: readlink d2/d10/d12/d13/l3c 0 2024-09-17T07:19:53.112 INFO:tasks.workunit.client.0.smithi087.stdout:2/436: fdatasync d2/d50/f74 0 2024-09-17T07:19:53.113 INFO:tasks.workunit.client.0.smithi087.stdout:8/463: mkdir d1/d7/d9/d27/da1 0 2024-09-17T07:19:53.114 INFO:tasks.workunit.client.0.smithi087.stdout:7/326: dread d0/d3/d23/f53 [0,4194304] 0 2024-09-17T07:19:53.115 INFO:tasks.workunit.client.1.smithi139.stdout:8/393: dwrite d0/d1a/f4a [4194304,4194304] 0 2024-09-17T07:19:53.115 INFO:tasks.workunit.client.0.smithi087.stdout:5/530: mkdir d5/d18/d20/d2f/d83/dac 0 2024-09-17T07:19:53.115 INFO:tasks.workunit.client.0.smithi087.stdout:8/464: readlink d1/d7/d9/d27/l3f 0 2024-09-17T07:19:53.118 INFO:tasks.workunit.client.1.smithi139.stdout:3/299: dwrite d5/d15/f33 [0,4194304] 0 2024-09-17T07:19:53.120 INFO:tasks.workunit.client.1.smithi139.stdout:8/394: readlink d0/dc/l49 0 2024-09-17T07:19:53.122 INFO:tasks.workunit.client.0.smithi087.stdout:0/554: write db/f17 [1462548,53169] 0 2024-09-17T07:19:53.124 INFO:tasks.workunit.client.0.smithi087.stdout:8/465: write d1/d7/d9/fc [192589,129467] 0 2024-09-17T07:19:53.124 INFO:tasks.workunit.client.0.smithi087.stdout:1/363: dwrite d2/d3d/d35/d57/d73/f77 [0,4194304] 0 2024-09-17T07:19:53.124 INFO:tasks.workunit.client.0.smithi087.stdout:3/349: mkdir d6/d1b/d42/d6e 0 2024-09-17T07:19:53.125 INFO:tasks.workunit.client.1.smithi139.stdout:3/300: link d5/f3c d5/d15/f62 0 2024-09-17T07:19:53.128 INFO:tasks.workunit.client.1.smithi139.stdout:8/395: symlink d0/dc/d18/l7e 0 2024-09-17T07:19:53.128 INFO:tasks.workunit.client.1.smithi139.stdout:3/301: mkdir d5/d63 0 2024-09-17T07:19:53.129 INFO:tasks.workunit.client.1.smithi139.stdout:8/396: fdatasync d0/dc/d18/f38 0 2024-09-17T07:19:53.129 INFO:tasks.workunit.client.1.smithi139.stdout:3/302: dread - d5/d15/f62 zero size 2024-09-17T07:19:53.131 INFO:tasks.workunit.client.1.smithi139.stdout:3/303: fsync d5/d15/d16/d4c/f4b 0 2024-09-17T07:19:53.131 INFO:tasks.workunit.client.1.smithi139.stdout:1/219: truncate f0 3477847 0 2024-09-17T07:19:53.133 INFO:tasks.workunit.client.0.smithi087.stdout:4/381: getdents d2/d5/d1f 0 2024-09-17T07:19:53.135 INFO:tasks.workunit.client.0.smithi087.stdout:2/437: creat d2/d7/dd/d10/f88 x:0 0 0 2024-09-17T07:19:53.135 INFO:tasks.workunit.client.1.smithi139.stdout:8/397: mkdir d0/d20/d28/d52/d65/d7f 0 2024-09-17T07:19:53.138 INFO:tasks.workunit.client.0.smithi087.stdout:5/531: mkdir d5/d18/dad 0 2024-09-17T07:19:53.139 INFO:tasks.workunit.client.1.smithi139.stdout:3/304: dread d5/d15/d16/d4c/d28/f30 [0,4194304] 0 2024-09-17T07:19:53.140 INFO:tasks.workunit.client.1.smithi139.stdout:8/398: write d0/dc/d18/f79 [882375,38384] 0 2024-09-17T07:19:53.140 INFO:tasks.workunit.client.0.smithi087.stdout:1/364: creat d2/d14/dd/d43/d5d/f84 x:0 0 0 2024-09-17T07:19:53.140 INFO:tasks.workunit.client.0.smithi087.stdout:8/466: mknod d1/d2b/d21/d6d/d6f/d7f/d54/ca2 0 2024-09-17T07:19:53.141 INFO:tasks.workunit.client.0.smithi087.stdout:3/350: dwrite d6/d1b/f67 [0,4194304] 0 2024-09-17T07:19:53.142 INFO:tasks.workunit.client.0.smithi087.stdout:0/555: dwrite db/d45/f68 [0,4194304] 0 2024-09-17T07:19:53.143 INFO:tasks.workunit.client.1.smithi139.stdout:3/305: creat d5/f64 x:0 0 0 2024-09-17T07:19:53.144 INFO:tasks.workunit.client.0.smithi087.stdout:3/351: stat d6/d1b/d2b/f39 0 2024-09-17T07:19:53.144 INFO:tasks.workunit.client.1.smithi139.stdout:8/399: stat d0/dc/c3e 0 2024-09-17T07:19:53.145 INFO:tasks.workunit.client.1.smithi139.stdout:8/400: stat d0/dc 0 2024-09-17T07:19:53.145 INFO:tasks.workunit.client.0.smithi087.stdout:5/532: creat d5/d12/d1c/fae x:0 0 0 2024-09-17T07:19:53.146 INFO:tasks.workunit.client.1.smithi139.stdout:1/220: getdents d2 0 2024-09-17T07:19:53.146 INFO:tasks.workunit.client.1.smithi139.stdout:3/306: rmdir d5/d15/d16/d4c/d28/d54 39 2024-09-17T07:19:53.147 INFO:tasks.workunit.client.0.smithi087.stdout:0/556: readlink db/l36 0 2024-09-17T07:19:53.147 INFO:tasks.workunit.client.1.smithi139.stdout:3/307: symlink d5/d15/d56/l65 0 2024-09-17T07:19:53.148 INFO:tasks.workunit.client.1.smithi139.stdout:8/401: mknod d0/d20/d28/c80 0 2024-09-17T07:19:53.149 INFO:tasks.workunit.client.1.smithi139.stdout:3/308: write d5/d21/d23/f47 [4858233,45997] 0 2024-09-17T07:19:53.150 INFO:tasks.workunit.client.1.smithi139.stdout:3/309: dread - d5/f64 zero size 2024-09-17T07:19:53.153 INFO:tasks.workunit.client.0.smithi087.stdout:2/438: dwrite d2/d24/f7d [0,4194304] 0 2024-09-17T07:19:53.155 INFO:tasks.workunit.client.1.smithi139.stdout:1/221: mknod d2/d10/d12/d24/d38/d3d/c3f 0 2024-09-17T07:19:53.156 INFO:tasks.workunit.client.0.smithi087.stdout:1/365: getdents d2/d3d 0 2024-09-17T07:19:53.156 INFO:tasks.workunit.client.0.smithi087.stdout:9/320: dread d3/d4/f26 [0,4194304] 0 2024-09-17T07:19:53.156 INFO:tasks.workunit.client.0.smithi087.stdout:5/533: mkdir d5/d12/d4d/d8c/daf 0 2024-09-17T07:19:53.161 INFO:tasks.workunit.client.0.smithi087.stdout:8/467: dwrite d1/d7/f13 [0,4194304] 0 2024-09-17T07:19:53.162 INFO:tasks.workunit.client.1.smithi139.stdout:8/402: dwrite d0/dc/f6b [0,4194304] 0 2024-09-17T07:19:53.165 INFO:tasks.workunit.client.0.smithi087.stdout:2/439: mknod d2/d24/d36/c89 0 2024-09-17T07:19:53.166 INFO:tasks.workunit.client.0.smithi087.stdout:5/534: chown d5/d12/d1c/l96 0 1 2024-09-17T07:19:53.167 INFO:tasks.workunit.client.1.smithi139.stdout:1/222: mknod d2/d10/d12/d24/d38/c40 0 2024-09-17T07:19:53.167 INFO:tasks.workunit.client.1.smithi139.stdout:3/310: dwrite d5/d21/d23/f57 [0,4194304] 0 2024-09-17T07:19:53.167 INFO:tasks.workunit.client.0.smithi087.stdout:6/545: dwrite d1/f35 [0,4194304] 0 2024-09-17T07:19:53.170 INFO:tasks.workunit.client.1.smithi139.stdout:8/403: read - d0/d1a/d3a/f7c zero size 2024-09-17T07:19:53.171 INFO:tasks.workunit.client.0.smithi087.stdout:8/468: write d1/d7/d9/d27/f45 [254347,20987] 0 2024-09-17T07:19:53.172 INFO:tasks.workunit.client.1.smithi139.stdout:8/404: stat d0/d20/f5f 0 2024-09-17T07:19:53.174 INFO:tasks.workunit.client.0.smithi087.stdout:9/321: mknod d3/d4/da/c6f 0 2024-09-17T07:19:53.175 INFO:tasks.workunit.client.0.smithi087.stdout:7/327: dwrite d0/d3/d10/d32/f56 [0,4194304] 0 2024-09-17T07:19:53.175 INFO:tasks.workunit.client.0.smithi087.stdout:5/535: write d5/f15 [5166336,112754] 0 2024-09-17T07:19:53.176 INFO:tasks.workunit.client.0.smithi087.stdout:6/546: dread - d1/d6/d1a/d2c/d48/f8c zero size 2024-09-17T07:19:53.177 INFO:tasks.workunit.client.0.smithi087.stdout:7/328: stat d0/d3/d23/d2d 0 2024-09-17T07:19:53.179 INFO:tasks.workunit.client.1.smithi139.stdout:3/311: creat d5/d15/d16/d4c/f66 x:0 0 0 2024-09-17T07:19:53.183 INFO:tasks.workunit.client.1.smithi139.stdout:8/405: dwrite d0/dc/f34 [0,4194304] 0 2024-09-17T07:19:53.185 INFO:tasks.workunit.client.1.smithi139.stdout:8/406: truncate d0/dc/d18/f79 1095785 0 2024-09-17T07:19:53.187 INFO:tasks.workunit.client.0.smithi087.stdout:3/352: fsync d6/d1b/f67 0 2024-09-17T07:19:53.188 INFO:tasks.workunit.client.1.smithi139.stdout:3/312: read d5/d15/d16/d4c/d28/f52 [3099477,86872] 0 2024-09-17T07:19:53.188 INFO:tasks.workunit.client.0.smithi087.stdout:0/557: dwrite db/f1b [0,4194304] 0 2024-09-17T07:19:53.188 INFO:tasks.workunit.client.0.smithi087.stdout:2/440: creat d2/f8a x:0 0 0 2024-09-17T07:19:53.189 INFO:tasks.workunit.client.0.smithi087.stdout:9/322: write d3/d4/f26 [1792836,57868] 0 2024-09-17T07:19:53.191 INFO:tasks.workunit.client.0.smithi087.stdout:3/353: stat d6/d15/f60 0 2024-09-17T07:19:53.192 INFO:tasks.workunit.client.0.smithi087.stdout:1/366: getdents d2/d3d 0 2024-09-17T07:19:53.192 INFO:tasks.workunit.client.0.smithi087.stdout:3/354: fdatasync d6/f12 0 2024-09-17T07:19:53.193 INFO:tasks.workunit.client.0.smithi087.stdout:6/547: rmdir d1/d6/d1a/d2c/d48/d9b 39 2024-09-17T07:19:53.194 INFO:tasks.workunit.client.0.smithi087.stdout:8/469: creat d1/d7/d9/d19/d1b/d18/fa3 x:0 0 0 2024-09-17T07:19:53.194 INFO:tasks.workunit.client.0.smithi087.stdout:5/536: rename d5/d18/d20/d2f/d52/f8e to d5/d18/d20/d2f/d83/fb0 0 2024-09-17T07:19:53.197 INFO:tasks.workunit.client.1.smithi139.stdout:8/407: fdatasync d0/d20/d28/d52/d65/f7b 0 2024-09-17T07:19:53.197 INFO:tasks.workunit.client.1.smithi139.stdout:1/223: truncate d2/f11 1123954 0 2024-09-17T07:19:53.199 INFO:tasks.workunit.client.0.smithi087.stdout:0/558: mkdir db/d45/d7b/db0/dd0 0 2024-09-17T07:19:53.199 INFO:tasks.workunit.client.1.smithi139.stdout:1/224: creat d2/d10/d12/d35/d2b/f41 x:0 0 0 2024-09-17T07:19:53.200 INFO:tasks.workunit.client.0.smithi087.stdout:5/537: stat d5/d6d/c79 0 2024-09-17T07:19:53.201 INFO:tasks.workunit.client.1.smithi139.stdout:8/408: truncate d0/dc/d18/f38 3721940 0 2024-09-17T07:19:53.203 INFO:tasks.workunit.client.0.smithi087.stdout:3/355: creat d6/d15/d37/d3c/f6f x:0 0 0 2024-09-17T07:19:53.203 INFO:tasks.workunit.client.0.smithi087.stdout:2/441: getdents d2/d12/d85 0 2024-09-17T07:19:53.204 INFO:tasks.workunit.client.1.smithi139.stdout:8/409: symlink d0/l81 0 2024-09-17T07:19:53.205 INFO:tasks.workunit.client.0.smithi087.stdout:8/470: write d1/d7/d9/d19/d1b/f43 [3686406,79944] 0 2024-09-17T07:19:53.206 INFO:tasks.workunit.client.0.smithi087.stdout:1/367: creat d2/d48/d61/f85 x:0 0 0 2024-09-17T07:19:53.206 INFO:tasks.workunit.client.0.smithi087.stdout:2/442: write d2/d7/dd/d10/f88 [935025,105651] 0 2024-09-17T07:19:53.207 INFO:tasks.workunit.client.0.smithi087.stdout:0/559: mknod db/d45/d9e/d86/cd1 0 2024-09-17T07:19:53.207 INFO:tasks.workunit.client.0.smithi087.stdout:4/382: dread d2/f25 [0,4194304] 0 2024-09-17T07:19:53.208 INFO:tasks.workunit.client.1.smithi139.stdout:8/410: mkdir d0/d1a/d82 0 2024-09-17T07:19:53.208 INFO:tasks.workunit.client.0.smithi087.stdout:1/368: chown d2/d3d 7968 1 2024-09-17T07:19:53.209 INFO:tasks.workunit.client.0.smithi087.stdout:5/538: rename d5/d12/d56/d5b/d87 to d5/d8/da7/db1 0 2024-09-17T07:19:53.210 INFO:tasks.workunit.client.0.smithi087.stdout:8/471: symlink d1/d7/d9/d19/d73/la4 0 2024-09-17T07:19:53.210 INFO:tasks.workunit.client.0.smithi087.stdout:1/369: chown d2/d14/dd/l36 10480958 1 2024-09-17T07:19:53.210 INFO:tasks.workunit.client.0.smithi087.stdout:5/539: chown d5/d18/f38 12850064 1 2024-09-17T07:19:53.211 INFO:tasks.workunit.client.0.smithi087.stdout:2/443: read - d2/f52 zero size 2024-09-17T07:19:53.211 INFO:tasks.workunit.client.0.smithi087.stdout:5/540: dread - d5/d12/d1c/fae zero size 2024-09-17T07:19:53.212 INFO:tasks.workunit.client.1.smithi139.stdout:8/411: fdatasync d0/dc/f58 0 2024-09-17T07:19:53.213 INFO:tasks.workunit.client.1.smithi139.stdout:8/412: rmdir d0/d1a/d4d/d53 39 2024-09-17T07:19:53.214 INFO:tasks.workunit.client.0.smithi087.stdout:5/541: write d5/d12/d4d/f47 [282941,95593] 0 2024-09-17T07:19:53.216 INFO:tasks.workunit.client.0.smithi087.stdout:6/548: getdents d1/d6/d1a/d2c/d40/d4c 0 2024-09-17T07:19:53.217 INFO:tasks.workunit.client.0.smithi087.stdout:3/356: getdents d6/d15/d37/d3c/d43 0 2024-09-17T07:19:53.220 INFO:tasks.workunit.client.0.smithi087.stdout:0/560: link db/d45/d5b/d92/fc7 db/d45/d7b/fd2 0 2024-09-17T07:19:53.220 INFO:tasks.workunit.client.0.smithi087.stdout:8/472: dwrite d1/d7/d9/f83 [0,4194304] 0 2024-09-17T07:19:53.223 INFO:tasks.workunit.client.0.smithi087.stdout:8/473: dread - d1/d7/d9/d19/d1b/d18/fa3 zero size 2024-09-17T07:19:53.223 INFO:tasks.workunit.client.0.smithi087.stdout:2/444: mkdir d2/d7/dd/d10/d4c/d5f/d8b 0 2024-09-17T07:19:53.223 INFO:tasks.workunit.client.0.smithi087.stdout:0/561: write db/fb1 [1945682,27499] 0 2024-09-17T07:19:53.223 INFO:tasks.workunit.client.0.smithi087.stdout:3/357: fdatasync d6/d16/f36 0 2024-09-17T07:19:53.226 INFO:tasks.workunit.client.1.smithi139.stdout:8/413: truncate d0/dc/f34 1758043 0 2024-09-17T07:19:53.226 INFO:tasks.workunit.client.0.smithi087.stdout:5/542: rename d5/d12/f62 to d5/d8/fb2 0 2024-09-17T07:19:53.228 INFO:tasks.workunit.client.1.smithi139.stdout:8/414: write d0/d1a/f39 [357294,2349] 0 2024-09-17T07:19:53.230 INFO:tasks.workunit.client.0.smithi087.stdout:3/358: read d6/d15/d37/d3c/d43/d48/f58 [3327418,79549] 0 2024-09-17T07:19:53.230 INFO:tasks.workunit.client.0.smithi087.stdout:8/474: mknod d1/d2b/d3b/d53/ca5 0 2024-09-17T07:19:53.233 INFO:tasks.workunit.client.0.smithi087.stdout:0/562: mknod db/d45/d5d/cd3 0 2024-09-17T07:19:53.236 INFO:tasks.workunit.client.0.smithi087.stdout:7/329: dread d0/f8 [0,4194304] 0 2024-09-17T07:19:53.238 INFO:tasks.workunit.client.0.smithi087.stdout:2/445: creat d2/d7/d30/d3f/f8c x:0 0 0 2024-09-17T07:19:53.239 INFO:tasks.workunit.client.1.smithi139.stdout:3/313: dread d5/d15/f18 [0,4194304] 0 2024-09-17T07:19:53.239 INFO:tasks.workunit.client.1.smithi139.stdout:8/415: write d0/d1a/d3a/f47 [491056,61306] 0 2024-09-17T07:19:53.239 INFO:tasks.workunit.client.0.smithi087.stdout:7/330: chown d0/d3/c5e 83546 1 2024-09-17T07:19:53.241 INFO:tasks.workunit.client.1.smithi139.stdout:3/314: mknod d5/d15/c67 0 2024-09-17T07:19:53.242 INFO:tasks.workunit.client.0.smithi087.stdout:9/323: write d3/d4/fb [330937,37013] 0 2024-09-17T07:19:53.242 INFO:tasks.workunit.client.0.smithi087.stdout:7/331: stat d0/d3/d10/d32/d62 0 2024-09-17T07:19:53.242 INFO:tasks.workunit.client.1.smithi139.stdout:3/315: write d5/d15/d20/d3b/f53 [175577,116616] 0 2024-09-17T07:19:53.243 INFO:tasks.workunit.client.1.smithi139.stdout:8/416: getdents d0/d20/d28/d52/d54 0 2024-09-17T07:19:53.243 INFO:tasks.workunit.client.0.smithi087.stdout:3/359: dwrite d6/d15/d37/f55 [0,4194304] 0 2024-09-17T07:19:53.244 INFO:tasks.workunit.client.0.smithi087.stdout:0/563: symlink db/d45/d9e/d86/ld4 0 2024-09-17T07:19:53.246 INFO:tasks.workunit.client.1.smithi139.stdout:3/316: unlink d5/d21/c34 0 2024-09-17T07:19:53.248 INFO:tasks.workunit.client.1.smithi139.stdout:2/364: sync 2024-09-17T07:19:53.248 INFO:tasks.workunit.client.1.smithi139.stdout:3/317: dread d5/d21/d23/f49 [0,4194304] 0 2024-09-17T07:19:53.249 INFO:tasks.workunit.client.1.smithi139.stdout:8/417: dwrite d0/dc/f4b [0,4194304] 0 2024-09-17T07:19:53.250 INFO:tasks.workunit.client.0.smithi087.stdout:5/543: rmdir d5/d12/d4d/d8c/daf 0 2024-09-17T07:19:53.250 INFO:tasks.workunit.client.0.smithi087.stdout:4/383: truncate d2/f6 466129 0 2024-09-17T07:19:53.251 INFO:tasks.workunit.client.1.smithi139.stdout:8/418: write d0/d20/d28/d52/f64 [253256,63557] 0 2024-09-17T07:19:53.251 INFO:tasks.workunit.client.0.smithi087.stdout:1/370: write d2/dc/f3a [212458,39990] 0 2024-09-17T07:19:53.252 INFO:tasks.workunit.client.1.smithi139.stdout:2/365: mknod d0/d7/d67/c7c 0 2024-09-17T07:19:53.252 INFO:tasks.workunit.client.1.smithi139.stdout:8/419: chown d0/l81 1051938 1 2024-09-17T07:19:53.253 INFO:tasks.workunit.client.1.smithi139.stdout:2/366: chown d0/de/d25 2230664 1 2024-09-17T07:19:53.253 INFO:tasks.workunit.client.0.smithi087.stdout:4/384: stat d2/d22/c6d 0 2024-09-17T07:19:53.254 INFO:tasks.workunit.client.1.smithi139.stdout:3/318: creat d5/d15/d16/d4c/f68 x:0 0 0 2024-09-17T07:19:53.255 INFO:tasks.workunit.client.0.smithi087.stdout:2/446: dwrite d2/d15/f2c [4194304,4194304] 0 2024-09-17T07:19:53.255 INFO:tasks.workunit.client.1.smithi139.stdout:3/319: chown d5/d21/d23/c5e 4840 1 2024-09-17T07:19:53.257 INFO:tasks.workunit.client.1.smithi139.stdout:3/320: fsync d5/d15/d16/d4c/d28/f30 0 2024-09-17T07:19:53.258 INFO:tasks.workunit.client.0.smithi087.stdout:0/564: dread db/d45/d5b/f6a [0,4194304] 0 2024-09-17T07:19:53.260 INFO:tasks.workunit.client.0.smithi087.stdout:2/447: chown d2/d12/l56 19084 1 2024-09-17T07:19:53.262 INFO:tasks.workunit.client.1.smithi139.stdout:8/420: truncate d0/dc/f7a 3535812 0 2024-09-17T07:19:53.262 INFO:tasks.workunit.client.0.smithi087.stdout:2/448: chown d2/d12/c57 327869 1 2024-09-17T07:19:53.262 INFO:tasks.workunit.client.0.smithi087.stdout:9/324: creat d3/d4/d6/d8/d12/d38/f70 x:0 0 0 2024-09-17T07:19:53.264 INFO:tasks.workunit.client.0.smithi087.stdout:7/332: write d0/f44 [1285230,101539] 0 2024-09-17T07:19:53.265 INFO:tasks.workunit.client.1.smithi139.stdout:8/421: truncate d0/dc/d18/f1f 2108936 0 2024-09-17T07:19:53.267 INFO:tasks.workunit.client.0.smithi087.stdout:1/371: creat d2/d14/dd/d43/d5d/f86 x:0 0 0 2024-09-17T07:19:53.278 INFO:tasks.workunit.client.0.smithi087.stdout:2/449: dread d2/d7/dd/d10/f88 [0,4194304] 0 2024-09-17T07:19:53.278 INFO:tasks.workunit.client.0.smithi087.stdout:6/549: dwrite d1/d6/d1a/d2c/f51 [0,4194304] 0 2024-09-17T07:19:53.280 INFO:tasks.workunit.client.0.smithi087.stdout:8/475: truncate d1/d2b/d21/d6d/d6f/d7f/d54/f86 1570233 0 2024-09-17T07:19:53.282 INFO:tasks.workunit.client.0.smithi087.stdout:9/325: dwrite d3/d4/d2f/f39 [0,4194304] 0 2024-09-17T07:19:53.285 INFO:tasks.workunit.client.0.smithi087.stdout:3/360: write d6/d15/d37/f5b [4076353,27764] 0 2024-09-17T07:19:53.286 INFO:tasks.workunit.client.0.smithi087.stdout:1/372: fsync d2/d14/dd/d37/f52 0 2024-09-17T07:19:53.287 INFO:tasks.workunit.client.0.smithi087.stdout:0/565: dwrite db/d45/d5b/f6a [0,4194304] 0 2024-09-17T07:19:53.289 INFO:tasks.workunit.client.0.smithi087.stdout:5/544: creat d5/d12/d14/fb3 x:0 0 0 2024-09-17T07:19:53.290 INFO:tasks.workunit.client.0.smithi087.stdout:7/333: mknod d0/d3/d10/c6c 0 2024-09-17T07:19:53.292 INFO:tasks.workunit.client.0.smithi087.stdout:8/476: creat d1/d2b/d21/d6d/fa6 x:0 0 0 2024-09-17T07:19:53.293 INFO:tasks.workunit.client.0.smithi087.stdout:3/361: truncate d6/d15/d37/f55 4275989 0 2024-09-17T07:19:53.298 INFO:tasks.workunit.client.0.smithi087.stdout:0/566: write db/f28 [1104530,119474] 0 2024-09-17T07:19:53.299 INFO:tasks.workunit.client.0.smithi087.stdout:9/326: dread d3/d4/da/f55 [0,4194304] 0 2024-09-17T07:19:53.300 INFO:tasks.workunit.client.0.smithi087.stdout:3/362: symlink d6/d1b/d42/l70 0 2024-09-17T07:19:53.301 INFO:tasks.workunit.client.0.smithi087.stdout:4/385: rmdir d2/d22/d2c/d3f/d4d/d21/d2f/d3b/d71 0 2024-09-17T07:19:53.302 INFO:tasks.workunit.client.0.smithi087.stdout:4/386: dread - d2/d22/d62/f72 zero size 2024-09-17T07:19:53.303 INFO:tasks.workunit.client.0.smithi087.stdout:1/373: rename d2/d3d/d35/d57/d6a/f7b to d2/d14/dd/d37/f87 0 2024-09-17T07:19:53.304 INFO:tasks.workunit.client.0.smithi087.stdout:2/450: link d2/d7/dd/d1f/d3a/c5e d2/d7/db/c8d 0 2024-09-17T07:19:53.304 INFO:tasks.workunit.client.0.smithi087.stdout:8/477: rename d1 to d1/d7/d9/d19/d4d/da7 22 2024-09-17T07:19:53.309 INFO:tasks.workunit.client.0.smithi087.stdout:2/451: truncate d2/d15/d34/f87 813386 0 2024-09-17T07:19:53.309 INFO:tasks.workunit.client.0.smithi087.stdout:6/550: symlink d1/d6/d1a/d2c/d58/d90/da9/db6/lc5 0 2024-09-17T07:19:53.311 INFO:tasks.workunit.client.0.smithi087.stdout:7/334: unlink d0/d3/d10/f27 0 2024-09-17T07:19:53.312 INFO:tasks.workunit.client.0.smithi087.stdout:4/387: dwrite d2/d22/d2c/d3f/d4d/f64 [0,4194304] 0 2024-09-17T07:19:53.312 INFO:tasks.workunit.client.0.smithi087.stdout:2/452: write d2/d12/f2a [2869680,129973] 0 2024-09-17T07:19:53.316 INFO:tasks.workunit.client.0.smithi087.stdout:5/545: link d5/d12/d1c/fae d5/d8/d1f/d4e/fb4 0 2024-09-17T07:19:53.317 INFO:tasks.workunit.client.0.smithi087.stdout:0/567: dwrite db/f54 [0,4194304] 0 2024-09-17T07:19:53.317 INFO:tasks.workunit.client.0.smithi087.stdout:5/546: chown d5/d18/d6a 677949 1 2024-09-17T07:19:53.321 INFO:tasks.workunit.client.0.smithi087.stdout:6/551: dread d1/d6/d1a/d2c/d48/f72 [4194304,4194304] 0 2024-09-17T07:19:53.337 INFO:tasks.workunit.client.0.smithi087.stdout:5/547: creat d5/d8/d1f/d4e/fb5 x:0 0 0 2024-09-17T07:19:53.362 INFO:tasks.workunit.client.0.smithi087.stdout:2/453: creat d2/d7/d30/d3f/f8e x:0 0 0 2024-09-17T07:19:53.362 INFO:tasks.workunit.client.0.smithi087.stdout:3/363: creat d6/d15/f71 x:0 0 0 2024-09-17T07:19:53.363 INFO:tasks.workunit.client.0.smithi087.stdout:1/374: mknod d2/c88 0 2024-09-17T07:19:53.363 INFO:tasks.workunit.client.0.smithi087.stdout:0/568: mkdir db/d45/d9e/d86/dd5 0 2024-09-17T07:19:53.364 INFO:tasks.workunit.client.0.smithi087.stdout:0/569: readlink db/lba 0 2024-09-17T07:19:53.367 INFO:tasks.workunit.client.0.smithi087.stdout:3/364: dread d6/d1b/f67 [0,4194304] 0 2024-09-17T07:19:53.370 INFO:tasks.workunit.client.0.smithi087.stdout:2/454: creat d2/d48/f8f x:0 0 0 2024-09-17T07:19:53.372 INFO:tasks.workunit.client.0.smithi087.stdout:7/335: creat d0/d3/d10/f6d x:0 0 0 2024-09-17T07:19:53.374 INFO:tasks.workunit.client.0.smithi087.stdout:0/570: dread db/f1a [0,4194304] 0 2024-09-17T07:19:53.374 INFO:tasks.workunit.client.0.smithi087.stdout:0/571: fsync db/d45/fae 0 2024-09-17T07:19:53.375 INFO:tasks.workunit.client.0.smithi087.stdout:3/365: creat d6/d15/d37/f72 x:0 0 0 2024-09-17T07:19:53.381 INFO:tasks.workunit.client.0.smithi087.stdout:6/552: truncate d1/d6/d1a/d2c/f59 1401742 0 2024-09-17T07:19:53.382 INFO:tasks.workunit.client.0.smithi087.stdout:4/388: link d2/f25 d2/d22/d2c/d3f/d4d/d21/d2f/f8d 0 2024-09-17T07:19:53.385 INFO:tasks.workunit.client.0.smithi087.stdout:7/336: write d0/f6 [807774,68338] 0 2024-09-17T07:19:53.388 INFO:tasks.workunit.client.0.smithi087.stdout:7/337: read d0/d3/d10/d31/f43 [6344760,85880] 0 2024-09-17T07:19:53.390 INFO:tasks.workunit.client.0.smithi087.stdout:2/455: unlink d2/d12/f2a 0 2024-09-17T07:19:53.390 INFO:tasks.workunit.client.1.smithi139.stdout:4/305: sync 2024-09-17T07:19:53.391 INFO:tasks.workunit.client.0.smithi087.stdout:4/389: dwrite d2/d22/d2c/d3f/d4d/d42/f55 [0,4194304] 0 2024-09-17T07:19:53.391 INFO:tasks.workunit.client.1.smithi139.stdout:4/306: chown d0/d10/f25 28 1 2024-09-17T07:19:53.392 INFO:tasks.workunit.client.0.smithi087.stdout:1/375: link d2/d14/dd/d37/f54 d2/d3d/d35/d57/f89 0 2024-09-17T07:19:53.392 INFO:tasks.workunit.client.1.smithi139.stdout:4/307: fsync d0/db/d17/f2c 0 2024-09-17T07:19:53.393 INFO:tasks.workunit.client.1.smithi139.stdout:4/308: truncate d0/db/f33 46600 0 2024-09-17T07:19:53.394 INFO:tasks.workunit.client.0.smithi087.stdout:1/376: write d2/d14/dd/d43/f4b [510758,123496] 0 2024-09-17T07:19:53.395 INFO:tasks.workunit.client.0.smithi087.stdout:3/366: mknod d6/d1b/d42/d6e/c73 0 2024-09-17T07:19:53.397 INFO:tasks.workunit.client.0.smithi087.stdout:5/548: getdents d5/d12/d1c 0 2024-09-17T07:19:53.398 INFO:tasks.workunit.client.1.smithi139.stdout:4/309: link d0/d1/l2f d0/d1/d29/d41/l5d 0 2024-09-17T07:19:53.400 INFO:tasks.workunit.client.1.smithi139.stdout:4/310: fdatasync d0/db/d17/f2d 0 2024-09-17T07:19:53.400 INFO:tasks.workunit.client.0.smithi087.stdout:6/553: truncate d1/d6/d1a/d2c/d40/d4c/da1/fc3 3371165 0 2024-09-17T07:19:53.400 INFO:tasks.workunit.client.0.smithi087.stdout:3/367: fsync d6/d16/f36 0 2024-09-17T07:19:53.401 INFO:tasks.workunit.client.0.smithi087.stdout:1/377: creat d2/d3d/d35/d57/d73/f8a x:0 0 0 2024-09-17T07:19:53.401 INFO:tasks.workunit.client.0.smithi087.stdout:0/572: link db/d45/d7b/d7e/c84 db/d4f/cd6 0 2024-09-17T07:19:53.402 INFO:tasks.workunit.client.0.smithi087.stdout:6/554: dread - d1/d6/d1a/d2c/d58/d90/fab zero size 2024-09-17T07:19:53.402 INFO:tasks.workunit.client.1.smithi139.stdout:4/311: creat d0/db/d58/f5e x:0 0 0 2024-09-17T07:19:53.403 INFO:tasks.workunit.client.0.smithi087.stdout:0/573: dread - db/d45/d7b/fa5 zero size 2024-09-17T07:19:53.404 INFO:tasks.workunit.client.0.smithi087.stdout:4/390: symlink d2/d22/l8e 0 2024-09-17T07:19:53.406 INFO:tasks.workunit.client.0.smithi087.stdout:2/456: link d2/d50/f61 d2/d50/f90 0 2024-09-17T07:19:53.406 INFO:tasks.workunit.client.0.smithi087.stdout:7/338: dread - d0/d3/d23/d17/f47 zero size 2024-09-17T07:19:53.409 INFO:tasks.workunit.client.0.smithi087.stdout:6/555: symlink d1/d6/d1a/d2c/d40/d4c/da1/lc6 0 2024-09-17T07:19:53.412 INFO:tasks.workunit.client.0.smithi087.stdout:4/391: chown d2/d22/d2c/d3f/d4d/d42/f55 24723448 1 2024-09-17T07:19:53.413 INFO:tasks.workunit.client.0.smithi087.stdout:0/574: mknod db/d45/d7b/db0/cd7 0 2024-09-17T07:19:53.414 INFO:tasks.workunit.client.0.smithi087.stdout:3/368: dwrite d6/d16/f68 [0,4194304] 0 2024-09-17T07:19:53.414 INFO:tasks.workunit.client.1.smithi139.stdout:4/312: dwrite d0/f7 [8388608,4194304] 0 2024-09-17T07:19:53.415 INFO:tasks.workunit.client.0.smithi087.stdout:5/549: getdents d5/d12/d14 0 2024-09-17T07:19:53.416 INFO:tasks.workunit.client.0.smithi087.stdout:6/556: read - d1/d6/d1a/d2c/d58/d90/fad zero size 2024-09-17T07:19:53.416 INFO:tasks.workunit.client.0.smithi087.stdout:1/378: dwrite d2/d3d/f28 [0,4194304] 0 2024-09-17T07:19:53.418 INFO:tasks.workunit.client.0.smithi087.stdout:7/339: stat d0/d3/d23/d17/l2f 0 2024-09-17T07:19:53.422 INFO:tasks.workunit.client.0.smithi087.stdout:6/557: readlink d1/d6/d1a/d2c/d48/d62/l66 0 2024-09-17T07:19:53.422 INFO:tasks.workunit.client.0.smithi087.stdout:0/575: chown db/d45/d5d/c8d 2 1 2024-09-17T07:19:53.424 INFO:tasks.workunit.client.0.smithi087.stdout:3/369: creat d6/d15/d37/d3c/f74 x:0 0 0 2024-09-17T07:19:53.424 INFO:tasks.workunit.client.0.smithi087.stdout:1/379: read d2/d3d/d35/d57/d73/f77 [554542,21534] 0 2024-09-17T07:19:53.425 INFO:tasks.workunit.client.0.smithi087.stdout:7/340: unlink d0/f44 0 2024-09-17T07:19:53.425 INFO:tasks.workunit.client.0.smithi087.stdout:6/558: stat d1/f18 0 2024-09-17T07:19:53.427 INFO:tasks.workunit.client.0.smithi087.stdout:3/370: write d6/d16/f68 [1639346,2202] 0 2024-09-17T07:19:53.430 INFO:tasks.workunit.client.0.smithi087.stdout:6/559: read d1/d6/d1a/f41 [1290605,55861] 0 2024-09-17T07:19:53.434 INFO:tasks.workunit.client.0.smithi087.stdout:0/576: mkdir db/d45/d9e/d95/dd8 0 2024-09-17T07:19:53.435 INFO:tasks.workunit.client.0.smithi087.stdout:0/577: readlink db/d45/d7b/d90/lc3 0 2024-09-17T07:19:53.436 INFO:tasks.workunit.client.0.smithi087.stdout:3/371: dread d6/d16/f38 [0,4194304] 0 2024-09-17T07:19:53.438 INFO:tasks.workunit.client.0.smithi087.stdout:7/341: write d0/d3/d23/d17/f1e [4073778,96830] 0 2024-09-17T07:19:53.439 INFO:tasks.workunit.client.0.smithi087.stdout:2/457: dwrite d2/d50/f61 [0,4194304] 0 2024-09-17T07:19:53.439 INFO:tasks.workunit.client.0.smithi087.stdout:3/372: fdatasync d6/d15/d37/f55 0 2024-09-17T07:19:53.439 INFO:tasks.workunit.client.0.smithi087.stdout:0/578: mkdir db/d45/d7b/d90/dd9 0 2024-09-17T07:19:53.442 INFO:tasks.workunit.client.1.smithi139.stdout:4/313: truncate d0/d1/d29/d41/f43 370741 0 2024-09-17T07:19:53.443 INFO:tasks.workunit.client.0.smithi087.stdout:7/342: rmdir d0/d3/d10 39 2024-09-17T07:19:53.443 INFO:tasks.workunit.client.1.smithi139.stdout:4/314: mkdir d0/d37/d5f 0 2024-09-17T07:19:53.444 INFO:tasks.workunit.client.0.smithi087.stdout:2/458: mkdir d2/d7/dd/d10/d91 0 2024-09-17T07:19:53.445 INFO:tasks.workunit.client.1.smithi139.stdout:4/315: chown d0/d1/f4f 359198360 1 2024-09-17T07:19:53.445 INFO:tasks.workunit.client.1.smithi139.stdout:4/316: dread - d0/d1/f4f zero size 2024-09-17T07:19:53.447 INFO:tasks.workunit.client.0.smithi087.stdout:1/380: getdents d2/d3d/d35 0 2024-09-17T07:19:53.448 INFO:tasks.workunit.client.0.smithi087.stdout:3/373: rename d6/d15/d37/d3c/f6c to d6/d15/d37/f75 0 2024-09-17T07:19:53.449 INFO:tasks.workunit.client.0.smithi087.stdout:2/459: chown d2/d24/d36/f39 364 1 2024-09-17T07:19:53.450 INFO:tasks.workunit.client.0.smithi087.stdout:0/579: dwrite db/d45/d7b/db0/fb5 [0,4194304] 0 2024-09-17T07:19:53.452 INFO:tasks.workunit.client.0.smithi087.stdout:3/374: fdatasync d6/d15/d37/f5b 0 2024-09-17T07:19:53.453 INFO:tasks.workunit.client.1.smithi139.stdout:4/317: dwrite d0/db/f4a [0,4194304] 0 2024-09-17T07:19:53.454 INFO:tasks.workunit.client.0.smithi087.stdout:5/550: dread d5/d18/d20/fa [0,4194304] 0 2024-09-17T07:19:53.455 INFO:tasks.workunit.client.0.smithi087.stdout:0/580: creat db/d4f/fda x:0 0 0 2024-09-17T07:19:53.456 INFO:tasks.workunit.client.0.smithi087.stdout:2/460: creat d2/d7/dd/d10/d4c/d5f/f92 x:0 0 0 2024-09-17T07:19:53.459 INFO:tasks.workunit.client.0.smithi087.stdout:4/392: dread d2/d5/f26 [0,4194304] 0 2024-09-17T07:19:53.460 INFO:tasks.workunit.client.0.smithi087.stdout:0/581: read db/f49 [120687,45881] 0 2024-09-17T07:19:53.461 INFO:tasks.workunit.client.0.smithi087.stdout:5/551: symlink d5/d8/d1f/d68/lb6 0 2024-09-17T07:19:53.462 INFO:tasks.workunit.client.1.smithi139.stdout:4/318: dwrite d0/d1a/f3e [0,4194304] 0 2024-09-17T07:19:53.463 INFO:tasks.workunit.client.0.smithi087.stdout:3/375: symlink d6/d1b/l76 0 2024-09-17T07:19:53.463 INFO:tasks.workunit.client.1.smithi139.stdout:4/319: readlink d0/db/d17/l34 0 2024-09-17T07:19:53.465 INFO:tasks.workunit.client.0.smithi087.stdout:4/393: write d2/d22/d2c/d3f/d4d/f75 [707646,17547] 0 2024-09-17T07:19:53.465 INFO:tasks.workunit.client.1.smithi139.stdout:4/320: getdents d0/d37/d5f 0 2024-09-17T07:19:53.466 INFO:tasks.workunit.client.0.smithi087.stdout:3/376: chown d6/d15/d37/d3c/d52 230607742 1 2024-09-17T07:19:53.468 INFO:tasks.workunit.client.1.smithi139.stdout:4/321: creat d0/d1a/f60 x:0 0 0 2024-09-17T07:19:53.468 INFO:tasks.workunit.client.0.smithi087.stdout:5/552: chown d5/d8/d1f/d68/f98 6 1 2024-09-17T07:19:53.469 INFO:tasks.workunit.client.1.smithi139.stdout:4/322: truncate d0/f47 765232 0 2024-09-17T07:19:53.470 INFO:tasks.workunit.client.1.smithi139.stdout:4/323: write d0/f30 [1307264,104505] 0 2024-09-17T07:19:53.471 INFO:tasks.workunit.client.0.smithi087.stdout:2/461: dwrite d2/d50/f61 [0,4194304] 0 2024-09-17T07:19:53.474 INFO:tasks.workunit.client.0.smithi087.stdout:4/394: creat d2/d22/d2c/d3f/d4d/d21/f8f x:0 0 0 2024-09-17T07:19:53.476 INFO:tasks.workunit.client.0.smithi087.stdout:3/377: unlink d6/d1b/d2b/l49 0 2024-09-17T07:19:53.476 INFO:tasks.workunit.client.0.smithi087.stdout:2/462: fsync d2/d7/dd/f79 0 2024-09-17T07:19:53.479 INFO:tasks.workunit.client.0.smithi087.stdout:0/582: dwrite db/d45/d7b/fb2 [0,4194304] 0 2024-09-17T07:19:53.479 INFO:tasks.workunit.client.0.smithi087.stdout:5/553: rename d5/d8/d1f/d9b to d5/d12/d56/db7 0 2024-09-17T07:19:53.483 INFO:tasks.workunit.client.0.smithi087.stdout:2/463: creat d2/d7/d30/d3f/f93 x:0 0 0 2024-09-17T07:19:53.486 INFO:tasks.workunit.client.0.smithi087.stdout:3/378: creat d6/d15/d37/d3c/d43/d48/f77 x:0 0 0 2024-09-17T07:19:53.486 INFO:tasks.workunit.client.0.smithi087.stdout:1/381: dwrite d2/da/f2b [0,4194304] 0 2024-09-17T07:19:53.489 INFO:tasks.workunit.client.0.smithi087.stdout:0/583: unlink db/d45/d9e/d86/ld4 0 2024-09-17T07:19:53.492 INFO:tasks.workunit.client.0.smithi087.stdout:0/584: dread - db/d45/d7b/d7e/fa4 zero size 2024-09-17T07:19:53.494 INFO:tasks.workunit.client.0.smithi087.stdout:7/343: dread d0/d3/f1f [0,4194304] 0 2024-09-17T07:19:53.496 INFO:tasks.workunit.client.0.smithi087.stdout:3/379: dwrite d6/d15/d37/f55 [0,4194304] 0 2024-09-17T07:19:53.498 INFO:tasks.workunit.client.0.smithi087.stdout:0/585: creat db/d45/d7b/db0/fdb x:0 0 0 2024-09-17T07:19:53.501 INFO:tasks.workunit.client.0.smithi087.stdout:3/380: mknod d6/d15/d37/d3c/c78 0 2024-09-17T07:19:53.503 INFO:tasks.workunit.client.0.smithi087.stdout:0/586: chown db/f59 588515289 1 2024-09-17T07:19:53.507 INFO:tasks.workunit.client.0.smithi087.stdout:3/381: rename d6/d1b/f67 to d6/d1b/d42/d6e/f79 0 2024-09-17T07:19:53.508 INFO:tasks.workunit.client.0.smithi087.stdout:0/587: creat db/d45/d7b/fdc x:0 0 0 2024-09-17T07:19:53.511 INFO:tasks.workunit.client.0.smithi087.stdout:7/344: dread d0/d3/d10/f20 [0,4194304] 0 2024-09-17T07:19:53.513 INFO:tasks.workunit.client.0.smithi087.stdout:0/588: link db/d45/c56 db/d45/cdd 0 2024-09-17T07:19:53.515 INFO:tasks.workunit.client.0.smithi087.stdout:7/345: unlink d0/d3/d23/d17/f34 0 2024-09-17T07:19:53.515 INFO:tasks.workunit.client.1.smithi139.stdout:6/502: sync 2024-09-17T07:19:53.516 INFO:tasks.workunit.client.1.smithi139.stdout:6/503: chown db/df/d4e/d64/d56/f66 12 1 2024-09-17T07:19:53.517 INFO:tasks.workunit.client.0.smithi087.stdout:7/346: dread d0/d3/d10/f38 [0,4194304] 0 2024-09-17T07:19:53.518 INFO:tasks.workunit.client.1.smithi139.stdout:4/324: creat d0/db/d17/f61 x:0 0 0 2024-09-17T07:19:53.518 INFO:tasks.workunit.client.1.smithi139.stdout:4/325: chown d0/d1 31 1 2024-09-17T07:19:53.519 INFO:tasks.workunit.client.0.smithi087.stdout:0/589: getdents db/d45/d5b 0 2024-09-17T07:19:53.520 INFO:tasks.workunit.client.1.smithi139.stdout:6/504: rename db/df/d73/d81/f3b to db/df/d4e/d64/d56/fa6 0 2024-09-17T07:19:53.522 INFO:tasks.workunit.client.1.smithi139.stdout:4/326: write d0/d10/d39/f3a [3791347,113368] 0 2024-09-17T07:19:53.523 INFO:tasks.workunit.client.1.smithi139.stdout:4/327: stat d0/d1/c27 0 2024-09-17T07:19:53.523 INFO:tasks.workunit.client.0.smithi087.stdout:7/347: dread d0/d3/d23/d17/f41 [0,4194304] 0 2024-09-17T07:19:53.524 INFO:tasks.workunit.client.1.smithi139.stdout:4/328: chown d0/db/c4b 3523383 1 2024-09-17T07:19:53.525 INFO:tasks.workunit.client.0.smithi087.stdout:4/395: getdents d2/d22/d2c/d3f/d4d/d21 0 2024-09-17T07:19:53.526 INFO:tasks.workunit.client.0.smithi087.stdout:7/348: write d0/d3/d23/d17/f65 [831189,43387] 0 2024-09-17T07:19:53.530 INFO:tasks.workunit.client.1.smithi139.stdout:4/329: dread d0/d1/d29/d41/f43 [0,4194304] 0 2024-09-17T07:19:53.531 INFO:tasks.workunit.client.0.smithi087.stdout:1/382: dread d2/d14/dd/d37/f38 [0,4194304] 0 2024-09-17T07:19:53.531 INFO:tasks.workunit.client.0.smithi087.stdout:4/396: link d2/d5/d1f/c1c d2/d22/d2c/d3f/d4f/c90 0 2024-09-17T07:19:53.532 INFO:tasks.workunit.client.1.smithi139.stdout:4/330: mknod d0/db/d58/c62 0 2024-09-17T07:19:53.533 INFO:tasks.workunit.client.0.smithi087.stdout:5/554: write d5/d18/d20/d2f/f57 [1820018,72214] 0 2024-09-17T07:19:53.533 INFO:tasks.workunit.client.0.smithi087.stdout:1/383: chown d2/d1a 41575915 1 2024-09-17T07:19:53.534 INFO:tasks.workunit.client.0.smithi087.stdout:5/555: chown d5/d18/d6f 1187523577 1 2024-09-17T07:19:53.535 INFO:tasks.workunit.client.0.smithi087.stdout:3/382: dread d6/d1b/d2b/f39 [0,4194304] 0 2024-09-17T07:19:53.538 INFO:tasks.workunit.client.0.smithi087.stdout:3/383: symlink d6/d1b/d42/l7a 0 2024-09-17T07:19:53.539 INFO:tasks.workunit.client.0.smithi087.stdout:0/590: dread db/d45/d7b/d7e/f8e [0,4194304] 0 2024-09-17T07:19:53.539 INFO:tasks.workunit.client.0.smithi087.stdout:5/556: write d5/d18/d20/f35 [708794,5003] 0 2024-09-17T07:19:53.541 INFO:tasks.workunit.client.0.smithi087.stdout:3/384: truncate d6/d15/d37/d3c/f54 5330887 0 2024-09-17T07:19:53.541 INFO:tasks.workunit.client.0.smithi087.stdout:0/591: creat db/d4f/fde x:0 0 0 2024-09-17T07:19:53.544 INFO:tasks.workunit.client.0.smithi087.stdout:5/557: getdents d5/d18/d20/d2f/d83/dac 0 2024-09-17T07:19:53.546 INFO:tasks.workunit.client.1.smithi139.stdout:4/331: dread d0/f26 [0,4194304] 0 2024-09-17T07:19:53.546 INFO:tasks.workunit.client.0.smithi087.stdout:0/592: symlink db/d45/d7b/db0/dd0/ldf 0 2024-09-17T07:19:53.547 INFO:tasks.workunit.client.0.smithi087.stdout:7/349: truncate d0/d3/d23/d17/f1e 3659753 0 2024-09-17T07:19:53.547 INFO:tasks.workunit.client.0.smithi087.stdout:0/593: dread - db/d45/d7b/db0/fdb zero size 2024-09-17T07:19:53.548 INFO:tasks.workunit.client.0.smithi087.stdout:1/384: write d2/d14/dd/f18 [363165,76738] 0 2024-09-17T07:19:53.549 INFO:tasks.workunit.client.1.smithi139.stdout:4/332: write d0/d1/d29/d41/f43 [139092,88828] 0 2024-09-17T07:19:53.550 INFO:tasks.workunit.client.0.smithi087.stdout:3/385: creat d6/d1b/d2b/f7b x:0 0 0 2024-09-17T07:19:53.551 INFO:tasks.workunit.client.1.smithi139.stdout:4/333: fdatasync d0/f4 0 2024-09-17T07:19:53.552 INFO:tasks.workunit.client.0.smithi087.stdout:1/385: creat d2/d14/dd/d37/f8b x:0 0 0 2024-09-17T07:19:53.553 INFO:tasks.workunit.client.0.smithi087.stdout:1/386: dread - d2/d14/dd/d37/f87 zero size 2024-09-17T07:19:53.553 INFO:tasks.workunit.client.1.smithi139.stdout:4/334: getdents d0/d49 0 2024-09-17T07:19:53.553 INFO:tasks.workunit.client.0.smithi087.stdout:5/558: rmdir d5/d12/d4d/d8c 0 2024-09-17T07:19:53.554 INFO:tasks.workunit.client.1.smithi139.stdout:4/335: readlink d0/d1/l2f 0 2024-09-17T07:19:53.554 INFO:tasks.workunit.client.1.smithi139.stdout:4/336: readlink d0/d10/l51 0 2024-09-17T07:19:53.555 INFO:tasks.workunit.client.0.smithi087.stdout:3/386: rename d6/f27 to d6/d16/f7c 0 2024-09-17T07:19:53.558 INFO:tasks.workunit.client.0.smithi087.stdout:0/594: getdents db/d45/d7b/d90/dd9 0 2024-09-17T07:19:53.559 INFO:tasks.workunit.client.0.smithi087.stdout:1/387: creat d2/d48/d61/f8c x:0 0 0 2024-09-17T07:19:53.560 INFO:tasks.workunit.client.0.smithi087.stdout:1/388: fdatasync d2/d14/dd/ff 0 2024-09-17T07:19:53.562 INFO:tasks.workunit.client.1.smithi139.stdout:4/337: dwrite d0/d1/fd [4194304,4194304] 0 2024-09-17T07:19:53.563 INFO:tasks.workunit.client.0.smithi087.stdout:7/350: truncate d0/f2 657359 0 2024-09-17T07:19:53.563 INFO:tasks.workunit.client.1.smithi139.stdout:4/338: write d0/d10/d39/f3a [1856104,58365] 0 2024-09-17T07:19:53.565 INFO:tasks.workunit.client.0.smithi087.stdout:3/387: mkdir d6/d7d 0 2024-09-17T07:19:53.566 INFO:tasks.workunit.client.0.smithi087.stdout:3/388: write d6/d1b/d42/f3d [745573,55695] 0 2024-09-17T07:19:53.566 INFO:tasks.workunit.client.0.smithi087.stdout:0/595: link db/f59 db/d45/d7b/db0/fe0 0 2024-09-17T07:19:53.567 INFO:tasks.workunit.client.1.smithi139.stdout:4/339: creat d0/d1/d29/d41/f63 x:0 0 0 2024-09-17T07:19:53.569 INFO:tasks.workunit.client.0.smithi087.stdout:7/351: rename d0/d3/c5e to d0/d3/d10/d31/c6e 0 2024-09-17T07:19:53.571 INFO:tasks.workunit.client.0.smithi087.stdout:1/389: mkdir d2/d69/d8d 0 2024-09-17T07:19:53.572 INFO:tasks.workunit.client.0.smithi087.stdout:0/596: fdatasync db/d45/d7b/fd2 0 2024-09-17T07:19:53.574 INFO:tasks.workunit.client.0.smithi087.stdout:5/559: link d5/d12/l70 d5/d8/lb8 0 2024-09-17T07:19:53.574 INFO:tasks.workunit.client.0.smithi087.stdout:0/597: write db/d45/d7b/d90/f8a [900095,7611] 0 2024-09-17T07:19:53.576 INFO:tasks.workunit.client.0.smithi087.stdout:0/598: write db/d4f/fda [4540,40121] 0 2024-09-17T07:19:53.576 INFO:tasks.workunit.client.0.smithi087.stdout:1/390: mkdir d2/d3d/d8e 0 2024-09-17T07:19:53.576 INFO:tasks.workunit.client.0.smithi087.stdout:5/560: write d5/d8/d1f/f95 [659715,67466] 0 2024-09-17T07:19:53.578 INFO:tasks.workunit.client.0.smithi087.stdout:0/599: dread - db/d45/d7b/fc5 zero size 2024-09-17T07:19:53.578 INFO:tasks.workunit.client.0.smithi087.stdout:1/391: chown d2/dc/l2e 51 1 2024-09-17T07:19:53.579 INFO:tasks.workunit.client.1.smithi139.stdout:4/340: dread d0/db/d17/f2c [0,4194304] 0 2024-09-17T07:19:53.581 INFO:tasks.workunit.client.1.smithi139.stdout:4/341: symlink d0/d37/l64 0 2024-09-17T07:19:53.584 INFO:tasks.workunit.client.0.smithi087.stdout:7/352: link d0/d36/c5b d0/d3/d23/d2d/c6f 0 2024-09-17T07:19:53.590 INFO:tasks.workunit.client.0.smithi087.stdout:5/561: dwrite d5/d18/d6a/f86 [0,4194304] 0 2024-09-17T07:19:53.594 INFO:tasks.workunit.client.0.smithi087.stdout:3/389: truncate d6/d16/f7c 133044 0 2024-09-17T07:19:53.597 INFO:tasks.workunit.client.0.smithi087.stdout:0/600: write db/f25 [4322297,45213] 0 2024-09-17T07:19:53.598 INFO:tasks.workunit.client.0.smithi087.stdout:5/562: dread d5/d8/d1f/f95 [0,4194304] 0 2024-09-17T07:19:53.599 INFO:tasks.workunit.client.0.smithi087.stdout:7/353: dwrite d0/d3/f3f [0,4194304] 0 2024-09-17T07:19:53.600 INFO:tasks.workunit.client.0.smithi087.stdout:3/390: creat d6/d1b/d42/f7e x:0 0 0 2024-09-17T07:19:53.607 INFO:tasks.workunit.client.0.smithi087.stdout:0/601: creat db/d45/d9e/d86/dd5/fe1 x:0 0 0 2024-09-17T07:19:53.607 INFO:tasks.workunit.client.0.smithi087.stdout:1/392: dwrite d2/da/f4d [0,4194304] 0 2024-09-17T07:19:53.612 INFO:tasks.workunit.client.0.smithi087.stdout:7/354: rename d0/d3/d10/f6d to d0/d3/d23/d4e/f70 0 2024-09-17T07:19:53.615 INFO:tasks.workunit.client.0.smithi087.stdout:1/393: mknod d2/d48/d6f/c8f 0 2024-09-17T07:19:53.616 INFO:tasks.workunit.client.1.smithi139.stdout:4/342: dread d0/f1d [0,4194304] 0 2024-09-17T07:19:53.617 INFO:tasks.workunit.client.0.smithi087.stdout:5/563: dwrite d5/d12/f77 [0,4194304] 0 2024-09-17T07:19:53.621 INFO:tasks.workunit.client.0.smithi087.stdout:3/391: dwrite d6/f57 [0,4194304] 0 2024-09-17T07:19:53.621 INFO:tasks.workunit.client.0.smithi087.stdout:1/394: fsync d2/d14/dd/f18 0 2024-09-17T07:19:53.621 INFO:tasks.workunit.client.0.smithi087.stdout:0/602: rename db/d45/d7b/db0/fe0 to db/d45/d9e/d95/dd8/fe2 0 2024-09-17T07:19:53.624 INFO:tasks.workunit.client.0.smithi087.stdout:5/564: write d5/d18/f38 [4988701,63328] 0 2024-09-17T07:19:53.624 INFO:tasks.workunit.client.0.smithi087.stdout:1/395: rmdir d2/d3d/d45 39 2024-09-17T07:19:53.625 INFO:tasks.workunit.client.0.smithi087.stdout:3/392: creat d6/d15/d37/f7f x:0 0 0 2024-09-17T07:19:53.632 INFO:tasks.workunit.client.1.smithi139.stdout:7/321: sync 2024-09-17T07:19:53.633 INFO:tasks.workunit.client.1.smithi139.stdout:7/322: fsync d5/d10/d2b/f44 0 2024-09-17T07:19:53.635 INFO:tasks.workunit.client.1.smithi139.stdout:7/323: chown d5/d10/d2b/d40/d47 366199033 1 2024-09-17T07:19:53.636 INFO:tasks.workunit.client.1.smithi139.stdout:7/324: symlink d5/d10/d4d/l64 0 2024-09-17T07:19:53.658 INFO:tasks.workunit.client.0.smithi087.stdout:3/393: symlink d6/d15/d37/d3c/l80 0 2024-09-17T07:19:53.659 INFO:tasks.workunit.client.0.smithi087.stdout:7/355: rename d0/d3/d23/d2d/l46 to d0/l71 0 2024-09-17T07:19:53.660 INFO:tasks.workunit.client.0.smithi087.stdout:0/603: truncate db/d45/d5d/f8f 3678655 0 2024-09-17T07:19:53.661 INFO:tasks.workunit.client.0.smithi087.stdout:5/565: rename d5/d12/d1c/l3b to d5/d12/d56/d9e/lb9 0 2024-09-17T07:19:53.663 INFO:tasks.workunit.client.0.smithi087.stdout:5/566: truncate d5/d12/d1c/fae 493466 0 2024-09-17T07:19:53.663 INFO:tasks.workunit.client.0.smithi087.stdout:0/604: mknod db/da3/ce3 0 2024-09-17T07:19:53.665 INFO:tasks.workunit.client.0.smithi087.stdout:1/396: rename d2/d14/dd to d2/d3d/d45/d90 0 2024-09-17T07:19:53.667 INFO:tasks.workunit.client.0.smithi087.stdout:1/397: write d2/d3d/d45/d90/d37/f8b [291716,10469] 0 2024-09-17T07:19:53.667 INFO:tasks.workunit.client.0.smithi087.stdout:5/567: rmdir d5/d12/d56/d9e 39 2024-09-17T07:19:53.668 INFO:tasks.workunit.client.0.smithi087.stdout:5/568: write d5/d18/d6f/f85 [299433,97822] 0 2024-09-17T07:19:53.669 INFO:tasks.workunit.client.0.smithi087.stdout:3/394: rename d6/fd to d6/d16/f81 0 2024-09-17T07:19:53.732 INFO:tasks.workunit.client.0.smithi087.stdout:5/569: mknod d5/d18/d20/d2f/cba 0 2024-09-17T07:19:53.732 INFO:tasks.workunit.client.0.smithi087.stdout:5/570: dread - d5/d6d/f90 zero size 2024-09-17T07:19:53.735 INFO:tasks.workunit.client.0.smithi087.stdout:0/605: rename db/d45/d7b/laa to db/d45/d7b/d7e/le4 0 2024-09-17T07:19:53.736 INFO:tasks.workunit.client.0.smithi087.stdout:7/356: write d0/d3/d23/d17/f1e [3824631,99085] 0 2024-09-17T07:19:53.737 INFO:tasks.workunit.client.0.smithi087.stdout:3/395: truncate d6/d16/f7c 576812 0 2024-09-17T07:19:53.740 INFO:tasks.workunit.client.0.smithi087.stdout:5/571: mknod d5/d8/cbb 0 2024-09-17T07:19:53.741 INFO:tasks.workunit.client.0.smithi087.stdout:7/357: symlink d0/d3/d10/d31/l72 0 2024-09-17T07:19:53.741 INFO:tasks.workunit.client.1.smithi139.stdout:6/505: sync 2024-09-17T07:19:53.742 INFO:tasks.workunit.client.1.smithi139.stdout:8/422: sync 2024-09-17T07:19:53.742 INFO:tasks.workunit.client.1.smithi139.stdout:1/225: sync 2024-09-17T07:19:53.742 INFO:tasks.workunit.client.1.smithi139.stdout:5/260: sync 2024-09-17T07:19:53.742 INFO:tasks.workunit.client.1.smithi139.stdout:9/612: sync 2024-09-17T07:19:53.742 INFO:tasks.workunit.client.1.smithi139.stdout:0/286: sync 2024-09-17T07:19:53.742 INFO:tasks.workunit.client.1.smithi139.stdout:3/321: sync 2024-09-17T07:19:53.742 INFO:tasks.workunit.client.1.smithi139.stdout:2/367: sync 2024-09-17T07:19:53.742 INFO:tasks.workunit.client.0.smithi087.stdout:1/398: truncate d2/d3d/d35/f53 4017721 0 2024-09-17T07:19:53.743 INFO:tasks.workunit.client.0.smithi087.stdout:0/606: dwrite db/f28 [0,4194304] 0 2024-09-17T07:19:53.743 INFO:tasks.workunit.client.0.smithi087.stdout:3/396: creat d6/d15/d37/d3c/d43/d48/f82 x:0 0 0 2024-09-17T07:19:53.743 INFO:tasks.workunit.client.0.smithi087.stdout:7/358: chown d0/d3/d10/d32/d62/d6b 82897885 1 2024-09-17T07:19:53.744 INFO:tasks.workunit.client.1.smithi139.stdout:5/261: read - d4/d16/d1b/d20/d28/f46 zero size 2024-09-17T07:19:53.744 INFO:tasks.workunit.client.0.smithi087.stdout:1/399: write d2/d48/d61/f76 [1620718,117225] 0 2024-09-17T07:19:53.744 INFO:tasks.workunit.client.0.smithi087.stdout:5/572: write d5/f1b [1664525,62917] 0 2024-09-17T07:19:53.745 INFO:tasks.workunit.client.1.smithi139.stdout:0/287: truncate d1/f26 765305 0 2024-09-17T07:19:53.745 INFO:tasks.workunit.client.0.smithi087.stdout:7/359: stat d0/d3/d10/f14 0 2024-09-17T07:19:53.747 INFO:tasks.workunit.client.0.smithi087.stdout:1/400: write d2/d1a/f29 [93890,74639] 0 2024-09-17T07:19:53.747 INFO:tasks.workunit.client.1.smithi139.stdout:3/322: write d5/d15/d16/d4c/d28/f5b [3951391,36896] 0 2024-09-17T07:19:53.747 INFO:tasks.workunit.client.1.smithi139.stdout:8/423: unlink d0/dc/d18/f79 0 2024-09-17T07:19:53.748 INFO:tasks.workunit.client.0.smithi087.stdout:0/607: write db/f79 [435206,90192] 0 2024-09-17T07:19:53.749 INFO:tasks.workunit.client.1.smithi139.stdout:2/368: symlink d0/d7/d1a/d1b/l7d 0 2024-09-17T07:19:53.750 INFO:tasks.workunit.client.0.smithi087.stdout:0/608: dread - db/dbe/fbf zero size 2024-09-17T07:19:53.750 INFO:tasks.workunit.client.0.smithi087.stdout:1/401: write d2/dc/f3b [2022829,51468] 0 2024-09-17T07:19:53.750 INFO:tasks.workunit.client.0.smithi087.stdout:3/397: creat d6/d1b/d2b/f83 x:0 0 0 2024-09-17T07:19:53.752 INFO:tasks.workunit.client.1.smithi139.stdout:0/288: mkdir d1/d58/d7d 0 2024-09-17T07:19:53.752 INFO:tasks.workunit.client.1.smithi139.stdout:2/369: dread - d0/d4e/f6c zero size 2024-09-17T07:19:53.753 INFO:tasks.workunit.client.0.smithi087.stdout:1/402: mknod d2/da/d7e/c91 0 2024-09-17T07:19:53.754 INFO:tasks.workunit.client.0.smithi087.stdout:5/573: getdents d5 0 2024-09-17T07:19:53.754 INFO:tasks.workunit.client.1.smithi139.stdout:9/613: truncate dc/d11/d15/d3c/f3f 2799610 0 2024-09-17T07:19:53.754 INFO:tasks.workunit.client.0.smithi087.stdout:3/398: creat d6/d1b/d42/d62/f84 x:0 0 0 2024-09-17T07:19:53.755 INFO:tasks.workunit.client.1.smithi139.stdout:8/424: creat d0/d20/d28/d48/f83 x:0 0 0 2024-09-17T07:19:53.755 INFO:tasks.workunit.client.0.smithi087.stdout:3/399: read - d6/d1b/d2b/f7b zero size 2024-09-17T07:19:53.756 INFO:tasks.workunit.client.0.smithi087.stdout:3/400: stat d6/d15 0 2024-09-17T07:19:53.756 INFO:tasks.workunit.client.0.smithi087.stdout:0/609: rename db/d45/f97 to db/d45/d7b/d90/fe5 0 2024-09-17T07:19:53.757 INFO:tasks.workunit.client.0.smithi087.stdout:3/401: chown d6/d1b/l56 9031698 1 2024-09-17T07:19:53.757 INFO:tasks.workunit.client.1.smithi139.stdout:2/370: fsync d0/d7/f19 0 2024-09-17T07:19:53.759 INFO:tasks.workunit.client.1.smithi139.stdout:1/226: dwrite d2/d10/d12/d1a/f30 [0,4194304] 0 2024-09-17T07:19:53.759 INFO:tasks.workunit.client.1.smithi139.stdout:5/262: write d4/d16/d1b/d20/d38/f4b [3805360,39954] 0 2024-09-17T07:19:53.760 INFO:tasks.workunit.client.0.smithi087.stdout:7/360: getdents d0/d3/d10 0 2024-09-17T07:19:53.760 INFO:tasks.workunit.client.1.smithi139.stdout:8/425: chown d0/dc/d18/l2c 1010 1 2024-09-17T07:19:53.761 INFO:tasks.workunit.client.1.smithi139.stdout:5/263: dread - d4/d16/f2b zero size 2024-09-17T07:19:53.764 INFO:tasks.workunit.client.1.smithi139.stdout:9/614: dread dc/d2a/f8a [0,4194304] 0 2024-09-17T07:19:53.764 INFO:tasks.workunit.client.0.smithi087.stdout:7/361: fsync d0/d3/d10/f38 0 2024-09-17T07:19:53.765 INFO:tasks.workunit.client.1.smithi139.stdout:2/371: creat d0/de/d54/f7e x:0 0 0 2024-09-17T07:19:53.766 INFO:tasks.workunit.client.1.smithi139.stdout:5/264: symlink d4/l4e 0 2024-09-17T07:19:53.766 INFO:tasks.workunit.client.1.smithi139.stdout:5/265: readlink d4/lc 0 2024-09-17T07:19:53.767 INFO:tasks.workunit.client.0.smithi087.stdout:0/610: truncate db/d45/d5d/f70 582172 0 2024-09-17T07:19:53.767 INFO:tasks.workunit.client.0.smithi087.stdout:7/362: write d0/d3/d10/d32/f4c [447944,6429] 0 2024-09-17T07:19:53.767 INFO:tasks.workunit.client.1.smithi139.stdout:8/426: creat d0/d20/d28/d52/d54/f84 x:0 0 0 2024-09-17T07:19:53.768 INFO:tasks.workunit.client.1.smithi139.stdout:9/615: stat dc/d11/d15/d1e/d34/cb8 0 2024-09-17T07:19:53.770 INFO:tasks.workunit.client.1.smithi139.stdout:0/289: rename d1/da/d1b/d32/c4c to d1/da/d17/d72/c7e 0 2024-09-17T07:19:53.770 INFO:tasks.workunit.client.0.smithi087.stdout:1/403: getdents d2/d3d/d45/d90/d37 0 2024-09-17T07:19:53.770 INFO:tasks.workunit.client.1.smithi139.stdout:0/290: stat d1/da/d17/l25 0 2024-09-17T07:19:53.771 INFO:tasks.workunit.client.1.smithi139.stdout:0/291: stat d1/da 0 2024-09-17T07:19:53.772 INFO:tasks.workunit.client.1.smithi139.stdout:0/292: fsync d1/da/d1b/d32/f37 0 2024-09-17T07:19:53.773 INFO:tasks.workunit.client.0.smithi087.stdout:5/574: write d5/d6d/f80 [4026130,22586] 0 2024-09-17T07:19:53.773 INFO:tasks.workunit.client.1.smithi139.stdout:5/266: mkdir d4/d16/d1b/d20/d38/d4f 0 2024-09-17T07:19:53.774 INFO:tasks.workunit.client.0.smithi087.stdout:5/575: stat d5/d18/d20/d2f/c9c 0 2024-09-17T07:19:53.775 INFO:tasks.workunit.client.0.smithi087.stdout:3/402: rename d6/d15/d37/d3c/d43/d48/l63 to d6/d1b/l85 0 2024-09-17T07:19:53.775 INFO:tasks.workunit.client.1.smithi139.stdout:8/427: creat d0/d1a/d3a/d71/f85 x:0 0 0 2024-09-17T07:19:53.775 INFO:tasks.workunit.client.1.smithi139.stdout:4/343: sync 2024-09-17T07:19:53.775 INFO:tasks.workunit.client.1.smithi139.stdout:7/325: sync 2024-09-17T07:19:53.775 INFO:tasks.workunit.client.1.smithi139.stdout:5/267: readlink d4/d16/d1b/d20/d32/l40 0 2024-09-17T07:19:53.776 INFO:tasks.workunit.client.0.smithi087.stdout:0/611: mkdir db/d45/d7b/d90/dd9/de6 0 2024-09-17T07:19:53.777 INFO:tasks.workunit.client.0.smithi087.stdout:1/404: dread d2/d3d/d45/d90/ff [4194304,4194304] 0 2024-09-17T07:19:53.779 INFO:tasks.workunit.client.1.smithi139.stdout:9/616: symlink dc/d11/d15/ld0 0 2024-09-17T07:19:53.779 INFO:tasks.workunit.client.0.smithi087.stdout:7/363: dwrite d0/d3/d10/f20 [0,4194304] 0 2024-09-17T07:19:53.780 INFO:tasks.workunit.client.1.smithi139.stdout:6/506: dwrite db/df/f84 [0,4194304] 0 2024-09-17T07:19:53.782 INFO:tasks.workunit.client.0.smithi087.stdout:3/403: truncate d6/d16/f7c 1583602 0 2024-09-17T07:19:53.782 INFO:tasks.workunit.client.0.smithi087.stdout:7/364: chown d0/d36/c4a 6350161 1 2024-09-17T07:19:53.783 INFO:tasks.workunit.client.1.smithi139.stdout:2/372: creat d0/d4e/f7f x:0 0 0 2024-09-17T07:19:53.784 INFO:tasks.workunit.client.0.smithi087.stdout:1/405: symlink d2/d3d/d45/d90/d43/l92 0 2024-09-17T07:19:53.784 INFO:tasks.workunit.client.1.smithi139.stdout:5/268: dread d4/d16/f22 [0,4194304] 0 2024-09-17T07:19:53.784 INFO:tasks.workunit.client.1.smithi139.stdout:0/293: mknod d1/da/d1b/d3d/d50/c7f 0 2024-09-17T07:19:53.785 INFO:tasks.workunit.client.0.smithi087.stdout:3/404: dread - d6/d15/d37/d3c/f6f zero size 2024-09-17T07:19:53.785 INFO:tasks.workunit.client.1.smithi139.stdout:2/373: chown d0/de/d25/d3f/l48 249 1 2024-09-17T07:19:53.786 INFO:tasks.workunit.client.0.smithi087.stdout:5/576: dwrite d5/d8/d1f/f92 [0,4194304] 0 2024-09-17T07:19:53.790 INFO:tasks.workunit.client.0.smithi087.stdout:3/405: symlink d6/l86 0 2024-09-17T07:19:53.792 INFO:tasks.workunit.client.1.smithi139.stdout:9/617: chown dc/l1f 5327 1 2024-09-17T07:19:53.793 INFO:tasks.workunit.client.1.smithi139.stdout:8/428: rename d0/c24 to d0/d1a/d3a/c86 0 2024-09-17T07:19:53.795 INFO:tasks.workunit.client.0.smithi087.stdout:7/365: link d0/d3/d23/d17/f66 d0/d3/d10/d32/f73 0 2024-09-17T07:19:53.796 INFO:tasks.workunit.client.1.smithi139.stdout:3/323: dwrite d5/d21/d23/d38/f5f [0,4194304] 0 2024-09-17T07:19:53.797 INFO:tasks.workunit.client.1.smithi139.stdout:0/294: chown d1/c19 258975 1 2024-09-17T07:19:53.798 INFO:tasks.workunit.client.0.smithi087.stdout:3/406: creat d6/d1b/d42/d62/f87 x:0 0 0 2024-09-17T07:19:53.798 INFO:tasks.workunit.client.0.smithi087.stdout:5/577: creat d5/d8/d1f/d68/d7d/fbc x:0 0 0 2024-09-17T07:19:53.799 INFO:tasks.workunit.client.0.smithi087.stdout:0/612: dread db/f18 [0,4194304] 0 2024-09-17T07:19:53.801 INFO:tasks.workunit.client.0.smithi087.stdout:1/406: dwrite d2/d3d/d45/d90/d37/f5c [4194304,4194304] 0 2024-09-17T07:19:53.802 INFO:tasks.workunit.client.0.smithi087.stdout:7/366: rename d0/d3/l13 to d0/d3/d23/d2d/l74 0 2024-09-17T07:19:53.803 INFO:tasks.workunit.client.0.smithi087.stdout:3/407: mkdir d6/d15/d88 0 2024-09-17T07:19:53.807 INFO:tasks.workunit.client.0.smithi087.stdout:7/367: symlink d0/l75 0 2024-09-17T07:19:53.807 INFO:tasks.workunit.client.0.smithi087.stdout:5/578: dwrite d5/f1b [0,4194304] 0 2024-09-17T07:19:53.809 INFO:tasks.workunit.client.0.smithi087.stdout:0/613: rename db/d45/d9e/d86/c91 to db/d4f/ce7 0 2024-09-17T07:19:53.810 INFO:tasks.workunit.client.0.smithi087.stdout:0/614: readlink db/d45/d7b/la6 0 2024-09-17T07:19:53.810 INFO:tasks.workunit.client.0.smithi087.stdout:3/408: symlink d6/d7d/l89 0 2024-09-17T07:19:53.811 INFO:tasks.workunit.client.1.smithi139.stdout:7/326: dwrite d5/f1e [0,4194304] 0 2024-09-17T07:19:53.811 INFO:tasks.workunit.client.1.smithi139.stdout:6/507: mkdir db/d18/d1b/da7 0 2024-09-17T07:19:53.812 INFO:tasks.workunit.client.1.smithi139.stdout:1/227: dwrite d2/d10/d12/d13/f16 [0,4194304] 0 2024-09-17T07:19:53.812 INFO:tasks.workunit.client.1.smithi139.stdout:9/618: rmdir dc/d11/d15/d3c/d61/dc8/d9f 39 2024-09-17T07:19:53.812 INFO:tasks.workunit.client.1.smithi139.stdout:5/269: symlink d4/d16/d1b/d20/d38/d4f/l50 0 2024-09-17T07:19:53.812 INFO:tasks.workunit.client.1.smithi139.stdout:3/324: chown d5/d15/d16/d4c/d28/f5b 203 1 2024-09-17T07:19:53.812 INFO:tasks.workunit.client.1.smithi139.stdout:8/429: creat d0/d20/f87 x:0 0 0 2024-09-17T07:19:53.812 INFO:tasks.workunit.client.1.smithi139.stdout:4/344: rename d0/d1/l2f to d0/d37/l65 0 2024-09-17T07:19:53.813 INFO:tasks.workunit.client.0.smithi087.stdout:5/579: write d5/d18/d20/d2f/d52/f72 [4858605,64043] 0 2024-09-17T07:19:53.814 INFO:tasks.workunit.client.0.smithi087.stdout:3/409: truncate d6/d1b/d42/f44 1299693 0 2024-09-17T07:19:53.815 INFO:tasks.workunit.client.0.smithi087.stdout:0/615: write db/faf [361070,79977] 0 2024-09-17T07:19:53.817 INFO:tasks.workunit.client.0.smithi087.stdout:7/368: dwrite d0/d3/d10/f1a [0,4194304] 0 2024-09-17T07:19:53.817 INFO:tasks.workunit.client.0.smithi087.stdout:0/616: fdatasync db/d45/f4c 0 2024-09-17T07:19:53.818 INFO:tasks.workunit.client.1.smithi139.stdout:1/228: dread d2/fd [0,4194304] 0 2024-09-17T07:19:53.820 INFO:tasks.workunit.client.0.smithi087.stdout:3/410: rmdir d6/d15/d37/d3c/d43 39 2024-09-17T07:19:53.820 INFO:tasks.workunit.client.0.smithi087.stdout:5/580: creat d5/d6d/fbd x:0 0 0 2024-09-17T07:19:53.821 INFO:tasks.workunit.client.0.smithi087.stdout:0/617: mkdir db/d45/d5b/d92/de8 0 2024-09-17T07:19:53.822 INFO:tasks.workunit.client.0.smithi087.stdout:5/581: chown d5/d18/d6a/c9d 150 1 2024-09-17T07:19:53.823 INFO:tasks.workunit.client.0.smithi087.stdout:5/582: write d5/d18/f78 [3376130,2652] 0 2024-09-17T07:19:53.824 INFO:tasks.workunit.client.1.smithi139.stdout:8/430: symlink d0/d20/d28/l88 0 2024-09-17T07:19:53.824 INFO:tasks.workunit.client.1.smithi139.stdout:4/345: creat d0/d1/d29/f66 x:0 0 0 2024-09-17T07:19:53.826 INFO:tasks.workunit.client.1.smithi139.stdout:3/325: mkdir d5/d21/d23/d69 0 2024-09-17T07:19:53.827 INFO:tasks.workunit.client.0.smithi087.stdout:5/583: rename d5/d8/fb2 to d5/d12/d4d/fbe 0 2024-09-17T07:19:53.828 INFO:tasks.workunit.client.1.smithi139.stdout:4/346: write d0/d1/d29/f50 [935485,8378] 0 2024-09-17T07:19:53.831 INFO:tasks.workunit.client.0.smithi087.stdout:5/584: rename d5/d6d/faa to d5/d18/d20/d7a/fbf 0 2024-09-17T07:19:53.832 INFO:tasks.workunit.client.1.smithi139.stdout:2/374: getdents d0/de/d69 0 2024-09-17T07:19:53.832 INFO:tasks.workunit.client.1.smithi139.stdout:8/431: dread - d0/d1a/d3a/d71/f75 zero size 2024-09-17T07:19:53.833 INFO:tasks.workunit.client.0.smithi087.stdout:5/585: dread d5/d8/d1f/d68/f8d [0,4194304] 0 2024-09-17T07:19:53.833 INFO:tasks.workunit.client.0.smithi087.stdout:0/618: dread db/d45/d9e/d95/dd8/fe2 [0,4194304] 0 2024-09-17T07:19:53.836 INFO:tasks.workunit.client.0.smithi087.stdout:5/586: creat d5/d8/d1f/fc0 x:0 0 0 2024-09-17T07:19:53.836 INFO:tasks.workunit.client.1.smithi139.stdout:7/327: getdents d5/d17 0 2024-09-17T07:19:53.836 INFO:tasks.workunit.client.0.smithi087.stdout:0/619: mkdir db/d45/d9e/d95/de9 0 2024-09-17T07:19:53.837 INFO:tasks.workunit.client.1.smithi139.stdout:4/347: write d0/d49/f52 [215470,59199] 0 2024-09-17T07:19:53.837 INFO:tasks.workunit.client.1.smithi139.stdout:2/375: rmdir d0/de/df 39 2024-09-17T07:19:53.838 INFO:tasks.workunit.client.0.smithi087.stdout:5/587: symlink d5/d18/lc1 0 2024-09-17T07:19:53.839 INFO:tasks.workunit.client.1.smithi139.stdout:9/619: dwrite dc/d2a/fa7 [4194304,4194304] 0 2024-09-17T07:19:53.840 INFO:tasks.workunit.client.0.smithi087.stdout:0/620: symlink db/d4f/lea 0 2024-09-17T07:19:53.840 INFO:tasks.workunit.client.1.smithi139.stdout:5/270: dwrite d4/d16/f22 [0,4194304] 0 2024-09-17T07:19:53.840 INFO:tasks.workunit.client.1.smithi139.stdout:7/328: stat d5/d17/d4e/l5c 0 2024-09-17T07:19:53.841 INFO:tasks.workunit.client.0.smithi087.stdout:5/588: write d5/d12/d4d/f47 [980640,46610] 0 2024-09-17T07:19:53.842 INFO:tasks.workunit.client.0.smithi087.stdout:5/589: stat d5/d8/f10 0 2024-09-17T07:19:53.844 INFO:tasks.workunit.client.1.smithi139.stdout:8/432: write d0/d20/d28/d52/f64 [967616,74490] 0 2024-09-17T07:19:53.847 INFO:tasks.workunit.client.1.smithi139.stdout:7/329: chown d5/d17/c3d 31 1 2024-09-17T07:19:53.849 INFO:tasks.workunit.client.1.smithi139.stdout:4/348: rmdir d0/d1a/d5a 0 2024-09-17T07:19:53.849 INFO:tasks.workunit.client.1.smithi139.stdout:7/330: chown d5/d17/f2a 0 1 2024-09-17T07:19:53.850 INFO:tasks.workunit.client.1.smithi139.stdout:8/433: dread - d0/d1a/d3a/d71/f75 zero size 2024-09-17T07:19:53.851 INFO:tasks.workunit.client.1.smithi139.stdout:2/376: truncate d0/de/f14 643027 0 2024-09-17T07:19:53.852 INFO:tasks.workunit.client.1.smithi139.stdout:7/331: readlink d5/d17/l2d 0 2024-09-17T07:19:53.853 INFO:tasks.workunit.client.1.smithi139.stdout:3/326: dwrite d5/d15/d16/d4c/d28/f30 [0,4194304] 0 2024-09-17T07:19:53.854 INFO:tasks.workunit.client.1.smithi139.stdout:2/377: write d0/dc/d15/f23 [5165689,103715] 0 2024-09-17T07:19:53.859 INFO:tasks.workunit.client.1.smithi139.stdout:8/434: rename d0/d1a/d3a/d71/f85 to d0/d1a/d82/f89 0 2024-09-17T07:19:53.860 INFO:tasks.workunit.client.1.smithi139.stdout:4/349: creat d0/d1/d29/d41/f67 x:0 0 0 2024-09-17T07:19:53.866 INFO:tasks.workunit.client.1.smithi139.stdout:8/435: link d0/fd d0/d1a/d3a/f8a 0 2024-09-17T07:19:53.866 INFO:tasks.workunit.client.1.smithi139.stdout:7/332: link d5/d10/d2b/c38 d5/d10/d4d/c65 0 2024-09-17T07:19:53.870 INFO:tasks.workunit.client.1.smithi139.stdout:7/333: mkdir d5/d17/d4e/d66 0 2024-09-17T07:19:53.871 INFO:tasks.workunit.client.1.smithi139.stdout:3/327: getdents d5/d15/d16/d4c/d28/d54 0 2024-09-17T07:19:53.872 INFO:tasks.workunit.client.1.smithi139.stdout:8/436: dread d0/d20/d28/d52/d65/f70 [0,4194304] 0 2024-09-17T07:19:53.873 INFO:tasks.workunit.client.1.smithi139.stdout:7/334: mkdir d5/d67 0 2024-09-17T07:19:53.875 INFO:tasks.workunit.client.1.smithi139.stdout:3/328: mknod d5/d15/d16/d4c/d28/d54/d58/c6a 0 2024-09-17T07:19:53.876 INFO:tasks.workunit.client.1.smithi139.stdout:7/335: unlink d5/d17/d4e/d55/l5e 0 2024-09-17T07:19:53.877 INFO:tasks.workunit.client.1.smithi139.stdout:3/329: mknod d5/d15/d20/d3b/c6b 0 2024-09-17T07:19:53.878 INFO:tasks.workunit.client.1.smithi139.stdout:7/336: mkdir d5/d17/d68 0 2024-09-17T07:19:53.879 INFO:tasks.workunit.client.1.smithi139.stdout:8/437: dread d0/d1a/f39 [0,4194304] 0 2024-09-17T07:19:53.882 INFO:tasks.workunit.client.0.smithi087.stdout:0/621: dread db/d45/d5d/f8f [0,4194304] 0 2024-09-17T07:19:53.883 INFO:tasks.workunit.client.0.smithi087.stdout:3/411: dread d6/f59 [0,4194304] 0 2024-09-17T07:19:53.884 INFO:tasks.workunit.client.1.smithi139.stdout:8/438: creat d0/d1a/d3a/d71/f8b x:0 0 0 2024-09-17T07:19:53.884 INFO:tasks.workunit.client.1.smithi139.stdout:8/439: dread - d0/d1a/f77 zero size 2024-09-17T07:19:53.884 INFO:tasks.workunit.client.0.smithi087.stdout:3/412: dread - d6/d1b/d2b/f7b zero size 2024-09-17T07:19:53.885 INFO:tasks.workunit.client.1.smithi139.stdout:3/330: dread d5/fe [0,4194304] 0 2024-09-17T07:19:53.885 INFO:tasks.workunit.client.0.smithi087.stdout:3/413: dread - d6/d15/d37/f72 zero size 2024-09-17T07:19:53.885 INFO:tasks.workunit.client.0.smithi087.stdout:0/622: mkdir db/d45/d9e/d86/dd5/deb 0 2024-09-17T07:19:53.886 INFO:tasks.workunit.client.1.smithi139.stdout:3/331: chown d5/d15/d16/d4c/d28/d54/c5c 64785 1 2024-09-17T07:19:53.886 INFO:tasks.workunit.client.1.smithi139.stdout:7/337: link d5/d10/d4d/d59/f5f d5/d17/d4e/f69 0 2024-09-17T07:19:53.888 INFO:tasks.workunit.client.0.smithi087.stdout:3/414: rmdir d6/d15/d37/d3c/d43 39 2024-09-17T07:19:53.889 INFO:tasks.workunit.client.1.smithi139.stdout:7/338: write d5/d10/d2b/f3f [1001959,7690] 0 2024-09-17T07:19:53.889 INFO:tasks.workunit.client.1.smithi139.stdout:3/332: truncate d5/d15/d16/d4c/f4b 578959 0 2024-09-17T07:19:53.890 INFO:tasks.workunit.client.1.smithi139.stdout:8/440: creat d0/d1a/d4d/d53/f8c x:0 0 0 2024-09-17T07:19:53.891 INFO:tasks.workunit.client.0.smithi087.stdout:0/623: link db/dbe/fcc db/d45/d5b/fec 0 2024-09-17T07:19:53.891 INFO:tasks.workunit.client.1.smithi139.stdout:7/339: mknod d5/d17/c6a 0 2024-09-17T07:19:53.892 INFO:tasks.workunit.client.0.smithi087.stdout:0/624: truncate db/d45/d7b/d7e/fbd 795003 0 2024-09-17T07:19:53.893 INFO:tasks.workunit.client.0.smithi087.stdout:3/415: mknod d6/d1b/d2b/c8a 0 2024-09-17T07:19:53.893 INFO:tasks.workunit.client.1.smithi139.stdout:8/441: mkdir d0/d1a/d3a/d8d 0 2024-09-17T07:19:53.894 INFO:tasks.workunit.client.0.smithi087.stdout:0/625: dread - db/d45/d7b/d7e/fa4 zero size 2024-09-17T07:19:53.894 INFO:tasks.workunit.client.0.smithi087.stdout:3/416: readlink d6/d15/d4b/l65 0 2024-09-17T07:19:53.894 INFO:tasks.workunit.client.0.smithi087.stdout:7/369: truncate d0/d3/f3f 2650866 0 2024-09-17T07:19:53.895 INFO:tasks.workunit.client.1.smithi139.stdout:0/295: truncate d1/da/d1b/d3d/d5a/d75/f77 1315522 0 2024-09-17T07:19:53.896 INFO:tasks.workunit.client.0.smithi087.stdout:3/417: write d6/d15/f24 [2506906,83864] 0 2024-09-17T07:19:53.897 INFO:tasks.workunit.client.1.smithi139.stdout:8/442: creat d0/d1a/d3a/f8e x:0 0 0 2024-09-17T07:19:53.898 INFO:tasks.workunit.client.1.smithi139.stdout:9/620: dread dc/d11/d15/d1e/f21 [0,4194304] 0 2024-09-17T07:19:53.899 INFO:tasks.workunit.client.1.smithi139.stdout:7/340: dread d5/d10/d2b/f3f [0,4194304] 0 2024-09-17T07:19:53.900 INFO:tasks.workunit.client.1.smithi139.stdout:9/621: chown dc 230 1 2024-09-17T07:19:53.901 INFO:tasks.workunit.client.1.smithi139.stdout:3/333: dwrite d5/d15/d16/d4c/d28/f3d [4194304,4194304] 0 2024-09-17T07:19:53.902 INFO:tasks.workunit.client.0.smithi087.stdout:3/418: link d6/d15/d37/f55 d6/d15/d4b/f8b 0 2024-09-17T07:19:53.903 INFO:tasks.workunit.client.1.smithi139.stdout:3/334: dread - d5/d15/d16/d4c/f66 zero size 2024-09-17T07:19:53.904 INFO:tasks.workunit.client.0.smithi087.stdout:3/419: creat d6/d1b/d42/d62/f8c x:0 0 0 2024-09-17T07:19:53.904 INFO:tasks.workunit.client.1.smithi139.stdout:3/335: write d5/f64 [890033,53641] 0 2024-09-17T07:19:53.904 INFO:tasks.workunit.client.1.smithi139.stdout:5/271: truncate d4/d16/f22 3965467 0 2024-09-17T07:19:53.905 INFO:tasks.workunit.client.1.smithi139.stdout:3/336: chown d5/d15/d16/d4c 96 1 2024-09-17T07:19:53.906 INFO:tasks.workunit.client.1.smithi139.stdout:8/443: unlink d0/d1a/d82/f89 0 2024-09-17T07:19:53.907 INFO:tasks.workunit.client.1.smithi139.stdout:8/444: fdatasync d0/d1a/d3a/f8e 0 2024-09-17T07:19:53.909 INFO:tasks.workunit.client.1.smithi139.stdout:9/622: mkdir dc/d11/d15/d3c/d61/dc8/dd1 0 2024-09-17T07:19:53.910 INFO:tasks.workunit.client.1.smithi139.stdout:3/337: symlink d5/d21/d23/l6c 0 2024-09-17T07:19:53.912 INFO:tasks.workunit.client.0.smithi087.stdout:5/590: dwrite d5/d8/d1f/d4e/fb4 [0,4194304] 0 2024-09-17T07:19:53.913 INFO:tasks.workunit.client.1.smithi139.stdout:2/378: dread d0/de/f14 [0,4194304] 0 2024-09-17T07:19:53.913 INFO:tasks.workunit.client.1.smithi139.stdout:5/272: symlink d4/d16/d1b/d20/d28/d3f/l51 0 2024-09-17T07:19:53.914 INFO:tasks.workunit.client.0.smithi087.stdout:5/591: write d5/d18/d20/d2f/d52/f72 [2925851,112704] 0 2024-09-17T07:19:53.914 INFO:tasks.workunit.client.1.smithi139.stdout:4/350: truncate d0/f7 5209073 0 2024-09-17T07:19:53.918 INFO:tasks.workunit.client.0.smithi087.stdout:5/592: rmdir d5/d8/d1f/d68/d7d 39 2024-09-17T07:19:53.920 INFO:tasks.workunit.client.1.smithi139.stdout:4/351: readlink d0/d1/d29/l2a 0 2024-09-17T07:19:53.920 INFO:tasks.workunit.client.1.smithi139.stdout:2/379: truncate d0/dc/d15/f5f 912318 0 2024-09-17T07:19:53.920 INFO:tasks.workunit.client.0.smithi087.stdout:5/593: rmdir d5/d8/d1f 39 2024-09-17T07:19:53.921 INFO:tasks.workunit.client.0.smithi087.stdout:5/594: dread - d5/d12/d14/fb3 zero size 2024-09-17T07:19:53.921 INFO:tasks.workunit.client.0.smithi087.stdout:7/370: write d0/d3/d23/d17/f51 [67399,119198] 0 2024-09-17T07:19:53.924 INFO:tasks.workunit.client.0.smithi087.stdout:7/371: rmdir d0/d3/d23/d4e 39 2024-09-17T07:19:53.924 INFO:tasks.workunit.client.1.smithi139.stdout:0/296: dread d1/da/d2a/f51 [0,4194304] 0 2024-09-17T07:19:53.926 INFO:tasks.workunit.client.1.smithi139.stdout:3/338: dread d5/d15/d16/d4c/d28/f3d [4194304,4194304] 0 2024-09-17T07:19:53.926 INFO:tasks.workunit.client.1.smithi139.stdout:7/341: dread d5/d17/f20 [0,4194304] 0 2024-09-17T07:19:53.927 INFO:tasks.workunit.client.0.smithi087.stdout:5/595: mkdir d5/d18/dc2 0 2024-09-17T07:19:53.927 INFO:tasks.workunit.client.1.smithi139.stdout:8/445: link d0/d1a/d4d/d53/f5d d0/d20/f8f 0 2024-09-17T07:19:53.927 INFO:tasks.workunit.client.0.smithi087.stdout:5/596: chown d5/d12/d1c/c64 454312 1 2024-09-17T07:19:53.929 INFO:tasks.workunit.client.0.smithi087.stdout:7/372: rename d0/d3/d10/d32/d62/d6b to d0/d3/d10/d32/d62/d76 0 2024-09-17T07:19:53.931 INFO:tasks.workunit.client.1.smithi139.stdout:2/380: chown d0/d4e/d76 666 1 2024-09-17T07:19:53.932 INFO:tasks.workunit.client.0.smithi087.stdout:5/597: symlink d5/d12/d56/d5b/lc3 0 2024-09-17T07:19:53.932 INFO:tasks.workunit.client.0.smithi087.stdout:5/598: readlink d5/d8/d1f/la6 0 2024-09-17T07:19:53.932 INFO:tasks.workunit.client.1.smithi139.stdout:0/297: truncate d1/da/d1b/d32/f73 370382 0 2024-09-17T07:19:53.932 INFO:tasks.workunit.client.1.smithi139.stdout:8/446: symlink d0/d20/d28/d52/d65/l90 0 2024-09-17T07:19:53.933 INFO:tasks.workunit.client.0.smithi087.stdout:7/373: rename d0/d3/d23/d17/c50 to d0/d3/d23/d2d/c77 0 2024-09-17T07:19:53.933 INFO:tasks.workunit.client.1.smithi139.stdout:3/339: chown d5/d21/d23/l6c 728 1 2024-09-17T07:19:53.934 INFO:tasks.workunit.client.1.smithi139.stdout:0/298: write d1/da/d2a/f38 [2008141,59108] 0 2024-09-17T07:19:53.934 INFO:tasks.workunit.client.1.smithi139.stdout:2/381: write d0/d4e/d76/f78 [385536,11063] 0 2024-09-17T07:19:53.936 INFO:tasks.workunit.client.1.smithi139.stdout:4/352: dwrite d0/d1/d54/f5b [0,4194304] 0 2024-09-17T07:19:53.937 INFO:tasks.workunit.client.1.smithi139.stdout:8/447: fdatasync d0/d20/f5f 0 2024-09-17T07:19:53.937 INFO:tasks.workunit.client.0.smithi087.stdout:5/599: rename d5/d8/d1f/d68/f98 to d5/d8/fc4 0 2024-09-17T07:19:53.937 INFO:tasks.workunit.client.0.smithi087.stdout:7/374: truncate d0/d3/d10/f38 1067179 0 2024-09-17T07:19:53.938 INFO:tasks.workunit.client.1.smithi139.stdout:7/342: creat d5/d17/d4e/d63/f6b x:0 0 0 2024-09-17T07:19:53.939 INFO:tasks.workunit.client.1.smithi139.stdout:8/448: write d0/f7d [261651,2674] 0 2024-09-17T07:19:53.940 INFO:tasks.workunit.client.1.smithi139.stdout:7/343: chown d5/f1e 35536 1 2024-09-17T07:19:53.940 INFO:tasks.workunit.client.0.smithi087.stdout:7/375: creat d0/d3/d23/d4e/f78 x:0 0 0 2024-09-17T07:19:53.941 INFO:tasks.workunit.client.1.smithi139.stdout:9/623: rename dc/d11/d15/d3c/f5d to dc/d11/d52/d56/d7a/fd2 0 2024-09-17T07:19:53.941 INFO:tasks.workunit.client.0.smithi087.stdout:3/420: dread d6/fa [0,4194304] 0 2024-09-17T07:19:53.942 INFO:tasks.workunit.client.0.smithi087.stdout:7/376: dread d0/f2e [0,4194304] 0 2024-09-17T07:19:53.945 INFO:tasks.workunit.client.0.smithi087.stdout:7/377: creat d0/d3/d23/d2d/f79 x:0 0 0 2024-09-17T07:19:53.947 INFO:tasks.workunit.client.1.smithi139.stdout:7/344: rmdir d5/d10/d4d 39 2024-09-17T07:19:53.947 INFO:tasks.workunit.client.0.smithi087.stdout:7/378: mkdir d0/d7a 0 2024-09-17T07:19:53.949 INFO:tasks.workunit.client.1.smithi139.stdout:9/624: write dc/d11/d15/d3c/d61/d64/f82 [4684236,26863] 0 2024-09-17T07:19:53.949 INFO:tasks.workunit.client.1.smithi139.stdout:8/449: symlink d0/d20/d28/d52/d54/l91 0 2024-09-17T07:19:53.949 INFO:tasks.workunit.client.0.smithi087.stdout:7/379: mkdir d0/d3/d23/d17/d7b 0 2024-09-17T07:19:53.949 INFO:tasks.workunit.client.0.smithi087.stdout:7/380: fsync d0/d3/f5a 0 2024-09-17T07:19:53.950 INFO:tasks.workunit.client.0.smithi087.stdout:7/381: symlink d0/d36/l7c 0 2024-09-17T07:19:53.951 INFO:tasks.workunit.client.1.smithi139.stdout:5/273: rmdir d4/d16/d1b 39 2024-09-17T07:19:53.953 INFO:tasks.workunit.client.1.smithi139.stdout:3/340: dwrite d5/d15/d16/d4c/d28/f50 [0,4194304] 0 2024-09-17T07:19:53.955 INFO:tasks.workunit.client.0.smithi087.stdout:7/382: dwrite d0/d3/d23/d17/f47 [0,4194304] 0 2024-09-17T07:19:53.956 INFO:tasks.workunit.client.1.smithi139.stdout:3/341: read - d5/f39 zero size 2024-09-17T07:19:53.956 INFO:tasks.workunit.client.0.smithi087.stdout:7/383: dread - d0/d3/d23/d4e/f70 zero size 2024-09-17T07:19:53.957 INFO:tasks.workunit.client.1.smithi139.stdout:5/274: stat d4/d16/d1b 0 2024-09-17T07:19:53.957 INFO:tasks.workunit.client.0.smithi087.stdout:7/384: dread d0/f2e [0,4194304] 0 2024-09-17T07:19:53.959 INFO:tasks.workunit.client.1.smithi139.stdout:3/342: chown d5/d21/c27 53 1 2024-09-17T07:19:53.961 INFO:tasks.workunit.client.1.smithi139.stdout:8/450: symlink d0/d1a/l92 0 2024-09-17T07:19:53.962 INFO:tasks.workunit.client.1.smithi139.stdout:0/299: dwrite d1/da/d2a/f62 [0,4194304] 0 2024-09-17T07:19:53.965 INFO:tasks.workunit.client.1.smithi139.stdout:8/451: write d0/d20/f5f [39216,66566] 0 2024-09-17T07:19:53.968 INFO:tasks.workunit.client.1.smithi139.stdout:8/452: write d0/d1a/f3f [196753,13720] 0 2024-09-17T07:19:53.968 INFO:tasks.workunit.client.0.smithi087.stdout:7/385: dwrite d0/d3/d23/d2d/f79 [0,4194304] 0 2024-09-17T07:19:53.970 INFO:tasks.workunit.client.1.smithi139.stdout:8/453: readlink d0/l81 0 2024-09-17T07:19:53.970 INFO:tasks.workunit.client.1.smithi139.stdout:8/454: dread - d0/d1a/f77 zero size 2024-09-17T07:19:53.970 INFO:tasks.workunit.client.1.smithi139.stdout:3/343: unlink d5/d15/d16/d4c/f36 0 2024-09-17T07:19:53.971 INFO:tasks.workunit.client.0.smithi087.stdout:7/386: creat d0/d3/d23/d2d/f7d x:0 0 0 2024-09-17T07:19:53.972 INFO:tasks.workunit.client.1.smithi139.stdout:0/300: dread d1/da/d1b/d3d/d50/f61 [0,4194304] 0 2024-09-17T07:19:53.977 INFO:tasks.workunit.client.0.smithi087.stdout:7/387: write d0/d3/d23/d4e/f70 [731872,130768] 0 2024-09-17T07:19:53.978 INFO:tasks.workunit.client.0.smithi087.stdout:5/600: dread d5/d12/d4d/fbe [0,4194304] 0 2024-09-17T07:19:53.979 INFO:tasks.workunit.client.1.smithi139.stdout:7/345: rename d5/d10/d4d/c65 to d5/d10/d2b/d40/c6c 0 2024-09-17T07:19:53.979 INFO:tasks.workunit.client.0.smithi087.stdout:7/388: truncate d0/d3/f5a 115568 0 2024-09-17T07:19:53.981 INFO:tasks.workunit.client.1.smithi139.stdout:8/455: dwrite d0/d20/f87 [0,4194304] 0 2024-09-17T07:19:53.982 INFO:tasks.workunit.client.0.smithi087.stdout:5/601: mknod d5/d18/d20/d2f/d60/cc5 0 2024-09-17T07:19:53.982 INFO:tasks.workunit.client.1.smithi139.stdout:3/344: mkdir d5/d63/d6d 0 2024-09-17T07:19:53.984 INFO:tasks.workunit.client.1.smithi139.stdout:5/275: rename d4/d16/d1b/d20/f24 to d4/d16/d1b/d20/d28/f52 0 2024-09-17T07:19:53.986 INFO:tasks.workunit.client.0.smithi087.stdout:5/602: dread d5/f1b [0,4194304] 0 2024-09-17T07:19:53.986 INFO:tasks.workunit.client.0.smithi087.stdout:5/603: stat d5/d12/d1c/c45 0 2024-09-17T07:19:53.989 INFO:tasks.workunit.client.0.smithi087.stdout:5/604: symlink d5/d6d/lc6 0 2024-09-17T07:19:53.992 INFO:tasks.workunit.client.0.smithi087.stdout:3/421: dread d6/d15/d37/d3c/d43/d48/f58 [0,4194304] 0 2024-09-17T07:19:53.992 INFO:tasks.workunit.client.1.smithi139.stdout:0/301: getdents d1/da/d17/d65 0 2024-09-17T07:19:53.993 INFO:tasks.workunit.client.0.smithi087.stdout:3/422: readlink d6/d1b/l5a 0 2024-09-17T07:19:53.993 INFO:tasks.workunit.client.1.smithi139.stdout:5/276: dread d4/d16/d1b/d20/d38/f3b [0,4194304] 0 2024-09-17T07:19:53.994 INFO:tasks.workunit.client.1.smithi139.stdout:0/302: write d1/da/f60 [1452299,62620] 0 2024-09-17T07:19:53.994 INFO:tasks.workunit.client.1.smithi139.stdout:7/346: creat d5/d10/d2b/d40/f6d x:0 0 0 2024-09-17T07:19:53.995 INFO:tasks.workunit.client.1.smithi139.stdout:7/347: stat d5/d10/f28 0 2024-09-17T07:19:53.996 INFO:tasks.workunit.client.1.smithi139.stdout:8/456: link d0/d20/c23 d0/d20/d28/d48/c93 0 2024-09-17T07:19:53.996 INFO:tasks.workunit.client.1.smithi139.stdout:3/345: link d5/d21/d23/c61 d5/d21/c6e 0 2024-09-17T07:19:53.998 INFO:tasks.workunit.client.1.smithi139.stdout:0/303: unlink d1/f3e 0 2024-09-17T07:19:54.001 INFO:tasks.workunit.client.1.smithi139.stdout:8/457: unlink d0/d20/d28/d52/d65/l90 0 2024-09-17T07:19:54.002 INFO:tasks.workunit.client.1.smithi139.stdout:8/458: chown d0/d20/d28/d48/l66 20 1 2024-09-17T07:19:54.002 INFO:tasks.workunit.client.1.smithi139.stdout:9/625: truncate dc/d11/d15/d1e/f65 1191611 0 2024-09-17T07:19:54.003 INFO:tasks.workunit.client.1.smithi139.stdout:0/304: creat d1/da/d2a/f80 x:0 0 0 2024-09-17T07:19:54.006 INFO:tasks.workunit.client.1.smithi139.stdout:5/277: link d4/d16/f1d d4/d16/d1b/d20/d28/f53 0 2024-09-17T07:19:54.006 INFO:tasks.workunit.client.1.smithi139.stdout:7/348: creat d5/f6e x:0 0 0 2024-09-17T07:19:54.007 INFO:tasks.workunit.client.0.smithi087.stdout:3/423: write d6/d16/f36 [1182815,67286] 0 2024-09-17T07:19:54.008 INFO:tasks.workunit.client.1.smithi139.stdout:8/459: creat d0/d20/d28/d52/d65/f94 x:0 0 0 2024-09-17T07:19:54.011 INFO:tasks.workunit.client.1.smithi139.stdout:3/346: dwrite d5/d15/d16/d4c/d28/f52 [4194304,4194304] 0 2024-09-17T07:19:54.011 INFO:tasks.workunit.client.1.smithi139.stdout:7/349: write d5/d17/f49 [414491,9002] 0 2024-09-17T07:19:54.011 INFO:tasks.workunit.client.0.smithi087.stdout:7/389: dwrite d0/d3/d23/d17/f66 [0,4194304] 0 2024-09-17T07:19:54.012 INFO:tasks.workunit.client.0.smithi087.stdout:3/424: creat d6/d15/d37/d3c/f8d x:0 0 0 2024-09-17T07:19:54.016 INFO:tasks.workunit.client.1.smithi139.stdout:5/278: dread d4/d16/d1b/d20/d38/f3b [0,4194304] 0 2024-09-17T07:19:54.017 INFO:tasks.workunit.client.0.smithi087.stdout:7/390: truncate d0/d3/d23/d2d/f35 3816431 0 2024-09-17T07:19:54.017 INFO:tasks.workunit.client.1.smithi139.stdout:7/350: creat d5/d17/d4e/d55/f6f x:0 0 0 2024-09-17T07:19:54.018 INFO:tasks.workunit.client.1.smithi139.stdout:0/305: dwrite d1/da/f14 [0,4194304] 0 2024-09-17T07:19:54.019 INFO:tasks.workunit.client.0.smithi087.stdout:5/605: dread d5/d12/d14/f7b [0,4194304] 0 2024-09-17T07:19:54.019 INFO:tasks.workunit.client.0.smithi087.stdout:3/425: rename d6/c34 to d6/d15/d37/d3c/c8e 0 2024-09-17T07:19:54.020 INFO:tasks.workunit.client.0.smithi087.stdout:7/391: symlink d0/d3/d23/d2d/l7e 0 2024-09-17T07:19:54.021 INFO:tasks.workunit.client.0.smithi087.stdout:3/426: truncate d6/f12 5171520 0 2024-09-17T07:19:54.021 INFO:tasks.workunit.client.0.smithi087.stdout:5/606: chown d5/d18/d20/d7a/l7c 69073 1 2024-09-17T07:19:54.022 INFO:tasks.workunit.client.0.smithi087.stdout:3/427: stat d6/f12 0 2024-09-17T07:19:54.022 INFO:tasks.workunit.client.1.smithi139.stdout:8/460: link d0/d20/l76 d0/d20/d28/d52/d65/d7f/l95 0 2024-09-17T07:19:54.023 INFO:tasks.workunit.client.0.smithi087.stdout:5/607: stat d5/d8/l23 0 2024-09-17T07:19:54.023 INFO:tasks.workunit.client.0.smithi087.stdout:7/392: read d0/d3/d23/d2d/f79 [127263,60251] 0 2024-09-17T07:19:54.023 INFO:tasks.workunit.client.0.smithi087.stdout:3/428: stat d6/d1b/d2b/c8a 0 2024-09-17T07:19:54.024 INFO:tasks.workunit.client.1.smithi139.stdout:5/279: write d4/d16/f19 [4928394,21170] 0 2024-09-17T07:19:54.024 INFO:tasks.workunit.client.1.smithi139.stdout:7/351: rmdir d5/d10/d4d 39 2024-09-17T07:19:54.024 INFO:tasks.workunit.client.1.smithi139.stdout:8/461: chown d0/dc/d18/l2c 45260294 1 2024-09-17T07:19:54.024 INFO:tasks.workunit.client.0.smithi087.stdout:5/608: write d5/d12/f8b [574125,91366] 0 2024-09-17T07:19:54.025 INFO:tasks.workunit.client.1.smithi139.stdout:0/306: chown d1/da/d1b/d3d/d5a/d75/f77 0 1 2024-09-17T07:19:54.025 INFO:tasks.workunit.client.1.smithi139.stdout:5/280: chown d4/d16/d1b/d20/d38/d4f 0 1 2024-09-17T07:19:54.026 INFO:tasks.workunit.client.1.smithi139.stdout:0/307: write d1/da/d2a/f80 [829869,95220] 0 2024-09-17T07:19:54.026 INFO:tasks.workunit.client.1.smithi139.stdout:5/281: dread - d4/d16/d1b/d20/d32/f4c zero size 2024-09-17T07:19:54.029 INFO:tasks.workunit.client.1.smithi139.stdout:5/282: dread d4/f36 [0,4194304] 0 2024-09-17T07:19:54.030 INFO:tasks.workunit.client.1.smithi139.stdout:5/283: creat d4/d16/d1b/d20/d38/f54 x:0 0 0 2024-09-17T07:19:54.032 INFO:tasks.workunit.client.0.smithi087.stdout:7/393: link d0/f6 d0/d3/d10/d32/d62/d76/f7f 0 2024-09-17T07:19:54.033 INFO:tasks.workunit.client.1.smithi139.stdout:5/284: read d4/d16/d1b/d20/d28/f1f [422308,24704] 0 2024-09-17T07:19:54.034 INFO:tasks.workunit.client.1.smithi139.stdout:5/285: creat d4/d16/d1b/f55 x:0 0 0 2024-09-17T07:19:54.036 INFO:tasks.workunit.client.1.smithi139.stdout:5/286: write d4/d16/d1b/d20/d28/f3e [2683139,22561] 0 2024-09-17T07:19:54.037 INFO:tasks.workunit.client.1.smithi139.stdout:5/287: truncate d4/d16/f2b 913246 0 2024-09-17T07:19:54.039 INFO:tasks.workunit.client.1.smithi139.stdout:9/626: dread dc/d11/d52/d56/f99 [0,4194304] 0 2024-09-17T07:19:54.039 INFO:tasks.workunit.client.0.smithi087.stdout:7/394: dwrite d0/d3/f5a [0,4194304] 0 2024-09-17T07:19:54.045 INFO:tasks.workunit.client.0.smithi087.stdout:7/395: link d0/d3/d10/d31/l3c d0/d3/d10/d32/d62/d76/l80 0 2024-09-17T07:19:54.045 INFO:tasks.workunit.client.1.smithi139.stdout:5/288: dread d4/d16/d1b/f39 [0,4194304] 0 2024-09-17T07:19:54.046 INFO:tasks.workunit.client.1.smithi139.stdout:5/289: chown d4/d16/d1b/d20/l27 62504634 1 2024-09-17T07:19:54.058 INFO:tasks.workunit.client.0.smithi087.stdout:3/429: write d6/d15/d4b/f8b [5316086,128503] 0 2024-09-17T07:19:54.062 INFO:tasks.workunit.client.0.smithi087.stdout:3/430: rename d6/d1b/d42/f7e to d6/d1b/f8f 0 2024-09-17T07:19:54.063 INFO:tasks.workunit.client.1.smithi139.stdout:9/627: dread dc/d11/f1b [0,4194304] 0 2024-09-17T07:19:54.064 INFO:tasks.workunit.client.1.smithi139.stdout:9/628: write dc/d11/d15/d3c/d61/d64/f82 [4144375,63878] 0 2024-09-17T07:19:54.067 INFO:tasks.workunit.client.1.smithi139.stdout:9/629: mknod dc/d11/d15/d3c/d61/dc8/d83/cd3 0 2024-09-17T07:19:54.068 INFO:tasks.workunit.client.1.smithi139.stdout:9/630: truncate dc/d11/d8b/fac 1704023 0 2024-09-17T07:19:54.070 INFO:tasks.workunit.client.1.smithi139.stdout:9/631: read dc/d11/d15/d3c/d61/dc8/d83/d98/fad [3068613,61334] 0 2024-09-17T07:19:54.072 INFO:tasks.workunit.client.1.smithi139.stdout:9/632: mknod dc/d2a/cd4 0 2024-09-17T07:19:54.074 INFO:tasks.workunit.client.1.smithi139.stdout:9/633: rmdir dc/d2c 39 2024-09-17T07:19:54.074 INFO:tasks.workunit.client.1.smithi139.stdout:5/290: dread d4/d16/f18 [0,4194304] 0 2024-09-17T07:19:54.076 INFO:tasks.workunit.client.1.smithi139.stdout:9/634: creat dc/d11/d8b/dc7/fd5 x:0 0 0 2024-09-17T07:19:54.077 INFO:tasks.workunit.client.1.smithi139.stdout:9/635: read dc/d2a/f8a [279392,29901] 0 2024-09-17T07:19:54.078 INFO:tasks.workunit.client.1.smithi139.stdout:9/636: chown dc/d11/d8b/dc7/dcc 1102006 1 2024-09-17T07:19:54.079 INFO:tasks.workunit.client.1.smithi139.stdout:5/291: link d4/d16/d1b/d20/d38/f4b d4/d16/d1b/d20/f56 0 2024-09-17T07:19:54.080 INFO:tasks.workunit.client.1.smithi139.stdout:9/637: chown dc/d11/d52/d56/d75/c7b 1 1 2024-09-17T07:19:54.081 INFO:tasks.workunit.client.1.smithi139.stdout:5/292: creat d4/d16/d1b/d20/d38/d4f/f57 x:0 0 0 2024-09-17T07:19:54.083 INFO:tasks.workunit.client.1.smithi139.stdout:9/638: creat dc/d11/d15/d3c/d61/d64/d96/db6/fd6 x:0 0 0 2024-09-17T07:19:54.085 INFO:tasks.workunit.client.1.smithi139.stdout:5/293: rename d4/d16/d1b/d20/d38/f4b to d4/d16/f58 0 2024-09-17T07:19:54.086 INFO:tasks.workunit.client.1.smithi139.stdout:5/294: readlink d4/d16/d1b/d20/d32/l40 0 2024-09-17T07:19:54.086 INFO:tasks.workunit.client.1.smithi139.stdout:5/295: chown d4/d16/c2f 1 1 2024-09-17T07:19:54.088 INFO:tasks.workunit.client.1.smithi139.stdout:5/296: rmdir d4/d16/d1b/d20/d32 39 2024-09-17T07:19:54.088 INFO:tasks.workunit.client.1.smithi139.stdout:9/639: dread dc/d11/d52/d56/d75/fa6 [0,4194304] 0 2024-09-17T07:19:54.089 INFO:tasks.workunit.client.1.smithi139.stdout:5/297: chown d4/d16 418978 1 2024-09-17T07:19:54.090 INFO:tasks.workunit.client.1.smithi139.stdout:5/298: write d4/d16/f22 [252947,126751] 0 2024-09-17T07:19:54.096 INFO:tasks.workunit.client.1.smithi139.stdout:9/640: write dc/fa8 [1189644,89366] 0 2024-09-17T07:19:54.096 INFO:tasks.workunit.client.1.smithi139.stdout:5/299: dwrite d4/f17 [0,4194304] 0 2024-09-17T07:19:54.097 INFO:tasks.workunit.client.1.smithi139.stdout:5/300: chown d4/d16/f1d 515955147 1 2024-09-17T07:19:54.101 INFO:tasks.workunit.client.1.smithi139.stdout:9/641: mkdir dc/d11/d15/d3c/d61/dc8/d9f/dd7 0 2024-09-17T07:19:54.103 INFO:tasks.workunit.client.1.smithi139.stdout:5/301: rename d4/d16/d1b/d20/d28/d3f/c49 to d4/d16/d1b/d20/d28/d3f/c59 0 2024-09-17T07:19:54.106 INFO:tasks.workunit.client.1.smithi139.stdout:5/302: write d4/d16/d1b/d20/d38/d4f/f57 [1003554,93760] 0 2024-09-17T07:19:54.109 INFO:tasks.workunit.client.1.smithi139.stdout:9/642: dwrite dc/d11/d15/d3c/d61/f88 [0,4194304] 0 2024-09-17T07:19:54.111 INFO:tasks.workunit.client.1.smithi139.stdout:9/643: dread - dc/d11/d15/d3c/d61/d64/fc9 zero size 2024-09-17T07:19:54.118 INFO:tasks.workunit.client.1.smithi139.stdout:5/303: write d4/f36 [1527375,100153] 0 2024-09-17T07:19:54.118 INFO:tasks.workunit.client.1.smithi139.stdout:9/644: dwrite dc/d11/d15/d3c/d61/dc8/d83/f9c [0,4194304] 0 2024-09-17T07:19:54.123 INFO:tasks.workunit.client.1.smithi139.stdout:5/304: symlink d4/d16/d1b/d20/d32/l5a 0 2024-09-17T07:19:54.124 INFO:tasks.workunit.client.1.smithi139.stdout:9/645: symlink dc/d11/d52/ld8 0 2024-09-17T07:19:54.125 INFO:tasks.workunit.client.1.smithi139.stdout:5/305: creat d4/f5b x:0 0 0 2024-09-17T07:19:54.127 INFO:tasks.workunit.client.1.smithi139.stdout:9/646: creat dc/d11/d15/d3c/d61/dc8/d9f/fd9 x:0 0 0 2024-09-17T07:19:54.128 INFO:tasks.workunit.client.1.smithi139.stdout:5/306: dread d4/d16/d1b/f39 [0,4194304] 0 2024-09-17T07:19:54.128 INFO:tasks.workunit.client.1.smithi139.stdout:9/647: chown dc/d11/d15/d3c/d68 9644857 1 2024-09-17T07:19:54.131 INFO:tasks.workunit.client.1.smithi139.stdout:9/648: mkdir dc/d11/d15/d3c/d61/dc8/dda 0 2024-09-17T07:19:54.133 INFO:tasks.workunit.client.1.smithi139.stdout:5/307: dwrite d4/f17 [0,4194304] 0 2024-09-17T07:19:54.134 INFO:tasks.workunit.client.1.smithi139.stdout:9/649: symlink dc/d11/d15/d1e/d53/ldb 0 2024-09-17T07:19:54.136 INFO:tasks.workunit.client.1.smithi139.stdout:5/308: creat d4/d16/d1b/d20/d38/d4f/f5c x:0 0 0 2024-09-17T07:19:54.142 INFO:tasks.workunit.client.1.smithi139.stdout:5/309: dread d4/d16/f22 [0,4194304] 0 2024-09-17T07:19:54.144 INFO:tasks.workunit.client.1.smithi139.stdout:5/310: readlink d4/d16/d1b/d20/d28/l35 0 2024-09-17T07:19:54.144 INFO:tasks.workunit.client.1.smithi139.stdout:9/650: write dc/f3e [2713314,6706] 0 2024-09-17T07:19:54.145 INFO:tasks.workunit.client.1.smithi139.stdout:5/311: write d4/d16/d1b/d20/d28/f46 [589515,14326] 0 2024-09-17T07:19:54.145 INFO:tasks.workunit.client.0.smithi087.stdout:9/327: sync 2024-09-17T07:19:54.146 INFO:tasks.workunit.client.1.smithi139.stdout:5/312: chown d4/d16/d1b/d20 0 1 2024-09-17T07:19:54.147 INFO:tasks.workunit.client.1.smithi139.stdout:9/651: rename dc/d2a/f49 to dc/d11/d15/d3c/d61/dc8/d83/fdc 0 2024-09-17T07:19:54.148 INFO:tasks.workunit.client.1.smithi139.stdout:5/313: mkdir d4/d5d 0 2024-09-17T07:19:54.150 INFO:tasks.workunit.client.1.smithi139.stdout:5/314: creat d4/d16/d1b/d20/d38/d4f/f5e x:0 0 0 2024-09-17T07:19:54.151 INFO:tasks.workunit.client.1.smithi139.stdout:9/652: rmdir dc/d11/d15/d3c/d61/dc8/d9f/dd7 0 2024-09-17T07:19:54.154 INFO:tasks.workunit.client.1.smithi139.stdout:9/653: creat dc/d11/d52/d56/d75/fdd x:0 0 0 2024-09-17T07:19:54.160 INFO:tasks.workunit.client.1.smithi139.stdout:5/315: write d4/d16/d1b/d20/d28/f52 [3921234,95811] 0 2024-09-17T07:19:54.161 INFO:tasks.workunit.client.1.smithi139.stdout:9/654: dwrite dc/d11/d8b/dc7/fd5 [0,4194304] 0 2024-09-17T07:19:54.161 INFO:tasks.workunit.client.1.smithi139.stdout:9/655: stat dc/d2a/cd4 0 2024-09-17T07:19:54.163 INFO:tasks.workunit.client.1.smithi139.stdout:9/656: stat dc/d11/d15/d3c/d61/dc8 0 2024-09-17T07:19:54.163 INFO:tasks.workunit.client.1.smithi139.stdout:5/316: mknod d4/d16/d1b/d20/d28/c5f 0 2024-09-17T07:19:54.166 INFO:tasks.workunit.client.1.smithi139.stdout:5/317: truncate d4/d16/d1b/d20/d28/f4d 433660 0 2024-09-17T07:19:54.166 INFO:tasks.workunit.client.1.smithi139.stdout:9/657: creat dc/d11/d15/d3c/d61/d64/d96/fde x:0 0 0 2024-09-17T07:19:54.167 INFO:tasks.workunit.client.1.smithi139.stdout:9/658: stat dc/d11/c8c 0 2024-09-17T07:19:54.168 INFO:tasks.workunit.client.1.smithi139.stdout:5/318: write d4/d16/d1b/d20/d38/d4f/f5e [358230,53638] 0 2024-09-17T07:19:54.169 INFO:tasks.workunit.client.1.smithi139.stdout:5/319: fsync d4/f6 0 2024-09-17T07:19:54.170 INFO:tasks.workunit.client.1.smithi139.stdout:9/659: chown dc/d11/d52/d56/d7a 384732260 1 2024-09-17T07:19:54.170 INFO:tasks.workunit.client.1.smithi139.stdout:5/320: readlink d4/d16/d1b/d20/d32/l5a 0 2024-09-17T07:19:54.172 INFO:tasks.workunit.client.1.smithi139.stdout:9/660: creat dc/d11/d15/d3c/d61/dc8/d83/d98/fdf x:0 0 0 2024-09-17T07:19:54.173 INFO:tasks.workunit.client.1.smithi139.stdout:9/661: stat dc/d11/d15/d1e/d34/fbc 0 2024-09-17T07:19:54.173 INFO:tasks.workunit.client.1.smithi139.stdout:9/662: readlink dc/d11/l36 0 2024-09-17T07:19:54.174 INFO:tasks.workunit.client.1.smithi139.stdout:9/663: creat dc/d11/d15/d3c/d61/fe0 x:0 0 0 2024-09-17T07:19:54.175 INFO:tasks.workunit.client.1.smithi139.stdout:9/664: fdatasync dc/d2a/fa7 0 2024-09-17T07:19:54.176 INFO:tasks.workunit.client.1.smithi139.stdout:5/321: fdatasync d4/d16/d1b/d20/d38/d4f/f5e 0 2024-09-17T07:19:54.179 INFO:tasks.workunit.client.1.smithi139.stdout:9/665: rename dc/d2a/c43 to dc/d11/d15/d3c/d61/dc8/ce1 0 2024-09-17T07:19:54.180 INFO:tasks.workunit.client.1.smithi139.stdout:9/666: truncate dc/d2a/f87 359978 0 2024-09-17T07:19:54.181 INFO:tasks.workunit.client.1.smithi139.stdout:9/667: chown dc/d11/c40 3977720 1 2024-09-17T07:19:54.182 INFO:tasks.workunit.client.1.smithi139.stdout:9/668: write dc/d11/d15/d3c/d61/fe0 [111180,85241] 0 2024-09-17T07:19:54.183 INFO:tasks.workunit.client.1.smithi139.stdout:9/669: stat dc/d11/l7f 0 2024-09-17T07:19:54.185 INFO:tasks.workunit.client.1.smithi139.stdout:9/670: symlink dc/d11/d15/d1e/d53/le2 0 2024-09-17T07:19:54.185 INFO:tasks.workunit.client.1.smithi139.stdout:9/671: read - dc/d11/d15/d3c/d61/dc8/d9f/fd9 zero size 2024-09-17T07:19:54.188 INFO:tasks.workunit.client.1.smithi139.stdout:9/672: rename dc/d11/l36 to dc/d11/d52/d56/d7a/da1/le3 0 2024-09-17T07:19:54.192 INFO:tasks.workunit.client.0.smithi087.stdout:3/431: rmdir d6/d1b 39 2024-09-17T07:19:54.192 INFO:tasks.workunit.client.0.smithi087.stdout:3/432: chown d6/d15/f60 1450963 1 2024-09-17T07:19:54.194 INFO:tasks.workunit.client.0.smithi087.stdout:9/328: mkdir d3/d4/d6/d71 0 2024-09-17T07:19:54.196 INFO:tasks.workunit.client.0.smithi087.stdout:9/329: creat d3/d25/d4c/f72 x:0 0 0 2024-09-17T07:19:54.196 INFO:tasks.workunit.client.1.smithi139.stdout:9/673: dwrite dc/d2c/f62 [0,4194304] 0 2024-09-17T07:19:54.197 INFO:tasks.workunit.client.0.smithi087.stdout:3/433: rename d6/d15/d37/l40 to d6/l90 0 2024-09-17T07:19:54.197 INFO:tasks.workunit.client.1.smithi139.stdout:6/508: sync 2024-09-17T07:19:54.198 INFO:tasks.workunit.client.0.smithi087.stdout:9/330: mknod d3/d4/da/d1c/c73 0 2024-09-17T07:19:54.199 INFO:tasks.workunit.client.1.smithi139.stdout:9/674: mknod dc/d11/d52/ce4 0 2024-09-17T07:19:54.201 INFO:tasks.workunit.client.1.smithi139.stdout:6/509: rename db/d18/f72 to db/df/d4e/d5e/fa8 0 2024-09-17T07:19:54.202 INFO:tasks.workunit.client.0.smithi087.stdout:3/434: rename d6/d1b/d2b/c3f to d6/d15/d37/c91 0 2024-09-17T07:19:54.203 INFO:tasks.workunit.client.1.smithi139.stdout:9/675: readlink dc/d11/d52/d56/lb5 0 2024-09-17T07:19:54.203 INFO:tasks.workunit.client.1.smithi139.stdout:9/676: write dc/fa8 [961409,51600] 0 2024-09-17T07:19:54.204 INFO:tasks.workunit.client.0.smithi087.stdout:3/435: chown d6/d1b/l85 1 1 2024-09-17T07:19:54.205 INFO:tasks.workunit.client.0.smithi087.stdout:9/331: rename d3/d4/da/d1c/c73 to d3/d4/d6/d8/d22/d64/c74 0 2024-09-17T07:19:54.205 INFO:tasks.workunit.client.1.smithi139.stdout:6/510: creat db/df/d73/da4/fa9 x:0 0 0 2024-09-17T07:19:54.207 INFO:tasks.workunit.client.1.smithi139.stdout:9/677: rmdir dc/d11/d52/d56/d7a 39 2024-09-17T07:19:54.208 INFO:tasks.workunit.client.1.smithi139.stdout:9/678: rename dc/d11 to dc/d11/d15/d1e/d53/de5 22 2024-09-17T07:19:54.211 INFO:tasks.workunit.client.0.smithi087.stdout:9/332: dwrite d3/d4/d6/d8/fd [0,4194304] 0 2024-09-17T07:19:54.214 INFO:tasks.workunit.client.1.smithi139.stdout:9/679: truncate dc/d11/d8b/dc7/fd5 2011595 0 2024-09-17T07:19:54.218 INFO:tasks.workunit.client.0.smithi087.stdout:3/436: truncate d6/d1b/d2b/f39 3935435 0 2024-09-17T07:19:54.218 INFO:tasks.workunit.client.0.smithi087.stdout:9/333: truncate d3/d4/da/f55 178033 0 2024-09-17T07:19:54.219 INFO:tasks.workunit.client.0.smithi087.stdout:9/334: readlink d3/d4/d6/d8/d22/d43/l6d 0 2024-09-17T07:19:54.220 INFO:tasks.workunit.client.0.smithi087.stdout:9/335: chown d3/d4/d2f 736429 1 2024-09-17T07:19:54.220 INFO:tasks.workunit.client.0.smithi087.stdout:3/437: mkdir d6/d15/d92 0 2024-09-17T07:19:54.221 INFO:tasks.workunit.client.0.smithi087.stdout:9/336: chown d3/d4/da/d1c 12159 1 2024-09-17T07:19:54.222 INFO:tasks.workunit.client.0.smithi087.stdout:9/337: creat d3/d4/d6/d8/d22/f75 x:0 0 0 2024-09-17T07:19:54.223 INFO:tasks.workunit.client.0.smithi087.stdout:9/338: fdatasync d3/d4/da/f47 0 2024-09-17T07:19:54.224 INFO:tasks.workunit.client.0.smithi087.stdout:9/339: fdatasync d3/d4/d2f/f39 0 2024-09-17T07:19:54.226 INFO:tasks.workunit.client.0.smithi087.stdout:9/340: mknod d3/d4/da/d4b/c76 0 2024-09-17T07:19:54.228 INFO:tasks.workunit.client.0.smithi087.stdout:9/341: write d3/d4/d6/d8/f18 [191989,95849] 0 2024-09-17T07:19:54.230 INFO:tasks.workunit.client.1.smithi139.stdout:9/680: dread dc/d11/f12 [0,4194304] 0 2024-09-17T07:19:54.231 INFO:tasks.workunit.client.0.smithi087.stdout:9/342: creat d3/d4/d6/d8/d22/d43/f77 x:0 0 0 2024-09-17T07:19:54.232 INFO:tasks.workunit.client.0.smithi087.stdout:9/343: creat d3/d4/d6/d8/f78 x:0 0 0 2024-09-17T07:19:54.234 INFO:tasks.workunit.client.0.smithi087.stdout:9/344: symlink d3/d4/d6/d8/d22/l79 0 2024-09-17T07:19:54.236 INFO:tasks.workunit.client.1.smithi139.stdout:9/681: dwrite dc/d11/d15/d3c/d61/d64/fc1 [0,4194304] 0 2024-09-17T07:19:54.236 INFO:tasks.workunit.client.0.smithi087.stdout:9/345: getdents d3/d25 0 2024-09-17T07:19:54.241 INFO:tasks.workunit.client.1.smithi139.stdout:9/682: creat dc/d11/d15/d1e/fe6 x:0 0 0 2024-09-17T07:19:54.242 INFO:tasks.workunit.client.1.smithi139.stdout:9/683: rmdir dc/d2c 39 2024-09-17T07:19:54.243 INFO:tasks.workunit.client.1.smithi139.stdout:9/684: chown dc/d11/d15/d1e/d34 62407 1 2024-09-17T07:19:54.245 INFO:tasks.workunit.client.0.smithi087.stdout:9/346: dread d3/d4/d6/d8/d22/d43/f45 [0,4194304] 0 2024-09-17T07:19:54.248 INFO:tasks.workunit.client.0.smithi087.stdout:9/347: getdents d3/d4/d16/d69 0 2024-09-17T07:19:54.251 INFO:tasks.workunit.client.0.smithi087.stdout:9/348: rename d3/d4/d6/d8/d12/c46 to d3/d4/d6/d8/d12/d32/d6c/c7a 0 2024-09-17T07:19:54.252 INFO:tasks.workunit.client.0.smithi087.stdout:9/349: rmdir d3/d25 39 2024-09-17T07:19:54.254 INFO:tasks.workunit.client.0.smithi087.stdout:9/350: creat d3/d4/d16/d69/f7b x:0 0 0 2024-09-17T07:19:54.255 INFO:tasks.workunit.client.0.smithi087.stdout:9/351: creat d3/d4/d16/f7c x:0 0 0 2024-09-17T07:19:54.257 INFO:tasks.workunit.client.0.smithi087.stdout:9/352: symlink d3/d4/d6/d8/d12/l7d 0 2024-09-17T07:19:54.259 INFO:tasks.workunit.client.0.smithi087.stdout:9/353: rename d3/d4/d6/d8/d12/d32/c4f to d3/d4/d6/d8/d22/c7e 0 2024-09-17T07:19:54.266 INFO:tasks.workunit.client.0.smithi087.stdout:9/354: link d3/d4/d6/d8/d22/c7e d3/d4/d16/c7f 0 2024-09-17T07:19:54.268 INFO:tasks.workunit.client.0.smithi087.stdout:9/355: truncate d3/d4/d6/d8/f14 605954 0 2024-09-17T07:19:54.269 INFO:tasks.workunit.client.0.smithi087.stdout:9/356: read d3/d4/d6/d8/d22/f50 [135433,91374] 0 2024-09-17T07:19:54.270 INFO:tasks.workunit.client.0.smithi087.stdout:9/357: write d3/d4/d6/f13 [3636254,94468] 0 2024-09-17T07:19:54.272 INFO:tasks.workunit.client.0.smithi087.stdout:9/358: symlink d3/d4/d6/d8/d12/d38/l80 0 2024-09-17T07:19:54.277 INFO:tasks.workunit.client.0.smithi087.stdout:9/359: dwrite d3/d4/d6/d8/f78 [0,4194304] 0 2024-09-17T07:19:54.280 INFO:tasks.workunit.client.0.smithi087.stdout:9/360: mknod d3/d4/d6/c81 0 2024-09-17T07:19:54.283 INFO:tasks.workunit.client.0.smithi087.stdout:9/361: rename d3/d4/d6/d8/d12/d38/l80 to d3/d4/d6/d8/d12/d32/l82 0 2024-09-17T07:19:54.284 INFO:tasks.workunit.client.0.smithi087.stdout:9/362: mkdir d3/d25/d83 0 2024-09-17T07:19:54.287 INFO:tasks.workunit.client.0.smithi087.stdout:9/363: rename d3/d25/d4c to d3/d4/d6/d8/d22/d43/d84 0 2024-09-17T07:19:54.404 INFO:tasks.workunit.client.1.smithi139.stdout:1/229: sync 2024-09-17T07:19:54.406 INFO:tasks.workunit.client.1.smithi139.stdout:1/230: creat d2/d10/d12/d35/d2b/f42 x:0 0 0 2024-09-17T07:19:54.408 INFO:tasks.workunit.client.1.smithi139.stdout:1/231: dread d2/f15 [0,4194304] 0 2024-09-17T07:19:54.409 INFO:tasks.workunit.client.1.smithi139.stdout:1/232: rmdir d2/d10/d12/d24 39 2024-09-17T07:19:54.412 INFO:tasks.workunit.client.1.smithi139.stdout:1/233: rename d2/d10/d12/f23 to d2/d10/d12/d13/f43 0 2024-09-17T07:19:54.415 INFO:tasks.workunit.client.1.smithi139.stdout:1/234: link f0 d2/d10/d12/d35/f44 0 2024-09-17T07:19:54.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:54 smithi087 ceph-mon[27636]: pgmap v10: 65 pgs: 65 active+clean; 1.3 GiB data, 5.4 GiB used, 531 GiB / 536 GiB avail; 22 MiB/s rd, 172 MiB/s wr, 310 op/s 2024-09-17T07:19:54.450 INFO:tasks.workunit.client.0.smithi087.stdout:2/464: sync 2024-09-17T07:19:54.450 INFO:tasks.workunit.client.0.smithi087.stdout:5/609: sync 2024-09-17T07:19:54.450 INFO:tasks.workunit.client.0.smithi087.stdout:1/407: sync 2024-09-17T07:19:54.450 INFO:tasks.workunit.client.0.smithi087.stdout:6/560: sync 2024-09-17T07:19:54.450 INFO:tasks.workunit.client.0.smithi087.stdout:7/396: sync 2024-09-17T07:19:54.450 INFO:tasks.workunit.client.0.smithi087.stdout:9/364: sync 2024-09-17T07:19:54.450 INFO:tasks.workunit.client.0.smithi087.stdout:3/438: sync 2024-09-17T07:19:54.450 INFO:tasks.workunit.client.0.smithi087.stdout:8/478: sync 2024-09-17T07:19:54.450 INFO:tasks.workunit.client.0.smithi087.stdout:4/397: sync 2024-09-17T07:19:54.450 INFO:tasks.workunit.client.0.smithi087.stdout:0/626: sync 2024-09-17T07:19:54.451 INFO:tasks.workunit.client.0.smithi087.stdout:1/408: chown d2/d3d/d35/d4f 154 1 2024-09-17T07:19:54.453 INFO:tasks.workunit.client.0.smithi087.stdout:5/610: chown d5/d8/l23 678 1 2024-09-17T07:19:54.453 INFO:tasks.workunit.client.0.smithi087.stdout:8/479: fsync d1/d2b/d21/f35 0 2024-09-17T07:19:54.454 INFO:tasks.workunit.client.0.smithi087.stdout:3/439: chown d6/d1b/c2c 169601355 1 2024-09-17T07:19:54.455 INFO:tasks.workunit.client.0.smithi087.stdout:9/365: creat d3/d4/da/d1c/f85 x:0 0 0 2024-09-17T07:19:54.456 INFO:tasks.workunit.client.0.smithi087.stdout:6/561: read d1/d6/d1a/d2c/d58/d90/f9c [339995,14254] 0 2024-09-17T07:19:54.456 INFO:tasks.workunit.client.0.smithi087.stdout:1/409: write d2/d3d/d45/d90/d37/f52 [2897548,114952] 0 2024-09-17T07:19:54.457 INFO:tasks.workunit.client.0.smithi087.stdout:0/627: read db/d45/d5b/fa7 [939811,66750] 0 2024-09-17T07:19:54.458 INFO:tasks.workunit.client.0.smithi087.stdout:2/465: rename d2/d7/dd/d10/d4c/d6c/f84 to d2/d12/f94 0 2024-09-17T07:19:54.459 INFO:tasks.workunit.client.0.smithi087.stdout:3/440: write d6/d15/d37/d3c/f6f [322044,56859] 0 2024-09-17T07:19:54.460 INFO:tasks.workunit.client.0.smithi087.stdout:4/398: unlink d2/d22/d2c/d3f/d4d/d21/d2f/l7f 0 2024-09-17T07:19:54.460 INFO:tasks.workunit.client.0.smithi087.stdout:0/628: fsync db/d45/f68 0 2024-09-17T07:19:54.461 INFO:tasks.workunit.client.0.smithi087.stdout:3/441: chown d6/d16/f36 16450029 1 2024-09-17T07:19:54.462 INFO:tasks.workunit.client.0.smithi087.stdout:8/480: mkdir d1/d2b/d3b/d53/da8 0 2024-09-17T07:19:54.464 INFO:tasks.workunit.client.0.smithi087.stdout:8/481: fsync d1/d2b/f42 0 2024-09-17T07:19:54.464 INFO:tasks.workunit.client.0.smithi087.stdout:3/442: chown d6/d15/d37/f7f 6 1 2024-09-17T07:19:54.467 INFO:tasks.workunit.client.0.smithi087.stdout:7/397: rename d0/d3/d10/d32/f56 to d0/d36/f81 0 2024-09-17T07:19:54.469 INFO:tasks.workunit.client.0.smithi087.stdout:7/398: chown d0/d36/c4a 245 1 2024-09-17T07:19:54.470 INFO:tasks.workunit.client.1.smithi139.stdout:2/382: sync 2024-09-17T07:19:54.471 INFO:tasks.workunit.client.0.smithi087.stdout:0/629: dwrite db/d45/f53 [0,4194304] 0 2024-09-17T07:19:54.471 INFO:tasks.workunit.client.0.smithi087.stdout:5/611: dwrite d5/d12/d14/d61/d94/fa4 [0,4194304] 0 2024-09-17T07:19:54.473 INFO:tasks.workunit.client.0.smithi087.stdout:4/399: mkdir d2/d22/d2c/d91 0 2024-09-17T07:19:54.473 INFO:tasks.workunit.client.1.smithi139.stdout:2/383: link d0/de/d11/d32/f72 d0/de/f80 0 2024-09-17T07:19:54.475 INFO:tasks.workunit.client.0.smithi087.stdout:9/366: creat d3/d4/d6/d71/f86 x:0 0 0 2024-09-17T07:19:54.476 INFO:tasks.workunit.client.1.smithi139.stdout:1/235: dwrite d2/d10/d12/d13/f17 [0,4194304] 0 2024-09-17T07:19:54.477 INFO:tasks.workunit.client.1.smithi139.stdout:2/384: mknod d0/de/d11/d12/d45/c81 0 2024-09-17T07:19:54.478 INFO:tasks.workunit.client.0.smithi087.stdout:1/410: write d2/d3d/f21 [1775912,8929] 0 2024-09-17T07:19:54.481 INFO:tasks.workunit.client.0.smithi087.stdout:6/562: dread d1/f4 [0,4194304] 0 2024-09-17T07:19:54.482 INFO:tasks.workunit.client.0.smithi087.stdout:8/482: chown d1/d7/d9/d19/l76 61659664 1 2024-09-17T07:19:54.484 INFO:tasks.workunit.client.0.smithi087.stdout:2/466: symlink d2/d7/dd/d10/d4c/d5f/d8b/l95 0 2024-09-17T07:19:54.485 INFO:tasks.workunit.client.0.smithi087.stdout:6/563: dread - d1/d6/d1a/d2c/d48/f9a zero size 2024-09-17T07:19:54.485 INFO:tasks.workunit.client.0.smithi087.stdout:4/400: dwrite d2/d22/d2c/d3f/d4d/d21/d2f/f8c [0,4194304] 0 2024-09-17T07:19:54.489 INFO:tasks.workunit.client.0.smithi087.stdout:6/564: dread - d1/d6/d1a/d2c/d33/f8e zero size 2024-09-17T07:19:54.490 INFO:tasks.workunit.client.0.smithi087.stdout:1/411: unlink d2/d48/d6f/c8f 0 2024-09-17T07:19:54.494 INFO:tasks.workunit.client.0.smithi087.stdout:4/401: write d2/d22/d2c/d3f/d4d/d21/f24 [668179,5623] 0 2024-09-17T07:19:54.497 INFO:tasks.workunit.client.0.smithi087.stdout:1/412: rmdir d2/d3d 39 2024-09-17T07:19:54.497 INFO:tasks.workunit.client.0.smithi087.stdout:6/565: truncate d1/d6/d1a/d2c/d48/d9b/dac/fbc 371805 0 2024-09-17T07:19:54.498 INFO:tasks.workunit.client.0.smithi087.stdout:1/413: write d2/d1a/f29 [559512,89781] 0 2024-09-17T07:19:54.499 INFO:tasks.workunit.client.0.smithi087.stdout:0/630: getdents db/d45/d9e/d95 0 2024-09-17T07:19:54.503 INFO:tasks.workunit.client.0.smithi087.stdout:9/367: getdents d3/d4/da 0 2024-09-17T07:19:54.503 INFO:tasks.workunit.client.0.smithi087.stdout:1/414: fdatasync d2/da/d7e/f83 0 2024-09-17T07:19:54.503 INFO:tasks.workunit.client.0.smithi087.stdout:3/443: write d6/fa [1972192,41745] 0 2024-09-17T07:19:54.505 INFO:tasks.workunit.client.0.smithi087.stdout:0/631: truncate db/d45/d5b/f5e 1868896 0 2024-09-17T07:19:54.506 INFO:tasks.workunit.client.0.smithi087.stdout:6/566: mknod d1/d6/d1a/d2c/d58/cc7 0 2024-09-17T07:19:54.507 INFO:tasks.workunit.client.0.smithi087.stdout:6/567: write d1/d6/d1a/d2c/d58/fbf [699379,29903] 0 2024-09-17T07:19:54.510 INFO:tasks.workunit.client.0.smithi087.stdout:4/402: rename d2/d22/d2c/d3f to d2/d92 0 2024-09-17T07:19:54.512 INFO:tasks.workunit.client.0.smithi087.stdout:3/444: write d6/d16/f26 [1989885,78992] 0 2024-09-17T07:19:54.514 INFO:tasks.workunit.client.0.smithi087.stdout:0/632: creat db/d45/d7b/d90/dd9/fed x:0 0 0 2024-09-17T07:19:54.515 INFO:tasks.workunit.client.0.smithi087.stdout:6/568: write d1/d6/d1a/d2c/d33/f4f [807962,81330] 0 2024-09-17T07:19:54.521 INFO:tasks.workunit.client.0.smithi087.stdout:5/612: truncate d5/d8/f3f 1339610 0 2024-09-17T07:19:54.522 INFO:tasks.workunit.client.0.smithi087.stdout:6/569: mknod d1/d6/d1a/d2c/d33/cc8 0 2024-09-17T07:19:54.523 INFO:tasks.workunit.client.0.smithi087.stdout:2/467: dread d2/d7/dd/d1f/d3a/f6f [0,4194304] 0 2024-09-17T07:19:54.524 INFO:tasks.workunit.client.0.smithi087.stdout:4/403: mknod d2/d22/c93 0 2024-09-17T07:19:54.525 INFO:tasks.workunit.client.0.smithi087.stdout:9/368: creat d3/d4/f87 x:0 0 0 2024-09-17T07:19:54.527 INFO:tasks.workunit.client.0.smithi087.stdout:3/445: dwrite d6/d15/d37/d3c/d43/d48/f77 [0,4194304] 0 2024-09-17T07:19:54.527 INFO:tasks.workunit.client.0.smithi087.stdout:5/613: creat d5/d18/d6f/fc7 x:0 0 0 2024-09-17T07:19:54.530 INFO:tasks.workunit.client.1.smithi139.stdout:1/236: symlink d2/d10/d12/d35/l45 0 2024-09-17T07:19:54.531 INFO:tasks.workunit.client.1.smithi139.stdout:2/385: chown d0/d7/f19 349045809 1 2024-09-17T07:19:54.531 INFO:tasks.workunit.client.0.smithi087.stdout:7/399: dwrite d0/f6 [0,4194304] 0 2024-09-17T07:19:54.534 INFO:tasks.workunit.client.1.smithi139.stdout:2/386: fdatasync d0/d7/fd 0 2024-09-17T07:19:54.535 INFO:tasks.workunit.client.0.smithi087.stdout:3/446: creat d6/d1b/d42/f93 x:0 0 0 2024-09-17T07:19:54.536 INFO:tasks.workunit.client.1.smithi139.stdout:2/387: mkdir d0/d4e/d76/d82 0 2024-09-17T07:19:54.537 INFO:tasks.workunit.client.0.smithi087.stdout:9/369: truncate d3/d4/d6/d71/f86 425133 0 2024-09-17T07:19:54.540 INFO:tasks.workunit.client.0.smithi087.stdout:7/400: chown d0/d3/cf 20 1 2024-09-17T07:19:54.540 INFO:tasks.workunit.client.0.smithi087.stdout:2/468: dwrite d2/d50/f61 [0,4194304] 0 2024-09-17T07:19:54.541 INFO:tasks.workunit.client.0.smithi087.stdout:0/633: truncate db/f25 2114907 0 2024-09-17T07:19:54.542 INFO:tasks.workunit.client.1.smithi139.stdout:2/388: creat d0/de/d11/f83 x:0 0 0 2024-09-17T07:19:54.543 INFO:tasks.workunit.client.1.smithi139.stdout:1/237: write d2/d10/d12/d1a/f30 [4968668,58076] 0 2024-09-17T07:19:54.543 INFO:tasks.workunit.client.0.smithi087.stdout:0/634: write db/fcb [569545,111093] 0 2024-09-17T07:19:54.544 INFO:tasks.workunit.client.1.smithi139.stdout:2/389: chown d0/de/d11/d12/d45/l68 719 1 2024-09-17T07:19:54.545 INFO:tasks.workunit.client.0.smithi087.stdout:9/370: symlink d3/d4/d6/d8/d12/l88 0 2024-09-17T07:19:54.545 INFO:tasks.workunit.client.0.smithi087.stdout:2/469: truncate d2/d7/d30/d3f/f8c 263014 0 2024-09-17T07:19:54.546 INFO:tasks.workunit.client.1.smithi139.stdout:2/390: rmdir d0 39 2024-09-17T07:19:54.547 INFO:tasks.workunit.client.0.smithi087.stdout:9/371: fsync d3/d4/d6/d8/d22/d43/f5d 0 2024-09-17T07:19:54.547 INFO:tasks.workunit.client.0.smithi087.stdout:7/401: symlink d0/d3/d10/d31/l82 0 2024-09-17T07:19:54.548 INFO:tasks.workunit.client.0.smithi087.stdout:2/470: read d2/d7/d30/d3f/f8c [183085,31417] 0 2024-09-17T07:19:54.548 INFO:tasks.workunit.client.0.smithi087.stdout:3/447: symlink d6/d15/l94 0 2024-09-17T07:19:54.550 INFO:tasks.workunit.client.0.smithi087.stdout:2/471: readlink d2/d7/d33/l4d 0 2024-09-17T07:19:54.550 INFO:tasks.workunit.client.0.smithi087.stdout:0/635: creat db/d45/d9e/d95/fee x:0 0 0 2024-09-17T07:19:54.551 INFO:tasks.workunit.client.1.smithi139.stdout:1/238: dwrite d2/d10/d12/d13/f16 [0,4194304] 0 2024-09-17T07:19:54.551 INFO:tasks.workunit.client.0.smithi087.stdout:9/372: truncate d3/f4d 5017194 0 2024-09-17T07:19:54.552 INFO:tasks.workunit.client.1.smithi139.stdout:2/391: rename d0/de/c2a to d0/de/d54/c84 0 2024-09-17T07:19:54.554 INFO:tasks.workunit.client.1.smithi139.stdout:1/239: creat d2/f46 x:0 0 0 2024-09-17T07:19:54.554 INFO:tasks.workunit.client.0.smithi087.stdout:3/448: mkdir d6/d1b/d42/d95 0 2024-09-17T07:19:54.555 INFO:tasks.workunit.client.0.smithi087.stdout:4/404: dwrite d2/d92/d4d/f3d [0,4194304] 0 2024-09-17T07:19:54.556 INFO:tasks.workunit.client.0.smithi087.stdout:0/636: creat db/d45/d7b/d7e/fef x:0 0 0 2024-09-17T07:19:54.560 INFO:tasks.workunit.client.0.smithi087.stdout:0/637: fdatasync db/f49 0 2024-09-17T07:19:54.563 INFO:tasks.workunit.client.0.smithi087.stdout:7/402: link d0/d3/cf d0/d3/c83 0 2024-09-17T07:19:54.563 INFO:tasks.workunit.client.0.smithi087.stdout:9/373: write d3/f1f [1602266,22032] 0 2024-09-17T07:19:54.569 INFO:tasks.workunit.client.0.smithi087.stdout:6/570: write d1/d6/d1a/d2c/d40/d4c/da1/fc3 [4292173,60421] 0 2024-09-17T07:19:54.570 INFO:tasks.workunit.client.1.smithi139.stdout:1/240: chown d2/d10/c28 3464 1 2024-09-17T07:19:54.571 INFO:tasks.workunit.client.0.smithi087.stdout:5/614: truncate d5/d18/d20/fa 662456 0 2024-09-17T07:19:54.572 INFO:tasks.workunit.client.0.smithi087.stdout:2/472: dwrite d2/d7/dd/d1f/f73 [0,4194304] 0 2024-09-17T07:19:54.572 INFO:tasks.workunit.client.1.smithi139.stdout:1/241: symlink d2/d10/l47 0 2024-09-17T07:19:54.577 INFO:tasks.workunit.client.0.smithi087.stdout:0/638: creat db/d45/d7b/d90/dd9/ff0 x:0 0 0 2024-09-17T07:19:54.578 INFO:tasks.workunit.client.1.smithi139.stdout:1/242: dwrite d2/d10/d12/d1a/f30 [0,4194304] 0 2024-09-17T07:19:54.578 INFO:tasks.workunit.client.0.smithi087.stdout:3/449: dwrite d6/f12 [4194304,4194304] 0 2024-09-17T07:19:54.579 INFO:tasks.workunit.client.1.smithi139.stdout:7/352: sync 2024-09-17T07:19:54.579 INFO:tasks.workunit.client.0.smithi087.stdout:9/374: stat d3/d4/d6/d8/d22/d2a/c5c 0 2024-09-17T07:19:54.580 INFO:tasks.workunit.client.0.smithi087.stdout:2/473: chown d2/d7/db/l44 922483 1 2024-09-17T07:19:54.580 INFO:tasks.workunit.client.0.smithi087.stdout:5/615: mkdir d5/d8/d1f/dc8 0 2024-09-17T07:19:54.581 INFO:tasks.workunit.client.0.smithi087.stdout:7/403: dread d0/d3/d23/f60 [0,4194304] 0 2024-09-17T07:19:54.582 INFO:tasks.workunit.client.0.smithi087.stdout:2/474: write d2/d7/f71 [4537793,75267] 0 2024-09-17T07:19:54.583 INFO:tasks.workunit.client.0.smithi087.stdout:9/375: write d3/d4/d2f/f39 [1866604,88330] 0 2024-09-17T07:19:54.583 INFO:tasks.workunit.client.1.smithi139.stdout:1/243: link d2/d10/c28 d2/d10/d12/d1a/c48 0 2024-09-17T07:19:54.583 INFO:tasks.workunit.client.1.smithi139.stdout:2/392: dread d0/f62 [0,4194304] 0 2024-09-17T07:19:54.584 INFO:tasks.workunit.client.0.smithi087.stdout:0/639: fsync db/d45/d7b/d7e/fa4 0 2024-09-17T07:19:54.587 INFO:tasks.workunit.client.0.smithi087.stdout:4/405: dwrite d2/d5/d1f/f20 [0,4194304] 0 2024-09-17T07:19:54.590 INFO:tasks.workunit.client.1.smithi139.stdout:2/393: truncate d0/de/d54/f7e 171581 0 2024-09-17T07:19:54.590 INFO:tasks.workunit.client.1.smithi139.stdout:7/353: dwrite d5/d10/f28 [0,4194304] 0 2024-09-17T07:19:54.590 INFO:tasks.workunit.client.0.smithi087.stdout:2/475: mkdir d2/d96 0 2024-09-17T07:19:54.591 INFO:tasks.workunit.client.0.smithi087.stdout:5/616: creat d5/d18/d20/d2f/d83/dac/fc9 x:0 0 0 2024-09-17T07:19:54.593 INFO:tasks.workunit.client.0.smithi087.stdout:3/450: link d6/d1b/d42/d62/f84 d6/d15/d92/f96 0 2024-09-17T07:19:54.593 INFO:tasks.workunit.client.0.smithi087.stdout:2/476: stat d2/d7/db 0 2024-09-17T07:19:54.596 INFO:tasks.workunit.client.1.smithi139.stdout:1/244: dwrite d2/d10/d12/d13/f17 [0,4194304] 0 2024-09-17T07:19:54.596 INFO:tasks.workunit.client.0.smithi087.stdout:0/640: unlink db/d4f/lc2 0 2024-09-17T07:19:54.596 INFO:tasks.workunit.client.0.smithi087.stdout:9/376: dwrite f2 [0,4194304] 0 2024-09-17T07:19:54.597 INFO:tasks.workunit.client.0.smithi087.stdout:5/617: symlink d5/d18/lca 0 2024-09-17T07:19:54.598 INFO:tasks.workunit.client.0.smithi087.stdout:0/641: dread - db/d45/d5d/fc1 zero size 2024-09-17T07:19:54.599 INFO:tasks.workunit.client.0.smithi087.stdout:3/451: creat d6/d15/d37/d3c/d52/f97 x:0 0 0 2024-09-17T07:19:54.600 INFO:tasks.workunit.client.0.smithi087.stdout:2/477: mknod d2/d7/dd/c97 0 2024-09-17T07:19:54.601 INFO:tasks.workunit.client.0.smithi087.stdout:0/642: dread - db/d45/d7b/d90/f80 zero size 2024-09-17T07:19:54.601 INFO:tasks.workunit.client.0.smithi087.stdout:9/377: creat d3/d4/d6/d8/d22/d64/f89 x:0 0 0 2024-09-17T07:19:54.601 INFO:tasks.workunit.client.0.smithi087.stdout:5/618: dread d5/d8/d1f/d68/f8d [0,4194304] 0 2024-09-17T07:19:54.602 INFO:tasks.workunit.client.0.smithi087.stdout:3/452: fsync d6/d1b/d2b/f83 0 2024-09-17T07:19:54.603 INFO:tasks.workunit.client.0.smithi087.stdout:9/378: chown d3/d4/d6/d8 10778 1 2024-09-17T07:19:54.604 INFO:tasks.workunit.client.1.smithi139.stdout:7/354: getdents d5/d17/d4e/d55 0 2024-09-17T07:19:54.604 INFO:tasks.workunit.client.0.smithi087.stdout:2/478: write d2/d7/dd/d10/f1d [1672363,51840] 0 2024-09-17T07:19:54.605 INFO:tasks.workunit.client.0.smithi087.stdout:0/643: mkdir db/d45/d9e/d95/df1 0 2024-09-17T07:19:54.605 INFO:tasks.workunit.client.0.smithi087.stdout:2/479: stat d2/d7/db/c2d 0 2024-09-17T07:19:54.608 INFO:tasks.workunit.client.1.smithi139.stdout:2/394: link d0/dc/d15/l1d d0/de/d11/l85 0 2024-09-17T07:19:54.612 INFO:tasks.workunit.client.0.smithi087.stdout:9/379: rename d3/d4/da/d1c to d3/d4/d16/d69/d8a 0 2024-09-17T07:19:54.612 INFO:tasks.workunit.client.1.smithi139.stdout:2/395: mkdir d0/d7/d86 0 2024-09-17T07:19:54.613 INFO:tasks.workunit.client.0.smithi087.stdout:5/619: dwrite d5/fa9 [0,4194304] 0 2024-09-17T07:19:54.615 INFO:tasks.workunit.client.0.smithi087.stdout:5/620: fsync d5/d18/d20/d2f/f48 0 2024-09-17T07:19:54.615 INFO:tasks.workunit.client.0.smithi087.stdout:0/644: creat db/d45/d9e/d86/dd5/ff2 x:0 0 0 2024-09-17T07:19:54.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:54 smithi139 ceph-mon[34403]: pgmap v10: 65 pgs: 65 active+clean; 1.3 GiB data, 5.4 GiB used, 531 GiB / 536 GiB avail; 22 MiB/s rd, 172 MiB/s wr, 310 op/s 2024-09-17T07:19:54.616 INFO:tasks.workunit.client.0.smithi087.stdout:2/480: rmdir d2/d7/dd/d10/d4c 39 2024-09-17T07:19:54.617 INFO:tasks.workunit.client.0.smithi087.stdout:9/380: mknod d3/d4/d6/d8/d12/c8b 0 2024-09-17T07:19:54.618 INFO:tasks.workunit.client.0.smithi087.stdout:0/645: chown db/d45/d5d/fac 5 1 2024-09-17T07:19:54.619 INFO:tasks.workunit.client.0.smithi087.stdout:2/481: rmdir d2/d7/dd/d1f/d3a 39 2024-09-17T07:19:54.620 INFO:tasks.workunit.client.0.smithi087.stdout:9/381: creat d3/d4/d2f/f8c x:0 0 0 2024-09-17T07:19:54.622 INFO:tasks.workunit.client.0.smithi087.stdout:5/621: mkdir d5/d12/d56/d9e/dcb 0 2024-09-17T07:19:54.626 INFO:tasks.workunit.client.0.smithi087.stdout:6/571: dread d1/f35 [0,4194304] 0 2024-09-17T07:19:54.626 INFO:tasks.workunit.client.0.smithi087.stdout:0/646: creat db/ff3 x:0 0 0 2024-09-17T07:19:54.627 INFO:tasks.workunit.client.0.smithi087.stdout:2/482: mknod d2/d7/dd/d10/d4c/d5f/d8b/c98 0 2024-09-17T07:19:54.628 INFO:tasks.workunit.client.0.smithi087.stdout:0/647: chown db/d45/d7b/d7e/fa4 678 1 2024-09-17T07:19:54.630 INFO:tasks.workunit.client.0.smithi087.stdout:6/572: rmdir d1 39 2024-09-17T07:19:54.633 INFO:tasks.workunit.client.0.smithi087.stdout:9/382: rename d3/d4/d6/d8/d22/f37 to d3/d4/f8d 0 2024-09-17T07:19:54.633 INFO:tasks.workunit.client.0.smithi087.stdout:2/483: mkdir d2/d7/d30/d99 0 2024-09-17T07:19:54.635 INFO:tasks.workunit.client.0.smithi087.stdout:6/573: stat d1/d6/f7d 0 2024-09-17T07:19:54.635 INFO:tasks.workunit.client.0.smithi087.stdout:2/484: dread d2/d50/f74 [0,4194304] 0 2024-09-17T07:19:54.636 INFO:tasks.workunit.client.0.smithi087.stdout:2/485: chown d2/d7/f68 0 1 2024-09-17T07:19:54.638 INFO:tasks.workunit.client.0.smithi087.stdout:0/648: unlink db/c58 0 2024-09-17T07:19:54.639 INFO:tasks.workunit.client.0.smithi087.stdout:0/649: symlink db/d45/d9e/d86/lf4 0 2024-09-17T07:19:54.640 INFO:tasks.workunit.client.0.smithi087.stdout:6/574: getdents d1/d67 0 2024-09-17T07:19:54.641 INFO:tasks.workunit.client.0.smithi087.stdout:0/650: truncate db/da3/fb3 430453 0 2024-09-17T07:19:54.641 INFO:tasks.workunit.client.0.smithi087.stdout:6/575: truncate d1/d6/d1a/d4e/f63 171703 0 2024-09-17T07:19:54.642 INFO:tasks.workunit.client.0.smithi087.stdout:6/576: chown d1/d67/db7 683 1 2024-09-17T07:19:54.643 INFO:tasks.workunit.client.0.smithi087.stdout:0/651: creat db/d45/d9e/d86/dd5/deb/ff5 x:0 0 0 2024-09-17T07:19:54.643 INFO:tasks.workunit.client.0.smithi087.stdout:0/652: write db/f34 [3169946,68482] 0 2024-09-17T07:19:54.644 INFO:tasks.workunit.client.0.smithi087.stdout:6/577: unlink d1/d6/f3e 0 2024-09-17T07:19:54.644 INFO:tasks.workunit.client.0.smithi087.stdout:0/653: dread - db/d45/d7b/db0/fdb zero size 2024-09-17T07:19:54.645 INFO:tasks.workunit.client.0.smithi087.stdout:6/578: write d1/d6/d1a/d2c/d48/f88 [2147317,25451] 0 2024-09-17T07:19:54.647 INFO:tasks.workunit.client.0.smithi087.stdout:6/579: fsync d1/d6/d1a/f57 0 2024-09-17T07:19:54.647 INFO:tasks.workunit.client.1.smithi139.stdout:7/355: fdatasync d5/d10/f28 0 2024-09-17T07:19:54.648 INFO:tasks.workunit.client.1.smithi139.stdout:7/356: chown d5/d17/d4e/d63 350014 1 2024-09-17T07:19:54.649 INFO:tasks.workunit.client.1.smithi139.stdout:2/396: dread d0/d3b/f51 [0,4194304] 0 2024-09-17T07:19:54.650 INFO:tasks.workunit.client.1.smithi139.stdout:7/357: symlink d5/d67/l70 0 2024-09-17T07:19:54.654 INFO:tasks.workunit.client.1.smithi139.stdout:7/358: mkdir d5/d10/d2b/d71 0 2024-09-17T07:19:54.656 INFO:tasks.workunit.client.1.smithi139.stdout:7/359: creat d5/d10/d2b/d40/d47/f72 x:0 0 0 2024-09-17T07:19:54.656 INFO:tasks.workunit.client.0.smithi087.stdout:0/654: dwrite db/d4f/fda [0,4194304] 0 2024-09-17T07:19:54.658 INFO:tasks.workunit.client.0.smithi087.stdout:0/655: dread - db/d45/d7b/d7e/fa4 zero size 2024-09-17T07:19:54.659 INFO:tasks.workunit.client.0.smithi087.stdout:6/580: dwrite d1/d6/f12 [4194304,4194304] 0 2024-09-17T07:19:54.663 INFO:tasks.workunit.client.0.smithi087.stdout:6/581: chown d1/d6/d1a/d4e/f50 5028 1 2024-09-17T07:19:54.664 INFO:tasks.workunit.client.0.smithi087.stdout:3/453: truncate d6/d1b/d42/d62/f6a 589764 0 2024-09-17T07:19:54.666 INFO:tasks.workunit.client.1.smithi139.stdout:2/397: dwrite d0/de/f80 [0,4194304] 0 2024-09-17T07:19:54.666 INFO:tasks.workunit.client.0.smithi087.stdout:6/582: fsync d1/d6/d1a/f57 0 2024-09-17T07:19:54.667 INFO:tasks.workunit.client.1.smithi139.stdout:2/398: write d0/d4e/f6c [510666,110278] 0 2024-09-17T07:19:54.668 INFO:tasks.workunit.client.0.smithi087.stdout:5/622: write d5/d18/d20/d2f/f43 [1416646,125836] 0 2024-09-17T07:19:54.668 INFO:tasks.workunit.client.0.smithi087.stdout:4/406: dwrite d2/f32 [0,4194304] 0 2024-09-17T07:19:54.669 INFO:tasks.workunit.client.1.smithi139.stdout:2/399: dread - d0/de/d69/f74 zero size 2024-09-17T07:19:54.670 INFO:tasks.workunit.client.1.smithi139.stdout:2/400: fdatasync d0/dc/f13 0 2024-09-17T07:19:54.670 INFO:tasks.workunit.client.0.smithi087.stdout:9/383: rmdir d3/d4/d6/d8/d22 39 2024-09-17T07:19:54.671 INFO:tasks.workunit.client.1.smithi139.stdout:7/360: write d5/d10/d2b/d40/f61 [3787404,57598] 0 2024-09-17T07:19:54.671 INFO:tasks.workunit.client.1.smithi139.stdout:2/401: stat d0/d3b/f5d 0 2024-09-17T07:19:54.672 INFO:tasks.workunit.client.1.smithi139.stdout:7/361: dread - d5/d17/d4e/d55/f6f zero size 2024-09-17T07:19:54.672 INFO:tasks.workunit.client.0.smithi087.stdout:5/623: mknod d5/d8/d1f/ccc 0 2024-09-17T07:19:54.677 INFO:tasks.workunit.client.1.smithi139.stdout:7/362: mknod d5/d10/d2b/c73 0 2024-09-17T07:19:54.679 INFO:tasks.workunit.client.1.smithi139.stdout:2/402: mknod d0/d4e/d76/d82/c87 0 2024-09-17T07:19:54.679 INFO:tasks.workunit.client.0.smithi087.stdout:6/583: dread d1/d6/d1a/d2c/d58/fbf [0,4194304] 0 2024-09-17T07:19:54.681 INFO:tasks.workunit.client.1.smithi139.stdout:7/363: fdatasync d5/d10/d2b/f3f 0 2024-09-17T07:19:54.682 INFO:tasks.workunit.client.0.smithi087.stdout:9/384: unlink d3/d4/da/d4b/l5a 0 2024-09-17T07:19:54.682 INFO:tasks.workunit.client.0.smithi087.stdout:5/624: dwrite d5/d18/d6f/fc7 [0,4194304] 0 2024-09-17T07:19:54.683 INFO:tasks.workunit.client.1.smithi139.stdout:7/364: write d5/f23 [4907726,100432] 0 2024-09-17T07:19:54.683 INFO:tasks.workunit.client.0.smithi087.stdout:4/407: link d2/d5/d1f/f34 d2/d92/f94 0 2024-09-17T07:19:54.684 INFO:tasks.workunit.client.0.smithi087.stdout:9/385: chown d3/d4/da/d4b 369766 1 2024-09-17T07:19:54.684 INFO:tasks.workunit.client.0.smithi087.stdout:4/408: chown d2/d5/f59 389147 1 2024-09-17T07:19:54.685 INFO:tasks.workunit.client.1.smithi139.stdout:2/403: dread d0/d3b/f51 [4194304,4194304] 0 2024-09-17T07:19:54.686 INFO:tasks.workunit.client.0.smithi087.stdout:5/625: write d5/d12/d4d/fbe [3310843,127017] 0 2024-09-17T07:19:54.686 INFO:tasks.workunit.client.1.smithi139.stdout:2/404: fsync d0/d3b/f64 0 2024-09-17T07:19:54.688 INFO:tasks.workunit.client.0.smithi087.stdout:6/584: creat d1/d67/db7/fc9 x:0 0 0 2024-09-17T07:19:54.690 INFO:tasks.workunit.client.0.smithi087.stdout:3/454: dread d6/d16/f4a [0,4194304] 0 2024-09-17T07:19:54.691 INFO:tasks.workunit.client.0.smithi087.stdout:5/626: symlink d5/d12/d14/d61/d94/lcd 0 2024-09-17T07:19:54.693 INFO:tasks.workunit.client.0.smithi087.stdout:4/409: mkdir d2/d22/d95 0 2024-09-17T07:19:54.693 INFO:tasks.workunit.client.1.smithi139.stdout:7/365: dwrite d5/d10/d2b/f44 [0,4194304] 0 2024-09-17T07:19:54.694 INFO:tasks.workunit.client.0.smithi087.stdout:6/585: mknod d1/d6/d1a/d2c/d48/d9b/dac/cca 0 2024-09-17T07:19:54.696 INFO:tasks.workunit.client.0.smithi087.stdout:0/656: dwrite db/d45/d7b/d7e/fa0 [0,4194304] 0 2024-09-17T07:19:54.696 INFO:tasks.workunit.client.1.smithi139.stdout:2/405: dwrite d0/de/d54/f7e [0,4194304] 0 2024-09-17T07:19:54.698 INFO:tasks.workunit.client.0.smithi087.stdout:3/455: rename d6/d1b/d42/d62/l64 to d6/d1b/d42/l98 0 2024-09-17T07:19:54.698 INFO:tasks.workunit.client.0.smithi087.stdout:4/410: mkdir d2/d22/d2c/d96 0 2024-09-17T07:19:54.699 INFO:tasks.workunit.client.0.smithi087.stdout:6/586: rmdir d1/d6/d1a/d2c/d40/d4c/d77 39 2024-09-17T07:19:54.701 INFO:tasks.workunit.client.0.smithi087.stdout:6/587: readlink d1/d6/d1a/d2c/d48/la7 0 2024-09-17T07:19:54.701 INFO:tasks.workunit.client.0.smithi087.stdout:0/657: mkdir db/da3/df6 0 2024-09-17T07:19:54.701 INFO:tasks.workunit.client.1.smithi139.stdout:7/366: rename d5/d17/d4e/d55/c5a to d5/d17/d4e/c74 0 2024-09-17T07:19:54.703 INFO:tasks.workunit.client.0.smithi087.stdout:4/411: mkdir d2/d92/d4d/d21/d2f/d3b/d7e/d97 0 2024-09-17T07:19:54.704 INFO:tasks.workunit.client.1.smithi139.stdout:2/406: rmdir d0/de/d11/d28 39 2024-09-17T07:19:54.704 INFO:tasks.workunit.client.0.smithi087.stdout:3/456: truncate d6/d15/d37/d3c/d43/d48/f58 4389424 0 2024-09-17T07:19:54.706 INFO:tasks.workunit.client.1.smithi139.stdout:2/407: write d0/de/d11/d28/f37 [6118717,41459] 0 2024-09-17T07:19:54.706 INFO:tasks.workunit.client.0.smithi087.stdout:6/588: read d1/d6/d1a/f28 [35937,47264] 0 2024-09-17T07:19:54.708 INFO:tasks.workunit.client.0.smithi087.stdout:4/412: unlink d2/d92/f5f 0 2024-09-17T07:19:54.711 INFO:tasks.workunit.client.1.smithi139.stdout:2/408: dread d0/de/d11/d32/f72 [0,4194304] 0 2024-09-17T07:19:54.712 INFO:tasks.workunit.client.0.smithi087.stdout:5/627: getdents d5 0 2024-09-17T07:19:54.713 INFO:tasks.workunit.client.0.smithi087.stdout:5/628: chown d5/d12/d14/c55 60 1 2024-09-17T07:19:54.714 INFO:tasks.workunit.client.1.smithi139.stdout:2/409: chown d0/d3b/c73 2072492387 1 2024-09-17T07:19:54.715 INFO:tasks.workunit.client.1.smithi139.stdout:2/410: dread - d0/de/df/d56/f7a zero size 2024-09-17T07:19:54.715 INFO:tasks.workunit.client.0.smithi087.stdout:0/658: getdents db/d45/d9e/d86/dd5/deb 0 2024-09-17T07:19:54.716 INFO:tasks.workunit.client.0.smithi087.stdout:5/629: fdatasync d5/d12/d14/f7b 0 2024-09-17T07:19:54.717 INFO:tasks.workunit.client.1.smithi139.stdout:2/411: symlink d0/de/d11/l88 0 2024-09-17T07:19:54.718 INFO:tasks.workunit.client.0.smithi087.stdout:0/659: symlink db/dbe/lf7 0 2024-09-17T07:19:54.719 INFO:tasks.workunit.client.1.smithi139.stdout:2/412: mknod d0/d7/d1a/d59/c89 0 2024-09-17T07:19:54.719 INFO:tasks.workunit.client.0.smithi087.stdout:3/457: link d6/d1b/d2b/c2a d6/d15/d37/d3c/c99 0 2024-09-17T07:19:54.720 INFO:tasks.workunit.client.1.smithi139.stdout:2/413: write d0/de/f80 [2374071,107928] 0 2024-09-17T07:19:54.720 INFO:tasks.workunit.client.0.smithi087.stdout:3/458: truncate d6/fc 3417765 0 2024-09-17T07:19:54.720 INFO:tasks.workunit.client.0.smithi087.stdout:3/459: fdatasync d6/fa 0 2024-09-17T07:19:54.722 INFO:tasks.workunit.client.0.smithi087.stdout:0/660: symlink db/d45/d7b/d7e/lf8 0 2024-09-17T07:19:54.723 INFO:tasks.workunit.client.1.smithi139.stdout:2/414: dread d0/d4e/d76/f78 [0,4194304] 0 2024-09-17T07:19:54.724 INFO:tasks.workunit.client.0.smithi087.stdout:5/630: link d5/d12/d14/d61/d94/fa4 d5/d12/d14/d61/fce 0 2024-09-17T07:19:54.724 INFO:tasks.workunit.client.0.smithi087.stdout:3/460: mknod d6/d15/d37/d3c/d52/c9a 0 2024-09-17T07:19:54.725 INFO:tasks.workunit.client.1.smithi139.stdout:2/415: creat d0/de/d54/f8a x:0 0 0 2024-09-17T07:19:54.725 INFO:tasks.workunit.client.0.smithi087.stdout:5/631: fsync d5/d12/d14/d61/f75 0 2024-09-17T07:19:54.726 INFO:tasks.workunit.client.0.smithi087.stdout:0/661: unlink db/f2e 0 2024-09-17T07:19:54.727 INFO:tasks.workunit.client.0.smithi087.stdout:3/461: mknod d6/d15/d4b/c9b 0 2024-09-17T07:19:54.728 INFO:tasks.workunit.client.0.smithi087.stdout:0/662: readlink db/d45/d5d/l77 0 2024-09-17T07:19:54.730 INFO:tasks.workunit.client.0.smithi087.stdout:5/632: getdents d5/d18/d20/d2f/d83 0 2024-09-17T07:19:54.736 INFO:tasks.workunit.client.1.smithi139.stdout:2/416: write d0/de/f14 [1349978,16908] 0 2024-09-17T07:19:54.736 INFO:tasks.workunit.client.0.smithi087.stdout:0/663: dwrite db/d45/d7b/d7e/f8b [0,4194304] 0 2024-09-17T07:19:54.737 INFO:tasks.workunit.client.0.smithi087.stdout:3/462: link d6/d1b/d42/l31 d6/d15/d37/d3c/l9c 0 2024-09-17T07:19:54.738 INFO:tasks.workunit.client.1.smithi139.stdout:2/417: symlink d0/d7/d86/l8b 0 2024-09-17T07:19:54.740 INFO:tasks.workunit.client.1.smithi139.stdout:2/418: mkdir d0/de/d11/d12/d8c 0 2024-09-17T07:19:54.740 INFO:tasks.workunit.client.1.smithi139.stdout:2/419: chown d0/de/d11/c44 50 1 2024-09-17T07:19:54.743 INFO:tasks.workunit.client.0.smithi087.stdout:5/633: mknod d5/d12/d56/ccf 0 2024-09-17T07:19:54.745 INFO:tasks.workunit.client.0.smithi087.stdout:0/664: dread db/d45/d7b/f9d [0,4194304] 0 2024-09-17T07:19:54.745 INFO:tasks.workunit.client.0.smithi087.stdout:9/386: dwrite d3/d4/d6/d8/d22/f2d [8388608,4194304] 0 2024-09-17T07:19:54.746 INFO:tasks.workunit.client.0.smithi087.stdout:3/463: unlink d6/d15/d4b/l65 0 2024-09-17T07:19:54.747 INFO:tasks.workunit.client.0.smithi087.stdout:6/589: dread d1/f4b [0,4194304] 0 2024-09-17T07:19:54.748 INFO:tasks.workunit.client.0.smithi087.stdout:0/665: write db/d4f/fde [663767,45524] 0 2024-09-17T07:19:54.750 INFO:tasks.workunit.client.0.smithi087.stdout:5/634: mknod d5/d12/d4d/cd0 0 2024-09-17T07:19:54.751 INFO:tasks.workunit.client.0.smithi087.stdout:0/666: fdatasync db/d45/d7b/d7e/fc6 0 2024-09-17T07:19:54.754 INFO:tasks.workunit.client.0.smithi087.stdout:9/387: symlink d3/d4/d2f/l8e 0 2024-09-17T07:19:54.754 INFO:tasks.workunit.client.0.smithi087.stdout:5/635: chown d5/d18/c2a 85037 1 2024-09-17T07:19:54.757 INFO:tasks.workunit.client.1.smithi139.stdout:7/367: dread d5/f23 [4194304,4194304] 0 2024-09-17T07:19:54.758 INFO:tasks.workunit.client.1.smithi139.stdout:0/308: sync 2024-09-17T07:19:54.758 INFO:tasks.workunit.client.1.smithi139.stdout:8/462: sync 2024-09-17T07:19:54.758 INFO:tasks.workunit.client.1.smithi139.stdout:4/353: sync 2024-09-17T07:19:54.758 INFO:tasks.workunit.client.1.smithi139.stdout:3/347: sync 2024-09-17T07:19:54.759 INFO:tasks.workunit.client.1.smithi139.stdout:8/463: stat d0/l11 0 2024-09-17T07:19:54.760 INFO:tasks.workunit.client.1.smithi139.stdout:3/348: chown f2 446783165 1 2024-09-17T07:19:54.760 INFO:tasks.workunit.client.1.smithi139.stdout:0/309: read d1/da/f60 [835689,104087] 0 2024-09-17T07:19:54.761 INFO:tasks.workunit.client.1.smithi139.stdout:8/464: stat d0/d1a/l33 0 2024-09-17T07:19:54.762 INFO:tasks.workunit.client.1.smithi139.stdout:3/349: write d5/d21/d23/f5d [561551,65128] 0 2024-09-17T07:19:54.762 INFO:tasks.workunit.client.1.smithi139.stdout:4/354: mknod d0/d1/d29/c68 0 2024-09-17T07:19:54.763 INFO:tasks.workunit.client.1.smithi139.stdout:8/465: fdatasync d0/d20/d28/d52/f64 0 2024-09-17T07:19:54.763 INFO:tasks.workunit.client.1.smithi139.stdout:7/368: creat d5/d10/d4d/d59/f75 x:0 0 0 2024-09-17T07:19:54.764 INFO:tasks.workunit.client.1.smithi139.stdout:3/350: chown d5/f3c 3 1 2024-09-17T07:19:54.767 INFO:tasks.workunit.client.1.smithi139.stdout:0/310: rename d1/da/d2a/d5c to d1/da/d1b/d32/d81 0 2024-09-17T07:19:54.767 INFO:tasks.workunit.client.1.smithi139.stdout:4/355: mknod d0/d1/d29/c69 0 2024-09-17T07:19:54.773 INFO:tasks.workunit.client.1.smithi139.stdout:7/369: getdents d5/d10/d4d/d59 0 2024-09-17T07:19:54.774 INFO:tasks.workunit.client.1.smithi139.stdout:2/420: dread d0/d7/f19 [4194304,4194304] 0 2024-09-17T07:19:54.791 INFO:tasks.workunit.client.1.smithi139.stdout:6/511: sync 2024-09-17T07:19:54.791 INFO:tasks.workunit.client.1.smithi139.stdout:9/685: sync 2024-09-17T07:19:54.791 INFO:tasks.workunit.client.1.smithi139.stdout:5/322: sync 2024-09-17T07:19:54.800 INFO:tasks.workunit.client.1.smithi139.stdout:8/466: dwrite d0/d20/d28/d52/f63 [0,4194304] 0 2024-09-17T07:19:54.800 INFO:tasks.workunit.client.1.smithi139.stdout:9/686: chown dc/d11/d15 4609 1 2024-09-17T07:19:54.801 INFO:tasks.workunit.client.1.smithi139.stdout:7/370: chown d5/d17/d4e/l5d 156681 1 2024-09-17T07:19:54.802 INFO:tasks.workunit.client.1.smithi139.stdout:3/351: dwrite d5/d15/d20/d3b/f53 [0,4194304] 0 2024-09-17T07:19:54.803 INFO:tasks.workunit.client.1.smithi139.stdout:6/512: fsync db/d18/d5b/f61 0 2024-09-17T07:19:54.804 INFO:tasks.workunit.client.1.smithi139.stdout:8/467: read - d0/d1a/d3a/d71/f75 zero size 2024-09-17T07:19:54.809 INFO:tasks.workunit.client.1.smithi139.stdout:8/468: write d0/f7 [1633460,80042] 0 2024-09-17T07:19:54.809 INFO:tasks.workunit.client.1.smithi139.stdout:6/513: mkdir db/df/daa 0 2024-09-17T07:19:54.809 INFO:tasks.workunit.client.1.smithi139.stdout:9/687: write dc/d11/d15/d3c/d68/fa0 [408149,129297] 0 2024-09-17T07:19:54.811 INFO:tasks.workunit.client.1.smithi139.stdout:0/311: dwrite d1/da/d1b/d32/f37 [0,4194304] 0 2024-09-17T07:19:54.816 INFO:tasks.workunit.client.0.smithi087.stdout:4/413: dwrite d2/d92/d4d/d21/d2f/f47 [0,4194304] 0 2024-09-17T07:19:54.816 INFO:tasks.workunit.client.1.smithi139.stdout:9/688: chown dc/d11/d15/d3c/d61/dc8/ce1 107955931 1 2024-09-17T07:19:54.817 INFO:tasks.workunit.client.1.smithi139.stdout:5/323: dwrite d4/d16/f2b [0,4194304] 0 2024-09-17T07:19:54.817 INFO:tasks.workunit.client.0.smithi087.stdout:6/590: write d1/d6/d1a/d2c/f2d [3174778,55693] 0 2024-09-17T07:19:54.819 INFO:tasks.workunit.client.1.smithi139.stdout:3/352: getdents d5/d15/d16 0 2024-09-17T07:19:54.820 INFO:tasks.workunit.client.1.smithi139.stdout:0/312: truncate d1/f43 1313996 0 2024-09-17T07:19:54.820 INFO:tasks.workunit.client.0.smithi087.stdout:0/667: dwrite f5 [0,4194304] 0 2024-09-17T07:19:54.823 INFO:tasks.workunit.client.0.smithi087.stdout:5/636: dread d5/f1b [0,4194304] 0 2024-09-17T07:19:54.824 INFO:tasks.workunit.client.1.smithi139.stdout:8/469: dwrite d0/d1a/d3a/f8e [0,4194304] 0 2024-09-17T07:19:54.825 INFO:tasks.workunit.client.1.smithi139.stdout:3/353: truncate d5/d15/d16/d4c/f66 861510 0 2024-09-17T07:19:54.828 INFO:tasks.workunit.client.0.smithi087.stdout:0/668: write db/d45/d7b/fdc [632383,123039] 0 2024-09-17T07:19:54.828 INFO:tasks.workunit.client.1.smithi139.stdout:3/354: dread d5/d21/d23/f49 [0,4194304] 0 2024-09-17T07:19:54.828 INFO:tasks.workunit.client.1.smithi139.stdout:2/421: truncate d0/de/d54/f7e 2305159 0 2024-09-17T07:19:54.829 INFO:tasks.workunit.client.0.smithi087.stdout:6/591: creat d1/d6/d1a/d2c/d58/d90/fcb x:0 0 0 2024-09-17T07:19:54.830 INFO:tasks.workunit.client.0.smithi087.stdout:5/637: creat d5/d12/fd1 x:0 0 0 2024-09-17T07:19:54.831 INFO:tasks.workunit.client.1.smithi139.stdout:8/470: mkdir d0/d96 0 2024-09-17T07:19:54.832 INFO:tasks.workunit.client.1.smithi139.stdout:2/422: symlink d0/de/d11/d12/d45/l8d 0 2024-09-17T07:19:54.832 INFO:tasks.workunit.client.0.smithi087.stdout:4/414: dwrite d2/d92/d4f/f5c [0,4194304] 0 2024-09-17T07:19:54.833 INFO:tasks.workunit.client.1.smithi139.stdout:3/355: mkdir d5/d63/d6d/d6f 0 2024-09-17T07:19:54.833 INFO:tasks.workunit.client.1.smithi139.stdout:2/423: write d0/de/d54/f8a [927409,51521] 0 2024-09-17T07:19:54.837 INFO:tasks.workunit.client.1.smithi139.stdout:8/471: rename d0/d20/d28/l88 to d0/d20/d28/d52/d65/l97 0 2024-09-17T07:19:54.837 INFO:tasks.workunit.client.0.smithi087.stdout:6/592: stat d1/d6/d1a/d2c/d40/d4c 0 2024-09-17T07:19:54.837 INFO:tasks.workunit.client.1.smithi139.stdout:2/424: fsync d0/de/f36 0 2024-09-17T07:19:54.841 INFO:tasks.workunit.client.0.smithi087.stdout:9/388: truncate d3/d4/d6/f13 2916961 0 2024-09-17T07:19:54.843 INFO:tasks.workunit.client.0.smithi087.stdout:0/669: dwrite db/d45/d7b/d90/dd9/ff0 [0,4194304] 0 2024-09-17T07:19:54.843 INFO:tasks.workunit.client.0.smithi087.stdout:9/389: write d3/d4/fb [23386,30838] 0 2024-09-17T07:19:54.844 INFO:tasks.workunit.client.1.smithi139.stdout:5/324: dread d4/d16/d1b/d20/d38/d4f/f5e [0,4194304] 0 2024-09-17T07:19:54.844 INFO:tasks.workunit.client.1.smithi139.stdout:2/425: chown d0/de/d69/f74 1449 1 2024-09-17T07:19:54.845 INFO:tasks.workunit.client.0.smithi087.stdout:0/670: write db/f21 [1461005,114624] 0 2024-09-17T07:19:54.846 INFO:tasks.workunit.client.1.smithi139.stdout:3/356: dwrite d5/d21/f4e [0,4194304] 0 2024-09-17T07:19:54.847 INFO:tasks.workunit.client.0.smithi087.stdout:0/671: write db/d45/f4b [931806,74558] 0 2024-09-17T07:19:54.849 INFO:tasks.workunit.client.0.smithi087.stdout:0/672: dread db/f42 [0,4194304] 0 2024-09-17T07:19:54.851 INFO:tasks.workunit.client.0.smithi087.stdout:9/390: getdents d3/d4/d6/d8/d12 0 2024-09-17T07:19:54.851 INFO:tasks.workunit.client.0.smithi087.stdout:0/673: mkdir db/d45/d9e/d95/de9/df9 0 2024-09-17T07:19:54.854 INFO:tasks.workunit.client.0.smithi087.stdout:9/391: creat d3/d4/d6/d8/d12/d32/f8f x:0 0 0 2024-09-17T07:19:54.855 INFO:tasks.workunit.client.1.smithi139.stdout:5/325: mknod d4/d16/d1b/d20/d28/c60 0 2024-09-17T07:19:54.855 INFO:tasks.workunit.client.0.smithi087.stdout:0/674: read db/d45/d7b/fb2 [1619474,16] 0 2024-09-17T07:19:54.856 INFO:tasks.workunit.client.1.smithi139.stdout:2/426: rename d0/de/d11/d12/d45/c81 to d0/de/d11/d32/c8e 0 2024-09-17T07:19:54.857 INFO:tasks.workunit.client.0.smithi087.stdout:9/392: mkdir d3/d4/d16/d69/d8a/d1e/d90 0 2024-09-17T07:19:54.859 INFO:tasks.workunit.client.0.smithi087.stdout:5/638: dread d5/d6d/f81 [0,4194304] 0 2024-09-17T07:19:54.860 INFO:tasks.workunit.client.0.smithi087.stdout:9/393: mkdir d3/d4/d6/d8/d91 0 2024-09-17T07:19:54.860 INFO:tasks.workunit.client.0.smithi087.stdout:5/639: stat d5/d18/d20/d2f 0 2024-09-17T07:19:54.861 INFO:tasks.workunit.client.1.smithi139.stdout:5/326: mkdir d4/d16/d1b/d20/d28/d61 0 2024-09-17T07:19:54.861 INFO:tasks.workunit.client.0.smithi087.stdout:5/640: dread - d5/d18/d20/d2f/d83/fb0 zero size 2024-09-17T07:19:54.864 INFO:tasks.workunit.client.0.smithi087.stdout:9/394: rename d3/d4/d6/d8/d91 to d3/d4/d6/d8/d22/d92 0 2024-09-17T07:19:54.864 INFO:tasks.workunit.client.0.smithi087.stdout:0/675: dread db/d45/f7c [0,4194304] 0 2024-09-17T07:19:54.865 INFO:tasks.workunit.client.1.smithi139.stdout:9/689: dread dc/d11/d15/f17 [0,4194304] 0 2024-09-17T07:19:54.866 INFO:tasks.workunit.client.0.smithi087.stdout:9/395: write d3/d4/d6/d8/d22/d43/d84/f72 [955585,39771] 0 2024-09-17T07:19:54.867 INFO:tasks.workunit.client.0.smithi087.stdout:0/676: creat db/d45/d7b/d90/dd9/de6/ffa x:0 0 0 2024-09-17T07:19:54.868 INFO:tasks.workunit.client.0.smithi087.stdout:9/396: dread - d3/d4/d6/d8/d12/d38/f56 zero size 2024-09-17T07:19:54.869 INFO:tasks.workunit.client.1.smithi139.stdout:9/690: rename dc/d11/d15/d1e/d53/fc6 to dc/d11/d15/d1e/d34/fe7 0 2024-09-17T07:19:54.869 INFO:tasks.workunit.client.1.smithi139.stdout:5/327: link d4/d16/d1b/d20/d32/d3d/c48 d4/d16/d1b/d20/d38/c62 0 2024-09-17T07:19:54.871 INFO:tasks.workunit.client.1.smithi139.stdout:5/328: symlink d4/d16/d1b/l63 0 2024-09-17T07:19:54.874 INFO:tasks.workunit.client.0.smithi087.stdout:0/677: unlink db/l10 0 2024-09-17T07:19:54.875 INFO:tasks.workunit.client.1.smithi139.stdout:9/691: link dc/d11/d15/d1e/d34/c4e dc/d11/d15/d3c/d68/ce8 0 2024-09-17T07:19:54.875 INFO:tasks.workunit.client.1.smithi139.stdout:8/472: dwrite d0/d1a/d4d/d53/f5d [0,4194304] 0 2024-09-17T07:19:54.877 INFO:tasks.workunit.client.0.smithi087.stdout:9/397: mkdir d3/d4/d16/d69/d8a/d1e/d90/d93 0 2024-09-17T07:19:54.878 INFO:tasks.workunit.client.0.smithi087.stdout:0/678: truncate db/f27 137327 0 2024-09-17T07:19:54.879 INFO:tasks.workunit.client.0.smithi087.stdout:9/398: symlink d3/d4/d16/d69/d8a/d1e/l94 0 2024-09-17T07:19:54.882 INFO:tasks.workunit.client.1.smithi139.stdout:9/692: truncate dc/d11/d15/d3c/d61/d64/fc1 5006954 0 2024-09-17T07:19:54.882 INFO:tasks.workunit.client.0.smithi087.stdout:9/399: write d3/d4/d16/d69/d8a/f85 [90870,17516] 0 2024-09-17T07:19:54.882 INFO:tasks.workunit.client.0.smithi087.stdout:9/400: write d3/f4d [5665213,1707] 0 2024-09-17T07:19:54.883 INFO:tasks.workunit.client.1.smithi139.stdout:5/329: dwrite d4/d16/d1b/d20/d38/d4f/f5e [0,4194304] 0 2024-09-17T07:19:54.883 INFO:tasks.workunit.client.0.smithi087.stdout:0/679: rename db/d45/d7b/fdc to db/d45/ffb 0 2024-09-17T07:19:54.885 INFO:tasks.workunit.client.1.smithi139.stdout:8/473: rename d0/dc/d18/f38 to d0/d20/d28/d52/d65/f98 0 2024-09-17T07:19:54.885 INFO:tasks.workunit.client.1.smithi139.stdout:9/693: rmdir dc 39 2024-09-17T07:19:54.886 INFO:tasks.workunit.client.1.smithi139.stdout:3/357: write d5/d21/f4e [4549325,123969] 0 2024-09-17T07:19:54.888 INFO:tasks.workunit.client.1.smithi139.stdout:8/474: mkdir d0/d20/d28/d52/d99 0 2024-09-17T07:19:54.889 INFO:tasks.workunit.client.0.smithi087.stdout:0/680: fsync db/dbe/fbf 0 2024-09-17T07:19:54.891 INFO:tasks.workunit.client.1.smithi139.stdout:3/358: truncate d5/d15/f33 5043389 0 2024-09-17T07:19:54.891 INFO:tasks.workunit.client.1.smithi139.stdout:8/475: mknod d0/d1a/d82/c9a 0 2024-09-17T07:19:54.894 INFO:tasks.workunit.client.0.smithi087.stdout:9/401: dwrite d3/d4/d6/d8/d22/d43/f77 [0,4194304] 0 2024-09-17T07:19:54.896 INFO:tasks.workunit.client.1.smithi139.stdout:5/330: dwrite d4/f36 [0,4194304] 0 2024-09-17T07:19:54.897 INFO:tasks.workunit.client.0.smithi087.stdout:0/681: rename db/d45/d7b/d7e/l81 to db/lfc 0 2024-09-17T07:19:54.897 INFO:tasks.workunit.client.1.smithi139.stdout:2/427: dread d0/d7/d1a/f1e [0,4194304] 0 2024-09-17T07:19:54.899 INFO:tasks.workunit.client.1.smithi139.stdout:2/428: chown d0/de/d11/d12/d45/l8d 35 1 2024-09-17T07:19:54.899 INFO:tasks.workunit.client.0.smithi087.stdout:0/682: chown db/d45/d5b/d92/de8 1021 1 2024-09-17T07:19:54.901 INFO:tasks.workunit.client.1.smithi139.stdout:2/429: chown d0/fb 2950616 1 2024-09-17T07:19:54.902 INFO:tasks.workunit.client.0.smithi087.stdout:0/683: symlink db/dbe/lfd 0 2024-09-17T07:19:54.902 INFO:tasks.workunit.client.1.smithi139.stdout:5/331: mknod d4/d5d/c64 0 2024-09-17T07:19:54.902 INFO:tasks.workunit.client.0.smithi087.stdout:0/684: chown db/d45/d9e/d95/dd8/fe2 41343 1 2024-09-17T07:19:54.904 INFO:tasks.workunit.client.1.smithi139.stdout:9/694: rename dc/d11/d15/d3c/c69 to dc/d11/d15/d3c/d61/dc8/ce9 0 2024-09-17T07:19:54.908 INFO:tasks.workunit.client.1.smithi139.stdout:2/430: creat d0/de/d11/d32/f8f x:0 0 0 2024-09-17T07:19:54.909 INFO:tasks.workunit.client.0.smithi087.stdout:0/685: rename db/d45/d7b/d7e/fbd to db/d45/d7b/d90/dd9/de6/ffe 0 2024-09-17T07:19:54.912 INFO:tasks.workunit.client.1.smithi139.stdout:2/431: creat d0/d7/d1a/d1b/f90 x:0 0 0 2024-09-17T07:19:54.913 INFO:tasks.workunit.client.1.smithi139.stdout:9/695: symlink dc/d11/d52/d56/d7a/lea 0 2024-09-17T07:19:54.915 INFO:tasks.workunit.client.1.smithi139.stdout:5/332: dwrite d4/d16/d1b/f39 [0,4194304] 0 2024-09-17T07:19:54.918 INFO:tasks.workunit.client.1.smithi139.stdout:9/696: dread dc/d11/d8b/dc7/fd5 [0,4194304] 0 2024-09-17T07:19:54.918 INFO:tasks.workunit.client.1.smithi139.stdout:2/432: rename d0/de/d25/d3f/f50 to d0/d7/f91 0 2024-09-17T07:19:54.920 INFO:tasks.workunit.client.1.smithi139.stdout:5/333: creat d4/d16/d1b/d20/d28/d3f/f65 x:0 0 0 2024-09-17T07:19:54.920 INFO:tasks.workunit.client.1.smithi139.stdout:2/433: rmdir d0/d7/d67 39 2024-09-17T07:19:54.921 INFO:tasks.workunit.client.0.smithi087.stdout:9/402: fsync d3/d4/d6/d8/d22/d43/f77 0 2024-09-17T07:19:54.923 INFO:tasks.workunit.client.0.smithi087.stdout:9/403: symlink d3/d4/d6/d71/l95 0 2024-09-17T07:19:54.924 INFO:tasks.workunit.client.1.smithi139.stdout:9/697: rmdir dc/d11/d8b/dc7/dcc 0 2024-09-17T07:19:54.926 INFO:tasks.workunit.client.0.smithi087.stdout:9/404: getdents d3/d4/d6/d8/d22/d2a 0 2024-09-17T07:19:54.927 INFO:tasks.workunit.client.0.smithi087.stdout:9/405: fdatasync d3/d4/d6/d8/d12/d38/f70 0 2024-09-17T07:19:54.927 INFO:tasks.workunit.client.1.smithi139.stdout:9/698: symlink dc/leb 0 2024-09-17T07:19:54.929 INFO:tasks.workunit.client.0.smithi087.stdout:9/406: mkdir d3/d4/d16/d69/d8a/d1e/d90/d93/d96 0 2024-09-17T07:19:54.929 INFO:tasks.workunit.client.1.smithi139.stdout:5/334: dwrite d4/d16/d1b/d20/d28/f1f [0,4194304] 0 2024-09-17T07:19:54.931 INFO:tasks.workunit.client.0.smithi087.stdout:9/407: creat d3/d25/d83/f97 x:0 0 0 2024-09-17T07:19:54.932 INFO:tasks.workunit.client.1.smithi139.stdout:9/699: dread - dc/d11/d8b/f91 zero size 2024-09-17T07:19:54.934 INFO:tasks.workunit.client.1.smithi139.stdout:2/434: dread d0/f3 [0,4194304] 0 2024-09-17T07:19:54.934 INFO:tasks.workunit.client.0.smithi087.stdout:9/408: getdents d3/d4/d6/d8/d12/d32/d6c 0 2024-09-17T07:19:54.935 INFO:tasks.workunit.client.1.smithi139.stdout:9/700: creat dc/d2a/fec x:0 0 0 2024-09-17T07:19:54.938 INFO:tasks.workunit.client.0.smithi087.stdout:9/409: getdents d3/d4 0 2024-09-17T07:19:54.940 INFO:tasks.workunit.client.1.smithi139.stdout:5/335: dwrite d4/d16/d1b/d20/d38/d4f/f5c [0,4194304] 0 2024-09-17T07:19:54.940 INFO:tasks.workunit.client.1.smithi139.stdout:9/701: write dc/d11/d52/d56/d75/fa6 [1304482,122694] 0 2024-09-17T07:19:54.941 INFO:tasks.workunit.client.1.smithi139.stdout:5/336: fsync d4/d16/d1b/f55 0 2024-09-17T07:19:54.947 INFO:tasks.workunit.client.1.smithi139.stdout:9/702: rename dc/d11/d52/ld8 to dc/d11/d15/d3c/d61/dc8/d9f/led 0 2024-09-17T07:19:54.948 INFO:tasks.workunit.client.1.smithi139.stdout:3/359: dread d5/d15/d20/d3b/f4a [0,4194304] 0 2024-09-17T07:19:54.948 INFO:tasks.workunit.client.1.smithi139.stdout:8/476: dread d0/d1a/f3f [0,4194304] 0 2024-09-17T07:19:54.950 INFO:tasks.workunit.client.0.smithi087.stdout:9/410: dread d3/fc [0,4194304] 0 2024-09-17T07:19:54.951 INFO:tasks.workunit.client.1.smithi139.stdout:3/360: creat d5/d15/d56/f70 x:0 0 0 2024-09-17T07:19:54.953 INFO:tasks.workunit.client.1.smithi139.stdout:5/337: dread d4/d16/d1b/d20/f56 [4194304,4194304] 0 2024-09-17T07:19:54.953 INFO:tasks.workunit.client.1.smithi139.stdout:8/477: rename d0/d20/d28/d48/l66 to d0/d20/d28/d52/l9b 0 2024-09-17T07:19:54.954 INFO:tasks.workunit.client.1.smithi139.stdout:5/338: readlink d4/d16/d1b/l34 0 2024-09-17T07:19:54.955 INFO:tasks.workunit.client.0.smithi087.stdout:9/411: dwrite d3/d25/d83/f97 [0,4194304] 0 2024-09-17T07:19:54.957 INFO:tasks.workunit.client.1.smithi139.stdout:5/339: write d4/d16/d1b/d20/d28/d3f/f65 [609922,58029] 0 2024-09-17T07:19:54.957 INFO:tasks.workunit.client.1.smithi139.stdout:3/361: getdents d5/d15/d20/d3b 0 2024-09-17T07:19:54.958 INFO:tasks.workunit.client.1.smithi139.stdout:9/703: write dc/d11/d15/d1e/f65 [1109880,30920] 0 2024-09-17T07:19:54.961 INFO:tasks.workunit.client.0.smithi087.stdout:9/412: link d3/d4/d6/d8/d22/d43/f61 d3/d4/f98 0 2024-09-17T07:19:54.961 INFO:tasks.workunit.client.1.smithi139.stdout:3/362: rename d5/d15/d20/f5a to d5/d63/d6d/f71 0 2024-09-17T07:19:54.962 INFO:tasks.workunit.client.1.smithi139.stdout:3/363: fsync d5/d15/d16/d4c/f4b 0 2024-09-17T07:19:54.963 INFO:tasks.workunit.client.1.smithi139.stdout:9/704: write dc/d11/d15/d3c/f7e [222208,120379] 0 2024-09-17T07:19:54.964 INFO:tasks.workunit.client.1.smithi139.stdout:5/340: link d4/d16/d1b/f39 d4/d16/d1b/f66 0 2024-09-17T07:19:54.967 INFO:tasks.workunit.client.1.smithi139.stdout:9/705: truncate dc/d11/d15/d3c/d61/d64/d96/f9e 817301 0 2024-09-17T07:19:54.968 INFO:tasks.workunit.client.1.smithi139.stdout:5/341: mkdir d4/d16/d1b/d20/d67 0 2024-09-17T07:19:54.969 INFO:tasks.workunit.client.1.smithi139.stdout:5/342: creat d4/d16/d1b/d20/d38/f68 x:0 0 0 2024-09-17T07:19:54.970 INFO:tasks.workunit.client.0.smithi087.stdout:8/483: sync 2024-09-17T07:19:54.970 INFO:tasks.workunit.client.1.smithi139.stdout:5/343: chown d4/d16/d1b/d20/d28/f46 1094366 1 2024-09-17T07:19:54.973 INFO:tasks.workunit.client.0.smithi087.stdout:8/484: link d1/d2b/d21/f35 d1/d7/d9/d27/fa9 0 2024-09-17T07:19:54.974 INFO:tasks.workunit.client.1.smithi139.stdout:8/478: dread d0/d1a/d3a/f67 [0,4194304] 0 2024-09-17T07:19:54.976 INFO:tasks.workunit.client.0.smithi087.stdout:8/485: link d1/c51 d1/d7/d9/d19/d73/caa 0 2024-09-17T07:19:54.976 INFO:tasks.workunit.client.0.smithi087.stdout:8/486: chown d1/d2b/d21 449892960 1 2024-09-17T07:19:54.977 INFO:tasks.workunit.client.1.smithi139.stdout:8/479: getdents d0/d20/d28 0 2024-09-17T07:19:54.978 INFO:tasks.workunit.client.1.smithi139.stdout:8/480: mkdir d0/d1a/d82/d9c 0 2024-09-17T07:19:54.978 INFO:tasks.workunit.client.0.smithi087.stdout:8/487: symlink d1/d2b/d21/d6d/d6f/d7f/lab 0 2024-09-17T07:19:54.979 INFO:tasks.workunit.client.1.smithi139.stdout:8/481: readlink d0/d20/l61 0 2024-09-17T07:19:54.980 INFO:tasks.workunit.client.1.smithi139.stdout:8/482: creat d0/d20/d28/f9d x:0 0 0 2024-09-17T07:19:54.982 INFO:tasks.workunit.client.1.smithi139.stdout:8/483: mknod d0/d1a/d3a/d71/c9e 0 2024-09-17T07:19:54.982 INFO:tasks.workunit.client.0.smithi087.stdout:0/686: rmdir db/d45/d7b/d7e 39 2024-09-17T07:19:54.984 INFO:tasks.workunit.client.1.smithi139.stdout:5/344: rmdir d4/d16/d1b 39 2024-09-17T07:19:54.985 INFO:tasks.workunit.client.1.smithi139.stdout:8/484: creat d0/d20/d28/d48/f9f x:0 0 0 2024-09-17T07:19:54.986 INFO:tasks.workunit.client.1.smithi139.stdout:8/485: fsync d0/d1a/f4a 0 2024-09-17T07:19:54.989 INFO:tasks.workunit.client.1.smithi139.stdout:8/486: rmdir d0/d1a/d82/d9c 0 2024-09-17T07:19:54.990 INFO:tasks.workunit.client.0.smithi087.stdout:9/413: read d3/d4/fb [110794,27277] 0 2024-09-17T07:19:54.990 INFO:tasks.workunit.client.0.smithi087.stdout:0/687: dwrite db/f38 [0,4194304] 0 2024-09-17T07:19:54.992 INFO:tasks.workunit.client.1.smithi139.stdout:5/345: dwrite d4/d16/d1b/d20/f56 [0,4194304] 0 2024-09-17T07:19:54.993 INFO:tasks.workunit.client.0.smithi087.stdout:8/488: write d1/d7/d9/d19/d1b/f1c [1052543,72560] 0 2024-09-17T07:19:54.995 INFO:tasks.workunit.client.1.smithi139.stdout:8/487: rename d0/d20/d28/d52/d54/l74 to d0/d20/d28/d52/d65/d7f/la0 0 2024-09-17T07:19:54.997 INFO:tasks.workunit.client.1.smithi139.stdout:5/346: mkdir d4/d16/d69 0 2024-09-17T07:19:54.997 INFO:tasks.workunit.client.0.smithi087.stdout:0/688: symlink db/d45/d9e/lff 0 2024-09-17T07:19:54.998 INFO:tasks.workunit.client.1.smithi139.stdout:5/347: chown d4/l21 1 1 2024-09-17T07:19:54.999 INFO:tasks.workunit.client.0.smithi087.stdout:0/689: write db/d45/d9e/d95/fee [790559,253] 0 2024-09-17T07:19:54.999 INFO:tasks.workunit.client.1.smithi139.stdout:9/706: dread fb [0,4194304] 0 2024-09-17T07:19:55.000 INFO:tasks.workunit.client.0.smithi087.stdout:9/414: rmdir d3/d4/d16/d69 39 2024-09-17T07:19:55.001 INFO:tasks.workunit.client.1.smithi139.stdout:1/245: sync 2024-09-17T07:19:55.002 INFO:tasks.workunit.client.1.smithi139.stdout:5/348: creat d4/d16/d1b/d20/d67/f6a x:0 0 0 2024-09-17T07:19:55.002 INFO:tasks.workunit.client.0.smithi087.stdout:0/690: creat db/d45/d9e/f100 x:0 0 0 2024-09-17T07:19:55.005 INFO:tasks.workunit.client.1.smithi139.stdout:1/246: mkdir d2/d10/d12/d35/d49 0 2024-09-17T07:19:55.006 INFO:tasks.workunit.client.0.smithi087.stdout:9/415: truncate d3/d4/f87 1034528 0 2024-09-17T07:19:55.006 INFO:tasks.workunit.client.0.smithi087.stdout:8/489: dwrite d1/d2b/d21/d6d/d6f/f93 [0,4194304] 0 2024-09-17T07:19:55.007 INFO:tasks.workunit.client.1.smithi139.stdout:1/247: fdatasync d2/d10/d12/d35/d2b/f34 0 2024-09-17T07:19:55.008 INFO:tasks.workunit.client.1.smithi139.stdout:5/349: getdents d4/d5d 0 2024-09-17T07:19:55.008 INFO:tasks.workunit.client.1.smithi139.stdout:9/707: dwrite dc/d11/d15/d3c/f95 [4194304,4194304] 0 2024-09-17T07:19:55.009 INFO:tasks.workunit.client.1.smithi139.stdout:5/350: chown d4/c2e 298409 1 2024-09-17T07:19:55.011 INFO:tasks.workunit.client.1.smithi139.stdout:5/351: fsync d4/d16/d1b/d20/d38/f68 0 2024-09-17T07:19:55.012 INFO:tasks.workunit.client.1.smithi139.stdout:9/708: fsync dc/d11/f12 0 2024-09-17T07:19:55.012 INFO:tasks.workunit.client.0.smithi087.stdout:9/416: symlink d3/d4/d6/d8/d22/l99 0 2024-09-17T07:19:55.013 INFO:tasks.workunit.client.1.smithi139.stdout:1/248: mkdir d2/d10/d12/d35/d2b/d4a 0 2024-09-17T07:19:55.015 INFO:tasks.workunit.client.1.smithi139.stdout:9/709: write dc/d11/d15/fca [597389,104499] 0 2024-09-17T07:19:55.016 INFO:tasks.workunit.client.1.smithi139.stdout:5/352: symlink d4/d16/d1b/d20/d32/d3d/l6b 0 2024-09-17T07:19:55.017 INFO:tasks.workunit.client.0.smithi087.stdout:0/691: fsync db/d45/d9e/d95/fee 0 2024-09-17T07:19:55.017 INFO:tasks.workunit.client.1.smithi139.stdout:5/353: readlink d4/d16/d1b/d20/l27 0 2024-09-17T07:19:55.018 INFO:tasks.workunit.client.0.smithi087.stdout:0/692: chown db/d45/d9e/d86/f98 101003 1 2024-09-17T07:19:55.019 INFO:tasks.workunit.client.1.smithi139.stdout:5/354: stat d4/d16/d1b/l63 0 2024-09-17T07:19:55.020 INFO:tasks.workunit.client.0.smithi087.stdout:9/417: dread d3/f1f [0,4194304] 0 2024-09-17T07:19:55.023 INFO:tasks.workunit.client.0.smithi087.stdout:0/693: dread db/d45/ffb [0,4194304] 0 2024-09-17T07:19:55.024 INFO:tasks.workunit.client.0.smithi087.stdout:9/418: read d3/f28 [3756251,96030] 0 2024-09-17T07:19:55.026 INFO:tasks.workunit.client.0.smithi087.stdout:0/694: creat db/d45/d5d/f101 x:0 0 0 2024-09-17T07:19:55.026 INFO:tasks.workunit.client.0.smithi087.stdout:0/695: chown db/f1e 210 1 2024-09-17T07:19:55.027 INFO:tasks.workunit.client.0.smithi087.stdout:9/419: rmdir d3/d4/d16 39 2024-09-17T07:19:55.028 INFO:tasks.workunit.client.0.smithi087.stdout:0/696: creat db/d45/d9e/f102 x:0 0 0 2024-09-17T07:19:55.028 INFO:tasks.workunit.client.0.smithi087.stdout:9/420: creat d3/d25/f9a x:0 0 0 2024-09-17T07:19:55.029 INFO:tasks.workunit.client.0.smithi087.stdout:0/697: dread - db/d45/d9e/f64 zero size 2024-09-17T07:19:55.031 INFO:tasks.workunit.client.0.smithi087.stdout:0/698: creat db/d45/d5b/d92/f103 x:0 0 0 2024-09-17T07:19:55.033 INFO:tasks.workunit.client.0.smithi087.stdout:9/421: unlink d3/d4/da/c6f 0 2024-09-17T07:19:55.035 INFO:tasks.workunit.client.0.smithi087.stdout:9/422: creat d3/d4/d6/d71/f9b x:0 0 0 2024-09-17T07:19:55.037 INFO:tasks.workunit.client.0.smithi087.stdout:0/699: dwrite db/f79 [0,4194304] 0 2024-09-17T07:19:55.038 INFO:tasks.workunit.client.0.smithi087.stdout:9/423: chown d3/d4/d6/d8/d12/d32/c62 240813 1 2024-09-17T07:19:55.038 INFO:tasks.workunit.client.0.smithi087.stdout:8/490: fdatasync d1/d2b/d21/d6d/d6f/f93 0 2024-09-17T07:19:55.044 INFO:tasks.workunit.client.0.smithi087.stdout:9/424: dread d3/d4/d2f/f3c [0,4194304] 0 2024-09-17T07:19:55.044 INFO:tasks.workunit.client.0.smithi087.stdout:8/491: creat d1/d7/d9/d19/fac x:0 0 0 2024-09-17T07:19:55.045 INFO:tasks.workunit.client.0.smithi087.stdout:9/425: chown d3/d4/da/d4b 13630444 1 2024-09-17T07:19:55.047 INFO:tasks.workunit.client.0.smithi087.stdout:8/492: getdents d1/d2b/d3b/d53/da8 0 2024-09-17T07:19:55.052 INFO:tasks.workunit.client.0.smithi087.stdout:0/700: dwrite db/d45/d9e/f64 [0,4194304] 0 2024-09-17T07:19:55.053 INFO:tasks.workunit.client.0.smithi087.stdout:8/493: getdents d1/d2b/d21 0 2024-09-17T07:19:55.053 INFO:tasks.workunit.client.0.smithi087.stdout:9/426: getdents d3/d4/d16/d69/d8a/d1e/d90 0 2024-09-17T07:19:55.055 INFO:tasks.workunit.client.0.smithi087.stdout:0/701: mkdir db/d45/d9e/d86/d104 0 2024-09-17T07:19:55.055 INFO:tasks.workunit.client.0.smithi087.stdout:9/427: dread - d3/d4/d6/d8/d12/d32/f8f zero size 2024-09-17T07:19:55.056 INFO:tasks.workunit.client.0.smithi087.stdout:8/494: symlink d1/d5f/d71/lad 0 2024-09-17T07:19:55.058 INFO:tasks.workunit.client.0.smithi087.stdout:8/495: write d1/d7/d9/d19/d1b/f1c [2656343,34709] 0 2024-09-17T07:19:55.058 INFO:tasks.workunit.client.0.smithi087.stdout:9/428: mknod d3/d25/d83/c9c 0 2024-09-17T07:19:55.059 INFO:tasks.workunit.client.0.smithi087.stdout:9/429: write d3/d4/d6/d8/d12/f60 [427308,67897] 0 2024-09-17T07:19:55.061 INFO:tasks.workunit.client.0.smithi087.stdout:0/702: write db/d45/d5b/fec [155707,37364] 0 2024-09-17T07:19:55.062 INFO:tasks.workunit.client.0.smithi087.stdout:9/430: fdatasync d3/f1f 0 2024-09-17T07:19:55.063 INFO:tasks.workunit.client.0.smithi087.stdout:8/496: rmdir d1/d2b/d3b/d53/da8 0 2024-09-17T07:19:55.065 INFO:tasks.workunit.client.0.smithi087.stdout:0/703: write db/d45/d5b/f89 [3303613,86978] 0 2024-09-17T07:19:55.066 INFO:tasks.workunit.client.0.smithi087.stdout:9/431: creat d3/d4/d16/d69/d8a/d1e/d90/d93/f9d x:0 0 0 2024-09-17T07:19:55.067 INFO:tasks.workunit.client.0.smithi087.stdout:8/497: creat d1/d7/d9/d19/fae x:0 0 0 2024-09-17T07:19:55.068 INFO:tasks.workunit.client.0.smithi087.stdout:0/704: mknod db/d45/d7b/d90/c105 0 2024-09-17T07:19:55.069 INFO:tasks.workunit.client.0.smithi087.stdout:8/498: mkdir d1/d2b/d21/daf 0 2024-09-17T07:19:55.070 INFO:tasks.workunit.client.0.smithi087.stdout:0/705: creat db/d45/d9e/d95/dd8/f106 x:0 0 0 2024-09-17T07:19:55.075 INFO:tasks.workunit.client.0.smithi087.stdout:9/432: dwrite d3/d4/f8d [0,4194304] 0 2024-09-17T07:19:55.079 INFO:tasks.workunit.client.0.smithi087.stdout:9/433: dread d3/d4/da/f49 [0,4194304] 0 2024-09-17T07:19:55.079 INFO:tasks.workunit.client.0.smithi087.stdout:0/706: rmdir db 39 2024-09-17T07:19:55.082 INFO:tasks.workunit.client.0.smithi087.stdout:9/434: creat d3/d4/d6/d8/d12/d32/f9e x:0 0 0 2024-09-17T07:19:55.083 INFO:tasks.workunit.client.1.smithi139.stdout:9/710: creat dc/d11/dbe/fee x:0 0 0 2024-09-17T07:19:55.083 INFO:tasks.workunit.client.0.smithi087.stdout:8/499: dread d1/d2b/f29 [0,4194304] 0 2024-09-17T07:19:55.083 INFO:tasks.workunit.client.0.smithi087.stdout:0/707: dread db/d45/d7b/f9d [0,4194304] 0 2024-09-17T07:19:55.084 INFO:tasks.workunit.client.0.smithi087.stdout:0/708: chown db/l3b 6120126 1 2024-09-17T07:19:55.085 INFO:tasks.workunit.client.0.smithi087.stdout:9/435: creat d3/d4/d16/d69/f9f x:0 0 0 2024-09-17T07:19:55.085 INFO:tasks.workunit.client.0.smithi087.stdout:8/500: symlink d1/d7/d9/d19/d1b/d18/lb0 0 2024-09-17T07:19:55.088 INFO:tasks.workunit.client.0.smithi087.stdout:9/436: symlink d3/d4/d6/la0 0 2024-09-17T07:19:55.090 INFO:tasks.workunit.client.0.smithi087.stdout:9/437: truncate d3/d4/d16/d69/d8a/d1e/d90/d93/f9d 619893 0 2024-09-17T07:19:55.091 INFO:tasks.workunit.client.1.smithi139.stdout:9/711: dwrite dc/d11/d15/d3c/f86 [0,4194304] 0 2024-09-17T07:19:55.093 INFO:tasks.workunit.client.1.smithi139.stdout:8/488: dwrite d0/d1a/d3a/f8a [0,4194304] 0 2024-09-17T07:19:55.096 INFO:tasks.workunit.client.1.smithi139.stdout:1/249: dwrite d2/d10/d12/d35/f44 [0,4194304] 0 2024-09-17T07:19:55.099 INFO:tasks.workunit.client.0.smithi087.stdout:0/709: write db/d45/d5b/d92/fc7 [2633144,77639] 0 2024-09-17T07:19:55.099 INFO:tasks.workunit.client.1.smithi139.stdout:9/712: mknod dc/d11/d15/d3c/d61/d64/d96/cef 0 2024-09-17T07:19:55.100 INFO:tasks.workunit.client.0.smithi087.stdout:8/501: truncate d1/d7/f2d 2087708 0 2024-09-17T07:19:55.100 INFO:tasks.workunit.client.1.smithi139.stdout:9/713: fsync dc/d11/d52/d56/fbf 0 2024-09-17T07:19:55.101 INFO:tasks.workunit.client.1.smithi139.stdout:1/250: mknod d2/d10/d12/d35/c4b 0 2024-09-17T07:19:55.103 INFO:tasks.workunit.client.0.smithi087.stdout:8/502: mknod d1/d2b/d3b/cb1 0 2024-09-17T07:19:55.104 INFO:tasks.workunit.client.0.smithi087.stdout:0/710: truncate db/f13 3495251 0 2024-09-17T07:19:55.105 INFO:tasks.workunit.client.0.smithi087.stdout:0/711: rename db/d45/d7b/d90 to db/d45/d7b/d90/d107 22 2024-09-17T07:19:55.105 INFO:tasks.workunit.client.1.smithi139.stdout:8/489: getdents d0/dc 0 2024-09-17T07:19:55.106 INFO:tasks.workunit.client.1.smithi139.stdout:9/714: write dc/d11/d15/d1e/f21 [3783366,64010] 0 2024-09-17T07:19:55.106 INFO:tasks.workunit.client.1.smithi139.stdout:8/490: dread - d0/d1a/d3a/d71/f75 zero size 2024-09-17T07:19:55.108 INFO:tasks.workunit.client.0.smithi087.stdout:0/712: stat db/d45/d5d/f76 0 2024-09-17T07:19:55.108 INFO:tasks.workunit.client.1.smithi139.stdout:9/715: symlink dc/lf0 0 2024-09-17T07:19:55.110 INFO:tasks.workunit.client.1.smithi139.stdout:9/716: chown dc/d11/d52/d56/d7a/da1 299 1 2024-09-17T07:19:55.110 INFO:tasks.workunit.client.0.smithi087.stdout:8/503: dwrite d1/d5f/f5d [0,4194304] 0 2024-09-17T07:19:55.111 INFO:tasks.workunit.client.1.smithi139.stdout:8/491: getdents d0/d1a/d4d/d53 0 2024-09-17T07:19:55.113 INFO:tasks.workunit.client.0.smithi087.stdout:0/713: link db/d45/c71 db/d45/d7b/db0/c108 0 2024-09-17T07:19:55.113 INFO:tasks.workunit.client.1.smithi139.stdout:9/717: unlink dc/d11/f4d 0 2024-09-17T07:19:55.114 INFO:tasks.workunit.client.0.smithi087.stdout:8/504: mkdir d1/d7/d9/d27/da1/db2 0 2024-09-17T07:19:55.114 INFO:tasks.workunit.client.1.smithi139.stdout:9/718: dread dc/d2a/f8a [0,4194304] 0 2024-09-17T07:19:55.115 INFO:tasks.workunit.client.1.smithi139.stdout:8/492: unlink d0/dc/d18/l7e 0 2024-09-17T07:19:55.115 INFO:tasks.workunit.client.0.smithi087.stdout:9/438: dread d3/d4/d16/d69/d8a/f21 [0,4194304] 0 2024-09-17T07:19:55.116 INFO:tasks.workunit.client.0.smithi087.stdout:8/505: write d1/d2b/f41 [2260979,70965] 0 2024-09-17T07:19:55.116 INFO:tasks.workunit.client.0.smithi087.stdout:0/714: mknod db/d45/d9e/d86/c109 0 2024-09-17T07:19:55.119 INFO:tasks.workunit.client.0.smithi087.stdout:0/715: truncate db/d45/d5d/fc1 332512 0 2024-09-17T07:19:55.119 INFO:tasks.workunit.client.0.smithi087.stdout:9/439: fsync d3/d4/d6/d8/d22/f50 0 2024-09-17T07:19:55.119 INFO:tasks.workunit.client.0.smithi087.stdout:8/506: chown d1/d7/d9/d19/d1b/d18/c26 3522 1 2024-09-17T07:19:55.120 INFO:tasks.workunit.client.0.smithi087.stdout:9/440: write d3/d4/d6/d8/d22/d43/f77 [3270575,14711] 0 2024-09-17T07:19:55.121 INFO:tasks.workunit.client.1.smithi139.stdout:8/493: rename d0/d20/d28/d48/c69 to d0/d20/d28/d48/ca1 0 2024-09-17T07:19:55.121 INFO:tasks.workunit.client.0.smithi087.stdout:0/716: mkdir db/d45/d7b/d90/dd9/de6/d10a 0 2024-09-17T07:19:55.122 INFO:tasks.workunit.client.0.smithi087.stdout:8/507: creat d1/d2b/d21/fb3 x:0 0 0 2024-09-17T07:19:55.122 INFO:tasks.workunit.client.0.smithi087.stdout:9/441: chown d3/d4/d6/d8/d12/d32/c62 1004270191 1 2024-09-17T07:19:55.123 INFO:tasks.workunit.client.1.smithi139.stdout:9/719: dwrite dc/d2a/f87 [0,4194304] 0 2024-09-17T07:19:55.124 INFO:tasks.workunit.client.0.smithi087.stdout:0/717: creat db/d45/d7b/db0/dd0/f10b x:0 0 0 2024-09-17T07:19:55.125 INFO:tasks.workunit.client.0.smithi087.stdout:9/442: mkdir d3/d4/d6/d8/d12/d32/da1 0 2024-09-17T07:19:55.126 INFO:tasks.workunit.client.1.smithi139.stdout:9/720: truncate dc/d11/dbe/fee 752203 0 2024-09-17T07:19:55.128 INFO:tasks.workunit.client.0.smithi087.stdout:0/718: rename db/d45/lb7 to db/d45/d5b/d92/l10c 0 2024-09-17T07:19:55.129 INFO:tasks.workunit.client.0.smithi087.stdout:8/508: getdents d1/d2b/d21/d6d/d6f 0 2024-09-17T07:19:55.132 INFO:tasks.workunit.client.0.smithi087.stdout:0/719: creat db/d45/d9e/d95/f10d x:0 0 0 2024-09-17T07:19:55.134 INFO:tasks.workunit.client.0.smithi087.stdout:8/509: rename d1/d7/d9/d19/f4b to d1/d2b/d21/d6d/d6f/fb4 0 2024-09-17T07:19:55.135 INFO:tasks.workunit.client.1.smithi139.stdout:8/494: write d0/dc/d18/f1f [2366072,4694] 0 2024-09-17T07:19:55.137 INFO:tasks.workunit.client.1.smithi139.stdout:8/495: write d0/d20/f5f [448945,85121] 0 2024-09-17T07:19:55.138 INFO:tasks.workunit.client.1.smithi139.stdout:8/496: readlink d0/dc/l2d 0 2024-09-17T07:19:55.139 INFO:tasks.workunit.client.1.smithi139.stdout:8/497: truncate d0/d20/d28/f9d 463342 0 2024-09-17T07:19:55.140 INFO:tasks.workunit.client.0.smithi087.stdout:0/720: dwrite db/d45/d9e/f64 [0,4194304] 0 2024-09-17T07:19:55.142 INFO:tasks.workunit.client.1.smithi139.stdout:1/251: dread d2/d10/d12/f29 [0,4194304] 0 2024-09-17T07:19:55.143 INFO:tasks.workunit.client.0.smithi087.stdout:0/721: unlink db/d45/d7b/fc5 0 2024-09-17T07:19:55.144 INFO:tasks.workunit.client.0.smithi087.stdout:0/722: chown db/dbe 5490616 1 2024-09-17T07:19:55.144 INFO:tasks.workunit.client.1.smithi139.stdout:9/721: fdatasync dc/d2a/f87 0 2024-09-17T07:19:55.145 INFO:tasks.workunit.client.0.smithi087.stdout:0/723: chown db/f3e 56 1 2024-09-17T07:19:55.146 INFO:tasks.workunit.client.1.smithi139.stdout:1/252: symlink d2/d10/d12/l4c 0 2024-09-17T07:19:55.147 INFO:tasks.workunit.client.1.smithi139.stdout:9/722: chown dc/d11/d52/d56/d7a/da1/le3 714 1 2024-09-17T07:19:55.148 INFO:tasks.workunit.client.0.smithi087.stdout:0/724: truncate db/f18 5216399 0 2024-09-17T07:19:55.149 INFO:tasks.workunit.client.1.smithi139.stdout:1/253: write d2/d10/d12/d35/d2b/f2c [1743046,19707] 0 2024-09-17T07:19:55.150 INFO:tasks.workunit.client.0.smithi087.stdout:3/464: sync 2024-09-17T07:19:55.150 INFO:tasks.workunit.client.0.smithi087.stdout:1/415: sync 2024-09-17T07:19:55.150 INFO:tasks.workunit.client.0.smithi087.stdout:6/593: sync 2024-09-17T07:19:55.150 INFO:tasks.workunit.client.0.smithi087.stdout:4/415: sync 2024-09-17T07:19:55.150 INFO:tasks.workunit.client.0.smithi087.stdout:5/641: sync 2024-09-17T07:19:55.150 INFO:tasks.workunit.client.0.smithi087.stdout:7/404: sync 2024-09-17T07:19:55.150 INFO:tasks.workunit.client.0.smithi087.stdout:2/486: sync 2024-09-17T07:19:55.153 INFO:tasks.workunit.client.0.smithi087.stdout:0/725: creat db/d45/d7b/d90/dd9/f10e x:0 0 0 2024-09-17T07:19:55.154 INFO:tasks.workunit.client.0.smithi087.stdout:9/443: dwrite d3/d4/da/f49 [0,4194304] 0 2024-09-17T07:19:55.157 INFO:tasks.workunit.client.0.smithi087.stdout:3/465: write d6/d16/f69 [276453,123977] 0 2024-09-17T07:19:55.157 INFO:tasks.workunit.client.0.smithi087.stdout:2/487: mknod d2/d12/d85/c9a 0 2024-09-17T07:19:55.157 INFO:tasks.workunit.client.0.smithi087.stdout:1/416: write d2/d1a/f29 [1192303,3971] 0 2024-09-17T07:19:55.158 INFO:tasks.workunit.client.0.smithi087.stdout:6/594: mknod d1/d6/d1a/d4e/ccc 0 2024-09-17T07:19:55.159 INFO:tasks.workunit.client.1.smithi139.stdout:9/723: write dc/d11/d15/f18 [4775661,50998] 0 2024-09-17T07:19:55.159 INFO:tasks.workunit.client.0.smithi087.stdout:7/405: write d0/d3/d10/f20 [1069690,6557] 0 2024-09-17T07:19:55.162 INFO:tasks.workunit.client.0.smithi087.stdout:5/642: fsync d5/d18/d20/d2f/f5c 0 2024-09-17T07:19:55.163 INFO:tasks.workunit.client.1.smithi139.stdout:8/498: dread d0/d20/d28/f3d [4194304,4194304] 0 2024-09-17T07:19:55.165 INFO:tasks.workunit.client.0.smithi087.stdout:7/406: creat d0/d3/d10/d32/d62/d76/f84 x:0 0 0 2024-09-17T07:19:55.167 INFO:tasks.workunit.client.0.smithi087.stdout:5/643: mknod d5/d12/d14/cd2 0 2024-09-17T07:19:55.168 INFO:tasks.workunit.client.1.smithi139.stdout:8/499: getdents d0/d1a/d3a/d8d 0 2024-09-17T07:19:55.169 INFO:tasks.workunit.client.0.smithi087.stdout:6/595: creat d1/d6/d1a/d2c/d48/d9b/fcd x:0 0 0 2024-09-17T07:19:55.170 INFO:tasks.workunit.client.1.smithi139.stdout:8/500: dread d0/dc/f6a [0,4194304] 0 2024-09-17T07:19:55.171 INFO:tasks.workunit.client.1.smithi139.stdout:1/254: dread d2/d10/d12/d35/d2b/f2c [0,4194304] 0 2024-09-17T07:19:55.171 INFO:tasks.workunit.client.0.smithi087.stdout:3/466: rename d6/d16/f69 to d6/d1b/f9d 0 2024-09-17T07:19:55.172 INFO:tasks.workunit.client.1.smithi139.stdout:1/255: chown d2/d10/d12/d35/d2b 16490502 1 2024-09-17T07:19:55.173 INFO:tasks.workunit.client.1.smithi139.stdout:8/501: mkdir d0/d20/da2 0 2024-09-17T07:19:55.175 INFO:tasks.workunit.client.1.smithi139.stdout:8/502: rmdir d0/d1a/d4d/d53 39 2024-09-17T07:19:55.176 INFO:tasks.workunit.client.0.smithi087.stdout:2/488: creat d2/d15/f9b x:0 0 0 2024-09-17T07:19:55.177 INFO:tasks.workunit.client.0.smithi087.stdout:5/644: dwrite d5/d18/d20/f35 [0,4194304] 0 2024-09-17T07:19:55.178 INFO:tasks.workunit.client.0.smithi087.stdout:4/416: dread d2/d5/d1f/f68 [0,4194304] 0 2024-09-17T07:19:55.179 INFO:tasks.workunit.client.0.smithi087.stdout:4/417: fdatasync d2/f32 0 2024-09-17T07:19:55.179 INFO:tasks.workunit.client.0.smithi087.stdout:3/467: symlink d6/d16/l9e 0 2024-09-17T07:19:55.180 INFO:tasks.workunit.client.1.smithi139.stdout:9/724: dread dc/d11/d15/d1e/d34/fbc [0,4194304] 0 2024-09-17T07:19:55.180 INFO:tasks.workunit.client.0.smithi087.stdout:9/444: link d3/d25/c36 d3/d4/d6/d8/d22/d92/ca2 0 2024-09-17T07:19:55.181 INFO:tasks.workunit.client.0.smithi087.stdout:7/407: symlink d0/d3/d23/d17/l85 0 2024-09-17T07:19:55.181 INFO:tasks.workunit.client.0.smithi087.stdout:4/418: chown d2/d92/d4d/c14 81882335 1 2024-09-17T07:19:55.182 INFO:tasks.workunit.client.1.smithi139.stdout:9/725: readlink dc/d11/d15/d1e/l37 0 2024-09-17T07:19:55.182 INFO:tasks.workunit.client.0.smithi087.stdout:2/489: symlink d2/d7/l9c 0 2024-09-17T07:19:55.185 INFO:tasks.workunit.client.1.smithi139.stdout:8/503: dwrite d0/d1a/f77 [0,4194304] 0 2024-09-17T07:19:55.186 INFO:tasks.workunit.client.0.smithi087.stdout:9/445: dread d3/d4/f8d [0,4194304] 0 2024-09-17T07:19:55.188 INFO:tasks.workunit.client.0.smithi087.stdout:9/446: dread - d3/d4/f98 zero size 2024-09-17T07:19:55.188 INFO:tasks.workunit.client.0.smithi087.stdout:1/417: write d2/d3d/d45/d90/f47 [839291,20284] 0 2024-09-17T07:19:55.190 INFO:tasks.workunit.client.0.smithi087.stdout:8/510: dread d1/d7/f2d [0,4194304] 0 2024-09-17T07:19:55.192 INFO:tasks.workunit.client.0.smithi087.stdout:7/408: write d0/d3/d23/d2d/f79 [163227,10691] 0 2024-09-17T07:19:55.193 INFO:tasks.workunit.client.1.smithi139.stdout:9/726: rmdir dc/d11/d15/d3c/d61/dc8/dda 0 2024-09-17T07:19:55.193 INFO:tasks.workunit.client.1.smithi139.stdout:8/504: dread d0/d20/d28/d52/f63 [0,4194304] 0 2024-09-17T07:19:55.195 INFO:tasks.workunit.client.1.smithi139.stdout:8/505: stat d0/f7d 0 2024-09-17T07:19:55.196 INFO:tasks.workunit.client.0.smithi087.stdout:6/596: rename d1/d6a/da3 to d1/d6/d1a/d2c/d40/d4c/dce 0 2024-09-17T07:19:55.200 INFO:tasks.workunit.client.1.smithi139.stdout:8/506: dread d0/d20/f8f [0,4194304] 0 2024-09-17T07:19:55.200 INFO:tasks.workunit.client.0.smithi087.stdout:2/490: link d2/d15/l2e d2/d12/d85/l9d 0 2024-09-17T07:19:55.202 INFO:tasks.workunit.client.0.smithi087.stdout:7/409: readlink d0/d3/d23/d4e/l64 0 2024-09-17T07:19:55.202 INFO:tasks.workunit.client.1.smithi139.stdout:8/507: write d0/d20/d28/d48/f9f [689195,45208] 0 2024-09-17T07:19:55.202 INFO:tasks.workunit.client.0.smithi087.stdout:1/418: link d2/d3d/d45/d90/f18 d2/d3d/d45/d90/d43/f93 0 2024-09-17T07:19:55.208 INFO:tasks.workunit.client.0.smithi087.stdout:3/468: dread d6/f57 [0,4194304] 0 2024-09-17T07:19:55.209 INFO:tasks.workunit.client.0.smithi087.stdout:5/645: dwrite d5/d12/d14/d61/f75 [4194304,4194304] 0 2024-09-17T07:19:55.209 INFO:tasks.workunit.client.0.smithi087.stdout:7/410: mkdir d0/d3/d86 0 2024-09-17T07:19:55.210 INFO:tasks.workunit.client.0.smithi087.stdout:9/447: dwrite d3/d4/d16/d69/d8a/f51 [0,4194304] 0 2024-09-17T07:19:55.212 INFO:tasks.workunit.client.0.smithi087.stdout:3/469: chown d6/d16/f68 0 1 2024-09-17T07:19:55.213 INFO:tasks.workunit.client.1.smithi139.stdout:8/508: truncate d0/d1a/d3a/f8a 2962089 0 2024-09-17T07:19:55.213 INFO:tasks.workunit.client.0.smithi087.stdout:0/726: dread db/d45/d5b/d92/fc7 [0,4194304] 0 2024-09-17T07:19:55.214 INFO:tasks.workunit.client.0.smithi087.stdout:5/646: write d5/d12/d1c/fae [4694838,117750] 0 2024-09-17T07:19:55.214 INFO:tasks.workunit.client.1.smithi139.stdout:1/256: dread d2/f11 [0,4194304] 0 2024-09-17T07:19:55.216 INFO:tasks.workunit.client.0.smithi087.stdout:8/511: write d1/d2b/d21/f35 [2857568,130130] 0 2024-09-17T07:19:55.220 INFO:tasks.workunit.client.0.smithi087.stdout:1/419: getdents d2/d48 0 2024-09-17T07:19:55.221 INFO:tasks.workunit.client.0.smithi087.stdout:9/448: mkdir d3/d4/d6/d8/d22/d92/da3 0 2024-09-17T07:19:55.221 INFO:tasks.workunit.client.0.smithi087.stdout:0/727: read db/f1b [1701172,77376] 0 2024-09-17T07:19:55.222 INFO:tasks.workunit.client.0.smithi087.stdout:7/411: chown d0/d3/d23/d2d/c77 0 1 2024-09-17T07:19:55.225 INFO:tasks.workunit.client.1.smithi139.stdout:8/509: dwrite d0/dc/f34 [0,4194304] 0 2024-09-17T07:19:55.225 INFO:tasks.workunit.client.1.smithi139.stdout:1/257: rename d2/d10/d12/d13/f17 to d2/d10/d12/d24/d38/d3d/f4d 0 2024-09-17T07:19:55.226 INFO:tasks.workunit.client.0.smithi087.stdout:8/512: creat d1/d2b/d21/d6d/d6f/fb5 x:0 0 0 2024-09-17T07:19:55.226 INFO:tasks.workunit.client.0.smithi087.stdout:4/419: dwrite d2/d92/f65 [0,4194304] 0 2024-09-17T07:19:55.227 INFO:tasks.workunit.client.0.smithi087.stdout:1/420: chown d2/d3d/d45/d90/d37/f38 271741 1 2024-09-17T07:19:55.228 INFO:tasks.workunit.client.0.smithi087.stdout:0/728: chown db/d45/d7b/db0/fdb 3689 1 2024-09-17T07:19:55.230 INFO:tasks.workunit.client.1.smithi139.stdout:8/510: mknod d0/d20/d28/ca3 0 2024-09-17T07:19:55.230 INFO:tasks.workunit.client.0.smithi087.stdout:7/412: fsync d0/f28 0 2024-09-17T07:19:55.231 INFO:tasks.workunit.client.0.smithi087.stdout:8/513: read - d1/d2b/f6c zero size 2024-09-17T07:19:55.232 INFO:tasks.workunit.client.0.smithi087.stdout:5/647: rmdir d5/d8/d1f/dc8 0 2024-09-17T07:19:55.234 INFO:tasks.workunit.client.1.smithi139.stdout:1/258: truncate d2/d10/d12/d1a/f21 852518 0 2024-09-17T07:19:55.234 INFO:tasks.workunit.client.1.smithi139.stdout:9/727: dread dc/d11/d15/d3c/d61/fc0 [0,4194304] 0 2024-09-17T07:19:55.236 INFO:tasks.workunit.client.0.smithi087.stdout:6/597: dwrite d1/d6/d1a/d2c/d48/f6f [0,4194304] 0 2024-09-17T07:19:55.237 INFO:tasks.workunit.client.0.smithi087.stdout:0/729: creat db/d45/d7b/db0/f10f x:0 0 0 2024-09-17T07:19:55.237 INFO:tasks.workunit.client.0.smithi087.stdout:7/413: mkdir d0/d3/d10/d87 0 2024-09-17T07:19:55.238 INFO:tasks.workunit.client.1.smithi139.stdout:1/259: creat d2/d10/d12/d24/f4e x:0 0 0 2024-09-17T07:19:55.239 INFO:tasks.workunit.client.0.smithi087.stdout:9/449: mkdir d3/d4/d6/d8/d22/d92/da3/da4 0 2024-09-17T07:19:55.239 INFO:tasks.workunit.client.1.smithi139.stdout:8/511: dwrite d0/d1a/d3a/f42 [0,4194304] 0 2024-09-17T07:19:55.241 INFO:tasks.workunit.client.0.smithi087.stdout:5/648: fsync d5/d18/d20/d2f/d52/f72 0 2024-09-17T07:19:55.243 INFO:tasks.workunit.client.1.smithi139.stdout:9/728: mknod dc/d11/d15/d3c/d61/dc8/d83/d98/dcf/cf1 0 2024-09-17T07:19:55.244 INFO:tasks.workunit.client.0.smithi087.stdout:7/414: unlink d0/f2e 0 2024-09-17T07:19:55.245 INFO:tasks.workunit.client.1.smithi139.stdout:9/729: fsync dc/d11/d15/f28 0 2024-09-17T07:19:55.248 INFO:tasks.workunit.client.1.smithi139.stdout:8/512: mkdir d0/d1a/d4d/da4 0 2024-09-17T07:19:55.249 INFO:tasks.workunit.client.1.smithi139.stdout:4/356: sync 2024-09-17T07:19:55.250 INFO:tasks.workunit.client.1.smithi139.stdout:8/513: write d0/f7d [20668,125827] 0 2024-09-17T07:19:55.251 INFO:tasks.workunit.client.0.smithi087.stdout:0/730: stat db/d4f/ce7 0 2024-09-17T07:19:55.251 INFO:tasks.workunit.client.1.smithi139.stdout:4/357: dread - d0/d1/d29/d41/f67 zero size 2024-09-17T07:19:55.252 INFO:tasks.workunit.client.0.smithi087.stdout:5/649: rmdir d5/d18/d20/d2f/d83/dac 39 2024-09-17T07:19:55.254 INFO:tasks.workunit.client.0.smithi087.stdout:8/514: dwrite d1/d7/d9/d19/d1b/f43 [0,4194304] 0 2024-09-17T07:19:55.254 INFO:tasks.workunit.client.1.smithi139.stdout:9/730: dread dc/d11/d15/f17 [0,4194304] 0 2024-09-17T07:19:55.254 INFO:tasks.workunit.client.0.smithi087.stdout:3/470: dread d6/d15/d4b/f8b [0,4194304] 0 2024-09-17T07:19:55.255 INFO:tasks.workunit.client.1.smithi139.stdout:9/731: stat dc/d11/d52/fa2 0 2024-09-17T07:19:55.256 INFO:tasks.workunit.client.1.smithi139.stdout:9/732: stat dc/d11/d15/d3c/d68/f90 0 2024-09-17T07:19:55.258 INFO:tasks.workunit.client.0.smithi087.stdout:1/421: dwrite d2/f2d [0,4194304] 0 2024-09-17T07:19:55.261 INFO:tasks.workunit.client.1.smithi139.stdout:8/514: dread d0/f2a [4194304,4194304] 0 2024-09-17T07:19:55.263 INFO:tasks.workunit.client.1.smithi139.stdout:4/358: mkdir d0/d1/d29/d6a 0 2024-09-17T07:19:55.264 INFO:tasks.workunit.client.1.smithi139.stdout:9/733: creat dc/d11/d15/d1e/d34/ff2 x:0 0 0 2024-09-17T07:19:55.265 INFO:tasks.workunit.client.1.smithi139.stdout:8/515: write d0/d1a/f39 [2005946,12111] 0 2024-09-17T07:19:55.265 INFO:tasks.workunit.client.0.smithi087.stdout:7/415: getdents d0/d3/d23 0 2024-09-17T07:19:55.266 INFO:tasks.workunit.client.1.smithi139.stdout:8/516: fdatasync d0/dc/f6b 0 2024-09-17T07:19:55.269 INFO:tasks.workunit.client.0.smithi087.stdout:0/731: truncate db/d45/d9e/d86/dd5/fe1 381992 0 2024-09-17T07:19:55.269 INFO:tasks.workunit.client.0.smithi087.stdout:6/598: dwrite d1/d67/f69 [0,4194304] 0 2024-09-17T07:19:55.270 INFO:tasks.workunit.client.1.smithi139.stdout:4/359: unlink d0/d1/d29/f50 0 2024-09-17T07:19:55.271 INFO:tasks.workunit.client.1.smithi139.stdout:4/360: chown d0/d1a/f1f 35 1 2024-09-17T07:19:55.271 INFO:tasks.workunit.client.0.smithi087.stdout:1/422: symlink d2/d48/d6f/l94 0 2024-09-17T07:19:55.272 INFO:tasks.workunit.client.0.smithi087.stdout:4/420: write d2/d92/f94 [445866,91316] 0 2024-09-17T07:19:55.272 INFO:tasks.workunit.client.1.smithi139.stdout:8/517: rmdir d0/d20/d28/d52/d65 39 2024-09-17T07:19:55.274 INFO:tasks.workunit.client.0.smithi087.stdout:3/471: link d6/d1b/d2b/f83 d6/d16/f9f 0 2024-09-17T07:19:55.276 INFO:tasks.workunit.client.1.smithi139.stdout:8/518: creat d0/d1a/d3a/d71/fa5 x:0 0 0 2024-09-17T07:19:55.277 INFO:tasks.workunit.client.1.smithi139.stdout:4/361: getdents d0/db/d58 0 2024-09-17T07:19:55.278 INFO:tasks.workunit.client.1.smithi139.stdout:9/734: dwrite dc/d11/d15/f17 [0,4194304] 0 2024-09-17T07:19:55.279 INFO:tasks.workunit.client.0.smithi087.stdout:7/416: dread d0/d3/d10/f38 [0,4194304] 0 2024-09-17T07:19:55.280 INFO:tasks.workunit.client.0.smithi087.stdout:1/423: unlink d2/d14/f5a 0 2024-09-17T07:19:55.280 INFO:tasks.workunit.client.1.smithi139.stdout:4/362: stat d0/f7 0 2024-09-17T07:19:55.280 INFO:tasks.workunit.client.0.smithi087.stdout:8/515: link d1/d7/d9/d19/f9d d1/d7/d9/d19/fb6 0 2024-09-17T07:19:55.284 INFO:tasks.workunit.client.0.smithi087.stdout:4/421: dwrite d2/d5/f26 [0,4194304] 0 2024-09-17T07:19:55.285 INFO:tasks.workunit.client.1.smithi139.stdout:4/363: write d0/db/f33 [1033175,90500] 0 2024-09-17T07:19:55.285 INFO:tasks.workunit.client.0.smithi087.stdout:3/472: mkdir d6/d15/da0 0 2024-09-17T07:19:55.286 INFO:tasks.workunit.client.0.smithi087.stdout:3/473: chown d6/d16/f68 960 1 2024-09-17T07:19:55.286 INFO:tasks.workunit.client.0.smithi087.stdout:6/599: symlink d1/d6/d1a/d2c/d40/d4c/da1/lcf 0 2024-09-17T07:19:55.288 INFO:tasks.workunit.client.0.smithi087.stdout:0/732: link db/d45/d5b/d92/l93 db/dbe/l110 0 2024-09-17T07:19:55.289 INFO:tasks.workunit.client.1.smithi139.stdout:4/364: mknod d0/d37/c6b 0 2024-09-17T07:19:55.291 INFO:tasks.workunit.client.0.smithi087.stdout:1/424: mknod d2/d69/d8d/c95 0 2024-09-17T07:19:55.291 INFO:tasks.workunit.client.1.smithi139.stdout:4/365: chown d0/f30 130501987 1 2024-09-17T07:19:55.292 INFO:tasks.workunit.client.0.smithi087.stdout:4/422: rename d2/d22/d2c/c30 to d2/d92/d4d/d2d/c98 0 2024-09-17T07:19:55.293 INFO:tasks.workunit.client.0.smithi087.stdout:2/491: dread d2/f3 [0,4194304] 0 2024-09-17T07:19:55.293 INFO:tasks.workunit.client.0.smithi087.stdout:8/516: symlink d1/d2b/d21/d68/lb7 0 2024-09-17T07:19:55.294 INFO:tasks.workunit.client.0.smithi087.stdout:9/450: write d3/d4/d6/d8/f14 [1235018,56518] 0 2024-09-17T07:19:55.295 INFO:tasks.workunit.client.1.smithi139.stdout:4/366: chown d0/d1 3709969 1 2024-09-17T07:19:55.296 INFO:tasks.workunit.client.0.smithi087.stdout:2/492: readlink d2/d7/d33/l76 0 2024-09-17T07:19:55.296 INFO:tasks.workunit.client.1.smithi139.stdout:9/735: dwrite dc/d11/f59 [0,4194304] 0 2024-09-17T07:19:55.299 INFO:tasks.workunit.client.1.smithi139.stdout:1/260: dread d2/d10/d12/f31 [0,4194304] 0 2024-09-17T07:19:55.301 INFO:tasks.workunit.client.1.smithi139.stdout:8/519: dwrite d0/d1a/d4d/d53/f8c [0,4194304] 0 2024-09-17T07:19:55.301 INFO:tasks.workunit.client.0.smithi087.stdout:3/474: link d6/d1b/d42/l7a d6/d15/d37/la1 0 2024-09-17T07:19:55.303 INFO:tasks.workunit.client.0.smithi087.stdout:3/475: rmdir d6/d7d 39 2024-09-17T07:19:55.304 INFO:tasks.workunit.client.0.smithi087.stdout:9/451: creat d3/d4/d6/d8/d22/fa5 x:0 0 0 2024-09-17T07:19:55.305 INFO:tasks.workunit.client.1.smithi139.stdout:1/261: chown d2/d10/d12/d24/d38/d3d/f4d 4 1 2024-09-17T07:19:55.305 INFO:tasks.workunit.client.1.smithi139.stdout:4/367: dread - d0/db/f35 zero size 2024-09-17T07:19:55.307 INFO:tasks.workunit.client.0.smithi087.stdout:6/600: rename d1/d6/d1a/d2c/d33/f3f to d1/d6/d1a/d2c/d40/d4c/fd0 0 2024-09-17T07:19:55.308 INFO:tasks.workunit.client.1.smithi139.stdout:1/262: mkdir d2/d10/d12/d13/d4f 0 2024-09-17T07:19:55.309 INFO:tasks.workunit.client.1.smithi139.stdout:1/263: stat d2/d10/d12/d35/d49 0 2024-09-17T07:19:55.311 INFO:tasks.workunit.client.0.smithi087.stdout:3/476: readlink d6/d15/d37/l4e 0 2024-09-17T07:19:55.311 INFO:tasks.workunit.client.0.smithi087.stdout:4/423: link d2/d92/d4d/d21/d2f/d3b/c43 d2/d22/d2c/d96/c99 0 2024-09-17T07:19:55.311 INFO:tasks.workunit.client.1.smithi139.stdout:8/520: symlink d0/d20/d28/d52/d99/la6 0 2024-09-17T07:19:55.312 INFO:tasks.workunit.client.1.smithi139.stdout:1/264: mknod d2/d10/d12/d35/c50 0 2024-09-17T07:19:55.313 INFO:tasks.workunit.client.1.smithi139.stdout:1/265: chown d2/d10/d12/d35/l45 22381245 1 2024-09-17T07:19:55.314 INFO:tasks.workunit.client.1.smithi139.stdout:9/736: getdents dc/d11/d52/d56/d7a 0 2024-09-17T07:19:55.314 INFO:tasks.workunit.client.0.smithi087.stdout:9/452: fdatasync d3/d4/d6/d8/d12/d38/f56 0 2024-09-17T07:19:55.314 INFO:tasks.workunit.client.0.smithi087.stdout:1/425: rename d2/d3d/d45/d90/d43/f4b to d2/d3d/d45/d90/f96 0 2024-09-17T07:19:55.314 INFO:tasks.workunit.client.0.smithi087.stdout:8/517: dwrite d1/d2b/d21/d6d/d6f/d7f/d54/f98 [0,4194304] 0 2024-09-17T07:19:55.317 INFO:tasks.workunit.client.1.smithi139.stdout:8/521: dread d0/d1a/f3f [0,4194304] 0 2024-09-17T07:19:55.317 INFO:tasks.workunit.client.0.smithi087.stdout:3/477: chown d6/d16/l22 3 1 2024-09-17T07:19:55.317 INFO:tasks.workunit.client.1.smithi139.stdout:8/522: chown d0/d20 3929 1 2024-09-17T07:19:55.318 INFO:tasks.workunit.client.0.smithi087.stdout:5/650: dread d5/d12/d1c/f65 [0,4194304] 0 2024-09-17T07:19:55.319 INFO:tasks.workunit.client.1.smithi139.stdout:4/368: rename d0/db/d17/f61 to d0/db/f6c 0 2024-09-17T07:19:55.319 INFO:tasks.workunit.client.0.smithi087.stdout:6/601: dread - d1/d6/d1a/d2c/d40/d4c/fb1 zero size 2024-09-17T07:19:55.319 INFO:tasks.workunit.client.0.smithi087.stdout:8/518: fsync d1/d2b/d21/d6d/d6f/f82 0 2024-09-17T07:19:55.320 INFO:tasks.workunit.client.1.smithi139.stdout:4/369: read - d0/d1/d29/d41/f63 zero size 2024-09-17T07:19:55.320 INFO:tasks.workunit.client.0.smithi087.stdout:1/426: write d2/d3d/d45/d90/d37/f38 [2771442,54908] 0 2024-09-17T07:19:55.321 INFO:tasks.workunit.client.1.smithi139.stdout:7/371: sync 2024-09-17T07:19:55.321 INFO:tasks.workunit.client.1.smithi139.stdout:0/313: sync 2024-09-17T07:19:55.321 INFO:tasks.workunit.client.1.smithi139.stdout:6/514: sync 2024-09-17T07:19:55.321 INFO:tasks.workunit.client.0.smithi087.stdout:6/602: dread - d1/d6/d68/f98 zero size 2024-09-17T07:19:55.322 INFO:tasks.workunit.client.1.smithi139.stdout:4/370: write d0/d10/f40 [1048359,107293] 0 2024-09-17T07:19:55.323 INFO:tasks.workunit.client.1.smithi139.stdout:9/737: mknod dc/d2a/cf3 0 2024-09-17T07:19:55.323 INFO:tasks.workunit.client.0.smithi087.stdout:4/424: write d2/d92/d4d/d21/d2f/d3b/f56 [2424174,119340] 0 2024-09-17T07:19:55.325 INFO:tasks.workunit.client.1.smithi139.stdout:4/371: read - d0/d1a/f60 zero size 2024-09-17T07:19:55.326 INFO:tasks.workunit.client.1.smithi139.stdout:4/372: write d0/d1/fd [2186807,8088] 0 2024-09-17T07:19:55.326 INFO:tasks.workunit.client.0.smithi087.stdout:9/453: creat d3/d4/d16/d69/d8a/d1e/d90/d93/d96/fa6 x:0 0 0 2024-09-17T07:19:55.326 INFO:tasks.workunit.client.0.smithi087.stdout:6/603: fdatasync d1/d67/db7/fc9 0 2024-09-17T07:19:55.326 INFO:tasks.workunit.client.0.smithi087.stdout:7/417: write d0/d3/d10/d31/f43 [1870154,58652] 0 2024-09-17T07:19:55.327 INFO:tasks.workunit.client.0.smithi087.stdout:8/519: write d1/d2b/d21/d6d/d6f/f93 [3458972,116076] 0 2024-09-17T07:19:55.327 INFO:tasks.workunit.client.1.smithi139.stdout:8/523: rename d0/d20/d28/d52/f64 to d0/d20/d28/d52/d99/fa7 0 2024-09-17T07:19:55.330 INFO:tasks.workunit.client.1.smithi139.stdout:7/372: truncate d5/f6e 1008295 0 2024-09-17T07:19:55.333 INFO:tasks.workunit.client.0.smithi087.stdout:1/427: rename d2/d3d/d45/d90/l7a to d2/d48/d61/l97 0 2024-09-17T07:19:55.333 INFO:tasks.workunit.client.1.smithi139.stdout:0/314: rmdir d1/da/d1b/d32/d81 39 2024-09-17T07:19:55.334 INFO:tasks.workunit.client.1.smithi139.stdout:4/373: mkdir d0/d1/d29/d6d 0 2024-09-17T07:19:55.335 INFO:tasks.workunit.client.1.smithi139.stdout:6/515: unlink db/df/d73/d81/l6f 0 2024-09-17T07:19:55.335 INFO:tasks.workunit.client.0.smithi087.stdout:8/520: symlink d1/d2b/d3b/lb8 0 2024-09-17T07:19:55.335 INFO:tasks.workunit.client.0.smithi087.stdout:3/478: dwrite d6/d1b/d42/f93 [0,4194304] 0 2024-09-17T07:19:55.337 INFO:tasks.workunit.client.0.smithi087.stdout:6/604: write d1/d6/d1a/d2c/d48/f6f [527891,126634] 0 2024-09-17T07:19:55.338 INFO:tasks.workunit.client.1.smithi139.stdout:1/266: dwrite d2/fd [0,4194304] 0 2024-09-17T07:19:55.338 INFO:tasks.workunit.client.1.smithi139.stdout:7/373: rmdir d5/d10/d2b/d40 39 2024-09-17T07:19:55.339 INFO:tasks.workunit.client.0.smithi087.stdout:9/454: rename d3/d4/d16/c17 to d3/d4/d6/d8/d12/d32/ca7 0 2024-09-17T07:19:55.339 INFO:tasks.workunit.client.0.smithi087.stdout:4/425: write d2/d92/d4d/f8a [1050013,67762] 0 2024-09-17T07:19:55.341 INFO:tasks.workunit.client.1.smithi139.stdout:9/738: rmdir dc/d2c 39 2024-09-17T07:19:55.341 INFO:tasks.workunit.client.1.smithi139.stdout:8/524: rename d0/d1a/d3a/f67 to d0/d20/d28/fa8 0 2024-09-17T07:19:55.341 INFO:tasks.workunit.client.0.smithi087.stdout:8/521: dread - d1/d7/d9/d19/d73/f97 zero size 2024-09-17T07:19:55.342 INFO:tasks.workunit.client.1.smithi139.stdout:8/525: dread - d0/d20/d28/d48/f83 zero size 2024-09-17T07:19:55.342 INFO:tasks.workunit.client.0.smithi087.stdout:3/479: write d6/d15/d37/d3c/f6f [789748,10264] 0 2024-09-17T07:19:55.343 INFO:tasks.workunit.client.1.smithi139.stdout:9/739: dread - dc/d11/d15/d3c/d68/fc4 zero size 2024-09-17T07:19:55.345 INFO:tasks.workunit.client.0.smithi087.stdout:0/733: dwrite db/d45/d5d/f76 [0,4194304] 0 2024-09-17T07:19:55.345 INFO:tasks.workunit.client.1.smithi139.stdout:4/374: rmdir d0/d10 39 2024-09-17T07:19:55.347 INFO:tasks.workunit.client.0.smithi087.stdout:8/522: write d1/d7/d9/d27/f58 [577289,45552] 0 2024-09-17T07:19:55.347 INFO:tasks.workunit.client.0.smithi087.stdout:9/455: dread - d3/d4/d6/d8/d22/d43/f5f zero size 2024-09-17T07:19:55.348 INFO:tasks.workunit.client.0.smithi087.stdout:4/426: fdatasync d2/d92/d4d/d21/d2f/f47 0 2024-09-17T07:19:55.348 INFO:tasks.workunit.client.1.smithi139.stdout:7/374: mkdir d5/d10/d4d/d59/d76 0 2024-09-17T07:19:55.349 INFO:tasks.workunit.client.1.smithi139.stdout:9/740: truncate dc/d11/d15/d3c/d68/fcb 662348 0 2024-09-17T07:19:55.350 INFO:tasks.workunit.client.1.smithi139.stdout:1/267: mknod d2/d10/d12/d35/d2b/c51 0 2024-09-17T07:19:55.352 INFO:tasks.workunit.client.0.smithi087.stdout:9/456: write d3/d4/d16/d69/d8a/f21 [3797743,27349] 0 2024-09-17T07:19:55.356 INFO:tasks.workunit.client.0.smithi087.stdout:1/428: write d2/d1a/f3e [3096743,82887] 0 2024-09-17T07:19:55.356 INFO:tasks.workunit.client.1.smithi139.stdout:8/526: dwrite d0/d1a/f77 [0,4194304] 0 2024-09-17T07:19:55.358 INFO:tasks.workunit.client.0.smithi087.stdout:0/734: rename db/f40 to db/d45/d7b/d90/f111 0 2024-09-17T07:19:55.359 INFO:tasks.workunit.client.0.smithi087.stdout:6/605: getdents d1/d6/d1a/d2c/d48/d62 0 2024-09-17T07:19:55.360 INFO:tasks.workunit.client.0.smithi087.stdout:3/480: creat d6/d15/d37/d3c/fa2 x:0 0 0 2024-09-17T07:19:55.363 INFO:tasks.workunit.client.0.smithi087.stdout:0/735: read db/f35 [1741157,88322] 0 2024-09-17T07:19:55.363 INFO:tasks.workunit.client.0.smithi087.stdout:8/523: creat d1/d7/d9/d19/fb9 x:0 0 0 2024-09-17T07:19:55.368 INFO:tasks.workunit.client.0.smithi087.stdout:9/457: dwrite d3/d4/d6/d8/d12/d32/f9e [0,4194304] 0 2024-09-17T07:19:55.368 INFO:tasks.workunit.client.0.smithi087.stdout:1/429: link d2/dc/f3b d2/d3d/d35/d57/f98 0 2024-09-17T07:19:55.368 INFO:tasks.workunit.client.0.smithi087.stdout:0/736: mknod db/d45/d7b/d90/c112 0 2024-09-17T07:19:55.369 INFO:tasks.workunit.client.1.smithi139.stdout:2/435: sync 2024-09-17T07:19:55.369 INFO:tasks.workunit.client.1.smithi139.stdout:3/364: sync 2024-09-17T07:19:55.369 INFO:tasks.workunit.client.1.smithi139.stdout:5/355: sync 2024-09-17T07:19:55.369 INFO:tasks.workunit.client.0.smithi087.stdout:8/524: symlink d1/d7/d9/d19/d73/lba 0 2024-09-17T07:19:55.370 INFO:tasks.workunit.client.0.smithi087.stdout:9/458: mknod d3/d4/d6/d8/d12/ca8 0 2024-09-17T07:19:55.370 INFO:tasks.workunit.client.0.smithi087.stdout:1/430: symlink d2/d48/d61/l99 0 2024-09-17T07:19:55.371 INFO:tasks.workunit.client.0.smithi087.stdout:0/737: mknod db/d45/d9e/c113 0 2024-09-17T07:19:55.371 INFO:tasks.workunit.client.0.smithi087.stdout:1/431: chown d2/d14/l68 47548279 1 2024-09-17T07:19:55.373 INFO:tasks.workunit.client.1.smithi139.stdout:2/436: write d0/d4e/f7f [558088,125289] 0 2024-09-17T07:19:55.373 INFO:tasks.workunit.client.0.smithi087.stdout:9/459: creat d3/d4/d6/d8/d22/d92/da3/fa9 x:0 0 0 2024-09-17T07:19:55.374 INFO:tasks.workunit.client.0.smithi087.stdout:1/432: mkdir d2/da/d9a 0 2024-09-17T07:19:55.375 INFO:tasks.workunit.client.1.smithi139.stdout:9/741: write dc/d11/d15/d3c/d68/fb9 [2081494,69490] 0 2024-09-17T07:19:55.375 INFO:tasks.workunit.client.0.smithi087.stdout:8/525: fsync d1/d7/d9/d19/d1b/f30 0 2024-09-17T07:19:55.375 INFO:tasks.workunit.client.1.smithi139.stdout:6/516: write db/d21/f42 [1241276,28627] 0 2024-09-17T07:19:55.378 INFO:tasks.workunit.client.1.smithi139.stdout:8/527: write d0/d20/d28/d52/d65/f94 [601311,15327] 0 2024-09-17T07:19:55.378 INFO:tasks.workunit.client.0.smithi087.stdout:0/738: creat db/dbe/f114 x:0 0 0 2024-09-17T07:19:55.380 INFO:tasks.workunit.client.1.smithi139.stdout:7/375: mkdir d5/d10/d2b/d77 0 2024-09-17T07:19:55.380 INFO:tasks.workunit.client.0.smithi087.stdout:1/433: creat d2/d48/f9b x:0 0 0 2024-09-17T07:19:55.382 INFO:tasks.workunit.client.0.smithi087.stdout:8/526: mkdir d1/d2b/d21/d6d/d6f/d7f/d54/dbb 0 2024-09-17T07:19:55.384 INFO:tasks.workunit.client.1.smithi139.stdout:1/268: unlink d2/c1f 0 2024-09-17T07:19:55.386 INFO:tasks.workunit.client.0.smithi087.stdout:8/527: creat d1/d2b/d21/d68/fbc x:0 0 0 2024-09-17T07:19:55.386 INFO:tasks.workunit.client.1.smithi139.stdout:0/315: rename d1/da/d1b/d3d/d50/c7f to d1/da/d17/d72/c82 0 2024-09-17T07:19:55.387 INFO:tasks.workunit.client.0.smithi087.stdout:0/739: read db/d45/d7b/d7e/f8e [3775685,81851] 0 2024-09-17T07:19:55.388 INFO:tasks.workunit.client.0.smithi087.stdout:0/740: write db/f1e [1812663,6524] 0 2024-09-17T07:19:55.389 INFO:tasks.workunit.client.0.smithi087.stdout:8/528: rename d1/l5 to d1/d2b/d3b/lbd 0 2024-09-17T07:19:55.390 INFO:tasks.workunit.client.0.smithi087.stdout:8/529: chown d1/d7/d9/d27/da1/db2 407606 1 2024-09-17T07:19:55.392 INFO:tasks.workunit.client.0.smithi087.stdout:0/741: chown db/f41 2534913 1 2024-09-17T07:19:55.393 INFO:tasks.workunit.client.0.smithi087.stdout:8/530: fdatasync d1/d7/d9/d19/f9d 0 2024-09-17T07:19:55.393 INFO:tasks.workunit.client.1.smithi139.stdout:1/269: write d2/d10/d12/f2d [739219,53988] 0 2024-09-17T07:19:55.395 INFO:tasks.workunit.client.0.smithi087.stdout:8/531: dread - d1/d7/d9/d19/d73/f9e zero size 2024-09-17T07:19:55.395 INFO:tasks.workunit.client.1.smithi139.stdout:2/437: mkdir d0/d7/d67/d92 0 2024-09-17T07:19:55.395 INFO:tasks.workunit.client.1.smithi139.stdout:2/438: readlink d0/l9 0 2024-09-17T07:19:55.397 INFO:tasks.workunit.client.1.smithi139.stdout:3/365: rename d5/d15/d16/d4c/d28/f5b to d5/d15/d16/d4c/d28/d54/d58/f72 0 2024-09-17T07:19:55.398 INFO:tasks.workunit.client.0.smithi087.stdout:0/742: dwrite db/d45/d7b/db0/fb5 [0,4194304] 0 2024-09-17T07:19:55.400 INFO:tasks.workunit.client.1.smithi139.stdout:6/517: mknod db/df/d4e/d64/d80/cab 0 2024-09-17T07:19:55.401 INFO:tasks.workunit.client.0.smithi087.stdout:4/427: dread d2/d5/d1f/f5e [0,4194304] 0 2024-09-17T07:19:55.402 INFO:tasks.workunit.client.1.smithi139.stdout:9/742: truncate dc/d11/d15/d3c/f3f 3286166 0 2024-09-17T07:19:55.402 INFO:tasks.workunit.client.0.smithi087.stdout:3/481: write d6/d16/f38 [1443420,70334] 0 2024-09-17T07:19:55.402 INFO:tasks.workunit.client.1.smithi139.stdout:6/518: fsync db/df/d4e/f68 0 2024-09-17T07:19:55.402 INFO:tasks.workunit.client.1.smithi139.stdout:4/375: write d0/db/d17/f2d [2213340,29329] 0 2024-09-17T07:19:55.404 INFO:tasks.workunit.client.1.smithi139.stdout:0/316: mknod d1/c83 0 2024-09-17T07:19:55.406 INFO:tasks.workunit.client.0.smithi087.stdout:8/532: dwrite d1/d7/d9/d19/f1d [4194304,4194304] 0 2024-09-17T07:19:55.407 INFO:tasks.workunit.client.0.smithi087.stdout:4/428: write d2/d92/f94 [1292462,50156] 0 2024-09-17T07:19:55.408 INFO:tasks.workunit.client.0.smithi087.stdout:6/606: dread d1/d6/d1a/d2c/d48/fb9 [0,4194304] 0 2024-09-17T07:19:55.409 INFO:tasks.workunit.client.1.smithi139.stdout:8/528: rename d0/d20/d28/l40 to d0/d20/d28/d52/d65/la9 0 2024-09-17T07:19:55.410 INFO:tasks.workunit.client.0.smithi087.stdout:1/434: write d2/d3d/d45/d90/f20 [2371524,95548] 0 2024-09-17T07:19:55.413 INFO:tasks.workunit.client.1.smithi139.stdout:9/743: creat dc/d11/d15/d3c/d61/d64/ff4 x:0 0 0 2024-09-17T07:19:55.413 INFO:tasks.workunit.client.0.smithi087.stdout:8/533: mknod d1/d7/d9/d19/cbe 0 2024-09-17T07:19:55.414 INFO:tasks.workunit.client.0.smithi087.stdout:1/435: creat d2/da/f9c x:0 0 0 2024-09-17T07:19:55.417 INFO:tasks.workunit.client.0.smithi087.stdout:4/429: creat d2/d92/d4d/d21/d2f/d3b/f9a x:0 0 0 2024-09-17T07:19:55.417 INFO:tasks.workunit.client.0.smithi087.stdout:4/430: stat d2/d92/f6f 0 2024-09-17T07:19:55.418 INFO:tasks.workunit.client.0.smithi087.stdout:9/460: dread d3/d4/d16/f3a [0,4194304] 0 2024-09-17T07:19:55.418 INFO:tasks.workunit.client.0.smithi087.stdout:6/607: creat d1/fd1 x:0 0 0 2024-09-17T07:19:55.419 INFO:tasks.workunit.client.1.smithi139.stdout:7/376: write d5/d17/f27 [3720894,110094] 0 2024-09-17T07:19:55.420 INFO:tasks.workunit.client.1.smithi139.stdout:2/439: creat d0/de/d11/d12/d8c/f93 x:0 0 0 2024-09-17T07:19:55.421 INFO:tasks.workunit.client.1.smithi139.stdout:2/440: fdatasync d0/de/f14 0 2024-09-17T07:19:55.421 INFO:tasks.workunit.client.1.smithi139.stdout:5/356: truncate d4/d16/f18 240593 0 2024-09-17T07:19:55.422 INFO:tasks.workunit.client.0.smithi087.stdout:8/534: link d1/d2b/d3b/f62 d1/d7/d9/d19/fbf 0 2024-09-17T07:19:55.423 INFO:tasks.workunit.client.1.smithi139.stdout:3/366: unlink d5/d15/d16/d4c/f44 0 2024-09-17T07:19:55.425 INFO:tasks.workunit.client.1.smithi139.stdout:4/376: mknod d0/d37/d5f/c6e 0 2024-09-17T07:19:55.425 INFO:tasks.workunit.client.1.smithi139.stdout:9/744: creat dc/d11/d15/d3c/d61/d64/ff5 x:0 0 0 2024-09-17T07:19:55.426 INFO:tasks.workunit.client.0.smithi087.stdout:9/461: creat d3/d4/d6/d8/d22/d2a/faa x:0 0 0 2024-09-17T07:19:55.426 INFO:tasks.workunit.client.1.smithi139.stdout:1/270: creat d2/f52 x:0 0 0 2024-09-17T07:19:55.428 INFO:tasks.workunit.client.0.smithi087.stdout:3/482: dread d6/fa [0,4194304] 0 2024-09-17T07:19:55.428 INFO:tasks.workunit.client.1.smithi139.stdout:8/529: creat d0/d1a/d3a/d8d/faa x:0 0 0 2024-09-17T07:19:55.429 INFO:tasks.workunit.client.0.smithi087.stdout:4/431: dwrite d2/d92/d4d/d21/f8f [0,4194304] 0 2024-09-17T07:19:55.430 INFO:tasks.workunit.client.1.smithi139.stdout:4/377: write d0/d1/d54/f5b [3455351,87018] 0 2024-09-17T07:19:55.431 INFO:tasks.workunit.client.1.smithi139.stdout:1/271: read - d2/d10/d12/d35/d2b/f34 zero size 2024-09-17T07:19:55.431 INFO:tasks.workunit.client.0.smithi087.stdout:8/535: dread d1/d5f/f5d [0,4194304] 0 2024-09-17T07:19:55.432 INFO:tasks.workunit.client.1.smithi139.stdout:3/367: mknod d5/d15/d20/c73 0 2024-09-17T07:19:55.432 INFO:tasks.workunit.client.0.smithi087.stdout:3/483: truncate d6/d1b/d42/f3d 5074252 0 2024-09-17T07:19:55.432 INFO:tasks.workunit.client.0.smithi087.stdout:9/462: creat d3/d4/d6/fab x:0 0 0 2024-09-17T07:19:55.433 INFO:tasks.workunit.client.1.smithi139.stdout:6/519: link db/df/d4e/c63 db/df/d73/da4/cac 0 2024-09-17T07:19:55.434 INFO:tasks.workunit.client.1.smithi139.stdout:7/377: mkdir d5/d10/d2b/d78 0 2024-09-17T07:19:55.435 INFO:tasks.workunit.client.1.smithi139.stdout:5/357: dwrite d4/d16/d1b/d20/d28/f3e [0,4194304] 0 2024-09-17T07:19:55.435 INFO:tasks.workunit.client.1.smithi139.stdout:2/441: dwrite d0/d7/d1a/d1b/f90 [0,4194304] 0 2024-09-17T07:19:55.435 INFO:tasks.workunit.client.0.smithi087.stdout:1/436: write d2/d3d/d35/d57/f89 [1770684,20482] 0 2024-09-17T07:19:55.436 INFO:tasks.workunit.client.0.smithi087.stdout:3/484: write d6/d15/d4b/f8b [2266942,3940] 0 2024-09-17T07:19:55.438 INFO:tasks.workunit.client.0.smithi087.stdout:3/485: chown d6/d16/f36 1028 1 2024-09-17T07:19:55.438 INFO:tasks.workunit.client.1.smithi139.stdout:2/442: write d0/dc/f13 [2410485,101836] 0 2024-09-17T07:19:55.441 INFO:tasks.workunit.client.0.smithi087.stdout:4/432: rename d2/d92/d4d/d21/d2f/d3b/f77 to d2/d92/d4d/d42/f9b 0 2024-09-17T07:19:55.443 INFO:tasks.workunit.client.0.smithi087.stdout:1/437: dread d2/d3d/d45/d90/d37/f8b [0,4194304] 0 2024-09-17T07:19:55.443 INFO:tasks.workunit.client.1.smithi139.stdout:8/530: symlink d0/d20/d28/lab 0 2024-09-17T07:19:55.444 INFO:tasks.workunit.client.1.smithi139.stdout:1/272: creat d2/d10/d12/d1a/f53 x:0 0 0 2024-09-17T07:19:55.445 INFO:tasks.workunit.client.1.smithi139.stdout:3/368: symlink d5/d21/d23/l74 0 2024-09-17T07:19:55.446 INFO:tasks.workunit.client.1.smithi139.stdout:5/358: unlink d4/d16/d1b/d20/d38/f3b 0 2024-09-17T07:19:55.447 INFO:tasks.workunit.client.0.smithi087.stdout:3/486: symlink d6/d15/d37/d3c/d43/la3 0 2024-09-17T07:19:55.447 INFO:tasks.workunit.client.1.smithi139.stdout:4/378: rename d0/d10/d39/l56 to d0/d1a/l6f 0 2024-09-17T07:19:55.448 INFO:tasks.workunit.client.0.smithi087.stdout:4/433: readlink d2/d92/d4d/d3e/l66 0 2024-09-17T07:19:55.448 INFO:tasks.workunit.client.0.smithi087.stdout:1/438: fdatasync d2/d48/f9b 0 2024-09-17T07:19:55.449 INFO:tasks.workunit.client.1.smithi139.stdout:6/520: rmdir db/df/d73/d81 39 2024-09-17T07:19:55.450 INFO:tasks.workunit.client.1.smithi139.stdout:5/359: dread - d4/d16/d1b/d20/d32/f4c zero size 2024-09-17T07:19:55.452 INFO:tasks.workunit.client.1.smithi139.stdout:0/317: dwrite d1/da/d1b/d32/f35 [0,4194304] 0 2024-09-17T07:19:55.452 INFO:tasks.workunit.client.1.smithi139.stdout:9/745: creat dc/d11/ff6 x:0 0 0 2024-09-17T07:19:55.453 INFO:tasks.workunit.client.0.smithi087.stdout:4/434: rename d2/f25 to d2/d5/f9c 0 2024-09-17T07:19:55.454 INFO:tasks.workunit.client.1.smithi139.stdout:5/360: chown d4/f9 4113800 1 2024-09-17T07:19:55.454 INFO:tasks.workunit.client.0.smithi087.stdout:6/608: dread d1/d6/d1a/d2c/d40/fb2 [0,4194304] 0 2024-09-17T07:19:55.455 INFO:tasks.workunit.client.1.smithi139.stdout:5/361: chown d4/d16/d1b/d20 13 1 2024-09-17T07:19:55.455 INFO:tasks.workunit.client.0.smithi087.stdout:1/439: mknod d2/da/d9a/c9d 0 2024-09-17T07:19:55.455 INFO:tasks.workunit.client.1.smithi139.stdout:9/746: stat dc/d11/l7f 0 2024-09-17T07:19:55.456 INFO:tasks.workunit.client.0.smithi087.stdout:1/440: chown d2/d3d/d35/l3c 40 1 2024-09-17T07:19:55.457 INFO:tasks.workunit.client.0.smithi087.stdout:4/435: unlink d2/d5/d1f/f69 0 2024-09-17T07:19:55.458 INFO:tasks.workunit.client.0.smithi087.stdout:4/436: chown d2/d92/d4d/d21/f6c 0 1 2024-09-17T07:19:55.459 INFO:tasks.workunit.client.1.smithi139.stdout:4/379: read d0/d1/d29/d41/f43 [112344,120103] 0 2024-09-17T07:19:55.459 INFO:tasks.workunit.client.1.smithi139.stdout:7/378: mknod d5/d10/d2b/d78/c79 0 2024-09-17T07:19:55.459 INFO:tasks.workunit.client.0.smithi087.stdout:4/437: fdatasync d2/d92/d4d/f64 0 2024-09-17T07:19:55.460 INFO:tasks.workunit.client.1.smithi139.stdout:4/380: dread - d0/db/f35 zero size 2024-09-17T07:19:55.461 INFO:tasks.workunit.client.1.smithi139.stdout:3/369: write d5/d15/f18 [1949053,32216] 0 2024-09-17T07:19:55.463 INFO:tasks.workunit.client.1.smithi139.stdout:2/443: symlink d0/d7/d67/d92/l94 0 2024-09-17T07:19:55.463 INFO:tasks.workunit.client.0.smithi087.stdout:4/438: mkdir d2/d92/d4f/d6a/d9d 0 2024-09-17T07:19:55.464 INFO:tasks.workunit.client.1.smithi139.stdout:6/521: chown db/d18/c70 289731 1 2024-09-17T07:19:55.465 INFO:tasks.workunit.client.0.smithi087.stdout:6/609: dread d1/d6/d1a/d2c/d58/fbf [0,4194304] 0 2024-09-17T07:19:55.466 INFO:tasks.workunit.client.1.smithi139.stdout:3/370: read d5/d15/d16/d4c/d28/f50 [630731,53909] 0 2024-09-17T07:19:55.467 INFO:tasks.workunit.client.0.smithi087.stdout:4/439: truncate d2/d92/d4d/f53 406343 0 2024-09-17T07:19:55.467 INFO:tasks.workunit.client.0.smithi087.stdout:9/463: dwrite d3/d4/f26 [4194304,4194304] 0 2024-09-17T07:19:55.467 INFO:tasks.workunit.client.1.smithi139.stdout:3/371: write d5/d21/f4e [1989788,35706] 0 2024-09-17T07:19:55.468 INFO:tasks.workunit.client.1.smithi139.stdout:5/362: mkdir d4/d16/d1b/d20/d32/d6c 0 2024-09-17T07:19:55.470 INFO:tasks.workunit.client.0.smithi087.stdout:3/487: truncate d6/d15/f19 6200968 0 2024-09-17T07:19:55.470 INFO:tasks.workunit.client.1.smithi139.stdout:3/372: truncate d5/d15/d16/d4c/f68 325803 0 2024-09-17T07:19:55.472 INFO:tasks.workunit.client.1.smithi139.stdout:9/747: rmdir dc/d11/d15/d3c 39 2024-09-17T07:19:55.473 INFO:tasks.workunit.client.0.smithi087.stdout:9/464: mkdir d3/dac 0 2024-09-17T07:19:55.473 INFO:tasks.workunit.client.0.smithi087.stdout:1/441: write d2/d3d/d45/d90/d43/f93 [109036,33112] 0 2024-09-17T07:19:55.474 INFO:tasks.workunit.client.1.smithi139.stdout:7/379: unlink d5/d17/d4e/l5d 0 2024-09-17T07:19:55.474 INFO:tasks.workunit.client.0.smithi087.stdout:4/440: mknod d2/d92/d4d/d21/d2f/d3b/d7e/d97/c9e 0 2024-09-17T07:19:55.475 INFO:tasks.workunit.client.1.smithi139.stdout:1/273: mknod d2/c54 0 2024-09-17T07:19:55.478 INFO:tasks.workunit.client.1.smithi139.stdout:3/373: write d5/d15/d16/d4c/d28/f52 [3550343,77329] 0 2024-09-17T07:19:55.478 INFO:tasks.workunit.client.1.smithi139.stdout:4/381: mkdir d0/d1a/d70 0 2024-09-17T07:19:55.479 INFO:tasks.workunit.client.0.smithi087.stdout:9/465: dwrite d3/d25/d83/f97 [0,4194304] 0 2024-09-17T07:19:55.480 INFO:tasks.workunit.client.0.smithi087.stdout:6/610: getdents d1/d6/d1a/d2c/d40/d4c 0 2024-09-17T07:19:55.481 INFO:tasks.workunit.client.0.smithi087.stdout:9/466: chown d3/d4/d16/d69/d8a 259577 1 2024-09-17T07:19:55.481 INFO:tasks.workunit.client.0.smithi087.stdout:1/442: symlink d2/d3d/d45/d90/d43/l9e 0 2024-09-17T07:19:55.482 INFO:tasks.workunit.client.1.smithi139.stdout:8/531: dwrite d0/d20/d28/d52/d65/f7b [0,4194304] 0 2024-09-17T07:19:55.482 INFO:tasks.workunit.client.1.smithi139.stdout:2/444: symlink d0/de/d69/l95 0 2024-09-17T07:19:55.483 INFO:tasks.workunit.client.0.smithi087.stdout:3/488: rmdir d6/d15/da0 0 2024-09-17T07:19:55.484 INFO:tasks.workunit.client.1.smithi139.stdout:5/363: dwrite d4/d16/d1b/d20/d32/f3c [0,4194304] 0 2024-09-17T07:19:55.485 INFO:tasks.workunit.client.1.smithi139.stdout:6/522: creat db/df/d4c/fad x:0 0 0 2024-09-17T07:19:55.485 INFO:tasks.workunit.client.0.smithi087.stdout:9/467: creat d3/d25/d83/fad x:0 0 0 2024-09-17T07:19:55.487 INFO:tasks.workunit.client.0.smithi087.stdout:4/441: chown d2/d5/d1f/l73 534566465 1 2024-09-17T07:19:55.487 INFO:tasks.workunit.client.1.smithi139.stdout:6/523: read - db/d18/f8e zero size 2024-09-17T07:19:55.488 INFO:tasks.workunit.client.0.smithi087.stdout:6/611: mkdir d1/d6/d1a/d2c/d40/dd2 0 2024-09-17T07:19:55.488 INFO:tasks.workunit.client.0.smithi087.stdout:3/489: write d6/d1b/f9d [1369406,22973] 0 2024-09-17T07:19:55.490 INFO:tasks.workunit.client.1.smithi139.stdout:9/748: mkdir dc/d11/d52/d56/d7a/df7 0 2024-09-17T07:19:55.491 INFO:tasks.workunit.client.0.smithi087.stdout:6/612: write d1/d6/d1a/f57 [477160,122636] 0 2024-09-17T07:19:55.491 INFO:tasks.workunit.client.0.smithi087.stdout:3/490: stat d6/d15/l1f 0 2024-09-17T07:19:55.494 INFO:tasks.workunit.client.1.smithi139.stdout:1/274: write d2/ff [50827,10191] 0 2024-09-17T07:19:55.494 INFO:tasks.workunit.client.1.smithi139.stdout:0/318: dwrite d1/da/d1b/d32/f7a [0,4194304] 0 2024-09-17T07:19:55.494 INFO:tasks.workunit.client.1.smithi139.stdout:8/532: creat d0/d1a/d3a/d8d/fac x:0 0 0 2024-09-17T07:19:55.495 INFO:tasks.workunit.client.0.smithi087.stdout:1/443: dwrite d2/d3d/d45/d90/ff [4194304,4194304] 0 2024-09-17T07:19:55.496 INFO:tasks.workunit.client.0.smithi087.stdout:6/613: write d1/d6/d1a/d2c/d40/d4c/d77/f93 [347067,89760] 0 2024-09-17T07:19:55.498 INFO:tasks.workunit.client.0.smithi087.stdout:6/614: readlink d1/d6/le 0 2024-09-17T07:19:55.498 INFO:tasks.workunit.client.0.smithi087.stdout:4/442: symlink d2/d92/d4f/d6a/l9f 0 2024-09-17T07:19:55.498 INFO:tasks.workunit.client.0.smithi087.stdout:3/491: fsync d6/d1b/d2b/f83 0 2024-09-17T07:19:55.500 INFO:tasks.workunit.client.0.smithi087.stdout:1/444: creat d2/d3d/d35/d57/d73/f9f x:0 0 0 2024-09-17T07:19:55.502 INFO:tasks.workunit.client.1.smithi139.stdout:3/374: rename d5/l37 to d5/d63/l75 0 2024-09-17T07:19:55.502 INFO:tasks.workunit.client.1.smithi139.stdout:0/319: truncate d1/f7c 433832 0 2024-09-17T07:19:55.504 INFO:tasks.workunit.client.1.smithi139.stdout:5/364: read d4/d16/d1b/d20/d38/d4f/f57 [734350,118288] 0 2024-09-17T07:19:55.505 INFO:tasks.workunit.client.1.smithi139.stdout:2/445: dwrite d0/de/df/d56/f7a [0,4194304] 0 2024-09-17T07:19:55.506 INFO:tasks.workunit.client.0.smithi087.stdout:9/468: rename d3/d4/da/c4e to d3/d4/d6/d8/cae 0 2024-09-17T07:19:55.506 INFO:tasks.workunit.client.0.smithi087.stdout:1/445: fdatasync d2/d1a/f1c 0 2024-09-17T07:19:55.508 INFO:tasks.workunit.client.1.smithi139.stdout:2/446: dread - d0/d3b/f5d zero size 2024-09-17T07:19:55.508 INFO:tasks.workunit.client.0.smithi087.stdout:6/615: write d1/d6/d1a/d2c/d58/fb8 [808562,90470] 0 2024-09-17T07:19:55.509 INFO:tasks.workunit.client.0.smithi087.stdout:3/492: mknod d6/d15/d37/d3c/d52/ca4 0 2024-09-17T07:19:55.509 INFO:tasks.workunit.client.0.smithi087.stdout:1/446: readlink d2/d14/l68 0 2024-09-17T07:19:55.512 INFO:tasks.workunit.client.1.smithi139.stdout:8/533: creat d0/d20/d28/d52/d65/fad x:0 0 0 2024-09-17T07:19:55.512 INFO:tasks.workunit.client.1.smithi139.stdout:1/275: mknod d2/d10/d12/d35/c55 0 2024-09-17T07:19:55.513 INFO:tasks.workunit.client.1.smithi139.stdout:0/320: readlink d1/da/d2a/l54 0 2024-09-17T07:19:55.514 INFO:tasks.workunit.client.1.smithi139.stdout:7/380: rename d5/d10/d2b/d77 to d5/d17/d4e/d7a 0 2024-09-17T07:19:55.514 INFO:tasks.workunit.client.1.smithi139.stdout:8/534: readlink d0/d1a/l92 0 2024-09-17T07:19:55.515 INFO:tasks.workunit.client.1.smithi139.stdout:5/365: mknod d4/d16/d1b/d20/d28/c6d 0 2024-09-17T07:19:55.515 INFO:tasks.workunit.client.0.smithi087.stdout:6/616: dread d1/d6/d1a/d2c/d48/f6f [0,4194304] 0 2024-09-17T07:19:55.517 INFO:tasks.workunit.client.1.smithi139.stdout:2/447: unlink d0/d7/f91 0 2024-09-17T07:19:55.517 INFO:tasks.workunit.client.1.smithi139.stdout:1/276: dread - d2/d10/d12/d35/d2b/f34 zero size 2024-09-17T07:19:55.518 INFO:tasks.workunit.client.1.smithi139.stdout:0/321: symlink d1/da/d17/d65/l84 0 2024-09-17T07:19:55.518 INFO:tasks.workunit.client.0.smithi087.stdout:9/469: getdents d3/d4/d6/d8/d12/d32/da1 0 2024-09-17T07:19:55.519 INFO:tasks.workunit.client.1.smithi139.stdout:3/375: dread d5/d15/d20/d3b/f4a [0,4194304] 0 2024-09-17T07:19:55.519 INFO:tasks.workunit.client.1.smithi139.stdout:5/366: unlink d4/f9 0 2024-09-17T07:19:55.520 INFO:tasks.workunit.client.0.smithi087.stdout:3/493: creat d6/d7d/fa5 x:0 0 0 2024-09-17T07:19:55.521 INFO:tasks.workunit.client.0.smithi087.stdout:9/470: write d3/d4/d6/d8/d12/d32/f8f [490750,76827] 0 2024-09-17T07:19:55.521 INFO:tasks.workunit.client.0.smithi087.stdout:4/443: getdents d2/d22/d62 0 2024-09-17T07:19:55.522 INFO:tasks.workunit.client.0.smithi087.stdout:9/471: fsync d3/f4d 0 2024-09-17T07:19:55.522 INFO:tasks.workunit.client.0.smithi087.stdout:6/617: creat d1/d6/d1a/d2c/d33/fd3 x:0 0 0 2024-09-17T07:19:55.524 INFO:tasks.workunit.client.0.smithi087.stdout:9/472: readlink d3/d4/d6/d8/d22/d43/l6e 0 2024-09-17T07:19:55.525 INFO:tasks.workunit.client.1.smithi139.stdout:2/448: creat d0/de/d25/d3f/f96 x:0 0 0 2024-09-17T07:19:55.525 INFO:tasks.workunit.client.1.smithi139.stdout:2/449: write d0/dc/f13 [4563,32999] 0 2024-09-17T07:19:55.525 INFO:tasks.workunit.client.1.smithi139.stdout:4/382: rename d0/db/f33 to d0/f71 0 2024-09-17T07:19:55.525 INFO:tasks.workunit.client.0.smithi087.stdout:9/473: write d3/d4/d16/d69/d8a/f85 [533015,107993] 0 2024-09-17T07:19:55.526 INFO:tasks.workunit.client.1.smithi139.stdout:0/322: creat d1/da/d17/d65/f85 x:0 0 0 2024-09-17T07:19:55.527 INFO:tasks.workunit.client.0.smithi087.stdout:6/618: mkdir d1/d6/d1a/d2c/d40/d4c/dd4 0 2024-09-17T07:19:55.527 INFO:tasks.workunit.client.1.smithi139.stdout:8/535: getdents d0/dc 0 2024-09-17T07:19:55.527 INFO:tasks.workunit.client.0.smithi087.stdout:1/447: link d2/da/l51 d2/d48/d61/la0 0 2024-09-17T07:19:55.529 INFO:tasks.workunit.client.1.smithi139.stdout:4/383: dread - d0/db/d58/f5e zero size 2024-09-17T07:19:55.529 INFO:tasks.workunit.client.0.smithi087.stdout:4/444: getdents d2/d92/d4d/d21 0 2024-09-17T07:19:55.529 INFO:tasks.workunit.client.1.smithi139.stdout:3/376: fdatasync d5/d21/d23/d38/f40 0 2024-09-17T07:19:55.529 INFO:tasks.workunit.client.0.smithi087.stdout:9/474: rmdir d3/d4/d6/d71 39 2024-09-17T07:19:55.531 INFO:tasks.workunit.client.0.smithi087.stdout:6/619: unlink d1/d67/l76 0 2024-09-17T07:19:55.532 INFO:tasks.workunit.client.1.smithi139.stdout:1/277: creat d2/d10/d12/d35/d49/f56 x:0 0 0 2024-09-17T07:19:55.533 INFO:tasks.workunit.client.1.smithi139.stdout:2/450: creat d0/d7/d1a/d59/f97 x:0 0 0 2024-09-17T07:19:55.534 INFO:tasks.workunit.client.0.smithi087.stdout:9/475: fdatasync d3/d4/d6/d71/f86 0 2024-09-17T07:19:55.534 INFO:tasks.workunit.client.1.smithi139.stdout:1/278: chown d2/d10/d12/d24/d38/d3d 335 1 2024-09-17T07:19:55.534 INFO:tasks.workunit.client.0.smithi087.stdout:4/445: dread d2/d92/d4d/f75 [0,4194304] 0 2024-09-17T07:19:55.536 INFO:tasks.workunit.client.1.smithi139.stdout:5/367: dwrite d4/d16/d1b/d20/d28/f4d [0,4194304] 0 2024-09-17T07:19:55.536 INFO:tasks.workunit.client.0.smithi087.stdout:6/620: mkdir d1/d6/d1a/d5e/d8f/dd5 0 2024-09-17T07:19:55.536 INFO:tasks.workunit.client.0.smithi087.stdout:9/476: truncate d3/d4/d6/f3e 1739500 0 2024-09-17T07:19:55.537 INFO:tasks.workunit.client.1.smithi139.stdout:4/384: write d0/f1d [361528,44944] 0 2024-09-17T07:19:55.538 INFO:tasks.workunit.client.0.smithi087.stdout:1/448: link d2/d3d/d35/d4f/l82 d2/da/d7e/la1 0 2024-09-17T07:19:55.540 INFO:tasks.workunit.client.0.smithi087.stdout:6/621: chown d1/d6/d1a/d4e/f50 1 1 2024-09-17T07:19:55.540 INFO:tasks.workunit.client.1.smithi139.stdout:5/368: write d4/d16/d1b/d20/d28/f52 [3464716,6206] 0 2024-09-17T07:19:55.540 INFO:tasks.workunit.client.0.smithi087.stdout:9/477: symlink d3/d4/d16/d69/d8a/d1e/d90/laf 0 2024-09-17T07:19:55.541 INFO:tasks.workunit.client.0.smithi087.stdout:4/446: dread d2/d5/f26 [0,4194304] 0 2024-09-17T07:19:55.542 INFO:tasks.workunit.client.0.smithi087.stdout:1/449: chown d2/d14/f63 311 1 2024-09-17T07:19:55.543 INFO:tasks.workunit.client.0.smithi087.stdout:6/622: creat d1/d6/d1a/d8a/fd6 x:0 0 0 2024-09-17T07:19:55.544 INFO:tasks.workunit.client.0.smithi087.stdout:6/623: chown d1/d6/d1a/f36 4373 1 2024-09-17T07:19:55.544 INFO:tasks.workunit.client.0.smithi087.stdout:9/478: creat d3/d4/d16/d69/d8a/d1e/fb0 x:0 0 0 2024-09-17T07:19:55.547 INFO:tasks.workunit.client.0.smithi087.stdout:1/450: rename d2/c80 to d2/d14/ca2 0 2024-09-17T07:19:55.548 INFO:tasks.workunit.client.0.smithi087.stdout:1/451: write d2/d48/d61/f85 [872255,48400] 0 2024-09-17T07:19:55.549 INFO:tasks.workunit.client.1.smithi139.stdout:0/323: symlink d1/da/d1b/l86 0 2024-09-17T07:19:55.550 INFO:tasks.workunit.client.1.smithi139.stdout:1/279: creat d2/d10/d12/d24/f57 x:0 0 0 2024-09-17T07:19:55.550 INFO:tasks.workunit.client.1.smithi139.stdout:8/536: creat d0/d1a/d4d/da4/fae x:0 0 0 2024-09-17T07:19:55.550 INFO:tasks.workunit.client.0.smithi087.stdout:9/479: unlink d3/d4/d6/d8/l6a 0 2024-09-17T07:19:55.552 INFO:tasks.workunit.client.0.smithi087.stdout:6/624: symlink d1/d6/d1a/d2c/d48/d9b/ld7 0 2024-09-17T07:19:55.554 INFO:tasks.workunit.client.1.smithi139.stdout:7/381: rename d5/d10/d2b/l34 to d5/l7b 0 2024-09-17T07:19:55.554 INFO:tasks.workunit.client.1.smithi139.stdout:6/524: dwrite f8 [0,4194304] 0 2024-09-17T07:19:55.554 INFO:tasks.workunit.client.0.smithi087.stdout:4/447: rename d2/d92/d4d/d21/d2f/f8d to d2/d92/d4f/fa0 0 2024-09-17T07:19:55.556 INFO:tasks.workunit.client.0.smithi087.stdout:4/448: fdatasync d2/d92/d4d/d21/d2f/d3b/f56 0 2024-09-17T07:19:55.556 INFO:tasks.workunit.client.0.smithi087.stdout:9/480: mkdir d3/d4/d6/d8/d12/db1 0 2024-09-17T07:19:55.557 INFO:tasks.workunit.client.0.smithi087.stdout:4/449: fsync d2/d92/d4f/f5c 0 2024-09-17T07:19:55.559 INFO:tasks.workunit.client.0.smithi087.stdout:3/494: getdents d6/d7d 0 2024-09-17T07:19:55.560 INFO:tasks.workunit.client.1.smithi139.stdout:8/537: symlink d0/d20/d28/d52/d54/laf 0 2024-09-17T07:19:55.561 INFO:tasks.workunit.client.0.smithi087.stdout:4/450: chown d2/f7 1394572 1 2024-09-17T07:19:55.562 INFO:tasks.workunit.client.0.smithi087.stdout:4/451: stat d2/d92/d4d/d42/f55 0 2024-09-17T07:19:55.562 INFO:tasks.workunit.client.0.smithi087.stdout:9/481: readlink d3/d4/d6/d8/d12/d32/l82 0 2024-09-17T07:19:55.563 INFO:tasks.workunit.client.0.smithi087.stdout:4/452: write d2/d92/d4d/d21/f6c [518761,93258] 0 2024-09-17T07:19:55.565 INFO:tasks.workunit.client.1.smithi139.stdout:5/369: dwrite d4/d16/d1b/d20/d28/f1f [4194304,4194304] 0 2024-09-17T07:19:55.565 INFO:tasks.workunit.client.0.smithi087.stdout:3/495: unlink d6/d1b/d42/f3d 0 2024-09-17T07:19:55.566 INFO:tasks.workunit.client.1.smithi139.stdout:8/538: stat d0/d1a/d3a/f8e 0 2024-09-17T07:19:55.570 INFO:tasks.workunit.client.0.smithi087.stdout:6/625: getdents d1/d6/d1a/d2c/d33 0 2024-09-17T07:19:55.570 INFO:tasks.workunit.client.0.smithi087.stdout:6/626: chown d1/l2 15 1 2024-09-17T07:19:55.571 INFO:tasks.workunit.client.1.smithi139.stdout:8/539: write d0/d20/d28/d52/d65/fad [813444,5947] 0 2024-09-17T07:19:55.572 INFO:tasks.workunit.client.0.smithi087.stdout:4/453: link d2/d92/f51 d2/d92/d4d/d21/d2f/d3b/d7e/fa1 0 2024-09-17T07:19:55.572 INFO:tasks.workunit.client.0.smithi087.stdout:6/627: chown d1/d6/d1a/d2c/d48/l53 0 1 2024-09-17T07:19:55.573 INFO:tasks.workunit.client.0.smithi087.stdout:4/454: fsync d2/d22/d2c/f31 0 2024-09-17T07:19:55.573 INFO:tasks.workunit.client.1.smithi139.stdout:7/382: dread - d5/d10/d2b/d40/f6d zero size 2024-09-17T07:19:55.574 INFO:tasks.workunit.client.1.smithi139.stdout:1/280: dwrite d2/d10/d12/f29 [4194304,4194304] 0 2024-09-17T07:19:55.574 INFO:tasks.workunit.client.1.smithi139.stdout:6/525: rmdir db/df/d4e/d64/d80 39 2024-09-17T07:19:55.575 INFO:tasks.workunit.client.1.smithi139.stdout:9/749: write dc/d11/d15/d3c/d68/f90 [1399756,99604] 0 2024-09-17T07:19:55.576 INFO:tasks.workunit.client.1.smithi139.stdout:5/370: unlink d4/d16/d1b/d20/d32/f4c 0 2024-09-17T07:19:55.576 INFO:tasks.workunit.client.1.smithi139.stdout:6/526: stat c4 0 2024-09-17T07:19:55.576 INFO:tasks.workunit.client.0.smithi087.stdout:1/452: getdents d2/da/d7e 0 2024-09-17T07:19:55.578 INFO:tasks.workunit.client.0.smithi087.stdout:6/628: unlink d1/d6/d1a/d5e/f7b 0 2024-09-17T07:19:55.579 INFO:tasks.workunit.client.1.smithi139.stdout:3/377: dread d5/d15/f33 [0,4194304] 0 2024-09-17T07:19:55.580 INFO:tasks.workunit.client.0.smithi087.stdout:6/629: chown d1/f35 15 1 2024-09-17T07:19:55.582 INFO:tasks.workunit.client.1.smithi139.stdout:6/527: write db/df/d4e/d64/f4d [225333,33672] 0 2024-09-17T07:19:55.583 INFO:tasks.workunit.client.1.smithi139.stdout:3/378: dread - d5/d15/d56/f70 zero size 2024-09-17T07:19:55.583 INFO:tasks.workunit.client.1.smithi139.stdout:4/385: dread d0/db/d17/f2d [0,4194304] 0 2024-09-17T07:19:55.584 INFO:tasks.workunit.client.1.smithi139.stdout:5/371: chown d4/d16/d1b/d20/l27 7195 1 2024-09-17T07:19:55.585 INFO:tasks.workunit.client.0.smithi087.stdout:1/453: dwrite d2/d3d/d45/d90/d37/f38 [4194304,4194304] 0 2024-09-17T07:19:55.585 INFO:tasks.workunit.client.0.smithi087.stdout:4/455: rename d2/d92/d4d/d2d/f5d to d2/d92/d4d/fa2 0 2024-09-17T07:19:55.587 INFO:tasks.workunit.client.1.smithi139.stdout:4/386: readlink d0/db/d17/l34 0 2024-09-17T07:19:55.588 INFO:tasks.workunit.client.0.smithi087.stdout:4/456: truncate d2/d92/d4d/d3e/f8b 60434 0 2024-09-17T07:19:55.591 INFO:tasks.workunit.client.1.smithi139.stdout:0/324: getdents d1/da/d17 0 2024-09-17T07:19:55.594 INFO:tasks.workunit.client.0.smithi087.stdout:6/630: symlink d1/d6/d1a/d2c/d40/d4c/d77/ld8 0 2024-09-17T07:19:55.596 INFO:tasks.workunit.client.0.smithi087.stdout:9/482: truncate d3/d4/d6/d8/f78 2291109 0 2024-09-17T07:19:55.597 INFO:tasks.workunit.client.0.smithi087.stdout:6/631: write d1/d6/d1a/d2c/d48/f9a [460901,110823] 0 2024-09-17T07:19:55.598 INFO:tasks.workunit.client.1.smithi139.stdout:6/528: dwrite f8 [0,4194304] 0 2024-09-17T07:19:55.600 INFO:tasks.workunit.client.1.smithi139.stdout:9/750: mkdir dc/d11/d15/d3c/d61/d64/df8 0 2024-09-17T07:19:55.602 INFO:tasks.workunit.client.0.smithi087.stdout:4/457: getdents d2/d92/d4d/d3e 0 2024-09-17T07:19:55.602 INFO:tasks.workunit.client.1.smithi139.stdout:6/529: stat db/df/d4e/d64 0 2024-09-17T07:19:55.605 INFO:tasks.workunit.client.0.smithi087.stdout:6/632: rename d1/d6/d1a/d2c/f75 to d1/d6/d1a/d2c/fd9 0 2024-09-17T07:19:55.605 INFO:tasks.workunit.client.0.smithi087.stdout:4/458: truncate d2/d92/d4d/d21/f6c 699635 0 2024-09-17T07:19:55.606 INFO:tasks.workunit.client.1.smithi139.stdout:8/540: dread d0/d20/d28/d52/d65/f7b [0,4194304] 0 2024-09-17T07:19:55.606 INFO:tasks.workunit.client.0.smithi087.stdout:9/483: dread d3/d25/d83/f97 [0,4194304] 0 2024-09-17T07:19:55.609 INFO:tasks.workunit.client.0.smithi087.stdout:4/459: mknod d2/d22/d62/ca3 0 2024-09-17T07:19:55.609 INFO:tasks.workunit.client.0.smithi087.stdout:1/454: dwrite d2/d3d/d45/f72 [0,4194304] 0 2024-09-17T07:19:55.610 INFO:tasks.workunit.client.0.smithi087.stdout:9/484: mkdir d3/d4/d6/d8/d12/d32/db2 0 2024-09-17T07:19:55.610 INFO:tasks.workunit.client.0.smithi087.stdout:4/460: readlink d2/d5/d1f/l73 0 2024-09-17T07:19:55.610 INFO:tasks.workunit.client.1.smithi139.stdout:9/751: fsync dc/d11/d15/d3c/d68/fcb 0 2024-09-17T07:19:55.611 INFO:tasks.workunit.client.1.smithi139.stdout:9/752: chown dc/d11/lc3 286225 1 2024-09-17T07:19:55.612 INFO:tasks.workunit.client.1.smithi139.stdout:5/372: symlink d4/d16/d1b/d20/d32/d3d/l6e 0 2024-09-17T07:19:55.612 INFO:tasks.workunit.client.1.smithi139.stdout:0/325: dwrite d1/f26 [0,4194304] 0 2024-09-17T07:19:55.612 INFO:tasks.workunit.client.0.smithi087.stdout:1/455: write d2/d48/f5e [1194602,109119] 0 2024-09-17T07:19:55.613 INFO:tasks.workunit.client.0.smithi087.stdout:1/456: chown d2/d3d/d35/d57 1653668 1 2024-09-17T07:19:55.616 INFO:tasks.workunit.client.1.smithi139.stdout:6/530: unlink db/df/c11 0 2024-09-17T07:19:55.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:55 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:19:55.617 INFO:tasks.workunit.client.0.smithi087.stdout:1/457: mkdir d2/d14/da3 0 2024-09-17T07:19:55.617 INFO:tasks.workunit.client.1.smithi139.stdout:8/541: symlink d0/d1a/d4d/da4/lb0 0 2024-09-17T07:19:55.618 INFO:tasks.workunit.client.0.smithi087.stdout:9/485: unlink d3/d4/d6/d8/d12/d32/f33 0 2024-09-17T07:19:55.619 INFO:tasks.workunit.client.1.smithi139.stdout:1/281: creat d2/f58 x:0 0 0 2024-09-17T07:19:55.619 INFO:tasks.workunit.client.1.smithi139.stdout:6/531: stat db/d18/d38/f92 0 2024-09-17T07:19:55.620 INFO:tasks.workunit.client.1.smithi139.stdout:5/373: rmdir d4/d16/d1b/d20 39 2024-09-17T07:19:55.620 INFO:tasks.workunit.client.0.smithi087.stdout:1/458: dread d2/dc/f3a [0,4194304] 0 2024-09-17T07:19:55.621 INFO:tasks.workunit.client.0.smithi087.stdout:1/459: chown d2/d48/d61/f85 26 1 2024-09-17T07:19:55.622 INFO:tasks.workunit.client.0.smithi087.stdout:9/486: symlink d3/d4/d6/d8/d12/d38/lb3 0 2024-09-17T07:19:55.622 INFO:tasks.workunit.client.0.smithi087.stdout:4/461: getdents d2/d92/d4d/d21/d2f/d6e 0 2024-09-17T07:19:55.623 INFO:tasks.workunit.client.1.smithi139.stdout:3/379: dwrite d5/d15/d16/f17 [0,4194304] 0 2024-09-17T07:19:55.623 INFO:tasks.workunit.client.1.smithi139.stdout:7/383: link d5/d17/f33 d5/d17/d4e/d66/f7c 0 2024-09-17T07:19:55.626 INFO:tasks.workunit.client.1.smithi139.stdout:8/542: write d0/d20/d28/d52/d54/f84 [334958,94554] 0 2024-09-17T07:19:55.626 INFO:tasks.workunit.client.1.smithi139.stdout:9/753: symlink dc/d11/d15/d3c/d61/dc8/d83/d98/dcf/lf9 0 2024-09-17T07:19:55.629 INFO:tasks.workunit.client.1.smithi139.stdout:3/380: chown d5/d15/d20/f42 2369 1 2024-09-17T07:19:55.633 INFO:tasks.workunit.client.1.smithi139.stdout:0/326: mknod d1/da/d1b/c87 0 2024-09-17T07:19:55.637 INFO:tasks.workunit.client.1.smithi139.stdout:8/543: dread d0/d20/d28/f3d [4194304,4194304] 0 2024-09-17T07:19:55.638 INFO:tasks.workunit.client.1.smithi139.stdout:6/532: dwrite db/d18/f44 [0,4194304] 0 2024-09-17T07:19:55.638 INFO:tasks.workunit.client.1.smithi139.stdout:7/384: rename d5/d10/f28 to d5/d10/d4d/f7d 0 2024-09-17T07:19:55.640 INFO:tasks.workunit.client.1.smithi139.stdout:1/282: write d2/fd [2091904,14872] 0 2024-09-17T07:19:55.641 INFO:tasks.workunit.client.1.smithi139.stdout:4/387: dread d0/d1/fd [4194304,4194304] 0 2024-09-17T07:19:55.646 INFO:tasks.workunit.client.1.smithi139.stdout:7/385: chown d5/d10/d4d/f7d 8057 1 2024-09-17T07:19:55.646 INFO:tasks.workunit.client.1.smithi139.stdout:8/544: rename d0/d1a/d3a/f8e to d0/d1a/d3a/fb1 0 2024-09-17T07:19:55.647 INFO:tasks.workunit.client.1.smithi139.stdout:0/327: mknod d1/da/c88 0 2024-09-17T07:19:55.647 INFO:tasks.workunit.client.1.smithi139.stdout:3/381: link d5/d15/f62 d5/d21/d23/d69/f76 0 2024-09-17T07:19:55.648 INFO:tasks.workunit.client.1.smithi139.stdout:0/328: fdatasync d1/da/d1b/d32/f7a 0 2024-09-17T07:19:55.651 INFO:tasks.workunit.client.1.smithi139.stdout:4/388: truncate d0/d1/f15 2138649 0 2024-09-17T07:19:55.655 INFO:tasks.workunit.client.1.smithi139.stdout:5/374: link d4/l4e d4/d16/d1b/d20/d32/l6f 0 2024-09-17T07:19:55.656 INFO:tasks.workunit.client.1.smithi139.stdout:8/545: getdents d0/d20/da2 0 2024-09-17T07:19:55.656 INFO:tasks.workunit.client.1.smithi139.stdout:0/329: dwrite d1/da/d17/f34 [0,4194304] 0 2024-09-17T07:19:55.657 INFO:tasks.workunit.client.1.smithi139.stdout:4/389: mknod d0/d37/c72 0 2024-09-17T07:19:55.659 INFO:tasks.workunit.client.1.smithi139.stdout:3/382: unlink d5/d15/d16/d4c/l4f 0 2024-09-17T07:19:55.659 INFO:tasks.workunit.client.1.smithi139.stdout:8/546: write d0/d1a/d3a/f7c [185059,71673] 0 2024-09-17T07:19:55.662 INFO:tasks.workunit.client.1.smithi139.stdout:8/547: readlink d0/dc/d18/l19 0 2024-09-17T07:19:55.662 INFO:tasks.workunit.client.1.smithi139.stdout:6/533: getdents db/df/d4e/d64/d56 0 2024-09-17T07:19:55.664 INFO:tasks.workunit.client.1.smithi139.stdout:4/390: creat d0/db/d58/f73 x:0 0 0 2024-09-17T07:19:55.664 INFO:tasks.workunit.client.1.smithi139.stdout:8/548: dread - d0/d1a/d4d/da4/fae zero size 2024-09-17T07:19:55.666 INFO:tasks.workunit.client.1.smithi139.stdout:3/383: creat d5/f77 x:0 0 0 2024-09-17T07:19:55.669 INFO:tasks.workunit.client.1.smithi139.stdout:3/384: fdatasync d5/fe 0 2024-09-17T07:19:55.670 INFO:tasks.workunit.client.1.smithi139.stdout:6/534: symlink db/d18/lae 0 2024-09-17T07:19:55.671 INFO:tasks.workunit.client.1.smithi139.stdout:0/330: dwrite d1/da/f78 [0,4194304] 0 2024-09-17T07:19:55.673 INFO:tasks.workunit.client.1.smithi139.stdout:8/549: chown d0/d20/d28/d52/d65/d7f/l95 996075 1 2024-09-17T07:19:55.673 INFO:tasks.workunit.client.1.smithi139.stdout:4/391: link d0/d10/f25 d0/db/f74 0 2024-09-17T07:19:55.675 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:55 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:19:55.676 INFO:tasks.workunit.client.1.smithi139.stdout:6/535: mknod db/df/d4e/caf 0 2024-09-17T07:19:55.676 INFO:tasks.workunit.client.1.smithi139.stdout:6/536: stat db/d18/l90 0 2024-09-17T07:19:55.677 INFO:tasks.workunit.client.1.smithi139.stdout:8/550: creat d0/d1a/d3a/d71/fb2 x:0 0 0 2024-09-17T07:19:55.678 INFO:tasks.workunit.client.1.smithi139.stdout:0/331: creat d1/da/d17/d72/d66/f89 x:0 0 0 2024-09-17T07:19:55.679 INFO:tasks.workunit.client.1.smithi139.stdout:4/392: rmdir d0/d1/d29/d41 39 2024-09-17T07:19:55.679 INFO:tasks.workunit.client.1.smithi139.stdout:8/551: truncate d0/d20/f8f 4788465 0 2024-09-17T07:19:55.680 INFO:tasks.workunit.client.1.smithi139.stdout:3/385: link d5/d21/d23/l6c d5/d21/l78 0 2024-09-17T07:19:55.680 INFO:tasks.workunit.client.1.smithi139.stdout:4/393: chown d0/db/d58/f5e 169065 1 2024-09-17T07:19:55.681 INFO:tasks.workunit.client.1.smithi139.stdout:6/537: mknod db/d18/d1b/da7/cb0 0 2024-09-17T07:19:55.682 INFO:tasks.workunit.client.1.smithi139.stdout:0/332: write d1/da/d1b/d32/f3a [358421,7921] 0 2024-09-17T07:19:55.683 INFO:tasks.workunit.client.1.smithi139.stdout:6/538: write f7 [3687685,91652] 0 2024-09-17T07:19:55.683 INFO:tasks.workunit.client.1.smithi139.stdout:4/394: symlink d0/d10/l75 0 2024-09-17T07:19:55.685 INFO:tasks.workunit.client.1.smithi139.stdout:6/539: fdatasync db/df/d4e/d64/d56/f69 0 2024-09-17T07:19:55.685 INFO:tasks.workunit.client.1.smithi139.stdout:3/386: rename d5/d15/d56/c12 to d5/d21/d23/d38/c79 0 2024-09-17T07:19:55.687 INFO:tasks.workunit.client.1.smithi139.stdout:3/387: write d5/d15/d16/d4c/f66 [284428,88121] 0 2024-09-17T07:19:55.689 INFO:tasks.workunit.client.1.smithi139.stdout:6/540: creat db/d18/d1b/da7/fb1 x:0 0 0 2024-09-17T07:19:55.690 INFO:tasks.workunit.client.1.smithi139.stdout:4/395: symlink d0/l76 0 2024-09-17T07:19:55.690 INFO:tasks.workunit.client.1.smithi139.stdout:0/333: dread d1/da/f78 [0,4194304] 0 2024-09-17T07:19:55.691 INFO:tasks.workunit.client.1.smithi139.stdout:3/388: creat d5/d15/f7a x:0 0 0 2024-09-17T07:19:55.693 INFO:tasks.workunit.client.1.smithi139.stdout:0/334: write d1/da/d1b/d3d/f64 [2824830,5921] 0 2024-09-17T07:19:55.693 INFO:tasks.workunit.client.1.smithi139.stdout:3/389: write d5/f64 [271606,41085] 0 2024-09-17T07:19:55.693 INFO:tasks.workunit.client.1.smithi139.stdout:6/541: write db/df/d4c/f65 [132303,116729] 0 2024-09-17T07:19:55.697 INFO:tasks.workunit.client.1.smithi139.stdout:0/335: unlink d1/da/d17/d72/l23 0 2024-09-17T07:19:55.698 INFO:tasks.workunit.client.1.smithi139.stdout:3/390: mknod d5/d15/d16/d4c/d28/d54/d58/c7b 0 2024-09-17T07:19:55.700 INFO:tasks.workunit.client.1.smithi139.stdout:0/336: symlink d1/d58/l8a 0 2024-09-17T07:19:55.702 INFO:tasks.workunit.client.1.smithi139.stdout:3/391: fdatasync d5/d15/d16/d4c/f46 0 2024-09-17T07:19:55.702 INFO:tasks.workunit.client.1.smithi139.stdout:0/337: chown d1/da/d1b/d32/l4a 1423236 1 2024-09-17T07:19:55.704 INFO:tasks.workunit.client.1.smithi139.stdout:6/542: dread db/f16 [0,4194304] 0 2024-09-17T07:19:55.704 INFO:tasks.workunit.client.1.smithi139.stdout:0/338: rmdir d1/d58 39 2024-09-17T07:19:55.706 INFO:tasks.workunit.client.0.smithi087.stdout:1/460: dwrite d2/d3d/d45/d90/d37/f38 [0,4194304] 0 2024-09-17T07:19:55.706 INFO:tasks.workunit.client.0.smithi087.stdout:4/462: rename d2/d5/d1f/f35 to d2/d92/d4f/d6a/d9d/fa4 0 2024-09-17T07:19:55.707 INFO:tasks.workunit.client.0.smithi087.stdout:9/487: dwrite d3/d4/d16/f5b [0,4194304] 0 2024-09-17T07:19:55.708 INFO:tasks.workunit.client.1.smithi139.stdout:9/754: dread dc/d11/d15/d3c/d68/f90 [0,4194304] 0 2024-09-17T07:19:55.708 INFO:tasks.workunit.client.1.smithi139.stdout:0/339: write d1/da/d1b/f33 [654541,5630] 0 2024-09-17T07:19:55.712 INFO:tasks.workunit.client.1.smithi139.stdout:6/543: fdatasync db/d18/f44 0 2024-09-17T07:19:55.712 INFO:tasks.workunit.client.1.smithi139.stdout:7/386: dread d5/d17/d4e/f69 [0,4194304] 0 2024-09-17T07:19:55.716 INFO:tasks.workunit.client.1.smithi139.stdout:6/544: write f8 [1271676,28708] 0 2024-09-17T07:19:55.717 INFO:tasks.workunit.client.1.smithi139.stdout:4/396: rename d0/f7 to d0/db/d58/f77 0 2024-09-17T07:19:55.725 INFO:tasks.workunit.client.1.smithi139.stdout:9/755: dwrite dc/d11/d15/d3c/d61/f88 [0,4194304] 0 2024-09-17T07:19:55.731 INFO:tasks.workunit.client.1.smithi139.stdout:4/397: mknod d0/d1a/d70/c78 0 2024-09-17T07:19:55.731 INFO:tasks.workunit.client.1.smithi139.stdout:6/545: write db/f16 [1044045,32948] 0 2024-09-17T07:19:55.734 INFO:tasks.workunit.client.1.smithi139.stdout:7/387: dwrite d5/f1e [0,4194304] 0 2024-09-17T07:19:55.735 INFO:tasks.workunit.client.1.smithi139.stdout:4/398: write d0/d49/f52 [32156,4646] 0 2024-09-17T07:19:55.736 INFO:tasks.workunit.client.1.smithi139.stdout:5/375: dwrite d4/d16/d1b/d20/d28/f2a [0,4194304] 0 2024-09-17T07:19:55.738 INFO:tasks.workunit.client.1.smithi139.stdout:4/399: dread - d0/db/d58/f5e zero size 2024-09-17T07:19:55.742 INFO:tasks.workunit.client.1.smithi139.stdout:8/552: truncate d0/d20/d28/fa8 2220912 0 2024-09-17T07:19:55.744 INFO:tasks.workunit.client.1.smithi139.stdout:8/553: write d0/f72 [750565,2957] 0 2024-09-17T07:19:55.747 INFO:tasks.workunit.client.1.smithi139.stdout:9/756: link dc/d11/d15/d3c/d61/d64/fc1 dc/d11/d52/ffa 0 2024-09-17T07:19:55.752 INFO:tasks.workunit.client.1.smithi139.stdout:4/400: rename d0/db/d17/l34 to d0/d1a/d70/l79 0 2024-09-17T07:19:55.754 INFO:tasks.workunit.client.1.smithi139.stdout:8/554: write d0/d20/d28/d52/d65/f7b [3339693,94729] 0 2024-09-17T07:19:55.755 INFO:tasks.workunit.client.1.smithi139.stdout:6/546: creat db/df/d4e/d64/fb2 x:0 0 0 2024-09-17T07:19:55.756 INFO:tasks.workunit.client.1.smithi139.stdout:7/388: link d5/d10/c12 d5/d17/d4e/d7a/c7e 0 2024-09-17T07:19:55.757 INFO:tasks.workunit.client.1.smithi139.stdout:5/376: creat d4/d16/d1b/d20/d32/d6c/f70 x:0 0 0 2024-09-17T07:19:55.761 INFO:tasks.workunit.client.1.smithi139.stdout:8/555: rmdir d0/d1a/d3a/d8d 39 2024-09-17T07:19:55.762 INFO:tasks.workunit.client.1.smithi139.stdout:6/547: unlink db/df/d4c/f65 0 2024-09-17T07:19:55.763 INFO:tasks.workunit.client.1.smithi139.stdout:7/389: creat d5/d17/d4e/f7f x:0 0 0 2024-09-17T07:19:55.764 INFO:tasks.workunit.client.1.smithi139.stdout:4/401: creat d0/d1/d29/d6d/f7a x:0 0 0 2024-09-17T07:19:55.764 INFO:tasks.workunit.client.1.smithi139.stdout:7/390: stat d5/l13 0 2024-09-17T07:19:55.770 INFO:tasks.workunit.client.1.smithi139.stdout:6/548: creat db/d18/d1b/da7/fb3 x:0 0 0 2024-09-17T07:19:55.771 INFO:tasks.workunit.client.1.smithi139.stdout:6/549: chown db/df/d4e/d64/f4d 16486510 1 2024-09-17T07:19:55.772 INFO:tasks.workunit.client.1.smithi139.stdout:4/402: symlink d0/d1/d54/l7b 0 2024-09-17T07:19:55.773 INFO:tasks.workunit.client.1.smithi139.stdout:5/377: mknod d4/d16/d69/c71 0 2024-09-17T07:19:55.773 INFO:tasks.workunit.client.1.smithi139.stdout:6/550: truncate db/df/d4e/d64/fb2 852301 0 2024-09-17T07:19:55.774 INFO:tasks.workunit.client.1.smithi139.stdout:7/391: truncate d5/d10/f2e 692410 0 2024-09-17T07:19:55.774 INFO:tasks.workunit.client.1.smithi139.stdout:6/551: fdatasync f7 0 2024-09-17T07:19:55.775 INFO:tasks.workunit.client.1.smithi139.stdout:5/378: readlink d4/d16/d1b/d20/d28/l13 0 2024-09-17T07:19:55.776 INFO:tasks.workunit.client.1.smithi139.stdout:5/379: stat d4/d16/d1b/d20/d32/d6c 0 2024-09-17T07:19:55.777 INFO:tasks.workunit.client.1.smithi139.stdout:9/757: rename dc/d11/d52/d56/c5f to dc/cfb 0 2024-09-17T07:19:55.782 INFO:tasks.workunit.client.1.smithi139.stdout:5/380: mkdir d4/d16/d1b/d20/d32/d72 0 2024-09-17T07:19:55.784 INFO:tasks.workunit.client.1.smithi139.stdout:4/403: link d0/d1/d29/d6d/f7a d0/d37/d5f/f7c 0 2024-09-17T07:19:55.785 INFO:tasks.workunit.client.1.smithi139.stdout:9/758: mknod dc/d11/d15/d3c/d61/dc8/d9f/cfc 0 2024-09-17T07:19:55.789 INFO:tasks.workunit.client.1.smithi139.stdout:8/556: getdents d0/d1a/d3a 0 2024-09-17T07:19:55.790 INFO:tasks.workunit.client.1.smithi139.stdout:6/552: symlink db/df/d73/lb4 0 2024-09-17T07:19:55.793 INFO:tasks.workunit.client.1.smithi139.stdout:4/404: rename d0/d1a/d70/c78 to d0/d37/c7d 0 2024-09-17T07:19:55.795 INFO:tasks.workunit.client.1.smithi139.stdout:9/759: creat dc/d11/d8b/dc7/ffd x:0 0 0 2024-09-17T07:19:55.798 INFO:tasks.workunit.client.1.smithi139.stdout:8/557: dwrite d0/d1a/d3a/d71/fa5 [0,4194304] 0 2024-09-17T07:19:55.799 INFO:tasks.workunit.client.1.smithi139.stdout:5/381: symlink d4/d16/l73 0 2024-09-17T07:19:55.806 INFO:tasks.workunit.client.1.smithi139.stdout:8/558: dread d0/f72 [0,4194304] 0 2024-09-17T07:19:55.807 INFO:tasks.workunit.client.1.smithi139.stdout:8/559: chown d0/dc/l59 1953 1 2024-09-17T07:19:55.807 INFO:tasks.workunit.client.1.smithi139.stdout:6/553: creat db/df/d4e/d64/d80/fb5 x:0 0 0 2024-09-17T07:19:55.807 INFO:tasks.workunit.client.1.smithi139.stdout:9/760: rmdir dc/d11/d8b 39 2024-09-17T07:19:55.809 INFO:tasks.workunit.client.1.smithi139.stdout:8/560: chown d0/dc/f58 3419387 1 2024-09-17T07:19:55.811 INFO:tasks.workunit.client.1.smithi139.stdout:6/554: read db/df/f84 [2866770,127185] 0 2024-09-17T07:19:55.814 INFO:tasks.workunit.client.1.smithi139.stdout:8/561: chown d0/d20/d28/d52/d65/l97 104509 1 2024-09-17T07:19:55.814 INFO:tasks.workunit.client.1.smithi139.stdout:8/562: stat d0/d1a/l33 0 2024-09-17T07:19:55.814 INFO:tasks.workunit.client.1.smithi139.stdout:7/392: truncate d5/d10/f2e 229633 0 2024-09-17T07:19:55.816 INFO:tasks.workunit.client.1.smithi139.stdout:4/405: getdents d0/d1/d29 0 2024-09-17T07:19:55.817 INFO:tasks.workunit.client.1.smithi139.stdout:9/761: unlink dc/d2c/f5e 0 2024-09-17T07:19:55.817 INFO:tasks.workunit.client.1.smithi139.stdout:6/555: symlink db/d18/d38/lb6 0 2024-09-17T07:19:55.818 INFO:tasks.workunit.client.1.smithi139.stdout:6/556: chown db/d18/d1b/f37 24 1 2024-09-17T07:19:55.819 INFO:tasks.workunit.client.1.smithi139.stdout:4/406: creat d0/db/d58/f7e x:0 0 0 2024-09-17T07:19:55.819 INFO:tasks.workunit.client.1.smithi139.stdout:5/382: getdents d4/d16/d1b/d20/d32/d3d 0 2024-09-17T07:19:55.820 INFO:tasks.workunit.client.1.smithi139.stdout:9/762: mkdir dc/d11/d15/d3c/dfe 0 2024-09-17T07:19:55.862 INFO:tasks.workunit.client.0.smithi087.stdout:4/463: truncate d2/d5/f9c 3160099 0 2024-09-17T07:19:55.864 INFO:tasks.workunit.client.0.smithi087.stdout:1/461: rename d2/d3d/d35/d57/d73/f9f to d2/d69/fa4 0 2024-09-17T07:19:55.865 INFO:tasks.workunit.client.0.smithi087.stdout:4/464: symlink d2/d5/la5 0 2024-09-17T07:19:55.865 INFO:tasks.workunit.client.0.smithi087.stdout:9/488: write d3/d4/da/f55 [833451,100755] 0 2024-09-17T07:19:55.865 INFO:tasks.workunit.client.0.smithi087.stdout:1/462: chown d2/d3d/d45/d90/d43/l92 433 1 2024-09-17T07:19:55.867 INFO:tasks.workunit.client.0.smithi087.stdout:4/465: dread - d2/d92/d4d/d21/d2f/d3b/d7e/fa1 zero size 2024-09-17T07:19:55.913 INFO:tasks.workunit.client.0.smithi087.stdout:1/463: dread d2/d3d/d45/d90/f47 [0,4194304] 0 2024-09-17T07:19:55.925 INFO:tasks.workunit.client.0.smithi087.stdout:9/489: symlink d3/d4/d6/d8/d22/d92/da3/da4/lb4 0 2024-09-17T07:19:55.926 INFO:tasks.workunit.client.0.smithi087.stdout:4/466: creat d2/d92/d4d/d21/d2f/d3b/d7e/d97/fa6 x:0 0 0 2024-09-17T07:19:55.927 INFO:tasks.workunit.client.0.smithi087.stdout:9/490: creat d3/d4/d16/d69/d8a/d1e/d90/fb5 x:0 0 0 2024-09-17T07:19:55.927 INFO:tasks.workunit.client.0.smithi087.stdout:4/467: read - d2/d5/f59 zero size 2024-09-17T07:19:55.929 INFO:tasks.workunit.client.0.smithi087.stdout:4/468: readlink d2/d5/l13 0 2024-09-17T07:19:55.931 INFO:tasks.workunit.client.1.smithi139.stdout:8/563: creat d0/d20/d28/d52/fb3 x:0 0 0 2024-09-17T07:19:55.932 INFO:tasks.workunit.client.1.smithi139.stdout:6/557: mkdir db/db7 0 2024-09-17T07:19:55.932 INFO:tasks.workunit.client.1.smithi139.stdout:7/393: link d5/d17/d4e/l50 d5/d10/l80 0 2024-09-17T07:19:55.933 INFO:tasks.workunit.client.1.smithi139.stdout:8/564: stat d0/d20/d28/d48 0 2024-09-17T07:19:55.933 INFO:tasks.workunit.client.0.smithi087.stdout:9/491: dwrite d3/d4/d16/f3a [0,4194304] 0 2024-09-17T07:19:55.937 INFO:tasks.workunit.client.0.smithi087.stdout:4/469: dwrite d2/d92/d4d/d21/d2f/d6e/f78 [0,4194304] 0 2024-09-17T07:19:55.938 INFO:tasks.workunit.client.0.smithi087.stdout:9/492: creat d3/d4/d16/fb6 x:0 0 0 2024-09-17T07:19:55.939 INFO:tasks.workunit.client.1.smithi139.stdout:6/558: dread - db/df/d4e/d5e/fa8 zero size 2024-09-17T07:19:55.941 INFO:tasks.workunit.client.1.smithi139.stdout:4/407: dwrite d0/d10/f53 [0,4194304] 0 2024-09-17T07:19:55.941 INFO:tasks.workunit.client.0.smithi087.stdout:4/470: mkdir d2/d5/d1f/da7 0 2024-09-17T07:19:55.942 INFO:tasks.workunit.client.1.smithi139.stdout:8/565: read d0/d1a/d4d/d53/f5d [1045228,7278] 0 2024-09-17T07:19:55.943 INFO:tasks.workunit.client.1.smithi139.stdout:5/383: rename d4/d16/d1b/d20/d28/d3f/c59 to d4/d16/d1b/d20/d32/d3d/c74 0 2024-09-17T07:19:55.945 INFO:tasks.workunit.client.0.smithi087.stdout:9/493: dread d3/d4/d6/d8/d12/d32/f9e [0,4194304] 0 2024-09-17T07:19:55.947 INFO:tasks.workunit.client.0.smithi087.stdout:4/471: mkdir d2/d92/d4d/d21/d2f/d3b/d7e/d97/da8 0 2024-09-17T07:19:55.948 INFO:tasks.workunit.client.1.smithi139.stdout:6/559: fdatasync f8 0 2024-09-17T07:19:55.948 INFO:tasks.workunit.client.0.smithi087.stdout:9/494: creat d3/d4/d16/d69/d8a/d1e/d90/d93/fb7 x:0 0 0 2024-09-17T07:19:55.949 INFO:tasks.workunit.client.0.smithi087.stdout:4/472: chown d2/d92/d4d/d21/d2f/d3b/d7e/d97/c9e 174418363 1 2024-09-17T07:19:55.950 INFO:tasks.workunit.client.0.smithi087.stdout:4/473: fdatasync d2/d92/d4d/f3d 0 2024-09-17T07:19:55.950 INFO:tasks.workunit.client.1.smithi139.stdout:9/763: dwrite dc/d2a/fec [0,4194304] 0 2024-09-17T07:19:55.952 INFO:tasks.workunit.client.1.smithi139.stdout:5/384: creat d4/d16/d1b/d20/d67/f75 x:0 0 0 2024-09-17T07:19:55.953 INFO:tasks.workunit.client.0.smithi087.stdout:9/495: rename d3/d4/d6/d8/d12/d32/c3b to d3/dac/cb8 0 2024-09-17T07:19:55.954 INFO:tasks.workunit.client.1.smithi139.stdout:5/385: chown d4/d16/d1b/d20/d67/f75 49141 1 2024-09-17T07:19:55.955 INFO:tasks.workunit.client.1.smithi139.stdout:8/566: mkdir d0/d20/d28/d52/d99/db4 0 2024-09-17T07:19:55.955 INFO:tasks.workunit.client.0.smithi087.stdout:9/496: truncate d3/d4/d6/d8/d12/d38/f70 81206 0 2024-09-17T07:19:55.956 INFO:tasks.workunit.client.0.smithi087.stdout:4/474: symlink d2/d92/d4d/d21/d2f/la9 0 2024-09-17T07:19:55.958 INFO:tasks.workunit.client.1.smithi139.stdout:9/764: rmdir dc/d11/d15/d3c/d68 39 2024-09-17T07:19:55.959 INFO:tasks.workunit.client.0.smithi087.stdout:9/497: mknod d3/d4/d16/d69/d8a/d1e/d90/cb9 0 2024-09-17T07:19:55.959 INFO:tasks.workunit.client.0.smithi087.stdout:9/498: readlink d3/d25/l53 0 2024-09-17T07:19:55.960 INFO:tasks.workunit.client.0.smithi087.stdout:9/499: dread - d3/d4/d6/d8/d22/fa5 zero size 2024-09-17T07:19:55.961 INFO:tasks.workunit.client.0.smithi087.stdout:4/475: getdents d2/d92/d4d/d42 0 2024-09-17T07:19:55.961 INFO:tasks.workunit.client.1.smithi139.stdout:5/386: mkdir d4/d16/d1b/d20/d32/d76 0 2024-09-17T07:19:55.962 INFO:tasks.workunit.client.0.smithi087.stdout:9/500: symlink d3/d4/d16/d69/lba 0 2024-09-17T07:19:55.963 INFO:tasks.workunit.client.1.smithi139.stdout:5/387: read - d4/d16/d1b/d20/d67/f6a zero size 2024-09-17T07:19:55.964 INFO:tasks.workunit.client.0.smithi087.stdout:4/476: mknod d2/d22/d2c/d91/caa 0 2024-09-17T07:19:55.964 INFO:tasks.workunit.client.1.smithi139.stdout:7/394: creat d5/d10/d2b/d40/f81 x:0 0 0 2024-09-17T07:19:55.968 INFO:tasks.workunit.client.0.smithi087.stdout:9/501: link d3/d4/d2f/f8c d3/d4/d6/d8/d22/d43/d84/fbb 0 2024-09-17T07:19:55.968 INFO:tasks.workunit.client.1.smithi139.stdout:8/567: creat d0/fb5 x:0 0 0 2024-09-17T07:19:55.969 INFO:tasks.workunit.client.0.smithi087.stdout:9/502: stat d3/d4/d16/d69/f7b 0 2024-09-17T07:19:55.970 INFO:tasks.workunit.client.1.smithi139.stdout:9/765: rename dc/d2a/l2b to dc/d11/d52/d56/d7a/lff 0 2024-09-17T07:19:55.971 INFO:tasks.workunit.client.1.smithi139.stdout:7/395: getdents d5/d10/d4d/d59 0 2024-09-17T07:19:55.971 INFO:tasks.workunit.client.0.smithi087.stdout:9/503: mknod d3/d4/d16/d69/d8a/d1e/d90/d93/d96/cbc 0 2024-09-17T07:19:55.972 INFO:tasks.workunit.client.1.smithi139.stdout:7/396: readlink d5/d17/l2d 0 2024-09-17T07:19:55.972 INFO:tasks.workunit.client.1.smithi139.stdout:7/397: readlink d5/d17/d4e/d55/l5b 0 2024-09-17T07:19:55.974 INFO:tasks.workunit.client.1.smithi139.stdout:7/398: truncate d5/d17/d4e/f7f 1029085 0 2024-09-17T07:19:55.974 INFO:tasks.workunit.client.1.smithi139.stdout:8/568: rename d0/dc to d0/d20/d28/d52/d65/d7f/db6 0 2024-09-17T07:19:55.976 INFO:tasks.workunit.client.1.smithi139.stdout:9/766: rmdir dc/d11/d15/d3c/d61/dc8/d9f 39 2024-09-17T07:19:55.977 INFO:tasks.workunit.client.1.smithi139.stdout:8/569: stat d0/d20/d28/d52/d65/d7f/db6/d18/c36 0 2024-09-17T07:19:55.978 INFO:tasks.workunit.client.1.smithi139.stdout:8/570: readlink d0/d1a/d4d/l60 0 2024-09-17T07:19:55.981 INFO:tasks.workunit.client.1.smithi139.stdout:7/399: rename d5/d17/d4e/d66/f7c to d5/d67/f82 0 2024-09-17T07:19:55.983 INFO:tasks.workunit.client.0.smithi087.stdout:9/504: truncate d3/d4/d16/f3a 1226632 0 2024-09-17T07:19:55.985 INFO:tasks.workunit.client.1.smithi139.stdout:9/767: dwrite dc/d2a/fec [0,4194304] 0 2024-09-17T07:19:55.986 INFO:tasks.workunit.client.0.smithi087.stdout:4/477: dwrite d2/d92/d4d/d42/f9b [0,4194304] 0 2024-09-17T07:19:55.988 INFO:tasks.workunit.client.1.smithi139.stdout:9/768: write dc/d11/d15/d1e/f21 [1697918,47760] 0 2024-09-17T07:19:55.990 INFO:tasks.workunit.client.1.smithi139.stdout:4/408: truncate d0/d1a/f3e 2717887 0 2024-09-17T07:19:55.991 INFO:tasks.workunit.client.0.smithi087.stdout:4/478: getdents d2/d92/d4d/d21/d2f/d3b 0 2024-09-17T07:19:55.992 INFO:tasks.workunit.client.1.smithi139.stdout:8/571: dwrite d0/d20/d28/d52/d65/d7f/db6/d18/f1f [0,4194304] 0 2024-09-17T07:19:55.992 INFO:tasks.workunit.client.0.smithi087.stdout:4/479: chown d2/d92/d4d/d21/l87 2750 1 2024-09-17T07:19:55.994 INFO:tasks.workunit.client.0.smithi087.stdout:4/480: dread - d2/d92/d4d/d21/d2f/d3b/d7e/fa1 zero size 2024-09-17T07:19:55.994 INFO:tasks.workunit.client.1.smithi139.stdout:4/409: chown d0/db/f21 107 1 2024-09-17T07:19:55.997 INFO:tasks.workunit.client.1.smithi139.stdout:7/400: rename d5/d10/d2b/d40/f6d to d5/d10/f83 0 2024-09-17T07:19:55.998 INFO:tasks.workunit.client.0.smithi087.stdout:4/481: link d2/d22/c93 d2/d5/d1f/cab 0 2024-09-17T07:19:56.001 INFO:tasks.workunit.client.0.smithi087.stdout:4/482: write d2/d92/d4d/f75 [264703,29104] 0 2024-09-17T07:19:56.004 INFO:tasks.workunit.client.1.smithi139.stdout:2/451: sync 2024-09-17T07:19:56.005 INFO:tasks.workunit.client.0.smithi087.stdout:4/483: rename d2/d92/d4f/fa0 to d2/d92/d4d/d42/fac 0 2024-09-17T07:19:56.008 INFO:tasks.workunit.client.0.smithi087.stdout:4/484: link d2/d92/d4d/c4a d2/d22/d62/cad 0 2024-09-17T07:19:56.008 INFO:tasks.workunit.client.0.smithi087.stdout:4/485: readlink d2/d22/l8e 0 2024-09-17T07:19:56.008 INFO:tasks.workunit.client.1.smithi139.stdout:7/401: dwrite d5/d10/d2b/d40/f81 [0,4194304] 0 2024-09-17T07:19:56.009 INFO:tasks.workunit.client.0.smithi087.stdout:4/486: chown d2/d92/d4d/d42/fac 0 1 2024-09-17T07:19:56.010 INFO:tasks.workunit.client.1.smithi139.stdout:9/769: rename dc/d11/d15/d3c/d68/fa0 to dc/d11/d15/d3c/dfe/f100 0 2024-09-17T07:19:56.011 INFO:tasks.workunit.client.0.smithi087.stdout:4/487: rename d2/d92/d4f/d6a/l9f to d2/d92/d4d/d21/d2f/d3b/lae 0 2024-09-17T07:19:56.012 INFO:tasks.workunit.client.1.smithi139.stdout:2/452: mknod d0/dc/d15/c98 0 2024-09-17T07:19:56.012 INFO:tasks.workunit.client.1.smithi139.stdout:7/402: read d5/d17/d4e/f7f [458291,44486] 0 2024-09-17T07:19:56.012 INFO:tasks.workunit.client.0.smithi087.stdout:4/488: truncate d2/f6 4936711 0 2024-09-17T07:19:56.014 INFO:tasks.workunit.client.1.smithi139.stdout:4/410: dread d0/f47 [0,4194304] 0 2024-09-17T07:19:56.014 INFO:tasks.workunit.client.1.smithi139.stdout:8/572: creat d0/d20/d28/d52/fb7 x:0 0 0 2024-09-17T07:19:56.015 INFO:tasks.workunit.client.0.smithi087.stdout:2/493: sync 2024-09-17T07:19:56.016 INFO:tasks.workunit.client.1.smithi139.stdout:8/573: fsync d0/f7d 0 2024-09-17T07:19:56.020 INFO:tasks.workunit.client.1.smithi139.stdout:4/411: mkdir d0/db/d7f 0 2024-09-17T07:19:56.024 INFO:tasks.workunit.client.0.smithi087.stdout:2/494: dread d2/d7/dd/f29 [0,4194304] 0 2024-09-17T07:19:56.025 INFO:tasks.workunit.client.1.smithi139.stdout:9/770: dwrite dc/d11/d15/d3c/f7e [0,4194304] 0 2024-09-17T07:19:56.026 INFO:tasks.workunit.client.1.smithi139.stdout:9/771: stat dc/d11/d15/d3c/d61/dc8/d83/d98/dcf/lf9 0 2024-09-17T07:19:56.026 INFO:tasks.workunit.client.0.smithi087.stdout:4/489: dwrite d2/d92/d4d/d42/fac [0,4194304] 0 2024-09-17T07:19:56.029 INFO:tasks.workunit.client.0.smithi087.stdout:4/490: write d2/d92/d4d/d42/f9b [5456634,60362] 0 2024-09-17T07:19:56.029 INFO:tasks.workunit.client.1.smithi139.stdout:8/574: chown d0/d20/d28/d52/d65/d7f/la0 108076 1 2024-09-17T07:19:56.034 INFO:tasks.workunit.client.1.smithi139.stdout:4/412: rmdir d0/d1a 39 2024-09-17T07:19:56.035 INFO:tasks.workunit.client.0.smithi087.stdout:2/495: dwrite d2/d7/dd/d10/f1d [0,4194304] 0 2024-09-17T07:19:56.035 INFO:tasks.workunit.client.1.smithi139.stdout:8/575: write d0/f72 [111165,102679] 0 2024-09-17T07:19:56.044 INFO:tasks.workunit.client.1.smithi139.stdout:8/576: dread d0/d1a/d4d/d53/f5d [0,4194304] 0 2024-09-17T07:19:56.051 INFO:tasks.workunit.client.1.smithi139.stdout:8/577: creat d0/d1a/fb8 x:0 0 0 2024-09-17T07:19:56.057 INFO:tasks.workunit.client.1.smithi139.stdout:2/453: dread d0/de/d11/d28/f2d [0,4194304] 0 2024-09-17T07:19:56.057 INFO:tasks.workunit.client.1.smithi139.stdout:8/578: creat d0/d20/d28/d52/d65/d7f/db6/fb9 x:0 0 0 2024-09-17T07:19:56.058 INFO:tasks.workunit.client.1.smithi139.stdout:9/772: dwrite dc/d11/d15/d3c/d61/d64/fc1 [4194304,4194304] 0 2024-09-17T07:19:56.059 INFO:tasks.workunit.client.1.smithi139.stdout:8/579: chown d0/d1a/d4d 2552 1 2024-09-17T07:19:56.060 INFO:tasks.workunit.client.0.smithi087.stdout:4/491: mknod d2/d92/d4f/d6a/caf 0 2024-09-17T07:19:56.061 INFO:tasks.workunit.client.0.smithi087.stdout:2/496: symlink d2/d48/l9e 0 2024-09-17T07:19:56.062 INFO:tasks.workunit.client.0.smithi087.stdout:2/497: stat d2/d7/dd/f79 0 2024-09-17T07:19:56.064 INFO:tasks.workunit.client.1.smithi139.stdout:7/403: dread d5/f23 [4194304,4194304] 0 2024-09-17T07:19:56.065 INFO:tasks.workunit.client.1.smithi139.stdout:2/454: rename d0/de/d11/d32 to d0/d7/d67/d92/d99 0 2024-09-17T07:19:56.067 INFO:tasks.workunit.client.1.smithi139.stdout:2/455: readlink d0/d4e/l6e 0 2024-09-17T07:19:56.069 INFO:tasks.workunit.client.0.smithi087.stdout:2/498: dread d2/d24/f64 [0,4194304] 0 2024-09-17T07:19:56.070 INFO:tasks.workunit.client.0.smithi087.stdout:2/499: write d2/d7/d30/d3f/f93 [204244,50865] 0 2024-09-17T07:19:56.071 INFO:tasks.workunit.client.0.smithi087.stdout:2/500: chown d2/f52 51 1 2024-09-17T07:19:56.072 INFO:tasks.workunit.client.1.smithi139.stdout:8/580: dwrite d0/f72 [0,4194304] 0 2024-09-17T07:19:56.072 INFO:tasks.workunit.client.0.smithi087.stdout:2/501: fsync d2/d15/f2c 0 2024-09-17T07:19:56.075 INFO:tasks.workunit.client.1.smithi139.stdout:2/456: chown d0/de/d25/d3f/l6b 1 1 2024-09-17T07:19:56.075 INFO:tasks.workunit.client.0.smithi087.stdout:2/502: mkdir d2/d7/dd/d1f/d3a/d9f 0 2024-09-17T07:19:56.078 INFO:tasks.workunit.client.1.smithi139.stdout:9/773: dwrite dc/d11/d52/d56/d75/fdd [0,4194304] 0 2024-09-17T07:19:56.082 INFO:tasks.workunit.client.1.smithi139.stdout:2/457: mknod d0/d7/d67/c9a 0 2024-09-17T07:19:56.083 INFO:tasks.workunit.client.1.smithi139.stdout:8/581: chown d0/fd 2356497 1 2024-09-17T07:19:56.083 INFO:tasks.workunit.client.1.smithi139.stdout:7/404: link d5/l26 d5/d10/d2b/d40/l84 0 2024-09-17T07:19:56.083 INFO:tasks.workunit.client.1.smithi139.stdout:9/774: creat dc/d11/d15/d3c/d61/f101 x:0 0 0 2024-09-17T07:19:56.084 INFO:tasks.workunit.client.0.smithi087.stdout:2/503: getdents d2/d12 0 2024-09-17T07:19:56.085 INFO:tasks.workunit.client.1.smithi139.stdout:2/458: stat d0/d7/d67/d92/l94 0 2024-09-17T07:19:56.087 INFO:tasks.workunit.client.0.smithi087.stdout:2/504: mkdir d2/d48/d69/da0 0 2024-09-17T07:19:56.088 INFO:tasks.workunit.client.1.smithi139.stdout:2/459: chown d0/d7/l35 427 1 2024-09-17T07:19:56.088 INFO:tasks.workunit.client.1.smithi139.stdout:9/775: write dc/d11/d15/fca [542740,45203] 0 2024-09-17T07:19:56.090 INFO:tasks.workunit.client.0.smithi087.stdout:2/505: mknod d2/d7/dd/d10/d4c/ca1 0 2024-09-17T07:19:56.091 INFO:tasks.workunit.client.1.smithi139.stdout:7/405: rmdir d5/d10/d2b/d78 39 2024-09-17T07:19:56.092 INFO:tasks.workunit.client.1.smithi139.stdout:7/406: write d5/f18 [2513640,31593] 0 2024-09-17T07:19:56.093 INFO:tasks.workunit.client.1.smithi139.stdout:8/582: dwrite d0/d1a/f39 [0,4194304] 0 2024-09-17T07:19:56.094 INFO:tasks.workunit.client.1.smithi139.stdout:9/776: symlink dc/d11/d52/l102 0 2024-09-17T07:19:56.096 INFO:tasks.workunit.client.1.smithi139.stdout:7/407: truncate d5/f18 4718657 0 2024-09-17T07:19:56.097 INFO:tasks.workunit.client.1.smithi139.stdout:9/777: dread - dc/d11/d15/d3c/d61/d64/ff4 zero size 2024-09-17T07:19:56.099 INFO:tasks.workunit.client.0.smithi087.stdout:7/418: sync 2024-09-17T07:19:56.100 INFO:tasks.workunit.client.0.smithi087.stdout:5/651: sync 2024-09-17T07:19:56.100 INFO:tasks.workunit.client.0.smithi087.stdout:0/743: sync 2024-09-17T07:19:56.102 INFO:tasks.workunit.client.1.smithi139.stdout:8/583: symlink d0/d96/lba 0 2024-09-17T07:19:56.103 INFO:tasks.workunit.client.1.smithi139.stdout:9/778: write dc/d11/d15/d3c/d68/fb9 [404305,49154] 0 2024-09-17T07:19:56.103 INFO:tasks.workunit.client.1.smithi139.stdout:7/408: fsync d5/d10/d2b/d40/d47/f72 0 2024-09-17T07:19:56.103 INFO:tasks.workunit.client.1.smithi139.stdout:2/460: dwrite d0/de/f80 [0,4194304] 0 2024-09-17T07:19:56.109 INFO:tasks.workunit.client.1.smithi139.stdout:7/409: mknod d5/d10/c85 0 2024-09-17T07:19:56.110 INFO:tasks.workunit.client.1.smithi139.stdout:7/410: chown d5/f58 14792478 1 2024-09-17T07:19:56.112 INFO:tasks.workunit.client.0.smithi087.stdout:5/652: link d5/d18/d20/d2f/f48 d5/d8/d1f/d68/fd3 0 2024-09-17T07:19:56.115 INFO:tasks.workunit.client.1.smithi139.stdout:2/461: link d0/d3b/f51 d0/f9b 0 2024-09-17T07:19:56.115 INFO:tasks.workunit.client.1.smithi139.stdout:7/411: mknod d5/d10/d4d/c86 0 2024-09-17T07:19:56.121 INFO:tasks.workunit.client.0.smithi087.stdout:7/419: dread d0/d3/f1f [0,4194304] 0 2024-09-17T07:19:56.123 INFO:tasks.workunit.client.1.smithi139.stdout:2/462: rename d0/de/d54/c84 to d0/de/d11/d12/c9c 0 2024-09-17T07:19:56.124 INFO:tasks.workunit.client.1.smithi139.stdout:8/584: write d0/fd [3322815,109032] 0 2024-09-17T07:19:56.124 INFO:tasks.workunit.client.0.smithi087.stdout:7/420: write d0/d3/d10/f1a [4494458,112957] 0 2024-09-17T07:19:56.125 INFO:tasks.workunit.client.0.smithi087.stdout:7/421: stat d0/d3/d23/f2b 0 2024-09-17T07:19:56.129 INFO:tasks.workunit.client.0.smithi087.stdout:7/422: creat d0/d3/d10/d32/d62/f88 x:0 0 0 2024-09-17T07:19:56.130 INFO:tasks.workunit.client.1.smithi139.stdout:9/779: dread dc/d11/d52/fa2 [0,4194304] 0 2024-09-17T07:19:56.130 INFO:tasks.workunit.client.1.smithi139.stdout:2/463: link d0/de/d11/d12/d45/l68 d0/de/d11/d28/l9d 0 2024-09-17T07:19:56.131 INFO:tasks.workunit.client.0.smithi087.stdout:7/423: write d0/d3/d23/d2d/f7d [138786,98467] 0 2024-09-17T07:19:56.133 INFO:tasks.workunit.client.1.smithi139.stdout:9/780: symlink dc/d11/d15/d1e/d34/l103 0 2024-09-17T07:19:56.133 INFO:tasks.workunit.client.0.smithi087.stdout:7/424: mkdir d0/d3/d86/d89 0 2024-09-17T07:19:56.133 INFO:tasks.workunit.client.1.smithi139.stdout:2/464: truncate d0/d3b/f5d 312699 0 2024-09-17T07:19:56.135 INFO:tasks.workunit.client.0.smithi087.stdout:7/425: fsync d0/d3/d23/f60 0 2024-09-17T07:19:56.138 INFO:tasks.workunit.client.0.smithi087.stdout:7/426: creat d0/d3/d23/d4e/f8a x:0 0 0 2024-09-17T07:19:56.144 INFO:tasks.workunit.client.0.smithi087.stdout:7/427: dread d0/d3/f4 [0,4194304] 0 2024-09-17T07:19:56.147 INFO:tasks.workunit.client.0.smithi087.stdout:7/428: rename d0/f26 to d0/d7a/f8b 0 2024-09-17T07:19:56.147 INFO:tasks.workunit.client.0.smithi087.stdout:4/492: symlink d2/d22/d2c/lb0 0 2024-09-17T07:19:56.151 INFO:tasks.workunit.client.0.smithi087.stdout:4/493: write d2/d92/d4d/d21/d2f/d3b/f56 [3970183,26984] 0 2024-09-17T07:19:56.156 INFO:tasks.workunit.client.0.smithi087.stdout:4/494: getdents d2 0 2024-09-17T07:19:56.159 INFO:tasks.workunit.client.0.smithi087.stdout:4/495: symlink d2/d92/d4d/lb1 0 2024-09-17T07:19:56.160 INFO:tasks.workunit.client.0.smithi087.stdout:4/496: fsync d2/d92/d4d/d21/d2f/d3b/d7e/d97/fa6 0 2024-09-17T07:19:56.163 INFO:tasks.workunit.client.0.smithi087.stdout:4/497: rename d2/d22/c6d to d2/d22/d2c/d91/cb2 0 2024-09-17T07:19:56.164 INFO:tasks.workunit.client.0.smithi087.stdout:4/498: write d2/d92/d4d/d21/f79 [1153509,12004] 0 2024-09-17T07:19:56.165 INFO:tasks.workunit.client.0.smithi087.stdout:2/506: write d2/d15/f45 [1459043,130031] 0 2024-09-17T07:19:56.166 INFO:tasks.workunit.client.0.smithi087.stdout:0/744: write db/f3e [1272154,40000] 0 2024-09-17T07:19:56.168 INFO:tasks.workunit.client.0.smithi087.stdout:4/499: read d2/d92/d4d/d21/d2f/f8c [29116,92283] 0 2024-09-17T07:19:56.173 INFO:tasks.workunit.client.0.smithi087.stdout:2/507: rename d2/d7/dd/d1f to d2/d48/da2 0 2024-09-17T07:19:56.173 INFO:tasks.workunit.client.0.smithi087.stdout:4/500: dread d2/f7 [0,4194304] 0 2024-09-17T07:19:56.175 INFO:tasks.workunit.client.0.smithi087.stdout:0/745: mknod db/d45/d5b/c115 0 2024-09-17T07:19:56.175 INFO:tasks.workunit.client.0.smithi087.stdout:4/501: dread - d2/d92/d4d/d21/d2f/d3b/f80 zero size 2024-09-17T07:19:56.177 INFO:tasks.workunit.client.0.smithi087.stdout:2/508: creat d2/d96/fa3 x:0 0 0 2024-09-17T07:19:56.178 INFO:tasks.workunit.client.0.smithi087.stdout:2/509: write d2/d7/d30/d3f/f8e [401624,31706] 0 2024-09-17T07:19:56.179 INFO:tasks.workunit.client.0.smithi087.stdout:2/510: fsync d2/d7/dd/f27 0 2024-09-17T07:19:56.180 INFO:tasks.workunit.client.0.smithi087.stdout:4/502: write d2/d92/d4d/d21/d2f/f8c [1204755,103739] 0 2024-09-17T07:19:56.183 INFO:tasks.workunit.client.0.smithi087.stdout:2/511: mkdir d2/d48/da2/d3a/da4 0 2024-09-17T07:19:56.183 INFO:tasks.workunit.client.0.smithi087.stdout:4/503: truncate d2/d92/d4d/d21/d2f/d3b/f9a 805489 0 2024-09-17T07:19:56.184 INFO:tasks.workunit.client.0.smithi087.stdout:2/512: rename d2/d24/d36 to d2/d24/d36/da5 22 2024-09-17T07:19:56.188 INFO:tasks.workunit.client.0.smithi087.stdout:4/504: creat d2/d92/d4d/d21/d2f/fb3 x:0 0 0 2024-09-17T07:19:56.190 INFO:tasks.workunit.client.0.smithi087.stdout:4/505: chown d2/d22/d2c/d91 23513251 1 2024-09-17T07:19:56.190 INFO:tasks.workunit.client.0.smithi087.stdout:7/429: dwrite d0/d3/f3e [0,4194304] 0 2024-09-17T07:19:56.191 INFO:tasks.workunit.client.0.smithi087.stdout:0/746: write db/d45/d5d/fac [581641,17869] 0 2024-09-17T07:19:56.196 INFO:tasks.workunit.client.0.smithi087.stdout:7/430: write d0/d3/d23/d2d/f79 [4920476,28977] 0 2024-09-17T07:19:56.196 INFO:tasks.workunit.client.0.smithi087.stdout:0/747: write db/dbe/f114 [777312,100712] 0 2024-09-17T07:19:56.196 INFO:tasks.workunit.client.0.smithi087.stdout:2/513: dwrite d2/d7/dd/f29 [0,4194304] 0 2024-09-17T07:19:56.198 INFO:tasks.workunit.client.0.smithi087.stdout:7/431: write d0/d3/d23/f60 [527353,107125] 0 2024-09-17T07:19:56.198 INFO:tasks.workunit.client.0.smithi087.stdout:4/506: link d2/d92/f65 d2/d92/d4d/d42/fb4 0 2024-09-17T07:19:56.201 INFO:tasks.workunit.client.0.smithi087.stdout:2/514: creat d2/d7/d30/d3f/fa6 x:0 0 0 2024-09-17T07:19:56.202 INFO:tasks.workunit.client.0.smithi087.stdout:0/748: fsync db/d45/d9e/d95/dd8/f106 0 2024-09-17T07:19:56.202 INFO:tasks.workunit.client.0.smithi087.stdout:2/515: chown d2/d48/da2/d3a/d9f 892 1 2024-09-17T07:19:56.203 INFO:tasks.workunit.client.0.smithi087.stdout:4/507: rmdir d2/d92/d4d/d21/d2f 39 2024-09-17T07:19:56.208 INFO:tasks.workunit.client.0.smithi087.stdout:4/508: write d2/d92/d4d/d21/d2f/d3b/f56 [363295,57713] 0 2024-09-17T07:19:56.208 INFO:tasks.workunit.client.0.smithi087.stdout:2/516: mknod d2/d48/da2/d3a/da4/ca7 0 2024-09-17T07:19:56.210 INFO:tasks.workunit.client.0.smithi087.stdout:4/509: write d2/d92/d4d/f75 [509045,68147] 0 2024-09-17T07:19:56.211 INFO:tasks.workunit.client.0.smithi087.stdout:2/517: read d2/d7/d30/f54 [3469744,100226] 0 2024-09-17T07:19:56.212 INFO:tasks.workunit.client.0.smithi087.stdout:4/510: truncate d2/d92/f51 829175 0 2024-09-17T07:19:56.214 INFO:tasks.workunit.client.0.smithi087.stdout:4/511: dread d2/d92/d4d/d3e/f8b [0,4194304] 0 2024-09-17T07:19:56.214 INFO:tasks.workunit.client.0.smithi087.stdout:7/432: truncate d0/d3/d10/d32/f73 1942002 0 2024-09-17T07:19:56.219 INFO:tasks.workunit.client.0.smithi087.stdout:0/749: dwrite db/f1a [0,4194304] 0 2024-09-17T07:19:56.224 INFO:tasks.workunit.client.0.smithi087.stdout:4/512: link d2/d92/d4d/d3e/l66 d2/d5/d1f/da7/lb5 0 2024-09-17T07:19:56.224 INFO:tasks.workunit.client.0.smithi087.stdout:0/750: dread db/d45/f75 [0,4194304] 0 2024-09-17T07:19:56.224 INFO:tasks.workunit.client.0.smithi087.stdout:0/751: readlink db/l3b 0 2024-09-17T07:19:56.225 INFO:tasks.workunit.client.0.smithi087.stdout:2/518: write d2/d7/fe [4648749,118510] 0 2024-09-17T07:19:56.225 INFO:tasks.workunit.client.0.smithi087.stdout:0/752: fsync f5 0 2024-09-17T07:19:56.227 INFO:tasks.workunit.client.0.smithi087.stdout:4/513: mkdir d2/d92/d4d/d42/db6 0 2024-09-17T07:19:56.228 INFO:tasks.workunit.client.0.smithi087.stdout:4/514: stat d2/d92/d4d/d3e/c61 0 2024-09-17T07:19:56.230 INFO:tasks.workunit.client.0.smithi087.stdout:2/519: creat d2/d50/fa8 x:0 0 0 2024-09-17T07:19:56.234 INFO:tasks.workunit.client.0.smithi087.stdout:0/753: dwrite db/faf [0,4194304] 0 2024-09-17T07:19:56.235 INFO:tasks.workunit.client.0.smithi087.stdout:4/515: rename d2/d92/d4d/d3e/l66 to d2/d22/d62/lb7 0 2024-09-17T07:19:56.235 INFO:tasks.workunit.client.0.smithi087.stdout:0/754: write f5 [3221741,4895] 0 2024-09-17T07:19:56.239 INFO:tasks.workunit.client.0.smithi087.stdout:0/755: write db/d45/f75 [545420,77604] 0 2024-09-17T07:19:56.243 INFO:tasks.workunit.client.0.smithi087.stdout:4/516: dwrite d2/d92/f6f [0,4194304] 0 2024-09-17T07:19:56.244 INFO:tasks.workunit.client.0.smithi087.stdout:4/517: fdatasync d2/d5/f9c 0 2024-09-17T07:19:56.246 INFO:tasks.workunit.client.0.smithi087.stdout:2/520: write d2/d24/d36/f38 [1368410,106639] 0 2024-09-17T07:19:56.247 INFO:tasks.workunit.client.0.smithi087.stdout:7/433: dread d0/d3/d23/d17/f47 [0,4194304] 0 2024-09-17T07:19:56.247 INFO:tasks.workunit.client.0.smithi087.stdout:2/521: chown d2/d7/d30/d3f/f8c 2005498759 1 2024-09-17T07:19:56.248 INFO:tasks.workunit.client.0.smithi087.stdout:8/536: sync 2024-09-17T07:19:56.248 INFO:tasks.workunit.client.0.smithi087.stdout:6/633: sync 2024-09-17T07:19:56.248 INFO:tasks.workunit.client.0.smithi087.stdout:1/464: sync 2024-09-17T07:19:56.249 INFO:tasks.workunit.client.0.smithi087.stdout:3/496: sync 2024-09-17T07:19:56.249 INFO:tasks.workunit.client.0.smithi087.stdout:9/505: sync 2024-09-17T07:19:56.249 INFO:tasks.workunit.client.0.smithi087.stdout:7/434: truncate d0/d3/f1f 4506270 0 2024-09-17T07:19:56.250 INFO:tasks.workunit.client.0.smithi087.stdout:4/518: rename d2/f6 to d2/d5/fb8 0 2024-09-17T07:19:56.251 INFO:tasks.workunit.client.0.smithi087.stdout:2/522: creat d2/d7/d33/fa9 x:0 0 0 2024-09-17T07:19:56.252 INFO:tasks.workunit.client.0.smithi087.stdout:3/497: write d6/d15/d37/d3c/f74 [205931,11016] 0 2024-09-17T07:19:56.252 INFO:tasks.workunit.client.0.smithi087.stdout:7/435: write d0/f6 [2357716,46303] 0 2024-09-17T07:19:56.253 INFO:tasks.workunit.client.0.smithi087.stdout:6/634: chown d1/d6/d1a/d2c/d40/d4c/dce/fbb 118318 1 2024-09-17T07:19:56.254 INFO:tasks.workunit.client.0.smithi087.stdout:1/465: mkdir d2/d3d/d35/d4f/da5 0 2024-09-17T07:19:56.255 INFO:tasks.workunit.client.0.smithi087.stdout:8/537: mknod d1/d7/d9/d19/cc0 0 2024-09-17T07:19:56.256 INFO:tasks.workunit.client.0.smithi087.stdout:1/466: write d2/d1a/f3e [489064,59658] 0 2024-09-17T07:19:56.256 INFO:tasks.workunit.client.0.smithi087.stdout:7/436: rmdir d0/d3/d10 39 2024-09-17T07:19:56.257 INFO:tasks.workunit.client.1.smithi139.stdout:1/283: sync 2024-09-17T07:19:56.258 INFO:tasks.workunit.client.0.smithi087.stdout:6/635: mkdir d1/d6a/dda 0 2024-09-17T07:19:56.259 INFO:tasks.workunit.client.0.smithi087.stdout:6/636: write d1/f18 [8054839,42639] 0 2024-09-17T07:19:56.260 INFO:tasks.workunit.client.1.smithi139.stdout:9/781: rename dc/d11/d52/d56/d7a/lc5 to dc/d11/d15/d1e/d53/l104 0 2024-09-17T07:19:56.264 INFO:tasks.workunit.client.0.smithi087.stdout:9/506: rename d3/d4/d6/d8/d12/d32/f58 to d3/d4/d6/d8/d22/d92/fbd 0 2024-09-17T07:19:56.264 INFO:tasks.workunit.client.1.smithi139.stdout:2/465: dwrite d0/d7/d67/d92/d99/f4f [4194304,4194304] 0 2024-09-17T07:19:56.265 INFO:tasks.workunit.client.1.smithi139.stdout:7/412: dread f2 [0,4194304] 0 2024-09-17T07:19:56.267 INFO:tasks.workunit.client.0.smithi087.stdout:7/437: mkdir d0/d3/d10/d32/d8c 0 2024-09-17T07:19:56.267 INFO:tasks.workunit.client.0.smithi087.stdout:8/538: dwrite d1/d2b/d21/f35 [4194304,4194304] 0 2024-09-17T07:19:56.268 INFO:tasks.workunit.client.1.smithi139.stdout:1/284: symlink d2/d10/d12/d13/l59 0 2024-09-17T07:19:56.268 INFO:tasks.workunit.client.1.smithi139.stdout:9/782: chown dc/d11/d15/d3c/d61/d64/ff5 0 1 2024-09-17T07:19:56.271 INFO:tasks.workunit.client.0.smithi087.stdout:6/637: symlink d1/d6/d1a/d2c/d40/ldb 0 2024-09-17T07:19:56.272 INFO:tasks.workunit.client.0.smithi087.stdout:2/523: dread d2/d24/d36/f38 [0,4194304] 0 2024-09-17T07:19:56.273 INFO:tasks.workunit.client.1.smithi139.stdout:1/285: write f0 [3663570,128468] 0 2024-09-17T07:19:56.274 INFO:tasks.workunit.client.0.smithi087.stdout:3/498: getdents d6/d15/d37/d3c 0 2024-09-17T07:19:56.274 INFO:tasks.workunit.client.0.smithi087.stdout:7/438: mkdir d0/d7a/d8d 0 2024-09-17T07:19:56.274 INFO:tasks.workunit.client.0.smithi087.stdout:8/539: fdatasync d1/d7/d9/d19/d1b/d18/fa3 0 2024-09-17T07:19:56.274 INFO:tasks.workunit.client.0.smithi087.stdout:4/519: stat d2/d22/c67 0 2024-09-17T07:19:56.275 INFO:tasks.workunit.client.0.smithi087.stdout:1/467: dwrite d2/d3d/d45/d90/d37/f52 [0,4194304] 0 2024-09-17T07:19:56.276 INFO:tasks.workunit.client.0.smithi087.stdout:6/638: mkdir d1/d67/ddc 0 2024-09-17T07:19:56.276 INFO:tasks.workunit.client.0.smithi087.stdout:9/507: stat d3/d4/d16/d69/d8a/d1e/d90/fb5 0 2024-09-17T07:19:56.280 INFO:tasks.workunit.client.1.smithi139.stdout:7/413: rmdir d5/d10/d4d/d59/d76 0 2024-09-17T07:19:56.281 INFO:tasks.workunit.client.1.smithi139.stdout:8/585: dwrite d0/d1a/f39 [4194304,4194304] 0 2024-09-17T07:19:56.282 INFO:tasks.workunit.client.0.smithi087.stdout:6/639: rmdir d1/d6/d1a/d8a 39 2024-09-17T07:19:56.283 INFO:tasks.workunit.client.0.smithi087.stdout:1/468: chown d2/d1a/c1b 32811789 1 2024-09-17T07:19:56.286 INFO:tasks.workunit.client.1.smithi139.stdout:1/286: getdents d2 0 2024-09-17T07:19:56.289 INFO:tasks.workunit.client.1.smithi139.stdout:7/414: mknod d5/d10/d2b/d71/c87 0 2024-09-17T07:19:56.289 INFO:tasks.workunit.client.0.smithi087.stdout:1/469: readlink d2/d3d/d45/d90/d43/l9e 0 2024-09-17T07:19:56.289 INFO:tasks.workunit.client.0.smithi087.stdout:4/520: write d2/d92/d4d/d21/d2f/d3b/f80 [443647,93673] 0 2024-09-17T07:19:56.291 INFO:tasks.workunit.client.0.smithi087.stdout:7/439: dread d0/d3/d10/d32/f4c [0,4194304] 0 2024-09-17T07:19:56.291 INFO:tasks.workunit.client.1.smithi139.stdout:8/586: read d0/d20/d28/d52/d65/d7f/db6/f6b [3612544,60445] 0 2024-09-17T07:19:56.292 INFO:tasks.workunit.client.1.smithi139.stdout:1/287: symlink d2/d10/d12/d24/l5a 0 2024-09-17T07:19:56.293 INFO:tasks.workunit.client.1.smithi139.stdout:9/783: dwrite dc/d11/d15/d1e/f2e [0,4194304] 0 2024-09-17T07:19:56.296 INFO:tasks.workunit.client.0.smithi087.stdout:7/440: mkdir d0/d36/d8e 0 2024-09-17T07:19:56.296 INFO:tasks.workunit.client.0.smithi087.stdout:2/524: dwrite d2/d24/f7d [0,4194304] 0 2024-09-17T07:19:56.297 INFO:tasks.workunit.client.0.smithi087.stdout:5/653: sync 2024-09-17T07:19:56.297 INFO:tasks.workunit.client.1.smithi139.stdout:7/415: unlink d5/d17/f33 0 2024-09-17T07:19:56.298 INFO:tasks.workunit.client.1.smithi139.stdout:2/466: dwrite d0/fb [4194304,4194304] 0 2024-09-17T07:19:56.299 INFO:tasks.workunit.client.0.smithi087.stdout:1/470: read d2/d1a/f29 [858387,18338] 0 2024-09-17T07:19:56.299 INFO:tasks.workunit.client.0.smithi087.stdout:2/525: readlink d2/d7/d33/l4d 0 2024-09-17T07:19:56.302 INFO:tasks.workunit.client.1.smithi139.stdout:2/467: chown d0/de/d11/l27 251441703 1 2024-09-17T07:19:56.302 INFO:tasks.workunit.client.0.smithi087.stdout:3/499: dwrite d6/d1b/d2b/f7b [0,4194304] 0 2024-09-17T07:19:56.303 INFO:tasks.workunit.client.0.smithi087.stdout:6/640: dwrite d1/d6/d1a/d2c/f52 [0,4194304] 0 2024-09-17T07:19:56.306 INFO:tasks.workunit.client.0.smithi087.stdout:5/654: chown d5/d12/d14/d61/d94 8588193 1 2024-09-17T07:19:56.308 INFO:tasks.workunit.client.0.smithi087.stdout:6/641: chown d1/d6/d1a/d8a 59836243 1 2024-09-17T07:19:56.311 INFO:tasks.workunit.client.1.smithi139.stdout:8/587: link d0/d1a/f3f d0/d1a/fbb 0 2024-09-17T07:19:56.311 INFO:tasks.workunit.client.1.smithi139.stdout:7/416: dwrite d5/d10/d2b/f44 [4194304,4194304] 0 2024-09-17T07:19:56.312 INFO:tasks.workunit.client.0.smithi087.stdout:1/471: dread - d2/d14/f63 zero size 2024-09-17T07:19:56.315 INFO:tasks.workunit.client.1.smithi139.stdout:1/288: dwrite d2/ff [0,4194304] 0 2024-09-17T07:19:56.316 INFO:tasks.workunit.client.0.smithi087.stdout:7/441: creat d0/d3/d10/f8f x:0 0 0 2024-09-17T07:19:56.316 INFO:tasks.workunit.client.0.smithi087.stdout:5/655: chown d5/d8/l50 50913557 1 2024-09-17T07:19:56.317 INFO:tasks.workunit.client.0.smithi087.stdout:1/472: mkdir d2/d69/d8d/da6 0 2024-09-17T07:19:56.318 INFO:tasks.workunit.client.0.smithi087.stdout:3/500: write d6/d1b/f8f [184100,22639] 0 2024-09-17T07:19:56.318 INFO:tasks.workunit.client.1.smithi139.stdout:2/468: dread d0/dc/f13 [4194304,4194304] 0 2024-09-17T07:19:56.318 INFO:tasks.workunit.client.1.smithi139.stdout:9/784: getdents dc/d11/d15/d3c/d61/dc8/d83 0 2024-09-17T07:19:56.318 INFO:tasks.workunit.client.0.smithi087.stdout:6/642: dread d1/d6/d1a/d4e/f82 [0,4194304] 0 2024-09-17T07:19:56.321 INFO:tasks.workunit.client.1.smithi139.stdout:1/289: creat d2/d10/d12/d1a/f5b x:0 0 0 2024-09-17T07:19:56.325 INFO:tasks.workunit.client.0.smithi087.stdout:7/442: readlink d0/d3/d10/d31/l48 0 2024-09-17T07:19:56.328 INFO:tasks.workunit.client.1.smithi139.stdout:1/290: chown d2/d10/d12/d13 8106391 1 2024-09-17T07:19:56.328 INFO:tasks.workunit.client.1.smithi139.stdout:8/588: link d0/d20/d28/d52/d65/d7f/db6/d18/f1f d0/d20/d28/d48/fbc 0 2024-09-17T07:19:56.329 INFO:tasks.workunit.client.0.smithi087.stdout:9/508: dwrite d3/d4/d6/f68 [0,4194304] 0 2024-09-17T07:19:56.330 INFO:tasks.workunit.client.0.smithi087.stdout:5/656: creat d5/d12/d56/d9e/dcb/fd4 x:0 0 0 2024-09-17T07:19:56.333 INFO:tasks.workunit.client.1.smithi139.stdout:2/469: creat d0/f9e x:0 0 0 2024-09-17T07:19:56.334 INFO:tasks.workunit.client.1.smithi139.stdout:9/785: link dc/l1f dc/d11/d15/d3c/d61/d64/l105 0 2024-09-17T07:19:56.335 INFO:tasks.workunit.client.0.smithi087.stdout:8/540: truncate d1/d7/d9/d27/f45 3987088 0 2024-09-17T07:19:56.335 INFO:tasks.workunit.client.0.smithi087.stdout:4/521: truncate d2/d92/d4d/d42/f55 3234875 0 2024-09-17T07:19:56.336 INFO:tasks.workunit.client.0.smithi087.stdout:9/509: truncate d3/d25/f9a 318206 0 2024-09-17T07:19:56.336 INFO:tasks.workunit.client.1.smithi139.stdout:2/470: mkdir d0/dc/d15/d9f 0 2024-09-17T07:19:56.337 INFO:tasks.workunit.client.1.smithi139.stdout:2/471: chown d0/de/d69/f74 1212 1 2024-09-17T07:19:56.339 INFO:tasks.workunit.client.0.smithi087.stdout:6/643: rename d1/d6/d1a/d5e/fae to d1/d6/d1a/d2c/d40/d4c/fdd 0 2024-09-17T07:19:56.339 INFO:tasks.workunit.client.0.smithi087.stdout:1/473: dwrite d2/f2d [0,4194304] 0 2024-09-17T07:19:56.340 INFO:tasks.workunit.client.1.smithi139.stdout:1/291: mkdir d2/d10/d12/d13/d4f/d5c 0 2024-09-17T07:19:56.342 INFO:tasks.workunit.client.1.smithi139.stdout:8/589: unlink d0/d20/d28/d52/d65/d7f/db6/l35 0 2024-09-17T07:19:56.345 INFO:tasks.workunit.client.0.smithi087.stdout:3/501: dwrite d6/d15/d37/d3c/f6f [0,4194304] 0 2024-09-17T07:19:56.345 INFO:tasks.workunit.client.0.smithi087.stdout:1/474: fdatasync d2/da/f9c 0 2024-09-17T07:19:56.346 INFO:tasks.workunit.client.1.smithi139.stdout:8/590: mknod d0/d20/d28/d52/d54/cbd 0 2024-09-17T07:19:56.346 INFO:tasks.workunit.client.1.smithi139.stdout:2/472: symlink d0/d7/d1a/la0 0 2024-09-17T07:19:56.347 INFO:tasks.workunit.client.0.smithi087.stdout:7/443: link d0/d3/d10/d31/c6e d0/d36/d8e/c90 0 2024-09-17T07:19:56.348 INFO:tasks.workunit.client.1.smithi139.stdout:8/591: write d0/d1a/d3a/d71/fb2 [924480,62270] 0 2024-09-17T07:19:56.348 INFO:tasks.workunit.client.1.smithi139.stdout:9/786: getdents dc/d11/d15/d3c 0 2024-09-17T07:19:56.349 INFO:tasks.workunit.client.0.smithi087.stdout:9/510: read - d3/d4/d6/d8/d22/f75 zero size 2024-09-17T07:19:56.349 INFO:tasks.workunit.client.0.smithi087.stdout:2/526: truncate d2/d7/f8 1412355 0 2024-09-17T07:19:56.352 INFO:tasks.workunit.client.0.smithi087.stdout:6/644: unlink d1/d6/d1a/d2c/f2d 0 2024-09-17T07:19:56.352 INFO:tasks.workunit.client.1.smithi139.stdout:8/592: mkdir d0/d20/d28/d52/d65/dbe 0 2024-09-17T07:19:56.353 INFO:tasks.workunit.client.1.smithi139.stdout:9/787: symlink dc/d11/d8b/dc7/l106 0 2024-09-17T07:19:56.354 INFO:tasks.workunit.client.0.smithi087.stdout:1/475: unlink d2/d1a/f29 0 2024-09-17T07:19:56.355 INFO:tasks.workunit.client.0.smithi087.stdout:0/756: dread db/d45/f53 [0,4194304] 0 2024-09-17T07:19:56.356 INFO:tasks.workunit.client.0.smithi087.stdout:2/527: chown d2/d15/f2c 5313 1 2024-09-17T07:19:56.356 INFO:tasks.workunit.client.1.smithi139.stdout:9/788: readlink dc/d11/d15/d1e/l39 0 2024-09-17T07:19:56.357 INFO:tasks.workunit.client.1.smithi139.stdout:8/593: creat d0/d20/d28/d52/d65/dbe/fbf x:0 0 0 2024-09-17T07:19:56.358 INFO:tasks.workunit.client.1.smithi139.stdout:9/789: write dc/d11/d15/f28 [1136570,26279] 0 2024-09-17T07:19:56.359 INFO:tasks.workunit.client.1.smithi139.stdout:9/790: dread - dc/d11/fbd zero size 2024-09-17T07:19:56.359 INFO:tasks.workunit.client.0.smithi087.stdout:6/645: stat d1/d6/d1a/d2c/d33/c38 0 2024-09-17T07:19:56.359 INFO:tasks.workunit.client.0.smithi087.stdout:5/657: dwrite d5/d12/d4d/f47 [4194304,4194304] 0 2024-09-17T07:19:56.359 INFO:tasks.workunit.client.0.smithi087.stdout:7/444: link d0/d3/d23/d2d/c52 d0/d3/d23/d4e/c91 0 2024-09-17T07:19:56.360 INFO:tasks.workunit.client.1.smithi139.stdout:9/791: fdatasync dc/d11/d15/d1e/f65 0 2024-09-17T07:19:56.360 INFO:tasks.workunit.client.1.smithi139.stdout:8/594: fsync d0/d20/d28/f3d 0 2024-09-17T07:19:56.361 INFO:tasks.workunit.client.0.smithi087.stdout:2/528: readlink d2/d15/l2e 0 2024-09-17T07:19:56.362 INFO:tasks.workunit.client.0.smithi087.stdout:0/757: dread - db/d4f/f96 zero size 2024-09-17T07:19:56.362 INFO:tasks.workunit.client.0.smithi087.stdout:5/658: readlink l3 0 2024-09-17T07:19:56.362 INFO:tasks.workunit.client.1.smithi139.stdout:8/595: write d0/d20/d28/d52/f63 [1535016,105088] 0 2024-09-17T07:19:56.365 INFO:tasks.workunit.client.0.smithi087.stdout:8/541: dwrite d1/d2b/d21/d6d/fa6 [0,4194304] 0 2024-09-17T07:19:56.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:56 smithi139 ceph-mon[34403]: pgmap v11: 65 pgs: 65 active+clean; 1.3 GiB data, 5.4 GiB used, 531 GiB / 536 GiB avail; 22 MiB/s rd, 172 MiB/s wr, 310 op/s 2024-09-17T07:19:56.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:56 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:19:56.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:56 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:19:56.366 INFO:tasks.workunit.client.0.smithi087.stdout:9/511: truncate d3/d4/d6/d8/d22/d43/f5f 273522 0 2024-09-17T07:19:56.367 INFO:tasks.workunit.client.0.smithi087.stdout:3/502: dread d6/fa [0,4194304] 0 2024-09-17T07:19:56.369 INFO:tasks.workunit.client.0.smithi087.stdout:5/659: write d5/d8/d1f/d4e/fb5 [361788,41046] 0 2024-09-17T07:19:56.369 INFO:tasks.workunit.client.0.smithi087.stdout:8/542: readlink d1/d2b/d3b/l8b 0 2024-09-17T07:19:56.370 INFO:tasks.workunit.client.0.smithi087.stdout:0/758: rmdir db/d45/d9e/d95/dd8 39 2024-09-17T07:19:56.370 INFO:tasks.workunit.client.0.smithi087.stdout:6/646: chown d1/d6/d1a/d2c/d40/d4c/dce/faf 22270991 1 2024-09-17T07:19:56.371 INFO:tasks.workunit.client.1.smithi139.stdout:1/292: rmdir d2/d10/d12/d24 39 2024-09-17T07:19:56.372 INFO:tasks.workunit.client.0.smithi087.stdout:6/647: stat d1/d67/ddc 0 2024-09-17T07:19:56.373 INFO:tasks.workunit.client.0.smithi087.stdout:0/759: write db/ff3 [314227,119141] 0 2024-09-17T07:19:56.375 INFO:tasks.workunit.client.0.smithi087.stdout:8/543: fsync d1/d7/d9/d19/fb6 0 2024-09-17T07:19:56.376 INFO:tasks.workunit.client.0.smithi087.stdout:6/648: chown d1/d6/d1a/d2c/d40/d4c/da1 1422 1 2024-09-17T07:19:56.378 INFO:tasks.workunit.client.0.smithi087.stdout:9/512: creat d3/d4/d6/fbe x:0 0 0 2024-09-17T07:19:56.379 INFO:tasks.workunit.client.0.smithi087.stdout:5/660: creat d5/d12/d1c/d71/fd5 x:0 0 0 2024-09-17T07:19:56.380 INFO:tasks.workunit.client.0.smithi087.stdout:7/445: getdents d0/d36 0 2024-09-17T07:19:56.380 INFO:tasks.workunit.client.0.smithi087.stdout:2/529: getdents d2/d7/dd/d6a/d6d 0 2024-09-17T07:19:56.382 INFO:tasks.workunit.client.0.smithi087.stdout:6/649: write d1/d6/f7d [869790,95459] 0 2024-09-17T07:19:56.384 INFO:tasks.workunit.client.0.smithi087.stdout:5/661: symlink d5/d12/d56/d9e/dcb/ld6 0 2024-09-17T07:19:56.385 INFO:tasks.workunit.client.1.smithi139.stdout:1/293: link d2/d10/c1e d2/d10/d12/d1a/c5d 0 2024-09-17T07:19:56.387 INFO:tasks.workunit.client.0.smithi087.stdout:2/530: mkdir d2/d7/d33/daa 0 2024-09-17T07:19:56.389 INFO:tasks.workunit.client.0.smithi087.stdout:0/760: rename db/d45/d7b/fa5 to db/d45/d9e/d95/f116 0 2024-09-17T07:19:56.389 INFO:tasks.workunit.client.1.smithi139.stdout:1/294: dread d2/fd [0,4194304] 0 2024-09-17T07:19:56.390 INFO:tasks.workunit.client.1.smithi139.stdout:1/295: readlink d2/d10/d12/d13/l59 0 2024-09-17T07:19:56.390 INFO:tasks.workunit.client.0.smithi087.stdout:6/650: creat d1/d6/d1a/d2c/d40/d4c/da1/fde x:0 0 0 2024-09-17T07:19:56.391 INFO:tasks.workunit.client.1.smithi139.stdout:7/417: write d5/d17/f20 [3563857,89253] 0 2024-09-17T07:19:56.396 INFO:tasks.workunit.client.1.smithi139.stdout:7/418: rmdir d5/d17/d4e/d63 39 2024-09-17T07:19:56.396 INFO:tasks.workunit.client.0.smithi087.stdout:1/476: dread d2/d3d/d45/d90/ff [0,4194304] 0 2024-09-17T07:19:56.398 INFO:tasks.workunit.client.0.smithi087.stdout:0/761: mkdir db/d45/d9e/d86/dd5/deb/d117 0 2024-09-17T07:19:56.400 INFO:tasks.workunit.client.1.smithi139.stdout:2/473: write d0/f3 [803269,64105] 0 2024-09-17T07:19:56.400 INFO:tasks.workunit.client.0.smithi087.stdout:0/762: fdatasync db/fcb 0 2024-09-17T07:19:56.403 INFO:tasks.workunit.client.0.smithi087.stdout:0/763: read db/f21 [1596432,16019] 0 2024-09-17T07:19:56.403 INFO:tasks.workunit.client.0.smithi087.stdout:1/477: dwrite d2/d3d/f21 [0,4194304] 0 2024-09-17T07:19:56.406 INFO:tasks.workunit.client.0.smithi087.stdout:2/531: mknod d2/d48/da2/d3a/d9f/cab 0 2024-09-17T07:19:56.406 INFO:tasks.workunit.client.0.smithi087.stdout:4/522: truncate d2/d92/d4d/fd 550660 0 2024-09-17T07:19:56.407 INFO:tasks.workunit.client.0.smithi087.stdout:2/532: read d2/d7/d30/d3f/f8e [410365,79689] 0 2024-09-17T07:19:56.407 INFO:tasks.workunit.client.0.smithi087.stdout:8/544: getdents d1/d7/d9/d19/d4d 0 2024-09-17T07:19:56.408 INFO:tasks.workunit.client.0.smithi087.stdout:8/545: stat d1/d2b/d21/d6d 0 2024-09-17T07:19:56.409 INFO:tasks.workunit.client.0.smithi087.stdout:6/651: symlink d1/d6/d1a/d2c/d40/dd2/ldf 0 2024-09-17T07:19:56.410 INFO:tasks.workunit.client.0.smithi087.stdout:9/513: dread d3/d4/d6/f13 [0,4194304] 0 2024-09-17T07:19:56.413 INFO:tasks.workunit.client.0.smithi087.stdout:3/503: write d6/d16/f7c [24813,125003] 0 2024-09-17T07:19:56.413 INFO:tasks.workunit.client.1.smithi139.stdout:9/792: dread dc/d11/d15/f17 [0,4194304] 0 2024-09-17T07:19:56.414 INFO:tasks.workunit.client.0.smithi087.stdout:2/533: truncate d2/f25 5143615 0 2024-09-17T07:19:56.414 INFO:tasks.workunit.client.1.smithi139.stdout:1/296: truncate d2/d10/d12/d35/d2b/f2c 2381522 0 2024-09-17T07:19:56.415 INFO:tasks.workunit.client.0.smithi087.stdout:2/534: write d2/d50/f61 [3209255,101797] 0 2024-09-17T07:19:56.417 INFO:tasks.workunit.client.0.smithi087.stdout:6/652: rename d1/d6/d1a/d2c/d33/f4f to d1/d6/d1a/d5e/fe0 0 2024-09-17T07:19:56.418 INFO:tasks.workunit.client.1.smithi139.stdout:2/474: dread d0/f9b [0,4194304] 0 2024-09-17T07:19:56.418 INFO:tasks.workunit.client.1.smithi139.stdout:9/793: unlink dc/d11/d15/f17 0 2024-09-17T07:19:56.424 INFO:tasks.workunit.client.0.smithi087.stdout:7/446: dwrite d0/d3/d23/d2d/f35 [0,4194304] 0 2024-09-17T07:19:56.426 INFO:tasks.workunit.client.0.smithi087.stdout:2/535: mknod d2/d7/dd/d6a/d6d/cac 0 2024-09-17T07:19:56.427 INFO:tasks.workunit.client.1.smithi139.stdout:8/596: dread d0/d20/d28/d52/d65/d7f/db6/d18/f1c [0,4194304] 0 2024-09-17T07:19:56.428 INFO:tasks.workunit.client.0.smithi087.stdout:5/662: truncate d5/d18/d6a/f86 3141938 0 2024-09-17T07:19:56.431 INFO:tasks.workunit.client.1.smithi139.stdout:2/475: dwrite d0/de/d11/d12/d8c/f93 [0,4194304] 0 2024-09-17T07:19:56.432 INFO:tasks.workunit.client.1.smithi139.stdout:9/794: dwrite dc/d11/d15/d3c/d61/f101 [0,4194304] 0 2024-09-17T07:19:56.432 INFO:tasks.workunit.client.0.smithi087.stdout:0/764: creat db/d45/f118 x:0 0 0 2024-09-17T07:19:56.433 INFO:tasks.workunit.client.0.smithi087.stdout:9/514: creat d3/d4/d6/d8/d12/db1/fbf x:0 0 0 2024-09-17T07:19:56.434 INFO:tasks.workunit.client.0.smithi087.stdout:1/478: creat d2/d3d/fa7 x:0 0 0 2024-09-17T07:19:56.435 INFO:tasks.workunit.client.0.smithi087.stdout:9/515: write d3/d4/d6/d8/f14 [1592900,110649] 0 2024-09-17T07:19:56.435 INFO:tasks.workunit.client.0.smithi087.stdout:3/504: mknod d6/d15/d92/ca6 0 2024-09-17T07:19:56.438 INFO:tasks.workunit.client.1.smithi139.stdout:2/476: mkdir d0/d7/d67/da1 0 2024-09-17T07:19:56.441 INFO:tasks.workunit.client.0.smithi087.stdout:7/447: rename d0/d3/d23/d2d/f7d to d0/d36/d8e/f92 0 2024-09-17T07:19:56.443 INFO:tasks.workunit.client.0.smithi087.stdout:5/663: mkdir d5/d6d/dd7 0 2024-09-17T07:19:56.446 INFO:tasks.workunit.client.0.smithi087.stdout:3/505: dwrite d6/d15/d37/d3c/fa2 [0,4194304] 0 2024-09-17T07:19:56.446 INFO:tasks.workunit.client.0.smithi087.stdout:5/664: read d5/f1b [3463436,69721] 0 2024-09-17T07:19:56.447 INFO:tasks.workunit.client.1.smithi139.stdout:8/597: dwrite d0/d20/d28/d52/d99/fa7 [0,4194304] 0 2024-09-17T07:19:56.447 INFO:tasks.workunit.client.0.smithi087.stdout:0/765: rmdir db/d45/d7b/db0 39 2024-09-17T07:19:56.448 INFO:tasks.workunit.client.0.smithi087.stdout:3/506: write d6/d1b/d42/f93 [1835570,123258] 0 2024-09-17T07:19:56.449 INFO:tasks.workunit.client.1.smithi139.stdout:9/795: creat dc/d11/d15/d3c/d61/dc8/f107 x:0 0 0 2024-09-17T07:19:56.449 INFO:tasks.workunit.client.0.smithi087.stdout:0/766: readlink db/d45/d7b/d7e/l9a 0 2024-09-17T07:19:56.450 INFO:tasks.workunit.client.1.smithi139.stdout:1/297: dread f0 [0,4194304] 0 2024-09-17T07:19:56.450 INFO:tasks.workunit.client.0.smithi087.stdout:8/546: truncate d1/d2b/f42 3037609 0 2024-09-17T07:19:56.451 INFO:tasks.workunit.client.0.smithi087.stdout:7/448: dread d0/d3/d23/f60 [0,4194304] 0 2024-09-17T07:19:56.451 INFO:tasks.workunit.client.1.smithi139.stdout:8/598: write d0/d20/d28/d52/d65/f94 [1085972,68089] 0 2024-09-17T07:19:56.453 INFO:tasks.workunit.client.1.smithi139.stdout:1/298: dread - d2/f52 zero size 2024-09-17T07:19:56.454 INFO:tasks.workunit.client.0.smithi087.stdout:2/536: fsync d2/d12/f94 0 2024-09-17T07:19:56.454 INFO:tasks.workunit.client.0.smithi087.stdout:7/449: dread d0/d3/d10/d32/f4c [0,4194304] 0 2024-09-17T07:19:56.457 INFO:tasks.workunit.client.1.smithi139.stdout:9/796: mknod dc/d11/d15/d3c/d61/d64/c108 0 2024-09-17T07:19:56.457 INFO:tasks.workunit.client.1.smithi139.stdout:8/599: rmdir d0/d1a/d82 39 2024-09-17T07:19:56.458 INFO:tasks.workunit.client.0.smithi087.stdout:2/537: chown d2/d7/dd/d6a/d6d/f86 302818 1 2024-09-17T07:19:56.458 INFO:tasks.workunit.client.1.smithi139.stdout:9/797: dread - dc/d11/d15/d3c/d61/d64/d96/fde zero size 2024-09-17T07:19:56.458 INFO:tasks.workunit.client.1.smithi139.stdout:1/299: write d2/d10/d12/d35/f44 [851361,62606] 0 2024-09-17T07:19:56.462 INFO:tasks.workunit.client.0.smithi087.stdout:0/767: creat db/d45/d5b/d92/f119 x:0 0 0 2024-09-17T07:19:56.463 INFO:tasks.workunit.client.0.smithi087.stdout:8/547: symlink d1/d2b/d21/d6d/d6f/lc1 0 2024-09-17T07:19:56.464 INFO:tasks.workunit.client.1.smithi139.stdout:8/600: symlink d0/d1a/d3a/lc0 0 2024-09-17T07:19:56.465 INFO:tasks.workunit.client.0.smithi087.stdout:6/653: dwrite d1/d6/d1a/d2c/d40/fb2 [0,4194304] 0 2024-09-17T07:19:56.466 INFO:tasks.workunit.client.1.smithi139.stdout:8/601: write d0/d20/d28/d52/fb7 [640507,18243] 0 2024-09-17T07:19:56.467 INFO:tasks.workunit.client.1.smithi139.stdout:9/798: creat dc/d11/d15/d3c/d61/d64/df8/f109 x:0 0 0 2024-09-17T07:19:56.468 INFO:tasks.workunit.client.0.smithi087.stdout:1/479: dread d2/d48/d61/f76 [0,4194304] 0 2024-09-17T07:19:56.468 INFO:tasks.workunit.client.0.smithi087.stdout:2/538: rmdir d2/d7/d30/d3f 39 2024-09-17T07:19:56.469 INFO:tasks.workunit.client.0.smithi087.stdout:7/450: write d0/d3/d10/f14 [1568729,15619] 0 2024-09-17T07:19:56.469 INFO:tasks.workunit.client.0.smithi087.stdout:0/768: write db/d45/d7b/d7e/fc6 [441276,5519] 0 2024-09-17T07:19:56.470 INFO:tasks.workunit.client.0.smithi087.stdout:9/516: rename d3/d4/d2f to d3/d4/d16/dc0 0 2024-09-17T07:19:56.472 INFO:tasks.workunit.client.1.smithi139.stdout:9/799: write dc/d11/d15/d3c/fbb [3723811,74499] 0 2024-09-17T07:19:56.473 INFO:tasks.workunit.client.0.smithi087.stdout:9/517: stat d3/d4/d16/d69/d8a/d1e 0 2024-09-17T07:19:56.474 INFO:tasks.workunit.client.0.smithi087.stdout:8/548: creat d1/d2b/d21/d6d/d6f/fc2 x:0 0 0 2024-09-17T07:19:56.475 INFO:tasks.workunit.client.0.smithi087.stdout:9/518: write d3/d4/d6/d8/d22/d2a/faa [727719,50432] 0 2024-09-17T07:19:56.476 INFO:tasks.workunit.client.1.smithi139.stdout:9/800: dread - dc/d11/d15/d3c/d61/d64/fc9 zero size 2024-09-17T07:19:56.476 INFO:tasks.workunit.client.1.smithi139.stdout:8/602: rename d0/d20/d28/d52/d65/d7f/db6/l49 to d0/d1a/d82/lc1 0 2024-09-17T07:19:56.477 INFO:tasks.workunit.client.1.smithi139.stdout:2/477: dwrite d0/de/f36 [0,4194304] 0 2024-09-17T07:19:56.478 INFO:tasks.workunit.client.0.smithi087.stdout:6/654: mkdir d1/d6/d1a/d4e/de1 0 2024-09-17T07:19:56.478 INFO:tasks.workunit.client.0.smithi087.stdout:9/519: truncate d3/d4/d16/d69/d8a/d1e/d90/d93/f9d 1378634 0 2024-09-17T07:19:56.479 INFO:tasks.workunit.client.0.smithi087.stdout:2/539: symlink d2/d12/d85/lad 0 2024-09-17T07:19:56.479 INFO:tasks.workunit.client.0.smithi087.stdout:6/655: dread - d1/d6/d1a/d2c/d48/f8c zero size 2024-09-17T07:19:56.480 INFO:tasks.workunit.client.0.smithi087.stdout:0/769: mknod db/dbe/c11a 0 2024-09-17T07:19:56.480 INFO:tasks.workunit.client.0.smithi087.stdout:6/656: dread - d1/d6/d1a/d8a/fd6 zero size 2024-09-17T07:19:56.482 INFO:tasks.workunit.client.1.smithi139.stdout:2/478: dread - d0/de/d11/d12/f77 zero size 2024-09-17T07:19:56.482 INFO:tasks.workunit.client.0.smithi087.stdout:3/507: rename d6/d15/d37/d3c/d52/ca4 to d6/d1b/d42/d95/ca7 0 2024-09-17T07:19:56.484 INFO:tasks.workunit.client.1.smithi139.stdout:1/300: fsync d2/d10/d12/d35/f44 0 2024-09-17T07:19:56.485 INFO:tasks.workunit.client.0.smithi087.stdout:8/549: rmdir d1/d7/d63 39 2024-09-17T07:19:56.485 INFO:tasks.workunit.client.1.smithi139.stdout:9/801: write dc/d11/d15/d3c/d61/fc0 [2656076,124171] 0 2024-09-17T07:19:56.485 INFO:tasks.workunit.client.0.smithi087.stdout:1/480: symlink d2/d69/d8d/da6/la8 0 2024-09-17T07:19:56.486 INFO:tasks.workunit.client.0.smithi087.stdout:5/665: link d5/d18/d6a/c9d d5/d12/d56/cd8 0 2024-09-17T07:19:56.488 INFO:tasks.workunit.client.0.smithi087.stdout:9/520: mkdir d3/d25/dc1 0 2024-09-17T07:19:56.490 INFO:tasks.workunit.client.1.smithi139.stdout:8/603: dread d0/d20/d28/d52/d65/f7b [0,4194304] 0 2024-09-17T07:19:56.490 INFO:tasks.workunit.client.1.smithi139.stdout:2/479: symlink d0/de/la2 0 2024-09-17T07:19:56.490 INFO:tasks.workunit.client.1.smithi139.stdout:9/802: fsync dc/d11/d15/d3c/d61/d64/d96/fde 0 2024-09-17T07:19:56.492 INFO:tasks.workunit.client.0.smithi087.stdout:6/657: mkdir d1/d6/d1a/d2c/d40/dd2/de2 0 2024-09-17T07:19:56.495 INFO:tasks.workunit.client.0.smithi087.stdout:6/658: chown d1/d6/d1a/d4e/c55 7240700 1 2024-09-17T07:19:56.495 INFO:tasks.workunit.client.1.smithi139.stdout:9/803: symlink dc/d2c/l10a 0 2024-09-17T07:19:56.496 INFO:tasks.workunit.client.0.smithi087.stdout:3/508: unlink d6/d15/d37/c5d 0 2024-09-17T07:19:56.497 INFO:tasks.workunit.client.0.smithi087.stdout:9/521: dwrite d3/d4/d6/d8/d12/d38/f56 [0,4194304] 0 2024-09-17T07:19:56.498 INFO:tasks.workunit.client.1.smithi139.stdout:1/301: mknod d2/d10/d12/d35/d2b/d4a/c5e 0 2024-09-17T07:19:56.501 INFO:tasks.workunit.client.1.smithi139.stdout:8/604: creat d0/d1a/d4d/fc2 x:0 0 0 2024-09-17T07:19:56.503 INFO:tasks.workunit.client.0.smithi087.stdout:8/550: symlink d1/d7/d63/lc3 0 2024-09-17T07:19:56.503 INFO:tasks.workunit.client.1.smithi139.stdout:9/804: mknod dc/d11/d15/d1e/c10b 0 2024-09-17T07:19:56.505 INFO:tasks.workunit.client.0.smithi087.stdout:3/509: creat d6/d1b/d42/d6e/fa8 x:0 0 0 2024-09-17T07:19:56.505 INFO:tasks.workunit.client.1.smithi139.stdout:8/605: chown d0/d20/d28/d52/d65/d7f/db6/l59 49049 1 2024-09-17T07:19:56.506 INFO:tasks.workunit.client.1.smithi139.stdout:2/480: getdents d0/d7/d67 0 2024-09-17T07:19:56.507 INFO:tasks.workunit.client.1.smithi139.stdout:8/606: write d0/f9 [594692,29628] 0 2024-09-17T07:19:56.511 INFO:tasks.workunit.client.0.smithi087.stdout:0/770: rmdir db/dbe 39 2024-09-17T07:19:56.514 INFO:tasks.workunit.client.0.smithi087.stdout:3/510: symlink d6/d15/d37/d3c/d43/d48/la9 0 2024-09-17T07:19:56.516 INFO:tasks.workunit.client.0.smithi087.stdout:8/551: dwrite d1/d2b/d21/d6d/d6f/fc2 [0,4194304] 0 2024-09-17T07:19:56.516 INFO:tasks.workunit.client.0.smithi087.stdout:7/451: truncate d0/d3/f1f 761967 0 2024-09-17T07:19:56.516 INFO:tasks.workunit.client.0.smithi087.stdout:0/771: fdatasync db/d45/d7b/d90/f8a 0 2024-09-17T07:19:56.517 INFO:tasks.workunit.client.1.smithi139.stdout:2/481: dwrite d0/d7/f19 [4194304,4194304] 0 2024-09-17T07:19:56.519 INFO:tasks.workunit.client.0.smithi087.stdout:5/666: link d5/d6d/lc6 d5/d18/d20/d7a/ld9 0 2024-09-17T07:19:56.519 INFO:tasks.workunit.client.0.smithi087.stdout:1/481: dread d2/d3d/d45/d90/f18 [0,4194304] 0 2024-09-17T07:19:56.520 INFO:tasks.workunit.client.1.smithi139.stdout:9/805: dwrite dc/d11/d15/d3c/d61/d64/fc1 [4194304,4194304] 0 2024-09-17T07:19:56.523 INFO:tasks.workunit.client.1.smithi139.stdout:8/607: dwrite d0/d20/d28/d52/d65/d7f/db6/f6b [0,4194304] 0 2024-09-17T07:19:56.523 INFO:tasks.workunit.client.0.smithi087.stdout:1/482: chown d2/d48 15439 1 2024-09-17T07:19:56.524 INFO:tasks.workunit.client.0.smithi087.stdout:9/522: creat d3/d4/d16/fc2 x:0 0 0 2024-09-17T07:19:56.524 INFO:tasks.workunit.client.1.smithi139.stdout:2/482: creat d0/de/d69/fa3 x:0 0 0 2024-09-17T07:19:56.526 INFO:tasks.workunit.client.1.smithi139.stdout:8/608: chown d0/d20/d28/d52/l56 0 1 2024-09-17T07:19:56.526 INFO:tasks.workunit.client.1.smithi139.stdout:2/483: fdatasync d0/f3 0 2024-09-17T07:19:56.526 INFO:tasks.workunit.client.1.smithi139.stdout:9/806: truncate dc/d11/dbe/fee 1759166 0 2024-09-17T07:19:56.528 INFO:tasks.workunit.client.1.smithi139.stdout:2/484: stat d0/d7/d1a/d1b/f90 0 2024-09-17T07:19:56.528 INFO:tasks.workunit.client.0.smithi087.stdout:3/511: rename d6/d15/f29 to d6/d1b/d42/d62/faa 0 2024-09-17T07:19:56.531 INFO:tasks.workunit.client.0.smithi087.stdout:7/452: fsync d0/d3/d10/d32/f73 0 2024-09-17T07:19:56.532 INFO:tasks.workunit.client.1.smithi139.stdout:9/807: symlink dc/d11/d15/d3c/d61/d64/d96/l10c 0 2024-09-17T07:19:56.534 INFO:tasks.workunit.client.0.smithi087.stdout:5/667: creat d5/d12/d14/d61/fda x:0 0 0 2024-09-17T07:19:56.534 INFO:tasks.workunit.client.0.smithi087.stdout:2/540: dwrite d2/f16 [0,4194304] 0 2024-09-17T07:19:56.536 INFO:tasks.workunit.client.0.smithi087.stdout:6/659: dread d1/d67/f8d [0,4194304] 0 2024-09-17T07:19:56.536 INFO:tasks.workunit.client.1.smithi139.stdout:2/485: rename d0/de/d11 to d0/d7/d86/da4 0 2024-09-17T07:19:56.538 INFO:tasks.workunit.client.1.smithi139.stdout:2/486: read d0/d3b/f5d [62439,76904] 0 2024-09-17T07:19:56.538 INFO:tasks.workunit.client.0.smithi087.stdout:1/483: link d2/dc/f23 d2/d3d/d8e/fa9 0 2024-09-17T07:19:56.539 INFO:tasks.workunit.client.0.smithi087.stdout:0/772: dread db/d45/d9e/d95/fee [0,4194304] 0 2024-09-17T07:19:56.539 INFO:tasks.workunit.client.1.smithi139.stdout:2/487: stat d0/d7/d86/da4/f83 0 2024-09-17T07:19:56.540 INFO:tasks.workunit.client.0.smithi087.stdout:3/512: rename d6/d16/l22 to d6/d15/d37/d3c/d43/lab 0 2024-09-17T07:19:56.540 INFO:tasks.workunit.client.1.smithi139.stdout:1/302: dread d2/d10/d12/d13/f16 [0,4194304] 0 2024-09-17T07:19:56.540 INFO:tasks.workunit.client.0.smithi087.stdout:6/660: write d1/d6/d1a/d2c/d40/d4c/dce/fbb [514309,79711] 0 2024-09-17T07:19:56.541 INFO:tasks.workunit.client.1.smithi139.stdout:2/488: readlink d0/de/df/l16 0 2024-09-17T07:19:56.542 INFO:tasks.workunit.client.0.smithi087.stdout:3/513: fsync d6/d15/d37/d3c/f8d 0 2024-09-17T07:19:56.544 INFO:tasks.workunit.client.1.smithi139.stdout:2/489: symlink d0/d7/d86/da4/d28/la5 0 2024-09-17T07:19:56.545 INFO:tasks.workunit.client.1.smithi139.stdout:1/303: chown d2/fd 248 1 2024-09-17T07:19:56.545 INFO:tasks.workunit.client.0.smithi087.stdout:7/453: symlink d0/d3/d10/d32/l93 0 2024-09-17T07:19:56.547 INFO:tasks.workunit.client.1.smithi139.stdout:2/490: dread - d0/de/d69/f74 zero size 2024-09-17T07:19:56.548 INFO:tasks.workunit.client.0.smithi087.stdout:2/541: mknod d2/d7/dd/d10/d4c/d5f/d8b/cae 0 2024-09-17T07:19:56.548 INFO:tasks.workunit.client.1.smithi139.stdout:3/392: sync 2024-09-17T07:19:56.550 INFO:tasks.workunit.client.1.smithi139.stdout:3/393: write d5/f2b [625583,110692] 0 2024-09-17T07:19:56.550 INFO:tasks.workunit.client.0.smithi087.stdout:0/773: chown db/d45/d5b/l5c 95444682 1 2024-09-17T07:19:56.550 INFO:tasks.workunit.client.0.smithi087.stdout:6/661: rmdir d1/d6/d1a/d2c/d58 39 2024-09-17T07:19:56.551 INFO:tasks.workunit.client.1.smithi139.stdout:1/304: creat d2/d10/d12/d13/d4f/d5c/f5f x:0 0 0 2024-09-17T07:19:56.552 INFO:tasks.workunit.client.1.smithi139.stdout:2/491: dread d0/d3b/f51 [4194304,4194304] 0 2024-09-17T07:19:56.552 INFO:tasks.workunit.client.1.smithi139.stdout:9/808: rmdir dc/d11/d15/d3c/d61 39 2024-09-17T07:19:56.553 INFO:tasks.workunit.client.0.smithi087.stdout:5/668: unlink d5/d18/d20/l30 0 2024-09-17T07:19:56.554 INFO:tasks.workunit.client.0.smithi087.stdout:7/454: truncate d0/d3/d10/f38 1573301 0 2024-09-17T07:19:56.554 INFO:tasks.workunit.client.1.smithi139.stdout:9/809: write dc/d11/d52/ffa [973185,39728] 0 2024-09-17T07:19:56.557 INFO:tasks.workunit.client.1.smithi139.stdout:2/492: symlink d0/de/d69/la6 0 2024-09-17T07:19:56.558 INFO:tasks.workunit.client.1.smithi139.stdout:1/305: mkdir d2/d10/d12/d13/d60 0 2024-09-17T07:19:56.558 INFO:tasks.workunit.client.0.smithi087.stdout:6/662: fsync d1/f1d 0 2024-09-17T07:19:56.561 INFO:tasks.workunit.client.1.smithi139.stdout:2/493: unlink d0/dc/l52 0 2024-09-17T07:19:56.561 INFO:tasks.workunit.client.1.smithi139.stdout:1/306: rmdir d2/d10/d12/d35/d2b/d4a 39 2024-09-17T07:19:56.563 INFO:tasks.workunit.client.0.smithi087.stdout:7/455: fdatasync d0/d3/d10/f29 0 2024-09-17T07:19:56.563 INFO:tasks.workunit.client.1.smithi139.stdout:9/810: read dc/d11/d15/f8d [49727,65492] 0 2024-09-17T07:19:56.566 INFO:tasks.workunit.client.0.smithi087.stdout:0/774: mknod db/d45/d7b/db0/dd0/c11b 0 2024-09-17T07:19:56.569 INFO:tasks.workunit.client.0.smithi087.stdout:9/523: truncate d3/d4/d6/f68 697692 0 2024-09-17T07:19:56.570 INFO:tasks.workunit.client.1.smithi139.stdout:8/609: dread d0/d20/d28/d52/f63 [0,4194304] 0 2024-09-17T07:19:56.572 INFO:tasks.workunit.client.1.smithi139.stdout:3/394: dwrite d5/d15/d16/d4c/d28/f50 [0,4194304] 0 2024-09-17T07:19:56.572 INFO:tasks.workunit.client.1.smithi139.stdout:9/811: write dc/d11/d15/d3c/d61/dc8/d9f/fd9 [563603,53115] 0 2024-09-17T07:19:56.572 INFO:tasks.workunit.client.1.smithi139.stdout:1/307: getdents d2/d10/d12/d35/d2b 0 2024-09-17T07:19:56.572 INFO:tasks.workunit.client.0.smithi087.stdout:1/484: getdents d2/d3d/d35/d57 0 2024-09-17T07:19:56.574 INFO:tasks.workunit.client.0.smithi087.stdout:2/542: write d2/d7/dd/d10/f5a [1243371,37659] 0 2024-09-17T07:19:56.575 INFO:tasks.workunit.client.0.smithi087.stdout:6/663: fdatasync d1/d6/d1a/d2c/d40/d4c/fd0 0 2024-09-17T07:19:56.576 INFO:tasks.workunit.client.1.smithi139.stdout:3/395: dread - d5/f3c zero size 2024-09-17T07:19:56.576 INFO:tasks.workunit.client.1.smithi139.stdout:9/812: symlink dc/d11/dbe/l10d 0 2024-09-17T07:19:56.577 INFO:tasks.workunit.client.0.smithi087.stdout:3/514: truncate d6/d15/d4b/f8b 4108373 0 2024-09-17T07:19:56.577 INFO:tasks.workunit.client.1.smithi139.stdout:8/610: symlink d0/d1a/d4d/lc3 0 2024-09-17T07:19:56.579 INFO:tasks.workunit.client.1.smithi139.stdout:1/308: mkdir d2/d10/d12/d1a/d61 0 2024-09-17T07:19:56.579 INFO:tasks.workunit.client.0.smithi087.stdout:0/775: creat db/dbe/f11c x:0 0 0 2024-09-17T07:19:56.580 INFO:tasks.workunit.client.0.smithi087.stdout:8/552: write d1/d2b/f42 [1980250,96094] 0 2024-09-17T07:19:56.581 INFO:tasks.workunit.client.1.smithi139.stdout:9/813: write dc/d11/d15/d3c/d61/d64/ff4 [562655,101172] 0 2024-09-17T07:19:56.582 INFO:tasks.workunit.client.1.smithi139.stdout:2/494: dwrite d0/d7/d1a/f1e [0,4194304] 0 2024-09-17T07:19:56.582 INFO:tasks.workunit.client.0.smithi087.stdout:2/543: mknod d2/d48/da2/d3a/d9f/caf 0 2024-09-17T07:19:56.586 INFO:tasks.workunit.client.1.smithi139.stdout:2/495: write d0/f9e [850433,20648] 0 2024-09-17T07:19:56.586 INFO:tasks.workunit.client.0.smithi087.stdout:5/669: dwrite d5/d12/f76 [0,4194304] 0 2024-09-17T07:19:56.588 INFO:tasks.workunit.client.0.smithi087.stdout:6/664: symlink d1/d67/db7/le3 0 2024-09-17T07:19:56.590 INFO:tasks.workunit.client.1.smithi139.stdout:8/611: write d0/d1a/d3a/d8d/fac [743533,119001] 0 2024-09-17T07:19:56.590 INFO:tasks.workunit.client.1.smithi139.stdout:1/309: mkdir d2/d10/d12/d24/d62 0 2024-09-17T07:19:56.591 INFO:tasks.workunit.client.1.smithi139.stdout:9/814: chown dc/d11/d52/d56/d7a/c7d 6272 1 2024-09-17T07:19:56.592 INFO:tasks.workunit.client.0.smithi087.stdout:3/515: chown d6/d15/d37/d3c/l9c 159978534 1 2024-09-17T07:19:56.593 INFO:tasks.workunit.client.0.smithi087.stdout:0/776: dread db/dbe/fcc [0,4194304] 0 2024-09-17T07:19:56.593 INFO:tasks.workunit.client.0.smithi087.stdout:3/516: readlink d6/d15/d37/l4e 0 2024-09-17T07:19:56.593 INFO:tasks.workunit.client.0.smithi087.stdout:1/485: truncate d2/d3d/f28 616638 0 2024-09-17T07:19:56.594 INFO:tasks.workunit.client.1.smithi139.stdout:2/496: mkdir d0/d7/d67/da1/da7 0 2024-09-17T07:19:56.596 INFO:tasks.workunit.client.1.smithi139.stdout:8/612: fdatasync d0/f2a 0 2024-09-17T07:19:56.596 INFO:tasks.workunit.client.0.smithi087.stdout:3/517: truncate d6/d15/f71 1020653 0 2024-09-17T07:19:56.597 INFO:tasks.workunit.client.0.smithi087.stdout:5/670: rename d5/d18/d20/d2f/f48 to d5/d12/d14/d61/d94/fdb 0 2024-09-17T07:19:56.597 INFO:tasks.workunit.client.1.smithi139.stdout:2/497: stat d0/d7/d67/da1/da7 0 2024-09-17T07:19:56.598 INFO:tasks.workunit.client.0.smithi087.stdout:3/518: dread - d6/d1b/d42/d62/f84 zero size 2024-09-17T07:19:56.599 INFO:tasks.workunit.client.0.smithi087.stdout:5/671: write d5/d12/d1c/fab [43871,104419] 0 2024-09-17T07:19:56.599 INFO:tasks.workunit.client.0.smithi087.stdout:6/665: write d1/d6/d1a/d2c/d58/d90/fab [758621,74517] 0 2024-09-17T07:19:56.602 INFO:tasks.workunit.client.0.smithi087.stdout:5/672: chown d5/d12/f77 3406338 1 2024-09-17T07:19:56.604 INFO:tasks.workunit.client.1.smithi139.stdout:8/613: read d0/d20/d28/d52/d65/d7f/db6/d18/f1c [2169131,33482] 0 2024-09-17T07:19:56.604 INFO:tasks.workunit.client.1.smithi139.stdout:1/310: truncate d2/d10/d12/d1a/f36 247481 0 2024-09-17T07:19:56.607 INFO:tasks.workunit.client.1.smithi139.stdout:9/815: dwrite dc/d11/d15/d3c/d61/f101 [0,4194304] 0 2024-09-17T07:19:56.608 INFO:tasks.workunit.client.1.smithi139.stdout:1/311: write d2/d10/d12/d1a/f53 [7283,24466] 0 2024-09-17T07:19:56.608 INFO:tasks.workunit.client.0.smithi087.stdout:7/456: truncate d0/d3/d23/d17/f3a 1568162 0 2024-09-17T07:19:56.608 INFO:tasks.workunit.client.0.smithi087.stdout:3/519: dwrite d6/d16/f26 [0,4194304] 0 2024-09-17T07:19:56.609 INFO:tasks.workunit.client.1.smithi139.stdout:3/396: truncate d5/d15/d16/d4c/f66 545385 0 2024-09-17T07:19:56.610 INFO:tasks.workunit.client.0.smithi087.stdout:0/777: truncate db/f13 2096053 0 2024-09-17T07:19:56.611 INFO:tasks.workunit.client.1.smithi139.stdout:8/614: write d0/d1a/d3a/d71/fa5 [1516178,90439] 0 2024-09-17T07:19:56.611 INFO:tasks.workunit.client.1.smithi139.stdout:9/816: chown dc/d11/d15/l54 10 1 2024-09-17T07:19:56.614 INFO:tasks.workunit.client.0.smithi087.stdout:0/778: chown db/d45/d9e/d86/dd5 7 1 2024-09-17T07:19:56.614 INFO:tasks.workunit.client.0.smithi087.stdout:9/524: dwrite d3/d4/d16/dc0/f3c [0,4194304] 0 2024-09-17T07:19:56.615 INFO:tasks.workunit.client.1.smithi139.stdout:1/312: symlink d2/d10/d12/d13/d4f/l63 0 2024-09-17T07:19:56.617 INFO:tasks.workunit.client.1.smithi139.stdout:3/397: creat d5/d15/d56/f7c x:0 0 0 2024-09-17T07:19:56.617 INFO:tasks.workunit.client.0.smithi087.stdout:6/666: truncate d1/d6/d1a/d4e/f74 1045848 0 2024-09-17T07:19:56.617 INFO:tasks.workunit.client.0.smithi087.stdout:8/553: link d1/d5f/d71/c78 d1/d2b/d21/d6d/d6f/d7f/d54/cc4 0 2024-09-17T07:19:56.620 INFO:tasks.workunit.client.1.smithi139.stdout:2/498: dread d0/d4e/f6c [0,4194304] 0 2024-09-17T07:19:56.620 INFO:tasks.workunit.client.0.smithi087.stdout:8/554: write d1/d7/d9/d19/d1b/f1c [1836345,10093] 0 2024-09-17T07:19:56.621 INFO:tasks.workunit.client.1.smithi139.stdout:2/499: chown d0/c79 3484 1 2024-09-17T07:19:56.621 INFO:tasks.workunit.client.1.smithi139.stdout:8/615: mkdir d0/d1a/d4d/da4/dc4 0 2024-09-17T07:19:56.623 INFO:tasks.workunit.client.1.smithi139.stdout:2/500: stat d0/de/d69/f6a 0 2024-09-17T07:19:56.624 INFO:tasks.workunit.client.0.smithi087.stdout:6/667: stat d1/d6/d1a/d2c/d33/c38 0 2024-09-17T07:19:56.625 INFO:tasks.workunit.client.1.smithi139.stdout:1/313: symlink d2/d10/d12/d35/l64 0 2024-09-17T07:19:56.628 INFO:tasks.workunit.client.0.smithi087.stdout:8/555: read d1/d7/d9/f85 [261576,120458] 0 2024-09-17T07:19:56.629 INFO:tasks.workunit.client.0.smithi087.stdout:0/779: dwrite f5 [0,4194304] 0 2024-09-17T07:19:56.630 INFO:tasks.workunit.client.0.smithi087.stdout:0/780: stat db/d45/d5d/fc8 0 2024-09-17T07:19:56.631 INFO:tasks.workunit.client.1.smithi139.stdout:1/314: symlink d2/d10/d12/d35/d49/l65 0 2024-09-17T07:19:56.631 INFO:tasks.workunit.client.0.smithi087.stdout:1/486: truncate d2/d3d/f2f 1780428 0 2024-09-17T07:19:56.631 INFO:tasks.workunit.client.1.smithi139.stdout:3/398: rename d5/d21/d23/d38/c79 to d5/d15/d16/d4c/d28/d54/c7d 0 2024-09-17T07:19:56.633 INFO:tasks.workunit.client.0.smithi087.stdout:0/781: write db/d45/d7b/d90/dd9/de6/ffa [1039721,84027] 0 2024-09-17T07:19:56.635 INFO:tasks.workunit.client.0.smithi087.stdout:0/782: write db/d45/f75 [1191973,82548] 0 2024-09-17T07:19:56.635 INFO:tasks.workunit.client.1.smithi139.stdout:6/560: sync 2024-09-17T07:19:56.637 INFO:tasks.workunit.client.1.smithi139.stdout:2/501: link d0/d7/f19 d0/d4e/fa8 0 2024-09-17T07:19:56.637 INFO:tasks.workunit.client.1.smithi139.stdout:5/388: sync 2024-09-17T07:19:56.637 INFO:tasks.workunit.client.1.smithi139.stdout:4/413: sync 2024-09-17T07:19:56.637 INFO:tasks.workunit.client.1.smithi139.stdout:0/340: sync 2024-09-17T07:19:56.639 INFO:tasks.workunit.client.0.smithi087.stdout:1/487: mknod d2/caa 0 2024-09-17T07:19:56.642 INFO:tasks.workunit.client.1.smithi139.stdout:2/502: fdatasync d0/de/d25/d3f/f96 0 2024-09-17T07:19:56.642 INFO:tasks.workunit.client.0.smithi087.stdout:3/520: truncate d6/f59 3446582 0 2024-09-17T07:19:56.643 INFO:tasks.workunit.client.0.smithi087.stdout:9/525: dread d3/d4/d6/d8/f18 [4194304,4194304] 0 2024-09-17T07:19:56.644 INFO:tasks.workunit.client.0.smithi087.stdout:6/668: getdents d1/d6/d1a/d2c/d48/d9b/dac 0 2024-09-17T07:19:56.644 INFO:tasks.workunit.client.1.smithi139.stdout:8/616: dwrite d0/d20/f8f [0,4194304] 0 2024-09-17T07:19:56.645 INFO:tasks.workunit.client.0.smithi087.stdout:0/783: mkdir db/d45/d5b/d92/de8/d11d 0 2024-09-17T07:19:56.645 INFO:tasks.workunit.client.1.smithi139.stdout:3/399: unlink d5/d15/d16/d4c/f46 0 2024-09-17T07:19:56.646 INFO:tasks.workunit.client.1.smithi139.stdout:9/817: dwrite dc/d11/d15/d3c/dfe/f100 [4194304,4194304] 0 2024-09-17T07:19:56.647 INFO:tasks.workunit.client.0.smithi087.stdout:7/457: dwrite d0/d3/d23/d17/f41 [0,4194304] 0 2024-09-17T07:19:56.650 INFO:tasks.workunit.client.0.smithi087.stdout:9/526: rename d3/d4/d6/d8/f18 to d3/dac/fc3 0 2024-09-17T07:19:56.657 INFO:tasks.workunit.client.0.smithi087.stdout:3/521: dwrite d6/d16/f81 [0,4194304] 0 2024-09-17T07:19:56.657 INFO:tasks.workunit.client.1.smithi139.stdout:2/503: dwrite d0/dc/d15/f5f [0,4194304] 0 2024-09-17T07:19:56.658 INFO:tasks.workunit.client.0.smithi087.stdout:0/784: truncate db/d45/f68 2607468 0 2024-09-17T07:19:56.658 INFO:tasks.workunit.client.0.smithi087.stdout:5/673: dread d5/d18/f38 [0,4194304] 0 2024-09-17T07:19:56.661 INFO:tasks.workunit.client.1.smithi139.stdout:0/341: unlink d1/l5d 0 2024-09-17T07:19:56.662 INFO:tasks.workunit.client.0.smithi087.stdout:5/674: chown d5/d12/d14/d61/l8a 7379815 1 2024-09-17T07:19:56.663 INFO:tasks.workunit.client.1.smithi139.stdout:3/400: write d5/d15/f7a [599357,108878] 0 2024-09-17T07:19:56.667 INFO:tasks.workunit.client.0.smithi087.stdout:5/675: write d5/d18/d20/d2f/f57 [893789,49733] 0 2024-09-17T07:19:56.667 INFO:tasks.workunit.client.1.smithi139.stdout:1/315: getdents d2/d10/d12/d35/d2b/d4a 0 2024-09-17T07:19:56.668 INFO:tasks.workunit.client.0.smithi087.stdout:9/527: mknod d3/d4/d6/d8/d22/cc4 0 2024-09-17T07:19:56.669 INFO:tasks.workunit.client.1.smithi139.stdout:6/561: creat db/df/d4e/fb8 x:0 0 0 2024-09-17T07:19:56.670 INFO:tasks.workunit.client.1.smithi139.stdout:5/389: rename d4/f17 to d4/d16/f77 0 2024-09-17T07:19:56.671 INFO:tasks.workunit.client.0.smithi087.stdout:7/458: dwrite d0/d3/d23/d17/f41 [0,4194304] 0 2024-09-17T07:19:56.671 INFO:tasks.workunit.client.0.smithi087.stdout:9/528: chown d3/d4/d6/d8/d12 712225 1 2024-09-17T07:19:56.672 INFO:tasks.workunit.client.0.smithi087.stdout:6/669: getdents d1/d6/d1a/d2c/d40/dd2 0 2024-09-17T07:19:56.673 INFO:tasks.workunit.client.0.smithi087.stdout:0/785: symlink db/d45/d9e/d86/dd5/deb/d117/l11e 0 2024-09-17T07:19:56.674 INFO:tasks.workunit.client.1.smithi139.stdout:3/401: symlink d5/d15/l7e 0 2024-09-17T07:19:56.674 INFO:tasks.workunit.client.1.smithi139.stdout:8/617: creat d0/d1a/d4d/da4/dc4/fc5 x:0 0 0 2024-09-17T07:19:56.675 INFO:tasks.workunit.client.0.smithi087.stdout:8/556: dread d1/d7/f13 [0,4194304] 0 2024-09-17T07:19:56.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:56 smithi087 ceph-mon[27636]: pgmap v11: 65 pgs: 65 active+clean; 1.3 GiB data, 5.4 GiB used, 531 GiB / 536 GiB avail; 22 MiB/s rd, 172 MiB/s wr, 310 op/s 2024-09-17T07:19:56.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:56 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:19:56.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:56 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:19:56.677 INFO:tasks.workunit.client.1.smithi139.stdout:2/504: dwrite d0/de/f80 [4194304,4194304] 0 2024-09-17T07:19:56.677 INFO:tasks.workunit.client.1.smithi139.stdout:9/818: creat dc/f10e x:0 0 0 2024-09-17T07:19:56.679 INFO:tasks.workunit.client.1.smithi139.stdout:0/342: truncate d1/da/d1b/d3d/d5a/d75/f77 2268316 0 2024-09-17T07:19:56.681 INFO:tasks.workunit.client.0.smithi087.stdout:8/557: write d1/d2b/f42 [233944,76421] 0 2024-09-17T07:19:56.682 INFO:tasks.workunit.client.1.smithi139.stdout:9/819: chown fb 522 1 2024-09-17T07:19:56.682 INFO:tasks.workunit.client.1.smithi139.stdout:5/390: dread - d4/f5b zero size 2024-09-17T07:19:56.683 INFO:tasks.workunit.client.0.smithi087.stdout:7/459: truncate d0/d3/d23/d17/f65 1160830 0 2024-09-17T07:19:56.683 INFO:tasks.workunit.client.0.smithi087.stdout:0/786: creat db/d45/d7b/d90/dd9/de6/f11f x:0 0 0 2024-09-17T07:19:56.684 INFO:tasks.workunit.client.0.smithi087.stdout:3/522: dwrite d6/f57 [0,4194304] 0 2024-09-17T07:19:56.684 INFO:tasks.workunit.client.1.smithi139.stdout:0/343: read d1/da/d17/d72/f30 [1065592,67568] 0 2024-09-17T07:19:56.687 INFO:tasks.workunit.client.1.smithi139.stdout:3/402: rename d5/cf to d5/d15/c7f 0 2024-09-17T07:19:56.690 INFO:tasks.workunit.client.0.smithi087.stdout:9/529: dread d3/f1f [0,4194304] 0 2024-09-17T07:19:56.690 INFO:tasks.workunit.client.1.smithi139.stdout:6/562: dwrite db/d18/f35 [0,4194304] 0 2024-09-17T07:19:56.691 INFO:tasks.workunit.client.0.smithi087.stdout:6/670: rename d1/f4b to d1/d6/d1a/d2c/d40/fe4 0 2024-09-17T07:19:56.691 INFO:tasks.workunit.client.1.smithi139.stdout:1/316: rmdir d2/d10/d12/d13/d60 0 2024-09-17T07:19:56.694 INFO:tasks.workunit.client.0.smithi087.stdout:3/523: symlink d6/d15/lac 0 2024-09-17T07:19:56.695 INFO:tasks.workunit.client.1.smithi139.stdout:9/820: read dc/d11/d15/f18 [6582429,38880] 0 2024-09-17T07:19:56.696 INFO:tasks.workunit.client.1.smithi139.stdout:1/317: dread - d2/f46 zero size 2024-09-17T07:19:56.698 INFO:tasks.workunit.client.0.smithi087.stdout:1/488: dwrite d2/da/d7e/f83 [0,4194304] 0 2024-09-17T07:19:56.698 INFO:tasks.workunit.client.1.smithi139.stdout:3/403: fsync f2 0 2024-09-17T07:19:56.700 INFO:tasks.workunit.client.0.smithi087.stdout:7/460: mknod d0/d3/d23/d17/d7b/c94 0 2024-09-17T07:19:56.702 INFO:tasks.workunit.client.1.smithi139.stdout:8/618: dread d0/d1a/f39 [4194304,4194304] 0 2024-09-17T07:19:56.702 INFO:tasks.workunit.client.1.smithi139.stdout:3/404: fsync d5/d15/d56/f70 0 2024-09-17T07:19:56.703 INFO:tasks.workunit.client.1.smithi139.stdout:4/414: dwrite d0/d1/d29/f2b [0,4194304] 0 2024-09-17T07:19:56.704 INFO:tasks.workunit.client.0.smithi087.stdout:1/489: dread - d2/d3d/d35/d57/d73/f8a zero size 2024-09-17T07:19:56.704 INFO:tasks.workunit.client.0.smithi087.stdout:6/671: mkdir d1/d67/ddc/de5 0 2024-09-17T07:19:56.705 INFO:tasks.workunit.client.1.smithi139.stdout:2/505: rename d0/de/f14 to d0/d3b/fa9 0 2024-09-17T07:19:56.705 INFO:tasks.workunit.client.0.smithi087.stdout:3/524: link d6/d16/f38 d6/d15/d92/fad 0 2024-09-17T07:19:56.707 INFO:tasks.workunit.client.1.smithi139.stdout:6/563: symlink db/df/d4c/lb9 0 2024-09-17T07:19:56.707 INFO:tasks.workunit.client.1.smithi139.stdout:2/506: fdatasync d0/f3 0 2024-09-17T07:19:56.707 INFO:tasks.workunit.client.1.smithi139.stdout:9/821: mkdir dc/d11/d15/d1e/d34/d10f 0 2024-09-17T07:19:56.710 INFO:tasks.workunit.client.1.smithi139.stdout:9/822: write dc/d11/d15/d1e/fe6 [763756,89147] 0 2024-09-17T07:19:56.712 INFO:tasks.workunit.client.1.smithi139.stdout:9/823: chown dc/d11/d15/d3c/d61/f101 44620 1 2024-09-17T07:19:56.712 INFO:tasks.workunit.client.0.smithi087.stdout:9/530: dwrite d3/d4/da/f49 [0,4194304] 0 2024-09-17T07:19:56.712 INFO:tasks.workunit.client.0.smithi087.stdout:6/672: stat d1/d6/d1a/f57 0 2024-09-17T07:19:56.713 INFO:tasks.workunit.client.0.smithi087.stdout:1/490: creat d2/da/d9a/fab x:0 0 0 2024-09-17T07:19:56.713 INFO:tasks.workunit.client.1.smithi139.stdout:8/619: creat d0/d20/d28/d52/d65/fc6 x:0 0 0 2024-09-17T07:19:56.714 INFO:tasks.workunit.client.0.smithi087.stdout:0/787: dwrite db/d45/d7b/d90/dd9/fed [0,4194304] 0 2024-09-17T07:19:56.715 INFO:tasks.workunit.client.1.smithi139.stdout:2/507: unlink d0/de/df/f39 0 2024-09-17T07:19:56.716 INFO:tasks.workunit.client.1.smithi139.stdout:3/405: mkdir d5/d15/d16/d4c/d28/d80 0 2024-09-17T07:19:56.716 INFO:tasks.workunit.client.1.smithi139.stdout:4/415: mknod d0/db/c80 0 2024-09-17T07:19:56.718 INFO:tasks.workunit.client.0.smithi087.stdout:0/788: chown db/d45/d9e/d95/de9/df9 10705102 1 2024-09-17T07:19:56.719 INFO:tasks.workunit.client.0.smithi087.stdout:1/491: fdatasync d2/da/f2b 0 2024-09-17T07:19:56.719 INFO:tasks.workunit.client.1.smithi139.stdout:1/318: link d2/d10/d12/l4c d2/d10/d12/d1a/d61/l66 0 2024-09-17T07:19:56.720 INFO:tasks.workunit.client.0.smithi087.stdout:0/789: stat db/d45/d9e/d86/dd5/deb 0 2024-09-17T07:19:56.721 INFO:tasks.workunit.client.1.smithi139.stdout:8/620: dread - d0/d1a/d4d/fc2 zero size 2024-09-17T07:19:56.723 INFO:tasks.workunit.client.0.smithi087.stdout:5/676: dread d5/d12/d1c/fa5 [0,4194304] 0 2024-09-17T07:19:56.723 INFO:tasks.workunit.client.1.smithi139.stdout:1/319: rmdir d2/d10/d12/d35/d2b 39 2024-09-17T07:19:56.724 INFO:tasks.workunit.client.0.smithi087.stdout:9/531: rename d3/d4/d16/d69/d8a/d1e/l94 to d3/d4/d6/d8/d12/d32/da1/lc5 0 2024-09-17T07:19:56.726 INFO:tasks.workunit.client.0.smithi087.stdout:1/492: creat d2/d14/fac x:0 0 0 2024-09-17T07:19:56.727 INFO:tasks.workunit.client.1.smithi139.stdout:8/621: write d0/d20/f8f [2836458,28021] 0 2024-09-17T07:19:56.727 INFO:tasks.workunit.client.1.smithi139.stdout:6/564: dwrite db/df/d4e/d64/d56/f69 [0,4194304] 0 2024-09-17T07:19:56.727 INFO:tasks.workunit.client.0.smithi087.stdout:0/790: write db/f3e [2988451,77364] 0 2024-09-17T07:19:56.728 INFO:tasks.workunit.client.0.smithi087.stdout:3/525: dwrite d6/d1b/d42/d62/f87 [0,4194304] 0 2024-09-17T07:19:56.729 INFO:tasks.workunit.client.0.smithi087.stdout:9/532: write d3/f4d [1460599,24874] 0 2024-09-17T07:19:56.730 INFO:tasks.workunit.client.0.smithi087.stdout:5/677: write d5/d12/d4d/f3a [869078,16974] 0 2024-09-17T07:19:56.731 INFO:tasks.workunit.client.1.smithi139.stdout:8/622: creat d0/d20/d28/d52/d99/fc7 x:0 0 0 2024-09-17T07:19:56.732 INFO:tasks.workunit.client.1.smithi139.stdout:6/565: mkdir db/df/d4e/d5e/d8a/dba 0 2024-09-17T07:19:56.733 INFO:tasks.workunit.client.1.smithi139.stdout:1/320: symlink d2/d10/d12/d24/d38/d3d/l67 0 2024-09-17T07:19:56.735 INFO:tasks.workunit.client.0.smithi087.stdout:5/678: creat d5/d12/d56/d9e/fdc x:0 0 0 2024-09-17T07:19:56.736 INFO:tasks.workunit.client.1.smithi139.stdout:1/321: write d2/d10/d12/d35/f44 [3125321,24253] 0 2024-09-17T07:19:56.736 INFO:tasks.workunit.client.1.smithi139.stdout:9/824: rename dc/d11/d15/d1e/f65 to dc/d11/d15/d3c/d61/f110 0 2024-09-17T07:19:56.736 INFO:tasks.workunit.client.1.smithi139.stdout:7/419: sync 2024-09-17T07:19:56.737 INFO:tasks.workunit.client.0.smithi087.stdout:6/673: dwrite d1/d6/d1a/d4e/f63 [0,4194304] 0 2024-09-17T07:19:56.738 INFO:tasks.workunit.client.0.smithi087.stdout:1/493: mknod d2/d3d/d35/d4f/cad 0 2024-09-17T07:19:56.739 INFO:tasks.workunit.client.1.smithi139.stdout:6/566: write db/df/d4e/d5e/fa8 [265626,98664] 0 2024-09-17T07:19:56.740 INFO:tasks.workunit.client.1.smithi139.stdout:8/623: mkdir d0/d20/d28/d52/dc8 0 2024-09-17T07:19:56.742 INFO:tasks.workunit.client.0.smithi087.stdout:5/679: creat d5/d18/d20/d2f/fdd x:0 0 0 2024-09-17T07:19:56.744 INFO:tasks.workunit.client.0.smithi087.stdout:3/526: creat d6/d1b/d2b/fae x:0 0 0 2024-09-17T07:19:56.745 INFO:tasks.workunit.client.1.smithi139.stdout:1/322: write d2/f15 [4562112,63689] 0 2024-09-17T07:19:56.746 INFO:tasks.workunit.client.1.smithi139.stdout:2/508: rename d0/d3b/f5b to d0/d7/d86/da4/d12/d45/faa 0 2024-09-17T07:19:56.747 INFO:tasks.workunit.client.1.smithi139.stdout:9/825: read dc/d2c/f62 [1697657,75382] 0 2024-09-17T07:19:56.747 INFO:tasks.workunit.client.0.smithi087.stdout:5/680: write d5/d12/d56/db7/fa0 [742026,71352] 0 2024-09-17T07:19:56.748 INFO:tasks.workunit.client.0.smithi087.stdout:9/533: dwrite d3/d4/d16/d69/f6b [0,4194304] 0 2024-09-17T07:19:56.750 INFO:tasks.workunit.client.0.smithi087.stdout:6/674: creat d1/d6/d1a/d2c/fe6 x:0 0 0 2024-09-17T07:19:56.751 INFO:tasks.workunit.client.1.smithi139.stdout:5/391: getdents d4 0 2024-09-17T07:19:56.752 INFO:tasks.workunit.client.0.smithi087.stdout:1/494: getdents d2/d3d 0 2024-09-17T07:19:56.753 INFO:tasks.workunit.client.0.smithi087.stdout:6/675: rename d1/d6/d1a to d1/d6/d1a/d2c/d58/d90/da9/de7 22 2024-09-17T07:19:56.753 INFO:tasks.workunit.client.0.smithi087.stdout:3/527: mknod d6/d1b/d42/d6e/caf 0 2024-09-17T07:19:56.753 INFO:tasks.workunit.client.1.smithi139.stdout:9/826: mkdir dc/d11/d15/d1e/d34/d111 0 2024-09-17T07:19:56.754 INFO:tasks.workunit.client.1.smithi139.stdout:9/827: chown dc/d11/d15/d3c/d61/d64/ff5 27813 1 2024-09-17T07:19:56.755 INFO:tasks.workunit.client.0.smithi087.stdout:3/528: dread - d6/d15/d37/d3c/d52/f97 zero size 2024-09-17T07:19:56.755 INFO:tasks.workunit.client.0.smithi087.stdout:9/534: fsync d3/d4/d6/d8/fd 0 2024-09-17T07:19:56.756 INFO:tasks.workunit.client.1.smithi139.stdout:2/509: rmdir d0/d7/d1a/d59 39 2024-09-17T07:19:56.757 INFO:tasks.workunit.client.0.smithi087.stdout:3/529: chown d6/d15/d37/f5b 173 1 2024-09-17T07:19:56.758 INFO:tasks.workunit.client.0.smithi087.stdout:6/676: unlink d1/d6/d1a/d8a/fd6 0 2024-09-17T07:19:56.761 INFO:tasks.workunit.client.0.smithi087.stdout:1/495: creat d2/d3d/d45/d90/fae x:0 0 0 2024-09-17T07:19:56.761 INFO:tasks.workunit.client.0.smithi087.stdout:7/461: write d0/d3/d10/f21 [362484,50257] 0 2024-09-17T07:19:56.762 INFO:tasks.workunit.client.1.smithi139.stdout:9/828: chown dc/d11/d15/d3c/lc2 5415847 1 2024-09-17T07:19:56.765 INFO:tasks.workunit.client.1.smithi139.stdout:2/510: write d0/f9b [3426915,126153] 0 2024-09-17T07:19:56.768 INFO:tasks.workunit.client.0.smithi087.stdout:3/530: chown d6/l9 571 1 2024-09-17T07:19:56.769 INFO:tasks.workunit.client.0.smithi087.stdout:6/677: chown d1/d6/d1a/d2c/fd9 84727 1 2024-09-17T07:19:56.770 INFO:tasks.workunit.client.1.smithi139.stdout:1/323: getdents d2/d10/d12 0 2024-09-17T07:19:56.771 INFO:tasks.workunit.client.0.smithi087.stdout:6/678: write d1/d6/d1a/d2c/d40/d4c/dce/faf [1753519,65312] 0 2024-09-17T07:19:56.772 INFO:tasks.workunit.client.0.smithi087.stdout:5/681: link d5/d12/d56/d5b/lc3 d5/d12/d56/lde 0 2024-09-17T07:19:56.774 INFO:tasks.workunit.client.0.smithi087.stdout:3/531: mkdir d6/d1b/d42/d6e/db0 0 2024-09-17T07:19:56.775 INFO:tasks.workunit.client.1.smithi139.stdout:2/511: creat d0/de/df/d56/fab x:0 0 0 2024-09-17T07:19:56.775 INFO:tasks.workunit.client.1.smithi139.stdout:0/344: dwrite d1/da/d1b/f42 [0,4194304] 0 2024-09-17T07:19:56.776 INFO:tasks.workunit.client.0.smithi087.stdout:0/791: write db/d45/d5d/fc8 [1466098,52040] 0 2024-09-17T07:19:56.776 INFO:tasks.workunit.client.1.smithi139.stdout:3/406: dread d5/d15/f18 [0,4194304] 0 2024-09-17T07:19:56.777 INFO:tasks.workunit.client.1.smithi139.stdout:7/420: dread d5/d17/f31 [0,4194304] 0 2024-09-17T07:19:56.777 INFO:tasks.workunit.client.0.smithi087.stdout:0/792: chown db/d45/d9e/d86/dd5/ff2 5689126 1 2024-09-17T07:19:56.778 INFO:tasks.workunit.client.0.smithi087.stdout:0/793: stat db/d45 0 2024-09-17T07:19:56.778 INFO:tasks.workunit.client.1.smithi139.stdout:3/407: chown d5/f3c 563777968 1 2024-09-17T07:19:56.779 INFO:tasks.workunit.client.0.smithi087.stdout:0/794: fdatasync db/d45/d7b/db0/f10f 0 2024-09-17T07:19:56.780 INFO:tasks.workunit.client.0.smithi087.stdout:5/682: mkdir d5/d18/dc2/ddf 0 2024-09-17T07:19:56.780 INFO:tasks.workunit.client.1.smithi139.stdout:3/408: write d5/d15/f7a [117795,105564] 0 2024-09-17T07:19:56.783 INFO:tasks.workunit.client.1.smithi139.stdout:1/324: fdatasync d2/fd 0 2024-09-17T07:19:56.784 INFO:tasks.workunit.client.0.smithi087.stdout:9/535: write d3/d4/d6/f13 [2431151,94892] 0 2024-09-17T07:19:56.784 INFO:tasks.workunit.client.1.smithi139.stdout:0/345: mkdir d1/da/d17/d65/d8b 0 2024-09-17T07:19:56.787 INFO:tasks.workunit.client.0.smithi087.stdout:9/536: chown d3/d4/d16/d69/d8a/d1e/d90 386830 1 2024-09-17T07:19:56.787 INFO:tasks.workunit.client.0.smithi087.stdout:0/795: rename db/d45/f53 to db/d45/d5b/d92/de8/d11d/f120 0 2024-09-17T07:19:56.788 INFO:tasks.workunit.client.1.smithi139.stdout:2/512: symlink d0/d7/d86/da4/d12/d45/lac 0 2024-09-17T07:19:56.788 INFO:tasks.workunit.client.0.smithi087.stdout:3/532: link d6/d15/c2f d6/d16/cb1 0 2024-09-17T07:19:56.788 INFO:tasks.workunit.client.1.smithi139.stdout:4/416: dread d0/d1/d29/d41/f44 [0,4194304] 0 2024-09-17T07:19:56.791 INFO:tasks.workunit.client.1.smithi139.stdout:9/829: rename dc/d11/d15/d1e/d53/le2 to dc/l112 0 2024-09-17T07:19:56.791 INFO:tasks.workunit.client.0.smithi087.stdout:9/537: stat d3/d4/d6/d8/d12/ca8 0 2024-09-17T07:19:56.791 INFO:tasks.workunit.client.0.smithi087.stdout:5/683: dwrite d5/d12/d14/d61/fda [0,4194304] 0 2024-09-17T07:19:56.792 INFO:tasks.workunit.client.1.smithi139.stdout:7/421: creat d5/d10/d4d/f88 x:0 0 0 2024-09-17T07:19:56.794 INFO:tasks.workunit.client.0.smithi087.stdout:3/533: mkdir d6/d15/d37/d3c/d52/db2 0 2024-09-17T07:19:56.794 INFO:tasks.workunit.client.1.smithi139.stdout:9/830: fsync dc/d11/f12 0 2024-09-17T07:19:56.796 INFO:tasks.workunit.client.0.smithi087.stdout:5/684: readlink d5/d12/d14/l36 0 2024-09-17T07:19:56.797 INFO:tasks.workunit.client.1.smithi139.stdout:3/409: unlink d5/l9 0 2024-09-17T07:19:56.797 INFO:tasks.workunit.client.1.smithi139.stdout:6/567: dwrite db/d18/d38/d60/f7c [0,4194304] 0 2024-09-17T07:19:56.799 INFO:tasks.workunit.client.0.smithi087.stdout:3/534: fsync d6/d16/f9f 0 2024-09-17T07:19:56.799 INFO:tasks.workunit.client.0.smithi087.stdout:7/462: dread d0/d3/d10/d32/d62/d76/f7f [0,4194304] 0 2024-09-17T07:19:56.800 INFO:tasks.workunit.client.0.smithi087.stdout:9/538: rename d3/d4/d6/c1a to d3/d4/d16/cc6 0 2024-09-17T07:19:56.800 INFO:tasks.workunit.client.0.smithi087.stdout:0/796: dread db/fcb [0,4194304] 0 2024-09-17T07:19:56.802 INFO:tasks.workunit.client.0.smithi087.stdout:6/679: truncate d1/d6/f2b 4910354 0 2024-09-17T07:19:56.802 INFO:tasks.workunit.client.0.smithi087.stdout:0/797: dread - db/d45/d9e/f102 zero size 2024-09-17T07:19:56.803 INFO:tasks.workunit.client.0.smithi087.stdout:1/496: dread d2/d3d/d45/d90/d37/f38 [0,4194304] 0 2024-09-17T07:19:56.803 INFO:tasks.workunit.client.0.smithi087.stdout:3/535: mkdir d6/d1b/d42/d95/db3 0 2024-09-17T07:19:56.804 INFO:tasks.workunit.client.0.smithi087.stdout:6/680: chown d1/d6/d68/l6b 84093691 1 2024-09-17T07:19:56.805 INFO:tasks.workunit.client.0.smithi087.stdout:9/539: mkdir d3/d4/d6/d8/d22/d43/d84/dc7 0 2024-09-17T07:19:56.805 INFO:tasks.workunit.client.0.smithi087.stdout:6/681: write d1/d6/f12 [3449114,85936] 0 2024-09-17T07:19:56.806 INFO:tasks.workunit.client.1.smithi139.stdout:9/831: dread dc/d11/d15/d3c/d61/d64/fc1 [4194304,4194304] 0 2024-09-17T07:19:56.807 INFO:tasks.workunit.client.0.smithi087.stdout:6/682: fdatasync d1/d6/d1a/d2c/d58/f92 0 2024-09-17T07:19:56.808 INFO:tasks.workunit.client.1.smithi139.stdout:1/325: write d2/d10/d12/d35/d2b/f42 [1044621,47926] 0 2024-09-17T07:19:56.810 INFO:tasks.workunit.client.0.smithi087.stdout:4/523: sync 2024-09-17T07:19:56.810 INFO:tasks.workunit.client.1.smithi139.stdout:9/832: truncate dc/f10e 131456 0 2024-09-17T07:19:56.811 INFO:tasks.workunit.client.1.smithi139.stdout:4/417: rmdir d0/d1/d29/d41 39 2024-09-17T07:19:56.812 INFO:tasks.workunit.client.0.smithi087.stdout:6/683: chown d1/d6/d1a/d2c/d48/f88 1493212 1 2024-09-17T07:19:56.813 INFO:tasks.workunit.client.1.smithi139.stdout:7/422: rmdir d5/d17/d4e/d55 39 2024-09-17T07:19:56.814 INFO:tasks.workunit.client.0.smithi087.stdout:6/684: write d1/d6/f7d [166270,111695] 0 2024-09-17T07:19:56.814 INFO:tasks.workunit.client.1.smithi139.stdout:6/568: symlink db/df/d4e/d64/d56/lbb 0 2024-09-17T07:19:56.814 INFO:tasks.workunit.client.0.smithi087.stdout:1/497: fdatasync d2/d3d/d45/d90/d43/f66 0 2024-09-17T07:19:56.815 INFO:tasks.workunit.client.1.smithi139.stdout:8/624: dwrite d0/d1a/d3a/f42 [4194304,4194304] 0 2024-09-17T07:19:56.816 INFO:tasks.workunit.client.0.smithi087.stdout:6/685: dread - d1/d6/d1a/d2c/fe6 zero size 2024-09-17T07:19:56.816 INFO:tasks.workunit.client.1.smithi139.stdout:2/513: truncate d0/d4e/fa8 4584072 0 2024-09-17T07:19:56.817 INFO:tasks.workunit.client.0.smithi087.stdout:3/536: creat d6/d15/d37/d3c/d43/fb4 x:0 0 0 2024-09-17T07:19:56.818 INFO:tasks.workunit.client.0.smithi087.stdout:3/537: chown d6/d1b/l56 11 1 2024-09-17T07:19:56.820 INFO:tasks.workunit.client.0.smithi087.stdout:1/498: dread d2/f2d [0,4194304] 0 2024-09-17T07:19:56.823 INFO:tasks.workunit.client.1.smithi139.stdout:9/833: fdatasync dc/d11/d15/d3c/d61/d64/ff5 0 2024-09-17T07:19:56.823 INFO:tasks.workunit.client.1.smithi139.stdout:7/423: write d5/d17/f49 [23208,78599] 0 2024-09-17T07:19:56.823 INFO:tasks.workunit.client.1.smithi139.stdout:3/410: dread d5/d15/f18 [0,4194304] 0 2024-09-17T07:19:56.825 INFO:tasks.workunit.client.1.smithi139.stdout:5/392: dwrite d4/d16/f1d [4194304,4194304] 0 2024-09-17T07:19:56.825 INFO:tasks.workunit.client.1.smithi139.stdout:6/569: truncate db/d18/f8e 630188 0 2024-09-17T07:19:56.826 INFO:tasks.workunit.client.1.smithi139.stdout:3/411: chown d5/d21/d23/f47 9870 1 2024-09-17T07:19:56.827 INFO:tasks.workunit.client.0.smithi087.stdout:3/538: rmdir d6/d16 39 2024-09-17T07:19:56.828 INFO:tasks.workunit.client.1.smithi139.stdout:8/625: stat d0/d20/d28/d52/d65/l97 0 2024-09-17T07:19:56.828 INFO:tasks.workunit.client.0.smithi087.stdout:5/685: truncate d5/fa9 3775357 0 2024-09-17T07:19:56.829 INFO:tasks.workunit.client.1.smithi139.stdout:1/326: getdents d2 0 2024-09-17T07:19:56.829 INFO:tasks.workunit.client.0.smithi087.stdout:4/524: truncate d2/d92/d4d/f64 1738965 0 2024-09-17T07:19:56.830 INFO:tasks.workunit.client.1.smithi139.stdout:2/514: creat d0/d7/d67/d92/fad x:0 0 0 2024-09-17T07:19:56.831 INFO:tasks.workunit.client.1.smithi139.stdout:4/418: read - d0/d1/d29/d41/f63 zero size 2024-09-17T07:19:56.831 INFO:tasks.workunit.client.0.smithi087.stdout:7/463: write d0/d3/f22 [501892,109177] 0 2024-09-17T07:19:56.833 INFO:tasks.workunit.client.0.smithi087.stdout:6/686: unlink d1/d6/d1a/d2c/d40/d4c/l7e 0 2024-09-17T07:19:56.836 INFO:tasks.workunit.client.0.smithi087.stdout:0/798: link db/c19 db/d45/d9e/d95/df1/c121 0 2024-09-17T07:19:56.837 INFO:tasks.workunit.client.1.smithi139.stdout:0/346: dread d1/da/d1b/d3d/f70 [0,4194304] 0 2024-09-17T07:19:56.837 INFO:tasks.workunit.client.1.smithi139.stdout:1/327: dread d2/d10/d12/d1a/f36 [0,4194304] 0 2024-09-17T07:19:56.838 INFO:tasks.workunit.client.0.smithi087.stdout:4/525: mknod d2/d92/d4d/d21/d2f/d3b/d7e/cb9 0 2024-09-17T07:19:56.839 INFO:tasks.workunit.client.0.smithi087.stdout:5/686: dwrite d5/d6d/f90 [0,4194304] 0 2024-09-17T07:19:56.843 INFO:tasks.workunit.client.0.smithi087.stdout:0/799: creat db/d45/d7b/d90/f122 x:0 0 0 2024-09-17T07:19:56.847 INFO:tasks.workunit.client.1.smithi139.stdout:8/626: mkdir d0/d1a/dc9 0 2024-09-17T07:19:56.847 INFO:tasks.workunit.client.0.smithi087.stdout:5/687: chown d5/d18/d20/d2f/l4b 26 1 2024-09-17T07:19:56.850 INFO:tasks.workunit.client.1.smithi139.stdout:3/412: mkdir d5/d63/d6d/d6f/d81 0 2024-09-17T07:19:56.851 INFO:tasks.workunit.client.0.smithi087.stdout:3/539: dread d6/d16/f36 [0,4194304] 0 2024-09-17T07:19:56.851 INFO:tasks.workunit.client.0.smithi087.stdout:3/540: readlink d6/d1b/d42/l31 0 2024-09-17T07:19:56.852 INFO:tasks.workunit.client.1.smithi139.stdout:9/834: truncate dc/d11/d52/fa2 4508396 0 2024-09-17T07:19:56.852 INFO:tasks.workunit.client.0.smithi087.stdout:0/800: stat db/d45/cdd 0 2024-09-17T07:19:56.853 INFO:tasks.workunit.client.0.smithi087.stdout:3/541: readlink d6/d15/l1f 0 2024-09-17T07:19:56.853 INFO:tasks.workunit.client.1.smithi139.stdout:1/328: rename d2/d10/d12/d24/d38/c40 to d2/d10/d12/d35/d2b/c68 0 2024-09-17T07:19:56.853 INFO:tasks.workunit.client.1.smithi139.stdout:2/515: dwrite d0/d7/d86/da4/d12/f77 [0,4194304] 0 2024-09-17T07:19:56.854 INFO:tasks.workunit.client.0.smithi087.stdout:6/687: creat d1/d6/d1a/d2c/fe8 x:0 0 0 2024-09-17T07:19:56.855 INFO:tasks.workunit.client.0.smithi087.stdout:9/540: dread d3/d4/d16/f5b [0,4194304] 0 2024-09-17T07:19:56.855 INFO:tasks.workunit.client.0.smithi087.stdout:5/688: rename d5/d18/d6a to d5/d6d/de0 0 2024-09-17T07:19:56.855 INFO:tasks.workunit.client.0.smithi087.stdout:0/801: write db/d45/d9e/d95/fee [257138,2241] 0 2024-09-17T07:19:56.858 INFO:tasks.workunit.client.0.smithi087.stdout:5/689: write d5/d12/d4d/f3a [2098761,108691] 0 2024-09-17T07:19:56.858 INFO:tasks.workunit.client.0.smithi087.stdout:9/541: mknod d3/d4/da/d4b/cc8 0 2024-09-17T07:19:56.860 INFO:tasks.workunit.client.0.smithi087.stdout:5/690: truncate d5/d12/d1c/fa5 4561487 0 2024-09-17T07:19:56.860 INFO:tasks.workunit.client.0.smithi087.stdout:0/802: fsync db/d45/d5b/fec 0 2024-09-17T07:19:56.866 INFO:tasks.workunit.client.0.smithi087.stdout:5/691: rename d5/d8/d1f/d68 to d5/d18/d6f/de1 0 2024-09-17T07:19:56.867 INFO:tasks.workunit.client.1.smithi139.stdout:7/424: dwrite d5/d17/d4e/f69 [0,4194304] 0 2024-09-17T07:19:56.870 INFO:tasks.workunit.client.0.smithi087.stdout:9/542: link d3/d4/d6/d8/d12/d32/f8f d3/d25/d83/fc9 0 2024-09-17T07:19:56.871 INFO:tasks.workunit.client.1.smithi139.stdout:0/347: dwrite d1/da/d1b/d32/f7a [0,4194304] 0 2024-09-17T07:19:56.871 INFO:tasks.workunit.client.0.smithi087.stdout:9/543: stat d3/d4/d16/d69/f6b 0 2024-09-17T07:19:56.871 INFO:tasks.workunit.client.0.smithi087.stdout:5/692: dread - d5/d18/d6f/de1/d7d/fbc zero size 2024-09-17T07:19:56.872 INFO:tasks.workunit.client.1.smithi139.stdout:9/835: write dc/d11/d52/d56/fbf [535832,113698] 0 2024-09-17T07:19:56.873 INFO:tasks.workunit.client.0.smithi087.stdout:5/693: readlink d5/d18/l46 0 2024-09-17T07:19:56.873 INFO:tasks.workunit.client.0.smithi087.stdout:0/803: rmdir db/d45/d9e/d95/de9/df9 0 2024-09-17T07:19:56.874 INFO:tasks.workunit.client.0.smithi087.stdout:5/694: write d5/d18/d20/d2f/fdd [452645,30048] 0 2024-09-17T07:19:56.876 INFO:tasks.workunit.client.0.smithi087.stdout:7/464: truncate d0/d3/d10/f21 3705205 0 2024-09-17T07:19:56.877 INFO:tasks.workunit.client.0.smithi087.stdout:5/695: write d5/d8/d1f/f58 [1478195,115757] 0 2024-09-17T07:19:56.878 INFO:tasks.workunit.client.1.smithi139.stdout:9/836: fsync dc/d11/dbe/fee 0 2024-09-17T07:19:56.878 INFO:tasks.workunit.client.1.smithi139.stdout:5/393: dread d4/d16/d1b/d20/d38/d4f/f5c [0,4194304] 0 2024-09-17T07:19:56.879 INFO:tasks.workunit.client.1.smithi139.stdout:5/394: chown d4/d16/d1b/d20/d32/d76 4068920 1 2024-09-17T07:19:56.880 INFO:tasks.workunit.client.0.smithi087.stdout:9/544: unlink d3/d4/d6/d8/d12/c48 0 2024-09-17T07:19:56.885 INFO:tasks.workunit.client.0.smithi087.stdout:5/696: dwrite d5/d18/f4a [0,4194304] 0 2024-09-17T07:19:56.887 INFO:tasks.workunit.client.0.smithi087.stdout:9/545: rmdir d3/d4/d6/d8/d12/d38 39 2024-09-17T07:19:56.889 INFO:tasks.workunit.client.0.smithi087.stdout:9/546: write d3/d4/d6/d8/d22/d43/f5d [1706656,68209] 0 2024-09-17T07:19:56.891 INFO:tasks.workunit.client.0.smithi087.stdout:3/542: truncate d6/d1b/d42/f93 2885306 0 2024-09-17T07:19:56.893 INFO:tasks.workunit.client.0.smithi087.stdout:9/547: unlink d3/d4/d6/d8/d22/d43/f5d 0 2024-09-17T07:19:56.894 INFO:tasks.workunit.client.0.smithi087.stdout:9/548: fdatasync d3/d4/d16/d69/f6b 0 2024-09-17T07:19:56.895 INFO:tasks.workunit.client.0.smithi087.stdout:0/804: getdents db/d45/d9e/d86/dd5 0 2024-09-17T07:19:56.895 INFO:tasks.workunit.client.0.smithi087.stdout:5/697: mknod d5/d18/d6f/de1/ce2 0 2024-09-17T07:19:56.896 INFO:tasks.workunit.client.0.smithi087.stdout:4/526: dread d2/d5/f26 [0,4194304] 0 2024-09-17T07:19:56.899 INFO:tasks.workunit.client.0.smithi087.stdout:9/549: truncate d3/d4/d6/d71/f9b 331156 0 2024-09-17T07:19:56.902 INFO:tasks.workunit.client.0.smithi087.stdout:5/698: rename d5/d12/d56/d5b to d5/d18/d20/d2f/d60/de3 0 2024-09-17T07:19:56.903 INFO:tasks.workunit.client.0.smithi087.stdout:3/543: getdents d6/d1b/d42/d62 0 2024-09-17T07:19:56.904 INFO:tasks.workunit.client.1.smithi139.stdout:4/419: link d0/d1/d29/d41/l5d d0/d37/d5f/l81 0 2024-09-17T07:19:56.905 INFO:tasks.workunit.client.0.smithi087.stdout:4/527: getdents d2/d22/d2c/d96 0 2024-09-17T07:19:56.907 INFO:tasks.workunit.client.0.smithi087.stdout:5/699: mkdir d5/d8/d1f/de4 0 2024-09-17T07:19:56.908 INFO:tasks.workunit.client.0.smithi087.stdout:3/544: mknod d6/d15/d37/d3c/cb5 0 2024-09-17T07:19:56.909 INFO:tasks.workunit.client.0.smithi087.stdout:9/550: dwrite d3/d4/d16/f7c [0,4194304] 0 2024-09-17T07:19:56.910 INFO:tasks.workunit.client.0.smithi087.stdout:4/528: getdents d2/d22/d2c/d96 0 2024-09-17T07:19:56.910 INFO:tasks.workunit.client.1.smithi139.stdout:2/516: chown d0/d7/d86/da4/d12/d45/l68 1 1 2024-09-17T07:19:56.914 INFO:tasks.workunit.client.1.smithi139.stdout:2/517: dread d0/de/d69/f6a [0,4194304] 0 2024-09-17T07:19:56.915 INFO:tasks.workunit.client.1.smithi139.stdout:6/570: truncate db/df/d4e/d64/d56/fa6 371476 0 2024-09-17T07:19:56.916 INFO:tasks.workunit.client.1.smithi139.stdout:2/518: fdatasync d0/de/d54/f8a 0 2024-09-17T07:19:56.917 INFO:tasks.workunit.client.1.smithi139.stdout:6/571: read - db/df/d73/f8d zero size 2024-09-17T07:19:56.917 INFO:tasks.workunit.client.1.smithi139.stdout:2/519: stat d0/d3b/c73 0 2024-09-17T07:19:56.918 INFO:tasks.workunit.client.0.smithi087.stdout:5/700: creat d5/d12/d56/d9e/fe5 x:0 0 0 2024-09-17T07:19:56.918 INFO:tasks.workunit.client.0.smithi087.stdout:3/545: rmdir d6/d15 39 2024-09-17T07:19:56.919 INFO:tasks.workunit.client.0.smithi087.stdout:6/688: dread d1/d6/d1a/d2c/f51 [0,4194304] 0 2024-09-17T07:19:56.920 INFO:tasks.workunit.client.1.smithi139.stdout:6/572: fsync db/df/d4e/fb8 0 2024-09-17T07:19:56.922 INFO:tasks.workunit.client.0.smithi087.stdout:5/701: chown d5/d8/d1f/d4e/fb5 0 1 2024-09-17T07:19:56.925 INFO:tasks.workunit.client.1.smithi139.stdout:0/348: dread d1/f43 [0,4194304] 0 2024-09-17T07:19:56.927 INFO:tasks.workunit.client.0.smithi087.stdout:6/689: read d1/d6/d1a/d2c/d58/d90/f9d [619290,109547] 0 2024-09-17T07:19:56.929 INFO:tasks.workunit.client.0.smithi087.stdout:9/551: dwrite d3/d4/d6/d8/d22/f2d [0,4194304] 0 2024-09-17T07:19:56.930 INFO:tasks.workunit.client.0.smithi087.stdout:4/529: rename d2/d92/d4d/d3e/l4b to d2/d92/d4f/d6a/lba 0 2024-09-17T07:19:56.932 INFO:tasks.workunit.client.1.smithi139.stdout:3/413: mkdir d5/d63/d6d/d6f/d81/d82 0 2024-09-17T07:19:56.932 INFO:tasks.workunit.client.0.smithi087.stdout:5/702: dwrite d5/d12/f8b [0,4194304] 0 2024-09-17T07:19:56.933 INFO:tasks.workunit.client.1.smithi139.stdout:8/627: dwrite d0/d20/d28/fa8 [0,4194304] 0 2024-09-17T07:19:56.933 INFO:tasks.workunit.client.1.smithi139.stdout:7/425: mknod d5/d10/d2b/d78/c89 0 2024-09-17T07:19:56.935 INFO:tasks.workunit.client.0.smithi087.stdout:5/703: write d5/d12/f77 [2990557,64655] 0 2024-09-17T07:19:56.938 INFO:tasks.workunit.client.0.smithi087.stdout:4/530: mknod d2/d92/d4d/d3e/cbb 0 2024-09-17T07:19:56.939 INFO:tasks.workunit.client.1.smithi139.stdout:6/573: mkdir db/df/d4c/dbc 0 2024-09-17T07:19:56.940 INFO:tasks.workunit.client.0.smithi087.stdout:9/552: symlink d3/d4/d16/d69/d8a/d1e/d90/lca 0 2024-09-17T07:19:56.941 INFO:tasks.workunit.client.1.smithi139.stdout:5/395: getdents d4/d16/d1b/d20/d32/d72 0 2024-09-17T07:19:56.941 INFO:tasks.workunit.client.0.smithi087.stdout:3/546: rmdir d6/d1b/d42 39 2024-09-17T07:19:56.943 INFO:tasks.workunit.client.0.smithi087.stdout:6/690: read d1/f78 [3808244,53277] 0 2024-09-17T07:19:56.945 INFO:tasks.workunit.client.1.smithi139.stdout:9/837: creat dc/d11/d52/d56/d7a/da1/f113 x:0 0 0 2024-09-17T07:19:56.946 INFO:tasks.workunit.client.0.smithi087.stdout:7/465: dwrite d0/d3/f4 [0,4194304] 0 2024-09-17T07:19:56.946 INFO:tasks.workunit.client.0.smithi087.stdout:4/531: dread d2/d92/d4d/d21/f4c [0,4194304] 0 2024-09-17T07:19:56.950 INFO:tasks.workunit.client.0.smithi087.stdout:5/704: dread d5/d6d/f90 [0,4194304] 0 2024-09-17T07:19:56.950 INFO:tasks.workunit.client.0.smithi087.stdout:4/532: write d2/d92/d4d/f8a [1753497,10057] 0 2024-09-17T07:19:56.951 INFO:tasks.workunit.client.0.smithi087.stdout:6/691: read d1/f78 [496378,64305] 0 2024-09-17T07:19:56.953 INFO:tasks.workunit.client.1.smithi139.stdout:7/426: mknod d5/d17/c8a 0 2024-09-17T07:19:56.954 INFO:tasks.workunit.client.0.smithi087.stdout:5/705: stat d5/d18/d6f/de1/lb6 0 2024-09-17T07:19:56.955 INFO:tasks.workunit.client.0.smithi087.stdout:5/706: chown d5/d8/d1f/d4e 10528 1 2024-09-17T07:19:56.956 INFO:tasks.workunit.client.0.smithi087.stdout:4/533: write d2/d22/d2c/f28 [3656158,98803] 0 2024-09-17T07:19:56.956 INFO:tasks.workunit.client.1.smithi139.stdout:5/396: unlink d4/d16/d1b/d20/d38/c3a 0 2024-09-17T07:19:56.957 INFO:tasks.workunit.client.0.smithi087.stdout:9/553: rename d3/d4/d6/d8/f14 to d3/d4/d6/d71/fcb 0 2024-09-17T07:19:56.958 INFO:tasks.workunit.client.0.smithi087.stdout:3/547: truncate d6/d15/d37/f7f 200837 0 2024-09-17T07:19:56.959 INFO:tasks.workunit.client.1.smithi139.stdout:3/414: rename d5/d15/d16/d4c/d28/d80 to d5/d15/d20/d83 0 2024-09-17T07:19:56.959 INFO:tasks.workunit.client.0.smithi087.stdout:0/805: dwrite db/d45/d9e/d86/f98 [0,4194304] 0 2024-09-17T07:19:56.961 INFO:tasks.workunit.client.0.smithi087.stdout:0/806: chown db/d45/d9e/c94 211 1 2024-09-17T07:19:56.962 INFO:tasks.workunit.client.1.smithi139.stdout:2/520: creat d0/fae x:0 0 0 2024-09-17T07:19:56.962 INFO:tasks.workunit.client.0.smithi087.stdout:7/466: truncate d0/d3/d23/d17/f68 672148 0 2024-09-17T07:19:56.962 INFO:tasks.workunit.client.0.smithi087.stdout:7/467: readlink d0/lb 0 2024-09-17T07:19:56.964 INFO:tasks.workunit.client.1.smithi139.stdout:2/521: chown d0/d7/d86/da4/d12/d45/lac 540044345 1 2024-09-17T07:19:56.964 INFO:tasks.workunit.client.0.smithi087.stdout:4/534: chown d2/d5/d1f/f5e 1 1 2024-09-17T07:19:56.964 INFO:tasks.workunit.client.0.smithi087.stdout:7/468: write d0/f28 [1827852,61872] 0 2024-09-17T07:19:56.965 INFO:tasks.workunit.client.1.smithi139.stdout:0/349: unlink d1/da/d2a/c40 0 2024-09-17T07:19:56.965 INFO:tasks.workunit.client.1.smithi139.stdout:7/427: write d5/d10/d4d/f7d [1248400,52622] 0 2024-09-17T07:19:56.966 INFO:tasks.workunit.client.1.smithi139.stdout:7/428: write f2 [7542004,9822] 0 2024-09-17T07:19:56.967 INFO:tasks.workunit.client.0.smithi087.stdout:5/707: write d5/d18/d20/d7a/fbf [774195,81154] 0 2024-09-17T07:19:56.967 INFO:tasks.workunit.client.1.smithi139.stdout:8/628: rmdir d0/d20/d28/d52/dc8 0 2024-09-17T07:19:56.969 INFO:tasks.workunit.client.1.smithi139.stdout:7/429: fsync d5/d17/f49 0 2024-09-17T07:19:56.970 INFO:tasks.workunit.client.1.smithi139.stdout:7/430: write d5/f18 [1548657,101064] 0 2024-09-17T07:19:56.970 INFO:tasks.workunit.client.0.smithi087.stdout:4/535: rename d2/d5/f8 to d2/d92/d4f/fbc 0 2024-09-17T07:19:56.971 INFO:tasks.workunit.client.1.smithi139.stdout:0/350: chown d1/lb 18996 1 2024-09-17T07:19:56.972 INFO:tasks.workunit.client.1.smithi139.stdout:2/522: symlink d0/d7/d86/laf 0 2024-09-17T07:19:56.973 INFO:tasks.workunit.client.0.smithi087.stdout:3/548: symlink d6/d1b/d42/d6e/db0/lb6 0 2024-09-17T07:19:56.975 INFO:tasks.workunit.client.1.smithi139.stdout:3/415: creat d5/d21/d23/d69/f84 x:0 0 0 2024-09-17T07:19:56.976 INFO:tasks.workunit.client.1.smithi139.stdout:2/523: dread d0/f9e [0,4194304] 0 2024-09-17T07:19:56.977 INFO:tasks.workunit.client.1.smithi139.stdout:8/629: mknod d0/d1a/d4d/da4/dc4/cca 0 2024-09-17T07:19:56.978 INFO:tasks.workunit.client.0.smithi087.stdout:4/536: creat d2/d92/d4f/d6a/d9d/fbd x:0 0 0 2024-09-17T07:19:56.979 INFO:tasks.workunit.client.0.smithi087.stdout:9/554: dwrite d3/d4/d16/f3a [0,4194304] 0 2024-09-17T07:19:56.980 INFO:tasks.workunit.client.0.smithi087.stdout:3/549: fsync d6/d15/f19 0 2024-09-17T07:19:56.981 INFO:tasks.workunit.client.0.smithi087.stdout:5/708: dwrite d5/d12/fd1 [0,4194304] 0 2024-09-17T07:19:56.983 INFO:tasks.workunit.client.0.smithi087.stdout:9/555: write d3/d4/d16/fc2 [425698,58295] 0 2024-09-17T07:19:56.984 INFO:tasks.workunit.client.1.smithi139.stdout:2/524: mknod d0/d7/d86/da4/d12/cb0 0 2024-09-17T07:19:56.986 INFO:tasks.workunit.client.0.smithi087.stdout:3/550: mkdir d6/d15/d37/d3c/d43/db7 0 2024-09-17T07:19:56.987 INFO:tasks.workunit.client.0.smithi087.stdout:4/537: rename d2/d22/d2c/f31 to d2/d92/d86/fbe 0 2024-09-17T07:19:56.990 INFO:tasks.workunit.client.1.smithi139.stdout:3/416: fsync d5/d15/d16/d4c/f66 0 2024-09-17T07:19:56.990 INFO:tasks.workunit.client.0.smithi087.stdout:3/551: readlink d6/l2d 0 2024-09-17T07:19:56.991 INFO:tasks.workunit.client.0.smithi087.stdout:5/709: link d5/d6d/f90 d5/d12/d1c/fe6 0 2024-09-17T07:19:56.991 INFO:tasks.workunit.client.0.smithi087.stdout:7/469: dread d0/d3/d10/d31/f43 [0,4194304] 0 2024-09-17T07:19:56.992 INFO:tasks.workunit.client.0.smithi087.stdout:5/710: stat d5/d8/d1f/f58 0 2024-09-17T07:19:56.993 INFO:tasks.workunit.client.0.smithi087.stdout:9/556: unlink d3/d4/l10 0 2024-09-17T07:19:56.994 INFO:tasks.workunit.client.0.smithi087.stdout:3/552: symlink d6/d15/d37/d3c/lb8 0 2024-09-17T07:19:56.995 INFO:tasks.workunit.client.1.smithi139.stdout:2/525: rmdir d0/de/d69 39 2024-09-17T07:19:56.996 INFO:tasks.workunit.client.0.smithi087.stdout:4/538: link d2/d92/d4d/d21/d2f/d3b/d7e/cb9 d2/d22/d62/cbf 0 2024-09-17T07:19:56.997 INFO:tasks.workunit.client.1.smithi139.stdout:1/329: truncate d2/ff 1095833 0 2024-09-17T07:19:56.998 INFO:tasks.workunit.client.0.smithi087.stdout:5/711: creat d5/d8/d1f/d4e/da3/fe7 x:0 0 0 2024-09-17T07:19:56.998 INFO:tasks.workunit.client.0.smithi087.stdout:3/553: fsync d6/d15/d4b/f8b 0 2024-09-17T07:19:56.999 INFO:tasks.workunit.client.0.smithi087.stdout:5/712: fdatasync d5/d18/d20/d2f/f57 0 2024-09-17T07:19:56.999 INFO:tasks.workunit.client.1.smithi139.stdout:2/526: rmdir d0/d7 39 2024-09-17T07:19:57.000 INFO:tasks.workunit.client.0.smithi087.stdout:3/554: unlink d6/d15/d4b/c9b 0 2024-09-17T07:19:57.001 INFO:tasks.workunit.client.0.smithi087.stdout:9/557: dread d3/d4/d6/d8/d22/d43/f45 [0,4194304] 0 2024-09-17T07:19:57.002 INFO:tasks.workunit.client.0.smithi087.stdout:9/558: chown d3/d4/d6/d8/d22/d64/l65 3742239 1 2024-09-17T07:19:57.002 INFO:tasks.workunit.client.1.smithi139.stdout:4/420: dwrite d0/f47 [0,4194304] 0 2024-09-17T07:19:57.003 INFO:tasks.workunit.client.0.smithi087.stdout:3/555: symlink d6/d7d/lb9 0 2024-09-17T07:19:57.003 INFO:tasks.workunit.client.0.smithi087.stdout:9/559: read d3/d4/d6/f13 [1694045,70048] 0 2024-09-17T07:19:57.004 INFO:tasks.workunit.client.0.smithi087.stdout:3/556: write d6/d7d/fa5 [219491,73767] 0 2024-09-17T07:19:57.006 INFO:tasks.workunit.client.0.smithi087.stdout:9/560: creat d3/d25/fcc x:0 0 0 2024-09-17T07:19:57.007 INFO:tasks.workunit.client.1.smithi139.stdout:4/421: chown d0/d1/d29 1578 1 2024-09-17T07:19:57.008 INFO:tasks.workunit.client.0.smithi087.stdout:9/561: write d3/d4/da/f55 [1275512,105766] 0 2024-09-17T07:19:57.009 INFO:tasks.workunit.client.0.smithi087.stdout:5/713: link d5/d18/d20/c5d d5/d6d/dd7/ce8 0 2024-09-17T07:19:57.009 INFO:tasks.workunit.client.1.smithi139.stdout:4/422: write d0/f4 [1335489,78644] 0 2024-09-17T07:19:57.010 INFO:tasks.workunit.client.0.smithi087.stdout:9/562: write d3/d4/d6/d8/d22/f50 [793216,80449] 0 2024-09-17T07:19:57.011 INFO:tasks.workunit.client.1.smithi139.stdout:5/397: creat d4/d16/f78 x:0 0 0 2024-09-17T07:19:57.013 INFO:tasks.workunit.client.1.smithi139.stdout:5/398: write d4/d16/f58 [2162587,89722] 0 2024-09-17T07:19:57.013 INFO:tasks.workunit.client.0.smithi087.stdout:3/557: link d6/d1b/d42/l98 d6/d15/lba 0 2024-09-17T07:19:57.013 INFO:tasks.workunit.client.1.smithi139.stdout:4/423: getdents d0/db/d7f 0 2024-09-17T07:19:57.016 INFO:tasks.workunit.client.0.smithi087.stdout:9/563: dread d3/d4/f87 [0,4194304] 0 2024-09-17T07:19:57.018 INFO:tasks.workunit.client.0.smithi087.stdout:5/714: dwrite d5/d12/d56/d9e/fe5 [0,4194304] 0 2024-09-17T07:19:57.021 INFO:tasks.workunit.client.1.smithi139.stdout:5/399: link d4/d16/d1b/d20/d28/l2d d4/d16/d1b/d20/d32/l79 0 2024-09-17T07:19:57.021 INFO:tasks.workunit.client.0.smithi087.stdout:5/715: creat d5/d6d/fe9 x:0 0 0 2024-09-17T07:19:57.023 INFO:tasks.workunit.client.1.smithi139.stdout:4/424: rename d0/d1a/f55 to d0/f82 0 2024-09-17T07:19:57.024 INFO:tasks.workunit.client.0.smithi087.stdout:3/558: dwrite d6/d1b/d2b/fae [0,4194304] 0 2024-09-17T07:19:57.027 INFO:tasks.workunit.client.0.smithi087.stdout:5/716: link d5/d12/d1c/fab d5/d12/d14/d61/d94/fea 0 2024-09-17T07:19:57.028 INFO:tasks.workunit.client.0.smithi087.stdout:3/559: mkdir d6/d1b/d42/d62/dbb 0 2024-09-17T07:19:57.030 INFO:tasks.workunit.client.0.smithi087.stdout:3/560: write d6/d15/d37/d3c/f54 [6039102,34183] 0 2024-09-17T07:19:57.031 INFO:tasks.workunit.client.1.smithi139.stdout:2/527: dread d0/de/df/d56/f7a [0,4194304] 0 2024-09-17T07:19:57.031 INFO:tasks.workunit.client.1.smithi139.stdout:5/400: creat d4/d16/f7a x:0 0 0 2024-09-17T07:19:57.031 INFO:tasks.workunit.client.1.smithi139.stdout:1/330: creat d2/d10/d12/f69 x:0 0 0 2024-09-17T07:19:57.033 INFO:tasks.workunit.client.0.smithi087.stdout:3/561: rename d6/c1d to d6/d15/d4b/cbc 0 2024-09-17T07:19:57.033 INFO:tasks.workunit.client.1.smithi139.stdout:2/528: fsync d0/de/df/d56/f71 0 2024-09-17T07:19:57.034 INFO:tasks.workunit.client.1.smithi139.stdout:5/401: chown d4/d16/f2b 1022 1 2024-09-17T07:19:57.035 INFO:tasks.workunit.client.0.smithi087.stdout:3/562: creat d6/d15/d37/d3c/d52/db2/fbd x:0 0 0 2024-09-17T07:19:57.036 INFO:tasks.workunit.client.0.smithi087.stdout:3/563: symlink d6/d15/d92/lbe 0 2024-09-17T07:19:57.037 INFO:tasks.workunit.client.1.smithi139.stdout:8/630: truncate d0/d1a/f39 6106964 0 2024-09-17T07:19:57.039 INFO:tasks.workunit.client.1.smithi139.stdout:2/529: fdatasync d0/de/d69/f74 0 2024-09-17T07:19:57.040 INFO:tasks.workunit.client.1.smithi139.stdout:3/417: truncate d5/d15/d16/d4c/d28/f30 1581178 0 2024-09-17T07:19:57.042 INFO:tasks.workunit.client.1.smithi139.stdout:0/351: dwrite d1/da/d1b/d32/f4f [0,4194304] 0 2024-09-17T07:19:57.042 INFO:tasks.workunit.client.0.smithi087.stdout:5/717: dread d5/d18/d6f/de1/fd3 [0,4194304] 0 2024-09-17T07:19:57.043 INFO:tasks.workunit.client.1.smithi139.stdout:8/631: unlink d0/d20/d28/f9d 0 2024-09-17T07:19:57.043 INFO:tasks.workunit.client.0.smithi087.stdout:5/718: chown l3 1159 1 2024-09-17T07:19:57.045 INFO:tasks.workunit.client.1.smithi139.stdout:8/632: stat d0/d20/d28/c46 0 2024-09-17T07:19:57.045 INFO:tasks.workunit.client.0.smithi087.stdout:5/719: mknod d5/d18/d6f/de1/d7d/ceb 0 2024-09-17T07:19:57.045 INFO:tasks.workunit.client.0.smithi087.stdout:5/720: chown d5/d12/d1c/l7e 244 1 2024-09-17T07:19:57.049 INFO:tasks.workunit.client.1.smithi139.stdout:4/425: write d0/db/d58/f77 [632168,68548] 0 2024-09-17T07:19:57.050 INFO:tasks.workunit.client.0.smithi087.stdout:5/721: link d5/d18/d20/d2f/d60/de3/ca8 d5/d18/d20/d2f/d83/cec 0 2024-09-17T07:19:57.051 INFO:tasks.workunit.client.1.smithi139.stdout:5/402: dwrite d4/f5b [0,4194304] 0 2024-09-17T07:19:57.053 INFO:tasks.workunit.client.0.smithi087.stdout:3/564: dread d6/d16/f4a [0,4194304] 0 2024-09-17T07:19:57.054 INFO:tasks.workunit.client.0.smithi087.stdout:5/722: rename d5/d6d/de0 to d5/d18/d20/d2f/d60/de3/ded 0 2024-09-17T07:19:57.054 INFO:tasks.workunit.client.1.smithi139.stdout:5/403: chown d4/d5d 1588253 1 2024-09-17T07:19:57.058 INFO:tasks.workunit.client.1.smithi139.stdout:3/418: dwrite d5/d21/d23/d38/f40 [0,4194304] 0 2024-09-17T07:19:57.059 INFO:tasks.workunit.client.1.smithi139.stdout:5/404: write d4/d16/d1b/d20/d28/f53 [1263912,108544] 0 2024-09-17T07:19:57.061 INFO:tasks.workunit.client.1.smithi139.stdout:1/331: dread - d2/d10/d12/d24/f4e zero size 2024-09-17T07:19:57.061 INFO:tasks.workunit.client.1.smithi139.stdout:2/530: truncate d0/d7/d1a/d59/f97 195077 0 2024-09-17T07:19:57.064 INFO:tasks.workunit.client.1.smithi139.stdout:1/332: fdatasync d2/d10/d12/d24/f4e 0 2024-09-17T07:19:57.069 INFO:tasks.workunit.client.1.smithi139.stdout:8/633: creat d0/d1a/d4d/fcb x:0 0 0 2024-09-17T07:19:57.071 INFO:tasks.workunit.client.1.smithi139.stdout:5/405: write d4/d16/f77 [5075904,39370] 0 2024-09-17T07:19:57.077 INFO:tasks.workunit.client.1.smithi139.stdout:2/531: creat d0/de/df/fb1 x:0 0 0 2024-09-17T07:19:57.079 INFO:tasks.workunit.client.1.smithi139.stdout:1/333: symlink d2/d10/d12/d24/d38/l6a 0 2024-09-17T07:19:57.117 INFO:tasks.workunit.client.1.smithi139.stdout:3/419: write d5/d21/d23/f49 [993317,74183] 0 2024-09-17T07:19:57.117 INFO:tasks.workunit.client.1.smithi139.stdout:4/426: truncate d0/f26 220192 0 2024-09-17T07:19:57.117 INFO:tasks.workunit.client.1.smithi139.stdout:5/406: dread d4/d16/d1b/d20/d28/d3f/f65 [0,4194304] 0 2024-09-17T07:19:57.118 INFO:tasks.workunit.client.0.smithi087.stdout:0/807: write db/f8c [41155,89778] 0 2024-09-17T07:19:57.118 INFO:tasks.workunit.client.1.smithi139.stdout:2/532: write d0/de/d25/d3f/f96 [80775,27956] 0 2024-09-17T07:19:57.122 INFO:tasks.workunit.client.1.smithi139.stdout:8/634: rename d0/l2e to d0/d1a/lcc 0 2024-09-17T07:19:57.122 INFO:tasks.workunit.client.1.smithi139.stdout:0/352: dwrite d1/da/d17/d72/f22 [0,4194304] 0 2024-09-17T07:19:57.123 INFO:tasks.workunit.client.0.smithi087.stdout:6/692: dwrite d1/d6/d1a/f41 [4194304,4194304] 0 2024-09-17T07:19:57.124 INFO:tasks.workunit.client.1.smithi139.stdout:0/353: chown d1/l5 12911058 1 2024-09-17T07:19:57.124 INFO:tasks.workunit.client.1.smithi139.stdout:1/334: write d2/d10/d12/f2d [1697864,6294] 0 2024-09-17T07:19:57.127 INFO:tasks.workunit.client.0.smithi087.stdout:6/693: creat d1/d6/d1a/d2c/d40/dd2/fe9 x:0 0 0 2024-09-17T07:19:57.128 INFO:tasks.workunit.client.1.smithi139.stdout:5/407: fdatasync d4/d16/d1b/d20/d38/d4f/f5e 0 2024-09-17T07:19:57.130 INFO:tasks.workunit.client.1.smithi139.stdout:4/427: rename d0/d10/d39 to d0/d37/d5f/d83 0 2024-09-17T07:19:57.134 INFO:tasks.workunit.client.1.smithi139.stdout:0/354: chown d1/da/d17/d72/f5b 483628 1 2024-09-17T07:19:57.136 INFO:tasks.workunit.client.0.smithi087.stdout:6/694: dwrite d1/d6/d1a/d2c/d58/d90/fab [0,4194304] 0 2024-09-17T07:19:57.137 INFO:tasks.workunit.client.1.smithi139.stdout:5/408: read d4/f36 [876578,3219] 0 2024-09-17T07:19:57.140 INFO:tasks.workunit.client.1.smithi139.stdout:2/533: dwrite d0/f9b [4194304,4194304] 0 2024-09-17T07:19:57.141 INFO:tasks.workunit.client.1.smithi139.stdout:8/635: rename d0/d20/d28/d52/d65/d7f/db6/l3c to d0/d20/d28/d52/d54/lcd 0 2024-09-17T07:19:57.141 INFO:tasks.workunit.client.0.smithi087.stdout:9/564: getdents d3/d25 0 2024-09-17T07:19:57.142 INFO:tasks.workunit.client.0.smithi087.stdout:6/695: creat d1/d6/d1a/d4e/de1/fea x:0 0 0 2024-09-17T07:19:57.145 INFO:tasks.workunit.client.1.smithi139.stdout:5/409: creat d4/f7b x:0 0 0 2024-09-17T07:19:57.152 INFO:tasks.workunit.client.0.smithi087.stdout:0/808: dread db/d4f/fda [0,4194304] 0 2024-09-17T07:19:57.152 INFO:tasks.workunit.client.1.smithi139.stdout:0/355: link d1/l9 d1/da/d1b/l8c 0 2024-09-17T07:19:57.152 INFO:tasks.workunit.client.1.smithi139.stdout:5/410: fsync d4/f36 0 2024-09-17T07:19:57.155 INFO:tasks.workunit.client.0.smithi087.stdout:6/696: dwrite d1/d6/d1a/d2c/d48/f72 [0,4194304] 0 2024-09-17T07:19:57.155 INFO:tasks.workunit.client.0.smithi087.stdout:0/809: mkdir db/dbe/d123 0 2024-09-17T07:19:57.156 INFO:tasks.workunit.client.0.smithi087.stdout:5/723: write d5/d18/d20/d2f/d60/de3/ded/f86 [951422,7533] 0 2024-09-17T07:19:57.157 INFO:tasks.workunit.client.1.smithi139.stdout:3/420: truncate d5/d15/d16/d4c/d28/f52 4429820 0 2024-09-17T07:19:57.157 INFO:tasks.workunit.client.0.smithi087.stdout:6/697: chown d1/d67/faa 0 1 2024-09-17T07:19:57.158 INFO:tasks.workunit.client.1.smithi139.stdout:1/335: link d2/d10/d12/d24/l5a d2/d10/d12/d35/d2b/d4a/l6b 0 2024-09-17T07:19:57.159 INFO:tasks.workunit.client.1.smithi139.stdout:2/534: dwrite d0/dc/d15/f5f [0,4194304] 0 2024-09-17T07:19:57.160 INFO:tasks.workunit.client.1.smithi139.stdout:4/428: write d0/f5 [498345,20800] 0 2024-09-17T07:19:57.160 INFO:tasks.workunit.client.0.smithi087.stdout:9/565: write d3/d4/d6/d8/d22/d92/fbd [174835,24502] 0 2024-09-17T07:19:57.161 INFO:tasks.workunit.client.0.smithi087.stdout:5/724: write d5/d6d/fbd [166975,13182] 0 2024-09-17T07:19:57.162 INFO:tasks.workunit.client.0.smithi087.stdout:0/810: rename db/d45/d7b/db0 to db/dbe/d124 0 2024-09-17T07:19:57.163 INFO:tasks.workunit.client.1.smithi139.stdout:8/636: dwrite d0/d20/d28/d52/d65/dbe/fbf [0,4194304] 0 2024-09-17T07:19:57.165 INFO:tasks.workunit.client.1.smithi139.stdout:4/429: fsync d0/d1/d29/d41/f5c 0 2024-09-17T07:19:57.165 INFO:tasks.workunit.client.0.smithi087.stdout:0/811: readlink db/l2b 0 2024-09-17T07:19:57.165 INFO:tasks.workunit.client.0.smithi087.stdout:9/566: readlink d3/d4/d6/d8/d22/d64/l65 0 2024-09-17T07:19:57.166 INFO:tasks.workunit.client.0.smithi087.stdout:3/565: dwrite d6/d1b/d2b/f83 [0,4194304] 0 2024-09-17T07:19:57.167 INFO:tasks.workunit.client.0.smithi087.stdout:6/698: fsync d1/d6/d1a/d2c/d48/d62/fa4 0 2024-09-17T07:19:57.170 INFO:tasks.workunit.client.1.smithi139.stdout:5/411: rename d4/lc to d4/d16/d1b/d20/d32/d6c/l7c 0 2024-09-17T07:19:57.173 INFO:tasks.workunit.client.1.smithi139.stdout:5/412: fdatasync d4/d16/d1b/d20/d28/f26 0 2024-09-17T07:19:57.174 INFO:tasks.workunit.client.0.smithi087.stdout:9/567: mkdir d3/d4/dcd 0 2024-09-17T07:19:57.175 INFO:tasks.workunit.client.1.smithi139.stdout:5/413: write d4/d16/f58 [3552341,92342] 0 2024-09-17T07:19:57.175 INFO:tasks.workunit.client.1.smithi139.stdout:0/356: getdents d1/da/d17/d72/d66/d6c 0 2024-09-17T07:19:57.177 INFO:tasks.workunit.client.1.smithi139.stdout:5/414: write d4/f36 [3084726,119706] 0 2024-09-17T07:19:57.177 INFO:tasks.workunit.client.1.smithi139.stdout:0/357: stat d1/da/d1b/d3d/d5a 0 2024-09-17T07:19:57.177 INFO:tasks.workunit.client.0.smithi087.stdout:3/566: readlink d6/d15/d37/la1 0 2024-09-17T07:19:57.179 INFO:tasks.workunit.client.1.smithi139.stdout:4/430: fdatasync d0/d37/f42 0 2024-09-17T07:19:57.180 INFO:tasks.workunit.client.0.smithi087.stdout:0/812: rmdir db/d45/d9e/d86/d104 0 2024-09-17T07:19:57.180 INFO:tasks.workunit.client.0.smithi087.stdout:9/568: read d3/d4/d6/d8/d12/d32/f9e [665899,35287] 0 2024-09-17T07:19:57.181 INFO:tasks.workunit.client.0.smithi087.stdout:3/567: truncate d6/d1b/f8f 404027 0 2024-09-17T07:19:57.183 INFO:tasks.workunit.client.1.smithi139.stdout:1/336: write d2/d10/d12/d13/f16 [1659915,68186] 0 2024-09-17T07:19:57.183 INFO:tasks.workunit.client.0.smithi087.stdout:6/699: dwrite d1/d6/fc1 [0,4194304] 0 2024-09-17T07:19:57.187 INFO:tasks.workunit.client.0.smithi087.stdout:0/813: getdents db/d4f 0 2024-09-17T07:19:57.187 INFO:tasks.workunit.client.1.smithi139.stdout:3/421: creat d5/d15/d16/d4c/d28/f85 x:0 0 0 2024-09-17T07:19:57.187 INFO:tasks.workunit.client.1.smithi139.stdout:0/358: dread d1/da/f60 [0,4194304] 0 2024-09-17T07:19:57.188 INFO:tasks.workunit.client.0.smithi087.stdout:6/700: rmdir d1/d6/d1a/d2c/d58/d90/da9 39 2024-09-17T07:19:57.189 INFO:tasks.workunit.client.1.smithi139.stdout:4/431: mknod d0/d1/d29/d41/c84 0 2024-09-17T07:19:57.189 INFO:tasks.workunit.client.1.smithi139.stdout:8/637: link d0/d20/d28/c80 d0/d1a/d3a/d8d/cce 0 2024-09-17T07:19:57.190 INFO:tasks.workunit.client.0.smithi087.stdout:0/814: write db/d45/d9e/d86/dd5/fe1 [120526,67906] 0 2024-09-17T07:19:57.190 INFO:tasks.workunit.client.0.smithi087.stdout:3/568: dwrite d6/d16/f7c [0,4194304] 0 2024-09-17T07:19:57.191 INFO:tasks.workunit.client.1.smithi139.stdout:0/359: write d1/da/d17/d72/f22 [2774388,128379] 0 2024-09-17T07:19:57.197 INFO:tasks.workunit.client.1.smithi139.stdout:2/535: getdents d0/d7/d86/da4 0 2024-09-17T07:19:57.197 INFO:tasks.workunit.client.1.smithi139.stdout:2/536: fsync d0/de/f36 0 2024-09-17T07:19:57.197 INFO:tasks.workunit.client.1.smithi139.stdout:1/337: mknod d2/d10/d12/d35/c6c 0 2024-09-17T07:19:57.198 INFO:tasks.workunit.client.1.smithi139.stdout:3/422: symlink d5/l86 0 2024-09-17T07:19:57.201 INFO:tasks.workunit.client.1.smithi139.stdout:5/415: getdents d4/d16/d1b/d20/d32 0 2024-09-17T07:19:57.202 INFO:tasks.workunit.client.1.smithi139.stdout:0/360: dwrite d1/f26 [0,4194304] 0 2024-09-17T07:19:57.204 INFO:tasks.workunit.client.1.smithi139.stdout:0/361: readlink d1/da/d2a/l54 0 2024-09-17T07:19:57.204 INFO:tasks.workunit.client.1.smithi139.stdout:3/423: write d5/d15/f18 [847496,104529] 0 2024-09-17T07:19:57.204 INFO:tasks.workunit.client.1.smithi139.stdout:4/432: mknod d0/db/c85 0 2024-09-17T07:19:57.206 INFO:tasks.workunit.client.1.smithi139.stdout:5/416: fdatasync d4/d16/d1b/d20/d67/f6a 0 2024-09-17T07:19:57.208 INFO:tasks.workunit.client.1.smithi139.stdout:2/537: write d0/d7/d86/da4/d28/f2d [4659776,19522] 0 2024-09-17T07:19:57.210 INFO:tasks.workunit.client.1.smithi139.stdout:8/638: getdents d0/d1a/d3a 0 2024-09-17T07:19:57.211 INFO:tasks.workunit.client.1.smithi139.stdout:0/362: mknod d1/c8d 0 2024-09-17T07:19:57.211 INFO:tasks.workunit.client.1.smithi139.stdout:3/424: mknod d5/d63/d6d/c87 0 2024-09-17T07:19:57.211 INFO:tasks.workunit.client.1.smithi139.stdout:4/433: creat d0/d1/d29/d6d/f86 x:0 0 0 2024-09-17T07:19:57.216 INFO:tasks.workunit.client.0.smithi087.stdout:2/544: sync 2024-09-17T07:19:57.217 INFO:tasks.workunit.client.1.smithi139.stdout:4/434: write d0/d49/f52 [866734,44801] 0 2024-09-17T07:19:57.218 INFO:tasks.workunit.client.1.smithi139.stdout:5/417: truncate d4/d16/d1b/d20/d28/d3f/f65 1026390 0 2024-09-17T07:19:57.219 INFO:tasks.workunit.client.1.smithi139.stdout:1/338: dwrite d2/d10/d12/d24/d38/d3d/f4d [0,4194304] 0 2024-09-17T07:19:57.219 INFO:tasks.workunit.client.1.smithi139.stdout:8/639: rename d0/d20/d28/f3d to d0/d20/d28/d52/d99/fcf 0 2024-09-17T07:19:57.220 INFO:tasks.workunit.client.1.smithi139.stdout:4/435: stat d0/d1/d54 0 2024-09-17T07:19:57.220 INFO:tasks.workunit.client.0.smithi087.stdout:9/569: dread d3/d4/d16/d69/d8a/f85 [0,4194304] 0 2024-09-17T07:19:57.224 INFO:tasks.workunit.client.1.smithi139.stdout:5/418: readlink d4/d16/d1b/d20/l27 0 2024-09-17T07:19:57.227 INFO:tasks.workunit.client.1.smithi139.stdout:3/425: dwrite d5/d15/d16/f17 [0,4194304] 0 2024-09-17T07:19:57.227 INFO:tasks.workunit.client.1.smithi139.stdout:4/436: unlink d0/d37/d5f/f7c 0 2024-09-17T07:19:57.228 INFO:tasks.workunit.client.0.smithi087.stdout:3/569: read d6/d1b/d2b/f39 [489631,123955] 0 2024-09-17T07:19:57.229 INFO:tasks.workunit.client.1.smithi139.stdout:4/437: chown d0/d37/d5f 131 1 2024-09-17T07:19:57.230 INFO:tasks.workunit.client.0.smithi087.stdout:3/570: readlink d6/d15/d37/d3c/d43/l66 0 2024-09-17T07:19:57.230 INFO:tasks.workunit.client.0.smithi087.stdout:9/570: rename d3/d4/d16/d69/d8a/d1e/l20 to d3/d4/d16/lce 0 2024-09-17T07:19:57.231 INFO:tasks.workunit.client.1.smithi139.stdout:0/363: dwrite d1/f26 [0,4194304] 0 2024-09-17T07:19:57.233 INFO:tasks.workunit.client.1.smithi139.stdout:1/339: creat d2/d10/d12/d1a/f6d x:0 0 0 2024-09-17T07:19:57.234 INFO:tasks.workunit.client.0.smithi087.stdout:6/701: dwrite d1/d6/d1a/d2c/d33/f89 [0,4194304] 0 2024-09-17T07:19:57.236 INFO:tasks.workunit.client.1.smithi139.stdout:4/438: creat d0/d37/f87 x:0 0 0 2024-09-17T07:19:57.236 INFO:tasks.workunit.client.0.smithi087.stdout:9/571: mknod d3/d4/d16/d69/d8a/ccf 0 2024-09-17T07:19:57.237 INFO:tasks.workunit.client.0.smithi087.stdout:3/571: creat d6/d1b/d42/d62/dbb/fbf x:0 0 0 2024-09-17T07:19:57.239 INFO:tasks.workunit.client.1.smithi139.stdout:3/426: creat d5/d21/d23/f88 x:0 0 0 2024-09-17T07:19:57.240 INFO:tasks.workunit.client.0.smithi087.stdout:6/702: mknod d1/d6/d1a/d2c/d40/d4c/d77/ceb 0 2024-09-17T07:19:57.241 INFO:tasks.workunit.client.0.smithi087.stdout:9/572: fdatasync d3/d4/d6/d8/d22/d43/f5f 0 2024-09-17T07:19:57.244 INFO:tasks.workunit.client.0.smithi087.stdout:2/545: write d2/f3 [3000102,84391] 0 2024-09-17T07:19:57.247 INFO:tasks.workunit.client.0.smithi087.stdout:3/572: symlink d6/d1b/d42/d6e/lc0 0 2024-09-17T07:19:57.248 INFO:tasks.workunit.client.0.smithi087.stdout:0/815: dwrite db/faf [4194304,4194304] 0 2024-09-17T07:19:57.248 INFO:tasks.workunit.client.0.smithi087.stdout:9/573: creat d3/d4/d6/d71/fd0 x:0 0 0 2024-09-17T07:19:57.249 INFO:tasks.workunit.client.0.smithi087.stdout:6/703: creat d1/d6a/fec x:0 0 0 2024-09-17T07:19:57.250 INFO:tasks.workunit.client.1.smithi139.stdout:5/419: creat d4/d16/d1b/d20/f7d x:0 0 0 2024-09-17T07:19:57.251 INFO:tasks.workunit.client.0.smithi087.stdout:3/573: mkdir d6/d1b/d42/d62/dc1 0 2024-09-17T07:19:57.252 INFO:tasks.workunit.client.0.smithi087.stdout:2/546: mkdir d2/d48/d69/da0/db0 0 2024-09-17T07:19:57.253 INFO:tasks.workunit.client.0.smithi087.stdout:9/574: fsync d3/d4/d6/d8/fd 0 2024-09-17T07:19:57.254 INFO:tasks.workunit.client.1.smithi139.stdout:4/439: symlink d0/l88 0 2024-09-17T07:19:57.255 INFO:tasks.workunit.client.0.smithi087.stdout:6/704: creat d1/d6/d1a/d2c/d40/d4c/dce/fed x:0 0 0 2024-09-17T07:19:57.256 INFO:tasks.workunit.client.0.smithi087.stdout:2/547: unlink d2/d7/dd/d10/d4c/l83 0 2024-09-17T07:19:57.257 INFO:tasks.workunit.client.0.smithi087.stdout:9/575: symlink d3/d25/ld1 0 2024-09-17T07:19:57.257 INFO:tasks.workunit.client.1.smithi139.stdout:4/440: dread - d0/f82 zero size 2024-09-17T07:19:57.258 INFO:tasks.workunit.client.1.smithi139.stdout:1/340: link d2/d10/d12/f31 d2/d10/d12/d35/d2b/f6e 0 2024-09-17T07:19:57.259 INFO:tasks.workunit.client.1.smithi139.stdout:5/420: dwrite d4/d16/f1d [4194304,4194304] 0 2024-09-17T07:19:57.259 INFO:tasks.workunit.client.0.smithi087.stdout:3/574: rename d6/d1b/d42/f44 to d6/d1b/d42/d62/dbb/fc2 0 2024-09-17T07:19:57.262 INFO:tasks.workunit.client.1.smithi139.stdout:8/640: write d0/d20/d28/d52/d65/d7f/db6/f6a [882157,59054] 0 2024-09-17T07:19:57.263 INFO:tasks.workunit.client.0.smithi087.stdout:6/705: creat d1/d6/d1a/d2c/d58/d90/fee x:0 0 0 2024-09-17T07:19:57.264 INFO:tasks.workunit.client.0.smithi087.stdout:3/575: creat d6/d1b/d2b/fc3 x:0 0 0 2024-09-17T07:19:57.264 INFO:tasks.workunit.client.1.smithi139.stdout:0/364: dread d1/f3 [0,4194304] 0 2024-09-17T07:19:57.265 INFO:tasks.workunit.client.1.smithi139.stdout:1/341: mkdir d2/d10/d12/d35/d2b/d4a/d6f 0 2024-09-17T07:19:57.267 INFO:tasks.workunit.client.1.smithi139.stdout:5/421: creat d4/d5d/f7e x:0 0 0 2024-09-17T07:19:57.268 INFO:tasks.workunit.client.0.smithi087.stdout:2/548: dwrite d2/d50/fa8 [0,4194304] 0 2024-09-17T07:19:57.268 INFO:tasks.workunit.client.1.smithi139.stdout:8/641: stat d0/d1a/d3a/c86 0 2024-09-17T07:19:57.270 INFO:tasks.workunit.client.0.smithi087.stdout:2/549: chown d2/d12/l80 737168 1 2024-09-17T07:19:57.270 INFO:tasks.workunit.client.1.smithi139.stdout:4/441: mknod d0/d1/d29/c89 0 2024-09-17T07:19:57.271 INFO:tasks.workunit.client.1.smithi139.stdout:4/442: fdatasync d0/f4 0 2024-09-17T07:19:57.275 INFO:tasks.workunit.client.1.smithi139.stdout:8/642: unlink d0/d20/d28/d52/c5b 0 2024-09-17T07:19:57.277 INFO:tasks.workunit.client.0.smithi087.stdout:6/706: dwrite d1/d6/d1a/d2c/d58/fbf [0,4194304] 0 2024-09-17T07:19:57.279 INFO:tasks.workunit.client.1.smithi139.stdout:3/427: dwrite f2 [0,4194304] 0 2024-09-17T07:19:57.279 INFO:tasks.workunit.client.0.smithi087.stdout:0/816: truncate db/d45/d9e/d86/f98 2640984 0 2024-09-17T07:19:57.280 INFO:tasks.workunit.client.0.smithi087.stdout:2/550: dread d2/d24/d36/f38 [0,4194304] 0 2024-09-17T07:19:57.282 INFO:tasks.workunit.client.1.smithi139.stdout:0/365: rename d1/ce to d1/d58/c8e 0 2024-09-17T07:19:57.283 INFO:tasks.workunit.client.0.smithi087.stdout:2/551: write d2/d7/d33/fa9 [92611,66125] 0 2024-09-17T07:19:57.283 INFO:tasks.workunit.client.0.smithi087.stdout:0/817: unlink db/d45/d7b/d90/lc3 0 2024-09-17T07:19:57.285 INFO:tasks.workunit.client.0.smithi087.stdout:0/818: readlink db/d4f/l5a 0 2024-09-17T07:19:57.285 INFO:tasks.workunit.client.1.smithi139.stdout:1/342: link d2/d10/d12/d1a/l3a d2/d10/l70 0 2024-09-17T07:19:57.286 INFO:tasks.workunit.client.0.smithi087.stdout:3/576: truncate d6/f57 3740440 0 2024-09-17T07:19:57.286 INFO:tasks.workunit.client.0.smithi087.stdout:6/707: dwrite d1/d6/d1a/d2c/d40/dd2/fe9 [0,4194304] 0 2024-09-17T07:19:57.286 INFO:tasks.workunit.client.1.smithi139.stdout:1/343: truncate d2/f58 544132 0 2024-09-17T07:19:57.287 INFO:tasks.workunit.client.0.smithi087.stdout:2/552: chown d2/d7/d30/c4a 275 1 2024-09-17T07:19:57.288 INFO:tasks.workunit.client.1.smithi139.stdout:4/443: creat d0/d1/d29/d41/f8a x:0 0 0 2024-09-17T07:19:57.289 INFO:tasks.workunit.client.0.smithi087.stdout:0/819: write db/f3e [3357508,120959] 0 2024-09-17T07:19:57.291 INFO:tasks.workunit.client.1.smithi139.stdout:0/366: mknod d1/da/d2a/c8f 0 2024-09-17T07:19:57.292 INFO:tasks.workunit.client.1.smithi139.stdout:5/422: link d4/d16/d1b/d20/d32/d3d/l6b d4/d16/d1b/l7f 0 2024-09-17T07:19:57.293 INFO:tasks.workunit.client.1.smithi139.stdout:8/643: creat d0/d20/da2/fd0 x:0 0 0 2024-09-17T07:19:57.294 INFO:tasks.workunit.client.0.smithi087.stdout:2/553: fdatasync d2/d7/d30/d3f/f8e 0 2024-09-17T07:19:57.295 INFO:tasks.workunit.client.0.smithi087.stdout:3/577: dread d6/d1b/d2b/fae [0,4194304] 0 2024-09-17T07:19:57.296 INFO:tasks.workunit.client.1.smithi139.stdout:3/428: creat d5/d15/d16/d4c/d28/f89 x:0 0 0 2024-09-17T07:19:57.296 INFO:tasks.workunit.client.0.smithi087.stdout:6/708: mkdir d1/d6/d1a/d2c/d58/d90/def 0 2024-09-17T07:19:57.297 INFO:tasks.workunit.client.0.smithi087.stdout:6/709: stat d1/d6a/dda 0 2024-09-17T07:19:57.298 INFO:tasks.workunit.client.1.smithi139.stdout:1/344: mkdir d2/d10/d71 0 2024-09-17T07:19:57.299 INFO:tasks.workunit.client.0.smithi087.stdout:6/710: write d1/d6/d1a/d2c/fe6 [498621,82569] 0 2024-09-17T07:19:57.300 INFO:tasks.workunit.client.0.smithi087.stdout:2/554: unlink d2/d48/d69/f75 0 2024-09-17T07:19:57.301 INFO:tasks.workunit.client.0.smithi087.stdout:3/578: read d6/d1b/d2b/f7b [3688205,52928] 0 2024-09-17T07:19:57.301 INFO:tasks.workunit.client.0.smithi087.stdout:0/820: link db/c2c db/d45/d9e/d95/df1/c125 0 2024-09-17T07:19:57.301 INFO:tasks.workunit.client.1.smithi139.stdout:0/367: unlink d1/da/d1b/c12 0 2024-09-17T07:19:57.302 INFO:tasks.workunit.client.0.smithi087.stdout:6/711: rmdir d1/d6/d1a/d2c/d58 39 2024-09-17T07:19:57.303 INFO:tasks.workunit.client.0.smithi087.stdout:6/712: write d1/d6/f12 [6587628,77591] 0 2024-09-17T07:19:57.304 INFO:tasks.workunit.client.1.smithi139.stdout:5/423: mknod d4/d16/d69/c80 0 2024-09-17T07:19:57.304 INFO:tasks.workunit.client.0.smithi087.stdout:6/713: fdatasync d1/d6/d1a/d4e/f50 0 2024-09-17T07:19:57.305 INFO:tasks.workunit.client.0.smithi087.stdout:0/821: chown db/d45/d9e/d95/dd8/f106 427488 1 2024-09-17T07:19:57.306 INFO:tasks.workunit.client.1.smithi139.stdout:5/424: rename d4 to d4/d16/d1b/d20/d32/d72/d81 22 2024-09-17T07:19:57.306 INFO:tasks.workunit.client.0.smithi087.stdout:0/822: rmdir db/d45/d5d 39 2024-09-17T07:19:57.307 INFO:tasks.workunit.client.1.smithi139.stdout:8/644: symlink d0/d1a/d4d/d53/ld1 0 2024-09-17T07:19:57.308 INFO:tasks.workunit.client.0.smithi087.stdout:3/579: getdents d6/d15 0 2024-09-17T07:19:57.308 INFO:tasks.workunit.client.1.smithi139.stdout:1/345: symlink d2/d10/d12/d24/d38/d3d/l72 0 2024-09-17T07:19:57.309 INFO:tasks.workunit.client.0.smithi087.stdout:6/714: symlink d1/d6/d1a/d2c/d33/lf0 0 2024-09-17T07:19:57.309 INFO:tasks.workunit.client.0.smithi087.stdout:0/823: write db/d45/d9e/d95/dd8/f106 [886925,9923] 0 2024-09-17T07:19:57.311 INFO:tasks.workunit.client.1.smithi139.stdout:5/425: creat d4/d16/d1b/d20/d28/f82 x:0 0 0 2024-09-17T07:19:57.311 INFO:tasks.workunit.client.0.smithi087.stdout:6/715: chown d1/d6/d1a/d2c/d40/d4c/dce/fbb 7540301 1 2024-09-17T07:19:57.311 INFO:tasks.workunit.client.0.smithi087.stdout:3/580: fsync d6/d1b/d2b/f7b 0 2024-09-17T07:19:57.313 INFO:tasks.workunit.client.1.smithi139.stdout:8/645: creat d0/d1a/d4d/d53/fd2 x:0 0 0 2024-09-17T07:19:57.316 INFO:tasks.workunit.client.1.smithi139.stdout:0/368: symlink d1/da/l90 0 2024-09-17T07:19:57.317 INFO:tasks.workunit.client.0.smithi087.stdout:3/581: creat d6/d1b/fc4 x:0 0 0 2024-09-17T07:19:57.318 INFO:tasks.workunit.client.1.smithi139.stdout:0/369: chown d1/da/d1b/c68 11467366 1 2024-09-17T07:19:57.318 INFO:tasks.workunit.client.1.smithi139.stdout:5/426: write d4/d16/d1b/d20/d38/d4f/f57 [722875,109055] 0 2024-09-17T07:19:57.319 INFO:tasks.workunit.client.0.smithi087.stdout:0/824: dwrite db/d45/d5b/f5e [0,4194304] 0 2024-09-17T07:19:57.319 INFO:tasks.workunit.client.1.smithi139.stdout:5/427: readlink d4/d16/d1b/l47 0 2024-09-17T07:19:57.320 INFO:tasks.workunit.client.0.smithi087.stdout:6/716: link d1/d6/d1a/d2c/d58/f92 d1/d6/d1a/d2c/d40/d4c/dce/ff1 0 2024-09-17T07:19:57.321 INFO:tasks.workunit.client.1.smithi139.stdout:5/428: fdatasync d4/d16/d1b/d20/d32/d6c/f70 0 2024-09-17T07:19:57.322 INFO:tasks.workunit.client.0.smithi087.stdout:2/555: dread d2/d7/f8 [0,4194304] 0 2024-09-17T07:19:57.322 INFO:tasks.workunit.client.0.smithi087.stdout:6/717: chown d1/d6/d1a/d2c/d33/cbe 897325 1 2024-09-17T07:19:57.322 INFO:tasks.workunit.client.1.smithi139.stdout:0/370: mkdir d1/da/d1b/d3d/d5a/d75/d91 0 2024-09-17T07:19:57.323 INFO:tasks.workunit.client.0.smithi087.stdout:3/582: creat d6/d15/d92/fc5 x:0 0 0 2024-09-17T07:19:57.325 INFO:tasks.workunit.client.1.smithi139.stdout:8/646: getdents d0/d20/d28/d52/d54 0 2024-09-17T07:19:57.325 INFO:tasks.workunit.client.0.smithi087.stdout:2/556: symlink d2/d7/db/lb1 0 2024-09-17T07:19:57.326 INFO:tasks.workunit.client.0.smithi087.stdout:6/718: dread - d1/d6/d1a/d2c/d40/d4c/f96 zero size 2024-09-17T07:19:57.328 INFO:tasks.workunit.client.0.smithi087.stdout:0/825: mkdir db/d45/d9e/d95/df1/d126 0 2024-09-17T07:19:57.329 INFO:tasks.workunit.client.1.smithi139.stdout:0/371: fdatasync d1/da/d1b/d32/f7a 0 2024-09-17T07:19:57.329 INFO:tasks.workunit.client.1.smithi139.stdout:5/429: creat d4/d16/d1b/d20/d28/f83 x:0 0 0 2024-09-17T07:19:57.331 INFO:tasks.workunit.client.0.smithi087.stdout:3/583: dwrite d6/d15/f24 [0,4194304] 0 2024-09-17T07:19:57.333 INFO:tasks.workunit.client.1.smithi139.stdout:8/647: mkdir d0/d20/d28/d52/d65/dd3 0 2024-09-17T07:19:57.333 INFO:tasks.workunit.client.1.smithi139.stdout:4/444: dwrite d0/d1/d29/d41/f44 [4194304,4194304] 0 2024-09-17T07:19:57.333 INFO:tasks.workunit.client.1.smithi139.stdout:5/430: chown d4/d16/l4a 46591 1 2024-09-17T07:19:57.334 INFO:tasks.workunit.client.0.smithi087.stdout:3/584: symlink d6/d15/lc6 0 2024-09-17T07:19:57.335 INFO:tasks.workunit.client.0.smithi087.stdout:2/557: rename d2/d50/c66 to d2/d7/d30/cb2 0 2024-09-17T07:19:57.335 INFO:tasks.workunit.client.1.smithi139.stdout:0/372: chown d1/da/d17/d72/l36 107295780 1 2024-09-17T07:19:57.336 INFO:tasks.workunit.client.0.smithi087.stdout:6/719: getdents d1/d6/d1a/d8a 0 2024-09-17T07:19:57.336 INFO:tasks.workunit.client.1.smithi139.stdout:3/429: dread d5/d21/d23/d38/f5f [4194304,4194304] 0 2024-09-17T07:19:57.338 INFO:tasks.workunit.client.1.smithi139.stdout:4/445: creat d0/d49/f8b x:0 0 0 2024-09-17T07:19:57.339 INFO:tasks.workunit.client.0.smithi087.stdout:0/826: dwrite db/f18 [4194304,4194304] 0 2024-09-17T07:19:57.343 INFO:tasks.workunit.client.1.smithi139.stdout:1/346: dwrite d2/fd [0,4194304] 0 2024-09-17T07:19:57.345 INFO:tasks.workunit.client.1.smithi139.stdout:3/430: mknod d5/d15/c8a 0 2024-09-17T07:19:57.346 INFO:tasks.workunit.client.0.smithi087.stdout:6/720: rename d1/d6/d1a/d2c/d58/d90/f9d to d1/d6/d1a/d2c/d58/ff2 0 2024-09-17T07:19:57.349 INFO:tasks.workunit.client.0.smithi087.stdout:2/558: dwrite d2/d48/f8f [0,4194304] 0 2024-09-17T07:19:57.350 INFO:tasks.workunit.client.0.smithi087.stdout:0/827: link db/d45/d9e/d95/f10d db/d45/d9e/d95/df1/d126/f127 0 2024-09-17T07:19:57.351 INFO:tasks.workunit.client.1.smithi139.stdout:5/431: rename d4/d16/f78 to d4/d16/d1b/d20/d32/d76/f84 0 2024-09-17T07:19:57.352 INFO:tasks.workunit.client.1.smithi139.stdout:4/446: creat d0/db/d7f/f8c x:0 0 0 2024-09-17T07:19:57.352 INFO:tasks.workunit.client.1.smithi139.stdout:8/648: mknod d0/d1a/d4d/cd4 0 2024-09-17T07:19:57.353 INFO:tasks.workunit.client.0.smithi087.stdout:0/828: dread db/f27 [0,4194304] 0 2024-09-17T07:19:57.354 INFO:tasks.workunit.client.0.smithi087.stdout:6/721: symlink d1/lf3 0 2024-09-17T07:19:57.355 INFO:tasks.workunit.client.1.smithi139.stdout:1/347: rename d2/d10/d12/d24/d38/l6a to d2/d10/d12/d13/l73 0 2024-09-17T07:19:57.356 INFO:tasks.workunit.client.1.smithi139.stdout:4/447: symlink d0/db/d17/l8d 0 2024-09-17T07:19:57.357 INFO:tasks.workunit.client.1.smithi139.stdout:4/448: readlink d0/db/d17/l8d 0 2024-09-17T07:19:57.358 INFO:tasks.workunit.client.0.smithi087.stdout:6/722: fdatasync d1/d6/d1a/d2c/d40/d4c/dce/fed 0 2024-09-17T07:19:57.358 INFO:tasks.workunit.client.0.smithi087.stdout:2/559: creat d2/d48/d69/da0/fb3 x:0 0 0 2024-09-17T07:19:57.359 INFO:tasks.workunit.client.1.smithi139.stdout:1/348: mkdir d2/d10/d12/d13/d4f/d5c/d74 0 2024-09-17T07:19:57.360 INFO:tasks.workunit.client.0.smithi087.stdout:0/829: stat db/d45/c4a 0 2024-09-17T07:19:57.360 INFO:tasks.workunit.client.1.smithi139.stdout:5/432: symlink d4/d16/d1b/d20/d32/d72/l85 0 2024-09-17T07:19:57.362 INFO:tasks.workunit.client.0.smithi087.stdout:2/560: creat d2/d48/fb4 x:0 0 0 2024-09-17T07:19:57.362 INFO:tasks.workunit.client.1.smithi139.stdout:5/433: write d4/d16/d1b/d20/d38/d4f/f57 [2038469,41583] 0 2024-09-17T07:19:57.364 INFO:tasks.workunit.client.0.smithi087.stdout:6/723: creat d1/d67/ddc/de5/ff4 x:0 0 0 2024-09-17T07:19:57.365 INFO:tasks.workunit.client.0.smithi087.stdout:6/724: write d1/d6/d1a/d2c/d58/d90/f9c [2076205,85997] 0 2024-09-17T07:19:57.365 INFO:tasks.workunit.client.0.smithi087.stdout:2/561: rmdir d2/d7/dd/d10/d4c/d6c 39 2024-09-17T07:19:57.366 INFO:tasks.workunit.client.1.smithi139.stdout:4/449: rename d0/d1/d29/d6d/f7a to d0/d37/d5f/d83/f8e 0 2024-09-17T07:19:57.367 INFO:tasks.workunit.client.0.smithi087.stdout:3/585: truncate d6/d1b/f9d 613506 0 2024-09-17T07:19:57.367 INFO:tasks.workunit.client.0.smithi087.stdout:0/830: mknod db/c128 0 2024-09-17T07:19:57.368 INFO:tasks.workunit.client.1.smithi139.stdout:4/450: readlink d0/d1/d54/l7b 0 2024-09-17T07:19:57.369 INFO:tasks.workunit.client.0.smithi087.stdout:0/831: write db/d45/d7b/d90/dd9/fed [570878,56929] 0 2024-09-17T07:19:57.372 INFO:tasks.workunit.client.0.smithi087.stdout:2/562: symlink d2/d7/dd/d10/d91/lb5 0 2024-09-17T07:19:57.372 INFO:tasks.workunit.client.0.smithi087.stdout:6/725: dread d1/d6/d1a/d2c/d48/f9a [0,4194304] 0 2024-09-17T07:19:57.373 INFO:tasks.workunit.client.0.smithi087.stdout:0/832: mknod db/d45/d7b/d90/dd9/c129 0 2024-09-17T07:19:57.374 INFO:tasks.workunit.client.1.smithi139.stdout:1/349: rename d2/f52 to d2/d10/d12/d13/f75 0 2024-09-17T07:19:57.375 INFO:tasks.workunit.client.1.smithi139.stdout:5/434: mkdir d4/d16/d1b/d20/d67/d86 0 2024-09-17T07:19:57.377 INFO:tasks.workunit.client.0.smithi087.stdout:6/726: write d1/d6/d1a/d2c/d48/d9b/fa2 [3473012,7297] 0 2024-09-17T07:19:57.377 INFO:tasks.workunit.client.1.smithi139.stdout:1/350: read d2/d10/d12/d13/f16 [3026247,82780] 0 2024-09-17T07:19:57.377 INFO:tasks.workunit.client.0.smithi087.stdout:0/833: creat db/d45/d9e/d86/dd5/deb/d117/f12a x:0 0 0 2024-09-17T07:19:57.378 INFO:tasks.workunit.client.1.smithi139.stdout:5/435: write d4/d16/d1b/d20/d28/f1f [4562419,105507] 0 2024-09-17T07:19:57.378 INFO:tasks.workunit.client.1.smithi139.stdout:5/436: chown d4/d16 32 1 2024-09-17T07:19:57.383 INFO:tasks.workunit.client.0.smithi087.stdout:0/834: write db/f41 [3273555,126519] 0 2024-09-17T07:19:57.385 INFO:tasks.workunit.client.0.smithi087.stdout:6/727: unlink d1/d6/d1a/d2c/d33/cc8 0 2024-09-17T07:19:57.386 INFO:tasks.workunit.client.0.smithi087.stdout:3/586: dwrite d6/d15/d37/f7f [0,4194304] 0 2024-09-17T07:19:57.387 INFO:tasks.workunit.client.0.smithi087.stdout:2/563: dwrite d2/d24/d36/f38 [0,4194304] 0 2024-09-17T07:19:57.388 INFO:tasks.workunit.client.0.smithi087.stdout:0/835: chown db/da3/ce3 80337564 1 2024-09-17T07:19:57.388 INFO:tasks.workunit.client.1.smithi139.stdout:5/437: dwrite d4/d16/d1b/d20/d67/f6a [0,4194304] 0 2024-09-17T07:19:57.389 INFO:tasks.workunit.client.0.smithi087.stdout:6/728: rename d1/d6 to d1/d6/d1a/d2c/d40/dd2/df5 22 2024-09-17T07:19:57.390 INFO:tasks.workunit.client.1.smithi139.stdout:5/438: write d4/d16/d1b/d20/d38/f54 [797485,117327] 0 2024-09-17T07:19:57.391 INFO:tasks.workunit.client.0.smithi087.stdout:3/587: mkdir d6/d15/d37/d3c/dc7 0 2024-09-17T07:19:57.394 INFO:tasks.workunit.client.0.smithi087.stdout:0/836: fdatasync db/d45/f99 0 2024-09-17T07:19:57.394 INFO:tasks.workunit.client.0.smithi087.stdout:8/558: sync 2024-09-17T07:19:57.395 INFO:tasks.workunit.client.0.smithi087.stdout:6/729: mknod d1/cf6 0 2024-09-17T07:19:57.396 INFO:tasks.workunit.client.0.smithi087.stdout:8/559: chown d1/d7/d9/d19/d1b/f30 3 1 2024-09-17T07:19:57.401 INFO:tasks.workunit.client.0.smithi087.stdout:0/837: unlink db/c19 0 2024-09-17T07:19:57.401 INFO:tasks.workunit.client.0.smithi087.stdout:8/560: rename d1/d2b/d21/d6d/d6f to d1/d2b/d21/d6d/d6f/d7f/d54/dc5 22 2024-09-17T07:19:57.402 INFO:tasks.workunit.client.0.smithi087.stdout:3/588: dwrite d6/fc [0,4194304] 0 2024-09-17T07:19:57.408 INFO:tasks.workunit.client.0.smithi087.stdout:3/589: creat d6/d15/d92/fc8 x:0 0 0 2024-09-17T07:19:57.408 INFO:tasks.workunit.client.0.smithi087.stdout:6/730: dread d1/f35 [0,4194304] 0 2024-09-17T07:19:57.411 INFO:tasks.workunit.client.0.smithi087.stdout:3/590: fdatasync d6/d15/d37/f5b 0 2024-09-17T07:19:57.412 INFO:tasks.workunit.client.0.smithi087.stdout:6/731: chown d1/d6/d1a/d2c/d48/f88 0 1 2024-09-17T07:19:57.414 INFO:tasks.workunit.client.1.smithi139.stdout:5/439: creat d4/d16/d1b/d20/d38/f87 x:0 0 0 2024-09-17T07:19:57.414 INFO:tasks.workunit.client.0.smithi087.stdout:8/561: dwrite d1/d2b/f32 [0,4194304] 0 2024-09-17T07:19:57.414 INFO:tasks.workunit.client.0.smithi087.stdout:3/591: stat d6/d15/d37/d3c/f74 0 2024-09-17T07:19:57.415 INFO:tasks.workunit.client.0.smithi087.stdout:0/838: dwrite db/d45/d7b/d90/dd9/ff0 [4194304,4194304] 0 2024-09-17T07:19:57.416 INFO:tasks.workunit.client.1.smithi139.stdout:0/373: dread d1/da/d1b/d3d/f64 [0,4194304] 0 2024-09-17T07:19:57.417 INFO:tasks.workunit.client.0.smithi087.stdout:8/562: chown d1/d7/d9/d19/d1b/c25 279637364 1 2024-09-17T07:19:57.417 INFO:tasks.workunit.client.0.smithi087.stdout:3/592: write d6/d16/f81 [5151649,45893] 0 2024-09-17T07:19:57.418 INFO:tasks.workunit.client.1.smithi139.stdout:5/440: dread - d4/d16/d1b/d20/f7d zero size 2024-09-17T07:19:57.420 INFO:tasks.workunit.client.0.smithi087.stdout:0/839: symlink db/d45/d9e/l12b 0 2024-09-17T07:19:57.420 INFO:tasks.workunit.client.1.smithi139.stdout:8/649: dread d0/d1a/f39 [0,4194304] 0 2024-09-17T07:19:57.421 INFO:tasks.workunit.client.1.smithi139.stdout:3/431: dwrite d5/d21/d23/d69/f76 [0,4194304] 0 2024-09-17T07:19:57.422 INFO:tasks.workunit.client.1.smithi139.stdout:0/374: chown d1/da/d1b/d32/c1e 219933 1 2024-09-17T07:19:57.422 INFO:tasks.workunit.client.1.smithi139.stdout:3/432: chown d5/d15/d20/c73 3 1 2024-09-17T07:19:57.423 INFO:tasks.workunit.client.0.smithi087.stdout:0/840: fdatasync f5 0 2024-09-17T07:19:57.423 INFO:tasks.workunit.client.0.smithi087.stdout:6/732: mknod d1/d6/d1a/d2c/d48/d62/cf7 0 2024-09-17T07:19:57.423 INFO:tasks.workunit.client.0.smithi087.stdout:3/593: symlink d6/lc9 0 2024-09-17T07:19:57.423 INFO:tasks.workunit.client.1.smithi139.stdout:8/650: write d0/d20/d28/d52/d65/d7f/db6/f58 [318056,39961] 0 2024-09-17T07:19:57.424 INFO:tasks.workunit.client.0.smithi087.stdout:0/841: creat db/d45/d9e/d86/dd5/deb/f12c x:0 0 0 2024-09-17T07:19:57.425 INFO:tasks.workunit.client.1.smithi139.stdout:3/433: chown d5/d21/d23/d69/f84 270086194 1 2024-09-17T07:19:57.426 INFO:tasks.workunit.client.0.smithi087.stdout:0/842: dread - db/d45/d9e/d95/f10d zero size 2024-09-17T07:19:57.428 INFO:tasks.workunit.client.0.smithi087.stdout:8/563: creat d1/d2b/fc6 x:0 0 0 2024-09-17T07:19:57.430 INFO:tasks.workunit.client.1.smithi139.stdout:5/441: dread d4/f5b [0,4194304] 0 2024-09-17T07:19:57.432 INFO:tasks.workunit.client.1.smithi139.stdout:3/434: mkdir d5/d63/d6d/d6f/d8b 0 2024-09-17T07:19:57.432 INFO:tasks.workunit.client.1.smithi139.stdout:5/442: write d4/d16/f7a [418273,10925] 0 2024-09-17T07:19:57.433 INFO:tasks.workunit.client.0.smithi087.stdout:6/733: creat d1/d6/d1a/d2c/d40/d4c/ff8 x:0 0 0 2024-09-17T07:19:57.435 INFO:tasks.workunit.client.0.smithi087.stdout:2/564: truncate d2/d7/dd/d10/f1d 3009316 0 2024-09-17T07:19:57.435 INFO:tasks.workunit.client.0.smithi087.stdout:0/843: dwrite db/d45/d9e/f64 [0,4194304] 0 2024-09-17T07:19:57.436 INFO:tasks.workunit.client.0.smithi087.stdout:0/844: chown db/f1b 6 1 2024-09-17T07:19:57.437 INFO:tasks.workunit.client.1.smithi139.stdout:5/443: mkdir d4/d16/d1b/d20/d67/d88 0 2024-09-17T07:19:57.438 INFO:tasks.workunit.client.0.smithi087.stdout:8/564: rename d1/d2b/d21/d6d/d6f/fb5 to d1/d7/d9/d27/da1/fc7 0 2024-09-17T07:19:57.438 INFO:tasks.workunit.client.0.smithi087.stdout:2/565: creat d2/d7/d60/fb6 x:0 0 0 2024-09-17T07:19:57.439 INFO:tasks.workunit.client.0.smithi087.stdout:2/566: chown d2/f8a 9 1 2024-09-17T07:19:57.440 INFO:tasks.workunit.client.0.smithi087.stdout:0/845: chown db/c20 25088 1 2024-09-17T07:19:57.441 INFO:tasks.workunit.client.1.smithi139.stdout:5/444: readlink d4/d16/d1b/d20/d32/l6f 0 2024-09-17T07:19:57.441 INFO:tasks.workunit.client.1.smithi139.stdout:5/445: chown d4/d16/d69 89 1 2024-09-17T07:19:57.441 INFO:tasks.workunit.client.1.smithi139.stdout:3/435: dwrite d5/d21/d23/d69/f76 [0,4194304] 0 2024-09-17T07:19:57.441 INFO:tasks.workunit.client.0.smithi087.stdout:6/734: symlink d1/lf9 0 2024-09-17T07:19:57.441 INFO:tasks.workunit.client.0.smithi087.stdout:8/565: truncate d1/d2b/d21/d6d/d6f/d7f/f7b 596275 0 2024-09-17T07:19:57.441 INFO:tasks.workunit.client.0.smithi087.stdout:2/567: fdatasync d2/d50/f61 0 2024-09-17T07:19:57.444 INFO:tasks.workunit.client.0.smithi087.stdout:2/568: rmdir d2/d96 39 2024-09-17T07:19:57.446 INFO:tasks.workunit.client.0.smithi087.stdout:8/566: symlink d1/d2b/d21/d6d/d6f/lc8 0 2024-09-17T07:19:57.446 INFO:tasks.workunit.client.1.smithi139.stdout:3/436: truncate d5/d15/d16/d4c/d28/f85 970615 0 2024-09-17T07:19:57.447 INFO:tasks.workunit.client.0.smithi087.stdout:2/569: write d2/d50/fa8 [478498,124034] 0 2024-09-17T07:19:57.447 INFO:tasks.workunit.client.1.smithi139.stdout:5/446: creat d4/d16/d1b/d20/d38/d4f/f89 x:0 0 0 2024-09-17T07:19:57.448 INFO:tasks.workunit.client.0.smithi087.stdout:0/846: dread db/d4f/fde [0,4194304] 0 2024-09-17T07:19:57.449 INFO:tasks.workunit.client.0.smithi087.stdout:6/735: dwrite d1/d6/d1a/d4e/f50 [0,4194304] 0 2024-09-17T07:19:57.450 INFO:tasks.workunit.client.0.smithi087.stdout:0/847: chown db/da3/ce3 25 1 2024-09-17T07:19:57.450 INFO:tasks.workunit.client.1.smithi139.stdout:3/437: symlink d5/d63/d6d/d6f/l8c 0 2024-09-17T07:19:57.451 INFO:tasks.workunit.client.0.smithi087.stdout:8/567: creat d1/d7/d9/d19/d1b/d18/fc9 x:0 0 0 2024-09-17T07:19:57.451 INFO:tasks.workunit.client.0.smithi087.stdout:2/570: symlink d2/d48/d69/da0/lb7 0 2024-09-17T07:19:57.452 INFO:tasks.workunit.client.1.smithi139.stdout:3/438: stat d5/d15/l7e 0 2024-09-17T07:19:57.453 INFO:tasks.workunit.client.1.smithi139.stdout:3/439: stat d5/f1d 0 2024-09-17T07:19:57.456 INFO:tasks.workunit.client.1.smithi139.stdout:1/351: write d2/ff [1597553,70618] 0 2024-09-17T07:19:57.457 INFO:tasks.workunit.client.0.smithi087.stdout:6/736: creat d1/d6/d68/ffa x:0 0 0 2024-09-17T07:19:57.458 INFO:tasks.workunit.client.0.smithi087.stdout:2/571: read d2/d48/da2/f73 [2821531,123981] 0 2024-09-17T07:19:57.461 INFO:tasks.workunit.client.0.smithi087.stdout:8/568: write d1/d2b/d21/d6d/d6f/fb4 [3800972,22756] 0 2024-09-17T07:19:57.462 INFO:tasks.workunit.client.1.smithi139.stdout:1/352: write d2/d10/d12/d35/d2b/f2c [4397736,29303] 0 2024-09-17T07:19:57.463 INFO:tasks.workunit.client.0.smithi087.stdout:2/572: mkdir d2/d50/db8 0 2024-09-17T07:19:57.463 INFO:tasks.workunit.client.0.smithi087.stdout:6/737: dread d1/d6/d1a/d2c/fe6 [0,4194304] 0 2024-09-17T07:19:57.464 INFO:tasks.workunit.client.0.smithi087.stdout:2/573: dread - d2/d48/d69/da0/fb3 zero size 2024-09-17T07:19:57.464 INFO:tasks.workunit.client.1.smithi139.stdout:4/451: dwrite d0/d10/f25 [0,4194304] 0 2024-09-17T07:19:57.465 INFO:tasks.workunit.client.0.smithi087.stdout:6/738: write d1/d6/d1a/d2c/d48/f88 [4923244,106012] 0 2024-09-17T07:19:57.467 INFO:tasks.workunit.client.1.smithi139.stdout:3/440: link d5/d21/c27 d5/d21/d23/d38/c8d 0 2024-09-17T07:19:57.467 INFO:tasks.workunit.client.0.smithi087.stdout:6/739: chown d1/d6/d1a/l4a 2076 1 2024-09-17T07:19:57.469 INFO:tasks.workunit.client.0.smithi087.stdout:8/569: symlink d1/d2b/d21/d6d/d6f/d7f/lca 0 2024-09-17T07:19:57.469 INFO:tasks.workunit.client.1.smithi139.stdout:4/452: mknod d0/c8f 0 2024-09-17T07:19:57.470 INFO:tasks.workunit.client.0.smithi087.stdout:1/499: sync 2024-09-17T07:19:57.471 INFO:tasks.workunit.client.1.smithi139.stdout:3/441: mkdir d5/d15/d16/d4c/d28/d54/d8e 0 2024-09-17T07:19:57.471 INFO:tasks.workunit.client.1.smithi139.stdout:4/453: read d0/f1d [293130,6453] 0 2024-09-17T07:19:57.473 INFO:tasks.workunit.client.1.smithi139.stdout:4/454: chown d0/d1a/f60 44 1 2024-09-17T07:19:57.473 INFO:tasks.workunit.client.0.smithi087.stdout:6/740: unlink d1/d6/d1a/d2c/d48/d9b/dac/fbc 0 2024-09-17T07:19:57.473 INFO:tasks.workunit.client.1.smithi139.stdout:3/442: readlink d5/d15/d16/d4c/l2e 0 2024-09-17T07:19:57.474 INFO:tasks.workunit.client.1.smithi139.stdout:1/353: rename d2/d10/d12/d1a/f30 to d2/d10/d12/f76 0 2024-09-17T07:19:57.475 INFO:tasks.workunit.client.1.smithi139.stdout:1/354: stat d2 0 2024-09-17T07:19:57.475 INFO:tasks.workunit.client.0.smithi087.stdout:8/570: symlink d1/d2b/d21/lcb 0 2024-09-17T07:19:57.476 INFO:tasks.workunit.client.0.smithi087.stdout:1/500: dread d2/d48/d61/f85 [0,4194304] 0 2024-09-17T07:19:57.477 INFO:tasks.workunit.client.0.smithi087.stdout:2/574: link d2/d50/f61 d2/d50/fb9 0 2024-09-17T07:19:57.480 INFO:tasks.workunit.client.0.smithi087.stdout:3/594: truncate d6/d1b/d42/d62/dbb/fc2 191180 0 2024-09-17T07:19:57.481 INFO:tasks.workunit.client.0.smithi087.stdout:6/741: symlink d1/d67/ddc/lfb 0 2024-09-17T07:19:57.482 INFO:tasks.workunit.client.0.smithi087.stdout:6/742: readlink d1/d6/d1a/d2c/d40/d4c/da1/lc0 0 2024-09-17T07:19:57.483 INFO:tasks.workunit.client.1.smithi139.stdout:4/455: readlink d0/d1a/l6f 0 2024-09-17T07:19:57.483 INFO:tasks.workunit.client.1.smithi139.stdout:8/651: dread d0/d20/d28/d52/d65/d7f/db6/f34 [0,4194304] 0 2024-09-17T07:19:57.483 INFO:tasks.workunit.client.1.smithi139.stdout:8/652: chown d0/d20/l29 199866025 1 2024-09-17T07:19:57.485 INFO:tasks.workunit.client.1.smithi139.stdout:1/355: fsync d2/d10/d12/d24/f57 0 2024-09-17T07:19:57.485 INFO:tasks.workunit.client.1.smithi139.stdout:8/653: symlink d0/d20/d28/d52/d65/d7f/ld5 0 2024-09-17T07:19:57.486 INFO:tasks.workunit.client.0.smithi087.stdout:3/595: rename d6/d15/d37/d3c/d43/d48/f77 to d6/d1b/d42/fca 0 2024-09-17T07:19:57.487 INFO:tasks.workunit.client.0.smithi087.stdout:3/596: write d6/d16/f9f [2386828,42950] 0 2024-09-17T07:19:57.488 INFO:tasks.workunit.client.1.smithi139.stdout:4/456: truncate d0/d1/d29/d41/f43 466206 0 2024-09-17T07:19:57.488 INFO:tasks.workunit.client.1.smithi139.stdout:5/447: dread d4/f36 [0,4194304] 0 2024-09-17T07:19:57.489 INFO:tasks.workunit.client.0.smithi087.stdout:1/501: creat d2/d14/da3/faf x:0 0 0 2024-09-17T07:19:57.489 INFO:tasks.workunit.client.1.smithi139.stdout:8/654: symlink d0/d20/d28/d52/d99/ld6 0 2024-09-17T07:19:57.490 INFO:tasks.workunit.client.1.smithi139.stdout:3/443: dread d5/d15/d16/d4c/d28/f30 [0,4194304] 0 2024-09-17T07:19:57.490 INFO:tasks.workunit.client.1.smithi139.stdout:4/457: fdatasync d0/d1/fd 0 2024-09-17T07:19:57.490 INFO:tasks.workunit.client.0.smithi087.stdout:3/597: write d6/d1b/fc4 [847535,20986] 0 2024-09-17T07:19:57.491 INFO:tasks.workunit.client.0.smithi087.stdout:1/502: stat d2/d3d/d8e/fa9 0 2024-09-17T07:19:57.492 INFO:tasks.workunit.client.1.smithi139.stdout:5/448: truncate d4/d5d/f7e 116289 0 2024-09-17T07:19:57.492 INFO:tasks.workunit.client.1.smithi139.stdout:3/444: chown d5/d21/d23/c5e 9468 1 2024-09-17T07:19:57.492 INFO:tasks.workunit.client.1.smithi139.stdout:8/655: dread - d0/d20/d28/d52/d99/fc7 zero size 2024-09-17T07:19:57.493 INFO:tasks.workunit.client.0.smithi087.stdout:1/503: truncate d2/d69/fa4 52087 0 2024-09-17T07:19:57.493 INFO:tasks.workunit.client.0.smithi087.stdout:6/743: mknod d1/d6/d1a/d2c/d58/d90/cfc 0 2024-09-17T07:19:57.495 INFO:tasks.workunit.client.1.smithi139.stdout:5/449: write d4/d16/f22 [2914673,14979] 0 2024-09-17T07:19:57.495 INFO:tasks.workunit.client.0.smithi087.stdout:2/575: link d2/d7/fe d2/fba 0 2024-09-17T07:19:57.495 INFO:tasks.workunit.client.1.smithi139.stdout:4/458: rename d0/f26 to d0/db/d7f/f90 0 2024-09-17T07:19:57.496 INFO:tasks.workunit.client.0.smithi087.stdout:8/571: dread d1/d2b/d21/d6d/d6f/fb4 [0,4194304] 0 2024-09-17T07:19:57.498 INFO:tasks.workunit.client.0.smithi087.stdout:2/576: dread - d2/d12/f94 zero size 2024-09-17T07:19:57.499 INFO:tasks.workunit.client.1.smithi139.stdout:5/450: creat d4/d16/f8a x:0 0 0 2024-09-17T07:19:57.499 INFO:tasks.workunit.client.1.smithi139.stdout:3/445: dwrite d5/d15/d16/d4c/f4b [0,4194304] 0 2024-09-17T07:19:57.499 INFO:tasks.workunit.client.1.smithi139.stdout:3/446: readlink d5/ld 0 2024-09-17T07:19:57.500 INFO:tasks.workunit.client.1.smithi139.stdout:5/451: stat d4/d5d/f7e 0 2024-09-17T07:19:57.500 INFO:tasks.workunit.client.0.smithi087.stdout:0/848: dwrite db/d45/d7b/d90/f111 [0,4194304] 0 2024-09-17T07:19:57.501 INFO:tasks.workunit.client.1.smithi139.stdout:3/447: readlink d5/d63/d6d/d6f/l8c 0 2024-09-17T07:19:57.501 INFO:tasks.workunit.client.1.smithi139.stdout:5/452: fdatasync d4/d16/d1b/d20/d28/f46 0 2024-09-17T07:19:57.503 INFO:tasks.workunit.client.0.smithi087.stdout:4/539: sync 2024-09-17T07:19:57.503 INFO:tasks.workunit.client.0.smithi087.stdout:9/576: sync 2024-09-17T07:19:57.504 INFO:tasks.workunit.client.0.smithi087.stdout:5/725: sync 2024-09-17T07:19:57.504 INFO:tasks.workunit.client.0.smithi087.stdout:7/470: sync 2024-09-17T07:19:57.504 INFO:tasks.workunit.client.1.smithi139.stdout:5/453: mknod d4/d16/d1b/d20/d32/d72/c8b 0 2024-09-17T07:19:57.505 INFO:tasks.workunit.client.1.smithi139.stdout:5/454: write d4/d16/d1b/d20/d28/f83 [545730,114943] 0 2024-09-17T07:19:57.507 INFO:tasks.workunit.client.0.smithi087.stdout:3/598: symlink d6/d1b/d2b/lcb 0 2024-09-17T07:19:57.509 INFO:tasks.workunit.client.1.smithi139.stdout:5/455: unlink d4/d16/c2f 0 2024-09-17T07:19:57.512 INFO:tasks.workunit.client.1.smithi139.stdout:5/456: creat d4/d16/d1b/d20/d67/d88/f8c x:0 0 0 2024-09-17T07:19:57.514 INFO:tasks.workunit.client.0.smithi087.stdout:2/577: symlink d2/d7/d30/d3f/lbb 0 2024-09-17T07:19:57.514 INFO:tasks.workunit.client.0.smithi087.stdout:7/471: dwrite d0/d3/d10/f1a [4194304,4194304] 0 2024-09-17T07:19:57.515 INFO:tasks.workunit.client.1.smithi139.stdout:5/457: creat d4/d16/d1b/d20/d67/d88/f8d x:0 0 0 2024-09-17T07:19:57.515 INFO:tasks.workunit.client.1.smithi139.stdout:5/458: dread - d4/d16/d1b/d20/d38/f87 zero size 2024-09-17T07:19:57.516 INFO:tasks.workunit.client.1.smithi139.stdout:3/448: truncate d5/d15/d20/d3b/f4a 2082904 0 2024-09-17T07:19:57.516 INFO:tasks.workunit.client.0.smithi087.stdout:2/578: truncate d2/d7/fe 5690192 0 2024-09-17T07:19:57.521 INFO:tasks.workunit.client.0.smithi087.stdout:9/577: write d3/f7 [3973860,94311] 0 2024-09-17T07:19:57.521 INFO:tasks.workunit.client.0.smithi087.stdout:9/578: write d3/d4/d16/dc0/f39 [1632066,73927] 0 2024-09-17T07:19:57.523 INFO:tasks.workunit.client.0.smithi087.stdout:4/540: creat d2/d22/d2c/fc0 x:0 0 0 2024-09-17T07:19:57.523 INFO:tasks.workunit.client.1.smithi139.stdout:5/459: rmdir d4/d16/d1b/d20/d67/d86 0 2024-09-17T07:19:57.524 INFO:tasks.workunit.client.0.smithi087.stdout:4/541: readlink d2/d92/d4d/lb1 0 2024-09-17T07:19:57.526 INFO:tasks.workunit.client.1.smithi139.stdout:5/460: write d4/d16/d1b/d20/d28/f2a [351964,103933] 0 2024-09-17T07:19:57.526 INFO:tasks.workunit.client.1.smithi139.stdout:5/461: dread - d4/d16/d1b/d20/d67/d88/f8d zero size 2024-09-17T07:19:57.527 INFO:tasks.workunit.client.0.smithi087.stdout:8/572: link d1/d2b/d21/d6d/d6f/d7f/d54/f91 d1/d7/d9/d19/d1b/fcc 0 2024-09-17T07:19:57.527 INFO:tasks.workunit.client.1.smithi139.stdout:5/462: fdatasync d4/d16/d1b/d20/d28/f1f 0 2024-09-17T07:19:57.528 INFO:tasks.workunit.client.0.smithi087.stdout:9/579: dread d3/d4/d6/d8/d12/f60 [0,4194304] 0 2024-09-17T07:19:57.529 INFO:tasks.workunit.client.1.smithi139.stdout:5/463: write d4/d16/d1b/d20/d38/f87 [144698,15482] 0 2024-09-17T07:19:57.529 INFO:tasks.workunit.client.0.smithi087.stdout:9/580: chown d3/d4/d6/d8/d22/d43/l6e 64184 1 2024-09-17T07:19:57.531 INFO:tasks.workunit.client.0.smithi087.stdout:7/472: fdatasync d0/d3/d10/d32/f4c 0 2024-09-17T07:19:57.532 INFO:tasks.workunit.client.0.smithi087.stdout:9/581: write d3/d4/d16/d69/d8a/d1e/d90/d93/fb7 [862865,100794] 0 2024-09-17T07:19:57.534 INFO:tasks.workunit.client.0.smithi087.stdout:2/579: truncate d2/d7/f68 57615 0 2024-09-17T07:19:57.536 INFO:tasks.workunit.client.1.smithi139.stdout:5/464: dwrite d4/d16/f77 [4194304,4194304] 0 2024-09-17T07:19:57.536 INFO:tasks.workunit.client.0.smithi087.stdout:3/599: symlink d6/d1b/d42/d95/db3/lcc 0 2024-09-17T07:19:57.538 INFO:tasks.workunit.client.0.smithi087.stdout:5/726: dread d5/d8/d1f/d4e/fb4 [0,4194304] 0 2024-09-17T07:19:57.538 INFO:tasks.workunit.client.1.smithi139.stdout:5/465: truncate d4/d16/d1b/d20/d38/f68 1030375 0 2024-09-17T07:19:57.539 INFO:tasks.workunit.client.0.smithi087.stdout:6/744: link d1/d6/d1a/d2c/d33/c38 d1/d6/d1a/d2c/d40/cfd 0 2024-09-17T07:19:57.539 INFO:tasks.workunit.client.1.smithi139.stdout:5/466: chown d4/d5d 774 1 2024-09-17T07:19:57.541 INFO:tasks.workunit.client.0.smithi087.stdout:9/582: symlink d3/d4/da/d4b/ld2 0 2024-09-17T07:19:57.541 INFO:tasks.workunit.client.0.smithi087.stdout:6/745: dread - d1/d67/ddc/de5/ff4 zero size 2024-09-17T07:19:57.542 INFO:tasks.workunit.client.0.smithi087.stdout:9/583: read d3/d4/d6/d8/fd [2902248,63291] 0 2024-09-17T07:19:57.543 INFO:tasks.workunit.client.1.smithi139.stdout:5/467: dread d4/d16/d1b/d20/d28/f46 [0,4194304] 0 2024-09-17T07:19:57.544 INFO:tasks.workunit.client.1.smithi139.stdout:5/468: chown d4/d16/d1b/d20/d38/f87 5388 1 2024-09-17T07:19:57.545 INFO:tasks.workunit.client.0.smithi087.stdout:4/542: truncate d2/d5/d1f/f1e 3735449 0 2024-09-17T07:19:57.545 INFO:tasks.workunit.client.0.smithi087.stdout:3/600: stat d6/d15/f60 0 2024-09-17T07:19:57.546 INFO:tasks.workunit.client.0.smithi087.stdout:5/727: rmdir d5/d12/d1c 39 2024-09-17T07:19:57.550 INFO:tasks.workunit.client.0.smithi087.stdout:1/504: dwrite d2/d14/fb [0,4194304] 0 2024-09-17T07:19:57.551 INFO:tasks.workunit.client.1.smithi139.stdout:5/469: dwrite d4/d16/d1b/f55 [0,4194304] 0 2024-09-17T07:19:57.553 INFO:tasks.workunit.client.0.smithi087.stdout:8/573: creat d1/d7/fcd x:0 0 0 2024-09-17T07:19:57.555 INFO:tasks.workunit.client.0.smithi087.stdout:4/543: chown d2/d92/d4d/d21/d2f/d3b/d7e/cb9 393869494 1 2024-09-17T07:19:57.558 INFO:tasks.workunit.client.0.smithi087.stdout:0/849: truncate db/f79 2947866 0 2024-09-17T07:19:57.559 INFO:tasks.workunit.client.1.smithi139.stdout:5/470: dwrite d4/d16/d1b/d20/d28/f53 [4194304,4194304] 0 2024-09-17T07:19:57.562 INFO:tasks.workunit.client.0.smithi087.stdout:9/584: mknod d3/d4/d6/d8/d12/d38/cd3 0 2024-09-17T07:19:57.565 INFO:tasks.workunit.client.1.smithi139.stdout:5/471: link d4/d16/d1b/d20/d32/d3d/l6b d4/d16/d1b/d20/d32/l8e 0 2024-09-17T07:19:57.566 INFO:tasks.workunit.client.0.smithi087.stdout:5/728: mkdir d5/d18/d6f/de1/d7d/dee 0 2024-09-17T07:19:57.566 INFO:tasks.workunit.client.0.smithi087.stdout:4/544: read d2/d92/d4d/d21/f8f [1695991,2190] 0 2024-09-17T07:19:57.566 INFO:tasks.workunit.client.0.smithi087.stdout:8/574: dwrite d1/d2b/fc6 [0,4194304] 0 2024-09-17T07:19:57.567 INFO:tasks.workunit.client.0.smithi087.stdout:6/746: rename d1/d6/d1a to d1/d67/dfe 0 2024-09-17T07:19:57.568 INFO:tasks.workunit.client.1.smithi139.stdout:5/472: creat d4/d16/d1b/f8f x:0 0 0 2024-09-17T07:19:57.575 INFO:tasks.workunit.client.1.smithi139.stdout:5/473: read d4/d16/d1b/f39 [2195972,2674] 0 2024-09-17T07:19:57.577 INFO:tasks.workunit.client.0.smithi087.stdout:0/850: dread db/d45/d9e/d95/dd8/fe2 [0,4194304] 0 2024-09-17T07:19:57.578 INFO:tasks.workunit.client.0.smithi087.stdout:2/580: dread d2/f14 [0,4194304] 0 2024-09-17T07:19:57.578 INFO:tasks.workunit.client.0.smithi087.stdout:9/585: dread d3/d4/d6/f13 [0,4194304] 0 2024-09-17T07:19:57.578 INFO:tasks.workunit.client.0.smithi087.stdout:3/601: creat d6/d15/d37/d5e/fcd x:0 0 0 2024-09-17T07:19:57.580 INFO:tasks.workunit.client.0.smithi087.stdout:6/747: truncate d1/d6/d68/f98 272683 0 2024-09-17T07:19:57.581 INFO:tasks.workunit.client.1.smithi139.stdout:5/474: truncate d4/d16/d1b/d20/d38/d4f/f5e 2058453 0 2024-09-17T07:19:57.582 INFO:tasks.workunit.client.0.smithi087.stdout:6/748: stat d1/d6/c3b 0 2024-09-17T07:19:57.582 INFO:tasks.workunit.client.0.smithi087.stdout:7/473: truncate d0/d3/f3e 1325058 0 2024-09-17T07:19:57.583 INFO:tasks.workunit.client.0.smithi087.stdout:4/545: dwrite d2/d92/f6f [0,4194304] 0 2024-09-17T07:19:57.583 INFO:tasks.workunit.client.1.smithi139.stdout:5/475: readlink d4/d16/d1b/l7f 0 2024-09-17T07:19:57.583 INFO:tasks.workunit.client.1.smithi139.stdout:5/476: dread - d4/d16/d1b/d20/f7d zero size 2024-09-17T07:19:57.585 INFO:tasks.workunit.client.0.smithi087.stdout:9/586: truncate d3/d25/f9a 884556 0 2024-09-17T07:19:57.585 INFO:tasks.workunit.client.0.smithi087.stdout:4/546: dread - d2/d92/d4d/d21/d2f/d3b/d7e/f81 zero size 2024-09-17T07:19:57.586 INFO:tasks.workunit.client.0.smithi087.stdout:5/729: symlink d5/d8/d1f/de4/lef 0 2024-09-17T07:19:57.587 INFO:tasks.workunit.client.1.smithi139.stdout:5/477: creat d4/d16/d1b/d20/d28/d3f/f90 x:0 0 0 2024-09-17T07:19:57.587 INFO:tasks.workunit.client.1.smithi139.stdout:5/478: stat d4/d16/d1b/d20/d28/f83 0 2024-09-17T07:19:57.588 INFO:tasks.workunit.client.0.smithi087.stdout:3/602: readlink d6/d15/lba 0 2024-09-17T07:19:57.588 INFO:tasks.workunit.client.1.smithi139.stdout:5/479: chown d4/d16/d1b/f8f 8 1 2024-09-17T07:19:57.589 INFO:tasks.workunit.client.0.smithi087.stdout:2/581: creat d2/d12/fbc x:0 0 0 2024-09-17T07:19:57.590 INFO:tasks.workunit.client.0.smithi087.stdout:8/575: rename d1/d7/d9/f83 to d1/d7/d9/d19/d1b/fce 0 2024-09-17T07:19:57.591 INFO:tasks.workunit.client.1.smithi139.stdout:5/480: mknod d4/d16/d1b/d20/d28/c91 0 2024-09-17T07:19:57.594 INFO:tasks.workunit.client.0.smithi087.stdout:4/547: fsync d2/d92/d86/fbe 0 2024-09-17T07:19:57.595 INFO:tasks.workunit.client.1.smithi139.stdout:5/481: creat d4/d16/f92 x:0 0 0 2024-09-17T07:19:57.598 INFO:tasks.workunit.client.1.smithi139.stdout:5/482: unlink d4/d16/d1b/d20/d28/f52 0 2024-09-17T07:19:57.599 INFO:tasks.workunit.client.0.smithi087.stdout:4/548: stat d2/d5/c3c 0 2024-09-17T07:19:57.600 INFO:tasks.workunit.client.1.smithi139.stdout:5/483: symlink d4/d16/d1b/d20/d38/l93 0 2024-09-17T07:19:57.601 INFO:tasks.workunit.client.0.smithi087.stdout:6/749: dwrite d1/d67/dfe/d2c/d40/d4c/dce/faf [4194304,4194304] 0 2024-09-17T07:19:57.601 INFO:tasks.workunit.client.0.smithi087.stdout:8/576: mkdir d1/d5f/d71/dcf 0 2024-09-17T07:19:57.603 INFO:tasks.workunit.client.1.smithi139.stdout:5/484: creat d4/d16/d1b/d20/d67/f94 x:0 0 0 2024-09-17T07:19:57.603 INFO:tasks.workunit.client.0.smithi087.stdout:3/603: rename d6/d15/d4b/f4c to d6/d16/fce 0 2024-09-17T07:19:57.604 INFO:tasks.workunit.client.1.smithi139.stdout:5/485: creat d4/d5d/f95 x:0 0 0 2024-09-17T07:19:57.605 INFO:tasks.workunit.client.0.smithi087.stdout:4/549: stat d2/d22/c93 0 2024-09-17T07:19:57.606 INFO:tasks.workunit.client.0.smithi087.stdout:1/505: truncate d2/d3d/d45/d90/d37/f38 5227371 0 2024-09-17T07:19:57.606 INFO:tasks.workunit.client.1.smithi139.stdout:5/486: write d4/d16/d1b/d20/d28/f1f [6818662,74598] 0 2024-09-17T07:19:57.606 INFO:tasks.workunit.client.0.smithi087.stdout:4/550: dread d2/d92/d4d/d21/d2f/d3b/f9a [0,4194304] 0 2024-09-17T07:19:57.611 INFO:tasks.workunit.client.1.smithi139.stdout:5/487: dread d4/f36 [0,4194304] 0 2024-09-17T07:19:57.614 INFO:tasks.workunit.client.1.smithi139.stdout:5/488: creat d4/d16/d1b/d20/d28/d3f/f96 x:0 0 0 2024-09-17T07:19:57.615 INFO:tasks.workunit.client.1.smithi139.stdout:5/489: readlink d4/d16/d1b/l34 0 2024-09-17T07:19:57.616 INFO:tasks.workunit.client.1.smithi139.stdout:5/490: mkdir d4/d5d/d97 0 2024-09-17T07:19:57.617 INFO:tasks.workunit.client.0.smithi087.stdout:1/506: dwrite d2/da/f9c [0,4194304] 0 2024-09-17T07:19:57.618 INFO:tasks.workunit.client.0.smithi087.stdout:6/750: readlink d1/d67/dfe/d2c/d40/d4c/l9e 0 2024-09-17T07:19:57.618 INFO:tasks.workunit.client.1.smithi139.stdout:5/491: creat d4/d16/d1b/d20/d32/d76/f98 x:0 0 0 2024-09-17T07:19:57.619 INFO:tasks.workunit.client.0.smithi087.stdout:3/604: mknod d6/d1b/d42/d62/ccf 0 2024-09-17T07:19:57.620 INFO:tasks.workunit.client.0.smithi087.stdout:7/474: write d0/f3b [4357108,85710] 0 2024-09-17T07:19:57.621 INFO:tasks.workunit.client.1.smithi139.stdout:5/492: creat d4/d16/d1b/d20/d67/d88/f99 x:0 0 0 2024-09-17T07:19:57.627 INFO:tasks.workunit.client.0.smithi087.stdout:5/730: dwrite d5/d12/d14/d61/d94/fea [0,4194304] 0 2024-09-17T07:19:57.635 INFO:tasks.workunit.client.0.smithi087.stdout:1/507: creat d2/d3d/d35/d4f/fb0 x:0 0 0 2024-09-17T07:19:57.635 INFO:tasks.workunit.client.0.smithi087.stdout:3/605: symlink d6/d15/d37/d3c/d43/ld0 0 2024-09-17T07:19:57.635 INFO:tasks.workunit.client.1.smithi139.stdout:5/493: write d4/d16/d1b/d20/d38/d4f/f5e [504018,29709] 0 2024-09-17T07:19:57.638 INFO:tasks.workunit.client.0.smithi087.stdout:9/587: dwrite d3/d4/d6/d8/d22/d43/d84/fbb [0,4194304] 0 2024-09-17T07:19:57.638 INFO:tasks.workunit.client.0.smithi087.stdout:5/731: creat d5/d8/d1f/ff0 x:0 0 0 2024-09-17T07:19:57.638 INFO:tasks.workunit.client.1.smithi139.stdout:5/494: symlink d4/d16/d1b/d20/d67/l9a 0 2024-09-17T07:19:57.639 INFO:tasks.workunit.client.1.smithi139.stdout:5/495: chown d4/d16/d1b/d20/d32/l6f 8 1 2024-09-17T07:19:57.639 INFO:tasks.workunit.client.1.smithi139.stdout:5/496: readlink d4/d16/d1b/d20/l30 0 2024-09-17T07:19:57.641 INFO:tasks.workunit.client.0.smithi087.stdout:5/732: write d5/d12/d56/d9e/dcb/fd4 [608393,5274] 0 2024-09-17T07:19:57.641 INFO:tasks.workunit.client.0.smithi087.stdout:4/551: link d2/d5/d1f/f20 d2/d92/d4d/d21/d2f/d6e/fc1 0 2024-09-17T07:19:57.642 INFO:tasks.workunit.client.1.smithi139.stdout:5/497: mknod d4/d16/d1b/d20/d67/c9b 0 2024-09-17T07:19:57.642 INFO:tasks.workunit.client.1.smithi139.stdout:5/498: chown d4/d16/f2b 32226 1 2024-09-17T07:19:57.643 INFO:tasks.workunit.client.0.smithi087.stdout:9/588: write d3/d4/d16/d69/d8a/d1e/d90/d93/d96/fa6 [637574,87048] 0 2024-09-17T07:19:57.643 INFO:tasks.workunit.client.0.smithi087.stdout:4/552: chown d2/d92/d4d/d21/d2f/d3b/d7e/d97 0 1 2024-09-17T07:19:57.644 INFO:tasks.workunit.client.0.smithi087.stdout:7/475: truncate d0/d3/d10/f29 2896162 0 2024-09-17T07:19:57.645 INFO:tasks.workunit.client.0.smithi087.stdout:8/577: getdents d1 0 2024-09-17T07:19:57.646 INFO:tasks.workunit.client.0.smithi087.stdout:4/553: write d2/d92/d4d/f8a [1151,48876] 0 2024-09-17T07:19:57.646 INFO:tasks.workunit.client.1.smithi139.stdout:5/499: getdents d4/d5d 0 2024-09-17T07:19:57.649 INFO:tasks.workunit.client.1.smithi139.stdout:5/500: creat d4/d16/d1b/d20/d28/d61/f9c x:0 0 0 2024-09-17T07:19:57.653 INFO:tasks.workunit.client.1.smithi139.stdout:5/501: getdents d4/d16/d1b 0 2024-09-17T07:19:57.653 INFO:tasks.workunit.client.0.smithi087.stdout:1/508: symlink d2/d3d/d8e/lb1 0 2024-09-17T07:19:57.653 INFO:tasks.workunit.client.0.smithi087.stdout:8/578: write d1/d7/d9/d27/fa9 [5315753,44287] 0 2024-09-17T07:19:57.656 INFO:tasks.workunit.client.0.smithi087.stdout:6/751: getdents d1/d67/dfe 0 2024-09-17T07:19:57.659 INFO:tasks.workunit.client.0.smithi087.stdout:7/476: stat d0/d3/d10/c5f 0 2024-09-17T07:19:57.659 INFO:tasks.workunit.client.0.smithi087.stdout:3/606: dwrite d6/d1b/d42/d6e/f79 [0,4194304] 0 2024-09-17T07:19:57.659 INFO:tasks.workunit.client.1.smithi139.stdout:5/502: dwrite d4/d16/d1b/d20/d28/d3f/f90 [0,4194304] 0 2024-09-17T07:19:57.661 INFO:tasks.workunit.client.0.smithi087.stdout:8/579: write d1/d7/d9/d27/f7a [760593,69880] 0 2024-09-17T07:19:57.663 INFO:tasks.workunit.client.0.smithi087.stdout:9/589: dwrite d3/d4/d6/d8/d22/f75 [0,4194304] 0 2024-09-17T07:19:57.664 INFO:tasks.workunit.client.0.smithi087.stdout:6/752: chown d1/lf9 13874198 1 2024-09-17T07:19:57.664 INFO:tasks.workunit.client.0.smithi087.stdout:7/477: readlink d0/d3/l4b 0 2024-09-17T07:19:57.665 INFO:tasks.workunit.client.0.smithi087.stdout:1/509: creat d2/d3d/d8e/fb2 x:0 0 0 2024-09-17T07:19:57.666 INFO:tasks.workunit.client.0.smithi087.stdout:5/733: rmdir d5/d18/dc2/ddf 0 2024-09-17T07:19:57.667 INFO:tasks.workunit.client.0.smithi087.stdout:4/554: mknod d2/d92/d4d/d21/d2f/cc2 0 2024-09-17T07:19:57.670 INFO:tasks.workunit.client.0.smithi087.stdout:8/580: write d1/d2b/f9a [977565,26152] 0 2024-09-17T07:19:57.671 INFO:tasks.workunit.client.0.smithi087.stdout:1/510: chown d2/d3d/d35/d57/f89 41351446 1 2024-09-17T07:19:57.672 INFO:tasks.workunit.client.0.smithi087.stdout:3/607: unlink d6/lc9 0 2024-09-17T07:19:57.674 INFO:tasks.workunit.client.0.smithi087.stdout:1/511: write d2/d14/fb [4400995,55987] 0 2024-09-17T07:19:57.674 INFO:tasks.workunit.client.0.smithi087.stdout:6/753: mknod d1/d67/cff 0 2024-09-17T07:19:57.675 INFO:tasks.workunit.client.0.smithi087.stdout:3/608: write d6/d1b/fc4 [394660,32510] 0 2024-09-17T07:19:57.675 INFO:tasks.workunit.client.1.smithi139.stdout:5/503: dread d4/d16/f19 [0,4194304] 0 2024-09-17T07:19:57.676 INFO:tasks.workunit.client.0.smithi087.stdout:2/582: dwrite d2/d7/f68 [0,4194304] 0 2024-09-17T07:19:57.677 INFO:tasks.workunit.client.1.smithi139.stdout:5/504: dread - d4/d16/d1b/d20/d32/d6c/f70 zero size 2024-09-17T07:19:57.679 INFO:tasks.workunit.client.1.smithi139.stdout:5/505: write d4/d16/d1b/d20/f7d [1005767,121676] 0 2024-09-17T07:19:57.679 INFO:tasks.workunit.client.0.smithi087.stdout:8/581: chown d1/d7/d9/d27/da1/db2 2 1 2024-09-17T07:19:57.682 INFO:tasks.workunit.client.1.smithi139.stdout:5/506: symlink d4/d16/d1b/d20/d32/d72/l9d 0 2024-09-17T07:19:57.683 INFO:tasks.workunit.client.0.smithi087.stdout:8/582: fsync d1/d2b/f29 0 2024-09-17T07:19:57.684 INFO:tasks.workunit.client.0.smithi087.stdout:9/590: fsync d3/d4/fb 0 2024-09-17T07:19:57.685 INFO:tasks.workunit.client.0.smithi087.stdout:8/583: truncate d1/d2b/d21/fb3 940548 0 2024-09-17T07:19:57.686 INFO:tasks.workunit.client.1.smithi139.stdout:5/507: link d4/d16/d1b/d20/d28/d61/f9c d4/d16/d1b/d20/d67/f9e 0 2024-09-17T07:19:57.687 INFO:tasks.workunit.client.1.smithi139.stdout:5/508: readlink d4/d16/d1b/d20/d28/l13 0 2024-09-17T07:19:57.687 INFO:tasks.workunit.client.0.smithi087.stdout:4/555: truncate d2/d92/d4d/fd 822936 0 2024-09-17T07:19:57.688 INFO:tasks.workunit.client.0.smithi087.stdout:7/478: link d0/d3/d23/d4e/f78 d0/d36/d8e/f95 0 2024-09-17T07:19:57.689 INFO:tasks.workunit.client.1.smithi139.stdout:5/509: unlink d4/d16/d1b/d20/d67/f94 0 2024-09-17T07:19:57.689 INFO:tasks.workunit.client.0.smithi087.stdout:2/583: mknod d2/d7/dd/d10/cbd 0 2024-09-17T07:19:57.690 INFO:tasks.workunit.client.1.smithi139.stdout:5/510: write d4/d5d/f95 [855677,15628] 0 2024-09-17T07:19:57.692 INFO:tasks.workunit.client.0.smithi087.stdout:5/734: creat d5/d12/ff1 x:0 0 0 2024-09-17T07:19:57.692 INFO:tasks.workunit.client.0.smithi087.stdout:9/591: mknod d3/d4/da/d4b/cd4 0 2024-09-17T07:19:57.693 INFO:tasks.workunit.client.0.smithi087.stdout:5/735: fdatasync d5/d12/ff1 0 2024-09-17T07:19:57.694 INFO:tasks.workunit.client.0.smithi087.stdout:8/584: creat d1/d7/d9/d19/d4d/fd0 x:0 0 0 2024-09-17T07:19:57.695 INFO:tasks.workunit.client.1.smithi139.stdout:5/511: dwrite d4/d16/d1b/d20/f56 [0,4194304] 0 2024-09-17T07:19:57.698 INFO:tasks.workunit.client.0.smithi087.stdout:5/736: creat d5/d12/d56/d9e/dcb/ff2 x:0 0 0 2024-09-17T07:19:57.698 INFO:tasks.workunit.client.0.smithi087.stdout:5/737: chown d5/d6d/c79 35315 1 2024-09-17T07:19:57.699 INFO:tasks.workunit.client.0.smithi087.stdout:4/556: rename d2/d92/d4f/c90 to d2/d92/d4d/d3e/cc3 0 2024-09-17T07:19:57.703 INFO:tasks.workunit.client.0.smithi087.stdout:7/479: mkdir d0/d3/d10/d87/d96 0 2024-09-17T07:19:57.708 INFO:tasks.workunit.client.0.smithi087.stdout:7/480: symlink d0/d3/l97 0 2024-09-17T07:19:57.709 INFO:tasks.workunit.client.0.smithi087.stdout:8/585: getdents d1/d2b/d3b 0 2024-09-17T07:19:57.709 INFO:tasks.workunit.client.0.smithi087.stdout:5/738: getdents d5/d18/dc2 0 2024-09-17T07:19:57.711 INFO:tasks.workunit.client.0.smithi087.stdout:8/586: fsync d1/d7/d9/d19/d4d/f47 0 2024-09-17T07:19:57.711 INFO:tasks.workunit.client.1.smithi139.stdout:5/512: write d4/d16/f18 [708261,69658] 0 2024-09-17T07:19:57.712 INFO:tasks.workunit.client.0.smithi087.stdout:7/481: truncate d0/f25 2047752 0 2024-09-17T07:19:57.713 INFO:tasks.workunit.client.1.smithi139.stdout:5/513: read d4/d16/d1b/f39 [971979,64563] 0 2024-09-17T07:19:57.715 INFO:tasks.workunit.client.0.smithi087.stdout:5/739: mkdir d5/d18/d6f/de1/d7d/df3 0 2024-09-17T07:19:57.715 INFO:tasks.workunit.client.1.smithi139.stdout:5/514: mkdir d4/d16/d1b/d20/d67/d88/d9f 0 2024-09-17T07:19:57.717 INFO:tasks.workunit.client.0.smithi087.stdout:8/587: rename d1/d7/d9/d19/d1b/d18/lb0 to d1/d2b/d21/d6d/d6f/d7f/ld1 0 2024-09-17T07:19:57.718 INFO:tasks.workunit.client.1.smithi139.stdout:5/515: rename d4/d16/l29 to d4/d16/d1b/d20/d32/d76/la0 0 2024-09-17T07:19:57.721 INFO:tasks.workunit.client.1.smithi139.stdout:5/516: link d4/d16/d1b/c37 d4/d16/d1b/d20/d32/d3d/ca1 0 2024-09-17T07:19:57.721 INFO:tasks.workunit.client.0.smithi087.stdout:5/740: creat d5/ff4 x:0 0 0 2024-09-17T07:19:57.722 INFO:tasks.workunit.client.1.smithi139.stdout:5/517: write d4/d16/d1b/d20/d28/f46 [1272065,73602] 0 2024-09-17T07:19:57.723 INFO:tasks.workunit.client.0.smithi087.stdout:7/482: link d0/d3/d10/d32/d62/f88 d0/d3/d86/d89/f98 0 2024-09-17T07:19:57.724 INFO:tasks.workunit.client.0.smithi087.stdout:3/609: dwrite d6/d1b/d42/d62/dbb/fc2 [0,4194304] 0 2024-09-17T07:19:57.725 INFO:tasks.workunit.client.1.smithi139.stdout:5/518: unlink d4/d16/d1b/d20/d28/l35 0 2024-09-17T07:19:57.725 INFO:tasks.workunit.client.0.smithi087.stdout:8/588: creat d1/d7/d9/d19/d4d/fd2 x:0 0 0 2024-09-17T07:19:57.728 INFO:tasks.workunit.client.1.smithi139.stdout:5/519: creat d4/d5d/d97/fa2 x:0 0 0 2024-09-17T07:19:57.728 INFO:tasks.workunit.client.1.smithi139.stdout:5/520: creat d4/d16/d1b/d20/d38/fa3 x:0 0 0 2024-09-17T07:19:57.729 INFO:tasks.workunit.client.0.smithi087.stdout:2/584: dwrite d2/d50/f61 [0,4194304] 0 2024-09-17T07:19:57.730 INFO:tasks.workunit.client.1.smithi139.stdout:5/521: mkdir d4/d5d/d97/da4 0 2024-09-17T07:19:57.730 INFO:tasks.workunit.client.0.smithi087.stdout:5/741: mkdir d5/d12/d56/df5 0 2024-09-17T07:19:57.733 INFO:tasks.workunit.client.1.smithi139.stdout:5/522: write d4/d16/d1b/d20/d28/d3f/f90 [3106734,101437] 0 2024-09-17T07:19:57.734 INFO:tasks.workunit.client.0.smithi087.stdout:7/483: unlink d0/d3/d23/d17/f51 0 2024-09-17T07:19:57.736 INFO:tasks.workunit.client.0.smithi087.stdout:9/592: dwrite d3/d4/d6/d8/d12/f60 [0,4194304] 0 2024-09-17T07:19:57.741 INFO:tasks.workunit.client.0.smithi087.stdout:3/610: mkdir d6/d15/d37/d3c/d43/d48/dd1 0 2024-09-17T07:19:57.745 INFO:tasks.workunit.client.0.smithi087.stdout:4/557: dwrite d2/d92/d4d/d21/d2f/d3b/f9a [0,4194304] 0 2024-09-17T07:19:57.749 INFO:tasks.workunit.client.0.smithi087.stdout:7/484: unlink d0/d3/d10/d32/d62/f88 0 2024-09-17T07:19:57.752 INFO:tasks.workunit.client.0.smithi087.stdout:5/742: dwrite d5/d12/f8b [0,4194304] 0 2024-09-17T07:19:57.753 INFO:tasks.workunit.client.0.smithi087.stdout:3/611: dread d6/d15/f71 [0,4194304] 0 2024-09-17T07:19:57.754 INFO:tasks.workunit.client.0.smithi087.stdout:4/558: mknod d2/cc4 0 2024-09-17T07:19:57.756 INFO:tasks.workunit.client.1.smithi139.stdout:5/523: getdents d4/d16/d1b/d20/d32/d76 0 2024-09-17T07:19:57.757 INFO:tasks.workunit.client.0.smithi087.stdout:7/485: write d0/d3/f5a [2196781,35330] 0 2024-09-17T07:19:57.757 INFO:tasks.workunit.client.0.smithi087.stdout:8/589: getdents d1/d5f 0 2024-09-17T07:19:57.757 INFO:tasks.workunit.client.1.smithi139.stdout:5/524: fdatasync d4/d16/d1b/d20/f56 0 2024-09-17T07:19:57.758 INFO:tasks.workunit.client.1.smithi139.stdout:5/525: readlink d4/d16/d1b/d20/d28/l13 0 2024-09-17T07:19:57.759 INFO:tasks.workunit.client.0.smithi087.stdout:2/585: getdents d2/d7/dd/d10/d4c 0 2024-09-17T07:19:57.762 INFO:tasks.workunit.client.0.smithi087.stdout:9/593: dwrite d3/d4/d16/d69/d8a/d1e/d90/fb5 [0,4194304] 0 2024-09-17T07:19:57.766 INFO:tasks.workunit.client.0.smithi087.stdout:3/612: mknod d6/d1b/d42/d6e/db0/cd2 0 2024-09-17T07:19:57.766 INFO:tasks.workunit.client.0.smithi087.stdout:5/743: creat d5/d18/d20/d2f/d60/ff6 x:0 0 0 2024-09-17T07:19:57.766 INFO:tasks.workunit.client.0.smithi087.stdout:7/486: readlink d0/d3/l1d 0 2024-09-17T07:19:57.767 INFO:tasks.workunit.client.0.smithi087.stdout:2/586: mknod d2/d7/db/cbe 0 2024-09-17T07:19:57.769 INFO:tasks.workunit.client.0.smithi087.stdout:8/590: creat d1/d2b/d21/d6d/d6f/d7f/fd3 x:0 0 0 2024-09-17T07:19:57.773 INFO:tasks.workunit.client.0.smithi087.stdout:8/591: readlink d1/d7/d9/d19/d1b/l28 0 2024-09-17T07:19:57.774 INFO:tasks.workunit.client.1.smithi139.stdout:5/526: truncate d4/d16/d1b/f66 2554436 0 2024-09-17T07:19:57.776 INFO:tasks.workunit.client.1.smithi139.stdout:5/527: mkdir d4/da5 0 2024-09-17T07:19:57.777 INFO:tasks.workunit.client.1.smithi139.stdout:5/528: chown d4/d16/d1b/d20/d38/f87 20624 1 2024-09-17T07:19:57.777 INFO:tasks.workunit.client.0.smithi087.stdout:3/613: symlink d6/d7d/ld3 0 2024-09-17T07:19:57.777 INFO:tasks.workunit.client.1.smithi139.stdout:5/529: write d4/d16/f7a [908721,19616] 0 2024-09-17T07:19:57.779 INFO:tasks.workunit.client.0.smithi087.stdout:4/559: symlink d2/d22/lc5 0 2024-09-17T07:19:57.780 INFO:tasks.workunit.client.0.smithi087.stdout:2/587: dwrite d2/d7/dd/f79 [0,4194304] 0 2024-09-17T07:19:57.780 INFO:tasks.workunit.client.0.smithi087.stdout:5/744: dwrite d5/d8/d1f/fc0 [0,4194304] 0 2024-09-17T07:19:57.780 INFO:tasks.workunit.client.1.smithi139.stdout:5/530: rmdir d4/d16/d1b/d20/d67 39 2024-09-17T07:19:57.781 INFO:tasks.workunit.client.0.smithi087.stdout:9/594: symlink d3/d25/dc1/ld5 0 2024-09-17T07:19:57.782 INFO:tasks.workunit.client.0.smithi087.stdout:5/745: chown d5/d6d/f81 3 1 2024-09-17T07:19:57.783 INFO:tasks.workunit.client.1.smithi139.stdout:5/531: chown d4/d16/d1b/d20/d32/d76/la0 78 1 2024-09-17T07:19:57.785 INFO:tasks.workunit.client.0.smithi087.stdout:8/592: mkdir d1/d2b/d21/dd4 0 2024-09-17T07:19:57.789 INFO:tasks.workunit.client.1.smithi139.stdout:5/532: link d4/d16/d1b/d20/d67/d88/f8c d4/d16/d1b/d20/d38/d4f/fa6 0 2024-09-17T07:19:57.790 INFO:tasks.workunit.client.0.smithi087.stdout:8/593: chown d1/d2b/d21/d6d/d6f/d7f/d54/f6a 864545 1 2024-09-17T07:19:57.791 INFO:tasks.workunit.client.0.smithi087.stdout:2/588: dwrite d2/d7/d33/fa9 [0,4194304] 0 2024-09-17T07:19:57.794 INFO:tasks.workunit.client.1.smithi139.stdout:5/533: rename d4/d16/f92 to d4/d16/d1b/d20/d32/d6c/fa7 0 2024-09-17T07:19:57.794 INFO:tasks.workunit.client.0.smithi087.stdout:3/614: rename d6/d15/d37/d3c/d43/d48 to d6/d1b/d42/dd4 0 2024-09-17T07:19:57.796 INFO:tasks.workunit.client.0.smithi087.stdout:9/595: mknod d3/d4/d6/d8/d22/d43/cd6 0 2024-09-17T07:19:57.800 INFO:tasks.workunit.client.0.smithi087.stdout:8/594: dread d1/d2b/d21/d6d/d6f/fb4 [0,4194304] 0 2024-09-17T07:19:57.801 INFO:tasks.workunit.client.0.smithi087.stdout:8/595: fsync d1/d5f/f87 0 2024-09-17T07:19:57.803 INFO:tasks.workunit.client.0.smithi087.stdout:8/596: fdatasync d1/d2b/d21/f9c 0 2024-09-17T07:19:57.803 INFO:tasks.workunit.client.0.smithi087.stdout:7/487: truncate d0/d3/d23/d4e/f8a 446545 0 2024-09-17T07:19:57.804 INFO:tasks.workunit.client.0.smithi087.stdout:2/589: write d2/d15/d34/f55 [4365855,113272] 0 2024-09-17T07:19:57.807 INFO:tasks.workunit.client.0.smithi087.stdout:5/746: mkdir d5/d12/d1c/d71/df7 0 2024-09-17T07:19:57.810 INFO:tasks.workunit.client.0.smithi087.stdout:8/597: creat d1/d2b/d21/dd4/fd5 x:0 0 0 2024-09-17T07:19:57.812 INFO:tasks.workunit.client.0.smithi087.stdout:3/615: read d6/f59 [1637116,119040] 0 2024-09-17T07:19:57.812 INFO:tasks.workunit.client.0.smithi087.stdout:7/488: link d0/d3/d23/d4e/f8a d0/d3/d10/d32/f99 0 2024-09-17T07:19:57.814 INFO:tasks.workunit.client.0.smithi087.stdout:8/598: creat d1/fd6 x:0 0 0 2024-09-17T07:19:57.818 INFO:tasks.workunit.client.0.smithi087.stdout:5/747: rmdir d5/d18/dc2 0 2024-09-17T07:19:57.819 INFO:tasks.workunit.client.0.smithi087.stdout:2/590: getdents d2/d48/da2 0 2024-09-17T07:19:57.822 INFO:tasks.workunit.client.0.smithi087.stdout:3/616: rename d6/l9 to d6/d15/d37/d3c/d52/ld5 0 2024-09-17T07:19:57.823 INFO:tasks.workunit.client.0.smithi087.stdout:9/596: truncate f2 1828218 0 2024-09-17T07:19:57.824 INFO:tasks.workunit.client.0.smithi087.stdout:8/599: dwrite d1/d2b/d21/d6d/d6f/f90 [0,4194304] 0 2024-09-17T07:19:57.826 INFO:tasks.workunit.client.0.smithi087.stdout:4/560: dread d2/d5/d1f/f68 [0,4194304] 0 2024-09-17T07:19:57.827 INFO:tasks.workunit.client.0.smithi087.stdout:2/591: creat d2/d15/d34/fbf x:0 0 0 2024-09-17T07:19:57.827 INFO:tasks.workunit.client.0.smithi087.stdout:7/489: fsync d0/d3/d23/f54 0 2024-09-17T07:19:57.830 INFO:tasks.workunit.client.0.smithi087.stdout:3/617: dread - d6/d15/d37/d3c/d52/db2/fbd zero size 2024-09-17T07:19:57.833 INFO:tasks.workunit.client.0.smithi087.stdout:7/490: readlink d0/d3/d10/d32/d62/d76/l80 0 2024-09-17T07:19:57.835 INFO:tasks.workunit.client.0.smithi087.stdout:2/592: dread d2/d50/f61 [0,4194304] 0 2024-09-17T07:19:57.836 INFO:tasks.workunit.client.0.smithi087.stdout:2/593: chown d2/d48/f59 94 1 2024-09-17T07:19:57.837 INFO:tasks.workunit.client.0.smithi087.stdout:9/597: mkdir d3/d4/da/dd7 0 2024-09-17T07:19:57.837 INFO:tasks.workunit.client.0.smithi087.stdout:2/594: stat d2/d7/d30/d3f/f8e 0 2024-09-17T07:19:57.839 INFO:tasks.workunit.client.0.smithi087.stdout:8/600: mkdir d1/d2b/d21/daf/dd7 0 2024-09-17T07:19:57.841 INFO:tasks.workunit.client.0.smithi087.stdout:3/618: mknod d6/d1b/d42/d62/dbb/cd6 0 2024-09-17T07:19:57.842 INFO:tasks.workunit.client.0.smithi087.stdout:4/561: creat d2/d5/d1f/fc6 x:0 0 0 2024-09-17T07:19:57.843 INFO:tasks.workunit.client.0.smithi087.stdout:2/595: rmdir d2/d48/da2/d3a/d9f 39 2024-09-17T07:19:57.845 INFO:tasks.workunit.client.0.smithi087.stdout:5/748: dread d5/d18/d20/f35 [0,4194304] 0 2024-09-17T07:19:57.845 INFO:tasks.workunit.client.0.smithi087.stdout:8/601: symlink d1/d2b/d21/ld8 0 2024-09-17T07:19:57.847 INFO:tasks.workunit.client.0.smithi087.stdout:3/619: mkdir d6/d1b/d42/d62/dbb/dd7 0 2024-09-17T07:19:57.852 INFO:tasks.workunit.client.0.smithi087.stdout:3/620: write d6/d1b/d42/fca [4345094,53549] 0 2024-09-17T07:19:57.852 INFO:tasks.workunit.client.0.smithi087.stdout:9/598: link d3/d4/d6/d8/d12/d32/c41 d3/d4/d6/d8/d22/d92/da3/da4/cd8 0 2024-09-17T07:19:57.875 INFO:tasks.workunit.client.0.smithi087.stdout:4/562: symlink d2/d92/d4f/d7b/lc7 0 2024-09-17T07:19:57.875 INFO:tasks.workunit.client.0.smithi087.stdout:3/621: readlink d6/d16/l53 0 2024-09-17T07:19:57.876 INFO:tasks.workunit.client.0.smithi087.stdout:8/602: dwrite d1/d7/d9/d19/d4d/fd0 [0,4194304] 0 2024-09-17T07:19:57.877 INFO:tasks.workunit.client.0.smithi087.stdout:2/596: getdents d2/d7/dd/d6a 0 2024-09-17T07:19:57.880 INFO:tasks.workunit.client.0.smithi087.stdout:3/622: write d6/d15/d37/f5b [148816,112016] 0 2024-09-17T07:19:57.883 INFO:tasks.workunit.client.0.smithi087.stdout:8/603: rename d1/d5f/d71 to d1/d7/d63/dd9 0 2024-09-17T07:19:57.884 INFO:tasks.workunit.client.0.smithi087.stdout:3/623: rmdir d6/d1b/d42/dd4 39 2024-09-17T07:19:57.887 INFO:tasks.workunit.client.0.smithi087.stdout:9/599: dwrite d3/d4/d6/d8/d22/d43/d84/fbb [0,4194304] 0 2024-09-17T07:19:57.888 INFO:tasks.workunit.client.0.smithi087.stdout:8/604: write d1/d2b/d21/d6d/d6f/d7f/fd3 [459741,54095] 0 2024-09-17T07:19:57.890 INFO:tasks.workunit.client.0.smithi087.stdout:5/749: dread d5/fa9 [0,4194304] 0 2024-09-17T07:19:57.892 INFO:tasks.workunit.client.0.smithi087.stdout:8/605: rmdir d1/d2b 39 2024-09-17T07:19:57.893 INFO:tasks.workunit.client.0.smithi087.stdout:5/750: mkdir d5/d18/d20/d2f/d60/de3/ded/df8 0 2024-09-17T07:19:57.897 INFO:tasks.workunit.client.0.smithi087.stdout:2/597: write d2/d48/da2/f73 [1720486,89289] 0 2024-09-17T07:19:57.898 INFO:tasks.workunit.client.0.smithi087.stdout:8/606: stat d1/d2b/d21/d6d/d6f/d7f/d54 0 2024-09-17T07:19:57.902 INFO:tasks.workunit.client.0.smithi087.stdout:2/598: creat d2/d24/fc0 x:0 0 0 2024-09-17T07:19:57.902 INFO:tasks.workunit.client.0.smithi087.stdout:9/600: dwrite d3/d4/d16/f5b [0,4194304] 0 2024-09-17T07:19:57.906 INFO:tasks.workunit.client.0.smithi087.stdout:5/751: link d5/d18/d20/d2f/c9c d5/d18/d20/d2f/d60/de3/ded/df8/cf9 0 2024-09-17T07:19:57.906 INFO:tasks.workunit.client.0.smithi087.stdout:4/563: dwrite d2/d92/d4d/d42/fb4 [4194304,4194304] 0 2024-09-17T07:19:57.911 INFO:tasks.workunit.client.0.smithi087.stdout:9/601: mknod d3/d4/d16/d69/d8a/d1e/d90/d93/d96/cd9 0 2024-09-17T07:19:57.913 INFO:tasks.workunit.client.0.smithi087.stdout:2/599: dwrite d2/d7/dd/f79 [0,4194304] 0 2024-09-17T07:19:57.915 INFO:tasks.workunit.client.0.smithi087.stdout:5/752: chown d5/d18/d20/c5d 47112 1 2024-09-17T07:19:57.917 INFO:tasks.workunit.client.0.smithi087.stdout:9/602: truncate d3/d25/d83/fc9 1095772 0 2024-09-17T07:19:57.929 INFO:tasks.workunit.client.0.smithi087.stdout:3/624: dread d6/d15/d37/d3c/f6f [0,4194304] 0 2024-09-17T07:19:57.929 INFO:tasks.workunit.client.0.smithi087.stdout:8/607: dwrite d1/d7/d9/d27/f45 [0,4194304] 0 2024-09-17T07:19:57.929 INFO:tasks.workunit.client.0.smithi087.stdout:9/603: chown d3/d4/d6/d8/d22/d2a 587 1 2024-09-17T07:19:57.931 INFO:tasks.workunit.client.0.smithi087.stdout:4/564: dwrite d2/d92/d4d/d21/d2f/f47 [4194304,4194304] 0 2024-09-17T07:19:57.935 INFO:tasks.workunit.client.0.smithi087.stdout:9/604: fdatasync d3/d4/d6/d8/d22/fa5 0 2024-09-17T07:19:57.936 INFO:tasks.workunit.client.0.smithi087.stdout:5/753: dread d5/d8/d1f/fc0 [0,4194304] 0 2024-09-17T07:19:57.939 INFO:tasks.workunit.client.0.smithi087.stdout:3/625: symlink d6/d1b/d42/d62/dc1/ld8 0 2024-09-17T07:19:57.941 INFO:tasks.workunit.client.0.smithi087.stdout:2/600: dwrite d2/d7/dd/f29 [4194304,4194304] 0 2024-09-17T07:19:57.942 INFO:tasks.workunit.client.0.smithi087.stdout:4/565: creat d2/d5/d1f/fc8 x:0 0 0 2024-09-17T07:19:57.944 INFO:tasks.workunit.client.0.smithi087.stdout:3/626: dread - d6/d1b/d42/d62/f84 zero size 2024-09-17T07:19:57.946 INFO:tasks.workunit.client.0.smithi087.stdout:4/566: fsync d2/d92/d4d/d21/d2f/d3b/f80 0 2024-09-17T07:19:57.947 INFO:tasks.workunit.client.0.smithi087.stdout:3/627: chown d6/d16/l53 22775 1 2024-09-17T07:19:57.947 INFO:tasks.workunit.client.0.smithi087.stdout:8/608: dwrite d1/d5f/f5d [0,4194304] 0 2024-09-17T07:19:57.950 INFO:tasks.workunit.client.0.smithi087.stdout:9/605: rename d3/d4/d6/d8/d22/f50 to d3/d4/d6/d8/fda 0 2024-09-17T07:19:57.953 INFO:tasks.workunit.client.0.smithi087.stdout:2/601: dwrite d2/f16 [0,4194304] 0 2024-09-17T07:19:57.956 INFO:tasks.workunit.client.0.smithi087.stdout:4/567: dread d2/d92/d4d/d21/d2f/d3b/d7e/fa1 [0,4194304] 0 2024-09-17T07:19:57.957 INFO:tasks.workunit.client.0.smithi087.stdout:9/606: mkdir d3/d4/da/d4b/ddb 0 2024-09-17T07:19:57.958 INFO:tasks.workunit.client.0.smithi087.stdout:4/568: fdatasync d2/d92/d4d/f3d 0 2024-09-17T07:19:57.963 INFO:tasks.workunit.client.1.smithi139.stdout:6/574: sync 2024-09-17T07:19:57.963 INFO:tasks.workunit.client.1.smithi139.stdout:6/575: dread - db/d18/d1b/da7/fb1 zero size 2024-09-17T07:19:57.968 INFO:tasks.workunit.client.1.smithi139.stdout:6/576: dwrite db/d18/f44 [0,4194304] 0 2024-09-17T07:19:57.971 INFO:tasks.workunit.client.1.smithi139.stdout:6/577: mknod db/df/d4e/d64/d56/cbd 0 2024-09-17T07:19:57.973 INFO:tasks.workunit.client.1.smithi139.stdout:6/578: mknod db/df/daa/cbe 0 2024-09-17T07:19:57.975 INFO:tasks.workunit.client.1.smithi139.stdout:6/579: creat db/df/d4e/d64/d83/fbf x:0 0 0 2024-09-17T07:19:57.991 INFO:tasks.workunit.client.1.smithi139.stdout:6/580: dwrite db/d18/f48 [0,4194304] 0 2024-09-17T07:19:57.992 INFO:tasks.workunit.client.1.smithi139.stdout:6/581: chown db/df/d4e/d64/fb2 148827 1 2024-09-17T07:19:58.017 INFO:tasks.workunit.client.0.smithi087.stdout:8/609: write d1/d7/d9/d27/f7c [1801028,15862] 0 2024-09-17T07:19:58.019 INFO:tasks.workunit.client.0.smithi087.stdout:9/607: symlink d3/d4/d6/ldc 0 2024-09-17T07:19:58.020 INFO:tasks.workunit.client.0.smithi087.stdout:4/569: write d2/d92/d4d/d21/d2f/d3b/d7e/d97/fa6 [53908,79304] 0 2024-09-17T07:19:58.020 INFO:tasks.workunit.client.0.smithi087.stdout:9/608: fdatasync d3/d4/d6/fbe 0 2024-09-17T07:19:58.021 INFO:tasks.workunit.client.0.smithi087.stdout:2/602: write d2/d7/dd/d10/f1d [3833582,115844] 0 2024-09-17T07:19:58.023 INFO:tasks.workunit.client.0.smithi087.stdout:4/570: stat d2/l57 0 2024-09-17T07:19:58.024 INFO:tasks.workunit.client.0.smithi087.stdout:2/603: write d2/d7/dd/f79 [3582831,74180] 0 2024-09-17T07:19:58.024 INFO:tasks.workunit.client.0.smithi087.stdout:4/571: dread - d2/d22/d2c/fc0 zero size 2024-09-17T07:19:58.026 INFO:tasks.workunit.client.0.smithi087.stdout:2/604: write d2/d50/f74 [592253,2141] 0 2024-09-17T07:19:58.027 INFO:tasks.workunit.client.0.smithi087.stdout:4/572: symlink d2/d22/d2c/lc9 0 2024-09-17T07:19:58.028 INFO:tasks.workunit.client.0.smithi087.stdout:8/610: dwrite d1/d7/d9/d27/f7c [0,4194304] 0 2024-09-17T07:19:58.033 INFO:tasks.workunit.client.0.smithi087.stdout:5/754: dread d5/d12/d14/d61/d94/fa4 [0,4194304] 0 2024-09-17T07:19:58.033 INFO:tasks.workunit.client.0.smithi087.stdout:2/605: rmdir d2/d24/d36 39 2024-09-17T07:19:58.033 INFO:tasks.workunit.client.0.smithi087.stdout:8/611: write d1/d2b/d21/d6d/d6f/f82 [1038872,85234] 0 2024-09-17T07:19:58.033 INFO:tasks.workunit.client.0.smithi087.stdout:4/573: stat d2/d22/d2c/d91/cb2 0 2024-09-17T07:19:58.033 INFO:tasks.workunit.client.0.smithi087.stdout:2/606: dread - d2/d7/d60/fb6 zero size 2024-09-17T07:19:58.035 INFO:tasks.workunit.client.0.smithi087.stdout:8/612: creat d1/d2b/d21/daf/fda x:0 0 0 2024-09-17T07:19:58.035 INFO:tasks.workunit.client.0.smithi087.stdout:2/607: read d2/d48/da2/f73 [241736,59055] 0 2024-09-17T07:19:58.036 INFO:tasks.workunit.client.0.smithi087.stdout:5/755: rename d5/d8/d1f/d4e/c93 to d5/d18/d20/d2f/d52/cfa 0 2024-09-17T07:19:58.040 INFO:tasks.workunit.client.0.smithi087.stdout:4/574: dwrite d2/d92/d86/fbe [0,4194304] 0 2024-09-17T07:19:58.041 INFO:tasks.workunit.client.0.smithi087.stdout:5/756: truncate d5/d18/d20/d7a/fbf 1153000 0 2024-09-17T07:19:58.042 INFO:tasks.workunit.client.0.smithi087.stdout:5/757: readlink d5/d12/d1c/l6e 0 2024-09-17T07:19:58.043 INFO:tasks.workunit.client.0.smithi087.stdout:2/608: rename d2/d48/c51 to d2/d15/cc1 0 2024-09-17T07:19:58.043 INFO:tasks.workunit.client.0.smithi087.stdout:4/575: symlink d2/d92/d4f/d6a/lca 0 2024-09-17T07:19:58.045 INFO:tasks.workunit.client.0.smithi087.stdout:2/609: write d2/d7/f68 [4682637,117836] 0 2024-09-17T07:19:58.050 INFO:tasks.workunit.client.0.smithi087.stdout:2/610: creat d2/d7/dd/d10/d4c/d5f/d8b/fc2 x:0 0 0 2024-09-17T07:19:58.050 INFO:tasks.workunit.client.0.smithi087.stdout:4/576: dread d2/d92/d4d/d21/f79 [0,4194304] 0 2024-09-17T07:19:58.051 INFO:tasks.workunit.client.0.smithi087.stdout:4/577: fsync d2/d92/f94 0 2024-09-17T07:19:58.051 INFO:tasks.workunit.client.0.smithi087.stdout:2/611: chown d2/d7/dd/d10/f5a 62721256 1 2024-09-17T07:19:58.052 INFO:tasks.workunit.client.0.smithi087.stdout:4/578: readlink d2/d22/d62/lb7 0 2024-09-17T07:19:58.053 INFO:tasks.workunit.client.0.smithi087.stdout:5/758: getdents d5/d12/d56/d9e 0 2024-09-17T07:19:58.055 INFO:tasks.workunit.client.0.smithi087.stdout:2/612: unlink d2/d7/d30/d3f/f8e 0 2024-09-17T07:19:58.061 INFO:tasks.workunit.client.0.smithi087.stdout:2/613: dread d2/d7/dd/f27 [0,4194304] 0 2024-09-17T07:19:58.061 INFO:tasks.workunit.client.0.smithi087.stdout:5/759: getdents d5/d8 0 2024-09-17T07:19:58.063 INFO:tasks.workunit.client.0.smithi087.stdout:8/613: dwrite d1/d7/d9/d19/f9d [0,4194304] 0 2024-09-17T07:19:58.063 INFO:tasks.workunit.client.0.smithi087.stdout:4/579: write d2/d92/d4f/fbc [3466733,55987] 0 2024-09-17T07:19:58.064 INFO:tasks.workunit.client.0.smithi087.stdout:2/614: write d2/f16 [2443616,98381] 0 2024-09-17T07:19:58.065 INFO:tasks.workunit.client.0.smithi087.stdout:8/614: fdatasync d1/d7/d9/d19/d1b/d18/fa3 0 2024-09-17T07:19:58.066 INFO:tasks.workunit.client.0.smithi087.stdout:2/615: fsync d2/d7/dd/d6a/d6d/f86 0 2024-09-17T07:19:58.067 INFO:tasks.workunit.client.0.smithi087.stdout:5/760: unlink d5/d18/d6f/de1/lb6 0 2024-09-17T07:19:58.068 INFO:tasks.workunit.client.0.smithi087.stdout:8/615: truncate d1/d7/d9/d19/fb9 982220 0 2024-09-17T07:19:58.069 INFO:tasks.workunit.client.0.smithi087.stdout:4/580: mknod d2/d92/d4f/d6a/ccb 0 2024-09-17T07:19:58.070 INFO:tasks.workunit.client.0.smithi087.stdout:8/616: write d1/d2b/f9a [1666835,45678] 0 2024-09-17T07:19:58.070 INFO:tasks.workunit.client.0.smithi087.stdout:2/616: creat d2/d7/dd/d10/d91/fc3 x:0 0 0 2024-09-17T07:19:58.072 INFO:tasks.workunit.client.0.smithi087.stdout:4/581: truncate d2/d5/d1f/fc8 941960 0 2024-09-17T07:19:58.074 INFO:tasks.workunit.client.0.smithi087.stdout:4/582: read d2/d92/d4d/d21/d2f/d3b/f7d [748762,9186] 0 2024-09-17T07:19:58.078 INFO:tasks.workunit.client.0.smithi087.stdout:4/583: creat d2/d92/d4d/d42/fcc x:0 0 0 2024-09-17T07:19:58.078 INFO:tasks.workunit.client.0.smithi087.stdout:8/617: dwrite d1/d2b/f32 [0,4194304] 0 2024-09-17T07:19:58.085 INFO:tasks.workunit.client.0.smithi087.stdout:4/584: creat d2/d92/d4d/d42/db6/fcd x:0 0 0 2024-09-17T07:19:58.085 INFO:tasks.workunit.client.0.smithi087.stdout:5/761: dread d5/d18/d20/d2f/d60/de3/ded/f86 [0,4194304] 0 2024-09-17T07:19:58.087 INFO:tasks.workunit.client.0.smithi087.stdout:4/585: mknod d2/cce 0 2024-09-17T07:19:58.088 INFO:tasks.workunit.client.0.smithi087.stdout:5/762: rmdir d5/d8/d1f/de4 39 2024-09-17T07:19:58.091 INFO:tasks.workunit.client.0.smithi087.stdout:8/618: dwrite d1/d2b/d21/f9c [0,4194304] 0 2024-09-17T07:19:58.093 INFO:tasks.workunit.client.0.smithi087.stdout:2/617: dwrite d2/d7/dd/d10/f88 [0,4194304] 0 2024-09-17T07:19:58.096 INFO:tasks.workunit.client.0.smithi087.stdout:2/618: stat d2/d48/f59 0 2024-09-17T07:19:58.097 INFO:tasks.workunit.client.0.smithi087.stdout:5/763: read d5/d12/d4d/fbe [3349084,116786] 0 2024-09-17T07:19:58.099 INFO:tasks.workunit.client.0.smithi087.stdout:4/586: truncate d2/d92/d4d/d21/d2f/d6e/fc1 2254308 0 2024-09-17T07:19:58.100 INFO:tasks.workunit.client.0.smithi087.stdout:2/619: creat d2/d7/d60/fc4 x:0 0 0 2024-09-17T07:19:58.101 INFO:tasks.workunit.client.0.smithi087.stdout:5/764: mknod d5/d8/cfb 0 2024-09-17T07:19:58.102 INFO:tasks.workunit.client.0.smithi087.stdout:8/619: getdents d1/d7/d9/d27 0 2024-09-17T07:19:58.102 INFO:tasks.workunit.client.0.smithi087.stdout:4/587: mkdir d2/d22/d2c/d91/dcf 0 2024-09-17T07:19:58.103 INFO:tasks.workunit.client.0.smithi087.stdout:8/620: fdatasync d1/d5f/f5d 0 2024-09-17T07:19:58.103 INFO:tasks.workunit.client.0.smithi087.stdout:2/620: rmdir d2/d50 39 2024-09-17T07:19:58.104 INFO:tasks.workunit.client.0.smithi087.stdout:8/621: fsync d1/d2b/fc6 0 2024-09-17T07:19:58.105 INFO:tasks.workunit.client.0.smithi087.stdout:4/588: chown d2/c88 6326 1 2024-09-17T07:19:58.106 INFO:tasks.workunit.client.0.smithi087.stdout:2/621: creat d2/d7/d33/fc5 x:0 0 0 2024-09-17T07:19:58.107 INFO:tasks.workunit.client.0.smithi087.stdout:2/622: stat d2/d12 0 2024-09-17T07:19:58.108 INFO:tasks.workunit.client.0.smithi087.stdout:8/622: creat d1/d7/fdb x:0 0 0 2024-09-17T07:19:58.109 INFO:tasks.workunit.client.0.smithi087.stdout:2/623: mknod d2/d12/cc6 0 2024-09-17T07:19:58.111 INFO:tasks.workunit.client.0.smithi087.stdout:8/623: mknod d1/d2b/d21/cdc 0 2024-09-17T07:19:58.112 INFO:tasks.workunit.client.0.smithi087.stdout:4/589: dwrite d2/d92/f65 [4194304,4194304] 0 2024-09-17T07:19:58.116 INFO:tasks.workunit.client.0.smithi087.stdout:4/590: truncate d2/d92/d4d/d21/d2f/f47 9094634 0 2024-09-17T07:19:58.116 INFO:tasks.workunit.client.0.smithi087.stdout:8/624: write d1/d7/d9/d19/f4e [386677,2117] 0 2024-09-17T07:19:58.117 INFO:tasks.workunit.client.0.smithi087.stdout:8/625: chown d1/d2b/d21/d6d/f74 1290 1 2024-09-17T07:19:58.121 INFO:tasks.workunit.client.0.smithi087.stdout:8/626: unlink d1/d7/l60 0 2024-09-17T07:19:58.122 INFO:tasks.workunit.client.0.smithi087.stdout:5/765: mknod d5/d8/d1f/d4e/cfc 0 2024-09-17T07:19:58.123 INFO:tasks.workunit.client.0.smithi087.stdout:5/766: chown d5/f1b 0 1 2024-09-17T07:19:58.128 INFO:tasks.workunit.client.0.smithi087.stdout:5/767: creat d5/d8/ffd x:0 0 0 2024-09-17T07:19:58.129 INFO:tasks.workunit.client.0.smithi087.stdout:4/591: write d2/d5/d1f/f20 [1498536,91853] 0 2024-09-17T07:19:58.130 INFO:tasks.workunit.client.0.smithi087.stdout:2/624: dwrite d2/d7/fe [4194304,4194304] 0 2024-09-17T07:19:58.131 INFO:tasks.workunit.client.0.smithi087.stdout:2/625: fsync d2/d7/d60/fb6 0 2024-09-17T07:19:58.133 INFO:tasks.workunit.client.0.smithi087.stdout:2/626: fsync d2/d7/dd/d10/f1d 0 2024-09-17T07:19:58.133 INFO:tasks.workunit.client.0.smithi087.stdout:4/592: creat d2/d22/d62/fd0 x:0 0 0 2024-09-17T07:19:58.135 INFO:tasks.workunit.client.0.smithi087.stdout:2/627: read d2/d7/d33/fa9 [1840335,48594] 0 2024-09-17T07:19:58.136 INFO:tasks.workunit.client.0.smithi087.stdout:5/768: rmdir d5/d18/d6f/de1/d7d/df3 0 2024-09-17T07:19:58.136 INFO:tasks.workunit.client.0.smithi087.stdout:2/628: read d2/d7/d30/f54 [97016,35558] 0 2024-09-17T07:19:58.137 INFO:tasks.workunit.client.0.smithi087.stdout:5/769: read d5/d12/fd1 [2886414,10105] 0 2024-09-17T07:19:58.138 INFO:tasks.workunit.client.0.smithi087.stdout:4/593: creat d2/d22/d2c/d91/fd1 x:0 0 0 2024-09-17T07:19:58.140 INFO:tasks.workunit.client.0.smithi087.stdout:5/770: dread d5/d18/d6f/de1/f8d [0,4194304] 0 2024-09-17T07:19:58.141 INFO:tasks.workunit.client.0.smithi087.stdout:2/629: truncate d2/d7/d30/f54 1258376 0 2024-09-17T07:19:58.142 INFO:tasks.workunit.client.0.smithi087.stdout:5/771: chown d5/l24 9311742 1 2024-09-17T07:19:58.145 INFO:tasks.workunit.client.0.smithi087.stdout:2/630: write d2/d7/d30/d3f/f93 [1219197,105154] 0 2024-09-17T07:19:58.146 INFO:tasks.workunit.client.0.smithi087.stdout:5/772: write d5/d18/d20/d2f/f43 [4747701,117563] 0 2024-09-17T07:19:58.147 INFO:tasks.workunit.client.1.smithi139.stdout:9/838: sync 2024-09-17T07:19:58.147 INFO:tasks.workunit.client.1.smithi139.stdout:2/538: sync 2024-09-17T07:19:58.148 INFO:tasks.workunit.client.0.smithi087.stdout:4/594: dwrite d2/d22/d2c/f28 [4194304,4194304] 0 2024-09-17T07:19:58.149 INFO:tasks.workunit.client.1.smithi139.stdout:2/539: truncate d0/de/df/fb1 752680 0 2024-09-17T07:19:58.150 INFO:tasks.workunit.client.1.smithi139.stdout:9/839: read dc/d11/d8b/dc7/fd5 [1382082,53180] 0 2024-09-17T07:19:58.150 INFO:tasks.workunit.client.1.smithi139.stdout:2/540: chown d0/de/df/d56/fab 448 1 2024-09-17T07:19:58.152 INFO:tasks.workunit.client.0.smithi087.stdout:2/631: dread d2/d7/dd/f79 [0,4194304] 0 2024-09-17T07:19:58.153 INFO:tasks.workunit.client.0.smithi087.stdout:4/595: rmdir d2/d22/d62 39 2024-09-17T07:19:58.154 INFO:tasks.workunit.client.1.smithi139.stdout:9/840: rename dc/d11/d15/d3c/d61/l66 to dc/d11/d15/d3c/d68/l114 0 2024-09-17T07:19:58.156 INFO:tasks.workunit.client.0.smithi087.stdout:8/627: dread d1/d7/d9/d27/fa9 [0,4194304] 0 2024-09-17T07:19:58.157 INFO:tasks.workunit.client.1.smithi139.stdout:9/841: mknod dc/d11/d15/d1e/c115 0 2024-09-17T07:19:58.158 INFO:tasks.workunit.client.0.smithi087.stdout:4/596: creat d2/d92/d4f/fd2 x:0 0 0 2024-09-17T07:19:58.159 INFO:tasks.workunit.client.1.smithi139.stdout:9/842: creat dc/d11/d8b/f116 x:0 0 0 2024-09-17T07:19:58.159 INFO:tasks.workunit.client.0.smithi087.stdout:8/628: chown d1/d7/d9/d19/d1b/d18/fa3 22 1 2024-09-17T07:19:58.160 INFO:tasks.workunit.client.1.smithi139.stdout:9/843: mknod dc/d2c/c117 0 2024-09-17T07:19:58.161 INFO:tasks.workunit.client.0.smithi087.stdout:2/632: dwrite d2/d15/f45 [0,4194304] 0 2024-09-17T07:19:58.161 INFO:tasks.workunit.client.1.smithi139.stdout:9/844: symlink dc/d2a/l118 0 2024-09-17T07:19:58.163 INFO:tasks.workunit.client.0.smithi087.stdout:4/597: rename d2/d92/d4d/f8a to d2/d92/d4d/d21/d2f/d3b/fd3 0 2024-09-17T07:19:58.164 INFO:tasks.workunit.client.1.smithi139.stdout:9/845: link dc/leb dc/d11/d15/l119 0 2024-09-17T07:19:58.172 INFO:tasks.workunit.client.0.smithi087.stdout:4/598: dwrite d2/d92/d4d/d21/f6c [0,4194304] 0 2024-09-17T07:19:58.172 INFO:tasks.workunit.client.0.smithi087.stdout:2/633: link d2/d48/da2/d3a/c5e d2/d7/dd/d10/d91/cc7 0 2024-09-17T07:19:58.177 INFO:tasks.workunit.client.0.smithi087.stdout:2/634: symlink d2/d50/db8/lc8 0 2024-09-17T07:19:58.179 INFO:tasks.workunit.client.0.smithi087.stdout:4/599: link d2/d92/d4d/d3e/f8b d2/d92/d4d/d21/d2f/d3b/fd4 0 2024-09-17T07:19:58.179 INFO:tasks.workunit.client.0.smithi087.stdout:4/600: stat d2/d22/l8e 0 2024-09-17T07:19:58.180 INFO:tasks.workunit.client.0.smithi087.stdout:2/635: unlink d2/d7/db/c8d 0 2024-09-17T07:19:58.182 INFO:tasks.workunit.client.1.smithi139.stdout:9/846: getdents dc/d2c 0 2024-09-17T07:19:58.182 INFO:tasks.workunit.client.0.smithi087.stdout:2/636: mkdir d2/d96/dc9 0 2024-09-17T07:19:58.183 INFO:tasks.workunit.client.1.smithi139.stdout:9/847: write dc/d11/d15/d3c/d61/f101 [4707862,123965] 0 2024-09-17T07:19:58.184 INFO:tasks.workunit.client.0.smithi087.stdout:2/637: stat d2/d12/l80 0 2024-09-17T07:19:58.186 INFO:tasks.workunit.client.1.smithi139.stdout:9/848: mknod dc/d11/d15/d3c/d61/dc8/c11a 0 2024-09-17T07:19:58.186 INFO:tasks.workunit.client.0.smithi087.stdout:4/601: dwrite d2/d92/d4d/d21/f79 [0,4194304] 0 2024-09-17T07:19:58.187 INFO:tasks.workunit.client.1.smithi139.stdout:9/849: dread - dc/d11/ff6 zero size 2024-09-17T07:19:58.188 INFO:tasks.workunit.client.1.smithi139.stdout:7/431: sync 2024-09-17T07:19:58.188 INFO:tasks.workunit.client.1.smithi139.stdout:7/432: readlink d5/d17/l36 0 2024-09-17T07:19:58.189 INFO:tasks.workunit.client.1.smithi139.stdout:7/433: write f2 [9185702,75704] 0 2024-09-17T07:19:58.190 INFO:tasks.workunit.client.0.smithi087.stdout:5/773: dread d5/d12/fd1 [0,4194304] 0 2024-09-17T07:19:58.194 INFO:tasks.workunit.client.1.smithi139.stdout:9/850: dwrite dc/d11/d15/d3c/d61/d64/ff4 [0,4194304] 0 2024-09-17T07:19:58.198 INFO:tasks.workunit.client.0.smithi087.stdout:5/774: dwrite d5/d12/d56/d9e/dcb/ff2 [0,4194304] 0 2024-09-17T07:19:58.200 INFO:tasks.workunit.client.1.smithi139.stdout:9/851: getdents dc/d11/d15/d3c/d68 0 2024-09-17T07:19:58.201 INFO:tasks.workunit.client.0.smithi087.stdout:5/775: mkdir d5/d18/d20/d2f/d60/dfe 0 2024-09-17T07:19:58.204 INFO:tasks.workunit.client.1.smithi139.stdout:7/434: dwrite d5/d10/d4d/f60 [0,4194304] 0 2024-09-17T07:19:58.209 INFO:tasks.workunit.client.0.smithi087.stdout:4/602: dwrite d2/f7 [4194304,4194304] 0 2024-09-17T07:19:58.212 INFO:tasks.workunit.client.1.smithi139.stdout:9/852: dwrite dc/d11/d15/d3c/d61/f110 [0,4194304] 0 2024-09-17T07:19:58.212 INFO:tasks.workunit.client.1.smithi139.stdout:7/435: link d5/c54 d5/d10/d2b/d40/d47/c8b 0 2024-09-17T07:19:58.213 INFO:tasks.workunit.client.1.smithi139.stdout:7/436: fsync d5/d17/f49 0 2024-09-17T07:19:58.213 INFO:tasks.workunit.client.0.smithi087.stdout:4/603: creat d2/d92/d4d/d21/d2f/d3b/d7e/d97/fd5 x:0 0 0 2024-09-17T07:19:58.215 INFO:tasks.workunit.client.1.smithi139.stdout:9/853: creat dc/d2c/f11b x:0 0 0 2024-09-17T07:19:58.217 INFO:tasks.workunit.client.0.smithi087.stdout:4/604: creat d2/d22/d95/fd6 x:0 0 0 2024-09-17T07:19:58.217 INFO:tasks.workunit.client.1.smithi139.stdout:7/437: mkdir d5/d10/d8c 0 2024-09-17T07:19:58.218 INFO:tasks.workunit.client.1.smithi139.stdout:7/438: chown d5/d10/d4d/d59/f5f 56091744 1 2024-09-17T07:19:58.220 INFO:tasks.workunit.client.1.smithi139.stdout:9/854: creat dc/d11/d15/d3c/d61/dc8/d83/f11c x:0 0 0 2024-09-17T07:19:58.220 INFO:tasks.workunit.client.0.smithi087.stdout:4/605: dread d2/d92/d4d/f53 [0,4194304] 0 2024-09-17T07:19:58.220 INFO:tasks.workunit.client.1.smithi139.stdout:7/439: symlink d5/d10/d4d/d59/l8d 0 2024-09-17T07:19:58.221 INFO:tasks.workunit.client.1.smithi139.stdout:9/855: mknod dc/d11/d8b/c11d 0 2024-09-17T07:19:58.225 INFO:tasks.workunit.client.0.smithi087.stdout:4/606: dwrite d2/d92/d4d/d21/f6c [0,4194304] 0 2024-09-17T07:19:58.226 INFO:tasks.workunit.client.1.smithi139.stdout:9/856: truncate dc/d11/d15/d3c/d68/fcb 21618 0 2024-09-17T07:19:58.226 INFO:tasks.workunit.client.0.smithi087.stdout:4/607: fdatasync d2/d92/d4d/d42/db6/fcd 0 2024-09-17T07:19:58.227 INFO:tasks.workunit.client.1.smithi139.stdout:7/440: dwrite d5/f23 [0,4194304] 0 2024-09-17T07:19:58.230 INFO:tasks.workunit.client.1.smithi139.stdout:9/857: rename dc/d11/d15/d1e/d34/cb8 to dc/d2c/c11e 0 2024-09-17T07:19:58.233 INFO:tasks.workunit.client.1.smithi139.stdout:9/858: rename dc/d11/d15/d3c/d61/dc8/d9f/fd9 to dc/d11/d8b/f11f 0 2024-09-17T07:19:58.234 INFO:tasks.workunit.client.0.smithi087.stdout:4/608: dwrite d2/d92/d4f/d6a/d9d/fa4 [0,4194304] 0 2024-09-17T07:19:58.235 INFO:tasks.workunit.client.0.smithi087.stdout:4/609: fdatasync d2/d92/d4d/d42/fac 0 2024-09-17T07:19:58.236 INFO:tasks.workunit.client.1.smithi139.stdout:9/859: rename dc/d11/d15/d3c/d68/c6c to dc/c120 0 2024-09-17T07:19:58.237 INFO:tasks.workunit.client.1.smithi139.stdout:9/860: rmdir dc/d11/d52/d56 39 2024-09-17T07:19:58.240 INFO:tasks.workunit.client.1.smithi139.stdout:9/861: creat dc/d11/d52/d56/d75/f121 x:0 0 0 2024-09-17T07:19:58.243 INFO:tasks.workunit.client.0.smithi087.stdout:4/610: dwrite d2/d92/d4d/d21/d2f/d6e/fc1 [0,4194304] 0 2024-09-17T07:19:58.264 INFO:tasks.workunit.client.0.smithi087.stdout:4/611: write d2/d92/d4d/d21/f8f [782843,34522] 0 2024-09-17T07:19:58.266 INFO:tasks.workunit.client.0.smithi087.stdout:4/612: creat d2/d22/fd7 x:0 0 0 2024-09-17T07:19:58.273 INFO:tasks.workunit.client.1.smithi139.stdout:9/862: dwrite dc/d11/d15/d3c/d68/fcb [0,4194304] 0 2024-09-17T07:19:58.278 INFO:tasks.workunit.client.1.smithi139.stdout:9/863: rename dc/d11/d15/d3c/d61/dc8 to dc/d11/d52/d56/d7a/df7/d122 0 2024-09-17T07:19:58.330 INFO:tasks.workunit.client.0.smithi087.stdout:4/613: write d2/d22/d2c/f28 [1585204,108064] 0 2024-09-17T07:19:58.335 INFO:tasks.workunit.client.0.smithi087.stdout:4/614: rename d2/d22/d2c/f28 to d2/d92/d86/fd8 0 2024-09-17T07:19:58.337 INFO:tasks.workunit.client.0.smithi087.stdout:4/615: fdatasync d2/d92/d4d/fd 0 2024-09-17T07:19:58.338 INFO:tasks.workunit.client.0.smithi087.stdout:4/616: write d2/d22/d2c/d91/fd1 [919047,89536] 0 2024-09-17T07:19:58.350 INFO:tasks.workunit.client.0.smithi087.stdout:4/617: dwrite d2/d92/d4d/d21/d2f/d3b/f56 [0,4194304] 0 2024-09-17T07:19:58.351 INFO:tasks.workunit.client.0.smithi087.stdout:4/618: fsync d2/d22/fd7 0 2024-09-17T07:19:58.352 INFO:tasks.workunit.client.1.smithi139.stdout:0/375: sync 2024-09-17T07:19:58.352 INFO:tasks.workunit.client.1.smithi139.stdout:8/656: sync 2024-09-17T07:19:58.352 INFO:tasks.workunit.client.1.smithi139.stdout:4/459: sync 2024-09-17T07:19:58.352 INFO:tasks.workunit.client.1.smithi139.stdout:1/356: sync 2024-09-17T07:19:58.352 INFO:tasks.workunit.client.1.smithi139.stdout:6/582: sync 2024-09-17T07:19:58.352 INFO:tasks.workunit.client.1.smithi139.stdout:5/534: sync 2024-09-17T07:19:58.352 INFO:tasks.workunit.client.1.smithi139.stdout:3/449: sync 2024-09-17T07:19:58.353 INFO:tasks.workunit.client.1.smithi139.stdout:8/657: fdatasync d0/fb5 0 2024-09-17T07:19:58.355 INFO:tasks.workunit.client.1.smithi139.stdout:5/535: unlink d4/f7b 0 2024-09-17T07:19:58.355 INFO:tasks.workunit.client.1.smithi139.stdout:8/658: fsync d0/d1a/d3a/f47 0 2024-09-17T07:19:58.356 INFO:tasks.workunit.client.1.smithi139.stdout:4/460: creat d0/db/d58/f91 x:0 0 0 2024-09-17T07:19:58.357 INFO:tasks.workunit.client.1.smithi139.stdout:8/659: write d0/d1a/d3a/f7c [630850,49569] 0 2024-09-17T07:19:58.358 INFO:tasks.workunit.client.1.smithi139.stdout:6/583: rename db/df/d4c/l59 to db/d18/lc0 0 2024-09-17T07:19:58.359 INFO:tasks.workunit.client.1.smithi139.stdout:3/450: creat d5/d15/d16/d4c/d28/d54/d58/f8f x:0 0 0 2024-09-17T07:19:58.360 INFO:tasks.workunit.client.1.smithi139.stdout:4/461: truncate d0/d37/f87 995234 0 2024-09-17T07:19:58.363 INFO:tasks.workunit.client.1.smithi139.stdout:5/536: write d4/f36 [4229494,50522] 0 2024-09-17T07:19:58.363 INFO:tasks.workunit.client.1.smithi139.stdout:1/357: dwrite d2/d10/d12/d35/f44 [0,4194304] 0 2024-09-17T07:19:58.364 INFO:tasks.workunit.client.1.smithi139.stdout:0/376: mkdir d1/da/d1b/d3d/d5a/d75/d91/d92 0 2024-09-17T07:19:58.365 INFO:tasks.workunit.client.1.smithi139.stdout:4/462: truncate d0/db/d58/f7e 132200 0 2024-09-17T07:19:58.365 INFO:tasks.workunit.client.1.smithi139.stdout:3/451: rmdir d5 39 2024-09-17T07:19:58.366 INFO:tasks.workunit.client.0.smithi087.stdout:4/619: mkdir d2/d92/d4d/d42/db6/dd9 0 2024-09-17T07:19:58.366 INFO:tasks.workunit.client.1.smithi139.stdout:6/584: dread db/df/d4e/d5e/fa8 [0,4194304] 0 2024-09-17T07:19:58.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:57 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:19:58.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:57 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:19:58.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:19:57 smithi139 ceph-mon[34403]: pgmap v12: 65 pgs: 65 active+clean; 2.1 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 67 MiB/s rd, 297 MiB/s wr, 566 op/s 2024-09-17T07:19:58.370 INFO:tasks.workunit.client.1.smithi139.stdout:5/537: unlink d4/d16/d1b/d20/d32/l40 0 2024-09-17T07:19:58.372 INFO:tasks.workunit.client.1.smithi139.stdout:1/358: dread d2/d10/d12/d35/d2b/f2c [0,4194304] 0 2024-09-17T07:19:58.372 INFO:tasks.workunit.client.1.smithi139.stdout:0/377: read d1/da/d1b/d3d/d5a/d75/f77 [1496984,93209] 0 2024-09-17T07:19:58.373 INFO:tasks.workunit.client.1.smithi139.stdout:4/463: unlink d0/d37/d5f/d83/f3c 0 2024-09-17T07:19:58.373 INFO:tasks.workunit.client.0.smithi087.stdout:4/620: dwrite d2/d92/d86/fbe [0,4194304] 0 2024-09-17T07:19:58.374 INFO:tasks.workunit.client.1.smithi139.stdout:8/660: getdents d0/d20/d28/d52/d65/d7f 0 2024-09-17T07:19:58.375 INFO:tasks.workunit.client.0.smithi087.stdout:4/621: fsync d2/d92/d4f/d6a/d9d/fbd 0 2024-09-17T07:19:58.381 INFO:tasks.workunit.client.1.smithi139.stdout:1/359: chown d2/d10/d12/d24/d38/d3d/f4d 898 1 2024-09-17T07:19:58.382 INFO:tasks.workunit.client.0.smithi087.stdout:4/622: write d2/d92/d4d/f53 [705221,81325] 0 2024-09-17T07:19:58.384 INFO:tasks.workunit.client.1.smithi139.stdout:4/464: write d0/db/d58/f91 [811990,26966] 0 2024-09-17T07:19:58.384 INFO:tasks.workunit.client.1.smithi139.stdout:6/585: fsync db/df/d73/d81/f67 0 2024-09-17T07:19:58.385 INFO:tasks.workunit.client.1.smithi139.stdout:0/378: read d1/da/d1b/d32/f35 [165612,48419] 0 2024-09-17T07:19:58.389 INFO:tasks.workunit.client.0.smithi087.stdout:4/623: write d2/d92/d4d/d21/d2f/d3b/fd4 [398359,39003] 0 2024-09-17T07:19:58.391 INFO:tasks.workunit.client.0.smithi087.stdout:4/624: getdents d2/d22/d2c/d91/dcf 0 2024-09-17T07:19:58.392 INFO:tasks.workunit.client.1.smithi139.stdout:1/360: dread d2/f11 [0,4194304] 0 2024-09-17T07:19:58.393 INFO:tasks.workunit.client.0.smithi087.stdout:4/625: dread d2/d92/d4d/d21/d2f/d3b/d7e/d97/fa6 [0,4194304] 0 2024-09-17T07:19:58.394 INFO:tasks.workunit.client.1.smithi139.stdout:8/661: dwrite d0/d1a/d3a/d71/fa5 [0,4194304] 0 2024-09-17T07:19:58.395 INFO:tasks.workunit.client.0.smithi087.stdout:4/626: creat d2/d92/fda x:0 0 0 2024-09-17T07:19:58.396 INFO:tasks.workunit.client.0.smithi087.stdout:4/627: creat d2/d92/d74/fdb x:0 0 0 2024-09-17T07:19:58.400 INFO:tasks.workunit.client.1.smithi139.stdout:4/465: dread d0/f30 [0,4194304] 0 2024-09-17T07:19:58.402 INFO:tasks.workunit.client.1.smithi139.stdout:4/466: write d0/db/d58/f5e [516271,54081] 0 2024-09-17T07:19:58.403 INFO:tasks.workunit.client.1.smithi139.stdout:4/467: readlink d0/d1a/l6f 0 2024-09-17T07:19:58.404 INFO:tasks.workunit.client.1.smithi139.stdout:4/468: read - d0/d1/d29/d41/f63 zero size 2024-09-17T07:19:58.408 INFO:tasks.workunit.client.1.smithi139.stdout:0/379: mkdir d1/da/d1b/d3d/d5a/d75/d93 0 2024-09-17T07:19:58.409 INFO:tasks.workunit.client.0.smithi087.stdout:4/628: dwrite d2/d92/d4d/d21/f70 [0,4194304] 0 2024-09-17T07:19:58.410 INFO:tasks.workunit.client.1.smithi139.stdout:1/361: mkdir d2/d10/d12/d35/d2b/d77 0 2024-09-17T07:19:58.410 INFO:tasks.workunit.client.1.smithi139.stdout:8/662: symlink d0/d20/d28/d52/d65/d7f/db6/d18/ld7 0 2024-09-17T07:19:58.411 INFO:tasks.workunit.client.1.smithi139.stdout:4/469: mkdir d0/d37/d5f/d92 0 2024-09-17T07:19:58.412 INFO:tasks.workunit.client.0.smithi087.stdout:4/629: unlink d2/d92/d4d/d21/d2f/d3b/d7e/fa1 0 2024-09-17T07:19:58.414 INFO:tasks.workunit.client.1.smithi139.stdout:5/538: mkdir d4/d16/d1b/d20/d28/da8 0 2024-09-17T07:19:58.414 INFO:tasks.workunit.client.1.smithi139.stdout:4/470: write d0/db/f74 [2275611,3111] 0 2024-09-17T07:19:58.419 INFO:tasks.workunit.client.1.smithi139.stdout:5/539: readlink d4/d16/d1b/d20/d32/d72/l9d 0 2024-09-17T07:19:58.419 INFO:tasks.workunit.client.1.smithi139.stdout:6/586: mkdir db/df/d73/dc1 0 2024-09-17T07:19:58.421 INFO:tasks.workunit.client.1.smithi139.stdout:8/663: symlink d0/d1a/d3a/d71/ld8 0 2024-09-17T07:19:58.421 INFO:tasks.workunit.client.1.smithi139.stdout:4/471: mkdir d0/d1/d54/d93 0 2024-09-17T07:19:58.421 INFO:tasks.workunit.client.1.smithi139.stdout:4/472: chown d0/d10/f53 0 1 2024-09-17T07:19:58.421 INFO:tasks.workunit.client.0.smithi087.stdout:4/630: write d2/d92/d4d/fd [536153,33781] 0 2024-09-17T07:19:58.422 INFO:tasks.workunit.client.0.smithi087.stdout:4/631: stat d2/d92/d86 0 2024-09-17T07:19:58.422 INFO:tasks.workunit.client.1.smithi139.stdout:0/380: dread d1/da/d2a/f51 [0,4194304] 0 2024-09-17T07:19:58.423 INFO:tasks.workunit.client.1.smithi139.stdout:6/587: write db/df/f84 [2435853,80661] 0 2024-09-17T07:19:58.423 INFO:tasks.workunit.client.0.smithi087.stdout:4/632: stat d2/d5/d1f/c46 0 2024-09-17T07:19:58.425 INFO:tasks.workunit.client.1.smithi139.stdout:0/381: chown d1/da/d17/d72/d66 8499 1 2024-09-17T07:19:58.425 INFO:tasks.workunit.client.0.smithi087.stdout:4/633: creat d2/d92/d4d/d42/db6/dd9/fdc x:0 0 0 2024-09-17T07:19:58.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:57 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:19:58.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:57 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:19:58.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:19:57 smithi087 ceph-mon[27636]: pgmap v12: 65 pgs: 65 active+clean; 2.1 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 67 MiB/s rd, 297 MiB/s wr, 566 op/s 2024-09-17T07:19:58.426 INFO:tasks.workunit.client.0.smithi087.stdout:4/634: rename d2/d92 to d2/d92/d74/ddd 22 2024-09-17T07:19:58.426 INFO:tasks.workunit.client.0.smithi087.stdout:4/635: stat d2/d92/d4d/d21/f79 0 2024-09-17T07:19:58.427 INFO:tasks.workunit.client.1.smithi139.stdout:0/382: chown d1/da/d2a/l54 82 1 2024-09-17T07:19:58.430 INFO:tasks.workunit.client.1.smithi139.stdout:0/383: write d1/da/d1b/d32/f7a [4891228,91331] 0 2024-09-17T07:19:58.432 INFO:tasks.workunit.client.1.smithi139.stdout:4/473: dwrite d0/d1/d29/d6d/f86 [0,4194304] 0 2024-09-17T07:19:58.434 INFO:tasks.workunit.client.1.smithi139.stdout:0/384: mknod d1/d58/d7d/c94 0 2024-09-17T07:19:58.437 INFO:tasks.workunit.client.1.smithi139.stdout:4/474: creat d0/db/d7f/f94 x:0 0 0 2024-09-17T07:19:58.437 INFO:tasks.workunit.client.1.smithi139.stdout:2/541: sync 2024-09-17T07:19:58.439 INFO:tasks.workunit.client.1.smithi139.stdout:0/385: rename d1/da/d2a/f51 to d1/da/d1b/d3d/f95 0 2024-09-17T07:19:58.443 INFO:tasks.workunit.client.1.smithi139.stdout:0/386: creat d1/da/d1b/d3d/d50/f96 x:0 0 0 2024-09-17T07:19:58.443 INFO:tasks.workunit.client.1.smithi139.stdout:0/387: readlink d1/d58/l71 0 2024-09-17T07:19:58.445 INFO:tasks.workunit.client.1.smithi139.stdout:2/542: creat d0/d7/d67/da1/da7/fb2 x:0 0 0 2024-09-17T07:19:58.446 INFO:tasks.workunit.client.1.smithi139.stdout:0/388: symlink d1/da/d1b/d3d/d50/l97 0 2024-09-17T07:19:58.446 INFO:tasks.workunit.client.1.smithi139.stdout:0/389: stat d1/f7c 0 2024-09-17T07:19:58.449 INFO:tasks.workunit.client.1.smithi139.stdout:0/390: fsync d1/da/d1b/d32/f35 0 2024-09-17T07:19:58.450 INFO:tasks.workunit.client.1.smithi139.stdout:0/391: dread - d1/da/d1b/d3d/d50/f96 zero size 2024-09-17T07:19:58.452 INFO:tasks.workunit.client.1.smithi139.stdout:0/392: mkdir d1/da/d1b/d3d/d5a/d98 0 2024-09-17T07:19:58.455 INFO:tasks.workunit.client.1.smithi139.stdout:5/540: dread d4/d16/d1b/d20/d28/f53 [4194304,4194304] 0 2024-09-17T07:19:58.455 INFO:tasks.workunit.client.1.smithi139.stdout:0/393: fsync d1/da/d1b/d3d/d5a/d75/f77 0 2024-09-17T07:19:58.457 INFO:tasks.workunit.client.1.smithi139.stdout:5/541: write d4/d16/d1b/d20/d67/f6a [694151,50578] 0 2024-09-17T07:19:58.457 INFO:tasks.workunit.client.1.smithi139.stdout:1/362: write d2/d10/d12/d1a/f21 [1378661,63224] 0 2024-09-17T07:19:58.458 INFO:tasks.workunit.client.1.smithi139.stdout:6/588: truncate f7 2875693 0 2024-09-17T07:19:58.460 INFO:tasks.workunit.client.1.smithi139.stdout:5/542: write d4/d16/d1b/d20/d38/d4f/f89 [233000,89986] 0 2024-09-17T07:19:58.461 INFO:tasks.workunit.client.1.smithi139.stdout:1/363: readlink d2/d10/d12/d1a/d61/l66 0 2024-09-17T07:19:58.461 INFO:tasks.workunit.client.1.smithi139.stdout:4/475: write d0/d37/d5f/d83/f8e [352078,78896] 0 2024-09-17T07:19:58.463 INFO:tasks.workunit.client.1.smithi139.stdout:6/589: mkdir db/d18/d38/d60/dc2 0 2024-09-17T07:19:58.463 INFO:tasks.workunit.client.1.smithi139.stdout:5/543: dread - d4/d16/d1b/d20/d67/d88/f99 zero size 2024-09-17T07:19:58.464 INFO:tasks.workunit.client.1.smithi139.stdout:4/476: stat d0/d1/c27 0 2024-09-17T07:19:58.466 INFO:tasks.workunit.client.1.smithi139.stdout:4/477: stat d0/d1/d29/c89 0 2024-09-17T07:19:58.467 INFO:tasks.workunit.client.1.smithi139.stdout:2/543: truncate d0/d7/d1a/f1e 1164716 0 2024-09-17T07:19:58.468 INFO:tasks.workunit.client.1.smithi139.stdout:5/544: readlink d4/d16/d1b/l7f 0 2024-09-17T07:19:58.469 INFO:tasks.workunit.client.1.smithi139.stdout:4/478: write d0/d1/d29/d41/f67 [698425,79307] 0 2024-09-17T07:19:58.469 INFO:tasks.workunit.client.1.smithi139.stdout:6/590: mknod db/d18/d38/d60/cc3 0 2024-09-17T07:19:58.471 INFO:tasks.workunit.client.1.smithi139.stdout:2/544: truncate d0/d4e/f6c 1098260 0 2024-09-17T07:19:58.471 INFO:tasks.workunit.client.1.smithi139.stdout:1/364: dwrite d2/f46 [0,4194304] 0 2024-09-17T07:19:58.472 INFO:tasks.workunit.client.1.smithi139.stdout:4/479: creat d0/d1a/f95 x:0 0 0 2024-09-17T07:19:58.475 INFO:tasks.workunit.client.1.smithi139.stdout:4/480: chown d0/d1/d29/d41/c84 40512239 1 2024-09-17T07:19:58.478 INFO:tasks.workunit.client.1.smithi139.stdout:1/365: mknod d2/d10/d12/d35/d49/c78 0 2024-09-17T07:19:58.478 INFO:tasks.workunit.client.1.smithi139.stdout:5/545: dread d4/f5b [0,4194304] 0 2024-09-17T07:19:58.478 INFO:tasks.workunit.client.1.smithi139.stdout:0/394: truncate d1/da/d1b/d32/f47 3838872 0 2024-09-17T07:19:58.479 INFO:tasks.workunit.client.1.smithi139.stdout:1/366: dread - d2/d10/d12/d1a/f6d zero size 2024-09-17T07:19:58.480 INFO:tasks.workunit.client.1.smithi139.stdout:2/545: readlink d0/d7/d67/d92/d99/l38 0 2024-09-17T07:19:58.481 INFO:tasks.workunit.client.1.smithi139.stdout:0/395: write d1/da/d2a/f38 [5101083,7731] 0 2024-09-17T07:19:58.484 INFO:tasks.workunit.client.1.smithi139.stdout:5/546: symlink d4/d16/d1b/d20/d67/d88/la9 0 2024-09-17T07:19:58.485 INFO:tasks.workunit.client.1.smithi139.stdout:4/481: link d0/d1/d54/f5b d0/d37/d5f/d83/f96 0 2024-09-17T07:19:58.486 INFO:tasks.workunit.client.1.smithi139.stdout:4/482: fdatasync d0/d1a/f60 0 2024-09-17T07:19:58.488 INFO:tasks.workunit.client.1.smithi139.stdout:4/483: write d0/db/d7f/f94 [303771,128296] 0 2024-09-17T07:19:58.488 INFO:tasks.workunit.client.1.smithi139.stdout:0/396: symlink d1/da/d1b/d3d/l99 0 2024-09-17T07:19:58.491 INFO:tasks.workunit.client.1.smithi139.stdout:5/547: chown d4/d16/d1b/f66 1 1 2024-09-17T07:19:58.495 INFO:tasks.workunit.client.1.smithi139.stdout:6/591: dread db/d18/d38/d60/f94 [0,4194304] 0 2024-09-17T07:19:58.497 INFO:tasks.workunit.client.1.smithi139.stdout:0/397: mkdir d1/da/d1b/d32/d9a 0 2024-09-17T07:19:58.498 INFO:tasks.workunit.client.1.smithi139.stdout:0/398: truncate d1/da/d2a/f80 1237879 0 2024-09-17T07:19:58.499 INFO:tasks.workunit.client.1.smithi139.stdout:0/399: chown d1/da/l6d 580 1 2024-09-17T07:19:58.501 INFO:tasks.workunit.client.1.smithi139.stdout:4/484: link d0/db/f35 d0/d1/d54/f97 0 2024-09-17T07:19:58.503 INFO:tasks.workunit.client.1.smithi139.stdout:5/548: link d4/d16/d1b/d20/f56 d4/d16/d1b/d20/faa 0 2024-09-17T07:19:58.504 INFO:tasks.workunit.client.1.smithi139.stdout:4/485: chown d0/d10/f25 11114 1 2024-09-17T07:19:58.504 INFO:tasks.workunit.client.1.smithi139.stdout:6/592: creat db/df/d4e/d64/d83/d9d/fc4 x:0 0 0 2024-09-17T07:19:58.505 INFO:tasks.workunit.client.1.smithi139.stdout:1/367: truncate d2/d10/d12/d35/f44 3519760 0 2024-09-17T07:19:58.507 INFO:tasks.workunit.client.1.smithi139.stdout:4/486: write d0/d1a/f95 [847694,36647] 0 2024-09-17T07:19:58.507 INFO:tasks.workunit.client.1.smithi139.stdout:0/400: getdents d1/da/d1b/d3d/d5a/d75/d91 0 2024-09-17T07:19:58.508 INFO:tasks.workunit.client.1.smithi139.stdout:2/546: dwrite d0/d4e/fa8 [4194304,4194304] 0 2024-09-17T07:19:58.508 INFO:tasks.workunit.client.1.smithi139.stdout:6/593: write db/df/d4c/fad [524887,74284] 0 2024-09-17T07:19:58.514 INFO:tasks.workunit.client.1.smithi139.stdout:0/401: write d1/f7c [1825,102721] 0 2024-09-17T07:19:58.515 INFO:tasks.workunit.client.1.smithi139.stdout:4/487: rename d0/c46 to d0/db/d58/c98 0 2024-09-17T07:19:58.515 INFO:tasks.workunit.client.1.smithi139.stdout:5/549: dwrite d4/d16/d1b/f8f [0,4194304] 0 2024-09-17T07:19:58.520 INFO:tasks.workunit.client.1.smithi139.stdout:4/488: symlink d0/d1/l99 0 2024-09-17T07:19:58.521 INFO:tasks.workunit.client.1.smithi139.stdout:5/550: mknod d4/d16/d1b/d20/d28/d61/cab 0 2024-09-17T07:19:58.521 INFO:tasks.workunit.client.1.smithi139.stdout:4/489: dread - d0/d1/d29/d41/f63 zero size 2024-09-17T07:19:58.523 INFO:tasks.workunit.client.1.smithi139.stdout:4/490: write d0/db/d17/f2d [1334662,36386] 0 2024-09-17T07:19:58.525 INFO:tasks.workunit.client.1.smithi139.stdout:5/551: rmdir d4/d16/d1b/d20/d38/d4f 39 2024-09-17T07:19:58.527 INFO:tasks.workunit.client.1.smithi139.stdout:4/491: creat d0/db/d58/f9a x:0 0 0 2024-09-17T07:19:58.527 INFO:tasks.workunit.client.1.smithi139.stdout:4/492: readlink d0/d1a/l6f 0 2024-09-17T07:19:58.528 INFO:tasks.workunit.client.1.smithi139.stdout:5/552: symlink d4/d16/d1b/lac 0 2024-09-17T07:19:58.532 INFO:tasks.workunit.client.1.smithi139.stdout:5/553: rmdir d4/d16/d1b/d20/d67/d88 39 2024-09-17T07:19:58.532 INFO:tasks.workunit.client.1.smithi139.stdout:5/554: chown d4/d16/d1b/d20/d32/l5a 277 1 2024-09-17T07:19:58.534 INFO:tasks.workunit.client.1.smithi139.stdout:4/493: rename d0/d37/d5f to d0/d1/d9b 0 2024-09-17T07:19:58.535 INFO:tasks.workunit.client.1.smithi139.stdout:5/555: write d4/d16/d1b/d20/d28/f26 [1019453,36228] 0 2024-09-17T07:19:58.537 INFO:tasks.workunit.client.1.smithi139.stdout:5/556: write d4/d16/d1b/d20/d67/f6a [3659699,52276] 0 2024-09-17T07:19:58.540 INFO:tasks.workunit.client.1.smithi139.stdout:5/557: fdatasync d4/d16/d1b/f39 0 2024-09-17T07:19:58.541 INFO:tasks.workunit.client.1.smithi139.stdout:0/402: write d1/da/d1b/d32/f7a [2121301,72958] 0 2024-09-17T07:19:58.542 INFO:tasks.workunit.client.1.smithi139.stdout:2/547: dread d0/d3b/f42 [0,4194304] 0 2024-09-17T07:19:58.544 INFO:tasks.workunit.client.1.smithi139.stdout:4/494: dread d0/db/f1c [0,4194304] 0 2024-09-17T07:19:58.545 INFO:tasks.workunit.client.1.smithi139.stdout:4/495: fdatasync d0/d1/d29/d6d/f86 0 2024-09-17T07:19:58.545 INFO:tasks.workunit.client.1.smithi139.stdout:5/558: truncate d4/d16/d1b/d20/d32/d76/f84 405825 0 2024-09-17T07:19:58.546 INFO:tasks.workunit.client.1.smithi139.stdout:0/403: symlink d1/da/d1b/d3d/d5a/d75/d93/l9b 0 2024-09-17T07:19:58.548 INFO:tasks.workunit.client.1.smithi139.stdout:0/404: write d1/da/d1b/d32/f37 [3859892,120531] 0 2024-09-17T07:19:58.549 INFO:tasks.workunit.client.1.smithi139.stdout:4/496: rename d0/d37/f87 to d0/d37/f9c 0 2024-09-17T07:19:58.552 INFO:tasks.workunit.client.1.smithi139.stdout:4/497: mknod d0/d1a/d70/c9d 0 2024-09-17T07:19:58.553 INFO:tasks.workunit.client.1.smithi139.stdout:0/405: mknod d1/da/c9c 0 2024-09-17T07:19:58.554 INFO:tasks.workunit.client.1.smithi139.stdout:2/548: dwrite d0/f6 [4194304,4194304] 0 2024-09-17T07:19:58.555 INFO:tasks.workunit.client.1.smithi139.stdout:5/559: getdents d4/d16/d1b 0 2024-09-17T07:19:58.559 INFO:tasks.workunit.client.1.smithi139.stdout:2/549: unlink d0/dc/d3a/l53 0 2024-09-17T07:19:58.560 INFO:tasks.workunit.client.1.smithi139.stdout:4/498: dread d0/d1/d29/d6d/f86 [0,4194304] 0 2024-09-17T07:19:58.563 INFO:tasks.workunit.client.1.smithi139.stdout:5/560: creat d4/d16/d1b/d20/d67/d88/fad x:0 0 0 2024-09-17T07:19:58.570 INFO:tasks.workunit.client.1.smithi139.stdout:5/561: dwrite d4/d16/d1b/d20/d28/f83 [0,4194304] 0 2024-09-17T07:19:58.573 INFO:tasks.workunit.client.1.smithi139.stdout:5/562: rmdir d4/d16/d1b/d20/d28/da8 0 2024-09-17T07:19:58.575 INFO:tasks.workunit.client.0.smithi087.stdout:0/851: sync 2024-09-17T07:19:58.581 INFO:tasks.workunit.client.1.smithi139.stdout:0/406: dread d1/da/d1b/d32/f47 [0,4194304] 0 2024-09-17T07:19:58.581 INFO:tasks.workunit.client.1.smithi139.stdout:2/550: dread d0/f6 [0,4194304] 0 2024-09-17T07:19:58.585 INFO:tasks.workunit.client.1.smithi139.stdout:0/407: dread d1/da/d1b/d3d/f95 [0,4194304] 0 2024-09-17T07:19:58.587 INFO:tasks.workunit.client.1.smithi139.stdout:0/408: chown d1/da/d1b/d32/c56 1 1 2024-09-17T07:19:58.587 INFO:tasks.workunit.client.1.smithi139.stdout:0/409: fdatasync d1/da/d1b/f33 0 2024-09-17T07:19:58.588 INFO:tasks.workunit.client.0.smithi087.stdout:0/852: write db/f42 [857703,129677] 0 2024-09-17T07:19:58.593 INFO:tasks.workunit.client.1.smithi139.stdout:0/410: getdents d1/da/d1b/d32 0 2024-09-17T07:19:58.594 INFO:tasks.workunit.client.0.smithi087.stdout:0/853: dwrite db/d45/d7b/f9d [0,4194304] 0 2024-09-17T07:19:58.598 INFO:tasks.workunit.client.1.smithi139.stdout:0/411: link d1/da/d17/d65/f85 d1/da/d1b/d32/d9a/f9d 0 2024-09-17T07:19:58.599 INFO:tasks.workunit.client.1.smithi139.stdout:5/563: dread d4/d16/d1b/d20/d28/f3e [0,4194304] 0 2024-09-17T07:19:58.600 INFO:tasks.workunit.client.1.smithi139.stdout:0/412: write d1/da/d17/d72/f22 [1307741,92424] 0 2024-09-17T07:19:58.601 INFO:tasks.workunit.client.1.smithi139.stdout:0/413: chown d1/da/d17/d65/l84 11616217 1 2024-09-17T07:19:58.611 INFO:tasks.workunit.client.0.smithi087.stdout:0/854: dread db/f54 [0,4194304] 0 2024-09-17T07:19:58.611 INFO:tasks.workunit.client.1.smithi139.stdout:2/551: dread d0/d7/d67/d92/d99/f72 [4194304,4194304] 0 2024-09-17T07:19:58.612 INFO:tasks.workunit.client.1.smithi139.stdout:2/552: readlink d0/d7/d86/da4/l85 0 2024-09-17T07:19:58.612 INFO:tasks.workunit.client.1.smithi139.stdout:5/564: write d4/d16/d1b/f39 [2451230,29909] 0 2024-09-17T07:19:58.613 INFO:tasks.workunit.client.1.smithi139.stdout:2/553: dread - d0/de/df/d56/fab zero size 2024-09-17T07:19:58.616 INFO:tasks.workunit.client.1.smithi139.stdout:2/554: creat d0/de/df/d56/fb3 x:0 0 0 2024-09-17T07:19:58.617 INFO:tasks.workunit.client.1.smithi139.stdout:0/414: dwrite d1/da/d1b/d3d/d50/f55 [0,4194304] 0 2024-09-17T07:19:58.619 INFO:tasks.workunit.client.1.smithi139.stdout:5/565: rename d4/d16/d1b/d20/d38/d4f/f89 to d4/d16/d1b/d20/d32/d72/fae 0 2024-09-17T07:19:58.622 INFO:tasks.workunit.client.1.smithi139.stdout:5/566: write d4/d16/d1b/d20/d38/f68 [208653,172] 0 2024-09-17T07:19:58.622 INFO:tasks.workunit.client.0.smithi087.stdout:0/855: dread db/f59 [0,4194304] 0 2024-09-17T07:19:58.624 INFO:tasks.workunit.client.0.smithi087.stdout:0/856: readlink db/l30 0 2024-09-17T07:19:58.624 INFO:tasks.workunit.client.1.smithi139.stdout:5/567: write d4/d16/d1b/f8f [2218903,42613] 0 2024-09-17T07:19:58.626 INFO:tasks.workunit.client.1.smithi139.stdout:2/555: dwrite d0/fae [0,4194304] 0 2024-09-17T07:19:58.630 INFO:tasks.workunit.client.1.smithi139.stdout:2/556: link d0/de/df/l16 d0/d7/d67/da1/da7/lb4 0 2024-09-17T07:19:58.630 INFO:tasks.workunit.client.0.smithi087.stdout:0/857: dwrite db/f59 [0,4194304] 0 2024-09-17T07:19:58.631 INFO:tasks.workunit.client.0.smithi087.stdout:1/512: sync 2024-09-17T07:19:58.632 INFO:tasks.workunit.client.0.smithi087.stdout:0/858: write db/d45/d7b/d90/f122 [889390,70815] 0 2024-09-17T07:19:58.633 INFO:tasks.workunit.client.1.smithi139.stdout:2/557: mknod d0/d7/d86/da4/d28/cb5 0 2024-09-17T07:19:58.633 INFO:tasks.workunit.client.0.smithi087.stdout:0/859: read db/fcb [662058,4421] 0 2024-09-17T07:19:58.636 INFO:tasks.workunit.client.1.smithi139.stdout:5/568: dwrite d4/d16/d1b/d20/d28/f82 [0,4194304] 0 2024-09-17T07:19:58.636 INFO:tasks.workunit.client.0.smithi087.stdout:1/513: unlink d2/d3d/d35/c4e 0 2024-09-17T07:19:58.638 INFO:tasks.workunit.client.1.smithi139.stdout:2/558: unlink d0/f3 0 2024-09-17T07:19:58.639 INFO:tasks.workunit.client.1.smithi139.stdout:0/415: truncate d1/f26 2076546 0 2024-09-17T07:19:58.640 INFO:tasks.workunit.client.0.smithi087.stdout:1/514: mknod d2/d1a/cb3 0 2024-09-17T07:19:58.641 INFO:tasks.workunit.client.1.smithi139.stdout:0/416: chown d1/da/d1b/d3d/f95 32855185 1 2024-09-17T07:19:58.642 INFO:tasks.workunit.client.0.smithi087.stdout:0/860: dwrite db/d45/d9e/d86/dd5/fe1 [0,4194304] 0 2024-09-17T07:19:58.644 INFO:tasks.workunit.client.1.smithi139.stdout:5/569: mknod d4/d16/d1b/d20/d67/d88/d9f/caf 0 2024-09-17T07:19:58.646 INFO:tasks.workunit.client.0.smithi087.stdout:0/861: rename db/f1a to db/d4f/f12d 0 2024-09-17T07:19:58.648 INFO:tasks.workunit.client.1.smithi139.stdout:0/417: creat d1/da/d17/d65/d8b/f9e x:0 0 0 2024-09-17T07:19:58.649 INFO:tasks.workunit.client.1.smithi139.stdout:0/418: stat d1/da/l90 0 2024-09-17T07:19:58.649 INFO:tasks.workunit.client.0.smithi087.stdout:0/862: symlink db/d45/d5b/d92/de8/l12e 0 2024-09-17T07:19:58.649 INFO:tasks.workunit.client.1.smithi139.stdout:2/559: creat d0/d7/d1a/fb6 x:0 0 0 2024-09-17T07:19:58.651 INFO:tasks.workunit.client.0.smithi087.stdout:1/515: dread d2/d1a/f34 [0,4194304] 0 2024-09-17T07:19:58.652 INFO:tasks.workunit.client.1.smithi139.stdout:0/419: creat d1/da/d17/f9f x:0 0 0 2024-09-17T07:19:58.652 INFO:tasks.workunit.client.0.smithi087.stdout:1/516: truncate d2/d48/f9b 393045 0 2024-09-17T07:19:58.652 INFO:tasks.workunit.client.0.smithi087.stdout:0/863: read db/d45/f4b [831598,126707] 0 2024-09-17T07:19:58.653 INFO:tasks.workunit.client.0.smithi087.stdout:1/517: fsync d2/d3d/d45/d90/d37/f8b 0 2024-09-17T07:19:58.654 INFO:tasks.workunit.client.1.smithi139.stdout:5/570: dwrite d4/d16/d1b/d20/d28/f83 [0,4194304] 0 2024-09-17T07:19:58.655 INFO:tasks.workunit.client.0.smithi087.stdout:1/518: dread - d2/d3d/d35/d57/d73/f8a zero size 2024-09-17T07:19:58.655 INFO:tasks.workunit.client.1.smithi139.stdout:2/560: read d0/d7/d67/d92/d99/f4f [2866001,88907] 0 2024-09-17T07:19:58.656 INFO:tasks.workunit.client.0.smithi087.stdout:1/519: rmdir d2/d14/da3 39 2024-09-17T07:19:58.657 INFO:tasks.workunit.client.1.smithi139.stdout:5/571: creat d4/d16/d1b/d20/d67/d88/fb0 x:0 0 0 2024-09-17T07:19:58.658 INFO:tasks.workunit.client.0.smithi087.stdout:1/520: mkdir d2/d3d/db4 0 2024-09-17T07:19:58.659 INFO:tasks.workunit.client.0.smithi087.stdout:1/521: mknod d2/d48/cb5 0 2024-09-17T07:19:58.660 INFO:tasks.workunit.client.1.smithi139.stdout:2/561: read d0/de/df/d56/f71 [2728549,771] 0 2024-09-17T07:19:58.663 INFO:tasks.workunit.client.1.smithi139.stdout:5/572: dread d4/d16/f58 [0,4194304] 0 2024-09-17T07:19:58.665 INFO:tasks.workunit.client.1.smithi139.stdout:5/573: write d4/d16/d1b/d20/d67/d88/fad [276183,92015] 0 2024-09-17T07:19:58.669 INFO:tasks.workunit.client.1.smithi139.stdout:5/574: getdents d4/d16/d1b/d20/d32/d6c 0 2024-09-17T07:19:58.677 INFO:tasks.workunit.client.1.smithi139.stdout:5/575: write d4/d16/f58 [1240832,50061] 0 2024-09-17T07:19:58.677 INFO:tasks.workunit.client.1.smithi139.stdout:2/562: write d0/d7/fd [3690046,42096] 0 2024-09-17T07:19:58.681 INFO:tasks.workunit.client.1.smithi139.stdout:2/563: creat d0/d4e/d76/fb7 x:0 0 0 2024-09-17T07:19:58.681 INFO:tasks.workunit.client.0.smithi087.stdout:0/864: dwrite db/d45/d5d/f8f [0,4194304] 0 2024-09-17T07:19:58.681 INFO:tasks.workunit.client.1.smithi139.stdout:2/564: chown d0/d7/d1a/l43 16 1 2024-09-17T07:19:58.682 INFO:tasks.workunit.client.0.smithi087.stdout:0/865: stat db/d45/d7b/d90/f122 0 2024-09-17T07:19:58.687 INFO:tasks.workunit.client.1.smithi139.stdout:5/576: dwrite d4/d16/d1b/d20/d32/d76/f84 [0,4194304] 0 2024-09-17T07:19:58.687 INFO:tasks.workunit.client.0.smithi087.stdout:0/866: rename db/d45/d9e/d95/dd8/f106 to db/d45/d9e/d86/dd5/deb/d117/f12f 0 2024-09-17T07:19:58.689 INFO:tasks.workunit.client.0.smithi087.stdout:1/522: dread d2/da/f9c [0,4194304] 0 2024-09-17T07:19:58.690 INFO:tasks.workunit.client.1.smithi139.stdout:5/577: chown d4/d16/d1b/d20/d67/d88 3 1 2024-09-17T07:19:58.695 INFO:tasks.workunit.client.1.smithi139.stdout:5/578: creat d4/d16/d1b/d20/d28/fb1 x:0 0 0 2024-09-17T07:19:58.698 INFO:tasks.workunit.client.1.smithi139.stdout:5/579: mknod d4/d16/d1b/d20/d32/d72/cb2 0 2024-09-17T07:19:58.700 INFO:tasks.workunit.client.1.smithi139.stdout:5/580: read - d4/d16/d1b/d20/d67/d88/f99 zero size 2024-09-17T07:19:58.701 INFO:tasks.workunit.client.1.smithi139.stdout:2/565: dwrite d0/d3b/f5d [0,4194304] 0 2024-09-17T07:19:58.704 INFO:tasks.workunit.client.1.smithi139.stdout:2/566: mknod d0/dc/cb8 0 2024-09-17T07:19:58.706 INFO:tasks.workunit.client.0.smithi087.stdout:6/754: sync 2024-09-17T07:19:58.708 INFO:tasks.workunit.client.1.smithi139.stdout:5/581: dwrite d4/d16/d1b/d20/d67/d88/fb0 [0,4194304] 0 2024-09-17T07:19:58.709 INFO:tasks.workunit.client.0.smithi087.stdout:6/755: truncate d1/d67/dfe/d2c/d33/f8e 1020161 0 2024-09-17T07:19:58.709 INFO:tasks.workunit.client.0.smithi087.stdout:0/867: write db/d45/d9e/d86/dd5/fe1 [5225634,4534] 0 2024-09-17T07:19:58.710 INFO:tasks.workunit.client.0.smithi087.stdout:1/523: write d2/da/f2b [642193,77333] 0 2024-09-17T07:19:58.714 INFO:tasks.workunit.client.1.smithi139.stdout:2/567: write d0/de/d69/f6a [1119462,118202] 0 2024-09-17T07:19:58.714 INFO:tasks.workunit.client.0.smithi087.stdout:6/756: rename d1/d67/dfe/d2c/c39 to d1/d67/ddc/c100 0 2024-09-17T07:19:58.715 INFO:tasks.workunit.client.0.smithi087.stdout:0/868: write db/f27 [44806,73349] 0 2024-09-17T07:19:58.715 INFO:tasks.workunit.client.1.smithi139.stdout:2/568: chown d0/d7/d67/d92 10499 1 2024-09-17T07:19:58.715 INFO:tasks.workunit.client.0.smithi087.stdout:6/757: fdatasync d1/d67/dfe/d2c/d58/d90/fcb 0 2024-09-17T07:19:58.716 INFO:tasks.workunit.client.0.smithi087.stdout:1/524: creat d2/d48/d61/fb6 x:0 0 0 2024-09-17T07:19:58.717 INFO:tasks.workunit.client.0.smithi087.stdout:1/525: fdatasync d2/dc/f23 0 2024-09-17T07:19:58.718 INFO:tasks.workunit.client.1.smithi139.stdout:2/569: mkdir d0/d3b/db9 0 2024-09-17T07:19:58.718 INFO:tasks.workunit.client.1.smithi139.stdout:5/582: dwrite d4/d16/f7a [0,4194304] 0 2024-09-17T07:19:58.721 INFO:tasks.workunit.client.0.smithi087.stdout:0/869: rename db/d45/d5d to db/d45/d7b/d7e/d130 0 2024-09-17T07:19:58.722 INFO:tasks.workunit.client.0.smithi087.stdout:1/526: chown d2/d3d/d45/d90/f96 57 1 2024-09-17T07:19:58.724 INFO:tasks.workunit.client.1.smithi139.stdout:5/583: link d4/d16/d1b/d20/d28/f3e d4/d5d/d97/fb3 0 2024-09-17T07:19:58.725 INFO:tasks.workunit.client.1.smithi139.stdout:2/570: link d0/d7/d1a/d1b/l4b d0/de/d25/d3f/lba 0 2024-09-17T07:19:58.725 INFO:tasks.workunit.client.0.smithi087.stdout:0/870: getdents db/d45/d9e/d86/dd5/deb 0 2024-09-17T07:19:58.726 INFO:tasks.workunit.client.1.smithi139.stdout:2/571: dread - d0/d7/d67/d92/fad zero size 2024-09-17T07:19:58.726 INFO:tasks.workunit.client.1.smithi139.stdout:5/584: mknod d4/d16/d1b/cb4 0 2024-09-17T07:19:58.727 INFO:tasks.workunit.client.1.smithi139.stdout:2/572: write d0/d7/d1a/fb6 [684638,109466] 0 2024-09-17T07:19:58.728 INFO:tasks.workunit.client.0.smithi087.stdout:0/871: creat db/d45/d5b/d92/de8/d11d/f131 x:0 0 0 2024-09-17T07:19:58.729 INFO:tasks.workunit.client.1.smithi139.stdout:5/585: mknod d4/d16/d69/cb5 0 2024-09-17T07:19:58.730 INFO:tasks.workunit.client.1.smithi139.stdout:2/573: creat d0/de/d25/d3f/fbb x:0 0 0 2024-09-17T07:19:58.731 INFO:tasks.workunit.client.1.smithi139.stdout:5/586: truncate d4/d16/d1b/d20/d38/d4f/f57 2097056 0 2024-09-17T07:19:58.732 INFO:tasks.workunit.client.1.smithi139.stdout:2/574: rmdir d0/d7/d67/d92/d99 39 2024-09-17T07:19:58.733 INFO:tasks.workunit.client.0.smithi087.stdout:8/629: sync 2024-09-17T07:19:58.733 INFO:tasks.workunit.client.0.smithi087.stdout:7/491: sync 2024-09-17T07:19:58.733 INFO:tasks.workunit.client.0.smithi087.stdout:9/609: sync 2024-09-17T07:19:58.733 INFO:tasks.workunit.client.0.smithi087.stdout:3/628: sync 2024-09-17T07:19:58.733 INFO:tasks.workunit.client.0.smithi087.stdout:2/638: sync 2024-09-17T07:19:58.733 INFO:tasks.workunit.client.0.smithi087.stdout:5/776: sync 2024-09-17T07:19:58.733 INFO:tasks.workunit.client.0.smithi087.stdout:4/636: sync 2024-09-17T07:19:58.734 INFO:tasks.workunit.client.1.smithi139.stdout:2/575: mknod d0/d7/d1a/d1b/cbc 0 2024-09-17T07:19:58.735 INFO:tasks.workunit.client.0.smithi087.stdout:7/492: fsync d0/f3b 0 2024-09-17T07:19:58.735 INFO:tasks.workunit.client.0.smithi087.stdout:5/777: stat d5/d18/f4a 0 2024-09-17T07:19:58.736 INFO:tasks.workunit.client.1.smithi139.stdout:2/576: creat d0/d7/d67/da1/da7/fbd x:0 0 0 2024-09-17T07:19:58.736 INFO:tasks.workunit.client.1.smithi139.stdout:2/577: chown d0/d3b/f51 669 1 2024-09-17T07:19:58.737 INFO:tasks.workunit.client.0.smithi087.stdout:3/629: write d6/d1b/d2b/f7b [2923238,88664] 0 2024-09-17T07:19:58.738 INFO:tasks.workunit.client.1.smithi139.stdout:2/578: creat d0/dc/d15/fbe x:0 0 0 2024-09-17T07:19:58.738 INFO:tasks.workunit.client.0.smithi087.stdout:8/630: write d1/d2b/f6c [244017,116446] 0 2024-09-17T07:19:58.739 INFO:tasks.workunit.client.0.smithi087.stdout:2/639: mknod d2/d7/dd/d10/d4c/cca 0 2024-09-17T07:19:58.741 INFO:tasks.workunit.client.0.smithi087.stdout:4/637: write d2/d92/d4d/d21/f8f [652702,47266] 0 2024-09-17T07:19:58.741 INFO:tasks.workunit.client.0.smithi087.stdout:5/778: read - d5/d8/ffd zero size 2024-09-17T07:19:58.743 INFO:tasks.workunit.client.1.smithi139.stdout:5/587: truncate d4/d16/d1b/d20/d28/f83 2776375 0 2024-09-17T07:19:58.743 INFO:tasks.workunit.client.1.smithi139.stdout:3/452: sync 2024-09-17T07:19:58.743 INFO:tasks.workunit.client.1.smithi139.stdout:9/864: sync 2024-09-17T07:19:58.743 INFO:tasks.workunit.client.1.smithi139.stdout:7/441: sync 2024-09-17T07:19:58.745 INFO:tasks.workunit.client.0.smithi087.stdout:6/758: dwrite d1/d6/f1f [0,4194304] 0 2024-09-17T07:19:58.746 INFO:tasks.workunit.client.1.smithi139.stdout:3/453: fsync d5/d15/d20/d3b/f53 0 2024-09-17T07:19:58.746 INFO:tasks.workunit.client.0.smithi087.stdout:9/610: creat d3/d4/d6/d8/d22/d43/d84/dc7/fdd x:0 0 0 2024-09-17T07:19:58.747 INFO:tasks.workunit.client.0.smithi087.stdout:7/493: fsync d0/d3/d10/d32/d62/d76/f7f 0 2024-09-17T07:19:58.747 INFO:tasks.workunit.client.1.smithi139.stdout:9/865: chown dc/d11/d15/d3c/d61/d64/d96/db6 432152410 1 2024-09-17T07:19:58.750 INFO:tasks.workunit.client.0.smithi087.stdout:1/527: dwrite d2/d3d/f2f [0,4194304] 0 2024-09-17T07:19:58.751 INFO:tasks.workunit.client.1.smithi139.stdout:7/442: creat d5/d10/d2b/d40/d47/f8e x:0 0 0 2024-09-17T07:19:58.753 INFO:tasks.workunit.client.1.smithi139.stdout:5/588: dwrite d4/d16/f18 [0,4194304] 0 2024-09-17T07:19:58.753 INFO:tasks.workunit.client.1.smithi139.stdout:9/866: dread - dc/d11/d15/d3c/d61/d64/ff5 zero size 2024-09-17T07:19:58.754 INFO:tasks.workunit.client.0.smithi087.stdout:7/494: chown d0/d36/l7c 31374503 1 2024-09-17T07:19:58.756 INFO:tasks.workunit.client.0.smithi087.stdout:4/638: link d2/d92/d4d/d21/f24 d2/fde 0 2024-09-17T07:19:58.757 INFO:tasks.workunit.client.0.smithi087.stdout:7/495: write d0/f2 [314398,76592] 0 2024-09-17T07:19:58.757 INFO:tasks.workunit.client.1.smithi139.stdout:9/867: chown dc/lf0 115905770 1 2024-09-17T07:19:58.757 INFO:tasks.workunit.client.1.smithi139.stdout:9/868: readlink dc/d11/d8b/lb2 0 2024-09-17T07:19:58.758 INFO:tasks.workunit.client.0.smithi087.stdout:2/640: fdatasync d2/d7/dd/d10/d4c/d6c/f81 0 2024-09-17T07:19:58.759 INFO:tasks.workunit.client.1.smithi139.stdout:3/454: rename d5/d21/c27 to d5/d15/d16/d25/c90 0 2024-09-17T07:19:58.760 INFO:tasks.workunit.client.1.smithi139.stdout:7/443: readlink d5/d10/d2b/d40/l84 0 2024-09-17T07:19:58.760 INFO:tasks.workunit.client.0.smithi087.stdout:6/759: truncate d1/d67/dfe/d5e/fa0 838496 0 2024-09-17T07:19:58.761 INFO:tasks.workunit.client.1.smithi139.stdout:3/455: write d5/d15/d16/f17 [3331757,107263] 0 2024-09-17T07:19:58.761 INFO:tasks.workunit.client.1.smithi139.stdout:7/444: chown d5/d10/c85 38723462 1 2024-09-17T07:19:58.762 INFO:tasks.workunit.client.1.smithi139.stdout:9/869: creat dc/d2a/f123 x:0 0 0 2024-09-17T07:19:58.762 INFO:tasks.workunit.client.0.smithi087.stdout:4/639: chown d2/d92/d4d/f75 888 1 2024-09-17T07:19:58.763 INFO:tasks.workunit.client.1.smithi139.stdout:5/589: creat d4/d16/d1b/d20/fb6 x:0 0 0 2024-09-17T07:19:58.764 INFO:tasks.workunit.client.0.smithi087.stdout:5/779: rename d5/d12/d14/d61/f75 to d5/d12/d14/fff 0 2024-09-17T07:19:58.767 INFO:tasks.workunit.client.1.smithi139.stdout:3/456: symlink d5/d15/d16/d4c/d28/l91 0 2024-09-17T07:19:58.769 INFO:tasks.workunit.client.0.smithi087.stdout:7/496: fdatasync d0/d3/d10/d32/f99 0 2024-09-17T07:19:58.771 INFO:tasks.workunit.client.0.smithi087.stdout:1/528: dwrite d2/d3d/d45/f72 [0,4194304] 0 2024-09-17T07:19:58.771 INFO:tasks.workunit.client.0.smithi087.stdout:2/641: mknod d2/d7/dd/d10/d4c/d6c/ccb 0 2024-09-17T07:19:58.772 INFO:tasks.workunit.client.1.smithi139.stdout:5/590: creat d4/d16/d1b/d20/d28/d3f/fb7 x:0 0 0 2024-09-17T07:19:58.773 INFO:tasks.workunit.client.0.smithi087.stdout:9/611: dread d3/d4/fb [0,4194304] 0 2024-09-17T07:19:58.774 INFO:tasks.workunit.client.1.smithi139.stdout:3/457: dread - d5/d15/d20/f42 zero size 2024-09-17T07:19:58.774 INFO:tasks.workunit.client.0.smithi087.stdout:0/872: dread db/d45/d5b/f89 [0,4194304] 0 2024-09-17T07:19:58.774 INFO:tasks.workunit.client.0.smithi087.stdout:6/760: write d1/d67/dfe/d2c/d40/f4d [966874,10344] 0 2024-09-17T07:19:58.775 INFO:tasks.workunit.client.1.smithi139.stdout:7/445: dwrite d5/d10/d4d/f7d [0,4194304] 0 2024-09-17T07:19:58.775 INFO:tasks.workunit.client.1.smithi139.stdout:9/870: dwrite dc/d11/d15/d3c/d68/fc4 [0,4194304] 0 2024-09-17T07:19:58.777 INFO:tasks.workunit.client.0.smithi087.stdout:7/497: chown d0/d3/d10/d31/l82 121673 1 2024-09-17T07:19:58.777 INFO:tasks.workunit.client.1.smithi139.stdout:2/579: dread d0/d7/fd [0,4194304] 0 2024-09-17T07:19:58.777 INFO:tasks.workunit.client.0.smithi087.stdout:8/631: dwrite d1/d7/d9/d27/f8f [0,4194304] 0 2024-09-17T07:19:58.778 INFO:tasks.workunit.client.1.smithi139.stdout:9/871: fdatasync dc/d11/d15/d3c/dfe/f100 0 2024-09-17T07:19:58.781 INFO:tasks.workunit.client.0.smithi087.stdout:0/873: truncate db/d45/d7b/d90/fe5 1023208 0 2024-09-17T07:19:58.781 INFO:tasks.workunit.client.0.smithi087.stdout:9/612: write d3/d4/d6/d8/d22/f75 [4235649,31896] 0 2024-09-17T07:19:58.782 INFO:tasks.workunit.client.0.smithi087.stdout:4/640: dread d2/d92/d4d/f48 [0,4194304] 0 2024-09-17T07:19:58.782 INFO:tasks.workunit.client.0.smithi087.stdout:5/780: getdents d5/d18/d20/d2f/d52 0 2024-09-17T07:19:58.783 INFO:tasks.workunit.client.0.smithi087.stdout:2/642: truncate d2/d7/d60/f65 2300734 0 2024-09-17T07:19:58.783 INFO:tasks.workunit.client.0.smithi087.stdout:4/641: stat d2/d92/fda 0 2024-09-17T07:19:58.784 INFO:tasks.workunit.client.1.smithi139.stdout:3/458: dread d5/f3c [0,4194304] 0 2024-09-17T07:19:58.784 INFO:tasks.workunit.client.1.smithi139.stdout:2/580: chown d0/d7/d67/d92/d99/l4a 439991 1 2024-09-17T07:19:58.785 INFO:tasks.workunit.client.0.smithi087.stdout:0/874: chown db/d45/d7b/d90/dd9/c129 166961 1 2024-09-17T07:19:58.785 INFO:tasks.workunit.client.0.smithi087.stdout:3/630: dread d6/d16/f81 [0,4194304] 0 2024-09-17T07:19:58.786 INFO:tasks.workunit.client.0.smithi087.stdout:7/498: creat d0/d3/d10/d31/f9a x:0 0 0 2024-09-17T07:19:58.787 INFO:tasks.workunit.client.0.smithi087.stdout:4/642: write d2/d92/d4d/d42/fac [1080076,42510] 0 2024-09-17T07:19:58.787 INFO:tasks.workunit.client.0.smithi087.stdout:8/632: mknod d1/d2b/d21/cdd 0 2024-09-17T07:19:58.791 INFO:tasks.workunit.client.0.smithi087.stdout:8/633: write d1/d2b/d21/d6d/d6f/d7f/f7b [446256,59155] 0 2024-09-17T07:19:58.793 INFO:tasks.workunit.client.0.smithi087.stdout:9/613: mknod d3/d4/d6/d8/d22/d92/da3/cde 0 2024-09-17T07:19:58.795 INFO:tasks.workunit.client.1.smithi139.stdout:7/446: creat d5/d17/d4e/d55/f8f x:0 0 0 2024-09-17T07:19:58.797 INFO:tasks.workunit.client.0.smithi087.stdout:0/875: creat db/dbe/d124/dd0/f132 x:0 0 0 2024-09-17T07:19:58.797 INFO:tasks.workunit.client.1.smithi139.stdout:3/459: getdents d5/d63/d6d/d6f/d8b 0 2024-09-17T07:19:58.798 INFO:tasks.workunit.client.1.smithi139.stdout:9/872: creat dc/d11/f124 x:0 0 0 2024-09-17T07:19:58.799 INFO:tasks.workunit.client.0.smithi087.stdout:5/781: creat d5/d12/d14/d61/f100 x:0 0 0 2024-09-17T07:19:58.799 INFO:tasks.workunit.client.1.smithi139.stdout:5/591: rmdir d4 39 2024-09-17T07:19:58.800 INFO:tasks.workunit.client.0.smithi087.stdout:1/529: link d2/f2d d2/d3d/d45/d90/d43/fb7 0 2024-09-17T07:19:58.801 INFO:tasks.workunit.client.0.smithi087.stdout:9/614: creat d3/d4/d6/d8/d12/db1/fdf x:0 0 0 2024-09-17T07:19:58.801 INFO:tasks.workunit.client.1.smithi139.stdout:7/447: mkdir d5/d17/d4e/d90 0 2024-09-17T07:19:58.802 INFO:tasks.workunit.client.0.smithi087.stdout:0/876: symlink db/d45/d5b/d92/l133 0 2024-09-17T07:19:58.802 INFO:tasks.workunit.client.0.smithi087.stdout:0/877: fdatasync db/f1e 0 2024-09-17T07:19:58.803 INFO:tasks.workunit.client.1.smithi139.stdout:2/581: getdents d0/d7 0 2024-09-17T07:19:58.803 INFO:tasks.workunit.client.1.smithi139.stdout:2/582: dread - d0/d7/d86/da4/f83 zero size 2024-09-17T07:19:58.804 INFO:tasks.workunit.client.1.smithi139.stdout:3/460: creat d5/d63/d6d/d6f/d8b/f92 x:0 0 0 2024-09-17T07:19:58.804 INFO:tasks.workunit.client.0.smithi087.stdout:2/643: rename d2/d15/d34 to d2/d7/dd/d10/d4c/dcc 0 2024-09-17T07:19:58.804 INFO:tasks.workunit.client.1.smithi139.stdout:9/873: mkdir dc/d11/d15/d3c/d125 0 2024-09-17T07:19:58.806 INFO:tasks.workunit.client.1.smithi139.stdout:5/592: write d4/d16/d1b/d20/d28/f1f [7520141,108671] 0 2024-09-17T07:19:58.807 INFO:tasks.workunit.client.1.smithi139.stdout:2/583: mknod d0/d7/d67/d92/d99/cbf 0 2024-09-17T07:19:58.808 INFO:tasks.workunit.client.0.smithi087.stdout:7/499: rmdir d0/d7a/d8d 0 2024-09-17T07:19:58.809 INFO:tasks.workunit.client.0.smithi087.stdout:9/615: rmdir d3/d4/d6/d8/d22/d43/d84 39 2024-09-17T07:19:58.809 INFO:tasks.workunit.client.1.smithi139.stdout:2/584: fsync d0/d7/d86/da4/d12/d8c/f93 0 2024-09-17T07:19:58.810 INFO:tasks.workunit.client.1.smithi139.stdout:5/593: mknod d4/d16/d1b/d20/d32/d72/cb8 0 2024-09-17T07:19:58.810 INFO:tasks.workunit.client.0.smithi087.stdout:0/878: dwrite db/d45/d7b/d90/f122 [0,4194304] 0 2024-09-17T07:19:58.812 INFO:tasks.workunit.client.0.smithi087.stdout:3/631: rename d6/d16/f38 to d6/d1b/d42/d62/dbb/dd7/fd9 0 2024-09-17T07:19:58.812 INFO:tasks.workunit.client.0.smithi087.stdout:5/782: symlink d5/d18/d20/d2f/d83/dac/l101 0 2024-09-17T07:19:58.813 INFO:tasks.workunit.client.0.smithi087.stdout:1/530: stat d2/d3d/d45/d90/d43/fb7 0 2024-09-17T07:19:58.814 INFO:tasks.workunit.client.0.smithi087.stdout:4/643: dread d2/d5/d1f/f34 [0,4194304] 0 2024-09-17T07:19:58.815 INFO:tasks.workunit.client.1.smithi139.stdout:2/585: creat d0/d7/d86/da4/d28/fc0 x:0 0 0 2024-09-17T07:19:58.817 INFO:tasks.workunit.client.0.smithi087.stdout:4/644: write d2/d92/d4d/d3e/f8b [24783,117081] 0 2024-09-17T07:19:58.818 INFO:tasks.workunit.client.1.smithi139.stdout:9/874: dwrite dc/d11/d15/d3c/f86 [0,4194304] 0 2024-09-17T07:19:58.818 INFO:tasks.workunit.client.0.smithi087.stdout:9/616: symlink d3/d4/d6/d8/d12/d32/da1/le0 0 2024-09-17T07:19:58.819 INFO:tasks.workunit.client.1.smithi139.stdout:2/586: fsync d0/d7/d67/da1/da7/fb2 0 2024-09-17T07:19:58.820 INFO:tasks.workunit.client.1.smithi139.stdout:8/664: sync 2024-09-17T07:19:58.821 INFO:tasks.workunit.client.0.smithi087.stdout:8/634: rename d1/d2b/d21/d6d/d6f/f93 to d1/d2b/d21/dd4/fde 0 2024-09-17T07:19:58.821 INFO:tasks.workunit.client.1.smithi139.stdout:3/461: write d5/d15/d56/f29 [3887124,4397] 0 2024-09-17T07:19:58.822 INFO:tasks.workunit.client.0.smithi087.stdout:9/617: read - d3/d4/d6/fab zero size 2024-09-17T07:19:58.822 INFO:tasks.workunit.client.0.smithi087.stdout:0/879: symlink db/d45/d9e/d86/dd5/l134 0 2024-09-17T07:19:58.825 INFO:tasks.workunit.client.1.smithi139.stdout:9/875: mknod dc/d11/d15/d3c/d61/c126 0 2024-09-17T07:19:58.825 INFO:tasks.workunit.client.1.smithi139.stdout:9/876: stat dc/d11/d15/d1e/c10b 0 2024-09-17T07:19:58.825 INFO:tasks.workunit.client.1.smithi139.stdout:8/665: fdatasync d0/d20/d28/d52/d99/fcf 0 2024-09-17T07:19:58.827 INFO:tasks.workunit.client.0.smithi087.stdout:0/880: write db/d45/d9e/d95/fee [913302,52395] 0 2024-09-17T07:19:58.827 INFO:tasks.workunit.client.1.smithi139.stdout:2/587: mkdir d0/dc/d15/d9f/dc1 0 2024-09-17T07:19:58.828 INFO:tasks.workunit.client.1.smithi139.stdout:5/594: truncate d4/d16/d1b/d20/d28/f1f 4797483 0 2024-09-17T07:19:58.829 INFO:tasks.workunit.client.1.smithi139.stdout:3/462: mknod d5/d15/d20/d3b/c93 0 2024-09-17T07:19:58.830 INFO:tasks.workunit.client.0.smithi087.stdout:1/531: creat d2/d69/d8d/fb8 x:0 0 0 2024-09-17T07:19:58.831 INFO:tasks.workunit.client.0.smithi087.stdout:3/632: dwrite d6/d15/d37/d3c/d43/fb4 [0,4194304] 0 2024-09-17T07:19:58.833 INFO:tasks.workunit.client.1.smithi139.stdout:5/595: symlink d4/d16/d1b/d20/d32/d6c/lb9 0 2024-09-17T07:19:58.833 INFO:tasks.workunit.client.0.smithi087.stdout:5/783: rmdir d5/d12 39 2024-09-17T07:19:58.834 INFO:tasks.workunit.client.0.smithi087.stdout:0/881: write db/d45/d9e/f64 [340717,382] 0 2024-09-17T07:19:58.834 INFO:tasks.workunit.client.1.smithi139.stdout:9/877: creat dc/f127 x:0 0 0 2024-09-17T07:19:58.835 INFO:tasks.workunit.client.1.smithi139.stdout:9/878: chown dc/d11/d8b/fac 31158 1 2024-09-17T07:19:58.836 INFO:tasks.workunit.client.0.smithi087.stdout:0/882: chown db/f54 57249104 1 2024-09-17T07:19:58.836 INFO:tasks.workunit.client.0.smithi087.stdout:7/500: creat d0/f9b x:0 0 0 2024-09-17T07:19:58.839 INFO:tasks.workunit.client.1.smithi139.stdout:8/666: dwrite d0/d1a/d4d/da4/fae [0,4194304] 0 2024-09-17T07:19:58.839 INFO:tasks.workunit.client.0.smithi087.stdout:8/635: read d1/d2b/f46 [3722124,31979] 0 2024-09-17T07:19:58.839 INFO:tasks.workunit.client.0.smithi087.stdout:9/618: dwrite d3/d4/d6/d71/fd0 [0,4194304] 0 2024-09-17T07:19:58.841 INFO:tasks.workunit.client.1.smithi139.stdout:2/588: creat d0/d7/d86/da4/d12/fc2 x:0 0 0 2024-09-17T07:19:58.841 INFO:tasks.workunit.client.0.smithi087.stdout:0/883: write db/d45/d7b/d7e/d130/f8f [669382,60454] 0 2024-09-17T07:19:58.841 INFO:tasks.workunit.client.1.smithi139.stdout:3/463: rename d5/d21/f48 to d5/d15/d20/d83/f94 0 2024-09-17T07:19:58.844 INFO:tasks.workunit.client.0.smithi087.stdout:1/532: mkdir d2/da/d7e/db9 0 2024-09-17T07:19:58.844 INFO:tasks.workunit.client.0.smithi087.stdout:9/619: read d3/d4/d6/f13 [1118670,65723] 0 2024-09-17T07:19:58.848 INFO:tasks.workunit.client.1.smithi139.stdout:2/589: write d0/d7/d67/da1/da7/fbd [408430,78207] 0 2024-09-17T07:19:58.848 INFO:tasks.workunit.client.1.smithi139.stdout:3/464: write d5/d15/d16/d4c/f68 [1048141,32396] 0 2024-09-17T07:19:58.848 INFO:tasks.workunit.client.1.smithi139.stdout:8/667: creat d0/d1a/d4d/da4/fd9 x:0 0 0 2024-09-17T07:19:58.848 INFO:tasks.workunit.client.1.smithi139.stdout:7/448: dread d5/d10/d2b/f3c [0,4194304] 0 2024-09-17T07:19:58.849 INFO:tasks.workunit.client.0.smithi087.stdout:3/633: rename d6/d1b/f3b to d6/d1b/d42/d62/dbb/dd7/fda 0 2024-09-17T07:19:58.849 INFO:tasks.workunit.client.1.smithi139.stdout:8/668: write d0/f72 [3611741,32004] 0 2024-09-17T07:19:58.849 INFO:tasks.workunit.client.1.smithi139.stdout:2/590: fsync d0/d4e/d76/fb7 0 2024-09-17T07:19:58.851 INFO:tasks.workunit.client.1.smithi139.stdout:2/591: stat d0/d4e/f7f 0 2024-09-17T07:19:58.853 INFO:tasks.workunit.client.1.smithi139.stdout:7/449: fdatasync d5/d17/f31 0 2024-09-17T07:19:58.854 INFO:tasks.workunit.client.1.smithi139.stdout:8/669: creat d0/d96/fda x:0 0 0 2024-09-17T07:19:58.856 INFO:tasks.workunit.client.0.smithi087.stdout:0/884: chown db/d45/d5b/c61 503165 1 2024-09-17T07:19:58.856 INFO:tasks.workunit.client.1.smithi139.stdout:3/465: rename d5/d15/d16/d4c/d28/d54/c5c to d5/d15/d16/d25/c95 0 2024-09-17T07:19:58.856 INFO:tasks.workunit.client.1.smithi139.stdout:9/879: link dc/d11/d15/ld0 dc/d11/d8b/dc7/l128 0 2024-09-17T07:19:58.858 INFO:tasks.workunit.client.0.smithi087.stdout:7/501: write d0/d3/d23/d17/f47 [3008785,130526] 0 2024-09-17T07:19:58.858 INFO:tasks.workunit.client.0.smithi087.stdout:8/636: dread d1/d2b/d21/d6d/d6f/d7f/f7b [0,4194304] 0 2024-09-17T07:19:58.859 INFO:tasks.workunit.client.0.smithi087.stdout:3/634: creat d6/d15/d37/d3c/d43/db7/fdb x:0 0 0 2024-09-17T07:19:58.860 INFO:tasks.workunit.client.0.smithi087.stdout:9/620: symlink d3/d4/d6/d8/le1 0 2024-09-17T07:19:58.860 INFO:tasks.workunit.client.0.smithi087.stdout:8/637: readlink d1/d7/d9/d19/d73/la4 0 2024-09-17T07:19:58.860 INFO:tasks.workunit.client.1.smithi139.stdout:8/670: creat d0/d1a/d3a/fdb x:0 0 0 2024-09-17T07:19:58.860 INFO:tasks.workunit.client.1.smithi139.stdout:3/466: symlink d5/d15/d20/d3b/l96 0 2024-09-17T07:19:58.862 INFO:tasks.workunit.client.0.smithi087.stdout:3/635: chown d6/d15/d37/d3c/d43/la3 6 1 2024-09-17T07:19:58.863 INFO:tasks.workunit.client.0.smithi087.stdout:9/621: truncate d3/d25/f9a 1759037 0 2024-09-17T07:19:58.863 INFO:tasks.workunit.client.1.smithi139.stdout:8/671: creat d0/d20/fdc x:0 0 0 2024-09-17T07:19:58.864 INFO:tasks.workunit.client.0.smithi087.stdout:5/784: getdents d5/d18/d20/d2f/d60/de3/ded/df8 0 2024-09-17T07:19:58.864 INFO:tasks.workunit.client.1.smithi139.stdout:2/592: getdents d0/d7/d86/da4/d12 0 2024-09-17T07:19:58.865 INFO:tasks.workunit.client.1.smithi139.stdout:3/467: mkdir d5/d15/d16/d25/d97 0 2024-09-17T07:19:58.865 INFO:tasks.workunit.client.1.smithi139.stdout:9/880: dwrite dc/d11/d15/d3c/d61/fc0 [0,4194304] 0 2024-09-17T07:19:58.866 INFO:tasks.workunit.client.1.smithi139.stdout:3/468: dread - d5/d63/d6d/f71 zero size 2024-09-17T07:19:58.867 INFO:tasks.workunit.client.1.smithi139.stdout:8/672: mknod d0/d20/d28/cdd 0 2024-09-17T07:19:58.867 INFO:tasks.workunit.client.1.smithi139.stdout:7/450: getdents d5/d17/d4e/d66 0 2024-09-17T07:19:58.867 INFO:tasks.workunit.client.0.smithi087.stdout:9/622: chown d3/d4/d6/d8/d12/d32/db2 405309048 1 2024-09-17T07:19:58.869 INFO:tasks.workunit.client.0.smithi087.stdout:3/636: mkdir d6/d1b/d42/dd4/ddc 0 2024-09-17T07:19:58.869 INFO:tasks.workunit.client.0.smithi087.stdout:7/502: dwrite d0/d3/d23/d17/f1e [4194304,4194304] 0 2024-09-17T07:19:58.869 INFO:tasks.workunit.client.1.smithi139.stdout:3/469: fsync d5/d15/d56/f29 0 2024-09-17T07:19:58.870 INFO:tasks.workunit.client.1.smithi139.stdout:2/593: symlink d0/d7/d67/d92/d99/lc3 0 2024-09-17T07:19:58.870 INFO:tasks.workunit.client.1.smithi139.stdout:9/881: creat dc/d11/d15/d3c/dfe/f129 x:0 0 0 2024-09-17T07:19:58.871 INFO:tasks.workunit.client.0.smithi087.stdout:3/637: chown d6/d15 3017 1 2024-09-17T07:19:58.873 INFO:tasks.workunit.client.1.smithi139.stdout:3/470: chown d5/l86 1793 1 2024-09-17T07:19:58.874 INFO:tasks.workunit.client.0.smithi087.stdout:8/638: dread d1/d2b/f32 [0,4194304] 0 2024-09-17T07:19:58.874 INFO:tasks.workunit.client.0.smithi087.stdout:5/785: fdatasync d5/d8/d1f/d4e/fb4 0 2024-09-17T07:19:58.874 INFO:tasks.workunit.client.0.smithi087.stdout:9/623: write d3/d4/d6/d8/d22/fa5 [80861,68683] 0 2024-09-17T07:19:58.874 INFO:tasks.workunit.client.1.smithi139.stdout:8/673: creat d0/d1a/d82/fde x:0 0 0 2024-09-17T07:19:58.877 INFO:tasks.workunit.client.0.smithi087.stdout:4/645: truncate d2/d92/d4d/d21/d2f/d3b/fd4 371284 0 2024-09-17T07:19:58.880 INFO:tasks.workunit.client.1.smithi139.stdout:8/674: write d0/d20/d28/d48/f9f [1495321,44712] 0 2024-09-17T07:19:58.880 INFO:tasks.workunit.client.1.smithi139.stdout:7/451: dwrite d5/d10/d4d/f88 [0,4194304] 0 2024-09-17T07:19:58.880 INFO:tasks.workunit.client.0.smithi087.stdout:8/639: creat d1/d2b/d21/fdf x:0 0 0 2024-09-17T07:19:58.880 INFO:tasks.workunit.client.0.smithi087.stdout:0/885: dwrite db/d4f/fde [0,4194304] 0 2024-09-17T07:19:58.882 INFO:tasks.workunit.client.0.smithi087.stdout:7/503: rename d0/d36/c4a to d0/d3/c9c 0 2024-09-17T07:19:58.884 INFO:tasks.workunit.client.1.smithi139.stdout:3/471: rename d5/ld to d5/d15/d16/d4c/d28/d54/d58/l98 0 2024-09-17T07:19:58.886 INFO:tasks.workunit.client.0.smithi087.stdout:4/646: write d2/d92/d4d/d21/d2f/f8c [3017329,41920] 0 2024-09-17T07:19:58.888 INFO:tasks.workunit.client.1.smithi139.stdout:7/452: creat d5/d17/f91 x:0 0 0 2024-09-17T07:19:58.888 INFO:tasks.workunit.client.0.smithi087.stdout:5/786: mkdir d5/d8/d1f/d4e/da3/d102 0 2024-09-17T07:19:58.892 INFO:tasks.workunit.client.0.smithi087.stdout:0/886: mknod db/d45/d7b/d90/dd9/de6/c135 0 2024-09-17T07:19:58.892 INFO:tasks.workunit.client.0.smithi087.stdout:8/640: readlink d1/d7/d9/l77 0 2024-09-17T07:19:58.892 INFO:tasks.workunit.client.1.smithi139.stdout:3/472: dwrite d5/d21/f4e [0,4194304] 0 2024-09-17T07:19:58.892 INFO:tasks.workunit.client.1.smithi139.stdout:8/675: rename d0/d1a/d4d/l60 to d0/d1a/d4d/d53/ldf 0 2024-09-17T07:19:58.895 INFO:tasks.workunit.client.0.smithi087.stdout:5/787: fsync d5/d8/d1f/fc0 0 2024-09-17T07:19:58.896 INFO:tasks.workunit.client.1.smithi139.stdout:7/453: dread - d5/f37 zero size 2024-09-17T07:19:58.896 INFO:tasks.workunit.client.0.smithi087.stdout:4/647: fdatasync d2/d92/d4d/d21/f24 0 2024-09-17T07:19:58.896 INFO:tasks.workunit.client.0.smithi087.stdout:3/638: dwrite d6/d1b/d42/d62/f8c [0,4194304] 0 2024-09-17T07:19:58.899 INFO:tasks.workunit.client.1.smithi139.stdout:2/594: rmdir d0 39 2024-09-17T07:19:58.899 INFO:tasks.workunit.client.0.smithi087.stdout:4/648: fdatasync d2/d5/f9c 0 2024-09-17T07:19:58.901 INFO:tasks.workunit.client.1.smithi139.stdout:9/882: getdents dc/d11/d52/d56 0 2024-09-17T07:19:58.901 INFO:tasks.workunit.client.1.smithi139.stdout:5/596: dread d4/d16/d1b/f39 [0,4194304] 0 2024-09-17T07:19:58.903 INFO:tasks.workunit.client.0.smithi087.stdout:5/788: fsync d5/d18/d20/d2f/d60/de3/ded/f86 0 2024-09-17T07:19:58.904 INFO:tasks.workunit.client.0.smithi087.stdout:3/639: dread - d6/d15/d92/f96 zero size 2024-09-17T07:19:58.904 INFO:tasks.workunit.client.1.smithi139.stdout:9/883: read - dc/d11/d52/d56/d7a/da1/f113 zero size 2024-09-17T07:19:58.905 INFO:tasks.workunit.client.1.smithi139.stdout:3/473: rename d5/d21/c6e to d5/d63/c99 0 2024-09-17T07:19:58.906 INFO:tasks.workunit.client.1.smithi139.stdout:8/676: dwrite d0/d1a/d4d/da4/fd9 [0,4194304] 0 2024-09-17T07:19:58.906 INFO:tasks.workunit.client.1.smithi139.stdout:7/454: symlink d5/d10/d4d/l92 0 2024-09-17T07:19:58.906 INFO:tasks.workunit.client.0.smithi087.stdout:9/624: dwrite d3/d4/d16/d69/d8a/d1e/d90/d93/f9d [0,4194304] 0 2024-09-17T07:19:58.908 INFO:tasks.workunit.client.1.smithi139.stdout:8/677: chown d0/d20/d28/d52/d65/d7f/db6 113427483 1 2024-09-17T07:19:58.909 INFO:tasks.workunit.client.0.smithi087.stdout:7/504: dwrite d0/f2 [0,4194304] 0 2024-09-17T07:19:58.911 INFO:tasks.workunit.client.1.smithi139.stdout:8/678: dread - d0/d20/d28/d52/d99/fc7 zero size 2024-09-17T07:19:58.913 INFO:tasks.workunit.client.1.smithi139.stdout:5/597: creat d4/d16/fba x:0 0 0 2024-09-17T07:19:58.914 INFO:tasks.workunit.client.1.smithi139.stdout:3/474: creat d5/d15/d16/d4c/f9a x:0 0 0 2024-09-17T07:19:58.916 INFO:tasks.workunit.client.0.smithi087.stdout:9/625: chown d3/d4/d6/d8/d12/d32/da1 171 1 2024-09-17T07:19:58.917 INFO:tasks.workunit.client.1.smithi139.stdout:2/595: dread d0/dc/d3a/f3d [0,4194304] 0 2024-09-17T07:19:58.917 INFO:tasks.workunit.client.1.smithi139.stdout:5/598: write d4/d16/d1b/d20/d28/d3f/fb7 [163300,14967] 0 2024-09-17T07:19:58.919 INFO:tasks.workunit.client.0.smithi087.stdout:3/640: mkdir d6/d16/ddd 0 2024-09-17T07:19:58.919 INFO:tasks.workunit.client.0.smithi087.stdout:8/641: dwrite d1/d2b/d21/d6d/d6f/d7f/fd3 [0,4194304] 0 2024-09-17T07:19:58.921 INFO:tasks.workunit.client.1.smithi139.stdout:7/455: dwrite d5/d10/d2b/d40/d47/f72 [0,4194304] 0 2024-09-17T07:19:58.921 INFO:tasks.workunit.client.1.smithi139.stdout:8/679: mknod d0/d20/d28/d52/ce0 0 2024-09-17T07:19:58.923 INFO:tasks.workunit.client.0.smithi087.stdout:4/649: mkdir d2/d92/d4d/ddf 0 2024-09-17T07:19:58.923 INFO:tasks.workunit.client.1.smithi139.stdout:2/596: mkdir d0/dc/dc4 0 2024-09-17T07:19:58.924 INFO:tasks.workunit.client.0.smithi087.stdout:3/641: readlink d6/d1b/l85 0 2024-09-17T07:19:58.924 INFO:tasks.workunit.client.0.smithi087.stdout:0/887: dwrite db/d45/d5b/fc4 [0,4194304] 0 2024-09-17T07:19:58.925 INFO:tasks.workunit.client.0.smithi087.stdout:9/626: creat d3/d25/fe2 x:0 0 0 2024-09-17T07:19:58.926 INFO:tasks.workunit.client.1.smithi139.stdout:8/680: getdents d0/d20/d28/d52/d65/dd3 0 2024-09-17T07:19:58.926 INFO:tasks.workunit.client.1.smithi139.stdout:8/681: chown d0/d20/d28/c50 10092906 1 2024-09-17T07:19:58.928 INFO:tasks.workunit.client.1.smithi139.stdout:2/597: symlink d0/d7/d86/da4/d12/d8c/lc5 0 2024-09-17T07:19:58.928 INFO:tasks.workunit.client.1.smithi139.stdout:5/599: creat d4/d16/d1b/d20/d38/fbb x:0 0 0 2024-09-17T07:19:58.928 INFO:tasks.workunit.client.1.smithi139.stdout:8/682: write d0/d20/d28/d52/fb3 [8045,12413] 0 2024-09-17T07:19:58.930 INFO:tasks.workunit.client.1.smithi139.stdout:5/600: truncate d4/d5d/f95 1484444 0 2024-09-17T07:19:58.932 INFO:tasks.workunit.client.1.smithi139.stdout:2/598: creat d0/d4e/fc6 x:0 0 0 2024-09-17T07:19:58.933 INFO:tasks.workunit.client.1.smithi139.stdout:8/683: mkdir d0/d20/d28/d48/de1 0 2024-09-17T07:19:58.934 INFO:tasks.workunit.client.0.smithi087.stdout:3/642: write d6/d15/d37/f5b [3317011,45168] 0 2024-09-17T07:19:58.934 INFO:tasks.workunit.client.0.smithi087.stdout:8/642: creat d1/d7/d9/d19/d73/fe0 x:0 0 0 2024-09-17T07:19:58.935 INFO:tasks.workunit.client.1.smithi139.stdout:5/601: mkdir d4/d16/d69/dbc 0 2024-09-17T07:19:58.937 INFO:tasks.workunit.client.0.smithi087.stdout:4/650: write d2/d92/d4d/f75 [1694154,110201] 0 2024-09-17T07:19:58.938 INFO:tasks.workunit.client.0.smithi087.stdout:9/627: write d3/d4/d6/d8/d22/d64/f89 [424692,116174] 0 2024-09-17T07:19:58.939 INFO:tasks.workunit.client.1.smithi139.stdout:2/599: symlink d0/d7/d86/da4/d28/lc7 0 2024-09-17T07:19:58.940 INFO:tasks.workunit.client.0.smithi087.stdout:9/628: truncate d3/d4/d6/d8/d12/d38/f70 686158 0 2024-09-17T07:19:58.942 INFO:tasks.workunit.client.1.smithi139.stdout:5/602: symlink d4/d16/d1b/d20/d32/d6c/lbd 0 2024-09-17T07:19:58.942 INFO:tasks.workunit.client.0.smithi087.stdout:9/629: read d3/d4/d6/d71/f86 [184696,43947] 0 2024-09-17T07:19:58.943 INFO:tasks.workunit.client.1.smithi139.stdout:2/600: symlink d0/dc/d3a/lc8 0 2024-09-17T07:19:58.944 INFO:tasks.workunit.client.1.smithi139.stdout:2/601: write d0/d3b/f51 [1162000,56800] 0 2024-09-17T07:19:58.945 INFO:tasks.workunit.client.1.smithi139.stdout:5/603: symlink d4/d16/d1b/d20/d67/d88/lbe 0 2024-09-17T07:19:58.946 INFO:tasks.workunit.client.0.smithi087.stdout:5/789: dwrite d5/fa9 [0,4194304] 0 2024-09-17T07:19:58.946 INFO:tasks.workunit.client.1.smithi139.stdout:5/604: chown d4/d16/d69/cb5 103 1 2024-09-17T07:19:58.947 INFO:tasks.workunit.client.0.smithi087.stdout:5/790: fdatasync d5/d18/d20/d2f/d52/f72 0 2024-09-17T07:19:58.950 INFO:tasks.workunit.client.1.smithi139.stdout:5/605: truncate d4/d16/d1b/d20/d32/d72/fae 1345952 0 2024-09-17T07:19:58.951 INFO:tasks.workunit.client.0.smithi087.stdout:3/643: creat d6/d1b/d42/d95/fde x:0 0 0 2024-09-17T07:19:58.954 INFO:tasks.workunit.client.0.smithi087.stdout:5/791: creat d5/d18/d20/d2f/d60/de3/ded/f103 x:0 0 0 2024-09-17T07:19:58.954 INFO:tasks.workunit.client.1.smithi139.stdout:2/602: dwrite d0/de/d69/fa3 [0,4194304] 0 2024-09-17T07:19:58.954 INFO:tasks.workunit.client.1.smithi139.stdout:5/606: chown d4/d16/d1b/f66 32511573 1 2024-09-17T07:19:58.955 INFO:tasks.workunit.client.0.smithi087.stdout:7/505: link d0/d3/d23/d17/f47 d0/d3/d10/d87/d96/f9d 0 2024-09-17T07:19:58.955 INFO:tasks.workunit.client.0.smithi087.stdout:5/792: truncate d5/d6d/f80 9427654 0 2024-09-17T07:19:58.955 INFO:tasks.workunit.client.0.smithi087.stdout:0/888: getdents db/da3/df6 0 2024-09-17T07:19:58.956 INFO:tasks.workunit.client.0.smithi087.stdout:8/643: creat d1/d2b/d21/daf/dd7/fe1 x:0 0 0 2024-09-17T07:19:58.956 INFO:tasks.workunit.client.1.smithi139.stdout:2/603: rmdir d0/dc 39 2024-09-17T07:19:58.957 INFO:tasks.workunit.client.1.smithi139.stdout:2/604: readlink d0/de/d25/d3f/l4c 0 2024-09-17T07:19:58.960 INFO:tasks.workunit.client.1.smithi139.stdout:2/605: symlink d0/d7/d67/da1/lc9 0 2024-09-17T07:19:58.961 INFO:tasks.workunit.client.0.smithi087.stdout:9/630: link d3/d4/d6/d71/f86 d3/d4/d16/d69/fe3 0 2024-09-17T07:19:58.963 INFO:tasks.workunit.client.1.smithi139.stdout:5/607: getdents d4/d16/d1b/d20/d28 0 2024-09-17T07:19:58.963 INFO:tasks.workunit.client.1.smithi139.stdout:7/456: dread f2 [0,4194304] 0 2024-09-17T07:19:58.965 INFO:tasks.workunit.client.1.smithi139.stdout:5/608: chown d4/d16/d1b/d20/d38/fa3 46 1 2024-09-17T07:19:58.965 INFO:tasks.workunit.client.0.smithi087.stdout:5/793: readlink d5/d6d/lc6 0 2024-09-17T07:19:58.967 INFO:tasks.workunit.client.1.smithi139.stdout:7/457: symlink d5/d17/d4e/d7a/l93 0 2024-09-17T07:19:58.968 INFO:tasks.workunit.client.0.smithi087.stdout:0/889: dwrite db/d45/d7b/d7e/d130/fc8 [0,4194304] 0 2024-09-17T07:19:58.968 INFO:tasks.workunit.client.0.smithi087.stdout:9/631: chown d3/dac/fc3 1060 1 2024-09-17T07:19:58.970 INFO:tasks.workunit.client.1.smithi139.stdout:2/606: creat d0/dc/dc4/fca x:0 0 0 2024-09-17T07:19:58.970 INFO:tasks.workunit.client.0.smithi087.stdout:8/644: dwrite d1/d2b/d21/daf/fda [0,4194304] 0 2024-09-17T07:19:58.971 INFO:tasks.workunit.client.1.smithi139.stdout:5/609: read d4/d16/f2b [2054427,82641] 0 2024-09-17T07:19:58.972 INFO:tasks.workunit.client.0.smithi087.stdout:5/794: unlink d5/c31 0 2024-09-17T07:19:58.973 INFO:tasks.workunit.client.0.smithi087.stdout:3/644: rmdir d6/d15/d88 0 2024-09-17T07:19:58.974 INFO:tasks.workunit.client.0.smithi087.stdout:8/645: stat d1/c51 0 2024-09-17T07:19:58.975 INFO:tasks.workunit.client.1.smithi139.stdout:2/607: creat d0/de/d25/fcb x:0 0 0 2024-09-17T07:19:58.975 INFO:tasks.workunit.client.0.smithi087.stdout:0/890: mkdir db/d45/d7b/d90/dd9/de6/d136 0 2024-09-17T07:19:58.976 INFO:tasks.workunit.client.1.smithi139.stdout:8/684: truncate d0/d20/f8f 1461895 0 2024-09-17T07:19:58.976 INFO:tasks.workunit.client.0.smithi087.stdout:0/891: fdatasync db/dbe/f11c 0 2024-09-17T07:19:58.979 INFO:tasks.workunit.client.1.smithi139.stdout:8/685: rename d0/d20/d28/d48/de1 to d0/d20/d28/d48/de1/de2 22 2024-09-17T07:19:58.979 INFO:tasks.workunit.client.1.smithi139.stdout:8/686: dread - d0/d96/fda zero size 2024-09-17T07:19:58.980 INFO:tasks.workunit.client.1.smithi139.stdout:7/458: creat d5/d10/d2b/d40/f94 x:0 0 0 2024-09-17T07:19:58.980 INFO:tasks.workunit.client.1.smithi139.stdout:5/610: mkdir d4/d5d/d97/da4/dbf 0 2024-09-17T07:19:58.980 INFO:tasks.workunit.client.0.smithi087.stdout:5/795: write d5/d12/d14/fff [7220201,118706] 0 2024-09-17T07:19:58.982 INFO:tasks.workunit.client.0.smithi087.stdout:8/646: truncate d1/d5f/f5d 2214323 0 2024-09-17T07:19:58.983 INFO:tasks.workunit.client.1.smithi139.stdout:7/459: truncate d5/d17/f91 481749 0 2024-09-17T07:19:58.984 INFO:tasks.workunit.client.1.smithi139.stdout:2/608: creat d0/d7/d1a/fcc x:0 0 0 2024-09-17T07:19:58.984 INFO:tasks.workunit.client.1.smithi139.stdout:5/611: mkdir d4/d5d/dc0 0 2024-09-17T07:19:58.984 INFO:tasks.workunit.client.0.smithi087.stdout:7/506: dread d0/d3/f1f [0,4194304] 0 2024-09-17T07:19:58.985 INFO:tasks.workunit.client.0.smithi087.stdout:0/892: dwrite db/f8c [0,4194304] 0 2024-09-17T07:19:58.985 INFO:tasks.workunit.client.1.smithi139.stdout:2/609: stat d0/d7/d1a 0 2024-09-17T07:19:58.985 INFO:tasks.workunit.client.0.smithi087.stdout:3/645: dread d6/d7d/fa5 [0,4194304] 0 2024-09-17T07:19:58.986 INFO:tasks.workunit.client.1.smithi139.stdout:8/687: fsync d0/d1a/fbb 0 2024-09-17T07:19:58.986 INFO:tasks.workunit.client.1.smithi139.stdout:7/460: write d5/d10/d2b/d40/f81 [4137911,100725] 0 2024-09-17T07:19:58.990 INFO:tasks.workunit.client.1.smithi139.stdout:2/610: mkdir d0/d7/d86/da4/d12/dcd 0 2024-09-17T07:19:58.992 INFO:tasks.workunit.client.0.smithi087.stdout:8/647: mknod d1/d7/ce2 0 2024-09-17T07:19:58.994 INFO:tasks.workunit.client.0.smithi087.stdout:0/893: unlink db/d45/d5b/fa7 0 2024-09-17T07:19:58.995 INFO:tasks.workunit.client.0.smithi087.stdout:5/796: creat d5/d8/d1f/f104 x:0 0 0 2024-09-17T07:19:58.996 INFO:tasks.workunit.client.1.smithi139.stdout:8/688: rename d0/d1a/d4d/d53/l6c to d0/d1a/d82/le3 0 2024-09-17T07:19:58.998 INFO:tasks.workunit.client.1.smithi139.stdout:8/689: read d0/d1a/d3a/d8d/fac [151263,46588] 0 2024-09-17T07:19:59.000 INFO:tasks.workunit.client.1.smithi139.stdout:5/612: link d4/d16/d1b/d20/d67/d88/f8c d4/d16/d1b/d20/d28/d61/fc1 0 2024-09-17T07:19:59.003 INFO:tasks.workunit.client.1.smithi139.stdout:5/613: creat d4/d5d/d97/fc2 x:0 0 0 2024-09-17T07:19:59.004 INFO:tasks.workunit.client.0.smithi087.stdout:3/646: link d6/d16/f4a d6/fdf 0 2024-09-17T07:19:59.006 INFO:tasks.workunit.client.0.smithi087.stdout:7/507: getdents d0/d36 0 2024-09-17T07:19:59.007 INFO:tasks.workunit.client.0.smithi087.stdout:3/647: truncate d6/f12 2155436 0 2024-09-17T07:19:59.007 INFO:tasks.workunit.client.1.smithi139.stdout:5/614: creat d4/d16/d1b/d20/d67/fc3 x:0 0 0 2024-09-17T07:19:59.008 INFO:tasks.workunit.client.0.smithi087.stdout:3/648: fsync d6/d15/d37/d3c/f8d 0 2024-09-17T07:19:59.009 INFO:tasks.workunit.client.0.smithi087.stdout:7/508: chown d0/d3/d23/d2d/l7e 610095300 1 2024-09-17T07:19:59.009 INFO:tasks.workunit.client.1.smithi139.stdout:5/615: write d4/d16/d1b/d20/d28/d3f/fb7 [1129026,63821] 0 2024-09-17T07:19:59.012 INFO:tasks.workunit.client.0.smithi087.stdout:7/509: symlink d0/d3/d10/d87/d96/l9e 0 2024-09-17T07:19:59.013 INFO:tasks.workunit.client.1.smithi139.stdout:5/616: mknod d4/d5d/cc4 0 2024-09-17T07:19:59.015 INFO:tasks.workunit.client.1.smithi139.stdout:7/461: dwrite d5/d10/d2b/d40/f4a [0,4194304] 0 2024-09-17T07:19:59.016 INFO:tasks.workunit.client.0.smithi087.stdout:8/648: rmdir d1 39 2024-09-17T07:19:59.019 INFO:tasks.workunit.client.1.smithi139.stdout:5/617: rename d4/d16/d1b/d20/d28/c6d to d4/d16/d69/dbc/cc5 0 2024-09-17T07:19:59.020 INFO:tasks.workunit.client.1.smithi139.stdout:7/462: stat d5/d67/f82 0 2024-09-17T07:19:59.020 INFO:tasks.workunit.client.0.smithi087.stdout:5/797: write d5/d6d/f90 [1840818,99812] 0 2024-09-17T07:19:59.022 INFO:tasks.workunit.client.1.smithi139.stdout:2/611: dread d0/d7/d67/d92/d99/f4f [0,4194304] 0 2024-09-17T07:19:59.025 INFO:tasks.workunit.client.1.smithi139.stdout:8/690: dread d0/d1a/fbb [0,4194304] 0 2024-09-17T07:19:59.025 INFO:tasks.workunit.client.0.smithi087.stdout:5/798: write d5/d8/d1f/f58 [1348694,82187] 0 2024-09-17T07:19:59.029 INFO:tasks.workunit.client.1.smithi139.stdout:2/612: write d0/d4e/f6c [1461044,39664] 0 2024-09-17T07:19:59.030 INFO:tasks.workunit.client.0.smithi087.stdout:5/799: fdatasync d5/d12/d1c/fa5 0 2024-09-17T07:19:59.030 INFO:tasks.workunit.client.1.smithi139.stdout:7/463: dwrite d5/d10/d2b/d40/f94 [0,4194304] 0 2024-09-17T07:19:59.031 INFO:tasks.workunit.client.0.smithi087.stdout:3/649: dread d6/fdf [0,4194304] 0 2024-09-17T07:19:59.031 INFO:tasks.workunit.client.0.smithi087.stdout:8/649: dwrite d1/d7/d9/d19/fae [0,4194304] 0 2024-09-17T07:19:59.032 INFO:tasks.workunit.client.0.smithi087.stdout:5/800: stat d5/d18/d20/d2f/l4b 0 2024-09-17T07:19:59.034 INFO:tasks.workunit.client.0.smithi087.stdout:3/650: chown d6/d1b/d42/d62/dc1 55362498 1 2024-09-17T07:19:59.034 INFO:tasks.workunit.client.0.smithi087.stdout:4/651: dwrite d2/d92/d4d/d3e/f8b [0,4194304] 0 2024-09-17T07:19:59.035 INFO:tasks.workunit.client.1.smithi139.stdout:8/691: rename d0/d20/d28/d52/d65/d7f/db6/d18 to d0/d20/d28/d52/d65/dd3/de4 0 2024-09-17T07:19:59.035 INFO:tasks.workunit.client.0.smithi087.stdout:4/652: write d2/d5/d1f/fc8 [795446,107836] 0 2024-09-17T07:19:59.036 INFO:tasks.workunit.client.1.smithi139.stdout:8/692: chown d0/d1a/d3a/d71 1 1 2024-09-17T07:19:59.036 INFO:tasks.workunit.client.1.smithi139.stdout:2/613: unlink d0/d7/d86/da4/d12/d45/l6d 0 2024-09-17T07:19:59.037 INFO:tasks.workunit.client.1.smithi139.stdout:8/693: fdatasync d0/d20/d28/d52/d65/d7f/db6/f58 0 2024-09-17T07:19:59.037 INFO:tasks.workunit.client.0.smithi087.stdout:4/653: write d2/d92/d4f/fbc [2129706,115740] 0 2024-09-17T07:19:59.038 INFO:tasks.workunit.client.1.smithi139.stdout:2/614: fsync d0/d7/d1a/d1b/f90 0 2024-09-17T07:19:59.040 INFO:tasks.workunit.client.0.smithi087.stdout:3/651: symlink d6/d15/d37/d3c/d43/le0 0 2024-09-17T07:19:59.041 INFO:tasks.workunit.client.0.smithi087.stdout:3/652: read d6/d7d/fa5 [105788,62587] 0 2024-09-17T07:19:59.044 INFO:tasks.workunit.client.0.smithi087.stdout:4/654: write d2/d92/d4d/f48 [340857,118746] 0 2024-09-17T07:19:59.045 INFO:tasks.workunit.client.0.smithi087.stdout:3/653: mknod d6/d1b/d42/d6e/ce1 0 2024-09-17T07:19:59.045 INFO:tasks.workunit.client.0.smithi087.stdout:8/650: mknod d1/d7/d9/d27/da1/db2/ce3 0 2024-09-17T07:19:59.047 INFO:tasks.workunit.client.0.smithi087.stdout:3/654: write d6/d15/d92/fc5 [423057,76407] 0 2024-09-17T07:19:59.049 INFO:tasks.workunit.client.1.smithi139.stdout:2/615: creat d0/d7/d86/da4/d12/d45/fce x:0 0 0 2024-09-17T07:19:59.050 INFO:tasks.workunit.client.0.smithi087.stdout:8/651: creat d1/d7/d63/dd9/fe4 x:0 0 0 2024-09-17T07:19:59.050 INFO:tasks.workunit.client.0.smithi087.stdout:3/655: creat d6/d1b/d42/dd4/fe2 x:0 0 0 2024-09-17T07:19:59.050 INFO:tasks.workunit.client.1.smithi139.stdout:5/618: chown d4/d16/d1b/d20/d28/f1f 17 1 2024-09-17T07:19:59.051 INFO:tasks.workunit.client.1.smithi139.stdout:5/619: write d4/d5d/f95 [1355270,121739] 0 2024-09-17T07:19:59.051 INFO:tasks.workunit.client.0.smithi087.stdout:4/655: read d2/d92/d4d/d21/d2f/d3b/f7d [413274,76952] 0 2024-09-17T07:19:59.052 INFO:tasks.workunit.client.1.smithi139.stdout:2/616: mkdir d0/d7/d86/da4/d28/dcf 0 2024-09-17T07:19:59.053 INFO:tasks.workunit.client.0.smithi087.stdout:3/656: unlink d6/d1b/d42/d95/fde 0 2024-09-17T07:19:59.053 INFO:tasks.workunit.client.1.smithi139.stdout:5/620: chown d4/d16/d1b/d20/d28/l2d 10 1 2024-09-17T07:19:59.054 INFO:tasks.workunit.client.1.smithi139.stdout:2/617: creat d0/de/d69/fd0 x:0 0 0 2024-09-17T07:19:59.054 INFO:tasks.workunit.client.0.smithi087.stdout:8/652: rename d1/d2b/d3b/c72 to d1/d7/d9/d19/d1b/ce5 0 2024-09-17T07:19:59.055 INFO:tasks.workunit.client.1.smithi139.stdout:5/621: write d4/d16/d1b/d20/d38/d4f/f5c [921843,85686] 0 2024-09-17T07:19:59.055 INFO:tasks.workunit.client.0.smithi087.stdout:4/656: chown d2/d22/d62/lb7 3170307 1 2024-09-17T07:19:59.056 INFO:tasks.workunit.client.0.smithi087.stdout:3/657: unlink d6/d1b/d42/l98 0 2024-09-17T07:19:59.057 INFO:tasks.workunit.client.0.smithi087.stdout:8/653: mkdir d1/d7/d9/d19/d1b/d18/de6 0 2024-09-17T07:19:59.057 INFO:tasks.workunit.client.0.smithi087.stdout:3/658: chown d6/d1b/d42/d95 1648 1 2024-09-17T07:19:59.058 INFO:tasks.workunit.client.0.smithi087.stdout:4/657: mknod d2/d92/d4d/d21/d2f/d3b/d7e/d97/da8/ce0 0 2024-09-17T07:19:59.060 INFO:tasks.workunit.client.0.smithi087.stdout:3/659: mkdir d6/d15/d37/d3c/d43/db7/de3 0 2024-09-17T07:19:59.062 INFO:tasks.workunit.client.0.smithi087.stdout:3/660: mkdir d6/d1b/d42/dd4/dd1/de4 0 2024-09-17T07:19:59.063 INFO:tasks.workunit.client.0.smithi087.stdout:4/658: creat d2/d5/d1f/fe1 x:0 0 0 2024-09-17T07:19:59.065 INFO:tasks.workunit.client.0.smithi087.stdout:4/659: creat d2/d5/d1f/da7/fe2 x:0 0 0 2024-09-17T07:19:59.068 INFO:tasks.workunit.client.0.smithi087.stdout:3/661: getdents d6/d15 0 2024-09-17T07:19:59.068 INFO:tasks.workunit.client.0.smithi087.stdout:5/801: write d5/d18/d20/fa [424167,118465] 0 2024-09-17T07:19:59.069 INFO:tasks.workunit.client.1.smithi139.stdout:2/618: link d0/d7/d86/da4/d28/f2d d0/d7/d86/da4/d28/dcf/fd1 0 2024-09-17T07:19:59.070 INFO:tasks.workunit.client.0.smithi087.stdout:4/660: link d2/d22/d2c/c7a d2/d92/d4f/d7b/ce3 0 2024-09-17T07:19:59.070 INFO:tasks.workunit.client.1.smithi139.stdout:8/694: write d0/d1a/f3f [3905525,33092] 0 2024-09-17T07:19:59.073 INFO:tasks.workunit.client.0.smithi087.stdout:8/654: dread d1/d2b/d21/d6d/d6f/d7f/d54/f86 [0,4194304] 0 2024-09-17T07:19:59.074 INFO:tasks.workunit.client.1.smithi139.stdout:5/622: dwrite d4/d16/d1b/d20/d32/d76/f84 [0,4194304] 0 2024-09-17T07:19:59.075 INFO:tasks.workunit.client.1.smithi139.stdout:8/695: mknod d0/ce5 0 2024-09-17T07:19:59.075 INFO:tasks.workunit.client.1.smithi139.stdout:7/464: dread d5/d10/d2b/d40/f81 [0,4194304] 0 2024-09-17T07:19:59.075 INFO:tasks.workunit.client.0.smithi087.stdout:8/655: symlink d1/d7/d9/d27/le7 0 2024-09-17T07:19:59.078 INFO:tasks.workunit.client.0.smithi087.stdout:8/656: unlink d1/d7/d9/d19/d1b/d18/c5c 0 2024-09-17T07:19:59.079 INFO:tasks.workunit.client.1.smithi139.stdout:7/465: chown d5/d10/f83 60192 1 2024-09-17T07:19:59.079 INFO:tasks.workunit.client.0.smithi087.stdout:8/657: mknod d1/d2b/d21/d68/ce8 0 2024-09-17T07:19:59.085 INFO:tasks.workunit.client.1.smithi139.stdout:2/619: dwrite d0/d7/d86/da4/d28/f2d [0,4194304] 0 2024-09-17T07:19:59.086 INFO:tasks.workunit.client.1.smithi139.stdout:8/696: dwrite d0/d20/d28/d48/f83 [0,4194304] 0 2024-09-17T07:19:59.087 INFO:tasks.workunit.client.0.smithi087.stdout:8/658: dwrite d1/d7/d9/d19/d73/f97 [0,4194304] 0 2024-09-17T07:19:59.088 INFO:tasks.workunit.client.1.smithi139.stdout:2/620: write d0/dc/d15/fbe [959855,11934] 0 2024-09-17T07:19:59.090 INFO:tasks.workunit.client.0.smithi087.stdout:4/661: write d2/d92/d4d/d21/f24 [1614874,121648] 0 2024-09-17T07:19:59.090 INFO:tasks.workunit.client.0.smithi087.stdout:8/659: truncate d1/d7/d63/dd9/fe4 981013 0 2024-09-17T07:19:59.092 INFO:tasks.workunit.client.0.smithi087.stdout:4/662: read d2/d92/f94 [1097389,20320] 0 2024-09-17T07:19:59.094 INFO:tasks.workunit.client.1.smithi139.stdout:2/621: getdents d0/d7/d86/da4 0 2024-09-17T07:19:59.096 INFO:tasks.workunit.client.1.smithi139.stdout:2/622: readlink d0/de/d25/d3f/l4c 0 2024-09-17T07:19:59.097 INFO:tasks.workunit.client.1.smithi139.stdout:2/623: chown d0/d7/d67/d92/d99/l38 256909092 1 2024-09-17T07:19:59.099 INFO:tasks.workunit.client.1.smithi139.stdout:2/624: fdatasync d0/d7/d1a/fcc 0 2024-09-17T07:19:59.100 INFO:tasks.workunit.client.0.smithi087.stdout:5/802: dwrite d5/d18/d20/d2f/f5c [0,4194304] 0 2024-09-17T07:19:59.103 INFO:tasks.workunit.client.0.smithi087.stdout:8/660: dwrite d1/d2b/f6c [0,4194304] 0 2024-09-17T07:19:59.104 INFO:tasks.workunit.client.0.smithi087.stdout:5/803: write d5/d18/d20/d7a/fbf [875488,121844] 0 2024-09-17T07:19:59.106 INFO:tasks.workunit.client.0.smithi087.stdout:4/663: rename d2/f32 to d2/d92/d4d/d21/d2f/d3b/d7e/d97/fe4 0 2024-09-17T07:19:59.109 INFO:tasks.workunit.client.0.smithi087.stdout:4/664: write d2/d92/d4d/d21/f8f [1255773,119007] 0 2024-09-17T07:19:59.109 INFO:tasks.workunit.client.0.smithi087.stdout:4/665: chown d2/d92/d74 225 1 2024-09-17T07:19:59.110 INFO:tasks.workunit.client.0.smithi087.stdout:5/804: mknod d5/d8/da7/db1/c105 0 2024-09-17T07:19:59.111 INFO:tasks.workunit.client.0.smithi087.stdout:5/805: rmdir d5/d8/da7 39 2024-09-17T07:19:59.112 INFO:tasks.workunit.client.1.smithi139.stdout:5/623: dread d4/d16/d1b/d20/d32/f3c [0,4194304] 0 2024-09-17T07:19:59.115 INFO:tasks.workunit.client.0.smithi087.stdout:4/666: link d2/d92/d4d/d21/f6c d2/d92/d4d/d21/d2f/d3b/d7e/d97/fe5 0 2024-09-17T07:19:59.116 INFO:tasks.workunit.client.1.smithi139.stdout:5/624: creat d4/d16/d1b/d20/d67/fc6 x:0 0 0 2024-09-17T07:19:59.117 INFO:tasks.workunit.client.0.smithi087.stdout:4/667: creat d2/d92/d74/fe6 x:0 0 0 2024-09-17T07:19:59.118 INFO:tasks.workunit.client.1.smithi139.stdout:5/625: mkdir d4/dc7 0 2024-09-17T07:19:59.120 INFO:tasks.workunit.client.1.smithi139.stdout:5/626: symlink d4/d16/lc8 0 2024-09-17T07:19:59.121 INFO:tasks.workunit.client.1.smithi139.stdout:5/627: fsync d4/d16/f18 0 2024-09-17T07:19:59.122 INFO:tasks.workunit.client.1.smithi139.stdout:8/697: dread d0/fd [0,4194304] 0 2024-09-17T07:19:59.123 INFO:tasks.workunit.client.1.smithi139.stdout:5/628: fsync d4/d16/d1b/d20/d28/f26 0 2024-09-17T07:19:59.124 INFO:tasks.workunit.client.0.smithi087.stdout:4/668: getdents d2/d92/d4f/d6a 0 2024-09-17T07:19:59.124 INFO:tasks.workunit.client.1.smithi139.stdout:5/629: truncate d4/d16/d1b/d20/fb6 942253 0 2024-09-17T07:19:59.125 INFO:tasks.workunit.client.1.smithi139.stdout:5/630: stat d4/f43 0 2024-09-17T07:19:59.125 INFO:tasks.workunit.client.1.smithi139.stdout:8/698: creat d0/d20/d28/d48/de1/fe6 x:0 0 0 2024-09-17T07:19:59.125 INFO:tasks.workunit.client.0.smithi087.stdout:5/806: dread d5/d12/d14/d61/d94/fdb [0,4194304] 0 2024-09-17T07:19:59.126 INFO:tasks.workunit.client.1.smithi139.stdout:5/631: dread - d4/f43 zero size 2024-09-17T07:19:59.126 INFO:tasks.workunit.client.0.smithi087.stdout:8/661: write d1/d2b/d3b/f62 [3894978,91376] 0 2024-09-17T07:19:59.127 INFO:tasks.workunit.client.1.smithi139.stdout:8/699: write d0/d20/d28/d52/d65/dd3/de4/f1c [2594265,130343] 0 2024-09-17T07:19:59.128 INFO:tasks.workunit.client.0.smithi087.stdout:8/662: dread - d1/fd6 zero size 2024-09-17T07:19:59.128 INFO:tasks.workunit.client.0.smithi087.stdout:5/807: write d5/d18/d6f/de1/d7d/fbc [738331,124950] 0 2024-09-17T07:19:59.129 INFO:tasks.workunit.client.1.smithi139.stdout:8/700: dread - d0/d1a/d3a/d8d/faa zero size 2024-09-17T07:19:59.130 INFO:tasks.workunit.client.1.smithi139.stdout:8/701: fsync d0/d1a/f3f 0 2024-09-17T07:19:59.131 INFO:tasks.workunit.client.0.smithi087.stdout:5/808: write d5/d18/d6f/de1/f8d [799167,2504] 0 2024-09-17T07:19:59.131 INFO:tasks.workunit.client.0.smithi087.stdout:8/663: write d1/d7/d9/d19/d4d/f47 [6795996,117962] 0 2024-09-17T07:19:59.132 INFO:tasks.workunit.client.0.smithi087.stdout:8/664: dread - d1/d5f/f87 zero size 2024-09-17T07:19:59.134 INFO:tasks.workunit.client.0.smithi087.stdout:8/665: dread d1/d7/d9/d19/fb9 [0,4194304] 0 2024-09-17T07:19:59.134 INFO:tasks.workunit.client.0.smithi087.stdout:8/666: readlink d1/d7/d9/l77 0 2024-09-17T07:19:59.137 INFO:tasks.workunit.client.0.smithi087.stdout:8/667: creat d1/d7/d63/dd9/dcf/fe9 x:0 0 0 2024-09-17T07:19:59.137 INFO:tasks.workunit.client.1.smithi139.stdout:8/702: dwrite d0/d20/d28/d52/d99/fc7 [0,4194304] 0 2024-09-17T07:19:59.138 INFO:tasks.workunit.client.1.smithi139.stdout:5/632: dread d4/d5d/f95 [0,4194304] 0 2024-09-17T07:19:59.139 INFO:tasks.workunit.client.0.smithi087.stdout:8/668: write d1/d2b/d21/dd4/fde [3012787,116034] 0 2024-09-17T07:19:59.139 INFO:tasks.workunit.client.1.smithi139.stdout:8/703: symlink d0/d96/le7 0 2024-09-17T07:19:59.142 INFO:tasks.workunit.client.1.smithi139.stdout:5/633: unlink d4/d16/d1b/d20/d32/d76/la0 0 2024-09-17T07:19:59.144 INFO:tasks.workunit.client.0.smithi087.stdout:8/669: link d1/d2b/d3b/c5a d1/d7/d9/d19/d73/cea 0 2024-09-17T07:19:59.144 INFO:tasks.workunit.client.1.smithi139.stdout:5/634: dread - d4/d5d/d97/fa2 zero size 2024-09-17T07:19:59.147 INFO:tasks.workunit.client.1.smithi139.stdout:5/635: write d4/d16/d1b/d20/d38/d4f/f5e [3097795,119021] 0 2024-09-17T07:19:59.147 INFO:tasks.workunit.client.0.smithi087.stdout:8/670: getdents d1/d2b/d21/daf 0 2024-09-17T07:19:59.148 INFO:tasks.workunit.client.1.smithi139.stdout:8/704: dwrite d0/d20/d28/d52/d65/d7f/db6/f6a [0,4194304] 0 2024-09-17T07:19:59.150 INFO:tasks.workunit.client.1.smithi139.stdout:8/705: truncate d0/d20/d28/d48/de1/fe6 797386 0 2024-09-17T07:19:59.151 INFO:tasks.workunit.client.1.smithi139.stdout:5/636: mkdir d4/d16/d1b/d20/d32/d6c/dc9 0 2024-09-17T07:19:59.155 INFO:tasks.workunit.client.1.smithi139.stdout:5/637: mkdir d4/d16/d1b/d20/d28/dca 0 2024-09-17T07:19:59.156 INFO:tasks.workunit.client.0.smithi087.stdout:4/669: dread d2/d92/d4d/d21/f24 [0,4194304] 0 2024-09-17T07:19:59.157 INFO:tasks.workunit.client.0.smithi087.stdout:4/670: readlink d2/d92/d4f/d7b/lc7 0 2024-09-17T07:19:59.157 INFO:tasks.workunit.client.1.smithi139.stdout:8/706: dwrite d0/f7 [0,4194304] 0 2024-09-17T07:19:59.158 INFO:tasks.workunit.client.0.smithi087.stdout:4/671: write d2/d92/f94 [221361,59194] 0 2024-09-17T07:19:59.158 INFO:tasks.workunit.client.1.smithi139.stdout:8/707: truncate d0/d1a/d3a/fdb 179271 0 2024-09-17T07:19:59.159 INFO:tasks.workunit.client.0.smithi087.stdout:4/672: chown d2/d5/d1f/fe1 245433969 1 2024-09-17T07:19:59.161 INFO:tasks.workunit.client.1.smithi139.stdout:8/708: write d0/d1a/d4d/da4/fd9 [1917431,53155] 0 2024-09-17T07:19:59.162 INFO:tasks.workunit.client.0.smithi087.stdout:5/809: dread d5/f15 [0,4194304] 0 2024-09-17T07:19:59.162 INFO:tasks.workunit.client.0.smithi087.stdout:4/673: mknod d2/d92/d4d/d21/d2f/d3b/d7e/d97/ce7 0 2024-09-17T07:19:59.162 INFO:tasks.workunit.client.1.smithi139.stdout:5/638: getdents d4/d16/d1b/d20/d67/d88 0 2024-09-17T07:19:59.164 INFO:tasks.workunit.client.1.smithi139.stdout:8/709: unlink d0/d20/d28/d52/d65/l97 0 2024-09-17T07:19:59.165 INFO:tasks.workunit.client.0.smithi087.stdout:5/810: write d5/d6d/f90 [5135564,70507] 0 2024-09-17T07:19:59.166 INFO:tasks.workunit.client.0.smithi087.stdout:4/674: creat d2/d92/d4f/d7b/fe8 x:0 0 0 2024-09-17T07:19:59.166 INFO:tasks.workunit.client.1.smithi139.stdout:5/639: mkdir d4/d16/d1b/d20/d32/d6c/dc9/dcb 0 2024-09-17T07:19:59.169 INFO:tasks.workunit.client.0.smithi087.stdout:5/811: unlink d5/d18/d20/d2f/d52/cfa 0 2024-09-17T07:19:59.169 INFO:tasks.workunit.client.1.smithi139.stdout:5/640: write d4/d16/d1b/d20/d32/d6c/f70 [827583,124789] 0 2024-09-17T07:19:59.170 INFO:tasks.workunit.client.0.smithi087.stdout:4/675: creat d2/d92/d4f/d6a/d9d/fe9 x:0 0 0 2024-09-17T07:19:59.172 INFO:tasks.workunit.client.1.smithi139.stdout:8/710: dwrite d0/d20/d28/d52/d99/fcf [0,4194304] 0 2024-09-17T07:19:59.173 INFO:tasks.workunit.client.0.smithi087.stdout:4/676: mknod d2/d92/d4d/d21/d2f/d3b/d7e/d97/cea 0 2024-09-17T07:19:59.173 INFO:tasks.workunit.client.0.smithi087.stdout:5/812: link d5/d6d/f81 d5/d18/d20/d2f/f106 0 2024-09-17T07:19:59.174 INFO:tasks.workunit.client.1.smithi139.stdout:8/711: chown d0/d20/d28/d52/d65/d7f/db6/c3e 108177 1 2024-09-17T07:19:59.174 INFO:tasks.workunit.client.1.smithi139.stdout:5/641: mkdir d4/d16/d1b/d20/d28/d3f/dcc 0 2024-09-17T07:19:59.175 INFO:tasks.workunit.client.0.smithi087.stdout:5/813: fdatasync d5/d8/d1f/d4e/da3/fe7 0 2024-09-17T07:19:59.176 INFO:tasks.workunit.client.0.smithi087.stdout:4/677: mkdir d2/d92/d4d/d21/d2f/d6e/deb 0 2024-09-17T07:19:59.177 INFO:tasks.workunit.client.1.smithi139.stdout:8/712: read d0/d1a/f39 [5568211,32488] 0 2024-09-17T07:19:59.178 INFO:tasks.workunit.client.0.smithi087.stdout:4/678: write d2/d92/d4d/d21/d2f/d3b/f9a [4062754,103512] 0 2024-09-17T07:19:59.178 INFO:tasks.workunit.client.0.smithi087.stdout:8/671: truncate d1/d2b/d21/d6d/fa6 2432793 0 2024-09-17T07:19:59.178 INFO:tasks.workunit.client.0.smithi087.stdout:5/814: dread d5/d18/d6f/de1/fd3 [0,4194304] 0 2024-09-17T07:19:59.179 INFO:tasks.workunit.client.1.smithi139.stdout:5/642: creat d4/d16/d1b/d20/d28/d3f/fcd x:0 0 0 2024-09-17T07:19:59.179 INFO:tasks.workunit.client.0.smithi087.stdout:4/679: chown d2/f7 9426 1 2024-09-17T07:19:59.182 INFO:tasks.workunit.client.1.smithi139.stdout:5/643: mknod d4/d5d/dc0/cce 0 2024-09-17T07:19:59.183 INFO:tasks.workunit.client.0.smithi087.stdout:4/680: getdents d2/d92/d86 0 2024-09-17T07:19:59.184 INFO:tasks.workunit.client.1.smithi139.stdout:5/644: fsync d4/d16/f7a 0 2024-09-17T07:19:59.185 INFO:tasks.workunit.client.1.smithi139.stdout:8/713: dwrite d0/d1a/d4d/fcb [0,4194304] 0 2024-09-17T07:19:59.187 INFO:tasks.workunit.client.0.smithi087.stdout:8/672: dwrite d1/d7/d63/dd9/dcf/fe9 [0,4194304] 0 2024-09-17T07:19:59.188 INFO:tasks.workunit.client.1.smithi139.stdout:5/645: unlink d4/d16/fba 0 2024-09-17T07:19:59.188 INFO:tasks.workunit.client.1.smithi139.stdout:8/714: creat d0/d20/d28/d48/fe8 x:0 0 0 2024-09-17T07:19:59.191 INFO:tasks.workunit.client.1.smithi139.stdout:8/715: creat d0/d20/d28/d52/d65/dbe/fe9 x:0 0 0 2024-09-17T07:19:59.192 INFO:tasks.workunit.client.0.smithi087.stdout:8/673: creat d1/feb x:0 0 0 2024-09-17T07:19:59.193 INFO:tasks.workunit.client.1.smithi139.stdout:5/646: unlink d4/d16/d1b/d20/d32/d72/l9d 0 2024-09-17T07:19:59.205 INFO:tasks.workunit.client.0.smithi087.stdout:6/761: sync 2024-09-17T07:19:59.205 INFO:tasks.workunit.client.0.smithi087.stdout:2/644: sync 2024-09-17T07:19:59.205 INFO:tasks.workunit.client.1.smithi139.stdout:5/647: truncate d4/d16/d1b/d20/d32/f3c 747702 0 2024-09-17T07:19:59.209 INFO:tasks.workunit.client.1.smithi139.stdout:5/648: rename d4/d16/d69/c71 to d4/d16/d1b/d20/d32/d6c/ccf 0 2024-09-17T07:19:59.210 INFO:tasks.workunit.client.1.smithi139.stdout:8/716: dwrite d0/d1a/d4d/d53/f5d [0,4194304] 0 2024-09-17T07:19:59.210 INFO:tasks.workunit.client.0.smithi087.stdout:6/762: creat d1/d67/dfe/d2c/d48/d9b/f101 x:0 0 0 2024-09-17T07:19:59.211 INFO:tasks.workunit.client.1.smithi139.stdout:5/649: fdatasync d4/d16/d1b/d20/d32/d6c/f70 0 2024-09-17T07:19:59.211 INFO:tasks.workunit.client.0.smithi087.stdout:5/815: dread d5/d12/d14/f7b [0,4194304] 0 2024-09-17T07:19:59.213 INFO:tasks.workunit.client.1.smithi139.stdout:5/650: chown d4/d16/d1b/l47 21 1 2024-09-17T07:19:59.213 INFO:tasks.workunit.client.0.smithi087.stdout:6/763: mknod d1/d67/dfe/d2c/c102 0 2024-09-17T07:19:59.215 INFO:tasks.workunit.client.0.smithi087.stdout:5/816: rename d5/d6d/f80 to d5/d8/d1f/d4e/da3/d102/f107 0 2024-09-17T07:19:59.216 INFO:tasks.workunit.client.1.smithi139.stdout:5/651: creat d4/d5d/d97/da4/dbf/fd0 x:0 0 0 2024-09-17T07:19:59.217 INFO:tasks.workunit.client.1.smithi139.stdout:8/717: dread d0/d20/d28/d52/d65/fad [0,4194304] 0 2024-09-17T07:19:59.218 INFO:tasks.workunit.client.0.smithi087.stdout:4/681: truncate d2/d92/d4d/d42/f9b 5203771 0 2024-09-17T07:19:59.219 INFO:tasks.workunit.client.1.smithi139.stdout:8/718: write d0/d20/d28/d52/d65/d7f/db6/fb9 [801829,22611] 0 2024-09-17T07:19:59.219 INFO:tasks.workunit.client.0.smithi087.stdout:4/682: dread - d2/d92/fda zero size 2024-09-17T07:19:59.221 INFO:tasks.workunit.client.1.smithi139.stdout:5/652: unlink d4/d16/f7a 0 2024-09-17T07:19:59.222 INFO:tasks.workunit.client.1.smithi139.stdout:8/719: creat d0/d20/d28/fea x:0 0 0 2024-09-17T07:19:59.225 INFO:tasks.workunit.client.1.smithi139.stdout:8/720: mkdir d0/d20/d28/d52/d65/dbe/deb 0 2024-09-17T07:19:59.226 INFO:tasks.workunit.client.1.smithi139.stdout:8/721: fsync d0/f7d 0 2024-09-17T07:19:59.226 INFO:tasks.workunit.client.0.smithi087.stdout:5/817: dwrite d5/d18/d20/d2f/d83/dac/fc9 [0,4194304] 0 2024-09-17T07:19:59.227 INFO:tasks.workunit.client.1.smithi139.stdout:5/653: link d4/d16/d1b/d20/d38/d4f/fa6 d4/d16/d1b/d20/fd1 0 2024-09-17T07:19:59.229 INFO:tasks.workunit.client.0.smithi087.stdout:6/764: truncate d1/d67/dfe/d2c/d40/f4d 557399 0 2024-09-17T07:19:59.232 INFO:tasks.workunit.client.1.smithi139.stdout:5/654: creat d4/d16/d1b/d20/d28/d3f/dcc/fd2 x:0 0 0 2024-09-17T07:19:59.234 INFO:tasks.workunit.client.1.smithi139.stdout:5/655: mknod d4/d16/d1b/d20/d32/d3d/cd3 0 2024-09-17T07:19:59.237 INFO:tasks.workunit.client.1.smithi139.stdout:5/656: mkdir d4/d16/d1b/d20/d38/dd4 0 2024-09-17T07:19:59.238 INFO:tasks.workunit.client.0.smithi087.stdout:6/765: dwrite d1/d6/f12 [8388608,4194304] 0 2024-09-17T07:19:59.238 INFO:tasks.workunit.client.0.smithi087.stdout:4/683: dwrite d2/d92/d4d/d3e/f52 [0,4194304] 0 2024-09-17T07:19:59.239 INFO:tasks.workunit.client.1.smithi139.stdout:5/657: creat d4/fd5 x:0 0 0 2024-09-17T07:19:59.240 INFO:tasks.workunit.client.0.smithi087.stdout:2/645: dread d2/d7/f68 [0,4194304] 0 2024-09-17T07:19:59.240 INFO:tasks.workunit.client.1.smithi139.stdout:5/658: fsync d4/d16/d1b/d20/d67/d88/fad 0 2024-09-17T07:19:59.241 INFO:tasks.workunit.client.0.smithi087.stdout:6/766: stat d1/d67/dfe/l83 0 2024-09-17T07:19:59.242 INFO:tasks.workunit.client.0.smithi087.stdout:4/684: creat d2/d92/d4d/d3e/fec x:0 0 0 2024-09-17T07:19:59.244 INFO:tasks.workunit.client.0.smithi087.stdout:4/685: read - d2/d92/d4d/d42/fcc zero size 2024-09-17T07:19:59.245 INFO:tasks.workunit.client.0.smithi087.stdout:6/767: rename d1/fa5 to d1/d6a/dda/f103 0 2024-09-17T07:19:59.246 INFO:tasks.workunit.client.0.smithi087.stdout:4/686: dread - d2/d92/d4d/d42/db6/fcd zero size 2024-09-17T07:19:59.247 INFO:tasks.workunit.client.0.smithi087.stdout:6/768: fsync d1/d67/dfe/d2c/d33/fd3 0 2024-09-17T07:19:59.249 INFO:tasks.workunit.client.0.smithi087.stdout:4/687: symlink d2/d22/d2c/d96/led 0 2024-09-17T07:19:59.250 INFO:tasks.workunit.client.0.smithi087.stdout:6/769: write d1/d6/fc1 [747438,88746] 0 2024-09-17T07:19:59.253 INFO:tasks.workunit.client.0.smithi087.stdout:4/688: fsync d2/d92/d4d/d21/d2f/d3b/d7e/d97/fe5 0 2024-09-17T07:19:59.254 INFO:tasks.workunit.client.1.smithi139.stdout:5/659: dread d4/d16/d1b/d20/d32/f3c [0,4194304] 0 2024-09-17T07:19:59.257 INFO:tasks.workunit.client.0.smithi087.stdout:4/689: dread d2/fde [0,4194304] 0 2024-09-17T07:19:59.257 INFO:tasks.workunit.client.1.smithi139.stdout:5/660: creat d4/d16/d1b/d20/d32/d6c/dc9/fd6 x:0 0 0 2024-09-17T07:19:59.258 INFO:tasks.workunit.client.0.smithi087.stdout:4/690: write d2/d92/d4d/d3e/f52 [2991907,1080] 0 2024-09-17T07:19:59.258 INFO:tasks.workunit.client.1.smithi139.stdout:5/661: dread - d4/d16/d1b/d20/d38/fa3 zero size 2024-09-17T07:19:59.261 INFO:tasks.workunit.client.0.smithi087.stdout:5/818: dread d5/d12/d4d/f47 [0,4194304] 0 2024-09-17T07:19:59.264 INFO:tasks.workunit.client.0.smithi087.stdout:5/819: link d5/d18/d6f/de1/ce2 d5/d12/d56/df5/c108 0 2024-09-17T07:19:59.265 INFO:tasks.workunit.client.0.smithi087.stdout:5/820: write d5/d8/d1f/d4e/da3/fe7 [656325,123690] 0 2024-09-17T07:19:59.267 INFO:tasks.workunit.client.0.smithi087.stdout:5/821: truncate d5/d18/d6f/de1/f8d 942792 0 2024-09-17T07:19:59.273 INFO:tasks.workunit.client.0.smithi087.stdout:4/691: write d2/d92/d4d/f64 [1853996,94433] 0 2024-09-17T07:19:59.276 INFO:tasks.workunit.client.0.smithi087.stdout:4/692: chown d2/d5/d1f/f5e 5 1 2024-09-17T07:19:59.276 INFO:tasks.workunit.client.0.smithi087.stdout:6/770: dread d1/f18 [0,4194304] 0 2024-09-17T07:19:59.277 INFO:tasks.workunit.client.0.smithi087.stdout:2/646: dwrite d2/d7/dd/d10/f53 [0,4194304] 0 2024-09-17T07:19:59.281 INFO:tasks.workunit.client.0.smithi087.stdout:5/822: dwrite d5/d12/d14/d61/d94/fdb [0,4194304] 0 2024-09-17T07:19:59.283 INFO:tasks.workunit.client.0.smithi087.stdout:5/823: stat d5/d12/d56/c97 0 2024-09-17T07:19:59.284 INFO:tasks.workunit.client.0.smithi087.stdout:6/771: symlink d1/d67/dfe/d2c/d40/dd2/l104 0 2024-09-17T07:19:59.287 INFO:tasks.workunit.client.0.smithi087.stdout:4/693: dwrite d2/d92/d4f/fbc [4194304,4194304] 0 2024-09-17T07:19:59.291 INFO:tasks.workunit.client.0.smithi087.stdout:5/824: rename d5/d12/d1c/d71/fd5 to d5/d12/f109 0 2024-09-17T07:19:59.297 INFO:tasks.workunit.client.0.smithi087.stdout:5/825: getdents d5/d18/d6f/de1/d7d 0 2024-09-17T07:19:59.300 INFO:tasks.workunit.client.0.smithi087.stdout:2/647: dwrite d2/d50/f90 [0,4194304] 0 2024-09-17T07:19:59.302 INFO:tasks.workunit.client.0.smithi087.stdout:6/772: dwrite d1/d6/f2a [8388608,4194304] 0 2024-09-17T07:19:59.304 INFO:tasks.workunit.client.0.smithi087.stdout:2/648: creat d2/d7/dd/d10/d4c/dcc/fcd x:0 0 0 2024-09-17T07:19:59.306 INFO:tasks.workunit.client.0.smithi087.stdout:6/773: symlink d1/d67/dfe/d2c/d58/l105 0 2024-09-17T07:19:59.307 INFO:tasks.workunit.client.0.smithi087.stdout:2/649: mkdir d2/d15/dce 0 2024-09-17T07:19:59.308 INFO:tasks.workunit.client.0.smithi087.stdout:6/774: creat d1/d67/dfe/d5e/f106 x:0 0 0 2024-09-17T07:19:59.309 INFO:tasks.workunit.client.0.smithi087.stdout:2/650: fdatasync d2/d7/d33/fa9 0 2024-09-17T07:19:59.310 INFO:tasks.workunit.client.0.smithi087.stdout:6/775: fsync d1/d67/dfe/d2c/d48/d9b/fa2 0 2024-09-17T07:19:59.311 INFO:tasks.workunit.client.0.smithi087.stdout:6/776: fdatasync d1/d67/dfe/f57 0 2024-09-17T07:19:59.312 INFO:tasks.workunit.client.0.smithi087.stdout:2/651: dread - d2/d7/dd/d6a/d6d/f77 zero size 2024-09-17T07:19:59.315 INFO:tasks.workunit.client.0.smithi087.stdout:2/652: mkdir d2/d7/dd/d6a/dcf 0 2024-09-17T07:19:59.319 INFO:tasks.workunit.client.0.smithi087.stdout:4/694: dread d2/d92/d4d/d21/d2f/f47 [4194304,4194304] 0 2024-09-17T07:19:59.319 INFO:tasks.workunit.client.0.smithi087.stdout:2/653: rename d2/d7/fe to d2/d50/db8/fd0 0 2024-09-17T07:19:59.322 INFO:tasks.workunit.client.0.smithi087.stdout:4/695: mknod d2/d22/d2c/d91/cee 0 2024-09-17T07:19:59.323 INFO:tasks.workunit.client.0.smithi087.stdout:4/696: readlink d2/d92/d4d/d21/l89 0 2024-09-17T07:19:59.323 INFO:tasks.workunit.client.0.smithi087.stdout:2/654: fsync d2/d7/d60/f65 0 2024-09-17T07:19:59.325 INFO:tasks.workunit.client.0.smithi087.stdout:5/826: dread d5/d8/d1f/f92 [0,4194304] 0 2024-09-17T07:19:59.325 INFO:tasks.workunit.client.0.smithi087.stdout:4/697: truncate d2/d92/d4d/f75 1896923 0 2024-09-17T07:19:59.327 INFO:tasks.workunit.client.0.smithi087.stdout:2/655: fsync d2/d24/d36/f39 0 2024-09-17T07:19:59.329 INFO:tasks.workunit.client.0.smithi087.stdout:5/827: dread d5/d6d/fbd [0,4194304] 0 2024-09-17T07:19:59.333 INFO:tasks.workunit.client.0.smithi087.stdout:5/828: getdents d5/d12/d56/d9e 0 2024-09-17T07:19:59.334 INFO:tasks.workunit.client.0.smithi087.stdout:4/698: dwrite d2/d92/d4d/d21/d2f/d6e/f78 [0,4194304] 0 2024-09-17T07:19:59.336 INFO:tasks.workunit.client.0.smithi087.stdout:4/699: fdatasync d2/d22/d2c/d91/fd1 0 2024-09-17T07:19:59.336 INFO:tasks.workunit.client.0.smithi087.stdout:6/777: truncate d1/d6/f12 8908389 0 2024-09-17T07:19:59.337 INFO:tasks.workunit.client.0.smithi087.stdout:2/656: dwrite d2/d15/f2c [0,4194304] 0 2024-09-17T07:19:59.342 INFO:tasks.workunit.client.0.smithi087.stdout:4/700: creat d2/d92/d86/fef x:0 0 0 2024-09-17T07:19:59.344 INFO:tasks.workunit.client.0.smithi087.stdout:5/829: creat d5/d18/d20/f10a x:0 0 0 2024-09-17T07:19:59.344 INFO:tasks.workunit.client.0.smithi087.stdout:2/657: dread - d2/d7/dd/d10/d4c/d5f/d8b/fc2 zero size 2024-09-17T07:19:59.345 INFO:tasks.workunit.client.0.smithi087.stdout:4/701: stat d2/d22/d2c/fc0 0 2024-09-17T07:19:59.346 INFO:tasks.workunit.client.0.smithi087.stdout:5/830: write d5/d18/d20/f10a [653067,45128] 0 2024-09-17T07:19:59.349 INFO:tasks.workunit.client.0.smithi087.stdout:6/778: link d1/d67/dfe/d2c/d48/la7 d1/d67/dfe/d2c/d48/d9b/dac/l107 0 2024-09-17T07:19:59.351 INFO:tasks.workunit.client.0.smithi087.stdout:5/831: symlink d5/d12/d1c/d71/l10b 0 2024-09-17T07:19:59.354 INFO:tasks.workunit.client.0.smithi087.stdout:5/832: write d5/d12/d56/d9e/dcb/fd4 [944751,85637] 0 2024-09-17T07:19:59.354 INFO:tasks.workunit.client.0.smithi087.stdout:2/658: dwrite d2/d50/fb9 [0,4194304] 0 2024-09-17T07:19:59.356 INFO:tasks.workunit.client.0.smithi087.stdout:6/779: truncate d1/d67/dfe/d2c/f59 1004210 0 2024-09-17T07:19:59.357 INFO:tasks.workunit.client.0.smithi087.stdout:2/659: unlink d2/d12/c1c 0 2024-09-17T07:19:59.359 INFO:tasks.workunit.client.0.smithi087.stdout:2/660: chown d2/d48/da2/d3a/f6f 10 1 2024-09-17T07:19:59.360 INFO:tasks.workunit.client.0.smithi087.stdout:5/833: rename d5/d18/d20/d2f/l8f to d5/d18/d20/l10c 0 2024-09-17T07:19:59.363 INFO:tasks.workunit.client.0.smithi087.stdout:2/661: rename d2/d7/d30 to d2/d15/dce/dd1 0 2024-09-17T07:19:59.364 INFO:tasks.workunit.client.0.smithi087.stdout:6/780: link d1/d67/dfe/d2c/d48/c95 d1/d67/dfe/d2c/d40/d4c/d77/c108 0 2024-09-17T07:19:59.369 INFO:tasks.workunit.client.0.smithi087.stdout:5/834: read d5/d8/f3f [523437,8363] 0 2024-09-17T07:19:59.374 INFO:tasks.workunit.client.0.smithi087.stdout:5/835: dread d5/d6d/f81 [0,4194304] 0 2024-09-17T07:19:59.374 INFO:tasks.workunit.client.0.smithi087.stdout:4/702: dread d2/d92/d4d/d21/d2f/d3b/d7e/d97/fe4 [0,4194304] 0 2024-09-17T07:19:59.376 INFO:tasks.workunit.client.0.smithi087.stdout:5/836: truncate d5/d12/d56/d9e/fdc 121760 0 2024-09-17T07:19:59.379 INFO:tasks.workunit.client.0.smithi087.stdout:5/837: readlink d5/d8/d1f/de4/lef 0 2024-09-17T07:19:59.382 INFO:tasks.workunit.client.0.smithi087.stdout:4/703: dwrite d2/d22/d2c/fc0 [0,4194304] 0 2024-09-17T07:19:59.386 INFO:tasks.workunit.client.0.smithi087.stdout:4/704: creat d2/d92/d4f/ff0 x:0 0 0 2024-09-17T07:19:59.388 INFO:tasks.workunit.client.0.smithi087.stdout:1/533: sync 2024-09-17T07:19:59.388 INFO:tasks.workunit.client.0.smithi087.stdout:4/705: symlink d2/d22/d2c/d91/lf1 0 2024-09-17T07:19:59.391 INFO:tasks.workunit.client.0.smithi087.stdout:2/662: write d2/d7/d33/f72 [162761,98571] 0 2024-09-17T07:19:59.391 INFO:tasks.workunit.client.0.smithi087.stdout:1/534: dread - d2/d3d/d8e/fb2 zero size 2024-09-17T07:19:59.391 INFO:tasks.workunit.client.0.smithi087.stdout:6/781: write d1/f16 [2704797,29481] 0 2024-09-17T07:19:59.394 INFO:tasks.workunit.client.0.smithi087.stdout:2/663: symlink d2/d12/d85/ld2 0 2024-09-17T07:19:59.396 INFO:tasks.workunit.client.0.smithi087.stdout:6/782: getdents d1/d67/dfe/d2c/d58/d90/def 0 2024-09-17T07:19:59.399 INFO:tasks.workunit.client.0.smithi087.stdout:2/664: dread d2/d15/dce/dd1/d3f/f8c [0,4194304] 0 2024-09-17T07:19:59.400 INFO:tasks.workunit.client.0.smithi087.stdout:5/838: dwrite d5/d12/fd1 [0,4194304] 0 2024-09-17T07:19:59.401 INFO:tasks.workunit.client.0.smithi087.stdout:1/535: dread d2/d3d/d45/d90/f96 [0,4194304] 0 2024-09-17T07:19:59.405 INFO:tasks.workunit.client.0.smithi087.stdout:1/536: creat d2/d3d/d8e/fba x:0 0 0 2024-09-17T07:19:59.405 INFO:tasks.workunit.client.0.smithi087.stdout:2/665: chown d2/d15/dce/dd1/cb2 368 1 2024-09-17T07:19:59.406 INFO:tasks.workunit.client.0.smithi087.stdout:1/537: readlink d2/d48/d61/l99 0 2024-09-17T07:19:59.409 INFO:tasks.workunit.client.0.smithi087.stdout:1/538: mknod d2/da/cbb 0 2024-09-17T07:19:59.409 INFO:tasks.workunit.client.0.smithi087.stdout:6/783: dwrite d1/f11 [0,4194304] 0 2024-09-17T07:19:59.410 INFO:tasks.workunit.client.0.smithi087.stdout:4/706: dread d2/d92/d4f/fbc [0,4194304] 0 2024-09-17T07:19:59.411 INFO:tasks.workunit.client.0.smithi087.stdout:2/666: truncate d2/d7/dd/d10/d4c/d5f/f92 481287 0 2024-09-17T07:19:59.415 INFO:tasks.workunit.client.0.smithi087.stdout:1/539: rename d2/d3d/d45/d90/d43/d5d/f86 to d2/da/d7e/db9/fbc 0 2024-09-17T07:19:59.415 INFO:tasks.workunit.client.0.smithi087.stdout:4/707: mknod d2/d22/d95/cf2 0 2024-09-17T07:19:59.417 INFO:tasks.workunit.client.0.smithi087.stdout:6/784: rename d1/d67/dfe/d2c/d40/d4c/da1/fc3 to d1/d67/dfe/d2c/d58/d90/def/f109 0 2024-09-17T07:19:59.419 INFO:tasks.workunit.client.0.smithi087.stdout:1/540: write d2/d69/fa4 [1033082,41915] 0 2024-09-17T07:19:59.419 INFO:tasks.workunit.client.0.smithi087.stdout:2/667: creat d2/d7/dd/fd3 x:0 0 0 2024-09-17T07:19:59.419 INFO:tasks.workunit.client.0.smithi087.stdout:6/785: chown d1/d67/dfe/d4e/f63 528371 1 2024-09-17T07:19:59.421 INFO:tasks.workunit.client.0.smithi087.stdout:4/708: rename d2/d92/d4d/ddf to d2/d92/d4f/d6a/df3 0 2024-09-17T07:19:59.422 INFO:tasks.workunit.client.0.smithi087.stdout:6/786: mknod d1/d67/dfe/d4e/de1/c10a 0 2024-09-17T07:19:59.426 INFO:tasks.workunit.client.0.smithi087.stdout:6/787: symlink d1/d67/dfe/d5e/d8f/dd5/l10b 0 2024-09-17T07:19:59.428 INFO:tasks.workunit.client.0.smithi087.stdout:1/541: dwrite d2/d3d/fa7 [0,4194304] 0 2024-09-17T07:19:59.434 INFO:tasks.workunit.client.0.smithi087.stdout:6/788: dwrite d1/d6/f2a [8388608,4194304] 0 2024-09-17T07:19:59.435 INFO:tasks.workunit.client.0.smithi087.stdout:1/542: creat d2/d3d/fbd x:0 0 0 2024-09-17T07:19:59.437 INFO:tasks.workunit.client.0.smithi087.stdout:1/543: symlink d2/da/lbe 0 2024-09-17T07:19:59.438 INFO:tasks.workunit.client.0.smithi087.stdout:1/544: stat d2/d14/c3f 0 2024-09-17T07:19:59.439 INFO:tasks.workunit.client.0.smithi087.stdout:6/789: rmdir d1/d67/dfe/d2c/d58/d90/da9/db6 39 2024-09-17T07:19:59.442 INFO:tasks.workunit.client.0.smithi087.stdout:1/545: link d2/d3d/d45/d90/f20 d2/da/d7e/fbf 0 2024-09-17T07:19:59.444 INFO:tasks.workunit.client.0.smithi087.stdout:1/546: creat d2/d14/fc0 x:0 0 0 2024-09-17T07:19:59.446 INFO:tasks.workunit.client.0.smithi087.stdout:1/547: creat d2/d48/d6f/fc1 x:0 0 0 2024-09-17T07:19:59.447 INFO:tasks.workunit.client.0.smithi087.stdout:1/548: chown d2/c15 95 1 2024-09-17T07:19:59.448 INFO:tasks.workunit.client.0.smithi087.stdout:1/549: write d2/d3d/d35/d57/d73/f8a [776948,121300] 0 2024-09-17T07:19:59.449 INFO:tasks.workunit.client.0.smithi087.stdout:1/550: readlink d2/l75 0 2024-09-17T07:19:59.450 INFO:tasks.workunit.client.0.smithi087.stdout:1/551: stat d2/d3d/d45/d90/fae 0 2024-09-17T07:19:59.451 INFO:tasks.workunit.client.0.smithi087.stdout:1/552: rmdir d2/d3d/d8e 39 2024-09-17T07:19:59.453 INFO:tasks.workunit.client.0.smithi087.stdout:1/553: mknod d2/d69/d8d/da6/cc2 0 2024-09-17T07:19:59.457 INFO:tasks.workunit.client.0.smithi087.stdout:1/554: dwrite d2/da/d7e/f83 [0,4194304] 0 2024-09-17T07:19:59.463 INFO:tasks.workunit.client.0.smithi087.stdout:1/555: truncate d2/d3d/d8e/fa9 5229135 0 2024-09-17T07:19:59.464 INFO:tasks.workunit.client.0.smithi087.stdout:6/790: dwrite d1/d67/dfe/d2c/d58/f92 [0,4194304] 0 2024-09-17T07:19:59.466 INFO:tasks.workunit.client.0.smithi087.stdout:1/556: write d2/d3d/d35/d57/d73/f8a [990694,46924] 0 2024-09-17T07:19:59.468 INFO:tasks.workunit.client.0.smithi087.stdout:6/791: mknod d1/d67/dfe/d2c/d58/d90/c10c 0 2024-09-17T07:19:59.490 INFO:tasks.workunit.client.0.smithi087.stdout:1/557: dread d2/d3d/d45/d90/d37/f38 [0,4194304] 0 2024-09-17T07:19:59.491 INFO:tasks.workunit.client.0.smithi087.stdout:6/792: dwrite d1/f42 [0,4194304] 0 2024-09-17T07:19:59.494 INFO:tasks.workunit.client.0.smithi087.stdout:1/558: mkdir d2/d3d/db4/dc3 0 2024-09-17T07:19:59.497 INFO:tasks.workunit.client.0.smithi087.stdout:1/559: creat d2/d3d/d45/d90/d43/d5d/fc4 x:0 0 0 2024-09-17T07:19:59.501 INFO:tasks.workunit.client.0.smithi087.stdout:6/793: dwrite d1/d67/dfe/d2c/d33/f3d [0,4194304] 0 2024-09-17T07:19:59.502 INFO:tasks.workunit.client.0.smithi087.stdout:1/560: creat d2/d1a/fc5 x:0 0 0 2024-09-17T07:19:59.503 INFO:tasks.workunit.client.0.smithi087.stdout:1/561: write d2/d3d/d45/f72 [490974,18777] 0 2024-09-17T07:19:59.507 INFO:tasks.workunit.client.0.smithi087.stdout:1/562: creat d2/d3d/d45/fc6 x:0 0 0 2024-09-17T07:19:59.508 INFO:tasks.workunit.client.0.smithi087.stdout:6/794: mkdir d1/d67/dfe/d2c/d58/d90/da9/d10d 0 2024-09-17T07:19:59.511 INFO:tasks.workunit.client.0.smithi087.stdout:6/795: fsync d1/d67/dfe/d2c/d58/d90/def/f109 0 2024-09-17T07:19:59.513 INFO:tasks.workunit.client.0.smithi087.stdout:6/796: creat d1/d67/dfe/d2c/d40/d4c/dce/f10e x:0 0 0 2024-09-17T07:19:59.513 INFO:tasks.workunit.client.0.smithi087.stdout:6/797: truncate d1/f11 4381240 0 2024-09-17T07:19:59.516 INFO:tasks.workunit.client.0.smithi087.stdout:6/798: creat d1/d67/dfe/d2c/d40/d4c/d77/f10f x:0 0 0 2024-09-17T07:19:59.516 INFO:tasks.workunit.client.0.smithi087.stdout:1/563: fsync d2/d3d/d45/d90/d43/d5d/fc4 0 2024-09-17T07:19:59.517 INFO:tasks.workunit.client.0.smithi087.stdout:1/564: write d2/da/d9a/fab [51457,34211] 0 2024-09-17T07:19:59.518 INFO:tasks.workunit.client.0.smithi087.stdout:6/799: mkdir d1/d67/d110 0 2024-09-17T07:19:59.525 INFO:tasks.workunit.client.0.smithi087.stdout:1/565: dwrite d2/d14/fac [0,4194304] 0 2024-09-17T07:19:59.527 INFO:tasks.workunit.client.0.smithi087.stdout:6/800: dwrite d1/d67/dfe/d2c/d58/d90/da9/db6/fba [0,4194304] 0 2024-09-17T07:19:59.529 INFO:tasks.workunit.client.0.smithi087.stdout:6/801: rmdir d1/d67/dfe/d4e 39 2024-09-17T07:19:59.536 INFO:tasks.workunit.client.0.smithi087.stdout:6/802: write d1/d67/dfe/d2c/d40/d4c/da1/fde [360923,127249] 0 2024-09-17T07:19:59.537 INFO:tasks.workunit.client.0.smithi087.stdout:1/566: dwrite d2/d14/fc0 [0,4194304] 0 2024-09-17T07:19:59.537 INFO:tasks.workunit.client.0.smithi087.stdout:6/803: chown d1/d67/dfe/d2c/d58/d90/def 0 1 2024-09-17T07:19:59.539 INFO:tasks.workunit.client.0.smithi087.stdout:1/567: write d2/d48/f9b [1413216,17040] 0 2024-09-17T07:19:59.542 INFO:tasks.workunit.client.0.smithi087.stdout:1/568: symlink d2/d3d/db4/lc7 0 2024-09-17T07:19:59.545 INFO:tasks.workunit.client.0.smithi087.stdout:6/804: getdents d1/d67/dfe/d2c/d58/d90/da9/db6 0 2024-09-17T07:19:59.550 INFO:tasks.workunit.client.0.smithi087.stdout:6/805: dwrite d1/d67/dfe/d2c/d58/d90/fcb [0,4194304] 0 2024-09-17T07:19:59.559 INFO:tasks.workunit.client.0.smithi087.stdout:6/806: dwrite d1/d67/dfe/d4e/f50 [0,4194304] 0 2024-09-17T07:19:59.562 INFO:tasks.workunit.client.0.smithi087.stdout:1/569: dwrite d2/d3d/d45/d90/f20 [0,4194304] 0 2024-09-17T07:19:59.566 INFO:tasks.workunit.client.0.smithi087.stdout:1/570: symlink d2/d48/d61/lc8 0 2024-09-17T07:19:59.570 INFO:tasks.workunit.client.0.smithi087.stdout:1/571: fdatasync d2/da/f9c 0 2024-09-17T07:19:59.571 INFO:tasks.workunit.client.0.smithi087.stdout:6/807: link d1/d67/dfe/d2c/d48/l53 d1/d67/dfe/d2c/d58/d90/da9/db6/l111 0 2024-09-17T07:19:59.573 INFO:tasks.workunit.client.0.smithi087.stdout:1/572: creat d2/d3d/db4/fc9 x:0 0 0 2024-09-17T07:19:59.574 INFO:tasks.workunit.client.0.smithi087.stdout:6/808: link d1/f11 d1/d67/db7/f112 0 2024-09-17T07:19:59.575 INFO:tasks.workunit.client.0.smithi087.stdout:1/573: symlink d2/d3d/d45/d90/d43/d5d/lca 0 2024-09-17T07:19:59.576 INFO:tasks.workunit.client.0.smithi087.stdout:6/809: stat d1/d67/dfe/d2c/d40/d4c/dce/ff1 0 2024-09-17T07:19:59.583 INFO:tasks.workunit.client.0.smithi087.stdout:1/574: dwrite d2/d48/d61/fb6 [0,4194304] 0 2024-09-17T07:19:59.583 INFO:tasks.workunit.client.1.smithi139.stdout:1/368: sync 2024-09-17T07:19:59.584 INFO:tasks.workunit.client.0.smithi087.stdout:6/810: dwrite d1/d67/dfe/d2c/d58/d90/fee [0,4194304] 0 2024-09-17T07:19:59.589 INFO:tasks.workunit.client.1.smithi139.stdout:1/369: dwrite d2/f15 [4194304,4194304] 0 2024-09-17T07:19:59.591 INFO:tasks.workunit.client.0.smithi087.stdout:0/894: sync 2024-09-17T07:19:59.591 INFO:tasks.workunit.client.0.smithi087.stdout:7/510: sync 2024-09-17T07:19:59.591 INFO:tasks.workunit.client.0.smithi087.stdout:3/662: sync 2024-09-17T07:19:59.591 INFO:tasks.workunit.client.0.smithi087.stdout:8/674: sync 2024-09-17T07:19:59.591 INFO:tasks.workunit.client.0.smithi087.stdout:9/632: sync 2024-09-17T07:19:59.593 INFO:tasks.workunit.client.1.smithi139.stdout:1/370: rename d2/c54 to d2/d10/d12/d1a/c79 0 2024-09-17T07:19:59.595 INFO:tasks.workunit.client.0.smithi087.stdout:7/511: chown d0/d3/f1f 4462 1 2024-09-17T07:19:59.595 INFO:tasks.workunit.client.0.smithi087.stdout:6/811: creat d1/f113 x:0 0 0 2024-09-17T07:19:59.596 INFO:tasks.workunit.client.1.smithi139.stdout:1/371: symlink d2/d10/d12/d35/l7a 0 2024-09-17T07:19:59.596 INFO:tasks.workunit.client.0.smithi087.stdout:1/575: dread d2/dc/f3a [0,4194304] 0 2024-09-17T07:19:59.600 INFO:tasks.workunit.client.0.smithi087.stdout:0/895: creat db/d45/d7b/d90/dd9/de6/f137 x:0 0 0 2024-09-17T07:19:59.603 INFO:tasks.workunit.client.0.smithi087.stdout:8/675: dread d1/d7/f2d [0,4194304] 0 2024-09-17T07:19:59.605 INFO:tasks.workunit.client.0.smithi087.stdout:0/896: chown db/c2c 33 1 2024-09-17T07:19:59.606 INFO:tasks.workunit.client.0.smithi087.stdout:9/633: rename d3/d4/d16/dc0/c66 to d3/ce4 0 2024-09-17T07:19:59.607 INFO:tasks.workunit.client.0.smithi087.stdout:7/512: creat d0/d3/f9f x:0 0 0 2024-09-17T07:19:59.608 INFO:tasks.workunit.client.0.smithi087.stdout:9/634: chown d3/d4/d6/d8/d12/d32/db2 0 1 2024-09-17T07:19:59.609 INFO:tasks.workunit.client.0.smithi087.stdout:1/576: dread d2/d48/d61/f85 [0,4194304] 0 2024-09-17T07:19:59.609 INFO:tasks.workunit.client.0.smithi087.stdout:8/676: rename d1/d7/d9/d27/fa9 to d1/d7/d9/d27/da1/fec 0 2024-09-17T07:19:59.611 INFO:tasks.workunit.client.0.smithi087.stdout:0/897: write db/d4f/fda [3167340,92388] 0 2024-09-17T07:19:59.611 INFO:tasks.workunit.client.0.smithi087.stdout:7/513: mknod d0/d3/d23/d17/d7b/ca0 0 2024-09-17T07:19:59.613 INFO:tasks.workunit.client.0.smithi087.stdout:1/577: rmdir d2/dc 39 2024-09-17T07:19:59.614 INFO:tasks.workunit.client.0.smithi087.stdout:1/578: write d2/d3d/d45/d90/d43/d5d/fc4 [769537,89405] 0 2024-09-17T07:19:59.615 INFO:tasks.workunit.client.0.smithi087.stdout:9/635: rmdir d3/d4/d6/d8/d22/d43/d84/dc7 39 2024-09-17T07:19:59.616 INFO:tasks.workunit.client.0.smithi087.stdout:0/898: mknod db/d45/d5b/d92/de8/c138 0 2024-09-17T07:19:59.616 INFO:tasks.workunit.client.0.smithi087.stdout:7/514: dread d0/d3/d10/d31/f63 [0,4194304] 0 2024-09-17T07:19:59.617 INFO:tasks.workunit.client.0.smithi087.stdout:8/677: mknod d1/d7/ced 0 2024-09-17T07:19:59.617 INFO:tasks.workunit.client.0.smithi087.stdout:8/678: rename d1 to d1/d2b/d3b/dee 22 2024-09-17T07:19:59.618 INFO:tasks.workunit.client.0.smithi087.stdout:1/579: unlink d2/d1a/cb3 0 2024-09-17T07:19:59.619 INFO:tasks.workunit.client.0.smithi087.stdout:1/580: dread - d2/d3d/d45/fc6 zero size 2024-09-17T07:19:59.620 INFO:tasks.workunit.client.0.smithi087.stdout:9/636: mknod d3/d4/d6/d8/d22/d43/d84/ce5 0 2024-09-17T07:19:59.623 INFO:tasks.workunit.client.0.smithi087.stdout:0/899: mkdir db/d45/d9e/d95/d139 0 2024-09-17T07:19:59.623 INFO:tasks.workunit.client.0.smithi087.stdout:8/679: creat d1/d7/d63/dd9/fef x:0 0 0 2024-09-17T07:19:59.624 INFO:tasks.workunit.client.0.smithi087.stdout:3/663: write d6/d1b/d42/f93 [2756870,82723] 0 2024-09-17T07:19:59.625 INFO:tasks.workunit.client.0.smithi087.stdout:9/637: rmdir d3/d4/d6/d8/d22/d92/da3/da4 39 2024-09-17T07:19:59.630 INFO:tasks.workunit.client.1.smithi139.stdout:1/372: dwrite d2/d10/d12/d13/f16 [0,4194304] 0 2024-09-17T07:19:59.632 INFO:tasks.workunit.client.0.smithi087.stdout:8/680: dwrite d1/feb [0,4194304] 0 2024-09-17T07:19:59.633 INFO:tasks.workunit.client.1.smithi139.stdout:1/373: rmdir d2/d10/d12/d1a 39 2024-09-17T07:19:59.633 INFO:tasks.workunit.client.0.smithi087.stdout:1/581: getdents d2/d3d/d35/d57 0 2024-09-17T07:19:59.636 INFO:tasks.workunit.client.0.smithi087.stdout:3/664: creat d6/d1b/fe5 x:0 0 0 2024-09-17T07:19:59.636 INFO:tasks.workunit.client.1.smithi139.stdout:1/374: dread d2/d10/d12/d1a/f36 [0,4194304] 0 2024-09-17T07:19:59.638 INFO:tasks.workunit.client.0.smithi087.stdout:8/681: mknod d1/d7/d9/d27/da1/cf0 0 2024-09-17T07:19:59.639 INFO:tasks.workunit.client.0.smithi087.stdout:6/812: dread d1/d67/f69 [0,4194304] 0 2024-09-17T07:19:59.639 INFO:tasks.workunit.client.0.smithi087.stdout:1/582: creat d2/d48/d6f/fcb x:0 0 0 2024-09-17T07:19:59.640 INFO:tasks.workunit.client.1.smithi139.stdout:1/375: rmdir d2/d10/d12/d13/d4f/d5c 39 2024-09-17T07:19:59.640 INFO:tasks.workunit.client.0.smithi087.stdout:8/682: write d1/d2b/d3b/f62 [791924,102976] 0 2024-09-17T07:19:59.641 INFO:tasks.workunit.client.1.smithi139.stdout:1/376: write d2/d10/d12/d1a/f5b [831311,9962] 0 2024-09-17T07:19:59.641 INFO:tasks.workunit.client.0.smithi087.stdout:9/638: write d3/d4/d16/d69/fe3 [256908,89769] 0 2024-09-17T07:19:59.642 INFO:tasks.workunit.client.0.smithi087.stdout:0/900: write db/d45/d9e/d95/f10d [720885,79199] 0 2024-09-17T07:19:59.643 INFO:tasks.workunit.client.1.smithi139.stdout:1/377: creat d2/d10/d12/d35/d49/f7b x:0 0 0 2024-09-17T07:19:59.644 INFO:tasks.workunit.client.0.smithi087.stdout:9/639: chown d3/d4/d6/d8/d12/d32/d6c 1311 1 2024-09-17T07:19:59.648 INFO:tasks.workunit.client.1.smithi139.stdout:1/378: dread d2/d10/d12/d1a/f53 [0,4194304] 0 2024-09-17T07:19:59.648 INFO:tasks.workunit.client.0.smithi087.stdout:3/665: creat d6/d15/d37/d3c/d52/db2/fe6 x:0 0 0 2024-09-17T07:19:59.648 INFO:tasks.workunit.client.1.smithi139.stdout:1/379: readlink d2/d10/d12/d13/l59 0 2024-09-17T07:19:59.649 INFO:tasks.workunit.client.0.smithi087.stdout:0/901: fdatasync db/d4f/f83 0 2024-09-17T07:19:59.650 INFO:tasks.workunit.client.0.smithi087.stdout:0/902: readlink db/l30 0 2024-09-17T07:19:59.650 INFO:tasks.workunit.client.0.smithi087.stdout:6/813: creat d1/d67/dfe/d2c/d40/d4c/dd4/f114 x:0 0 0 2024-09-17T07:19:59.650 INFO:tasks.workunit.client.1.smithi139.stdout:1/380: chown d2/d10/d12/f2d 60615 1 2024-09-17T07:19:59.651 INFO:tasks.workunit.client.1.smithi139.stdout:1/381: chown d2/d10/c28 74 1 2024-09-17T07:19:59.652 INFO:tasks.workunit.client.0.smithi087.stdout:3/666: readlink d6/d15/l94 0 2024-09-17T07:19:59.653 INFO:tasks.workunit.client.1.smithi139.stdout:1/382: mkdir d2/d10/d12/d7c 0 2024-09-17T07:19:59.654 INFO:tasks.workunit.client.0.smithi087.stdout:9/640: dread d3/d4/d6/d8/d12/d32/f8f [0,4194304] 0 2024-09-17T07:19:59.654 INFO:tasks.workunit.client.0.smithi087.stdout:6/814: stat d1/d67/dfe/d2c/d40/dd2/de2 0 2024-09-17T07:19:59.654 INFO:tasks.workunit.client.0.smithi087.stdout:8/683: dwrite d1/d7/f13 [0,4194304] 0 2024-09-17T07:19:59.656 INFO:tasks.workunit.client.0.smithi087.stdout:9/641: chown d3/d4/d6/d8/d22/d2a 55 1 2024-09-17T07:19:59.656 INFO:tasks.workunit.client.0.smithi087.stdout:8/684: fdatasync d1/d2b/d21/fdf 0 2024-09-17T07:19:59.656 INFO:tasks.workunit.client.0.smithi087.stdout:0/903: mknod db/d4f/c13a 0 2024-09-17T07:19:59.657 INFO:tasks.workunit.client.0.smithi087.stdout:9/642: fsync d3/d25/fcc 0 2024-09-17T07:19:59.659 INFO:tasks.workunit.client.0.smithi087.stdout:8/685: dread - d1/d7/d9/d19/d4d/fd2 zero size 2024-09-17T07:19:59.662 INFO:tasks.workunit.client.0.smithi087.stdout:3/667: rename d6/d16 to d6/d15/d37/d3c/d52/db2/de7 0 2024-09-17T07:19:59.662 INFO:tasks.workunit.client.0.smithi087.stdout:1/583: write d2/d3d/f28 [350309,37189] 0 2024-09-17T07:19:59.663 INFO:tasks.workunit.client.0.smithi087.stdout:8/686: dread d1/d7/f2d [0,4194304] 0 2024-09-17T07:19:59.663 INFO:tasks.workunit.client.1.smithi139.stdout:1/383: dread d2/d10/d12/d35/d2b/f42 [0,4194304] 0 2024-09-17T07:19:59.664 INFO:tasks.workunit.client.0.smithi087.stdout:0/904: mknod db/dbe/c13b 0 2024-09-17T07:19:59.665 INFO:tasks.workunit.client.0.smithi087.stdout:9/643: symlink d3/d4/d6/d8/d22/d64/le6 0 2024-09-17T07:19:59.665 INFO:tasks.workunit.client.1.smithi139.stdout:1/384: read d2/d10/d12/d24/d38/d3d/f4d [1027332,102957] 0 2024-09-17T07:19:59.669 INFO:tasks.workunit.client.0.smithi087.stdout:3/668: rename d6/d1b/d2b to d6/d1b/d42/d62/dc1/de8 0 2024-09-17T07:19:59.670 INFO:tasks.workunit.client.0.smithi087.stdout:8/687: symlink d1/d2b/d21/d6d/d6f/d7f/d54/dbb/lf1 0 2024-09-17T07:19:59.670 INFO:tasks.workunit.client.0.smithi087.stdout:8/688: readlink d1/d7/d9/d19/l20 0 2024-09-17T07:19:59.671 INFO:tasks.workunit.client.0.smithi087.stdout:3/669: dread d6/d15/d37/d3c/d52/db2/de7/fce [0,4194304] 0 2024-09-17T07:19:59.671 INFO:tasks.workunit.client.0.smithi087.stdout:8/689: fsync d1/d7/d63/dd9/fe4 0 2024-09-17T07:19:59.673 INFO:tasks.workunit.client.1.smithi139.stdout:6/594: sync 2024-09-17T07:19:59.677 INFO:tasks.workunit.client.0.smithi087.stdout:3/670: symlink d6/d15/d37/d5e/le9 0 2024-09-17T07:19:59.677 INFO:tasks.workunit.client.1.smithi139.stdout:6/595: rename db/df/d4e/d64/d83/d9d to db/df/d4e/d64/d83/dc5 0 2024-09-17T07:19:59.679 INFO:tasks.workunit.client.0.smithi087.stdout:1/584: write d2/d3d/d45/d90/d43/f66 [196117,113794] 0 2024-09-17T07:19:59.681 INFO:tasks.workunit.client.0.smithi087.stdout:8/690: dwrite d1/d2b/d21/fb3 [0,4194304] 0 2024-09-17T07:19:59.683 INFO:tasks.workunit.client.1.smithi139.stdout:6/596: dwrite db/d18/f6c [0,4194304] 0 2024-09-17T07:19:59.683 INFO:tasks.workunit.client.0.smithi087.stdout:9/644: rename d3/d4/d6/f59 to d3/d4/d6/d8/d22/d92/da3/fe7 0 2024-09-17T07:19:59.684 INFO:tasks.workunit.client.0.smithi087.stdout:6/815: dwrite d1/d6/d68/f98 [0,4194304] 0 2024-09-17T07:19:59.684 INFO:tasks.workunit.client.0.smithi087.stdout:3/671: dread - d6/d15/d37/f72 zero size 2024-09-17T07:19:59.686 INFO:tasks.workunit.client.1.smithi139.stdout:6/597: creat db/df/d4e/d64/d83/fc6 x:0 0 0 2024-09-17T07:19:59.687 INFO:tasks.workunit.client.1.smithi139.stdout:6/598: stat db/d18/c20 0 2024-09-17T07:19:59.688 INFO:tasks.workunit.client.1.smithi139.stdout:6/599: chown db/df/d4c/lb9 6513 1 2024-09-17T07:19:59.688 INFO:tasks.workunit.client.0.smithi087.stdout:1/585: creat d2/d69/d8d/da6/fcc x:0 0 0 2024-09-17T07:19:59.688 INFO:tasks.workunit.client.0.smithi087.stdout:0/905: write db/f13 [1103952,104444] 0 2024-09-17T07:19:59.689 INFO:tasks.workunit.client.1.smithi139.stdout:6/600: mknod db/df/cc7 0 2024-09-17T07:19:59.692 INFO:tasks.workunit.client.1.smithi139.stdout:6/601: creat db/d18/d38/d60/fc8 x:0 0 0 2024-09-17T07:19:59.696 INFO:tasks.workunit.client.1.smithi139.stdout:6/602: mknod db/df/d4e/cc9 0 2024-09-17T07:19:59.697 INFO:tasks.workunit.client.1.smithi139.stdout:6/603: write db/df/d4e/fb8 [773595,20568] 0 2024-09-17T07:19:59.698 INFO:tasks.workunit.client.0.smithi087.stdout:0/906: creat db/d45/d7b/d90/dd9/de6/d10a/f13c x:0 0 0 2024-09-17T07:19:59.698 INFO:tasks.workunit.client.0.smithi087.stdout:1/586: mknod d2/d14/ccd 0 2024-09-17T07:19:59.699 INFO:tasks.workunit.client.1.smithi139.stdout:1/385: dread d2/d10/d12/f31 [0,4194304] 0 2024-09-17T07:19:59.700 INFO:tasks.workunit.client.1.smithi139.stdout:1/386: fsync d2/d10/d12/d1a/f6d 0 2024-09-17T07:19:59.702 INFO:tasks.workunit.client.1.smithi139.stdout:6/604: link db/d18/d1b/da7/cb0 db/df/daa/cca 0 2024-09-17T07:19:59.703 INFO:tasks.workunit.client.0.smithi087.stdout:6/816: dwrite d1/d67/dfe/d2c/d40/d4c/dd4/f114 [0,4194304] 0 2024-09-17T07:19:59.703 INFO:tasks.workunit.client.1.smithi139.stdout:6/605: write f8 [4395857,57720] 0 2024-09-17T07:19:59.708 INFO:tasks.workunit.client.1.smithi139.stdout:1/387: dwrite d2/d10/d12/d24/f57 [0,4194304] 0 2024-09-17T07:19:59.708 INFO:tasks.workunit.client.0.smithi087.stdout:0/907: dread db/d45/d9e/d86/dd5/deb/d117/f12f [0,4194304] 0 2024-09-17T07:19:59.711 INFO:tasks.workunit.client.0.smithi087.stdout:0/908: dread - db/d45/fae zero size 2024-09-17T07:19:59.712 INFO:tasks.workunit.client.0.smithi087.stdout:1/587: dread d2/dc/f3b [0,4194304] 0 2024-09-17T07:19:59.713 INFO:tasks.workunit.client.0.smithi087.stdout:6/817: dwrite d1/d67/dfe/d2c/f52 [8388608,4194304] 0 2024-09-17T07:19:59.714 INFO:tasks.workunit.client.0.smithi087.stdout:3/672: write d6/d1b/d42/d62/dbb/dd7/fd9 [2553216,111527] 0 2024-09-17T07:19:59.718 INFO:tasks.workunit.client.1.smithi139.stdout:1/388: dwrite d2/d10/d12/d1a/f6d [0,4194304] 0 2024-09-17T07:19:59.721 INFO:tasks.workunit.client.1.smithi139.stdout:1/389: truncate d2/d10/d12/d1a/f5b 1541061 0 2024-09-17T07:19:59.721 INFO:tasks.workunit.client.0.smithi087.stdout:3/673: write d6/d7d/fa5 [528395,63493] 0 2024-09-17T07:19:59.724 INFO:tasks.workunit.client.0.smithi087.stdout:1/588: mkdir d2/d3d/d35/d4f/da5/dce 0 2024-09-17T07:19:59.724 INFO:tasks.workunit.client.0.smithi087.stdout:6/818: fdatasync d1/d67/dfe/d2c/f59 0 2024-09-17T07:19:59.725 INFO:tasks.workunit.client.0.smithi087.stdout:8/691: dread d1/d2b/d21/d6d/d6f/fb4 [0,4194304] 0 2024-09-17T07:19:59.726 INFO:tasks.workunit.client.1.smithi139.stdout:6/606: dwrite db/df/d73/da4/fa9 [0,4194304] 0 2024-09-17T07:19:59.727 INFO:tasks.workunit.client.0.smithi087.stdout:8/692: stat d1/d7/d9/c7d 0 2024-09-17T07:19:59.728 INFO:tasks.workunit.client.0.smithi087.stdout:6/819: chown d1/d67/dfe/d2c/d58/d90/fee 31194 1 2024-09-17T07:19:59.729 INFO:tasks.workunit.client.1.smithi139.stdout:1/390: getdents d2/d10/d12/d13/d4f/d5c/d74 0 2024-09-17T07:19:59.731 INFO:tasks.workunit.client.0.smithi087.stdout:8/693: mkdir d1/d7/d63/df2 0 2024-09-17T07:19:59.731 INFO:tasks.workunit.client.0.smithi087.stdout:1/589: write d2/d3d/d45/d90/d43/f66 [952028,9238] 0 2024-09-17T07:19:59.731 INFO:tasks.workunit.client.1.smithi139.stdout:1/391: dread - d2/d10/d12/f69 zero size 2024-09-17T07:19:59.732 INFO:tasks.workunit.client.1.smithi139.stdout:6/607: write db/df/d4e/d5e/fa8 [206435,74803] 0 2024-09-17T07:19:59.733 INFO:tasks.workunit.client.0.smithi087.stdout:9/645: dread d3/d4/d16/f3a [0,4194304] 0 2024-09-17T07:19:59.733 INFO:tasks.workunit.client.1.smithi139.stdout:6/608: dread - db/df/d4e/d64/f52 zero size 2024-09-17T07:19:59.734 INFO:tasks.workunit.client.0.smithi087.stdout:3/674: rename d6/d15/c33 to d6/d15/d37/d3c/dc7/cea 0 2024-09-17T07:19:59.735 INFO:tasks.workunit.client.0.smithi087.stdout:3/675: chown d6/d15/d37/d3c/d52/db2/de7 999 1 2024-09-17T07:19:59.736 INFO:tasks.workunit.client.1.smithi139.stdout:6/609: symlink db/df/d4e/d5e/d8a/lcb 0 2024-09-17T07:19:59.737 INFO:tasks.workunit.client.1.smithi139.stdout:1/392: rmdir d2/d10/d12/d35/d2b/d77 0 2024-09-17T07:19:59.737 INFO:tasks.workunit.client.1.smithi139.stdout:6/610: readlink db/d18/d38/d60/l82 0 2024-09-17T07:19:59.738 INFO:tasks.workunit.client.1.smithi139.stdout:1/393: readlink d2/d10/d12/d35/l45 0 2024-09-17T07:19:59.739 INFO:tasks.workunit.client.0.smithi087.stdout:8/694: truncate d1/d5f/f5d 1728452 0 2024-09-17T07:19:59.739 INFO:tasks.workunit.client.1.smithi139.stdout:1/394: chown d2/d10/d12/d35/d2b/f42 563459 1 2024-09-17T07:19:59.741 INFO:tasks.workunit.client.0.smithi087.stdout:9/646: getdents d3/d4/d6/d8/d12/d32/db2 0 2024-09-17T07:19:59.742 INFO:tasks.workunit.client.1.smithi139.stdout:1/395: symlink d2/d10/d12/d13/d4f/l7d 0 2024-09-17T07:19:59.743 INFO:tasks.workunit.client.0.smithi087.stdout:6/820: getdents d1/d67/dfe/d2c/d48/d9b 0 2024-09-17T07:19:59.743 INFO:tasks.workunit.client.1.smithi139.stdout:1/396: dread d2/f58 [0,4194304] 0 2024-09-17T07:19:59.746 INFO:tasks.workunit.client.1.smithi139.stdout:1/397: fdatasync d2/d10/d12/f29 0 2024-09-17T07:19:59.748 INFO:tasks.workunit.client.1.smithi139.stdout:1/398: symlink d2/d10/d12/d1a/l7e 0 2024-09-17T07:19:59.749 INFO:tasks.workunit.client.1.smithi139.stdout:1/399: chown d2/f6 239610 1 2024-09-17T07:19:59.750 INFO:tasks.workunit.client.0.smithi087.stdout:9/647: dwrite d3/d25/f9a [0,4194304] 0 2024-09-17T07:19:59.752 INFO:tasks.workunit.client.0.smithi087.stdout:8/695: dwrite d1/d7/d9/d19/d4d/fd0 [0,4194304] 0 2024-09-17T07:19:59.753 INFO:tasks.workunit.client.0.smithi087.stdout:0/909: write db/d45/d9e/d86/f98 [1823849,95902] 0 2024-09-17T07:19:59.755 INFO:tasks.workunit.client.1.smithi139.stdout:1/400: dwrite d2/d10/d12/d35/d49/f56 [0,4194304] 0 2024-09-17T07:19:59.757 INFO:tasks.workunit.client.0.smithi087.stdout:8/696: truncate d1/d7/fcd 552216 0 2024-09-17T07:19:59.757 INFO:tasks.workunit.client.0.smithi087.stdout:6/821: dwrite d1/f113 [0,4194304] 0 2024-09-17T07:19:59.757 INFO:tasks.workunit.client.0.smithi087.stdout:9/648: symlink d3/dac/le8 0 2024-09-17T07:19:59.758 INFO:tasks.workunit.client.1.smithi139.stdout:1/401: truncate d2/d10/d12/d1a/f6d 4324558 0 2024-09-17T07:19:59.760 INFO:tasks.workunit.client.1.smithi139.stdout:1/402: truncate d2/d10/d12/d13/f75 828234 0 2024-09-17T07:19:59.767 INFO:tasks.workunit.client.1.smithi139.stdout:1/403: rename d2/d10/l70 to d2/d10/d12/d35/d49/l7f 0 2024-09-17T07:19:59.768 INFO:tasks.workunit.client.1.smithi139.stdout:1/404: chown d2/d10/d12/d35/d2b/c51 73 1 2024-09-17T07:19:59.771 INFO:tasks.workunit.client.1.smithi139.stdout:1/405: fdatasync d2/d10/d12/d1a/f36 0 2024-09-17T07:19:59.774 INFO:tasks.workunit.client.1.smithi139.stdout:9/884: sync 2024-09-17T07:19:59.774 INFO:tasks.workunit.client.1.smithi139.stdout:9/885: dread - dc/f127 zero size 2024-09-17T07:19:59.776 INFO:tasks.workunit.client.1.smithi139.stdout:9/886: chown dc/d11/d52/l94 0 1 2024-09-17T07:19:59.776 INFO:tasks.workunit.client.1.smithi139.stdout:6/611: dread db/df/d4e/d64/d54/f2b [0,4194304] 0 2024-09-17T07:19:59.779 INFO:tasks.workunit.client.1.smithi139.stdout:1/406: truncate d2/d10/d12/d35/f44 3136787 0 2024-09-17T07:19:59.779 INFO:tasks.workunit.client.1.smithi139.stdout:9/887: symlink dc/l12a 0 2024-09-17T07:19:59.779 INFO:tasks.workunit.client.1.smithi139.stdout:1/407: read - d2/d10/d12/d24/f4e zero size 2024-09-17T07:19:59.780 INFO:tasks.workunit.client.1.smithi139.stdout:9/888: read - dc/d11/d8b/f91 zero size 2024-09-17T07:19:59.781 INFO:tasks.workunit.client.1.smithi139.stdout:1/408: write d2/d10/d12/d35/d49/f56 [326764,60204] 0 2024-09-17T07:19:59.782 INFO:tasks.workunit.client.1.smithi139.stdout:9/889: stat dc/d11/d15/d3c/l6a 0 2024-09-17T07:19:59.782 INFO:tasks.workunit.client.1.smithi139.stdout:1/409: chown d2/d10/d12/d1a/c48 1 1 2024-09-17T07:19:59.784 INFO:tasks.workunit.client.1.smithi139.stdout:1/410: creat d2/d10/d12/d35/d49/f80 x:0 0 0 2024-09-17T07:19:59.785 INFO:tasks.workunit.client.1.smithi139.stdout:1/411: chown d2/d10/d12/d24 193321226 1 2024-09-17T07:19:59.786 INFO:tasks.workunit.client.1.smithi139.stdout:1/412: read - d2/d10/d12/d35/d49/f7b zero size 2024-09-17T07:19:59.786 INFO:tasks.workunit.client.1.smithi139.stdout:1/413: stat d2/l1d 0 2024-09-17T07:19:59.786 INFO:tasks.workunit.client.1.smithi139.stdout:1/414: dread - d2/d10/d12/f69 zero size 2024-09-17T07:19:59.789 INFO:tasks.workunit.client.1.smithi139.stdout:0/420: sync 2024-09-17T07:19:59.789 INFO:tasks.workunit.client.1.smithi139.stdout:4/499: sync 2024-09-17T07:19:59.789 INFO:tasks.workunit.client.1.smithi139.stdout:8/722: sync 2024-09-17T07:19:59.789 INFO:tasks.workunit.client.1.smithi139.stdout:2/625: sync 2024-09-17T07:19:59.789 INFO:tasks.workunit.client.1.smithi139.stdout:7/466: sync 2024-09-17T07:19:59.789 INFO:tasks.workunit.client.1.smithi139.stdout:5/662: sync 2024-09-17T07:19:59.789 INFO:tasks.workunit.client.1.smithi139.stdout:3/475: sync 2024-09-17T07:19:59.789 INFO:tasks.workunit.client.1.smithi139.stdout:1/415: rmdir d2/d10/d12/d35/d2b/d4a 39 2024-09-17T07:19:59.790 INFO:tasks.workunit.client.1.smithi139.stdout:9/890: dread dc/d11/d15/d3c/d68/f90 [0,4194304] 0 2024-09-17T07:19:59.793 INFO:tasks.workunit.client.1.smithi139.stdout:2/626: symlink d0/d7/d86/ld2 0 2024-09-17T07:19:59.793 INFO:tasks.workunit.client.1.smithi139.stdout:8/723: chown d0/d20/d28/d52/d65/f70 66463645 1 2024-09-17T07:19:59.794 INFO:tasks.workunit.client.1.smithi139.stdout:3/476: chown d5/d15/d16/d4c/d28/f30 6858 1 2024-09-17T07:19:59.794 INFO:tasks.workunit.client.1.smithi139.stdout:4/500: creat d0/f9e x:0 0 0 2024-09-17T07:19:59.795 INFO:tasks.workunit.client.1.smithi139.stdout:1/416: read d2/d10/d12/d1a/f5b [757718,24418] 0 2024-09-17T07:19:59.795 INFO:tasks.workunit.client.1.smithi139.stdout:0/421: mknod d1/da/d1b/d3d/d50/ca0 0 2024-09-17T07:19:59.796 INFO:tasks.workunit.client.1.smithi139.stdout:5/663: creat d4/d16/d69/fd7 x:0 0 0 2024-09-17T07:19:59.796 INFO:tasks.workunit.client.1.smithi139.stdout:7/467: mknod d5/d10/d8c/c95 0 2024-09-17T07:19:59.796 INFO:tasks.workunit.client.1.smithi139.stdout:8/724: readlink d0/d20/l76 0 2024-09-17T07:19:59.799 INFO:tasks.workunit.client.1.smithi139.stdout:2/627: mknod d0/dc/cd3 0 2024-09-17T07:19:59.799 INFO:tasks.workunit.client.1.smithi139.stdout:5/664: stat d4/d16/d1b/d20/d38/f68 0 2024-09-17T07:19:59.800 INFO:tasks.workunit.client.1.smithi139.stdout:4/501: chown d0/f1d 162385 1 2024-09-17T07:19:59.802 INFO:tasks.workunit.client.1.smithi139.stdout:9/891: write dc/d11/d15/d3c/d61/d64/d96/fa4 [6257921,126028] 0 2024-09-17T07:19:59.802 INFO:tasks.workunit.client.1.smithi139.stdout:8/725: unlink d0/l15 0 2024-09-17T07:19:59.805 INFO:tasks.workunit.client.1.smithi139.stdout:5/665: write d4/d16/d1b/d20/d38/d4f/f5c [2393777,95709] 0 2024-09-17T07:19:59.808 INFO:tasks.workunit.client.1.smithi139.stdout:3/477: mknod d5/d15/d16/d4c/c9b 0 2024-09-17T07:19:59.809 INFO:tasks.workunit.client.1.smithi139.stdout:4/502: mknod d0/d10/c9f 0 2024-09-17T07:19:59.809 INFO:tasks.workunit.client.1.smithi139.stdout:2/628: symlink d0/d7/d86/da4/d12/d45/ld4 0 2024-09-17T07:19:59.809 INFO:tasks.workunit.client.1.smithi139.stdout:6/612: dread f8 [0,4194304] 0 2024-09-17T07:19:59.811 INFO:tasks.workunit.client.1.smithi139.stdout:3/478: chown d5/d21/d23/d38 1967282907 1 2024-09-17T07:19:59.811 INFO:tasks.workunit.client.1.smithi139.stdout:8/726: mknod d0/d96/cec 0 2024-09-17T07:19:59.813 INFO:tasks.workunit.client.1.smithi139.stdout:7/468: mkdir d5/d96 0 2024-09-17T07:19:59.816 INFO:tasks.workunit.client.1.smithi139.stdout:8/727: read d0/f9 [1698681,82359] 0 2024-09-17T07:19:59.819 INFO:tasks.workunit.client.1.smithi139.stdout:3/479: creat d5/d21/d23/f9c x:0 0 0 2024-09-17T07:19:59.820 INFO:tasks.workunit.client.0.smithi087.stdout:1/590: dread d2/d3d/d45/d90/d37/f52 [0,4194304] 0 2024-09-17T07:19:59.820 INFO:tasks.workunit.client.0.smithi087.stdout:8/697: mknod d1/d7/d9/d19/d4d/cf3 0 2024-09-17T07:19:59.821 INFO:tasks.workunit.client.0.smithi087.stdout:9/649: mkdir d3/d4/da/de9 0 2024-09-17T07:19:59.822 INFO:tasks.workunit.client.1.smithi139.stdout:7/469: dread d5/f6e [0,4194304] 0 2024-09-17T07:19:59.822 INFO:tasks.workunit.client.1.smithi139.stdout:6/613: dread db/d18/d5b/f61 [0,4194304] 0 2024-09-17T07:19:59.822 INFO:tasks.workunit.client.1.smithi139.stdout:0/422: dread d1/da/d1b/d3d/f70 [0,4194304] 0 2024-09-17T07:19:59.823 INFO:tasks.workunit.client.1.smithi139.stdout:3/480: fsync d5/d15/d56/f7c 0 2024-09-17T07:19:59.823 INFO:tasks.workunit.client.1.smithi139.stdout:2/629: creat d0/d7/d86/da4/d12/d8c/fd5 x:0 0 0 2024-09-17T07:19:59.824 INFO:tasks.workunit.client.0.smithi087.stdout:6/822: truncate d1/d67/dfe/d2c/d40/d4c/d77/f93 792143 0 2024-09-17T07:19:59.824 INFO:tasks.workunit.client.0.smithi087.stdout:3/676: dwrite d6/d15/d37/d3c/d52/db2/de7/f7c [4194304,4194304] 0 2024-09-17T07:19:59.825 INFO:tasks.workunit.client.0.smithi087.stdout:1/591: rename d2/da to d2/dcf 0 2024-09-17T07:19:59.825 INFO:tasks.workunit.client.1.smithi139.stdout:5/666: dwrite d4/d16/d1b/d20/d38/f87 [0,4194304] 0 2024-09-17T07:19:59.827 INFO:tasks.workunit.client.1.smithi139.stdout:4/503: dread d0/f30 [0,4194304] 0 2024-09-17T07:19:59.829 INFO:tasks.workunit.client.1.smithi139.stdout:1/417: truncate d2/d10/d12/d13/f43 212568 0 2024-09-17T07:19:59.832 INFO:tasks.workunit.client.1.smithi139.stdout:2/630: truncate d0/d3b/f64 136742 0 2024-09-17T07:19:59.835 INFO:tasks.workunit.client.1.smithi139.stdout:7/470: symlink d5/d17/d4e/d7a/l97 0 2024-09-17T07:19:59.835 INFO:tasks.workunit.client.1.smithi139.stdout:8/728: dwrite d0/d20/d28/d48/fe8 [0,4194304] 0 2024-09-17T07:19:59.835 INFO:tasks.workunit.client.1.smithi139.stdout:9/892: truncate dc/d11/d52/d56/d75/fa6 23921 0 2024-09-17T07:19:59.837 INFO:tasks.workunit.client.1.smithi139.stdout:3/481: chown d5/d21/d23/d38/f5f 32415 1 2024-09-17T07:19:59.838 INFO:tasks.workunit.client.1.smithi139.stdout:6/614: rename db/d18/l22 to db/d18/d9f/lcc 0 2024-09-17T07:19:59.839 INFO:tasks.workunit.client.1.smithi139.stdout:3/482: write f2 [3179223,19156] 0 2024-09-17T07:19:59.847 INFO:tasks.workunit.client.1.smithi139.stdout:7/471: symlink d5/d17/l98 0 2024-09-17T07:19:59.849 INFO:tasks.workunit.client.1.smithi139.stdout:0/423: link d1/da/d1b/d32/f35 d1/da/d1b/d3d/d5a/d75/d93/fa1 0 2024-09-17T07:19:59.854 INFO:tasks.workunit.client.1.smithi139.stdout:9/893: dwrite dc/d2a/fec [4194304,4194304] 0 2024-09-17T07:19:59.856 INFO:tasks.workunit.client.1.smithi139.stdout:7/472: chown d5/d17/c6a 0 1 2024-09-17T07:19:59.857 INFO:tasks.workunit.client.1.smithi139.stdout:1/418: dwrite d2/d10/d12/d35/d2b/f42 [0,4194304] 0 2024-09-17T07:19:59.863 INFO:tasks.workunit.client.1.smithi139.stdout:3/483: dread d5/d21/d23/f49 [0,4194304] 0 2024-09-17T07:19:59.866 INFO:tasks.workunit.client.1.smithi139.stdout:8/729: mknod d0/d1a/d4d/d53/ced 0 2024-09-17T07:19:59.870 INFO:tasks.workunit.client.1.smithi139.stdout:2/631: link d0/de/df/d56/fb3 d0/d7/d86/da4/d12/fd6 0 2024-09-17T07:19:59.872 INFO:tasks.workunit.client.1.smithi139.stdout:2/632: fsync d0/de/d69/fa3 0 2024-09-17T07:19:59.872 INFO:tasks.workunit.client.1.smithi139.stdout:0/424: symlink d1/da/d1b/d3d/d5a/d75/d93/la2 0 2024-09-17T07:19:59.872 INFO:tasks.workunit.client.1.smithi139.stdout:9/894: dwrite dc/d11/f124 [0,4194304] 0 2024-09-17T07:19:59.875 INFO:tasks.workunit.client.1.smithi139.stdout:4/504: getdents d0/d1/d29 0 2024-09-17T07:19:59.879 INFO:tasks.workunit.client.1.smithi139.stdout:3/484: creat d5/d21/d23/d38/f9d x:0 0 0 2024-09-17T07:19:59.882 INFO:tasks.workunit.client.1.smithi139.stdout:6/615: dwrite db/d18/d1b/f1d [0,4194304] 0 2024-09-17T07:19:59.883 INFO:tasks.workunit.client.1.smithi139.stdout:5/667: dread d4/f36 [0,4194304] 0 2024-09-17T07:19:59.884 INFO:tasks.workunit.client.1.smithi139.stdout:3/485: fsync d5/d15/d20/d3b/f53 0 2024-09-17T07:19:59.885 INFO:tasks.workunit.client.1.smithi139.stdout:8/730: creat d0/d1a/d4d/d53/fee x:0 0 0 2024-09-17T07:19:59.885 INFO:tasks.workunit.client.1.smithi139.stdout:7/473: write d5/d67/f82 [1703857,39429] 0 2024-09-17T07:19:59.889 INFO:tasks.workunit.client.1.smithi139.stdout:0/425: write d1/da/d1b/d3d/f95 [3010656,88670] 0 2024-09-17T07:19:59.890 INFO:tasks.workunit.client.1.smithi139.stdout:7/474: read - d5/d17/d4e/d55/f8f zero size 2024-09-17T07:19:59.893 INFO:tasks.workunit.client.1.smithi139.stdout:4/505: rename d0/l2e to d0/d1/d9b/la0 0 2024-09-17T07:19:59.893 INFO:tasks.workunit.client.1.smithi139.stdout:6/616: mknod db/df/d4e/d64/d83/dc5/ccd 0 2024-09-17T07:19:59.895 INFO:tasks.workunit.client.1.smithi139.stdout:3/486: creat d5/d15/d16/f9e x:0 0 0 2024-09-17T07:19:59.897 INFO:tasks.workunit.client.1.smithi139.stdout:7/475: stat d5/d10/d2b/d40/l41 0 2024-09-17T07:19:59.899 INFO:tasks.workunit.client.1.smithi139.stdout:2/633: symlink d0/d7/d67/d92/ld7 0 2024-09-17T07:19:59.901 INFO:tasks.workunit.client.1.smithi139.stdout:0/426: symlink d1/da/d1b/d3d/d5a/d75/d93/la3 0 2024-09-17T07:19:59.901 INFO:tasks.workunit.client.1.smithi139.stdout:9/895: link dc/d11/d15/d1e/d34/l41 dc/d11/d15/d3c/d61/d64/df8/l12b 0 2024-09-17T07:19:59.902 INFO:tasks.workunit.client.1.smithi139.stdout:6/617: chown db/c76 0 1 2024-09-17T07:19:59.903 INFO:tasks.workunit.client.1.smithi139.stdout:7/476: mknod d5/d10/d8c/c99 0 2024-09-17T07:19:59.906 INFO:tasks.workunit.client.1.smithi139.stdout:5/668: dwrite d4/d16/d1b/d20/d28/f82 [0,4194304] 0 2024-09-17T07:19:59.908 INFO:tasks.workunit.client.1.smithi139.stdout:0/427: write d1/da/d1b/d32/f4f [2593013,54291] 0 2024-09-17T07:19:59.908 INFO:tasks.workunit.client.1.smithi139.stdout:1/419: dread d2/d10/d12/f29 [4194304,4194304] 0 2024-09-17T07:19:59.912 INFO:tasks.workunit.client.1.smithi139.stdout:7/477: truncate d5/d17/f27 5539465 0 2024-09-17T07:19:59.914 INFO:tasks.workunit.client.1.smithi139.stdout:5/669: truncate d4/d16/d1b/d20/d28/d3f/fcd 851327 0 2024-09-17T07:19:59.915 INFO:tasks.workunit.client.1.smithi139.stdout:7/478: fdatasync d5/d10/d4d/f88 0 2024-09-17T07:19:59.916 INFO:tasks.workunit.client.1.smithi139.stdout:8/731: dread d0/d20/d28/d52/d65/f98 [0,4194304] 0 2024-09-17T07:19:59.917 INFO:tasks.workunit.client.1.smithi139.stdout:6/618: rename db/df/d4e/d5e/c9e to db/df/d4e/d64/d56/d98/cce 0 2024-09-17T07:19:59.919 INFO:tasks.workunit.client.1.smithi139.stdout:1/420: creat d2/d10/d12/d35/d49/f81 x:0 0 0 2024-09-17T07:19:59.922 INFO:tasks.workunit.client.1.smithi139.stdout:8/732: dread d0/f2a [4194304,4194304] 0 2024-09-17T07:19:59.923 INFO:tasks.workunit.client.1.smithi139.stdout:5/670: mkdir d4/d16/d69/dd8 0 2024-09-17T07:19:59.924 INFO:tasks.workunit.client.1.smithi139.stdout:4/506: write d0/d1/d9b/d83/f96 [961714,33106] 0 2024-09-17T07:19:59.925 INFO:tasks.workunit.client.1.smithi139.stdout:6/619: rmdir db 39 2024-09-17T07:19:59.926 INFO:tasks.workunit.client.1.smithi139.stdout:4/507: chown d0/l88 62 1 2024-09-17T07:19:59.929 INFO:tasks.workunit.client.1.smithi139.stdout:8/733: mknod d0/d1a/d82/cef 0 2024-09-17T07:19:59.929 INFO:tasks.workunit.client.1.smithi139.stdout:1/421: dwrite d2/d10/d12/f69 [0,4194304] 0 2024-09-17T07:19:59.931 INFO:tasks.workunit.client.1.smithi139.stdout:8/734: write d0/d1a/d4d/d53/fd2 [694697,35548] 0 2024-09-17T07:19:59.933 INFO:tasks.workunit.client.1.smithi139.stdout:1/422: chown d2/d10/d12/d13/d4f/l7d 22 1 2024-09-17T07:19:59.935 INFO:tasks.workunit.client.1.smithi139.stdout:7/479: symlink d5/d17/d4e/d90/l9a 0 2024-09-17T07:19:59.935 INFO:tasks.workunit.client.1.smithi139.stdout:2/634: truncate d0/de/df/d56/f7a 3610729 0 2024-09-17T07:19:59.937 INFO:tasks.workunit.client.1.smithi139.stdout:0/428: dread d1/da/d2a/f38 [0,4194304] 0 2024-09-17T07:19:59.939 INFO:tasks.workunit.client.0.smithi087.stdout:9/650: creat d3/d4/d6/d8/d12/d38/fea x:0 0 0 2024-09-17T07:19:59.941 INFO:tasks.workunit.client.0.smithi087.stdout:1/592: creat d2/d3d/d45/d90/d43/fd0 x:0 0 0 2024-09-17T07:19:59.941 INFO:tasks.workunit.client.1.smithi139.stdout:2/635: mknod d0/dc/dc4/cd8 0 2024-09-17T07:19:59.942 INFO:tasks.workunit.client.0.smithi087.stdout:1/593: stat d2/d3d/db4/dc3 0 2024-09-17T07:19:59.944 INFO:tasks.workunit.client.1.smithi139.stdout:7/480: mknod d5/d17/d4e/d7a/c9b 0 2024-09-17T07:19:59.944 INFO:tasks.workunit.client.1.smithi139.stdout:3/487: fdatasync d5/d15/d16/d4c/d28/f52 0 2024-09-17T07:19:59.945 INFO:tasks.workunit.client.1.smithi139.stdout:0/429: symlink d1/da/d1b/d32/d81/la4 0 2024-09-17T07:19:59.948 INFO:tasks.workunit.client.1.smithi139.stdout:4/508: write d0/db/f21 [563368,68022] 0 2024-09-17T07:19:59.949 INFO:tasks.workunit.client.1.smithi139.stdout:2/636: write d0/f6 [1222718,96032] 0 2024-09-17T07:19:59.953 INFO:tasks.workunit.client.0.smithi087.stdout:8/698: rename d1/d2b/d21/d6d/d6f/d7f to d1/d2b/df4 0 2024-09-17T07:19:59.954 INFO:tasks.workunit.client.0.smithi087.stdout:8/699: write d1/d7/d9/d19/fb6 [4503423,126275] 0 2024-09-17T07:19:59.954 INFO:tasks.workunit.client.1.smithi139.stdout:3/488: mknod d5/d63/d6d/d6f/d8b/c9f 0 2024-09-17T07:19:59.954 INFO:tasks.workunit.client.1.smithi139.stdout:2/637: read d0/d7/d86/da4/d28/dcf/fd1 [4175100,389] 0 2024-09-17T07:19:59.955 INFO:tasks.workunit.client.1.smithi139.stdout:0/430: mkdir d1/da/d2a/da5 0 2024-09-17T07:19:59.955 INFO:tasks.workunit.client.0.smithi087.stdout:5/839: sync 2024-09-17T07:19:59.958 INFO:tasks.workunit.client.0.smithi087.stdout:1/594: creat d2/d3d/d35/d57/d73/fd1 x:0 0 0 2024-09-17T07:19:59.959 INFO:tasks.workunit.client.0.smithi087.stdout:1/595: chown d2/d3d/d35/d57 246927 1 2024-09-17T07:19:59.959 INFO:tasks.workunit.client.0.smithi087.stdout:8/700: mknod d1/d7/d9/d27/cf5 0 2024-09-17T07:19:59.960 INFO:tasks.workunit.client.0.smithi087.stdout:5/840: mkdir d5/d8/d1f/d4e/d10d 0 2024-09-17T07:19:59.960 INFO:tasks.workunit.client.1.smithi139.stdout:3/489: fdatasync d5/d15/d20/d3b/f53 0 2024-09-17T07:19:59.961 INFO:tasks.workunit.client.0.smithi087.stdout:9/651: mknod d3/d4/da/ceb 0 2024-09-17T07:19:59.962 INFO:tasks.workunit.client.0.smithi087.stdout:3/677: creat d6/d1b/d42/feb x:0 0 0 2024-09-17T07:19:59.963 INFO:tasks.workunit.client.0.smithi087.stdout:1/596: symlink d2/d3d/d45/ld2 0 2024-09-17T07:19:59.963 INFO:tasks.workunit.client.0.smithi087.stdout:3/678: dread - d6/d1b/fe5 zero size 2024-09-17T07:19:59.964 INFO:tasks.workunit.client.1.smithi139.stdout:8/735: dwrite d0/d20/d28/d48/fbc [0,4194304] 0 2024-09-17T07:19:59.964 INFO:tasks.workunit.client.1.smithi139.stdout:1/423: truncate d2/d10/d12/d24/d38/d3d/f4d 1462610 0 2024-09-17T07:19:59.964 INFO:tasks.workunit.client.0.smithi087.stdout:8/701: fsync d1/d2b/f32 0 2024-09-17T07:19:59.965 INFO:tasks.workunit.client.0.smithi087.stdout:5/841: mknod d5/d12/d56/db7/c10e 0 2024-09-17T07:19:59.966 INFO:tasks.workunit.client.0.smithi087.stdout:8/702: read - d1/d7/d63/dd9/fef zero size 2024-09-17T07:19:59.966 INFO:tasks.workunit.client.1.smithi139.stdout:2/638: write d0/de/d25/fcb [498828,113998] 0 2024-09-17T07:19:59.967 INFO:tasks.workunit.client.0.smithi087.stdout:9/652: rmdir d3/d4/d16 39 2024-09-17T07:19:59.969 INFO:tasks.workunit.client.1.smithi139.stdout:7/481: getdents d5/d17/d4e 0 2024-09-17T07:19:59.969 INFO:tasks.workunit.client.0.smithi087.stdout:3/679: truncate d6/f59 4480013 0 2024-09-17T07:19:59.971 INFO:tasks.workunit.client.1.smithi139.stdout:3/490: mkdir d5/d63/d6d/da0 0 2024-09-17T07:19:59.971 INFO:tasks.workunit.client.1.smithi139.stdout:5/671: dread d4/d16/d1b/d20/d28/f26 [0,4194304] 0 2024-09-17T07:19:59.971 INFO:tasks.workunit.client.0.smithi087.stdout:1/597: rename d2/d48/d61/lc8 to d2/dcf/d9a/ld3 0 2024-09-17T07:19:59.971 INFO:tasks.workunit.client.1.smithi139.stdout:4/509: dwrite d0/db/f21 [0,4194304] 0 2024-09-17T07:19:59.973 INFO:tasks.workunit.client.0.smithi087.stdout:3/680: mknod d6/d1b/d42/d6e/cec 0 2024-09-17T07:19:59.974 INFO:tasks.workunit.client.1.smithi139.stdout:8/736: creat d0/d1a/d3a/d71/ff0 x:0 0 0 2024-09-17T07:19:59.974 INFO:tasks.workunit.client.1.smithi139.stdout:6/620: dwrite db/f3d [0,4194304] 0 2024-09-17T07:19:59.974 INFO:tasks.workunit.client.1.smithi139.stdout:2/639: write d0/de/d25/fcb [1496045,67997] 0 2024-09-17T07:19:59.975 INFO:tasks.workunit.client.1.smithi139.stdout:0/431: mknod d1/da/d1b/d3d/d5a/d75/d91/d92/ca6 0 2024-09-17T07:19:59.975 INFO:tasks.workunit.client.0.smithi087.stdout:3/681: write d6/d1b/d42/d62/f8c [4491489,116017] 0 2024-09-17T07:19:59.976 INFO:tasks.workunit.client.0.smithi087.stdout:5/842: creat d5/d12/d14/f10f x:0 0 0 2024-09-17T07:19:59.977 INFO:tasks.workunit.client.0.smithi087.stdout:5/843: read - d5/d12/f109 zero size 2024-09-17T07:19:59.977 INFO:tasks.workunit.client.1.smithi139.stdout:5/672: fdatasync d4/d16/d1b/f39 0 2024-09-17T07:19:59.978 INFO:tasks.workunit.client.0.smithi087.stdout:3/682: chown d6/d1b/d42/dd4/f82 1303 1 2024-09-17T07:19:59.979 INFO:tasks.workunit.client.0.smithi087.stdout:9/653: dread d3/d4/d6/f3e [0,4194304] 0 2024-09-17T07:19:59.980 INFO:tasks.workunit.client.0.smithi087.stdout:1/598: creat d2/d3d/fd4 x:0 0 0 2024-09-17T07:19:59.980 INFO:tasks.workunit.client.0.smithi087.stdout:9/654: chown d3/d4/da 1159 1 2024-09-17T07:19:59.981 INFO:tasks.workunit.client.0.smithi087.stdout:1/599: chown d2/dcf/f9c 22241 1 2024-09-17T07:19:59.982 INFO:tasks.workunit.client.0.smithi087.stdout:6/823: truncate d1/f16 6765184 0 2024-09-17T07:19:59.982 INFO:tasks.workunit.client.1.smithi139.stdout:8/737: rmdir d0/d1a/d4d/da4 39 2024-09-17T07:19:59.982 INFO:tasks.workunit.client.1.smithi139.stdout:1/424: truncate d2/d10/d12/d24/f4e 944405 0 2024-09-17T07:19:59.983 INFO:tasks.workunit.client.0.smithi087.stdout:9/655: readlink d3/d4/d6/d8/d22/d64/l65 0 2024-09-17T07:19:59.983 INFO:tasks.workunit.client.1.smithi139.stdout:8/738: read d0/d20/d28/d52/d65/fad [736132,91871] 0 2024-09-17T07:19:59.984 INFO:tasks.workunit.client.0.smithi087.stdout:3/683: mkdir d6/d1b/d42/d62/dbb/ded 0 2024-09-17T07:19:59.984 INFO:tasks.workunit.client.0.smithi087.stdout:1/600: chown d2/d3d/d45/d90/d43/f66 3593 1 2024-09-17T07:19:59.984 INFO:tasks.workunit.client.0.smithi087.stdout:5/844: mkdir d5/d8/d1f/d4e/d10d/d110 0 2024-09-17T07:19:59.986 INFO:tasks.workunit.client.0.smithi087.stdout:9/656: dread - d3/d4/d6/d8/d12/db1/fdf zero size 2024-09-17T07:19:59.987 INFO:tasks.workunit.client.0.smithi087.stdout:6/824: read d1/d67/dfe/f31 [53974,77972] 0 2024-09-17T07:19:59.988 INFO:tasks.workunit.client.1.smithi139.stdout:6/621: chown db/df/d4e/d64/d54/l78 323253 1 2024-09-17T07:19:59.989 INFO:tasks.workunit.client.0.smithi087.stdout:5/845: write d5/d8/f10 [2544943,17156] 0 2024-09-17T07:19:59.989 INFO:tasks.workunit.client.0.smithi087.stdout:3/684: mkdir d6/d1b/d42/d62/dbb/dd7/dee 0 2024-09-17T07:19:59.989 INFO:tasks.workunit.client.0.smithi087.stdout:6/825: chown d1/d67/dfe/d2c 260052061 1 2024-09-17T07:19:59.989 INFO:tasks.workunit.client.1.smithi139.stdout:4/510: mkdir d0/d1/d54/d93/da1 0 2024-09-17T07:19:59.990 INFO:tasks.workunit.client.0.smithi087.stdout:1/601: rename d2/dcf/lbe to d2/dcf/d7e/ld5 0 2024-09-17T07:19:59.990 INFO:tasks.workunit.client.1.smithi139.stdout:2/640: mknod d0/dc/d15/d9f/dc1/cd9 0 2024-09-17T07:19:59.990 INFO:tasks.workunit.client.1.smithi139.stdout:5/673: mkdir d4/d16/d69/dd8/dd9 0 2024-09-17T07:19:59.991 INFO:tasks.workunit.client.1.smithi139.stdout:0/432: symlink d1/da/d1b/d3d/d5a/d98/la7 0 2024-09-17T07:19:59.991 INFO:tasks.workunit.client.1.smithi139.stdout:4/511: chown d0/db/f21 6341 1 2024-09-17T07:19:59.991 INFO:tasks.workunit.client.1.smithi139.stdout:3/491: dwrite d5/d15/d16/d4c/f4b [0,4194304] 0 2024-09-17T07:19:59.992 INFO:tasks.workunit.client.1.smithi139.stdout:1/425: creat d2/d10/d12/d13/f82 x:0 0 0 2024-09-17T07:19:59.994 INFO:tasks.workunit.client.1.smithi139.stdout:6/622: unlink db/df/d4c/l99 0 2024-09-17T07:19:59.995 INFO:tasks.workunit.client.1.smithi139.stdout:7/482: write d5/d17/d4e/d63/f6b [847219,50511] 0 2024-09-17T07:19:59.995 INFO:tasks.workunit.client.1.smithi139.stdout:6/623: stat db/d21/l4b 0 2024-09-17T07:19:59.996 INFO:tasks.workunit.client.1.smithi139.stdout:8/739: creat d0/d1a/dc9/ff1 x:0 0 0 2024-09-17T07:19:59.997 INFO:tasks.workunit.client.0.smithi087.stdout:5/846: mkdir d5/d6d/dd7/d111 0 2024-09-17T07:19:59.997 INFO:tasks.workunit.client.1.smithi139.stdout:0/433: mkdir d1/da/d1b/d32/da8 0 2024-09-17T07:19:59.998 INFO:tasks.workunit.client.1.smithi139.stdout:5/674: symlink d4/d16/d69/dd8/lda 0 2024-09-17T07:19:59.999 INFO:tasks.workunit.client.0.smithi087.stdout:6/826: mkdir d1/d67/dfe/d2c/d58/d90/d115 0 2024-09-17T07:20:00.000 INFO:tasks.workunit.client.1.smithi139.stdout:4/512: mkdir d0/d1/d54/d93/da2 0 2024-09-17T07:20:00.001 INFO:tasks.workunit.client.1.smithi139.stdout:1/426: mknod d2/d10/d12/d13/c83 0 2024-09-17T07:20:00.001 INFO:tasks.workunit.client.0.smithi087.stdout:1/602: truncate d2/d3d/d35/f53 4785568 0 2024-09-17T07:20:00.002 INFO:tasks.workunit.client.0.smithi087.stdout:5/847: symlink d5/d18/d6f/l112 0 2024-09-17T07:20:00.003 INFO:tasks.workunit.client.0.smithi087.stdout:3/685: creat d6/d1b/d42/d62/dc1/de8/fef x:0 0 0 2024-09-17T07:20:00.004 INFO:tasks.workunit.client.1.smithi139.stdout:8/740: creat d0/d1a/dc9/ff2 x:0 0 0 2024-09-17T07:20:00.004 INFO:tasks.workunit.client.0.smithi087.stdout:1/603: dread d2/d3d/d45/d90/f96 [0,4194304] 0 2024-09-17T07:20:00.005 INFO:tasks.workunit.client.0.smithi087.stdout:9/657: getdents d3/d4/d6/d8/d22 0 2024-09-17T07:20:00.006 INFO:tasks.workunit.client.0.smithi087.stdout:5/848: symlink d5/d18/d6f/l113 0 2024-09-17T07:20:00.007 INFO:tasks.workunit.client.0.smithi087.stdout:6/827: creat d1/d67/dfe/d5e/f116 x:0 0 0 2024-09-17T07:20:00.009 INFO:tasks.workunit.client.1.smithi139.stdout:6/624: mkdir db/d21/d96/dcf 0 2024-09-17T07:20:00.009 INFO:tasks.workunit.client.0.smithi087.stdout:9/658: rename d3/d4/d6/d8/d22/d92 to d3/d4/d6/d8/d22/d92/dec 22 2024-09-17T07:20:00.009 INFO:tasks.workunit.client.0.smithi087.stdout:1/604: read d2/d3d/d45/d90/d43/f93 [2737608,60754] 0 2024-09-17T07:20:00.009 INFO:tasks.workunit.client.1.smithi139.stdout:3/492: link d5/c2d d5/d15/ca1 0 2024-09-17T07:20:00.011 INFO:tasks.workunit.client.0.smithi087.stdout:5/849: symlink d5/d8/d1f/l114 0 2024-09-17T07:20:00.012 INFO:tasks.workunit.client.0.smithi087.stdout:9/659: rmdir d3/d4/d6/d8/d12/d32/da1 39 2024-09-17T07:20:00.012 INFO:tasks.workunit.client.1.smithi139.stdout:3/493: chown d5/d63/l75 1072813437 1 2024-09-17T07:20:00.013 INFO:tasks.workunit.client.0.smithi087.stdout:6/828: mknod d1/d67/d110/c117 0 2024-09-17T07:20:00.016 INFO:tasks.workunit.client.0.smithi087.stdout:6/829: unlink d1/lf9 0 2024-09-17T07:20:00.017 INFO:tasks.workunit.client.1.smithi139.stdout:7/483: dread d5/d10/d4d/f7d [0,4194304] 0 2024-09-17T07:20:00.018 INFO:tasks.workunit.client.1.smithi139.stdout:5/675: link d4/d16/d1b/d20/d32/d3d/c74 d4/d16/d1b/d20/d32/d72/cdb 0 2024-09-17T07:20:00.018 INFO:tasks.workunit.client.1.smithi139.stdout:5/676: fsync d4/d16/f8a 0 2024-09-17T07:20:00.020 INFO:tasks.workunit.client.0.smithi087.stdout:9/660: dwrite d3/d4/d6/d8/d12/d38/fea [0,4194304] 0 2024-09-17T07:20:00.020 INFO:tasks.workunit.client.0.smithi087.stdout:6/830: mkdir d1/d67/dfe/d2c/d48/d118 0 2024-09-17T07:20:00.021 INFO:tasks.workunit.client.1.smithi139.stdout:6/625: rename db/df/c1f to db/d18/d1b/cd0 0 2024-09-17T07:20:00.022 INFO:tasks.workunit.client.1.smithi139.stdout:6/626: write db/df/d4e/f68 [536546,55821] 0 2024-09-17T07:20:00.024 INFO:tasks.workunit.client.0.smithi087.stdout:9/661: unlink d3/d4/d6/d8/d22/d92/da3/fe7 0 2024-09-17T07:20:00.026 INFO:tasks.workunit.client.0.smithi087.stdout:3/686: write d6/d15/d92/f96 [768995,71083] 0 2024-09-17T07:20:00.031 INFO:tasks.workunit.client.0.smithi087.stdout:9/662: creat d3/d4/d6/d8/d12/d32/da1/fed x:0 0 0 2024-09-17T07:20:00.032 INFO:tasks.workunit.client.1.smithi139.stdout:3/494: rename d5/d15/d16/d25/c90 to d5/d15/d20/d3b/ca2 0 2024-09-17T07:20:00.034 INFO:tasks.workunit.client.1.smithi139.stdout:7/484: rmdir d5/d17/d68 0 2024-09-17T07:20:00.035 INFO:tasks.workunit.client.1.smithi139.stdout:2/641: write d0/d7/d86/da4/d28/f37 [2480979,94963] 0 2024-09-17T07:20:00.035 INFO:tasks.workunit.client.0.smithi087.stdout:3/687: creat d6/d15/d37/d3c/d52/db2/de7/ddd/ff0 x:0 0 0 2024-09-17T07:20:00.036 INFO:tasks.workunit.client.1.smithi139.stdout:1/427: write d2/f7 [3276140,39269] 0 2024-09-17T07:20:00.037 INFO:tasks.workunit.client.0.smithi087.stdout:5/850: dwrite d5/d18/d20/d2f/d83/fb0 [0,4194304] 0 2024-09-17T07:20:00.037 INFO:tasks.workunit.client.0.smithi087.stdout:9/663: fdatasync d3/d4/d16/d69/d8a/f21 0 2024-09-17T07:20:00.037 INFO:tasks.workunit.client.1.smithi139.stdout:7/485: fdatasync d5/f37 0 2024-09-17T07:20:00.038 INFO:tasks.workunit.client.0.smithi087.stdout:5/851: fdatasync d5/d12/d14/f7b 0 2024-09-17T07:20:00.039 INFO:tasks.workunit.client.0.smithi087.stdout:5/852: fdatasync d5/d8/d1f/f58 0 2024-09-17T07:20:00.040 INFO:tasks.workunit.client.1.smithi139.stdout:0/434: write d1/f26 [1835609,123091] 0 2024-09-17T07:20:00.040 INFO:tasks.workunit.client.0.smithi087.stdout:9/664: write d3/d4/d6/d8/d22/d64/f89 [1040515,124408] 0 2024-09-17T07:20:00.040 INFO:tasks.workunit.client.0.smithi087.stdout:3/688: rmdir d6/d1b/d42/d62/dbb 39 2024-09-17T07:20:00.041 INFO:tasks.workunit.client.0.smithi087.stdout:5/853: dread - d5/d12/ff1 zero size 2024-09-17T07:20:00.041 INFO:tasks.workunit.client.1.smithi139.stdout:2/642: unlink d0/d7/d67/d92/d99/l46 0 2024-09-17T07:20:00.043 INFO:tasks.workunit.client.1.smithi139.stdout:4/513: truncate d0/db/f74 303641 0 2024-09-17T07:20:00.044 INFO:tasks.workunit.client.0.smithi087.stdout:9/665: symlink d3/d4/d6/d8/d12/d38/lee 0 2024-09-17T07:20:00.044 INFO:tasks.workunit.client.0.smithi087.stdout:1/605: dread d2/d3d/d8e/fa9 [0,4194304] 0 2024-09-17T07:20:00.045 INFO:tasks.workunit.client.0.smithi087.stdout:5/854: write d5/d12/d1c/fab [348890,114331] 0 2024-09-17T07:20:00.047 INFO:tasks.workunit.client.0.smithi087.stdout:9/666: chown d3/d4/da/d4b/cd4 324 1 2024-09-17T07:20:00.047 INFO:tasks.workunit.client.1.smithi139.stdout:8/741: truncate d0/d20/d28/d52/fb7 341988 0 2024-09-17T07:20:00.049 INFO:tasks.workunit.client.0.smithi087.stdout:1/606: mkdir d2/d69/d8d/da6/dd6 0 2024-09-17T07:20:00.049 INFO:tasks.workunit.client.1.smithi139.stdout:7/486: dwrite d5/d17/f2a [4194304,4194304] 0 2024-09-17T07:20:00.049 INFO:tasks.workunit.client.1.smithi139.stdout:1/428: dread d2/d10/d12/d13/f43 [0,4194304] 0 2024-09-17T07:20:00.051 INFO:tasks.workunit.client.0.smithi087.stdout:3/689: rename d6/d1b/d42/d62/dbb/dd7/fd9 to d6/d15/d37/d5e/ff1 0 2024-09-17T07:20:00.051 INFO:tasks.workunit.client.1.smithi139.stdout:0/435: symlink d1/da/d17/d65/d8b/la9 0 2024-09-17T07:20:00.052 INFO:tasks.workunit.client.1.smithi139.stdout:8/742: truncate d0/d1a/d3a/d71/ff0 582874 0 2024-09-17T07:20:00.052 INFO:tasks.workunit.client.1.smithi139.stdout:6/627: write db/df/f24 [1459648,42307] 0 2024-09-17T07:20:00.052 INFO:tasks.workunit.client.1.smithi139.stdout:2/643: symlink d0/dc/d15/d9f/lda 0 2024-09-17T07:20:00.054 INFO:tasks.workunit.client.0.smithi087.stdout:5/855: dwrite d5/d8/ffd [0,4194304] 0 2024-09-17T07:20:00.054 INFO:tasks.workunit.client.1.smithi139.stdout:3/495: rename d5/lb to d5/d15/d16/d4c/d28/la3 0 2024-09-17T07:20:00.055 INFO:tasks.workunit.client.1.smithi139.stdout:8/743: read d0/d20/d28/d52/d65/f98 [855914,98870] 0 2024-09-17T07:20:00.058 INFO:tasks.workunit.client.1.smithi139.stdout:2/644: truncate d0/d4e/fc6 936343 0 2024-09-17T07:20:00.059 INFO:tasks.workunit.client.0.smithi087.stdout:1/607: creat d2/d14/da3/fd7 x:0 0 0 2024-09-17T07:20:00.060 INFO:tasks.workunit.client.1.smithi139.stdout:6/628: truncate db/df/d4e/d5e/fa8 472186 0 2024-09-17T07:20:00.061 INFO:tasks.workunit.client.0.smithi087.stdout:1/608: dread - d2/d3d/d8e/fba zero size 2024-09-17T07:20:00.062 INFO:tasks.workunit.client.1.smithi139.stdout:5/677: dwrite d4/d16/d1b/d20/d28/f3e [0,4194304] 0 2024-09-17T07:20:00.062 INFO:tasks.workunit.client.0.smithi087.stdout:1/609: fdatasync d2/d69/fa4 0 2024-09-17T07:20:00.062 INFO:tasks.workunit.client.1.smithi139.stdout:0/436: symlink d1/da/d17/d72/d66/d6c/laa 0 2024-09-17T07:20:00.063 INFO:tasks.workunit.client.1.smithi139.stdout:2/645: chown d0/de/d25/d3f/l48 12 1 2024-09-17T07:20:00.063 INFO:tasks.workunit.client.0.smithi087.stdout:9/667: creat d3/d4/d6/d8/d12/d32/fef x:0 0 0 2024-09-17T07:20:00.063 INFO:tasks.workunit.client.0.smithi087.stdout:1/610: truncate d2/dc/f23 5974833 0 2024-09-17T07:20:00.064 INFO:tasks.workunit.client.0.smithi087.stdout:5/856: symlink d5/l115 0 2024-09-17T07:20:00.064 INFO:tasks.workunit.client.0.smithi087.stdout:1/611: readlink d2/l6d 0 2024-09-17T07:20:00.064 INFO:tasks.workunit.client.1.smithi139.stdout:1/429: mknod d2/d10/d12/d35/d2b/d4a/d6f/c84 0 2024-09-17T07:20:00.064 INFO:tasks.workunit.client.1.smithi139.stdout:0/437: readlink d1/da/d1b/l86 0 2024-09-17T07:20:00.065 INFO:tasks.workunit.client.0.smithi087.stdout:9/668: write d3/d4/d6/d8/d22/d43/f5f [432529,11784] 0 2024-09-17T07:20:00.065 INFO:tasks.workunit.client.1.smithi139.stdout:7/487: link d5/d10/d4d/l92 d5/d10/d2b/d78/l9c 0 2024-09-17T07:20:00.067 INFO:tasks.workunit.client.1.smithi139.stdout:7/488: truncate d5/d17/f27 5707994 0 2024-09-17T07:20:00.067 INFO:tasks.workunit.client.0.smithi087.stdout:3/690: rmdir d6/d15/d37 39 2024-09-17T07:20:00.068 INFO:tasks.workunit.client.1.smithi139.stdout:3/496: creat d5/d15/d16/d25/d97/fa4 x:0 0 0 2024-09-17T07:20:00.068 INFO:tasks.workunit.client.1.smithi139.stdout:5/678: chown d4/d16/d1b/d20/d28/l2d 6114 1 2024-09-17T07:20:00.069 INFO:tasks.workunit.client.1.smithi139.stdout:3/497: fdatasync d5/d15/d56/f7c 0 2024-09-17T07:20:00.070 INFO:tasks.workunit.client.1.smithi139.stdout:2/646: unlink d0/de/d69/c60 0 2024-09-17T07:20:00.070 INFO:tasks.workunit.client.1.smithi139.stdout:6/629: mknod db/d21/d96/dcf/cd1 0 2024-09-17T07:20:00.071 INFO:tasks.workunit.client.0.smithi087.stdout:1/612: dread d2/dcf/d7e/fbf [0,4194304] 0 2024-09-17T07:20:00.072 INFO:tasks.workunit.client.1.smithi139.stdout:0/438: chown d1/da/d1b/d3d/d5a/d75/d91/d92/ca6 61203944 1 2024-09-17T07:20:00.072 INFO:tasks.workunit.client.1.smithi139.stdout:1/430: rename d2/ff to d2/d10/d12/d1a/d61/f85 0 2024-09-17T07:20:00.073 INFO:tasks.workunit.client.0.smithi087.stdout:2/668: sync 2024-09-17T07:20:00.074 INFO:tasks.workunit.client.0.smithi087.stdout:1/613: stat d2/f2d 0 2024-09-17T07:20:00.075 INFO:tasks.workunit.client.1.smithi139.stdout:6/630: mkdir db/d18/d9f/dd2 0 2024-09-17T07:20:00.075 INFO:tasks.workunit.client.0.smithi087.stdout:5/857: rename d5/d18/d20/d2f/d60/de3/ca8 to d5/d12/d14/d61/d94/c116 0 2024-09-17T07:20:00.075 INFO:tasks.workunit.client.0.smithi087.stdout:9/669: dwrite d3/d4/d6/d8/d12/d32/da1/fed [0,4194304] 0 2024-09-17T07:20:00.076 INFO:tasks.workunit.client.1.smithi139.stdout:1/431: fsync d2/d10/d12/d35/d49/f81 0 2024-09-17T07:20:00.076 INFO:tasks.workunit.client.1.smithi139.stdout:7/489: symlink d5/d10/d2b/d40/l9d 0 2024-09-17T07:20:00.078 INFO:tasks.workunit.client.0.smithi087.stdout:5/858: write d5/d12/d1c/fae [2112232,21386] 0 2024-09-17T07:20:00.080 INFO:tasks.workunit.client.0.smithi087.stdout:1/614: write d2/d3d/d45/d90/d43/f66 [1685622,2897] 0 2024-09-17T07:20:00.080 INFO:tasks.workunit.client.1.smithi139.stdout:6/631: read db/f16 [914905,109005] 0 2024-09-17T07:20:00.081 INFO:tasks.workunit.client.1.smithi139.stdout:7/490: write d5/d10/f2e [4251621,39744] 0 2024-09-17T07:20:00.081 INFO:tasks.workunit.client.1.smithi139.stdout:5/679: dread d4/d16/d1b/d20/f7d [0,4194304] 0 2024-09-17T07:20:00.083 INFO:tasks.workunit.client.0.smithi087.stdout:5/859: write d5/d12/f109 [71894,67119] 0 2024-09-17T07:20:00.083 INFO:tasks.workunit.client.0.smithi087.stdout:9/670: symlink d3/d4/d16/d69/d8a/d1e/d90/d93/d96/lf0 0 2024-09-17T07:20:00.084 INFO:tasks.workunit.client.1.smithi139.stdout:6/632: stat db/db7 0 2024-09-17T07:20:00.084 INFO:tasks.workunit.client.1.smithi139.stdout:0/439: mknod d1/da/d1b/d32/d81/cab 0 2024-09-17T07:20:00.086 INFO:tasks.workunit.client.1.smithi139.stdout:1/432: creat d2/d10/d12/d13/d4f/d5c/f86 x:0 0 0 2024-09-17T07:20:00.089 INFO:tasks.workunit.client.1.smithi139.stdout:2/647: dwrite d0/d7/d67/d92/d99/f8f [0,4194304] 0 2024-09-17T07:20:00.090 INFO:tasks.workunit.client.1.smithi139.stdout:3/498: dwrite d5/d15/d16/d4c/f9a [0,4194304] 0 2024-09-17T07:20:00.090 INFO:tasks.workunit.client.0.smithi087.stdout:1/615: link d2/dcf/d7e/ld5 d2/dcf/d9a/ld8 0 2024-09-17T07:20:00.091 INFO:tasks.workunit.client.0.smithi087.stdout:9/671: rename d3/dac to d3/d4/d6/d8/df1 0 2024-09-17T07:20:00.092 INFO:tasks.workunit.client.0.smithi087.stdout:1/616: read d2/d14/fb [840402,122540] 0 2024-09-17T07:20:00.092 INFO:tasks.workunit.client.1.smithi139.stdout:6/633: creat db/d18/d1b/fd3 x:0 0 0 2024-09-17T07:20:00.095 INFO:tasks.workunit.client.1.smithi139.stdout:2/648: creat d0/d7/fdb x:0 0 0 2024-09-17T07:20:00.097 INFO:tasks.workunit.client.1.smithi139.stdout:5/680: mkdir d4/d16/d1b/d20/d38/d4f/ddc 0 2024-09-17T07:20:00.097 INFO:tasks.workunit.client.0.smithi087.stdout:1/617: link d2/d3d/d45/d90/fae d2/d3d/d35/d4f/da5/dce/fd9 0 2024-09-17T07:20:00.101 INFO:tasks.workunit.client.1.smithi139.stdout:0/440: dwrite d1/da/d2a/f80 [0,4194304] 0 2024-09-17T07:20:00.101 INFO:tasks.workunit.client.0.smithi087.stdout:1/618: truncate d2/dcf/d7e/db9/fbc 772798 0 2024-09-17T07:20:00.102 INFO:tasks.workunit.client.1.smithi139.stdout:3/499: creat d5/d15/d16/d4c/d28/d54/d8e/fa5 x:0 0 0 2024-09-17T07:20:00.103 INFO:tasks.workunit.client.1.smithi139.stdout:5/681: rmdir d4/d16/d69/dbc 39 2024-09-17T07:20:00.104 INFO:tasks.workunit.client.0.smithi087.stdout:1/619: symlink d2/d14/lda 0 2024-09-17T07:20:00.108 INFO:tasks.workunit.client.0.smithi087.stdout:2/669: dread d2/d7/d33/fa9 [0,4194304] 0 2024-09-17T07:20:00.112 INFO:tasks.workunit.client.1.smithi139.stdout:5/682: dwrite d4/d5d/d97/fb3 [0,4194304] 0 2024-09-17T07:20:00.113 INFO:tasks.workunit.client.0.smithi087.stdout:3/691: write d6/f57 [4008618,27425] 0 2024-09-17T07:20:00.113 INFO:tasks.workunit.client.0.smithi087.stdout:2/670: chown d2/d7/dd/d10/d4c/d5f/d8b/cae 22647 1 2024-09-17T07:20:00.114 INFO:tasks.workunit.client.1.smithi139.stdout:0/441: rmdir d1/da/d1b/d32/da8 0 2024-09-17T07:20:00.115 INFO:tasks.workunit.client.0.smithi087.stdout:1/620: dwrite d2/d3d/d45/fc6 [0,4194304] 0 2024-09-17T07:20:00.116 INFO:tasks.workunit.client.0.smithi087.stdout:2/671: truncate d2/d7/dd/d10/f53 4533845 0 2024-09-17T07:20:00.117 INFO:tasks.workunit.client.0.smithi087.stdout:9/672: write d3/d25/d83/fc9 [1038287,125767] 0 2024-09-17T07:20:00.120 INFO:tasks.workunit.client.0.smithi087.stdout:1/621: creat d2/d3d/db4/dc3/fdb x:0 0 0 2024-09-17T07:20:00.121 INFO:tasks.workunit.client.1.smithi139.stdout:0/442: link d1/da/d17/d72/c39 d1/da/d2a/cac 0 2024-09-17T07:20:00.123 INFO:tasks.workunit.client.1.smithi139.stdout:5/683: dwrite d4/d16/d1b/d20/d32/d6c/dc9/fd6 [0,4194304] 0 2024-09-17T07:20:00.123 INFO:tasks.workunit.client.0.smithi087.stdout:5/860: dread d5/d8/d1f/d4e/da3/d102/f107 [4194304,4194304] 0 2024-09-17T07:20:00.124 INFO:tasks.workunit.client.0.smithi087.stdout:1/622: stat d2/d3d/d45/d90/l2c 0 2024-09-17T07:20:00.126 INFO:tasks.workunit.client.1.smithi139.stdout:7/491: truncate d5/d17/f2a 6461249 0 2024-09-17T07:20:00.126 INFO:tasks.workunit.client.0.smithi087.stdout:9/673: link d3/d4/d6/d8/d12/db1/fdf d3/d4/da/d4b/ff2 0 2024-09-17T07:20:00.126 INFO:tasks.workunit.client.1.smithi139.stdout:7/492: stat d5/d10/d4d 0 2024-09-17T07:20:00.127 INFO:tasks.workunit.client.0.smithi087.stdout:5/861: write d5/d8/f10 [3514420,38891] 0 2024-09-17T07:20:00.129 INFO:tasks.workunit.client.0.smithi087.stdout:5/862: fsync d5/d12/d1c/fe6 0 2024-09-17T07:20:00.129 INFO:tasks.workunit.client.0.smithi087.stdout:2/672: symlink d2/d7/d60/ld4 0 2024-09-17T07:20:00.129 INFO:tasks.workunit.client.0.smithi087.stdout:1/623: truncate d2/d3d/d45/d90/f47 972490 0 2024-09-17T07:20:00.131 INFO:tasks.workunit.client.0.smithi087.stdout:2/673: dread - d2/d7/dd/d6a/d6d/f77 zero size 2024-09-17T07:20:00.131 INFO:tasks.workunit.client.0.smithi087.stdout:1/624: fsync d2/d3d/d45/d90/d43/f66 0 2024-09-17T07:20:00.134 INFO:tasks.workunit.client.1.smithi139.stdout:0/443: rename d1/da/d1b/d3d/d50/c74 to d1/da/d1b/d3d/d5a/d75/d91/cad 0 2024-09-17T07:20:00.134 INFO:tasks.workunit.client.1.smithi139.stdout:6/634: dwrite f7 [0,4194304] 0 2024-09-17T07:20:00.136 INFO:tasks.workunit.client.0.smithi087.stdout:5/863: dread d5/d12/d14/d61/fce [4194304,4194304] 0 2024-09-17T07:20:00.136 INFO:tasks.workunit.client.0.smithi087.stdout:9/674: rename d3/d4/d6/d8/d22/d43/l6d to d3/d4/da/lf3 0 2024-09-17T07:20:00.136 INFO:tasks.workunit.client.1.smithi139.stdout:6/635: fsync db/d18/d1b/fd3 0 2024-09-17T07:20:00.139 INFO:tasks.workunit.client.1.smithi139.stdout:7/493: getdents d5/d10/d2b/d40 0 2024-09-17T07:20:00.139 INFO:tasks.workunit.client.1.smithi139.stdout:6/636: dread - db/df/d73/f7a zero size 2024-09-17T07:20:00.139 INFO:tasks.workunit.client.0.smithi087.stdout:5/864: creat d5/d18/d20/d2f/d83/dac/f117 x:0 0 0 2024-09-17T07:20:00.141 INFO:tasks.workunit.client.0.smithi087.stdout:1/625: rename d2/f2d to d2/d3d/d45/d90/fdc 0 2024-09-17T07:20:00.143 INFO:tasks.workunit.client.1.smithi139.stdout:3/500: write d5/d15/f51 [459915,25287] 0 2024-09-17T07:20:00.145 INFO:tasks.workunit.client.1.smithi139.stdout:3/501: chown d5/d21/d23/d69/f84 438197489 1 2024-09-17T07:20:00.147 INFO:tasks.workunit.client.1.smithi139.stdout:6/637: dwrite db/d18/d1b/da7/fb3 [0,4194304] 0 2024-09-17T07:20:00.147 INFO:tasks.workunit.client.1.smithi139.stdout:3/502: write d5/d21/d23/d38/f9d [868324,17692] 0 2024-09-17T07:20:00.148 INFO:tasks.workunit.client.0.smithi087.stdout:3/692: write d6/d15/d37/f5c [125989,5635] 0 2024-09-17T07:20:00.148 INFO:tasks.workunit.client.0.smithi087.stdout:1/626: chown d2/d3d/c59 8179969 1 2024-09-17T07:20:00.148 INFO:tasks.workunit.client.0.smithi087.stdout:5/865: dwrite d5/d6d/f90 [0,4194304] 0 2024-09-17T07:20:00.150 INFO:tasks.workunit.client.1.smithi139.stdout:3/503: creat d5/d21/d23/d69/fa6 x:0 0 0 2024-09-17T07:20:00.153 INFO:tasks.workunit.client.1.smithi139.stdout:3/504: mkdir d5/da7 0 2024-09-17T07:20:00.154 INFO:tasks.workunit.client.0.smithi087.stdout:9/675: truncate d3/d4/d6/d8/d12/d32/da1/fed 3982355 0 2024-09-17T07:20:00.156 INFO:tasks.workunit.client.0.smithi087.stdout:5/866: mkdir d5/d18/d20/d2f/d118 0 2024-09-17T07:20:00.156 INFO:tasks.workunit.client.1.smithi139.stdout:6/638: getdents db/df 0 2024-09-17T07:20:00.158 INFO:tasks.workunit.client.1.smithi139.stdout:3/505: rename d5/d15/d20/d3b/l96 to d5/d21/d23/d38/la8 0 2024-09-17T07:20:00.159 INFO:tasks.workunit.client.1.smithi139.stdout:5/684: truncate d4/d16/d1b/d20/d28/f53 2696781 0 2024-09-17T07:20:00.159 INFO:tasks.workunit.client.1.smithi139.stdout:3/506: stat d5/d15/d16/d4c/d28 0 2024-09-17T07:20:00.160 INFO:tasks.workunit.client.0.smithi087.stdout:3/693: getdents d6/d15/d37/d5e 0 2024-09-17T07:20:00.161 INFO:tasks.workunit.client.1.smithi139.stdout:6/639: dread db/df/d73/d81/f67 [0,4194304] 0 2024-09-17T07:20:00.161 INFO:tasks.workunit.client.1.smithi139.stdout:3/507: write d5/d15/f7a [1316495,117968] 0 2024-09-17T07:20:00.162 INFO:tasks.workunit.client.0.smithi087.stdout:5/867: mkdir d5/d12/d14/d61/d119 0 2024-09-17T07:20:00.164 INFO:tasks.workunit.client.0.smithi087.stdout:9/676: read d3/d4/d6/d8/d22/f2d [3963297,84971] 0 2024-09-17T07:20:00.164 INFO:tasks.workunit.client.0.smithi087.stdout:2/674: dwrite d2/f67 [0,4194304] 0 2024-09-17T07:20:00.164 INFO:tasks.workunit.client.1.smithi139.stdout:6/640: read - db/df/d4e/d64/d83/fc6 zero size 2024-09-17T07:20:00.165 INFO:tasks.workunit.client.0.smithi087.stdout:1/627: dwrite d2/dcf/d7e/f83 [0,4194304] 0 2024-09-17T07:20:00.167 INFO:tasks.workunit.client.1.smithi139.stdout:3/508: symlink d5/d15/d16/d4c/la9 0 2024-09-17T07:20:00.167 INFO:tasks.workunit.client.0.smithi087.stdout:9/677: chown d3/d4/d16/dc0 12961996 1 2024-09-17T07:20:00.167 INFO:tasks.workunit.client.1.smithi139.stdout:6/641: truncate db/df/d4e/d64/d54/f3a 443132 0 2024-09-17T07:20:00.168 INFO:tasks.workunit.client.0.smithi087.stdout:9/678: dread - d3/d4/d16/d69/f9f zero size 2024-09-17T07:20:00.169 INFO:tasks.workunit.client.1.smithi139.stdout:6/642: write db/df/d4e/d64/d80/fb5 [281905,52826] 0 2024-09-17T07:20:00.170 INFO:tasks.workunit.client.1.smithi139.stdout:6/643: truncate f7 5078919 0 2024-09-17T07:20:00.171 INFO:tasks.workunit.client.1.smithi139.stdout:5/685: fsync d4/d16/f1d 0 2024-09-17T07:20:00.174 INFO:tasks.workunit.client.1.smithi139.stdout:6/644: creat db/d18/d9f/fd4 x:0 0 0 2024-09-17T07:20:00.178 INFO:tasks.workunit.client.1.smithi139.stdout:3/509: rename d5/d15/d16/d4c/d28/d54/d58/l98 to d5/d63/d6d/d6f/d81/d82/laa 0 2024-09-17T07:20:00.178 INFO:tasks.workunit.client.0.smithi087.stdout:9/679: mkdir d3/d4/dcd/df4 0 2024-09-17T07:20:00.180 INFO:tasks.workunit.client.0.smithi087.stdout:1/628: getdents d2/d3d/d35/d4f 0 2024-09-17T07:20:00.181 INFO:tasks.workunit.client.1.smithi139.stdout:5/686: dwrite d4/f36 [0,4194304] 0 2024-09-17T07:20:00.182 INFO:tasks.workunit.client.1.smithi139.stdout:5/687: write d4/d16/d1b/d20/d28/f3e [5207210,9169] 0 2024-09-17T07:20:00.187 INFO:tasks.workunit.client.1.smithi139.stdout:5/688: dread d4/d16/d1b/d20/d38/f54 [0,4194304] 0 2024-09-17T07:20:00.190 INFO:tasks.workunit.client.1.smithi139.stdout:5/689: symlink d4/d16/d1b/d20/d32/ldd 0 2024-09-17T07:20:00.195 INFO:tasks.workunit.client.0.smithi087.stdout:1/629: symlink d2/d3d/d45/d90/d37/ldd 0 2024-09-17T07:20:00.195 INFO:tasks.workunit.client.0.smithi087.stdout:9/680: creat d3/d4/dcd/df4/ff5 x:0 0 0 2024-09-17T07:20:00.196 INFO:tasks.workunit.client.1.smithi139.stdout:5/690: dwrite d4/d16/d1b/d20/d28/d3f/fb7 [0,4194304] 0 2024-09-17T07:20:00.197 INFO:tasks.workunit.client.0.smithi087.stdout:9/681: write d3/d4/d6/d8/d22/d92/da3/fa9 [73425,35111] 0 2024-09-17T07:20:00.197 INFO:tasks.workunit.client.0.smithi087.stdout:1/630: creat d2/d3d/d35/fde x:0 0 0 2024-09-17T07:20:00.197 INFO:tasks.workunit.client.0.smithi087.stdout:9/682: readlink d3/d4/d6/d71/l95 0 2024-09-17T07:20:00.199 INFO:tasks.workunit.client.0.smithi087.stdout:1/631: mknod d2/cdf 0 2024-09-17T07:20:00.199 INFO:tasks.workunit.client.0.smithi087.stdout:9/683: chown d3/d4/d6/d8/d22/d43/d84/fbb 0 1 2024-09-17T07:20:00.201 INFO:tasks.workunit.client.0.smithi087.stdout:1/632: symlink d2/d69/d8d/le0 0 2024-09-17T07:20:00.203 INFO:tasks.workunit.client.1.smithi139.stdout:5/691: link d4/d16/d1b/d20/l30 d4/d16/d1b/d20/d67/d88/d9f/lde 0 2024-09-17T07:20:00.203 INFO:tasks.workunit.client.0.smithi087.stdout:3/694: dread d6/d15/d37/f55 [0,4194304] 0 2024-09-17T07:20:00.203 INFO:tasks.workunit.client.0.smithi087.stdout:5/868: dread d5/d12/d4d/f47 [4194304,4194304] 0 2024-09-17T07:20:00.204 INFO:tasks.workunit.client.0.smithi087.stdout:5/869: readlink d5/l4c 0 2024-09-17T07:20:00.205 INFO:tasks.workunit.client.0.smithi087.stdout:1/633: read d2/d3d/d45/d90/d43/f93 [2585964,69599] 0 2024-09-17T07:20:00.206 INFO:tasks.workunit.client.1.smithi139.stdout:5/692: creat d4/d16/d1b/d20/d28/dca/fdf x:0 0 0 2024-09-17T07:20:00.206 INFO:tasks.workunit.client.1.smithi139.stdout:3/510: dread d5/d21/d23/d38/f5f [0,4194304] 0 2024-09-17T07:20:00.207 INFO:tasks.workunit.client.0.smithi087.stdout:5/870: write d5/d8/d1f/d4e/da3/fe7 [92747,63764] 0 2024-09-17T07:20:00.208 INFO:tasks.workunit.client.0.smithi087.stdout:1/634: mknod d2/d69/ce1 0 2024-09-17T07:20:00.209 INFO:tasks.workunit.client.1.smithi139.stdout:6/645: dread db/d18/d38/d60/f94 [0,4194304] 0 2024-09-17T07:20:00.209 INFO:tasks.workunit.client.1.smithi139.stdout:3/511: unlink d5/d15/l7e 0 2024-09-17T07:20:00.210 INFO:tasks.workunit.client.0.smithi087.stdout:5/871: truncate d5/d18/d20/d2f/fdd 1207659 0 2024-09-17T07:20:00.210 INFO:tasks.workunit.client.1.smithi139.stdout:5/693: rmdir d4/d16/d1b/d20/d32/d6c 39 2024-09-17T07:20:00.211 INFO:tasks.workunit.client.1.smithi139.stdout:3/512: write d5/d15/d56/f29 [1382585,68606] 0 2024-09-17T07:20:00.211 INFO:tasks.workunit.client.0.smithi087.stdout:3/695: getdents d6/d15/d37/d3c/d52/db2/de7/ddd 0 2024-09-17T07:20:00.211 INFO:tasks.workunit.client.1.smithi139.stdout:6/646: mkdir db/df/d4e/d64/d83/dd5 0 2024-09-17T07:20:00.212 INFO:tasks.workunit.client.1.smithi139.stdout:5/694: write d4/d16/f19 [1564551,5931] 0 2024-09-17T07:20:00.213 INFO:tasks.workunit.client.0.smithi087.stdout:5/872: mkdir d5/d8/d1f/d4e/d10d/d11a 0 2024-09-17T07:20:00.213 INFO:tasks.workunit.client.1.smithi139.stdout:3/513: mkdir d5/d15/d16/d25/dab 0 2024-09-17T07:20:00.214 INFO:tasks.workunit.client.1.smithi139.stdout:6/647: read - db/d18/d38/f43 zero size 2024-09-17T07:20:00.217 INFO:tasks.workunit.client.0.smithi087.stdout:9/684: truncate d3/d4/f8d 6438530 0 2024-09-17T07:20:00.217 INFO:tasks.workunit.client.0.smithi087.stdout:5/873: chown d5/d18/d20/c40 1 1 2024-09-17T07:20:00.218 INFO:tasks.workunit.client.1.smithi139.stdout:5/695: dread d4/f6 [0,4194304] 0 2024-09-17T07:20:00.219 INFO:tasks.workunit.client.0.smithi087.stdout:5/874: stat d5/d18/c9f 0 2024-09-17T07:20:00.221 INFO:tasks.workunit.client.0.smithi087.stdout:1/635: dwrite d2/d3d/d8e/fa9 [4194304,4194304] 0 2024-09-17T07:20:00.221 INFO:tasks.workunit.client.0.smithi087.stdout:9/685: rmdir d3/d4/d6/d8/d22/d64 39 2024-09-17T07:20:00.222 INFO:tasks.workunit.client.0.smithi087.stdout:3/696: dwrite d6/d1b/d42/d62/f8c [0,4194304] 0 2024-09-17T07:20:00.223 INFO:tasks.workunit.client.0.smithi087.stdout:1/636: chown d2/dcf/l42 654 1 2024-09-17T07:20:00.225 INFO:tasks.workunit.client.1.smithi139.stdout:5/696: dwrite d4/d16/d1b/d20/d28/f3e [0,4194304] 0 2024-09-17T07:20:00.226 INFO:tasks.workunit.client.1.smithi139.stdout:3/514: write d5/d15/d16/d4c/f66 [1274841,65589] 0 2024-09-17T07:20:00.227 INFO:tasks.workunit.client.1.smithi139.stdout:5/697: readlink d4/d16/d1b/d20/l30 0 2024-09-17T07:20:00.228 INFO:tasks.workunit.client.1.smithi139.stdout:3/515: read d5/d21/d23/f49 [789346,54925] 0 2024-09-17T07:20:00.228 INFO:tasks.workunit.client.1.smithi139.stdout:5/698: chown d4/l4e 296 1 2024-09-17T07:20:00.229 INFO:tasks.workunit.client.1.smithi139.stdout:3/516: fsync d5/d21/d23/f9c 0 2024-09-17T07:20:00.229 INFO:tasks.workunit.client.0.smithi087.stdout:9/686: unlink d3/d4/d16/d69/d8a/d1e/d90/d93/d96/lf0 0 2024-09-17T07:20:00.230 INFO:tasks.workunit.client.0.smithi087.stdout:3/697: symlink d6/d1b/d42/d6e/db0/lf2 0 2024-09-17T07:20:00.230 INFO:tasks.workunit.client.1.smithi139.stdout:3/517: fsync d5/d21/f4e 0 2024-09-17T07:20:00.231 INFO:tasks.workunit.client.1.smithi139.stdout:5/699: mkdir d4/d16/d1b/d20/d67/d88/de0 0 2024-09-17T07:20:00.232 INFO:tasks.workunit.client.0.smithi087.stdout:5/875: rename d5/d8 to d5/d18/d6f/d11b 0 2024-09-17T07:20:00.233 INFO:tasks.workunit.client.1.smithi139.stdout:3/518: creat d5/da7/fac x:0 0 0 2024-09-17T07:20:00.235 INFO:tasks.workunit.client.1.smithi139.stdout:5/700: creat d4/d16/d1b/d20/d67/d88/d9f/fe1 x:0 0 0 2024-09-17T07:20:00.235 INFO:tasks.workunit.client.0.smithi087.stdout:1/637: dwrite d2/d14/da3/fd7 [0,4194304] 0 2024-09-17T07:20:00.238 INFO:tasks.workunit.client.0.smithi087.stdout:9/687: symlink d3/d4/d6/d8/d22/d43/lf6 0 2024-09-17T07:20:00.239 INFO:tasks.workunit.client.0.smithi087.stdout:1/638: write d2/d48/d6f/fc1 [233928,119375] 0 2024-09-17T07:20:00.241 INFO:tasks.workunit.client.1.smithi139.stdout:5/701: creat d4/da5/fe2 x:0 0 0 2024-09-17T07:20:00.243 INFO:tasks.workunit.client.1.smithi139.stdout:3/519: dwrite d5/d15/d16/d4c/f66 [0,4194304] 0 2024-09-17T07:20:00.243 INFO:tasks.workunit.client.0.smithi087.stdout:9/688: chown d3/d4/d6/d8/d22/d64/c74 39 1 2024-09-17T07:20:00.247 INFO:tasks.workunit.client.1.smithi139.stdout:6/648: dread db/df/d73/f95 [0,4194304] 0 2024-09-17T07:20:00.247 INFO:tasks.workunit.client.1.smithi139.stdout:5/702: mknod d4/d16/ce3 0 2024-09-17T07:20:00.247 INFO:tasks.workunit.client.0.smithi087.stdout:1/639: dwrite d2/d14/da3/fd7 [0,4194304] 0 2024-09-17T07:20:00.249 INFO:tasks.workunit.client.0.smithi087.stdout:9/689: rename d3/d4/d16/dc0/l8e to d3/d4/d16/d69/d8a/d1e/lf7 0 2024-09-17T07:20:00.249 INFO:tasks.workunit.client.1.smithi139.stdout:3/520: write d5/d15/d16/d4c/f66 [1967764,86255] 0 2024-09-17T07:20:00.250 INFO:tasks.workunit.client.0.smithi087.stdout:9/690: stat d3/d4/d6/ldc 0 2024-09-17T07:20:00.250 INFO:tasks.workunit.client.0.smithi087.stdout:1/640: mknod d2/d3d/d8e/ce2 0 2024-09-17T07:20:00.251 INFO:tasks.workunit.client.1.smithi139.stdout:5/703: chown d4/d16/d1b/d20/d38/dd4 175 1 2024-09-17T07:20:00.251 INFO:tasks.workunit.client.0.smithi087.stdout:9/691: read d3/d4/d6/d8/d22/d43/f5f [146257,46172] 0 2024-09-17T07:20:00.252 INFO:tasks.workunit.client.0.smithi087.stdout:9/692: fdatasync d3/d25/d83/fad 0 2024-09-17T07:20:00.253 INFO:tasks.workunit.client.0.smithi087.stdout:1/641: truncate d2/dcf/f67 2512530 0 2024-09-17T07:20:00.254 INFO:tasks.workunit.client.1.smithi139.stdout:3/521: unlink d5/f2b 0 2024-09-17T07:20:00.255 INFO:tasks.workunit.client.1.smithi139.stdout:6/649: dread f8 [0,4194304] 0 2024-09-17T07:20:00.257 INFO:tasks.workunit.client.0.smithi087.stdout:9/693: creat d3/d4/da/ff8 x:0 0 0 2024-09-17T07:20:00.258 INFO:tasks.workunit.client.0.smithi087.stdout:1/642: getdents d2/d3d/d35 0 2024-09-17T07:20:00.259 INFO:tasks.workunit.client.0.smithi087.stdout:9/694: write d3/d4/da/f55 [2151300,100745] 0 2024-09-17T07:20:00.260 INFO:tasks.workunit.client.1.smithi139.stdout:5/704: rmdir d4/d16/d1b/d20/d38/d4f/ddc 0 2024-09-17T07:20:00.262 INFO:tasks.workunit.client.0.smithi087.stdout:1/643: creat d2/d14/fe3 x:0 0 0 2024-09-17T07:20:00.263 INFO:tasks.workunit.client.1.smithi139.stdout:6/650: mknod db/df/d4e/d64/d80/cd6 0 2024-09-17T07:20:00.264 INFO:tasks.workunit.client.1.smithi139.stdout:3/522: dwrite d5/d15/f18 [0,4194304] 0 2024-09-17T07:20:00.264 INFO:tasks.workunit.client.1.smithi139.stdout:5/705: symlink d4/d5d/le4 0 2024-09-17T07:20:00.264 INFO:tasks.workunit.client.0.smithi087.stdout:1/644: creat d2/d69/d8d/da6/fe4 x:0 0 0 2024-09-17T07:20:00.267 INFO:tasks.workunit.client.0.smithi087.stdout:1/645: creat d2/d3d/d45/fe5 x:0 0 0 2024-09-17T07:20:00.268 INFO:tasks.workunit.client.0.smithi087.stdout:1/646: chown d2/d48/d61/f8c 6 1 2024-09-17T07:20:00.269 INFO:tasks.workunit.client.0.smithi087.stdout:9/695: link d3/d4/d16/fc2 d3/d4/d6/d8/ff9 0 2024-09-17T07:20:00.270 INFO:tasks.workunit.client.1.smithi139.stdout:6/651: getdents db/d18/d38 0 2024-09-17T07:20:00.271 INFO:tasks.workunit.client.1.smithi139.stdout:5/706: dread d4/d16/d1b/d20/d32/d6c/f70 [0,4194304] 0 2024-09-17T07:20:00.271 INFO:tasks.workunit.client.1.smithi139.stdout:6/652: read db/f16 [1304031,97687] 0 2024-09-17T07:20:00.272 INFO:tasks.workunit.client.0.smithi087.stdout:9/696: chown d3/d4/d6/d8/d12/d32/f8f 422062 1 2024-09-17T07:20:00.272 INFO:tasks.workunit.client.1.smithi139.stdout:6/653: stat db/d18/d5b/f8b 0 2024-09-17T07:20:00.275 INFO:tasks.workunit.client.0.smithi087.stdout:1/647: truncate d2/d3d/d45/d90/d37/f8b 253410 0 2024-09-17T07:20:00.275 INFO:tasks.workunit.client.1.smithi139.stdout:6/654: creat db/db7/fd7 x:0 0 0 2024-09-17T07:20:00.276 INFO:tasks.workunit.client.0.smithi087.stdout:9/697: truncate d3/d4/fb 863464 0 2024-09-17T07:20:00.277 INFO:tasks.workunit.client.0.smithi087.stdout:1/648: write d2/d69/f70 [3978230,69676] 0 2024-09-17T07:20:00.278 INFO:tasks.workunit.client.1.smithi139.stdout:6/655: symlink db/df/d4e/ld8 0 2024-09-17T07:20:00.278 INFO:tasks.workunit.client.0.smithi087.stdout:5/876: dread d5/d12/d4d/fbe [0,4194304] 0 2024-09-17T07:20:00.279 INFO:tasks.workunit.client.0.smithi087.stdout:9/698: mknod d3/d4/cfa 0 2024-09-17T07:20:00.280 INFO:tasks.workunit.client.1.smithi139.stdout:5/707: dwrite d4/d16/d1b/d20/d38/f54 [0,4194304] 0 2024-09-17T07:20:00.284 INFO:tasks.workunit.client.0.smithi087.stdout:0/910: sync 2024-09-17T07:20:00.284 INFO:tasks.workunit.client.0.smithi087.stdout:4/709: sync 2024-09-17T07:20:00.284 INFO:tasks.workunit.client.0.smithi087.stdout:7/515: sync 2024-09-17T07:20:00.284 INFO:tasks.workunit.client.1.smithi139.stdout:6/656: rename db/d18/d5b/f8b to db/df/d4e/d64/d56/d98/fd9 0 2024-09-17T07:20:00.288 INFO:tasks.workunit.client.0.smithi087.stdout:5/877: dwrite d5/d12/d56/db7/fa0 [0,4194304] 0 2024-09-17T07:20:00.288 INFO:tasks.workunit.client.0.smithi087.stdout:7/516: chown d0/d3/d10/d31/l72 359282 1 2024-09-17T07:20:00.290 INFO:tasks.workunit.client.0.smithi087.stdout:3/698: dread d6/d15/d37/f7f [0,4194304] 0 2024-09-17T07:20:00.290 INFO:tasks.workunit.client.0.smithi087.stdout:5/878: readlink d5/l115 0 2024-09-17T07:20:00.291 INFO:tasks.workunit.client.1.smithi139.stdout:3/523: dread d5/d21/f4e [0,4194304] 0 2024-09-17T07:20:00.292 INFO:tasks.workunit.client.0.smithi087.stdout:7/517: stat d0/d3/d10/f14 0 2024-09-17T07:20:00.292 INFO:tasks.workunit.client.1.smithi139.stdout:3/524: chown d5/da7 9186867 1 2024-09-17T07:20:00.292 INFO:tasks.workunit.client.1.smithi139.stdout:3/525: chown d5/f11 1 1 2024-09-17T07:20:00.292 INFO:tasks.workunit.client.0.smithi087.stdout:9/699: dwrite d3/d4/d16/d69/d8a/d1e/d90/d93/f9d [0,4194304] 0 2024-09-17T07:20:00.295 INFO:tasks.workunit.client.0.smithi087.stdout:5/879: chown d5/d12/d1c/d71/df7 2 1 2024-09-17T07:20:00.296 INFO:tasks.workunit.client.0.smithi087.stdout:9/700: write d3/d4/d16/d69/fe3 [1158125,90990] 0 2024-09-17T07:20:00.298 INFO:tasks.workunit.client.0.smithi087.stdout:4/710: dwrite d2/d92/d4d/d21/f70 [0,4194304] 0 2024-09-17T07:20:00.298 INFO:tasks.workunit.client.1.smithi139.stdout:3/526: getdents d5/d15/d16/d4c/d28/d54/d8e 0 2024-09-17T07:20:00.299 INFO:tasks.workunit.client.0.smithi087.stdout:4/711: chown d2/d92/d4d/d21/d2f/d3b/d7e/d97 4065 1 2024-09-17T07:20:00.305 INFO:tasks.workunit.client.1.smithi139.stdout:3/527: dwrite d5/d15/d56/f29 [0,4194304] 0 2024-09-17T07:20:00.306 INFO:tasks.workunit.client.1.smithi139.stdout:3/528: chown d5/d63/d6d/da0 6 1 2024-09-17T07:20:00.310 INFO:tasks.workunit.client.1.smithi139.stdout:3/529: symlink d5/d63/d6d/lad 0 2024-09-17T07:20:00.311 INFO:tasks.workunit.client.0.smithi087.stdout:0/911: rename db/d45/d5b/d92/fa8 to db/d45/d5b/d92/de8/d11d/f13d 0 2024-09-17T07:20:00.313 INFO:tasks.workunit.client.0.smithi087.stdout:5/880: stat d5/d18/d20/c26 0 2024-09-17T07:20:00.313 INFO:tasks.workunit.client.0.smithi087.stdout:5/881: stat d5/d18/lca 0 2024-09-17T07:20:00.316 INFO:tasks.workunit.client.1.smithi139.stdout:3/530: truncate d5/fe 2785687 0 2024-09-17T07:20:00.317 INFO:tasks.workunit.client.0.smithi087.stdout:3/699: truncate d6/d1b/d42/dd4/f58 4152012 0 2024-09-17T07:20:00.319 INFO:tasks.workunit.client.0.smithi087.stdout:3/700: dread - d6/d15/d37/d5e/fcd zero size 2024-09-17T07:20:00.319 INFO:tasks.workunit.client.0.smithi087.stdout:9/701: dread d3/d4/d6/d8/d12/d32/da1/fed [0,4194304] 0 2024-09-17T07:20:00.320 INFO:tasks.workunit.client.1.smithi139.stdout:3/531: creat d5/d15/d20/d3b/fae x:0 0 0 2024-09-17T07:20:00.321 INFO:tasks.workunit.client.1.smithi139.stdout:6/657: dread db/df/d4e/d64/d56/f69 [0,4194304] 0 2024-09-17T07:20:00.321 INFO:tasks.workunit.client.0.smithi087.stdout:9/702: chown d3/d25/f9a 1754449 1 2024-09-17T07:20:00.322 INFO:tasks.workunit.client.1.smithi139.stdout:3/532: creat d5/d15/d56/faf x:0 0 0 2024-09-17T07:20:00.322 INFO:tasks.workunit.client.0.smithi087.stdout:5/882: mknod d5/d12/d4d/c11c 0 2024-09-17T07:20:00.323 INFO:tasks.workunit.client.0.smithi087.stdout:9/703: readlink d3/d4/d16/d69/d8a/d1e/d90/laf 0 2024-09-17T07:20:00.324 INFO:tasks.workunit.client.1.smithi139.stdout:3/533: symlink d5/d15/d56/lb0 0 2024-09-17T07:20:00.325 INFO:tasks.workunit.client.0.smithi087.stdout:9/704: chown d3/d4/d6/d8/d12 13898 1 2024-09-17T07:20:00.326 INFO:tasks.workunit.client.0.smithi087.stdout:5/883: mknod d5/d18/d20/d2f/d52/c11d 0 2024-09-17T07:20:00.329 INFO:tasks.workunit.client.0.smithi087.stdout:4/712: getdents d2/d92/d4d/d42 0 2024-09-17T07:20:00.329 INFO:tasks.workunit.client.0.smithi087.stdout:5/884: creat d5/d12/d1c/f11e x:0 0 0 2024-09-17T07:20:00.329 INFO:tasks.workunit.client.1.smithi139.stdout:6/658: dwrite db/df/f9c [0,4194304] 0 2024-09-17T07:20:00.330 INFO:tasks.workunit.client.0.smithi087.stdout:3/701: dwrite d6/d15/d92/f96 [0,4194304] 0 2024-09-17T07:20:00.331 INFO:tasks.workunit.client.1.smithi139.stdout:6/659: symlink db/df/d73/dc1/lda 0 2024-09-17T07:20:00.331 INFO:tasks.workunit.client.0.smithi087.stdout:1/649: dread d2/d14/fb [0,4194304] 0 2024-09-17T07:20:00.333 INFO:tasks.workunit.client.1.smithi139.stdout:6/660: mkdir db/db7/ddb 0 2024-09-17T07:20:00.336 INFO:tasks.workunit.client.0.smithi087.stdout:1/650: rmdir d2/d3d/d45 39 2024-09-17T07:20:00.337 INFO:tasks.workunit.client.1.smithi139.stdout:6/661: creat db/df/d73/fdc x:0 0 0 2024-09-17T07:20:00.339 INFO:tasks.workunit.client.0.smithi087.stdout:3/702: rename d6/d1b/l3a to d6/d15/d37/d3c/d43/db7/lf3 0 2024-09-17T07:20:00.339 INFO:tasks.workunit.client.0.smithi087.stdout:1/651: write d2/d48/d61/fb6 [4121873,74750] 0 2024-09-17T07:20:00.340 INFO:tasks.workunit.client.0.smithi087.stdout:5/885: rmdir d5/d6d/dd7/d111 0 2024-09-17T07:20:00.340 INFO:tasks.workunit.client.1.smithi139.stdout:6/662: symlink db/d18/d1b/ldd 0 2024-09-17T07:20:00.340 INFO:tasks.workunit.client.0.smithi087.stdout:4/713: dwrite d2/d92/d4f/fbc [4194304,4194304] 0 2024-09-17T07:20:00.343 INFO:tasks.workunit.client.1.smithi139.stdout:5/708: dread d4/d16/d1b/f55 [0,4194304] 0 2024-09-17T07:20:00.344 INFO:tasks.workunit.client.0.smithi087.stdout:5/886: readlink d5/d6d/lc6 0 2024-09-17T07:20:00.344 INFO:tasks.workunit.client.0.smithi087.stdout:4/714: fdatasync d2/d92/d4f/ff0 0 2024-09-17T07:20:00.344 INFO:tasks.workunit.client.1.smithi139.stdout:6/663: creat db/fde x:0 0 0 2024-09-17T07:20:00.345 INFO:tasks.workunit.client.0.smithi087.stdout:1/652: write d2/d3d/fd4 [127637,90947] 0 2024-09-17T07:20:00.347 INFO:tasks.workunit.client.0.smithi087.stdout:5/887: write d5/d18/d20/fa [1429921,11383] 0 2024-09-17T07:20:00.347 INFO:tasks.workunit.client.1.smithi139.stdout:5/709: mkdir d4/d16/d1b/d20/d32/d72/de5 0 2024-09-17T07:20:00.348 INFO:tasks.workunit.client.0.smithi087.stdout:1/653: write d2/d14/fb [7396983,19363] 0 2024-09-17T07:20:00.349 INFO:tasks.workunit.client.0.smithi087.stdout:3/703: rename d6/d15/d37/d3c/d52/db2/de7/f68 to d6/d15/d37/ff4 0 2024-09-17T07:20:00.350 INFO:tasks.workunit.client.0.smithi087.stdout:7/518: write d0/f8 [334890,67108] 0 2024-09-17T07:20:00.351 INFO:tasks.workunit.client.1.smithi139.stdout:3/534: rmdir d5/d15 39 2024-09-17T07:20:00.351 INFO:tasks.workunit.client.0.smithi087.stdout:5/888: getdents d5/d12/d14/d61/d119 0 2024-09-17T07:20:00.352 INFO:tasks.workunit.client.1.smithi139.stdout:3/535: write d5/f77 [766714,11287] 0 2024-09-17T07:20:00.354 INFO:tasks.workunit.client.1.smithi139.stdout:3/536: write d5/d21/d23/d38/f9d [729476,130581] 0 2024-09-17T07:20:00.354 INFO:tasks.workunit.client.1.smithi139.stdout:6/664: rename db/df/d4e/d64/d56/f69 to db/d18/d9f/fdf 0 2024-09-17T07:20:00.354 INFO:tasks.workunit.client.0.smithi087.stdout:4/715: rename d2/d92/d4d/c7c to d2/d92/d4f/d6a/cf4 0 2024-09-17T07:20:00.356 INFO:tasks.workunit.client.1.smithi139.stdout:3/537: read - d5/d15/d56/faf zero size 2024-09-17T07:20:00.357 INFO:tasks.workunit.client.1.smithi139.stdout:6/665: creat db/df/fe0 x:0 0 0 2024-09-17T07:20:00.358 INFO:tasks.workunit.client.0.smithi087.stdout:3/704: creat d6/d15/d37/d3c/ff5 x:0 0 0 2024-09-17T07:20:00.358 INFO:tasks.workunit.client.1.smithi139.stdout:6/666: creat db/db7/fe1 x:0 0 0 2024-09-17T07:20:00.359 INFO:tasks.workunit.client.0.smithi087.stdout:5/889: unlink d5/d18/d20/d2f/f57 0 2024-09-17T07:20:00.360 INFO:tasks.workunit.client.1.smithi139.stdout:6/667: dread db/d18/d5b/f61 [0,4194304] 0 2024-09-17T07:20:00.362 INFO:tasks.workunit.client.0.smithi087.stdout:0/912: dwrite db/d45/d7b/d7e/fef [0,4194304] 0 2024-09-17T07:20:00.363 INFO:tasks.workunit.client.0.smithi087.stdout:5/890: write d5/d18/d20/d2f/d83/fb0 [5039054,19788] 0 2024-09-17T07:20:00.363 INFO:tasks.workunit.client.1.smithi139.stdout:6/668: rename db/df/f19 to db/df/d73/d81/fe2 0 2024-09-17T07:20:00.365 INFO:tasks.workunit.client.1.smithi139.stdout:6/669: mkdir db/df/daa/de3 0 2024-09-17T07:20:00.365 INFO:tasks.workunit.client.0.smithi087.stdout:4/716: unlink d2/d5/fb8 0 2024-09-17T07:20:00.368 INFO:tasks.workunit.client.0.smithi087.stdout:5/891: unlink d5/d18/d20/d2f/d83/ca1 0 2024-09-17T07:20:00.369 INFO:tasks.workunit.client.0.smithi087.stdout:5/892: chown d5/d18/d6f/de1/d7d/ceb 239 1 2024-09-17T07:20:00.371 INFO:tasks.workunit.client.0.smithi087.stdout:0/913: truncate db/d45/d7b/d90/f80 722812 0 2024-09-17T07:20:00.375 INFO:tasks.workunit.client.0.smithi087.stdout:4/717: dwrite d2/d92/d4d/d3e/f8b [0,4194304] 0 2024-09-17T07:20:00.375 INFO:tasks.workunit.client.0.smithi087.stdout:3/705: rename d6/d15/d37/d3c/dc7 to d6/d1b/df6 0 2024-09-17T07:20:00.376 INFO:tasks.workunit.client.1.smithi139.stdout:5/710: dread d4/f5b [0,4194304] 0 2024-09-17T07:20:00.378 INFO:tasks.workunit.client.0.smithi087.stdout:5/893: creat d5/d12/d14/d61/d94/f11f x:0 0 0 2024-09-17T07:20:00.378 INFO:tasks.workunit.client.0.smithi087.stdout:3/706: chown d6/d15/d37/d3c/d52/db2/de7/f9f 42042 1 2024-09-17T07:20:00.379 INFO:tasks.workunit.client.1.smithi139.stdout:6/670: truncate db/df/d4e/d64/f4d 348395 0 2024-09-17T07:20:00.379 INFO:tasks.workunit.client.0.smithi087.stdout:5/894: stat d5/d12/d56/d9e 0 2024-09-17T07:20:00.380 INFO:tasks.workunit.client.0.smithi087.stdout:4/718: creat d2/d92/ff5 x:0 0 0 2024-09-17T07:20:00.382 INFO:tasks.workunit.client.1.smithi139.stdout:6/671: symlink db/df/d4c/dbc/le4 0 2024-09-17T07:20:00.383 INFO:tasks.workunit.client.0.smithi087.stdout:5/895: chown d5/d12/d14/d61/d94/f11f 0 1 2024-09-17T07:20:00.383 INFO:tasks.workunit.client.0.smithi087.stdout:7/519: write d0/d7a/f8b [3272910,3263] 0 2024-09-17T07:20:00.383 INFO:tasks.workunit.client.1.smithi139.stdout:6/672: write db/df/d4e/f68 [9103,91613] 0 2024-09-17T07:20:00.385 INFO:tasks.workunit.client.0.smithi087.stdout:3/707: truncate d6/d15/d37/d3c/d52/db2/fe6 733850 0 2024-09-17T07:20:00.386 INFO:tasks.workunit.client.0.smithi087.stdout:4/719: creat d2/d22/d62/ff6 x:0 0 0 2024-09-17T07:20:00.387 INFO:tasks.workunit.client.0.smithi087.stdout:7/520: chown d0/d3/d10/f20 253485 1 2024-09-17T07:20:00.389 INFO:tasks.workunit.client.0.smithi087.stdout:3/708: rmdir d6/d1b/d42/d6e 39 2024-09-17T07:20:00.390 INFO:tasks.workunit.client.0.smithi087.stdout:1/654: dread d2/d3d/d45/d90/f18 [0,4194304] 0 2024-09-17T07:20:00.394 INFO:tasks.workunit.client.0.smithi087.stdout:4/720: creat d2/d92/d4d/d21/d2f/d3b/d7e/d97/da8/ff7 x:0 0 0 2024-09-17T07:20:00.395 INFO:tasks.workunit.client.0.smithi087.stdout:5/896: getdents d5/d18/d6f/d11b/d1f/d4e/d10d/d11a 0 2024-09-17T07:20:00.397 INFO:tasks.workunit.client.0.smithi087.stdout:5/897: chown d5/d18/d6f/de1/f8d 12 1 2024-09-17T07:20:00.397 INFO:tasks.workunit.client.0.smithi087.stdout:6/831: sync 2024-09-17T07:20:00.397 INFO:tasks.workunit.client.0.smithi087.stdout:8/703: sync 2024-09-17T07:20:00.398 INFO:tasks.workunit.client.0.smithi087.stdout:0/914: write db/d4f/fb8 [299735,49969] 0 2024-09-17T07:20:00.399 INFO:tasks.workunit.client.0.smithi087.stdout:5/898: write d5/ff4 [548760,103301] 0 2024-09-17T07:20:00.399 INFO:tasks.workunit.client.0.smithi087.stdout:7/521: write d0/d3/d10/d87/d96/f9d [4335662,101806] 0 2024-09-17T07:20:00.402 INFO:tasks.workunit.client.0.smithi087.stdout:3/709: creat d6/d1b/d42/dd4/dd1/de4/ff7 x:0 0 0 2024-09-17T07:20:00.402 INFO:tasks.workunit.client.0.smithi087.stdout:7/522: write d0/d3/d23/d17/f3a [2385614,70567] 0 2024-09-17T07:20:00.405 INFO:tasks.workunit.client.0.smithi087.stdout:7/523: stat d0/d3/d23/d17/d7b/ca0 0 2024-09-17T07:20:00.410 INFO:tasks.workunit.client.0.smithi087.stdout:4/721: write d2/d92/d4d/d21/f70 [3620713,56008] 0 2024-09-17T07:20:00.417 INFO:tasks.workunit.client.0.smithi087.stdout:8/704: truncate d1/d7/d9/d19/fb6 2281412 0 2024-09-17T07:20:00.419 INFO:tasks.workunit.client.0.smithi087.stdout:1/655: dwrite d2/dcf/f67 [0,4194304] 0 2024-09-17T07:20:00.420 INFO:tasks.workunit.client.0.smithi087.stdout:7/524: truncate d0/d3/f4 2741157 0 2024-09-17T07:20:00.424 INFO:tasks.workunit.client.0.smithi087.stdout:6/832: dwrite d1/d67/dfe/d2c/f59 [0,4194304] 0 2024-09-17T07:20:00.425 INFO:tasks.workunit.client.0.smithi087.stdout:8/705: fsync d1/d7/d9/d27/f58 0 2024-09-17T07:20:00.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:00 smithi087 ceph-mon[27636]: pgmap v13: 65 pgs: 65 active+clean; 2.1 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 65 MiB/s rd, 256 MiB/s wr, 469 op/s 2024-09-17T07:20:00.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:00 smithi087 ceph-mon[27636]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T07:20:00.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:00 smithi087 ceph-mon[27636]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T07:20:00.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:00 smithi087 ceph-mon[27636]: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T07:20:00.428 INFO:tasks.workunit.client.0.smithi087.stdout:3/710: dwrite d6/d15/f24 [0,4194304] 0 2024-09-17T07:20:00.430 INFO:tasks.workunit.client.0.smithi087.stdout:5/899: dread d5/d18/d20/f35 [0,4194304] 0 2024-09-17T07:20:00.431 INFO:tasks.workunit.client.0.smithi087.stdout:4/722: write d2/d92/d4d/d21/d2f/d3b/d7e/d97/fd5 [661255,71199] 0 2024-09-17T07:20:00.433 INFO:tasks.workunit.client.0.smithi087.stdout:7/525: getdents d0 0 2024-09-17T07:20:00.436 INFO:tasks.workunit.client.0.smithi087.stdout:6/833: rename d1/fd1 to d1/d67/dfe/d2c/d40/d4c/d77/f119 0 2024-09-17T07:20:00.438 INFO:tasks.workunit.client.0.smithi087.stdout:1/656: dread d2/dcf/f67 [0,4194304] 0 2024-09-17T07:20:00.442 INFO:tasks.workunit.client.0.smithi087.stdout:3/711: link d6/d15/d37/f5b d6/d15/d37/ff8 0 2024-09-17T07:20:00.442 INFO:tasks.workunit.client.0.smithi087.stdout:6/834: mknod d1/d67/dfe/d2c/d58/c11a 0 2024-09-17T07:20:00.443 INFO:tasks.workunit.client.0.smithi087.stdout:5/900: creat d5/d18/d6f/de1/f120 x:0 0 0 2024-09-17T07:20:00.446 INFO:tasks.workunit.client.0.smithi087.stdout:6/835: creat d1/d6a/dda/f11b x:0 0 0 2024-09-17T07:20:00.447 INFO:tasks.workunit.client.0.smithi087.stdout:5/901: fsync d5/d18/d6f/d11b/d1f/d4e/da3/d102/f107 0 2024-09-17T07:20:00.447 INFO:tasks.workunit.client.0.smithi087.stdout:3/712: creat d6/d15/d4b/ff9 x:0 0 0 2024-09-17T07:20:00.448 INFO:tasks.workunit.client.0.smithi087.stdout:6/836: fdatasync d1/d67/dfe/d2c/d48/fb9 0 2024-09-17T07:20:00.450 INFO:tasks.workunit.client.0.smithi087.stdout:5/902: getdents d5/d6d 0 2024-09-17T07:20:00.451 INFO:tasks.workunit.client.0.smithi087.stdout:3/713: rename d6/d15/d37/d3c/d52/db2/de7/f9f to d6/d1b/d42/dd4/dd1/ffa 0 2024-09-17T07:20:00.454 INFO:tasks.workunit.client.0.smithi087.stdout:3/714: creat d6/d1b/d42/d62/dbb/ffb x:0 0 0 2024-09-17T07:20:00.455 INFO:tasks.workunit.client.0.smithi087.stdout:5/903: getdents d5/d18/d20 0 2024-09-17T07:20:00.456 INFO:tasks.workunit.client.0.smithi087.stdout:5/904: write d5/d12/d56/d9e/fe5 [968788,49473] 0 2024-09-17T07:20:00.458 INFO:tasks.workunit.client.0.smithi087.stdout:3/715: symlink d6/d1b/d42/d62/dc1/de8/lfc 0 2024-09-17T07:20:00.460 INFO:tasks.workunit.client.0.smithi087.stdout:5/905: creat d5/d18/d6f/d11b/d1f/d4e/d10d/f121 x:0 0 0 2024-09-17T07:20:00.461 INFO:tasks.workunit.client.0.smithi087.stdout:3/716: creat d6/d15/d37/ffd x:0 0 0 2024-09-17T07:20:00.463 INFO:tasks.workunit.client.0.smithi087.stdout:7/526: truncate d0/d3/d23/d17/f3a 919354 0 2024-09-17T07:20:00.465 INFO:tasks.workunit.client.0.smithi087.stdout:4/723: dwrite d2/d92/d4d/d21/f6c [4194304,4194304] 0 2024-09-17T07:20:00.466 INFO:tasks.workunit.client.0.smithi087.stdout:7/527: write d0/d3/d23/d2d/f35 [3660194,124183] 0 2024-09-17T07:20:00.472 INFO:tasks.workunit.client.0.smithi087.stdout:3/717: dwrite d6/d15/d37/d3c/d43/fb4 [0,4194304] 0 2024-09-17T07:20:00.474 INFO:tasks.workunit.client.0.smithi087.stdout:4/724: fdatasync d2/d5/d1f/fc8 0 2024-09-17T07:20:00.474 INFO:tasks.workunit.client.0.smithi087.stdout:7/528: creat d0/d3/d10/d87/d96/fa1 x:0 0 0 2024-09-17T07:20:00.474 INFO:tasks.workunit.client.0.smithi087.stdout:3/718: write d6/d1b/d42/f93 [3060152,71457] 0 2024-09-17T07:20:00.475 INFO:tasks.workunit.client.0.smithi087.stdout:5/906: getdents d5/d18/d6f/d11b/d1f/d4e/d10d 0 2024-09-17T07:20:00.476 INFO:tasks.workunit.client.0.smithi087.stdout:7/529: fdatasync d0/d3/d23/d2d/f79 0 2024-09-17T07:20:00.478 INFO:tasks.workunit.client.0.smithi087.stdout:7/530: chown d0/d3/d23/d2d 1297722 1 2024-09-17T07:20:00.480 INFO:tasks.workunit.client.0.smithi087.stdout:4/725: creat d2/d92/d4f/d6a/ff8 x:0 0 0 2024-09-17T07:20:00.483 INFO:tasks.workunit.client.0.smithi087.stdout:4/726: write d2/d92/d4d/d21/d2f/d3b/d7e/d97/fe5 [5323404,111936] 0 2024-09-17T07:20:00.483 INFO:tasks.workunit.client.0.smithi087.stdout:7/531: mkdir d0/d36/d8e/da2 0 2024-09-17T07:20:00.486 INFO:tasks.workunit.client.0.smithi087.stdout:3/719: link d6/d15/d37/d5e/ff1 d6/d1b/d42/dd4/ddc/ffe 0 2024-09-17T07:20:00.488 INFO:tasks.workunit.client.0.smithi087.stdout:7/532: unlink d0/d3/f1f 0 2024-09-17T07:20:00.489 INFO:tasks.workunit.client.0.smithi087.stdout:5/907: dread d5/d18/d20/d7a/fbf [0,4194304] 0 2024-09-17T07:20:00.490 INFO:tasks.workunit.client.0.smithi087.stdout:4/727: creat d2/d92/d4d/d42/ff9 x:0 0 0 2024-09-17T07:20:00.491 INFO:tasks.workunit.client.0.smithi087.stdout:5/908: write d5/d12/f77 [4073525,117021] 0 2024-09-17T07:20:00.494 INFO:tasks.workunit.client.0.smithi087.stdout:3/720: link d6/d15/d92/f96 d6/d15/d92/fff 0 2024-09-17T07:20:00.495 INFO:tasks.workunit.client.0.smithi087.stdout:3/721: write d6/d1b/d42/dd4/dd1/de4/ff7 [205292,89428] 0 2024-09-17T07:20:00.496 INFO:tasks.workunit.client.0.smithi087.stdout:4/728: mkdir d2/d92/d4d/d21/dfa 0 2024-09-17T07:20:00.497 INFO:tasks.workunit.client.0.smithi087.stdout:3/722: fdatasync d6/d1b/d42/f93 0 2024-09-17T07:20:00.497 INFO:tasks.workunit.client.0.smithi087.stdout:5/909: creat d5/d18/dad/f122 x:0 0 0 2024-09-17T07:20:00.502 INFO:tasks.workunit.client.0.smithi087.stdout:5/910: dread - d5/d18/d6f/d11b/fc4 zero size 2024-09-17T07:20:00.504 INFO:tasks.workunit.client.0.smithi087.stdout:5/911: dread - d5/d18/d20/d2f/d60/de3/ded/f103 zero size 2024-09-17T07:20:00.504 INFO:tasks.workunit.client.0.smithi087.stdout:4/729: getdents d2/d22/d2c/d91/dcf 0 2024-09-17T07:20:00.505 INFO:tasks.workunit.client.0.smithi087.stdout:5/912: write d5/d18/d6f/d11b/ffd [4463342,40442] 0 2024-09-17T07:20:00.505 INFO:tasks.workunit.client.0.smithi087.stdout:3/723: creat d6/d1b/d42/d62/f100 x:0 0 0 2024-09-17T07:20:00.508 INFO:tasks.workunit.client.0.smithi087.stdout:4/730: mknod d2/d92/d4d/d2d/cfb 0 2024-09-17T07:20:00.511 INFO:tasks.workunit.client.0.smithi087.stdout:3/724: unlink d6/d15/d37/f7f 0 2024-09-17T07:20:00.513 INFO:tasks.workunit.client.0.smithi087.stdout:4/731: truncate d2/fde 4720373 0 2024-09-17T07:20:00.513 INFO:tasks.workunit.client.0.smithi087.stdout:4/732: readlink d2/d92/d4d/d3e/l83 0 2024-09-17T07:20:00.513 INFO:tasks.workunit.client.0.smithi087.stdout:4/733: dread - d2/d92/d4d/d21/d2f/d3b/d7e/f81 zero size 2024-09-17T07:20:00.514 INFO:tasks.workunit.client.0.smithi087.stdout:4/734: write d2/d92/d4d/d21/d2f/d6e/fc1 [1093621,6018] 0 2024-09-17T07:20:00.516 INFO:tasks.workunit.client.0.smithi087.stdout:5/913: link d5/d18/d6f/d11b/da7/db1/c105 d5/d18/d20/d2f/d83/dac/c123 0 2024-09-17T07:20:00.517 INFO:tasks.workunit.client.0.smithi087.stdout:5/914: chown d5/d18/f4a 5654 1 2024-09-17T07:20:00.518 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:00 smithi139 ceph-mon[34403]: pgmap v13: 65 pgs: 65 active+clean; 2.1 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 65 MiB/s rd, 256 MiB/s wr, 469 op/s 2024-09-17T07:20:00.518 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:00 smithi139 ceph-mon[34403]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T07:20:00.518 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:00 smithi139 ceph-mon[34403]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T07:20:00.518 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:00 smithi139 ceph-mon[34403]: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T07:20:00.562 INFO:tasks.workunit.client.0.smithi087.stdout:2/675: sync 2024-09-17T07:20:00.579 INFO:tasks.workunit.client.0.smithi087.stdout:2/676: write d2/d7/d33/f72 [438143,54777] 0 2024-09-17T07:20:00.581 INFO:tasks.workunit.client.0.smithi087.stdout:7/533: dwrite d0/d3/d10/f38 [0,4194304] 0 2024-09-17T07:20:00.583 INFO:tasks.workunit.client.0.smithi087.stdout:7/534: chown d0/fd 71119262 1 2024-09-17T07:20:00.583 INFO:tasks.workunit.client.0.smithi087.stdout:4/735: link d2/d22/c67 d2/d92/d4d/d21/d2f/d6e/deb/cfc 0 2024-09-17T07:20:00.584 INFO:tasks.workunit.client.0.smithi087.stdout:7/535: rmdir d0 39 2024-09-17T07:20:00.588 INFO:tasks.workunit.client.0.smithi087.stdout:5/915: dwrite d5/d18/d6f/d11b/f3f [0,4194304] 0 2024-09-17T07:20:00.592 INFO:tasks.workunit.client.0.smithi087.stdout:5/916: write d5/d12/d1c/fa5 [2868130,100032] 0 2024-09-17T07:20:00.595 INFO:tasks.workunit.client.0.smithi087.stdout:4/736: dwrite d2/d22/d62/ff6 [0,4194304] 0 2024-09-17T07:20:00.611 INFO:tasks.workunit.client.0.smithi087.stdout:2/677: dread d2/f7c [0,4194304] 0 2024-09-17T07:20:00.686 INFO:tasks.workunit.client.0.smithi087.stdout:5/917: unlink d5/d6d/f81 0 2024-09-17T07:20:00.686 INFO:tasks.workunit.client.0.smithi087.stdout:4/737: mknod d2/d92/d86/cfd 0 2024-09-17T07:20:00.687 INFO:tasks.workunit.client.0.smithi087.stdout:5/918: write d5/d12/d14/d61/f100 [922474,14128] 0 2024-09-17T07:20:00.689 INFO:tasks.workunit.client.0.smithi087.stdout:7/536: getdents d0/d3/d10/d32 0 2024-09-17T07:20:00.689 INFO:tasks.workunit.client.0.smithi087.stdout:7/537: chown d0/d7a 28861 1 2024-09-17T07:20:00.690 INFO:tasks.workunit.client.0.smithi087.stdout:4/738: unlink d2/lf 0 2024-09-17T07:20:00.692 INFO:tasks.workunit.client.0.smithi087.stdout:2/678: rename d2/d7/dd/d10/d4c/dcc/c4f to d2/d48/da2/d3a/cd5 0 2024-09-17T07:20:00.693 INFO:tasks.workunit.client.0.smithi087.stdout:2/679: fdatasync d2/d7/d60/fc4 0 2024-09-17T07:20:00.694 INFO:tasks.workunit.client.0.smithi087.stdout:7/538: rename d0/d3/d23/d4e/f78 to d0/d3/d86/fa3 0 2024-09-17T07:20:00.696 INFO:tasks.workunit.client.0.smithi087.stdout:4/739: dwrite d2/d5/f9c [0,4194304] 0 2024-09-17T07:20:00.697 INFO:tasks.workunit.client.0.smithi087.stdout:7/539: symlink d0/d3/d10/d87/la4 0 2024-09-17T07:20:00.698 INFO:tasks.workunit.client.0.smithi087.stdout:4/740: symlink d2/d92/d4f/d7b/lfe 0 2024-09-17T07:20:00.706 INFO:tasks.workunit.client.0.smithi087.stdout:4/741: dwrite d2/d92/d4d/fa2 [4194304,4194304] 0 2024-09-17T07:20:00.708 INFO:tasks.workunit.client.0.smithi087.stdout:4/742: truncate d2/d22/fd7 897067 0 2024-09-17T07:20:00.709 INFO:tasks.workunit.client.0.smithi087.stdout:2/680: truncate d2/d24/d36/f38 3851065 0 2024-09-17T07:20:00.713 INFO:tasks.workunit.client.0.smithi087.stdout:4/743: getdents d2/d22/d62 0 2024-09-17T07:20:00.717 INFO:tasks.workunit.client.0.smithi087.stdout:4/744: unlink d2/d92/d4d/d21/f70 0 2024-09-17T07:20:00.723 INFO:tasks.workunit.client.0.smithi087.stdout:4/745: dwrite d2/d92/d4d/d21/d2f/d3b/d7e/d97/fe5 [0,4194304] 0 2024-09-17T07:20:00.725 INFO:tasks.workunit.client.0.smithi087.stdout:4/746: mknod d2/d92/d4d/d2d/cff 0 2024-09-17T07:20:00.732 INFO:tasks.workunit.client.0.smithi087.stdout:2/681: dread d2/d48/da2/f73 [0,4194304] 0 2024-09-17T07:20:00.734 INFO:tasks.workunit.client.0.smithi087.stdout:2/682: creat d2/d7/db/fd6 x:0 0 0 2024-09-17T07:20:00.734 INFO:tasks.workunit.client.0.smithi087.stdout:2/683: chown d2/d12/d85 228665040 1 2024-09-17T07:20:00.735 INFO:tasks.workunit.client.0.smithi087.stdout:2/684: chown d2/d50/db8/fd0 2422 1 2024-09-17T07:20:00.736 INFO:tasks.workunit.client.0.smithi087.stdout:2/685: creat d2/d7/dd/d10/d4c/d5f/fd7 x:0 0 0 2024-09-17T07:20:00.744 INFO:tasks.workunit.client.1.smithi139.stdout:2/649: sync 2024-09-17T07:20:00.744 INFO:tasks.workunit.client.1.smithi139.stdout:6/673: sync 2024-09-17T07:20:00.745 INFO:tasks.workunit.client.1.smithi139.stdout:9/896: sync 2024-09-17T07:20:00.745 INFO:tasks.workunit.client.1.smithi139.stdout:7/494: sync 2024-09-17T07:20:00.745 INFO:tasks.workunit.client.1.smithi139.stdout:4/514: sync 2024-09-17T07:20:00.745 INFO:tasks.workunit.client.1.smithi139.stdout:5/711: sync 2024-09-17T07:20:00.745 INFO:tasks.workunit.client.1.smithi139.stdout:0/444: sync 2024-09-17T07:20:00.745 INFO:tasks.workunit.client.1.smithi139.stdout:3/538: sync 2024-09-17T07:20:00.745 INFO:tasks.workunit.client.1.smithi139.stdout:1/433: sync 2024-09-17T07:20:00.745 INFO:tasks.workunit.client.1.smithi139.stdout:8/744: sync 2024-09-17T07:20:00.745 INFO:tasks.workunit.client.0.smithi087.stdout:2/686: dwrite d2/d7/d33/fa9 [4194304,4194304] 0 2024-09-17T07:20:00.746 INFO:tasks.workunit.client.1.smithi139.stdout:5/712: fdatasync d4/d5d/f7e 0 2024-09-17T07:20:00.746 INFO:tasks.workunit.client.0.smithi087.stdout:4/747: dread d2/d92/d4f/f5c [0,4194304] 0 2024-09-17T07:20:00.747 INFO:tasks.workunit.client.1.smithi139.stdout:3/539: chown d5/d15/d20/c73 29 1 2024-09-17T07:20:00.748 INFO:tasks.workunit.client.1.smithi139.stdout:1/434: read - d2/d10/d12/d13/d4f/d5c/f5f zero size 2024-09-17T07:20:00.749 INFO:tasks.workunit.client.0.smithi087.stdout:2/687: creat d2/d7/dd/d6a/dcf/fd8 x:0 0 0 2024-09-17T07:20:00.749 INFO:tasks.workunit.client.0.smithi087.stdout:4/748: truncate d2/d22/d2c/d91/fd1 1642801 0 2024-09-17T07:20:00.750 INFO:tasks.workunit.client.1.smithi139.stdout:6/674: mkdir db/df/d4e/d5e/de5 0 2024-09-17T07:20:00.753 INFO:tasks.workunit.client.1.smithi139.stdout:0/445: mkdir d1/da/d2a/dae 0 2024-09-17T07:20:00.753 INFO:tasks.workunit.client.1.smithi139.stdout:2/650: chown d0/d7/d67/da1/da7/fb2 0 1 2024-09-17T07:20:00.755 INFO:tasks.workunit.client.1.smithi139.stdout:3/540: fsync d5/d15/d56/f1a 0 2024-09-17T07:20:00.756 INFO:tasks.workunit.client.0.smithi087.stdout:4/749: creat d2/d5/f100 x:0 0 0 2024-09-17T07:20:00.757 INFO:tasks.workunit.client.1.smithi139.stdout:0/446: readlink d1/da/d17/d65/l84 0 2024-09-17T07:20:00.758 INFO:tasks.workunit.client.0.smithi087.stdout:2/688: creat d2/d7/dd/fd9 x:0 0 0 2024-09-17T07:20:00.759 INFO:tasks.workunit.client.0.smithi087.stdout:4/750: mknod d2/d92/d4d/d21/d2f/d3b/d7e/c101 0 2024-09-17T07:20:00.760 INFO:tasks.workunit.client.0.smithi087.stdout:2/689: mknod d2/d7/d33/daa/cda 0 2024-09-17T07:20:00.760 INFO:tasks.workunit.client.1.smithi139.stdout:9/897: creat dc/d11/d15/d3c/d125/f12c x:0 0 0 2024-09-17T07:20:00.760 INFO:tasks.workunit.client.1.smithi139.stdout:7/495: dread d5/d10/d2b/f3f [0,4194304] 0 2024-09-17T07:20:00.761 INFO:tasks.workunit.client.0.smithi087.stdout:4/751: symlink d2/d92/d4f/d6a/df3/l102 0 2024-09-17T07:20:00.763 INFO:tasks.workunit.client.0.smithi087.stdout:2/690: rename d2/d24/l5b to d2/d7/dd/ldb 0 2024-09-17T07:20:00.764 INFO:tasks.workunit.client.1.smithi139.stdout:8/745: dwrite d0/d20/d28/d52/d99/fa7 [4194304,4194304] 0 2024-09-17T07:20:00.764 INFO:tasks.workunit.client.1.smithi139.stdout:4/515: creat d0/d1/d54/d93/da2/fa3 x:0 0 0 2024-09-17T07:20:00.764 INFO:tasks.workunit.client.0.smithi087.stdout:4/752: mknod d2/d92/d4d/d21/d2f/d3b/d7e/d97/c103 0 2024-09-17T07:20:00.765 INFO:tasks.workunit.client.0.smithi087.stdout:2/691: write d2/d7/dd/d6a/dcf/fd8 [183627,16928] 0 2024-09-17T07:20:00.768 INFO:tasks.workunit.client.1.smithi139.stdout:8/746: dread - d0/fb5 zero size 2024-09-17T07:20:00.768 INFO:tasks.workunit.client.1.smithi139.stdout:3/541: write d5/d63/d6d/f71 [250740,85108] 0 2024-09-17T07:20:00.769 INFO:tasks.workunit.client.1.smithi139.stdout:1/435: creat d2/d10/d12/d13/d4f/f87 x:0 0 0 2024-09-17T07:20:00.769 INFO:tasks.workunit.client.1.smithi139.stdout:7/496: mkdir d5/d10/d2b/d78/d9e 0 2024-09-17T07:20:00.770 INFO:tasks.workunit.client.0.smithi087.stdout:2/692: rename d2/d7/dd/f79 to d2/d15/dce/dd1/d3f/fdc 0 2024-09-17T07:20:00.770 INFO:tasks.workunit.client.1.smithi139.stdout:6/675: dwrite db/df/d73/da4/fa9 [4194304,4194304] 0 2024-09-17T07:20:00.773 INFO:tasks.workunit.client.1.smithi139.stdout:4/516: creat d0/d1/d29/fa4 x:0 0 0 2024-09-17T07:20:00.773 INFO:tasks.workunit.client.1.smithi139.stdout:7/497: chown d5/d10/d2b/d78 205792583 1 2024-09-17T07:20:00.774 INFO:tasks.workunit.client.1.smithi139.stdout:6/676: chown db/d18/d38/f43 81 1 2024-09-17T07:20:00.774 INFO:tasks.workunit.client.1.smithi139.stdout:5/713: getdents d4/d16/d1b/d20/d38/d4f 0 2024-09-17T07:20:00.775 INFO:tasks.workunit.client.0.smithi087.stdout:2/693: unlink d2/d7/dd/d10/d4c/dcc/fbf 0 2024-09-17T07:20:00.776 INFO:tasks.workunit.client.1.smithi139.stdout:8/747: rmdir d0/d1a/d4d/d53 39 2024-09-17T07:20:00.777 INFO:tasks.workunit.client.1.smithi139.stdout:1/436: write d2/d10/d12/d1a/f53 [965905,117366] 0 2024-09-17T07:20:00.778 INFO:tasks.workunit.client.1.smithi139.stdout:5/714: chown d4/d16/d1b/d20/d67/d88/fad 477 1 2024-09-17T07:20:00.778 INFO:tasks.workunit.client.0.smithi087.stdout:2/694: unlink d2/d7/dd/d10/d91/fc3 0 2024-09-17T07:20:00.780 INFO:tasks.workunit.client.1.smithi139.stdout:1/437: chown d2/d10/d12/f29 30309 1 2024-09-17T07:20:00.780 INFO:tasks.workunit.client.0.smithi087.stdout:4/753: write d2/d5/d1f/f1e [2276020,55013] 0 2024-09-17T07:20:00.782 INFO:tasks.workunit.client.1.smithi139.stdout:4/517: rename d0/d1/f15 to d0/db/d17/fa5 0 2024-09-17T07:20:00.782 INFO:tasks.workunit.client.1.smithi139.stdout:6/677: rmdir db/df/d4e/d64/d83/dc5 39 2024-09-17T07:20:00.782 INFO:tasks.workunit.client.0.smithi087.stdout:2/695: dread d2/d7/dd/d10/d4c/d5f/f92 [0,4194304] 0 2024-09-17T07:20:00.784 INFO:tasks.workunit.client.0.smithi087.stdout:2/696: chown d2/d7/d33/fc5 358145401 1 2024-09-17T07:20:00.784 INFO:tasks.workunit.client.0.smithi087.stdout:4/754: symlink d2/d92/d4f/d7b/l104 0 2024-09-17T07:20:00.784 INFO:tasks.workunit.client.1.smithi139.stdout:1/438: read d2/d10/d12/d35/d2b/f42 [3979971,109918] 0 2024-09-17T07:20:00.785 INFO:tasks.workunit.client.1.smithi139.stdout:7/498: read d5/d10/f42 [2052444,60087] 0 2024-09-17T07:20:00.785 INFO:tasks.workunit.client.1.smithi139.stdout:5/715: mknod d4/d16/d1b/d20/d67/d88/d9f/ce6 0 2024-09-17T07:20:00.789 INFO:tasks.workunit.client.1.smithi139.stdout:6/678: mknod db/df/d4e/d64/d56/d98/ce6 0 2024-09-17T07:20:00.789 INFO:tasks.workunit.client.1.smithi139.stdout:8/748: dread d0/d20/d28/d52/d65/d7f/db6/fb9 [0,4194304] 0 2024-09-17T07:20:00.789 INFO:tasks.workunit.client.1.smithi139.stdout:9/898: dread dc/d11/d15/d3c/d68/fb9 [0,4194304] 0 2024-09-17T07:20:00.790 INFO:tasks.workunit.client.0.smithi087.stdout:4/755: dwrite d2/d92/d4d/d21/d2f/f8c [0,4194304] 0 2024-09-17T07:20:00.792 INFO:tasks.workunit.client.0.smithi087.stdout:4/756: symlink d2/d22/d95/l105 0 2024-09-17T07:20:00.793 INFO:tasks.workunit.client.1.smithi139.stdout:5/716: mkdir d4/d16/d1b/de7 0 2024-09-17T07:20:00.795 INFO:tasks.workunit.client.0.smithi087.stdout:4/757: creat d2/d22/d2c/d91/dcf/f106 x:0 0 0 2024-09-17T07:20:00.797 INFO:tasks.workunit.client.1.smithi139.stdout:5/717: write d4/d16/d1b/d20/d28/f26 [2734602,52506] 0 2024-09-17T07:20:00.799 INFO:tasks.workunit.client.1.smithi139.stdout:6/679: symlink db/df/d4e/d5e/d8a/le7 0 2024-09-17T07:20:00.801 INFO:tasks.workunit.client.1.smithi139.stdout:1/439: creat d2/d10/d12/f88 x:0 0 0 2024-09-17T07:20:00.801 INFO:tasks.workunit.client.1.smithi139.stdout:9/899: dwrite dc/d11/d15/f28 [0,4194304] 0 2024-09-17T07:20:00.802 INFO:tasks.workunit.client.0.smithi087.stdout:4/758: dwrite d2/d92/d4d/d21/d2f/d3b/f7d [0,4194304] 0 2024-09-17T07:20:00.804 INFO:tasks.workunit.client.1.smithi139.stdout:0/447: dread d1/da/d2a/f62 [0,4194304] 0 2024-09-17T07:20:00.806 INFO:tasks.workunit.client.1.smithi139.stdout:5/718: fsync d4/d16/d1b/d20/faa 0 2024-09-17T07:20:00.808 INFO:tasks.workunit.client.1.smithi139.stdout:0/448: chown d1/da/d1b/d32/d81 7 1 2024-09-17T07:20:00.809 INFO:tasks.workunit.client.0.smithi087.stdout:4/759: dwrite d2/d92/d4d/d42/fcc [0,4194304] 0 2024-09-17T07:20:00.810 INFO:tasks.workunit.client.1.smithi139.stdout:8/749: creat d0/d1a/ff3 x:0 0 0 2024-09-17T07:20:00.813 INFO:tasks.workunit.client.0.smithi087.stdout:4/760: mknod d2/c107 0 2024-09-17T07:20:00.814 INFO:tasks.workunit.client.1.smithi139.stdout:6/680: dread db/d18/d1b/da7/fb3 [0,4194304] 0 2024-09-17T07:20:00.817 INFO:tasks.workunit.client.0.smithi087.stdout:4/761: mkdir d2/d92/d4d/d21/dfa/d108 0 2024-09-17T07:20:00.817 INFO:tasks.workunit.client.1.smithi139.stdout:1/440: symlink d2/d10/d12/d35/d2b/d4a/l89 0 2024-09-17T07:20:00.819 INFO:tasks.workunit.client.1.smithi139.stdout:5/719: mkdir d4/d16/d1b/d20/d28/d3f/de8 0 2024-09-17T07:20:00.820 INFO:tasks.workunit.client.0.smithi087.stdout:4/762: symlink d2/d92/d4d/d3e/l109 0 2024-09-17T07:20:00.821 INFO:tasks.workunit.client.1.smithi139.stdout:0/449: fsync d1/da/d17/d72/f5b 0 2024-09-17T07:20:00.822 INFO:tasks.workunit.client.0.smithi087.stdout:4/763: chown d2/d92/f51 139 1 2024-09-17T07:20:00.823 INFO:tasks.workunit.client.1.smithi139.stdout:3/542: dwrite d5/d21/d23/f49 [0,4194304] 0 2024-09-17T07:20:00.824 INFO:tasks.workunit.client.1.smithi139.stdout:9/900: dread dc/d2a/f8a [0,4194304] 0 2024-09-17T07:20:00.828 INFO:tasks.workunit.client.1.smithi139.stdout:6/681: creat db/df/d4e/d64/d83/dc5/fe8 x:0 0 0 2024-09-17T07:20:00.828 INFO:tasks.workunit.client.1.smithi139.stdout:1/441: read d2/f15 [2579710,107213] 0 2024-09-17T07:20:00.828 INFO:tasks.workunit.client.1.smithi139.stdout:9/901: fsync dc/d11/ff6 0 2024-09-17T07:20:00.834 INFO:tasks.workunit.client.1.smithi139.stdout:7/499: dwrite d5/f43 [0,4194304] 0 2024-09-17T07:20:00.835 INFO:tasks.workunit.client.1.smithi139.stdout:8/750: dwrite d0/d20/d28/d48/de1/fe6 [0,4194304] 0 2024-09-17T07:20:00.840 INFO:tasks.workunit.client.1.smithi139.stdout:4/518: dwrite d0/d1/d29/d6d/f86 [4194304,4194304] 0 2024-09-17T07:20:00.845 INFO:tasks.workunit.client.1.smithi139.stdout:9/902: mkdir dc/d11/d52/d56/d75/d12d 0 2024-09-17T07:20:00.845 INFO:tasks.workunit.client.1.smithi139.stdout:7/500: dread - d5/f58 zero size 2024-09-17T07:20:00.849 INFO:tasks.workunit.client.1.smithi139.stdout:0/450: write d1/da/d17/d65/f85 [928506,28345] 0 2024-09-17T07:20:00.850 INFO:tasks.workunit.client.1.smithi139.stdout:9/903: stat dc/d11/d15/d3c/d61/f101 0 2024-09-17T07:20:00.851 INFO:tasks.workunit.client.1.smithi139.stdout:3/543: dwrite d5/d15/d16/d4c/d28/d54/d8e/fa5 [0,4194304] 0 2024-09-17T07:20:00.854 INFO:tasks.workunit.client.1.smithi139.stdout:3/544: chown d5/d63/d6d/d6f/d81 430365413 1 2024-09-17T07:20:00.858 INFO:tasks.workunit.client.1.smithi139.stdout:5/720: link d4/d16/d1b/d20/d67/fc6 d4/d16/d1b/d20/d67/d88/d9f/fe9 0 2024-09-17T07:20:00.858 INFO:tasks.workunit.client.1.smithi139.stdout:6/682: rmdir db/df/d4e/d5e/d8a/dba 0 2024-09-17T07:20:00.859 INFO:tasks.workunit.client.1.smithi139.stdout:7/501: creat d5/d17/d4e/f9f x:0 0 0 2024-09-17T07:20:00.862 INFO:tasks.workunit.client.1.smithi139.stdout:3/545: fdatasync d5/f39 0 2024-09-17T07:20:00.862 INFO:tasks.workunit.client.1.smithi139.stdout:0/451: stat d1/da/d17/d72/c82 0 2024-09-17T07:20:00.862 INFO:tasks.workunit.client.1.smithi139.stdout:1/442: dwrite d2/d10/d12/d13/d4f/d5c/f86 [0,4194304] 0 2024-09-17T07:20:00.863 INFO:tasks.workunit.client.1.smithi139.stdout:5/721: fdatasync d4/d16/d1b/d20/d38/fbb 0 2024-09-17T07:20:00.864 INFO:tasks.workunit.client.1.smithi139.stdout:4/519: truncate d0/d1/d54/f97 724711 0 2024-09-17T07:20:00.866 INFO:tasks.workunit.client.1.smithi139.stdout:0/452: write d1/da/d1b/d3d/f95 [3741023,53524] 0 2024-09-17T07:20:00.870 INFO:tasks.workunit.client.1.smithi139.stdout:9/904: truncate dc/d11/d52/d56/f99 4023629 0 2024-09-17T07:20:00.874 INFO:tasks.workunit.client.1.smithi139.stdout:4/520: dread d0/d1a/f95 [0,4194304] 0 2024-09-17T07:20:00.882 INFO:tasks.workunit.client.1.smithi139.stdout:4/521: truncate d0/d1/d29/fa4 242127 0 2024-09-17T07:20:00.885 INFO:tasks.workunit.client.1.smithi139.stdout:0/453: dwrite d1/da/d17/f34 [0,4194304] 0 2024-09-17T07:20:00.889 INFO:tasks.workunit.client.1.smithi139.stdout:9/905: rename dc/d11/d52/d56/d75/fdd to dc/d11/d52/d56/d7a/f12e 0 2024-09-17T07:20:00.890 INFO:tasks.workunit.client.1.smithi139.stdout:3/546: dread d5/fe [0,4194304] 0 2024-09-17T07:20:00.891 INFO:tasks.workunit.client.1.smithi139.stdout:8/751: dread d0/d20/d28/d52/d65/d7f/db6/f6a [0,4194304] 0 2024-09-17T07:20:00.893 INFO:tasks.workunit.client.1.smithi139.stdout:5/722: dwrite d4/d16/d1b/d20/d28/f4d [0,4194304] 0 2024-09-17T07:20:00.913 INFO:tasks.workunit.client.1.smithi139.stdout:9/906: rmdir dc/d11/d52/d56/d7a/da1 39 2024-09-17T07:20:00.913 INFO:tasks.workunit.client.1.smithi139.stdout:5/723: fdatasync d4/f6 0 2024-09-17T07:20:00.915 INFO:tasks.workunit.client.1.smithi139.stdout:8/752: write d0/d20/d28/d52/d65/d7f/db6/f58 [2355541,46360] 0 2024-09-17T07:20:00.916 INFO:tasks.workunit.client.1.smithi139.stdout:6/683: dread db/d18/d1b/f37 [0,4194304] 0 2024-09-17T07:20:00.917 INFO:tasks.workunit.client.1.smithi139.stdout:7/502: dread d5/d10/d4d/f88 [0,4194304] 0 2024-09-17T07:20:00.917 INFO:tasks.workunit.client.1.smithi139.stdout:1/443: dread d2/f7 [0,4194304] 0 2024-09-17T07:20:00.918 INFO:tasks.workunit.client.1.smithi139.stdout:5/724: chown d4/d16/d1b/d20/f7d 132599218 1 2024-09-17T07:20:00.919 INFO:tasks.workunit.client.1.smithi139.stdout:4/522: dwrite d0/db/d58/f7e [0,4194304] 0 2024-09-17T07:20:00.922 INFO:tasks.workunit.client.1.smithi139.stdout:9/907: creat dc/d11/d15/d1e/d34/f12f x:0 0 0 2024-09-17T07:20:00.923 INFO:tasks.workunit.client.1.smithi139.stdout:5/725: read d4/d16/d1b/d20/d67/f6a [2057667,82561] 0 2024-09-17T07:20:00.923 INFO:tasks.workunit.client.1.smithi139.stdout:6/684: fsync db/d18/d38/f49 0 2024-09-17T07:20:00.925 INFO:tasks.workunit.client.1.smithi139.stdout:5/726: chown d4/d16/d1b/f66 679 1 2024-09-17T07:20:00.925 INFO:tasks.workunit.client.1.smithi139.stdout:4/523: mknod d0/d1/d9b/ca6 0 2024-09-17T07:20:00.925 INFO:tasks.workunit.client.1.smithi139.stdout:9/908: fsync dc/d11/d15/d3c/d61/d64/d96/fde 0 2024-09-17T07:20:00.927 INFO:tasks.workunit.client.1.smithi139.stdout:4/524: stat d0/d1a/f1f 0 2024-09-17T07:20:00.929 INFO:tasks.workunit.client.1.smithi139.stdout:1/444: dwrite d2/d10/d12/f2d [0,4194304] 0 2024-09-17T07:20:00.932 INFO:tasks.workunit.client.1.smithi139.stdout:5/727: write d4/f5b [3481333,88820] 0 2024-09-17T07:20:00.936 INFO:tasks.workunit.client.1.smithi139.stdout:4/525: mknod d0/d1/d54/d93/ca7 0 2024-09-17T07:20:00.936 INFO:tasks.workunit.client.1.smithi139.stdout:8/753: fsync d0/d20/d28/d52/d65/dd3/de4/f4f 0 2024-09-17T07:20:00.939 INFO:tasks.workunit.client.1.smithi139.stdout:6/685: dwrite db/f16 [0,4194304] 0 2024-09-17T07:20:00.939 INFO:tasks.workunit.client.1.smithi139.stdout:1/445: mknod d2/d10/d71/c8a 0 2024-09-17T07:20:00.939 INFO:tasks.workunit.client.1.smithi139.stdout:7/503: write d5/d17/d4e/f7f [1603124,124989] 0 2024-09-17T07:20:00.942 INFO:tasks.workunit.client.1.smithi139.stdout:1/446: chown d2/d10/d12/d24/f57 341 1 2024-09-17T07:20:00.943 INFO:tasks.workunit.client.1.smithi139.stdout:4/526: symlink d0/d10/la8 0 2024-09-17T07:20:00.944 INFO:tasks.workunit.client.1.smithi139.stdout:8/754: fdatasync d0/f2a 0 2024-09-17T07:20:00.944 INFO:tasks.workunit.client.1.smithi139.stdout:4/527: dread - d0/d37/f42 zero size 2024-09-17T07:20:00.945 INFO:tasks.workunit.client.1.smithi139.stdout:5/728: mknod d4/d16/d1b/d20/d32/cea 0 2024-09-17T07:20:00.945 INFO:tasks.workunit.client.1.smithi139.stdout:7/504: symlink d5/d10/d4d/la0 0 2024-09-17T07:20:00.946 INFO:tasks.workunit.client.1.smithi139.stdout:8/755: write d0/d20/d28/d52/d99/fc7 [3426659,89519] 0 2024-09-17T07:20:00.947 INFO:tasks.workunit.client.1.smithi139.stdout:6/686: creat db/df/d73/dc1/fe9 x:0 0 0 2024-09-17T07:20:00.949 INFO:tasks.workunit.client.1.smithi139.stdout:6/687: write db/d18/f35 [4083695,66687] 0 2024-09-17T07:20:00.951 INFO:tasks.workunit.client.1.smithi139.stdout:8/756: write d0/fd [2864605,103668] 0 2024-09-17T07:20:00.954 INFO:tasks.workunit.client.1.smithi139.stdout:7/505: mknod d5/d10/d2b/ca1 0 2024-09-17T07:20:00.954 INFO:tasks.workunit.client.1.smithi139.stdout:5/729: mknod d4/d16/d1b/d20/d32/d72/de5/ceb 0 2024-09-17T07:20:00.955 INFO:tasks.workunit.client.1.smithi139.stdout:6/688: unlink db/d18/c20 0 2024-09-17T07:20:00.956 INFO:tasks.workunit.client.1.smithi139.stdout:8/757: rmdir d0/d20/d28/d52/d54 39 2024-09-17T07:20:00.956 INFO:tasks.workunit.client.1.smithi139.stdout:1/447: dwrite d2/f7 [4194304,4194304] 0 2024-09-17T07:20:00.958 INFO:tasks.workunit.client.1.smithi139.stdout:7/506: write d5/d10/d2b/f62 [2634229,93986] 0 2024-09-17T07:20:00.958 INFO:tasks.workunit.client.1.smithi139.stdout:8/758: chown d0/d20/d28/cdd 406500562 1 2024-09-17T07:20:00.960 INFO:tasks.workunit.client.1.smithi139.stdout:4/528: getdents d0/d1/d29/d41 0 2024-09-17T07:20:00.961 INFO:tasks.workunit.client.1.smithi139.stdout:8/759: fdatasync d0/d1a/d3a/f42 0 2024-09-17T07:20:00.963 INFO:tasks.workunit.client.1.smithi139.stdout:6/689: readlink db/df/d73/d81/l79 0 2024-09-17T07:20:00.964 INFO:tasks.workunit.client.1.smithi139.stdout:1/448: chown d2/f58 195882 1 2024-09-17T07:20:00.964 INFO:tasks.workunit.client.1.smithi139.stdout:6/690: dread - db/d18/d38/f77 zero size 2024-09-17T07:20:00.964 INFO:tasks.workunit.client.1.smithi139.stdout:7/507: rmdir d5/d10/d2b/d78 39 2024-09-17T07:20:00.967 INFO:tasks.workunit.client.1.smithi139.stdout:6/691: write db/df/d4e/fb8 [333733,77697] 0 2024-09-17T07:20:00.969 INFO:tasks.workunit.client.1.smithi139.stdout:5/730: link d4/d16/d1b/d20/d32/l5a d4/lec 0 2024-09-17T07:20:00.971 INFO:tasks.workunit.client.1.smithi139.stdout:8/760: dwrite d0/d1a/f3f [0,4194304] 0 2024-09-17T07:20:00.975 INFO:tasks.workunit.client.0.smithi087.stdout:9/705: sync 2024-09-17T07:20:00.976 INFO:tasks.workunit.client.1.smithi139.stdout:7/508: creat d5/d67/fa2 x:0 0 0 2024-09-17T07:20:00.977 INFO:tasks.workunit.client.1.smithi139.stdout:6/692: mknod db/df/d4e/d64/d83/dd5/cea 0 2024-09-17T07:20:00.979 INFO:tasks.workunit.client.1.smithi139.stdout:8/761: write d0/d20/d28/d52/d65/dd3/de4/f1f [936007,95775] 0 2024-09-17T07:20:00.979 INFO:tasks.workunit.client.1.smithi139.stdout:5/731: dwrite d4/d16/d1b/d20/faa [0,4194304] 0 2024-09-17T07:20:00.981 INFO:tasks.workunit.client.1.smithi139.stdout:4/529: dread d0/db/d17/fa5 [0,4194304] 0 2024-09-17T07:20:00.982 INFO:tasks.workunit.client.0.smithi087.stdout:9/706: dwrite d3/d4/d6/d8/d12/d38/f56 [0,4194304] 0 2024-09-17T07:20:00.983 INFO:tasks.workunit.client.1.smithi139.stdout:5/732: write d4/d5d/f7e [471340,43734] 0 2024-09-17T07:20:00.983 INFO:tasks.workunit.client.1.smithi139.stdout:1/449: truncate d2/f7 2936823 0 2024-09-17T07:20:00.984 INFO:tasks.workunit.client.1.smithi139.stdout:7/509: creat d5/d96/fa3 x:0 0 0 2024-09-17T07:20:00.985 INFO:tasks.workunit.client.0.smithi087.stdout:9/707: chown d3/d4/d6/d8/d12/d32/fef 3139 1 2024-09-17T07:20:00.986 INFO:tasks.workunit.client.1.smithi139.stdout:1/450: fdatasync d2/d10/d12/d13/d4f/d5c/f5f 0 2024-09-17T07:20:00.988 INFO:tasks.workunit.client.1.smithi139.stdout:5/733: mkdir d4/d5d/ded 0 2024-09-17T07:20:00.990 INFO:tasks.workunit.client.1.smithi139.stdout:1/451: write d2/d10/d12/d35/d49/f7b [106179,101989] 0 2024-09-17T07:20:00.990 INFO:tasks.workunit.client.1.smithi139.stdout:4/530: mkdir d0/d1/d9b/d83/da9 0 2024-09-17T07:20:00.994 INFO:tasks.workunit.client.1.smithi139.stdout:8/762: link d0/d20/d28/d52/d65/d7f/db6/f34 d0/d20/d28/d52/d99/db4/ff4 0 2024-09-17T07:20:00.995 INFO:tasks.workunit.client.1.smithi139.stdout:7/510: dwrite d5/d10/f2e [0,4194304] 0 2024-09-17T07:20:00.998 INFO:tasks.workunit.client.0.smithi087.stdout:9/708: write d3/d4/f87 [208849,28169] 0 2024-09-17T07:20:00.998 INFO:tasks.workunit.client.1.smithi139.stdout:4/531: creat d0/d1/d29/d6d/faa x:0 0 0 2024-09-17T07:20:00.998 INFO:tasks.workunit.client.1.smithi139.stdout:1/452: mkdir d2/d10/d12/d35/d49/d8b 0 2024-09-17T07:20:01.000 INFO:tasks.workunit.client.1.smithi139.stdout:1/453: readlink d2/d10/d12/d35/l45 0 2024-09-17T07:20:01.000 INFO:tasks.workunit.client.1.smithi139.stdout:5/734: symlink d4/d16/d1b/d20/d67/d88/d9f/lee 0 2024-09-17T07:20:01.001 INFO:tasks.workunit.client.1.smithi139.stdout:7/511: dread - d5/d10/d4d/d59/f75 zero size 2024-09-17T07:20:01.002 INFO:tasks.workunit.client.1.smithi139.stdout:8/763: creat d0/d1a/d3a/ff5 x:0 0 0 2024-09-17T07:20:01.003 INFO:tasks.workunit.client.1.smithi139.stdout:4/532: creat d0/d1a/fab x:0 0 0 2024-09-17T07:20:01.004 INFO:tasks.workunit.client.1.smithi139.stdout:8/764: dread - d0/d1a/d3a/ff5 zero size 2024-09-17T07:20:01.006 INFO:tasks.workunit.client.1.smithi139.stdout:6/693: write db/df/d73/d81/fe2 [1870421,99404] 0 2024-09-17T07:20:01.006 INFO:tasks.workunit.client.1.smithi139.stdout:7/512: symlink d5/d10/d8c/la4 0 2024-09-17T07:20:01.007 INFO:tasks.workunit.client.1.smithi139.stdout:1/454: link d2/d10/d12/f76 d2/d10/d12/d24/f8c 0 2024-09-17T07:20:01.009 INFO:tasks.workunit.client.1.smithi139.stdout:5/735: truncate d4/d16/d1b/d20/d28/f2a 4627873 0 2024-09-17T07:20:01.010 INFO:tasks.workunit.client.1.smithi139.stdout:4/533: link d0/db/d7f/f94 d0/d1/d9b/fac 0 2024-09-17T07:20:01.011 INFO:tasks.workunit.client.1.smithi139.stdout:4/534: stat d0/d1/cc 0 2024-09-17T07:20:01.012 INFO:tasks.workunit.client.1.smithi139.stdout:6/694: mkdir db/df/d4e/d5e/deb 0 2024-09-17T07:20:01.012 INFO:tasks.workunit.client.1.smithi139.stdout:7/513: fsync d5/d10/d4d/f7d 0 2024-09-17T07:20:01.014 INFO:tasks.workunit.client.1.smithi139.stdout:1/455: dread d2/f58 [0,4194304] 0 2024-09-17T07:20:01.017 INFO:tasks.workunit.client.1.smithi139.stdout:7/514: mknod d5/d10/d2b/d40/d47/ca5 0 2024-09-17T07:20:01.019 INFO:tasks.workunit.client.1.smithi139.stdout:1/456: rename d2/d10/d12/d24/d62 to d2/d10/d12/d35/d49/d8d 0 2024-09-17T07:20:01.019 INFO:tasks.workunit.client.1.smithi139.stdout:7/515: creat d5/d10/d4d/d59/fa6 x:0 0 0 2024-09-17T07:20:01.020 INFO:tasks.workunit.client.1.smithi139.stdout:7/516: chown d5/d96/fa3 357721231 1 2024-09-17T07:20:01.023 INFO:tasks.workunit.client.1.smithi139.stdout:7/517: fsync d5/d10/d2b/d40/f61 0 2024-09-17T07:20:01.025 INFO:tasks.workunit.client.1.smithi139.stdout:1/457: dwrite d2/d10/d12/d24/f57 [0,4194304] 0 2024-09-17T07:20:01.028 INFO:tasks.workunit.client.1.smithi139.stdout:7/518: creat d5/d10/d2b/d40/d47/fa7 x:0 0 0 2024-09-17T07:20:01.029 INFO:tasks.workunit.client.1.smithi139.stdout:7/519: dread - d5/d96/fa3 zero size 2024-09-17T07:20:01.033 INFO:tasks.workunit.client.1.smithi139.stdout:7/520: unlink d5/d17/d4e/d55/f8f 0 2024-09-17T07:20:01.034 INFO:tasks.workunit.client.1.smithi139.stdout:8/765: write d0/d1a/d3a/d71/f8b [259682,106892] 0 2024-09-17T07:20:01.035 INFO:tasks.workunit.client.1.smithi139.stdout:7/521: fdatasync d5/d10/d4d/f60 0 2024-09-17T07:20:01.038 INFO:tasks.workunit.client.1.smithi139.stdout:4/535: write d0/db/d17/f2c [533656,79372] 0 2024-09-17T07:20:01.042 INFO:tasks.workunit.client.1.smithi139.stdout:5/736: dread d4/d16/d1b/d20/d28/f83 [0,4194304] 0 2024-09-17T07:20:01.042 INFO:tasks.workunit.client.1.smithi139.stdout:8/766: symlink d0/d20/d28/d48/de1/lf6 0 2024-09-17T07:20:01.043 INFO:tasks.workunit.client.0.smithi087.stdout:9/709: dread d3/d4/f26 [4194304,4194304] 0 2024-09-17T07:20:01.045 INFO:tasks.workunit.client.1.smithi139.stdout:4/536: dread d0/db/d58/f7e [0,4194304] 0 2024-09-17T07:20:01.048 INFO:tasks.workunit.client.1.smithi139.stdout:1/458: write d2/f58 [94,1783] 0 2024-09-17T07:20:01.048 INFO:tasks.workunit.client.1.smithi139.stdout:5/737: rename d4/d16/d1b/d20/d67/d88/fb0 to d4/da5/fef 0 2024-09-17T07:20:01.050 INFO:tasks.workunit.client.1.smithi139.stdout:6/695: dread db/df/d4e/f55 [0,4194304] 0 2024-09-17T07:20:01.050 INFO:tasks.workunit.client.1.smithi139.stdout:4/537: mkdir d0/d1/d29/d41/dad 0 2024-09-17T07:20:01.054 INFO:tasks.workunit.client.1.smithi139.stdout:8/767: symlink d0/d1a/d4d/lf7 0 2024-09-17T07:20:01.060 INFO:tasks.workunit.client.1.smithi139.stdout:8/768: truncate d0/f2a 1029294 0 2024-09-17T07:20:01.060 INFO:tasks.workunit.client.1.smithi139.stdout:1/459: dread d2/d10/d12/d1a/d61/f85 [0,4194304] 0 2024-09-17T07:20:01.062 INFO:tasks.workunit.client.0.smithi087.stdout:9/710: dread d3/f4d [0,4194304] 0 2024-09-17T07:20:01.066 INFO:tasks.workunit.client.1.smithi139.stdout:6/696: getdents db/df/d4e/d5e 0 2024-09-17T07:20:01.066 INFO:tasks.workunit.client.1.smithi139.stdout:8/769: mknod d0/d20/d28/d52/d65/dd3/de4/cf8 0 2024-09-17T07:20:01.067 INFO:tasks.workunit.client.1.smithi139.stdout:1/460: symlink d2/d10/d12/d13/d4f/d5c/l8e 0 2024-09-17T07:20:01.069 INFO:tasks.workunit.client.1.smithi139.stdout:2/651: sync 2024-09-17T07:20:01.070 INFO:tasks.workunit.client.1.smithi139.stdout:8/770: stat d0/d20/d28/d52/d65 0 2024-09-17T07:20:01.071 INFO:tasks.workunit.client.1.smithi139.stdout:4/538: dwrite d0/d1/d29/f66 [0,4194304] 0 2024-09-17T07:20:01.075 INFO:tasks.workunit.client.1.smithi139.stdout:6/697: creat db/d18/d9f/dd2/fec x:0 0 0 2024-09-17T07:20:01.075 INFO:tasks.workunit.client.1.smithi139.stdout:5/738: dread d4/d16/f18 [0,4194304] 0 2024-09-17T07:20:01.076 INFO:tasks.workunit.client.1.smithi139.stdout:1/461: creat d2/d10/d71/f8f x:0 0 0 2024-09-17T07:20:01.076 INFO:tasks.workunit.client.1.smithi139.stdout:6/698: chown db/d21/f31 155623984 1 2024-09-17T07:20:01.079 INFO:tasks.workunit.client.1.smithi139.stdout:2/652: write d0/d7/d86/da4/d28/fc0 [460626,126412] 0 2024-09-17T07:20:01.079 INFO:tasks.workunit.client.1.smithi139.stdout:4/539: chown d0/d37/c7d 107736 1 2024-09-17T07:20:01.081 INFO:tasks.workunit.client.0.smithi087.stdout:6/837: sync 2024-09-17T07:20:01.082 INFO:tasks.workunit.client.0.smithi087.stdout:3/725: sync 2024-09-17T07:20:01.082 INFO:tasks.workunit.client.0.smithi087.stdout:1/657: sync 2024-09-17T07:20:01.082 INFO:tasks.workunit.client.0.smithi087.stdout:4/764: sync 2024-09-17T07:20:01.082 INFO:tasks.workunit.client.0.smithi087.stdout:0/915: sync 2024-09-17T07:20:01.082 INFO:tasks.workunit.client.0.smithi087.stdout:2/697: sync 2024-09-17T07:20:01.082 INFO:tasks.workunit.client.0.smithi087.stdout:5/919: sync 2024-09-17T07:20:01.082 INFO:tasks.workunit.client.0.smithi087.stdout:8/706: sync 2024-09-17T07:20:01.082 INFO:tasks.workunit.client.0.smithi087.stdout:7/540: sync 2024-09-17T07:20:01.084 INFO:tasks.workunit.client.0.smithi087.stdout:1/658: write d2/d1a/f1c [1476945,63231] 0 2024-09-17T07:20:01.084 INFO:tasks.workunit.client.1.smithi139.stdout:2/653: mkdir d0/d3b/ddc 0 2024-09-17T07:20:01.086 INFO:tasks.workunit.client.0.smithi087.stdout:5/920: fsync d5/d18/dad/f122 0 2024-09-17T07:20:01.088 INFO:tasks.workunit.client.1.smithi139.stdout:6/699: creat db/df/d4e/d64/d83/fed x:0 0 0 2024-09-17T07:20:01.088 INFO:tasks.workunit.client.0.smithi087.stdout:4/765: symlink d2/d92/d4d/d42/db6/dd9/l10a 0 2024-09-17T07:20:01.089 INFO:tasks.workunit.client.0.smithi087.stdout:2/698: chown d2/d48/da2/d3a/l47 970744 1 2024-09-17T07:20:01.089 INFO:tasks.workunit.client.0.smithi087.stdout:7/541: chown d0/d3/d10/f1a 1646 1 2024-09-17T07:20:01.089 INFO:tasks.workunit.client.1.smithi139.stdout:8/771: link d0/d1a/d4d/d53/fd2 d0/d20/da2/ff9 0 2024-09-17T07:20:01.090 INFO:tasks.workunit.client.0.smithi087.stdout:0/916: rename db/d45/d9e/f64 to db/dbe/d124/f13e 0 2024-09-17T07:20:01.094 INFO:tasks.workunit.client.1.smithi139.stdout:2/654: mkdir d0/d7/d86/da4/d28/ddd 0 2024-09-17T07:20:01.096 INFO:tasks.workunit.client.1.smithi139.stdout:1/462: link d2/d10/d12/d24/d38/d3d/c3f d2/d10/d12/d35/d49/d8d/c90 0 2024-09-17T07:20:01.097 INFO:tasks.workunit.client.0.smithi087.stdout:1/659: dwrite d2/d69/d8d/fb8 [0,4194304] 0 2024-09-17T07:20:01.104 INFO:tasks.workunit.client.0.smithi087.stdout:2/699: write d2/d24/f64 [1334922,71573] 0 2024-09-17T07:20:01.104 INFO:tasks.workunit.client.1.smithi139.stdout:6/700: dwrite db/df/d4c/fad [0,4194304] 0 2024-09-17T07:20:01.106 INFO:tasks.workunit.client.1.smithi139.stdout:8/772: dwrite d0/fb5 [0,4194304] 0 2024-09-17T07:20:01.108 INFO:tasks.workunit.client.0.smithi087.stdout:1/660: dread d2/d3d/d45/d90/d43/d5d/fc4 [0,4194304] 0 2024-09-17T07:20:01.110 INFO:tasks.workunit.client.1.smithi139.stdout:6/701: write db/f3d [5085484,21747] 0 2024-09-17T07:20:01.110 INFO:tasks.workunit.client.1.smithi139.stdout:1/463: rename d2/d10/d12/d1a/d61/f85 to d2/f91 0 2024-09-17T07:20:01.111 INFO:tasks.workunit.client.0.smithi087.stdout:3/726: rename d6/d15/c18 to d6/d15/d37/d3c/d43/db7/de3/c101 0 2024-09-17T07:20:01.112 INFO:tasks.workunit.client.0.smithi087.stdout:3/727: chown d6/d1b/l85 6316241 1 2024-09-17T07:20:01.115 INFO:tasks.workunit.client.1.smithi139.stdout:4/540: dread d0/d10/f53 [0,4194304] 0 2024-09-17T07:20:01.117 INFO:tasks.workunit.client.0.smithi087.stdout:1/661: rename d2/d3d/d45/d90/d37/f54 to d2/d48/d6f/fe6 0 2024-09-17T07:20:01.118 INFO:tasks.workunit.client.1.smithi139.stdout:5/739: dread d4/d16/d1b/d20/d28/f82 [0,4194304] 0 2024-09-17T07:20:01.118 INFO:tasks.workunit.client.1.smithi139.stdout:8/773: rmdir d0/d20/d28/d52/d65/dd3/de4 39 2024-09-17T07:20:01.118 INFO:tasks.workunit.client.0.smithi087.stdout:1/662: chown d2/dcf/d9a/fab 29 1 2024-09-17T07:20:01.118 INFO:tasks.workunit.client.1.smithi139.stdout:1/464: truncate d2/d10/d12/d13/d4f/d5c/f5f 619534 0 2024-09-17T07:20:01.120 INFO:tasks.workunit.client.0.smithi087.stdout:3/728: mkdir d6/d15/d37/d3c/d52/db2/d102 0 2024-09-17T07:20:01.120 INFO:tasks.workunit.client.1.smithi139.stdout:2/655: rename d0/d7/d1a/d1b/c31 to d0/d4e/d76/d82/cde 0 2024-09-17T07:20:01.121 INFO:tasks.workunit.client.0.smithi087.stdout:8/707: getdents d1/d2b/d21/d6d/d6f 0 2024-09-17T07:20:01.122 INFO:tasks.workunit.client.1.smithi139.stdout:2/656: write d0/d7/d86/da4/d12/fc2 [202908,17202] 0 2024-09-17T07:20:01.123 INFO:tasks.workunit.client.0.smithi087.stdout:7/542: getdents d0/d3/d10/d87/d96 0 2024-09-17T07:20:01.124 INFO:tasks.workunit.client.1.smithi139.stdout:5/740: creat d4/d16/d1b/d20/d32/d6c/dc9/ff0 x:0 0 0 2024-09-17T07:20:01.124 INFO:tasks.workunit.client.1.smithi139.stdout:2/657: chown d0/d4e/d76 20346713 1 2024-09-17T07:20:01.124 INFO:tasks.workunit.client.0.smithi087.stdout:7/543: chown d0/d3/d23/d17/d7b 121002574 1 2024-09-17T07:20:01.125 INFO:tasks.workunit.client.1.smithi139.stdout:6/702: mknod db/df/d4e/d64/cee 0 2024-09-17T07:20:01.126 INFO:tasks.workunit.client.1.smithi139.stdout:5/741: mkdir d4/d16/d1b/d20/d28/d3f/dcc/df1 0 2024-09-17T07:20:01.126 INFO:tasks.workunit.client.0.smithi087.stdout:3/729: unlink d6/d1b/d42/d6e/c73 0 2024-09-17T07:20:01.127 INFO:tasks.workunit.client.0.smithi087.stdout:4/766: dread d2/d92/d4d/d21/d2f/d3b/f9a [0,4194304] 0 2024-09-17T07:20:01.127 INFO:tasks.workunit.client.1.smithi139.stdout:2/658: mknod d0/d7/d86/cdf 0 2024-09-17T07:20:01.127 INFO:tasks.workunit.client.1.smithi139.stdout:6/703: chown db/df/d73/dc1/lda 11 1 2024-09-17T07:20:01.127 INFO:tasks.workunit.client.0.smithi087.stdout:4/767: stat d2/d92/f65 0 2024-09-17T07:20:01.128 INFO:tasks.workunit.client.0.smithi087.stdout:4/768: read - d2/d92/d4f/d6a/d9d/fbd zero size 2024-09-17T07:20:01.129 INFO:tasks.workunit.client.0.smithi087.stdout:3/730: creat d6/d1b/df6/f103 x:0 0 0 2024-09-17T07:20:01.130 INFO:tasks.workunit.client.0.smithi087.stdout:4/769: chown d2/d22/d62/ff6 9429781 1 2024-09-17T07:20:01.130 INFO:tasks.workunit.client.1.smithi139.stdout:2/659: creat d0/dc/d15/fe0 x:0 0 0 2024-09-17T07:20:01.131 INFO:tasks.workunit.client.0.smithi087.stdout:9/711: write d3/d4/d16/d69/f7b [952953,104343] 0 2024-09-17T07:20:01.131 INFO:tasks.workunit.client.1.smithi139.stdout:5/742: creat d4/d16/d1b/d20/d32/d6c/dc9/dcb/ff2 x:0 0 0 2024-09-17T07:20:01.132 INFO:tasks.workunit.client.1.smithi139.stdout:1/465: write d2/f58 [1549921,85640] 0 2024-09-17T07:20:01.134 INFO:tasks.workunit.client.0.smithi087.stdout:4/770: link d2/c107 d2/d92/d74/c10b 0 2024-09-17T07:20:01.135 INFO:tasks.workunit.client.1.smithi139.stdout:5/743: dread - d4/d16/d1b/d20/d32/d6c/dc9/ff0 zero size 2024-09-17T07:20:01.136 INFO:tasks.workunit.client.1.smithi139.stdout:2/660: mkdir d0/de/d69/de1 0 2024-09-17T07:20:01.136 INFO:tasks.workunit.client.1.smithi139.stdout:1/466: mkdir d2/d10/d12/d13/d4f/d5c/d92 0 2024-09-17T07:20:01.138 INFO:tasks.workunit.client.0.smithi087.stdout:9/712: dwrite d3/d4/d16/d69/d8a/d1e/d90/d93/f9d [0,4194304] 0 2024-09-17T07:20:01.138 INFO:tasks.workunit.client.1.smithi139.stdout:2/661: read d0/dc/d3a/f3d [41536,61959] 0 2024-09-17T07:20:01.139 INFO:tasks.workunit.client.1.smithi139.stdout:5/744: mknod d4/d16/d1b/d20/cf3 0 2024-09-17T07:20:01.140 INFO:tasks.workunit.client.1.smithi139.stdout:1/467: write d2/d10/d12/d35/d2b/f6e [223823,35051] 0 2024-09-17T07:20:01.142 INFO:tasks.workunit.client.0.smithi087.stdout:4/771: dwrite d2/d92/d4d/fd [0,4194304] 0 2024-09-17T07:20:01.143 INFO:tasks.workunit.client.1.smithi139.stdout:5/745: unlink d4/d16/d1b/d20/d32/cea 0 2024-09-17T07:20:01.148 INFO:tasks.workunit.client.1.smithi139.stdout:5/746: creat d4/d16/d1b/d20/d67/d88/de0/ff4 x:0 0 0 2024-09-17T07:20:01.150 INFO:tasks.workunit.client.1.smithi139.stdout:1/468: dwrite d2/d10/d12/d35/d2b/f34 [0,4194304] 0 2024-09-17T07:20:01.153 INFO:tasks.workunit.client.1.smithi139.stdout:5/747: unlink d4/d5d/c64 0 2024-09-17T07:20:01.154 INFO:tasks.workunit.client.0.smithi087.stdout:9/713: dread d3/d4/d6/d71/fd0 [0,4194304] 0 2024-09-17T07:20:01.154 INFO:tasks.workunit.client.1.smithi139.stdout:1/469: creat d2/d10/d12/d7c/f93 x:0 0 0 2024-09-17T07:20:01.156 INFO:tasks.workunit.client.0.smithi087.stdout:9/714: dread d3/d4/d6/d71/f9b [0,4194304] 0 2024-09-17T07:20:01.159 INFO:tasks.workunit.client.1.smithi139.stdout:1/470: dread d2/f7 [0,4194304] 0 2024-09-17T07:20:01.160 INFO:tasks.workunit.client.1.smithi139.stdout:8/774: write d0/d1a/d3a/d71/f75 [615436,10423] 0 2024-09-17T07:20:01.161 INFO:tasks.workunit.client.1.smithi139.stdout:5/748: rmdir d4/d16/d1b/d20/d28/d3f 39 2024-09-17T07:20:01.164 INFO:tasks.workunit.client.0.smithi087.stdout:5/921: unlink d5/d12/f77 0 2024-09-17T07:20:01.164 INFO:tasks.workunit.client.1.smithi139.stdout:8/775: stat d0/d1a/d4d/da4/lb0 0 2024-09-17T07:20:01.164 INFO:tasks.workunit.client.0.smithi087.stdout:5/922: chown d5/d12/d14/d61 61 1 2024-09-17T07:20:01.166 INFO:tasks.workunit.client.0.smithi087.stdout:5/923: creat d5/d18/dad/f124 x:0 0 0 2024-09-17T07:20:01.167 INFO:tasks.workunit.client.1.smithi139.stdout:8/776: fsync d0/d1a/f39 0 2024-09-17T07:20:01.167 INFO:tasks.workunit.client.1.smithi139.stdout:5/749: write d4/d16/d1b/d20/d28/f46 [1141436,127490] 0 2024-09-17T07:20:01.174 INFO:tasks.workunit.client.1.smithi139.stdout:5/750: rename d4/d16/d1b/d20/d28/d61/f9c to d4/d16/d69/dd8/ff5 0 2024-09-17T07:20:01.176 INFO:tasks.workunit.client.1.smithi139.stdout:5/751: readlink d4/d16/d1b/d20/d32/d3d/l6b 0 2024-09-17T07:20:01.176 INFO:tasks.workunit.client.1.smithi139.stdout:2/662: dwrite d0/dc/d3a/f3c [8388608,4194304] 0 2024-09-17T07:20:01.178 INFO:tasks.workunit.client.1.smithi139.stdout:5/752: dread - d4/d5d/d97/fc2 zero size 2024-09-17T07:20:01.182 INFO:tasks.workunit.client.1.smithi139.stdout:5/753: unlink d4/fd5 0 2024-09-17T07:20:01.183 INFO:tasks.workunit.client.0.smithi087.stdout:6/838: truncate d1/d6/f2a 11433656 0 2024-09-17T07:20:01.185 INFO:tasks.workunit.client.0.smithi087.stdout:7/544: creat d0/d3/fa5 x:0 0 0 2024-09-17T07:20:01.185 INFO:tasks.workunit.client.1.smithi139.stdout:5/754: mknod d4/d16/d1b/cf6 0 2024-09-17T07:20:01.187 INFO:tasks.workunit.client.0.smithi087.stdout:6/839: mkdir d1/d67/dfe/d4e/db0/d11c 0 2024-09-17T07:20:01.187 INFO:tasks.workunit.client.0.smithi087.stdout:6/840: chown d1/lf3 1 1 2024-09-17T07:20:01.188 INFO:tasks.workunit.client.0.smithi087.stdout:0/917: write db/d45/f4c [4640277,12971] 0 2024-09-17T07:20:01.190 INFO:tasks.workunit.client.1.smithi139.stdout:8/777: dread d0/d20/d28/d48/f83 [0,4194304] 0 2024-09-17T07:20:01.190 INFO:tasks.workunit.client.0.smithi087.stdout:7/545: rename d0/d3/f22 to d0/d3/d10/d87/d96/fa6 0 2024-09-17T07:20:01.192 INFO:tasks.workunit.client.0.smithi087.stdout:0/918: symlink db/d45/d7b/d90/dd9/de6/l13f 0 2024-09-17T07:20:01.193 INFO:tasks.workunit.client.1.smithi139.stdout:8/778: rmdir d0/d1a 39 2024-09-17T07:20:01.193 INFO:tasks.workunit.client.1.smithi139.stdout:8/779: fdatasync d0/d20/fdc 0 2024-09-17T07:20:01.194 INFO:tasks.workunit.client.0.smithi087.stdout:0/919: write db/d45/d7b/d90/dd9/de6/d10a/f13c [316767,82116] 0 2024-09-17T07:20:01.195 INFO:tasks.workunit.client.1.smithi139.stdout:8/780: chown d0/d1a/d4d/da4/lb0 10889682 1 2024-09-17T07:20:01.195 INFO:tasks.workunit.client.0.smithi087.stdout:6/841: link d1/d67/f69 d1/d67/dfe/d4e/db0/f11d 0 2024-09-17T07:20:01.199 INFO:tasks.workunit.client.1.smithi139.stdout:8/781: rename d0/d1a/d3a/f47 to d0/d20/d28/d52/d99/ffa 0 2024-09-17T07:20:01.199 INFO:tasks.workunit.client.0.smithi087.stdout:6/842: write d1/d67/dfe/d2c/d40/d4c/ff8 [530483,101023] 0 2024-09-17T07:20:01.199 INFO:tasks.workunit.client.0.smithi087.stdout:7/546: creat d0/d3/d86/d89/fa7 x:0 0 0 2024-09-17T07:20:01.200 INFO:tasks.workunit.client.1.smithi139.stdout:8/782: mkdir d0/d20/d28/d52/d65/d7f/db6/dfb 0 2024-09-17T07:20:01.201 INFO:tasks.workunit.client.1.smithi139.stdout:8/783: fsync d0/d1a/d3a/f42 0 2024-09-17T07:20:01.201 INFO:tasks.workunit.client.1.smithi139.stdout:8/784: chown d0/d20/d28/cdd 15649 1 2024-09-17T07:20:01.202 INFO:tasks.workunit.client.0.smithi087.stdout:0/920: dwrite f5 [4194304,4194304] 0 2024-09-17T07:20:01.203 INFO:tasks.workunit.client.0.smithi087.stdout:3/731: truncate d6/d15/d37/d3c/d52/db2/de7/f4a 4097150 0 2024-09-17T07:20:01.203 INFO:tasks.workunit.client.1.smithi139.stdout:8/785: fdatasync d0/d20/f5f 0 2024-09-17T07:20:01.204 INFO:tasks.workunit.client.1.smithi139.stdout:8/786: read d0/d20/f5f [120251,6586] 0 2024-09-17T07:20:01.207 INFO:tasks.workunit.client.0.smithi087.stdout:4/772: truncate d2/d92/f65 3298165 0 2024-09-17T07:20:01.208 INFO:tasks.workunit.client.0.smithi087.stdout:3/732: dread d6/d1b/fc4 [0,4194304] 0 2024-09-17T07:20:01.209 INFO:tasks.workunit.client.1.smithi139.stdout:2/663: dread d0/d3b/f51 [4194304,4194304] 0 2024-09-17T07:20:01.210 INFO:tasks.workunit.client.0.smithi087.stdout:0/921: unlink db/d45/d7b/d90/dd9/ff0 0 2024-09-17T07:20:01.210 INFO:tasks.workunit.client.1.smithi139.stdout:8/787: rename d0/d20/d28/d52/d99/fa7 to d0/d20/d28/ffc 0 2024-09-17T07:20:01.211 INFO:tasks.workunit.client.0.smithi087.stdout:6/843: symlink d1/d67/dfe/d4e/db0/d11c/l11e 0 2024-09-17T07:20:01.211 INFO:tasks.workunit.client.0.smithi087.stdout:9/715: write d3/d4/d6/d8/f78 [1499571,17077] 0 2024-09-17T07:20:01.214 INFO:tasks.workunit.client.1.smithi139.stdout:2/664: mknod d0/dc/d15/d9f/ce2 0 2024-09-17T07:20:01.215 INFO:tasks.workunit.client.1.smithi139.stdout:8/788: chown d0/d20/d28/d52/d54/l91 29 1 2024-09-17T07:20:01.216 INFO:tasks.workunit.client.0.smithi087.stdout:3/733: unlink d6/d15/d37/d3c/d52/db2/de7/fce 0 2024-09-17T07:20:01.218 INFO:tasks.workunit.client.0.smithi087.stdout:5/924: truncate d5/d18/d6f/de1/fd3 841068 0 2024-09-17T07:20:01.218 INFO:tasks.workunit.client.1.smithi139.stdout:8/789: symlink d0/d20/d28/d52/d65/dbe/deb/lfd 0 2024-09-17T07:20:01.219 INFO:tasks.workunit.client.1.smithi139.stdout:8/790: read d0/d20/d28/d52/d99/fcf [3987997,88696] 0 2024-09-17T07:20:01.219 INFO:tasks.workunit.client.0.smithi087.stdout:5/925: chown d5/d18/d6f/de1/f8d 235 1 2024-09-17T07:20:01.220 INFO:tasks.workunit.client.1.smithi139.stdout:8/791: chown d0/d20/f8f 111698360 1 2024-09-17T07:20:01.222 INFO:tasks.workunit.client.0.smithi087.stdout:6/844: dread d1/f35 [0,4194304] 0 2024-09-17T07:20:01.222 INFO:tasks.workunit.client.0.smithi087.stdout:0/922: mknod db/c140 0 2024-09-17T07:20:01.223 INFO:tasks.workunit.client.0.smithi087.stdout:3/734: mkdir d6/d15/d37/d3c/d43/db7/d104 0 2024-09-17T07:20:01.224 INFO:tasks.workunit.client.0.smithi087.stdout:4/773: creat d2/f10c x:0 0 0 2024-09-17T07:20:01.229 INFO:tasks.workunit.client.0.smithi087.stdout:0/923: write db/d45/d5b/d92/de8/d11d/f13d [1191666,35260] 0 2024-09-17T07:20:01.229 INFO:tasks.workunit.client.0.smithi087.stdout:5/926: dwrite d5/d12/d56/d9e/fe5 [4194304,4194304] 0 2024-09-17T07:20:01.231 INFO:tasks.workunit.client.0.smithi087.stdout:3/735: mknod d6/d15/d37/d3c/d52/db2/de7/c105 0 2024-09-17T07:20:01.232 INFO:tasks.workunit.client.0.smithi087.stdout:9/716: link d3/d4/d6/c23 d3/d25/cfb 0 2024-09-17T07:20:01.236 INFO:tasks.workunit.client.0.smithi087.stdout:5/927: read d5/d12/d1c/fe6 [3027163,127057] 0 2024-09-17T07:20:01.237 INFO:tasks.workunit.client.0.smithi087.stdout:6/845: creat d1/f11f x:0 0 0 2024-09-17T07:20:01.241 INFO:tasks.workunit.client.0.smithi087.stdout:7/547: dwrite d0/d3/d23/f54 [0,4194304] 0 2024-09-17T07:20:01.241 INFO:tasks.workunit.client.1.smithi139.stdout:2/665: dread d0/dc/d3a/f3c [0,4194304] 0 2024-09-17T07:20:01.242 INFO:tasks.workunit.client.0.smithi087.stdout:4/774: rename d2/d22/d62/cad to d2/d92/d4d/d42/db6/dd9/c10d 0 2024-09-17T07:20:01.243 INFO:tasks.workunit.client.0.smithi087.stdout:4/775: fdatasync d2/d92/ff5 0 2024-09-17T07:20:01.244 INFO:tasks.workunit.client.0.smithi087.stdout:3/736: mknod d6/d1b/d42/d62/dbb/c106 0 2024-09-17T07:20:01.249 INFO:tasks.workunit.client.0.smithi087.stdout:6/846: rmdir d1/d67/ddc 39 2024-09-17T07:20:01.251 INFO:tasks.workunit.client.0.smithi087.stdout:0/924: rename db/d45/c4a to db/d45/d5b/d92/de8/d11d/c141 0 2024-09-17T07:20:01.253 INFO:tasks.workunit.client.0.smithi087.stdout:7/548: mknod d0/d3/d10/d32/ca8 0 2024-09-17T07:20:01.255 INFO:tasks.workunit.client.0.smithi087.stdout:9/717: mknod d3/d4/da/d4b/ddb/cfc 0 2024-09-17T07:20:01.258 INFO:tasks.workunit.client.1.smithi139.stdout:2/666: mknod d0/de/df/d56/ce3 0 2024-09-17T07:20:01.258 INFO:tasks.workunit.client.0.smithi087.stdout:5/928: symlink d5/d12/d1c/d71/df7/l125 0 2024-09-17T07:20:01.259 INFO:tasks.workunit.client.1.smithi139.stdout:8/792: creat d0/d20/d28/d52/d65/d7f/db6/dfb/ffe x:0 0 0 2024-09-17T07:20:01.259 INFO:tasks.workunit.client.0.smithi087.stdout:6/847: write d1/d67/dfe/d2c/fe6 [1267647,14413] 0 2024-09-17T07:20:01.259 INFO:tasks.workunit.client.1.smithi139.stdout:2/667: mkdir d0/dc/d15/d9f/dc1/de4 0 2024-09-17T07:20:01.262 INFO:tasks.workunit.client.1.smithi139.stdout:8/793: creat d0/fff x:0 0 0 2024-09-17T07:20:01.263 INFO:tasks.workunit.client.0.smithi087.stdout:4/776: mkdir d2/d22/d10e 0 2024-09-17T07:20:01.263 INFO:tasks.workunit.client.1.smithi139.stdout:2/668: rename d0/de/d69/c57 to d0/de/d25/ce5 0 2024-09-17T07:20:01.266 INFO:tasks.workunit.client.0.smithi087.stdout:9/718: rmdir d3/d4/d6/d8/d12 39 2024-09-17T07:20:01.266 INFO:tasks.workunit.client.1.smithi139.stdout:8/794: truncate d0/d20/d28/d52/d65/d7f/db6/f34 3316804 0 2024-09-17T07:20:01.268 INFO:tasks.workunit.client.1.smithi139.stdout:8/795: creat d0/d1a/d4d/f100 x:0 0 0 2024-09-17T07:20:01.269 INFO:tasks.workunit.client.0.smithi087.stdout:9/719: stat d3/d4/d16/d69/d8a/d1e/d90/lca 0 2024-09-17T07:20:01.269 INFO:tasks.workunit.client.0.smithi087.stdout:5/929: write d5/d18/f38 [5271472,45318] 0 2024-09-17T07:20:01.271 INFO:tasks.workunit.client.0.smithi087.stdout:6/848: creat d1/d67/dfe/d2c/d48/d9b/dac/f120 x:0 0 0 2024-09-17T07:20:01.271 INFO:tasks.workunit.client.1.smithi139.stdout:8/796: creat d0/f101 x:0 0 0 2024-09-17T07:20:01.272 INFO:tasks.workunit.client.1.smithi139.stdout:2/669: write d0/d7/d86/da4/d28/f2d [1962442,55703] 0 2024-09-17T07:20:01.273 INFO:tasks.workunit.client.0.smithi087.stdout:6/849: chown d1/d67/dfe/d2c/d40/fe4 0 1 2024-09-17T07:20:01.274 INFO:tasks.workunit.client.1.smithi139.stdout:2/670: creat d0/de/df/d56/fe6 x:0 0 0 2024-09-17T07:20:01.275 INFO:tasks.workunit.client.0.smithi087.stdout:7/549: dread d0/d7a/f8b [0,4194304] 0 2024-09-17T07:20:01.277 INFO:tasks.workunit.client.1.smithi139.stdout:2/671: creat d0/dc/d15/d9f/dc1/de4/fe7 x:0 0 0 2024-09-17T07:20:01.278 INFO:tasks.workunit.client.0.smithi087.stdout:9/720: fdatasync d3/d4/d6/d8/ff9 0 2024-09-17T07:20:01.278 INFO:tasks.workunit.client.1.smithi139.stdout:2/672: chown d0/d7/d67/d92/d99/f72 70 1 2024-09-17T07:20:01.280 INFO:tasks.workunit.client.0.smithi087.stdout:3/737: getdents d6/d15/d37/d3c/d43/db7/de3 0 2024-09-17T07:20:01.281 INFO:tasks.workunit.client.1.smithi139.stdout:2/673: unlink d0/d7/d86/ld2 0 2024-09-17T07:20:01.285 INFO:tasks.workunit.client.1.smithi139.stdout:8/797: truncate d0/d20/d28/d52/d99/db4/ff4 1183711 0 2024-09-17T07:20:01.286 INFO:tasks.workunit.client.0.smithi087.stdout:6/850: dwrite d1/f113 [0,4194304] 0 2024-09-17T07:20:01.287 INFO:tasks.workunit.client.0.smithi087.stdout:3/738: fsync d6/d15/d37/d3c/ff5 0 2024-09-17T07:20:01.289 INFO:tasks.workunit.client.0.smithi087.stdout:7/550: rename d0/d3/d23/d4e/f8a to d0/d36/d8e/fa9 0 2024-09-17T07:20:01.290 INFO:tasks.workunit.client.1.smithi139.stdout:8/798: dread d0/d1a/fbb [0,4194304] 0 2024-09-17T07:20:01.292 INFO:tasks.workunit.client.1.smithi139.stdout:8/799: mkdir d0/d1a/d3a/d8d/d102 0 2024-09-17T07:20:01.293 INFO:tasks.workunit.client.0.smithi087.stdout:4/777: dread d2/d5/d1f/f68 [0,4194304] 0 2024-09-17T07:20:01.293 INFO:tasks.workunit.client.0.smithi087.stdout:6/851: write d1/d67/dfe/d2c/d40/dd2/fe9 [1283195,116472] 0 2024-09-17T07:20:01.293 INFO:tasks.workunit.client.0.smithi087.stdout:9/721: write d3/d4/d6/d8/d12/f60 [1887129,27438] 0 2024-09-17T07:20:01.293 INFO:tasks.workunit.client.1.smithi139.stdout:8/800: dread - d0/d96/fda zero size 2024-09-17T07:20:01.294 INFO:tasks.workunit.client.1.smithi139.stdout:8/801: dread - d0/d1a/dc9/ff2 zero size 2024-09-17T07:20:01.294 INFO:tasks.workunit.client.0.smithi087.stdout:0/925: dwrite db/f49 [0,4194304] 0 2024-09-17T07:20:01.297 INFO:tasks.workunit.client.0.smithi087.stdout:5/930: dwrite d5/d12/d4d/f47 [0,4194304] 0 2024-09-17T07:20:01.299 INFO:tasks.workunit.client.0.smithi087.stdout:4/778: chown d2/d92/d4d/lb1 70540068 1 2024-09-17T07:20:01.301 INFO:tasks.workunit.client.0.smithi087.stdout:9/722: write d3/d4/d6/d8/d22/d2a/faa [1396031,123184] 0 2024-09-17T07:20:01.305 INFO:tasks.workunit.client.0.smithi087.stdout:0/926: fdatasync db/d45/d7b/d90/dd9/de6/f137 0 2024-09-17T07:20:01.309 INFO:tasks.workunit.client.0.smithi087.stdout:0/927: write db/ff3 [1333433,61669] 0 2024-09-17T07:20:01.315 INFO:tasks.workunit.client.0.smithi087.stdout:0/928: creat db/d45/d9e/d86/dd5/deb/d117/f142 x:0 0 0 2024-09-17T07:20:01.315 INFO:tasks.workunit.client.0.smithi087.stdout:9/723: dwrite d3/d25/d83/fad [0,4194304] 0 2024-09-17T07:20:01.319 INFO:tasks.workunit.client.0.smithi087.stdout:0/929: symlink db/dbe/l143 0 2024-09-17T07:20:01.319 INFO:tasks.workunit.client.0.smithi087.stdout:7/551: dread d0/fd [0,4194304] 0 2024-09-17T07:20:01.326 INFO:tasks.workunit.client.0.smithi087.stdout:7/552: rename d0/l75 to d0/d3/d23/d4e/laa 0 2024-09-17T07:20:01.327 INFO:tasks.workunit.client.0.smithi087.stdout:0/930: symlink db/l144 0 2024-09-17T07:20:01.327 INFO:tasks.workunit.client.0.smithi087.stdout:3/739: write d6/d1b/d42/d62/dbb/dd7/fda [2578271,38911] 0 2024-09-17T07:20:01.328 INFO:tasks.workunit.client.0.smithi087.stdout:4/779: truncate d2/d92/d4d/fa2 5935594 0 2024-09-17T07:20:01.330 INFO:tasks.workunit.client.0.smithi087.stdout:4/780: symlink d2/d92/d86/l10f 0 2024-09-17T07:20:01.335 INFO:tasks.workunit.client.0.smithi087.stdout:4/781: mknod d2/d92/d4d/d42/c110 0 2024-09-17T07:20:01.337 INFO:tasks.workunit.client.0.smithi087.stdout:0/931: getdents db/dbe/d124/dd0 0 2024-09-17T07:20:01.340 INFO:tasks.workunit.client.0.smithi087.stdout:9/724: dwrite d3/d4/d6/d8/d12/db1/fdf [0,4194304] 0 2024-09-17T07:20:01.341 INFO:tasks.workunit.client.0.smithi087.stdout:5/931: dread d5/d12/d14/fff [0,4194304] 0 2024-09-17T07:20:01.341 INFO:tasks.workunit.client.0.smithi087.stdout:6/852: dread d1/d67/dfe/d2c/d40/d4c/dce/ff1 [0,4194304] 0 2024-09-17T07:20:01.343 INFO:tasks.workunit.client.0.smithi087.stdout:5/932: stat d5/d18/d20 0 2024-09-17T07:20:01.348 INFO:tasks.workunit.client.0.smithi087.stdout:9/725: dread d3/d4/d6/d8/d22/d92/da3/fa9 [0,4194304] 0 2024-09-17T07:20:01.348 INFO:tasks.workunit.client.0.smithi087.stdout:4/782: symlink d2/d92/d4d/d21/l111 0 2024-09-17T07:20:01.350 INFO:tasks.workunit.client.0.smithi087.stdout:6/853: write d1/d67/dfe/d2c/d48/f8c [84331,83859] 0 2024-09-17T07:20:01.355 INFO:tasks.workunit.client.0.smithi087.stdout:9/726: creat d3/d4/d16/ffd x:0 0 0 2024-09-17T07:20:01.358 INFO:tasks.workunit.client.0.smithi087.stdout:3/740: dwrite d6/d15/d37/f72 [0,4194304] 0 2024-09-17T07:20:01.361 INFO:tasks.workunit.client.0.smithi087.stdout:6/854: link d1/d6/d68/l6b d1/d67/d110/l121 0 2024-09-17T07:20:01.363 INFO:tasks.workunit.client.0.smithi087.stdout:3/741: creat d6/d1b/d42/dd4/dd1/de4/f107 x:0 0 0 2024-09-17T07:20:01.364 INFO:tasks.workunit.client.0.smithi087.stdout:6/855: chown d1/d67/lc4 51238161 1 2024-09-17T07:20:01.365 INFO:tasks.workunit.client.0.smithi087.stdout:9/727: creat d3/d4/d6/ffe x:0 0 0 2024-09-17T07:20:01.367 INFO:tasks.workunit.client.0.smithi087.stdout:7/553: dread d0/d3/d10/f14 [0,4194304] 0 2024-09-17T07:20:01.371 INFO:tasks.workunit.client.0.smithi087.stdout:5/933: truncate d5/d18/d6f/d11b/d1f/d4e/fb4 3695668 0 2024-09-17T07:20:01.373 INFO:tasks.workunit.client.0.smithi087.stdout:4/783: dwrite d2/d92/d4d/d21/d2f/d3b/fd3 [0,4194304] 0 2024-09-17T07:20:01.375 INFO:tasks.workunit.client.0.smithi087.stdout:5/934: write d5/fa9 [4142354,60993] 0 2024-09-17T07:20:01.375 INFO:tasks.workunit.client.0.smithi087.stdout:0/932: dread db/f3e [0,4194304] 0 2024-09-17T07:20:01.378 INFO:tasks.workunit.client.0.smithi087.stdout:0/933: write db/f1e [4208073,44159] 0 2024-09-17T07:20:01.378 INFO:tasks.workunit.client.0.smithi087.stdout:4/784: chown d2/d22/d2c/lc9 68013524 1 2024-09-17T07:20:01.380 INFO:tasks.workunit.client.0.smithi087.stdout:9/728: truncate d3/d4/f98 422711 0 2024-09-17T07:20:01.384 INFO:tasks.workunit.client.0.smithi087.stdout:6/856: write d1/d67/dfe/d2c/d40/d4c/fd0 [2491341,102102] 0 2024-09-17T07:20:01.386 INFO:tasks.workunit.client.0.smithi087.stdout:7/554: getdents d0/d36/d8e/da2 0 2024-09-17T07:20:01.387 INFO:tasks.workunit.client.0.smithi087.stdout:9/729: mkdir d3/d4/d16/d69/d8a/d1e/d90/d93/dff 0 2024-09-17T07:20:01.388 INFO:tasks.workunit.client.0.smithi087.stdout:0/934: dread db/d45/d7b/f9f [0,4194304] 0 2024-09-17T07:20:01.388 INFO:tasks.workunit.client.0.smithi087.stdout:3/742: dwrite d6/d15/d4b/f8b [0,4194304] 0 2024-09-17T07:20:01.389 INFO:tasks.workunit.client.0.smithi087.stdout:7/555: chown d0/d3/d23/d4e/f70 208730210 1 2024-09-17T07:20:01.393 INFO:tasks.workunit.client.0.smithi087.stdout:2/700: sync 2024-09-17T07:20:01.393 INFO:tasks.workunit.client.0.smithi087.stdout:1/663: sync 2024-09-17T07:20:01.393 INFO:tasks.workunit.client.0.smithi087.stdout:8/708: sync 2024-09-17T07:20:01.395 INFO:tasks.workunit.client.0.smithi087.stdout:5/935: unlink d5/d18/d20/d2f/cba 0 2024-09-17T07:20:01.395 INFO:tasks.workunit.client.0.smithi087.stdout:4/785: rename d2/d92/d4d/d21/d2f/d6e/deb/cfc to d2/d22/c112 0 2024-09-17T07:20:01.398 INFO:tasks.workunit.client.0.smithi087.stdout:9/730: write d3/d4/d6/d71/fd0 [3895107,26816] 0 2024-09-17T07:20:01.399 INFO:tasks.workunit.client.0.smithi087.stdout:3/743: read d6/d15/d37/ff4 [1775022,62489] 0 2024-09-17T07:20:01.400 INFO:tasks.workunit.client.0.smithi087.stdout:4/786: write d2/d92/d4d/d21/d2f/d3b/d7e/f81 [39889,126722] 0 2024-09-17T07:20:01.403 INFO:tasks.workunit.client.0.smithi087.stdout:6/857: rename d1/d67/dfe/d8a to d1/d6a/d122 0 2024-09-17T07:20:01.404 INFO:tasks.workunit.client.0.smithi087.stdout:4/787: dread - d2/d92/d4d/d42/ff9 zero size 2024-09-17T07:20:01.405 INFO:tasks.workunit.client.0.smithi087.stdout:5/936: symlink d5/d18/d6f/d11b/d1f/d4e/d10d/d11a/l126 0 2024-09-17T07:20:01.406 INFO:tasks.workunit.client.0.smithi087.stdout:6/858: mkdir d1/d6a/dda/d123 0 2024-09-17T07:20:01.407 INFO:tasks.workunit.client.0.smithi087.stdout:3/744: mkdir d6/d15/d37/d3c/d43/db7/de3/d108 0 2024-09-17T07:20:01.408 INFO:tasks.workunit.client.0.smithi087.stdout:0/935: rename db/dbe/d124/fb5 to db/d45/d5b/d92/de8/f145 0 2024-09-17T07:20:01.409 INFO:tasks.workunit.client.0.smithi087.stdout:7/556: dread d0/d3/d10/f29 [0,4194304] 0 2024-09-17T07:20:01.410 INFO:tasks.workunit.client.0.smithi087.stdout:9/731: unlink d3/d4/d6/c23 0 2024-09-17T07:20:01.412 INFO:tasks.workunit.client.0.smithi087.stdout:6/859: chown d1/d67/dfe/d2c/d58/d90/def/f109 13 1 2024-09-17T07:20:01.412 INFO:tasks.workunit.client.0.smithi087.stdout:7/557: stat d0/d3/d10/c5f 0 2024-09-17T07:20:01.412 INFO:tasks.workunit.client.0.smithi087.stdout:1/664: dread d2/d3d/d35/d57/f89 [0,4194304] 0 2024-09-17T07:20:01.413 INFO:tasks.workunit.client.0.smithi087.stdout:8/709: rename d1/d2b/d3b/l8b to d1/d7/d9/d27/da1/db2/lf6 0 2024-09-17T07:20:01.414 INFO:tasks.workunit.client.0.smithi087.stdout:2/701: link d2/d15/dce/dd1/f54 d2/d24/fdd 0 2024-09-17T07:20:01.415 INFO:tasks.workunit.client.0.smithi087.stdout:1/665: chown d2/dcf/d7e/fbf 199162384 1 2024-09-17T07:20:01.415 INFO:tasks.workunit.client.0.smithi087.stdout:6/860: fdatasync d1/d67/dfe/d2c/d48/f6f 0 2024-09-17T07:20:01.417 INFO:tasks.workunit.client.0.smithi087.stdout:0/936: write db/d45/d9e/d86/dd5/deb/d117/f12f [74853,107644] 0 2024-09-17T07:20:01.417 INFO:tasks.workunit.client.0.smithi087.stdout:2/702: chown d2/d7/dd/c3c 13 1 2024-09-17T07:20:01.418 INFO:tasks.workunit.client.0.smithi087.stdout:4/788: rename d2/d92/d4d/d3e to d2/d22/d2c/d91/d113 0 2024-09-17T07:20:01.421 INFO:tasks.workunit.client.0.smithi087.stdout:1/666: dread - d2/d3d/f49 zero size 2024-09-17T07:20:01.425 INFO:tasks.workunit.client.0.smithi087.stdout:3/745: rename d6/d15/d37/d3c/l80 to d6/d1b/df6/l109 0 2024-09-17T07:20:01.426 INFO:tasks.workunit.client.0.smithi087.stdout:1/667: dread d2/d3d/fd4 [0,4194304] 0 2024-09-17T07:20:01.429 INFO:tasks.workunit.client.0.smithi087.stdout:6/861: mknod d1/d67/dfe/d2c/d58/d90/d115/c124 0 2024-09-17T07:20:01.429 INFO:tasks.workunit.client.0.smithi087.stdout:8/710: dwrite d1/d7/d9/d27/da1/fec [4194304,4194304] 0 2024-09-17T07:20:01.430 INFO:tasks.workunit.client.0.smithi087.stdout:4/789: dwrite d2/d22/d95/fd6 [0,4194304] 0 2024-09-17T07:20:01.431 INFO:tasks.workunit.client.0.smithi087.stdout:0/937: mknod db/d45/d7b/d90/dd9/de6/c146 0 2024-09-17T07:20:01.432 INFO:tasks.workunit.client.0.smithi087.stdout:3/746: truncate d6/d15/d37/f5c 295068 0 2024-09-17T07:20:01.438 INFO:tasks.workunit.client.0.smithi087.stdout:5/937: rename d5/d18/f38 to d5/d18/d20/d2f/d60/de3/ded/f127 0 2024-09-17T07:20:01.443 INFO:tasks.workunit.client.0.smithi087.stdout:4/790: dwrite d2/d92/d74/fe6 [0,4194304] 0 2024-09-17T07:20:01.445 INFO:tasks.workunit.client.0.smithi087.stdout:7/558: truncate d0/d3/d23/d2d/f35 1105979 0 2024-09-17T07:20:01.449 INFO:tasks.workunit.client.0.smithi087.stdout:2/703: creat d2/d7/dd/fde x:0 0 0 2024-09-17T07:20:01.450 INFO:tasks.workunit.client.0.smithi087.stdout:2/704: readlink d2/d7/db/l44 0 2024-09-17T07:20:01.451 INFO:tasks.workunit.client.0.smithi087.stdout:1/668: mknod d2/ce7 0 2024-09-17T07:20:01.453 INFO:tasks.workunit.client.0.smithi087.stdout:6/862: mkdir d1/d67/dfe/d125 0 2024-09-17T07:20:01.455 INFO:tasks.workunit.client.0.smithi087.stdout:7/559: readlink d0/d3/d23/d2d/l74 0 2024-09-17T07:20:01.457 INFO:tasks.workunit.client.0.smithi087.stdout:9/732: rename d3/d4/da/f47 to d3/d4/d6/d8/d12/db1/f100 0 2024-09-17T07:20:01.458 INFO:tasks.workunit.client.0.smithi087.stdout:1/669: unlink d2/d3d/fbd 0 2024-09-17T07:20:01.460 INFO:tasks.workunit.client.0.smithi087.stdout:8/711: link d1/d2b/d21/fb3 d1/d2b/ff7 0 2024-09-17T07:20:01.461 INFO:tasks.workunit.client.0.smithi087.stdout:2/705: symlink d2/d15/ldf 0 2024-09-17T07:20:01.461 INFO:tasks.workunit.client.0.smithi087.stdout:8/712: stat d1/d7/d9/d19/d4d 0 2024-09-17T07:20:01.462 INFO:tasks.workunit.client.0.smithi087.stdout:7/560: unlink d0/d3/d23/d17/d7b/ca0 0 2024-09-17T07:20:01.463 INFO:tasks.workunit.client.0.smithi087.stdout:7/561: chown d0/d3/d10/c5f 109 1 2024-09-17T07:20:01.465 INFO:tasks.workunit.client.0.smithi087.stdout:3/747: getdents d6 0 2024-09-17T07:20:01.466 INFO:tasks.workunit.client.0.smithi087.stdout:4/791: creat d2/f114 x:0 0 0 2024-09-17T07:20:01.467 INFO:tasks.workunit.client.0.smithi087.stdout:1/670: write d2/d3d/d45/d90/f20 [2674358,121273] 0 2024-09-17T07:20:01.469 INFO:tasks.workunit.client.0.smithi087.stdout:1/671: read - d2/d3d/d8e/fb2 zero size 2024-09-17T07:20:01.471 INFO:tasks.workunit.client.0.smithi087.stdout:2/706: symlink d2/d12/d85/le0 0 2024-09-17T07:20:01.471 INFO:tasks.workunit.client.0.smithi087.stdout:4/792: dread d2/d92/d4d/f29 [0,4194304] 0 2024-09-17T07:20:01.473 INFO:tasks.workunit.client.0.smithi087.stdout:2/707: read - d2/d7/d60/fb6 zero size 2024-09-17T07:20:01.474 INFO:tasks.workunit.client.1.smithi139.stdout:3/547: sync 2024-09-17T07:20:01.474 INFO:tasks.workunit.client.1.smithi139.stdout:0/454: sync 2024-09-17T07:20:01.475 INFO:tasks.workunit.client.0.smithi087.stdout:0/938: dwrite db/d45/d7b/fd2 [0,4194304] 0 2024-09-17T07:20:01.476 INFO:tasks.workunit.client.1.smithi139.stdout:3/548: mknod d5/d21/cb1 0 2024-09-17T07:20:01.477 INFO:tasks.workunit.client.0.smithi087.stdout:1/672: rmdir d2/d48 39 2024-09-17T07:20:01.478 INFO:tasks.workunit.client.1.smithi139.stdout:3/549: dread - d5/d15/d16/d25/d97/fa4 zero size 2024-09-17T07:20:01.479 INFO:tasks.workunit.client.0.smithi087.stdout:7/562: read d0/d3/d10/f20 [3033597,91375] 0 2024-09-17T07:20:01.482 INFO:tasks.workunit.client.1.smithi139.stdout:3/550: unlink d5/d63/d6d/d6f/d8b/c9f 0 2024-09-17T07:20:01.483 INFO:tasks.workunit.client.0.smithi087.stdout:3/748: unlink d6/d1b/df6/cea 0 2024-09-17T07:20:01.483 INFO:tasks.workunit.client.1.smithi139.stdout:3/551: write d5/d15/d16/d4c/d28/d54/d8e/fa5 [1789510,17962] 0 2024-09-17T07:20:01.486 INFO:tasks.workunit.client.0.smithi087.stdout:3/749: chown d6/d1b/d42/d62/dc1/de8/fef 15510 1 2024-09-17T07:20:01.487 INFO:tasks.workunit.client.0.smithi087.stdout:5/938: dread d5/d18/d6f/fc7 [0,4194304] 0 2024-09-17T07:20:01.488 INFO:tasks.workunit.client.1.smithi139.stdout:3/552: rename d5/d15/d56/f1a to d5/d15/d20/fb2 0 2024-09-17T07:20:01.491 INFO:tasks.workunit.client.0.smithi087.stdout:2/708: mkdir d2/d7/db/de1 0 2024-09-17T07:20:01.493 INFO:tasks.workunit.client.0.smithi087.stdout:1/673: mknod d2/d3d/d45/d90/d43/ce8 0 2024-09-17T07:20:01.494 INFO:tasks.workunit.client.0.smithi087.stdout:2/709: write d2/d24/fc0 [31133,95053] 0 2024-09-17T07:20:01.494 INFO:tasks.workunit.client.1.smithi139.stdout:3/553: dwrite d5/f3c [0,4194304] 0 2024-09-17T07:20:01.495 INFO:tasks.workunit.client.0.smithi087.stdout:9/733: getdents d3/d4/dcd 0 2024-09-17T07:20:01.497 INFO:tasks.workunit.client.1.smithi139.stdout:3/554: mkdir d5/d63/db3 0 2024-09-17T07:20:01.499 INFO:tasks.workunit.client.0.smithi087.stdout:8/713: getdents d1/d2b/d21 0 2024-09-17T07:20:01.499 INFO:tasks.workunit.client.0.smithi087.stdout:5/939: mkdir d5/d12/d56/db7/d128 0 2024-09-17T07:20:01.500 INFO:tasks.workunit.client.0.smithi087.stdout:4/793: creat d2/f115 x:0 0 0 2024-09-17T07:20:01.503 INFO:tasks.workunit.client.0.smithi087.stdout:2/710: truncate d2/d7/dd/d10/d4c/d5f/fd7 678224 0 2024-09-17T07:20:01.503 INFO:tasks.workunit.client.1.smithi139.stdout:3/555: rename d5/d15/d20/d3b/f53 to d5/d15/d16/d4c/fb4 0 2024-09-17T07:20:01.505 INFO:tasks.workunit.client.0.smithi087.stdout:9/734: unlink d3/d4/d16/d69/f6b 0 2024-09-17T07:20:01.506 INFO:tasks.workunit.client.1.smithi139.stdout:3/556: unlink d5/d15/d16/d4c/f66 0 2024-09-17T07:20:01.508 INFO:tasks.workunit.client.0.smithi087.stdout:2/711: creat d2/d7/db/fe2 x:0 0 0 2024-09-17T07:20:01.509 INFO:tasks.workunit.client.0.smithi087.stdout:7/563: write d0/d3/f40 [885518,9691] 0 2024-09-17T07:20:01.510 INFO:tasks.workunit.client.0.smithi087.stdout:5/940: symlink d5/d12/d56/df5/l129 0 2024-09-17T07:20:01.511 INFO:tasks.workunit.client.1.smithi139.stdout:3/557: rename d5/d63/d6d/d6f/d81/d82 to d5/d15/d16/d4c/d28/db5 0 2024-09-17T07:20:01.513 INFO:tasks.workunit.client.0.smithi087.stdout:0/939: write db/f48 [681414,131057] 0 2024-09-17T07:20:01.517 INFO:tasks.workunit.client.1.smithi139.stdout:3/558: link d5/d63/c99 d5/da7/cb6 0 2024-09-17T07:20:01.518 INFO:tasks.workunit.client.1.smithi139.stdout:3/559: fdatasync f2 0 2024-09-17T07:20:01.520 INFO:tasks.workunit.client.1.smithi139.stdout:0/455: dwrite d1/da/d17/d72/f5b [0,4194304] 0 2024-09-17T07:20:01.521 INFO:tasks.workunit.client.0.smithi087.stdout:8/714: write d1/d7/d9/d19/f1d [2091175,125274] 0 2024-09-17T07:20:01.521 INFO:tasks.workunit.client.1.smithi139.stdout:3/560: stat d5/d15/d16/d25/c95 0 2024-09-17T07:20:01.524 INFO:tasks.workunit.client.0.smithi087.stdout:6/863: dread d1/d67/dfe/d2c/f51 [0,4194304] 0 2024-09-17T07:20:01.525 INFO:tasks.workunit.client.0.smithi087.stdout:7/564: chown d0/d3/d86/d89 40354 1 2024-09-17T07:20:01.526 INFO:tasks.workunit.client.1.smithi139.stdout:3/561: symlink d5/d63/d6d/d6f/d81/lb7 0 2024-09-17T07:20:01.527 INFO:tasks.workunit.client.0.smithi087.stdout:3/750: dread d6/d15/d37/ff4 [0,4194304] 0 2024-09-17T07:20:01.529 INFO:tasks.workunit.client.1.smithi139.stdout:3/562: creat d5/d63/d6d/d6f/fb8 x:0 0 0 2024-09-17T07:20:01.530 INFO:tasks.workunit.client.0.smithi087.stdout:9/735: fdatasync d3/d4/d6/d8/d12/db1/f100 0 2024-09-17T07:20:01.530 INFO:tasks.workunit.client.0.smithi087.stdout:3/751: write d6/d15/d37/f5c [698764,27445] 0 2024-09-17T07:20:01.533 INFO:tasks.workunit.client.0.smithi087.stdout:1/674: dread d2/d48/d61/fb6 [0,4194304] 0 2024-09-17T07:20:01.533 INFO:tasks.workunit.client.1.smithi139.stdout:3/563: getdents d5/d21/d23/d69 0 2024-09-17T07:20:01.534 INFO:tasks.workunit.client.0.smithi087.stdout:3/752: chown d6/d1b/l76 174555362 1 2024-09-17T07:20:01.535 INFO:tasks.workunit.client.1.smithi139.stdout:3/564: mknod d5/d15/d20/cb9 0 2024-09-17T07:20:01.535 INFO:tasks.workunit.client.0.smithi087.stdout:1/675: chown d2/d14/f63 60797 1 2024-09-17T07:20:01.535 INFO:tasks.workunit.client.0.smithi087.stdout:2/712: mkdir d2/d15/dce/dd1/d99/de3 0 2024-09-17T07:20:01.536 INFO:tasks.workunit.client.1.smithi139.stdout:3/565: mkdir d5/d21/dba 0 2024-09-17T07:20:01.537 INFO:tasks.workunit.client.0.smithi087.stdout:3/753: write d6/d15/d37/d3c/d52/db2/de7/f26 [5072553,50514] 0 2024-09-17T07:20:01.538 INFO:tasks.workunit.client.1.smithi139.stdout:3/566: symlink d5/d63/d6d/lbb 0 2024-09-17T07:20:01.539 INFO:tasks.workunit.client.1.smithi139.stdout:3/567: dread - d5/d63/d6d/d6f/d8b/f92 zero size 2024-09-17T07:20:01.539 INFO:tasks.workunit.client.0.smithi087.stdout:6/864: creat d1/d67/dfe/d5e/d8f/f126 x:0 0 0 2024-09-17T07:20:01.540 INFO:tasks.workunit.client.1.smithi139.stdout:3/568: chown d5/d15/d16/l55 1059862040 1 2024-09-17T07:20:01.541 INFO:tasks.workunit.client.1.smithi139.stdout:3/569: chown d5/d15/d16/d4c/d28/l45 1 1 2024-09-17T07:20:01.542 INFO:tasks.workunit.client.0.smithi087.stdout:7/565: mknod d0/d3/cab 0 2024-09-17T07:20:01.542 INFO:tasks.workunit.client.0.smithi087.stdout:9/736: rmdir d3/d4/d6/d8/d22/d92 39 2024-09-17T07:20:01.542 INFO:tasks.workunit.client.0.smithi087.stdout:6/865: write d1/d67/dfe/d2c/d40/d4c/dce/f10e [285287,21105] 0 2024-09-17T07:20:01.543 INFO:tasks.workunit.client.1.smithi139.stdout:3/570: write d5/d15/d16/d4c/d28/d54/d58/f8f [675415,79255] 0 2024-09-17T07:20:01.544 INFO:tasks.workunit.client.0.smithi087.stdout:8/715: rename d1/d2b/df4/ld1 to d1/d2b/d21/d6d/lf8 0 2024-09-17T07:20:01.545 INFO:tasks.workunit.client.1.smithi139.stdout:3/571: chown d5/d63/d6d/d6f/fb8 5815 1 2024-09-17T07:20:01.546 INFO:tasks.workunit.client.0.smithi087.stdout:1/676: unlink d2/d3d/d45/d90/c7c 0 2024-09-17T07:20:01.547 INFO:tasks.workunit.client.0.smithi087.stdout:4/794: getdents d2/d92/d4d/d21/d2f/d6e 0 2024-09-17T07:20:01.548 INFO:tasks.workunit.client.1.smithi139.stdout:3/572: creat d5/d15/d16/d4c/d28/d54/fbc x:0 0 0 2024-09-17T07:20:01.548 INFO:tasks.workunit.client.0.smithi087.stdout:3/754: mkdir d6/d15/d37/d3c/d52/db2/d10a 0 2024-09-17T07:20:01.549 INFO:tasks.workunit.client.0.smithi087.stdout:1/677: read d2/d48/d61/fb6 [1961151,75207] 0 2024-09-17T07:20:01.550 INFO:tasks.workunit.client.1.smithi139.stdout:3/573: fsync d5/d15/d16/d4c/d28/f89 0 2024-09-17T07:20:01.552 INFO:tasks.workunit.client.1.smithi139.stdout:3/574: chown d5/d15/f33 6210783 1 2024-09-17T07:20:01.552 INFO:tasks.workunit.client.1.smithi139.stdout:0/456: dwrite d1/da/d1b/f27 [0,4194304] 0 2024-09-17T07:20:01.552 INFO:tasks.workunit.client.0.smithi087.stdout:6/866: creat d1/d67/dfe/d2c/d48/d62/f127 x:0 0 0 2024-09-17T07:20:01.553 INFO:tasks.workunit.client.0.smithi087.stdout:0/940: getdents db/d45/d7b/d90 0 2024-09-17T07:20:01.555 INFO:tasks.workunit.client.0.smithi087.stdout:8/716: creat d1/d2b/d21/dd4/ff9 x:0 0 0 2024-09-17T07:20:01.556 INFO:tasks.workunit.client.0.smithi087.stdout:5/941: dread d5/d12/d4d/fbe [0,4194304] 0 2024-09-17T07:20:01.556 INFO:tasks.workunit.client.0.smithi087.stdout:7/566: dwrite d0/d3/d10/d31/f63 [0,4194304] 0 2024-09-17T07:20:01.557 INFO:tasks.workunit.client.1.smithi139.stdout:0/457: creat d1/da/d1b/d32/d81/faf x:0 0 0 2024-09-17T07:20:01.558 INFO:tasks.workunit.client.0.smithi087.stdout:0/941: dread - db/d45/d9e/d95/f116 zero size 2024-09-17T07:20:01.558 INFO:tasks.workunit.client.1.smithi139.stdout:0/458: chown d1/da/d17/d65/f85 11350 1 2024-09-17T07:20:01.559 INFO:tasks.workunit.client.0.smithi087.stdout:9/737: unlink d3/d4/da/lf 0 2024-09-17T07:20:01.560 INFO:tasks.workunit.client.1.smithi139.stdout:3/575: dwrite d5/d15/f51 [0,4194304] 0 2024-09-17T07:20:01.562 INFO:tasks.workunit.client.1.smithi139.stdout:3/576: rmdir d5/d21/d23/d69 39 2024-09-17T07:20:01.563 INFO:tasks.workunit.client.1.smithi139.stdout:3/577: write d5/d15/f51 [2859517,24461] 0 2024-09-17T07:20:01.565 INFO:tasks.workunit.client.0.smithi087.stdout:0/942: read db/d45/d5b/f89 [532127,29659] 0 2024-09-17T07:20:01.565 INFO:tasks.workunit.client.0.smithi087.stdout:6/867: write d1/d67/dfe/d2c/d58/d90/def/f109 [20019,77726] 0 2024-09-17T07:20:01.565 INFO:tasks.workunit.client.0.smithi087.stdout:9/738: dread - d3/d4/d16/d69/f9f zero size 2024-09-17T07:20:01.567 INFO:tasks.workunit.client.0.smithi087.stdout:1/678: symlink d2/d3d/db4/dc3/le9 0 2024-09-17T07:20:01.572 INFO:tasks.workunit.client.1.smithi139.stdout:3/578: dread d5/f77 [0,4194304] 0 2024-09-17T07:20:01.574 INFO:tasks.workunit.client.0.smithi087.stdout:3/755: creat d6/d1b/d42/d95/db3/f10b x:0 0 0 2024-09-17T07:20:01.577 INFO:tasks.workunit.client.0.smithi087.stdout:2/713: truncate d2/d7/dd/d10/f53 1935901 0 2024-09-17T07:20:01.578 INFO:tasks.workunit.client.0.smithi087.stdout:6/868: mknod d1/d67/dfe/d2c/d48/d62/c128 0 2024-09-17T07:20:01.578 INFO:tasks.workunit.client.0.smithi087.stdout:8/717: dwrite d1/d7/d9/d19/d73/fe0 [0,4194304] 0 2024-09-17T07:20:01.579 INFO:tasks.workunit.client.1.smithi139.stdout:0/459: dwrite d1/da/fc [0,4194304] 0 2024-09-17T07:20:01.579 INFO:tasks.workunit.client.0.smithi087.stdout:0/943: creat db/dbe/d124/f147 x:0 0 0 2024-09-17T07:20:01.579 INFO:tasks.workunit.client.0.smithi087.stdout:1/679: write d2/d48/d6f/fc1 [245868,8199] 0 2024-09-17T07:20:01.579 INFO:tasks.workunit.client.0.smithi087.stdout:4/795: dwrite d2/d92/d4d/d21/d2f/fb3 [0,4194304] 0 2024-09-17T07:20:01.580 INFO:tasks.workunit.client.1.smithi139.stdout:3/579: dwrite d5/d15/f7a [0,4194304] 0 2024-09-17T07:20:01.582 INFO:tasks.workunit.client.0.smithi087.stdout:2/714: readlink d2/d24/d36/l3d 0 2024-09-17T07:20:01.583 INFO:tasks.workunit.client.0.smithi087.stdout:4/796: fsync d2/d5/f9c 0 2024-09-17T07:20:01.585 INFO:tasks.workunit.client.0.smithi087.stdout:7/567: getdents d0/d36/d8e 0 2024-09-17T07:20:01.587 INFO:tasks.workunit.client.0.smithi087.stdout:6/869: chown d1/f16 8519637 1 2024-09-17T07:20:01.589 INFO:tasks.workunit.client.0.smithi087.stdout:9/739: rename d3/d4/d6/d8/d12/d32/d6c/c7a to d3/d4/d16/d69/d8a/d1e/c101 0 2024-09-17T07:20:01.590 INFO:tasks.workunit.client.0.smithi087.stdout:6/870: write d1/d67/dfe/d2c/d33/f3d [4464911,32534] 0 2024-09-17T07:20:01.590 INFO:tasks.workunit.client.1.smithi139.stdout:3/580: dwrite d5/d15/d16/d4c/d28/d54/d58/f8f [0,4194304] 0 2024-09-17T07:20:01.591 INFO:tasks.workunit.client.0.smithi087.stdout:8/718: unlink d1/d7/d9/d19/d1b/f30 0 2024-09-17T07:20:01.592 INFO:tasks.workunit.client.0.smithi087.stdout:7/568: dread - d0/d3/d86/d89/f98 zero size 2024-09-17T07:20:01.594 INFO:tasks.workunit.client.1.smithi139.stdout:3/581: truncate d5/d15/d16/d25/d97/fa4 971422 0 2024-09-17T07:20:01.594 INFO:tasks.workunit.client.0.smithi087.stdout:4/797: creat d2/d92/d4f/d7b/f116 x:0 0 0 2024-09-17T07:20:01.596 INFO:tasks.workunit.client.0.smithi087.stdout:2/715: creat d2/d7/dd/d6a/d6d/fe4 x:0 0 0 2024-09-17T07:20:01.597 INFO:tasks.workunit.client.1.smithi139.stdout:3/582: mkdir d5/d21/d23/d38/dbd 0 2024-09-17T07:20:01.597 INFO:tasks.workunit.client.0.smithi087.stdout:0/944: unlink db/d45/d9e/d86/fad 0 2024-09-17T07:20:01.599 INFO:tasks.workunit.client.0.smithi087.stdout:7/569: chown d0/d3/d23/d17/f65 949790483 1 2024-09-17T07:20:01.599 INFO:tasks.workunit.client.0.smithi087.stdout:9/740: mkdir d3/d4/dcd/df4/d102 0 2024-09-17T07:20:01.600 INFO:tasks.workunit.client.1.smithi139.stdout:3/583: unlink d5/d15/d56/lb0 0 2024-09-17T07:20:01.601 INFO:tasks.workunit.client.0.smithi087.stdout:6/871: write d1/d67/dfe/d2c/d48/fb9 [5076060,40740] 0 2024-09-17T07:20:01.602 INFO:tasks.workunit.client.1.smithi139.stdout:3/584: truncate d5/d15/d16/d4c/d28/f89 511348 0 2024-09-17T07:20:01.603 INFO:tasks.workunit.client.0.smithi087.stdout:1/680: read d2/d48/d6f/fc1 [198674,4988] 0 2024-09-17T07:20:01.605 INFO:tasks.workunit.client.1.smithi139.stdout:3/585: truncate d5/d21/d23/f47 4956207 0 2024-09-17T07:20:01.607 INFO:tasks.workunit.client.1.smithi139.stdout:3/586: rmdir d5/d15/d16/d4c/d28 39 2024-09-17T07:20:01.609 INFO:tasks.workunit.client.0.smithi087.stdout:3/756: dwrite d6/d15/d37/d3c/d43/db7/fdb [0,4194304] 0 2024-09-17T07:20:01.610 INFO:tasks.workunit.client.1.smithi139.stdout:3/587: creat d5/d15/d16/d4c/d28/d54/d8e/fbe x:0 0 0 2024-09-17T07:20:01.611 INFO:tasks.workunit.client.1.smithi139.stdout:3/588: read d5/d15/d16/d4c/f68 [36938,16693] 0 2024-09-17T07:20:01.612 INFO:tasks.workunit.client.0.smithi087.stdout:7/570: creat d0/d3/d10/d32/d62/d76/fac x:0 0 0 2024-09-17T07:20:01.612 INFO:tasks.workunit.client.0.smithi087.stdout:7/571: fdatasync d0/d3/d10/d31/f9a 0 2024-09-17T07:20:01.614 INFO:tasks.workunit.client.1.smithi139.stdout:3/589: creat d5/d21/d23/d69/fbf x:0 0 0 2024-09-17T07:20:01.614 INFO:tasks.workunit.client.0.smithi087.stdout:2/716: symlink d2/d7/dd/d10/d4c/d5f/d8b/le5 0 2024-09-17T07:20:01.615 INFO:tasks.workunit.client.1.smithi139.stdout:3/590: write d5/d15/d16/d4c/f9a [2347320,29266] 0 2024-09-17T07:20:01.616 INFO:tasks.workunit.client.0.smithi087.stdout:8/719: dread d1/d7/d9/d27/f58 [0,4194304] 0 2024-09-17T07:20:01.616 INFO:tasks.workunit.client.0.smithi087.stdout:7/572: write d0/d3/d10/d32/d62/d76/f7f [2634349,36412] 0 2024-09-17T07:20:01.616 INFO:tasks.workunit.client.0.smithi087.stdout:1/681: rmdir d2/d3d/db4/dc3 39 2024-09-17T07:20:01.616 INFO:tasks.workunit.client.0.smithi087.stdout:3/757: write d6/d1b/d42/dd4/dd1/de4/f107 [677759,57365] 0 2024-09-17T07:20:01.617 INFO:tasks.workunit.client.1.smithi139.stdout:3/591: mknod d5/d15/d20/cc0 0 2024-09-17T07:20:01.618 INFO:tasks.workunit.client.1.smithi139.stdout:3/592: truncate d5/d15/d16/d4c/d28/d54/d8e/fbe 731560 0 2024-09-17T07:20:01.619 INFO:tasks.workunit.client.0.smithi087.stdout:0/945: symlink db/d45/d7b/d90/l148 0 2024-09-17T07:20:01.619 INFO:tasks.workunit.client.1.smithi139.stdout:3/593: write d5/d21/d23/d69/fa6 [917883,84401] 0 2024-09-17T07:20:01.620 INFO:tasks.workunit.client.0.smithi087.stdout:4/798: mknod d2/d92/d4d/d21/dfa/d108/c117 0 2024-09-17T07:20:01.620 INFO:tasks.workunit.client.0.smithi087.stdout:3/758: truncate d6/d15/d37/d3c/ff5 927177 0 2024-09-17T07:20:01.621 INFO:tasks.workunit.client.0.smithi087.stdout:4/799: read - d2/d5/d1f/fe1 zero size 2024-09-17T07:20:01.622 INFO:tasks.workunit.client.0.smithi087.stdout:2/717: dread - d2/f8a zero size 2024-09-17T07:20:01.625 INFO:tasks.workunit.client.0.smithi087.stdout:4/800: read d2/d22/d2c/d91/fd1 [1255945,39777] 0 2024-09-17T07:20:01.627 INFO:tasks.workunit.client.1.smithi139.stdout:3/594: dwrite d5/d15/d16/f9e [0,4194304] 0 2024-09-17T07:20:01.627 INFO:tasks.workunit.client.0.smithi087.stdout:5/942: dread d5/d18/d6f/d11b/d1f/fc0 [0,4194304] 0 2024-09-17T07:20:01.627 INFO:tasks.workunit.client.0.smithi087.stdout:4/801: write d2/d92/d4f/d7b/fe8 [911512,120344] 0 2024-09-17T07:20:01.628 INFO:tasks.workunit.client.1.smithi139.stdout:3/595: chown d5/d15/d16/d4c/la9 498 1 2024-09-17T07:20:01.628 INFO:tasks.workunit.client.0.smithi087.stdout:0/946: mknod db/dbe/c149 0 2024-09-17T07:20:01.630 INFO:tasks.workunit.client.0.smithi087.stdout:0/947: write db/f49 [3777734,7786] 0 2024-09-17T07:20:01.633 INFO:tasks.workunit.client.0.smithi087.stdout:0/948: write db/dbe/d124/f147 [916024,15806] 0 2024-09-17T07:20:01.634 INFO:tasks.workunit.client.0.smithi087.stdout:7/573: rename d0/d3/d86 to d0/d3/d23/d17/d7b/dad 0 2024-09-17T07:20:01.637 INFO:tasks.workunit.client.0.smithi087.stdout:4/802: dread d2/d92/d4d/d21/d2f/d3b/d7e/d97/fa6 [0,4194304] 0 2024-09-17T07:20:01.639 INFO:tasks.workunit.client.0.smithi087.stdout:5/943: unlink l3 0 2024-09-17T07:20:01.639 INFO:tasks.workunit.client.0.smithi087.stdout:2/718: creat d2/d7/d60/fe6 x:0 0 0 2024-09-17T07:20:01.641 INFO:tasks.workunit.client.0.smithi087.stdout:6/872: getdents d1/d6/d68 0 2024-09-17T07:20:01.642 INFO:tasks.workunit.client.0.smithi087.stdout:3/759: symlink d6/d1b/d42/d6e/l10c 0 2024-09-17T07:20:01.643 INFO:tasks.workunit.client.0.smithi087.stdout:8/720: rmdir d1/d7/d63/df2 0 2024-09-17T07:20:01.644 INFO:tasks.workunit.client.0.smithi087.stdout:8/721: readlink d1/d2b/d3b/lb8 0 2024-09-17T07:20:01.647 INFO:tasks.workunit.client.0.smithi087.stdout:3/760: mkdir d6/d10d 0 2024-09-17T07:20:01.649 INFO:tasks.workunit.client.0.smithi087.stdout:2/719: dread d2/f7c [0,4194304] 0 2024-09-17T07:20:01.651 INFO:tasks.workunit.client.0.smithi087.stdout:5/944: rename d5/d18/f78 to d5/d18/d6f/d11b/d1f/d4e/da3/d102/f12a 0 2024-09-17T07:20:01.655 INFO:tasks.workunit.client.0.smithi087.stdout:4/803: mknod d2/d92/d4d/d21/d2f/c118 0 2024-09-17T07:20:01.656 INFO:tasks.workunit.client.1.smithi139.stdout:3/596: truncate d5/d15/d56/f29 574991 0 2024-09-17T07:20:01.656 INFO:tasks.workunit.client.1.smithi139.stdout:3/597: fdatasync d5/d15/f18 0 2024-09-17T07:20:01.658 INFO:tasks.workunit.client.1.smithi139.stdout:3/598: mkdir d5/d15/d20/d3b/dc1 0 2024-09-17T07:20:01.662 INFO:tasks.workunit.client.1.smithi139.stdout:3/599: dwrite d5/d15/f18 [0,4194304] 0 2024-09-17T07:20:01.663 INFO:tasks.workunit.client.0.smithi087.stdout:5/945: fsync d5/d18/d6f/d11b/fc4 0 2024-09-17T07:20:01.663 INFO:tasks.workunit.client.0.smithi087.stdout:1/682: write d2/d14/f60 [1142063,71340] 0 2024-09-17T07:20:01.665 INFO:tasks.workunit.client.0.smithi087.stdout:4/804: dwrite d2/d92/d4d/d21/d2f/d3b/f56 [0,4194304] 0 2024-09-17T07:20:01.666 INFO:tasks.workunit.client.1.smithi139.stdout:3/600: rename d5/d15/d20/cc0 to d5/d63/d6d/da0/cc2 0 2024-09-17T07:20:01.668 INFO:tasks.workunit.client.0.smithi087.stdout:9/741: readlink d3/d4/d6/d8/d22/l79 0 2024-09-17T07:20:01.668 INFO:tasks.workunit.client.1.smithi139.stdout:3/601: creat d5/d15/d16/d25/d97/fc3 x:0 0 0 2024-09-17T07:20:01.669 INFO:tasks.workunit.client.0.smithi087.stdout:4/805: write d2/d5/d1f/da7/fe2 [262633,89385] 0 2024-09-17T07:20:01.672 INFO:tasks.workunit.client.1.smithi139.stdout:3/602: dread d5/f3c [0,4194304] 0 2024-09-17T07:20:01.675 INFO:tasks.workunit.client.0.smithi087.stdout:0/949: getdents db/d45/d9e/d95/dd8 0 2024-09-17T07:20:01.678 INFO:tasks.workunit.client.0.smithi087.stdout:1/683: creat d2/d3d/d35/d57/d73/fea x:0 0 0 2024-09-17T07:20:01.681 INFO:tasks.workunit.client.0.smithi087.stdout:7/574: getdents d0/d3/d23/d17 0 2024-09-17T07:20:01.684 INFO:tasks.workunit.client.0.smithi087.stdout:7/575: chown d0/d36/d8e/f92 39619470 1 2024-09-17T07:20:01.685 INFO:tasks.workunit.client.0.smithi087.stdout:4/806: mknod d2/d22/d2c/d96/c119 0 2024-09-17T07:20:01.687 INFO:tasks.workunit.client.0.smithi087.stdout:6/873: getdents d1/d67/dfe/d5e 0 2024-09-17T07:20:01.688 INFO:tasks.workunit.client.0.smithi087.stdout:8/722: dwrite d1/d2b/f46 [4194304,4194304] 0 2024-09-17T07:20:01.691 INFO:tasks.workunit.client.0.smithi087.stdout:1/684: creat d2/dcf/d7e/db9/feb x:0 0 0 2024-09-17T07:20:01.691 INFO:tasks.workunit.client.0.smithi087.stdout:5/946: mkdir d5/d18/d6f/de1/d7d/dee/d12b 0 2024-09-17T07:20:01.693 INFO:tasks.workunit.client.0.smithi087.stdout:9/742: rename d3/d4/d6/d8/d22/d2a/faa to d3/d4/dcd/f103 0 2024-09-17T07:20:01.695 INFO:tasks.workunit.client.0.smithi087.stdout:4/807: creat d2/d22/d2c/d91/d113/f11a x:0 0 0 2024-09-17T07:20:01.698 INFO:tasks.workunit.client.0.smithi087.stdout:3/761: creat d6/d1b/df6/f10e x:0 0 0 2024-09-17T07:20:01.699 INFO:tasks.workunit.client.1.smithi139.stdout:7/522: sync 2024-09-17T07:20:01.700 INFO:tasks.workunit.client.1.smithi139.stdout:4/541: sync 2024-09-17T07:20:01.700 INFO:tasks.workunit.client.1.smithi139.stdout:9/909: sync 2024-09-17T07:20:01.700 INFO:tasks.workunit.client.1.smithi139.stdout:2/674: sync 2024-09-17T07:20:01.700 INFO:tasks.workunit.client.1.smithi139.stdout:8/802: sync 2024-09-17T07:20:01.700 INFO:tasks.workunit.client.1.smithi139.stdout:6/704: sync 2024-09-17T07:20:01.700 INFO:tasks.workunit.client.1.smithi139.stdout:5/755: sync 2024-09-17T07:20:01.700 INFO:tasks.workunit.client.1.smithi139.stdout:1/471: sync 2024-09-17T07:20:01.701 INFO:tasks.workunit.client.0.smithi087.stdout:1/685: creat d2/d3d/d45/d90/d43/d5d/fec x:0 0 0 2024-09-17T07:20:01.702 INFO:tasks.workunit.client.1.smithi139.stdout:1/472: stat d2/d10/d12/d1a/l7e 0 2024-09-17T07:20:01.703 INFO:tasks.workunit.client.1.smithi139.stdout:8/803: write d0/d20/f8f [1593206,47438] 0 2024-09-17T07:20:01.703 INFO:tasks.workunit.client.0.smithi087.stdout:5/947: chown d5/d18/d20/d2f/d60/de3/lc3 45 1 2024-09-17T07:20:01.703 INFO:tasks.workunit.client.0.smithi087.stdout:1/686: chown d2/d69/d8d/le0 14 1 2024-09-17T07:20:01.704 INFO:tasks.workunit.client.1.smithi139.stdout:3/603: dwrite d5/fe [0,4194304] 0 2024-09-17T07:20:01.704 INFO:tasks.workunit.client.1.smithi139.stdout:6/705: rmdir db/d18/d38 39 2024-09-17T07:20:01.708 INFO:tasks.workunit.client.1.smithi139.stdout:7/523: symlink d5/d17/d4e/d63/la8 0 2024-09-17T07:20:01.708 INFO:tasks.workunit.client.0.smithi087.stdout:7/576: getdents d0/d3/d10/d32/d8c 0 2024-09-17T07:20:01.710 INFO:tasks.workunit.client.0.smithi087.stdout:4/808: creat d2/d92/d4d/d21/d2f/d6e/f11b x:0 0 0 2024-09-17T07:20:01.710 INFO:tasks.workunit.client.1.smithi139.stdout:3/604: fsync d5/d21/d23/d38/f40 0 2024-09-17T07:20:01.710 INFO:tasks.workunit.client.1.smithi139.stdout:1/473: mkdir d2/d10/d71/d94 0 2024-09-17T07:20:01.713 INFO:tasks.workunit.client.0.smithi087.stdout:5/948: dwrite d5/d12/fd1 [4194304,4194304] 0 2024-09-17T07:20:01.714 INFO:tasks.workunit.client.1.smithi139.stdout:4/542: write d0/db/f1c [412306,85243] 0 2024-09-17T07:20:01.715 INFO:tasks.workunit.client.0.smithi087.stdout:6/874: fsync d1/d67/dfe/f36 0 2024-09-17T07:20:01.715 INFO:tasks.workunit.client.0.smithi087.stdout:5/949: truncate d5/d6d/fbd 722608 0 2024-09-17T07:20:01.716 INFO:tasks.workunit.client.1.smithi139.stdout:2/675: dwrite d0/de/d25/d3f/fbb [0,4194304] 0 2024-09-17T07:20:01.716 INFO:tasks.workunit.client.1.smithi139.stdout:3/605: readlink d5/d15/d16/d4c/d28/db5/laa 0 2024-09-17T07:20:01.717 INFO:tasks.workunit.client.0.smithi087.stdout:0/950: creat db/d45/d5b/f14a x:0 0 0 2024-09-17T07:20:01.717 INFO:tasks.workunit.client.0.smithi087.stdout:0/951: readlink db/d45/d9e/d86/dd5/l134 0 2024-09-17T07:20:01.721 INFO:tasks.workunit.client.1.smithi139.stdout:8/804: creat d0/d20/d28/d52/f103 x:0 0 0 2024-09-17T07:20:01.721 INFO:tasks.workunit.client.1.smithi139.stdout:9/910: link dc/d11/d15/d1e/f2e dc/d11/d15/d1e/d34/d10f/f130 0 2024-09-17T07:20:01.721 INFO:tasks.workunit.client.1.smithi139.stdout:8/805: chown d0/d1a/d4d/da4/fae 729 1 2024-09-17T07:20:01.722 INFO:tasks.workunit.client.0.smithi087.stdout:0/952: readlink db/l2b 0 2024-09-17T07:20:01.722 INFO:tasks.workunit.client.0.smithi087.stdout:5/950: write d5/d18/d6f/de1/f120 [946250,33201] 0 2024-09-17T07:20:01.722 INFO:tasks.workunit.client.0.smithi087.stdout:1/687: fsync d2/d48/d61/f85 0 2024-09-17T07:20:01.722 INFO:tasks.workunit.client.1.smithi139.stdout:3/606: symlink d5/d15/d16/d4c/d28/d54/d8e/lc4 0 2024-09-17T07:20:01.722 INFO:tasks.workunit.client.1.smithi139.stdout:6/706: link db/df/d4e/d5e/d8a/le7 db/db7/ddb/lef 0 2024-09-17T07:20:01.724 INFO:tasks.workunit.client.0.smithi087.stdout:3/762: chown d6/d1b/d42/d62/dc1/de8/c6b 3 1 2024-09-17T07:20:01.724 INFO:tasks.workunit.client.0.smithi087.stdout:5/951: fdatasync d5/d18/d6f/d11b/d1f/d4e/d10d/f121 0 2024-09-17T07:20:01.726 INFO:tasks.workunit.client.1.smithi139.stdout:9/911: write dc/d11/d15/d3c/fbb [1746249,111154] 0 2024-09-17T07:20:01.726 INFO:tasks.workunit.client.1.smithi139.stdout:7/524: getdents d5/d17/d4e/d55 0 2024-09-17T07:20:01.727 INFO:tasks.workunit.client.0.smithi087.stdout:0/953: mknod db/d45/d9e/d86/dd5/deb/c14b 0 2024-09-17T07:20:01.728 INFO:tasks.workunit.client.1.smithi139.stdout:6/707: mknod db/d21/d96/dcf/cf0 0 2024-09-17T07:20:01.729 INFO:tasks.workunit.client.0.smithi087.stdout:1/688: stat d2/d3d/db4/dc3 0 2024-09-17T07:20:01.729 INFO:tasks.workunit.client.0.smithi087.stdout:8/723: link d1/d7/d9/d19/cc0 d1/d2b/d21/dd4/cfa 0 2024-09-17T07:20:01.729 INFO:tasks.workunit.client.1.smithi139.stdout:7/525: write d5/f23 [1586749,121918] 0 2024-09-17T07:20:01.730 INFO:tasks.workunit.client.0.smithi087.stdout:3/763: readlink d6/lf 0 2024-09-17T07:20:01.732 INFO:tasks.workunit.client.1.smithi139.stdout:1/474: link d2/d10/d12/d13/d4f/d5c/f5f d2/d10/d12/d13/d4f/f95 0 2024-09-17T07:20:01.732 INFO:tasks.workunit.client.1.smithi139.stdout:3/607: dread d5/fe [0,4194304] 0 2024-09-17T07:20:01.733 INFO:tasks.workunit.client.0.smithi087.stdout:7/577: rename d0/d3/d10/c5f to d0/d3/d10/cae 0 2024-09-17T07:20:01.734 INFO:tasks.workunit.client.0.smithi087.stdout:8/724: read d1/d7/d63/dd9/dcf/fe9 [1434548,44290] 0 2024-09-17T07:20:01.734 INFO:tasks.workunit.client.1.smithi139.stdout:6/708: creat db/d21/d96/ff1 x:0 0 0 2024-09-17T07:20:01.735 INFO:tasks.workunit.client.0.smithi087.stdout:7/578: truncate d0/d3/f9f 706215 0 2024-09-17T07:20:01.735 INFO:tasks.workunit.client.0.smithi087.stdout:4/809: rename d2/d5/d1f/f34 to d2/d92/d4d/f11c 0 2024-09-17T07:20:01.736 INFO:tasks.workunit.client.1.smithi139.stdout:2/676: dwrite d0/d7/fd [0,4194304] 0 2024-09-17T07:20:01.736 INFO:tasks.workunit.client.0.smithi087.stdout:1/689: rmdir d2/d3d/d35/d57/d73 39 2024-09-17T07:20:01.737 INFO:tasks.workunit.client.1.smithi139.stdout:1/475: write d2/d10/d12/d35/d2b/f6e [4731895,123437] 0 2024-09-17T07:20:01.739 INFO:tasks.workunit.client.1.smithi139.stdout:6/709: truncate db/df/d4e/d5e/fa8 840608 0 2024-09-17T07:20:01.739 INFO:tasks.workunit.client.0.smithi087.stdout:5/952: unlink d5/d18/d20/d2f/l4b 0 2024-09-17T07:20:01.743 INFO:tasks.workunit.client.1.smithi139.stdout:2/677: truncate d0/d7/d86/da4/d12/d8c/f93 3383034 0 2024-09-17T07:20:01.744 INFO:tasks.workunit.client.0.smithi087.stdout:0/954: symlink db/d45/l14c 0 2024-09-17T07:20:01.746 INFO:tasks.workunit.client.0.smithi087.stdout:7/579: dwrite d0/d3/d23/d17/f41 [0,4194304] 0 2024-09-17T07:20:01.747 INFO:tasks.workunit.client.1.smithi139.stdout:4/543: write d0/d37/f42 [280268,6868] 0 2024-09-17T07:20:01.747 INFO:tasks.workunit.client.0.smithi087.stdout:3/764: dread d6/d1b/d42/dd4/dd1/de4/ff7 [0,4194304] 0 2024-09-17T07:20:01.747 INFO:tasks.workunit.client.0.smithi087.stdout:8/725: creat d1/d2b/d21/ffb x:0 0 0 2024-09-17T07:20:01.749 INFO:tasks.workunit.client.0.smithi087.stdout:1/690: dread d2/d3d/d35/d57/f89 [0,4194304] 0 2024-09-17T07:20:01.750 INFO:tasks.workunit.client.1.smithi139.stdout:2/678: truncate d0/d7/d86/da4/d28/fc0 1337327 0 2024-09-17T07:20:01.750 INFO:tasks.workunit.client.1.smithi139.stdout:1/476: dwrite d2/d10/d71/f8f [0,4194304] 0 2024-09-17T07:20:01.752 INFO:tasks.workunit.client.0.smithi087.stdout:5/953: mknod d5/d18/d6f/d11b/d1f/d4e/c12c 0 2024-09-17T07:20:01.752 INFO:tasks.workunit.client.0.smithi087.stdout:0/955: fsync db/d45/d5b/fec 0 2024-09-17T07:20:01.755 INFO:tasks.workunit.client.0.smithi087.stdout:5/954: fsync d5/d18/d6f/d11b/d1f/f95 0 2024-09-17T07:20:01.756 INFO:tasks.workunit.client.1.smithi139.stdout:4/544: mkdir d0/d1/d29/dae 0 2024-09-17T07:20:01.758 INFO:tasks.workunit.client.0.smithi087.stdout:6/875: rename d1/d67/dfe/d2c/d58/d90/da9 to d1/d67/dfe/d2c/d129 0 2024-09-17T07:20:01.759 INFO:tasks.workunit.client.1.smithi139.stdout:2/679: chown d0/d7/d1a/fcc 324939037 1 2024-09-17T07:20:01.759 INFO:tasks.workunit.client.1.smithi139.stdout:9/912: dread dc/d11/d15/d3c/d61/f110 [0,4194304] 0 2024-09-17T07:20:01.761 INFO:tasks.workunit.client.0.smithi087.stdout:6/876: chown d1/d67/db7/le3 30027 1 2024-09-17T07:20:01.761 INFO:tasks.workunit.client.1.smithi139.stdout:7/526: dwrite d5/d17/d4e/d55/f6f [0,4194304] 0 2024-09-17T07:20:01.763 INFO:tasks.workunit.client.1.smithi139.stdout:9/913: chown dc/d11/d8b/f116 187306769 1 2024-09-17T07:20:01.763 INFO:tasks.workunit.client.0.smithi087.stdout:7/580: fdatasync d0/d3/d23/d17/f3a 0 2024-09-17T07:20:01.764 INFO:tasks.workunit.client.0.smithi087.stdout:5/955: unlink d5/fa9 0 2024-09-17T07:20:01.764 INFO:tasks.workunit.client.0.smithi087.stdout:8/726: link d1/d2b/d21/f35 d1/d2b/d21/d6d/ffc 0 2024-09-17T07:20:01.765 INFO:tasks.workunit.client.0.smithi087.stdout:4/810: rename d2/d92/d4d/d21/l89 to d2/d22/d10e/l11d 0 2024-09-17T07:20:01.766 INFO:tasks.workunit.client.0.smithi087.stdout:4/811: dread - d2/d5/f100 zero size 2024-09-17T07:20:01.766 INFO:tasks.workunit.client.1.smithi139.stdout:3/608: dwrite d5/d21/d23/f57 [4194304,4194304] 0 2024-09-17T07:20:01.766 INFO:tasks.workunit.client.0.smithi087.stdout:6/877: creat d1/d6a/d122/f12a x:0 0 0 2024-09-17T07:20:01.768 INFO:tasks.workunit.client.0.smithi087.stdout:6/878: fdatasync d1/d67/dfe/d2c/d40/d4c/ff8 0 2024-09-17T07:20:01.769 INFO:tasks.workunit.client.0.smithi087.stdout:7/581: chown d0/d3/f4 515700408 1 2024-09-17T07:20:01.770 INFO:tasks.workunit.client.0.smithi087.stdout:8/727: mkdir d1/d2b/d3b/d53/dfd 0 2024-09-17T07:20:01.771 INFO:tasks.workunit.client.0.smithi087.stdout:5/956: symlink d5/d12/d1c/l12d 0 2024-09-17T07:20:01.773 INFO:tasks.workunit.client.0.smithi087.stdout:3/765: rename d6/d15/d37/f75 to d6/d1b/d42/d62/dbb/f10f 0 2024-09-17T07:20:01.776 INFO:tasks.workunit.client.0.smithi087.stdout:4/812: mkdir d2/d5/d1f/da7/d11e 0 2024-09-17T07:20:01.780 INFO:tasks.workunit.client.0.smithi087.stdout:8/728: read - d1/d7/d9/d19/d73/f9e zero size 2024-09-17T07:20:01.781 INFO:tasks.workunit.client.0.smithi087.stdout:3/766: readlink d6/l86 0 2024-09-17T07:20:01.782 INFO:tasks.workunit.client.0.smithi087.stdout:7/582: dread d0/fd [0,4194304] 0 2024-09-17T07:20:01.783 INFO:tasks.workunit.client.0.smithi087.stdout:6/879: creat d1/d67/dfe/d2c/d58/f12b x:0 0 0 2024-09-17T07:20:01.785 INFO:tasks.workunit.client.0.smithi087.stdout:7/583: unlink d0/d36/l7c 0 2024-09-17T07:20:01.787 INFO:tasks.workunit.client.0.smithi087.stdout:8/729: rename d1/d2b/d21/dd4/ff9 to d1/d7/d9/d19/d4d/ffe 0 2024-09-17T07:20:01.788 INFO:tasks.workunit.client.0.smithi087.stdout:1/691: dread d2/d3d/d45/d90/ff [4194304,4194304] 0 2024-09-17T07:20:01.789 INFO:tasks.workunit.client.0.smithi087.stdout:8/730: mknod d1/d5f/cff 0 2024-09-17T07:20:01.790 INFO:tasks.workunit.client.0.smithi087.stdout:7/584: mkdir d0/d3/d23/d17/d7b/dad/daf 0 2024-09-17T07:20:01.791 INFO:tasks.workunit.client.0.smithi087.stdout:8/731: chown d1/d7/d9/d27/f69 656402 1 2024-09-17T07:20:01.791 INFO:tasks.workunit.client.0.smithi087.stdout:3/767: truncate d6/d1b/d42/dd4/ddc/ffe 677041 0 2024-09-17T07:20:01.794 INFO:tasks.workunit.client.0.smithi087.stdout:3/768: write d6/d15/d37/d3c/d43/db7/fdb [409906,79462] 0 2024-09-17T07:20:01.796 INFO:tasks.workunit.client.0.smithi087.stdout:3/769: chown d6/d15/d37/d3c/l9c 18322 1 2024-09-17T07:20:01.796 INFO:tasks.workunit.client.0.smithi087.stdout:1/692: creat d2/d3d/db4/fed x:0 0 0 2024-09-17T07:20:01.798 INFO:tasks.workunit.client.0.smithi087.stdout:3/770: chown d6/d15/d92/fff 281776 1 2024-09-17T07:20:01.798 INFO:tasks.workunit.client.0.smithi087.stdout:0/956: dread db/f39 [0,4194304] 0 2024-09-17T07:20:01.800 INFO:tasks.workunit.client.0.smithi087.stdout:8/732: truncate d1/d7/d9/d19/fb6 1652940 0 2024-09-17T07:20:01.803 INFO:tasks.workunit.client.0.smithi087.stdout:8/733: rmdir d1/d2b/d3b/d53 39 2024-09-17T07:20:01.805 INFO:tasks.workunit.client.0.smithi087.stdout:4/813: dread d2/d5/f26 [0,4194304] 0 2024-09-17T07:20:01.806 INFO:tasks.workunit.client.0.smithi087.stdout:3/771: truncate d6/d15/f19 824429 0 2024-09-17T07:20:01.809 INFO:tasks.workunit.client.0.smithi087.stdout:1/693: dwrite d2/d48/d61/f76 [0,4194304] 0 2024-09-17T07:20:01.810 INFO:tasks.workunit.client.0.smithi087.stdout:1/694: readlink d2/d3d/d45/ld2 0 2024-09-17T07:20:01.811 INFO:tasks.workunit.client.0.smithi087.stdout:8/734: unlink d1/d5f/f5d 0 2024-09-17T07:20:01.811 INFO:tasks.workunit.client.0.smithi087.stdout:0/957: dwrite db/d45/d5b/d92/de8/d11d/f131 [0,4194304] 0 2024-09-17T07:20:01.812 INFO:tasks.workunit.client.1.smithi139.stdout:0/460: sync 2024-09-17T07:20:01.816 INFO:tasks.workunit.client.0.smithi087.stdout:8/735: write d1/d2b/d21/d6d/d6f/f90 [4474168,56570] 0 2024-09-17T07:20:01.818 INFO:tasks.workunit.client.0.smithi087.stdout:6/880: write d1/f1d [3940930,2433] 0 2024-09-17T07:20:01.818 INFO:tasks.workunit.client.0.smithi087.stdout:3/772: mknod d6/d1b/d42/d62/c110 0 2024-09-17T07:20:01.824 INFO:tasks.workunit.client.0.smithi087.stdout:7/585: write d0/d3/d10/d32/d62/d76/f84 [61863,68269] 0 2024-09-17T07:20:01.825 INFO:tasks.workunit.client.0.smithi087.stdout:3/773: creat d6/d1b/d42/dd4/dd1/f111 x:0 0 0 2024-09-17T07:20:01.829 INFO:tasks.workunit.client.0.smithi087.stdout:6/881: dread d1/d67/dfe/d2c/d33/f3d [4194304,4194304] 0 2024-09-17T07:20:01.831 INFO:tasks.workunit.client.0.smithi087.stdout:3/774: creat d6/d15/d37/d3c/d43/f112 x:0 0 0 2024-09-17T07:20:01.832 INFO:tasks.workunit.client.0.smithi087.stdout:7/586: dread d0/d3/d23/d17/f41 [0,4194304] 0 2024-09-17T07:20:01.833 INFO:tasks.workunit.client.1.smithi139.stdout:1/477: creat d2/d10/d12/d1a/f96 x:0 0 0 2024-09-17T07:20:01.836 INFO:tasks.workunit.client.0.smithi087.stdout:7/587: chown d0/d3/d10/d32/l93 63 1 2024-09-17T07:20:01.840 INFO:tasks.workunit.client.0.smithi087.stdout:8/736: write d1/d7/d9/d19/d1b/f43 [1093469,21867] 0 2024-09-17T07:20:01.843 INFO:tasks.workunit.client.0.smithi087.stdout:1/695: dwrite d2/d3d/d45/d90/d37/f87 [0,4194304] 0 2024-09-17T07:20:01.844 INFO:tasks.workunit.client.1.smithi139.stdout:2/680: creat d0/d7/d86/da4/d12/dcd/fe8 x:0 0 0 2024-09-17T07:20:01.844 INFO:tasks.workunit.client.1.smithi139.stdout:9/914: truncate dc/d11/d15/d3c/f7e 197315 0 2024-09-17T07:20:01.845 INFO:tasks.workunit.client.1.smithi139.stdout:2/681: fdatasync d0/d7/d67/da1/da7/fbd 0 2024-09-17T07:20:01.847 INFO:tasks.workunit.client.1.smithi139.stdout:2/682: write d0/d7/d86/da4/d28/f37 [1269995,103153] 0 2024-09-17T07:20:01.848 INFO:tasks.workunit.client.1.smithi139.stdout:1/478: creat d2/d10/d12/d35/d2b/f97 x:0 0 0 2024-09-17T07:20:01.848 INFO:tasks.workunit.client.1.smithi139.stdout:2/683: chown d0/d7/d67/da1/da7 16459997 1 2024-09-17T07:20:01.849 INFO:tasks.workunit.client.1.smithi139.stdout:4/545: getdents d0/db/d58 0 2024-09-17T07:20:01.850 INFO:tasks.workunit.client.0.smithi087.stdout:6/882: truncate d1/d67/dfe/d2c/d129/db6/fba 1274260 0 2024-09-17T07:20:01.850 INFO:tasks.workunit.client.1.smithi139.stdout:4/546: dread - d0/db/d7f/f8c zero size 2024-09-17T07:20:01.851 INFO:tasks.workunit.client.0.smithi087.stdout:1/696: mknod d2/dcf/d7e/cee 0 2024-09-17T07:20:01.852 INFO:tasks.workunit.client.1.smithi139.stdout:9/915: creat dc/d11/d52/d56/d75/f131 x:0 0 0 2024-09-17T07:20:01.852 INFO:tasks.workunit.client.0.smithi087.stdout:7/588: mknod d0/d3/d10/d32/d8c/cb0 0 2024-09-17T07:20:01.852 INFO:tasks.workunit.client.1.smithi139.stdout:9/916: readlink dc/lb0 0 2024-09-17T07:20:01.853 INFO:tasks.workunit.client.0.smithi087.stdout:0/958: dread db/d45/d7b/d7e/f8b [0,4194304] 0 2024-09-17T07:20:01.854 INFO:tasks.workunit.client.1.smithi139.stdout:9/917: write dc/d11/d15/d3c/fbb [2642406,77244] 0 2024-09-17T07:20:01.854 INFO:tasks.workunit.client.0.smithi087.stdout:4/814: dread d2/f7 [0,4194304] 0 2024-09-17T07:20:01.854 INFO:tasks.workunit.client.0.smithi087.stdout:3/775: dwrite d6/d15/d37/d3c/d52/db2/fe6 [0,4194304] 0 2024-09-17T07:20:01.856 INFO:tasks.workunit.client.1.smithi139.stdout:2/684: creat d0/dc/d15/d9f/dc1/fe9 x:0 0 0 2024-09-17T07:20:01.859 INFO:tasks.workunit.client.1.smithi139.stdout:4/547: fdatasync d0/d1/d29/d6d/f86 0 2024-09-17T07:20:01.860 INFO:tasks.workunit.client.1.smithi139.stdout:0/461: link d1/d58/d7d/c94 d1/da/d1b/d32/d9a/cb0 0 2024-09-17T07:20:01.861 INFO:tasks.workunit.client.1.smithi139.stdout:7/527: link d5/d10/l80 d5/d10/d2b/d78/la9 0 2024-09-17T07:20:01.862 INFO:tasks.workunit.client.1.smithi139.stdout:1/479: getdents d2/d10/d71/d94 0 2024-09-17T07:20:01.863 INFO:tasks.workunit.client.1.smithi139.stdout:9/918: readlink dc/d11/d52/d56/d7a/da1/le3 0 2024-09-17T07:20:01.863 INFO:tasks.workunit.client.1.smithi139.stdout:3/609: dwrite d5/d15/d20/f42 [0,4194304] 0 2024-09-17T07:20:01.865 INFO:tasks.workunit.client.1.smithi139.stdout:3/610: chown d5/d21/d23/f49 104 1 2024-09-17T07:20:01.873 INFO:tasks.workunit.client.1.smithi139.stdout:3/611: dread d5/d15/f7a [0,4194304] 0 2024-09-17T07:20:01.874 INFO:tasks.workunit.client.1.smithi139.stdout:0/462: dwrite d1/da/f60 [0,4194304] 0 2024-09-17T07:20:01.874 INFO:tasks.workunit.client.1.smithi139.stdout:3/612: dread - d5/d15/d56/f70 zero size 2024-09-17T07:20:01.881 INFO:tasks.workunit.client.0.smithi087.stdout:6/883: getdents d1/d67/dfe/d2c/d48 0 2024-09-17T07:20:01.882 INFO:tasks.workunit.client.0.smithi087.stdout:7/589: dread - d0/d3/d10/d31/f9a zero size 2024-09-17T07:20:01.882 INFO:tasks.workunit.client.1.smithi139.stdout:2/685: read d0/d7/d86/da4/d28/f2d [265572,68054] 0 2024-09-17T07:20:01.884 INFO:tasks.workunit.client.1.smithi139.stdout:9/919: unlink dc/d11/d52/d56/cb3 0 2024-09-17T07:20:01.887 INFO:tasks.workunit.client.0.smithi087.stdout:1/697: symlink d2/d69/d8d/da6/dd6/lef 0 2024-09-17T07:20:01.890 INFO:tasks.workunit.client.1.smithi139.stdout:2/686: dwrite d0/de/d69/f6a [0,4194304] 0 2024-09-17T07:20:01.891 INFO:tasks.workunit.client.0.smithi087.stdout:3/776: creat d6/d7d/f113 x:0 0 0 2024-09-17T07:20:01.894 INFO:tasks.workunit.client.0.smithi087.stdout:1/698: dread d2/dc/f3a [0,4194304] 0 2024-09-17T07:20:01.896 INFO:tasks.workunit.client.0.smithi087.stdout:1/699: write d2/dcf/f2b [7218775,124736] 0 2024-09-17T07:20:01.897 INFO:tasks.workunit.client.0.smithi087.stdout:3/777: truncate d6/d1b/d42/d62/f87 4508130 0 2024-09-17T07:20:01.903 INFO:tasks.workunit.client.1.smithi139.stdout:7/528: symlink d5/d17/d4e/d90/laa 0 2024-09-17T07:20:01.905 INFO:tasks.workunit.client.0.smithi087.stdout:3/778: mkdir d6/d15/d37/d3c/d43/d114 0 2024-09-17T07:20:01.906 INFO:tasks.workunit.client.1.smithi139.stdout:3/613: symlink d5/d15/d16/d25/d97/lc5 0 2024-09-17T07:20:01.907 INFO:tasks.workunit.client.0.smithi087.stdout:8/737: dread d1/d2b/f46 [0,4194304] 0 2024-09-17T07:20:01.907 INFO:tasks.workunit.client.0.smithi087.stdout:1/700: unlink d2/d3d/d45/d90/d43/d5d/f84 0 2024-09-17T07:20:01.907 INFO:tasks.workunit.client.0.smithi087.stdout:0/959: link db/d45/d5b/l65 db/dbe/d124/l14d 0 2024-09-17T07:20:01.909 INFO:tasks.workunit.client.0.smithi087.stdout:3/779: read - d6/d1b/d42/d62/dbb/ffb zero size 2024-09-17T07:20:01.909 INFO:tasks.workunit.client.0.smithi087.stdout:1/701: fdatasync d2/dcf/f9c 0 2024-09-17T07:20:01.909 INFO:tasks.workunit.client.1.smithi139.stdout:7/529: readlink d5/d17/d4e/l5c 0 2024-09-17T07:20:01.911 INFO:tasks.workunit.client.1.smithi139.stdout:3/614: symlink d5/d15/lc6 0 2024-09-17T07:20:01.913 INFO:tasks.workunit.client.0.smithi087.stdout:3/780: write d6/d7d/fa5 [138958,127949] 0 2024-09-17T07:20:01.913 INFO:tasks.workunit.client.1.smithi139.stdout:3/615: stat d5/d15/d16/d25/d97/fa4 0 2024-09-17T07:20:01.913 INFO:tasks.workunit.client.1.smithi139.stdout:2/687: link d0/d7/fdb d0/d7/d67/da1/fea 0 2024-09-17T07:20:01.914 INFO:tasks.workunit.client.1.smithi139.stdout:3/616: chown d5/d15/d16/d4c/d28/db5 2 1 2024-09-17T07:20:01.915 INFO:tasks.workunit.client.0.smithi087.stdout:0/960: read db/d45/d5b/f5e [3834669,55758] 0 2024-09-17T07:20:01.916 INFO:tasks.workunit.client.0.smithi087.stdout:1/702: symlink d2/dcf/d7e/db9/lf0 0 2024-09-17T07:20:01.917 INFO:tasks.workunit.client.0.smithi087.stdout:4/815: dread d2/d92/d86/fbe [0,4194304] 0 2024-09-17T07:20:01.917 INFO:tasks.workunit.client.1.smithi139.stdout:7/530: fsync d5/d17/d4e/f69 0 2024-09-17T07:20:01.919 INFO:tasks.workunit.client.1.smithi139.stdout:1/480: getdents d2/d10/d12/d35/d49/d8d 0 2024-09-17T07:20:01.921 INFO:tasks.workunit.client.1.smithi139.stdout:2/688: dwrite d0/dc/d15/d9f/dc1/fe9 [0,4194304] 0 2024-09-17T07:20:01.921 INFO:tasks.workunit.client.0.smithi087.stdout:0/961: unlink db/l2b 0 2024-09-17T07:20:01.923 INFO:tasks.workunit.client.0.smithi087.stdout:4/816: write d2/d22/d62/ff6 [4978968,12514] 0 2024-09-17T07:20:01.924 INFO:tasks.workunit.client.1.smithi139.stdout:7/531: creat d5/d96/fab x:0 0 0 2024-09-17T07:20:01.927 INFO:tasks.workunit.client.0.smithi087.stdout:4/817: dread - d2/d5/d1f/fe1 zero size 2024-09-17T07:20:01.927 INFO:tasks.workunit.client.1.smithi139.stdout:8/806: sync 2024-09-17T07:20:01.927 INFO:tasks.workunit.client.1.smithi139.stdout:5/756: sync 2024-09-17T07:20:01.927 INFO:tasks.workunit.client.1.smithi139.stdout:1/481: chown d2/d10/d12/d1a/c5d 3192 1 2024-09-17T07:20:01.929 INFO:tasks.workunit.client.1.smithi139.stdout:8/807: dread - d0/fff zero size 2024-09-17T07:20:01.929 INFO:tasks.workunit.client.0.smithi087.stdout:1/703: rename d2/dcf/f2b to d2/d48/d6f/ff1 0 2024-09-17T07:20:01.932 INFO:tasks.workunit.client.0.smithi087.stdout:6/884: dwrite d1/d67/dfe/d2c/d48/d9b/fcd [0,4194304] 0 2024-09-17T07:20:01.933 INFO:tasks.workunit.client.1.smithi139.stdout:4/548: dwrite d0/d1a/f1f [0,4194304] 0 2024-09-17T07:20:01.935 INFO:tasks.workunit.client.1.smithi139.stdout:4/549: chown d0/d1/d29/d6d/faa 449981 1 2024-09-17T07:20:01.938 INFO:tasks.workunit.client.0.smithi087.stdout:3/781: rename d6/d1b/d42/d62/dbb/ffb to d6/d15/d37/d3c/d52/db2/d102/f115 0 2024-09-17T07:20:01.940 INFO:tasks.workunit.client.0.smithi087.stdout:7/590: dwrite d0/f28 [0,4194304] 0 2024-09-17T07:20:01.940 INFO:tasks.workunit.client.1.smithi139.stdout:1/482: dwrite d2/d10/d12/d35/d2b/f97 [0,4194304] 0 2024-09-17T07:20:01.942 INFO:tasks.workunit.client.1.smithi139.stdout:3/617: getdents d5/d15/d16/d25 0 2024-09-17T07:20:01.942 INFO:tasks.workunit.client.1.smithi139.stdout:1/483: chown d2/d10/d12/d24/d38/d3d 495651 1 2024-09-17T07:20:01.944 INFO:tasks.workunit.client.0.smithi087.stdout:8/738: dwrite d1/d7/d9/d19/d73/f8c [0,4194304] 0 2024-09-17T07:20:01.946 INFO:tasks.workunit.client.1.smithi139.stdout:1/484: read d2/d10/d12/f76 [4429233,8839] 0 2024-09-17T07:20:01.947 INFO:tasks.workunit.client.1.smithi139.stdout:4/550: stat d0/d1/d29/f2b 0 2024-09-17T07:20:01.947 INFO:tasks.workunit.client.1.smithi139.stdout:5/757: unlink d4/d16/d1b/d20/d28/d3f/dcc/fd2 0 2024-09-17T07:20:01.954 INFO:tasks.workunit.client.0.smithi087.stdout:4/818: symlink d2/d92/d4d/d21/d2f/d3b/d7e/l11f 0 2024-09-17T07:20:01.958 INFO:tasks.workunit.client.1.smithi139.stdout:5/758: symlink d4/d5d/d97/lf7 0 2024-09-17T07:20:01.964 INFO:tasks.workunit.client.0.smithi087.stdout:4/819: dwrite d2/d92/f6f [0,4194304] 0 2024-09-17T07:20:01.965 INFO:tasks.workunit.client.1.smithi139.stdout:5/759: mknod d4/d16/d1b/d20/d67/cf8 0 2024-09-17T07:20:01.965 INFO:tasks.workunit.client.1.smithi139.stdout:5/760: chown d4/da5/fe2 498465 1 2024-09-17T07:20:01.967 INFO:tasks.workunit.client.0.smithi087.stdout:4/820: write d2/d92/d4d/f3d [3615910,55862] 0 2024-09-17T07:20:01.970 INFO:tasks.workunit.client.1.smithi139.stdout:1/485: link d2/d10/d12/d35/d2b/c33 d2/d10/d12/d35/d2b/d4a/d6f/c98 0 2024-09-17T07:20:01.970 INFO:tasks.workunit.client.0.smithi087.stdout:1/704: dread d2/d3d/d45/d90/f18 [0,4194304] 0 2024-09-17T07:20:01.972 INFO:tasks.workunit.client.1.smithi139.stdout:1/486: chown d2/d10/d12/d1a/f96 1123311 1 2024-09-17T07:20:01.981 INFO:tasks.workunit.client.1.smithi139.stdout:2/689: dread d0/dc/d15/f23 [0,4194304] 0 2024-09-17T07:20:01.986 INFO:tasks.workunit.client.1.smithi139.stdout:2/690: symlink d0/de/d25/leb 0 2024-09-17T07:20:01.988 INFO:tasks.workunit.client.1.smithi139.stdout:4/551: dread d0/f47 [0,4194304] 0 2024-09-17T07:20:01.989 INFO:tasks.workunit.client.1.smithi139.stdout:9/920: link dc/d11/d52/d56/d7a/da1/le3 dc/d11/d52/d56/d7a/df7/d122/d83/d98/l132 0 2024-09-17T07:20:01.989 INFO:tasks.workunit.client.0.smithi087.stdout:6/885: mknod d1/d67/dfe/d2c/d48/d118/c12c 0 2024-09-17T07:20:01.991 INFO:tasks.workunit.client.1.smithi139.stdout:4/552: mkdir d0/db/d17/daf 0 2024-09-17T07:20:01.992 INFO:tasks.workunit.client.1.smithi139.stdout:3/618: rmdir d5/d15/d16/d4c/d28/d54/d58 39 2024-09-17T07:20:01.994 INFO:tasks.workunit.client.1.smithi139.stdout:3/619: write d5/d15/d16/d4c/d28/d54/fbc [27767,45032] 0 2024-09-17T07:20:01.995 INFO:tasks.workunit.client.0.smithi087.stdout:1/705: creat d2/dc/ff2 x:0 0 0 2024-09-17T07:20:01.995 INFO:tasks.workunit.client.1.smithi139.stdout:4/553: stat d0/d1/d9b/la0 0 2024-09-17T07:20:01.996 INFO:tasks.workunit.client.1.smithi139.stdout:4/554: fsync d0/d49/f8b 0 2024-09-17T07:20:01.996 INFO:tasks.workunit.client.0.smithi087.stdout:1/706: chown d2/d3d/d45/d90/d37/ldd 366500259 1 2024-09-17T07:20:01.997 INFO:tasks.workunit.client.1.smithi139.stdout:3/620: creat d5/d15/d56/fc7 x:0 0 0 2024-09-17T07:20:01.997 INFO:tasks.workunit.client.1.smithi139.stdout:4/555: write d0/d1a/fab [544340,28563] 0 2024-09-17T07:20:01.998 INFO:tasks.workunit.client.0.smithi087.stdout:3/782: truncate d6/d15/d37/d3c/d52/db2/de7/f4a 2174258 0 2024-09-17T07:20:01.999 INFO:tasks.workunit.client.1.smithi139.stdout:3/621: write d5/d21/d23/f9c [311803,71933] 0 2024-09-17T07:20:02.002 INFO:tasks.workunit.client.1.smithi139.stdout:0/463: write d1/f43 [872929,55688] 0 2024-09-17T07:20:02.002 INFO:tasks.workunit.client.0.smithi087.stdout:4/821: link d2/d92/d4d/f53 d2/d92/d4f/d6a/f120 0 2024-09-17T07:20:02.003 INFO:tasks.workunit.client.0.smithi087.stdout:4/822: stat d2/d92/d4d/fd 0 2024-09-17T07:20:02.003 INFO:tasks.workunit.client.1.smithi139.stdout:0/464: readlink d1/da/d17/d72/l36 0 2024-09-17T07:20:02.004 INFO:tasks.workunit.client.0.smithi087.stdout:4/823: fsync d2/d92/d4d/d42/fac 0 2024-09-17T07:20:02.004 INFO:tasks.workunit.client.1.smithi139.stdout:3/622: unlink d5/d21/l78 0 2024-09-17T07:20:02.005 INFO:tasks.workunit.client.0.smithi087.stdout:4/824: write d2/f115 [184026,4386] 0 2024-09-17T07:20:02.006 INFO:tasks.workunit.client.1.smithi139.stdout:3/623: write d5/d15/d16/d4c/d28/f85 [1453682,80904] 0 2024-09-17T07:20:02.009 INFO:tasks.workunit.client.1.smithi139.stdout:3/624: chown d5/d63/d6d/d6f/fb8 6595864 1 2024-09-17T07:20:02.009 INFO:tasks.workunit.client.0.smithi087.stdout:3/783: unlink d6/d15/d92/fad 0 2024-09-17T07:20:02.010 INFO:tasks.workunit.client.0.smithi087.stdout:3/784: fsync d6/d1b/d42/d62/dc1/de8/fc3 0 2024-09-17T07:20:02.011 INFO:tasks.workunit.client.0.smithi087.stdout:4/825: creat d2/d92/d4d/d21/d2f/d3b/d7e/d97/f121 x:0 0 0 2024-09-17T07:20:02.012 INFO:tasks.workunit.client.1.smithi139.stdout:0/465: dwrite d1/da/d1b/d32/f37 [0,4194304] 0 2024-09-17T07:20:02.012 INFO:tasks.workunit.client.1.smithi139.stdout:2/691: dread d0/de/f36 [0,4194304] 0 2024-09-17T07:20:02.013 INFO:tasks.workunit.client.0.smithi087.stdout:4/826: chown d2/d92/d4f/d6a/ff8 152240467 1 2024-09-17T07:20:02.014 INFO:tasks.workunit.client.0.smithi087.stdout:3/785: mknod d6/c116 0 2024-09-17T07:20:02.014 INFO:tasks.workunit.client.1.smithi139.stdout:3/625: symlink d5/d15/d16/d4c/d28/d54/d58/lc8 0 2024-09-17T07:20:02.015 INFO:tasks.workunit.client.0.smithi087.stdout:4/827: write d2/d5/d1f/da7/fe2 [134785,56600] 0 2024-09-17T07:20:02.016 INFO:tasks.workunit.client.1.smithi139.stdout:0/466: symlink d1/da/d1b/d3d/d5a/d75/d93/lb1 0 2024-09-17T07:20:02.017 INFO:tasks.workunit.client.0.smithi087.stdout:4/828: write d2/d92/d4d/d21/f79 [4649763,28346] 0 2024-09-17T07:20:02.019 INFO:tasks.workunit.client.1.smithi139.stdout:0/467: mkdir d1/da/d1b/d3d/d5a/db2 0 2024-09-17T07:20:02.023 INFO:tasks.workunit.client.0.smithi087.stdout:4/829: rename d2/d22/d2c/d91/d113/l109 to d2/d92/d86/l122 0 2024-09-17T07:20:02.025 INFO:tasks.workunit.client.0.smithi087.stdout:7/591: write d0/d3/f3f [2523641,83350] 0 2024-09-17T07:20:02.025 INFO:tasks.workunit.client.0.smithi087.stdout:8/739: write d1/d7/d63/dd9/dcf/fe9 [577476,102644] 0 2024-09-17T07:20:02.026 INFO:tasks.workunit.client.0.smithi087.stdout:6/886: write d1/d67/dfe/d2c/f32 [1864065,35719] 0 2024-09-17T07:20:02.028 INFO:tasks.workunit.client.1.smithi139.stdout:7/532: dwrite d5/d10/d2b/f3c [0,4194304] 0 2024-09-17T07:20:02.028 INFO:tasks.workunit.client.0.smithi087.stdout:7/592: write d0/d3/f40 [1061251,129098] 0 2024-09-17T07:20:02.029 INFO:tasks.workunit.client.0.smithi087.stdout:3/786: creat d6/d15/d37/d3c/d52/db2/d102/f117 x:0 0 0 2024-09-17T07:20:02.030 INFO:tasks.workunit.client.0.smithi087.stdout:1/707: truncate d2/d3d/d35/d57/f98 246163 0 2024-09-17T07:20:02.031 INFO:tasks.workunit.client.1.smithi139.stdout:5/761: rename d4/d16/d1b/d20/d28/c14 to d4/d16/d1b/d20/d28/cf9 0 2024-09-17T07:20:02.032 INFO:tasks.workunit.client.0.smithi087.stdout:7/593: truncate d0/d3/d10/d87/d96/fa1 137832 0 2024-09-17T07:20:02.033 INFO:tasks.workunit.client.0.smithi087.stdout:8/740: creat d1/d2b/d21/d6d/f100 x:0 0 0 2024-09-17T07:20:02.034 INFO:tasks.workunit.client.0.smithi087.stdout:8/741: dread - d1/d7/d9/d19/d1b/d18/fc9 zero size 2024-09-17T07:20:02.035 INFO:tasks.workunit.client.0.smithi087.stdout:8/742: chown d1/c51 38807075 1 2024-09-17T07:20:02.035 INFO:tasks.workunit.client.1.smithi139.stdout:1/487: write d2/d10/d12/d1a/f36 [1291907,55342] 0 2024-09-17T07:20:02.037 INFO:tasks.workunit.client.0.smithi087.stdout:3/787: creat d6/d15/d37/d3c/d52/f118 x:0 0 0 2024-09-17T07:20:02.038 INFO:tasks.workunit.client.1.smithi139.stdout:0/468: dread d1/da/d1b/d32/f7a [0,4194304] 0 2024-09-17T07:20:02.038 INFO:tasks.workunit.client.0.smithi087.stdout:6/887: mknod d1/c12d 0 2024-09-17T07:20:02.039 INFO:tasks.workunit.client.1.smithi139.stdout:1/488: unlink d2/d10/d12/d24/d38/d3d/l67 0 2024-09-17T07:20:02.040 INFO:tasks.workunit.client.0.smithi087.stdout:8/743: creat d1/d7/d9/d27/f101 x:0 0 0 2024-09-17T07:20:02.041 INFO:tasks.workunit.client.1.smithi139.stdout:0/469: fsync d1/da/d1b/d32/d81/f5e 0 2024-09-17T07:20:02.041 INFO:tasks.workunit.client.0.smithi087.stdout:1/708: mkdir d2/d3d/df3 0 2024-09-17T07:20:02.041 INFO:tasks.workunit.client.0.smithi087.stdout:8/744: chown d1/d7 426 1 2024-09-17T07:20:02.041 INFO:tasks.workunit.client.1.smithi139.stdout:9/921: truncate dc/d11/d8b/f11f 35761 0 2024-09-17T07:20:02.042 INFO:tasks.workunit.client.0.smithi087.stdout:3/788: mknod d6/d15/d37/d3c/d43/d114/c119 0 2024-09-17T07:20:02.042 INFO:tasks.workunit.client.1.smithi139.stdout:9/922: chown dc/d2c 1 1 2024-09-17T07:20:02.044 INFO:tasks.workunit.client.1.smithi139.stdout:1/489: rename d2/d10/d12/d1a/f6d to d2/d10/d12/d24/d38/d3d/f99 0 2024-09-17T07:20:02.044 INFO:tasks.workunit.client.1.smithi139.stdout:1/490: chown d2/d10/d12/d35/d49 928 1 2024-09-17T07:20:02.044 INFO:tasks.workunit.client.1.smithi139.stdout:4/556: write d0/f30 [1579628,42923] 0 2024-09-17T07:20:02.045 INFO:tasks.workunit.client.0.smithi087.stdout:3/789: chown d6/d1b/d42/dd4/fe2 12 1 2024-09-17T07:20:02.046 INFO:tasks.workunit.client.1.smithi139.stdout:9/923: truncate dc/d11/d8b/dc7/ffd 78572 0 2024-09-17T07:20:02.047 INFO:tasks.workunit.client.0.smithi087.stdout:1/709: creat d2/dcf/d9a/ff4 x:0 0 0 2024-09-17T07:20:02.047 INFO:tasks.workunit.client.1.smithi139.stdout:0/470: creat d1/da/d1b/d32/d9a/fb3 x:0 0 0 2024-09-17T07:20:02.048 INFO:tasks.workunit.client.0.smithi087.stdout:8/745: creat d1/d2b/d21/dd4/f102 x:0 0 0 2024-09-17T07:20:02.049 INFO:tasks.workunit.client.0.smithi087.stdout:8/746: chown d1/fd6 54228 1 2024-09-17T07:20:02.050 INFO:tasks.workunit.client.1.smithi139.stdout:1/491: dread d2/f58 [0,4194304] 0 2024-09-17T07:20:02.050 INFO:tasks.workunit.client.1.smithi139.stdout:0/471: mknod d1/da/d1b/d3d/d5a/d75/d91/cb4 0 2024-09-17T07:20:02.051 INFO:tasks.workunit.client.0.smithi087.stdout:4/830: truncate d2/d22/d95/fd6 254417 0 2024-09-17T07:20:02.054 INFO:tasks.workunit.client.1.smithi139.stdout:4/557: getdents d0 0 2024-09-17T07:20:02.055 INFO:tasks.workunit.client.1.smithi139.stdout:4/558: chown d0/db/d7f/f8c 25155 1 2024-09-17T07:20:02.055 INFO:tasks.workunit.client.0.smithi087.stdout:1/710: mkdir d2/d3d/d35/d57/df5 0 2024-09-17T07:20:02.056 INFO:tasks.workunit.client.1.smithi139.stdout:4/559: dread - d0/f82 zero size 2024-09-17T07:20:02.056 INFO:tasks.workunit.client.0.smithi087.stdout:1/711: readlink d2/d3d/d45/d90/d43/d5d/lca 0 2024-09-17T07:20:02.057 INFO:tasks.workunit.client.1.smithi139.stdout:0/472: mkdir d1/da/d17/d72/db5 0 2024-09-17T07:20:02.057 INFO:tasks.workunit.client.0.smithi087.stdout:6/888: rename d1/d67/dfe/f28 to d1/d67/dfe/d2c/d129/f12e 0 2024-09-17T07:20:02.058 INFO:tasks.workunit.client.1.smithi139.stdout:1/492: dwrite d2/d10/d12/d35/d49/f56 [0,4194304] 0 2024-09-17T07:20:02.058 INFO:tasks.workunit.client.1.smithi139.stdout:2/692: truncate d0/f6 4127853 0 2024-09-17T07:20:02.058 INFO:tasks.workunit.client.1.smithi139.stdout:9/924: link dc/d2a/cf3 dc/d11/d52/d56/d7a/df7/d122/d83/d98/dcf/c133 0 2024-09-17T07:20:02.061 INFO:tasks.workunit.client.1.smithi139.stdout:3/626: truncate d5/d15/d20/f42 887368 0 2024-09-17T07:20:02.061 INFO:tasks.workunit.client.1.smithi139.stdout:4/560: mkdir d0/db/d7f/db0 0 2024-09-17T07:20:02.062 INFO:tasks.workunit.client.0.smithi087.stdout:7/594: dread d0/d3/d23/f2b [0,4194304] 0 2024-09-17T07:20:02.063 INFO:tasks.workunit.client.0.smithi087.stdout:3/790: rename d6/d15/d37/d3c/l9c to d6/d1b/d42/d62/dc1/l11a 0 2024-09-17T07:20:02.063 INFO:tasks.workunit.client.1.smithi139.stdout:1/493: symlink d2/l9a 0 2024-09-17T07:20:02.067 INFO:tasks.workunit.client.0.smithi087.stdout:1/712: unlink d2/d3d/d45/d90/d43/fb7 0 2024-09-17T07:20:02.069 INFO:tasks.workunit.client.1.smithi139.stdout:2/693: write d0/dc/d3a/f3c [11702262,39945] 0 2024-09-17T07:20:02.070 INFO:tasks.workunit.client.1.smithi139.stdout:1/494: mkdir d2/d10/d12/d35/d49/d8d/d9b 0 2024-09-17T07:20:02.070 INFO:tasks.workunit.client.0.smithi087.stdout:7/595: unlink d0/d3/f5a 0 2024-09-17T07:20:02.076 INFO:tasks.workunit.client.0.smithi087.stdout:4/831: link d2/d22/c112 d2/d22/d95/c123 0 2024-09-17T07:20:02.076 INFO:tasks.workunit.client.0.smithi087.stdout:8/747: truncate d1/d2b/f46 7415759 0 2024-09-17T07:20:02.077 INFO:tasks.workunit.client.1.smithi139.stdout:0/473: dwrite d1/da/d1b/f27 [0,4194304] 0 2024-09-17T07:20:02.080 INFO:tasks.workunit.client.1.smithi139.stdout:2/694: mknod d0/dc/d3a/cec 0 2024-09-17T07:20:02.082 INFO:tasks.workunit.client.1.smithi139.stdout:3/627: dwrite d5/d15/d56/f7c [0,4194304] 0 2024-09-17T07:20:02.083 INFO:tasks.workunit.client.1.smithi139.stdout:1/495: readlink d2/d10/d12/d35/d2b/d4a/l6b 0 2024-09-17T07:20:02.087 INFO:tasks.workunit.client.1.smithi139.stdout:4/561: dwrite d0/f5 [0,4194304] 0 2024-09-17T07:20:02.088 INFO:tasks.workunit.client.1.smithi139.stdout:9/925: dwrite dc/d11/d52/d56/d7a/df7/d122/f107 [0,4194304] 0 2024-09-17T07:20:02.090 INFO:tasks.workunit.client.1.smithi139.stdout:0/474: mkdir d1/da/d1b/db6 0 2024-09-17T07:20:02.091 INFO:tasks.workunit.client.0.smithi087.stdout:4/832: creat d2/d92/d4d/d21/d2f/d3b/f124 x:0 0 0 2024-09-17T07:20:02.091 INFO:tasks.workunit.client.0.smithi087.stdout:4/833: readlink d2/d92/d4d/l40 0 2024-09-17T07:20:02.092 INFO:tasks.workunit.client.1.smithi139.stdout:2/695: rename d0/d7/d67/c9a to d0/d4e/d76/ced 0 2024-09-17T07:20:02.093 INFO:tasks.workunit.client.0.smithi087.stdout:8/748: creat d1/d2b/df4/d54/dbb/f103 x:0 0 0 2024-09-17T07:20:02.093 INFO:tasks.workunit.client.1.smithi139.stdout:4/562: stat d0/d1a/d70/l79 0 2024-09-17T07:20:02.094 INFO:tasks.workunit.client.1.smithi139.stdout:4/563: write d0/db/d58/f91 [491920,61307] 0 2024-09-17T07:20:02.094 INFO:tasks.workunit.client.0.smithi087.stdout:7/596: fsync d0/d3/d10/f5d 0 2024-09-17T07:20:02.095 INFO:tasks.workunit.client.1.smithi139.stdout:4/564: chown d0/d1/d54/d93 212430 1 2024-09-17T07:20:02.095 INFO:tasks.workunit.client.1.smithi139.stdout:0/475: symlink d1/da/d2a/lb7 0 2024-09-17T07:20:02.096 INFO:tasks.workunit.client.0.smithi087.stdout:6/889: getdents d1/d67/dfe/d2c/d58 0 2024-09-17T07:20:02.096 INFO:tasks.workunit.client.1.smithi139.stdout:4/565: write d0/d1a/f1f [559191,13624] 0 2024-09-17T07:20:02.097 INFO:tasks.workunit.client.1.smithi139.stdout:2/696: creat d0/dc/dc4/fee x:0 0 0 2024-09-17T07:20:02.097 INFO:tasks.workunit.client.0.smithi087.stdout:6/890: stat d1/d67/dfe/d2c/d33/cbe 0 2024-09-17T07:20:02.100 INFO:tasks.workunit.client.1.smithi139.stdout:3/628: rename d5/d21/d23/f47 to d5/d63/d6d/d6f/d81/fc9 0 2024-09-17T07:20:02.104 INFO:tasks.workunit.client.1.smithi139.stdout:2/697: getdents d0/d4e/d76/d82 0 2024-09-17T07:20:02.106 INFO:tasks.workunit.client.1.smithi139.stdout:2/698: stat d0/dc/d15/d9f 0 2024-09-17T07:20:02.106 INFO:tasks.workunit.client.1.smithi139.stdout:3/629: dread d5/d15/d16/d4c/d28/d54/d8e/fbe [0,4194304] 0 2024-09-17T07:20:02.107 INFO:tasks.workunit.client.1.smithi139.stdout:4/566: dwrite d0/d49/f8b [0,4194304] 0 2024-09-17T07:20:02.108 INFO:tasks.workunit.client.1.smithi139.stdout:3/630: readlink d5/d15/d16/d4c/d28/d54/d8e/lc4 0 2024-09-17T07:20:02.110 INFO:tasks.workunit.client.1.smithi139.stdout:4/567: rmdir d0/d1/d29/d6d 39 2024-09-17T07:20:02.112 INFO:tasks.workunit.client.1.smithi139.stdout:2/699: mknod d0/d7/d86/da4/d28/cef 0 2024-09-17T07:20:02.115 INFO:tasks.workunit.client.1.smithi139.stdout:3/631: rename d5/d15/d16/d25 to d5/da7/dca 0 2024-09-17T07:20:02.116 INFO:tasks.workunit.client.1.smithi139.stdout:4/568: mkdir d0/d1/d54/db1 0 2024-09-17T07:20:02.117 INFO:tasks.workunit.client.1.smithi139.stdout:3/632: mknod d5/d63/d6d/d6f/d81/ccb 0 2024-09-17T07:20:02.119 INFO:tasks.workunit.client.1.smithi139.stdout:2/700: dwrite d0/de/d69/f6a [0,4194304] 0 2024-09-17T07:20:02.120 INFO:tasks.workunit.client.1.smithi139.stdout:2/701: fdatasync d0/d7/d1a/d59/f97 0 2024-09-17T07:20:02.128 INFO:tasks.workunit.client.1.smithi139.stdout:2/702: dwrite d0/dc/f13 [0,4194304] 0 2024-09-17T07:20:02.128 INFO:tasks.workunit.client.1.smithi139.stdout:2/703: readlink d0/d7/d67/d92/d99/l4a 0 2024-09-17T07:20:02.128 INFO:tasks.workunit.client.1.smithi139.stdout:2/704: fsync d0/d7/d67/d92/fad 0 2024-09-17T07:20:02.132 INFO:tasks.workunit.client.1.smithi139.stdout:2/705: unlink d0/d7/d1a/d1b/l4b 0 2024-09-17T07:20:02.133 INFO:tasks.workunit.client.1.smithi139.stdout:2/706: dread - d0/de/d69/fd0 zero size 2024-09-17T07:20:02.135 INFO:tasks.workunit.client.1.smithi139.stdout:2/707: mkdir d0/de/d54/df0 0 2024-09-17T07:20:02.135 INFO:tasks.workunit.client.1.smithi139.stdout:2/708: chown d0/d7/d67/da1/fea 0 1 2024-09-17T07:20:02.137 INFO:tasks.workunit.client.1.smithi139.stdout:2/709: mknod d0/dc/d15/cf1 0 2024-09-17T07:20:02.175 INFO:tasks.workunit.client.0.smithi087.stdout:4/834: creat d2/d92/d4d/d21/d2f/d3b/d7e/d97/f125 x:0 0 0 2024-09-17T07:20:02.176 INFO:tasks.workunit.client.0.smithi087.stdout:7/597: creat d0/d3/d10/d87/d96/fb1 x:0 0 0 2024-09-17T07:20:02.177 INFO:tasks.workunit.client.0.smithi087.stdout:6/891: symlink d1/d67/dfe/d4e/l12f 0 2024-09-17T07:20:02.178 INFO:tasks.workunit.client.0.smithi087.stdout:1/713: getdents d2/d3d/d35/d4f/da5/dce 0 2024-09-17T07:20:02.180 INFO:tasks.workunit.client.0.smithi087.stdout:4/835: symlink d2/d92/d4d/d21/dfa/d108/l126 0 2024-09-17T07:20:02.187 INFO:tasks.workunit.client.0.smithi087.stdout:3/791: dwrite d6/d1b/d42/dd4/f58 [0,4194304] 0 2024-09-17T07:20:02.188 INFO:tasks.workunit.client.0.smithi087.stdout:6/892: dwrite d1/d67/dfe/d2c/fe6 [0,4194304] 0 2024-09-17T07:20:02.193 INFO:tasks.workunit.client.1.smithi139.stdout:2/710: stat d0/d4e/d76/ced 0 2024-09-17T07:20:02.193 INFO:tasks.workunit.client.0.smithi087.stdout:6/893: read - d1/d67/dfe/d2c/fe8 zero size 2024-09-17T07:20:02.194 INFO:tasks.workunit.client.0.smithi087.stdout:1/714: dwrite d2/dc/f3a [0,4194304] 0 2024-09-17T07:20:02.195 INFO:tasks.workunit.client.1.smithi139.stdout:2/711: fdatasync d0/d7/d86/da4/d12/fc2 0 2024-09-17T07:20:02.196 INFO:tasks.workunit.client.1.smithi139.stdout:6/710: sync 2024-09-17T07:20:02.197 INFO:tasks.workunit.client.0.smithi087.stdout:3/792: chown d6/d1b/d42/l31 2 1 2024-09-17T07:20:02.197 INFO:tasks.workunit.client.1.smithi139.stdout:2/712: truncate d0/dc/dc4/fee 629035 0 2024-09-17T07:20:02.199 INFO:tasks.workunit.client.0.smithi087.stdout:1/715: creat d2/dcf/ff6 x:0 0 0 2024-09-17T07:20:02.201 INFO:tasks.workunit.client.0.smithi087.stdout:6/894: unlink d1/d67/dfe/d2c/d40/cfd 0 2024-09-17T07:20:02.203 INFO:tasks.workunit.client.0.smithi087.stdout:1/716: mknod d2/d69/cf7 0 2024-09-17T07:20:02.203 INFO:tasks.workunit.client.0.smithi087.stdout:3/793: mkdir d6/d15/d37/d3c/d52/db2/d10a/d11b 0 2024-09-17T07:20:02.205 INFO:tasks.workunit.client.0.smithi087.stdout:1/717: chown d2/d3d/d45/d90/d37/f38 34 1 2024-09-17T07:20:02.206 INFO:tasks.workunit.client.0.smithi087.stdout:3/794: write d6/d1b/d42/dd4/dd1/de4/f107 [1226292,47645] 0 2024-09-17T07:20:02.206 INFO:tasks.workunit.client.0.smithi087.stdout:6/895: rename d1/d67/dfe/d2c/d40/d4c/d77 to d1/d67/dfe/d2c/d40/dd2/d130 0 2024-09-17T07:20:02.207 INFO:tasks.workunit.client.1.smithi139.stdout:4/569: write d0/db/f4a [2538194,104412] 0 2024-09-17T07:20:02.208 INFO:tasks.workunit.client.1.smithi139.stdout:9/926: dread dc/d2a/fec [4194304,4194304] 0 2024-09-17T07:20:02.208 INFO:tasks.workunit.client.1.smithi139.stdout:3/633: rmdir d5/d15/d16/d4c 39 2024-09-17T07:20:02.209 INFO:tasks.workunit.client.1.smithi139.stdout:3/634: chown d5/d63/d6d/d6f/d8b 66639927 1 2024-09-17T07:20:02.211 INFO:tasks.workunit.client.0.smithi087.stdout:1/718: rename d2/d3d/d45/d90/d37/ldd to d2/d3d/d45/d90/d37/lf8 0 2024-09-17T07:20:02.212 INFO:tasks.workunit.client.0.smithi087.stdout:3/795: symlink d6/d10d/l11c 0 2024-09-17T07:20:02.214 INFO:tasks.workunit.client.0.smithi087.stdout:3/796: read - d6/d15/d37/d3c/d52/db2/fbd zero size 2024-09-17T07:20:02.214 INFO:tasks.workunit.client.0.smithi087.stdout:1/719: symlink d2/d69/d8d/da6/lf9 0 2024-09-17T07:20:02.216 INFO:tasks.workunit.client.0.smithi087.stdout:8/749: write d1/d2b/d21/d68/fbc [50935,32110] 0 2024-09-17T07:20:02.216 INFO:tasks.workunit.client.1.smithi139.stdout:4/570: dwrite d0/db/d58/f5e [0,4194304] 0 2024-09-17T07:20:02.216 INFO:tasks.workunit.client.1.smithi139.stdout:3/635: truncate d5/d15/d16/d4c/d28/f30 1486979 0 2024-09-17T07:20:02.217 INFO:tasks.workunit.client.0.smithi087.stdout:3/797: unlink d6/d1b/d42/d6e/f79 0 2024-09-17T07:20:02.218 INFO:tasks.workunit.client.0.smithi087.stdout:8/750: write d1/d7/d9/d19/fae [1663333,74483] 0 2024-09-17T07:20:02.220 INFO:tasks.workunit.client.1.smithi139.stdout:3/636: unlink d5/d15/d16/d4c/d28/d54/d58/c6a 0 2024-09-17T07:20:02.220 INFO:tasks.workunit.client.1.smithi139.stdout:4/571: getdents d0/db/d7f/db0 0 2024-09-17T07:20:02.221 INFO:tasks.workunit.client.0.smithi087.stdout:3/798: write d6/d1b/d42/d62/dbb/dd7/fda [2231737,9459] 0 2024-09-17T07:20:02.223 INFO:tasks.workunit.client.0.smithi087.stdout:3/799: write d6/d1b/d42/d62/f87 [424259,48585] 0 2024-09-17T07:20:02.223 INFO:tasks.workunit.client.1.smithi139.stdout:4/572: mkdir d0/db/db2 0 2024-09-17T07:20:02.224 INFO:tasks.workunit.client.0.smithi087.stdout:4/836: truncate d2/d92/d4f/fbc 6337771 0 2024-09-17T07:20:02.225 INFO:tasks.workunit.client.1.smithi139.stdout:3/637: fdatasync d5/d15/d20/d3b/f4a 0 2024-09-17T07:20:02.227 INFO:tasks.workunit.client.1.smithi139.stdout:3/638: creat d5/d21/fcc x:0 0 0 2024-09-17T07:20:02.229 INFO:tasks.workunit.client.1.smithi139.stdout:6/711: dread db/d18/d9f/fdf [0,4194304] 0 2024-09-17T07:20:02.229 INFO:tasks.workunit.client.1.smithi139.stdout:3/639: write d5/d15/d56/f7c [3373111,126052] 0 2024-09-17T07:20:02.232 INFO:tasks.workunit.client.0.smithi087.stdout:8/751: fdatasync d1/d7/d9/d19/fae 0 2024-09-17T07:20:02.232 INFO:tasks.workunit.client.0.smithi087.stdout:3/800: rename d6/d15/d92/fc5 to d6/d1b/d42/d95/f11d 0 2024-09-17T07:20:02.234 INFO:tasks.workunit.client.1.smithi139.stdout:3/640: getdents d5/d63/db3 0 2024-09-17T07:20:02.235 INFO:tasks.workunit.client.1.smithi139.stdout:3/641: stat d5/d63/db3 0 2024-09-17T07:20:02.237 INFO:tasks.workunit.client.0.smithi087.stdout:4/837: dwrite d2/d92/d4d/d21/d2f/d3b/d7e/d97/f121 [0,4194304] 0 2024-09-17T07:20:02.237 INFO:tasks.workunit.client.1.smithi139.stdout:6/712: creat db/df/d4e/d5e/deb/ff2 x:0 0 0 2024-09-17T07:20:02.238 INFO:tasks.workunit.client.1.smithi139.stdout:6/713: chown db/d18/f39 1980 1 2024-09-17T07:20:02.238 INFO:tasks.workunit.client.1.smithi139.stdout:9/927: dread dc/d11/d15/d3c/d61/fc0 [0,4194304] 0 2024-09-17T07:20:02.239 INFO:tasks.workunit.client.0.smithi087.stdout:8/752: creat d1/d2b/d21/dd4/f104 x:0 0 0 2024-09-17T07:20:02.239 INFO:tasks.workunit.client.1.smithi139.stdout:6/714: write db/f16 [249044,79025] 0 2024-09-17T07:20:02.240 INFO:tasks.workunit.client.1.smithi139.stdout:9/928: readlink dc/d2a/l2d 0 2024-09-17T07:20:02.241 INFO:tasks.workunit.client.0.smithi087.stdout:3/801: symlink d6/d15/d37/d5e/l11e 0 2024-09-17T07:20:02.246 INFO:tasks.workunit.client.1.smithi139.stdout:6/715: rename db/f3d to db/d18/d5b/ff3 0 2024-09-17T07:20:02.247 INFO:tasks.workunit.client.0.smithi087.stdout:6/896: dread d1/d67/dfe/d2c/f52 [4194304,4194304] 0 2024-09-17T07:20:02.247 INFO:tasks.workunit.client.1.smithi139.stdout:2/713: dwrite d0/d7/fdb [0,4194304] 0 2024-09-17T07:20:02.249 INFO:tasks.workunit.client.0.smithi087.stdout:7/598: dread d0/f6 [0,4194304] 0 2024-09-17T07:20:02.250 INFO:tasks.workunit.client.0.smithi087.stdout:4/838: rename d2/cce to d2/d22/d10e/c127 0 2024-09-17T07:20:02.252 INFO:tasks.workunit.client.0.smithi087.stdout:8/753: dwrite d1/feb [0,4194304] 0 2024-09-17T07:20:02.252 INFO:tasks.workunit.client.1.smithi139.stdout:6/716: mkdir db/d21/d96/df4 0 2024-09-17T07:20:02.253 INFO:tasks.workunit.client.0.smithi087.stdout:4/839: chown d2/d5/f59 3064 1 2024-09-17T07:20:02.253 INFO:tasks.workunit.client.0.smithi087.stdout:6/897: chown d1/d67/dfe/d2c/d40/dd2/d130/ld8 1454438127 1 2024-09-17T07:20:02.254 INFO:tasks.workunit.client.1.smithi139.stdout:6/717: fdatasync db/d18/d1b/f1d 0 2024-09-17T07:20:02.255 INFO:tasks.workunit.client.1.smithi139.stdout:2/714: mknod d0/d3b/ddc/cf2 0 2024-09-17T07:20:02.256 INFO:tasks.workunit.client.0.smithi087.stdout:7/599: mkdir d0/d3/d10/d87/d96/db2 0 2024-09-17T07:20:02.257 INFO:tasks.workunit.client.1.smithi139.stdout:4/573: write d0/d10/f40 [988484,28712] 0 2024-09-17T07:20:02.258 INFO:tasks.workunit.client.0.smithi087.stdout:4/840: chown d2/d92/d4d/d21 479 1 2024-09-17T07:20:02.258 INFO:tasks.workunit.client.1.smithi139.stdout:6/718: symlink db/df/d73/d81/lf5 0 2024-09-17T07:20:02.260 INFO:tasks.workunit.client.0.smithi087.stdout:4/841: dread - d2/d5/f59 zero size 2024-09-17T07:20:02.260 INFO:tasks.workunit.client.0.smithi087.stdout:8/754: truncate d1/d7/d63/f84 213570 0 2024-09-17T07:20:02.261 INFO:tasks.workunit.client.1.smithi139.stdout:6/719: write db/df/d73/f95 [2662781,91515] 0 2024-09-17T07:20:02.262 INFO:tasks.workunit.client.0.smithi087.stdout:4/842: readlink d2/d92/d4d/d21/l111 0 2024-09-17T07:20:02.262 INFO:tasks.workunit.client.1.smithi139.stdout:4/574: mkdir d0/d1/d29/d6d/db3 0 2024-09-17T07:20:02.263 INFO:tasks.workunit.client.0.smithi087.stdout:6/898: rmdir d1/d67/dfe/d2c/d48 39 2024-09-17T07:20:02.265 INFO:tasks.workunit.client.0.smithi087.stdout:7/600: mkdir d0/d36/db3 0 2024-09-17T07:20:02.266 INFO:tasks.workunit.client.1.smithi139.stdout:6/720: dread db/df/d4e/d64/fb2 [0,4194304] 0 2024-09-17T07:20:02.266 INFO:tasks.workunit.client.0.smithi087.stdout:3/802: dwrite d6/d1b/d42/dd4/dd1/de4/f107 [0,4194304] 0 2024-09-17T07:20:02.266 INFO:tasks.workunit.client.0.smithi087.stdout:7/601: readlink d0/d3/d10/d32/d62/d76/l80 0 2024-09-17T07:20:02.266 INFO:tasks.workunit.client.1.smithi139.stdout:3/642: truncate d5/d15/d16/d4c/d28/d54/d8e/fa5 1858954 0 2024-09-17T07:20:02.267 INFO:tasks.workunit.client.1.smithi139.stdout:2/715: dread d0/de/d25/d3f/f96 [0,4194304] 0 2024-09-17T07:20:02.268 INFO:tasks.workunit.client.0.smithi087.stdout:1/720: dread d2/d69/d8d/fb8 [0,4194304] 0 2024-09-17T07:20:02.270 INFO:tasks.workunit.client.1.smithi139.stdout:4/575: rename d0/d1/d54/db1 to d0/d10/db4 0 2024-09-17T07:20:02.272 INFO:tasks.workunit.client.0.smithi087.stdout:8/755: mkdir d1/d2b/d3b/d53/d105 0 2024-09-17T07:20:02.273 INFO:tasks.workunit.client.0.smithi087.stdout:4/843: write d2/d92/d86/fd8 [2447628,47864] 0 2024-09-17T07:20:02.274 INFO:tasks.workunit.client.1.smithi139.stdout:9/929: dread dc/d11/d15/d3c/f3f [0,4194304] 0 2024-09-17T07:20:02.275 INFO:tasks.workunit.client.0.smithi087.stdout:6/899: fsync d1/d67/dfe/d2c/d48/d9b/f101 0 2024-09-17T07:20:02.276 INFO:tasks.workunit.client.0.smithi087.stdout:1/721: mknod d2/d69/d8d/cfa 0 2024-09-17T07:20:02.278 INFO:tasks.workunit.client.0.smithi087.stdout:4/844: dread - d2/d92/d86/fef zero size 2024-09-17T07:20:02.279 INFO:tasks.workunit.client.0.smithi087.stdout:7/602: dwrite d0/d3/d23/d17/d7b/dad/d89/fa7 [0,4194304] 0 2024-09-17T07:20:02.279 INFO:tasks.workunit.client.1.smithi139.stdout:6/721: creat db/d18/d38/ff6 x:0 0 0 2024-09-17T07:20:02.280 INFO:tasks.workunit.client.1.smithi139.stdout:6/722: chown db/df/d4e 105 1 2024-09-17T07:20:02.281 INFO:tasks.workunit.client.0.smithi087.stdout:8/756: creat d1/d2b/df4/d54/dbb/f106 x:0 0 0 2024-09-17T07:20:02.281 INFO:tasks.workunit.client.1.smithi139.stdout:2/716: write d0/de/d25/d3f/f96 [337703,121360] 0 2024-09-17T07:20:02.281 INFO:tasks.workunit.client.1.smithi139.stdout:9/930: symlink dc/d11/d8b/dc7/l134 0 2024-09-17T07:20:02.283 INFO:tasks.workunit.client.1.smithi139.stdout:6/723: creat db/d18/d38/d60/ff7 x:0 0 0 2024-09-17T07:20:02.283 INFO:tasks.workunit.client.0.smithi087.stdout:6/900: write d1/d67/dfe/d2c/d33/f3d [4971506,82979] 0 2024-09-17T07:20:02.284 INFO:tasks.workunit.client.1.smithi139.stdout:2/717: rmdir d0/de/df 39 2024-09-17T07:20:02.284 INFO:tasks.workunit.client.0.smithi087.stdout:6/901: chown d1/f11f 37056748 1 2024-09-17T07:20:02.285 INFO:tasks.workunit.client.1.smithi139.stdout:6/724: mknod db/d18/d9f/cf8 0 2024-09-17T07:20:02.286 INFO:tasks.workunit.client.0.smithi087.stdout:1/722: stat d2/d3d/d35/d57/d73/c7f 0 2024-09-17T07:20:02.289 INFO:tasks.workunit.client.0.smithi087.stdout:7/603: creat d0/d3/d10/d31/fb4 x:0 0 0 2024-09-17T07:20:02.289 INFO:tasks.workunit.client.0.smithi087.stdout:3/803: write d6/d1b/d42/d62/f84 [5150439,74244] 0 2024-09-17T07:20:02.291 INFO:tasks.workunit.client.0.smithi087.stdout:7/604: fdatasync d0/d3/f9f 0 2024-09-17T07:20:02.292 INFO:tasks.workunit.client.0.smithi087.stdout:6/902: chown d1/d67/dfe/d2c/d33/c38 3 1 2024-09-17T07:20:02.292 INFO:tasks.workunit.client.0.smithi087.stdout:4/845: dread d2/d92/f94 [0,4194304] 0 2024-09-17T07:20:02.293 INFO:tasks.workunit.client.0.smithi087.stdout:1/723: chown d2/d48/d61/l97 1363 1 2024-09-17T07:20:02.294 INFO:tasks.workunit.client.1.smithi139.stdout:6/725: dwrite db/df/f24 [0,4194304] 0 2024-09-17T07:20:02.294 INFO:tasks.workunit.client.0.smithi087.stdout:6/903: stat d1/d67/dfe/d5e/l7a 0 2024-09-17T07:20:02.294 INFO:tasks.workunit.client.0.smithi087.stdout:1/724: dread - d2/d3d/db4/dc3/fdb zero size 2024-09-17T07:20:02.296 INFO:tasks.workunit.client.0.smithi087.stdout:3/804: chown d6/d15/d37/d5e/ff1 503685 1 2024-09-17T07:20:02.296 INFO:tasks.workunit.client.1.smithi139.stdout:3/643: rename d5/d15/d16/d4c/d28/d54/d8e/fa5 to d5/d15/d16/d4c/d28/db5/fcd 0 2024-09-17T07:20:02.298 INFO:tasks.workunit.client.0.smithi087.stdout:1/725: mkdir d2/dcf/d7e/db9/dfb 0 2024-09-17T07:20:02.299 INFO:tasks.workunit.client.0.smithi087.stdout:8/757: link d1/d7/d9/d19/d1b/l3d d1/d7/d9/d19/l107 0 2024-09-17T07:20:02.300 INFO:tasks.workunit.client.0.smithi087.stdout:4/846: rename d2/d92/d4d/d42/db6/dd9/l10a to d2/d22/d2c/d91/dcf/l128 0 2024-09-17T07:20:02.301 INFO:tasks.workunit.client.0.smithi087.stdout:3/805: unlink d6/d15/d37/f5c 0 2024-09-17T07:20:02.301 INFO:tasks.workunit.client.0.smithi087.stdout:6/904: read d1/d67/f8d [273888,74106] 0 2024-09-17T07:20:02.302 INFO:tasks.workunit.client.0.smithi087.stdout:6/905: dread - d1/d6a/dda/f11b zero size 2024-09-17T07:20:02.303 INFO:tasks.workunit.client.0.smithi087.stdout:8/758: mknod d1/d2b/d21/c108 0 2024-09-17T07:20:02.303 INFO:tasks.workunit.client.1.smithi139.stdout:4/576: write d0/d1/d54/f97 [1727581,113780] 0 2024-09-17T07:20:02.304 INFO:tasks.workunit.client.1.smithi139.stdout:2/718: truncate d0/dc/d15/fbe 686261 0 2024-09-17T07:20:02.306 INFO:tasks.workunit.client.1.smithi139.stdout:4/577: write d0/db/d17/f38 [1219793,130540] 0 2024-09-17T07:20:02.306 INFO:tasks.workunit.client.1.smithi139.stdout:9/931: dread dc/d11/d52/d56/d7a/f12e [0,4194304] 0 2024-09-17T07:20:02.307 INFO:tasks.workunit.client.0.smithi087.stdout:7/605: write d0/d3/d10/f8f [397489,42684] 0 2024-09-17T07:20:02.307 INFO:tasks.workunit.client.0.smithi087.stdout:1/726: creat d2/d3d/d35/d4f/da5/dce/ffc x:0 0 0 2024-09-17T07:20:02.308 INFO:tasks.workunit.client.1.smithi139.stdout:9/932: dread - dc/d11/d8b/f116 zero size 2024-09-17T07:20:02.308 INFO:tasks.workunit.client.1.smithi139.stdout:2/719: readlink d0/d7/d86/da4/l85 0 2024-09-17T07:20:02.309 INFO:tasks.workunit.client.0.smithi087.stdout:4/847: mkdir d2/d92/d129 0 2024-09-17T07:20:02.311 INFO:tasks.workunit.client.0.smithi087.stdout:4/848: chown d2/d22/d62/fd0 5 1 2024-09-17T07:20:02.311 INFO:tasks.workunit.client.1.smithi139.stdout:3/644: write d5/d63/d6d/d6f/d81/fc9 [2005034,77069] 0 2024-09-17T07:20:02.312 INFO:tasks.workunit.client.1.smithi139.stdout:2/720: rmdir d0/d4e/d76/d82 39 2024-09-17T07:20:02.312 INFO:tasks.workunit.client.0.smithi087.stdout:7/606: rename d0/d3/cab to d0/d3/d23/d17/d7b/dad/daf/cb5 0 2024-09-17T07:20:02.313 INFO:tasks.workunit.client.1.smithi139.stdout:2/721: chown d0/d7/d86/laf 47399558 1 2024-09-17T07:20:02.314 INFO:tasks.workunit.client.0.smithi087.stdout:1/727: mknod d2/d48/cfd 0 2024-09-17T07:20:02.314 INFO:tasks.workunit.client.1.smithi139.stdout:3/645: write d5/d63/d6d/d6f/d81/fc9 [794255,33205] 0 2024-09-17T07:20:02.314 INFO:tasks.workunit.client.1.smithi139.stdout:9/933: creat dc/f135 x:0 0 0 2024-09-17T07:20:02.315 INFO:tasks.workunit.client.0.smithi087.stdout:4/849: mknod d2/d92/c12a 0 2024-09-17T07:20:02.316 INFO:tasks.workunit.client.0.smithi087.stdout:4/850: fdatasync d2/d22/fd7 0 2024-09-17T07:20:02.318 INFO:tasks.workunit.client.1.smithi139.stdout:2/722: mknod d0/d7/d86/da4/d12/dcd/cf3 0 2024-09-17T07:20:02.319 INFO:tasks.workunit.client.1.smithi139.stdout:4/578: write d0/db/d7f/f90 [873379,14042] 0 2024-09-17T07:20:02.319 INFO:tasks.workunit.client.0.smithi087.stdout:1/728: creat d2/d3d/d35/ffe x:0 0 0 2024-09-17T07:20:02.319 INFO:tasks.workunit.client.1.smithi139.stdout:4/579: chown d0/d10 1084 1 2024-09-17T07:20:02.320 INFO:tasks.workunit.client.1.smithi139.stdout:3/646: mknod d5/d15/d16/cce 0 2024-09-17T07:20:02.321 INFO:tasks.workunit.client.0.smithi087.stdout:1/729: readlink d2/d3d/d45/d90/l36 0 2024-09-17T07:20:02.321 INFO:tasks.workunit.client.0.smithi087.stdout:1/730: chown d2/d48/d6f/fc1 2 1 2024-09-17T07:20:02.322 INFO:tasks.workunit.client.1.smithi139.stdout:4/580: write d0/db/d17/f38 [860227,68084] 0 2024-09-17T07:20:02.322 INFO:tasks.workunit.client.0.smithi087.stdout:7/607: truncate d0/d36/d8e/fa9 88789 0 2024-09-17T07:20:02.323 INFO:tasks.workunit.client.1.smithi139.stdout:4/581: chown d0/d10/f40 0 1 2024-09-17T07:20:02.324 INFO:tasks.workunit.client.1.smithi139.stdout:6/726: dread db/df/f9c [0,4194304] 0 2024-09-17T07:20:02.325 INFO:tasks.workunit.client.1.smithi139.stdout:9/934: dread dc/d11/d8b/fac [0,4194304] 0 2024-09-17T07:20:02.327 INFO:tasks.workunit.client.0.smithi087.stdout:1/731: creat d2/d3d/d45/d90/d43/fff x:0 0 0 2024-09-17T07:20:02.327 INFO:tasks.workunit.client.1.smithi139.stdout:4/582: unlink d0/db/f21 0 2024-09-17T07:20:02.327 INFO:tasks.workunit.client.0.smithi087.stdout:8/759: dread d1/d2b/d21/d6d/fa6 [0,4194304] 0 2024-09-17T07:20:02.329 INFO:tasks.workunit.client.1.smithi139.stdout:6/727: creat db/df/d4e/d64/d83/dd5/ff9 x:0 0 0 2024-09-17T07:20:02.330 INFO:tasks.workunit.client.0.smithi087.stdout:4/851: link d2/d22/d2c/d91/fd1 d2/d92/d4d/d21/d2f/d3b/d7e/d97/f12b 0 2024-09-17T07:20:02.330 INFO:tasks.workunit.client.1.smithi139.stdout:9/935: write dc/d11/d15/d3c/d68/f90 [509344,69043] 0 2024-09-17T07:20:02.331 INFO:tasks.workunit.client.1.smithi139.stdout:4/583: write d0/db/f6c [832429,31683] 0 2024-09-17T07:20:02.334 INFO:tasks.workunit.client.1.smithi139.stdout:2/723: truncate d0/d7/d67/da1/fea 3450777 0 2024-09-17T07:20:02.336 INFO:tasks.workunit.client.0.smithi087.stdout:6/906: dread d1/d6/f1f [0,4194304] 0 2024-09-17T07:20:02.336 INFO:tasks.workunit.client.1.smithi139.stdout:4/584: mkdir d0/db/db2/db5 0 2024-09-17T07:20:02.337 INFO:tasks.workunit.client.0.smithi087.stdout:4/852: symlink d2/d92/d4d/d21/d2f/d3b/d7e/d97/l12c 0 2024-09-17T07:20:02.338 INFO:tasks.workunit.client.1.smithi139.stdout:6/728: getdents db/df/d4e/d64/d56/d98 0 2024-09-17T07:20:02.338 INFO:tasks.workunit.client.0.smithi087.stdout:7/608: dwrite d0/d3/d23/d17/f47 [0,4194304] 0 2024-09-17T07:20:02.338 INFO:tasks.workunit.client.0.smithi087.stdout:3/806: dwrite d6/d1b/d42/dd4/f82 [0,4194304] 0 2024-09-17T07:20:02.339 INFO:tasks.workunit.client.0.smithi087.stdout:1/732: truncate d2/dc/f3b 366491 0 2024-09-17T07:20:02.340 INFO:tasks.workunit.client.1.smithi139.stdout:2/724: creat d0/dc/d15/d9f/dc1/de4/ff4 x:0 0 0 2024-09-17T07:20:02.340 INFO:tasks.workunit.client.1.smithi139.stdout:3/647: dread d5/d21/f4e [0,4194304] 0 2024-09-17T07:20:02.341 INFO:tasks.workunit.client.1.smithi139.stdout:9/936: write dc/d2a/f8a [1131114,85631] 0 2024-09-17T07:20:02.344 INFO:tasks.workunit.client.0.smithi087.stdout:3/807: symlink d6/d1b/df6/l11f 0 2024-09-17T07:20:02.345 INFO:tasks.workunit.client.1.smithi139.stdout:2/725: creat d0/dc/d15/ff5 x:0 0 0 2024-09-17T07:20:02.346 INFO:tasks.workunit.client.0.smithi087.stdout:7/609: symlink d0/d3/d10/d32/d62/d76/lb6 0 2024-09-17T07:20:02.347 INFO:tasks.workunit.client.1.smithi139.stdout:4/585: dwrite d0/d1/d29/fa4 [0,4194304] 0 2024-09-17T07:20:02.347 INFO:tasks.workunit.client.1.smithi139.stdout:6/729: dread db/df/d4e/d5e/fa8 [0,4194304] 0 2024-09-17T07:20:02.348 INFO:tasks.workunit.client.0.smithi087.stdout:1/733: symlink d2/d3d/d35/d57/d6a/l100 0 2024-09-17T07:20:02.352 INFO:tasks.workunit.client.0.smithi087.stdout:4/853: rename d2/d92/f65 to d2/d22/d2c/d91/dcf/f12d 0 2024-09-17T07:20:02.353 INFO:tasks.workunit.client.1.smithi139.stdout:9/937: symlink dc/d11/d52/d56/d7a/l136 0 2024-09-17T07:20:02.355 INFO:tasks.workunit.client.0.smithi087.stdout:1/734: mkdir d2/dcf/d7e/db9/dfb/d101 0 2024-09-17T07:20:02.356 INFO:tasks.workunit.client.1.smithi139.stdout:2/726: mknod d0/d7/d86/da4/d12/d8c/cf6 0 2024-09-17T07:20:02.357 INFO:tasks.workunit.client.0.smithi087.stdout:7/610: creat d0/d3/d10/fb7 x:0 0 0 2024-09-17T07:20:02.358 INFO:tasks.workunit.client.1.smithi139.stdout:4/586: write d0/d1/d29/f66 [3304816,54636] 0 2024-09-17T07:20:02.358 INFO:tasks.workunit.client.1.smithi139.stdout:6/730: mkdir db/d18/d1b/dfa 0 2024-09-17T07:20:02.358 INFO:tasks.workunit.client.0.smithi087.stdout:4/854: symlink d2/d92/d4d/d21/dfa/d108/l12e 0 2024-09-17T07:20:02.359 INFO:tasks.workunit.client.0.smithi087.stdout:7/611: chown d0/d3/d23/d17/d7b/dad/daf 2 1 2024-09-17T07:20:02.360 INFO:tasks.workunit.client.0.smithi087.stdout:1/735: creat d2/dcf/d7e/db9/dfb/d101/f102 x:0 0 0 2024-09-17T07:20:02.360 INFO:tasks.workunit.client.0.smithi087.stdout:8/760: dread d1/d2b/f6c [0,4194304] 0 2024-09-17T07:20:02.362 INFO:tasks.workunit.client.1.smithi139.stdout:2/727: mknod d0/d7/d86/da4/cf7 0 2024-09-17T07:20:02.362 INFO:tasks.workunit.client.0.smithi087.stdout:4/855: mkdir d2/d22/d2c/d12f 0 2024-09-17T07:20:02.363 INFO:tasks.workunit.client.1.smithi139.stdout:3/648: dread d5/d15/d16/d4c/f68 [0,4194304] 0 2024-09-17T07:20:02.364 INFO:tasks.workunit.client.1.smithi139.stdout:3/649: chown d5/d63/db3 0 1 2024-09-17T07:20:02.365 INFO:tasks.workunit.client.1.smithi139.stdout:6/731: mkdir db/d18/d1b/dfb 0 2024-09-17T07:20:02.366 INFO:tasks.workunit.client.1.smithi139.stdout:2/728: mkdir d0/df8 0 2024-09-17T07:20:02.368 INFO:tasks.workunit.client.1.smithi139.stdout:3/650: rename d5/d15/d16/d4c/d28/f89 to d5/d15/fcf 0 2024-09-17T07:20:02.370 INFO:tasks.workunit.client.0.smithi087.stdout:4/856: stat d2/d92/d4f/d6a/d9d/fa4 0 2024-09-17T07:20:02.372 INFO:tasks.workunit.client.0.smithi087.stdout:7/612: creat d0/d3/d23/d17/d7b/dad/daf/fb8 x:0 0 0 2024-09-17T07:20:02.373 INFO:tasks.workunit.client.0.smithi087.stdout:8/761: dread d1/d2b/df4/f7b [0,4194304] 0 2024-09-17T07:20:02.374 INFO:tasks.workunit.client.1.smithi139.stdout:3/651: rename d5/d21/d23/c61 to d5/d15/d56/cd0 0 2024-09-17T07:20:02.375 INFO:tasks.workunit.client.1.smithi139.stdout:2/729: dread d0/d3b/fa9 [0,4194304] 0 2024-09-17T07:20:02.376 INFO:tasks.workunit.client.0.smithi087.stdout:4/857: readlink d2/d92/d4d/d21/d2f/d3b/lae 0 2024-09-17T07:20:02.376 INFO:tasks.workunit.client.1.smithi139.stdout:2/730: stat d0/dc/d15/d9f 0 2024-09-17T07:20:02.377 INFO:tasks.workunit.client.0.smithi087.stdout:6/907: dwrite d1/d67/dfe/d2c/d48/d62/fa4 [0,4194304] 0 2024-09-17T07:20:02.378 INFO:tasks.workunit.client.0.smithi087.stdout:8/762: fdatasync d1/d2b/f6c 0 2024-09-17T07:20:02.379 INFO:tasks.workunit.client.1.smithi139.stdout:3/652: getdents d5/d21/d23/d69 0 2024-09-17T07:20:02.379 INFO:tasks.workunit.client.0.smithi087.stdout:4/858: chown d2/d92/d86/fef 6398002 1 2024-09-17T07:20:02.380 INFO:tasks.workunit.client.1.smithi139.stdout:2/731: creat d0/dc/d15/d9f/dc1/de4/ff9 x:0 0 0 2024-09-17T07:20:02.382 INFO:tasks.workunit.client.1.smithi139.stdout:3/653: write d5/d21/d23/d38/f5f [473518,39877] 0 2024-09-17T07:20:02.382 INFO:tasks.workunit.client.1.smithi139.stdout:9/938: dwrite dc/d11/d15/d3c/d61/d64/d96/db6/fd6 [0,4194304] 0 2024-09-17T07:20:02.383 INFO:tasks.workunit.client.0.smithi087.stdout:7/613: rename d0/d3/d10/d31/c6e to d0/d36/db3/cb9 0 2024-09-17T07:20:02.383 INFO:tasks.workunit.client.1.smithi139.stdout:2/732: mkdir d0/de/d69/dfa 0 2024-09-17T07:20:02.386 INFO:tasks.workunit.client.1.smithi139.stdout:9/939: chown dc/d11/d52/ffa 6986582 1 2024-09-17T07:20:02.388 INFO:tasks.workunit.client.0.smithi087.stdout:8/763: creat d1/f109 x:0 0 0 2024-09-17T07:20:02.388 INFO:tasks.workunit.client.0.smithi087.stdout:1/736: dwrite d2/dcf/f4d [0,4194304] 0 2024-09-17T07:20:02.389 INFO:tasks.workunit.client.1.smithi139.stdout:2/733: readlink d0/de/d25/d3f/l6b 0 2024-09-17T07:20:02.389 INFO:tasks.workunit.client.1.smithi139.stdout:2/734: chown d0/dc/d15/cf1 8155612 1 2024-09-17T07:20:02.390 INFO:tasks.workunit.client.1.smithi139.stdout:2/735: chown d0/d7/l75 49 1 2024-09-17T07:20:02.391 INFO:tasks.workunit.client.1.smithi139.stdout:2/736: write d0/d7/d86/da4/d12/dcd/fe8 [335658,80481] 0 2024-09-17T07:20:02.393 INFO:tasks.workunit.client.0.smithi087.stdout:8/764: read - d1/d7/d9/d19/d1b/d18/fc9 zero size 2024-09-17T07:20:02.395 INFO:tasks.workunit.client.0.smithi087.stdout:6/908: write d1/d6/f61 [734549,126627] 0 2024-09-17T07:20:02.396 INFO:tasks.workunit.client.0.smithi087.stdout:4/859: write d2/d92/d4d/d21/d2f/d3b/d7e/d97/f12b [1731906,64045] 0 2024-09-17T07:20:02.397 INFO:tasks.workunit.client.0.smithi087.stdout:3/808: dread d6/fa [0,4194304] 0 2024-09-17T07:20:02.400 INFO:tasks.workunit.client.0.smithi087.stdout:1/737: rename d2/d3d/d35/d4f/da5/dce/ffc to d2/d3d/d45/d90/d37/f103 0 2024-09-17T07:20:02.400 INFO:tasks.workunit.client.0.smithi087.stdout:7/614: dwrite d0/f28 [0,4194304] 0 2024-09-17T07:20:02.404 INFO:tasks.workunit.client.0.smithi087.stdout:8/765: symlink d1/d2b/l10a 0 2024-09-17T07:20:02.407 INFO:tasks.workunit.client.0.smithi087.stdout:6/909: mknod d1/d67/dfe/d2c/d40/c131 0 2024-09-17T07:20:02.408 INFO:tasks.workunit.client.0.smithi087.stdout:1/738: write d2/d3d/d45/d90/d37/f103 [694558,113245] 0 2024-09-17T07:20:02.409 INFO:tasks.workunit.client.0.smithi087.stdout:1/739: chown d2/d3d/d35/d4f/cad 61 1 2024-09-17T07:20:02.410 INFO:tasks.workunit.client.0.smithi087.stdout:4/860: unlink d2/d92/d4d/d21/d2f/d3b/c43 0 2024-09-17T07:20:02.411 INFO:tasks.workunit.client.0.smithi087.stdout:1/740: write d2/d3d/d35/fde [289003,3896] 0 2024-09-17T07:20:02.412 INFO:tasks.workunit.client.0.smithi087.stdout:3/809: rename d6/d15/d37/d5e to d6/d15/d37/d3c/d52/db2/d10a/d11b/d120 0 2024-09-17T07:20:02.413 INFO:tasks.workunit.client.0.smithi087.stdout:8/766: mknod d1/d7/d9/c10b 0 2024-09-17T07:20:02.414 INFO:tasks.workunit.client.0.smithi087.stdout:6/910: mkdir d1/d67/dfe/d2c/d48/d118/d132 0 2024-09-17T07:20:02.414 INFO:tasks.workunit.client.0.smithi087.stdout:3/810: chown d6/d15/d37/d3c/d52/db2/de7/c32 0 1 2024-09-17T07:20:02.415 INFO:tasks.workunit.client.0.smithi087.stdout:4/861: unlink d2/d92/d4d/d42/db6/dd9/fdc 0 2024-09-17T07:20:02.415 INFO:tasks.workunit.client.0.smithi087.stdout:8/767: chown d1/d2b/d21/cdc 25518323 1 2024-09-17T07:20:02.416 INFO:tasks.workunit.client.0.smithi087.stdout:6/911: chown d1/d67/dfe/d2c/d58/d90/c10c 6 1 2024-09-17T07:20:02.417 INFO:tasks.workunit.client.0.smithi087.stdout:1/741: rmdir d2/d3d/d45/d90/d43/d5d 39 2024-09-17T07:20:02.417 INFO:tasks.workunit.client.0.smithi087.stdout:7/615: dread d0/d3/d23/f60 [0,4194304] 0 2024-09-17T07:20:02.418 INFO:tasks.workunit.client.0.smithi087.stdout:4/862: dread - d2/d92/d86/fef zero size 2024-09-17T07:20:02.419 INFO:tasks.workunit.client.0.smithi087.stdout:6/912: readlink d1/l9 0 2024-09-17T07:20:02.420 INFO:tasks.workunit.client.0.smithi087.stdout:8/768: creat d1/d7/d9/d27/da1/f10c x:0 0 0 2024-09-17T07:20:02.421 INFO:tasks.workunit.client.0.smithi087.stdout:6/913: write d1/d67/dfe/d2c/d58/f12b [105219,101949] 0 2024-09-17T07:20:02.422 INFO:tasks.workunit.client.0.smithi087.stdout:3/811: rename d6/d1b/d42/d6e/db0/lb6 to d6/d1b/d42/d6e/db0/l121 0 2024-09-17T07:20:02.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:02 smithi087 ceph-mon[27636]: pgmap v14: 65 pgs: 65 active+clean; 3.0 GiB data, 9.9 GiB used, 527 GiB / 536 GiB avail; 116 MiB/s rd, 389 MiB/s wr, 744 op/s 2024-09-17T07:20:02.428 INFO:tasks.workunit.client.0.smithi087.stdout:8/769: write d1/d2b/d21/dd4/f104 [88582,78028] 0 2024-09-17T07:20:02.431 INFO:tasks.workunit.client.0.smithi087.stdout:6/914: write d1/d67/dfe/d2c/d48/d62/fa4 [2472695,81055] 0 2024-09-17T07:20:02.432 INFO:tasks.workunit.client.0.smithi087.stdout:3/812: creat d6/d15/d37/d3c/d52/db2/de7/ddd/f122 x:0 0 0 2024-09-17T07:20:02.434 INFO:tasks.workunit.client.0.smithi087.stdout:1/742: dwrite d2/d3d/d45/fe5 [0,4194304] 0 2024-09-17T07:20:02.436 INFO:tasks.workunit.client.0.smithi087.stdout:7/616: dwrite d0/d3/d10/d87/d96/f9d [4194304,4194304] 0 2024-09-17T07:20:02.437 INFO:tasks.workunit.client.0.smithi087.stdout:8/770: creat d1/d2b/d21/d6d/f10d x:0 0 0 2024-09-17T07:20:02.437 INFO:tasks.workunit.client.0.smithi087.stdout:6/915: write d1/d6a/fec [130049,89388] 0 2024-09-17T07:20:02.439 INFO:tasks.workunit.client.0.smithi087.stdout:3/813: mkdir d6/d1b/d42/dd4/d123 0 2024-09-17T07:20:02.443 INFO:tasks.workunit.client.0.smithi087.stdout:1/743: symlink d2/d3d/d8e/l104 0 2024-09-17T07:20:02.444 INFO:tasks.workunit.client.0.smithi087.stdout:7/617: creat d0/d3/d23/d17/d7b/fba x:0 0 0 2024-09-17T07:20:02.445 INFO:tasks.workunit.client.0.smithi087.stdout:3/814: mknod d6/d15/d92/c124 0 2024-09-17T07:20:02.446 INFO:tasks.workunit.client.0.smithi087.stdout:4/863: dwrite d2/d5/d1f/f5e [0,4194304] 0 2024-09-17T07:20:02.447 INFO:tasks.workunit.client.0.smithi087.stdout:2/720: sync 2024-09-17T07:20:02.449 INFO:tasks.workunit.client.0.smithi087.stdout:3/815: write d6/d15/d37/d3c/d43/fb4 [2591235,29317] 0 2024-09-17T07:20:02.451 INFO:tasks.workunit.client.0.smithi087.stdout:7/618: mkdir d0/dbb 0 2024-09-17T07:20:02.452 INFO:tasks.workunit.client.0.smithi087.stdout:1/744: symlink d2/d69/d8d/l105 0 2024-09-17T07:20:02.454 INFO:tasks.workunit.client.0.smithi087.stdout:3/816: mkdir d6/d15/d37/d3c/d52/d125 0 2024-09-17T07:20:02.456 INFO:tasks.workunit.client.0.smithi087.stdout:6/916: dwrite d1/d6/d68/ffa [0,4194304] 0 2024-09-17T07:20:02.457 INFO:tasks.workunit.client.0.smithi087.stdout:8/771: dwrite d1/d2b/d21/d6d/f100 [0,4194304] 0 2024-09-17T07:20:02.457 INFO:tasks.workunit.client.0.smithi087.stdout:4/864: creat d2/d92/d4d/d21/d2f/f130 x:0 0 0 2024-09-17T07:20:02.461 INFO:tasks.workunit.client.0.smithi087.stdout:4/865: truncate d2/d5/f100 620067 0 2024-09-17T07:20:02.461 INFO:tasks.workunit.client.0.smithi087.stdout:3/817: creat d6/d1b/d42/d6e/db0/f126 x:0 0 0 2024-09-17T07:20:02.464 INFO:tasks.workunit.client.0.smithi087.stdout:6/917: creat d1/d67/ddc/de5/f133 x:0 0 0 2024-09-17T07:20:02.466 INFO:tasks.workunit.client.0.smithi087.stdout:8/772: chown d1/d2b/d21/d6d/d6f/lc8 34567 1 2024-09-17T07:20:02.466 INFO:tasks.workunit.client.0.smithi087.stdout:6/918: write d1/f113 [2517334,52001] 0 2024-09-17T07:20:02.467 INFO:tasks.workunit.client.0.smithi087.stdout:3/818: creat d6/d1b/d42/d6e/db0/f127 x:0 0 0 2024-09-17T07:20:02.470 INFO:tasks.workunit.client.0.smithi087.stdout:8/773: creat d1/d7/d9/d19/d4d/f10e x:0 0 0 2024-09-17T07:20:02.472 INFO:tasks.workunit.client.0.smithi087.stdout:4/866: rename d2/d92/d4d/d2d/cfb to d2/d92/d4d/d42/db6/c131 0 2024-09-17T07:20:02.474 INFO:tasks.workunit.client.0.smithi087.stdout:4/867: chown d2/d22/d95/c123 63557174 1 2024-09-17T07:20:02.476 INFO:tasks.workunit.client.0.smithi087.stdout:4/868: dread d2/d92/d4d/f11c [0,4194304] 0 2024-09-17T07:20:02.477 INFO:tasks.workunit.client.0.smithi087.stdout:4/869: write d2/d5/f26 [2084521,35666] 0 2024-09-17T07:20:02.482 INFO:tasks.workunit.client.0.smithi087.stdout:4/870: link d2/d5/d1f/f20 d2/d5/d1f/da7/f132 0 2024-09-17T07:20:02.484 INFO:tasks.workunit.client.0.smithi087.stdout:4/871: symlink d2/d92/d4d/d21/d2f/d6e/deb/l133 0 2024-09-17T07:20:02.486 INFO:tasks.workunit.client.0.smithi087.stdout:4/872: truncate d2/d5/d1f/f68 4246877 0 2024-09-17T07:20:02.488 INFO:tasks.workunit.client.1.smithi139.stdout:8/808: sync 2024-09-17T07:20:02.489 INFO:tasks.workunit.client.0.smithi087.stdout:7/619: dread d0/d3/d10/f14 [0,4194304] 0 2024-09-17T07:20:02.491 INFO:tasks.workunit.client.0.smithi087.stdout:4/873: getdents d2/d22/d2c/d91/dcf 0 2024-09-17T07:20:02.492 INFO:tasks.workunit.client.0.smithi087.stdout:7/620: chown d0/d3/d23/d4e/laa 2488 1 2024-09-17T07:20:02.492 INFO:tasks.workunit.client.0.smithi087.stdout:4/874: chown d2/d92/d4d/d21/d2f/d6e/deb 26 1 2024-09-17T07:20:02.495 INFO:tasks.workunit.client.1.smithi139.stdout:6/732: write db/d18/f4a [1614543,3845] 0 2024-09-17T07:20:02.495 INFO:tasks.workunit.client.0.smithi087.stdout:7/621: mknod d0/cbc 0 2024-09-17T07:20:02.495 INFO:tasks.workunit.client.0.smithi087.stdout:4/875: mkdir d2/d22/d134 0 2024-09-17T07:20:02.498 INFO:tasks.workunit.client.0.smithi087.stdout:4/876: read d2/d5/f26 [3490124,87039] 0 2024-09-17T07:20:02.498 INFO:tasks.workunit.client.0.smithi087.stdout:3/819: dread d6/d15/d4b/f8b [0,4194304] 0 2024-09-17T07:20:02.500 INFO:tasks.workunit.client.0.smithi087.stdout:7/622: truncate d0/d3/d23/d4e/f70 1104551 0 2024-09-17T07:20:02.501 INFO:tasks.workunit.client.1.smithi139.stdout:3/654: write d5/f11 [3160431,39579] 0 2024-09-17T07:20:02.501 INFO:tasks.workunit.client.0.smithi087.stdout:4/877: creat d2/d92/d4f/d6a/d9d/f135 x:0 0 0 2024-09-17T07:20:02.503 INFO:tasks.workunit.client.1.smithi139.stdout:4/587: dwrite d0/d1/d9b/fac [0,4194304] 0 2024-09-17T07:20:02.503 INFO:tasks.workunit.client.0.smithi087.stdout:3/820: fdatasync d6/d15/d37/f55 0 2024-09-17T07:20:02.506 INFO:tasks.workunit.client.0.smithi087.stdout:4/878: mkdir d2/d92/d4d/d21/d2f/d6e/d136 0 2024-09-17T07:20:02.507 INFO:tasks.workunit.client.1.smithi139.stdout:4/588: chown d0/d1/d29/f66 605 1 2024-09-17T07:20:02.509 INFO:tasks.workunit.client.0.smithi087.stdout:4/879: chown d2/d92/d4f/d7b/lc7 967729 1 2024-09-17T07:20:02.510 INFO:tasks.workunit.client.1.smithi139.stdout:3/655: dwrite d5/f11 [0,4194304] 0 2024-09-17T07:20:02.513 INFO:tasks.workunit.client.0.smithi087.stdout:3/821: dwrite d6/d1b/d42/d62/dc1/de8/fc3 [0,4194304] 0 2024-09-17T07:20:02.515 INFO:tasks.workunit.client.0.smithi087.stdout:7/623: link d0/d36/db3/cb9 d0/d3/d10/d87/d96/db2/cbd 0 2024-09-17T07:20:02.516 INFO:tasks.workunit.client.1.smithi139.stdout:3/656: dread d5/d15/d56/f7c [0,4194304] 0 2024-09-17T07:20:02.518 INFO:tasks.workunit.client.1.smithi139.stdout:3/657: chown d5/da7/dca/c95 150201 1 2024-09-17T07:20:02.519 INFO:tasks.workunit.client.0.smithi087.stdout:4/880: getdents d2/d22/d134 0 2024-09-17T07:20:02.521 INFO:tasks.workunit.client.1.smithi139.stdout:2/737: creat d0/de/ffb x:0 0 0 2024-09-17T07:20:02.522 INFO:tasks.workunit.client.0.smithi087.stdout:4/881: truncate d2/d92/d74/fdb 493549 0 2024-09-17T07:20:02.524 INFO:tasks.workunit.client.0.smithi087.stdout:7/624: dwrite d0/d3/d10/d87/d96/f9d [0,4194304] 0 2024-09-17T07:20:02.526 INFO:tasks.workunit.client.1.smithi139.stdout:4/589: truncate d0/db/d58/f73 21015 0 2024-09-17T07:20:02.526 INFO:tasks.workunit.client.0.smithi087.stdout:7/625: write d0/d3/d23/d17/d7b/dad/d89/fa7 [2136566,60420] 0 2024-09-17T07:20:02.528 INFO:tasks.workunit.client.1.smithi139.stdout:2/738: fsync d0/de/d69/f74 0 2024-09-17T07:20:02.529 INFO:tasks.workunit.client.0.smithi087.stdout:4/882: symlink d2/d92/d4d/d21/d2f/l137 0 2024-09-17T07:20:02.531 INFO:tasks.workunit.client.1.smithi139.stdout:4/590: write d0/f82 [701669,57216] 0 2024-09-17T07:20:02.533 INFO:tasks.workunit.client.1.smithi139.stdout:3/658: link d5/f11 d5/d15/d16/d4c/d28/d54/d58/fd1 0 2024-09-17T07:20:02.536 INFO:tasks.workunit.client.0.smithi087.stdout:1/745: dwrite d2/d48/d61/f8c [0,4194304] 0 2024-09-17T07:20:02.537 INFO:tasks.workunit.client.1.smithi139.stdout:4/591: chown d0/db/f35 3432 1 2024-09-17T07:20:02.537 INFO:tasks.workunit.client.1.smithi139.stdout:6/733: dwrite f8 [0,4194304] 0 2024-09-17T07:20:02.537 INFO:tasks.workunit.client.1.smithi139.stdout:4/592: dread - d0/f4c zero size 2024-09-17T07:20:02.538 INFO:tasks.workunit.client.0.smithi087.stdout:4/883: mknod d2/d92/d4d/d21/d2f/d3b/d7e/c138 0 2024-09-17T07:20:02.538 INFO:tasks.workunit.client.1.smithi139.stdout:4/593: chown d0/db/d7f/f94 0 1 2024-09-17T07:20:02.540 INFO:tasks.workunit.client.1.smithi139.stdout:4/594: chown d0/d1/d29 98385103 1 2024-09-17T07:20:02.540 INFO:tasks.workunit.client.1.smithi139.stdout:6/734: creat db/d21/d96/df4/ffc x:0 0 0 2024-09-17T07:20:02.541 INFO:tasks.workunit.client.1.smithi139.stdout:2/739: dread d0/de/d69/f6a [0,4194304] 0 2024-09-17T07:20:02.541 INFO:tasks.workunit.client.1.smithi139.stdout:2/740: stat d0 0 2024-09-17T07:20:02.544 INFO:tasks.workunit.client.0.smithi087.stdout:8/774: dwrite d1/d2b/f42 [0,4194304] 0 2024-09-17T07:20:02.545 INFO:tasks.workunit.client.0.smithi087.stdout:8/775: fdatasync d1/d2b/d21/dd4/f104 0 2024-09-17T07:20:02.545 INFO:tasks.workunit.client.1.smithi139.stdout:4/595: chown d0/d1/d29/d6a 7112790 1 2024-09-17T07:20:02.546 INFO:tasks.workunit.client.1.smithi139.stdout:3/659: read d5/d15/d16/d4c/d28/f30 [1263016,118696] 0 2024-09-17T07:20:02.546 INFO:tasks.workunit.client.1.smithi139.stdout:6/735: mknod db/d21/d96/df4/cfd 0 2024-09-17T07:20:02.547 INFO:tasks.workunit.client.0.smithi087.stdout:8/776: unlink d1/d2b/d3b/l79 0 2024-09-17T07:20:02.548 INFO:tasks.workunit.client.0.smithi087.stdout:8/777: chown d1/d7/fdb 2066 1 2024-09-17T07:20:02.549 INFO:tasks.workunit.client.0.smithi087.stdout:8/778: truncate d1/d2b/d21/d6d/ffc 9277525 0 2024-09-17T07:20:02.550 INFO:tasks.workunit.client.1.smithi139.stdout:3/660: truncate d5/d15/fcf 1058435 0 2024-09-17T07:20:02.550 INFO:tasks.workunit.client.0.smithi087.stdout:8/779: fsync d1/d2b/d21/d6d/d6f/f82 0 2024-09-17T07:20:02.551 INFO:tasks.workunit.client.1.smithi139.stdout:4/596: mkdir d0/d1/d29/d6a/db6 0 2024-09-17T07:20:02.552 INFO:tasks.workunit.client.0.smithi087.stdout:8/780: mknod d1/d7/d63/c10f 0 2024-09-17T07:20:02.552 INFO:tasks.workunit.client.1.smithi139.stdout:2/741: dread d0/de/d69/f6a [0,4194304] 0 2024-09-17T07:20:02.553 INFO:tasks.workunit.client.0.smithi087.stdout:8/781: truncate d1/d2b/f29 4826660 0 2024-09-17T07:20:02.553 INFO:tasks.workunit.client.1.smithi139.stdout:6/736: rename db/df/d73/d81/fe2 to db/d18/d9f/ffe 0 2024-09-17T07:20:02.555 INFO:tasks.workunit.client.1.smithi139.stdout:3/661: write d5/d15/fcf [637755,89939] 0 2024-09-17T07:20:02.555 INFO:tasks.workunit.client.0.smithi087.stdout:8/782: creat d1/d2b/df4/d54/f110 x:0 0 0 2024-09-17T07:20:02.556 INFO:tasks.workunit.client.1.smithi139.stdout:4/597: creat d0/d37/fb7 x:0 0 0 2024-09-17T07:20:02.558 INFO:tasks.workunit.client.0.smithi087.stdout:8/783: symlink d1/d7/d63/dd9/l111 0 2024-09-17T07:20:02.558 INFO:tasks.workunit.client.1.smithi139.stdout:2/742: write d0/de/df/d56/fe6 [691444,68589] 0 2024-09-17T07:20:02.558 INFO:tasks.workunit.client.1.smithi139.stdout:3/662: truncate d5/da7/fac 278214 0 2024-09-17T07:20:02.559 INFO:tasks.workunit.client.1.smithi139.stdout:6/737: creat db/df/d4e/d64/d56/fff x:0 0 0 2024-09-17T07:20:02.560 INFO:tasks.workunit.client.1.smithi139.stdout:6/738: fsync db/df/f13 0 2024-09-17T07:20:02.564 INFO:tasks.workunit.client.1.smithi139.stdout:4/598: dwrite d0/f9e [0,4194304] 0 2024-09-17T07:20:02.569 INFO:tasks.workunit.client.1.smithi139.stdout:4/599: mknod d0/d1/d29/d41/dad/cb8 0 2024-09-17T07:20:02.571 INFO:tasks.workunit.client.1.smithi139.stdout:4/600: mknod d0/d10/cb9 0 2024-09-17T07:20:02.573 INFO:tasks.workunit.client.1.smithi139.stdout:4/601: symlink d0/db/d58/lba 0 2024-09-17T07:20:02.576 INFO:tasks.workunit.client.0.smithi087.stdout:8/784: dread d1/d7/d9/d19/d1b/f43 [0,4194304] 0 2024-09-17T07:20:02.576 INFO:tasks.workunit.client.1.smithi139.stdout:4/602: creat d0/d1/d29/d41/fbb x:0 0 0 2024-09-17T07:20:02.577 INFO:tasks.workunit.client.0.smithi087.stdout:8/785: stat d1/d7/d9/d19/fb9 0 2024-09-17T07:20:02.585 INFO:tasks.workunit.client.0.smithi087.stdout:4/884: truncate d2/d5/d1f/f20 2413043 0 2024-09-17T07:20:02.588 INFO:tasks.workunit.client.0.smithi087.stdout:4/885: creat d2/d92/d4d/d21/f139 x:0 0 0 2024-09-17T07:20:02.589 INFO:tasks.workunit.client.0.smithi087.stdout:8/786: dread d1/d2b/f29 [0,4194304] 0 2024-09-17T07:20:02.591 INFO:tasks.workunit.client.0.smithi087.stdout:4/886: creat d2/d22/d95/f13a x:0 0 0 2024-09-17T07:20:02.592 INFO:tasks.workunit.client.0.smithi087.stdout:8/787: unlink d1/d7/d9/d19/d73/f9e 0 2024-09-17T07:20:02.595 INFO:tasks.workunit.client.1.smithi139.stdout:8/809: write d0/d20/d28/d52/fb7 [1248619,17447] 0 2024-09-17T07:20:02.599 INFO:tasks.workunit.client.1.smithi139.stdout:8/810: symlink d0/d20/d28/d52/d65/d7f/db6/l104 0 2024-09-17T07:20:02.604 INFO:tasks.workunit.client.0.smithi087.stdout:7/626: write d0/d3/d23/f53 [3686759,96765] 0 2024-09-17T07:20:02.604 INFO:tasks.workunit.client.1.smithi139.stdout:3/663: write d5/d15/d20/fb2 [193341,96076] 0 2024-09-17T07:20:02.604 INFO:tasks.workunit.client.1.smithi139.stdout:2/743: write d0/de/df/d56/f7a [1536796,2284] 0 2024-09-17T07:20:02.608 INFO:tasks.workunit.client.1.smithi139.stdout:3/664: read d5/d21/d23/d38/f40 [3064739,90149] 0 2024-09-17T07:20:02.609 INFO:tasks.workunit.client.0.smithi087.stdout:7/627: chown d0/f6 11 1 2024-09-17T07:20:02.610 INFO:tasks.workunit.client.0.smithi087.stdout:1/746: dwrite d2/d3d/d35/d57/f89 [0,4194304] 0 2024-09-17T07:20:02.612 INFO:tasks.workunit.client.0.smithi087.stdout:1/747: dread - d2/d69/d8d/da6/fe4 zero size 2024-09-17T07:20:02.613 INFO:tasks.workunit.client.0.smithi087.stdout:7/628: creat d0/d3/d10/d32/d8c/fbe x:0 0 0 2024-09-17T07:20:02.613 INFO:tasks.workunit.client.1.smithi139.stdout:8/811: write d0/d20/f87 [4046268,85243] 0 2024-09-17T07:20:02.613 INFO:tasks.workunit.client.1.smithi139.stdout:3/665: write d5/d15/d16/d4c/d28/d54/d58/f8f [3104300,8741] 0 2024-09-17T07:20:02.613 INFO:tasks.workunit.client.1.smithi139.stdout:2/744: dwrite d0/d7/d67/d92/d99/f8f [4194304,4194304] 0 2024-09-17T07:20:02.616 INFO:tasks.workunit.client.1.smithi139.stdout:3/666: readlink d5/d15/d16/d4c/l2e 0 2024-09-17T07:20:02.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:02 smithi139 ceph-mon[34403]: pgmap v14: 65 pgs: 65 active+clean; 3.0 GiB data, 9.9 GiB used, 527 GiB / 536 GiB avail; 116 MiB/s rd, 389 MiB/s wr, 744 op/s 2024-09-17T07:20:02.616 INFO:tasks.workunit.client.0.smithi087.stdout:4/887: dread d2/d92/d4d/d21/f8f [0,4194304] 0 2024-09-17T07:20:02.618 INFO:tasks.workunit.client.0.smithi087.stdout:4/888: chown d2/d92/d4d/d21/d2f 5410 1 2024-09-17T07:20:02.618 INFO:tasks.workunit.client.1.smithi139.stdout:3/667: chown d5/d63/d6d/d6f/d81/fc9 0 1 2024-09-17T07:20:02.620 INFO:tasks.workunit.client.1.smithi139.stdout:4/603: rename d0/d1/d29/d41/f44 to d0/db/d7f/fbc 0 2024-09-17T07:20:02.622 INFO:tasks.workunit.client.1.smithi139.stdout:4/604: stat d0/d1/l99 0 2024-09-17T07:20:02.623 INFO:tasks.workunit.client.0.smithi087.stdout:7/629: dread d0/d3/f40 [0,4194304] 0 2024-09-17T07:20:02.625 INFO:tasks.workunit.client.0.smithi087.stdout:1/748: link d2/d3d/d45/c44 d2/d1a/c106 0 2024-09-17T07:20:02.627 INFO:tasks.workunit.client.1.smithi139.stdout:2/745: dwrite d0/dc/dc4/fee [0,4194304] 0 2024-09-17T07:20:02.627 INFO:tasks.workunit.client.0.smithi087.stdout:4/889: dwrite d2/d92/d4d/d21/d2f/d3b/f7d [0,4194304] 0 2024-09-17T07:20:02.627 INFO:tasks.workunit.client.0.smithi087.stdout:1/749: chown d2/dcf/d7e/c91 1 1 2024-09-17T07:20:02.627 INFO:tasks.workunit.client.1.smithi139.stdout:4/605: mknod d0/d1/d9b/d83/da9/cbd 0 2024-09-17T07:20:02.628 INFO:tasks.workunit.client.0.smithi087.stdout:1/750: write d2/d3d/d35/ffe [823396,14047] 0 2024-09-17T07:20:02.630 INFO:tasks.workunit.client.0.smithi087.stdout:4/890: truncate d2/d22/d62/fd0 149807 0 2024-09-17T07:20:02.632 INFO:tasks.workunit.client.0.smithi087.stdout:4/891: write d2/d92/f6f [3152739,92871] 0 2024-09-17T07:20:02.632 INFO:tasks.workunit.client.0.smithi087.stdout:1/751: fdatasync d2/d3d/d45/fe5 0 2024-09-17T07:20:02.632 INFO:tasks.workunit.client.1.smithi139.stdout:3/668: dwrite d5/d15/fcf [0,4194304] 0 2024-09-17T07:20:02.637 INFO:tasks.workunit.client.0.smithi087.stdout:1/752: creat d2/d3d/d35/d4f/da5/f107 x:0 0 0 2024-09-17T07:20:02.639 INFO:tasks.workunit.client.1.smithi139.stdout:2/746: rename d0/d7/d86/da4/d28/l9d to d0/de/d69/de1/lfc 0 2024-09-17T07:20:02.640 INFO:tasks.workunit.client.0.smithi087.stdout:1/753: mkdir d2/dc/d108 0 2024-09-17T07:20:02.642 INFO:tasks.workunit.client.1.smithi139.stdout:2/747: creat d0/dc/d15/d9f/dc1/ffd x:0 0 0 2024-09-17T07:20:02.643 INFO:tasks.workunit.client.1.smithi139.stdout:3/669: link d5/d15/d16/d4c/d28/l91 d5/d63/d6d/ld2 0 2024-09-17T07:20:02.643 INFO:tasks.workunit.client.1.smithi139.stdout:2/748: dread - d0/de/df/d56/fb3 zero size 2024-09-17T07:20:02.644 INFO:tasks.workunit.client.0.smithi087.stdout:1/754: unlink d2/d3d/d45/d90/d37/f87 0 2024-09-17T07:20:02.645 INFO:tasks.workunit.client.1.smithi139.stdout:2/749: write d0/de/df/d56/f7a [2948703,7148] 0 2024-09-17T07:20:02.648 INFO:tasks.workunit.client.1.smithi139.stdout:2/750: dread d0/d4e/fc6 [0,4194304] 0 2024-09-17T07:20:02.648 INFO:tasks.workunit.client.1.smithi139.stdout:3/670: fsync d5/f64 0 2024-09-17T07:20:02.649 INFO:tasks.workunit.client.1.smithi139.stdout:3/671: fdatasync d5/d15/d16/d4c/f9a 0 2024-09-17T07:20:02.651 INFO:tasks.workunit.client.1.smithi139.stdout:3/672: chown d5/da7/dca/l2f 5 1 2024-09-17T07:20:02.654 INFO:tasks.workunit.client.1.smithi139.stdout:8/812: dread d0/d1a/d3a/f42 [4194304,4194304] 0 2024-09-17T07:20:02.656 INFO:tasks.workunit.client.1.smithi139.stdout:2/751: rename d0/d7/d67/c7c to d0/df8/cfe 0 2024-09-17T07:20:02.657 INFO:tasks.workunit.client.1.smithi139.stdout:8/813: mkdir d0/d20/d28/d52/d65/dbe/d105 0 2024-09-17T07:20:02.664 INFO:tasks.workunit.client.1.smithi139.stdout:2/752: rename d0/d7/d86/l8b to d0/d7/d86/da4/lff 0 2024-09-17T07:20:02.665 INFO:tasks.workunit.client.1.smithi139.stdout:2/753: write d0/dc/dc4/fee [2719981,48039] 0 2024-09-17T07:20:02.665 INFO:tasks.workunit.client.1.smithi139.stdout:4/606: truncate d0/db/d7f/fbc 7288581 0 2024-09-17T07:20:02.665 INFO:tasks.workunit.client.0.smithi087.stdout:4/892: dread d2/fde [0,4194304] 0 2024-09-17T07:20:02.666 INFO:tasks.workunit.client.1.smithi139.stdout:2/754: write d0/de/ffb [635502,125939] 0 2024-09-17T07:20:02.667 INFO:tasks.workunit.client.0.smithi087.stdout:4/893: fsync d2/d22/d2c/d91/d113/f11a 0 2024-09-17T07:20:02.670 INFO:tasks.workunit.client.1.smithi139.stdout:2/755: unlink d0/de/d25/l33 0 2024-09-17T07:20:02.670 INFO:tasks.workunit.client.0.smithi087.stdout:4/894: creat d2/d5/d1f/da7/d11e/f13b x:0 0 0 2024-09-17T07:20:02.671 INFO:tasks.workunit.client.0.smithi087.stdout:4/895: stat d2/d22/d2c/d91/cb2 0 2024-09-17T07:20:02.671 INFO:tasks.workunit.client.1.smithi139.stdout:3/673: dread d5/d15/d56/f29 [0,4194304] 0 2024-09-17T07:20:02.672 INFO:tasks.workunit.client.1.smithi139.stdout:4/607: rename d0/d1a to d0/d1/dbe 0 2024-09-17T07:20:02.674 INFO:tasks.workunit.client.0.smithi087.stdout:4/896: link d2/d92/d4d/c14 d2/d92/d4f/d6a/d9d/c13c 0 2024-09-17T07:20:02.675 INFO:tasks.workunit.client.1.smithi139.stdout:2/756: rename d0/d4e/d76/fb7 to d0/de/d25/f100 0 2024-09-17T07:20:02.676 INFO:tasks.workunit.client.1.smithi139.stdout:3/674: mknod d5/d15/d16/cd3 0 2024-09-17T07:20:02.676 INFO:tasks.workunit.client.0.smithi087.stdout:4/897: creat d2/d92/d4d/d21/d2f/f13d x:0 0 0 2024-09-17T07:20:02.677 INFO:tasks.workunit.client.1.smithi139.stdout:3/675: write d5/da7/fac [994882,33735] 0 2024-09-17T07:20:02.678 INFO:tasks.workunit.client.0.smithi087.stdout:4/898: mknod d2/d92/d4d/d21/d2f/d3b/c13e 0 2024-09-17T07:20:02.680 INFO:tasks.workunit.client.1.smithi139.stdout:3/676: chown d5/d15/d16/d4c/c43 191200999 1 2024-09-17T07:20:02.681 INFO:tasks.workunit.client.1.smithi139.stdout:2/757: mknod d0/d4e/d76/d82/c101 0 2024-09-17T07:20:02.682 INFO:tasks.workunit.client.0.smithi087.stdout:1/755: dread d2/d14/fac [0,4194304] 0 2024-09-17T07:20:02.683 INFO:tasks.workunit.client.1.smithi139.stdout:2/758: dread - d0/de/d69/fd0 zero size 2024-09-17T07:20:02.685 INFO:tasks.workunit.client.1.smithi139.stdout:8/814: dwrite d0/d20/d28/d52/d65/d7f/db6/f4b [0,4194304] 0 2024-09-17T07:20:02.685 INFO:tasks.workunit.client.1.smithi139.stdout:2/759: chown d0/dc/d15/d9f/dc1/fe9 5640499 1 2024-09-17T07:20:02.685 INFO:tasks.workunit.client.0.smithi087.stdout:1/756: write d2/d48/d6f/ff1 [8822070,88266] 0 2024-09-17T07:20:02.686 INFO:tasks.workunit.client.0.smithi087.stdout:4/899: dwrite d2/d5/d1f/da7/d11e/f13b [0,4194304] 0 2024-09-17T07:20:02.687 INFO:tasks.workunit.client.1.smithi139.stdout:8/815: write d0/d20/d28/d52/d65/dbe/fe9 [669352,41121] 0 2024-09-17T07:20:02.689 INFO:tasks.workunit.client.0.smithi087.stdout:4/900: write d2/d5/d1f/fc6 [774040,80527] 0 2024-09-17T07:20:02.690 INFO:tasks.workunit.client.0.smithi087.stdout:1/757: creat d2/d48/d6f/f109 x:0 0 0 2024-09-17T07:20:02.691 INFO:tasks.workunit.client.1.smithi139.stdout:8/816: creat d0/d20/d28/d52/d99/f106 x:0 0 0 2024-09-17T07:20:02.691 INFO:tasks.workunit.client.1.smithi139.stdout:2/760: truncate d0/d7/d67/da1/fea 3847304 0 2024-09-17T07:20:02.694 INFO:tasks.workunit.client.1.smithi139.stdout:4/608: creat d0/d1/d29/d6a/fbf x:0 0 0 2024-09-17T07:20:02.695 INFO:tasks.workunit.client.0.smithi087.stdout:1/758: truncate d2/d3d/d45/d90/d43/fff 705649 0 2024-09-17T07:20:02.695 INFO:tasks.workunit.client.0.smithi087.stdout:4/901: rename d2/d92/d4d/d21/d2f/d3b/d7e/d97/da8/ce0 to d2/d92/d4d/d42/db6/c13f 0 2024-09-17T07:20:02.695 INFO:tasks.workunit.client.1.smithi139.stdout:8/817: creat d0/d1a/d3a/f107 x:0 0 0 2024-09-17T07:20:02.697 INFO:tasks.workunit.client.0.smithi087.stdout:1/759: write d2/d3d/d35/d4f/da5/f107 [552783,44480] 0 2024-09-17T07:20:02.698 INFO:tasks.workunit.client.0.smithi087.stdout:4/902: read d2/d92/d4d/d21/d2f/d3b/f80 [164570,81710] 0 2024-09-17T07:20:02.699 INFO:tasks.workunit.client.0.smithi087.stdout:1/760: write d2/d69/d8d/da6/fe4 [493853,123610] 0 2024-09-17T07:20:02.699 INFO:tasks.workunit.client.1.smithi139.stdout:2/761: link d0/de/d69/fd0 d0/de/d69/de1/f102 0 2024-09-17T07:20:02.699 INFO:tasks.workunit.client.1.smithi139.stdout:4/609: mknod d0/d49/cc0 0 2024-09-17T07:20:02.700 INFO:tasks.workunit.client.0.smithi087.stdout:1/761: chown d2/d3d/d35/d57/d6a 14360049 1 2024-09-17T07:20:02.700 INFO:tasks.workunit.client.0.smithi087.stdout:5/957: sync 2024-09-17T07:20:02.700 INFO:tasks.workunit.client.0.smithi087.stdout:0/962: sync 2024-09-17T07:20:02.700 INFO:tasks.workunit.client.0.smithi087.stdout:9/743: sync 2024-09-17T07:20:02.701 INFO:tasks.workunit.client.1.smithi139.stdout:2/762: dread d0/d3b/f64 [0,4194304] 0 2024-09-17T07:20:02.701 INFO:tasks.workunit.client.1.smithi139.stdout:3/677: dwrite d5/d15/f7a [0,4194304] 0 2024-09-17T07:20:02.702 INFO:tasks.workunit.client.0.smithi087.stdout:4/903: creat d2/d92/d86/f140 x:0 0 0 2024-09-17T07:20:02.702 INFO:tasks.workunit.client.0.smithi087.stdout:1/762: write d2/dcf/f4d [4478752,69112] 0 2024-09-17T07:20:02.702 INFO:tasks.workunit.client.1.smithi139.stdout:2/763: readlink d0/d7/d67/da1/lc9 0 2024-09-17T07:20:02.704 INFO:tasks.workunit.client.0.smithi087.stdout:5/958: symlink d5/d12/d14/d61/l12e 0 2024-09-17T07:20:02.705 INFO:tasks.workunit.client.0.smithi087.stdout:0/963: mkdir db/d14e 0 2024-09-17T07:20:02.706 INFO:tasks.workunit.client.0.smithi087.stdout:9/744: readlink d3/d25/dc1/ld5 0 2024-09-17T07:20:02.706 INFO:tasks.workunit.client.1.smithi139.stdout:2/764: mkdir d0/d7/d1a/d103 0 2024-09-17T07:20:02.707 INFO:tasks.workunit.client.0.smithi087.stdout:9/745: chown d3/d4/d6/d71/fcb 530002309 1 2024-09-17T07:20:02.709 INFO:tasks.workunit.client.1.smithi139.stdout:3/678: read d5/d15/d16/d4c/d28/db5/fcd [595150,25787] 0 2024-09-17T07:20:02.709 INFO:tasks.workunit.client.1.smithi139.stdout:2/765: dread d0/d3b/f64 [0,4194304] 0 2024-09-17T07:20:02.710 INFO:tasks.workunit.client.1.smithi139.stdout:3/679: write d5/d15/d16/d4c/f9a [3746957,29491] 0 2024-09-17T07:20:02.713 INFO:tasks.workunit.client.1.smithi139.stdout:3/680: mkdir d5/d15/d16/d4c/d28/d54/d58/dd4 0 2024-09-17T07:20:02.716 INFO:tasks.workunit.client.1.smithi139.stdout:3/681: rename d5/da7/dca/d97 to d5/d21/d23/d69/dd5 0 2024-09-17T07:20:02.716 INFO:tasks.workunit.client.1.smithi139.stdout:3/682: dread - d5/f39 zero size 2024-09-17T07:20:02.718 INFO:tasks.workunit.client.1.smithi139.stdout:3/683: write d5/d15/d16/d4c/f68 [1278307,113972] 0 2024-09-17T07:20:02.724 INFO:tasks.workunit.client.1.smithi139.stdout:8/818: dread d0/d20/d28/d52/d65/d7f/db6/f7a [0,4194304] 0 2024-09-17T07:20:02.726 INFO:tasks.workunit.client.1.smithi139.stdout:4/610: dread d0/db/d17/fa5 [0,4194304] 0 2024-09-17T07:20:02.726 INFO:tasks.workunit.client.1.smithi139.stdout:2/766: write d0/dc/d15/fbe [1468626,21542] 0 2024-09-17T07:20:02.727 INFO:tasks.workunit.client.0.smithi087.stdout:1/763: dread d2/d3d/d45/fc6 [0,4194304] 0 2024-09-17T07:20:02.728 INFO:tasks.workunit.client.1.smithi139.stdout:8/819: creat d0/d1a/d3a/d8d/d102/f108 x:0 0 0 2024-09-17T07:20:02.729 INFO:tasks.workunit.client.1.smithi139.stdout:3/684: rename d5/d15/d16/d4c to d5/da7/dca/dab/dd6 0 2024-09-17T07:20:02.729 INFO:tasks.workunit.client.1.smithi139.stdout:2/767: read d0/d7/d67/d92/d99/f4f [851115,124979] 0 2024-09-17T07:20:02.730 INFO:tasks.workunit.client.1.smithi139.stdout:2/768: stat d0/dc/d3a 0 2024-09-17T07:20:02.730 INFO:tasks.workunit.client.1.smithi139.stdout:3/685: stat d5/d21/d23/c41 0 2024-09-17T07:20:02.731 INFO:tasks.workunit.client.1.smithi139.stdout:3/686: readlink d5/d15/l32 0 2024-09-17T07:20:02.731 INFO:tasks.workunit.client.1.smithi139.stdout:2/769: readlink d0/d7/d1a/la0 0 2024-09-17T07:20:02.732 INFO:tasks.workunit.client.1.smithi139.stdout:4/611: write d0/d1/d29/d41/f63 [490417,26773] 0 2024-09-17T07:20:02.734 INFO:tasks.workunit.client.1.smithi139.stdout:4/612: read d0/db/d17/f38 [630893,17859] 0 2024-09-17T07:20:02.735 INFO:tasks.workunit.client.1.smithi139.stdout:8/820: write d0/d20/d28/d52/d65/f98 [2848066,97062] 0 2024-09-17T07:20:02.735 INFO:tasks.workunit.client.0.smithi087.stdout:0/964: symlink db/dbe/d124/dd0/l14f 0 2024-09-17T07:20:02.737 INFO:tasks.workunit.client.0.smithi087.stdout:5/959: rename d5/d18/d6f/d11b/d1f/de4 to d5/d18/d6f/d11b/d1f/d4e/da3/d102/d12f 0 2024-09-17T07:20:02.740 INFO:tasks.workunit.client.1.smithi139.stdout:8/821: mknod d0/d1a/d4d/c109 0 2024-09-17T07:20:02.740 INFO:tasks.workunit.client.1.smithi139.stdout:2/770: dwrite d0/d7/d67/d92/d99/f8f [4194304,4194304] 0 2024-09-17T07:20:02.741 INFO:tasks.workunit.client.1.smithi139.stdout:4/613: getdents d0/d1/d29 0 2024-09-17T07:20:02.742 INFO:tasks.workunit.client.0.smithi087.stdout:0/965: fdatasync db/d45/f118 0 2024-09-17T07:20:02.742 INFO:tasks.workunit.client.1.smithi139.stdout:4/614: stat d0/d1/d54/c57 0 2024-09-17T07:20:02.743 INFO:tasks.workunit.client.1.smithi139.stdout:2/771: creat d0/dc/d15/f104 x:0 0 0 2024-09-17T07:20:02.743 INFO:tasks.workunit.client.1.smithi139.stdout:8/822: dread - d0/d1a/dc9/ff1 zero size 2024-09-17T07:20:02.744 INFO:tasks.workunit.client.0.smithi087.stdout:1/764: rename d2/d3d/d35/f53 to d2/d3d/db4/dc3/f10a 0 2024-09-17T07:20:02.745 INFO:tasks.workunit.client.0.smithi087.stdout:9/746: readlink d3/d4/d6/d8/d12/d32/da1/lc5 0 2024-09-17T07:20:02.746 INFO:tasks.workunit.client.0.smithi087.stdout:5/960: write d5/d18/d20/d2f/d83/dac/f117 [838260,99022] 0 2024-09-17T07:20:02.747 INFO:tasks.workunit.client.1.smithi139.stdout:2/772: creat d0/d7/d86/da4/d12/d8c/f105 x:0 0 0 2024-09-17T07:20:02.748 INFO:tasks.workunit.client.1.smithi139.stdout:8/823: mknod d0/d20/d28/d52/d65/dbe/c10a 0 2024-09-17T07:20:02.748 INFO:tasks.workunit.client.0.smithi087.stdout:0/966: creat db/d45/d7b/d7e/f150 x:0 0 0 2024-09-17T07:20:02.750 INFO:tasks.workunit.client.0.smithi087.stdout:1/765: dread d2/d69/d8d/da6/fe4 [0,4194304] 0 2024-09-17T07:20:02.752 INFO:tasks.workunit.client.1.smithi139.stdout:3/687: dread d5/d21/d23/d38/f5f [4194304,4194304] 0 2024-09-17T07:20:02.753 INFO:tasks.workunit.client.0.smithi087.stdout:5/961: mknod d5/d12/d1c/d71/c130 0 2024-09-17T07:20:02.753 INFO:tasks.workunit.client.1.smithi139.stdout:2/773: rename d0/d7/d86/da4/c7b to d0/dc/d15/d9f/c106 0 2024-09-17T07:20:02.754 INFO:tasks.workunit.client.0.smithi087.stdout:4/904: truncate d2/d92/d4d/d21/d2f/d3b/d7e/d97/f121 1791533 0 2024-09-17T07:20:02.754 INFO:tasks.workunit.client.1.smithi139.stdout:4/615: dwrite d0/d49/f8b [0,4194304] 0 2024-09-17T07:20:02.755 INFO:tasks.workunit.client.0.smithi087.stdout:5/962: mknod d5/d18/d6f/d11b/d1f/d4e/da3/c131 0 2024-09-17T07:20:02.756 INFO:tasks.workunit.client.0.smithi087.stdout:5/963: chown d5/d12/d14/d61/d94 66215 1 2024-09-17T07:20:02.757 INFO:tasks.workunit.client.1.smithi139.stdout:3/688: mkdir d5/da7/dca/dd7 0 2024-09-17T07:20:02.757 INFO:tasks.workunit.client.0.smithi087.stdout:4/905: unlink d2/d92/fda 0 2024-09-17T07:20:02.760 INFO:tasks.workunit.client.1.smithi139.stdout:8/824: dwrite d0/d20/d28/d52/d65/f98 [0,4194304] 0 2024-09-17T07:20:02.763 INFO:tasks.workunit.client.1.smithi139.stdout:4/616: rmdir d0/d1/d29/dae 0 2024-09-17T07:20:02.763 INFO:tasks.workunit.client.0.smithi087.stdout:0/967: creat db/d45/d9e/d95/f151 x:0 0 0 2024-09-17T07:20:02.765 INFO:tasks.workunit.client.1.smithi139.stdout:8/825: rename d0/d1a/l73 to d0/d20/d28/d52/d65/dbe/deb/l10b 0 2024-09-17T07:20:02.766 INFO:tasks.workunit.client.0.smithi087.stdout:5/964: getdents d5/d18/d20/d2f/d60/de3/ded 0 2024-09-17T07:20:02.767 INFO:tasks.workunit.client.1.smithi139.stdout:3/689: dread d5/d15/d56/f7c [0,4194304] 0 2024-09-17T07:20:02.769 INFO:tasks.workunit.client.1.smithi139.stdout:8/826: chown d0/d20/d28/d52/d99/ffa 14 1 2024-09-17T07:20:02.769 INFO:tasks.workunit.client.1.smithi139.stdout:4/617: creat d0/d37/fc1 x:0 0 0 2024-09-17T07:20:02.769 INFO:tasks.workunit.client.1.smithi139.stdout:2/774: write d0/de/d69/fd0 [200980,130998] 0 2024-09-17T07:20:02.770 INFO:tasks.workunit.client.0.smithi087.stdout:9/747: dwrite d3/d4/f26 [0,4194304] 0 2024-09-17T07:20:02.770 INFO:tasks.workunit.client.0.smithi087.stdout:4/906: dwrite d2/d92/d86/fbe [0,4194304] 0 2024-09-17T07:20:02.772 INFO:tasks.workunit.client.0.smithi087.stdout:4/907: write d2/f114 [68824,14328] 0 2024-09-17T07:20:02.772 INFO:tasks.workunit.client.1.smithi139.stdout:8/827: readlink d0/d20/d28/d52/d65/d7f/ld5 0 2024-09-17T07:20:02.773 INFO:tasks.workunit.client.1.smithi139.stdout:4/618: rmdir d0/d1/d54 39 2024-09-17T07:20:02.775 INFO:tasks.workunit.client.0.smithi087.stdout:9/748: symlink d3/d4/d16/l104 0 2024-09-17T07:20:02.778 INFO:tasks.workunit.client.0.smithi087.stdout:4/908: creat d2/d92/d4d/d21/d2f/d6e/deb/f141 x:0 0 0 2024-09-17T07:20:02.779 INFO:tasks.workunit.client.0.smithi087.stdout:9/749: rmdir d3/d4/d16/d69/d8a/d1e/d90/d93/d96 39 2024-09-17T07:20:02.779 INFO:tasks.workunit.client.0.smithi087.stdout:4/909: readlink d2/d22/d95/l105 0 2024-09-17T07:20:02.781 INFO:tasks.workunit.client.0.smithi087.stdout:4/910: mkdir d2/d92/d142 0 2024-09-17T07:20:02.782 INFO:tasks.workunit.client.0.smithi087.stdout:5/965: rmdir d5/d18/d6f 39 2024-09-17T07:20:02.783 INFO:tasks.workunit.client.1.smithi139.stdout:3/690: dwrite d5/d15/d56/fc7 [0,4194304] 0 2024-09-17T07:20:02.787 INFO:tasks.workunit.client.0.smithi087.stdout:4/911: mkdir d2/d92/d4d/d42/db6/dd9/d143 0 2024-09-17T07:20:02.788 INFO:tasks.workunit.client.1.smithi139.stdout:8/828: dwrite d0/d20/d28/fea [0,4194304] 0 2024-09-17T07:20:02.788 INFO:tasks.workunit.client.0.smithi087.stdout:0/968: write db/d45/d7b/d90/dd9/de6/ffa [444483,86795] 0 2024-09-17T07:20:02.789 INFO:tasks.workunit.client.0.smithi087.stdout:4/912: read d2/d5/d1f/f68 [13566,88286] 0 2024-09-17T07:20:02.792 INFO:tasks.workunit.client.0.smithi087.stdout:0/969: creat db/da3/f152 x:0 0 0 2024-09-17T07:20:02.793 INFO:tasks.workunit.client.0.smithi087.stdout:4/913: truncate d2/d92/d4d/d21/d2f/d3b/d7e/d97/fe4 4769277 0 2024-09-17T07:20:02.795 INFO:tasks.workunit.client.1.smithi139.stdout:4/619: write d0/d1/d29/f66 [3806445,128586] 0 2024-09-17T07:20:02.796 INFO:tasks.workunit.client.1.smithi139.stdout:8/829: symlink d0/d20/d28/d52/d65/dbe/deb/l10c 0 2024-09-17T07:20:02.798 INFO:tasks.workunit.client.1.smithi139.stdout:3/691: mknod d5/da7/dca/dab/dd6/d28/d54/cd8 0 2024-09-17T07:20:02.798 INFO:tasks.workunit.client.0.smithi087.stdout:0/970: rename db/dbe/f11c to db/d45/d7b/d90/dd9/de6/d10a/f153 0 2024-09-17T07:20:02.799 INFO:tasks.workunit.client.1.smithi139.stdout:2/775: dwrite d0/d7/d86/da4/d12/d8c/f93 [4194304,4194304] 0 2024-09-17T07:20:02.800 INFO:tasks.workunit.client.1.smithi139.stdout:3/692: chown d5/da7/dca/l59 15 1 2024-09-17T07:20:02.800 INFO:tasks.workunit.client.1.smithi139.stdout:4/620: fsync d0/f47 0 2024-09-17T07:20:02.802 INFO:tasks.workunit.client.1.smithi139.stdout:7/533: sync 2024-09-17T07:20:02.803 INFO:tasks.workunit.client.1.smithi139.stdout:7/534: chown d5/f1e 0 1 2024-09-17T07:20:02.803 INFO:tasks.workunit.client.0.smithi087.stdout:0/971: rename db/da3/fb3 to db/d45/d7b/d90/dd9/de6/d10a/f154 0 2024-09-17T07:20:02.806 INFO:tasks.workunit.client.1.smithi139.stdout:8/830: rename d0/d1a/fbb to d0/d20/d28/d52/d54/f10d 0 2024-09-17T07:20:02.808 INFO:tasks.workunit.client.1.smithi139.stdout:7/535: fdatasync d5/d17/f20 0 2024-09-17T07:20:02.808 INFO:tasks.workunit.client.1.smithi139.stdout:8/831: write d0/d1a/d4d/da4/fae [3480903,36951] 0 2024-09-17T07:20:02.811 INFO:tasks.workunit.client.1.smithi139.stdout:4/621: rename d0/d1/dbe/l32 to d0/db/d7f/lc2 0 2024-09-17T07:20:02.811 INFO:tasks.workunit.client.1.smithi139.stdout:3/693: mknod d5/d21/dba/cd9 0 2024-09-17T07:20:02.812 INFO:tasks.workunit.client.1.smithi139.stdout:7/536: mknod d5/d17/d4e/d63/cac 0 2024-09-17T07:20:02.813 INFO:tasks.workunit.client.1.smithi139.stdout:7/537: chown d5/f6e 1 1 2024-09-17T07:20:02.814 INFO:tasks.workunit.client.1.smithi139.stdout:8/832: creat d0/d20/d28/d48/de1/f10e x:0 0 0 2024-09-17T07:20:02.814 INFO:tasks.workunit.client.1.smithi139.stdout:4/622: mkdir d0/db/d17/dc3 0 2024-09-17T07:20:02.817 INFO:tasks.workunit.client.1.smithi139.stdout:2/776: dread d0/de/d54/f8a [0,4194304] 0 2024-09-17T07:20:02.820 INFO:tasks.workunit.client.1.smithi139.stdout:7/538: getdents d5/d10/d2b/d40 0 2024-09-17T07:20:02.821 INFO:tasks.workunit.client.1.smithi139.stdout:3/694: dwrite d5/d63/d6d/d6f/d81/fc9 [0,4194304] 0 2024-09-17T07:20:02.822 INFO:tasks.workunit.client.1.smithi139.stdout:2/777: write d0/de/d25/fcb [2311801,29843] 0 2024-09-17T07:20:02.822 INFO:tasks.workunit.client.0.smithi087.stdout:9/750: dread d3/d4/d6/d8/d22/d43/f77 [0,4194304] 0 2024-09-17T07:20:02.825 INFO:tasks.workunit.client.0.smithi087.stdout:9/751: write d3/d4/d6/d8/d12/d38/f70 [713282,122712] 0 2024-09-17T07:20:02.827 INFO:tasks.workunit.client.1.smithi139.stdout:7/539: creat d5/fad x:0 0 0 2024-09-17T07:20:02.829 INFO:tasks.workunit.client.0.smithi087.stdout:5/966: write d5/d18/d6f/de1/fd3 [274361,47482] 0 2024-09-17T07:20:02.830 INFO:tasks.workunit.client.0.smithi087.stdout:9/752: creat d3/d4/da/de9/f105 x:0 0 0 2024-09-17T07:20:02.831 INFO:tasks.workunit.client.1.smithi139.stdout:8/833: dwrite d0/d20/d28/d52/d99/fcf [4194304,4194304] 0 2024-09-17T07:20:02.831 INFO:tasks.workunit.client.1.smithi139.stdout:3/695: creat d5/d21/d23/d69/dd5/fda x:0 0 0 2024-09-17T07:20:02.832 INFO:tasks.workunit.client.0.smithi087.stdout:5/967: fdatasync d5/f1b 0 2024-09-17T07:20:02.833 INFO:tasks.workunit.client.0.smithi087.stdout:9/753: read d3/d4/d6/d8/fda [89052,42716] 0 2024-09-17T07:20:02.834 INFO:tasks.workunit.client.1.smithi139.stdout:2/778: symlink d0/d7/d1a/d59/l107 0 2024-09-17T07:20:02.835 INFO:tasks.workunit.client.1.smithi139.stdout:2/779: chown d0/de 3368 1 2024-09-17T07:20:02.836 INFO:tasks.workunit.client.1.smithi139.stdout:2/780: write d0/de/f36 [2361598,2106] 0 2024-09-17T07:20:02.837 INFO:tasks.workunit.client.0.smithi087.stdout:9/754: creat d3/d4/d6/d8/d12/d32/da1/f106 x:0 0 0 2024-09-17T07:20:02.837 INFO:tasks.workunit.client.0.smithi087.stdout:4/914: chown d2/d92/d4d/d21/d2f/d3b/d7e/d97/f121 14736 1 2024-09-17T07:20:02.839 INFO:tasks.workunit.client.1.smithi139.stdout:4/623: write d0/f4c [589234,13097] 0 2024-09-17T07:20:02.840 INFO:tasks.workunit.client.1.smithi139.stdout:2/781: fsync d0/de/d69/fa3 0 2024-09-17T07:20:02.842 INFO:tasks.workunit.client.1.smithi139.stdout:8/834: dwrite d0/d20/f8f [0,4194304] 0 2024-09-17T07:20:02.842 INFO:tasks.workunit.client.1.smithi139.stdout:3/696: dwrite d5/d21/d23/f57 [0,4194304] 0 2024-09-17T07:20:02.843 INFO:tasks.workunit.client.0.smithi087.stdout:0/972: dwrite db/f34 [4194304,4194304] 0 2024-09-17T07:20:02.844 INFO:tasks.workunit.client.1.smithi139.stdout:2/782: write d0/d7/d86/da4/f83 [190660,92750] 0 2024-09-17T07:20:02.845 INFO:tasks.workunit.client.0.smithi087.stdout:4/915: creat d2/d92/d4f/f144 x:0 0 0 2024-09-17T07:20:02.846 INFO:tasks.workunit.client.0.smithi087.stdout:0/973: chown db/d45/d7b/la6 14 1 2024-09-17T07:20:02.846 INFO:tasks.workunit.client.0.smithi087.stdout:5/968: dwrite d5/d6d/fbd [0,4194304] 0 2024-09-17T07:20:02.847 INFO:tasks.workunit.client.1.smithi139.stdout:3/697: fsync d5/d63/d6d/d6f/fb8 0 2024-09-17T07:20:02.848 INFO:tasks.workunit.client.0.smithi087.stdout:9/755: creat d3/d4/d16/d69/d8a/d1e/f107 x:0 0 0 2024-09-17T07:20:02.849 INFO:tasks.workunit.client.0.smithi087.stdout:0/974: chown db/f34 333 1 2024-09-17T07:20:02.849 INFO:tasks.workunit.client.1.smithi139.stdout:2/783: mkdir d0/d7/d108 0 2024-09-17T07:20:02.854 INFO:tasks.workunit.client.1.smithi139.stdout:2/784: fsync d0/de/d54/f8a 0 2024-09-17T07:20:02.855 INFO:tasks.workunit.client.0.smithi087.stdout:9/756: write d3/d4/d6/d8/fda [812515,123939] 0 2024-09-17T07:20:02.857 INFO:tasks.workunit.client.0.smithi087.stdout:4/916: rename d2/d92/d4f/d7b/l104 to d2/d92/l145 0 2024-09-17T07:20:02.857 INFO:tasks.workunit.client.1.smithi139.stdout:7/540: dread d5/f1e [0,4194304] 0 2024-09-17T07:20:02.859 INFO:tasks.workunit.client.1.smithi139.stdout:2/785: creat d0/d7/d86/da4/d12/d8c/f109 x:0 0 0 2024-09-17T07:20:02.861 INFO:tasks.workunit.client.1.smithi139.stdout:7/541: symlink d5/d17/d4e/d66/lae 0 2024-09-17T07:20:02.861 INFO:tasks.workunit.client.1.smithi139.stdout:2/786: dread d0/de/d54/f8a [0,4194304] 0 2024-09-17T07:20:02.862 INFO:tasks.workunit.client.1.smithi139.stdout:7/542: chown d5/d10/c85 7 1 2024-09-17T07:20:02.862 INFO:tasks.workunit.client.0.smithi087.stdout:0/975: unlink db/l3d 0 2024-09-17T07:20:02.864 INFO:tasks.workunit.client.1.smithi139.stdout:7/543: chown d5/f18 26995 1 2024-09-17T07:20:02.866 INFO:tasks.workunit.client.1.smithi139.stdout:7/544: rmdir d5/d10/d2b/d40 39 2024-09-17T07:20:02.867 INFO:tasks.workunit.client.1.smithi139.stdout:7/545: write d5/d10/d2b/d40/d47/f8e [508236,25942] 0 2024-09-17T07:20:02.868 INFO:tasks.workunit.client.0.smithi087.stdout:9/757: dwrite d3/d4/d16/d69/d8a/f21 [0,4194304] 0 2024-09-17T07:20:02.868 INFO:tasks.workunit.client.1.smithi139.stdout:7/546: chown d5/d10/d2b 51021998 1 2024-09-17T07:20:02.870 INFO:tasks.workunit.client.0.smithi087.stdout:4/917: dwrite d2/d92/d4d/d21/d2f/d3b/d7e/d97/f12b [0,4194304] 0 2024-09-17T07:20:02.870 INFO:tasks.workunit.client.1.smithi139.stdout:8/835: dread d0/d20/da2/ff9 [0,4194304] 0 2024-09-17T07:20:02.872 INFO:tasks.workunit.client.0.smithi087.stdout:5/969: link d5/d12/d56/df5/c108 d5/d18/d6f/de1/c132 0 2024-09-17T07:20:02.872 INFO:tasks.workunit.client.0.smithi087.stdout:4/918: write d2/d22/d2c/d91/fd1 [3250273,72591] 0 2024-09-17T07:20:02.873 INFO:tasks.workunit.client.1.smithi139.stdout:3/698: truncate d5/f77 308439 0 2024-09-17T07:20:02.875 INFO:tasks.workunit.client.1.smithi139.stdout:8/836: rename d0/d20/da2/fd0 to d0/d20/d28/d52/d65/dbe/d105/f10f 0 2024-09-17T07:20:02.875 INFO:tasks.workunit.client.1.smithi139.stdout:7/547: dwrite d5/d17/f91 [0,4194304] 0 2024-09-17T07:20:02.878 INFO:tasks.workunit.client.0.smithi087.stdout:9/758: mkdir d3/d4/da/d4b/d108 0 2024-09-17T07:20:02.879 INFO:tasks.workunit.client.1.smithi139.stdout:3/699: mkdir d5/d63/db3/ddb 0 2024-09-17T07:20:02.879 INFO:tasks.workunit.client.1.smithi139.stdout:7/548: truncate d5/d10/d4d/d59/fa6 371495 0 2024-09-17T07:20:02.881 INFO:tasks.workunit.client.1.smithi139.stdout:3/700: chown d5/d63/d6d/d6f/d81/ccb 332 1 2024-09-17T07:20:02.882 INFO:tasks.workunit.client.0.smithi087.stdout:5/970: truncate d5/d18/d6f/d11b/d1f/d4e/fb5 371195 0 2024-09-17T07:20:02.884 INFO:tasks.workunit.client.0.smithi087.stdout:4/919: dwrite d2/d92/d86/fbe [0,4194304] 0 2024-09-17T07:20:02.884 INFO:tasks.workunit.client.1.smithi139.stdout:8/837: fsync d0/d20/d28/d52/d99/db4/ff4 0 2024-09-17T07:20:02.885 INFO:tasks.workunit.client.1.smithi139.stdout:7/549: read d5/d17/f32 [3559874,95175] 0 2024-09-17T07:20:02.885 INFO:tasks.workunit.client.0.smithi087.stdout:5/971: mknod d5/d18/c133 0 2024-09-17T07:20:02.889 INFO:tasks.workunit.client.1.smithi139.stdout:8/838: read d0/d20/da2/ff9 [296282,79902] 0 2024-09-17T07:20:02.889 INFO:tasks.workunit.client.1.smithi139.stdout:7/550: chown d5/d10/c12 1 1 2024-09-17T07:20:02.889 INFO:tasks.workunit.client.0.smithi087.stdout:5/972: chown d5/d12/d14/f10f 27 1 2024-09-17T07:20:02.892 INFO:tasks.workunit.client.0.smithi087.stdout:9/759: dwrite d3/d25/fcc [0,4194304] 0 2024-09-17T07:20:02.892 INFO:tasks.workunit.client.0.smithi087.stdout:4/920: creat d2/d5/d1f/f146 x:0 0 0 2024-09-17T07:20:02.893 INFO:tasks.workunit.client.1.smithi139.stdout:3/701: dwrite d5/d21/d23/d69/fa6 [0,4194304] 0 2024-09-17T07:20:02.896 INFO:tasks.workunit.client.1.smithi139.stdout:7/551: write d5/d10/d2b/d40/f81 [2609937,52420] 0 2024-09-17T07:20:02.897 INFO:tasks.workunit.client.0.smithi087.stdout:4/921: chown d2/d92/d4d/d21/d2f/d3b/d7e/f81 588220 1 2024-09-17T07:20:02.900 INFO:tasks.workunit.client.1.smithi139.stdout:7/552: fsync d5/d10/d2b/d40/f61 0 2024-09-17T07:20:02.902 INFO:tasks.workunit.client.0.smithi087.stdout:5/973: dwrite d5/d12/d14/f10f [0,4194304] 0 2024-09-17T07:20:02.904 INFO:tasks.workunit.client.1.smithi139.stdout:7/553: creat d5/d17/d4e/faf x:0 0 0 2024-09-17T07:20:02.904 INFO:tasks.workunit.client.1.smithi139.stdout:7/554: chown d5/l13 10 1 2024-09-17T07:20:02.905 INFO:tasks.workunit.client.0.smithi087.stdout:5/974: chown d5/d18/d20/d2f/d60/de3 3909470 1 2024-09-17T07:20:02.908 INFO:tasks.workunit.client.0.smithi087.stdout:5/975: chown d5/d18/d6f/d11b/l23 286117047 1 2024-09-17T07:20:02.910 INFO:tasks.workunit.client.0.smithi087.stdout:5/976: mknod d5/d6d/dd7/c134 0 2024-09-17T07:20:02.912 INFO:tasks.workunit.client.0.smithi087.stdout:5/977: write d5/d12/d1c/fab [3947596,110902] 0 2024-09-17T07:20:02.913 INFO:tasks.workunit.client.1.smithi139.stdout:7/555: dwrite d5/d17/d4e/f69 [0,4194304] 0 2024-09-17T07:20:02.916 INFO:tasks.workunit.client.1.smithi139.stdout:7/556: creat d5/d17/fb0 x:0 0 0 2024-09-17T07:20:02.918 INFO:tasks.workunit.client.0.smithi087.stdout:0/976: write db/f33 [126968,71011] 0 2024-09-17T07:20:02.920 INFO:tasks.workunit.client.1.smithi139.stdout:2/787: dread d0/d7/d86/da4/d12/f77 [0,4194304] 0 2024-09-17T07:20:02.920 INFO:tasks.workunit.client.1.smithi139.stdout:7/557: getdents d5/d17/d4e/d55 0 2024-09-17T07:20:02.922 INFO:tasks.workunit.client.0.smithi087.stdout:5/978: dwrite d5/d18/d20/d2f/f43 [0,4194304] 0 2024-09-17T07:20:02.933 INFO:tasks.workunit.client.0.smithi087.stdout:9/760: write d3/d4/da/f49 [3724790,50955] 0 2024-09-17T07:20:02.934 INFO:tasks.workunit.client.1.smithi139.stdout:8/839: write d0/d1a/d4d/fc2 [547244,28216] 0 2024-09-17T07:20:02.934 INFO:tasks.workunit.client.1.smithi139.stdout:3/702: write d5/d15/d20/d83/f94 [419969,100700] 0 2024-09-17T07:20:02.940 INFO:tasks.workunit.client.1.smithi139.stdout:8/840: rename d0/d20/d28/d52/fb3 to d0/d1a/d4d/f110 0 2024-09-17T07:20:02.944 INFO:tasks.workunit.client.1.smithi139.stdout:8/841: rename d0/d1a/c78 to d0/d1a/d4d/da4/dc4/c111 0 2024-09-17T07:20:02.944 INFO:tasks.workunit.client.1.smithi139.stdout:2/788: dread d0/d7/d86/da4/d12/d45/faa [0,4194304] 0 2024-09-17T07:20:02.948 INFO:tasks.workunit.client.1.smithi139.stdout:2/789: write d0/d7/d1a/fb6 [1232589,97370] 0 2024-09-17T07:20:02.948 INFO:tasks.workunit.client.1.smithi139.stdout:2/790: creat d0/d7/d1a/d59/f10a x:0 0 0 2024-09-17T07:20:02.949 INFO:tasks.workunit.client.0.smithi087.stdout:0/977: dread db/faf [0,4194304] 0 2024-09-17T07:20:02.950 INFO:tasks.workunit.client.0.smithi087.stdout:4/922: truncate d2/d92/d4d/d21/d2f/fb3 454889 0 2024-09-17T07:20:02.952 INFO:tasks.workunit.client.1.smithi139.stdout:3/703: write d5/d21/d23/d69/f84 [310194,26255] 0 2024-09-17T07:20:02.953 INFO:tasks.workunit.client.0.smithi087.stdout:4/923: symlink d2/d22/d62/l147 0 2024-09-17T07:20:02.955 INFO:tasks.workunit.client.1.smithi139.stdout:3/704: creat d5/da7/dca/dd7/fdc x:0 0 0 2024-09-17T07:20:02.958 INFO:tasks.workunit.client.1.smithi139.stdout:3/705: dread d5/da7/dca/dab/dd6/d28/d54/d58/fd1 [0,4194304] 0 2024-09-17T07:20:02.959 INFO:tasks.workunit.client.1.smithi139.stdout:8/842: write d0/f9 [2476611,54221] 0 2024-09-17T07:20:02.960 INFO:tasks.workunit.client.1.smithi139.stdout:2/791: write d0/f62 [2453450,116085] 0 2024-09-17T07:20:02.962 INFO:tasks.workunit.client.1.smithi139.stdout:2/792: fsync d0/d7/d67/d92/fad 0 2024-09-17T07:20:02.963 INFO:tasks.workunit.client.1.smithi139.stdout:3/706: getdents d5/da7/dca 0 2024-09-17T07:20:02.964 INFO:tasks.workunit.client.1.smithi139.stdout:8/843: rename d0/d96/lba to d0/d20/d28/d52/d65/dbe/deb/l112 0 2024-09-17T07:20:02.966 INFO:tasks.workunit.client.1.smithi139.stdout:2/793: rename d0/d7/d86/da4/l88 to d0/de/d69/de1/l10b 0 2024-09-17T07:20:02.966 INFO:tasks.workunit.client.1.smithi139.stdout:3/707: write d5/d21/d23/d38/f5f [5663028,113379] 0 2024-09-17T07:20:02.968 INFO:tasks.workunit.client.1.smithi139.stdout:3/708: truncate d5/da7/dca/dd7/fdc 386330 0 2024-09-17T07:20:02.971 INFO:tasks.workunit.client.1.smithi139.stdout:3/709: rename d5/d21/d23/d69/dd5/lc5 to d5/d21/d23/d38/ldd 0 2024-09-17T07:20:02.972 INFO:tasks.workunit.client.1.smithi139.stdout:3/710: readlink d5/d15/lc6 0 2024-09-17T07:20:02.974 INFO:tasks.workunit.client.1.smithi139.stdout:3/711: mknod d5/d15/d20/d83/cde 0 2024-09-17T07:20:02.979 INFO:tasks.workunit.client.1.smithi139.stdout:8/844: dread d0/d20/d28/d52/d99/fcf [0,4194304] 0 2024-09-17T07:20:02.980 INFO:tasks.workunit.client.1.smithi139.stdout:8/845: chown d0/f2a 1 1 2024-09-17T07:20:02.981 INFO:tasks.workunit.client.1.smithi139.stdout:2/794: dread d0/d7/d67/d92/d99/f4f [4194304,4194304] 0 2024-09-17T07:20:02.981 INFO:tasks.workunit.client.1.smithi139.stdout:8/846: rmdir d0 39 2024-09-17T07:20:02.983 INFO:tasks.workunit.client.1.smithi139.stdout:3/712: write d5/da7/dca/dab/dd6/d28/d54/d58/f72 [2723054,6405] 0 2024-09-17T07:20:02.984 INFO:tasks.workunit.client.1.smithi139.stdout:8/847: write d0/d1a/d3a/f7c [655498,40321] 0 2024-09-17T07:20:02.984 INFO:tasks.workunit.client.1.smithi139.stdout:2/795: creat d0/dc/dc4/f10c x:0 0 0 2024-09-17T07:20:02.985 INFO:tasks.workunit.client.1.smithi139.stdout:3/713: fsync d5/d21/d23/f5d 0 2024-09-17T07:20:02.986 INFO:tasks.workunit.client.1.smithi139.stdout:3/714: dread - d5/d63/d6d/d6f/d8b/f92 zero size 2024-09-17T07:20:02.988 INFO:tasks.workunit.client.1.smithi139.stdout:2/796: rename d0/dc to d0/d7/d67/da1/d10d 0 2024-09-17T07:20:02.990 INFO:tasks.workunit.client.1.smithi139.stdout:3/715: readlink d5/d21/d23/l3a 0 2024-09-17T07:20:02.990 INFO:tasks.workunit.client.1.smithi139.stdout:3/716: fsync d5/d63/d6d/d6f/d8b/f92 0 2024-09-17T07:20:02.991 INFO:tasks.workunit.client.1.smithi139.stdout:3/717: write d5/d21/d23/d38/f5f [2033880,55188] 0 2024-09-17T07:20:02.994 INFO:tasks.workunit.client.1.smithi139.stdout:2/797: rmdir d0/d3b/db9 0 2024-09-17T07:20:02.995 INFO:tasks.workunit.client.1.smithi139.stdout:8/848: getdents d0/d20/d28/d52/d65/dbe 0 2024-09-17T07:20:02.996 INFO:tasks.workunit.client.1.smithi139.stdout:8/849: write d0/d1a/d4d/f100 [929362,117342] 0 2024-09-17T07:20:02.998 INFO:tasks.workunit.client.1.smithi139.stdout:3/718: dread d5/d63/d6d/d6f/d81/fc9 [0,4194304] 0 2024-09-17T07:20:03.000 INFO:tasks.workunit.client.1.smithi139.stdout:3/719: creat d5/d21/d23/d38/fdf x:0 0 0 2024-09-17T07:20:03.002 INFO:tasks.workunit.client.1.smithi139.stdout:3/720: write d5/d15/d20/d3b/f4a [2010690,126184] 0 2024-09-17T07:20:03.003 INFO:tasks.workunit.client.1.smithi139.stdout:8/850: dwrite d0/f7 [0,4194304] 0 2024-09-17T07:20:03.009 INFO:tasks.workunit.client.1.smithi139.stdout:3/721: write d5/da7/dca/dab/dd6/d28/d54/d8e/fbe [1764231,2495] 0 2024-09-17T07:20:03.010 INFO:tasks.workunit.client.1.smithi139.stdout:8/851: write d0/d20/d28/d52/d65/dbe/fbf [3145285,29960] 0 2024-09-17T07:20:03.013 INFO:tasks.workunit.client.1.smithi139.stdout:3/722: write d5/da7/dca/dab/dd6/d28/f3d [360344,97728] 0 2024-09-17T07:20:03.014 INFO:tasks.workunit.client.1.smithi139.stdout:3/723: chown d5/da7/dca/dab/dd6/f4b 31460 1 2024-09-17T07:20:03.024 INFO:tasks.workunit.client.0.smithi087.stdout:9/761: write d3/d4/d6/d8/fd [862018,42156] 0 2024-09-17T07:20:03.035 INFO:tasks.workunit.client.1.smithi139.stdout:3/724: dread d5/da7/dca/dab/dd6/d28/d54/d58/f8f [0,4194304] 0 2024-09-17T07:20:03.037 INFO:tasks.workunit.client.1.smithi139.stdout:8/852: dread d0/d20/d28/d52/d65/d7f/db6/f58 [0,4194304] 0 2024-09-17T07:20:03.039 INFO:tasks.workunit.client.1.smithi139.stdout:8/853: rmdir d0/d20/d28/d52/d65/dbe/deb 39 2024-09-17T07:20:03.041 INFO:tasks.workunit.client.1.smithi139.stdout:3/725: dwrite d5/da7/dca/dab/dd6/d28/f85 [0,4194304] 0 2024-09-17T07:20:03.041 INFO:tasks.workunit.client.1.smithi139.stdout:5/762: sync 2024-09-17T07:20:03.044 INFO:tasks.workunit.client.1.smithi139.stdout:8/854: read d0/d20/d28/d52/d65/dd3/de4/f1c [2569049,26884] 0 2024-09-17T07:20:03.045 INFO:tasks.workunit.client.1.smithi139.stdout:3/726: unlink d5/d15/d56/f70 0 2024-09-17T07:20:03.046 INFO:tasks.workunit.client.1.smithi139.stdout:3/727: write d5/d15/d20/fb2 [539344,90500] 0 2024-09-17T07:20:03.047 INFO:tasks.workunit.client.1.smithi139.stdout:5/763: mkdir d4/d16/d1b/d20/d32/d6c/dc9/dfa 0 2024-09-17T07:20:03.050 INFO:tasks.workunit.client.1.smithi139.stdout:8/855: rmdir d0/d20/d28/d48/de1 39 2024-09-17T07:20:03.057 INFO:tasks.workunit.client.1.smithi139.stdout:8/856: truncate d0/d20/d28/d52/d99/fcf 5330716 0 2024-09-17T07:20:03.058 INFO:tasks.workunit.client.1.smithi139.stdout:8/857: mkdir d0/d1a/d3a/d8d/d102/d113 0 2024-09-17T07:20:03.070 INFO:tasks.workunit.client.0.smithi087.stdout:5/979: dread d5/d12/d14/d61/fce [0,4194304] 0 2024-09-17T07:20:03.072 INFO:tasks.workunit.client.0.smithi087.stdout:0/978: dwrite db/f38 [0,4194304] 0 2024-09-17T07:20:03.086 INFO:tasks.workunit.client.0.smithi087.stdout:4/924: creat d2/d92/d4d/d42/f148 x:0 0 0 2024-09-17T07:20:03.086 INFO:tasks.workunit.client.0.smithi087.stdout:4/925: fdatasync d2/f10c 0 2024-09-17T07:20:03.090 INFO:tasks.workunit.client.0.smithi087.stdout:0/979: mknod db/d45/d9e/d95/c155 0 2024-09-17T07:20:03.091 INFO:tasks.workunit.client.0.smithi087.stdout:5/980: symlink d5/d18/d20/d2f/d118/l135 0 2024-09-17T07:20:03.092 INFO:tasks.workunit.client.0.smithi087.stdout:4/926: creat d2/d22/d134/f149 x:0 0 0 2024-09-17T07:20:03.094 INFO:tasks.workunit.client.0.smithi087.stdout:5/981: write d5/d18/d6f/d11b/d1f/d4e/da3/d102/f107 [8733857,83916] 0 2024-09-17T07:20:03.094 INFO:tasks.workunit.client.0.smithi087.stdout:9/762: rename d3/d4/d6/d8/d22/d43/d84/c5e to d3/d25/c109 0 2024-09-17T07:20:03.096 INFO:tasks.workunit.client.0.smithi087.stdout:4/927: readlink d2/d92/d4d/d21/d2f/l4e 0 2024-09-17T07:20:03.096 INFO:tasks.workunit.client.0.smithi087.stdout:5/982: dread - d5/d18/d6f/d11b/fc4 zero size 2024-09-17T07:20:03.099 INFO:tasks.workunit.client.0.smithi087.stdout:0/980: dwrite db/d45/d5b/d92/fc7 [0,4194304] 0 2024-09-17T07:20:03.099 INFO:tasks.workunit.client.0.smithi087.stdout:9/763: fsync d3/d4/d6/d8/d22/d43/d84/fbb 0 2024-09-17T07:20:03.100 INFO:tasks.workunit.client.0.smithi087.stdout:4/928: truncate d2/d92/d4d/d21/d2f/d3b/f124 4219 0 2024-09-17T07:20:03.101 INFO:tasks.workunit.client.0.smithi087.stdout:5/983: unlink d5/d12/d4d/f3a 0 2024-09-17T07:20:03.102 INFO:tasks.workunit.client.0.smithi087.stdout:9/764: chown d3/d25/c36 36647007 1 2024-09-17T07:20:03.103 INFO:tasks.workunit.client.0.smithi087.stdout:5/984: read d5/d12/d14/f7b [1019290,92386] 0 2024-09-17T07:20:03.103 INFO:tasks.workunit.client.0.smithi087.stdout:0/981: mkdir db/d45/d7b/d7e/d156 0 2024-09-17T07:20:03.106 INFO:tasks.workunit.client.0.smithi087.stdout:9/765: mknod d3/d4/d6/d8/d12/c10a 0 2024-09-17T07:20:03.108 INFO:tasks.workunit.client.0.smithi087.stdout:0/982: fsync db/d45/d9e/d86/dd5/deb/d117/f12a 0 2024-09-17T07:20:03.113 INFO:tasks.workunit.client.0.smithi087.stdout:0/983: dread db/d45/d5b/fec [0,4194304] 0 2024-09-17T07:20:03.114 INFO:tasks.workunit.client.0.smithi087.stdout:5/985: dwrite d5/d18/d20/d2f/d60/de3/ded/f127 [0,4194304] 0 2024-09-17T07:20:03.116 INFO:tasks.workunit.client.0.smithi087.stdout:5/986: chown d5/ff4 28447 1 2024-09-17T07:20:03.124 INFO:tasks.workunit.client.0.smithi087.stdout:5/987: dwrite d5/d18/d6f/d11b/d1f/f104 [0,4194304] 0 2024-09-17T07:20:03.125 INFO:tasks.workunit.client.0.smithi087.stdout:5/988: chown d5/d18/d20/c5d 1016621 1 2024-09-17T07:20:03.128 INFO:tasks.workunit.client.0.smithi087.stdout:5/989: symlink d5/d18/d6f/d11b/d1f/d4e/da3/d102/d12f/l136 0 2024-09-17T07:20:03.129 INFO:tasks.workunit.client.1.smithi139.stdout:8/858: mknod d0/d1a/d3a/d71/c114 0 2024-09-17T07:20:03.130 INFO:tasks.workunit.client.0.smithi087.stdout:5/990: read d5/f15 [64926,60617] 0 2024-09-17T07:20:03.136 INFO:tasks.workunit.client.0.smithi087.stdout:4/929: dread d2/d92/d4d/d21/d2f/d3b/f9a [0,4194304] 0 2024-09-17T07:20:03.137 INFO:tasks.workunit.client.1.smithi139.stdout:8/859: dwrite d0/fff [0,4194304] 0 2024-09-17T07:20:03.137 INFO:tasks.workunit.client.0.smithi087.stdout:2/721: sync 2024-09-17T07:20:03.140 INFO:tasks.workunit.client.0.smithi087.stdout:9/766: dwrite d3/d4/d6/d8/df1/fc3 [0,4194304] 0 2024-09-17T07:20:03.140 INFO:tasks.workunit.client.1.smithi139.stdout:8/860: creat d0/d20/d28/d52/d65/f115 x:0 0 0 2024-09-17T07:20:03.141 INFO:tasks.workunit.client.0.smithi087.stdout:4/930: chown d2/d92/d4d/f11c 461 1 2024-09-17T07:20:03.142 INFO:tasks.workunit.client.0.smithi087.stdout:2/722: write d2/d7/dd/d10/d4c/dcc/fcd [266233,80086] 0 2024-09-17T07:20:03.143 INFO:tasks.workunit.client.1.smithi139.stdout:5/764: dread d4/d16/f18 [0,4194304] 0 2024-09-17T07:20:03.145 INFO:tasks.workunit.client.0.smithi087.stdout:9/767: readlink d3/d4/d6/d8/d22/d64/l65 0 2024-09-17T07:20:03.145 INFO:tasks.workunit.client.0.smithi087.stdout:0/984: dwrite db/d45/d7b/d7e/d130/fac [4194304,4194304] 0 2024-09-17T07:20:03.149 INFO:tasks.workunit.client.0.smithi087.stdout:4/931: rename d2/d5/f59 to d2/d92/d4d/d21/dfa/f14a 0 2024-09-17T07:20:03.152 INFO:tasks.workunit.client.0.smithi087.stdout:4/932: dread - d2/d92/d4f/d6a/d9d/fbd zero size 2024-09-17T07:20:03.153 INFO:tasks.workunit.client.0.smithi087.stdout:0/985: read f5 [5960957,86769] 0 2024-09-17T07:20:03.154 INFO:tasks.workunit.client.0.smithi087.stdout:9/768: mknod d3/d4/d6/d8/d12/db1/c10b 0 2024-09-17T07:20:03.156 INFO:tasks.workunit.client.1.smithi139.stdout:8/861: write d0/d20/d28/d52/f63 [3664648,49217] 0 2024-09-17T07:20:03.156 INFO:tasks.workunit.client.1.smithi139.stdout:8/862: chown d0/ce5 1309 1 2024-09-17T07:20:03.157 INFO:tasks.workunit.client.0.smithi087.stdout:9/769: chown d3/d4/dcd/f103 125 1 2024-09-17T07:20:03.158 INFO:tasks.workunit.client.0.smithi087.stdout:5/991: dwrite d5/d12/f76 [0,4194304] 0 2024-09-17T07:20:03.158 INFO:tasks.workunit.client.0.smithi087.stdout:0/986: creat db/d45/d9e/d95/de9/f157 x:0 0 0 2024-09-17T07:20:03.158 INFO:tasks.workunit.client.1.smithi139.stdout:8/863: creat d0/d1a/d4d/da4/dc4/f116 x:0 0 0 2024-09-17T07:20:03.160 INFO:tasks.workunit.client.1.smithi139.stdout:8/864: creat d0/d1a/d82/f117 x:0 0 0 2024-09-17T07:20:03.161 INFO:tasks.workunit.client.1.smithi139.stdout:8/865: fdatasync d0/d1a/d3a/d71/f8b 0 2024-09-17T07:20:03.162 INFO:tasks.workunit.client.0.smithi087.stdout:5/992: write d5/d18/d6f/d11b/d1f/f58 [2181935,44187] 0 2024-09-17T07:20:03.163 INFO:tasks.workunit.client.1.smithi139.stdout:8/866: symlink d0/d1a/d3a/d8d/d102/l118 0 2024-09-17T07:20:03.163 INFO:tasks.workunit.client.0.smithi087.stdout:4/933: rename d2/d92/d4f to d2/d22/d2c/d96/d14b 0 2024-09-17T07:20:03.167 INFO:tasks.workunit.client.0.smithi087.stdout:5/993: mkdir d5/d18/d6f/d11b/d1f/d4e/d10d/d11a/d137 0 2024-09-17T07:20:03.167 INFO:tasks.workunit.client.0.smithi087.stdout:9/770: dwrite d3/d4/d16/ffd [0,4194304] 0 2024-09-17T07:20:03.168 INFO:tasks.workunit.client.1.smithi139.stdout:8/867: link d0/d1a/ff3 d0/d20/d28/d52/d65/d7f/f119 0 2024-09-17T07:20:03.170 INFO:tasks.workunit.client.0.smithi087.stdout:5/994: mknod d5/d6d/c138 0 2024-09-17T07:20:03.171 INFO:tasks.workunit.client.1.smithi139.stdout:8/868: creat d0/d20/d28/d52/d99/f11a x:0 0 0 2024-09-17T07:20:03.171 INFO:tasks.workunit.client.0.smithi087.stdout:9/771: getdents d3/d4/d16/d69/d8a/d1e/d90/d93/dff 0 2024-09-17T07:20:03.171 INFO:tasks.workunit.client.0.smithi087.stdout:5/995: chown d5/d12/d14/d61/d94/f11f 344 1 2024-09-17T07:20:03.173 INFO:tasks.workunit.client.1.smithi139.stdout:8/869: dread d0/d1a/d4d/d53/fd2 [0,4194304] 0 2024-09-17T07:20:03.175 INFO:tasks.workunit.client.0.smithi087.stdout:2/723: dread d2/d7/f8 [0,4194304] 0 2024-09-17T07:20:03.177 INFO:tasks.workunit.client.0.smithi087.stdout:5/996: creat d5/d18/d6f/d11b/d1f/f139 x:0 0 0 2024-09-17T07:20:03.179 INFO:tasks.workunit.client.0.smithi087.stdout:2/724: mknod d2/d48/da2/ce7 0 2024-09-17T07:20:03.180 INFO:tasks.workunit.client.0.smithi087.stdout:9/772: dwrite d3/d4/f8d [4194304,4194304] 0 2024-09-17T07:20:03.180 INFO:tasks.workunit.client.0.smithi087.stdout:5/997: mknod d5/c13a 0 2024-09-17T07:20:03.182 INFO:tasks.workunit.client.0.smithi087.stdout:4/934: dread d2/d92/d4d/d21/f6c [0,4194304] 0 2024-09-17T07:20:03.186 INFO:tasks.workunit.client.0.smithi087.stdout:9/773: mkdir d3/d4/d6/d8/d22/d10c 0 2024-09-17T07:20:03.187 INFO:tasks.workunit.client.0.smithi087.stdout:4/935: creat d2/d92/d74/f14c x:0 0 0 2024-09-17T07:20:03.188 INFO:tasks.workunit.client.1.smithi139.stdout:1/496: sync 2024-09-17T07:20:03.188 INFO:tasks.workunit.client.0.smithi087.stdout:9/774: chown d3/d4/da/f49 124873935 1 2024-09-17T07:20:03.188 INFO:tasks.workunit.client.0.smithi087.stdout:2/725: getdents d2/d7/dd/d10/d91 0 2024-09-17T07:20:03.191 INFO:tasks.workunit.client.0.smithi087.stdout:4/936: creat d2/d92/d4d/d42/f14d x:0 0 0 2024-09-17T07:20:03.192 INFO:tasks.workunit.client.0.smithi087.stdout:5/998: dwrite d5/d18/d6f/d11b/d1f/d4e/d10d/f121 [0,4194304] 0 2024-09-17T07:20:03.193 INFO:tasks.workunit.client.1.smithi139.stdout:1/497: rename d2/d10/d12/d13/d4f/l7d to d2/d10/d12/d35/d2b/l9c 0 2024-09-17T07:20:03.196 INFO:tasks.workunit.client.1.smithi139.stdout:1/498: mkdir d2/d10/d12/d35/d49/d8d/d9b/d9d 0 2024-09-17T07:20:03.199 INFO:tasks.workunit.client.0.smithi087.stdout:5/999: truncate d5/d18/d20/d2f/d60/de3/ded/f103 583123 0 2024-09-17T07:20:03.199 INFO:tasks.workunit.client.0.smithi087.stdout:9/775: read d3/d4/d6/d8/fda [506552,113454] 0 2024-09-17T07:20:03.202 INFO:tasks.workunit.client.0.smithi087.stdout:4/937: dread d2/d92/d4d/f53 [0,4194304] 0 2024-09-17T07:20:03.202 INFO:tasks.workunit.client.1.smithi139.stdout:1/499: dwrite d2/d10/d12/f29 [4194304,4194304] 0 2024-09-17T07:20:03.204 INFO:tasks.workunit.client.0.smithi087.stdout:9/776: symlink d3/d4/d6/d8/d12/d32/l10d 0 2024-09-17T07:20:03.204 INFO:tasks.workunit.client.0.smithi087.stdout:0/987: dwrite db/dbe/fcc [0,4194304] 0 2024-09-17T07:20:03.205 INFO:tasks.workunit.client.1.smithi139.stdout:1/500: symlink d2/l9e 0 2024-09-17T07:20:03.205 INFO:tasks.workunit.client.0.smithi087.stdout:9/777: fdatasync d3/d4/d6/d71/f86 0 2024-09-17T07:20:03.215 INFO:tasks.workunit.client.0.smithi087.stdout:2/726: dread d2/d7/dd/d10/f1e [0,4194304] 0 2024-09-17T07:20:03.219 INFO:tasks.workunit.client.1.smithi139.stdout:1/501: write d2/d10/d12/f76 [1952135,43951] 0 2024-09-17T07:20:03.220 INFO:tasks.workunit.client.1.smithi139.stdout:1/502: write d2/f15 [2174846,6312] 0 2024-09-17T07:20:03.222 INFO:tasks.workunit.client.0.smithi087.stdout:3/822: sync 2024-09-17T07:20:03.223 INFO:tasks.workunit.client.1.smithi139.stdout:1/503: creat d2/d10/d12/d35/d2b/f9f x:0 0 0 2024-09-17T07:20:03.226 INFO:tasks.workunit.client.1.smithi139.stdout:1/504: creat d2/d10/d12/fa0 x:0 0 0 2024-09-17T07:20:03.228 INFO:tasks.workunit.client.0.smithi087.stdout:3/823: dwrite d6/d1b/d42/dd4/dd1/f111 [0,4194304] 0 2024-09-17T07:20:03.229 INFO:tasks.workunit.client.1.smithi139.stdout:1/505: rename d2/d10/d12/d35/l45 to d2/d10/d71/d94/la1 0 2024-09-17T07:20:03.230 INFO:tasks.workunit.client.0.smithi087.stdout:6/919: sync 2024-09-17T07:20:03.231 INFO:tasks.workunit.client.0.smithi087.stdout:3/824: fsync d6/d1b/d42/d62/dbb/f10f 0 2024-09-17T07:20:03.234 INFO:tasks.workunit.client.0.smithi087.stdout:6/920: symlink d1/d6a/dda/d123/l134 0 2024-09-17T07:20:03.237 INFO:tasks.workunit.client.0.smithi087.stdout:3/825: creat d6/d15/d37/d3c/d52/db2/d10a/d11b/d120/f128 x:0 0 0 2024-09-17T07:20:03.238 INFO:tasks.workunit.client.1.smithi139.stdout:1/506: write d2/d10/d12/d13/f43 [451762,2802] 0 2024-09-17T07:20:03.241 INFO:tasks.workunit.client.1.smithi139.stdout:1/507: rename d2/d10/d12/d13/f75 to d2/d10/d12/d13/d4f/d5c/fa2 0 2024-09-17T07:20:03.242 INFO:tasks.workunit.client.0.smithi087.stdout:3/826: write d6/d15/d37/d3c/d52/db2/fbd [46404,35532] 0 2024-09-17T07:20:03.245 INFO:tasks.workunit.client.0.smithi087.stdout:9/778: dread d3/d4/d16/f7c [0,4194304] 0 2024-09-17T07:20:03.246 INFO:tasks.workunit.client.0.smithi087.stdout:0/988: dwrite db/d45/fae [0,4194304] 0 2024-09-17T07:20:03.248 INFO:tasks.workunit.client.0.smithi087.stdout:2/727: dwrite d2/d7/dd/d6a/d6d/f77 [0,4194304] 0 2024-09-17T07:20:03.251 INFO:tasks.workunit.client.0.smithi087.stdout:3/827: creat d6/d1b/d42/dd4/dd1/de4/f129 x:0 0 0 2024-09-17T07:20:03.251 INFO:tasks.workunit.client.1.smithi139.stdout:1/508: dwrite d2/d10/d12/d13/d4f/f95 [0,4194304] 0 2024-09-17T07:20:03.252 INFO:tasks.workunit.client.0.smithi087.stdout:9/779: creat d3/d4/d16/d69/d8a/d1e/d90/f10e x:0 0 0 2024-09-17T07:20:03.253 INFO:tasks.workunit.client.1.smithi139.stdout:1/509: write d2/d10/d12/d1a/f53 [368489,21961] 0 2024-09-17T07:20:03.254 INFO:tasks.workunit.client.0.smithi087.stdout:2/728: unlink d2/fba 0 2024-09-17T07:20:03.255 INFO:tasks.workunit.client.0.smithi087.stdout:2/729: chown d2/d50/fb9 60 1 2024-09-17T07:20:03.255 INFO:tasks.workunit.client.0.smithi087.stdout:9/780: mkdir d3/d4/dcd/df4/d10f 0 2024-09-17T07:20:03.259 INFO:tasks.workunit.client.1.smithi139.stdout:1/510: creat d2/d10/d12/d13/d4f/fa3 x:0 0 0 2024-09-17T07:20:03.259 INFO:tasks.workunit.client.0.smithi087.stdout:0/989: creat db/d45/d9e/d95/df1/f158 x:0 0 0 2024-09-17T07:20:03.261 INFO:tasks.workunit.client.0.smithi087.stdout:9/781: dread - d3/d4/d6/d8/d22/d43/d84/dc7/fdd zero size 2024-09-17T07:20:03.263 INFO:tasks.workunit.client.0.smithi087.stdout:0/990: rename db/ff3 to db/d45/d9e/d95/de9/f159 0 2024-09-17T07:20:03.264 INFO:tasks.workunit.client.0.smithi087.stdout:2/730: chown d2/d48/da2/d3a/d9f 4860 1 2024-09-17T07:20:03.275 INFO:tasks.workunit.client.0.smithi087.stdout:3/828: truncate d6/d15/d37/d3c/d52/db2/de7/f81 2147055 0 2024-09-17T07:20:03.278 INFO:tasks.workunit.client.0.smithi087.stdout:3/829: symlink d6/d1b/d42/d62/dbb/dd7/l12a 0 2024-09-17T07:20:03.279 INFO:tasks.workunit.client.0.smithi087.stdout:9/782: write d3/f28 [140437,38001] 0 2024-09-17T07:20:03.280 INFO:tasks.workunit.client.1.smithi139.stdout:1/511: truncate d2/d10/d12/f69 4125570 0 2024-09-17T07:20:03.280 INFO:tasks.workunit.client.0.smithi087.stdout:0/991: write db/d45/d5b/d92/f119 [506626,40940] 0 2024-09-17T07:20:03.280 INFO:tasks.workunit.client.1.smithi139.stdout:1/512: fdatasync d2/d10/d12/d24/f4e 0 2024-09-17T07:20:03.281 INFO:tasks.workunit.client.0.smithi087.stdout:6/921: dread d1/d67/dfe/d2c/fd9 [0,4194304] 0 2024-09-17T07:20:03.283 INFO:tasks.workunit.client.0.smithi087.stdout:9/783: chown d3/d4/d16/d69/d8a/d1e/d90/laf 15478 1 2024-09-17T07:20:03.283 INFO:tasks.workunit.client.0.smithi087.stdout:3/830: unlink d6/d1b/df6/l109 0 2024-09-17T07:20:03.286 INFO:tasks.workunit.client.1.smithi139.stdout:1/513: dwrite d2/d10/d12/d13/f16 [0,4194304] 0 2024-09-17T07:20:03.294 INFO:tasks.workunit.client.1.smithi139.stdout:1/514: dwrite d2/d10/d12/d35/d49/f7b [0,4194304] 0 2024-09-17T07:20:03.295 INFO:tasks.workunit.client.1.smithi139.stdout:1/515: mkdir d2/d10/d12/d24/d38/da4 0 2024-09-17T07:20:03.299 INFO:tasks.workunit.client.1.smithi139.stdout:1/516: truncate d2/d10/d12/d24/d38/d3d/f4d 2001535 0 2024-09-17T07:20:03.299 INFO:tasks.workunit.client.1.smithi139.stdout:1/517: read - d2/d10/d12/d13/f82 zero size 2024-09-17T07:20:03.304 INFO:tasks.workunit.client.1.smithi139.stdout:1/518: dwrite d2/d10/d12/f29 [0,4194304] 0 2024-09-17T07:20:03.310 INFO:tasks.workunit.client.1.smithi139.stdout:1/519: dread d2/f7 [0,4194304] 0 2024-09-17T07:20:03.312 INFO:tasks.workunit.client.1.smithi139.stdout:1/520: mknod d2/ca5 0 2024-09-17T07:20:03.327 INFO:tasks.workunit.client.1.smithi139.stdout:1/521: rmdir d2/d10/d12/d24/d38/d3d 39 2024-09-17T07:20:03.328 INFO:tasks.workunit.client.1.smithi139.stdout:1/522: fsync d2/f7 0 2024-09-17T07:20:03.330 INFO:tasks.workunit.client.1.smithi139.stdout:1/523: chown d2/d10/d12/d35/d2b/c68 285 1 2024-09-17T07:20:03.333 INFO:tasks.workunit.client.1.smithi139.stdout:0/476: sync 2024-09-17T07:20:03.335 INFO:tasks.workunit.client.1.smithi139.stdout:1/524: truncate d2/d10/d12/d24/d38/d3d/f99 4320141 0 2024-09-17T07:20:03.335 INFO:tasks.workunit.client.1.smithi139.stdout:0/477: read d1/da/d1b/d3d/f70 [3578706,67418] 0 2024-09-17T07:20:03.336 INFO:tasks.workunit.client.1.smithi139.stdout:0/478: write d1/da/d17/d72/f30 [4543468,89124] 0 2024-09-17T07:20:03.338 INFO:tasks.workunit.client.1.smithi139.stdout:0/479: mkdir d1/da/d17/db8 0 2024-09-17T07:20:03.341 INFO:tasks.workunit.client.1.smithi139.stdout:0/480: unlink d1/da/d1b/c87 0 2024-09-17T07:20:03.343 INFO:tasks.workunit.client.0.smithi087.stdout:9/784: mkdir d3/d4/d6/d8/d12/d38/d110 0 2024-09-17T07:20:03.344 INFO:tasks.workunit.client.1.smithi139.stdout:0/481: creat d1/da/d1b/d3d/d5a/fb9 x:0 0 0 2024-09-17T07:20:03.344 INFO:tasks.workunit.client.1.smithi139.stdout:0/482: fsync d1/da/d1b/f33 0 2024-09-17T07:20:03.345 INFO:tasks.workunit.client.0.smithi087.stdout:0/992: write db/f29 [222415,120078] 0 2024-09-17T07:20:03.346 INFO:tasks.workunit.client.1.smithi139.stdout:0/483: mkdir d1/da/d1b/dba 0 2024-09-17T07:20:03.347 INFO:tasks.workunit.client.0.smithi087.stdout:6/922: dwrite d1/d67/dfe/d2c/d40/d4c/dce/ff1 [0,4194304] 0 2024-09-17T07:20:03.347 INFO:tasks.workunit.client.0.smithi087.stdout:3/831: creat d6/d1b/d42/d62/dbb/dd7/dee/f12b x:0 0 0 2024-09-17T07:20:03.349 INFO:tasks.workunit.client.1.smithi139.stdout:0/484: symlink d1/da/d1b/lbb 0 2024-09-17T07:20:03.350 INFO:tasks.workunit.client.0.smithi087.stdout:0/993: chown db/dbe/l110 18955 1 2024-09-17T07:20:03.352 INFO:tasks.workunit.client.0.smithi087.stdout:6/923: unlink d1/d6a/dda/f11b 0 2024-09-17T07:20:03.353 INFO:tasks.workunit.client.0.smithi087.stdout:3/832: fsync d6/d15/f19 0 2024-09-17T07:20:03.353 INFO:tasks.workunit.client.1.smithi139.stdout:1/525: dread d2/d10/d12/d35/d2b/f6e [0,4194304] 0 2024-09-17T07:20:03.356 INFO:tasks.workunit.client.1.smithi139.stdout:1/526: getdents d2/d10/d12/d35/d49/d8b 0 2024-09-17T07:20:03.357 INFO:tasks.workunit.client.0.smithi087.stdout:0/994: symlink db/l15a 0 2024-09-17T07:20:03.362 INFO:tasks.workunit.client.1.smithi139.stdout:1/527: dwrite d2/d10/d12/d35/d49/f7b [0,4194304] 0 2024-09-17T07:20:03.365 INFO:tasks.workunit.client.1.smithi139.stdout:1/528: getdents d2/d10/d12/d1a/d61 0 2024-09-17T07:20:03.369 INFO:tasks.workunit.client.1.smithi139.stdout:0/485: truncate d1/da/d1b/d32/f47 1336997 0 2024-09-17T07:20:03.371 INFO:tasks.workunit.client.1.smithi139.stdout:1/529: dwrite d2/d10/d12/fa0 [0,4194304] 0 2024-09-17T07:20:03.371 INFO:tasks.workunit.client.1.smithi139.stdout:0/486: stat d1/da/d1b/d32/f73 0 2024-09-17T07:20:03.373 INFO:tasks.workunit.client.1.smithi139.stdout:9/940: sync 2024-09-17T07:20:03.373 INFO:tasks.workunit.client.1.smithi139.stdout:6/739: sync 2024-09-17T07:20:03.374 INFO:tasks.workunit.client.1.smithi139.stdout:6/740: chown db/df/d4e/d64/d54/f2b 471776638 1 2024-09-17T07:20:03.376 INFO:tasks.workunit.client.1.smithi139.stdout:1/530: mkdir d2/d10/d12/d24/d38/da6 0 2024-09-17T07:20:03.378 INFO:tasks.workunit.client.1.smithi139.stdout:0/487: creat d1/da/d1b/d32/fbc x:0 0 0 2024-09-17T07:20:03.379 INFO:tasks.workunit.client.0.smithi087.stdout:9/785: dread d3/d25/d83/fad [0,4194304] 0 2024-09-17T07:20:03.381 INFO:tasks.workunit.client.0.smithi087.stdout:6/924: dwrite d1/d67/dfe/f36 [4194304,4194304] 0 2024-09-17T07:20:03.382 INFO:tasks.workunit.client.0.smithi087.stdout:3/833: dwrite d6/fdf [0,4194304] 0 2024-09-17T07:20:03.382 INFO:tasks.workunit.client.1.smithi139.stdout:6/741: creat db/df/d4e/d5e/d8a/f100 x:0 0 0 2024-09-17T07:20:03.384 INFO:tasks.workunit.client.0.smithi087.stdout:0/995: dwrite db/d45/d9e/d86/dd5/deb/ff5 [0,4194304] 0 2024-09-17T07:20:03.387 INFO:tasks.workunit.client.0.smithi087.stdout:6/925: read d1/d67/dfe/d2c/d40/d4c/da1/fde [282700,72136] 0 2024-09-17T07:20:03.388 INFO:tasks.workunit.client.1.smithi139.stdout:0/488: link d1/da/d2a/f38 d1/d58/fbd 0 2024-09-17T07:20:03.389 INFO:tasks.workunit.client.1.smithi139.stdout:1/531: creat d2/d10/d12/fa7 x:0 0 0 2024-09-17T07:20:03.390 INFO:tasks.workunit.client.0.smithi087.stdout:6/926: read - d1/d67/dfe/d5e/f73 zero size 2024-09-17T07:20:03.391 INFO:tasks.workunit.client.0.smithi087.stdout:3/834: read d6/d1b/d42/d62/dbb/fc2 [2675250,51068] 0 2024-09-17T07:20:03.392 INFO:tasks.workunit.client.1.smithi139.stdout:6/742: rename db/d18/d9f/lcc to db/df/d4e/d64/d83/dd5/l101 0 2024-09-17T07:20:03.393 INFO:tasks.workunit.client.1.smithi139.stdout:0/489: symlink d1/da/d1b/d32/d81/lbe 0 2024-09-17T07:20:03.394 INFO:tasks.workunit.client.0.smithi087.stdout:0/996: creat db/dbe/d124/f15b x:0 0 0 2024-09-17T07:20:03.395 INFO:tasks.workunit.client.0.smithi087.stdout:9/786: symlink d3/d4/da/dd7/l111 0 2024-09-17T07:20:03.396 INFO:tasks.workunit.client.1.smithi139.stdout:6/743: creat db/d21/f102 x:0 0 0 2024-09-17T07:20:03.397 INFO:tasks.workunit.client.1.smithi139.stdout:1/532: read d2/d10/d12/f69 [1396253,61794] 0 2024-09-17T07:20:03.398 INFO:tasks.workunit.client.0.smithi087.stdout:6/927: fsync d1/d67/dfe/d4e/de1/fea 0 2024-09-17T07:20:03.398 INFO:tasks.workunit.client.1.smithi139.stdout:0/490: mknod d1/da/cbf 0 2024-09-17T07:20:03.399 INFO:tasks.workunit.client.1.smithi139.stdout:6/744: rmdir db/d18/d5b 39 2024-09-17T07:20:03.399 INFO:tasks.workunit.client.0.smithi087.stdout:6/928: write d1/f11f [304152,20767] 0 2024-09-17T07:20:03.399 INFO:tasks.workunit.client.0.smithi087.stdout:3/835: creat d6/d1b/d42/d62/dbb/dd7/dee/f12c x:0 0 0 2024-09-17T07:20:03.400 INFO:tasks.workunit.client.0.smithi087.stdout:0/997: chown db/c26 54635964 1 2024-09-17T07:20:03.402 INFO:tasks.workunit.client.1.smithi139.stdout:1/533: creat d2/d10/d12/d35/d49/d8b/fa8 x:0 0 0 2024-09-17T07:20:03.403 INFO:tasks.workunit.client.0.smithi087.stdout:0/998: chown db/d45/d9e/d86/f98 13562633 1 2024-09-17T07:20:03.403 INFO:tasks.workunit.client.1.smithi139.stdout:6/745: readlink db/df/d4e/d5e/d8a/le7 0 2024-09-17T07:20:03.404 INFO:tasks.workunit.client.0.smithi087.stdout:9/787: rename d3/d4/dcd/f103 to d3/d4/d6/d8/d22/d43/d84/f112 0 2024-09-17T07:20:03.404 INFO:tasks.workunit.client.1.smithi139.stdout:6/746: chown db/d18/d38/f49 0 1 2024-09-17T07:20:03.405 INFO:tasks.workunit.client.0.smithi087.stdout:3/836: truncate d6/d15/d37/d3c/f54 4924292 0 2024-09-17T07:20:03.407 INFO:tasks.workunit.client.1.smithi139.stdout:6/747: fdatasync db/df/d73/dc1/fe9 0 2024-09-17T07:20:03.407 INFO:tasks.workunit.client.0.smithi087.stdout:6/929: creat d1/d67/dfe/d2c/d48/d118/d132/f135 x:0 0 0 2024-09-17T07:20:03.407 INFO:tasks.workunit.client.1.smithi139.stdout:0/491: dwrite d1/da/d1b/d3d/d5a/fb9 [0,4194304] 0 2024-09-17T07:20:03.410 INFO:tasks.workunit.client.0.smithi087.stdout:3/837: creat d6/d15/d37/d3c/d52/db2/d10a/d11b/d120/f12d x:0 0 0 2024-09-17T07:20:03.411 INFO:tasks.workunit.client.0.smithi087.stdout:0/999: dwrite db/d45/d7b/d7e/d130/f8f [0,4194304] 0 2024-09-17T07:20:03.413 INFO:tasks.workunit.client.1.smithi139.stdout:1/534: dwrite d2/d10/d12/d13/f82 [0,4194304] 0 2024-09-17T07:20:03.414 INFO:tasks.workunit.client.1.smithi139.stdout:9/941: dread dc/d11/f12 [0,4194304] 0 2024-09-17T07:20:03.415 INFO:tasks.workunit.client.0.smithi087.stdout:6/930: readlink d1/d67/dfe/d2c/d48/l53 0 2024-09-17T07:20:03.417 INFO:tasks.workunit.client.1.smithi139.stdout:1/535: fdatasync f0 0 2024-09-17T07:20:03.419 INFO:tasks.workunit.client.0.smithi087.stdout:9/788: rename d3/d4/d6/d8/d22/d2a to d3/d4/d6/d8/d22/d92/da3/d113 0 2024-09-17T07:20:03.421 INFO:tasks.workunit.client.1.smithi139.stdout:0/492: dread d1/f43 [0,4194304] 0 2024-09-17T07:20:03.421 INFO:tasks.workunit.client.1.smithi139.stdout:7/558: sync 2024-09-17T07:20:03.421 INFO:tasks.workunit.client.1.smithi139.stdout:9/942: mkdir dc/d11/d52/d56/d7a/da1/d137 0 2024-09-17T07:20:03.421 INFO:tasks.workunit.client.1.smithi139.stdout:8/870: sync 2024-09-17T07:20:03.421 INFO:tasks.workunit.client.1.smithi139.stdout:2/798: sync 2024-09-17T07:20:03.421 INFO:tasks.workunit.client.1.smithi139.stdout:3/728: sync 2024-09-17T07:20:03.422 INFO:tasks.workunit.client.1.smithi139.stdout:4/624: sync 2024-09-17T07:20:03.422 INFO:tasks.workunit.client.1.smithi139.stdout:5/765: sync 2024-09-17T07:20:03.422 INFO:tasks.workunit.client.0.smithi087.stdout:8/788: sync 2024-09-17T07:20:03.422 INFO:tasks.workunit.client.0.smithi087.stdout:7/630: sync 2024-09-17T07:20:03.423 INFO:tasks.workunit.client.0.smithi087.stdout:1/766: sync 2024-09-17T07:20:03.423 INFO:tasks.workunit.client.0.smithi087.stdout:8/789: chown d1/d2b/d21/ffb 15395468 1 2024-09-17T07:20:03.423 INFO:tasks.workunit.client.0.smithi087.stdout:6/931: mkdir d1/d6a/dda/d123/d136 0 2024-09-17T07:20:03.426 INFO:tasks.workunit.client.0.smithi087.stdout:1/767: mknod d2/dcf/c10b 0 2024-09-17T07:20:03.426 INFO:tasks.workunit.client.1.smithi139.stdout:5/766: chown d4/d16/d1b/d20/d32/d72/fae 249182 1 2024-09-17T07:20:03.427 INFO:tasks.workunit.client.0.smithi087.stdout:8/790: creat d1/d7/d63/dd9/dcf/f112 x:0 0 0 2024-09-17T07:20:03.428 INFO:tasks.workunit.client.0.smithi087.stdout:6/932: getdents d1/d6/d68 0 2024-09-17T07:20:03.429 INFO:tasks.workunit.client.0.smithi087.stdout:1/768: mkdir d2/d69/d8d/d10c 0 2024-09-17T07:20:03.430 INFO:tasks.workunit.client.1.smithi139.stdout:1/536: chown d2/d10/d12/d24/d38/d3d/c3f 13 1 2024-09-17T07:20:03.431 INFO:tasks.workunit.client.0.smithi087.stdout:1/769: mknod d2/dcf/c10d 0 2024-09-17T07:20:03.432 INFO:tasks.workunit.client.0.smithi087.stdout:1/770: stat d2/d3d/d35/c56 0 2024-09-17T07:20:03.432 INFO:tasks.workunit.client.1.smithi139.stdout:5/767: fsync d4/d16/d1b/d20/d32/d6c/dc9/dcb/ff2 0 2024-09-17T07:20:03.433 INFO:tasks.workunit.client.1.smithi139.stdout:0/493: creat d1/da/d17/d72/d66/d6c/fc0 x:0 0 0 2024-09-17T07:20:03.436 INFO:tasks.workunit.client.1.smithi139.stdout:0/494: stat d1/d58/d7d 0 2024-09-17T07:20:03.436 INFO:tasks.workunit.client.1.smithi139.stdout:7/559: dread d5/d10/d4d/d59/f5f [0,4194304] 0 2024-09-17T07:20:03.437 INFO:tasks.workunit.client.1.smithi139.stdout:3/729: mknod d5/d15/d16/ce0 0 2024-09-17T07:20:03.437 INFO:tasks.workunit.client.1.smithi139.stdout:5/768: chown d4/d16/d1b/l7f 0 1 2024-09-17T07:20:03.438 INFO:tasks.workunit.client.1.smithi139.stdout:4/625: dwrite d0/f4c [0,4194304] 0 2024-09-17T07:20:03.439 INFO:tasks.workunit.client.1.smithi139.stdout:8/871: creat d0/d20/d28/d52/d65/dbe/f11b x:0 0 0 2024-09-17T07:20:03.440 INFO:tasks.workunit.client.0.smithi087.stdout:1/771: dwrite d2/d3d/d45/d90/d43/d5d/fec [0,4194304] 0 2024-09-17T07:20:03.440 INFO:tasks.workunit.client.1.smithi139.stdout:1/537: mknod d2/d10/ca9 0 2024-09-17T07:20:03.440 INFO:tasks.workunit.client.1.smithi139.stdout:6/748: write db/df/d4e/d5e/fa8 [79278,95851] 0 2024-09-17T07:20:03.442 INFO:tasks.workunit.client.1.smithi139.stdout:7/560: unlink d5/f6e 0 2024-09-17T07:20:03.443 INFO:tasks.workunit.client.1.smithi139.stdout:3/730: creat d5/da7/dca/fe1 x:0 0 0 2024-09-17T07:20:03.444 INFO:tasks.workunit.client.1.smithi139.stdout:4/626: chown d0/d1/d9b/ca6 13 1 2024-09-17T07:20:03.444 INFO:tasks.workunit.client.1.smithi139.stdout:0/495: symlink d1/da/d1b/d3d/lc1 0 2024-09-17T07:20:03.446 INFO:tasks.workunit.client.1.smithi139.stdout:7/561: stat d5/d67/f82 0 2024-09-17T07:20:03.448 INFO:tasks.workunit.client.1.smithi139.stdout:6/749: mkdir db/db7/ddb/d103 0 2024-09-17T07:20:03.448 INFO:tasks.workunit.client.1.smithi139.stdout:1/538: write d2/d10/d12/d1a/f21 [783671,103867] 0 2024-09-17T07:20:03.449 INFO:tasks.workunit.client.0.smithi087.stdout:7/631: dread d0/d3/d10/d31/f43 [0,4194304] 0 2024-09-17T07:20:03.449 INFO:tasks.workunit.client.1.smithi139.stdout:2/799: dwrite d0/d7/d67/d92/d99/f72 [4194304,4194304] 0 2024-09-17T07:20:03.449 INFO:tasks.workunit.client.1.smithi139.stdout:3/731: creat d5/d15/d56/fe2 x:0 0 0 2024-09-17T07:20:03.450 INFO:tasks.workunit.client.0.smithi087.stdout:1/772: dwrite d2/d48/d6f/f109 [0,4194304] 0 2024-09-17T07:20:03.454 INFO:tasks.workunit.client.1.smithi139.stdout:5/769: rename d4/d16/l4a to d4/d16/d1b/de7/lfb 0 2024-09-17T07:20:03.455 INFO:tasks.workunit.client.0.smithi087.stdout:3/838: truncate d6/d15/d37/d3c/d43/db7/fdb 3538104 0 2024-09-17T07:20:03.457 INFO:tasks.workunit.client.1.smithi139.stdout:0/496: symlink d1/da/d1b/d3d/d5a/lc2 0 2024-09-17T07:20:03.457 INFO:tasks.workunit.client.1.smithi139.stdout:2/800: write d0/de/df/d56/f7a [4639098,26650] 0 2024-09-17T07:20:03.458 INFO:tasks.workunit.client.0.smithi087.stdout:1/773: creat d2/dcf/d7e/db9/dfb/d101/f10e x:0 0 0 2024-09-17T07:20:03.459 INFO:tasks.workunit.client.1.smithi139.stdout:6/750: write db/df/d4e/d64/d83/dd5/ff9 [696296,66804] 0 2024-09-17T07:20:03.460 INFO:tasks.workunit.client.0.smithi087.stdout:3/839: fsync d6/d1b/d42/d62/dbb/fc2 0 2024-09-17T07:20:03.461 INFO:tasks.workunit.client.0.smithi087.stdout:1/774: readlink d2/d3d/d45/d90/d43/d5d/lca 0 2024-09-17T07:20:03.462 INFO:tasks.workunit.client.0.smithi087.stdout:3/840: chown d6/d15/d37/ff4 44516260 1 2024-09-17T07:20:03.462 INFO:tasks.workunit.client.1.smithi139.stdout:7/562: mkdir d5/d10/d2b/d78/d9e/db1 0 2024-09-17T07:20:03.462 INFO:tasks.workunit.client.1.smithi139.stdout:5/770: stat d4/d16/d1b/d20/d32/d6c/lb9 0 2024-09-17T07:20:03.462 INFO:tasks.workunit.client.1.smithi139.stdout:8/872: dwrite d0/d20/d28/d48/fbc [0,4194304] 0 2024-09-17T07:20:03.463 INFO:tasks.workunit.client.1.smithi139.stdout:3/732: creat d5/da7/dca/dd7/fe3 x:0 0 0 2024-09-17T07:20:03.465 INFO:tasks.workunit.client.1.smithi139.stdout:0/497: readlink d1/da/d1b/d3d/d5a/lc2 0 2024-09-17T07:20:03.467 INFO:tasks.workunit.client.1.smithi139.stdout:0/498: chown d1/d58 156211201 1 2024-09-17T07:20:03.467 INFO:tasks.workunit.client.0.smithi087.stdout:6/933: dread d1/f18 [4194304,4194304] 0 2024-09-17T07:20:03.467 INFO:tasks.workunit.client.0.smithi087.stdout:1/775: mknod d2/d3d/d35/d57/c10f 0 2024-09-17T07:20:03.471 INFO:tasks.workunit.client.0.smithi087.stdout:6/934: symlink d1/d67/dfe/d2c/d48/d62/l137 0 2024-09-17T07:20:03.471 INFO:tasks.workunit.client.1.smithi139.stdout:1/539: dread d2/d10/d12/d13/d4f/d5c/fa2 [0,4194304] 0 2024-09-17T07:20:03.472 INFO:tasks.workunit.client.0.smithi087.stdout:1/776: rmdir d2/d69/d8d/d10c 0 2024-09-17T07:20:03.473 INFO:tasks.workunit.client.1.smithi139.stdout:2/801: dread d0/d7/d86/da4/d12/dcd/fe8 [0,4194304] 0 2024-09-17T07:20:03.473 INFO:tasks.workunit.client.1.smithi139.stdout:6/751: rename db/c76 to db/df/daa/de3/c104 0 2024-09-17T07:20:03.475 INFO:tasks.workunit.client.1.smithi139.stdout:7/563: symlink d5/d17/d4e/d66/lb2 0 2024-09-17T07:20:03.477 INFO:tasks.workunit.client.1.smithi139.stdout:8/873: mknod d0/d1a/d3a/d8d/c11c 0 2024-09-17T07:20:03.478 INFO:tasks.workunit.client.1.smithi139.stdout:0/499: mknod d1/da/d1b/d3d/cc3 0 2024-09-17T07:20:03.479 INFO:tasks.workunit.client.1.smithi139.stdout:2/802: mknod d0/de/d69/c10e 0 2024-09-17T07:20:03.481 INFO:tasks.workunit.client.0.smithi087.stdout:7/632: dread d0/fd [0,4194304] 0 2024-09-17T07:20:03.483 INFO:tasks.workunit.client.0.smithi087.stdout:7/633: fdatasync d0/d3/d10/d87/d96/fa6 0 2024-09-17T07:20:03.484 INFO:tasks.workunit.client.1.smithi139.stdout:7/564: mknod d5/d10/d2b/d78/d9e/db1/cb3 0 2024-09-17T07:20:03.484 INFO:tasks.workunit.client.1.smithi139.stdout:3/733: dwrite d5/da7/dca/dab/dd6/d28/d54/d8e/fbe [0,4194304] 0 2024-09-17T07:20:03.484 INFO:tasks.workunit.client.1.smithi139.stdout:0/500: rmdir d1/da/d17/d72 39 2024-09-17T07:20:03.486 INFO:tasks.workunit.client.0.smithi087.stdout:7/634: getdents d0/d3 0 2024-09-17T07:20:03.488 INFO:tasks.workunit.client.1.smithi139.stdout:0/501: dread - d1/da/d17/f9f zero size 2024-09-17T07:20:03.490 INFO:tasks.workunit.client.0.smithi087.stdout:7/635: link d0/d3/c83 d0/d3/d23/d4e/cbf 0 2024-09-17T07:20:03.492 INFO:tasks.workunit.client.0.smithi087.stdout:7/636: symlink d0/d3/d10/d32/d8c/lc0 0 2024-09-17T07:20:03.496 INFO:tasks.workunit.client.0.smithi087.stdout:7/637: mkdir d0/d3/d10/d31/dc1 0 2024-09-17T07:20:03.497 INFO:tasks.workunit.client.0.smithi087.stdout:1/777: dread d2/dcf/d7e/f83 [0,4194304] 0 2024-09-17T07:20:03.499 INFO:tasks.workunit.client.1.smithi139.stdout:1/540: dwrite d2/f7 [0,4194304] 0 2024-09-17T07:20:03.500 INFO:tasks.workunit.client.0.smithi087.stdout:7/638: getdents d0 0 2024-09-17T07:20:03.500 INFO:tasks.workunit.client.0.smithi087.stdout:7/639: readlink d0/d3/d23/d4e/l64 0 2024-09-17T07:20:03.501 INFO:tasks.workunit.client.0.smithi087.stdout:1/778: rename d2/d3d/d45/d90/d43/fd0 to d2/f110 0 2024-09-17T07:20:03.503 INFO:tasks.workunit.client.1.smithi139.stdout:8/874: dwrite d0/d20/f87 [0,4194304] 0 2024-09-17T07:20:03.503 INFO:tasks.workunit.client.1.smithi139.stdout:5/771: dread d4/d16/d1b/d20/d38/d4f/f5c [0,4194304] 0 2024-09-17T07:20:03.506 INFO:tasks.workunit.client.1.smithi139.stdout:2/803: dwrite d0/de/df/d56/fab [0,4194304] 0 2024-09-17T07:20:03.506 INFO:tasks.workunit.client.1.smithi139.stdout:2/804: chown d0/de/d54/l61 266397 1 2024-09-17T07:20:03.509 INFO:tasks.workunit.client.0.smithi087.stdout:7/640: rmdir d0/d3/d10 39 2024-09-17T07:20:03.509 INFO:tasks.workunit.client.0.smithi087.stdout:7/641: fsync d0/d3/d23/d2d/f35 0 2024-09-17T07:20:03.517 INFO:tasks.workunit.client.0.smithi087.stdout:1/779: dread d2/d3d/d45/d90/f20 [0,4194304] 0 2024-09-17T07:20:03.530 INFO:tasks.workunit.client.0.smithi087.stdout:1/780: write d2/d48/f5e [2522656,25313] 0 2024-09-17T07:20:03.532 INFO:tasks.workunit.client.0.smithi087.stdout:1/781: unlink d2/d3d/d35/d57/d73/l74 0 2024-09-17T07:20:03.549 INFO:tasks.workunit.client.0.smithi087.stdout:1/782: dread d2/d3d/d45/d90/ff [4194304,4194304] 0 2024-09-17T07:20:03.551 INFO:tasks.workunit.client.0.smithi087.stdout:1/783: fdatasync d2/d3d/d45/d90/f18 0 2024-09-17T07:20:03.553 INFO:tasks.workunit.client.0.smithi087.stdout:1/784: write d2/d3d/d45/d90/d37/f52 [2126730,114954] 0 2024-09-17T07:20:03.555 INFO:tasks.workunit.client.0.smithi087.stdout:1/785: creat d2/d69/f111 x:0 0 0 2024-09-17T07:20:03.556 INFO:tasks.workunit.client.0.smithi087.stdout:1/786: write d2/d3d/d45/d90/d37/f52 [34761,3453] 0 2024-09-17T07:20:03.558 INFO:tasks.workunit.client.0.smithi087.stdout:1/787: symlink d2/d3d/d45/d90/d43/d5d/l112 0 2024-09-17T07:20:03.559 INFO:tasks.workunit.client.0.smithi087.stdout:1/788: rmdir d2/dcf/d7e/db9/dfb/d101 39 2024-09-17T07:20:03.560 INFO:tasks.workunit.client.0.smithi087.stdout:1/789: rmdir d2/d3d/d8e 39 2024-09-17T07:20:03.600 INFO:tasks.workunit.client.1.smithi139.stdout:1/541: dwrite d2/d10/d12/f31 [0,4194304] 0 2024-09-17T07:20:03.600 INFO:tasks.workunit.client.1.smithi139.stdout:8/875: rename d0/d20/d28/d52/l68 to d0/d20/d28/d52/d65/dbe/deb/l11d 0 2024-09-17T07:20:03.600 INFO:tasks.workunit.client.1.smithi139.stdout:0/502: rmdir d1/da/d17/d72/d66 39 2024-09-17T07:20:03.601 INFO:tasks.workunit.client.1.smithi139.stdout:8/876: write d0/f72 [2880568,75619] 0 2024-09-17T07:20:03.608 INFO:tasks.workunit.client.1.smithi139.stdout:1/542: dread d2/f58 [0,4194304] 0 2024-09-17T07:20:03.609 INFO:tasks.workunit.client.1.smithi139.stdout:0/503: dwrite d1/da/d17/d72/f30 [0,4194304] 0 2024-09-17T07:20:03.617 INFO:tasks.workunit.client.1.smithi139.stdout:1/543: dwrite d2/f58 [0,4194304] 0 2024-09-17T07:20:03.623 INFO:tasks.workunit.client.1.smithi139.stdout:1/544: rmdir d2/d10/d12/d35/d49/d8d/d9b/d9d 0 2024-09-17T07:20:03.624 INFO:tasks.workunit.client.1.smithi139.stdout:1/545: read - d2/d10/d12/d13/d4f/f87 zero size 2024-09-17T07:20:03.628 INFO:tasks.workunit.client.1.smithi139.stdout:1/546: read d2/d10/d12/f76 [2059438,87378] 0 2024-09-17T07:20:03.628 INFO:tasks.workunit.client.1.smithi139.stdout:3/734: truncate d5/d15/f62 1725270 0 2024-09-17T07:20:03.630 INFO:tasks.workunit.client.1.smithi139.stdout:1/547: truncate d2/f11 1080982 0 2024-09-17T07:20:03.632 INFO:tasks.workunit.client.1.smithi139.stdout:1/548: creat d2/d10/d12/d1a/d61/faa x:0 0 0 2024-09-17T07:20:03.635 INFO:tasks.workunit.client.1.smithi139.stdout:8/877: write d0/d1a/d3a/d8d/fac [1482320,46122] 0 2024-09-17T07:20:03.636 INFO:tasks.workunit.client.1.smithi139.stdout:8/878: readlink d0/d20/d28/d52/d54/lcd 0 2024-09-17T07:20:03.637 INFO:tasks.workunit.client.1.smithi139.stdout:8/879: fsync d0/d96/fda 0 2024-09-17T07:20:03.644 INFO:tasks.workunit.client.1.smithi139.stdout:8/880: write d0/d1a/fb8 [836226,121958] 0 2024-09-17T07:20:03.648 INFO:tasks.workunit.client.1.smithi139.stdout:3/735: dwrite d5/da7/dca/dab/dd6/d28/d54/d8e/fbe [4194304,4194304] 0 2024-09-17T07:20:03.649 INFO:tasks.workunit.client.1.smithi139.stdout:8/881: mkdir d0/d20/d28/d48/de1/d11e 0 2024-09-17T07:20:03.649 INFO:tasks.workunit.client.1.smithi139.stdout:1/549: dwrite d2/d10/d12/d24/d38/d3d/f99 [0,4194304] 0 2024-09-17T07:20:03.651 INFO:tasks.workunit.client.1.smithi139.stdout:8/882: read d0/d20/d28/ffc [4206296,68426] 0 2024-09-17T07:20:03.653 INFO:tasks.workunit.client.1.smithi139.stdout:8/883: write d0/d20/d28/d52/f103 [563316,76423] 0 2024-09-17T07:20:03.657 INFO:tasks.workunit.client.1.smithi139.stdout:8/884: rmdir d0 39 2024-09-17T07:20:03.659 INFO:tasks.workunit.client.1.smithi139.stdout:3/736: write d5/d15/d56/f7c [4779761,40831] 0 2024-09-17T07:20:03.660 INFO:tasks.workunit.client.1.smithi139.stdout:3/737: stat d5/d21/dba 0 2024-09-17T07:20:03.661 INFO:tasks.workunit.client.1.smithi139.stdout:3/738: read - d5/d21/d23/d69/fbf zero size 2024-09-17T07:20:03.664 INFO:tasks.workunit.client.1.smithi139.stdout:3/739: mknod d5/d15/d20/d3b/dc1/ce4 0 2024-09-17T07:20:03.668 INFO:tasks.workunit.client.1.smithi139.stdout:1/550: dread d2/d10/d12/d24/f8c [0,4194304] 0 2024-09-17T07:20:03.670 INFO:tasks.workunit.client.1.smithi139.stdout:1/551: write d2/d10/d12/d1a/f96 [837869,44066] 0 2024-09-17T07:20:03.670 INFO:tasks.workunit.client.1.smithi139.stdout:1/552: fdatasync d2/d10/d12/fa0 0 2024-09-17T07:20:03.671 INFO:tasks.workunit.client.1.smithi139.stdout:1/553: readlink d2/d10/d12/d1a/d61/l66 0 2024-09-17T07:20:03.672 INFO:tasks.workunit.client.1.smithi139.stdout:3/740: dread d5/d63/d6d/f71 [0,4194304] 0 2024-09-17T07:20:03.675 INFO:tasks.workunit.client.1.smithi139.stdout:3/741: creat d5/d63/fe5 x:0 0 0 2024-09-17T07:20:03.677 INFO:tasks.workunit.client.1.smithi139.stdout:3/742: rmdir d5/d21/d23 39 2024-09-17T07:20:03.678 INFO:tasks.workunit.client.1.smithi139.stdout:1/554: mkdir d2/d10/d12/d13/d4f/d5c/d92/dab 0 2024-09-17T07:20:03.679 INFO:tasks.workunit.client.0.smithi087.stdout:4/938: sync 2024-09-17T07:20:03.680 INFO:tasks.workunit.client.1.smithi139.stdout:1/555: symlink d2/d10/d12/d13/lac 0 2024-09-17T07:20:03.682 INFO:tasks.workunit.client.0.smithi087.stdout:4/939: mkdir d2/d14e 0 2024-09-17T07:20:03.684 INFO:tasks.workunit.client.1.smithi139.stdout:1/556: mknod d2/d10/d12/d35/d2b/d4a/d6f/cad 0 2024-09-17T07:20:03.684 INFO:tasks.workunit.client.1.smithi139.stdout:3/743: link d5/da7/dca/dab/dd6/d28/la3 d5/d63/db3/ddb/le6 0 2024-09-17T07:20:03.684 INFO:tasks.workunit.client.0.smithi087.stdout:4/940: creat d2/d92/d4d/d42/db6/f14f x:0 0 0 2024-09-17T07:20:03.685 INFO:tasks.workunit.client.0.smithi087.stdout:4/941: truncate d2/d92/d4d/d42/f148 161754 0 2024-09-17T07:20:03.687 INFO:tasks.workunit.client.1.smithi139.stdout:8/885: dread d0/d20/d28/ffc [4194304,4194304] 0 2024-09-17T07:20:03.688 INFO:tasks.workunit.client.1.smithi139.stdout:1/557: rmdir d2/d10/d12/d13/d4f/d5c 39 2024-09-17T07:20:03.691 INFO:tasks.workunit.client.1.smithi139.stdout:1/558: creat d2/d10/d12/d1a/fae x:0 0 0 2024-09-17T07:20:03.693 INFO:tasks.workunit.client.1.smithi139.stdout:3/744: link d5/da7/dca/dab/dd6/d28/d54/d58/c7b d5/da7/dca/dab/dd6/d28/d54/d58/ce7 0 2024-09-17T07:20:03.694 INFO:tasks.workunit.client.0.smithi087.stdout:4/942: dread d2/d22/d2c/d91/dcf/f12d [0,4194304] 0 2024-09-17T07:20:03.695 INFO:tasks.workunit.client.1.smithi139.stdout:8/886: creat d0/d20/d28/d52/d99/db4/f11f x:0 0 0 2024-09-17T07:20:03.696 INFO:tasks.workunit.client.1.smithi139.stdout:3/745: mknod d5/da7/dca/dd7/ce8 0 2024-09-17T07:20:03.697 INFO:tasks.workunit.client.1.smithi139.stdout:3/746: write f2 [48557,120519] 0 2024-09-17T07:20:03.698 INFO:tasks.workunit.client.1.smithi139.stdout:1/559: rename d2/d10/d12/d13/d4f/d5c/f5f to d2/d10/d12/d1a/d61/faf 0 2024-09-17T07:20:03.700 INFO:tasks.workunit.client.1.smithi139.stdout:3/747: symlink d5/d63/d6d/le9 0 2024-09-17T07:20:03.702 INFO:tasks.workunit.client.1.smithi139.stdout:3/748: dread - d5/d21/d23/d69/dd5/fda zero size 2024-09-17T07:20:03.703 INFO:tasks.workunit.client.1.smithi139.stdout:8/887: getdents d0/d1a/d3a 0 2024-09-17T07:20:03.704 INFO:tasks.workunit.client.1.smithi139.stdout:3/749: dread - d5/d21/d23/d69/fbf zero size 2024-09-17T07:20:03.706 INFO:tasks.workunit.client.1.smithi139.stdout:8/888: unlink d0/d1a/f4a 0 2024-09-17T07:20:03.708 INFO:tasks.workunit.client.1.smithi139.stdout:8/889: creat d0/d1a/d82/f120 x:0 0 0 2024-09-17T07:20:03.709 INFO:tasks.workunit.client.0.smithi087.stdout:4/943: dread d2/d92/d4d/d21/d2f/f47 [4194304,4194304] 0 2024-09-17T07:20:03.711 INFO:tasks.workunit.client.0.smithi087.stdout:4/944: creat d2/d14e/f150 x:0 0 0 2024-09-17T07:20:03.711 INFO:tasks.workunit.client.0.smithi087.stdout:4/945: dread - d2/d92/d4d/d42/db6/f14f zero size 2024-09-17T07:20:03.712 INFO:tasks.workunit.client.1.smithi139.stdout:1/560: dread d2/d10/d12/d35/d2b/f97 [0,4194304] 0 2024-09-17T07:20:03.712 INFO:tasks.workunit.client.1.smithi139.stdout:1/561: stat d2/c2e 0 2024-09-17T07:20:03.712 INFO:tasks.workunit.client.1.smithi139.stdout:8/890: mkdir d0/d1a/d4d/d121 0 2024-09-17T07:20:03.714 INFO:tasks.workunit.client.1.smithi139.stdout:8/891: chown d0/d20/d28/d52/d54/l91 12 1 2024-09-17T07:20:03.714 INFO:tasks.workunit.client.0.smithi087.stdout:4/946: creat d2/d22/d2c/d96/d14b/f151 x:0 0 0 2024-09-17T07:20:03.715 INFO:tasks.workunit.client.1.smithi139.stdout:1/562: mknod d2/d10/d12/d35/d2b/d4a/d6f/cb0 0 2024-09-17T07:20:03.718 INFO:tasks.workunit.client.1.smithi139.stdout:8/892: creat d0/d20/d28/d52/d54/f122 x:0 0 0 2024-09-17T07:20:03.718 INFO:tasks.workunit.client.1.smithi139.stdout:1/563: mkdir d2/d10/d12/d1a/db1 0 2024-09-17T07:20:03.719 INFO:tasks.workunit.client.1.smithi139.stdout:3/750: dwrite d5/d21/d23/f88 [0,4194304] 0 2024-09-17T07:20:03.719 INFO:tasks.workunit.client.1.smithi139.stdout:1/564: stat d2/d10/d12/f88 0 2024-09-17T07:20:03.721 INFO:tasks.workunit.client.1.smithi139.stdout:8/893: creat d0/d1a/d82/f123 x:0 0 0 2024-09-17T07:20:03.724 INFO:tasks.workunit.client.0.smithi087.stdout:4/947: dwrite d2/d92/d4d/d21/d2f/fb3 [0,4194304] 0 2024-09-17T07:20:03.724 INFO:tasks.workunit.client.1.smithi139.stdout:1/565: getdents d2/d10 0 2024-09-17T07:20:03.726 INFO:tasks.workunit.client.0.smithi087.stdout:4/948: chown d2/c107 2174 1 2024-09-17T07:20:03.728 INFO:tasks.workunit.client.1.smithi139.stdout:8/894: dwrite d0/d20/d28/d48/fbc [0,4194304] 0 2024-09-17T07:20:03.729 INFO:tasks.workunit.client.0.smithi087.stdout:4/949: rmdir d2/d5/d1f/da7 39 2024-09-17T07:20:03.731 INFO:tasks.workunit.client.1.smithi139.stdout:8/895: symlink d0/d1a/d3a/d71/l124 0 2024-09-17T07:20:03.733 INFO:tasks.workunit.client.0.smithi087.stdout:4/950: rename d2/d5/d1f/fc6 to d2/d22/d2c/d91/f152 0 2024-09-17T07:20:03.735 INFO:tasks.workunit.client.1.smithi139.stdout:8/896: symlink d0/d20/d28/d52/d99/l125 0 2024-09-17T07:20:03.746 INFO:tasks.workunit.client.1.smithi139.stdout:1/566: dread d2/d10/d12/f2d [0,4194304] 0 2024-09-17T07:20:03.747 INFO:tasks.workunit.client.1.smithi139.stdout:1/567: chown d2/d10/d12/d1a/d61/l66 775240162 1 2024-09-17T07:20:03.748 INFO:tasks.workunit.client.1.smithi139.stdout:1/568: rmdir d2/d10/d12/d35/d49 39 2024-09-17T07:20:03.749 INFO:tasks.workunit.client.0.smithi087.stdout:4/951: write d2/d92/d4d/d42/f9b [1604550,99643] 0 2024-09-17T07:20:03.750 INFO:tasks.workunit.client.1.smithi139.stdout:1/569: mkdir d2/d10/d12/d24/db2 0 2024-09-17T07:20:03.752 INFO:tasks.workunit.client.1.smithi139.stdout:1/570: fsync d2/d10/d12/d35/d49/f80 0 2024-09-17T07:20:03.755 INFO:tasks.workunit.client.1.smithi139.stdout:1/571: getdents d2/d10/d12/d13/d4f/d5c 0 2024-09-17T07:20:03.757 INFO:tasks.workunit.client.1.smithi139.stdout:1/572: creat d2/d10/d12/d13/d4f/d5c/fb3 x:0 0 0 2024-09-17T07:20:03.758 INFO:tasks.workunit.client.1.smithi139.stdout:8/897: write d0/d1a/f39 [1479754,70775] 0 2024-09-17T07:20:03.760 INFO:tasks.workunit.client.1.smithi139.stdout:1/573: unlink d2/f46 0 2024-09-17T07:20:03.761 INFO:tasks.workunit.client.1.smithi139.stdout:8/898: chown d0/d20/d28/d52/d65/dd3/de4/c45 236336927 1 2024-09-17T07:20:03.761 INFO:tasks.workunit.client.1.smithi139.stdout:1/574: dread - d2/d10/d12/fa7 zero size 2024-09-17T07:20:03.762 INFO:tasks.workunit.client.1.smithi139.stdout:1/575: chown d2/d10/d12/d24 637 1 2024-09-17T07:20:03.763 INFO:tasks.workunit.client.1.smithi139.stdout:8/899: creat d0/d1a/d4d/da4/dc4/f126 x:0 0 0 2024-09-17T07:20:03.766 INFO:tasks.workunit.client.1.smithi139.stdout:8/900: truncate d0/d1a/d4d/d53/fd2 1411644 0 2024-09-17T07:20:03.768 INFO:tasks.workunit.client.1.smithi139.stdout:1/576: dwrite d2/f7 [0,4194304] 0 2024-09-17T07:20:03.769 INFO:tasks.workunit.client.1.smithi139.stdout:1/577: chown d2/d10/d12/d13/f16 5726 1 2024-09-17T07:20:03.769 INFO:tasks.workunit.client.1.smithi139.stdout:8/901: mkdir d0/d1a/d3a/d71/d127 0 2024-09-17T07:20:03.770 INFO:tasks.workunit.client.0.smithi087.stdout:4/952: dread d2/d92/d4d/fd [0,4194304] 0 2024-09-17T07:20:03.772 INFO:tasks.workunit.client.1.smithi139.stdout:1/578: rmdir d2/d10 39 2024-09-17T07:20:03.772 INFO:tasks.workunit.client.1.smithi139.stdout:8/902: write d0/d20/d28/d52/d65/d7f/db6/dfb/ffe [572838,22255] 0 2024-09-17T07:20:03.773 INFO:tasks.workunit.client.0.smithi087.stdout:4/953: unlink d2/d22/d2c/d96/d14b/f144 0 2024-09-17T07:20:03.773 INFO:tasks.workunit.client.1.smithi139.stdout:8/903: chown d0/d1a/d3a/d71 27388 1 2024-09-17T07:20:03.774 INFO:tasks.workunit.client.1.smithi139.stdout:1/579: chown d2/d10/d12/d35/f44 1300790 1 2024-09-17T07:20:03.774 INFO:tasks.workunit.client.0.smithi087.stdout:4/954: chown d2/l57 57509858 1 2024-09-17T07:20:03.776 INFO:tasks.workunit.client.0.smithi087.stdout:4/955: creat d2/d22/d2c/f153 x:0 0 0 2024-09-17T07:20:03.776 INFO:tasks.workunit.client.0.smithi087.stdout:4/956: fsync d2/d22/d95/f13a 0 2024-09-17T07:20:03.777 INFO:tasks.workunit.client.1.smithi139.stdout:8/904: rename d0/d20/d28/d48/de1/f10e to d0/d20/d28/d52/d54/f128 0 2024-09-17T07:20:03.780 INFO:tasks.workunit.client.1.smithi139.stdout:1/580: dwrite d2/d10/d12/d35/d2b/f34 [4194304,4194304] 0 2024-09-17T07:20:03.787 INFO:tasks.workunit.client.0.smithi087.stdout:4/957: truncate d2/d22/d62/ff6 428387 0 2024-09-17T07:20:03.788 INFO:tasks.workunit.client.0.smithi087.stdout:4/958: stat d2/d22/d2c/d91/d113/f52 0 2024-09-17T07:20:03.788 INFO:tasks.workunit.client.1.smithi139.stdout:1/581: dwrite d2/d10/d12/d35/d49/f80 [0,4194304] 0 2024-09-17T07:20:03.790 INFO:tasks.workunit.client.0.smithi087.stdout:4/959: unlink d2/d92/d86/f140 0 2024-09-17T07:20:03.791 INFO:tasks.workunit.client.1.smithi139.stdout:1/582: rmdir d2/d10/d12/d35/d2b 39 2024-09-17T07:20:03.791 INFO:tasks.workunit.client.0.smithi087.stdout:4/960: chown d2/d92/d4d/d42/db6/dd9/d143 722 1 2024-09-17T07:20:03.792 INFO:tasks.workunit.client.0.smithi087.stdout:4/961: read - d2/d92/ff5 zero size 2024-09-17T07:20:03.795 INFO:tasks.workunit.client.1.smithi139.stdout:1/583: dread d2/d10/d12/f2d [0,4194304] 0 2024-09-17T07:20:03.795 INFO:tasks.workunit.client.0.smithi087.stdout:4/962: creat d2/d22/d10e/f154 x:0 0 0 2024-09-17T07:20:03.797 INFO:tasks.workunit.client.1.smithi139.stdout:1/584: mkdir d2/d10/db4 0 2024-09-17T07:20:03.809 INFO:tasks.workunit.client.0.smithi087.stdout:4/963: truncate d2/d5/d1f/da7/d11e/f13b 2982054 0 2024-09-17T07:20:03.812 INFO:tasks.workunit.client.0.smithi087.stdout:4/964: getdents d2/d22/d2c 0 2024-09-17T07:20:03.813 INFO:tasks.workunit.client.0.smithi087.stdout:2/731: sync 2024-09-17T07:20:03.814 INFO:tasks.workunit.client.0.smithi087.stdout:2/732: write d2/d7/dd/fd3 [110449,52476] 0 2024-09-17T07:20:03.814 INFO:tasks.workunit.client.0.smithi087.stdout:4/965: creat d2/d92/d4d/d21/d2f/d3b/d7e/d97/da8/f155 x:0 0 0 2024-09-17T07:20:03.815 INFO:tasks.workunit.client.0.smithi087.stdout:4/966: dread - d2/d92/d4d/d42/db6/f14f zero size 2024-09-17T07:20:03.816 INFO:tasks.workunit.client.1.smithi139.stdout:1/585: dwrite d2/d10/d12/d1a/f5b [0,4194304] 0 2024-09-17T07:20:03.816 INFO:tasks.workunit.client.0.smithi087.stdout:2/733: symlink d2/d48/le8 0 2024-09-17T07:20:03.817 INFO:tasks.workunit.client.0.smithi087.stdout:4/967: chown d2/d22/d2c/d96/d14b/d6a/df3 942971 1 2024-09-17T07:20:03.820 INFO:tasks.workunit.client.1.smithi139.stdout:1/586: creat d2/d10/fb5 x:0 0 0 2024-09-17T07:20:03.821 INFO:tasks.workunit.client.0.smithi087.stdout:4/968: fsync d2/d92/d4d/d21/d2f/d6e/fc1 0 2024-09-17T07:20:03.822 INFO:tasks.workunit.client.0.smithi087.stdout:2/734: write d2/d15/f21 [619942,79791] 0 2024-09-17T07:20:03.822 INFO:tasks.workunit.client.0.smithi087.stdout:4/969: write d2/d92/d4d/d21/f79 [4243860,30679] 0 2024-09-17T07:20:03.824 INFO:tasks.workunit.client.0.smithi087.stdout:4/970: write d2/d92/d4d/d42/db6/f14f [66088,96527] 0 2024-09-17T07:20:03.825 INFO:tasks.workunit.client.0.smithi087.stdout:4/971: fdatasync d2/d92/d4d/d21/d2f/d3b/d7e/d97/fd5 0 2024-09-17T07:20:03.832 INFO:tasks.workunit.client.0.smithi087.stdout:4/972: dwrite d2/d22/d2c/d96/d14b/d6a/d9d/f135 [0,4194304] 0 2024-09-17T07:20:03.837 INFO:tasks.workunit.client.1.smithi139.stdout:1/587: dwrite d2/d10/d12/f69 [4194304,4194304] 0 2024-09-17T07:20:03.837 INFO:tasks.workunit.client.1.smithi139.stdout:1/588: readlink d2/d10/d12/d1a/d61/l66 0 2024-09-17T07:20:03.838 INFO:tasks.workunit.client.1.smithi139.stdout:1/589: write d2/f7 [2610729,124527] 0 2024-09-17T07:20:03.842 INFO:tasks.workunit.client.1.smithi139.stdout:1/590: symlink d2/d10/d12/d35/d49/d8b/lb6 0 2024-09-17T07:20:03.846 INFO:tasks.workunit.client.1.smithi139.stdout:1/591: dread d2/d10/d12/d1a/f96 [0,4194304] 0 2024-09-17T07:20:03.847 INFO:tasks.workunit.client.1.smithi139.stdout:1/592: write d2/d10/d12/d35/d49/d8b/fa8 [66809,74066] 0 2024-09-17T07:20:03.847 INFO:tasks.workunit.client.1.smithi139.stdout:1/593: stat d2/d10/d12/d13/l59 0 2024-09-17T07:20:03.852 INFO:tasks.workunit.client.0.smithi087.stdout:4/973: dwrite d2/d22/d2c/d96/d14b/fbc [0,4194304] 0 2024-09-17T07:20:03.867 INFO:tasks.workunit.client.0.smithi087.stdout:4/974: dread d2/d92/d4d/d42/fcc [0,4194304] 0 2024-09-17T07:20:03.870 INFO:tasks.workunit.client.0.smithi087.stdout:4/975: rename d2/d92/d86/fbe to d2/d5/d1f/f156 0 2024-09-17T07:20:03.883 INFO:tasks.workunit.client.0.smithi087.stdout:4/976: dread d2/d22/d2c/d91/d113/f52 [0,4194304] 0 2024-09-17T07:20:03.886 INFO:tasks.workunit.client.0.smithi087.stdout:4/977: dread d2/d92/d4d/f48 [0,4194304] 0 2024-09-17T07:20:03.886 INFO:tasks.workunit.client.0.smithi087.stdout:4/978: readlink d2/d92/d4d/l40 0 2024-09-17T07:20:03.887 INFO:tasks.workunit.client.0.smithi087.stdout:4/979: chown d2/d92/d4d/d21/d2f/d6e/deb/f141 1878432 1 2024-09-17T07:20:03.888 INFO:tasks.workunit.client.0.smithi087.stdout:4/980: truncate d2/d92/d4d/d42/f14d 1042968 0 2024-09-17T07:20:03.889 INFO:tasks.workunit.client.0.smithi087.stdout:4/981: truncate d2/d92/d4d/d21/d2f/d3b/d7e/d97/f125 668814 0 2024-09-17T07:20:03.892 INFO:tasks.workunit.client.0.smithi087.stdout:4/982: link d2/d22/d2c/c37 d2/d22/d2c/d96/d14b/c157 0 2024-09-17T07:20:03.893 INFO:tasks.workunit.client.0.smithi087.stdout:4/983: write d2/d92/d4d/d42/ff9 [370214,7286] 0 2024-09-17T07:20:03.894 INFO:tasks.workunit.client.0.smithi087.stdout:4/984: mkdir d2/d22/d62/d158 0 2024-09-17T07:20:03.955 INFO:tasks.workunit.client.0.smithi087.stdout:9/789: sync 2024-09-17T07:20:03.955 INFO:tasks.workunit.client.0.smithi087.stdout:8/791: sync 2024-09-17T07:20:03.955 INFO:tasks.workunit.client.0.smithi087.stdout:6/935: sync 2024-09-17T07:20:03.955 INFO:tasks.workunit.client.0.smithi087.stdout:3/841: sync 2024-09-17T07:20:03.956 INFO:tasks.workunit.client.0.smithi087.stdout:9/790: chown d3/d4/d6/d8/d12/d38/fea 252477 1 2024-09-17T07:20:03.956 INFO:tasks.workunit.client.0.smithi087.stdout:3/842: chown d6/d15/c2f 69 1 2024-09-17T07:20:03.957 INFO:tasks.workunit.client.0.smithi087.stdout:3/843: stat d6/d1b/d42/d62/dbb/cd6 0 2024-09-17T07:20:03.957 INFO:tasks.workunit.client.0.smithi087.stdout:8/792: creat d1/d7/d9/d19/d73/f113 x:0 0 0 2024-09-17T07:20:03.958 INFO:tasks.workunit.client.0.smithi087.stdout:6/936: symlink d1/d67/dfe/l138 0 2024-09-17T07:20:03.959 INFO:tasks.workunit.client.0.smithi087.stdout:9/791: symlink d3/d4/d6/d8/d12/d32/l114 0 2024-09-17T07:20:03.969 INFO:tasks.workunit.client.0.smithi087.stdout:8/793: dread d1/d2b/d21/d6d/d6f/fc2 [0,4194304] 0 2024-09-17T07:20:03.971 INFO:tasks.workunit.client.1.smithi139.stdout:9/943: sync 2024-09-17T07:20:03.971 INFO:tasks.workunit.client.1.smithi139.stdout:4/627: sync 2024-09-17T07:20:03.973 INFO:tasks.workunit.client.1.smithi139.stdout:9/944: write dc/d11/d15/d3c/dfe/f129 [216648,18982] 0 2024-09-17T07:20:03.978 INFO:tasks.workunit.client.1.smithi139.stdout:9/945: link dc/d11/d15/d1e/f21 dc/d11/d52/d56/d7a/df7/d122/d83/d98/f138 0 2024-09-17T07:20:03.980 INFO:tasks.workunit.client.1.smithi139.stdout:9/946: dread dc/d11/dbe/fee [0,4194304] 0 2024-09-17T07:20:03.983 INFO:tasks.workunit.client.1.smithi139.stdout:4/628: dread d0/d1/d29/f2b [0,4194304] 0 2024-09-17T07:20:03.985 INFO:tasks.workunit.client.1.smithi139.stdout:4/629: chown d0/d1/d29/d6d 163 1 2024-09-17T07:20:03.986 INFO:tasks.workunit.client.1.smithi139.stdout:9/947: write dc/f3e [4878828,64983] 0 2024-09-17T07:20:03.989 INFO:tasks.workunit.client.1.smithi139.stdout:4/630: dread d0/f71 [0,4194304] 0 2024-09-17T07:20:03.991 INFO:tasks.workunit.client.1.smithi139.stdout:9/948: link dc/d11/d52/d56/d7a/df7/d122/f107 dc/d11/f139 0 2024-09-17T07:20:03.992 INFO:tasks.workunit.client.1.smithi139.stdout:4/631: symlink d0/db/d7f/lc4 0 2024-09-17T07:20:03.994 INFO:tasks.workunit.client.1.smithi139.stdout:4/632: creat d0/d10/fc5 x:0 0 0 2024-09-17T07:20:03.995 INFO:tasks.workunit.client.1.smithi139.stdout:4/633: chown d0/d10/cb9 3454905 1 2024-09-17T07:20:03.996 INFO:tasks.workunit.client.1.smithi139.stdout:9/949: dwrite dc/d11/d52/d56/d7a/da1/f113 [0,4194304] 0 2024-09-17T07:20:03.998 INFO:tasks.workunit.client.1.smithi139.stdout:4/634: fsync d0/d1/d29/d41/fbb 0 2024-09-17T07:20:04.003 INFO:tasks.workunit.client.1.smithi139.stdout:9/950: mknod dc/d11/d52/d56/d75/d12d/c13a 0 2024-09-17T07:20:04.004 INFO:tasks.workunit.client.1.smithi139.stdout:4/635: write d0/d1/f8 [4273545,41199] 0 2024-09-17T07:20:04.005 INFO:tasks.workunit.client.1.smithi139.stdout:9/951: dread dc/d11/d15/d3c/d61/d64/d96/f9e [0,4194304] 0 2024-09-17T07:20:04.007 INFO:tasks.workunit.client.1.smithi139.stdout:4/636: fdatasync d0/d1/d9b/d83/f8e 0 2024-09-17T07:20:04.009 INFO:tasks.workunit.client.1.smithi139.stdout:4/637: creat d0/db/db2/db5/fc6 x:0 0 0 2024-09-17T07:20:04.031 INFO:tasks.workunit.client.0.smithi087.stdout:8/794: creat d1/d7/d9/d19/d4d/f114 x:0 0 0 2024-09-17T07:20:04.042 INFO:tasks.workunit.client.1.smithi139.stdout:9/952: link dc/lf dc/d11/d15/d3c/d61/d64/d96/l13b 0 2024-09-17T07:20:04.043 INFO:tasks.workunit.client.0.smithi087.stdout:6/937: link d1/d67/dfe/f31 d1/d67/dfe/d2c/d58/d90/def/f139 0 2024-09-17T07:20:04.043 INFO:tasks.workunit.client.1.smithi139.stdout:4/638: rename d0/d1/d29/d41/l5d to d0/d1/d9b/d83/da9/lc7 0 2024-09-17T07:20:04.045 INFO:tasks.workunit.client.1.smithi139.stdout:9/953: rename dc/d11/d52/d56/d7a/df7 to dc/d11/d15/d3c/d61/d64/d96/d13c 0 2024-09-17T07:20:04.046 INFO:tasks.workunit.client.0.smithi087.stdout:9/792: rename d3/f1f to d3/d4/da/f115 0 2024-09-17T07:20:04.048 INFO:tasks.workunit.client.1.smithi139.stdout:9/954: unlink dc/d11/d15/d3c/d125/f12c 0 2024-09-17T07:20:04.050 INFO:tasks.workunit.client.1.smithi139.stdout:9/955: creat dc/f13d x:0 0 0 2024-09-17T07:20:04.050 INFO:tasks.workunit.client.0.smithi087.stdout:8/795: dwrite d1/d2b/d21/daf/fda [4194304,4194304] 0 2024-09-17T07:20:04.051 INFO:tasks.workunit.client.1.smithi139.stdout:9/956: mkdir dc/d11/d15/d3c/d13e 0 2024-09-17T07:20:04.055 INFO:tasks.workunit.client.0.smithi087.stdout:9/793: dwrite d3/d4/d6/fbe [0,4194304] 0 2024-09-17T07:20:04.056 INFO:tasks.workunit.client.0.smithi087.stdout:8/796: truncate d1/d2b/df4/d54/f6a 2111527 0 2024-09-17T07:20:04.058 INFO:tasks.workunit.client.0.smithi087.stdout:9/794: chown d3/d4/d6/d8/l42 1277 1 2024-09-17T07:20:04.059 INFO:tasks.workunit.client.0.smithi087.stdout:7/642: sync 2024-09-17T07:20:04.060 INFO:tasks.workunit.client.0.smithi087.stdout:1/790: sync 2024-09-17T07:20:04.060 INFO:tasks.workunit.client.0.smithi087.stdout:2/735: sync 2024-09-17T07:20:04.061 INFO:tasks.workunit.client.0.smithi087.stdout:8/797: creat d1/d2b/d21/daf/f115 x:0 0 0 2024-09-17T07:20:04.062 INFO:tasks.workunit.client.0.smithi087.stdout:7/643: dread - d0/d3/fa5 zero size 2024-09-17T07:20:04.063 INFO:tasks.workunit.client.0.smithi087.stdout:2/736: mknod d2/d7/ce9 0 2024-09-17T07:20:04.065 INFO:tasks.workunit.client.0.smithi087.stdout:9/795: rename d3/d25/dc1 to d3/d4/d6/d71/d116 0 2024-09-17T07:20:04.068 INFO:tasks.workunit.client.0.smithi087.stdout:7/644: write d0/f6 [5221743,30081] 0 2024-09-17T07:20:04.068 INFO:tasks.workunit.client.0.smithi087.stdout:8/798: creat d1/d7/d9/d19/d1b/f116 x:0 0 0 2024-09-17T07:20:04.069 INFO:tasks.workunit.client.0.smithi087.stdout:1/791: dwrite d2/d14/f60 [0,4194304] 0 2024-09-17T07:20:04.071 INFO:tasks.workunit.client.0.smithi087.stdout:9/796: read d3/d4/d6/d71/fd0 [1292382,26538] 0 2024-09-17T07:20:04.071 INFO:tasks.workunit.client.0.smithi087.stdout:7/645: dread d0/d3/f9f [0,4194304] 0 2024-09-17T07:20:04.073 INFO:tasks.workunit.client.0.smithi087.stdout:8/799: mkdir d1/d7/d9/d27/da1/d117 0 2024-09-17T07:20:04.077 INFO:tasks.workunit.client.0.smithi087.stdout:9/797: getdents d3/d4/dcd/df4/d10f 0 2024-09-17T07:20:04.079 INFO:tasks.workunit.client.0.smithi087.stdout:7/646: rmdir d0/d3/d10/d32/d62/d76 39 2024-09-17T07:20:04.081 INFO:tasks.workunit.client.0.smithi087.stdout:7/647: symlink d0/d3/d23/d17/d7b/lc2 0 2024-09-17T07:20:04.082 INFO:tasks.workunit.client.0.smithi087.stdout:8/800: link d1/d2b/l55 d1/d7/d9/d27/da1/d117/l118 0 2024-09-17T07:20:04.084 INFO:tasks.workunit.client.0.smithi087.stdout:7/648: creat d0/d3/d10/d87/d96/db2/fc3 x:0 0 0 2024-09-17T07:20:04.085 INFO:tasks.workunit.client.0.smithi087.stdout:8/801: read d1/d2b/d21/fb3 [2126807,81355] 0 2024-09-17T07:20:04.087 INFO:tasks.workunit.client.0.smithi087.stdout:8/802: write d1/d7/d9/d19/d73/f113 [305142,81932] 0 2024-09-17T07:20:04.089 INFO:tasks.workunit.client.0.smithi087.stdout:8/803: mknod d1/d2b/d21/d68/c119 0 2024-09-17T07:20:04.094 INFO:tasks.workunit.client.0.smithi087.stdout:6/938: write d1/d67/dfe/d2c/fd9 [1254810,18932] 0 2024-09-17T07:20:04.094 INFO:tasks.workunit.client.0.smithi087.stdout:8/804: link d1/d2b/d21/d68/ce8 d1/d2b/c11a 0 2024-09-17T07:20:04.096 INFO:tasks.workunit.client.0.smithi087.stdout:7/649: dread d0/d3/f4 [0,4194304] 0 2024-09-17T07:20:04.097 INFO:tasks.workunit.client.0.smithi087.stdout:8/805: truncate d1/d7/d9/d19/d4d/ffe 21952 0 2024-09-17T07:20:04.097 INFO:tasks.workunit.client.0.smithi087.stdout:7/650: readlink d0/d3/d10/d87/d96/l9e 0 2024-09-17T07:20:04.098 INFO:tasks.workunit.client.0.smithi087.stdout:8/806: readlink d1/d5f/l9f 0 2024-09-17T07:20:04.099 INFO:tasks.workunit.client.0.smithi087.stdout:6/939: rename d1/d67/dfe/d2c/d40/dd2/ldf to d1/d6a/d122/l13a 0 2024-09-17T07:20:04.101 INFO:tasks.workunit.client.0.smithi087.stdout:8/807: creat d1/d7/d63/dd9/f11b x:0 0 0 2024-09-17T07:20:04.102 INFO:tasks.workunit.client.0.smithi087.stdout:6/940: creat d1/d67/dfe/d2c/d58/f13b x:0 0 0 2024-09-17T07:20:04.103 INFO:tasks.workunit.client.0.smithi087.stdout:8/808: dread - d1/d7/fdb zero size 2024-09-17T07:20:04.104 INFO:tasks.workunit.client.1.smithi139.stdout:9/957: dread dc/d11/d15/d3c/d61/d64/d96/d13c/d122/d83/fdc [0,4194304] 0 2024-09-17T07:20:04.106 INFO:tasks.workunit.client.0.smithi087.stdout:1/792: dwrite d2/d3d/d45/d90/fdc [0,4194304] 0 2024-09-17T07:20:04.107 INFO:tasks.workunit.client.0.smithi087.stdout:8/809: rename d1/d2b/d21/c108 to d1/d5f/c11c 0 2024-09-17T07:20:04.108 INFO:tasks.workunit.client.0.smithi087.stdout:7/651: write d0/f3b [5386108,29819] 0 2024-09-17T07:20:04.110 INFO:tasks.workunit.client.0.smithi087.stdout:1/793: symlink d2/d3d/d35/d4f/da5/l113 0 2024-09-17T07:20:04.112 INFO:tasks.workunit.client.0.smithi087.stdout:8/810: creat d1/d2b/d3b/d53/dfd/f11d x:0 0 0 2024-09-17T07:20:04.113 INFO:tasks.workunit.client.0.smithi087.stdout:1/794: dread - d2/dcf/d7e/db9/dfb/d101/f102 zero size 2024-09-17T07:20:04.114 INFO:tasks.workunit.client.1.smithi139.stdout:9/958: write dc/d11/d15/d3c/d61/d64/ff4 [654636,29387] 0 2024-09-17T07:20:04.114 INFO:tasks.workunit.client.0.smithi087.stdout:7/652: getdents d0/d3/d10/d87/d96/db2 0 2024-09-17T07:20:04.115 INFO:tasks.workunit.client.0.smithi087.stdout:8/811: symlink d1/d7/d63/l11e 0 2024-09-17T07:20:04.118 INFO:tasks.workunit.client.1.smithi139.stdout:9/959: rename dc/d11/d15/d1e/d34/d111 to dc/d11/d52/d13f 0 2024-09-17T07:20:04.118 INFO:tasks.workunit.client.0.smithi087.stdout:7/653: creat d0/d3/d10/d32/d8c/fc4 x:0 0 0 2024-09-17T07:20:04.118 INFO:tasks.workunit.client.1.smithi139.stdout:9/960: chown dc/cfb 2 1 2024-09-17T07:20:04.120 INFO:tasks.workunit.client.0.smithi087.stdout:1/795: link d2/d3d/d45/d90/d43/d5d/l112 d2/d3d/d35/l114 0 2024-09-17T07:20:04.120 INFO:tasks.workunit.client.1.smithi139.stdout:9/961: mkdir dc/d11/d15/d3c/d140 0 2024-09-17T07:20:04.122 INFO:tasks.workunit.client.1.smithi139.stdout:9/962: truncate dc/d11/d15/d3c/f3f 202606 0 2024-09-17T07:20:04.123 INFO:tasks.workunit.client.1.smithi139.stdout:9/963: chown dc/lf 7409186 1 2024-09-17T07:20:04.124 INFO:tasks.workunit.client.0.smithi087.stdout:8/812: dwrite d1/d7/d9/d19/d4d/f10e [0,4194304] 0 2024-09-17T07:20:04.126 INFO:tasks.workunit.client.0.smithi087.stdout:1/796: mknod d2/d69/d8d/c115 0 2024-09-17T07:20:04.126 INFO:tasks.workunit.client.0.smithi087.stdout:1/797: fsync d2/d3d/d45/d90/fdc 0 2024-09-17T07:20:04.133 INFO:tasks.workunit.client.0.smithi087.stdout:8/813: rename d1/d7/d9/d27 to d1/d7/d9/d19/d4d/d11f 0 2024-09-17T07:20:04.135 INFO:tasks.workunit.client.0.smithi087.stdout:1/798: creat d2/d14/f116 x:0 0 0 2024-09-17T07:20:04.137 INFO:tasks.workunit.client.0.smithi087.stdout:1/799: mkdir d2/d1a/d117 0 2024-09-17T07:20:04.138 INFO:tasks.workunit.client.0.smithi087.stdout:1/800: fsync d2/d14/fe3 0 2024-09-17T07:20:04.138 INFO:tasks.workunit.client.1.smithi139.stdout:9/964: dwrite dc/d11/d15/d3c/d61/f101 [0,4194304] 0 2024-09-17T07:20:04.140 INFO:tasks.workunit.client.0.smithi087.stdout:1/801: write d2/d3d/d45/d90/d43/d5d/fec [2139804,113821] 0 2024-09-17T07:20:04.140 INFO:tasks.workunit.client.0.smithi087.stdout:7/654: dread d0/d3/d23/f53 [0,4194304] 0 2024-09-17T07:20:04.145 INFO:tasks.workunit.client.0.smithi087.stdout:1/802: link d2/d3d/d35/fde d2/d3d/df3/f118 0 2024-09-17T07:20:04.146 INFO:tasks.workunit.client.0.smithi087.stdout:8/814: dread d1/d2b/f6c [0,4194304] 0 2024-09-17T07:20:04.147 INFO:tasks.workunit.client.0.smithi087.stdout:8/815: stat d1/fd6 0 2024-09-17T07:20:04.149 INFO:tasks.workunit.client.0.smithi087.stdout:7/655: dwrite d0/d3/d23/d17/f41 [0,4194304] 0 2024-09-17T07:20:04.149 INFO:tasks.workunit.client.1.smithi139.stdout:9/965: write dc/d11/d15/d3c/d68/fcb [2478807,54688] 0 2024-09-17T07:20:04.150 INFO:tasks.workunit.client.0.smithi087.stdout:7/656: chown d0/d3/d23/d4e/c58 29506859 1 2024-09-17T07:20:04.151 INFO:tasks.workunit.client.0.smithi087.stdout:8/816: mkdir d1/d5f/d120 0 2024-09-17T07:20:04.151 INFO:tasks.workunit.client.1.smithi139.stdout:9/966: creat dc/d11/d15/d1e/d53/f141 x:0 0 0 2024-09-17T07:20:04.153 INFO:tasks.workunit.client.1.smithi139.stdout:9/967: truncate dc/d11/f97 1002946 0 2024-09-17T07:20:04.154 INFO:tasks.workunit.client.1.smithi139.stdout:9/968: readlink dc/d11/d52/d56/d7a/lea 0 2024-09-17T07:20:04.156 INFO:tasks.workunit.client.0.smithi087.stdout:1/803: link d2/d3d/fd4 d2/d3d/d35/f119 0 2024-09-17T07:20:04.156 INFO:tasks.workunit.client.1.smithi139.stdout:9/969: mkdir dc/d11/d15/d142 0 2024-09-17T07:20:04.158 INFO:tasks.workunit.client.1.smithi139.stdout:6/752: sync 2024-09-17T07:20:04.159 INFO:tasks.workunit.client.1.smithi139.stdout:9/970: unlink dc/d11/d15/l119 0 2024-09-17T07:20:04.160 INFO:tasks.workunit.client.1.smithi139.stdout:9/971: chown dc/d11/d15/d1e/d34 14866904 1 2024-09-17T07:20:04.161 INFO:tasks.workunit.client.0.smithi087.stdout:7/657: read d0/f28 [3305778,68301] 0 2024-09-17T07:20:04.163 INFO:tasks.workunit.client.0.smithi087.stdout:7/658: creat d0/d7a/fc5 x:0 0 0 2024-09-17T07:20:04.163 INFO:tasks.workunit.client.1.smithi139.stdout:6/753: rename db/d18/d5b to db/d18/d1b/d105 0 2024-09-17T07:20:04.164 INFO:tasks.workunit.client.0.smithi087.stdout:7/659: dread - d0/d3/d23/d17/d7b/dad/fa3 zero size 2024-09-17T07:20:04.164 INFO:tasks.workunit.client.1.smithi139.stdout:6/754: write db/d18/d9f/fd4 [885325,70965] 0 2024-09-17T07:20:04.165 INFO:tasks.workunit.client.1.smithi139.stdout:6/755: truncate db/df/f24 4591498 0 2024-09-17T07:20:04.166 INFO:tasks.workunit.client.0.smithi087.stdout:7/660: fdatasync d0/d3/d23/d17/d7b/dad/fa3 0 2024-09-17T07:20:04.169 INFO:tasks.workunit.client.1.smithi139.stdout:6/756: rename db/d18/d1b/ldd to db/d18/d38/d60/dc2/l106 0 2024-09-17T07:20:04.170 INFO:tasks.workunit.client.0.smithi087.stdout:7/661: link d0/lb d0/d3/d23/d17/d7b/dad/daf/lc6 0 2024-09-17T07:20:04.172 INFO:tasks.workunit.client.0.smithi087.stdout:7/662: creat d0/d3/d10/d31/dc1/fc7 x:0 0 0 2024-09-17T07:20:04.172 INFO:tasks.workunit.client.1.smithi139.stdout:6/757: getdents db/df/d4e/d5e/deb 0 2024-09-17T07:20:04.173 INFO:tasks.workunit.client.1.smithi139.stdout:6/758: write db/d18/d9f/fd4 [1844649,55683] 0 2024-09-17T07:20:04.176 INFO:tasks.workunit.client.0.smithi087.stdout:8/817: dread d1/d2b/ff7 [0,4194304] 0 2024-09-17T07:20:04.179 INFO:tasks.workunit.client.1.smithi139.stdout:6/759: dwrite db/df/d4e/d5e/d8a/f100 [0,4194304] 0 2024-09-17T07:20:04.180 INFO:tasks.workunit.client.0.smithi087.stdout:1/804: truncate d2/d3d/d45/d90/f20 1316012 0 2024-09-17T07:20:04.180 INFO:tasks.workunit.client.0.smithi087.stdout:8/818: creat d1/d2b/df4/f121 x:0 0 0 2024-09-17T07:20:04.181 INFO:tasks.workunit.client.0.smithi087.stdout:7/663: dwrite d0/d3/d10/f8f [0,4194304] 0 2024-09-17T07:20:04.182 INFO:tasks.workunit.client.1.smithi139.stdout:6/760: mkdir db/df/daa/de3/d107 0 2024-09-17T07:20:04.183 INFO:tasks.workunit.client.0.smithi087.stdout:7/664: readlink d0/d3/d10/d31/l48 0 2024-09-17T07:20:04.183 INFO:tasks.workunit.client.0.smithi087.stdout:8/819: fdatasync d1/d7/d9/d19/d4d/fd0 0 2024-09-17T07:20:04.183 INFO:tasks.workunit.client.0.smithi087.stdout:1/805: unlink d2/d14/ccd 0 2024-09-17T07:20:04.183 INFO:tasks.workunit.client.1.smithi139.stdout:6/761: chown db/d18/d1b/d105 605236 1 2024-09-17T07:20:04.184 INFO:tasks.workunit.client.1.smithi139.stdout:9/972: write dc/d11/d52/fa2 [2358012,97792] 0 2024-09-17T07:20:04.185 INFO:tasks.workunit.client.1.smithi139.stdout:6/762: fdatasync db/df/d73/d81/f67 0 2024-09-17T07:20:04.186 INFO:tasks.workunit.client.1.smithi139.stdout:9/973: chown dc/d11/d15/d1e/d53/f141 68144535 1 2024-09-17T07:20:04.187 INFO:tasks.workunit.client.1.smithi139.stdout:6/763: chown db/df/d4e/d64/d56/d98 1891792 1 2024-09-17T07:20:04.187 INFO:tasks.workunit.client.0.smithi087.stdout:7/665: mknod d0/d3/d10/d87/d96/db2/cc8 0 2024-09-17T07:20:04.188 INFO:tasks.workunit.client.0.smithi087.stdout:8/820: creat d1/d2b/d21/dd4/f122 x:0 0 0 2024-09-17T07:20:04.188 INFO:tasks.workunit.client.0.smithi087.stdout:1/806: truncate d2/dcf/d7e/db9/fbc 846071 0 2024-09-17T07:20:04.188 INFO:tasks.workunit.client.1.smithi139.stdout:6/764: chown db/df/d4e/d5e/d8a 1030159723 1 2024-09-17T07:20:04.189 INFO:tasks.workunit.client.1.smithi139.stdout:6/765: write db/df/d73/fdc [499350,59271] 0 2024-09-17T07:20:04.190 INFO:tasks.workunit.client.1.smithi139.stdout:9/974: creat dc/d11/d52/d56/d75/d12d/f143 x:0 0 0 2024-09-17T07:20:04.194 INFO:tasks.workunit.client.0.smithi087.stdout:1/807: rename d2/d3d/d35/d57/d6a to d2/d11a 0 2024-09-17T07:20:04.198 INFO:tasks.workunit.client.0.smithi087.stdout:1/808: creat d2/d3d/d45/f11b x:0 0 0 2024-09-17T07:20:04.198 INFO:tasks.workunit.client.0.smithi087.stdout:7/666: dwrite d0/d3/d10/d87/d96/fa1 [0,4194304] 0 2024-09-17T07:20:04.199 INFO:tasks.workunit.client.0.smithi087.stdout:8/821: dwrite d1/d7/d9/d19/d1b/d18/fc9 [0,4194304] 0 2024-09-17T07:20:04.200 INFO:tasks.workunit.client.0.smithi087.stdout:7/667: chown d0/d36/c45 13 1 2024-09-17T07:20:04.200 INFO:tasks.workunit.client.0.smithi087.stdout:7/668: stat d0/d3/d23/d17/d7b/c94 0 2024-09-17T07:20:04.203 INFO:tasks.workunit.client.0.smithi087.stdout:1/809: creat d2/d3d/d45/d90/f11c x:0 0 0 2024-09-17T07:20:04.203 INFO:tasks.workunit.client.0.smithi087.stdout:8/822: dread d1/d2b/d21/d68/fbc [0,4194304] 0 2024-09-17T07:20:04.204 INFO:tasks.workunit.client.0.smithi087.stdout:1/810: chown d2/d3d/d45/d90/d43/ce8 101 1 2024-09-17T07:20:04.204 INFO:tasks.workunit.client.0.smithi087.stdout:4/985: sync 2024-09-17T07:20:04.205 INFO:tasks.workunit.client.1.smithi139.stdout:9/975: dwrite dc/d11/f59 [0,4194304] 0 2024-09-17T07:20:04.206 INFO:tasks.workunit.client.0.smithi087.stdout:7/669: truncate d0/d3/d10/f20 1914906 0 2024-09-17T07:20:04.210 INFO:tasks.workunit.client.1.smithi139.stdout:9/976: rename dc/f127 to dc/d11/d15/d142/f144 0 2024-09-17T07:20:04.211 INFO:tasks.workunit.client.0.smithi087.stdout:1/811: creat d2/d3d/d45/d90/f11d x:0 0 0 2024-09-17T07:20:04.211 INFO:tasks.workunit.client.0.smithi087.stdout:7/670: symlink d0/d3/d23/d17/d7b/dad/daf/lc9 0 2024-09-17T07:20:04.213 INFO:tasks.workunit.client.0.smithi087.stdout:4/986: dwrite d2/d22/d95/f13a [0,4194304] 0 2024-09-17T07:20:04.214 INFO:tasks.workunit.client.1.smithi139.stdout:9/977: creat dc/d11/f145 x:0 0 0 2024-09-17T07:20:04.220 INFO:tasks.workunit.client.1.smithi139.stdout:9/978: dwrite dc/d11/d15/f28 [0,4194304] 0 2024-09-17T07:20:04.220 INFO:tasks.workunit.client.0.smithi087.stdout:1/812: link d2/d3d/d8e/fb2 d2/d3d/d35/d4f/f11e 0 2024-09-17T07:20:04.222 INFO:tasks.workunit.client.1.smithi139.stdout:9/979: chown dc/d11/l58 30 1 2024-09-17T07:20:04.222 INFO:tasks.workunit.client.0.smithi087.stdout:7/671: dwrite d0/f8 [4194304,4194304] 0 2024-09-17T07:20:04.224 INFO:tasks.workunit.client.0.smithi087.stdout:1/813: truncate d2/d3d/d35/fde 847242 0 2024-09-17T07:20:04.226 INFO:tasks.workunit.client.0.smithi087.stdout:7/672: write d0/d3/f40 [1555755,75806] 0 2024-09-17T07:20:04.231 INFO:tasks.workunit.client.0.smithi087.stdout:7/673: link d0/d3/d10/f38 d0/d3/d23/d2d/fca 0 2024-09-17T07:20:04.231 INFO:tasks.workunit.client.0.smithi087.stdout:8/823: write d1/d2b/df4/f44 [1550966,7918] 0 2024-09-17T07:20:04.233 INFO:tasks.workunit.client.0.smithi087.stdout:7/674: mknod d0/d3/ccb 0 2024-09-17T07:20:04.234 INFO:tasks.workunit.client.1.smithi139.stdout:9/980: dread dc/d11/d15/fca [0,4194304] 0 2024-09-17T07:20:04.234 INFO:tasks.workunit.client.0.smithi087.stdout:7/675: stat d0/d36/c59 0 2024-09-17T07:20:04.235 INFO:tasks.workunit.client.0.smithi087.stdout:4/987: truncate d2/fde 722685 0 2024-09-17T07:20:04.235 INFO:tasks.workunit.client.1.smithi139.stdout:9/981: truncate dc/f13d 333156 0 2024-09-17T07:20:04.236 INFO:tasks.workunit.client.0.smithi087.stdout:8/824: creat d1/d7/d9/d19/d4d/d11f/da1/d117/f123 x:0 0 0 2024-09-17T07:20:04.240 INFO:tasks.workunit.client.0.smithi087.stdout:8/825: mkdir d1/d2b/df4/d54/dbb/d124 0 2024-09-17T07:20:04.241 INFO:tasks.workunit.client.0.smithi087.stdout:4/988: dwrite d2/d22/d2c/d91/fd1 [0,4194304] 0 2024-09-17T07:20:04.243 INFO:tasks.workunit.client.0.smithi087.stdout:8/826: rename d1/d5f/cff to d1/d2b/df4/c125 0 2024-09-17T07:20:04.245 INFO:tasks.workunit.client.0.smithi087.stdout:4/989: creat d2/d92/d4d/d21/d2f/d6e/d136/f159 x:0 0 0 2024-09-17T07:20:04.246 INFO:tasks.workunit.client.0.smithi087.stdout:8/827: truncate d1/d7/d9/d19/d4d/ffe 571966 0 2024-09-17T07:20:04.246 INFO:tasks.workunit.client.0.smithi087.stdout:4/990: write d2/d22/d2c/f153 [762601,39639] 0 2024-09-17T07:20:04.250 INFO:tasks.workunit.client.0.smithi087.stdout:4/991: mknod d2/d22/d2c/d91/d113/c15a 0 2024-09-17T07:20:04.251 INFO:tasks.workunit.client.0.smithi087.stdout:4/992: mknod d2/d5/c15b 0 2024-09-17T07:20:04.256 INFO:tasks.workunit.client.0.smithi087.stdout:4/993: dwrite d2/d5/d1f/fc8 [0,4194304] 0 2024-09-17T07:20:04.258 INFO:tasks.workunit.client.0.smithi087.stdout:4/994: mknod d2/d22/d95/c15c 0 2024-09-17T07:20:04.259 INFO:tasks.workunit.client.0.smithi087.stdout:4/995: chown d2/d92/d4d/d42/db6/fcd 7 1 2024-09-17T07:20:04.261 INFO:tasks.workunit.client.0.smithi087.stdout:4/996: truncate d2/d22/d2c/d96/d14b/d6a/ff8 955877 0 2024-09-17T07:20:04.266 INFO:tasks.workunit.client.0.smithi087.stdout:7/676: write d0/d3/d10/d32/f99 [672911,105634] 0 2024-09-17T07:20:04.270 INFO:tasks.workunit.client.0.smithi087.stdout:4/997: dwrite d2/d92/d4d/d21/d2f/d6e/deb/f141 [0,4194304] 0 2024-09-17T07:20:04.272 INFO:tasks.workunit.client.1.smithi139.stdout:5/772: sync 2024-09-17T07:20:04.272 INFO:tasks.workunit.client.1.smithi139.stdout:7/565: sync 2024-09-17T07:20:04.273 INFO:tasks.workunit.client.1.smithi139.stdout:5/773: chown d4/d16/d1b/d20/d32/d72/fae 30768 1 2024-09-17T07:20:04.275 INFO:tasks.workunit.client.0.smithi087.stdout:4/998: chown d2/d22/d2c/d91 1969 1 2024-09-17T07:20:04.275 INFO:tasks.workunit.client.1.smithi139.stdout:7/566: creat d5/d10/d2b/fb4 x:0 0 0 2024-09-17T07:20:04.277 INFO:tasks.workunit.client.0.smithi087.stdout:7/677: truncate d0/d3/d23/d17/d7b/fba 1008262 0 2024-09-17T07:20:04.277 INFO:tasks.workunit.client.1.smithi139.stdout:5/774: rename d4/d5d/d97/da4 to d4/d16/d1b/d20/d67/d88/d9f/dfc 0 2024-09-17T07:20:04.278 INFO:tasks.workunit.client.1.smithi139.stdout:7/567: write d5/d17/d4e/f69 [1885680,65556] 0 2024-09-17T07:20:04.279 INFO:tasks.workunit.client.0.smithi087.stdout:8/828: dwrite d1/d7/d9/d19/d4d/d11f/f69 [0,4194304] 0 2024-09-17T07:20:04.280 INFO:tasks.workunit.client.1.smithi139.stdout:5/775: creat d4/d16/d1b/d20/d38/d4f/ffd x:0 0 0 2024-09-17T07:20:04.281 INFO:tasks.workunit.client.0.smithi087.stdout:8/829: readlink d1/d7/d9/d19/d4d/d11f/le7 0 2024-09-17T07:20:04.281 INFO:tasks.workunit.client.0.smithi087.stdout:4/999: unlink d2/d22/fd7 0 2024-09-17T07:20:04.282 INFO:tasks.workunit.client.1.smithi139.stdout:7/568: readlink d5/d67/l70 0 2024-09-17T07:20:04.285 INFO:tasks.workunit.client.0.smithi087.stdout:7/678: unlink d0/d3/d23/d4e/f70 0 2024-09-17T07:20:04.285 INFO:tasks.workunit.client.1.smithi139.stdout:5/776: link d4/d16/d1b/d20/d28/f46 d4/d5d/dc0/ffe 0 2024-09-17T07:20:04.286 INFO:tasks.workunit.client.1.smithi139.stdout:7/569: truncate d5/d10/d4d/d59/f75 42153 0 2024-09-17T07:20:04.288 INFO:tasks.workunit.client.1.smithi139.stdout:5/777: mknod d4/d16/d1b/de7/cff 0 2024-09-17T07:20:04.288 INFO:tasks.workunit.client.1.smithi139.stdout:7/570: getdents d5/d17/d4e/d55 0 2024-09-17T07:20:04.289 INFO:tasks.workunit.client.1.smithi139.stdout:5/778: chown d4/d16/d1b/d20/d32/d72/l85 658 1 2024-09-17T07:20:04.289 INFO:tasks.workunit.client.1.smithi139.stdout:7/571: fsync d5/d17/f27 0 2024-09-17T07:20:04.290 INFO:tasks.workunit.client.1.smithi139.stdout:7/572: write d5/d17/f27 [289831,38666] 0 2024-09-17T07:20:04.292 INFO:tasks.workunit.client.1.smithi139.stdout:5/779: symlink d4/d16/d1b/d20/l100 0 2024-09-17T07:20:04.299 INFO:tasks.workunit.client.0.smithi087.stdout:7/679: fsync d0/d3/f40 0 2024-09-17T07:20:04.301 INFO:tasks.workunit.client.0.smithi087.stdout:7/680: symlink d0/d3/d23/d17/d7b/dad/d89/lcc 0 2024-09-17T07:20:04.301 INFO:tasks.workunit.client.0.smithi087.stdout:7/681: fdatasync d0/d3/d23/d2d/f35 0 2024-09-17T07:20:04.304 INFO:tasks.workunit.client.1.smithi139.stdout:9/982: write dc/d11/d15/d1e/f21 [4298974,97390] 0 2024-09-17T07:20:04.306 INFO:tasks.workunit.client.1.smithi139.stdout:9/983: truncate dc/d2a/f123 976992 0 2024-09-17T07:20:04.309 INFO:tasks.workunit.client.0.smithi087.stdout:7/682: dwrite d0/d3/d10/d32/d62/d76/f7f [4194304,4194304] 0 2024-09-17T07:20:04.310 INFO:tasks.workunit.client.1.smithi139.stdout:9/984: rename dc/d11/d15/d3c/f3f to dc/d11/d52/d56/d75/f146 0 2024-09-17T07:20:04.310 INFO:tasks.workunit.client.0.smithi087.stdout:8/830: dwrite d1/d2b/d21/d6d/f74 [0,4194304] 0 2024-09-17T07:20:04.312 INFO:tasks.workunit.client.0.smithi087.stdout:8/831: write d1/d2b/d21/dd4/f102 [330812,10167] 0 2024-09-17T07:20:04.314 INFO:tasks.workunit.client.1.smithi139.stdout:9/985: getdents dc/d11/d15/d142 0 2024-09-17T07:20:04.314 INFO:tasks.workunit.client.0.smithi087.stdout:7/683: write d0/fd [262778,33373] 0 2024-09-17T07:20:04.315 INFO:tasks.workunit.client.0.smithi087.stdout:8/832: creat d1/d7/d9/d19/d4d/d11f/da1/d117/f126 x:0 0 0 2024-09-17T07:20:04.317 INFO:tasks.workunit.client.1.smithi139.stdout:9/986: fsync dc/d11/d52/d56/d7a/f12e 0 2024-09-17T07:20:04.319 INFO:tasks.workunit.client.1.smithi139.stdout:5/780: dwrite d4/d16/d1b/d20/d67/d88/f8d [0,4194304] 0 2024-09-17T07:20:04.320 INFO:tasks.workunit.client.0.smithi087.stdout:8/833: write d1/d2b/df4/d54/f91 [4496308,122276] 0 2024-09-17T07:20:04.322 INFO:tasks.workunit.client.0.smithi087.stdout:8/834: mknod d1/d2b/d21/daf/c127 0 2024-09-17T07:20:04.324 INFO:tasks.workunit.client.1.smithi139.stdout:5/781: symlink d4/d16/d1b/d20/d28/d3f/l101 0 2024-09-17T07:20:04.325 INFO:tasks.workunit.client.1.smithi139.stdout:9/987: fsync dc/d11/d52/d56/d7a/fd2 0 2024-09-17T07:20:04.328 INFO:tasks.workunit.client.1.smithi139.stdout:5/782: mknod d4/da5/c102 0 2024-09-17T07:20:04.328 INFO:tasks.workunit.client.1.smithi139.stdout:9/988: fsync dc/d11/d15/d3c/d61/f110 0 2024-09-17T07:20:04.329 INFO:tasks.workunit.client.0.smithi087.stdout:8/835: dwrite d1/d2b/d21/dd4/fde [0,4194304] 0 2024-09-17T07:20:04.330 INFO:tasks.workunit.client.0.smithi087.stdout:8/836: read - d1/d2b/d21/fdf zero size 2024-09-17T07:20:04.330 INFO:tasks.workunit.client.1.smithi139.stdout:9/989: fdatasync dc/d11/d15/f18 0 2024-09-17T07:20:04.332 INFO:tasks.workunit.client.1.smithi139.stdout:9/990: read dc/d11/f124 [807676,23900] 0 2024-09-17T07:20:04.334 INFO:tasks.workunit.client.0.smithi087.stdout:7/684: dread d0/d3/d23/f2b [0,4194304] 0 2024-09-17T07:20:04.334 INFO:tasks.workunit.client.0.smithi087.stdout:8/837: unlink d1/d2b/d3b/cb1 0 2024-09-17T07:20:04.335 INFO:tasks.workunit.client.0.smithi087.stdout:8/838: rmdir d1/d2b 39 2024-09-17T07:20:04.336 INFO:tasks.workunit.client.0.smithi087.stdout:7/685: symlink d0/d3/d23/d2d/lcd 0 2024-09-17T07:20:04.338 INFO:tasks.workunit.client.1.smithi139.stdout:9/991: read dc/d11/d52/fa2 [2938344,69449] 0 2024-09-17T07:20:04.339 INFO:tasks.workunit.client.0.smithi087.stdout:8/839: dread - d1/d2b/df4/d54/f110 zero size 2024-09-17T07:20:04.340 INFO:tasks.workunit.client.0.smithi087.stdout:7/686: mknod d0/d3/d10/d31/cce 0 2024-09-17T07:20:04.340 INFO:tasks.workunit.client.0.smithi087.stdout:7/687: chown d0/d36/d8e 559747 1 2024-09-17T07:20:04.341 INFO:tasks.workunit.client.0.smithi087.stdout:8/840: unlink d1/d7/d9/d19/d1b/l28 0 2024-09-17T07:20:04.341 INFO:tasks.workunit.client.1.smithi139.stdout:9/992: chown dc/d11/d8b/dc7/ffd 230 1 2024-09-17T07:20:04.341 INFO:tasks.workunit.client.1.smithi139.stdout:9/993: readlink dc/d11/l80 0 2024-09-17T07:20:04.342 INFO:tasks.workunit.client.1.smithi139.stdout:9/994: fdatasync dc/d11/d52/d56/d75/f131 0 2024-09-17T07:20:04.342 INFO:tasks.workunit.client.0.smithi087.stdout:8/841: creat d1/d2b/d21/d68/f128 x:0 0 0 2024-09-17T07:20:04.343 INFO:tasks.workunit.client.1.smithi139.stdout:9/995: chown dc/d11/fbd 0 1 2024-09-17T07:20:04.344 INFO:tasks.workunit.client.0.smithi087.stdout:8/842: mknod d1/d5f/c129 0 2024-09-17T07:20:04.345 INFO:tasks.workunit.client.1.smithi139.stdout:9/996: symlink dc/d11/d52/d56/d75/l147 0 2024-09-17T07:20:04.346 INFO:tasks.workunit.client.0.smithi087.stdout:8/843: creat d1/d7/d9/d19/d4d/d11f/da1/d117/f12a x:0 0 0 2024-09-17T07:20:04.347 INFO:tasks.workunit.client.0.smithi087.stdout:8/844: dread - d1/d2b/d21/dd4/fd5 zero size 2024-09-17T07:20:04.349 INFO:tasks.workunit.client.0.smithi087.stdout:8/845: symlink d1/d7/d9/d19/l12b 0 2024-09-17T07:20:04.351 INFO:tasks.workunit.client.0.smithi087.stdout:8/846: getdents d1 0 2024-09-17T07:20:04.353 INFO:tasks.workunit.client.0.smithi087.stdout:8/847: creat d1/d2b/d21/dd4/f12c x:0 0 0 2024-09-17T07:20:04.358 INFO:tasks.workunit.client.1.smithi139.stdout:5/783: write d4/d16/d1b/d20/d32/f3c [1063779,117615] 0 2024-09-17T07:20:04.359 INFO:tasks.workunit.client.1.smithi139.stdout:9/997: write dc/d11/d15/d3c/d61/d64/df8/f109 [290244,56565] 0 2024-09-17T07:20:04.360 INFO:tasks.workunit.client.1.smithi139.stdout:9/998: dread - dc/d11/d8b/f116 zero size 2024-09-17T07:20:04.362 INFO:tasks.workunit.client.1.smithi139.stdout:5/784: creat d4/d16/d1b/d20/d28/d3f/de8/f103 x:0 0 0 2024-09-17T07:20:04.362 INFO:tasks.workunit.client.1.smithi139.stdout:9/999: write dc/d11/d15/d3c/d61/d64/d96/fde [201455,38477] 0 2024-09-17T07:20:04.364 INFO:tasks.workunit.client.1.smithi139.stdout:5/785: dread - d4/d16/d1b/d20/d67/d88/f8c zero size 2024-09-17T07:20:04.366 INFO:tasks.workunit.client.1.smithi139.stdout:5/786: symlink d4/d16/l104 0 2024-09-17T07:20:04.373 INFO:tasks.workunit.client.1.smithi139.stdout:5/787: dwrite d4/d16/d1b/d20/fd1 [0,4194304] 0 2024-09-17T07:20:04.375 INFO:tasks.workunit.client.1.smithi139.stdout:5/788: truncate d4/d16/d1b/d20/f7d 2057915 0 2024-09-17T07:20:04.377 INFO:tasks.workunit.client.0.smithi087.stdout:7/688: write d0/d3/d10/f21 [2794361,59618] 0 2024-09-17T07:20:04.379 INFO:tasks.workunit.client.0.smithi087.stdout:7/689: unlink d0/d7a/f8b 0 2024-09-17T07:20:04.380 INFO:tasks.workunit.client.0.smithi087.stdout:8/848: write d1/d2b/d21/f9c [4377287,85311] 0 2024-09-17T07:20:04.380 INFO:tasks.workunit.client.1.smithi139.stdout:5/789: rename d4/d16/d1b/d20/d28/d3f/l101 to d4/d16/d1b/d20/l105 0 2024-09-17T07:20:04.381 INFO:tasks.workunit.client.0.smithi087.stdout:7/690: write d0/d3/d10/d32/d8c/fc4 [573102,31530] 0 2024-09-17T07:20:04.382 INFO:tasks.workunit.client.0.smithi087.stdout:7/691: readlink d0/d3/l7 0 2024-09-17T07:20:04.385 INFO:tasks.workunit.client.0.smithi087.stdout:8/849: symlink d1/d2b/df4/d54/dbb/d124/l12d 0 2024-09-17T07:20:04.385 INFO:tasks.workunit.client.0.smithi087.stdout:7/692: mknod d0/d3/d10/d87/d96/ccf 0 2024-09-17T07:20:04.387 INFO:tasks.workunit.client.1.smithi139.stdout:5/790: write d4/d16/d1b/d20/d28/d3f/f65 [1779234,71992] 0 2024-09-17T07:20:04.388 INFO:tasks.workunit.client.0.smithi087.stdout:8/850: rename d1/d2b/d21/d6d/lf8 to d1/d7/d63/dd9/l12e 0 2024-09-17T07:20:04.389 INFO:tasks.workunit.client.1.smithi139.stdout:5/791: truncate d4/d16/d1b/d20/d32/d6c/dc9/fd6 4367590 0 2024-09-17T07:20:04.390 INFO:tasks.workunit.client.1.smithi139.stdout:5/792: write d4/d16/d1b/d20/d38/f68 [556108,47789] 0 2024-09-17T07:20:04.391 INFO:tasks.workunit.client.1.smithi139.stdout:5/793: write d4/d16/d1b/d20/d38/f54 [2831398,41585] 0 2024-09-17T07:20:04.391 INFO:tasks.workunit.client.0.smithi087.stdout:8/851: truncate d1/d7/d9/d19/d1b/d18/fa3 575500 0 2024-09-17T07:20:04.393 INFO:tasks.workunit.client.0.smithi087.stdout:8/852: write d1/d2b/d21/d6d/d6f/f90 [3834808,34548] 0 2024-09-17T07:20:04.399 INFO:tasks.workunit.client.0.smithi087.stdout:8/853: dwrite d1/d7/d9/d19/d4d/fd0 [0,4194304] 0 2024-09-17T07:20:04.404 INFO:tasks.workunit.client.0.smithi087.stdout:8/854: creat d1/d7/d9/d19/f12f x:0 0 0 2024-09-17T07:20:04.405 INFO:tasks.workunit.client.0.smithi087.stdout:7/693: dread d0/d3/d23/d2d/f79 [0,4194304] 0 2024-09-17T07:20:04.407 INFO:tasks.workunit.client.0.smithi087.stdout:8/855: mkdir d1/d7/d9/d19/d4d/d11f/d130 0 2024-09-17T07:20:04.408 INFO:tasks.workunit.client.0.smithi087.stdout:7/694: chown d0/d3/d23/d17/d7b/dad/daf/cb5 1140579 1 2024-09-17T07:20:04.409 INFO:tasks.workunit.client.0.smithi087.stdout:8/856: write d1/d2b/d21/dd4/fde [2005863,97705] 0 2024-09-17T07:20:04.410 INFO:tasks.workunit.client.0.smithi087.stdout:7/695: unlink d0/f9b 0 2024-09-17T07:20:04.415 INFO:tasks.workunit.client.0.smithi087.stdout:8/857: dwrite d1/d7/f2d [0,4194304] 0 2024-09-17T07:20:04.418 INFO:tasks.workunit.client.0.smithi087.stdout:8/858: mknod d1/d7/d63/dd9/c131 0 2024-09-17T07:20:04.419 INFO:tasks.workunit.client.1.smithi139.stdout:3/751: sync 2024-09-17T07:20:04.419 INFO:tasks.workunit.client.1.smithi139.stdout:2/805: sync 2024-09-17T07:20:04.419 INFO:tasks.workunit.client.1.smithi139.stdout:0/504: sync 2024-09-17T07:20:04.425 INFO:tasks.workunit.client.0.smithi087.stdout:8/859: dread d1/d2b/d21/dd4/f102 [0,4194304] 0 2024-09-17T07:20:04.425 INFO:tasks.workunit.client.0.smithi087.stdout:8/860: chown d1/d5f/c129 4010809 1 2024-09-17T07:20:04.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:04 smithi087 ceph-mon[27636]: pgmap v15: 65 pgs: 65 active+clean; 3.0 GiB data, 9.9 GiB used, 527 GiB / 536 GiB avail; 97 MiB/s rd, 258 MiB/s wr, 532 op/s 2024-09-17T07:20:04.427 INFO:tasks.workunit.client.1.smithi139.stdout:0/505: dread d1/da/d17/d72/f30 [0,4194304] 0 2024-09-17T07:20:04.429 INFO:tasks.workunit.client.1.smithi139.stdout:3/752: dwrite d5/d15/d20/d3b/f4a [0,4194304] 0 2024-09-17T07:20:04.434 INFO:tasks.workunit.client.0.smithi087.stdout:8/861: dwrite d1/d2b/df4/f7b [0,4194304] 0 2024-09-17T07:20:04.435 INFO:tasks.workunit.client.1.smithi139.stdout:0/506: dwrite d1/da/fc [0,4194304] 0 2024-09-17T07:20:04.435 INFO:tasks.workunit.client.1.smithi139.stdout:3/753: dwrite d5/d15/f51 [0,4194304] 0 2024-09-17T07:20:04.440 INFO:tasks.workunit.client.0.smithi087.stdout:7/696: symlink d0/d3/d10/d32/d8c/ld0 0 2024-09-17T07:20:04.441 INFO:tasks.workunit.client.1.smithi139.stdout:0/507: stat d1/da/d17/d72/d66/l67 0 2024-09-17T07:20:04.443 INFO:tasks.workunit.client.0.smithi087.stdout:8/862: dwrite d1/d2b/df4/f121 [0,4194304] 0 2024-09-17T07:20:04.444 INFO:tasks.workunit.client.0.smithi087.stdout:3/844: sync 2024-09-17T07:20:04.449 INFO:tasks.workunit.client.0.smithi087.stdout:7/697: link d0/d3/d10/d87/d96/f9d d0/d3/d23/d17/d7b/fd1 0 2024-09-17T07:20:04.450 INFO:tasks.workunit.client.1.smithi139.stdout:2/806: dwrite d0/d7/d67/da1/fea [4194304,4194304] 0 2024-09-17T07:20:04.451 INFO:tasks.workunit.client.0.smithi087.stdout:3/845: creat d6/d1b/d42/dd4/dd1/f12e x:0 0 0 2024-09-17T07:20:04.453 INFO:tasks.workunit.client.0.smithi087.stdout:8/863: dwrite d1/d7/d9/d19/d73/f8c [0,4194304] 0 2024-09-17T07:20:04.455 INFO:tasks.workunit.client.0.smithi087.stdout:3/846: symlink d6/d15/d37/d3c/d52/db2/l12f 0 2024-09-17T07:20:04.458 INFO:tasks.workunit.client.0.smithi087.stdout:3/847: readlink d6/d1b/d42/dd4/la9 0 2024-09-17T07:20:04.458 INFO:tasks.workunit.client.0.smithi087.stdout:7/698: rename d0/d36/c57 to d0/d3/d10/d32/cd2 0 2024-09-17T07:20:04.460 INFO:tasks.workunit.client.1.smithi139.stdout:2/807: rmdir d0/de/d54/df0 0 2024-09-17T07:20:04.462 INFO:tasks.workunit.client.1.smithi139.stdout:2/808: write d0/d7/d1a/fcc [286225,4525] 0 2024-09-17T07:20:04.462 INFO:tasks.workunit.client.0.smithi087.stdout:8/864: creat d1/d7/d9/f132 x:0 0 0 2024-09-17T07:20:04.463 INFO:tasks.workunit.client.0.smithi087.stdout:8/865: readlink d1/d2b/df4/d54/l57 0 2024-09-17T07:20:04.466 INFO:tasks.workunit.client.0.smithi087.stdout:8/866: rename d1/d2b/d3b/d53/dfd/f11d to d1/d2b/d21/d6d/f133 0 2024-09-17T07:20:04.467 INFO:tasks.workunit.client.0.smithi087.stdout:8/867: read d1/d2b/d21/dd4/f102 [97935,18002] 0 2024-09-17T07:20:04.467 INFO:tasks.workunit.client.0.smithi087.stdout:8/868: chown d1/d2b/d21/daf/dd7 3897738 1 2024-09-17T07:20:04.469 INFO:tasks.workunit.client.0.smithi087.stdout:8/869: write d1/d7/d9/d19/f1d [7326116,34444] 0 2024-09-17T07:20:04.470 INFO:tasks.workunit.client.1.smithi139.stdout:2/809: dwrite d0/d7/d67/da1/d10d/d15/ff5 [0,4194304] 0 2024-09-17T07:20:04.471 INFO:tasks.workunit.client.0.smithi087.stdout:8/870: readlink d1/d7/d9/d19/l107 0 2024-09-17T07:20:04.472 INFO:tasks.workunit.client.1.smithi139.stdout:2/810: creat d0/de/d69/de1/f10f x:0 0 0 2024-09-17T07:20:04.474 INFO:tasks.workunit.client.0.smithi087.stdout:8/871: truncate d1/d7/d9/d19/d4d/d11f/f45 4802895 0 2024-09-17T07:20:04.475 INFO:tasks.workunit.client.1.smithi139.stdout:2/811: creat d0/d7/d86/da4/d28/ddd/f110 x:0 0 0 2024-09-17T07:20:04.476 INFO:tasks.workunit.client.0.smithi087.stdout:8/872: truncate d1/d7/d9/d19/d1b/fce 4312140 0 2024-09-17T07:20:04.514 INFO:tasks.workunit.client.1.smithi139.stdout:0/508: write d1/da/d2a/f38 [4131501,14154] 0 2024-09-17T07:20:04.516 INFO:tasks.workunit.client.0.smithi087.stdout:8/873: fsync d1/d7/d9/d19/d4d/ffe 0 2024-09-17T07:20:04.519 INFO:tasks.workunit.client.1.smithi139.stdout:3/754: dwrite d5/d15/d20/f42 [0,4194304] 0 2024-09-17T07:20:04.520 INFO:tasks.workunit.client.0.smithi087.stdout:3/848: dwrite d6/d1b/d42/dd4/ddc/ffe [0,4194304] 0 2024-09-17T07:20:04.522 INFO:tasks.workunit.client.0.smithi087.stdout:2/737: sync 2024-09-17T07:20:04.524 INFO:tasks.workunit.client.0.smithi087.stdout:7/699: dread d0/d3/d23/d17/f1e [0,4194304] 0 2024-09-17T07:20:04.524 INFO:tasks.workunit.client.0.smithi087.stdout:2/738: fdatasync d2/d7/dd/d10/d4c/dcc/fcd 0 2024-09-17T07:20:04.528 INFO:tasks.workunit.client.0.smithi087.stdout:2/739: mkdir d2/d7/dd/d10/d91/dea 0 2024-09-17T07:20:04.529 INFO:tasks.workunit.client.0.smithi087.stdout:2/740: readlink d2/d12/d85/lad 0 2024-09-17T07:20:04.530 INFO:tasks.workunit.client.1.smithi139.stdout:3/755: dwrite d5/da7/dca/dab/dd6/d28/f3d [0,4194304] 0 2024-09-17T07:20:04.530 INFO:tasks.workunit.client.1.smithi139.stdout:2/812: dwrite d0/d7/d86/da4/d12/f77 [0,4194304] 0 2024-09-17T07:20:04.534 INFO:tasks.workunit.client.0.smithi087.stdout:7/700: dwrite d0/d3/d10/d32/d62/d76/fac [0,4194304] 0 2024-09-17T07:20:04.535 INFO:tasks.workunit.client.1.smithi139.stdout:0/509: mknod d1/da/d1b/d3d/d5a/d75/d91/cc4 0 2024-09-17T07:20:04.536 INFO:tasks.workunit.client.0.smithi087.stdout:2/741: truncate d2/d15/dce/dd1/f54 1360100 0 2024-09-17T07:20:04.537 INFO:tasks.workunit.client.0.smithi087.stdout:7/701: creat d0/d3/d10/d87/fd3 x:0 0 0 2024-09-17T07:20:04.539 INFO:tasks.workunit.client.0.smithi087.stdout:2/742: mknod d2/d7/db/de1/ceb 0 2024-09-17T07:20:04.541 INFO:tasks.workunit.client.0.smithi087.stdout:2/743: dread - d2/d12/fbc zero size 2024-09-17T07:20:04.542 INFO:tasks.workunit.client.1.smithi139.stdout:0/510: rename d1/da/d17/d72/db5 to d1/da/d1b/dba/dc5 0 2024-09-17T07:20:04.543 INFO:tasks.workunit.client.1.smithi139.stdout:2/813: dwrite d0/d7/d67/d92/d99/f8f [4194304,4194304] 0 2024-09-17T07:20:04.545 INFO:tasks.workunit.client.0.smithi087.stdout:7/702: dwrite d0/d3/d23/d17/d7b/fba [0,4194304] 0 2024-09-17T07:20:04.548 INFO:tasks.workunit.client.0.smithi087.stdout:7/703: read - d0/d3/d23/d17/d7b/dad/daf/fb8 zero size 2024-09-17T07:20:04.548 INFO:tasks.workunit.client.1.smithi139.stdout:4/639: sync 2024-09-17T07:20:04.549 INFO:tasks.workunit.client.1.smithi139.stdout:7/573: sync 2024-09-17T07:20:04.549 INFO:tasks.workunit.client.1.smithi139.stdout:1/594: sync 2024-09-17T07:20:04.549 INFO:tasks.workunit.client.1.smithi139.stdout:8/905: sync 2024-09-17T07:20:04.549 INFO:tasks.workunit.client.1.smithi139.stdout:6/766: sync 2024-09-17T07:20:04.559 INFO:tasks.workunit.client.1.smithi139.stdout:7/574: mknod d5/d67/cb5 0 2024-09-17T07:20:04.560 INFO:tasks.workunit.client.1.smithi139.stdout:6/767: truncate db/df/f84 4141930 0 2024-09-17T07:20:04.561 INFO:tasks.workunit.client.1.smithi139.stdout:7/575: stat d5/d67 0 2024-09-17T07:20:04.564 INFO:tasks.workunit.client.1.smithi139.stdout:1/595: dwrite d2/f15 [4194304,4194304] 0 2024-09-17T07:20:04.566 INFO:tasks.workunit.client.1.smithi139.stdout:0/511: dwrite d1/da/d17/d72/f30 [0,4194304] 0 2024-09-17T07:20:04.568 INFO:tasks.workunit.client.1.smithi139.stdout:0/512: dread d1/da/d1b/d32/f73 [0,4194304] 0 2024-09-17T07:20:04.569 INFO:tasks.workunit.client.1.smithi139.stdout:0/513: chown d1/da/f60 259592 1 2024-09-17T07:20:04.569 INFO:tasks.workunit.client.1.smithi139.stdout:7/576: rmdir d5/d17/d4e 39 2024-09-17T07:20:04.573 INFO:tasks.workunit.client.1.smithi139.stdout:7/577: symlink d5/d10/d2b/d78/d9e/db1/lb6 0 2024-09-17T07:20:04.575 INFO:tasks.workunit.client.1.smithi139.stdout:0/514: fdatasync d1/da/d1b/d32/f7a 0 2024-09-17T07:20:04.578 INFO:tasks.workunit.client.1.smithi139.stdout:7/578: fsync d5/d10/d2b/f44 0 2024-09-17T07:20:04.579 INFO:tasks.workunit.client.0.smithi087.stdout:8/874: dread d1/d7/d9/d19/d4d/f47 [4194304,4194304] 0 2024-09-17T07:20:04.580 INFO:tasks.workunit.client.0.smithi087.stdout:8/875: dread - d1/d2b/d21/d6d/f133 zero size 2024-09-17T07:20:04.581 INFO:tasks.workunit.client.1.smithi139.stdout:7/579: chown d5/d17/d4e/d55 123141423 1 2024-09-17T07:20:04.582 INFO:tasks.workunit.client.0.smithi087.stdout:8/876: creat d1/d2b/d21/d6d/f134 x:0 0 0 2024-09-17T07:20:04.583 INFO:tasks.workunit.client.0.smithi087.stdout:8/877: write d1/fd6 [940126,53147] 0 2024-09-17T07:20:04.583 INFO:tasks.workunit.client.1.smithi139.stdout:7/580: mkdir d5/d10/d2b/d78/d9e/db1/db7 0 2024-09-17T07:20:04.585 INFO:tasks.workunit.client.1.smithi139.stdout:7/581: mkdir d5/d10/d2b/d78/d9e/db1/db8 0 2024-09-17T07:20:04.589 INFO:tasks.workunit.client.1.smithi139.stdout:3/756: truncate d5/d15/d16/f9e 3919023 0 2024-09-17T07:20:04.590 INFO:tasks.workunit.client.1.smithi139.stdout:3/757: creat d5/d21/dba/fea x:0 0 0 2024-09-17T07:20:04.597 INFO:tasks.workunit.client.1.smithi139.stdout:3/758: dwrite d5/d63/d6d/d6f/d81/fc9 [4194304,4194304] 0 2024-09-17T07:20:04.598 INFO:tasks.workunit.client.1.smithi139.stdout:3/759: readlink d5/d63/d6d/lad 0 2024-09-17T07:20:04.598 INFO:tasks.workunit.client.1.smithi139.stdout:6/768: dread db/d18/d1b/f3f [0,4194304] 0 2024-09-17T07:20:04.602 INFO:tasks.workunit.client.1.smithi139.stdout:6/769: rename db/d18/d1b/fd3 to db/df/d73/dc1/f108 0 2024-09-17T07:20:04.606 INFO:tasks.workunit.client.1.smithi139.stdout:6/770: creat db/d18/d38/d60/dc2/f109 x:0 0 0 2024-09-17T07:20:04.606 INFO:tasks.workunit.client.1.smithi139.stdout:3/760: dwrite d5/d15/fcf [0,4194304] 0 2024-09-17T07:20:04.610 INFO:tasks.workunit.client.1.smithi139.stdout:3/761: mkdir d5/d21/d23/d38/deb 0 2024-09-17T07:20:04.613 INFO:tasks.workunit.client.1.smithi139.stdout:3/762: getdents d5/d15/d56 0 2024-09-17T07:20:04.614 INFO:tasks.workunit.client.1.smithi139.stdout:3/763: dread - d5/d21/d23/d69/dd5/fda zero size 2024-09-17T07:20:04.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:04 smithi139 ceph-mon[34403]: pgmap v15: 65 pgs: 65 active+clean; 3.0 GiB data, 9.9 GiB used, 527 GiB / 536 GiB avail; 97 MiB/s rd, 258 MiB/s wr, 532 op/s 2024-09-17T07:20:04.623 INFO:tasks.workunit.client.1.smithi139.stdout:7/582: dread d5/d10/d2b/d40/f61 [0,4194304] 0 2024-09-17T07:20:04.626 INFO:tasks.workunit.client.1.smithi139.stdout:0/515: dread d1/da/d1b/d32/f35 [0,4194304] 0 2024-09-17T07:20:04.629 INFO:tasks.workunit.client.1.smithi139.stdout:7/583: link d5/d17/f2a d5/d17/d4e/d63/fb9 0 2024-09-17T07:20:04.629 INFO:tasks.workunit.client.1.smithi139.stdout:7/584: readlink d5/l26 0 2024-09-17T07:20:04.637 INFO:tasks.workunit.client.1.smithi139.stdout:2/814: write d0/de/df/d56/fb3 [71078,99732] 0 2024-09-17T07:20:04.638 INFO:tasks.workunit.client.1.smithi139.stdout:2/815: fdatasync d0/d7/d67/da1/d10d/d15/fe0 0 2024-09-17T07:20:04.640 INFO:tasks.workunit.client.1.smithi139.stdout:2/816: mkdir d0/d4e/d76/d111 0 2024-09-17T07:20:04.641 INFO:tasks.workunit.client.1.smithi139.stdout:2/817: write d0/d7/d67/d92/d99/f8f [1025098,3987] 0 2024-09-17T07:20:04.645 INFO:tasks.workunit.client.1.smithi139.stdout:2/818: dread d0/d7/d67/da1/d10d/d15/fbe [0,4194304] 0 2024-09-17T07:20:04.647 INFO:tasks.workunit.client.1.smithi139.stdout:2/819: chown d0/de/d25/d3f/fbb 15019 1 2024-09-17T07:20:04.649 INFO:tasks.workunit.client.1.smithi139.stdout:2/820: symlink d0/d7/d67/da1/d10d/d3a/l112 0 2024-09-17T07:20:04.650 INFO:tasks.workunit.client.1.smithi139.stdout:2/821: chown d0/d7/d86/da4/d28/la5 2563 1 2024-09-17T07:20:04.650 INFO:tasks.workunit.client.1.smithi139.stdout:2/822: fsync d0/de/f36 0 2024-09-17T07:20:04.657 INFO:tasks.workunit.client.1.smithi139.stdout:7/585: dread d5/d17/f91 [0,4194304] 0 2024-09-17T07:20:04.657 INFO:tasks.workunit.client.0.smithi087.stdout:2/744: getdents d2/d7/db/de1 0 2024-09-17T07:20:04.658 INFO:tasks.workunit.client.1.smithi139.stdout:8/906: write d0/d20/d28/d52/d54/f84 [541879,67322] 0 2024-09-17T07:20:04.659 INFO:tasks.workunit.client.0.smithi087.stdout:7/704: write d0/d3/d10/f29 [397414,1357] 0 2024-09-17T07:20:04.660 INFO:tasks.workunit.client.0.smithi087.stdout:2/745: dread - d2/d48/d69/da0/fb3 zero size 2024-09-17T07:20:04.661 INFO:tasks.workunit.client.0.smithi087.stdout:7/705: write d0/f28 [2452530,40684] 0 2024-09-17T07:20:04.662 INFO:tasks.workunit.client.0.smithi087.stdout:7/706: fsync d0/d3/d10/d31/f63 0 2024-09-17T07:20:04.663 INFO:tasks.workunit.client.1.smithi139.stdout:7/586: creat d5/d10/d2b/d78/d9e/fba x:0 0 0 2024-09-17T07:20:04.664 INFO:tasks.workunit.client.0.smithi087.stdout:2/746: unlink d2/d7/dd/d10/d91/lb5 0 2024-09-17T07:20:04.664 INFO:tasks.workunit.client.1.smithi139.stdout:4/640: dwrite d0/d1/d9b/d83/f8e [0,4194304] 0 2024-09-17T07:20:04.666 INFO:tasks.workunit.client.0.smithi087.stdout:2/747: truncate d2/d48/d69/da0/fb3 779629 0 2024-09-17T07:20:04.666 INFO:tasks.workunit.client.1.smithi139.stdout:8/907: fsync d0/d20/d28/d52/d65/d7f/db6/f34 0 2024-09-17T07:20:04.667 INFO:tasks.workunit.client.1.smithi139.stdout:8/908: stat d0/d20/d28/cdd 0 2024-09-17T07:20:04.668 INFO:tasks.workunit.client.1.smithi139.stdout:8/909: chown d0/d1a/d4d/da4 397 1 2024-09-17T07:20:04.672 INFO:tasks.workunit.client.1.smithi139.stdout:2/823: dread d0/de/df/d56/f7a [0,4194304] 0 2024-09-17T07:20:04.676 INFO:tasks.workunit.client.1.smithi139.stdout:4/641: creat d0/db/d17/dc3/fc8 x:0 0 0 2024-09-17T07:20:04.676 INFO:tasks.workunit.client.1.smithi139.stdout:5/794: sync 2024-09-17T07:20:04.677 INFO:tasks.workunit.client.1.smithi139.stdout:2/824: symlink d0/d7/d86/da4/d12/l113 0 2024-09-17T07:20:04.679 INFO:tasks.workunit.client.0.smithi087.stdout:2/748: write d2/d15/f45 [3718189,82577] 0 2024-09-17T07:20:04.679 INFO:tasks.workunit.client.0.smithi087.stdout:2/749: chown d2/d48/l9e 493388 1 2024-09-17T07:20:04.680 INFO:tasks.workunit.client.1.smithi139.stdout:5/795: mknod d4/c106 0 2024-09-17T07:20:04.680 INFO:tasks.workunit.client.1.smithi139.stdout:0/516: write d1/da/d1b/d32/f7a [676272,95283] 0 2024-09-17T07:20:04.681 INFO:tasks.workunit.client.0.smithi087.stdout:2/750: creat d2/d50/fec x:0 0 0 2024-09-17T07:20:04.681 INFO:tasks.workunit.client.1.smithi139.stdout:4/642: creat d0/d10/fc9 x:0 0 0 2024-09-17T07:20:04.682 INFO:tasks.workunit.client.1.smithi139.stdout:7/587: dread d5/f23 [4194304,4194304] 0 2024-09-17T07:20:04.682 INFO:tasks.workunit.client.1.smithi139.stdout:6/771: dwrite db/d18/d1b/da7/fb1 [0,4194304] 0 2024-09-17T07:20:04.683 INFO:tasks.workunit.client.1.smithi139.stdout:2/825: rmdir d0/de/d69/de1 39 2024-09-17T07:20:04.685 INFO:tasks.workunit.client.1.smithi139.stdout:5/796: unlink d4/d16/lc8 0 2024-09-17T07:20:04.690 INFO:tasks.workunit.client.1.smithi139.stdout:2/826: creat d0/d7/d67/da1/d10d/d15/d9f/f114 x:0 0 0 2024-09-17T07:20:04.693 INFO:tasks.workunit.client.1.smithi139.stdout:4/643: symlink d0/d1/d54/d93/da2/lca 0 2024-09-17T07:20:04.694 INFO:tasks.workunit.client.1.smithi139.stdout:5/797: mknod d4/d16/d1b/d20/d67/d88/d9f/c107 0 2024-09-17T07:20:04.698 INFO:tasks.workunit.client.1.smithi139.stdout:7/588: dwrite d5/d10/f83 [0,4194304] 0 2024-09-17T07:20:04.699 INFO:tasks.workunit.client.1.smithi139.stdout:2/827: read d0/f6 [3572272,18365] 0 2024-09-17T07:20:04.699 INFO:tasks.workunit.client.1.smithi139.stdout:5/798: mkdir d4/d16/d1b/d20/d108 0 2024-09-17T07:20:04.701 INFO:tasks.workunit.client.1.smithi139.stdout:4/644: truncate d0/d1/d9b/d83/f48 5128292 0 2024-09-17T07:20:04.702 INFO:tasks.workunit.client.1.smithi139.stdout:7/589: rmdir d5/d17/d4e/d66 39 2024-09-17T07:20:04.704 INFO:tasks.workunit.client.1.smithi139.stdout:2/828: dread - d0/d7/d67/da1/d10d/d15/d9f/dc1/ffd zero size 2024-09-17T07:20:04.705 INFO:tasks.workunit.client.1.smithi139.stdout:0/517: dread d1/da/d2a/f2e [0,4194304] 0 2024-09-17T07:20:04.706 INFO:tasks.workunit.client.1.smithi139.stdout:8/910: write d0/f7d [1275764,81474] 0 2024-09-17T07:20:04.710 INFO:tasks.workunit.client.1.smithi139.stdout:2/829: mkdir d0/d3b/ddc/d115 0 2024-09-17T07:20:04.711 INFO:tasks.workunit.client.1.smithi139.stdout:6/772: dread db/d18/f6c [0,4194304] 0 2024-09-17T07:20:04.712 INFO:tasks.workunit.client.1.smithi139.stdout:4/645: rename d0/db/c80 to d0/d1/d54/d93/da1/ccb 0 2024-09-17T07:20:04.713 INFO:tasks.workunit.client.1.smithi139.stdout:4/646: stat d0/db 0 2024-09-17T07:20:04.715 INFO:tasks.workunit.client.1.smithi139.stdout:7/590: symlink d5/d17/d4e/d90/lbb 0 2024-09-17T07:20:04.715 INFO:tasks.workunit.client.1.smithi139.stdout:5/799: dwrite d4/d16/d1b/d20/d38/d4f/f5c [0,4194304] 0 2024-09-17T07:20:04.717 INFO:tasks.workunit.client.1.smithi139.stdout:0/518: symlink d1/da/d1b/d3d/d5a/d75/d93/lc6 0 2024-09-17T07:20:04.721 INFO:tasks.workunit.client.1.smithi139.stdout:6/773: symlink db/df/d4e/d5e/d8a/l10a 0 2024-09-17T07:20:04.721 INFO:tasks.workunit.client.1.smithi139.stdout:8/911: symlink d0/d1a/d3a/d71/d127/l129 0 2024-09-17T07:20:04.722 INFO:tasks.workunit.client.1.smithi139.stdout:4/647: chown d0/d1/d29/d41/f43 148421499 1 2024-09-17T07:20:04.725 INFO:tasks.workunit.client.1.smithi139.stdout:5/800: rmdir d4/d5d 39 2024-09-17T07:20:04.725 INFO:tasks.workunit.client.1.smithi139.stdout:4/648: dread d0/f71 [0,4194304] 0 2024-09-17T07:20:04.726 INFO:tasks.workunit.client.1.smithi139.stdout:8/912: truncate d0/d1a/d4d/d53/fee 448874 0 2024-09-17T07:20:04.727 INFO:tasks.workunit.client.0.smithi087.stdout:2/751: dread d2/d7/dd/f29 [4194304,4194304] 0 2024-09-17T07:20:04.728 INFO:tasks.workunit.client.1.smithi139.stdout:7/591: link d5/d10/d2b/d40/d47/f8e d5/d10/d2b/d71/fbc 0 2024-09-17T07:20:04.729 INFO:tasks.workunit.client.0.smithi087.stdout:2/752: mkdir d2/d96/ded 0 2024-09-17T07:20:04.730 INFO:tasks.workunit.client.0.smithi087.stdout:2/753: mknod d2/d7/d60/cee 0 2024-09-17T07:20:04.734 INFO:tasks.workunit.client.1.smithi139.stdout:7/592: mknod d5/d96/cbd 0 2024-09-17T07:20:04.736 INFO:tasks.workunit.client.1.smithi139.stdout:4/649: creat d0/d1/d29/d6d/db3/fcc x:0 0 0 2024-09-17T07:20:04.736 INFO:tasks.workunit.client.1.smithi139.stdout:8/913: creat d0/d1a/f12a x:0 0 0 2024-09-17T07:20:04.737 INFO:tasks.workunit.client.1.smithi139.stdout:7/593: symlink d5/d10/d8c/lbe 0 2024-09-17T07:20:04.739 INFO:tasks.workunit.client.1.smithi139.stdout:4/650: fdatasync d0/d49/f52 0 2024-09-17T07:20:04.739 INFO:tasks.workunit.client.1.smithi139.stdout:2/830: dwrite d0/d4e/fc6 [0,4194304] 0 2024-09-17T07:20:04.743 INFO:tasks.workunit.client.1.smithi139.stdout:1/596: sync 2024-09-17T07:20:04.744 INFO:tasks.workunit.client.1.smithi139.stdout:4/651: readlink d0/d1/d29/d41/l4d 0 2024-09-17T07:20:04.746 INFO:tasks.workunit.client.1.smithi139.stdout:4/652: dread - d0/d1/d29/d6d/faa zero size 2024-09-17T07:20:04.747 INFO:tasks.workunit.client.1.smithi139.stdout:2/831: rename d0/c79 to d0/d7/d67/da1/d10d/d15/d9f/c116 0 2024-09-17T07:20:04.748 INFO:tasks.workunit.client.1.smithi139.stdout:6/774: truncate db/df/d73/fdc 538721 0 2024-09-17T07:20:04.750 INFO:tasks.workunit.client.1.smithi139.stdout:0/519: dwrite d1/da/d1b/d3d/f64 [0,4194304] 0 2024-09-17T07:20:04.751 INFO:tasks.workunit.client.1.smithi139.stdout:5/801: truncate d4/d16/f19 2828779 0 2024-09-17T07:20:04.752 INFO:tasks.workunit.client.1.smithi139.stdout:6/775: stat db/d18/d38/ff6 0 2024-09-17T07:20:04.755 INFO:tasks.workunit.client.1.smithi139.stdout:2/832: creat d0/df8/f117 x:0 0 0 2024-09-17T07:20:04.755 INFO:tasks.workunit.client.1.smithi139.stdout:6/776: chown db/d21/l4b 0 1 2024-09-17T07:20:04.756 INFO:tasks.workunit.client.0.smithi087.stdout:2/754: dread d2/d7/dd/d10/f53 [0,4194304] 0 2024-09-17T07:20:04.756 INFO:tasks.workunit.client.1.smithi139.stdout:8/914: write d0/d20/d28/d48/f9f [1523529,122660] 0 2024-09-17T07:20:04.758 INFO:tasks.workunit.client.1.smithi139.stdout:4/653: dwrite d0/d1/f8 [0,4194304] 0 2024-09-17T07:20:04.758 INFO:tasks.workunit.client.0.smithi087.stdout:2/755: mknod d2/d48/cef 0 2024-09-17T07:20:04.760 INFO:tasks.workunit.client.1.smithi139.stdout:1/597: link d2/d10/d12/d35/d49/l65 d2/d10/d12/d35/d49/lb7 0 2024-09-17T07:20:04.761 INFO:tasks.workunit.client.1.smithi139.stdout:2/833: write d0/f9b [2328938,106667] 0 2024-09-17T07:20:04.761 INFO:tasks.workunit.client.1.smithi139.stdout:5/802: symlink d4/d16/d1b/d20/d32/d6c/dc9/l109 0 2024-09-17T07:20:04.761 INFO:tasks.workunit.client.1.smithi139.stdout:4/654: write d0/db/f35 [1147726,130209] 0 2024-09-17T07:20:04.762 INFO:tasks.workunit.client.1.smithi139.stdout:6/777: truncate db/d21/d96/df4/ffc 166887 0 2024-09-17T07:20:04.765 INFO:tasks.workunit.client.1.smithi139.stdout:7/594: link d5/d10/d2b/d78/la9 d5/d10/lbf 0 2024-09-17T07:20:04.765 INFO:tasks.workunit.client.1.smithi139.stdout:2/834: readlink d0/de/d25/d3f/l65 0 2024-09-17T07:20:04.765 INFO:tasks.workunit.client.1.smithi139.stdout:1/598: stat d2/f11 0 2024-09-17T07:20:04.765 INFO:tasks.workunit.client.0.smithi087.stdout:2/756: dread d2/d24/fc0 [0,4194304] 0 2024-09-17T07:20:04.767 INFO:tasks.workunit.client.1.smithi139.stdout:2/835: write d0/d3b/f51 [2654210,116567] 0 2024-09-17T07:20:04.768 INFO:tasks.workunit.client.0.smithi087.stdout:9/798: sync 2024-09-17T07:20:04.768 INFO:tasks.workunit.client.1.smithi139.stdout:4/655: fdatasync d0/d1/d29/d41/f5c 0 2024-09-17T07:20:04.769 INFO:tasks.workunit.client.0.smithi087.stdout:9/799: stat d3/f4d 0 2024-09-17T07:20:04.770 INFO:tasks.workunit.client.1.smithi139.stdout:5/803: symlink d4/d16/d1b/d20/d67/d88/d9f/dfc/l10a 0 2024-09-17T07:20:04.770 INFO:tasks.workunit.client.1.smithi139.stdout:4/656: stat d0/d1/cc 0 2024-09-17T07:20:04.775 INFO:tasks.workunit.client.0.smithi087.stdout:9/800: dwrite d3/d25/d83/fc9 [0,4194304] 0 2024-09-17T07:20:04.776 INFO:tasks.workunit.client.0.smithi087.stdout:9/801: chown d3/d4/d6/d8/cae 5908 1 2024-09-17T07:20:04.779 INFO:tasks.workunit.client.0.smithi087.stdout:9/802: getdents d3/d4/d6 0 2024-09-17T07:20:04.781 INFO:tasks.workunit.client.0.smithi087.stdout:9/803: mkdir d3/d4/d6/d8/d22/d117 0 2024-09-17T07:20:04.800 INFO:tasks.workunit.client.0.smithi087.stdout:6/941: sync 2024-09-17T07:20:04.801 INFO:tasks.workunit.client.0.smithi087.stdout:1/814: sync 2024-09-17T07:20:04.803 INFO:tasks.workunit.client.0.smithi087.stdout:6/942: creat d1/d67/dfe/d125/f13c x:0 0 0 2024-09-17T07:20:04.803 INFO:tasks.workunit.client.0.smithi087.stdout:1/815: dread d2/d3d/db4/dc3/f10a [4194304,4194304] 0 2024-09-17T07:20:04.805 INFO:tasks.workunit.client.0.smithi087.stdout:1/816: mknod d2/d3d/d35/d57/d73/c11f 0 2024-09-17T07:20:04.806 INFO:tasks.workunit.client.0.smithi087.stdout:6/943: getdents d1/d67/dfe/d2c/d48/d9b 0 2024-09-17T07:20:04.806 INFO:tasks.workunit.client.0.smithi087.stdout:1/817: write d2/dcf/f4d [4438004,28976] 0 2024-09-17T07:20:04.807 INFO:tasks.workunit.client.0.smithi087.stdout:6/944: chown d1/d6a/dda/d123/l134 19669 1 2024-09-17T07:20:04.818 INFO:tasks.workunit.client.0.smithi087.stdout:2/757: dwrite d2/d7/dd/f27 [0,4194304] 0 2024-09-17T07:20:04.820 INFO:tasks.workunit.client.1.smithi139.stdout:4/657: chown d0/d1/d9b/d83 14852 1 2024-09-17T07:20:04.821 INFO:tasks.workunit.client.1.smithi139.stdout:8/915: truncate d0/d20/d28/d48/fe8 1008133 0 2024-09-17T07:20:04.822 INFO:tasks.workunit.client.1.smithi139.stdout:5/804: fsync d4/d16/d1b/d20/fb6 0 2024-09-17T07:20:04.823 INFO:tasks.workunit.client.0.smithi087.stdout:9/804: dwrite d3/d4/d6/d8/d12/d32/f8f [4194304,4194304] 0 2024-09-17T07:20:04.823 INFO:tasks.workunit.client.0.smithi087.stdout:2/758: dread - d2/d48/fb4 zero size 2024-09-17T07:20:04.826 INFO:tasks.workunit.client.0.smithi087.stdout:6/945: dwrite d1/d67/dfe/d4e/f74 [0,4194304] 0 2024-09-17T07:20:04.826 INFO:tasks.workunit.client.0.smithi087.stdout:1/818: dwrite d2/d3d/db4/dc3/f10a [4194304,4194304] 0 2024-09-17T07:20:04.827 INFO:tasks.workunit.client.1.smithi139.stdout:2/836: rename d0/d7/d1a/d1b to d0/d7/d67/da1/d10d/d15/d9f/d118 0 2024-09-17T07:20:04.827 INFO:tasks.workunit.client.0.smithi087.stdout:2/759: write d2/d15/f45 [1094315,6299] 0 2024-09-17T07:20:04.829 INFO:tasks.workunit.client.1.smithi139.stdout:4/658: creat d0/d1/d54/d93/fcd x:0 0 0 2024-09-17T07:20:04.830 INFO:tasks.workunit.client.0.smithi087.stdout:9/805: unlink d3/d4/d16/dc0/l67 0 2024-09-17T07:20:04.831 INFO:tasks.workunit.client.1.smithi139.stdout:1/599: dwrite d2/d10/d12/d24/d38/d3d/f4d [0,4194304] 0 2024-09-17T07:20:04.832 INFO:tasks.workunit.client.0.smithi087.stdout:9/806: chown d3/d4/d6/d8/d22/d64 20967 1 2024-09-17T07:20:04.833 INFO:tasks.workunit.client.0.smithi087.stdout:1/819: chown d2/dcf/l51 2 1 2024-09-17T07:20:04.834 INFO:tasks.workunit.client.1.smithi139.stdout:7/595: link d5/d10/d2b/fb4 d5/d17/d4e/d63/fc0 0 2024-09-17T07:20:04.834 INFO:tasks.workunit.client.0.smithi087.stdout:6/946: symlink d1/d67/l13d 0 2024-09-17T07:20:04.834 INFO:tasks.workunit.client.0.smithi087.stdout:9/807: dread - d3/d25/fe2 zero size 2024-09-17T07:20:04.835 INFO:tasks.workunit.client.0.smithi087.stdout:2/760: mknod d2/d15/dce/dd1/cf0 0 2024-09-17T07:20:04.837 INFO:tasks.workunit.client.0.smithi087.stdout:1/820: mkdir d2/d69/d8d/da6/d120 0 2024-09-17T07:20:04.837 INFO:tasks.workunit.client.1.smithi139.stdout:8/916: mkdir d0/d20/d12b 0 2024-09-17T07:20:04.837 INFO:tasks.workunit.client.1.smithi139.stdout:5/805: rename d4/d16/d1b/d20/d32/l8e to d4/d16/d1b/d20/d32/d72/de5/l10b 0 2024-09-17T07:20:04.839 INFO:tasks.workunit.client.1.smithi139.stdout:1/600: mkdir d2/d10/d12/d35/d49/d8b/db8 0 2024-09-17T07:20:04.840 INFO:tasks.workunit.client.1.smithi139.stdout:1/601: chown d2/d10/d12/d13/c83 2 1 2024-09-17T07:20:04.841 INFO:tasks.workunit.client.0.smithi087.stdout:2/761: rename d2/d7/dd/d10/f53 to d2/d7/dd/d10/d91/dea/ff1 0 2024-09-17T07:20:04.843 INFO:tasks.workunit.client.1.smithi139.stdout:2/837: creat d0/d3b/ddc/d115/f119 x:0 0 0 2024-09-17T07:20:04.844 INFO:tasks.workunit.client.1.smithi139.stdout:8/917: unlink d0/d20/d28/d48/de1/lf6 0 2024-09-17T07:20:04.846 INFO:tasks.workunit.client.1.smithi139.stdout:1/602: truncate d2/d10/d12/fa7 528272 0 2024-09-17T07:20:04.847 INFO:tasks.workunit.client.1.smithi139.stdout:4/659: creat d0/fce x:0 0 0 2024-09-17T07:20:04.847 INFO:tasks.workunit.client.1.smithi139.stdout:2/838: write d0/de/ffb [1466736,120706] 0 2024-09-17T07:20:04.848 INFO:tasks.workunit.client.0.smithi087.stdout:1/821: rename d2/dcf/d7e/fbf to d2/d69/d8d/da6/d120/f121 0 2024-09-17T07:20:04.849 INFO:tasks.workunit.client.1.smithi139.stdout:7/596: rename d5/d10/d2b/d40/d47/fa7 to d5/d17/d4e/fc1 0 2024-09-17T07:20:04.850 INFO:tasks.workunit.client.0.smithi087.stdout:1/822: truncate d2/d3d/d45/d90/f11c 903967 0 2024-09-17T07:20:04.850 INFO:tasks.workunit.client.1.smithi139.stdout:5/806: mkdir d4/d16/d1b/d20/d28/d3f/dcc/df1/d10c 0 2024-09-17T07:20:04.850 INFO:tasks.workunit.client.1.smithi139.stdout:0/520: dread d1/da/d2a/f80 [0,4194304] 0 2024-09-17T07:20:04.852 INFO:tasks.workunit.client.0.smithi087.stdout:1/823: write d2/d3d/d45/d90/f47 [256065,111352] 0 2024-09-17T07:20:04.853 INFO:tasks.workunit.client.0.smithi087.stdout:1/824: chown d2/d3d/d35/d4f/da5/l113 7985 1 2024-09-17T07:20:04.855 INFO:tasks.workunit.client.1.smithi139.stdout:2/839: mkdir d0/d11a 0 2024-09-17T07:20:04.856 INFO:tasks.workunit.client.1.smithi139.stdout:8/918: creat d0/d20/d28/d52/d65/dbe/f12c x:0 0 0 2024-09-17T07:20:04.857 INFO:tasks.workunit.client.1.smithi139.stdout:4/660: creat d0/db/db2/fcf x:0 0 0 2024-09-17T07:20:04.857 INFO:tasks.workunit.client.1.smithi139.stdout:1/603: dwrite d2/d10/d12/d1a/d61/faa [0,4194304] 0 2024-09-17T07:20:04.859 INFO:tasks.workunit.client.1.smithi139.stdout:5/807: chown d4/d16/d1b/d20/d32/d3d/ca1 0 1 2024-09-17T07:20:04.861 INFO:tasks.workunit.client.1.smithi139.stdout:0/521: rename d1/da/d1b/d3d/d5a/d75/d91/cb4 to d1/da/d1b/d3d/d5a/d75/d91/cc7 0 2024-09-17T07:20:04.862 INFO:tasks.workunit.client.1.smithi139.stdout:5/808: chown d4/d16/d1b/d20/d32/f3c 254762 1 2024-09-17T07:20:04.865 INFO:tasks.workunit.client.0.smithi087.stdout:8/878: sync 2024-09-17T07:20:04.865 INFO:tasks.workunit.client.0.smithi087.stdout:7/707: sync 2024-09-17T07:20:04.865 INFO:tasks.workunit.client.0.smithi087.stdout:3/849: sync 2024-09-17T07:20:04.866 INFO:tasks.workunit.client.1.smithi139.stdout:0/522: unlink d1/l6 0 2024-09-17T07:20:04.866 INFO:tasks.workunit.client.0.smithi087.stdout:1/825: dread d2/dcf/d9a/fab [0,4194304] 0 2024-09-17T07:20:04.867 INFO:tasks.workunit.client.0.smithi087.stdout:7/708: chown d0/d3/d10/d87/fd3 73 1 2024-09-17T07:20:04.868 INFO:tasks.workunit.client.0.smithi087.stdout:1/826: dread - d2/d3d/d8e/fb2 zero size 2024-09-17T07:20:04.868 INFO:tasks.workunit.client.1.smithi139.stdout:2/840: dwrite d0/d7/d86/da4/d12/fd6 [0,4194304] 0 2024-09-17T07:20:04.869 INFO:tasks.workunit.client.1.smithi139.stdout:1/604: dwrite d2/f7 [0,4194304] 0 2024-09-17T07:20:04.870 INFO:tasks.workunit.client.0.smithi087.stdout:8/879: creat d1/d2b/d21/d6d/d6f/f135 x:0 0 0 2024-09-17T07:20:04.870 INFO:tasks.workunit.client.0.smithi087.stdout:3/850: creat d6/d15/d37/d3c/d52/db2/d10a/d11b/f130 x:0 0 0 2024-09-17T07:20:04.876 INFO:tasks.workunit.client.0.smithi087.stdout:6/947: dread d1/d67/dfe/d2c/d58/ff2 [4194304,4194304] 0 2024-09-17T07:20:04.876 INFO:tasks.workunit.client.1.smithi139.stdout:5/809: getdents d4/d16/d1b/d20/d28/d3f/de8 0 2024-09-17T07:20:04.876 INFO:tasks.workunit.client.1.smithi139.stdout:5/810: readlink d4/l21 0 2024-09-17T07:20:04.877 INFO:tasks.workunit.client.1.smithi139.stdout:0/523: symlink d1/da/d1b/db6/lc8 0 2024-09-17T07:20:04.878 INFO:tasks.workunit.client.0.smithi087.stdout:7/709: chown d0/d3/d23/l12 4564 1 2024-09-17T07:20:04.878 INFO:tasks.workunit.client.0.smithi087.stdout:1/827: link d2/d48/d61/l99 d2/dcf/l122 0 2024-09-17T07:20:04.879 INFO:tasks.workunit.client.1.smithi139.stdout:1/605: creat d2/d10/d71/d94/fb9 x:0 0 0 2024-09-17T07:20:04.880 INFO:tasks.workunit.client.1.smithi139.stdout:1/606: read d2/d10/d12/d24/f8c [3682390,34080] 0 2024-09-17T07:20:04.881 INFO:tasks.workunit.client.0.smithi087.stdout:8/880: dwrite d1/d2b/d21/d6d/f10d [0,4194304] 0 2024-09-17T07:20:04.881 INFO:tasks.workunit.client.0.smithi087.stdout:3/851: link d6/d1b/d42/d62/dc1/de8/c3e d6/c131 0 2024-09-17T07:20:04.881 INFO:tasks.workunit.client.1.smithi139.stdout:2/841: link d0/d7/d86/da4/d12/cb0 d0/d7/d67/da1/d10d/d15/d9f/d118/c11b 0 2024-09-17T07:20:04.882 INFO:tasks.workunit.client.0.smithi087.stdout:7/710: mknod d0/d3/d10/d31/dc1/cd4 0 2024-09-17T07:20:04.883 INFO:tasks.workunit.client.1.smithi139.stdout:1/607: write d2/d10/d12/d13/f82 [3664170,106049] 0 2024-09-17T07:20:04.883 INFO:tasks.workunit.client.0.smithi087.stdout:1/828: symlink d2/d14/l123 0 2024-09-17T07:20:04.885 INFO:tasks.workunit.client.0.smithi087.stdout:1/829: chown d2/d3d/db4/lc7 42623704 1 2024-09-17T07:20:04.886 INFO:tasks.workunit.client.1.smithi139.stdout:0/524: link d1/da/d2a/cac d1/da/d1b/d3d/d5a/d75/d91/cc9 0 2024-09-17T07:20:04.888 INFO:tasks.workunit.client.0.smithi087.stdout:6/948: symlink d1/d67/dfe/d2c/d58/d90/l13e 0 2024-09-17T07:20:04.888 INFO:tasks.workunit.client.0.smithi087.stdout:1/830: dread - d2/d3d/d35/d57/d73/fea zero size 2024-09-17T07:20:04.889 INFO:tasks.workunit.client.1.smithi139.stdout:2/842: dwrite d0/de/df/d56/fb3 [0,4194304] 0 2024-09-17T07:20:04.891 INFO:tasks.workunit.client.1.smithi139.stdout:0/525: getdents d1/da/d17/db8 0 2024-09-17T07:20:04.892 INFO:tasks.workunit.client.0.smithi087.stdout:7/711: truncate d0/d3/d23/d17/f65 1750487 0 2024-09-17T07:20:04.892 INFO:tasks.workunit.client.0.smithi087.stdout:1/831: fsync d2/d1a/fc5 0 2024-09-17T07:20:04.892 INFO:tasks.workunit.client.0.smithi087.stdout:9/808: dread d3/d4/d16/d69/fe3 [0,4194304] 0 2024-09-17T07:20:04.892 INFO:tasks.workunit.client.1.smithi139.stdout:2/843: dread - d0/de/d25/f100 zero size 2024-09-17T07:20:04.893 INFO:tasks.workunit.client.1.smithi139.stdout:1/608: dwrite d2/d10/d12/d13/f43 [0,4194304] 0 2024-09-17T07:20:04.894 INFO:tasks.workunit.client.0.smithi087.stdout:3/852: link d6/d1b/d42/d62/f87 d6/d1b/d42/d6e/f132 0 2024-09-17T07:20:04.896 INFO:tasks.workunit.client.0.smithi087.stdout:6/949: getdents d1/d6a 0 2024-09-17T07:20:04.898 INFO:tasks.workunit.client.0.smithi087.stdout:7/712: write d0/d3/d10/f14 [1827847,88372] 0 2024-09-17T07:20:04.899 INFO:tasks.workunit.client.0.smithi087.stdout:9/809: symlink d3/d4/d6/d8/d12/d32/db2/l118 0 2024-09-17T07:20:04.901 INFO:tasks.workunit.client.0.smithi087.stdout:3/853: unlink d6/d15/l1f 0 2024-09-17T07:20:04.903 INFO:tasks.workunit.client.0.smithi087.stdout:8/881: dwrite d1/d7/d9/d19/d4d/d11f/da1/fec [0,4194304] 0 2024-09-17T07:20:04.903 INFO:tasks.workunit.client.0.smithi087.stdout:7/713: mknod d0/d3/d23/d17/d7b/cd5 0 2024-09-17T07:20:04.906 INFO:tasks.workunit.client.0.smithi087.stdout:6/950: unlink d1/d67/dfe/d2c/d40/d4c/la8 0 2024-09-17T07:20:04.909 INFO:tasks.workunit.client.0.smithi087.stdout:3/854: write d6/d1b/d42/d62/f87 [478166,83424] 0 2024-09-17T07:20:04.910 INFO:tasks.workunit.client.0.smithi087.stdout:7/714: creat d0/d3/d23/d4e/fd6 x:0 0 0 2024-09-17T07:20:04.911 INFO:tasks.workunit.client.0.smithi087.stdout:6/951: rename d1/c12d to d1/d67/dfe/d2c/d40/d4c/da1/c13f 0 2024-09-17T07:20:04.914 INFO:tasks.workunit.client.0.smithi087.stdout:9/810: getdents d3/d4/d6/d8/d22/d92/da3/da4 0 2024-09-17T07:20:04.916 INFO:tasks.workunit.client.0.smithi087.stdout:7/715: dread d0/d3/d23/d17/f41 [0,4194304] 0 2024-09-17T07:20:04.916 INFO:tasks.workunit.client.0.smithi087.stdout:3/855: mknod d6/d15/d37/d3c/d43/db7/de3/d108/c133 0 2024-09-17T07:20:04.921 INFO:tasks.workunit.client.0.smithi087.stdout:7/716: getdents d0/d7a 0 2024-09-17T07:20:04.922 INFO:tasks.workunit.client.0.smithi087.stdout:9/811: dwrite d3/d25/fcc [0,4194304] 0 2024-09-17T07:20:04.922 INFO:tasks.workunit.client.0.smithi087.stdout:3/856: truncate d6/d15/d37/d3c/d52/db2/de7/f36 1118188 0 2024-09-17T07:20:04.926 INFO:tasks.workunit.client.0.smithi087.stdout:7/717: fsync d0/d3/d10/f20 0 2024-09-17T07:20:04.927 INFO:tasks.workunit.client.0.smithi087.stdout:3/857: dread d6/d15/d37/d3c/ff5 [0,4194304] 0 2024-09-17T07:20:04.928 INFO:tasks.workunit.client.0.smithi087.stdout:3/858: fdatasync d6/d1b/d42/d62/dbb/dd7/fda 0 2024-09-17T07:20:04.929 INFO:tasks.workunit.client.0.smithi087.stdout:7/718: chown d0/d3/d23/d2d/fca 428 1 2024-09-17T07:20:04.930 INFO:tasks.workunit.client.0.smithi087.stdout:7/719: chown d0/d3/d10/d87/d96/l9e 55 1 2024-09-17T07:20:04.931 INFO:tasks.workunit.client.0.smithi087.stdout:7/720: chown d0/d3/f3e 1 1 2024-09-17T07:20:04.932 INFO:tasks.workunit.client.0.smithi087.stdout:7/721: fdatasync d0/d3/d10/d31/f9a 0 2024-09-17T07:20:04.933 INFO:tasks.workunit.client.0.smithi087.stdout:3/859: rename d6/d15/d4b/f8b to d6/d1b/d42/d62/dbb/dd7/dee/f134 0 2024-09-17T07:20:04.934 INFO:tasks.workunit.client.1.smithi139.stdout:1/609: dread d2/d10/d12/d35/d2b/f34 [0,4194304] 0 2024-09-17T07:20:04.936 INFO:tasks.workunit.client.0.smithi087.stdout:3/860: mkdir d6/d7d/d135 0 2024-09-17T07:20:04.937 INFO:tasks.workunit.client.0.smithi087.stdout:3/861: dread - d6/d1b/d42/d62/dc1/de8/fef zero size 2024-09-17T07:20:04.938 INFO:tasks.workunit.client.0.smithi087.stdout:3/862: fdatasync d6/d15/d37/f72 0 2024-09-17T07:20:04.939 INFO:tasks.workunit.client.0.smithi087.stdout:3/863: write d6/d15/d37/d3c/d52/db2/fbd [891060,45183] 0 2024-09-17T07:20:04.940 INFO:tasks.workunit.client.0.smithi087.stdout:3/864: chown d6/d15/d37/f5b 397 1 2024-09-17T07:20:04.941 INFO:tasks.workunit.client.1.smithi139.stdout:1/610: dwrite d2/d10/d12/d13/d4f/d5c/fb3 [0,4194304] 0 2024-09-17T07:20:04.941 INFO:tasks.workunit.client.1.smithi139.stdout:3/764: sync 2024-09-17T07:20:04.942 INFO:tasks.workunit.client.1.smithi139.stdout:3/765: chown d5/d21/d23/d38/f5f 14631 1 2024-09-17T07:20:04.943 INFO:tasks.workunit.client.1.smithi139.stdout:3/766: chown d5/d21/cb1 47 1 2024-09-17T07:20:04.944 INFO:tasks.workunit.client.1.smithi139.stdout:1/611: symlink d2/d10/d12/d13/lba 0 2024-09-17T07:20:04.945 INFO:tasks.workunit.client.1.smithi139.stdout:3/767: write d5/d21/d23/d38/f5f [4585397,105704] 0 2024-09-17T07:20:04.946 INFO:tasks.workunit.client.1.smithi139.stdout:1/612: read d2/d10/d12/f76 [2820039,5884] 0 2024-09-17T07:20:04.963 INFO:tasks.workunit.client.0.smithi087.stdout:3/865: dread d6/d15/f19 [0,4194304] 0 2024-09-17T07:20:04.971 INFO:tasks.workunit.client.0.smithi087.stdout:2/762: write d2/d15/dce/dd1/d3f/fdc [992172,45211] 0 2024-09-17T07:20:04.972 INFO:tasks.workunit.client.0.smithi087.stdout:1/832: dread d2/d48/d6f/f109 [0,4194304] 0 2024-09-17T07:20:04.979 INFO:tasks.workunit.client.0.smithi087.stdout:9/812: dread d3/d4/d6/d8/df1/fc3 [0,4194304] 0 2024-09-17T07:20:04.980 INFO:tasks.workunit.client.0.smithi087.stdout:9/813: read - d3/d4/da/de9/f105 zero size 2024-09-17T07:20:04.984 INFO:tasks.workunit.client.0.smithi087.stdout:9/814: getdents d3/d4/d6/d8/d22/d43 0 2024-09-17T07:20:04.986 INFO:tasks.workunit.client.0.smithi087.stdout:9/815: dread - d3/d4/d16/d69/d8a/d1e/fb0 zero size 2024-09-17T07:20:04.991 INFO:tasks.workunit.client.0.smithi087.stdout:9/816: creat d3/d4/d16/d69/d8a/d1e/d90/d93/d96/f119 x:0 0 0 2024-09-17T07:20:04.992 INFO:tasks.workunit.client.0.smithi087.stdout:3/866: write d6/d15/d37/d3c/d52/f97 [889194,73057] 0 2024-09-17T07:20:04.992 INFO:tasks.workunit.client.0.smithi087.stdout:2/763: write d2/d7/dd/d10/d4c/dcc/f55 [1267762,39776] 0 2024-09-17T07:20:04.994 INFO:tasks.workunit.client.0.smithi087.stdout:9/817: symlink d3/d4/d6/d8/d12/d32/d6c/l11a 0 2024-09-17T07:20:04.996 INFO:tasks.workunit.client.0.smithi087.stdout:2/764: read - d2/d7/db/fe2 zero size 2024-09-17T07:20:04.996 INFO:tasks.workunit.client.0.smithi087.stdout:3/867: mkdir d6/d136 0 2024-09-17T07:20:05.000 INFO:tasks.workunit.client.0.smithi087.stdout:9/818: symlink d3/d4/d6/d8/d12/d32/db2/l11b 0 2024-09-17T07:20:05.000 INFO:tasks.workunit.client.0.smithi087.stdout:1/833: dwrite d2/d3d/d35/fde [0,4194304] 0 2024-09-17T07:20:05.003 INFO:tasks.workunit.client.0.smithi087.stdout:7/722: dwrite d0/d3/d23/d17/f65 [0,4194304] 0 2024-09-17T07:20:05.005 INFO:tasks.workunit.client.0.smithi087.stdout:3/868: creat d6/d15/f137 x:0 0 0 2024-09-17T07:20:05.007 INFO:tasks.workunit.client.0.smithi087.stdout:2/765: dwrite d2/d12/f94 [0,4194304] 0 2024-09-17T07:20:05.010 INFO:tasks.workunit.client.0.smithi087.stdout:2/766: readlink d2/d7/l9c 0 2024-09-17T07:20:05.010 INFO:tasks.workunit.client.0.smithi087.stdout:1/834: creat d2/d3d/d35/d57/f124 x:0 0 0 2024-09-17T07:20:05.014 INFO:tasks.workunit.client.0.smithi087.stdout:7/723: rename d0/d3/d23/d2d/l74 to d0/d3/d10/d31/dc1/ld7 0 2024-09-17T07:20:05.015 INFO:tasks.workunit.client.0.smithi087.stdout:3/869: symlink d6/d1b/l138 0 2024-09-17T07:20:05.015 INFO:tasks.workunit.client.0.smithi087.stdout:7/724: readlink d0/d3/d10/d31/l3c 0 2024-09-17T07:20:05.017 INFO:tasks.workunit.client.0.smithi087.stdout:1/835: mkdir d2/d3d/d35/d4f/da5/dce/d125 0 2024-09-17T07:20:05.017 INFO:tasks.workunit.client.0.smithi087.stdout:3/870: write d6/d15/d37/d3c/d52/db2/d102/f117 [49943,23085] 0 2024-09-17T07:20:05.018 INFO:tasks.workunit.client.0.smithi087.stdout:9/819: getdents d3/d4/d6/d8/d22/d43/d84/dc7 0 2024-09-17T07:20:05.019 INFO:tasks.workunit.client.0.smithi087.stdout:1/836: fsync d2/d3d/d35/ffe 0 2024-09-17T07:20:05.019 INFO:tasks.workunit.client.0.smithi087.stdout:7/725: mknod d0/d3/d23/cd8 0 2024-09-17T07:20:05.022 INFO:tasks.workunit.client.0.smithi087.stdout:7/726: rmdir d0/d3 39 2024-09-17T07:20:05.023 INFO:tasks.workunit.client.0.smithi087.stdout:3/871: mkdir d6/d15/d37/d3c/d52/db2/de7/ddd/d139 0 2024-09-17T07:20:05.023 INFO:tasks.workunit.client.0.smithi087.stdout:9/820: write d3/d4/d16/d69/d8a/d1e/d90/f10e [204311,35458] 0 2024-09-17T07:20:05.024 INFO:tasks.workunit.client.1.smithi139.stdout:7/597: write d5/d17/f49 [1188478,28386] 0 2024-09-17T07:20:05.025 INFO:tasks.workunit.client.0.smithi087.stdout:1/837: truncate d2/d3d/d45/d90/f11d 734903 0 2024-09-17T07:20:05.025 INFO:tasks.workunit.client.0.smithi087.stdout:2/767: dwrite d2/d7/f68 [0,4194304] 0 2024-09-17T07:20:05.026 INFO:tasks.workunit.client.1.smithi139.stdout:4/661: write d0/d1/fd [3697445,32686] 0 2024-09-17T07:20:05.028 INFO:tasks.workunit.client.1.smithi139.stdout:2/844: write d0/d7/d1a/f1e [1802453,75939] 0 2024-09-17T07:20:05.029 INFO:tasks.workunit.client.1.smithi139.stdout:1/613: creat d2/d10/d12/d13/d4f/d5c/d74/fbb x:0 0 0 2024-09-17T07:20:05.030 INFO:tasks.workunit.client.0.smithi087.stdout:1/838: fdatasync d2/dcf/d9a/fab 0 2024-09-17T07:20:05.033 INFO:tasks.workunit.client.1.smithi139.stdout:7/598: creat d5/d10/d2b/d78/d9e/db1/fc2 x:0 0 0 2024-09-17T07:20:05.033 INFO:tasks.workunit.client.1.smithi139.stdout:3/768: dwrite d5/d63/fe5 [0,4194304] 0 2024-09-17T07:20:05.036 INFO:tasks.workunit.client.1.smithi139.stdout:2/845: creat d0/d7/d86/f11c x:0 0 0 2024-09-17T07:20:05.036 INFO:tasks.workunit.client.1.smithi139.stdout:1/614: creat d2/d10/d12/d35/d49/d8d/fbc x:0 0 0 2024-09-17T07:20:05.037 INFO:tasks.workunit.client.0.smithi087.stdout:7/727: creat d0/d3/d10/d32/d8c/fd9 x:0 0 0 2024-09-17T07:20:05.038 INFO:tasks.workunit.client.1.smithi139.stdout:1/615: chown d2/f6 22 1 2024-09-17T07:20:05.039 INFO:tasks.workunit.client.0.smithi087.stdout:1/839: chown d2/d3d/d45/f72 132562 1 2024-09-17T07:20:05.039 INFO:tasks.workunit.client.1.smithi139.stdout:2/846: mknod d0/de/d25/c11d 0 2024-09-17T07:20:05.039 INFO:tasks.workunit.client.1.smithi139.stdout:7/599: mknod d5/d17/cc3 0 2024-09-17T07:20:05.041 INFO:tasks.workunit.client.1.smithi139.stdout:4/662: dwrite d0/f5 [0,4194304] 0 2024-09-17T07:20:05.042 INFO:tasks.workunit.client.0.smithi087.stdout:9/821: dwrite d3/d4/da/f55 [0,4194304] 0 2024-09-17T07:20:05.042 INFO:tasks.workunit.client.1.smithi139.stdout:7/600: write d5/d10/d4d/f60 [2828944,128184] 0 2024-09-17T07:20:05.045 INFO:tasks.workunit.client.1.smithi139.stdout:2/847: write d0/d7/d67/da1/d10d/d15/fbe [765725,120632] 0 2024-09-17T07:20:05.047 INFO:tasks.workunit.client.1.smithi139.stdout:4/663: creat d0/d1/d29/d6a/fd0 x:0 0 0 2024-09-17T07:20:05.047 INFO:tasks.workunit.client.1.smithi139.stdout:2/848: truncate d0/d3b/fa9 1764773 0 2024-09-17T07:20:05.048 INFO:tasks.workunit.client.1.smithi139.stdout:7/601: read d5/d17/d4e/d63/fb9 [3917894,19166] 0 2024-09-17T07:20:05.049 INFO:tasks.workunit.client.1.smithi139.stdout:2/849: chown d0/d7/d1a/l43 200 1 2024-09-17T07:20:05.049 INFO:tasks.workunit.client.1.smithi139.stdout:4/664: write d0/d1/d29/d41/fbb [224821,55781] 0 2024-09-17T07:20:05.050 INFO:tasks.workunit.client.1.smithi139.stdout:7/602: chown d5/d17/d4e/d90/l9a 10 1 2024-09-17T07:20:05.051 INFO:tasks.workunit.client.1.smithi139.stdout:4/665: chown d0/db/f4a 5724 1 2024-09-17T07:20:05.052 INFO:tasks.workunit.client.1.smithi139.stdout:7/603: chown d5/d17/d4e/faf 136409 1 2024-09-17T07:20:05.053 INFO:tasks.workunit.client.1.smithi139.stdout:4/666: read - d0/db/db2/fcf zero size 2024-09-17T07:20:05.054 INFO:tasks.workunit.client.1.smithi139.stdout:7/604: fdatasync d5/f43 0 2024-09-17T07:20:05.056 INFO:tasks.workunit.client.1.smithi139.stdout:2/850: creat d0/d4e/f11e x:0 0 0 2024-09-17T07:20:05.057 INFO:tasks.workunit.client.1.smithi139.stdout:2/851: write d0/f9b [6414950,32353] 0 2024-09-17T07:20:05.059 INFO:tasks.workunit.client.1.smithi139.stdout:7/605: rmdir d5/d96 39 2024-09-17T07:20:05.059 INFO:tasks.workunit.client.1.smithi139.stdout:2/852: chown d0/d7/d67/da1/d10d/d15/d9f/lda 13260458 1 2024-09-17T07:20:05.059 INFO:tasks.workunit.client.1.smithi139.stdout:7/606: chown d5/d10/d2b 6 1 2024-09-17T07:20:05.061 INFO:tasks.workunit.client.1.smithi139.stdout:2/853: write d0/d7/fdb [4049293,32015] 0 2024-09-17T07:20:05.062 INFO:tasks.workunit.client.0.smithi087.stdout:3/872: dwrite d6/d15/d37/f5b [0,4194304] 0 2024-09-17T07:20:05.063 INFO:tasks.workunit.client.1.smithi139.stdout:4/667: unlink d0/d37/l65 0 2024-09-17T07:20:05.065 INFO:tasks.workunit.client.1.smithi139.stdout:4/668: mknod d0/db/db2/db5/cd1 0 2024-09-17T07:20:05.066 INFO:tasks.workunit.client.1.smithi139.stdout:4/669: fdatasync d0/db/db2/fcf 0 2024-09-17T07:20:05.067 INFO:tasks.workunit.client.1.smithi139.stdout:7/607: rename d5/d17/d4e/d55/l5b to d5/d67/lc4 0 2024-09-17T07:20:05.070 INFO:tasks.workunit.client.1.smithi139.stdout:2/854: rename d0/d3b/f5d to d0/d7/d108/f11f 0 2024-09-17T07:20:05.071 INFO:tasks.workunit.client.1.smithi139.stdout:4/670: mknod d0/db/cd2 0 2024-09-17T07:20:05.075 INFO:tasks.workunit.client.1.smithi139.stdout:1/616: dread d2/d10/d12/d13/f82 [0,4194304] 0 2024-09-17T07:20:05.076 INFO:tasks.workunit.client.0.smithi087.stdout:2/768: creat d2/ff2 x:0 0 0 2024-09-17T07:20:05.077 INFO:tasks.workunit.client.1.smithi139.stdout:4/671: mkdir d0/db/d17/daf/dd3 0 2024-09-17T07:20:05.077 INFO:tasks.workunit.client.0.smithi087.stdout:7/728: mkdir d0/d3/d23/d4e/dda 0 2024-09-17T07:20:05.078 INFO:tasks.workunit.client.0.smithi087.stdout:1/840: chown d2/d3d/d35/l114 385129 1 2024-09-17T07:20:05.079 INFO:tasks.workunit.client.0.smithi087.stdout:3/873: creat d6/d10d/f13a x:0 0 0 2024-09-17T07:20:05.079 INFO:tasks.workunit.client.0.smithi087.stdout:7/729: rmdir d0/d3/d23 39 2024-09-17T07:20:05.081 INFO:tasks.workunit.client.1.smithi139.stdout:2/855: dwrite d0/d7/d67/da1/d10d/dc4/fee [0,4194304] 0 2024-09-17T07:20:05.081 INFO:tasks.workunit.client.1.smithi139.stdout:4/672: fsync d0/d1/d54/d93/da2/fa3 0 2024-09-17T07:20:05.082 INFO:tasks.workunit.client.0.smithi087.stdout:2/769: rename d2/d48/da2 to d2/d15/dce/dd1/d3f/df3 0 2024-09-17T07:20:05.082 INFO:tasks.workunit.client.0.smithi087.stdout:3/874: dread d6/d15/d37/d3c/d52/db2/d102/f117 [0,4194304] 0 2024-09-17T07:20:05.084 INFO:tasks.workunit.client.0.smithi087.stdout:7/730: rmdir d0/d36/d8e 39 2024-09-17T07:20:05.085 INFO:tasks.workunit.client.1.smithi139.stdout:2/856: mkdir d0/de/d25/d120 0 2024-09-17T07:20:05.086 INFO:tasks.workunit.client.1.smithi139.stdout:1/617: dwrite d2/d10/fb5 [0,4194304] 0 2024-09-17T07:20:05.086 INFO:tasks.workunit.client.1.smithi139.stdout:3/769: dwrite d5/d15/f62 [0,4194304] 0 2024-09-17T07:20:05.087 INFO:tasks.workunit.client.0.smithi087.stdout:3/875: mknod d6/d15/d37/d3c/d52/db2/c13b 0 2024-09-17T07:20:05.089 INFO:tasks.workunit.client.0.smithi087.stdout:7/731: rmdir d0/d3/d23/d17/d7b/dad/daf 39 2024-09-17T07:20:05.090 INFO:tasks.workunit.client.0.smithi087.stdout:7/732: chown d0/d3 55784 1 2024-09-17T07:20:05.090 INFO:tasks.workunit.client.0.smithi087.stdout:2/770: link d2/d12/c5c d2/d24/d36/cf4 0 2024-09-17T07:20:05.091 INFO:tasks.workunit.client.0.smithi087.stdout:3/876: symlink d6/d1b/d42/d62/l13c 0 2024-09-17T07:20:05.092 INFO:tasks.workunit.client.1.smithi139.stdout:2/857: write d0/d7/d86/da4/d28/dcf/fd1 [4951020,67089] 0 2024-09-17T07:20:05.093 INFO:tasks.workunit.client.1.smithi139.stdout:1/618: truncate d2/d10/d12/d7c/f93 110627 0 2024-09-17T07:20:05.094 INFO:tasks.workunit.client.0.smithi087.stdout:2/771: fdatasync d2/f8a 0 2024-09-17T07:20:05.096 INFO:tasks.workunit.client.0.smithi087.stdout:7/733: creat d0/d36/d8e/da2/fdb x:0 0 0 2024-09-17T07:20:05.098 INFO:tasks.workunit.client.1.smithi139.stdout:7/608: write d5/d17/d4e/d63/fc0 [540815,77216] 0 2024-09-17T07:20:05.098 INFO:tasks.workunit.client.1.smithi139.stdout:2/858: creat d0/df8/f121 x:0 0 0 2024-09-17T07:20:05.099 INFO:tasks.workunit.client.0.smithi087.stdout:2/772: symlink d2/d15/lf5 0 2024-09-17T07:20:05.101 INFO:tasks.workunit.client.1.smithi139.stdout:1/619: creat d2/d10/d12/d1a/db1/fbd x:0 0 0 2024-09-17T07:20:05.102 INFO:tasks.workunit.client.0.smithi087.stdout:7/734: rename d0/d3/d23/l12 to d0/d3/d23/d4e/ldc 0 2024-09-17T07:20:05.103 INFO:tasks.workunit.client.0.smithi087.stdout:2/773: symlink d2/d15/dce/dd1/d3f/lf6 0 2024-09-17T07:20:05.103 INFO:tasks.workunit.client.1.smithi139.stdout:7/609: creat d5/d17/d4e/d55/fc5 x:0 0 0 2024-09-17T07:20:05.104 INFO:tasks.workunit.client.0.smithi087.stdout:3/877: dread d6/d15/d37/d3c/d52/db2/de7/f36 [0,4194304] 0 2024-09-17T07:20:05.105 INFO:tasks.workunit.client.1.smithi139.stdout:2/859: creat d0/de/f122 x:0 0 0 2024-09-17T07:20:05.106 INFO:tasks.workunit.client.0.smithi087.stdout:2/774: rmdir d2/d7/dd/d10/d91 39 2024-09-17T07:20:05.109 INFO:tasks.workunit.client.1.smithi139.stdout:2/860: write d0/d7/d86/da4/d12/d8c/f109 [468033,119628] 0 2024-09-17T07:20:05.111 INFO:tasks.workunit.client.0.smithi087.stdout:7/735: dwrite d0/d3/d10/d32/d62/d76/f84 [0,4194304] 0 2024-09-17T07:20:05.112 INFO:tasks.workunit.client.1.smithi139.stdout:1/620: dwrite d2/d10/d12/d35/d2b/f9f [0,4194304] 0 2024-09-17T07:20:05.114 INFO:tasks.workunit.client.1.smithi139.stdout:7/610: dwrite d5/d17/d4e/d63/f6b [0,4194304] 0 2024-09-17T07:20:05.114 INFO:tasks.workunit.client.0.smithi087.stdout:7/736: write d0/d3/d10/d32/d62/d76/fac [1598056,69566] 0 2024-09-17T07:20:05.115 INFO:tasks.workunit.client.1.smithi139.stdout:2/861: creat d0/d4e/d76/f123 x:0 0 0 2024-09-17T07:20:05.116 INFO:tasks.workunit.client.1.smithi139.stdout:7/611: chown d5/d10/f2e 6 1 2024-09-17T07:20:05.118 INFO:tasks.workunit.client.1.smithi139.stdout:2/862: readlink d0/d7/d67/d92/d99/l38 0 2024-09-17T07:20:05.121 INFO:tasks.workunit.client.1.smithi139.stdout:2/863: creat d0/d7/d1a/d103/f124 x:0 0 0 2024-09-17T07:20:05.122 INFO:tasks.workunit.client.1.smithi139.stdout:2/864: chown d0/de/df/d56/c6f 70763 1 2024-09-17T07:20:05.127 INFO:tasks.workunit.client.1.smithi139.stdout:1/621: dread d2/f11 [0,4194304] 0 2024-09-17T07:20:05.128 INFO:tasks.workunit.client.1.smithi139.stdout:4/673: dread d0/d1/d29/d6d/f86 [4194304,4194304] 0 2024-09-17T07:20:05.128 INFO:tasks.workunit.client.1.smithi139.stdout:3/770: write d5/da7/dca/dab/dd6/d28/f52 [2419183,110248] 0 2024-09-17T07:20:05.128 INFO:tasks.workunit.client.1.smithi139.stdout:1/622: dread - d2/d10/d12/d1a/db1/fbd zero size 2024-09-17T07:20:05.128 INFO:tasks.workunit.client.0.smithi087.stdout:7/737: dwrite d0/d3/d10/f21 [0,4194304] 0 2024-09-17T07:20:05.131 INFO:tasks.workunit.client.1.smithi139.stdout:4/674: getdents d0/d1/d29/d6a/db6 0 2024-09-17T07:20:05.131 INFO:tasks.workunit.client.1.smithi139.stdout:3/771: mknod d5/d63/db3/ddb/cec 0 2024-09-17T07:20:05.132 INFO:tasks.workunit.client.0.smithi087.stdout:7/738: unlink d0/d36/f81 0 2024-09-17T07:20:05.133 INFO:tasks.workunit.client.1.smithi139.stdout:3/772: write d5/d21/d23/d38/f9d [1794477,121906] 0 2024-09-17T07:20:05.134 INFO:tasks.workunit.client.1.smithi139.stdout:1/623: rename d2/d10/d12/f2d to d2/d10/d12/d13/d4f/d5c/d74/fbe 0 2024-09-17T07:20:05.137 INFO:tasks.workunit.client.0.smithi087.stdout:7/739: creat d0/d36/d8e/fdd x:0 0 0 2024-09-17T07:20:05.139 INFO:tasks.workunit.client.1.smithi139.stdout:1/624: readlink d2/d10/d12/d35/d49/lb7 0 2024-09-17T07:20:05.139 INFO:tasks.workunit.client.1.smithi139.stdout:4/675: dwrite d0/db/d7f/f90 [0,4194304] 0 2024-09-17T07:20:05.140 INFO:tasks.workunit.client.0.smithi087.stdout:7/740: mknod d0/d36/d8e/cde 0 2024-09-17T07:20:05.142 INFO:tasks.workunit.client.0.smithi087.stdout:3/878: dread d6/f57 [0,4194304] 0 2024-09-17T07:20:05.143 INFO:tasks.workunit.client.1.smithi139.stdout:1/625: write d2/d10/d12/fa7 [1488755,13537] 0 2024-09-17T07:20:05.144 INFO:tasks.workunit.client.1.smithi139.stdout:4/676: mknod d0/d1/d54/d93/da2/cd4 0 2024-09-17T07:20:05.145 INFO:tasks.workunit.client.0.smithi087.stdout:3/879: creat d6/d1b/d42/d62/dbb/f13d x:0 0 0 2024-09-17T07:20:05.145 INFO:tasks.workunit.client.1.smithi139.stdout:3/773: dwrite d5/d15/d20/f42 [0,4194304] 0 2024-09-17T07:20:05.146 INFO:tasks.workunit.client.0.smithi087.stdout:2/775: dread d2/d15/f21 [0,4194304] 0 2024-09-17T07:20:05.147 INFO:tasks.workunit.client.0.smithi087.stdout:7/741: dwrite d0/d3/f40 [0,4194304] 0 2024-09-17T07:20:05.149 INFO:tasks.workunit.client.0.smithi087.stdout:7/742: chown d0/d3/d10/d31/dc1/cd4 32 1 2024-09-17T07:20:05.150 INFO:tasks.workunit.client.1.smithi139.stdout:4/677: mknod d0/db/d17/daf/cd5 0 2024-09-17T07:20:05.154 INFO:tasks.workunit.client.1.smithi139.stdout:1/626: mkdir d2/d10/d12/d24/d38/da4/dbf 0 2024-09-17T07:20:05.154 INFO:tasks.workunit.client.0.smithi087.stdout:7/743: rename d0/d3/d10/d32/l93 to d0/d36/d8e/ldf 0 2024-09-17T07:20:05.156 INFO:tasks.workunit.client.0.smithi087.stdout:3/880: dwrite d6/d1b/d42/d62/dbb/f13d [0,4194304] 0 2024-09-17T07:20:05.157 INFO:tasks.workunit.client.1.smithi139.stdout:6/778: sync 2024-09-17T07:20:05.157 INFO:tasks.workunit.client.1.smithi139.stdout:4/678: truncate d0/db/f74 1328021 0 2024-09-17T07:20:05.158 INFO:tasks.workunit.client.1.smithi139.stdout:4/679: fdatasync d0/d1/d29/d6a/fd0 0 2024-09-17T07:20:05.158 INFO:tasks.workunit.client.1.smithi139.stdout:3/774: link d5/d15/d20/d3b/ca2 d5/d15/ced 0 2024-09-17T07:20:05.160 INFO:tasks.workunit.client.1.smithi139.stdout:3/775: chown d5/d15/f51 1 1 2024-09-17T07:20:05.160 INFO:tasks.workunit.client.1.smithi139.stdout:1/627: write d2/f91 [667309,12665] 0 2024-09-17T07:20:05.161 INFO:tasks.workunit.client.0.smithi087.stdout:2/776: link d2/d7/dd/d10/d4c/ca1 d2/d7/dd/d10/d91/dea/cf7 0 2024-09-17T07:20:05.161 INFO:tasks.workunit.client.0.smithi087.stdout:7/744: read d0/d3/d23/d17/d7b/fd1 [1044071,97969] 0 2024-09-17T07:20:05.161 INFO:tasks.workunit.client.1.smithi139.stdout:6/779: fdatasync db/d18/f48 0 2024-09-17T07:20:05.163 INFO:tasks.workunit.client.1.smithi139.stdout:6/780: stat db/d18/c29 0 2024-09-17T07:20:05.163 INFO:tasks.workunit.client.1.smithi139.stdout:4/680: mknod d0/d1/dbe/d70/cd6 0 2024-09-17T07:20:05.164 INFO:tasks.workunit.client.1.smithi139.stdout:4/681: dread - d0/db/db2/db5/fc6 zero size 2024-09-17T07:20:05.164 INFO:tasks.workunit.client.0.smithi087.stdout:7/745: chown d0/d3/d23/d17/d7b/dad/d89/fa7 36461 1 2024-09-17T07:20:05.166 INFO:tasks.workunit.client.0.smithi087.stdout:3/881: dwrite d6/d1b/d42/dd4/f58 [0,4194304] 0 2024-09-17T07:20:05.166 INFO:tasks.workunit.client.1.smithi139.stdout:3/776: unlink d5/d15/d20/d3b/f4a 0 2024-09-17T07:20:05.167 INFO:tasks.workunit.client.0.smithi087.stdout:3/882: write d6/d1b/d42/d6e/db0/f127 [820519,19944] 0 2024-09-17T07:20:05.168 INFO:tasks.workunit.client.0.smithi087.stdout:7/746: rename d0/d36/c45 to d0/d3/d10/d32/d8c/ce0 0 2024-09-17T07:20:05.169 INFO:tasks.workunit.client.1.smithi139.stdout:7/612: truncate f2 6622855 0 2024-09-17T07:20:05.170 INFO:tasks.workunit.client.1.smithi139.stdout:2/865: truncate d0/de/f80 3571049 0 2024-09-17T07:20:05.177 INFO:tasks.workunit.client.1.smithi139.stdout:6/781: symlink db/df/daa/de3/d107/l10b 0 2024-09-17T07:20:05.178 INFO:tasks.workunit.client.1.smithi139.stdout:6/782: stat db/df/d4c/dbc 0 2024-09-17T07:20:05.180 INFO:tasks.workunit.client.1.smithi139.stdout:3/777: creat d5/da7/dca/dab/dd6/d28/d54/fee x:0 0 0 2024-09-17T07:20:05.185 INFO:tasks.workunit.client.1.smithi139.stdout:3/778: dwrite d5/da7/dca/dab/dd6/f9a [0,4194304] 0 2024-09-17T07:20:05.191 INFO:tasks.workunit.client.1.smithi139.stdout:3/779: dread d5/d21/d23/d69/f76 [0,4194304] 0 2024-09-17T07:20:05.196 INFO:tasks.workunit.client.1.smithi139.stdout:3/780: getdents d5/d63/d6d 0 2024-09-17T07:20:05.198 INFO:tasks.workunit.client.1.smithi139.stdout:3/781: mkdir d5/d63/d6d/d6f/d8b/def 0 2024-09-17T07:20:05.199 INFO:tasks.workunit.client.1.smithi139.stdout:1/628: dread d2/f91 [0,4194304] 0 2024-09-17T07:20:05.200 INFO:tasks.workunit.client.1.smithi139.stdout:1/629: stat d2/d10/d12/d1a/c48 0 2024-09-17T07:20:05.206 INFO:tasks.workunit.client.1.smithi139.stdout:4/682: truncate d0/d1/dbe/f1f 3791544 0 2024-09-17T07:20:05.207 INFO:tasks.workunit.client.1.smithi139.stdout:2/866: read d0/de/f80 [776106,2150] 0 2024-09-17T07:20:05.211 INFO:tasks.workunit.client.1.smithi139.stdout:5/811: sync 2024-09-17T07:20:05.211 INFO:tasks.workunit.client.1.smithi139.stdout:8/919: sync 2024-09-17T07:20:05.211 INFO:tasks.workunit.client.1.smithi139.stdout:0/526: sync 2024-09-17T07:20:05.211 INFO:tasks.workunit.client.1.smithi139.stdout:7/613: dwrite d5/f18 [4194304,4194304] 0 2024-09-17T07:20:05.213 INFO:tasks.workunit.client.1.smithi139.stdout:8/920: dread - d0/d1a/d82/f123 zero size 2024-09-17T07:20:05.215 INFO:tasks.workunit.client.1.smithi139.stdout:0/527: write d1/da/d17/d65/f85 [1372005,58727] 0 2024-09-17T07:20:05.215 INFO:tasks.workunit.client.1.smithi139.stdout:2/867: creat d0/d7/d1a/f125 x:0 0 0 2024-09-17T07:20:05.219 INFO:tasks.workunit.client.1.smithi139.stdout:6/783: dwrite db/df/d4e/f55 [0,4194304] 0 2024-09-17T07:20:05.219 INFO:tasks.workunit.client.1.smithi139.stdout:4/683: dread d0/d1/d29/d41/f5c [0,4194304] 0 2024-09-17T07:20:05.220 INFO:tasks.workunit.client.1.smithi139.stdout:6/784: stat db/df/d4e/d64/d54/l71 0 2024-09-17T07:20:05.221 INFO:tasks.workunit.client.1.smithi139.stdout:3/782: write d5/d15/d16/f9e [728729,41410] 0 2024-09-17T07:20:05.222 INFO:tasks.workunit.client.1.smithi139.stdout:1/630: truncate d2/d10/d12/d13/d4f/f95 72023 0 2024-09-17T07:20:05.223 INFO:tasks.workunit.client.1.smithi139.stdout:2/868: rmdir d0/d3b 39 2024-09-17T07:20:05.225 INFO:tasks.workunit.client.1.smithi139.stdout:2/869: chown d0/d7/d67/d92 0 1 2024-09-17T07:20:05.227 INFO:tasks.workunit.client.1.smithi139.stdout:4/684: unlink d0/db/d17/fa5 0 2024-09-17T07:20:05.228 INFO:tasks.workunit.client.1.smithi139.stdout:5/812: write d4/d16/d1b/d20/d32/d72/fae [1292165,43007] 0 2024-09-17T07:20:05.230 INFO:tasks.workunit.client.1.smithi139.stdout:6/785: dwrite db/f16 [0,4194304] 0 2024-09-17T07:20:05.234 INFO:tasks.workunit.client.1.smithi139.stdout:7/614: creat d5/d10/fc6 x:0 0 0 2024-09-17T07:20:05.236 INFO:tasks.workunit.client.0.smithi087.stdout:7/747: creat d0/d3/d23/d4e/dda/fe1 x:0 0 0 2024-09-17T07:20:05.237 INFO:tasks.workunit.client.1.smithi139.stdout:2/870: chown d0/de/d69/de1 3523 1 2024-09-17T07:20:05.237 INFO:tasks.workunit.client.1.smithi139.stdout:2/871: fsync d0/d7/d1a/f125 0 2024-09-17T07:20:05.238 INFO:tasks.workunit.client.1.smithi139.stdout:4/685: readlink d0/d1/d29/l2a 0 2024-09-17T07:20:05.239 INFO:tasks.workunit.client.0.smithi087.stdout:3/883: getdents d6/d15/d37/d3c 0 2024-09-17T07:20:05.239 INFO:tasks.workunit.client.1.smithi139.stdout:6/786: creat db/df/d73/d81/f10c x:0 0 0 2024-09-17T07:20:05.240 INFO:tasks.workunit.client.1.smithi139.stdout:6/787: stat ca 0 2024-09-17T07:20:05.240 INFO:tasks.workunit.client.0.smithi087.stdout:3/884: dread - d6/d7d/f113 zero size 2024-09-17T07:20:05.240 INFO:tasks.workunit.client.1.smithi139.stdout:5/813: mkdir d4/d16/d1b/d20/d32/d3d/d10d 0 2024-09-17T07:20:05.241 INFO:tasks.workunit.client.1.smithi139.stdout:1/631: creat d2/d10/db4/fc0 x:0 0 0 2024-09-17T07:20:05.241 INFO:tasks.workunit.client.1.smithi139.stdout:3/783: mkdir d5/d15/d16/df0 0 2024-09-17T07:20:05.242 INFO:tasks.workunit.client.1.smithi139.stdout:8/921: link d0/d1a/l33 d0/d20/d28/d52/d65/l12d 0 2024-09-17T07:20:05.242 INFO:tasks.workunit.client.0.smithi087.stdout:3/885: creat d6/d136/f13e x:0 0 0 2024-09-17T07:20:05.243 INFO:tasks.workunit.client.1.smithi139.stdout:7/615: mkdir d5/d10/d2b/d40/d47/dc7 0 2024-09-17T07:20:05.243 INFO:tasks.workunit.client.1.smithi139.stdout:8/922: dread - d0/d1a/ff3 zero size 2024-09-17T07:20:05.243 INFO:tasks.workunit.client.1.smithi139.stdout:0/528: link d1/da/d1b/d3d/cc3 d1/d58/cca 0 2024-09-17T07:20:05.244 INFO:tasks.workunit.client.0.smithi087.stdout:7/748: dwrite d0/d3/d10/d31/f43 [0,4194304] 0 2024-09-17T07:20:05.244 INFO:tasks.workunit.client.1.smithi139.stdout:2/872: chown d0/d7/l5e 15799 1 2024-09-17T07:20:05.245 INFO:tasks.workunit.client.1.smithi139.stdout:4/686: unlink d0/fce 0 2024-09-17T07:20:05.246 INFO:tasks.workunit.client.0.smithi087.stdout:3/886: creat d6/d1b/d42/dd4/d123/f13f x:0 0 0 2024-09-17T07:20:05.247 INFO:tasks.workunit.client.0.smithi087.stdout:3/887: fdatasync d6/d1b/d42/d6e/f132 0 2024-09-17T07:20:05.248 INFO:tasks.workunit.client.0.smithi087.stdout:7/749: rename d0/d3/d10/d31/c49 to d0/d3/d10/d32/ce2 0 2024-09-17T07:20:05.250 INFO:tasks.workunit.client.0.smithi087.stdout:3/888: mknod d6/d15/d37/d3c/d43/db7/de3/d108/c140 0 2024-09-17T07:20:05.251 INFO:tasks.workunit.client.1.smithi139.stdout:5/814: mknod d4/d16/d69/dbc/c10e 0 2024-09-17T07:20:05.251 INFO:tasks.workunit.client.0.smithi087.stdout:7/750: mknod d0/d3/d10/ce3 0 2024-09-17T07:20:05.253 INFO:tasks.workunit.client.1.smithi139.stdout:7/616: mkdir d5/d17/d4e/d66/dc8 0 2024-09-17T07:20:05.254 INFO:tasks.workunit.client.0.smithi087.stdout:7/751: symlink d0/d3/d23/le4 0 2024-09-17T07:20:05.255 INFO:tasks.workunit.client.1.smithi139.stdout:3/784: dwrite d5/da7/dca/dab/dd6/d28/d54/fee [0,4194304] 0 2024-09-17T07:20:05.255 INFO:tasks.workunit.client.0.smithi087.stdout:3/889: read d6/d15/d37/f55 [399091,107581] 0 2024-09-17T07:20:05.256 INFO:tasks.workunit.client.1.smithi139.stdout:2/873: rename d0/d7/d86/da4/d28 to d0/de/d69/de1/d126 0 2024-09-17T07:20:05.257 INFO:tasks.workunit.client.1.smithi139.stdout:2/874: truncate d0/de/d25/f100 91922 0 2024-09-17T07:20:05.257 INFO:tasks.workunit.client.0.smithi087.stdout:3/890: write d6/d1b/d42/d95/f11d [97247,9079] 0 2024-09-17T07:20:05.259 INFO:tasks.workunit.client.0.smithi087.stdout:7/752: dread d0/d3/d10/d32/d62/d76/fac [0,4194304] 0 2024-09-17T07:20:05.259 INFO:tasks.workunit.client.1.smithi139.stdout:2/875: write d0/d7/d67/da1/d10d/d15/d9f/dc1/fe9 [3263756,121562] 0 2024-09-17T07:20:05.261 INFO:tasks.workunit.client.1.smithi139.stdout:2/876: readlink d0/d7/d67/da1/d10d/d15/d9f/lda 0 2024-09-17T07:20:05.262 INFO:tasks.workunit.client.0.smithi087.stdout:3/891: read d6/d1b/d42/f93 [2175862,87117] 0 2024-09-17T07:20:05.263 INFO:tasks.workunit.client.0.smithi087.stdout:7/753: creat d0/d36/fe5 x:0 0 0 2024-09-17T07:20:05.263 INFO:tasks.workunit.client.1.smithi139.stdout:1/632: rmdir d2/d10/d12/d35/d49/d8d/d9b 0 2024-09-17T07:20:05.264 INFO:tasks.workunit.client.0.smithi087.stdout:7/754: chown d0/d3/d10/d87/d96/db2 6583 1 2024-09-17T07:20:05.264 INFO:tasks.workunit.client.1.smithi139.stdout:7/617: fsync d5/d17/f32 0 2024-09-17T07:20:05.265 INFO:tasks.workunit.client.0.smithi087.stdout:3/892: mkdir d6/d1b/d42/d62/dbb/dd7/dee/d141 0 2024-09-17T07:20:05.265 INFO:tasks.workunit.client.0.smithi087.stdout:7/755: write d0/d36/fe5 [896159,99508] 0 2024-09-17T07:20:05.266 INFO:tasks.workunit.client.1.smithi139.stdout:3/785: creat d5/d15/d20/ff1 x:0 0 0 2024-09-17T07:20:05.268 INFO:tasks.workunit.client.0.smithi087.stdout:3/893: mknod d6/d15/d37/d3c/d52/db2/de7/ddd/c142 0 2024-09-17T07:20:05.270 INFO:tasks.workunit.client.0.smithi087.stdout:3/894: mknod d6/d15/d37/d3c/d52/db2/de7/c143 0 2024-09-17T07:20:05.271 INFO:tasks.workunit.client.1.smithi139.stdout:5/815: mknod d4/d16/d1b/d20/d32/c10f 0 2024-09-17T07:20:05.273 INFO:tasks.workunit.client.1.smithi139.stdout:1/633: symlink d2/d10/d12/d35/d49/d8b/lc1 0 2024-09-17T07:20:05.277 INFO:tasks.workunit.client.1.smithi139.stdout:0/529: link d1/da/d1b/d3d/l99 d1/da/d1b/d3d/d5a/lcb 0 2024-09-17T07:20:05.278 INFO:tasks.workunit.client.1.smithi139.stdout:6/788: write db/df/d73/f97 [931043,118829] 0 2024-09-17T07:20:05.278 INFO:tasks.workunit.client.0.smithi087.stdout:7/756: dread d0/f3b [4194304,4194304] 0 2024-09-17T07:20:05.279 INFO:tasks.workunit.client.1.smithi139.stdout:8/923: dread d0/d1a/d3a/fb1 [0,4194304] 0 2024-09-17T07:20:05.279 INFO:tasks.workunit.client.0.smithi087.stdout:7/757: chown d0/d3/d23/d17/f47 6508 1 2024-09-17T07:20:05.280 INFO:tasks.workunit.client.1.smithi139.stdout:0/530: stat d1/da/d17/d65/f85 0 2024-09-17T07:20:05.282 INFO:tasks.workunit.client.0.smithi087.stdout:7/758: read - d0/d3/d23/d17/d7b/dad/d89/f98 zero size 2024-09-17T07:20:05.282 INFO:tasks.workunit.client.1.smithi139.stdout:1/634: dwrite d2/d10/d12/d35/d49/f80 [0,4194304] 0 2024-09-17T07:20:05.282 INFO:tasks.workunit.client.1.smithi139.stdout:3/786: symlink d5/lf2 0 2024-09-17T07:20:05.282 INFO:tasks.workunit.client.1.smithi139.stdout:0/531: write d1/da/d17/f34 [4302034,40576] 0 2024-09-17T07:20:05.285 INFO:tasks.workunit.client.0.smithi087.stdout:3/895: dwrite d6/d1b/d42/d62/f6a [0,4194304] 0 2024-09-17T07:20:05.285 INFO:tasks.workunit.client.1.smithi139.stdout:5/816: rename d4/d16/d1b/d20/d38/d4f/l50 to d4/d16/d1b/d20/d28/d3f/dcc/df1/d10c/l110 0 2024-09-17T07:20:05.286 INFO:tasks.workunit.client.1.smithi139.stdout:2/877: rmdir d0/de/d69/dfa 0 2024-09-17T07:20:05.288 INFO:tasks.workunit.client.1.smithi139.stdout:6/789: creat db/d21/f10d x:0 0 0 2024-09-17T07:20:05.289 INFO:tasks.workunit.client.0.smithi087.stdout:3/896: link d6/d15/d37/d3c/fa2 d6/d10d/f144 0 2024-09-17T07:20:05.290 INFO:tasks.workunit.client.0.smithi087.stdout:3/897: symlink d6/d1b/d42/d62/dbb/ded/l145 0 2024-09-17T07:20:05.292 INFO:tasks.workunit.client.0.smithi087.stdout:3/898: dread d6/d15/d37/d3c/ff5 [0,4194304] 0 2024-09-17T07:20:05.293 INFO:tasks.workunit.client.1.smithi139.stdout:0/532: creat d1/da/d1b/dba/dc5/fcc x:0 0 0 2024-09-17T07:20:05.294 INFO:tasks.workunit.client.1.smithi139.stdout:1/635: mkdir d2/d10/d12/d24/d38/da4/dc2 0 2024-09-17T07:20:05.294 INFO:tasks.workunit.client.0.smithi087.stdout:3/899: creat d6/d136/f146 x:0 0 0 2024-09-17T07:20:05.295 INFO:tasks.workunit.client.1.smithi139.stdout:3/787: creat d5/da7/dca/dd7/ff3 x:0 0 0 2024-09-17T07:20:05.296 INFO:tasks.workunit.client.0.smithi087.stdout:3/900: fdatasync d6/d1b/d42/d62/dc1/de8/f39 0 2024-09-17T07:20:05.298 INFO:tasks.workunit.client.1.smithi139.stdout:7/618: getdents d5/d10/d4d 0 2024-09-17T07:20:05.299 INFO:tasks.workunit.client.0.smithi087.stdout:3/901: truncate d6/d15/d37/d3c/d52/db2/d10a/d11b/d120/fcd 380386 0 2024-09-17T07:20:05.301 INFO:tasks.workunit.client.1.smithi139.stdout:1/636: creat d2/d10/d12/d1a/d61/fc3 x:0 0 0 2024-09-17T07:20:05.303 INFO:tasks.workunit.client.1.smithi139.stdout:1/637: read d2/d10/d12/d1a/f96 [652188,121597] 0 2024-09-17T07:20:05.305 INFO:tasks.workunit.client.1.smithi139.stdout:7/619: truncate d5/d10/d2b/d40/f4a 3929795 0 2024-09-17T07:20:05.307 INFO:tasks.workunit.client.1.smithi139.stdout:3/788: link d5/d63/d6d/d6f/fb8 d5/d21/d23/d69/dd5/ff4 0 2024-09-17T07:20:05.310 INFO:tasks.workunit.client.1.smithi139.stdout:1/638: write d2/d10/d12/d13/f82 [474945,72224] 0 2024-09-17T07:20:05.310 INFO:tasks.workunit.client.0.smithi087.stdout:3/902: dwrite d6/d15/d37/d3c/f54 [0,4194304] 0 2024-09-17T07:20:05.311 INFO:tasks.workunit.client.0.smithi087.stdout:3/903: write d6/d1b/d42/d62/dbb/dd7/fda [1580017,10716] 0 2024-09-17T07:20:05.312 INFO:tasks.workunit.client.1.smithi139.stdout:0/533: write d1/da/d17/d72/d66/f89 [259119,38829] 0 2024-09-17T07:20:05.314 INFO:tasks.workunit.client.0.smithi087.stdout:3/904: symlink d6/d15/d37/d3c/l147 0 2024-09-17T07:20:05.314 INFO:tasks.workunit.client.1.smithi139.stdout:6/790: write db/df/d73/fdc [56943,83514] 0 2024-09-17T07:20:05.315 INFO:tasks.workunit.client.1.smithi139.stdout:7/620: dwrite d5/d17/d4e/d63/fc0 [0,4194304] 0 2024-09-17T07:20:05.315 INFO:tasks.workunit.client.0.smithi087.stdout:3/905: symlink d6/d15/d37/d3c/d52/db2/d10a/l148 0 2024-09-17T07:20:05.316 INFO:tasks.workunit.client.0.smithi087.stdout:3/906: readlink d6/d1b/d42/d95/db3/lcc 0 2024-09-17T07:20:05.317 INFO:tasks.workunit.client.0.smithi087.stdout:8/882: sync 2024-09-17T07:20:05.318 INFO:tasks.workunit.client.0.smithi087.stdout:8/883: chown d1/d7/d63/dd9/fe4 0 1 2024-09-17T07:20:05.318 INFO:tasks.workunit.client.0.smithi087.stdout:3/907: unlink d6/d15/d37/d3c/d52/ld5 0 2024-09-17T07:20:05.320 INFO:tasks.workunit.client.0.smithi087.stdout:8/884: creat d1/d5f/d120/f136 x:0 0 0 2024-09-17T07:20:05.323 INFO:tasks.workunit.client.1.smithi139.stdout:0/534: write d1/da/d1b/d3d/d5a/fb9 [5014507,103249] 0 2024-09-17T07:20:05.323 INFO:tasks.workunit.client.1.smithi139.stdout:7/621: unlink d5/d17/l36 0 2024-09-17T07:20:05.324 INFO:tasks.workunit.client.0.smithi087.stdout:3/908: rename d6/d1b/d42/d62/dbb/dd7/dee/f12c to d6/d1b/d42/d62/dbb/ded/f149 0 2024-09-17T07:20:05.324 INFO:tasks.workunit.client.1.smithi139.stdout:3/789: dwrite d5/d21/dba/fea [0,4194304] 0 2024-09-17T07:20:05.327 INFO:tasks.workunit.client.0.smithi087.stdout:3/909: truncate d6/d15/d37/d3c/d52/db2/de7/ddd/f122 518307 0 2024-09-17T07:20:05.327 INFO:tasks.workunit.client.1.smithi139.stdout:1/639: rename d2/d10/d12/d13/d4f/l63 to d2/d10/d12/d24/d38/da6/lc4 0 2024-09-17T07:20:05.327 INFO:tasks.workunit.client.0.smithi087.stdout:8/885: read d1/d2b/f41 [3247982,75782] 0 2024-09-17T07:20:05.329 INFO:tasks.workunit.client.0.smithi087.stdout:3/910: truncate d6/d1b/d42/dd4/dd1/de4/ff7 1198860 0 2024-09-17T07:20:05.329 INFO:tasks.workunit.client.1.smithi139.stdout:6/791: mkdir db/db7/ddb/d103/d10e 0 2024-09-17T07:20:05.330 INFO:tasks.workunit.client.0.smithi087.stdout:8/886: creat d1/d5f/f137 x:0 0 0 2024-09-17T07:20:05.330 INFO:tasks.workunit.client.1.smithi139.stdout:5/817: dwrite d4/d16/d1b/d20/d28/f1f [4194304,4194304] 0 2024-09-17T07:20:05.331 INFO:tasks.workunit.client.0.smithi087.stdout:3/911: write d6/d1b/d42/d95/db3/f10b [478986,63190] 0 2024-09-17T07:20:05.332 INFO:tasks.workunit.client.1.smithi139.stdout:0/535: symlink d1/da/d1b/dba/dc5/lcd 0 2024-09-17T07:20:05.333 INFO:tasks.workunit.client.0.smithi087.stdout:3/912: creat d6/d136/f14a x:0 0 0 2024-09-17T07:20:05.340 INFO:tasks.workunit.client.1.smithi139.stdout:0/536: fsync d1/da/d1b/f27 0 2024-09-17T07:20:05.340 INFO:tasks.workunit.client.1.smithi139.stdout:6/792: creat db/df/d4e/f10f x:0 0 0 2024-09-17T07:20:05.340 INFO:tasks.workunit.client.1.smithi139.stdout:5/818: write d4/d16/d1b/d20/d28/f2a [5112647,97300] 0 2024-09-17T07:20:05.343 INFO:tasks.workunit.client.1.smithi139.stdout:7/622: dwrite d5/d10/d2b/fb4 [0,4194304] 0 2024-09-17T07:20:05.343 INFO:tasks.workunit.client.1.smithi139.stdout:1/640: creat d2/d10/d12/d35/d2b/fc5 x:0 0 0 2024-09-17T07:20:05.345 INFO:tasks.workunit.client.1.smithi139.stdout:3/790: dwrite d5/da7/dca/dd7/fdc [0,4194304] 0 2024-09-17T07:20:05.346 INFO:tasks.workunit.client.1.smithi139.stdout:6/793: rmdir db/db7/ddb/d103 39 2024-09-17T07:20:05.350 INFO:tasks.workunit.client.1.smithi139.stdout:0/537: dread d1/da/d17/d72/d66/f89 [0,4194304] 0 2024-09-17T07:20:05.350 INFO:tasks.workunit.client.1.smithi139.stdout:1/641: read d2/d10/d12/d35/d49/f7b [2455287,12995] 0 2024-09-17T07:20:05.351 INFO:tasks.workunit.client.1.smithi139.stdout:7/623: readlink d5/d10/lbf 0 2024-09-17T07:20:05.351 INFO:tasks.workunit.client.1.smithi139.stdout:3/791: symlink d5/da7/lf5 0 2024-09-17T07:20:05.352 INFO:tasks.workunit.client.1.smithi139.stdout:1/642: fdatasync d2/d10/d12/d24/f4e 0 2024-09-17T07:20:05.356 INFO:tasks.workunit.client.1.smithi139.stdout:5/819: rename d4/d16/d1b/d20/faa to d4/d16/d1b/d20/d32/d6c/dc9/f111 0 2024-09-17T07:20:05.358 INFO:tasks.workunit.client.1.smithi139.stdout:3/792: creat d5/d15/d20/d3b/dc1/ff6 x:0 0 0 2024-09-17T07:20:05.361 INFO:tasks.workunit.client.1.smithi139.stdout:1/643: read d2/d10/d12/d35/d49/d8b/fa8 [126428,94873] 0 2024-09-17T07:20:05.362 INFO:tasks.workunit.client.1.smithi139.stdout:0/538: dwrite d1/da/d17/f9f [0,4194304] 0 2024-09-17T07:20:05.362 INFO:tasks.workunit.client.1.smithi139.stdout:7/624: dread d5/d17/d4e/d63/fc0 [0,4194304] 0 2024-09-17T07:20:05.363 INFO:tasks.workunit.client.0.smithi087.stdout:3/913: dread d6/d15/f60 [0,4194304] 0 2024-09-17T07:20:05.364 INFO:tasks.workunit.client.1.smithi139.stdout:7/625: fdatasync d5/d10/fc6 0 2024-09-17T07:20:05.366 INFO:tasks.workunit.client.0.smithi087.stdout:8/887: dwrite d1/d2b/ff7 [0,4194304] 0 2024-09-17T07:20:05.367 INFO:tasks.workunit.client.1.smithi139.stdout:0/539: dread d1/da/d17/f34 [4194304,4194304] 0 2024-09-17T07:20:05.372 INFO:tasks.workunit.client.1.smithi139.stdout:3/793: dwrite d5/d15/d20/d83/f94 [0,4194304] 0 2024-09-17T07:20:05.373 INFO:tasks.workunit.client.1.smithi139.stdout:6/794: rename db/df/d4c/fad to db/df/d4e/d64/d83/f110 0 2024-09-17T07:20:05.374 INFO:tasks.workunit.client.0.smithi087.stdout:8/888: dwrite d1/d7/d9/d19/d4d/d11f/da1/f10c [0,4194304] 0 2024-09-17T07:20:05.375 INFO:tasks.workunit.client.1.smithi139.stdout:6/795: chown db/df/d4e/d5e/de5 88244023 1 2024-09-17T07:20:05.377 INFO:tasks.workunit.client.1.smithi139.stdout:0/540: stat d1/l8 0 2024-09-17T07:20:05.378 INFO:tasks.workunit.client.0.smithi087.stdout:8/889: rename d1/d7/le to d1/d2b/d21/d68/l138 0 2024-09-17T07:20:05.378 INFO:tasks.workunit.client.1.smithi139.stdout:3/794: mknod d5/da7/dca/dab/dd6/d28/db5/cf7 0 2024-09-17T07:20:05.379 INFO:tasks.workunit.client.1.smithi139.stdout:3/795: write d5/d21/d23/d69/dd5/fda [559579,35465] 0 2024-09-17T07:20:05.380 INFO:tasks.workunit.client.0.smithi087.stdout:8/890: write d1/d7/f2d [4644970,127405] 0 2024-09-17T07:20:05.380 INFO:tasks.workunit.client.1.smithi139.stdout:7/626: rename d5/d10/d2b/f44 to d5/d10/d4d/fc9 0 2024-09-17T07:20:05.382 INFO:tasks.workunit.client.1.smithi139.stdout:0/541: creat d1/da/d17/db8/fce x:0 0 0 2024-09-17T07:20:05.383 INFO:tasks.workunit.client.1.smithi139.stdout:6/796: rename db/df/d4e/d64/c6a to db/d21/c111 0 2024-09-17T07:20:05.385 INFO:tasks.workunit.client.0.smithi087.stdout:8/891: symlink d1/d7/l139 0 2024-09-17T07:20:05.387 INFO:tasks.workunit.client.1.smithi139.stdout:7/627: symlink d5/d10/lca 0 2024-09-17T07:20:05.388 INFO:tasks.workunit.client.0.smithi087.stdout:8/892: creat d1/d2b/df4/d54/f13a x:0 0 0 2024-09-17T07:20:05.391 INFO:tasks.workunit.client.1.smithi139.stdout:1/644: dread d2/d10/d12/d35/d49/d8b/fa8 [0,4194304] 0 2024-09-17T07:20:05.392 INFO:tasks.workunit.client.0.smithi087.stdout:3/914: mkdir d6/d1b/d42/d14b 0 2024-09-17T07:20:05.392 INFO:tasks.workunit.client.0.smithi087.stdout:8/893: truncate d1/d7/d63/f84 767184 0 2024-09-17T07:20:05.395 INFO:tasks.workunit.client.1.smithi139.stdout:1/645: rename d2/d10/d12/d13 to d2/d10/d12/d13/d4f/d5c/d74/dc6 22 2024-09-17T07:20:05.396 INFO:tasks.workunit.client.1.smithi139.stdout:7/628: dwrite d5/d67/f82 [0,4194304] 0 2024-09-17T07:20:05.396 INFO:tasks.workunit.client.0.smithi087.stdout:8/894: rename d1/d7/d9/d19/d4d/d11f/da1/d117/f12a to d1/d7/d63/f13b 0 2024-09-17T07:20:05.396 INFO:tasks.workunit.client.1.smithi139.stdout:0/542: dread d1/da/d1b/d32/d9a/f9d [0,4194304] 0 2024-09-17T07:20:05.398 INFO:tasks.workunit.client.0.smithi087.stdout:3/915: dread d6/d15/d37/d3c/d52/db2/d102/f117 [0,4194304] 0 2024-09-17T07:20:05.398 INFO:tasks.workunit.client.1.smithi139.stdout:1/646: stat d2/d10/d12/d35/d2b/d4a/d6f/c84 0 2024-09-17T07:20:05.398 INFO:tasks.workunit.client.1.smithi139.stdout:3/796: mkdir d5/da7/dca/dab/dd6/d28/d54/d58/dd4/df8 0 2024-09-17T07:20:05.398 INFO:tasks.workunit.client.0.smithi087.stdout:8/895: mkdir d1/d2b/df4/d54/dbb/d124/d13c 0 2024-09-17T07:20:05.399 INFO:tasks.workunit.client.0.smithi087.stdout:8/896: chown d1/d2b/f29 744641 1 2024-09-17T07:20:05.399 INFO:tasks.workunit.client.0.smithi087.stdout:3/916: write d6/d15/d37/d3c/d52/db2/d10a/d11b/d120/ff1 [1118807,65279] 0 2024-09-17T07:20:05.404 INFO:tasks.workunit.client.0.smithi087.stdout:8/897: mkdir d1/d7/d9/d19/d73/d13d 0 2024-09-17T07:20:05.404 INFO:tasks.workunit.client.0.smithi087.stdout:3/917: truncate d6/d1b/d42/d6e/fa8 182475 0 2024-09-17T07:20:05.405 INFO:tasks.workunit.client.0.smithi087.stdout:8/898: mknod d1/d2b/df4/d54/dbb/d124/c13e 0 2024-09-17T07:20:05.406 INFO:tasks.workunit.client.0.smithi087.stdout:3/918: creat d6/d15/d37/d3c/d52/f14c x:0 0 0 2024-09-17T07:20:05.407 INFO:tasks.workunit.client.1.smithi139.stdout:1/647: rename d2/d10/d12/d24/d38/da4 to d2/d10/d12/d1a/db1/dc7 0 2024-09-17T07:20:05.408 INFO:tasks.workunit.client.1.smithi139.stdout:7/629: creat d5/d10/d2b/fcb x:0 0 0 2024-09-17T07:20:05.409 INFO:tasks.workunit.client.1.smithi139.stdout:5/820: dwrite d4/d16/f22 [0,4194304] 0 2024-09-17T07:20:05.410 INFO:tasks.workunit.client.0.smithi087.stdout:3/919: getdents d6/d10d 0 2024-09-17T07:20:05.411 INFO:tasks.workunit.client.1.smithi139.stdout:0/543: dwrite d1/da/f78 [0,4194304] 0 2024-09-17T07:20:05.411 INFO:tasks.workunit.client.1.smithi139.stdout:3/797: creat d5/da7/dca/dab/dd6/ff9 x:0 0 0 2024-09-17T07:20:05.412 INFO:tasks.workunit.client.0.smithi087.stdout:3/920: mkdir d6/d1b/d42/d62/dbb/dd7/dee/d141/d14d 0 2024-09-17T07:20:05.414 INFO:tasks.workunit.client.1.smithi139.stdout:1/648: creat d2/d10/d12/d1a/fc8 x:0 0 0 2024-09-17T07:20:05.414 INFO:tasks.workunit.client.1.smithi139.stdout:7/630: fdatasync d5/d17/d4e/d63/f6b 0 2024-09-17T07:20:05.416 INFO:tasks.workunit.client.1.smithi139.stdout:6/797: write db/df/d4e/d64/f4d [217817,110858] 0 2024-09-17T07:20:05.418 INFO:tasks.workunit.client.1.smithi139.stdout:5/821: creat d4/d16/d1b/d20/d32/d3d/f112 x:0 0 0 2024-09-17T07:20:05.418 INFO:tasks.workunit.client.1.smithi139.stdout:0/544: rmdir d1/da/d17 39 2024-09-17T07:20:05.419 INFO:tasks.workunit.client.1.smithi139.stdout:0/545: fsync d1/da/fc 0 2024-09-17T07:20:05.420 INFO:tasks.workunit.client.1.smithi139.stdout:1/649: symlink d2/d10/d12/d24/lc9 0 2024-09-17T07:20:05.421 INFO:tasks.workunit.client.1.smithi139.stdout:5/822: mknod d4/d16/d1b/d20/d38/d4f/c113 0 2024-09-17T07:20:05.422 INFO:tasks.workunit.client.1.smithi139.stdout:3/798: symlink d5/d63/d6d/d6f/d8b/def/lfa 0 2024-09-17T07:20:05.423 INFO:tasks.workunit.client.1.smithi139.stdout:5/823: readlink d4/d16/d1b/d20/d32/d6c/dc9/l109 0 2024-09-17T07:20:05.424 INFO:tasks.workunit.client.1.smithi139.stdout:7/631: read f2 [4619608,41907] 0 2024-09-17T07:20:05.426 INFO:tasks.workunit.client.1.smithi139.stdout:1/650: mkdir d2/d10/d12/d13/dca 0 2024-09-17T07:20:05.427 INFO:tasks.workunit.client.1.smithi139.stdout:3/799: mknod d5/d63/d6d/da0/cfb 0 2024-09-17T07:20:05.429 INFO:tasks.workunit.client.0.smithi087.stdout:3/921: dwrite d6/d1b/d42/d62/dbb/fc2 [0,4194304] 0 2024-09-17T07:20:05.430 INFO:tasks.workunit.client.1.smithi139.stdout:0/546: dwrite d1/da/d1b/d32/d81/faf [0,4194304] 0 2024-09-17T07:20:05.431 INFO:tasks.workunit.client.1.smithi139.stdout:0/547: read d1/da/d1b/d3d/f64 [3670928,120385] 0 2024-09-17T07:20:05.433 INFO:tasks.workunit.client.0.smithi087.stdout:3/922: link d6/d15/d37/f5b d6/d15/d37/d3c/d52/db2/d10a/d11b/f14e 0 2024-09-17T07:20:05.434 INFO:tasks.workunit.client.1.smithi139.stdout:0/548: truncate d1/da/d1b/d32/f7a 1778577 0 2024-09-17T07:20:05.435 INFO:tasks.workunit.client.1.smithi139.stdout:1/651: creat d2/d10/d12/d13/fcb x:0 0 0 2024-09-17T07:20:05.435 INFO:tasks.workunit.client.1.smithi139.stdout:7/632: mknod d5/ccc 0 2024-09-17T07:20:05.436 INFO:tasks.workunit.client.1.smithi139.stdout:1/652: chown d2/d10/d12/d1a/db1/dc7 2985955 1 2024-09-17T07:20:05.439 INFO:tasks.workunit.client.1.smithi139.stdout:5/824: symlink d4/d16/d1b/d20/d32/d3d/d10d/l114 0 2024-09-17T07:20:05.440 INFO:tasks.workunit.client.1.smithi139.stdout:7/633: chown d5/d10/d2b/d40/d47/c51 1982 1 2024-09-17T07:20:05.440 INFO:tasks.workunit.client.0.smithi087.stdout:3/923: dwrite d6/d15/d37/d3c/d52/db2/d10a/d11b/f130 [0,4194304] 0 2024-09-17T07:20:05.441 INFO:tasks.workunit.client.0.smithi087.stdout:3/924: dread - d6/d1b/d42/d6e/db0/f126 zero size 2024-09-17T07:20:05.442 INFO:tasks.workunit.client.0.smithi087.stdout:3/925: chown d6/d15/d92/fc8 13701 1 2024-09-17T07:20:05.444 INFO:tasks.workunit.client.0.smithi087.stdout:3/926: chown d6/d15/d37/d3c/d52/db2/d10a/d11b/f130 22543 1 2024-09-17T07:20:05.445 INFO:tasks.workunit.client.1.smithi139.stdout:1/653: rename d2/d10/d12/d35/d49/f81 to d2/d10/d12/d7c/fcc 0 2024-09-17T07:20:05.446 INFO:tasks.workunit.client.1.smithi139.stdout:7/634: truncate d5/d17/f91 5091924 0 2024-09-17T07:20:05.447 INFO:tasks.workunit.client.0.smithi087.stdout:3/927: rmdir d6/d136 39 2024-09-17T07:20:05.448 INFO:tasks.workunit.client.1.smithi139.stdout:1/654: write d2/d10/d12/d24/f57 [1158789,14506] 0 2024-09-17T07:20:05.448 INFO:tasks.workunit.client.0.smithi087.stdout:3/928: symlink d6/d1b/d42/dd4/dd1/l14f 0 2024-09-17T07:20:05.450 INFO:tasks.workunit.client.0.smithi087.stdout:3/929: mknod d6/d15/d92/c150 0 2024-09-17T07:20:05.451 INFO:tasks.workunit.client.1.smithi139.stdout:0/549: creat d1/da/d17/d72/d66/fcf x:0 0 0 2024-09-17T07:20:05.451 INFO:tasks.workunit.client.0.smithi087.stdout:3/930: dread - d6/d1b/d42/d62/dbb/fbf zero size 2024-09-17T07:20:05.452 INFO:tasks.workunit.client.1.smithi139.stdout:0/550: stat d1/da/d17/f9f 0 2024-09-17T07:20:05.453 INFO:tasks.workunit.client.1.smithi139.stdout:1/655: truncate d2/d10/d12/d1a/f53 1168976 0 2024-09-17T07:20:05.453 INFO:tasks.workunit.client.0.smithi087.stdout:3/931: chown d6/d1b/d42/d6e/lc0 88418122 1 2024-09-17T07:20:05.454 INFO:tasks.workunit.client.1.smithi139.stdout:5/825: getdents d4/d16/d1b/d20/d28/d61 0 2024-09-17T07:20:05.454 INFO:tasks.workunit.client.0.smithi087.stdout:3/932: truncate d6/d1b/d42/d62/faa 849691 0 2024-09-17T07:20:05.455 INFO:tasks.workunit.client.1.smithi139.stdout:7/635: dread d5/d17/d4e/d63/fc0 [0,4194304] 0 2024-09-17T07:20:05.456 INFO:tasks.workunit.client.0.smithi087.stdout:3/933: fdatasync d6/d15/f60 0 2024-09-17T07:20:05.456 INFO:tasks.workunit.client.1.smithi139.stdout:6/798: dread db/d18/f44 [0,4194304] 0 2024-09-17T07:20:05.458 INFO:tasks.workunit.client.0.smithi087.stdout:3/934: fsync d6/d15/d37/d3c/d52/db2/d10a/d11b/d120/ff1 0 2024-09-17T07:20:05.458 INFO:tasks.workunit.client.1.smithi139.stdout:7/636: fsync d5/d10/d4d/d59/fa6 0 2024-09-17T07:20:05.458 INFO:tasks.workunit.client.1.smithi139.stdout:0/551: truncate d1/da/d2a/f62 57165 0 2024-09-17T07:20:05.458 INFO:tasks.workunit.client.1.smithi139.stdout:5/826: creat d4/d16/d1b/f115 x:0 0 0 2024-09-17T07:20:05.459 INFO:tasks.workunit.client.0.smithi087.stdout:3/935: dread - d6/d1b/d42/d62/f100 zero size 2024-09-17T07:20:05.459 INFO:tasks.workunit.client.1.smithi139.stdout:6/799: dread - db/df/d73/dc1/f108 zero size 2024-09-17T07:20:05.460 INFO:tasks.workunit.client.0.smithi087.stdout:3/936: rmdir d6/d1b/d42/d62/dc1/de8 39 2024-09-17T07:20:05.461 INFO:tasks.workunit.client.1.smithi139.stdout:0/552: write d1/da/d1b/d32/d9a/fb3 [990302,15186] 0 2024-09-17T07:20:05.462 INFO:tasks.workunit.client.0.smithi087.stdout:3/937: dread d6/d15/f19 [0,4194304] 0 2024-09-17T07:20:05.462 INFO:tasks.workunit.client.1.smithi139.stdout:5/827: write d4/d16/d1b/d20/d28/f1f [7945213,39142] 0 2024-09-17T07:20:05.462 INFO:tasks.workunit.client.1.smithi139.stdout:1/656: dread d2/d10/d12/d35/d2b/f34 [4194304,4194304] 0 2024-09-17T07:20:05.463 INFO:tasks.workunit.client.1.smithi139.stdout:6/800: rmdir db/d18/d38 39 2024-09-17T07:20:05.466 INFO:tasks.workunit.client.1.smithi139.stdout:7/637: unlink d5/d17/d4e/d7a/l97 0 2024-09-17T07:20:05.467 INFO:tasks.workunit.client.1.smithi139.stdout:7/638: readlink d5/d10/l80 0 2024-09-17T07:20:05.467 INFO:tasks.workunit.client.0.smithi087.stdout:3/938: rmdir d6/d1b 39 2024-09-17T07:20:05.468 INFO:tasks.workunit.client.1.smithi139.stdout:5/828: mknod d4/d16/d69/dbc/c116 0 2024-09-17T07:20:05.469 INFO:tasks.workunit.client.1.smithi139.stdout:1/657: symlink d2/d10/d12/d35/d49/d8d/lcd 0 2024-09-17T07:20:05.470 INFO:tasks.workunit.client.1.smithi139.stdout:7/639: read d5/d10/f42 [1115479,83005] 0 2024-09-17T07:20:05.471 INFO:tasks.workunit.client.1.smithi139.stdout:6/801: mkdir db/df/d4e/d5e/deb/d112 0 2024-09-17T07:20:05.471 INFO:tasks.workunit.client.0.smithi087.stdout:3/939: write d6/d15/d37/d3c/f74 [664700,108670] 0 2024-09-17T07:20:05.473 INFO:tasks.workunit.client.0.smithi087.stdout:3/940: chown d6/d136/f13e 107216510 1 2024-09-17T07:20:05.474 INFO:tasks.workunit.client.1.smithi139.stdout:3/800: dread d5/d15/d16/f17 [0,4194304] 0 2024-09-17T07:20:05.474 INFO:tasks.workunit.client.1.smithi139.stdout:0/553: dwrite d1/da/d17/f9f [0,4194304] 0 2024-09-17T07:20:05.474 INFO:tasks.workunit.client.0.smithi087.stdout:6/952: sync 2024-09-17T07:20:05.475 INFO:tasks.workunit.client.0.smithi087.stdout:3/941: mkdir d6/d1b/d42/dd4/d123/d151 0 2024-09-17T07:20:05.475 INFO:tasks.workunit.client.1.smithi139.stdout:6/802: truncate db/df/f9c 4583026 0 2024-09-17T07:20:05.478 INFO:tasks.workunit.client.1.smithi139.stdout:1/658: mkdir d2/d10/dce 0 2024-09-17T07:20:05.478 INFO:tasks.workunit.client.1.smithi139.stdout:0/554: write d1/f26 [2483791,117196] 0 2024-09-17T07:20:05.478 INFO:tasks.workunit.client.1.smithi139.stdout:7/640: symlink d5/d10/lcd 0 2024-09-17T07:20:05.478 INFO:tasks.workunit.client.1.smithi139.stdout:3/801: chown d5/da7/dca/dab/dd6/f9a 21876 1 2024-09-17T07:20:05.480 INFO:tasks.workunit.client.1.smithi139.stdout:0/555: stat d1/da/d17/l52 0 2024-09-17T07:20:05.482 INFO:tasks.workunit.client.1.smithi139.stdout:3/802: write d5/da7/dca/dab/dd6/f68 [898634,23320] 0 2024-09-17T07:20:05.482 INFO:tasks.workunit.client.1.smithi139.stdout:0/556: chown d1/da/d1b/d3d/f95 193160620 1 2024-09-17T07:20:05.483 INFO:tasks.workunit.client.1.smithi139.stdout:3/803: dread - d5/d21/d23/d69/dd5/fc3 zero size 2024-09-17T07:20:05.487 INFO:tasks.workunit.client.1.smithi139.stdout:1/659: creat d2/d10/d12/d24/db2/fcf x:0 0 0 2024-09-17T07:20:05.488 INFO:tasks.workunit.client.0.smithi087.stdout:3/942: dread d6/d1b/f9d [0,4194304] 0 2024-09-17T07:20:05.488 INFO:tasks.workunit.client.0.smithi087.stdout:6/953: dwrite d1/d67/dfe/f23 [4194304,4194304] 0 2024-09-17T07:20:05.489 INFO:tasks.workunit.client.0.smithi087.stdout:6/954: chown d1/d67/dfe/d2c/d40/d4c/da1/lc6 7976805 1 2024-09-17T07:20:05.489 INFO:tasks.workunit.client.1.smithi139.stdout:3/804: creat d5/d21/d23/d38/ffc x:0 0 0 2024-09-17T07:20:05.490 INFO:tasks.workunit.client.1.smithi139.stdout:5/829: getdents d4/d16/d1b/d20/d32/d76 0 2024-09-17T07:20:05.490 INFO:tasks.workunit.client.0.smithi087.stdout:3/943: symlink d6/d1b/d42/d62/l152 0 2024-09-17T07:20:05.491 INFO:tasks.workunit.client.0.smithi087.stdout:3/944: fdatasync d6/d10d/f13a 0 2024-09-17T07:20:05.492 INFO:tasks.workunit.client.1.smithi139.stdout:1/660: mknod d2/d10/d12/d1a/db1/cd0 0 2024-09-17T07:20:05.493 INFO:tasks.workunit.client.1.smithi139.stdout:3/805: write d5/f3c [331288,73376] 0 2024-09-17T07:20:05.493 INFO:tasks.workunit.client.0.smithi087.stdout:6/955: creat d1/d67/dfe/f140 x:0 0 0 2024-09-17T07:20:05.493 INFO:tasks.workunit.client.0.smithi087.stdout:3/945: mknod d6/d15/d37/d3c/d52/db2/c153 0 2024-09-17T07:20:05.495 INFO:tasks.workunit.client.0.smithi087.stdout:3/946: write d6/d1b/d42/d62/f87 [3611680,41593] 0 2024-09-17T07:20:05.496 INFO:tasks.workunit.client.1.smithi139.stdout:1/661: rmdir d2/d10/d12/d24/d38 39 2024-09-17T07:20:05.496 INFO:tasks.workunit.client.0.smithi087.stdout:6/956: mknod d1/d67/dfe/d2c/d40/c141 0 2024-09-17T07:20:05.497 INFO:tasks.workunit.client.0.smithi087.stdout:3/947: mkdir d6/d10d/d154 0 2024-09-17T07:20:05.497 INFO:tasks.workunit.client.1.smithi139.stdout:3/806: mkdir d5/da7/dca/dfd 0 2024-09-17T07:20:05.498 INFO:tasks.workunit.client.1.smithi139.stdout:5/830: link d4/d16/d1b/d20/d67/d88/d9f/lee d4/d16/d1b/d20/d108/l117 0 2024-09-17T07:20:05.504 INFO:tasks.workunit.client.1.smithi139.stdout:5/831: mkdir d4/d16/d1b/d20/d28/d3f/dcc/df1/d118 0 2024-09-17T07:20:05.507 INFO:tasks.workunit.client.0.smithi087.stdout:6/957: dread d1/f35 [0,4194304] 0 2024-09-17T07:20:05.510 INFO:tasks.workunit.client.0.smithi087.stdout:6/958: symlink d1/d67/dfe/d2c/d40/d4c/dce/l142 0 2024-09-17T07:20:05.510 INFO:tasks.workunit.client.1.smithi139.stdout:0/557: truncate d1/da/d17/f9f 3896357 0 2024-09-17T07:20:05.513 INFO:tasks.workunit.client.1.smithi139.stdout:1/662: dwrite d2/d10/d12/d35/d2b/f2c [4194304,4194304] 0 2024-09-17T07:20:05.515 INFO:tasks.workunit.client.1.smithi139.stdout:6/803: dread db/d18/d38/d60/f7c [0,4194304] 0 2024-09-17T07:20:05.518 INFO:tasks.workunit.client.1.smithi139.stdout:6/804: chown db/d18/d38/d60/dc2/f109 30350094 1 2024-09-17T07:20:05.519 INFO:tasks.workunit.client.0.smithi087.stdout:3/948: dwrite d6/f59 [0,4194304] 0 2024-09-17T07:20:05.520 INFO:tasks.workunit.client.1.smithi139.stdout:3/807: dwrite d5/da7/dca/dab/dd6/d28/db5/fcd [0,4194304] 0 2024-09-17T07:20:05.530 INFO:tasks.workunit.client.1.smithi139.stdout:0/558: unlink d1/da/d1b/d32/d81/cab 0 2024-09-17T07:20:05.533 INFO:tasks.workunit.client.1.smithi139.stdout:1/663: symlink d2/d10/d12/d1a/db1/dc7/dbf/ld1 0 2024-09-17T07:20:05.533 INFO:tasks.workunit.client.1.smithi139.stdout:3/808: dread d5/d21/d23/f5d [0,4194304] 0 2024-09-17T07:20:05.536 INFO:tasks.workunit.client.0.smithi087.stdout:1/841: sync 2024-09-17T07:20:05.536 INFO:tasks.workunit.client.0.smithi087.stdout:9/822: sync 2024-09-17T07:20:05.537 INFO:tasks.workunit.client.1.smithi139.stdout:1/664: getdents d2/d10/d12/d13/dca 0 2024-09-17T07:20:05.537 INFO:tasks.workunit.client.1.smithi139.stdout:0/559: dread d1/da/d1b/d3d/d50/f55 [4194304,4194304] 0 2024-09-17T07:20:05.538 INFO:tasks.workunit.client.1.smithi139.stdout:1/665: chown d2/d10/d12/d24/db2/fcf 132195023 1 2024-09-17T07:20:05.540 INFO:tasks.workunit.client.0.smithi087.stdout:9/823: symlink d3/d4/d6/d8/d22/d92/da3/d113/l11c 0 2024-09-17T07:20:05.540 INFO:tasks.workunit.client.1.smithi139.stdout:1/666: truncate d2/d10/d12/d7c/f93 513400 0 2024-09-17T07:20:05.541 INFO:tasks.workunit.client.1.smithi139.stdout:1/667: truncate d2/d10/d12/d35/d2b/fc5 594056 0 2024-09-17T07:20:05.543 INFO:tasks.workunit.client.1.smithi139.stdout:1/668: unlink d2/d10/d12/d1a/f21 0 2024-09-17T07:20:05.544 INFO:tasks.workunit.client.0.smithi087.stdout:9/824: creat d3/d4/d16/d69/d8a/d1e/d90/d93/dff/f11d x:0 0 0 2024-09-17T07:20:05.544 INFO:tasks.workunit.client.0.smithi087.stdout:1/842: dread d2/d69/f70 [0,4194304] 0 2024-09-17T07:20:05.547 INFO:tasks.workunit.client.0.smithi087.stdout:1/843: write d2/d48/d61/fb6 [3583326,99064] 0 2024-09-17T07:20:05.549 INFO:tasks.workunit.client.1.smithi139.stdout:1/669: rename d2/d10/d12/d1a/c48 to d2/d10/d12/d24/d38/cd2 0 2024-09-17T07:20:05.550 INFO:tasks.workunit.client.0.smithi087.stdout:6/959: dread d1/d67/dfe/d2c/f32 [0,4194304] 0 2024-09-17T07:20:05.550 INFO:tasks.workunit.client.1.smithi139.stdout:1/670: write d2/d10/d12/f31 [671458,125888] 0 2024-09-17T07:20:05.551 INFO:tasks.workunit.client.0.smithi087.stdout:1/844: getdents d2/d3d/db4 0 2024-09-17T07:20:05.553 INFO:tasks.workunit.client.0.smithi087.stdout:6/960: dread - d1/d67/dfe/d2c/d48/d9b/f101 zero size 2024-09-17T07:20:05.553 INFO:tasks.workunit.client.1.smithi139.stdout:1/671: unlink d2/d10/d12/d35/d2b/f2c 0 2024-09-17T07:20:05.555 INFO:tasks.workunit.client.1.smithi139.stdout:1/672: readlink d2/d10/d12/d35/d49/l7f 0 2024-09-17T07:20:05.555 INFO:tasks.workunit.client.0.smithi087.stdout:1/845: creat d2/d3d/d35/d57/d73/f126 x:0 0 0 2024-09-17T07:20:05.558 INFO:tasks.workunit.client.0.smithi087.stdout:6/961: rmdir d1/d67/dfe/d2c/d129/d10d 0 2024-09-17T07:20:05.559 INFO:tasks.workunit.client.1.smithi139.stdout:1/673: creat d2/d10/d12/d13/dca/fd3 x:0 0 0 2024-09-17T07:20:05.560 INFO:tasks.workunit.client.0.smithi087.stdout:9/825: dwrite d3/d25/f9a [0,4194304] 0 2024-09-17T07:20:05.562 INFO:tasks.workunit.client.0.smithi087.stdout:1/846: link d2/d3d/fa7 d2/d11a/f127 0 2024-09-17T07:20:05.565 INFO:tasks.workunit.client.0.smithi087.stdout:9/826: mknod d3/d4/d6/d8/d22/d43/d84/dc7/c11e 0 2024-09-17T07:20:05.566 INFO:tasks.workunit.client.1.smithi139.stdout:3/809: write d5/f1d [3437885,2736] 0 2024-09-17T07:20:05.567 INFO:tasks.workunit.client.1.smithi139.stdout:6/805: dread db/df/f84 [0,4194304] 0 2024-09-17T07:20:05.568 INFO:tasks.workunit.client.1.smithi139.stdout:0/560: dread d1/da/d17/d72/f5b [0,4194304] 0 2024-09-17T07:20:05.569 INFO:tasks.workunit.client.0.smithi087.stdout:9/827: fdatasync d3/d4/d16/d69/d8a/d1e/d90/d93/fb7 0 2024-09-17T07:20:05.571 INFO:tasks.workunit.client.0.smithi087.stdout:9/828: fsync d3/d4/d6/f3e 0 2024-09-17T07:20:05.571 INFO:tasks.workunit.client.1.smithi139.stdout:1/674: dwrite d2/d10/d12/d13/d4f/d5c/d74/fbb [0,4194304] 0 2024-09-17T07:20:05.573 INFO:tasks.workunit.client.1.smithi139.stdout:0/561: stat d1/da/d17/d72/l36 0 2024-09-17T07:20:05.577 INFO:tasks.workunit.client.1.smithi139.stdout:3/810: truncate d5/da7/dca/fe1 144263 0 2024-09-17T07:20:05.577 INFO:tasks.workunit.client.1.smithi139.stdout:1/675: chown d2/d10/d12/d13/l73 172 1 2024-09-17T07:20:05.577 INFO:tasks.workunit.client.0.smithi087.stdout:9/829: dread d3/d4/d16/d69/d8a/f85 [0,4194304] 0 2024-09-17T07:20:05.578 INFO:tasks.workunit.client.1.smithi139.stdout:5/832: dwrite d4/d16/d1b/d20/d38/f87 [4194304,4194304] 0 2024-09-17T07:20:05.580 INFO:tasks.workunit.client.1.smithi139.stdout:6/806: rename db/d18/d38/f92 to db/df/d73/d81/f113 0 2024-09-17T07:20:05.580 INFO:tasks.workunit.client.1.smithi139.stdout:1/676: write d2/f15 [3377867,34197] 0 2024-09-17T07:20:05.582 INFO:tasks.workunit.client.1.smithi139.stdout:5/833: write d4/d16/d1b/d20/d28/f4d [4154490,45807] 0 2024-09-17T07:20:05.584 INFO:tasks.workunit.client.0.smithi087.stdout:9/830: rename d3/d4/d6/d8/ff9 to d3/d4/d16/d69/d8a/d1e/f11f 0 2024-09-17T07:20:05.585 INFO:tasks.workunit.client.1.smithi139.stdout:5/834: dread - d4/d16/d1b/d20/d32/d6c/dc9/dcb/ff2 zero size 2024-09-17T07:20:05.586 INFO:tasks.workunit.client.0.smithi087.stdout:1/847: dwrite d2/dcf/d7e/db9/fbc [0,4194304] 0 2024-09-17T07:20:05.590 INFO:tasks.workunit.client.0.smithi087.stdout:9/831: symlink d3/d4/l120 0 2024-09-17T07:20:05.590 INFO:tasks.workunit.client.1.smithi139.stdout:3/811: unlink d5/d15/d20/d3b/ca2 0 2024-09-17T07:20:05.591 INFO:tasks.workunit.client.0.smithi087.stdout:1/848: dread - d2/d3d/d35/d57/d73/fd1 zero size 2024-09-17T07:20:05.593 INFO:tasks.workunit.client.0.smithi087.stdout:9/832: dread d3/d4/d16/d69/fe3 [0,4194304] 0 2024-09-17T07:20:05.594 INFO:tasks.workunit.client.0.smithi087.stdout:1/849: fdatasync d2/d3d/f21 0 2024-09-17T07:20:05.595 INFO:tasks.workunit.client.1.smithi139.stdout:3/812: creat d5/d15/ffe x:0 0 0 2024-09-17T07:20:05.595 INFO:tasks.workunit.client.1.smithi139.stdout:6/807: getdents db/df/d4c 0 2024-09-17T07:20:05.596 INFO:tasks.workunit.client.0.smithi087.stdout:1/850: chown d2/d69/d8d/da6/cc2 3 1 2024-09-17T07:20:05.596 INFO:tasks.workunit.client.0.smithi087.stdout:6/962: dread d1/d67/dfe/d2c/d48/f6f [0,4194304] 0 2024-09-17T07:20:05.597 INFO:tasks.workunit.client.0.smithi087.stdout:1/851: truncate d2/dcf/ff6 645959 0 2024-09-17T07:20:05.599 INFO:tasks.workunit.client.0.smithi087.stdout:9/833: rename d3/d25/d83/c9c to d3/d4/d6/d71/c121 0 2024-09-17T07:20:05.599 INFO:tasks.workunit.client.0.smithi087.stdout:6/963: rmdir d1/d67/dfe/d4e/db0/d11c 39 2024-09-17T07:20:05.600 INFO:tasks.workunit.client.1.smithi139.stdout:5/835: dwrite d4/d16/d1b/d20/f7d [0,4194304] 0 2024-09-17T07:20:05.600 INFO:tasks.workunit.client.0.smithi087.stdout:6/964: readlink d1/d67/dfe/l138 0 2024-09-17T07:20:05.600 INFO:tasks.workunit.client.0.smithi087.stdout:1/852: symlink d2/d3d/db4/dc3/l128 0 2024-09-17T07:20:05.601 INFO:tasks.workunit.client.1.smithi139.stdout:3/813: symlink d5/d15/d20/lff 0 2024-09-17T07:20:05.605 INFO:tasks.workunit.client.1.smithi139.stdout:0/562: dread d1/da/d1b/d32/f3a [0,4194304] 0 2024-09-17T07:20:05.608 INFO:tasks.workunit.client.1.smithi139.stdout:3/814: mknod d5/c100 0 2024-09-17T07:20:05.608 INFO:tasks.workunit.client.1.smithi139.stdout:5/836: dread - d4/d16/d1b/d20/d32/d3d/f112 zero size 2024-09-17T07:20:05.609 INFO:tasks.workunit.client.1.smithi139.stdout:3/815: chown d5/fe 7371 1 2024-09-17T07:20:05.609 INFO:tasks.workunit.client.1.smithi139.stdout:6/808: dwrite db/df/d4e/d64/d83/fed [0,4194304] 0 2024-09-17T07:20:05.610 INFO:tasks.workunit.client.1.smithi139.stdout:5/837: chown d4/d16/ce3 2660 1 2024-09-17T07:20:05.610 INFO:tasks.workunit.client.1.smithi139.stdout:0/563: read d1/d58/fbd [1741976,76412] 0 2024-09-17T07:20:05.612 INFO:tasks.workunit.client.1.smithi139.stdout:6/809: creat db/d21/d96/dcf/f114 x:0 0 0 2024-09-17T07:20:05.614 INFO:tasks.workunit.client.1.smithi139.stdout:3/816: chown d5/da7/dca/dab/dd6/d28/d54/d58/f8f 200 1 2024-09-17T07:20:05.616 INFO:tasks.workunit.client.1.smithi139.stdout:6/810: mkdir db/d18/d115 0 2024-09-17T07:20:05.619 INFO:tasks.workunit.client.1.smithi139.stdout:0/564: link d1/da/f14 d1/da/d2a/dae/fd0 0 2024-09-17T07:20:05.619 INFO:tasks.workunit.client.1.smithi139.stdout:5/838: truncate d4/d16/d1b/d20/d28/fb1 620685 0 2024-09-17T07:20:05.621 INFO:tasks.workunit.client.1.smithi139.stdout:6/811: symlink db/df/d4e/d64/d80/l116 0 2024-09-17T07:20:05.621 INFO:tasks.workunit.client.1.smithi139.stdout:0/565: chown d1/da/d2a/lb7 707 1 2024-09-17T07:20:05.623 INFO:tasks.workunit.client.0.smithi087.stdout:1/853: write d2/d3d/f2f [2043062,44362] 0 2024-09-17T07:20:05.623 INFO:tasks.workunit.client.0.smithi087.stdout:6/965: write d1/d6/d68/f98 [2752935,111227] 0 2024-09-17T07:20:05.624 INFO:tasks.workunit.client.1.smithi139.stdout:3/817: dwrite d5/d21/d23/d38/f40 [0,4194304] 0 2024-09-17T07:20:05.624 INFO:tasks.workunit.client.1.smithi139.stdout:3/818: fdatasync d5/d21/dba/fea 0 2024-09-17T07:20:05.627 INFO:tasks.workunit.client.0.smithi087.stdout:6/966: readlink d1/d6a/d122/l13a 0 2024-09-17T07:20:05.627 INFO:tasks.workunit.client.0.smithi087.stdout:1/854: chown d2/d3d/l58 47492 1 2024-09-17T07:20:05.627 INFO:tasks.workunit.client.1.smithi139.stdout:0/566: write d1/d58/fbd [961715,77349] 0 2024-09-17T07:20:05.629 INFO:tasks.workunit.client.0.smithi087.stdout:6/967: write d1/d67/dfe/d125/f13c [801027,77750] 0 2024-09-17T07:20:05.629 INFO:tasks.workunit.client.1.smithi139.stdout:5/839: symlink d4/d16/d1b/d20/d67/d88/l119 0 2024-09-17T07:20:05.630 INFO:tasks.workunit.client.1.smithi139.stdout:5/840: readlink d4/d16/l73 0 2024-09-17T07:20:05.632 INFO:tasks.workunit.client.1.smithi139.stdout:3/819: creat d5/da7/f101 x:0 0 0 2024-09-17T07:20:05.634 INFO:tasks.workunit.client.1.smithi139.stdout:6/812: symlink db/df/d4e/d5e/deb/d112/l117 0 2024-09-17T07:20:05.635 INFO:tasks.workunit.client.0.smithi087.stdout:1/855: write d2/d3d/d35/d4f/fb0 [707460,89147] 0 2024-09-17T07:20:05.637 INFO:tasks.workunit.client.1.smithi139.stdout:6/813: fdatasync db/d18/d38/d60/f7c 0 2024-09-17T07:20:05.640 INFO:tasks.workunit.client.1.smithi139.stdout:3/820: dwrite d5/d15/d20/d3b/dc1/ff6 [0,4194304] 0 2024-09-17T07:20:05.642 INFO:tasks.workunit.client.0.smithi087.stdout:1/856: dwrite d2/d3d/d35/d57/d73/fea [0,4194304] 0 2024-09-17T07:20:05.644 INFO:tasks.workunit.client.0.smithi087.stdout:1/857: symlink d2/d3d/d8e/l129 0 2024-09-17T07:20:05.646 INFO:tasks.workunit.client.0.smithi087.stdout:1/858: stat d2/d3d/d35/d4f/da5/l113 0 2024-09-17T07:20:05.649 INFO:tasks.workunit.client.0.smithi087.stdout:1/859: symlink d2/d48/d6f/l12a 0 2024-09-17T07:20:05.650 INFO:tasks.workunit.client.0.smithi087.stdout:1/860: chown d2/d69/d8d/c95 893256 1 2024-09-17T07:20:05.653 INFO:tasks.workunit.client.0.smithi087.stdout:1/861: mknod d2/d3d/d35/d57/c12b 0 2024-09-17T07:20:05.676 INFO:tasks.workunit.client.0.smithi087.stdout:1/862: dread d2/dcf/f67 [0,4194304] 0 2024-09-17T07:20:05.682 INFO:tasks.workunit.client.0.smithi087.stdout:1/863: dwrite d2/d69/f70 [4194304,4194304] 0 2024-09-17T07:20:05.684 INFO:tasks.workunit.client.0.smithi087.stdout:1/864: write d2/dc/f3a [4451342,72626] 0 2024-09-17T07:20:05.685 INFO:tasks.workunit.client.0.smithi087.stdout:8/899: sync 2024-09-17T07:20:05.685 INFO:tasks.workunit.client.0.smithi087.stdout:2/777: sync 2024-09-17T07:20:05.685 INFO:tasks.workunit.client.0.smithi087.stdout:7/759: sync 2024-09-17T07:20:05.692 INFO:tasks.workunit.client.0.smithi087.stdout:1/865: dread d2/d69/f70 [0,4194304] 0 2024-09-17T07:20:05.693 INFO:tasks.workunit.client.0.smithi087.stdout:8/900: rename d1/d7/d9/d19/d4d/d11f/da1/f10c to d1/d7/d9/d19/d4d/d11f/da1/f13f 0 2024-09-17T07:20:05.693 INFO:tasks.workunit.client.0.smithi087.stdout:2/778: dread d2/d7/dd/d6a/dcf/fd8 [0,4194304] 0 2024-09-17T07:20:05.696 INFO:tasks.workunit.client.0.smithi087.stdout:2/779: unlink d2/d7/dd/d10/f88 0 2024-09-17T07:20:05.699 INFO:tasks.workunit.client.0.smithi087.stdout:8/901: getdents d1/d7/d63/dd9 0 2024-09-17T07:20:05.704 INFO:tasks.workunit.client.0.smithi087.stdout:8/902: dwrite d1/d7/d9/d19/d4d/f10e [0,4194304] 0 2024-09-17T07:20:05.706 INFO:tasks.workunit.client.0.smithi087.stdout:8/903: write d1/d7/d9/d19/d4d/d11f/f58 [652147,90322] 0 2024-09-17T07:20:05.708 INFO:tasks.workunit.client.0.smithi087.stdout:8/904: fsync d1/d7/d9/d19/d4d/d11f/f101 0 2024-09-17T07:20:05.712 INFO:tasks.workunit.client.0.smithi087.stdout:8/905: link d1/d2b/d21/daf/f115 d1/d7/d63/f140 0 2024-09-17T07:20:05.714 INFO:tasks.workunit.client.0.smithi087.stdout:8/906: link d1/d5f/l9f d1/d7/d9/d19/l141 0 2024-09-17T07:20:05.719 INFO:tasks.workunit.client.0.smithi087.stdout:9/834: sync 2024-09-17T07:20:05.720 INFO:tasks.workunit.client.0.smithi087.stdout:3/949: sync 2024-09-17T07:20:05.722 INFO:tasks.workunit.client.0.smithi087.stdout:3/950: write d6/d7d/f113 [533595,89877] 0 2024-09-17T07:20:05.722 INFO:tasks.workunit.client.0.smithi087.stdout:9/835: creat d3/d4/d6/d8/d22/d92/f122 x:0 0 0 2024-09-17T07:20:05.725 INFO:tasks.workunit.client.0.smithi087.stdout:8/907: dread d1/d2b/d21/d6d/fa6 [0,4194304] 0 2024-09-17T07:20:05.725 INFO:tasks.workunit.client.0.smithi087.stdout:9/836: fdatasync d3/d4/d6/d8/d22/d92/fbd 0 2024-09-17T07:20:05.729 INFO:tasks.workunit.client.0.smithi087.stdout:8/908: dread d1/d7/d9/d19/d4d/ffe [0,4194304] 0 2024-09-17T07:20:05.730 INFO:tasks.workunit.client.0.smithi087.stdout:3/951: dwrite d6/d1b/d42/f93 [0,4194304] 0 2024-09-17T07:20:05.734 INFO:tasks.workunit.client.0.smithi087.stdout:9/837: getdents d3/d4/d6/d8/d22/d43/d84/dc7 0 2024-09-17T07:20:05.734 INFO:tasks.workunit.client.0.smithi087.stdout:8/909: symlink d1/d7/d9/d19/d4d/d11f/da1/d117/l142 0 2024-09-17T07:20:05.735 INFO:tasks.workunit.client.0.smithi087.stdout:3/952: creat d6/d1b/d42/f155 x:0 0 0 2024-09-17T07:20:05.738 INFO:tasks.workunit.client.0.smithi087.stdout:3/953: write d6/f57 [482237,113242] 0 2024-09-17T07:20:05.743 INFO:tasks.workunit.client.0.smithi087.stdout:9/838: dwrite d3/d4/d6/ffe [0,4194304] 0 2024-09-17T07:20:05.743 INFO:tasks.workunit.client.0.smithi087.stdout:3/954: creat d6/d1b/d42/d95/db3/f156 x:0 0 0 2024-09-17T07:20:05.746 INFO:tasks.workunit.client.0.smithi087.stdout:3/955: creat d6/d15/d37/d3c/d52/db2/f157 x:0 0 0 2024-09-17T07:20:05.747 INFO:tasks.workunit.client.1.smithi139.stdout:4/687: sync 2024-09-17T07:20:05.748 INFO:tasks.workunit.client.0.smithi087.stdout:3/956: creat d6/d1b/d42/d95/db3/f158 x:0 0 0 2024-09-17T07:20:05.756 INFO:tasks.workunit.client.0.smithi087.stdout:6/968: dread d1/d67/dfe/d2c/d40/f49 [4194304,4194304] 0 2024-09-17T07:20:05.757 INFO:tasks.workunit.client.0.smithi087.stdout:6/969: readlink d1/d67/dfe/d2c/d129/db6/l111 0 2024-09-17T07:20:05.758 INFO:tasks.workunit.client.0.smithi087.stdout:1/866: write d2/d3d/d45/d90/fae [16593,118498] 0 2024-09-17T07:20:05.761 INFO:tasks.workunit.client.0.smithi087.stdout:1/867: symlink d2/d11a/l12c 0 2024-09-17T07:20:05.762 INFO:tasks.workunit.client.0.smithi087.stdout:6/970: creat d1/d67/dfe/d125/f143 x:0 0 0 2024-09-17T07:20:05.762 INFO:tasks.workunit.client.0.smithi087.stdout:1/868: chown d2/dcf/f9c 4330358 1 2024-09-17T07:20:05.764 INFO:tasks.workunit.client.0.smithi087.stdout:2/780: dwrite d2/d50/fa8 [4194304,4194304] 0 2024-09-17T07:20:05.765 INFO:tasks.workunit.client.0.smithi087.stdout:2/781: chown d2/d15/dce/dd1/d99/de3 1 1 2024-09-17T07:20:05.766 INFO:tasks.workunit.client.0.smithi087.stdout:6/971: unlink d1/d67/dfe/d4e/ccc 0 2024-09-17T07:20:05.767 INFO:tasks.workunit.client.0.smithi087.stdout:2/782: symlink d2/d96/lf8 0 2024-09-17T07:20:05.769 INFO:tasks.workunit.client.0.smithi087.stdout:1/869: rename d2/d3d/c2a to d2/d69/d8d/da6/dd6/c12d 0 2024-09-17T07:20:05.772 INFO:tasks.workunit.client.0.smithi087.stdout:6/972: creat d1/d67/dfe/d2c/d48/f144 x:0 0 0 2024-09-17T07:20:05.773 INFO:tasks.workunit.client.0.smithi087.stdout:7/760: dread d0/d3/d10/f14 [0,4194304] 0 2024-09-17T07:20:05.776 INFO:tasks.workunit.client.0.smithi087.stdout:6/973: mkdir d1/d67/dfe/d2c/d58/d90/def/d145 0 2024-09-17T07:20:05.777 INFO:tasks.workunit.client.0.smithi087.stdout:6/974: stat d1/d67 0 2024-09-17T07:20:05.777 INFO:tasks.workunit.client.0.smithi087.stdout:2/783: link d2/d7/dd/d10/f1d d2/d7/d60/ff9 0 2024-09-17T07:20:05.778 INFO:tasks.workunit.client.0.smithi087.stdout:7/761: creat d0/d3/d23/d2d/fe6 x:0 0 0 2024-09-17T07:20:05.780 INFO:tasks.workunit.client.0.smithi087.stdout:7/762: dread - d0/d3/d10/d31/f9a zero size 2024-09-17T07:20:05.781 INFO:tasks.workunit.client.0.smithi087.stdout:6/975: creat d1/d67/dfe/d2c/d40/dd2/d130/f146 x:0 0 0 2024-09-17T07:20:05.782 INFO:tasks.workunit.client.0.smithi087.stdout:3/957: fsync d6/d1b/d42/dd4/dd1/de4/ff7 0 2024-09-17T07:20:05.782 INFO:tasks.workunit.client.0.smithi087.stdout:7/763: chown d0/dbb 865 1 2024-09-17T07:20:05.786 INFO:tasks.workunit.client.0.smithi087.stdout:2/784: dread d2/d7/dd/d10/f5a [0,4194304] 0 2024-09-17T07:20:05.786 INFO:tasks.workunit.client.0.smithi087.stdout:3/958: chown d6/d15/d37/d3c/d52/db2/d102/f115 0 1 2024-09-17T07:20:05.787 INFO:tasks.workunit.client.0.smithi087.stdout:7/764: rename d0/d3/fa5 to d0/d3/d23/d4e/fe7 0 2024-09-17T07:20:05.788 INFO:tasks.workunit.client.0.smithi087.stdout:2/785: chown d2/d7/d60/cee 347759 1 2024-09-17T07:20:05.789 INFO:tasks.workunit.client.0.smithi087.stdout:3/959: dread - d6/d1b/d42/feb zero size 2024-09-17T07:20:05.790 INFO:tasks.workunit.client.0.smithi087.stdout:1/870: dread d2/d3d/d45/d90/d43/f93 [0,4194304] 0 2024-09-17T07:20:05.791 INFO:tasks.workunit.client.0.smithi087.stdout:2/786: symlink d2/d96/ded/lfa 0 2024-09-17T07:20:05.791 INFO:tasks.workunit.client.0.smithi087.stdout:3/960: stat d6/d15/d37/d3c/d52/db2/de7/c32 0 2024-09-17T07:20:05.792 INFO:tasks.workunit.client.1.smithi139.stdout:4/688: chown d0/f82 0 1 2024-09-17T07:20:05.794 INFO:tasks.workunit.client.0.smithi087.stdout:3/961: write d6/d15/d37/d3c/d52/db2/d10a/d11b/d120/f12d [554811,99997] 0 2024-09-17T07:20:05.797 INFO:tasks.workunit.client.1.smithi139.stdout:3/821: getdents d5/d63/d6d 0 2024-09-17T07:20:05.799 INFO:tasks.workunit.client.1.smithi139.stdout:5/841: write d4/d16/f19 [1198245,1487] 0 2024-09-17T07:20:05.800 INFO:tasks.workunit.client.1.smithi139.stdout:3/822: write d5/d21/d23/d69/f76 [3429433,115106] 0 2024-09-17T07:20:05.805 INFO:tasks.workunit.client.1.smithi139.stdout:5/842: read d4/d16/d1b/d20/d28/f3e [2007013,69141] 0 2024-09-17T07:20:05.805 INFO:tasks.workunit.client.1.smithi139.stdout:0/567: dwrite d1/da/d1b/d32/f4f [0,4194304] 0 2024-09-17T07:20:05.806 INFO:tasks.workunit.client.1.smithi139.stdout:5/843: stat d4/d16/f77 0 2024-09-17T07:20:05.809 INFO:tasks.workunit.client.1.smithi139.stdout:3/823: link d5/da7/fac d5/da7/dca/f102 0 2024-09-17T07:20:05.809 INFO:tasks.workunit.client.1.smithi139.stdout:4/689: dwrite d0/f4 [0,4194304] 0 2024-09-17T07:20:05.810 INFO:tasks.workunit.client.1.smithi139.stdout:0/568: creat d1/da/d1b/dba/dc5/fd1 x:0 0 0 2024-09-17T07:20:05.813 INFO:tasks.workunit.client.1.smithi139.stdout:5/844: dread - d4/d5d/d97/fa2 zero size 2024-09-17T07:20:05.813 INFO:tasks.workunit.client.1.smithi139.stdout:0/569: write d1/da/f60 [3999670,35223] 0 2024-09-17T07:20:05.814 INFO:tasks.workunit.client.1.smithi139.stdout:3/824: dread - d5/d21/d23/d38/fdf zero size 2024-09-17T07:20:05.818 INFO:tasks.workunit.client.1.smithi139.stdout:3/825: unlink d5/d15/f62 0 2024-09-17T07:20:05.818 INFO:tasks.workunit.client.1.smithi139.stdout:5/845: truncate d4/d16/f8a 345931 0 2024-09-17T07:20:05.819 INFO:tasks.workunit.client.1.smithi139.stdout:3/826: readlink d5/d63/d6d/d6f/d81/lb7 0 2024-09-17T07:20:05.819 INFO:tasks.workunit.client.1.smithi139.stdout:4/690: symlink d0/d1/d9b/ld7 0 2024-09-17T07:20:05.827 INFO:tasks.workunit.client.1.smithi139.stdout:5/846: dwrite d4/d16/d1b/d20/d28/f26 [4194304,4194304] 0 2024-09-17T07:20:05.827 INFO:tasks.workunit.client.1.smithi139.stdout:3/827: dwrite d5/d21/d23/d38/f5f [0,4194304] 0 2024-09-17T07:20:05.833 INFO:tasks.workunit.client.1.smithi139.stdout:5/847: mkdir d4/d16/d1b/d20/d11a 0 2024-09-17T07:20:05.833 INFO:tasks.workunit.client.1.smithi139.stdout:3/828: symlink d5/d15/d20/d3b/l103 0 2024-09-17T07:20:05.840 INFO:tasks.workunit.client.1.smithi139.stdout:3/829: mknod d5/da7/dca/dab/dd6/c104 0 2024-09-17T07:20:05.842 INFO:tasks.workunit.client.1.smithi139.stdout:5/848: dwrite d4/f5b [0,4194304] 0 2024-09-17T07:20:05.843 INFO:tasks.workunit.client.1.smithi139.stdout:3/830: stat d5/da7/dca/dab/dd6/d28/d54/fbc 0 2024-09-17T07:20:05.856 INFO:tasks.workunit.client.1.smithi139.stdout:5/849: getdents d4/d16/d1b/d20 0 2024-09-17T07:20:05.857 INFO:tasks.workunit.client.1.smithi139.stdout:4/691: write d0/d1/d9b/d83/f3a [4302056,104440] 0 2024-09-17T07:20:05.859 INFO:tasks.workunit.client.1.smithi139.stdout:5/850: symlink d4/d5d/d97/l11b 0 2024-09-17T07:20:05.860 INFO:tasks.workunit.client.1.smithi139.stdout:4/692: fdatasync d0/d1/d9b/d83/f96 0 2024-09-17T07:20:05.862 INFO:tasks.workunit.client.1.smithi139.stdout:3/831: dwrite d5/d15/d16/f17 [0,4194304] 0 2024-09-17T07:20:05.865 INFO:tasks.workunit.client.1.smithi139.stdout:5/851: mkdir d4/d16/d1b/d20/d32/d6c/dc9/d11c 0 2024-09-17T07:20:05.865 INFO:tasks.workunit.client.1.smithi139.stdout:4/693: mknod d0/d49/cd8 0 2024-09-17T07:20:05.865 INFO:tasks.workunit.client.1.smithi139.stdout:4/694: readlink d0/d1/l99 0 2024-09-17T07:20:05.866 INFO:tasks.workunit.client.1.smithi139.stdout:3/832: rmdir d5/d21/dba 39 2024-09-17T07:20:05.867 INFO:tasks.workunit.client.1.smithi139.stdout:3/833: chown d5/d63/l75 0 1 2024-09-17T07:20:05.868 INFO:tasks.workunit.client.1.smithi139.stdout:4/695: rmdir d0/db/d58 39 2024-09-17T07:20:05.870 INFO:tasks.workunit.client.0.smithi087.stdout:1/871: link d2/d3d/d45/d90/d43/f66 d2/d3d/d45/d90/d37/f12e 0 2024-09-17T07:20:05.871 INFO:tasks.workunit.client.1.smithi139.stdout:3/834: write d5/da7/dca/dab/dd6/d28/d54/d58/fd1 [3023660,50817] 0 2024-09-17T07:20:05.871 INFO:tasks.workunit.client.1.smithi139.stdout:4/696: symlink d0/db/d17/dc3/ld9 0 2024-09-17T07:20:05.873 INFO:tasks.workunit.client.0.smithi087.stdout:6/976: dwrite d1/d67/dfe/d2c/d40/d4c/dce/fed [0,4194304] 0 2024-09-17T07:20:05.873 INFO:tasks.workunit.client.0.smithi087.stdout:3/962: link d6/d1b/d42/d62/f87 d6/d15/d37/d3c/d43/db7/d104/f159 0 2024-09-17T07:20:05.874 INFO:tasks.workunit.client.0.smithi087.stdout:2/787: truncate d2/d50/fa8 6448984 0 2024-09-17T07:20:05.877 INFO:tasks.workunit.client.0.smithi087.stdout:1/872: mkdir d2/dcf/d12f 0 2024-09-17T07:20:05.878 INFO:tasks.workunit.client.1.smithi139.stdout:3/835: mkdir d5/d15/d16/d105 0 2024-09-17T07:20:05.878 INFO:tasks.workunit.client.0.smithi087.stdout:1/873: truncate d2/d3d/d35/ffe 1149497 0 2024-09-17T07:20:05.881 INFO:tasks.workunit.client.0.smithi087.stdout:1/874: symlink d2/d3d/db4/l130 0 2024-09-17T07:20:05.882 INFO:tasks.workunit.client.0.smithi087.stdout:3/963: dread d6/d15/d37/d3c/f54 [0,4194304] 0 2024-09-17T07:20:05.882 INFO:tasks.workunit.client.1.smithi139.stdout:5/852: dwrite d4/d16/d1b/d20/d28/f3e [4194304,4194304] 0 2024-09-17T07:20:05.883 INFO:tasks.workunit.client.1.smithi139.stdout:4/697: dwrite d0/f4c [0,4194304] 0 2024-09-17T07:20:05.884 INFO:tasks.workunit.client.0.smithi087.stdout:1/875: mknod d2/c131 0 2024-09-17T07:20:05.885 INFO:tasks.workunit.client.1.smithi139.stdout:5/853: chown d4/d16/d1b/d20/d28/f46 3 1 2024-09-17T07:20:05.885 INFO:tasks.workunit.client.1.smithi139.stdout:5/854: chown d4/f5b 3886 1 2024-09-17T07:20:05.885 INFO:tasks.workunit.client.0.smithi087.stdout:3/964: creat d6/d1b/d42/f15a x:0 0 0 2024-09-17T07:20:05.886 INFO:tasks.workunit.client.0.smithi087.stdout:1/876: write d2/dcf/d7e/f83 [101175,25368] 0 2024-09-17T07:20:05.886 INFO:tasks.workunit.client.0.smithi087.stdout:3/965: readlink d6/d7d/l89 0 2024-09-17T07:20:05.892 INFO:tasks.workunit.client.1.smithi139.stdout:4/698: rename d0/db/d58/f77 to d0/d1/d54/d93/da2/fda 0 2024-09-17T07:20:05.892 INFO:tasks.workunit.client.0.smithi087.stdout:3/966: mknod d6/d1b/d42/d62/dc1/de8/c15b 0 2024-09-17T07:20:05.893 INFO:tasks.workunit.client.1.smithi139.stdout:4/699: write d0/d1/dbe/f95 [763063,128696] 0 2024-09-17T07:20:05.895 INFO:tasks.workunit.client.1.smithi139.stdout:4/700: chown d0/d1/dbe/d70/c9d 984 1 2024-09-17T07:20:05.898 INFO:tasks.workunit.client.1.smithi139.stdout:4/701: creat d0/d1/d9b/d83/fdb x:0 0 0 2024-09-17T07:20:05.898 INFO:tasks.workunit.client.0.smithi087.stdout:3/967: mknod d6/d1b/d42/dd4/dd1/de4/c15c 0 2024-09-17T07:20:05.899 INFO:tasks.workunit.client.0.smithi087.stdout:3/968: read d6/d15/f60 [960768,8390] 0 2024-09-17T07:20:05.900 INFO:tasks.workunit.client.0.smithi087.stdout:1/877: dread d2/d3d/d45/d90/d43/f66 [0,4194304] 0 2024-09-17T07:20:05.900 INFO:tasks.workunit.client.1.smithi139.stdout:4/702: mknod d0/db/d7f/db0/cdc 0 2024-09-17T07:20:05.903 INFO:tasks.workunit.client.1.smithi139.stdout:4/703: mkdir d0/d1/dbe/ddd 0 2024-09-17T07:20:05.903 INFO:tasks.workunit.client.0.smithi087.stdout:1/878: symlink d2/d69/d8d/l132 0 2024-09-17T07:20:05.908 INFO:tasks.workunit.client.0.smithi087.stdout:3/969: link d6/d10d/l11c d6/d15/d37/d3c/d52/l15d 0 2024-09-17T07:20:05.910 INFO:tasks.workunit.client.0.smithi087.stdout:6/977: dread d1/d67/dfe/d2c/f59 [0,4194304] 0 2024-09-17T07:20:05.910 INFO:tasks.workunit.client.0.smithi087.stdout:8/910: sync 2024-09-17T07:20:05.910 INFO:tasks.workunit.client.0.smithi087.stdout:9/839: sync 2024-09-17T07:20:05.911 INFO:tasks.workunit.client.0.smithi087.stdout:3/970: dread - d6/d1b/d42/d62/dbb/f10f zero size 2024-09-17T07:20:05.912 INFO:tasks.workunit.client.0.smithi087.stdout:2/788: dwrite d2/d50/f61 [0,4194304] 0 2024-09-17T07:20:05.914 INFO:tasks.workunit.client.1.smithi139.stdout:5/855: dread d4/d16/d1b/d20/d32/d76/f84 [0,4194304] 0 2024-09-17T07:20:05.915 INFO:tasks.workunit.client.0.smithi087.stdout:3/971: chown d6/d1b/d42/d62/l13c 12383 1 2024-09-17T07:20:05.916 INFO:tasks.workunit.client.0.smithi087.stdout:8/911: chown d1/d7/d9/c1e 144238090 1 2024-09-17T07:20:05.916 INFO:tasks.workunit.client.0.smithi087.stdout:3/972: dread - d6/d1b/df6/f103 zero size 2024-09-17T07:20:05.916 INFO:tasks.workunit.client.1.smithi139.stdout:5/856: creat d4/d16/d1b/d20/d28/dca/f11d x:0 0 0 2024-09-17T07:20:05.917 INFO:tasks.workunit.client.0.smithi087.stdout:2/789: rmdir d2/d96/ded 39 2024-09-17T07:20:05.918 INFO:tasks.workunit.client.1.smithi139.stdout:5/857: write d4/d16/f19 [3583218,7854] 0 2024-09-17T07:20:05.918 INFO:tasks.workunit.client.0.smithi087.stdout:2/790: write d2/d7/d33/f72 [1319541,37438] 0 2024-09-17T07:20:05.920 INFO:tasks.workunit.client.0.smithi087.stdout:8/912: write d1/d7/f2d [4960022,19589] 0 2024-09-17T07:20:05.920 INFO:tasks.workunit.client.1.smithi139.stdout:4/704: dwrite d0/d1/d29/d41/f8a [0,4194304] 0 2024-09-17T07:20:05.925 INFO:tasks.workunit.client.0.smithi087.stdout:3/973: readlink d6/l86 0 2024-09-17T07:20:05.927 INFO:tasks.workunit.client.0.smithi087.stdout:2/791: mknod d2/d15/dce/dd1/d3f/cfb 0 2024-09-17T07:20:05.929 INFO:tasks.workunit.client.1.smithi139.stdout:4/705: link d0/d1/dbe/d70/cd6 d0/d10/db4/cde 0 2024-09-17T07:20:05.930 INFO:tasks.workunit.client.0.smithi087.stdout:1/879: dread d2/d48/d61/fb6 [0,4194304] 0 2024-09-17T07:20:05.932 INFO:tasks.workunit.client.0.smithi087.stdout:9/840: link f2 d3/d4/d6/d8/d22/d43/d84/f123 0 2024-09-17T07:20:05.932 INFO:tasks.workunit.client.1.smithi139.stdout:4/706: symlink d0/db/d7f/db0/ldf 0 2024-09-17T07:20:05.932 INFO:tasks.workunit.client.0.smithi087.stdout:1/880: fsync d2/d1a/f1c 0 2024-09-17T07:20:05.933 INFO:tasks.workunit.client.0.smithi087.stdout:3/974: write d6/d1b/d42/dd4/dd1/ffa [684990,34778] 0 2024-09-17T07:20:05.934 INFO:tasks.workunit.client.1.smithi139.stdout:4/707: mkdir d0/db/d7f/db0/de0 0 2024-09-17T07:20:05.935 INFO:tasks.workunit.client.0.smithi087.stdout:2/792: symlink d2/d48/d69/lfc 0 2024-09-17T07:20:05.937 INFO:tasks.workunit.client.0.smithi087.stdout:1/881: symlink d2/dc/l133 0 2024-09-17T07:20:05.938 INFO:tasks.workunit.client.0.smithi087.stdout:6/978: write d1/d67/dfe/d2c/d58/fb8 [1684597,119348] 0 2024-09-17T07:20:05.942 INFO:tasks.workunit.client.0.smithi087.stdout:3/975: mknod d6/d15/d37/d3c/d43/db7/de3/d108/c15e 0 2024-09-17T07:20:05.943 INFO:tasks.workunit.client.1.smithi139.stdout:4/708: truncate d0/d49/f8b 2251740 0 2024-09-17T07:20:05.944 INFO:tasks.workunit.client.0.smithi087.stdout:6/979: stat d1/d67/dfe/d2c/d58/cc7 0 2024-09-17T07:20:05.944 INFO:tasks.workunit.client.0.smithi087.stdout:2/793: dread d2/d7/dd/d10/d4c/dcc/fcd [0,4194304] 0 2024-09-17T07:20:05.944 INFO:tasks.workunit.client.0.smithi087.stdout:8/913: getdents d1/d2b/d3b/d53 0 2024-09-17T07:20:05.945 INFO:tasks.workunit.client.0.smithi087.stdout:7/765: sync 2024-09-17T07:20:05.945 INFO:tasks.workunit.client.1.smithi139.stdout:4/709: mknod d0/d10/ce1 0 2024-09-17T07:20:05.945 INFO:tasks.workunit.client.0.smithi087.stdout:9/841: rename d3/d4/d6/d8/df1/cb8 to d3/c124 0 2024-09-17T07:20:05.946 INFO:tasks.workunit.client.0.smithi087.stdout:3/976: fdatasync d6/d1b/d42/d62/dbb/fbf 0 2024-09-17T07:20:05.946 INFO:tasks.workunit.client.1.smithi139.stdout:4/710: mknod d0/d1/d29/d6d/ce2 0 2024-09-17T07:20:05.947 INFO:tasks.workunit.client.1.smithi139.stdout:4/711: fsync d0/db/d58/f5e 0 2024-09-17T07:20:05.949 INFO:tasks.workunit.client.0.smithi087.stdout:2/794: unlink d2/d7/d60/l82 0 2024-09-17T07:20:05.950 INFO:tasks.workunit.client.1.smithi139.stdout:4/712: creat d0/fe3 x:0 0 0 2024-09-17T07:20:05.951 INFO:tasks.workunit.client.0.smithi087.stdout:1/882: getdents d2/d3d 0 2024-09-17T07:20:05.953 INFO:tasks.workunit.client.1.smithi139.stdout:4/713: stat d0/d1/dbe/f3e 0 2024-09-17T07:20:05.953 INFO:tasks.workunit.client.0.smithi087.stdout:9/842: creat d3/d25/d83/f125 x:0 0 0 2024-09-17T07:20:05.954 INFO:tasks.workunit.client.1.smithi139.stdout:5/858: dread d4/d16/d1b/d20/d67/d88/f8d [0,4194304] 0 2024-09-17T07:20:05.954 INFO:tasks.workunit.client.1.smithi139.stdout:4/714: read - d0/d1/d29/d6d/faa zero size 2024-09-17T07:20:05.956 INFO:tasks.workunit.client.0.smithi087.stdout:8/914: dwrite d1/d2b/d21/dd4/f12c [0,4194304] 0 2024-09-17T07:20:05.958 INFO:tasks.workunit.client.1.smithi139.stdout:5/859: write d4/d16/d69/fd7 [508125,34184] 0 2024-09-17T07:20:05.960 INFO:tasks.workunit.client.0.smithi087.stdout:2/795: dread - d2/d7/dd/d10/d4c/d5f/d8b/fc2 zero size 2024-09-17T07:20:05.966 INFO:tasks.workunit.client.0.smithi087.stdout:1/883: mknod d2/d3d/df3/c134 0 2024-09-17T07:20:05.966 INFO:tasks.workunit.client.0.smithi087.stdout:6/980: write d1/f42 [1341229,34879] 0 2024-09-17T07:20:05.967 INFO:tasks.workunit.client.0.smithi087.stdout:9/843: dread d3/d4/d6/d8/d22/d43/d84/f72 [0,4194304] 0 2024-09-17T07:20:05.970 INFO:tasks.workunit.client.0.smithi087.stdout:9/844: readlink d3/d4/d6/la0 0 2024-09-17T07:20:05.971 INFO:tasks.workunit.client.1.smithi139.stdout:5/860: write d4/d16/f1d [2002721,47831] 0 2024-09-17T07:20:05.971 INFO:tasks.workunit.client.0.smithi087.stdout:7/766: dread d0/d3/d23/d17/f1e [4194304,4194304] 0 2024-09-17T07:20:05.972 INFO:tasks.workunit.client.0.smithi087.stdout:1/884: mknod d2/d3d/d35/c135 0 2024-09-17T07:20:05.974 INFO:tasks.workunit.client.0.smithi087.stdout:6/981: creat d1/d6a/d122/f147 x:0 0 0 2024-09-17T07:20:05.974 INFO:tasks.workunit.client.0.smithi087.stdout:3/977: write d6/d15/d37/d3c/d52/db2/de7/f81 [2662871,59833] 0 2024-09-17T07:20:05.977 INFO:tasks.workunit.client.0.smithi087.stdout:2/796: write d2/f3 [791062,18199] 0 2024-09-17T07:20:05.977 INFO:tasks.workunit.client.1.smithi139.stdout:5/861: dwrite d4/d16/d1b/d20/d38/d4f/f5c [0,4194304] 0 2024-09-17T07:20:05.978 INFO:tasks.workunit.client.0.smithi087.stdout:7/767: mkdir d0/d3/d10/d32/d8c/de8 0 2024-09-17T07:20:05.978 INFO:tasks.workunit.client.0.smithi087.stdout:8/915: dwrite d1/d7/d9/d19/d4d/d11f/da1/fc7 [0,4194304] 0 2024-09-17T07:20:05.979 INFO:tasks.workunit.client.0.smithi087.stdout:1/885: symlink d2/l136 0 2024-09-17T07:20:05.979 INFO:tasks.workunit.client.1.smithi139.stdout:5/862: truncate d4/f36 848462 0 2024-09-17T07:20:05.980 INFO:tasks.workunit.client.0.smithi087.stdout:3/978: chown d6/d1b/d42/d62/ccf 696 1 2024-09-17T07:20:05.981 INFO:tasks.workunit.client.1.smithi139.stdout:4/715: dread d0/db/f4a [0,4194304] 0 2024-09-17T07:20:05.981 INFO:tasks.workunit.client.0.smithi087.stdout:6/982: creat d1/d67/dfe/d2c/d48/f148 x:0 0 0 2024-09-17T07:20:05.982 INFO:tasks.workunit.client.1.smithi139.stdout:4/716: write d0/d10/fc5 [781860,5327] 0 2024-09-17T07:20:05.983 INFO:tasks.workunit.client.0.smithi087.stdout:9/845: creat d3/d4/d16/d69/d8a/d1e/d90/d93/d96/f126 x:0 0 0 2024-09-17T07:20:05.983 INFO:tasks.workunit.client.0.smithi087.stdout:1/886: write d2/dc/f3a [1720369,64290] 0 2024-09-17T07:20:05.986 INFO:tasks.workunit.client.0.smithi087.stdout:7/768: truncate d0/d3/d10/f5d 850261 0 2024-09-17T07:20:05.987 INFO:tasks.workunit.client.0.smithi087.stdout:8/916: symlink d1/d2b/d3b/d53/dfd/l143 0 2024-09-17T07:20:05.988 INFO:tasks.workunit.client.0.smithi087.stdout:3/979: read d6/d15/d37/d3c/d52/db2/de7/f36 [840872,103352] 0 2024-09-17T07:20:05.988 INFO:tasks.workunit.client.0.smithi087.stdout:1/887: chown d2/d69/d8d/da6/fe4 1263 1 2024-09-17T07:20:05.989 INFO:tasks.workunit.client.0.smithi087.stdout:3/980: fdatasync d6/d15/f137 0 2024-09-17T07:20:05.991 INFO:tasks.workunit.client.1.smithi139.stdout:4/717: dwrite d0/f82 [0,4194304] 0 2024-09-17T07:20:05.991 INFO:tasks.workunit.client.0.smithi087.stdout:2/797: link d2/f7c d2/d7/dd/d10/d91/dea/ffd 0 2024-09-17T07:20:05.996 INFO:tasks.workunit.client.0.smithi087.stdout:2/798: chown d2/d15/dce/dd1/d3f/fa6 35431609 1 2024-09-17T07:20:05.996 INFO:tasks.workunit.client.0.smithi087.stdout:2/799: readlink d2/d96/lf8 0 2024-09-17T07:20:05.996 INFO:tasks.workunit.client.0.smithi087.stdout:1/888: mkdir d2/d3d/d35/d57/d73/d137 0 2024-09-17T07:20:05.997 INFO:tasks.workunit.client.0.smithi087.stdout:8/917: creat d1/d2b/d3b/d53/d105/f144 x:0 0 0 2024-09-17T07:20:06.000 INFO:tasks.workunit.client.1.smithi139.stdout:5/863: dwrite d4/d16/d1b/d20/d67/d88/f99 [0,4194304] 0 2024-09-17T07:20:06.002 INFO:tasks.workunit.client.0.smithi087.stdout:7/769: dwrite d0/d3/d23/d4e/fe7 [0,4194304] 0 2024-09-17T07:20:06.002 INFO:tasks.workunit.client.1.smithi139.stdout:4/718: dwrite d0/d1/d54/f97 [0,4194304] 0 2024-09-17T07:20:06.003 INFO:tasks.workunit.client.0.smithi087.stdout:3/981: rename d6/c4d to d6/d1b/d42/d95/db3/c15f 0 2024-09-17T07:20:06.004 INFO:tasks.workunit.client.1.smithi139.stdout:4/719: truncate d0/d1/d54/d93/fcd 808296 0 2024-09-17T07:20:06.006 INFO:tasks.workunit.client.0.smithi087.stdout:2/800: rmdir d2/d15/dce/dd1/d3f/df3 39 2024-09-17T07:20:06.006 INFO:tasks.workunit.client.1.smithi139.stdout:5/864: mknod d4/d16/d1b/d20/d28/d3f/dcc/c11e 0 2024-09-17T07:20:06.007 INFO:tasks.workunit.client.0.smithi087.stdout:1/889: dread d2/d3d/df3/f118 [0,4194304] 0 2024-09-17T07:20:06.007 INFO:tasks.workunit.client.0.smithi087.stdout:8/918: mknod d1/d7/d9/d19/d4d/d11f/c145 0 2024-09-17T07:20:06.008 INFO:tasks.workunit.client.1.smithi139.stdout:5/865: readlink d4/d16/d1b/d20/d32/d6c/dc9/l109 0 2024-09-17T07:20:06.008 INFO:tasks.workunit.client.0.smithi087.stdout:1/890: fdatasync d2/dcf/d7e/db9/feb 0 2024-09-17T07:20:06.009 INFO:tasks.workunit.client.1.smithi139.stdout:4/720: rename d0/d1/dbe/d70 to d0/d1/d29/d6a/db6/de4 0 2024-09-17T07:20:06.009 INFO:tasks.workunit.client.0.smithi087.stdout:7/770: symlink d0/le9 0 2024-09-17T07:20:06.010 INFO:tasks.workunit.client.0.smithi087.stdout:7/771: stat d0/d3/d10/f38 0 2024-09-17T07:20:06.011 INFO:tasks.workunit.client.0.smithi087.stdout:1/891: write d2/dcf/f4d [1120544,73920] 0 2024-09-17T07:20:06.012 INFO:tasks.workunit.client.1.smithi139.stdout:5/866: creat d4/d16/d1b/d20/d32/d6c/f11f x:0 0 0 2024-09-17T07:20:06.016 INFO:tasks.workunit.client.0.smithi087.stdout:3/982: fdatasync d6/d15/d37/d3c/d43/db7/fdb 0 2024-09-17T07:20:06.017 INFO:tasks.workunit.client.0.smithi087.stdout:8/919: chown d1/d7/d9/d19/f9d 2594 1 2024-09-17T07:20:06.017 INFO:tasks.workunit.client.1.smithi139.stdout:5/867: creat d4/d16/d69/f120 x:0 0 0 2024-09-17T07:20:06.017 INFO:tasks.workunit.client.1.smithi139.stdout:4/721: dwrite d0/db/f6c [0,4194304] 0 2024-09-17T07:20:06.018 INFO:tasks.workunit.client.1.smithi139.stdout:5/868: read - d4/d16/d1b/d20/d32/d6c/dc9/dcb/ff2 zero size 2024-09-17T07:20:06.019 INFO:tasks.workunit.client.1.smithi139.stdout:4/722: symlink d0/db/d7f/db0/de0/le5 0 2024-09-17T07:20:06.020 INFO:tasks.workunit.client.0.smithi087.stdout:8/920: readlink d1/d7/d9/d19/d4d/d11f/le7 0 2024-09-17T07:20:06.026 INFO:tasks.workunit.client.0.smithi087.stdout:8/921: chown d1/d7/d9/d19/d4d/f47 371608756 1 2024-09-17T07:20:06.028 INFO:tasks.workunit.client.0.smithi087.stdout:2/801: getdents d2/d48 0 2024-09-17T07:20:06.033 INFO:tasks.workunit.client.0.smithi087.stdout:7/772: dwrite d0/d36/d8e/fdd [0,4194304] 0 2024-09-17T07:20:06.034 INFO:tasks.workunit.client.0.smithi087.stdout:1/892: dwrite d2/d3d/d35/ffe [0,4194304] 0 2024-09-17T07:20:06.036 INFO:tasks.workunit.client.0.smithi087.stdout:7/773: stat d0/d36/l69 0 2024-09-17T07:20:06.046 INFO:tasks.workunit.client.0.smithi087.stdout:6/983: dread d1/d67/dfe/d2c/d48/d9b/fcd [0,4194304] 0 2024-09-17T07:20:06.046 INFO:tasks.workunit.client.0.smithi087.stdout:8/922: truncate d1/d7/d9/d19/d4d/d11f/f69 4545669 0 2024-09-17T07:20:06.051 INFO:tasks.workunit.client.0.smithi087.stdout:9/846: dwrite d3/d4/d6/d8/d22/d43/f45 [0,4194304] 0 2024-09-17T07:20:06.057 INFO:tasks.workunit.client.0.smithi087.stdout:8/923: dwrite d1/d2b/d21/d6d/d6f/f135 [0,4194304] 0 2024-09-17T07:20:06.067 INFO:tasks.workunit.client.1.smithi139.stdout:4/723: truncate d0/db/d58/f91 168679 0 2024-09-17T07:20:06.069 INFO:tasks.workunit.client.1.smithi139.stdout:4/724: write d0/d1/d29/d6d/faa [695281,49642] 0 2024-09-17T07:20:06.073 INFO:tasks.workunit.client.1.smithi139.stdout:4/725: dread d0/db/f4a [0,4194304] 0 2024-09-17T07:20:06.077 INFO:tasks.workunit.client.1.smithi139.stdout:4/726: getdents d0/d1/d9b/d83 0 2024-09-17T07:20:06.078 INFO:tasks.workunit.client.1.smithi139.stdout:4/727: chown d0/d1/dbe/f3e 85606168 1 2024-09-17T07:20:06.080 INFO:tasks.workunit.client.1.smithi139.stdout:4/728: truncate d0/db/d17/f2d 2341998 0 2024-09-17T07:20:06.082 INFO:tasks.workunit.client.1.smithi139.stdout:4/729: fsync d0/d1/d54/f5b 0 2024-09-17T07:20:06.083 INFO:tasks.workunit.client.1.smithi139.stdout:4/730: dread - d0/db/db2/db5/fc6 zero size 2024-09-17T07:20:06.085 INFO:tasks.workunit.client.1.smithi139.stdout:4/731: read d0/d1/d29/d41/f5c [158446,68407] 0 2024-09-17T07:20:06.088 INFO:tasks.workunit.client.1.smithi139.stdout:4/732: symlink d0/db/db2/db5/le6 0 2024-09-17T07:20:06.089 INFO:tasks.workunit.client.1.smithi139.stdout:4/733: write d0/f4 [626157,94769] 0 2024-09-17T07:20:06.092 INFO:tasks.workunit.client.1.smithi139.stdout:4/734: mkdir d0/d1/de7 0 2024-09-17T07:20:06.095 INFO:tasks.workunit.client.1.smithi139.stdout:4/735: mknod d0/d1/d29/d41/dad/ce8 0 2024-09-17T07:20:06.096 INFO:tasks.workunit.client.1.smithi139.stdout:4/736: chown d0/db/d17/daf/cd5 2781 1 2024-09-17T07:20:06.101 INFO:tasks.workunit.client.0.smithi087.stdout:2/802: chown d2/d24/d36/f38 2083350 1 2024-09-17T07:20:06.102 INFO:tasks.workunit.client.1.smithi139.stdout:4/737: dwrite d0/d1/fd [4194304,4194304] 0 2024-09-17T07:20:06.104 INFO:tasks.workunit.client.1.smithi139.stdout:4/738: rmdir d0/d1/dbe 39 2024-09-17T07:20:06.108 INFO:tasks.workunit.client.1.smithi139.stdout:4/739: rename d0/d1/d9b to d0/de9 0 2024-09-17T07:20:06.110 INFO:tasks.workunit.client.1.smithi139.stdout:4/740: write d0/d1/d29/d6d/f86 [6578060,44542] 0 2024-09-17T07:20:06.113 INFO:tasks.workunit.client.1.smithi139.stdout:4/741: rmdir d0/db/d17 39 2024-09-17T07:20:06.114 INFO:tasks.workunit.client.1.smithi139.stdout:4/742: truncate d0/d10/fc5 1143001 0 2024-09-17T07:20:06.121 INFO:tasks.workunit.client.1.smithi139.stdout:4/743: dwrite d0/d1/d29/d41/f8a [0,4194304] 0 2024-09-17T07:20:06.125 INFO:tasks.workunit.client.1.smithi139.stdout:4/744: unlink d0/d10/fc9 0 2024-09-17T07:20:06.129 INFO:tasks.workunit.client.1.smithi139.stdout:4/745: fdatasync d0/db/f74 0 2024-09-17T07:20:06.133 INFO:tasks.workunit.client.1.smithi139.stdout:4/746: rename d0/d1/d29/l2a to d0/db/db2/db5/lea 0 2024-09-17T07:20:06.143 INFO:tasks.workunit.client.1.smithi139.stdout:4/747: creat d0/d1/d29/feb x:0 0 0 2024-09-17T07:20:06.145 INFO:tasks.workunit.client.1.smithi139.stdout:4/748: mknod d0/d10/cec 0 2024-09-17T07:20:06.147 INFO:tasks.workunit.client.1.smithi139.stdout:4/749: mkdir d0/d1/de7/ded 0 2024-09-17T07:20:06.150 INFO:tasks.workunit.client.1.smithi139.stdout:4/750: creat d0/d1/d29/d6d/db3/fee x:0 0 0 2024-09-17T07:20:06.152 INFO:tasks.workunit.client.0.smithi087.stdout:6/984: mknod d1/d6a/d122/c149 0 2024-09-17T07:20:06.154 INFO:tasks.workunit.client.0.smithi087.stdout:1/893: chown d2/dcf/d7e/la1 90 1 2024-09-17T07:20:06.155 INFO:tasks.workunit.client.1.smithi139.stdout:4/751: rename d0/d37/fc1 to d0/d1/d29/d6a/fef 0 2024-09-17T07:20:06.156 INFO:tasks.workunit.client.0.smithi087.stdout:1/894: write d2/dcf/d7e/db9/dfb/d101/f102 [394960,97637] 0 2024-09-17T07:20:06.157 INFO:tasks.workunit.client.1.smithi139.stdout:4/752: mkdir d0/db/d58/df0 0 2024-09-17T07:20:06.157 INFO:tasks.workunit.client.1.smithi139.stdout:4/753: fsync d0/db/d58/f5e 0 2024-09-17T07:20:06.160 INFO:tasks.workunit.client.0.smithi087.stdout:8/924: truncate d1/d7/d9/d19/d1b/f1c 905273 0 2024-09-17T07:20:06.164 INFO:tasks.workunit.client.0.smithi087.stdout:6/985: creat d1/d67/dfe/d5e/d8f/dd5/f14a x:0 0 0 2024-09-17T07:20:06.165 INFO:tasks.workunit.client.1.smithi139.stdout:4/754: dwrite d0/d1/d29/d41/fbb [0,4194304] 0 2024-09-17T07:20:06.166 INFO:tasks.workunit.client.0.smithi087.stdout:1/895: fdatasync d2/dcf/f67 0 2024-09-17T07:20:06.168 INFO:tasks.workunit.client.0.smithi087.stdout:8/925: dwrite d1/d7/d9/d19/f12f [0,4194304] 0 2024-09-17T07:20:06.168 INFO:tasks.workunit.client.0.smithi087.stdout:1/896: write d2/d14/f60 [3019769,22340] 0 2024-09-17T07:20:06.174 INFO:tasks.workunit.client.0.smithi087.stdout:9/847: getdents d3/d4/d6/d8 0 2024-09-17T07:20:06.175 INFO:tasks.workunit.client.0.smithi087.stdout:1/897: write d2/dcf/d7e/db9/fbc [2937311,26719] 0 2024-09-17T07:20:06.181 INFO:tasks.workunit.client.0.smithi087.stdout:1/898: rmdir d2/d3d/d45/d90/d43 39 2024-09-17T07:20:06.181 INFO:tasks.workunit.client.0.smithi087.stdout:6/986: dwrite d1/d67/dfe/d2c/d48/d118/d132/f135 [0,4194304] 0 2024-09-17T07:20:06.182 INFO:tasks.workunit.client.0.smithi087.stdout:9/848: chown d3/d4/f98 9277925 1 2024-09-17T07:20:06.185 INFO:tasks.workunit.client.0.smithi087.stdout:8/926: dwrite d1/d2b/df4/d54/f13a [0,4194304] 0 2024-09-17T07:20:06.186 INFO:tasks.workunit.client.0.smithi087.stdout:8/927: chown d1/d5f 0 1 2024-09-17T07:20:06.188 INFO:tasks.workunit.client.0.smithi087.stdout:1/899: truncate d2/d3d/db4/fc9 345931 0 2024-09-17T07:20:06.190 INFO:tasks.workunit.client.1.smithi139.stdout:8/924: sync 2024-09-17T07:20:06.191 INFO:tasks.workunit.client.0.smithi087.stdout:9/849: mkdir d3/d4/d6/d8/d22/d92/da3/d113/d127 0 2024-09-17T07:20:06.193 INFO:tasks.workunit.client.1.smithi139.stdout:8/925: readlink d0/d20/d28/d52/d65/dbe/deb/l112 0 2024-09-17T07:20:06.193 INFO:tasks.workunit.client.0.smithi087.stdout:8/928: creat d1/d2b/d21/daf/dd7/f146 x:0 0 0 2024-09-17T07:20:06.194 INFO:tasks.workunit.client.0.smithi087.stdout:1/900: mknod d2/d11a/c138 0 2024-09-17T07:20:06.194 INFO:tasks.workunit.client.0.smithi087.stdout:9/850: readlink d3/d4/d16/d69/d8a/d1e/d90/lca 0 2024-09-17T07:20:06.199 INFO:tasks.workunit.client.0.smithi087.stdout:8/929: dread d1/d2b/ff7 [0,4194304] 0 2024-09-17T07:20:06.200 INFO:tasks.workunit.client.0.smithi087.stdout:1/901: mknod d2/dcf/d12f/c139 0 2024-09-17T07:20:06.201 INFO:tasks.workunit.client.0.smithi087.stdout:9/851: mkdir d3/d4/d6/d8/d22/d92/da3/d113/d127/d128 0 2024-09-17T07:20:06.202 INFO:tasks.workunit.client.0.smithi087.stdout:8/930: dread - d1/d7/d63/f140 zero size 2024-09-17T07:20:06.202 INFO:tasks.workunit.client.0.smithi087.stdout:9/852: fdatasync d3/d4/d6/d8/f78 0 2024-09-17T07:20:06.204 INFO:tasks.workunit.client.0.smithi087.stdout:8/931: stat d1/d7/d9/d19/d4d/cf3 0 2024-09-17T07:20:06.207 INFO:tasks.workunit.client.0.smithi087.stdout:9/853: creat d3/d4/d6/d8/d22/d92/da3/d113/f129 x:0 0 0 2024-09-17T07:20:06.208 INFO:tasks.workunit.client.0.smithi087.stdout:9/854: readlink d3/d4/d6/d8/d22/d64/le6 0 2024-09-17T07:20:06.208 INFO:tasks.workunit.client.0.smithi087.stdout:8/932: truncate d1/d7/d9/d19/d73/f97 693343 0 2024-09-17T07:20:06.210 INFO:tasks.workunit.client.0.smithi087.stdout:8/933: write d1/d2b/d21/d6d/ffc [2530065,78421] 0 2024-09-17T07:20:06.212 INFO:tasks.workunit.client.0.smithi087.stdout:6/987: dread d1/d67/dfe/d4e/f50 [0,4194304] 0 2024-09-17T07:20:06.215 INFO:tasks.workunit.client.0.smithi087.stdout:6/988: read d1/d67/dfe/d2c/d48/d118/d132/f135 [966043,64997] 0 2024-09-17T07:20:06.216 INFO:tasks.workunit.client.0.smithi087.stdout:9/855: link d3/d4/d16/d69/d8a/d1e/d90/f10e d3/d4/d16/d69/d8a/d1e/f12a 0 2024-09-17T07:20:06.220 INFO:tasks.workunit.client.0.smithi087.stdout:6/989: chown d1/d67/dfe/d2c/d48/f8c 1803810 1 2024-09-17T07:20:06.220 INFO:tasks.workunit.client.0.smithi087.stdout:8/934: dwrite d1/d7/d9/d19/d73/f8c [0,4194304] 0 2024-09-17T07:20:06.221 INFO:tasks.workunit.client.0.smithi087.stdout:9/856: mkdir d3/d4/d16/d69/d8a/d12b 0 2024-09-17T07:20:06.222 INFO:tasks.workunit.client.0.smithi087.stdout:6/990: write d1/d67/dfe/d2c/d40/f49 [6861254,86343] 0 2024-09-17T07:20:06.223 INFO:tasks.workunit.client.0.smithi087.stdout:8/935: creat d1/d2b/d3b/d53/d105/f147 x:0 0 0 2024-09-17T07:20:06.225 INFO:tasks.workunit.client.0.smithi087.stdout:1/902: dread d2/d14/fac [0,4194304] 0 2024-09-17T07:20:06.226 INFO:tasks.workunit.client.0.smithi087.stdout:6/991: mknod d1/d67/d110/c14b 0 2024-09-17T07:20:06.227 INFO:tasks.workunit.client.0.smithi087.stdout:8/936: symlink d1/d7/d9/d19/d1b/d18/l148 0 2024-09-17T07:20:06.229 INFO:tasks.workunit.client.0.smithi087.stdout:6/992: read d1/d67/dfe/d2c/d40/d4c/dce/ff1 [2740528,4889] 0 2024-09-17T07:20:06.230 INFO:tasks.workunit.client.0.smithi087.stdout:1/903: creat d2/d3d/d35/d4f/da5/f13a x:0 0 0 2024-09-17T07:20:06.232 INFO:tasks.workunit.client.0.smithi087.stdout:8/937: mkdir d1/d2b/d21/d6d/d6f/d149 0 2024-09-17T07:20:06.234 INFO:tasks.workunit.client.0.smithi087.stdout:6/993: fsync d1/d67/dfe/d2c/d40/f4d 0 2024-09-17T07:20:06.238 INFO:tasks.workunit.client.0.smithi087.stdout:8/938: mkdir d1/d7/d9/d19/d4d/d11f/d130/d14a 0 2024-09-17T07:20:06.241 INFO:tasks.workunit.client.0.smithi087.stdout:6/994: link d1/d67/dfe/d4e/l7f d1/d67/dfe/d5e/l14c 0 2024-09-17T07:20:06.242 INFO:tasks.workunit.client.0.smithi087.stdout:6/995: fdatasync d1/f113 0 2024-09-17T07:20:06.248 INFO:tasks.workunit.client.0.smithi087.stdout:6/996: dread d1/d67/dfe/d5e/fe0 [0,4194304] 0 2024-09-17T07:20:06.248 INFO:tasks.workunit.client.0.smithi087.stdout:3/983: rename d6/d15/d37/d3c/d52/db2/d10a/d11b/d120/le9 to d6/d15/l160 0 2024-09-17T07:20:06.250 INFO:tasks.workunit.client.0.smithi087.stdout:7/774: rename d0/d3/d10/d87/la4 to d0/d3/d10/d32/d62/d76/lea 0 2024-09-17T07:20:06.252 INFO:tasks.workunit.client.0.smithi087.stdout:6/997: mkdir d1/d67/dfe/d2c/d48/d9b/d14d 0 2024-09-17T07:20:06.253 INFO:tasks.workunit.client.0.smithi087.stdout:6/998: readlink d1/d67/dfe/d2c/d48/d62/l137 0 2024-09-17T07:20:06.254 INFO:tasks.workunit.client.0.smithi087.stdout:7/775: readlink d0/d3/d23/d4e/ldc 0 2024-09-17T07:20:06.258 INFO:tasks.workunit.client.0.smithi087.stdout:3/984: getdents d6/d15/d37/d3c 0 2024-09-17T07:20:06.259 INFO:tasks.workunit.client.0.smithi087.stdout:7/776: mkdir d0/d36/deb 0 2024-09-17T07:20:06.260 INFO:tasks.workunit.client.0.smithi087.stdout:3/985: mknod d6/d15/d37/d3c/d43/d114/c161 0 2024-09-17T07:20:06.261 INFO:tasks.workunit.client.0.smithi087.stdout:7/777: creat d0/d3/d23/d17/fec x:0 0 0 2024-09-17T07:20:06.262 INFO:tasks.workunit.client.0.smithi087.stdout:8/939: unlink d1/d2b/d21/fdf 0 2024-09-17T07:20:06.263 INFO:tasks.workunit.client.0.smithi087.stdout:7/778: truncate d0/d3/d10/d87/fd3 504620 0 2024-09-17T07:20:06.263 INFO:tasks.workunit.client.0.smithi087.stdout:8/940: write d1/fd6 [509071,39353] 0 2024-09-17T07:20:06.264 INFO:tasks.workunit.client.0.smithi087.stdout:3/986: unlink d6/d15/d37/d3c/f54 0 2024-09-17T07:20:06.264 INFO:tasks.workunit.client.0.smithi087.stdout:7/779: chown d0/d3/l55 1541016611 1 2024-09-17T07:20:06.267 INFO:tasks.workunit.client.0.smithi087.stdout:3/987: symlink d6/d15/d37/d3c/d43/l162 0 2024-09-17T07:20:06.267 INFO:tasks.workunit.client.0.smithi087.stdout:3/988: chown d6/d15/d92/c150 3129811 1 2024-09-17T07:20:06.268 INFO:tasks.workunit.client.0.smithi087.stdout:8/941: symlink d1/d7/d9/d19/l14b 0 2024-09-17T07:20:06.268 INFO:tasks.workunit.client.0.smithi087.stdout:3/989: fdatasync d6/d1b/d42/d6e/db0/f126 0 2024-09-17T07:20:06.269 INFO:tasks.workunit.client.0.smithi087.stdout:7/780: creat d0/d7a/fed x:0 0 0 2024-09-17T07:20:06.270 INFO:tasks.workunit.client.0.smithi087.stdout:8/942: chown d1/d7/d9/d19/d4d/d11f/da1/db2/ce3 63778 1 2024-09-17T07:20:06.272 INFO:tasks.workunit.client.0.smithi087.stdout:7/781: symlink d0/lee 0 2024-09-17T07:20:06.277 INFO:tasks.workunit.client.0.smithi087.stdout:1/904: creat d2/f13b x:0 0 0 2024-09-17T07:20:06.280 INFO:tasks.workunit.client.0.smithi087.stdout:3/990: dwrite d6/d1b/d42/dd4/dd1/de4/f129 [0,4194304] 0 2024-09-17T07:20:06.284 INFO:tasks.workunit.client.0.smithi087.stdout:8/943: dwrite d1/d7/d9/d19/fae [0,4194304] 0 2024-09-17T07:20:06.287 INFO:tasks.workunit.client.0.smithi087.stdout:8/944: fsync d1/d2b/d3b/d53/d105/f144 0 2024-09-17T07:20:06.289 INFO:tasks.workunit.client.0.smithi087.stdout:3/991: symlink d6/d15/d37/d3c/d52/db2/d10a/l163 0 2024-09-17T07:20:06.291 INFO:tasks.workunit.client.0.smithi087.stdout:7/782: dread d0/f3b [0,4194304] 0 2024-09-17T07:20:06.292 INFO:tasks.workunit.client.0.smithi087.stdout:8/945: dread d1/d2b/d21/dd4/f104 [0,4194304] 0 2024-09-17T07:20:06.293 INFO:tasks.workunit.client.0.smithi087.stdout:7/783: write d0/d3/d23/f54 [1094510,26778] 0 2024-09-17T07:20:06.295 INFO:tasks.workunit.client.0.smithi087.stdout:7/784: write d0/d3/d10/d87/fd3 [780425,73489] 0 2024-09-17T07:20:06.296 INFO:tasks.workunit.client.0.smithi087.stdout:3/992: creat d6/d15/d37/d3c/d52/db2/de7/ddd/d139/f164 x:0 0 0 2024-09-17T07:20:06.301 INFO:tasks.workunit.client.0.smithi087.stdout:6/999: write d1/d67/dfe/d2c/d33/f8e [924348,88939] 0 2024-09-17T07:20:06.302 INFO:tasks.workunit.client.0.smithi087.stdout:7/785: mkdir d0/d3/d23/d2d/def 0 2024-09-17T07:20:06.303 INFO:tasks.workunit.client.0.smithi087.stdout:7/786: fdatasync d0/d36/d8e/da2/fdb 0 2024-09-17T07:20:06.307 INFO:tasks.workunit.client.0.smithi087.stdout:7/787: getdents d0/d36/db3 0 2024-09-17T07:20:06.309 INFO:tasks.workunit.client.0.smithi087.stdout:7/788: mkdir d0/d7a/df0 0 2024-09-17T07:20:06.310 INFO:tasks.workunit.client.0.smithi087.stdout:1/905: write d2/d3d/d45/d90/d37/f38 [4510408,16229] 0 2024-09-17T07:20:06.313 INFO:tasks.workunit.client.0.smithi087.stdout:8/946: truncate d1/d2b/f42 3483426 0 2024-09-17T07:20:06.314 INFO:tasks.workunit.client.0.smithi087.stdout:1/906: rename d2/c31 to d2/d3d/d45/d90/d37/c13c 0 2024-09-17T07:20:06.316 INFO:tasks.workunit.client.0.smithi087.stdout:8/947: creat d1/d7/d9/d19/d1b/d18/de6/f14c x:0 0 0 2024-09-17T07:20:06.316 INFO:tasks.workunit.client.0.smithi087.stdout:1/907: symlink d2/dcf/d7e/l13d 0 2024-09-17T07:20:06.319 INFO:tasks.workunit.client.0.smithi087.stdout:8/948: write d1/d2b/d21/f9c [4552441,94069] 0 2024-09-17T07:20:06.321 INFO:tasks.workunit.client.0.smithi087.stdout:3/993: dwrite d6/f12 [0,4194304] 0 2024-09-17T07:20:06.323 INFO:tasks.workunit.client.0.smithi087.stdout:8/949: symlink d1/d2b/df4/l14d 0 2024-09-17T07:20:06.328 INFO:tasks.workunit.client.0.smithi087.stdout:1/908: dwrite d2/f13b [0,4194304] 0 2024-09-17T07:20:06.331 INFO:tasks.workunit.client.0.smithi087.stdout:3/994: mkdir d6/d1b/d42/d62/d165 0 2024-09-17T07:20:06.331 INFO:tasks.workunit.client.0.smithi087.stdout:8/950: creat d1/d2b/f14e x:0 0 0 2024-09-17T07:20:06.333 INFO:tasks.workunit.client.0.smithi087.stdout:8/951: stat d1/d7/d9/d19/d1b 0 2024-09-17T07:20:06.335 INFO:tasks.workunit.client.0.smithi087.stdout:1/909: symlink d2/dcf/d7e/db9/dfb/l13e 0 2024-09-17T07:20:06.335 INFO:tasks.workunit.client.0.smithi087.stdout:8/952: fsync d1/d7/d9/d19/d4d/d11f/da1/f13f 0 2024-09-17T07:20:06.336 INFO:tasks.workunit.client.0.smithi087.stdout:1/910: dread - d2/d3d/f49 zero size 2024-09-17T07:20:06.337 INFO:tasks.workunit.client.0.smithi087.stdout:3/995: read d6/d10d/f144 [3941032,45036] 0 2024-09-17T07:20:06.337 INFO:tasks.workunit.client.0.smithi087.stdout:1/911: symlink d2/d69/d8d/l13f 0 2024-09-17T07:20:06.342 INFO:tasks.workunit.client.0.smithi087.stdout:1/912: mknod d2/d1a/d117/c140 0 2024-09-17T07:20:06.345 INFO:tasks.workunit.client.0.smithi087.stdout:1/913: mkdir d2/d3d/d35/d57/d141 0 2024-09-17T07:20:06.345 INFO:tasks.workunit.client.0.smithi087.stdout:3/996: dwrite d6/fdf [0,4194304] 0 2024-09-17T07:20:06.353 INFO:tasks.workunit.client.0.smithi087.stdout:3/997: link d6/d1b/d42/d62/dc1/l11a d6/d15/d37/d3c/d43/db7/de3/l166 0 2024-09-17T07:20:06.353 INFO:tasks.workunit.client.0.smithi087.stdout:8/953: write d1/d7/d9/d19/d1b/f1c [452378,46136] 0 2024-09-17T07:20:06.355 INFO:tasks.workunit.client.0.smithi087.stdout:1/914: dwrite d2/d69/d8d/da6/fe4 [0,4194304] 0 2024-09-17T07:20:06.356 INFO:tasks.workunit.client.0.smithi087.stdout:1/915: chown d2/d14 3 1 2024-09-17T07:20:06.357 INFO:tasks.workunit.client.0.smithi087.stdout:3/998: write d6/d15/d37/d3c/d52/db2/d102/f115 [65677,28505] 0 2024-09-17T07:20:06.360 INFO:tasks.workunit.client.0.smithi087.stdout:8/954: rename d1/d7/d9/d19/d73/l8e to d1/d7/d63/l14f 0 2024-09-17T07:20:06.360 INFO:tasks.workunit.client.0.smithi087.stdout:1/916: mkdir d2/d69/d142 0 2024-09-17T07:20:06.363 INFO:tasks.workunit.client.0.smithi087.stdout:8/955: symlink d1/d2b/d3b/d53/l150 0 2024-09-17T07:20:06.366 INFO:tasks.workunit.client.0.smithi087.stdout:1/917: link d2/d3d/db4/dc3/f10a d2/d14/f143 0 2024-09-17T07:20:06.368 INFO:tasks.workunit.client.1.smithi139.stdout:2/878: sync 2024-09-17T07:20:06.369 INFO:tasks.workunit.client.1.smithi139.stdout:2/879: write d0/de/ffb [2340323,129036] 0 2024-09-17T07:20:06.370 INFO:tasks.workunit.client.0.smithi087.stdout:8/956: dwrite d1/d2b/d21/d6d/ffc [0,4194304] 0 2024-09-17T07:20:06.374 INFO:tasks.workunit.client.0.smithi087.stdout:1/918: link d2/d69/d8d/da6/dd6/lef d2/dcf/d7e/db9/l144 0 2024-09-17T07:20:06.375 INFO:tasks.workunit.client.0.smithi087.stdout:3/999: dwrite d6/d1b/d42/d62/dc1/de8/f39 [0,4194304] 0 2024-09-17T07:20:06.375 INFO:tasks.workunit.client.0.smithi087.stdout:8/957: creat d1/d7/d9/d19/d1b/d18/f151 x:0 0 0 2024-09-17T07:20:06.376 INFO:tasks.workunit.client.1.smithi139.stdout:2/880: dwrite d0/de/d69/fd0 [0,4194304] 0 2024-09-17T07:20:06.377 INFO:tasks.workunit.client.0.smithi087.stdout:8/958: dread - d1/d2b/d21/daf/dd7/f146 zero size 2024-09-17T07:20:06.378 INFO:tasks.workunit.client.1.smithi139.stdout:2/881: chown d0/d7/d67/da1/d10d/dc4/f10c 7408717 1 2024-09-17T07:20:06.382 INFO:tasks.workunit.client.1.smithi139.stdout:2/882: creat d0/d7/d67/d92/f127 x:0 0 0 2024-09-17T07:20:06.385 INFO:tasks.workunit.client.0.smithi087.stdout:1/919: dwrite d2/d3d/d35/d4f/da5/f107 [0,4194304] 0 2024-09-17T07:20:06.388 INFO:tasks.workunit.client.0.smithi087.stdout:8/959: write d1/d2b/fc6 [1976298,41224] 0 2024-09-17T07:20:06.390 INFO:tasks.workunit.client.1.smithi139.stdout:2/883: dwrite d0/de/d69/de1/d126/ddd/f110 [0,4194304] 0 2024-09-17T07:20:06.391 INFO:tasks.workunit.client.1.smithi139.stdout:2/884: chown d0/de/df/l66 121 1 2024-09-17T07:20:06.392 INFO:tasks.workunit.client.0.smithi087.stdout:8/960: symlink d1/d5f/l152 0 2024-09-17T07:20:06.393 INFO:tasks.workunit.client.0.smithi087.stdout:1/920: rename d2/d3d/d45/d90/d43/d5d/fc4 to d2/d3d/f145 0 2024-09-17T07:20:06.394 INFO:tasks.workunit.client.0.smithi087.stdout:1/921: truncate d2/d69/f111 810144 0 2024-09-17T07:20:06.397 INFO:tasks.workunit.client.0.smithi087.stdout:8/961: read d1/d7/d9/d19/f4e [1998442,5843] 0 2024-09-17T07:20:06.398 INFO:tasks.workunit.client.1.smithi139.stdout:2/885: dwrite d0/de/f36 [4194304,4194304] 0 2024-09-17T07:20:06.400 INFO:tasks.workunit.client.0.smithi087.stdout:8/962: write d1/d2b/d21/d6d/d6f/f135 [207955,32318] 0 2024-09-17T07:20:06.400 INFO:tasks.workunit.client.1.smithi139.stdout:2/886: fdatasync d0/fae 0 2024-09-17T07:20:06.402 INFO:tasks.workunit.client.0.smithi087.stdout:8/963: readlink d1/d2b/d3b/d53/l80 0 2024-09-17T07:20:06.420 INFO:tasks.workunit.client.0.smithi087.stdout:1/922: creat d2/d3d/d35/d57/d73/f146 x:0 0 0 2024-09-17T07:20:06.421 INFO:tasks.workunit.client.0.smithi087.stdout:1/923: write d2/d3d/d35/d57/d73/f146 [1019067,53396] 0 2024-09-17T07:20:06.423 INFO:tasks.workunit.client.1.smithi139.stdout:2/887: dread d0/de/d69/f6a [0,4194304] 0 2024-09-17T07:20:06.424 INFO:tasks.workunit.client.1.smithi139.stdout:2/888: stat d0/d7/d86/da4/c44 0 2024-09-17T07:20:06.425 INFO:tasks.workunit.client.0.smithi087.stdout:1/924: rename d2/dcf/d7e/db9/dfb/d101/f102 to d2/d3d/d35/f147 0 2024-09-17T07:20:06.431 INFO:tasks.workunit.client.0.smithi087.stdout:8/964: dread d1/d7/d63/dd9/dcf/fe9 [0,4194304] 0 2024-09-17T07:20:06.432 INFO:tasks.workunit.client.0.smithi087.stdout:1/925: dwrite d2/d3d/d35/ffe [4194304,4194304] 0 2024-09-17T07:20:06.438 INFO:tasks.workunit.client.0.smithi087.stdout:8/965: rename d1/d7/d9/d19/d1b/d18 to d1/d2b/d153 0 2024-09-17T07:20:06.442 INFO:tasks.workunit.client.1.smithi139.stdout:2/889: dread d0/d4e/fc6 [0,4194304] 0 2024-09-17T07:20:06.444 INFO:tasks.workunit.client.1.smithi139.stdout:2/890: creat d0/d4e/d76/d82/f128 x:0 0 0 2024-09-17T07:20:06.445 INFO:tasks.workunit.client.1.smithi139.stdout:2/891: dread - d0/d7/d67/da1/d10d/dc4/fca zero size 2024-09-17T07:20:06.446 INFO:tasks.workunit.client.1.smithi139.stdout:2/892: rmdir d0/d7/d67/da1/d10d/d15 39 2024-09-17T07:20:06.449 INFO:tasks.workunit.client.1.smithi139.stdout:2/893: rename d0/d7/d1a/la0 to d0/de/d54/l129 0 2024-09-17T07:20:06.449 INFO:tasks.workunit.client.1.smithi139.stdout:2/894: readlink d0/de/d25/d3f/l65 0 2024-09-17T07:20:06.451 INFO:tasks.workunit.client.1.smithi139.stdout:2/895: creat d0/d4e/d76/d111/f12a x:0 0 0 2024-09-17T07:20:06.452 INFO:tasks.workunit.client.1.smithi139.stdout:2/896: unlink d0/fae 0 2024-09-17T07:20:06.453 INFO:tasks.workunit.client.1.smithi139.stdout:2/897: chown d0/de/d69/de1/d126 10 1 2024-09-17T07:20:06.453 INFO:tasks.workunit.client.1.smithi139.stdout:2/898: readlink d0/d7/d86/da4/l27 0 2024-09-17T07:20:06.456 INFO:tasks.workunit.client.1.smithi139.stdout:2/899: getdents d0/d4e 0 2024-09-17T07:20:06.459 INFO:tasks.workunit.client.1.smithi139.stdout:2/900: creat d0/d7/d67/da1/d10d/f12b x:0 0 0 2024-09-17T07:20:06.461 INFO:tasks.workunit.client.1.smithi139.stdout:2/901: creat d0/d7/d67/da1/d10d/dc4/f12c x:0 0 0 2024-09-17T07:20:06.462 INFO:tasks.workunit.client.1.smithi139.stdout:2/902: write d0/de/d69/f6a [4162359,15100] 0 2024-09-17T07:20:06.464 INFO:tasks.workunit.client.1.smithi139.stdout:2/903: write d0/d7/fd [4540256,19710] 0 2024-09-17T07:20:06.467 INFO:tasks.workunit.client.1.smithi139.stdout:1/677: sync 2024-09-17T07:20:06.467 INFO:tasks.workunit.client.1.smithi139.stdout:7/641: sync 2024-09-17T07:20:06.468 INFO:tasks.workunit.client.1.smithi139.stdout:1/678: fsync d2/d10/d12/d35/d49/f80 0 2024-09-17T07:20:06.470 INFO:tasks.workunit.client.1.smithi139.stdout:2/904: dwrite d0/de/d69/fa3 [4194304,4194304] 0 2024-09-17T07:20:06.471 INFO:tasks.workunit.client.1.smithi139.stdout:7/642: symlink d5/d17/d4e/d66/dc8/lce 0 2024-09-17T07:20:06.473 INFO:tasks.workunit.client.1.smithi139.stdout:1/679: chown d2/d10/d12/d13/d4f/f95 30337639 1 2024-09-17T07:20:06.476 INFO:tasks.workunit.client.1.smithi139.stdout:7/643: link d5/d17/d4e/d63/f6b d5/d17/fcf 0 2024-09-17T07:20:06.495 INFO:tasks.workunit.client.0.smithi087.stdout:2/803: sync 2024-09-17T07:20:06.496 INFO:tasks.workunit.client.0.smithi087.stdout:2/804: write d2/f3 [7525225,4994] 0 2024-09-17T07:20:06.499 INFO:tasks.workunit.client.0.smithi087.stdout:2/805: symlink d2/d15/dce/dd1/d99/de3/lfe 0 2024-09-17T07:20:06.500 INFO:tasks.workunit.client.0.smithi087.stdout:2/806: mknod d2/d15/dce/dd1/d99/de3/cff 0 2024-09-17T07:20:06.501 INFO:tasks.workunit.client.0.smithi087.stdout:2/807: chown d2/d12/f7a 2417884 1 2024-09-17T07:20:06.504 INFO:tasks.workunit.client.1.smithi139.stdout:7/644: dwrite d5/d96/fab [0,4194304] 0 2024-09-17T07:20:06.505 INFO:tasks.workunit.client.1.smithi139.stdout:1/680: dread d2/d10/d12/d1a/d61/faa [0,4194304] 0 2024-09-17T07:20:06.507 INFO:tasks.workunit.client.1.smithi139.stdout:7/645: rmdir d5/d17/d4e/d55 39 2024-09-17T07:20:06.509 INFO:tasks.workunit.client.1.smithi139.stdout:7/646: truncate d5/d17/f91 5879747 0 2024-09-17T07:20:06.516 INFO:tasks.workunit.client.1.smithi139.stdout:7/647: truncate d5/d17/d4e/faf 389353 0 2024-09-17T07:20:06.525 INFO:tasks.workunit.client.0.smithi087.stdout:2/808: dread d2/d48/f59 [0,4194304] 0 2024-09-17T07:20:06.527 INFO:tasks.workunit.client.0.smithi087.stdout:2/809: mkdir d2/d7/d60/d100 0 2024-09-17T07:20:06.528 INFO:tasks.workunit.client.1.smithi139.stdout:1/681: dread d2/d10/d12/d35/d49/f80 [0,4194304] 0 2024-09-17T07:20:06.531 INFO:tasks.workunit.client.0.smithi087.stdout:2/810: rename d2/d15/dce/dd1/d3f/df3/d3a to d2/d96/d101 0 2024-09-17T07:20:06.533 INFO:tasks.workunit.client.0.smithi087.stdout:2/811: unlink d2/d7/dd/d10/d4c/d5f/d8b/fc2 0 2024-09-17T07:20:06.534 INFO:tasks.workunit.client.1.smithi139.stdout:1/682: mknod d2/d10/d71/cd4 0 2024-09-17T07:20:06.536 INFO:tasks.workunit.client.1.smithi139.stdout:7/648: getdents d5/d17 0 2024-09-17T07:20:06.537 INFO:tasks.workunit.client.1.smithi139.stdout:1/683: write d2/d10/d12/d1a/d61/faa [5146431,120086] 0 2024-09-17T07:20:06.538 INFO:tasks.workunit.client.1.smithi139.stdout:7/649: mkdir d5/d17/dd0 0 2024-09-17T07:20:06.539 INFO:tasks.workunit.client.1.smithi139.stdout:1/684: rmdir d2/d10/d12/d24 39 2024-09-17T07:20:06.539 INFO:tasks.workunit.client.1.smithi139.stdout:1/685: fdatasync d2/d10/d12/d1a/fae 0 2024-09-17T07:20:06.540 INFO:tasks.workunit.client.0.smithi087.stdout:2/812: dwrite d2/d50/f90 [4194304,4194304] 0 2024-09-17T07:20:06.541 INFO:tasks.workunit.client.1.smithi139.stdout:1/686: chown d2/d10/d12/d35/d49/f7b 9182821 1 2024-09-17T07:20:06.544 INFO:tasks.workunit.client.0.smithi087.stdout:2/813: link d2/d7/dd/d10/d4c/d5f/d8b/cae d2/d50/db8/c102 0 2024-09-17T07:20:06.551 INFO:tasks.workunit.client.1.smithi139.stdout:1/687: write d2/d10/d12/d35/d2b/f41 [665043,129843] 0 2024-09-17T07:20:06.553 INFO:tasks.workunit.client.0.smithi087.stdout:2/814: write d2/d7/dd/d10/d91/dea/ff1 [1050016,76056] 0 2024-09-17T07:20:06.555 INFO:tasks.workunit.client.1.smithi139.stdout:1/688: getdents d2/d10 0 2024-09-17T07:20:06.556 INFO:tasks.workunit.client.0.smithi087.stdout:2/815: mkdir d2/d15/dce/dd1/d103 0 2024-09-17T07:20:06.558 INFO:tasks.workunit.client.1.smithi139.stdout:7/650: dwrite d5/d17/d4e/f69 [0,4194304] 0 2024-09-17T07:20:06.561 INFO:tasks.workunit.client.0.smithi087.stdout:2/816: fsync d2/d7/dd/d10/d91/dea/ff1 0 2024-09-17T07:20:06.562 INFO:tasks.workunit.client.1.smithi139.stdout:1/689: rename d2/d10/d12/d1a/d61/l66 to d2/d10/d12/d24/db2/ld5 0 2024-09-17T07:20:06.562 INFO:tasks.workunit.client.1.smithi139.stdout:7/651: dread - d5/d17/d4e/f9f zero size 2024-09-17T07:20:06.563 INFO:tasks.workunit.client.1.smithi139.stdout:1/690: unlink d2/l1d 0 2024-09-17T07:20:06.564 INFO:tasks.workunit.client.1.smithi139.stdout:7/652: mkdir d5/d10/d4d/d59/dd1 0 2024-09-17T07:20:06.567 INFO:tasks.workunit.client.1.smithi139.stdout:7/653: dread - d5/d17/d4e/d55/fc5 zero size 2024-09-17T07:20:06.567 INFO:tasks.workunit.client.1.smithi139.stdout:1/691: fdatasync d2/fd 0 2024-09-17T07:20:06.569 INFO:tasks.workunit.client.1.smithi139.stdout:3/836: sync 2024-09-17T07:20:06.569 INFO:tasks.workunit.client.1.smithi139.stdout:0/570: sync 2024-09-17T07:20:06.569 INFO:tasks.workunit.client.1.smithi139.stdout:5/869: sync 2024-09-17T07:20:06.570 INFO:tasks.workunit.client.1.smithi139.stdout:6/814: sync 2024-09-17T07:20:06.570 INFO:tasks.workunit.client.1.smithi139.stdout:4/755: sync 2024-09-17T07:20:06.570 INFO:tasks.workunit.client.1.smithi139.stdout:8/926: sync 2024-09-17T07:20:06.571 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:06 smithi139 ceph-mon[34403]: pgmap v16: 65 pgs: 65 active+clean; 3.0 GiB data, 9.9 GiB used, 527 GiB / 536 GiB avail; 97 MiB/s rd, 258 MiB/s wr, 532 op/s 2024-09-17T07:20:06.571 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:06 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:20:06.571 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:06 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:20:06.571 INFO:tasks.workunit.client.1.smithi139.stdout:1/692: stat d2/d10/d12/l4c 0 2024-09-17T07:20:06.573 INFO:tasks.workunit.client.1.smithi139.stdout:7/654: link d5/d17/d4e/d7a/l93 d5/d10/d4d/ld2 0 2024-09-17T07:20:06.574 INFO:tasks.workunit.client.1.smithi139.stdout:1/693: dread - d2/d10/d12/d13/d4f/f87 zero size 2024-09-17T07:20:06.576 INFO:tasks.workunit.client.1.smithi139.stdout:6/815: creat db/d18/d1b/da7/f118 x:0 0 0 2024-09-17T07:20:06.577 INFO:tasks.workunit.client.0.smithi087.stdout:2/817: write d2/d15/f2c [7561790,22873] 0 2024-09-17T07:20:06.577 INFO:tasks.workunit.client.1.smithi139.stdout:5/870: truncate d4/d16/d1b/f8f 1570521 0 2024-09-17T07:20:06.577 INFO:tasks.workunit.client.1.smithi139.stdout:1/694: truncate d2/d10/d12/d13/fcb 43480 0 2024-09-17T07:20:06.580 INFO:tasks.workunit.client.1.smithi139.stdout:8/927: truncate d0/d20/d28/d52/d65/d7f/db6/f7a 3446213 0 2024-09-17T07:20:06.580 INFO:tasks.workunit.client.1.smithi139.stdout:5/871: read d4/d16/d1b/d20/f56 [2138705,95226] 0 2024-09-17T07:20:06.581 INFO:tasks.workunit.client.1.smithi139.stdout:6/816: mknod db/d18/d38/d60/c119 0 2024-09-17T07:20:06.581 INFO:tasks.workunit.client.0.smithi087.stdout:2/818: rename d2/d96/ded to d2/d7/dd/d10/d91/dea/d104 0 2024-09-17T07:20:06.581 INFO:tasks.workunit.client.0.smithi087.stdout:2/819: readlink d2/d7/l26 0 2024-09-17T07:20:06.582 INFO:tasks.workunit.client.0.smithi087.stdout:2/820: write d2/d50/f90 [2783983,83211] 0 2024-09-17T07:20:06.583 INFO:tasks.workunit.client.1.smithi139.stdout:4/756: creat d0/d1/d29/d41/ff1 x:0 0 0 2024-09-17T07:20:06.584 INFO:tasks.workunit.client.1.smithi139.stdout:1/695: creat d2/d10/d12/d35/d49/d8d/fd6 x:0 0 0 2024-09-17T07:20:06.585 INFO:tasks.workunit.client.0.smithi087.stdout:2/821: symlink d2/d7/dd/d10/d91/l105 0 2024-09-17T07:20:06.586 INFO:tasks.workunit.client.1.smithi139.stdout:5/872: mknod d4/d16/d1b/d20/d32/d6c/c121 0 2024-09-17T07:20:06.587 INFO:tasks.workunit.client.1.smithi139.stdout:5/873: fdatasync d4/d16/d1b/d20/d28/f4d 0 2024-09-17T07:20:06.587 INFO:tasks.workunit.client.0.smithi087.stdout:2/822: fsync d2/d7/dd/d10/d91/dea/ffd 0 2024-09-17T07:20:06.588 INFO:tasks.workunit.client.1.smithi139.stdout:5/874: chown d4/d16/d1b/d20/d28/d3f/dcc/df1/d118 1 1 2024-09-17T07:20:06.589 INFO:tasks.workunit.client.1.smithi139.stdout:0/571: getdents d1/da/d17/d72/d66 0 2024-09-17T07:20:06.590 INFO:tasks.workunit.client.0.smithi087.stdout:2/823: dread d2/d48/d69/da0/fb3 [0,4194304] 0 2024-09-17T07:20:06.590 INFO:tasks.workunit.client.1.smithi139.stdout:0/572: stat d1/da/d17/d72/d66/d6c/laa 0 2024-09-17T07:20:06.591 INFO:tasks.workunit.client.1.smithi139.stdout:8/928: mkdir d0/d20/d28/d48/de1/d11e/d12e 0 2024-09-17T07:20:06.598 INFO:tasks.workunit.client.1.smithi139.stdout:5/875: read d4/f36 [18059,4967] 0 2024-09-17T07:20:06.599 INFO:tasks.workunit.client.1.smithi139.stdout:5/876: fsync d4/d16/d1b/d20/d28/f26 0 2024-09-17T07:20:06.600 INFO:tasks.workunit.client.0.smithi087.stdout:2/824: dwrite d2/d7/db/fd6 [0,4194304] 0 2024-09-17T07:20:06.601 INFO:tasks.workunit.client.1.smithi139.stdout:0/573: truncate d1/da/d2a/f2e 806954 0 2024-09-17T07:20:06.608 INFO:tasks.workunit.client.1.smithi139.stdout:5/877: rename d4/d16/d1b/d20/d67/d88/f8c to d4/d5d/f122 0 2024-09-17T07:20:06.611 INFO:tasks.workunit.client.0.smithi087.stdout:2/825: dwrite d2/f8a [0,4194304] 0 2024-09-17T07:20:06.611 INFO:tasks.workunit.client.1.smithi139.stdout:6/817: dread db/f16 [0,4194304] 0 2024-09-17T07:20:06.612 INFO:tasks.workunit.client.1.smithi139.stdout:1/696: dwrite d2/fd [0,4194304] 0 2024-09-17T07:20:06.615 INFO:tasks.workunit.client.1.smithi139.stdout:1/697: write d2/f58 [1556351,23729] 0 2024-09-17T07:20:06.617 INFO:tasks.workunit.client.0.smithi087.stdout:2/826: rename d2/d7/dd/d10/d4c/d5f/d8b/le5 to d2/d96/d101/da4/l106 0 2024-09-17T07:20:06.618 INFO:tasks.workunit.client.1.smithi139.stdout:1/698: read d2/d10/d12/fa7 [608853,78534] 0 2024-09-17T07:20:06.621 INFO:tasks.workunit.client.1.smithi139.stdout:8/929: write d0/d20/d28/d52/d65/d7f/db6/f4e [769928,9074] 0 2024-09-17T07:20:06.624 INFO:tasks.workunit.client.1.smithi139.stdout:1/699: dread d2/d10/d12/d13/fcb [0,4194304] 0 2024-09-17T07:20:06.624 INFO:tasks.workunit.client.1.smithi139.stdout:4/757: dwrite d0/db/d17/f2c [0,4194304] 0 2024-09-17T07:20:06.626 INFO:tasks.workunit.client.0.smithi087.stdout:2/827: dwrite d2/d50/fec [0,4194304] 0 2024-09-17T07:20:06.627 INFO:tasks.workunit.client.1.smithi139.stdout:6/818: creat db/df/d4e/d64/f11a x:0 0 0 2024-09-17T07:20:06.628 INFO:tasks.workunit.client.0.smithi087.stdout:9/857: sync 2024-09-17T07:20:06.630 INFO:tasks.workunit.client.1.smithi139.stdout:1/700: chown d2/d10/d12/l4c 4 1 2024-09-17T07:20:06.632 INFO:tasks.workunit.client.0.smithi087.stdout:2/828: creat d2/d15/dce/dd1/f107 x:0 0 0 2024-09-17T07:20:06.634 INFO:tasks.workunit.client.0.smithi087.stdout:2/829: getdents d2/d96/d101/d9f 0 2024-09-17T07:20:06.635 INFO:tasks.workunit.client.1.smithi139.stdout:4/758: mkdir d0/d1/d29/d6a/db6/de4/df2 0 2024-09-17T07:20:06.637 INFO:tasks.workunit.client.1.smithi139.stdout:4/759: chown d0/d1/f8 178 1 2024-09-17T07:20:06.640 INFO:tasks.workunit.client.1.smithi139.stdout:6/819: mkdir db/df/d4e/d64/d83/dd5/d11b 0 2024-09-17T07:20:06.644 INFO:tasks.workunit.client.1.smithi139.stdout:5/878: dread d4/d16/d1b/d20/d38/f54 [0,4194304] 0 2024-09-17T07:20:06.646 INFO:tasks.workunit.client.1.smithi139.stdout:0/574: rename d1/da/d1b/d3d/d5a/d75/d91/cc9 to d1/da/cd2 0 2024-09-17T07:20:06.647 INFO:tasks.workunit.client.1.smithi139.stdout:8/930: write d0/d1a/d4d/da4/fd9 [810634,40980] 0 2024-09-17T07:20:06.649 INFO:tasks.workunit.client.1.smithi139.stdout:5/879: mknod d4/d16/d1b/d20/d28/d3f/c123 0 2024-09-17T07:20:06.651 INFO:tasks.workunit.client.1.smithi139.stdout:0/575: creat d1/da/d2a/fd3 x:0 0 0 2024-09-17T07:20:06.655 INFO:tasks.workunit.client.1.smithi139.stdout:1/701: getdents d2/d10/d12/d13/d4f/d5c 0 2024-09-17T07:20:06.656 INFO:tasks.workunit.client.0.smithi087.stdout:2/830: dwrite d2/d7/dd/d10/f5a [0,4194304] 0 2024-09-17T07:20:06.660 INFO:tasks.workunit.client.0.smithi087.stdout:2/831: rename d2/d7/db/l44 to d2/d50/l108 0 2024-09-17T07:20:06.661 INFO:tasks.workunit.client.1.smithi139.stdout:5/880: dwrite d4/d16/d1b/d20/f56 [0,4194304] 0 2024-09-17T07:20:06.661 INFO:tasks.workunit.client.1.smithi139.stdout:1/702: rename d2/d10/d12/d35 to d2/d10/d12/d1a/dd7 0 2024-09-17T07:20:06.664 INFO:tasks.workunit.client.1.smithi139.stdout:5/881: symlink d4/d16/d1b/d20/d32/d6c/l124 0 2024-09-17T07:20:06.665 INFO:tasks.workunit.client.1.smithi139.stdout:1/703: symlink d2/d10/d12/d13/d4f/d5c/d74/ld8 0 2024-09-17T07:20:06.669 INFO:tasks.workunit.client.0.smithi087.stdout:2/832: write d2/d15/f9b [528277,18476] 0 2024-09-17T07:20:06.671 INFO:tasks.workunit.client.1.smithi139.stdout:1/704: rmdir d2/d10/d12/d1a/dd7/d49/d8d 39 2024-09-17T07:20:06.671 INFO:tasks.workunit.client.0.smithi087.stdout:2/833: fdatasync d2/d24/fdd 0 2024-09-17T07:20:06.671 INFO:tasks.workunit.client.0.smithi087.stdout:2/834: stat d2/d48/fb4 0 2024-09-17T07:20:06.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:06 smithi087 ceph-mon[27636]: pgmap v16: 65 pgs: 65 active+clean; 3.0 GiB data, 9.9 GiB used, 527 GiB / 536 GiB avail; 97 MiB/s rd, 258 MiB/s wr, 532 op/s 2024-09-17T07:20:06.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:06 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:20:06.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:06 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:20:06.678 INFO:tasks.workunit.client.0.smithi087.stdout:2/835: dwrite d2/d7/db/fd6 [0,4194304] 0 2024-09-17T07:20:06.679 INFO:tasks.workunit.client.1.smithi139.stdout:1/705: link d2/d10/d12/d1a/dd7/d49/d8d/c90 d2/d10/cd9 0 2024-09-17T07:20:06.680 INFO:tasks.workunit.client.1.smithi139.stdout:8/931: dread d0/d1a/d4d/d53/f5d [0,4194304] 0 2024-09-17T07:20:06.681 INFO:tasks.workunit.client.1.smithi139.stdout:8/932: chown d0/d20/d28/d52/d65/f115 724 1 2024-09-17T07:20:06.682 INFO:tasks.workunit.client.1.smithi139.stdout:6/820: write db/d18/d9f/dd2/fec [99881,64443] 0 2024-09-17T07:20:06.683 INFO:tasks.workunit.client.1.smithi139.stdout:4/760: write d0/d49/f8b [990339,78340] 0 2024-09-17T07:20:06.685 INFO:tasks.workunit.client.1.smithi139.stdout:0/576: truncate d1/da/d1b/d3d/d5a/fb9 85613 0 2024-09-17T07:20:06.686 INFO:tasks.workunit.client.0.smithi087.stdout:2/836: dread d2/d15/f9b [0,4194304] 0 2024-09-17T07:20:06.686 INFO:tasks.workunit.client.0.smithi087.stdout:2/837: readlink d2/d15/l2e 0 2024-09-17T07:20:06.687 INFO:tasks.workunit.client.1.smithi139.stdout:4/761: unlink d0/d1/c27 0 2024-09-17T07:20:06.688 INFO:tasks.workunit.client.0.smithi087.stdout:2/838: read - d2/d7/dd/fd9 zero size 2024-09-17T07:20:06.689 INFO:tasks.workunit.client.1.smithi139.stdout:4/762: dread - d0/d1/d54/d93/da2/fa3 zero size 2024-09-17T07:20:06.689 INFO:tasks.workunit.client.0.smithi087.stdout:2/839: creat d2/d7/dd/d6a/d6d/f109 x:0 0 0 2024-09-17T07:20:06.691 INFO:tasks.workunit.client.1.smithi139.stdout:8/933: getdents d0/d20/d28/d52/d99/db4 0 2024-09-17T07:20:06.697 INFO:tasks.workunit.client.1.smithi139.stdout:5/882: truncate d4/d16/d1b/d20/d32/f3c 607225 0 2024-09-17T07:20:06.700 INFO:tasks.workunit.client.1.smithi139.stdout:5/883: chown d4/d16/d1b/d20/d32/l5a 4938910 1 2024-09-17T07:20:06.702 INFO:tasks.workunit.client.1.smithi139.stdout:1/706: mknod d2/d10/d12/d1a/db1/dc7/dc2/cda 0 2024-09-17T07:20:06.705 INFO:tasks.workunit.client.1.smithi139.stdout:1/707: write d2/f91 [139932,74601] 0 2024-09-17T07:20:06.706 INFO:tasks.workunit.client.1.smithi139.stdout:4/763: truncate d0/f82 2628518 0 2024-09-17T07:20:06.708 INFO:tasks.workunit.client.1.smithi139.stdout:4/764: stat d0/db/d7f/db0/cdc 0 2024-09-17T07:20:06.711 INFO:tasks.workunit.client.1.smithi139.stdout:8/934: dwrite d0/d20/d28/d52/d99/fc7 [0,4194304] 0 2024-09-17T07:20:06.714 INFO:tasks.workunit.client.1.smithi139.stdout:4/765: truncate d0/de9/d83/f96 185763 0 2024-09-17T07:20:06.715 INFO:tasks.workunit.client.1.smithi139.stdout:1/708: write d2/f11 [1028707,109516] 0 2024-09-17T07:20:06.718 INFO:tasks.workunit.client.1.smithi139.stdout:8/935: fdatasync d0/d20/d28/d52/d99/db4/ff4 0 2024-09-17T07:20:06.721 INFO:tasks.workunit.client.1.smithi139.stdout:4/766: truncate d0/db/d17/f38 610462 0 2024-09-17T07:20:06.722 INFO:tasks.workunit.client.1.smithi139.stdout:8/936: rmdir d0/d1a/d82 39 2024-09-17T07:20:06.724 INFO:tasks.workunit.client.1.smithi139.stdout:8/937: creat d0/d20/d28/d52/d99/db4/f12f x:0 0 0 2024-09-17T07:20:06.725 INFO:tasks.workunit.client.1.smithi139.stdout:8/938: chown d0/d1a/d4d/da4/dc4/f116 24398 1 2024-09-17T07:20:06.725 INFO:tasks.workunit.client.1.smithi139.stdout:4/767: read d0/f1d [3430640,111200] 0 2024-09-17T07:20:06.726 INFO:tasks.workunit.client.0.smithi087.stdout:2/840: dread d2/f16 [0,4194304] 0 2024-09-17T07:20:06.730 INFO:tasks.workunit.client.0.smithi087.stdout:2/841: dread d2/d24/fc0 [0,4194304] 0 2024-09-17T07:20:06.731 INFO:tasks.workunit.client.1.smithi139.stdout:4/768: link d0/db/d17/dc3/fc8 d0/db/d7f/ff3 0 2024-09-17T07:20:06.732 INFO:tasks.workunit.client.0.smithi087.stdout:2/842: chown d2/d7/dd/d6a/d6d/f109 98890909 1 2024-09-17T07:20:06.732 INFO:tasks.workunit.client.1.smithi139.stdout:8/939: dwrite d0/d1a/fb8 [0,4194304] 0 2024-09-17T07:20:06.735 INFO:tasks.workunit.client.1.smithi139.stdout:4/769: creat d0/db/d58/ff4 x:0 0 0 2024-09-17T07:20:06.735 INFO:tasks.workunit.client.1.smithi139.stdout:1/709: dwrite d2/d10/d12/d1a/d61/faf [0,4194304] 0 2024-09-17T07:20:06.739 INFO:tasks.workunit.client.0.smithi087.stdout:2/843: write d2/d7/d60/fc4 [146505,27962] 0 2024-09-17T07:20:06.740 INFO:tasks.workunit.client.1.smithi139.stdout:8/940: mkdir d0/d1a/d3a/d8d/d102/d113/d130 0 2024-09-17T07:20:06.740 INFO:tasks.workunit.client.0.smithi087.stdout:2/844: readlink d2/d7/dd/ldb 0 2024-09-17T07:20:06.742 INFO:tasks.workunit.client.1.smithi139.stdout:4/770: rename d0/d37/c7d to d0/d1/d29/d6a/db6/de4/df2/cf5 0 2024-09-17T07:20:06.742 INFO:tasks.workunit.client.0.smithi087.stdout:2/845: fdatasync d2/d7/dd/d6a/d6d/f77 0 2024-09-17T07:20:06.742 INFO:tasks.workunit.client.1.smithi139.stdout:1/710: mknod d2/d10/d12/cdb 0 2024-09-17T07:20:06.748 INFO:tasks.workunit.client.1.smithi139.stdout:1/711: creat d2/d10/d12/d24/d38/da6/fdc x:0 0 0 2024-09-17T07:20:06.749 INFO:tasks.workunit.client.1.smithi139.stdout:8/941: dwrite d0/d20/d28/d52/d65/d7f/db6/f4b [4194304,4194304] 0 2024-09-17T07:20:06.750 INFO:tasks.workunit.client.0.smithi087.stdout:2/846: rename d2/d7/dd/d6a/l7e to d2/d15/l10a 0 2024-09-17T07:20:06.752 INFO:tasks.workunit.client.1.smithi139.stdout:1/712: mkdir d2/d10/d12/d13/d4f/d5c/d92/dab/ddd 0 2024-09-17T07:20:06.754 INFO:tasks.workunit.client.0.smithi087.stdout:2/847: link d2/d7/d60/cee d2/d7/d33/c10b 0 2024-09-17T07:20:06.754 INFO:tasks.workunit.client.1.smithi139.stdout:8/942: rename d0/l81 to d0/d20/d28/d52/d65/dd3/l131 0 2024-09-17T07:20:06.755 INFO:tasks.workunit.client.0.smithi087.stdout:2/848: read d2/d7/dd/d10/d4c/dcc/fcd [38834,46867] 0 2024-09-17T07:20:06.756 INFO:tasks.workunit.client.0.smithi087.stdout:7/789: sync 2024-09-17T07:20:06.756 INFO:tasks.workunit.client.0.smithi087.stdout:1/926: sync 2024-09-17T07:20:06.756 INFO:tasks.workunit.client.0.smithi087.stdout:8/966: sync 2024-09-17T07:20:06.756 INFO:tasks.workunit.client.1.smithi139.stdout:1/713: rmdir d2/d10/d71 39 2024-09-17T07:20:06.757 INFO:tasks.workunit.client.0.smithi087.stdout:2/849: creat d2/d7/d33/f10c x:0 0 0 2024-09-17T07:20:06.758 INFO:tasks.workunit.client.1.smithi139.stdout:8/943: write d0/d1a/d4d/d53/f5d [2129320,69635] 0 2024-09-17T07:20:06.759 INFO:tasks.workunit.client.0.smithi087.stdout:7/790: mkdir d0/d36/d8e/df1 0 2024-09-17T07:20:06.760 INFO:tasks.workunit.client.1.smithi139.stdout:1/714: write d2/d10/d12/f69 [1559620,93114] 0 2024-09-17T07:20:06.761 INFO:tasks.workunit.client.1.smithi139.stdout:8/944: mknod d0/d1a/d4d/c132 0 2024-09-17T07:20:06.762 INFO:tasks.workunit.client.0.smithi087.stdout:8/967: unlink d1/d7/d9/d19/d4d/d11f/f7a 0 2024-09-17T07:20:06.763 INFO:tasks.workunit.client.1.smithi139.stdout:1/715: fdatasync d2/d10/fb5 0 2024-09-17T07:20:06.763 INFO:tasks.workunit.client.0.smithi087.stdout:2/850: fsync d2/d50/db8/fd0 0 2024-09-17T07:20:06.765 INFO:tasks.workunit.client.0.smithi087.stdout:8/968: fsync d1/d2b/df4/d54/f110 0 2024-09-17T07:20:06.765 INFO:tasks.workunit.client.0.smithi087.stdout:7/791: fdatasync d0/d3/d10/d87/d96/fa6 0 2024-09-17T07:20:06.766 INFO:tasks.workunit.client.0.smithi087.stdout:2/851: creat d2/d48/f10d x:0 0 0 2024-09-17T07:20:06.767 INFO:tasks.workunit.client.0.smithi087.stdout:1/927: dwrite d2/d14/f116 [0,4194304] 0 2024-09-17T07:20:06.768 INFO:tasks.workunit.client.0.smithi087.stdout:7/792: write d0/d3/d10/d87/d96/fa1 [1833677,51769] 0 2024-09-17T07:20:06.769 INFO:tasks.workunit.client.0.smithi087.stdout:2/852: write d2/d15/f2c [8203107,99753] 0 2024-09-17T07:20:06.769 INFO:tasks.workunit.client.0.smithi087.stdout:8/969: mknod d1/d2b/d21/daf/dd7/c154 0 2024-09-17T07:20:06.770 INFO:tasks.workunit.client.0.smithi087.stdout:8/970: chown d1/d2b/d21/d6d/fa6 39191 1 2024-09-17T07:20:06.771 INFO:tasks.workunit.client.0.smithi087.stdout:2/853: write d2/d7/d33/f10c [406228,84187] 0 2024-09-17T07:20:06.772 INFO:tasks.workunit.client.0.smithi087.stdout:1/928: write d2/d69/d8d/fb8 [2508530,122478] 0 2024-09-17T07:20:06.773 INFO:tasks.workunit.client.0.smithi087.stdout:2/854: chown d2/d7/dd/d10/d91/l105 194 1 2024-09-17T07:20:06.776 INFO:tasks.workunit.client.0.smithi087.stdout:1/929: fsync d2/d3d/d45/d90/f47 0 2024-09-17T07:20:06.779 INFO:tasks.workunit.client.0.smithi087.stdout:8/971: mkdir d1/d2b/d21/d6d/d6f/d149/d155 0 2024-09-17T07:20:06.782 INFO:tasks.workunit.client.0.smithi087.stdout:8/972: write d1/d7/d63/f13b [520225,30249] 0 2024-09-17T07:20:06.783 INFO:tasks.workunit.client.0.smithi087.stdout:7/793: write d0/d3/d23/d17/f1e [865641,42435] 0 2024-09-17T07:20:06.787 INFO:tasks.workunit.client.0.smithi087.stdout:7/794: creat d0/d3/d10/ff2 x:0 0 0 2024-09-17T07:20:06.788 INFO:tasks.workunit.client.0.smithi087.stdout:1/930: write d2/d1a/f3e [2132417,77545] 0 2024-09-17T07:20:06.788 INFO:tasks.workunit.client.0.smithi087.stdout:2/855: write d2/d50/fa8 [7447638,7485] 0 2024-09-17T07:20:06.791 INFO:tasks.workunit.client.0.smithi087.stdout:8/973: dwrite d1/d7/d9/d19/d73/f113 [0,4194304] 0 2024-09-17T07:20:06.791 INFO:tasks.workunit.client.0.smithi087.stdout:7/795: fdatasync d0/d3/d10/d32/f4c 0 2024-09-17T07:20:06.793 INFO:tasks.workunit.client.0.smithi087.stdout:1/931: creat d2/dcf/d7e/db9/f148 x:0 0 0 2024-09-17T07:20:06.796 INFO:tasks.workunit.client.0.smithi087.stdout:8/974: mknod d1/d5f/c156 0 2024-09-17T07:20:06.797 INFO:tasks.workunit.client.0.smithi087.stdout:2/856: write d2/d12/fbc [40009,37427] 0 2024-09-17T07:20:06.797 INFO:tasks.workunit.client.0.smithi087.stdout:1/932: chown d2/d3d/f2f 196981224 1 2024-09-17T07:20:06.799 INFO:tasks.workunit.client.0.smithi087.stdout:7/796: symlink d0/d3/d23/d17/d7b/dad/d89/lf3 0 2024-09-17T07:20:06.800 INFO:tasks.workunit.client.0.smithi087.stdout:1/933: write d2/d14/fe3 [574413,87412] 0 2024-09-17T07:20:06.800 INFO:tasks.workunit.client.0.smithi087.stdout:8/975: truncate d1/d2b/f32 405013 0 2024-09-17T07:20:06.801 INFO:tasks.workunit.client.0.smithi087.stdout:1/934: write d2/f110 [113738,119841] 0 2024-09-17T07:20:06.802 INFO:tasks.workunit.client.0.smithi087.stdout:2/857: rename d2/d48/d69/da0/lb7 to d2/d50/l10e 0 2024-09-17T07:20:06.802 INFO:tasks.workunit.client.0.smithi087.stdout:8/976: write d1/d2b/d21/dd4/f104 [1176993,123581] 0 2024-09-17T07:20:06.806 INFO:tasks.workunit.client.0.smithi087.stdout:8/977: fdatasync d1/d2b/f29 0 2024-09-17T07:20:06.807 INFO:tasks.workunit.client.0.smithi087.stdout:2/858: symlink d2/d48/d69/da0/db0/l10f 0 2024-09-17T07:20:06.808 INFO:tasks.workunit.client.0.smithi087.stdout:1/935: truncate d2/d1a/f34 230030 0 2024-09-17T07:20:06.809 INFO:tasks.workunit.client.0.smithi087.stdout:7/797: dwrite d0/d3/d10/d32/d8c/fc4 [0,4194304] 0 2024-09-17T07:20:06.810 INFO:tasks.workunit.client.0.smithi087.stdout:8/978: creat d1/d2b/d21/daf/dd7/f157 x:0 0 0 2024-09-17T07:20:06.810 INFO:tasks.workunit.client.0.smithi087.stdout:2/859: dread d2/d24/fc0 [0,4194304] 0 2024-09-17T07:20:06.811 INFO:tasks.workunit.client.0.smithi087.stdout:1/936: fdatasync d2/d3d/d45/d90/fdc 0 2024-09-17T07:20:06.814 INFO:tasks.workunit.client.0.smithi087.stdout:9/858: sync 2024-09-17T07:20:06.817 INFO:tasks.workunit.client.0.smithi087.stdout:9/859: mkdir d3/d4/dcd/d12c 0 2024-09-17T07:20:06.817 INFO:tasks.workunit.client.0.smithi087.stdout:9/860: chown d3/d25/d83/f125 1325965 1 2024-09-17T07:20:06.819 INFO:tasks.workunit.client.0.smithi087.stdout:2/860: getdents d2 0 2024-09-17T07:20:06.820 INFO:tasks.workunit.client.1.smithi139.stdout:2/905: sync 2024-09-17T07:20:06.821 INFO:tasks.workunit.client.0.smithi087.stdout:7/798: write d0/d3/d10/f20 [2936935,76941] 0 2024-09-17T07:20:06.824 INFO:tasks.workunit.client.0.smithi087.stdout:7/799: creat d0/d36/d8e/da2/ff4 x:0 0 0 2024-09-17T07:20:06.826 INFO:tasks.workunit.client.0.smithi087.stdout:2/861: rmdir d2/d96/dc9 0 2024-09-17T07:20:06.827 INFO:tasks.workunit.client.0.smithi087.stdout:7/800: write d0/d3/d10/d32/f99 [1686113,49173] 0 2024-09-17T07:20:06.827 INFO:tasks.workunit.client.0.smithi087.stdout:2/862: stat d2/d12/d85 0 2024-09-17T07:20:06.829 INFO:tasks.workunit.client.1.smithi139.stdout:8/945: truncate d0/d20/d28/d52/f63 4365954 0 2024-09-17T07:20:06.829 INFO:tasks.workunit.client.0.smithi087.stdout:1/937: dwrite d2/d3d/f145 [0,4194304] 0 2024-09-17T07:20:06.830 INFO:tasks.workunit.client.0.smithi087.stdout:2/863: readlink d2/d7/db/lb1 0 2024-09-17T07:20:06.830 INFO:tasks.workunit.client.0.smithi087.stdout:7/801: symlink d0/d36/db3/lf5 0 2024-09-17T07:20:06.831 INFO:tasks.workunit.client.1.smithi139.stdout:2/906: getdents d0/d4e/d76/d111 0 2024-09-17T07:20:06.833 INFO:tasks.workunit.client.0.smithi087.stdout:1/938: dread - d2/d14/f63 zero size 2024-09-17T07:20:06.834 INFO:tasks.workunit.client.1.smithi139.stdout:2/907: creat d0/d7/d1a/d103/f12d x:0 0 0 2024-09-17T07:20:06.837 INFO:tasks.workunit.client.1.smithi139.stdout:8/946: dwrite d0/d96/fda [0,4194304] 0 2024-09-17T07:20:06.837 INFO:tasks.workunit.client.0.smithi087.stdout:2/864: unlink d2/d15/l63 0 2024-09-17T07:20:06.837 INFO:tasks.workunit.client.0.smithi087.stdout:9/861: dwrite d3/d4/d16/dc0/f39 [0,4194304] 0 2024-09-17T07:20:06.837 INFO:tasks.workunit.client.1.smithi139.stdout:8/947: chown d0/d1a/d4d/d121 31742596 1 2024-09-17T07:20:06.838 INFO:tasks.workunit.client.1.smithi139.stdout:8/948: stat d0/fff 0 2024-09-17T07:20:06.838 INFO:tasks.workunit.client.0.smithi087.stdout:2/865: write d2/f8a [3821414,125357] 0 2024-09-17T07:20:06.839 INFO:tasks.workunit.client.1.smithi139.stdout:8/949: fsync d0/d1a/d3a/f42 0 2024-09-17T07:20:06.840 INFO:tasks.workunit.client.0.smithi087.stdout:7/802: mkdir d0/d3/d23/d17/d7b/dad/daf/df6 0 2024-09-17T07:20:06.841 INFO:tasks.workunit.client.0.smithi087.stdout:9/862: rmdir d3/d4/d6/d8/d22/d92/da3 39 2024-09-17T07:20:06.842 INFO:tasks.workunit.client.1.smithi139.stdout:2/908: unlink d0/d7/d67/da1/d10d/d15/d9f/c116 0 2024-09-17T07:20:06.843 INFO:tasks.workunit.client.0.smithi087.stdout:2/866: creat d2/d15/dce/dd1/d99/de3/f110 x:0 0 0 2024-09-17T07:20:06.843 INFO:tasks.workunit.client.1.smithi139.stdout:2/909: write d0/d7/d1a/d59/f97 [350136,36259] 0 2024-09-17T07:20:06.845 INFO:tasks.workunit.client.0.smithi087.stdout:2/867: dread - d2/d7/dd/fd9 zero size 2024-09-17T07:20:06.848 INFO:tasks.workunit.client.0.smithi087.stdout:7/803: creat d0/d3/ff7 x:0 0 0 2024-09-17T07:20:06.849 INFO:tasks.workunit.client.1.smithi139.stdout:4/771: dread d0/d10/f53 [0,4194304] 0 2024-09-17T07:20:06.849 INFO:tasks.workunit.client.0.smithi087.stdout:9/863: creat d3/d4/d6/d8/d12/f12d x:0 0 0 2024-09-17T07:20:06.854 INFO:tasks.workunit.client.0.smithi087.stdout:1/939: dwrite d2/d3d/d45/fc6 [0,4194304] 0 2024-09-17T07:20:06.856 INFO:tasks.workunit.client.1.smithi139.stdout:4/772: dwrite d0/db/d58/f5e [0,4194304] 0 2024-09-17T07:20:06.857 INFO:tasks.workunit.client.0.smithi087.stdout:7/804: link d0/d3/l7 d0/d3/d10/d87/d96/db2/lf8 0 2024-09-17T07:20:06.857 INFO:tasks.workunit.client.0.smithi087.stdout:9/864: mknod d3/d4/d16/d69/d8a/c12e 0 2024-09-17T07:20:06.859 INFO:tasks.workunit.client.0.smithi087.stdout:7/805: stat d0/d3/f4 0 2024-09-17T07:20:06.859 INFO:tasks.workunit.client.1.smithi139.stdout:4/773: rename d0/d10/c9f to d0/de9/d83/cf6 0 2024-09-17T07:20:06.863 INFO:tasks.workunit.client.0.smithi087.stdout:9/865: getdents d3/d4/d16/d69/d8a/d12b 0 2024-09-17T07:20:06.863 INFO:tasks.workunit.client.1.smithi139.stdout:1/716: dread f0 [0,4194304] 0 2024-09-17T07:20:06.864 INFO:tasks.workunit.client.0.smithi087.stdout:7/806: read d0/d3/d23/d17/f47 [1820834,7775] 0 2024-09-17T07:20:06.867 INFO:tasks.workunit.client.0.smithi087.stdout:9/866: creat d3/d4/d6/d8/d12/d32/db2/f12f x:0 0 0 2024-09-17T07:20:06.867 INFO:tasks.workunit.client.1.smithi139.stdout:4/774: dwrite d0/de9/d83/f3a [0,4194304] 0 2024-09-17T07:20:06.870 INFO:tasks.workunit.client.0.smithi087.stdout:9/867: symlink d3/d4/d6/d8/d12/d38/d110/l130 0 2024-09-17T07:20:06.873 INFO:tasks.workunit.client.1.smithi139.stdout:1/717: dwrite d2/d10/d12/f69 [8388608,4194304] 0 2024-09-17T07:20:06.874 INFO:tasks.workunit.client.0.smithi087.stdout:9/868: creat d3/d4/d6/d71/d116/f131 x:0 0 0 2024-09-17T07:20:06.881 INFO:tasks.workunit.client.0.smithi087.stdout:9/869: link d3/d4/da/d4b/c76 d3/d4/d6/d8/d22/d92/da3/d113/c132 0 2024-09-17T07:20:06.885 INFO:tasks.workunit.client.0.smithi087.stdout:9/870: chown d3/d4/d6/d8/d22/d43/d84/c54 21073632 1 2024-09-17T07:20:06.888 INFO:tasks.workunit.client.1.smithi139.stdout:2/910: dread d0/de/d25/d3f/fbb [0,4194304] 0 2024-09-17T07:20:06.896 INFO:tasks.workunit.client.0.smithi087.stdout:2/868: write d2/d7/d60/ff9 [3806089,95569] 0 2024-09-17T07:20:06.899 INFO:tasks.workunit.client.0.smithi087.stdout:2/869: unlink d2/d12/l56 0 2024-09-17T07:20:06.900 INFO:tasks.workunit.client.0.smithi087.stdout:1/940: truncate d2/d48/d61/fb6 41953 0 2024-09-17T07:20:06.901 INFO:tasks.workunit.client.0.smithi087.stdout:2/870: read d2/d50/db8/fd0 [1273279,83000] 0 2024-09-17T07:20:06.903 INFO:tasks.workunit.client.0.smithi087.stdout:1/941: readlink d2/d48/d61/l99 0 2024-09-17T07:20:06.908 INFO:tasks.workunit.client.0.smithi087.stdout:1/942: dread - d2/d3d/f49 zero size 2024-09-17T07:20:06.908 INFO:tasks.workunit.client.0.smithi087.stdout:7/807: dwrite d0/d3/d23/d17/f66 [0,4194304] 0 2024-09-17T07:20:06.909 INFO:tasks.workunit.client.0.smithi087.stdout:1/943: chown d2/d69/cf7 15599 1 2024-09-17T07:20:06.910 INFO:tasks.workunit.client.0.smithi087.stdout:1/944: dread - d2/d3d/db4/dc3/fdb zero size 2024-09-17T07:20:06.910 INFO:tasks.workunit.client.0.smithi087.stdout:7/808: mknod d0/d36/d8e/da2/cf9 0 2024-09-17T07:20:06.913 INFO:tasks.workunit.client.0.smithi087.stdout:7/809: mkdir d0/d7a/dfa 0 2024-09-17T07:20:06.917 INFO:tasks.workunit.client.0.smithi087.stdout:9/871: dread d3/d4/d16/d69/d8a/f21 [0,4194304] 0 2024-09-17T07:20:06.917 INFO:tasks.workunit.client.0.smithi087.stdout:7/810: readlink d0/d3/d23/d17/d7b/dad/daf/lc6 0 2024-09-17T07:20:06.918 INFO:tasks.workunit.client.1.smithi139.stdout:1/718: mknod d2/d10/d12/d1a/db1/cde 0 2024-09-17T07:20:06.920 INFO:tasks.workunit.client.0.smithi087.stdout:2/871: write d2/d7/d33/fa9 [2183037,66044] 0 2024-09-17T07:20:06.924 INFO:tasks.workunit.client.0.smithi087.stdout:1/945: getdents d2/d3d/d35/d4f/da5 0 2024-09-17T07:20:06.924 INFO:tasks.workunit.client.0.smithi087.stdout:2/872: rmdir d2/d7/d33 39 2024-09-17T07:20:06.925 INFO:tasks.workunit.client.1.smithi139.stdout:4/775: rmdir d0/d1/de7/ded 0 2024-09-17T07:20:06.926 INFO:tasks.workunit.client.1.smithi139.stdout:3/837: sync 2024-09-17T07:20:06.928 INFO:tasks.workunit.client.1.smithi139.stdout:1/719: dwrite d2/d10/d12/d24/db2/fcf [0,4194304] 0 2024-09-17T07:20:06.928 INFO:tasks.workunit.client.0.smithi087.stdout:1/946: write d2/d1a/f1c [1004660,76879] 0 2024-09-17T07:20:06.928 INFO:tasks.workunit.client.0.smithi087.stdout:7/811: dwrite d0/d3/d10/d87/d96/fa1 [0,4194304] 0 2024-09-17T07:20:06.929 INFO:tasks.workunit.client.0.smithi087.stdout:2/873: mkdir d2/d7/dd/d6a/d6d/d111 0 2024-09-17T07:20:06.930 INFO:tasks.workunit.client.1.smithi139.stdout:8/950: dwrite d0/d20/d28/d52/d65/f70 [0,4194304] 0 2024-09-17T07:20:06.931 INFO:tasks.workunit.client.0.smithi087.stdout:2/874: write d2/ff2 [764564,2306] 0 2024-09-17T07:20:06.932 INFO:tasks.workunit.client.0.smithi087.stdout:9/872: write d3/d4/d6/d8/d22/d92/fbd [1340908,96640] 0 2024-09-17T07:20:06.934 INFO:tasks.workunit.client.0.smithi087.stdout:1/947: truncate d2/d3d/db4/fc9 768849 0 2024-09-17T07:20:06.935 INFO:tasks.workunit.client.0.smithi087.stdout:2/875: truncate d2/d15/dce/dd1/d99/de3/f110 769670 0 2024-09-17T07:20:06.936 INFO:tasks.workunit.client.0.smithi087.stdout:7/812: getdents d0/d3/d10/d87 0 2024-09-17T07:20:06.938 INFO:tasks.workunit.client.1.smithi139.stdout:2/911: getdents d0/de 0 2024-09-17T07:20:06.938 INFO:tasks.workunit.client.0.smithi087.stdout:7/813: dread - d0/d3/d10/fb7 zero size 2024-09-17T07:20:06.940 INFO:tasks.workunit.client.0.smithi087.stdout:9/873: getdents d3/d4/d16 0 2024-09-17T07:20:06.942 INFO:tasks.workunit.client.0.smithi087.stdout:1/948: creat d2/d3d/d35/d57/d73/d137/f149 x:0 0 0 2024-09-17T07:20:06.944 INFO:tasks.workunit.client.0.smithi087.stdout:1/949: symlink d2/d11a/l14a 0 2024-09-17T07:20:06.945 INFO:tasks.workunit.client.1.smithi139.stdout:2/912: rmdir d0/d7/d1a/d103 39 2024-09-17T07:20:06.948 INFO:tasks.workunit.client.0.smithi087.stdout:1/950: symlink d2/d3d/d35/d57/d141/l14b 0 2024-09-17T07:20:06.949 INFO:tasks.workunit.client.1.smithi139.stdout:2/913: truncate d0/d7/d1a/d103/f124 713123 0 2024-09-17T07:20:06.949 INFO:tasks.workunit.client.0.smithi087.stdout:9/874: dwrite d3/d4/d16/dc0/f8c [0,4194304] 0 2024-09-17T07:20:06.951 INFO:tasks.workunit.client.1.smithi139.stdout:1/720: getdents d2/d10/d12/d1a 0 2024-09-17T07:20:06.952 INFO:tasks.workunit.client.0.smithi087.stdout:1/951: rmdir d2/d69 39 2024-09-17T07:20:06.953 INFO:tasks.workunit.client.0.smithi087.stdout:9/875: creat d3/d4/d16/d69/d8a/d1e/d90/d93/dff/f133 x:0 0 0 2024-09-17T07:20:06.954 INFO:tasks.workunit.client.1.smithi139.stdout:2/914: symlink d0/d7/d67/da1/d10d/l12e 0 2024-09-17T07:20:06.958 INFO:tasks.workunit.client.1.smithi139.stdout:1/721: fsync d2/d10/d12/d1a/dd7/d2b/f42 0 2024-09-17T07:20:06.964 INFO:tasks.workunit.client.1.smithi139.stdout:1/722: rename d2/d10/d12/d1a/dd7/d2b/d4a/l6b to d2/d10/d12/d1a/db1/dc7/dc2/ldf 0 2024-09-17T07:20:06.966 INFO:tasks.workunit.client.1.smithi139.stdout:2/915: getdents d0/d7/d86/da4/d12/d45 0 2024-09-17T07:20:06.969 INFO:tasks.workunit.client.1.smithi139.stdout:2/916: unlink d0/d7/d67/d92/d99/l38 0 2024-09-17T07:20:06.974 INFO:tasks.workunit.client.1.smithi139.stdout:2/917: link d0/d4e/d76/d111/f12a d0/d7/d67/f12f 0 2024-09-17T07:20:06.976 INFO:tasks.workunit.client.1.smithi139.stdout:2/918: symlink d0/d7/d67/da1/da7/l130 0 2024-09-17T07:20:06.976 INFO:tasks.workunit.client.0.smithi087.stdout:9/876: write d3/d4/dcd/df4/ff5 [230586,95316] 0 2024-09-17T07:20:06.977 INFO:tasks.workunit.client.0.smithi087.stdout:2/876: dread d2/d15/dce/dd1/f4e [0,4194304] 0 2024-09-17T07:20:06.980 INFO:tasks.workunit.client.0.smithi087.stdout:7/814: dread d0/d3/d23/d17/f41 [0,4194304] 0 2024-09-17T07:20:06.984 INFO:tasks.workunit.client.0.smithi087.stdout:2/877: creat d2/d96/d101/f112 x:0 0 0 2024-09-17T07:20:06.985 INFO:tasks.workunit.client.0.smithi087.stdout:7/815: unlink d0/d3/d10/f21 0 2024-09-17T07:20:06.986 INFO:tasks.workunit.client.0.smithi087.stdout:9/877: dread d3/d4/d16/fc2 [0,4194304] 0 2024-09-17T07:20:06.988 INFO:tasks.workunit.client.0.smithi087.stdout:7/816: creat d0/d36/deb/ffb x:0 0 0 2024-09-17T07:20:06.989 INFO:tasks.workunit.client.1.smithi139.stdout:8/951: link d0/d20/d28/d52/d65/dbe/c10a d0/d20/d28/d52/d99/c133 0 2024-09-17T07:20:06.990 INFO:tasks.workunit.client.0.smithi087.stdout:7/817: write d0/d3/d23/d17/f66 [2545720,94879] 0 2024-09-17T07:20:06.990 INFO:tasks.workunit.client.0.smithi087.stdout:9/878: mkdir d3/d4/d6/d8/d22/d64/d134 0 2024-09-17T07:20:06.992 INFO:tasks.workunit.client.0.smithi087.stdout:7/818: chown d0/d3/d10/d32/d62/d76/l80 881420 1 2024-09-17T07:20:06.992 INFO:tasks.workunit.client.1.smithi139.stdout:8/952: creat d0/d20/d28/d52/d99/db4/f134 x:0 0 0 2024-09-17T07:20:06.993 INFO:tasks.workunit.client.0.smithi087.stdout:9/879: rmdir d3/d4/d6/d8/df1 39 2024-09-17T07:20:06.994 INFO:tasks.workunit.client.0.smithi087.stdout:7/819: creat d0/d36/db3/ffc x:0 0 0 2024-09-17T07:20:06.995 INFO:tasks.workunit.client.0.smithi087.stdout:7/820: fdatasync d0/d3/f3f 0 2024-09-17T07:20:06.996 INFO:tasks.workunit.client.0.smithi087.stdout:9/880: mknod d3/d4/d16/d69/d8a/d12b/c135 0 2024-09-17T07:20:06.997 INFO:tasks.workunit.client.1.smithi139.stdout:8/953: getdents d0/d1a/d4d/d53 0 2024-09-17T07:20:07.000 INFO:tasks.workunit.client.1.smithi139.stdout:8/954: link d0/d20/d28/fea d0/d1a/d3a/d71/f135 0 2024-09-17T07:20:07.004 INFO:tasks.workunit.client.1.smithi139.stdout:3/838: dwrite d5/da7/fac [0,4194304] 0 2024-09-17T07:20:07.008 INFO:tasks.workunit.client.1.smithi139.stdout:3/839: creat d5/d63/d6d/da0/f106 x:0 0 0 2024-09-17T07:20:07.009 INFO:tasks.workunit.client.0.smithi087.stdout:7/821: getdents d0/d3/d23/d2d 0 2024-09-17T07:20:07.009 INFO:tasks.workunit.client.0.smithi087.stdout:2/878: dread d2/d24/d36/f39 [0,4194304] 0 2024-09-17T07:20:07.009 INFO:tasks.workunit.client.1.smithi139.stdout:3/840: write d5/da7/fac [2165042,19104] 0 2024-09-17T07:20:07.009 INFO:tasks.workunit.client.1.smithi139.stdout:3/841: readlink d5/d63/d6d/d6f/l8c 0 2024-09-17T07:20:07.010 INFO:tasks.workunit.client.0.smithi087.stdout:9/881: dread d3/d4/d6/d8/d12/d38/f70 [0,4194304] 0 2024-09-17T07:20:07.010 INFO:tasks.workunit.client.1.smithi139.stdout:8/955: getdents d0/d20/d28/d52/d65/dd3 0 2024-09-17T07:20:07.011 INFO:tasks.workunit.client.0.smithi087.stdout:9/882: chown d3/d4/f26 139 1 2024-09-17T07:20:07.012 INFO:tasks.workunit.client.1.smithi139.stdout:8/956: write d0/d20/d28/d52/f63 [2718213,1305] 0 2024-09-17T07:20:07.012 INFO:tasks.workunit.client.0.smithi087.stdout:7/822: write d0/d3/d10/d31/dc1/fc7 [86165,90630] 0 2024-09-17T07:20:07.012 INFO:tasks.workunit.client.0.smithi087.stdout:9/883: fdatasync d3/d4/f26 0 2024-09-17T07:20:07.013 INFO:tasks.workunit.client.0.smithi087.stdout:2/879: mkdir d2/d24/d113 0 2024-09-17T07:20:07.015 INFO:tasks.workunit.client.1.smithi139.stdout:8/957: creat d0/d20/d28/d52/d65/d7f/db6/dfb/f136 x:0 0 0 2024-09-17T07:20:07.018 INFO:tasks.workunit.client.1.smithi139.stdout:1/723: rename d2/d10/d12/d1a/db1/dc7/dc2/ldf to d2/d10/d12/d1a/d61/le0 0 2024-09-17T07:20:07.018 INFO:tasks.workunit.client.0.smithi087.stdout:9/884: unlink d3/d4/d6/d8/d12/d38/lee 0 2024-09-17T07:20:07.018 INFO:tasks.workunit.client.1.smithi139.stdout:3/842: getdents d5/d21/d23/d38/deb 0 2024-09-17T07:20:07.020 INFO:tasks.workunit.client.1.smithi139.stdout:8/958: creat d0/d1a/d3a/d8d/f137 x:0 0 0 2024-09-17T07:20:07.020 INFO:tasks.workunit.client.0.smithi087.stdout:2/880: mkdir d2/d15/dce/dd1/d114 0 2024-09-17T07:20:07.022 INFO:tasks.workunit.client.1.smithi139.stdout:2/919: rename d0/d4e/d76/ced to d0/d3b/ddc/c131 0 2024-09-17T07:20:07.022 INFO:tasks.workunit.client.0.smithi087.stdout:2/881: write d2/d15/dce/dd1/d3f/fdc [2611712,124616] 0 2024-09-17T07:20:07.023 INFO:tasks.workunit.client.0.smithi087.stdout:7/823: rename d0/d3/d23/d17/f41 to d0/d36/deb/ffd 0 2024-09-17T07:20:07.023 INFO:tasks.workunit.client.1.smithi139.stdout:3/843: mkdir d5/da7/dca/dab/d107 0 2024-09-17T07:20:07.024 INFO:tasks.workunit.client.0.smithi087.stdout:2/882: write d2/d50/f90 [6780407,47533] 0 2024-09-17T07:20:07.024 INFO:tasks.workunit.client.1.smithi139.stdout:2/920: truncate d0/de/d69/de1/f102 4744354 0 2024-09-17T07:20:07.025 INFO:tasks.workunit.client.0.smithi087.stdout:2/883: chown d2/d7/dd/ldb 820891 1 2024-09-17T07:20:07.025 INFO:tasks.workunit.client.1.smithi139.stdout:8/959: creat d0/d1a/d4d/da4/dc4/f138 x:0 0 0 2024-09-17T07:20:07.026 INFO:tasks.workunit.client.0.smithi087.stdout:2/884: write d2/f3 [7081593,114341] 0 2024-09-17T07:20:07.026 INFO:tasks.workunit.client.1.smithi139.stdout:3/844: mkdir d5/d63/d6d/d108 0 2024-09-17T07:20:07.027 INFO:tasks.workunit.client.0.smithi087.stdout:7/824: fdatasync d0/d3/d23/f2b 0 2024-09-17T07:20:07.027 INFO:tasks.workunit.client.1.smithi139.stdout:2/921: read d0/d7/d67/d92/d99/f72 [1391243,94205] 0 2024-09-17T07:20:07.029 INFO:tasks.workunit.client.1.smithi139.stdout:8/960: write d0/d1a/d82/f120 [685274,19323] 0 2024-09-17T07:20:07.029 INFO:tasks.workunit.client.0.smithi087.stdout:7/825: mkdir d0/d3/d10/dfe 0 2024-09-17T07:20:07.030 INFO:tasks.workunit.client.1.smithi139.stdout:8/961: chown d0/d20/d28/d52/f103 1467 1 2024-09-17T07:20:07.030 INFO:tasks.workunit.client.0.smithi087.stdout:7/826: fsync d0/d36/d8e/da2/fdb 0 2024-09-17T07:20:07.031 INFO:tasks.workunit.client.0.smithi087.stdout:7/827: fsync d0/d3/d10/d32/f99 0 2024-09-17T07:20:07.032 INFO:tasks.workunit.client.1.smithi139.stdout:3/845: unlink d5/da7/dca/dab/dd6/d28/la3 0 2024-09-17T07:20:07.034 INFO:tasks.workunit.client.0.smithi087.stdout:7/828: truncate d0/d3/d10/fb7 256128 0 2024-09-17T07:20:07.035 INFO:tasks.workunit.client.1.smithi139.stdout:4/776: mkdir d0/d1/df7 0 2024-09-17T07:20:07.036 INFO:tasks.workunit.client.0.smithi087.stdout:7/829: rmdir d0/d3/d23/d2d 39 2024-09-17T07:20:07.036 INFO:tasks.workunit.client.1.smithi139.stdout:8/962: creat d0/d20/d28/d48/f139 x:0 0 0 2024-09-17T07:20:07.037 INFO:tasks.workunit.client.0.smithi087.stdout:9/885: dwrite f2 [4194304,4194304] 0 2024-09-17T07:20:07.038 INFO:tasks.workunit.client.0.smithi087.stdout:7/830: truncate d0/d3/d10/d31/dc1/fc7 401474 0 2024-09-17T07:20:07.042 INFO:tasks.workunit.client.0.smithi087.stdout:9/886: truncate d3/d4/d6/d8/d22/d92/da3/fa9 479146 0 2024-09-17T07:20:07.048 INFO:tasks.workunit.client.1.smithi139.stdout:8/963: dwrite d0/d1a/d3a/fb1 [0,4194304] 0 2024-09-17T07:20:07.048 INFO:tasks.workunit.client.1.smithi139.stdout:3/846: dread d5/d21/d23/d69/fa6 [0,4194304] 0 2024-09-17T07:20:07.049 INFO:tasks.workunit.client.1.smithi139.stdout:8/964: fdatasync d0/d1a/f12a 0 2024-09-17T07:20:07.051 INFO:tasks.workunit.client.1.smithi139.stdout:2/922: write d0/d3b/f64 [745540,126566] 0 2024-09-17T07:20:07.051 INFO:tasks.workunit.client.1.smithi139.stdout:3/847: truncate d5/da7/dca/dd7/ff3 115215 0 2024-09-17T07:20:07.052 INFO:tasks.workunit.client.0.smithi087.stdout:9/887: creat d3/d4/d6/d8/d22/d92/da3/d113/d127/d128/f136 x:0 0 0 2024-09-17T07:20:07.052 INFO:tasks.workunit.client.0.smithi087.stdout:7/831: dwrite d0/d3/f9f [0,4194304] 0 2024-09-17T07:20:07.055 INFO:tasks.workunit.client.1.smithi139.stdout:2/923: creat d0/d7/d1a/d59/f132 x:0 0 0 2024-09-17T07:20:07.056 INFO:tasks.workunit.client.1.smithi139.stdout:4/777: truncate d0/d10/fc5 774570 0 2024-09-17T07:20:07.057 INFO:tasks.workunit.client.1.smithi139.stdout:3/848: creat d5/d63/d6d/da0/f109 x:0 0 0 2024-09-17T07:20:07.061 INFO:tasks.workunit.client.1.smithi139.stdout:2/924: dread d0/de/f36 [4194304,4194304] 0 2024-09-17T07:20:07.062 INFO:tasks.workunit.client.1.smithi139.stdout:4/778: symlink d0/de9/d83/lf8 0 2024-09-17T07:20:07.063 INFO:tasks.workunit.client.1.smithi139.stdout:2/925: chown d0/d7/d1a/d59/c89 54096 1 2024-09-17T07:20:07.063 INFO:tasks.workunit.client.1.smithi139.stdout:3/849: symlink d5/d15/d20/d3b/l10a 0 2024-09-17T07:20:07.067 INFO:tasks.workunit.client.1.smithi139.stdout:4/779: dread d0/d1/fd [4194304,4194304] 0 2024-09-17T07:20:07.068 INFO:tasks.workunit.client.1.smithi139.stdout:4/780: chown d0/db/f1c 3226748 1 2024-09-17T07:20:07.069 INFO:tasks.workunit.client.1.smithi139.stdout:2/926: getdents d0/d7/d67/da1/d10d/d15/d9f/d118 0 2024-09-17T07:20:07.069 INFO:tasks.workunit.client.1.smithi139.stdout:2/927: chown d0/l9 30 1 2024-09-17T07:20:07.071 INFO:tasks.workunit.client.1.smithi139.stdout:4/781: creat d0/d1/dbe/ff9 x:0 0 0 2024-09-17T07:20:07.071 INFO:tasks.workunit.client.1.smithi139.stdout:8/965: write d0/d1a/d3a/f8a [2393406,92702] 0 2024-09-17T07:20:07.072 INFO:tasks.workunit.client.1.smithi139.stdout:2/928: rmdir d0/d4e/d76/d82 39 2024-09-17T07:20:07.076 INFO:tasks.workunit.client.1.smithi139.stdout:8/966: rename d0/lf to d0/d20/da2/l13a 0 2024-09-17T07:20:07.076 INFO:tasks.workunit.client.0.smithi087.stdout:8/979: sync 2024-09-17T07:20:07.077 INFO:tasks.workunit.client.1.smithi139.stdout:2/929: unlink d0/d7/d67/da1/fea 0 2024-09-17T07:20:07.080 INFO:tasks.workunit.client.1.smithi139.stdout:4/782: dwrite d0/d1/d29/d6d/db3/fee [0,4194304] 0 2024-09-17T07:20:07.081 INFO:tasks.workunit.client.0.smithi087.stdout:7/832: dread - d0/d3/d23/d4e/fd6 zero size 2024-09-17T07:20:07.081 INFO:tasks.workunit.client.0.smithi087.stdout:7/833: chown d0/d7a/dfa 861 1 2024-09-17T07:20:07.085 INFO:tasks.workunit.client.1.smithi139.stdout:3/850: truncate d5/d21/d23/d69/dd5/fda 275208 0 2024-09-17T07:20:07.086 INFO:tasks.workunit.client.1.smithi139.stdout:2/930: read - d0/d4e/d76/d82/f128 zero size 2024-09-17T07:20:07.086 INFO:tasks.workunit.client.0.smithi087.stdout:7/834: rename d0/d36/db3 to d0/d3/d10/dfe/dff 0 2024-09-17T07:20:07.086 INFO:tasks.workunit.client.1.smithi139.stdout:3/851: truncate d5/da7/dca/dd7/ff3 836416 0 2024-09-17T07:20:07.087 INFO:tasks.workunit.client.1.smithi139.stdout:4/783: rename d0/d1/d29/d6a/fef to d0/db/d7f/db0/ffa 0 2024-09-17T07:20:07.088 INFO:tasks.workunit.client.1.smithi139.stdout:2/931: truncate d0/d7/d1a/fcc 922989 0 2024-09-17T07:20:07.090 INFO:tasks.workunit.client.1.smithi139.stdout:4/784: truncate d0/f71 1398621 0 2024-09-17T07:20:07.090 INFO:tasks.workunit.client.0.smithi087.stdout:7/835: dread d0/d3/d10/f5d [0,4194304] 0 2024-09-17T07:20:07.098 INFO:tasks.workunit.client.1.smithi139.stdout:3/852: rename d5/da7/dca/dab/dd6/d28/l91 to d5/da7/dca/dab/l10b 0 2024-09-17T07:20:07.099 INFO:tasks.workunit.client.1.smithi139.stdout:2/932: dwrite d0/d7/d1a/f1e [0,4194304] 0 2024-09-17T07:20:07.103 INFO:tasks.workunit.client.1.smithi139.stdout:4/785: dwrite d0/f4c [4194304,4194304] 0 2024-09-17T07:20:07.104 INFO:tasks.workunit.client.1.smithi139.stdout:3/853: unlink d5/d21/d23/l74 0 2024-09-17T07:20:07.104 INFO:tasks.workunit.client.1.smithi139.stdout:8/967: dwrite d0/d20/d28/d52/d99/db4/ff4 [0,4194304] 0 2024-09-17T07:20:07.107 INFO:tasks.workunit.client.0.smithi087.stdout:7/836: dread d0/d3/d23/d2d/f35 [0,4194304] 0 2024-09-17T07:20:07.108 INFO:tasks.workunit.client.1.smithi139.stdout:8/968: mkdir d0/d1a/d4d/d53/d13b 0 2024-09-17T07:20:07.110 INFO:tasks.workunit.client.1.smithi139.stdout:3/854: symlink d5/d63/db3/l10c 0 2024-09-17T07:20:07.110 INFO:tasks.workunit.client.0.smithi087.stdout:7/837: rmdir d0/d3/d23/d4e 39 2024-09-17T07:20:07.111 INFO:tasks.workunit.client.1.smithi139.stdout:3/855: write d5/d15/f7a [4992742,9011] 0 2024-09-17T07:20:07.112 INFO:tasks.workunit.client.1.smithi139.stdout:4/786: creat d0/db/d17/daf/ffb x:0 0 0 2024-09-17T07:20:07.114 INFO:tasks.workunit.client.1.smithi139.stdout:3/856: chown d5/da7/dca/dab/dd6/c43 2942 1 2024-09-17T07:20:07.115 INFO:tasks.workunit.client.1.smithi139.stdout:8/969: mknod d0/d20/d28/d52/d65/d7f/db6/dfb/c13c 0 2024-09-17T07:20:07.116 INFO:tasks.workunit.client.0.smithi087.stdout:7/838: getdents d0/d36/d8e/da2 0 2024-09-17T07:20:07.116 INFO:tasks.workunit.client.0.smithi087.stdout:9/888: dwrite d3/d4/d6/d8/d22/d43/f77 [0,4194304] 0 2024-09-17T07:20:07.117 INFO:tasks.workunit.client.1.smithi139.stdout:2/933: rename d0/d7/d67/da1/d10d/d15/fbe to d0/d4e/d76/f133 0 2024-09-17T07:20:07.118 INFO:tasks.workunit.client.1.smithi139.stdout:4/787: chown d0/d1/d29/d41/f67 1623443476 1 2024-09-17T07:20:07.119 INFO:tasks.workunit.client.0.smithi087.stdout:8/980: dwrite d1/d2b/f9a [0,4194304] 0 2024-09-17T07:20:07.119 INFO:tasks.workunit.client.1.smithi139.stdout:2/934: write d0/d7/d86/da4/d12/f77 [4325133,98706] 0 2024-09-17T07:20:07.120 INFO:tasks.workunit.client.1.smithi139.stdout:3/857: fdatasync d5/f64 0 2024-09-17T07:20:07.120 INFO:tasks.workunit.client.0.smithi087.stdout:9/889: readlink d3/d4/d6/d8/d22/d92/da3/d113/l11c 0 2024-09-17T07:20:07.122 INFO:tasks.workunit.client.0.smithi087.stdout:8/981: creat d1/d2b/d3b/d53/d105/f158 x:0 0 0 2024-09-17T07:20:07.122 INFO:tasks.workunit.client.1.smithi139.stdout:2/935: fsync d0/de/d69/de1/d126/f37 0 2024-09-17T07:20:07.122 INFO:tasks.workunit.client.1.smithi139.stdout:8/970: unlink d0/d20/d28/d52/d54/laf 0 2024-09-17T07:20:07.123 INFO:tasks.workunit.client.0.smithi087.stdout:8/982: write d1/d2b/d21/d68/f128 [824998,71623] 0 2024-09-17T07:20:07.123 INFO:tasks.workunit.client.0.smithi087.stdout:7/839: creat d0/d36/d8e/df1/f100 x:0 0 0 2024-09-17T07:20:07.124 INFO:tasks.workunit.client.1.smithi139.stdout:8/971: fsync d0/d1a/d3a/d71/f8b 0 2024-09-17T07:20:07.125 INFO:tasks.workunit.client.0.smithi087.stdout:8/983: stat d1/d7/d63/c10f 0 2024-09-17T07:20:07.126 INFO:tasks.workunit.client.1.smithi139.stdout:4/788: dread d0/db/d58/f73 [0,4194304] 0 2024-09-17T07:20:07.126 INFO:tasks.workunit.client.0.smithi087.stdout:9/890: unlink d3/d4/d6/d8/fda 0 2024-09-17T07:20:07.127 INFO:tasks.workunit.client.1.smithi139.stdout:2/936: symlink d0/de/d69/de1/l134 0 2024-09-17T07:20:07.127 INFO:tasks.workunit.client.0.smithi087.stdout:9/891: read - d3/d4/d16/fb6 zero size 2024-09-17T07:20:07.131 INFO:tasks.workunit.client.0.smithi087.stdout:8/984: creat d1/d2b/d153/de6/f159 x:0 0 0 2024-09-17T07:20:07.131 INFO:tasks.workunit.client.0.smithi087.stdout:8/985: readlink d1/d7/d9/d19/l76 0 2024-09-17T07:20:07.132 INFO:tasks.workunit.client.0.smithi087.stdout:8/986: stat d1/d2b/d21/d68 0 2024-09-17T07:20:07.133 INFO:tasks.workunit.client.0.smithi087.stdout:8/987: fdatasync d1/d7/d9/d19/d73/f8c 0 2024-09-17T07:20:07.136 INFO:tasks.workunit.client.1.smithi139.stdout:2/937: dwrite d0/f9b [0,4194304] 0 2024-09-17T07:20:07.137 INFO:tasks.workunit.client.0.smithi087.stdout:8/988: dread d1/d7/d9/d19/fae [0,4194304] 0 2024-09-17T07:20:07.143 INFO:tasks.workunit.client.1.smithi139.stdout:2/938: mknod d0/d3b/ddc/d115/c135 0 2024-09-17T07:20:07.144 INFO:tasks.workunit.client.0.smithi087.stdout:8/989: dread d1/d2b/d21/d6d/fa6 [0,4194304] 0 2024-09-17T07:20:07.146 INFO:tasks.workunit.client.1.smithi139.stdout:2/939: symlink d0/d7/d67/da1/d10d/d15/l136 0 2024-09-17T07:20:07.147 INFO:tasks.workunit.client.1.smithi139.stdout:4/789: truncate d0/d1/fd 4604365 0 2024-09-17T07:20:07.149 INFO:tasks.workunit.client.1.smithi139.stdout:2/940: truncate d0/d4e/f11e 747294 0 2024-09-17T07:20:07.150 INFO:tasks.workunit.client.0.smithi087.stdout:8/990: dwrite d1/d7/d63/dd9/f11b [0,4194304] 0 2024-09-17T07:20:07.151 INFO:tasks.workunit.client.1.smithi139.stdout:2/941: fsync d0/d7/d86/da4/f83 0 2024-09-17T07:20:07.151 INFO:tasks.workunit.client.1.smithi139.stdout:3/858: dwrite d5/d21/d23/f5d [0,4194304] 0 2024-09-17T07:20:07.152 INFO:tasks.workunit.client.0.smithi087.stdout:9/892: dread d3/d4/d6/d8/d22/d43/d84/f112 [0,4194304] 0 2024-09-17T07:20:07.155 INFO:tasks.workunit.client.0.smithi087.stdout:8/991: mkdir d1/d2b/df4/d54/dbb/d15a 0 2024-09-17T07:20:07.157 INFO:tasks.workunit.client.0.smithi087.stdout:9/893: truncate d3/d4/d6/d8/d22/d43/d84/dc7/fdd 744519 0 2024-09-17T07:20:07.158 INFO:tasks.workunit.client.0.smithi087.stdout:8/992: creat d1/d2b/d21/daf/dd7/f15b x:0 0 0 2024-09-17T07:20:07.160 INFO:tasks.workunit.client.1.smithi139.stdout:3/859: dwrite d5/d15/d20/d83/f94 [0,4194304] 0 2024-09-17T07:20:07.160 INFO:tasks.workunit.client.0.smithi087.stdout:8/993: mknod d1/d2b/df4/d54/dbb/d124/c15c 0 2024-09-17T07:20:07.160 INFO:tasks.workunit.client.1.smithi139.stdout:2/942: dwrite d0/d7/d86/da4/d12/d8c/f109 [0,4194304] 0 2024-09-17T07:20:07.162 INFO:tasks.workunit.client.1.smithi139.stdout:2/943: chown d0/d4e/fa8 3836 1 2024-09-17T07:20:07.163 INFO:tasks.workunit.client.0.smithi087.stdout:8/994: mkdir d1/d7/d9/d19/d4d/d11f/d130/d15d 0 2024-09-17T07:20:07.167 INFO:tasks.workunit.client.0.smithi087.stdout:7/840: dread d0/d3/d10/f20 [0,4194304] 0 2024-09-17T07:20:07.167 INFO:tasks.workunit.client.0.smithi087.stdout:8/995: getdents d1/d7/d9/d19/d4d/d11f/d130/d14a 0 2024-09-17T07:20:07.168 INFO:tasks.workunit.client.0.smithi087.stdout:7/841: read - d0/d3/ff7 zero size 2024-09-17T07:20:07.168 INFO:tasks.workunit.client.0.smithi087.stdout:8/996: write d1/d7/d9/d19/f12f [1694189,64783] 0 2024-09-17T07:20:07.170 INFO:tasks.workunit.client.0.smithi087.stdout:7/842: read - d0/d3/d10/d87/d96/fb1 zero size 2024-09-17T07:20:07.173 INFO:tasks.workunit.client.0.smithi087.stdout:9/894: write d3/d4/d16/f5b [3017926,86844] 0 2024-09-17T07:20:07.175 INFO:tasks.workunit.client.0.smithi087.stdout:7/843: mknod d0/d7a/dfa/c101 0 2024-09-17T07:20:07.176 INFO:tasks.workunit.client.0.smithi087.stdout:7/844: chown d0/d3/d10/d32/f73 411747309 1 2024-09-17T07:20:07.177 INFO:tasks.workunit.client.0.smithi087.stdout:9/895: creat d3/d4/d6/d8/d22/f137 x:0 0 0 2024-09-17T07:20:07.177 INFO:tasks.workunit.client.1.smithi139.stdout:4/790: dwrite d0/de9/d83/f48 [0,4194304] 0 2024-09-17T07:20:07.179 INFO:tasks.workunit.client.1.smithi139.stdout:4/791: truncate d0/d1/d29/d41/f63 564921 0 2024-09-17T07:20:07.180 INFO:tasks.workunit.client.0.smithi087.stdout:9/896: creat d3/d4/d6/d8/d12/d32/f138 x:0 0 0 2024-09-17T07:20:07.182 INFO:tasks.workunit.client.1.smithi139.stdout:4/792: write d0/d1/d29/d6d/f86 [7950200,128545] 0 2024-09-17T07:20:07.183 INFO:tasks.workunit.client.0.smithi087.stdout:9/897: rmdir d3/d4/da/d4b/d108 0 2024-09-17T07:20:07.186 INFO:tasks.workunit.client.1.smithi139.stdout:2/944: write d0/d4e/fa8 [5390355,116075] 0 2024-09-17T07:20:07.187 INFO:tasks.workunit.client.1.smithi139.stdout:2/945: write d0/de/df/d56/fe6 [700187,83117] 0 2024-09-17T07:20:07.188 INFO:tasks.workunit.client.1.smithi139.stdout:4/793: rename d0/f47 to d0/de9/ffc 0 2024-09-17T07:20:07.190 INFO:tasks.workunit.client.1.smithi139.stdout:2/946: write d0/d7/d67/da1/d10d/d15/ff5 [3446572,16412] 0 2024-09-17T07:20:07.196 INFO:tasks.workunit.client.0.smithi087.stdout:7/845: dread d0/d3/d10/d87/d96/fa6 [0,4194304] 0 2024-09-17T07:20:07.196 INFO:tasks.workunit.client.1.smithi139.stdout:3/860: dread d5/f1d [0,4194304] 0 2024-09-17T07:20:07.196 INFO:tasks.workunit.client.0.smithi087.stdout:7/846: fdatasync d0/d36/d8e/da2/ff4 0 2024-09-17T07:20:07.198 INFO:tasks.workunit.client.0.smithi087.stdout:7/847: truncate d0/f2 9296984 0 2024-09-17T07:20:07.199 INFO:tasks.workunit.client.0.smithi087.stdout:8/997: write d1/d2b/df4/fd3 [3054571,50991] 0 2024-09-17T07:20:07.200 INFO:tasks.workunit.client.1.smithi139.stdout:3/861: getdents d5/d63/d6d/d6f 0 2024-09-17T07:20:07.200 INFO:tasks.workunit.client.0.smithi087.stdout:7/848: rmdir d0/d3/d10/dfe 39 2024-09-17T07:20:07.203 INFO:tasks.workunit.client.1.smithi139.stdout:2/947: truncate d0/d7/d67/da1/d10d/d15/f23 3127571 0 2024-09-17T07:20:07.204 INFO:tasks.workunit.client.0.smithi087.stdout:7/849: mknod d0/d3/d23/d17/d7b/dad/c102 0 2024-09-17T07:20:07.205 INFO:tasks.workunit.client.1.smithi139.stdout:2/948: write d0/d7/d67/da1/d10d/dc4/f10c [703213,117676] 0 2024-09-17T07:20:07.206 INFO:tasks.workunit.client.0.smithi087.stdout:9/898: dwrite d3/d4/d6/d8/d22/f75 [0,4194304] 0 2024-09-17T07:20:07.207 INFO:tasks.workunit.client.1.smithi139.stdout:4/794: dwrite d0/db/f74 [0,4194304] 0 2024-09-17T07:20:07.209 INFO:tasks.workunit.client.0.smithi087.stdout:7/850: symlink d0/d36/d8e/l103 0 2024-09-17T07:20:07.209 INFO:tasks.workunit.client.0.smithi087.stdout:8/998: truncate d1/d2b/d21/d6d/f100 1275042 0 2024-09-17T07:20:07.209 INFO:tasks.workunit.client.0.smithi087.stdout:1/952: sync 2024-09-17T07:20:07.210 INFO:tasks.workunit.client.0.smithi087.stdout:7/851: chown d0/d3/d10/d31/l72 3845 1 2024-09-17T07:20:07.211 INFO:tasks.workunit.client.1.smithi139.stdout:4/795: write d0/d1/d29/f66 [2036113,88671] 0 2024-09-17T07:20:07.211 INFO:tasks.workunit.client.0.smithi087.stdout:9/899: creat d3/d4/d6/d8/d12/d32/f139 x:0 0 0 2024-09-17T07:20:07.212 INFO:tasks.workunit.client.0.smithi087.stdout:1/953: write d2/dcf/d7e/db9/feb [503647,20409] 0 2024-09-17T07:20:07.214 INFO:tasks.workunit.client.0.smithi087.stdout:9/900: read d3/d4/d16/dc0/f39 [88578,85901] 0 2024-09-17T07:20:07.215 INFO:tasks.workunit.client.1.smithi139.stdout:4/796: truncate d0/d1/d29/d41/f63 1468057 0 2024-09-17T07:20:07.215 INFO:tasks.workunit.client.0.smithi087.stdout:7/852: dread d0/d3/d10/d87/d96/fa6 [0,4194304] 0 2024-09-17T07:20:07.216 INFO:tasks.workunit.client.0.smithi087.stdout:8/999: rename d1/d7/d9/d19/d4d/d11f/da1/fc7 to d1/d2b/d21/daf/f15e 0 2024-09-17T07:20:07.220 INFO:tasks.workunit.client.0.smithi087.stdout:7/853: rmdir d0/d36/deb 39 2024-09-17T07:20:07.221 INFO:tasks.workunit.client.1.smithi139.stdout:4/797: dwrite d0/db/d58/f5e [0,4194304] 0 2024-09-17T07:20:07.222 INFO:tasks.workunit.client.0.smithi087.stdout:7/854: chown d0/d3/d10/d31/l72 3411 1 2024-09-17T07:20:07.223 INFO:tasks.workunit.client.0.smithi087.stdout:9/901: fdatasync d3/d4/d16/d69/d8a/d1e/d90/d93/fb7 0 2024-09-17T07:20:07.224 INFO:tasks.workunit.client.0.smithi087.stdout:1/954: dwrite d2/d3d/d45/d90/f18 [0,4194304] 0 2024-09-17T07:20:07.224 INFO:tasks.workunit.client.1.smithi139.stdout:4/798: mkdir d0/d1/dbe/dfd 0 2024-09-17T07:20:07.225 INFO:tasks.workunit.client.0.smithi087.stdout:9/902: chown d3/d4/d6/d8/d22/d43/f45 1374 1 2024-09-17T07:20:07.226 INFO:tasks.workunit.client.0.smithi087.stdout:9/903: dread - d3/d25/fe2 zero size 2024-09-17T07:20:07.227 INFO:tasks.workunit.client.0.smithi087.stdout:1/955: creat d2/d3d/d35/d57/d73/f14c x:0 0 0 2024-09-17T07:20:07.228 INFO:tasks.workunit.client.0.smithi087.stdout:9/904: fsync d3/d4/f98 0 2024-09-17T07:20:07.229 INFO:tasks.workunit.client.0.smithi087.stdout:7/855: getdents d0/d3/d23/d17/d7b/dad/daf 0 2024-09-17T07:20:07.234 INFO:tasks.workunit.client.1.smithi139.stdout:4/799: dwrite d0/db/d58/f5e [4194304,4194304] 0 2024-09-17T07:20:07.235 INFO:tasks.workunit.client.0.smithi087.stdout:7/856: unlink d0/d3/d23/d17/d7b/dad/fa3 0 2024-09-17T07:20:07.238 INFO:tasks.workunit.client.0.smithi087.stdout:1/956: link d2/d1a/fc5 d2/d3d/d35/d4f/da5/f14d 0 2024-09-17T07:20:07.238 INFO:tasks.workunit.client.0.smithi087.stdout:1/957: chown d2/d1a 5334803 1 2024-09-17T07:20:07.238 INFO:tasks.workunit.client.1.smithi139.stdout:2/949: dwrite d0/d7/d67/da1/d10d/d15/f23 [0,4194304] 0 2024-09-17T07:20:07.239 INFO:tasks.workunit.client.0.smithi087.stdout:9/905: mkdir d3/d4/d6/d8/d22/d92/da3/d13a 0 2024-09-17T07:20:07.244 INFO:tasks.workunit.client.0.smithi087.stdout:9/906: unlink d3/d4/d16/d69/d8a/d1e/d90/d93/dff/f11d 0 2024-09-17T07:20:07.244 INFO:tasks.workunit.client.0.smithi087.stdout:1/958: truncate d2/d1a/f34 9419 0 2024-09-17T07:20:07.245 INFO:tasks.workunit.client.0.smithi087.stdout:9/907: chown d3/d4/d16/d69/d8a 1 1 2024-09-17T07:20:07.245 INFO:tasks.workunit.client.0.smithi087.stdout:7/857: link d0/d3/d23/d17/l2f d0/d3/d23/d2d/l104 0 2024-09-17T07:20:07.247 INFO:tasks.workunit.client.0.smithi087.stdout:2/885: sync 2024-09-17T07:20:07.247 INFO:tasks.workunit.client.0.smithi087.stdout:1/959: creat d2/d3d/d35/d57/d73/f14e x:0 0 0 2024-09-17T07:20:07.248 INFO:tasks.workunit.client.0.smithi087.stdout:7/858: write d0/d3/d10/d31/f63 [83980,65276] 0 2024-09-17T07:20:07.248 INFO:tasks.workunit.client.0.smithi087.stdout:9/908: creat d3/d4/dcd/df4/d10f/f13b x:0 0 0 2024-09-17T07:20:07.249 INFO:tasks.workunit.client.1.smithi139.stdout:2/950: dwrite d0/d7/d67/da1/d10d/d15/f23 [4194304,4194304] 0 2024-09-17T07:20:07.250 INFO:tasks.workunit.client.1.smithi139.stdout:4/800: dwrite d0/d1/d29/d41/f63 [0,4194304] 0 2024-09-17T07:20:07.251 INFO:tasks.workunit.client.1.smithi139.stdout:2/951: dread - d0/d7/d1a/d59/f10a zero size 2024-09-17T07:20:07.251 INFO:tasks.workunit.client.0.smithi087.stdout:2/886: read d2/d15/dce/dd1/d3f/f93 [644076,1827] 0 2024-09-17T07:20:07.253 INFO:tasks.workunit.client.0.smithi087.stdout:7/859: mknod d0/d3/d10/d32/d8c/c105 0 2024-09-17T07:20:07.254 INFO:tasks.workunit.client.0.smithi087.stdout:7/860: chown d0/d3/d23/d2d/c77 58631 1 2024-09-17T07:20:07.254 INFO:tasks.workunit.client.0.smithi087.stdout:9/909: mkdir d3/d4/d6/d8/d12/d38/d13c 0 2024-09-17T07:20:07.255 INFO:tasks.workunit.client.1.smithi139.stdout:2/952: mkdir d0/d7/d86/d137 0 2024-09-17T07:20:07.257 INFO:tasks.workunit.client.1.smithi139.stdout:2/953: write d0/d7/d67/da1/d10d/d15/fe0 [722452,46357] 0 2024-09-17T07:20:07.258 INFO:tasks.workunit.client.0.smithi087.stdout:1/960: dread d2/dcf/d7e/db9/feb [0,4194304] 0 2024-09-17T07:20:07.259 INFO:tasks.workunit.client.1.smithi139.stdout:2/954: creat d0/d7/d1a/d59/f138 x:0 0 0 2024-09-17T07:20:07.260 INFO:tasks.workunit.client.0.smithi087.stdout:1/961: creat d2/dcf/d12f/f14f x:0 0 0 2024-09-17T07:20:07.265 INFO:tasks.workunit.client.0.smithi087.stdout:9/910: dread d3/d4/d6/d8/d22/fa5 [0,4194304] 0 2024-09-17T07:20:07.269 INFO:tasks.workunit.client.0.smithi087.stdout:9/911: creat d3/d4/d6/d8/d12/d32/db2/f13d x:0 0 0 2024-09-17T07:20:07.271 INFO:tasks.workunit.client.0.smithi087.stdout:7/861: getdents d0/d3/d23/d17/d7b/dad 0 2024-09-17T07:20:07.271 INFO:tasks.workunit.client.1.smithi139.stdout:4/801: dread d0/d1/dbe/fab [0,4194304] 0 2024-09-17T07:20:07.273 INFO:tasks.workunit.client.1.smithi139.stdout:4/802: creat d0/d37/ffe x:0 0 0 2024-09-17T07:20:07.274 INFO:tasks.workunit.client.1.smithi139.stdout:4/803: readlink d0/db/d7f/lc4 0 2024-09-17T07:20:07.276 INFO:tasks.workunit.client.1.smithi139.stdout:4/804: creat d0/db/db2/db5/fff x:0 0 0 2024-09-17T07:20:07.278 INFO:tasks.workunit.client.1.smithi139.stdout:4/805: chown d0/d10/db4/cde 369827 1 2024-09-17T07:20:07.278 INFO:tasks.workunit.client.0.smithi087.stdout:9/912: rename d3/d4/d16/d69/d8a/d1e/c101 to d3/d4/dcd/df4/d10f/c13e 0 2024-09-17T07:20:07.279 INFO:tasks.workunit.client.1.smithi139.stdout:4/806: write d0/d1/d29/d41/f8a [3287216,84063] 0 2024-09-17T07:20:07.282 INFO:tasks.workunit.client.1.smithi139.stdout:4/807: rmdir d0/d1/de7 0 2024-09-17T07:20:07.284 INFO:tasks.workunit.client.1.smithi139.stdout:4/808: unlink d0/d37/ffe 0 2024-09-17T07:20:07.285 INFO:tasks.workunit.client.1.smithi139.stdout:4/809: creat d0/d10/f100 x:0 0 0 2024-09-17T07:20:07.286 INFO:tasks.workunit.client.1.smithi139.stdout:4/810: chown d0/db/d7f/f8c 16456857 1 2024-09-17T07:20:07.287 INFO:tasks.workunit.client.0.smithi087.stdout:2/887: dwrite d2/f52 [0,4194304] 0 2024-09-17T07:20:07.289 INFO:tasks.workunit.client.0.smithi087.stdout:7/862: write d0/d3/f3e [117253,91220] 0 2024-09-17T07:20:07.289 INFO:tasks.workunit.client.1.smithi139.stdout:4/811: creat d0/d1/dbe/ddd/f101 x:0 0 0 2024-09-17T07:20:07.290 INFO:tasks.workunit.client.1.smithi139.stdout:4/812: stat d0/d1/c31 0 2024-09-17T07:20:07.292 INFO:tasks.workunit.client.1.smithi139.stdout:4/813: read d0/f30 [118032,106346] 0 2024-09-17T07:20:07.294 INFO:tasks.workunit.client.1.smithi139.stdout:4/814: write d0/db/d58/ff4 [557231,59305] 0 2024-09-17T07:20:07.296 INFO:tasks.workunit.client.0.smithi087.stdout:7/863: dwrite d0/d7a/fc5 [0,4194304] 0 2024-09-17T07:20:07.298 INFO:tasks.workunit.client.1.smithi139.stdout:4/815: read d0/d49/f52 [245127,96913] 0 2024-09-17T07:20:07.301 INFO:tasks.workunit.client.0.smithi087.stdout:7/864: unlink d0/d3/d23/d17/d7b/dad/daf/cb5 0 2024-09-17T07:20:07.304 INFO:tasks.workunit.client.0.smithi087.stdout:7/865: mknod d0/d36/d8e/c106 0 2024-09-17T07:20:07.310 INFO:tasks.workunit.client.0.smithi087.stdout:7/866: dwrite d0/d3/f40 [0,4194304] 0 2024-09-17T07:20:07.312 INFO:tasks.workunit.client.0.smithi087.stdout:9/913: dread d3/d4/d16/d69/d8a/f51 [0,4194304] 0 2024-09-17T07:20:07.312 INFO:tasks.workunit.client.0.smithi087.stdout:7/867: dread - d0/d3/d23/d17/d7b/dad/daf/fb8 zero size 2024-09-17T07:20:07.314 INFO:tasks.workunit.client.0.smithi087.stdout:9/914: chown d3/d4/d6/d8/d12/d32/da1/le0 8200032 1 2024-09-17T07:20:07.315 INFO:tasks.workunit.client.0.smithi087.stdout:7/868: truncate d0/d3/d10/d87/d96/fb1 535712 0 2024-09-17T07:20:07.317 INFO:tasks.workunit.client.0.smithi087.stdout:9/915: mkdir d3/d4/d6/d8/d22/d92/da3/da4/d13f 0 2024-09-17T07:20:07.318 INFO:tasks.workunit.client.0.smithi087.stdout:9/916: chown d3/d4/d6/fab 915 1 2024-09-17T07:20:07.319 INFO:tasks.workunit.client.0.smithi087.stdout:7/869: getdents d0/d3/d10/d87/d96/db2 0 2024-09-17T07:20:07.321 INFO:tasks.workunit.client.0.smithi087.stdout:7/870: mkdir d0/d3/d10/d107 0 2024-09-17T07:20:07.322 INFO:tasks.workunit.client.0.smithi087.stdout:7/871: write d0/d3/d10/d31/f43 [1175184,14530] 0 2024-09-17T07:20:07.323 INFO:tasks.workunit.client.0.smithi087.stdout:9/917: rename d3/d4/d16/d69/d8a/f85 to d3/d4/da/d4b/f140 0 2024-09-17T07:20:07.324 INFO:tasks.workunit.client.0.smithi087.stdout:7/872: creat d0/d7a/f108 x:0 0 0 2024-09-17T07:20:07.326 INFO:tasks.workunit.client.0.smithi087.stdout:7/873: creat d0/d3/d23/d17/d7b/dad/f109 x:0 0 0 2024-09-17T07:20:07.328 INFO:tasks.workunit.client.0.smithi087.stdout:7/874: mkdir d0/d3/d10/d87/d10a 0 2024-09-17T07:20:07.330 INFO:tasks.workunit.client.0.smithi087.stdout:7/875: getdents d0/d7a/dfa 0 2024-09-17T07:20:07.332 INFO:tasks.workunit.client.0.smithi087.stdout:7/876: rmdir d0/d3/d10/d32/d62 39 2024-09-17T07:20:07.333 INFO:tasks.workunit.client.0.smithi087.stdout:7/877: mknod d0/d3/d10/d31/c10b 0 2024-09-17T07:20:07.333 INFO:tasks.workunit.client.0.smithi087.stdout:7/878: fsync d0/d3/d23/d2d/fe6 0 2024-09-17T07:20:07.337 INFO:tasks.workunit.client.0.smithi087.stdout:7/879: link d0/d3/d23/f54 d0/d3/f10c 0 2024-09-17T07:20:07.338 INFO:tasks.workunit.client.0.smithi087.stdout:7/880: rmdir d0/d36 39 2024-09-17T07:20:07.352 INFO:tasks.workunit.client.1.smithi139.stdout:4/816: dwrite d0/d1/d54/d93/da2/fda [0,4194304] 0 2024-09-17T07:20:07.354 INFO:tasks.workunit.client.1.smithi139.stdout:4/817: mkdir d0/d1/d29/d6a/db6/d102 0 2024-09-17T07:20:07.356 INFO:tasks.workunit.client.1.smithi139.stdout:4/818: mknod d0/db/d58/df0/c103 0 2024-09-17T07:20:07.357 INFO:tasks.workunit.client.1.smithi139.stdout:4/819: truncate d0/d1/f4f 154383 0 2024-09-17T07:20:07.358 INFO:tasks.workunit.client.1.smithi139.stdout:4/820: creat d0/db/d17/daf/f104 x:0 0 0 2024-09-17T07:20:07.359 INFO:tasks.workunit.client.1.smithi139.stdout:4/821: stat d0/d10/la8 0 2024-09-17T07:20:07.360 INFO:tasks.workunit.client.1.smithi139.stdout:4/822: rmdir d0/d37 39 2024-09-17T07:20:07.361 INFO:tasks.workunit.client.1.smithi139.stdout:4/823: mknod d0/db/db2/c105 0 2024-09-17T07:20:07.363 INFO:tasks.workunit.client.1.smithi139.stdout:4/824: mkdir d0/d1/dbe/dfd/d106 0 2024-09-17T07:20:07.450 INFO:tasks.workunit.client.0.smithi087.stdout:1/962: sync 2024-09-17T07:20:07.450 INFO:tasks.workunit.client.0.smithi087.stdout:2/888: sync 2024-09-17T07:20:07.450 INFO:tasks.workunit.client.0.smithi087.stdout:9/918: sync 2024-09-17T07:20:07.450 INFO:tasks.workunit.client.0.smithi087.stdout:7/881: sync 2024-09-17T07:20:07.451 INFO:tasks.workunit.client.0.smithi087.stdout:9/919: rmdir d3/d4/d6/d71/d116 39 2024-09-17T07:20:07.452 INFO:tasks.workunit.client.0.smithi087.stdout:2/889: mknod d2/d48/d69/da0/c115 0 2024-09-17T07:20:07.455 INFO:tasks.workunit.client.1.smithi139.stdout:7/655: sync 2024-09-17T07:20:07.458 INFO:tasks.workunit.client.0.smithi087.stdout:9/920: dwrite d3/d4/d6/fbe [0,4194304] 0 2024-09-17T07:20:07.460 INFO:tasks.workunit.client.0.smithi087.stdout:9/921: dread d3/d4/d6/d8/d12/d38/f70 [0,4194304] 0 2024-09-17T07:20:07.462 INFO:tasks.workunit.client.0.smithi087.stdout:1/963: getdents d2/d3d/d35/d4f 0 2024-09-17T07:20:07.463 INFO:tasks.workunit.client.0.smithi087.stdout:7/882: creat d0/d36/d8e/f10d x:0 0 0 2024-09-17T07:20:07.463 INFO:tasks.workunit.client.0.smithi087.stdout:2/890: link d2/d24/fdd d2/d50/db8/f116 0 2024-09-17T07:20:07.464 INFO:tasks.workunit.client.0.smithi087.stdout:9/922: chown d3/d4/d6/d8/l42 2 1 2024-09-17T07:20:07.467 INFO:tasks.workunit.client.0.smithi087.stdout:2/891: read d2/d24/d36/f38 [2777611,43620] 0 2024-09-17T07:20:07.468 INFO:tasks.workunit.client.1.smithi139.stdout:6/821: sync 2024-09-17T07:20:07.469 INFO:tasks.workunit.client.0.smithi087.stdout:2/892: truncate d2/d7/dd/d10/f1d 4199471 0 2024-09-17T07:20:07.469 INFO:tasks.workunit.client.0.smithi087.stdout:1/964: link d2/d3d/d45/d90/d43/l9e d2/d69/d142/l150 0 2024-09-17T07:20:07.470 INFO:tasks.workunit.client.0.smithi087.stdout:2/893: mkdir d2/d7/db/d117 0 2024-09-17T07:20:07.473 INFO:tasks.workunit.client.0.smithi087.stdout:2/894: rename d2/d96/d101/f112 to d2/d24/d36/f118 0 2024-09-17T07:20:07.474 INFO:tasks.workunit.client.0.smithi087.stdout:9/923: dread d3/d4/d6/d8/d22/d92/fbd [0,4194304] 0 2024-09-17T07:20:07.475 INFO:tasks.workunit.client.0.smithi087.stdout:9/924: readlink d3/d4/d6/d8/d22/d43/l6e 0 2024-09-17T07:20:07.479 INFO:tasks.workunit.client.0.smithi087.stdout:1/965: write d2/d3d/d35/d57/d73/f8a [439744,10209] 0 2024-09-17T07:20:07.480 INFO:tasks.workunit.client.0.smithi087.stdout:7/883: write d0/d36/d8e/f92 [851656,62876] 0 2024-09-17T07:20:07.480 INFO:tasks.workunit.client.0.smithi087.stdout:2/895: dwrite d2/d50/fb9 [4194304,4194304] 0 2024-09-17T07:20:07.482 INFO:tasks.workunit.client.0.smithi087.stdout:1/966: rmdir d2/d3d/d35/d4f 39 2024-09-17T07:20:07.484 INFO:tasks.workunit.client.0.smithi087.stdout:9/925: truncate d3/d4/d16/ffd 2016821 0 2024-09-17T07:20:07.486 INFO:tasks.workunit.client.0.smithi087.stdout:7/884: symlink d0/d36/d8e/da2/l10e 0 2024-09-17T07:20:07.488 INFO:tasks.workunit.client.0.smithi087.stdout:2/896: rename d2/d7/dd/d6a/d6d/f77 to d2/d15/dce/dd1/d3f/df3/f119 0 2024-09-17T07:20:07.490 INFO:tasks.workunit.client.0.smithi087.stdout:7/885: unlink d0/d3/d23/d2d/c37 0 2024-09-17T07:20:07.492 INFO:tasks.workunit.client.1.smithi139.stdout:4/825: chown d0/db/f74 328839780 1 2024-09-17T07:20:07.492 INFO:tasks.workunit.client.0.smithi087.stdout:7/886: readlink d0/l71 0 2024-09-17T07:20:07.493 INFO:tasks.workunit.client.0.smithi087.stdout:1/967: rename d2/d3d/db4/lc7 to d2/dcf/d7e/l151 0 2024-09-17T07:20:07.495 INFO:tasks.workunit.client.0.smithi087.stdout:7/887: chown d0/d3/d10/dfe/dff/ffc 73578 1 2024-09-17T07:20:07.496 INFO:tasks.workunit.client.1.smithi139.stdout:6/822: link db/d18/d38/d60/f7c db/d18/d1b/dfa/f11c 0 2024-09-17T07:20:07.496 INFO:tasks.workunit.client.0.smithi087.stdout:2/897: link d2/d7/dd/d10/d4c/d5f/d8b/cae d2/d7/dd/d6a/d6d/d111/c11a 0 2024-09-17T07:20:07.497 INFO:tasks.workunit.client.1.smithi139.stdout:6/823: fsync db/df/f84 0 2024-09-17T07:20:07.498 INFO:tasks.workunit.client.0.smithi087.stdout:2/898: rmdir d2/d7/dd/d10/d91/dea 39 2024-09-17T07:20:07.499 INFO:tasks.workunit.client.1.smithi139.stdout:6/824: write db/df/d73/d81/f3c [3891770,6538] 0 2024-09-17T07:20:07.501 INFO:tasks.workunit.client.0.smithi087.stdout:2/899: creat d2/d7/dd/d10/d4c/f11b x:0 0 0 2024-09-17T07:20:07.501 INFO:tasks.workunit.client.1.smithi139.stdout:6/825: fsync db/d18/d1b/da7/fb3 0 2024-09-17T07:20:07.502 INFO:tasks.workunit.client.0.smithi087.stdout:7/888: dread d0/d36/d8e/f92 [0,4194304] 0 2024-09-17T07:20:07.502 INFO:tasks.workunit.client.1.smithi139.stdout:4/826: dread d0/f30 [0,4194304] 0 2024-09-17T07:20:07.503 INFO:tasks.workunit.client.0.smithi087.stdout:2/900: creat d2/d7/d60/d100/f11c x:0 0 0 2024-09-17T07:20:07.503 INFO:tasks.workunit.client.1.smithi139.stdout:7/656: write d5/d17/d4e/d63/f6b [4573641,76520] 0 2024-09-17T07:20:07.504 INFO:tasks.workunit.client.1.smithi139.stdout:6/826: creat db/df/daa/f11d x:0 0 0 2024-09-17T07:20:07.505 INFO:tasks.workunit.client.0.smithi087.stdout:7/889: symlink d0/d3/d23/d17/d7b/dad/l10f 0 2024-09-17T07:20:07.505 INFO:tasks.workunit.client.1.smithi139.stdout:7/657: creat d5/d10/d2b/d40/fd3 x:0 0 0 2024-09-17T07:20:07.506 INFO:tasks.workunit.client.1.smithi139.stdout:4/827: creat d0/f107 x:0 0 0 2024-09-17T07:20:07.507 INFO:tasks.workunit.client.0.smithi087.stdout:2/901: link d2/d7/dd/d10/d4c/dcc/f55 d2/d7/dd/d6a/d6d/d111/f11d 0 2024-09-17T07:20:07.508 INFO:tasks.workunit.client.0.smithi087.stdout:7/890: creat d0/d36/f110 x:0 0 0 2024-09-17T07:20:07.509 INFO:tasks.workunit.client.0.smithi087.stdout:2/902: truncate d2/d7/dd/f29 5363439 0 2024-09-17T07:20:07.510 INFO:tasks.workunit.client.1.smithi139.stdout:6/827: rename db/df/d4e/d5e/d8a/f100 to db/df/d73/dc1/f11e 0 2024-09-17T07:20:07.511 INFO:tasks.workunit.client.1.smithi139.stdout:4/828: read d0/db/d7f/fbc [4765515,69659] 0 2024-09-17T07:20:07.512 INFO:tasks.workunit.client.1.smithi139.stdout:4/829: stat d0/d1/cc 0 2024-09-17T07:20:07.514 INFO:tasks.workunit.client.1.smithi139.stdout:6/828: mknod db/db7/ddb/d103/c11f 0 2024-09-17T07:20:07.516 INFO:tasks.workunit.client.0.smithi087.stdout:7/891: dwrite d0/d3/d10/d32/d8c/fbe [0,4194304] 0 2024-09-17T07:20:07.519 INFO:tasks.workunit.client.0.smithi087.stdout:7/892: symlink d0/d3/d23/d17/d7b/l111 0 2024-09-17T07:20:07.522 INFO:tasks.workunit.client.0.smithi087.stdout:2/903: fsync d2/d7/d60/d100/f11c 0 2024-09-17T07:20:07.527 INFO:tasks.workunit.client.0.smithi087.stdout:2/904: truncate d2/d24/fdd 2070041 0 2024-09-17T07:20:07.528 INFO:tasks.workunit.client.0.smithi087.stdout:7/893: dwrite d0/d3/d23/d4e/fe7 [0,4194304] 0 2024-09-17T07:20:07.529 INFO:tasks.workunit.client.1.smithi139.stdout:7/658: dwrite d5/d17/d4e/f9f [0,4194304] 0 2024-09-17T07:20:07.530 INFO:tasks.workunit.client.0.smithi087.stdout:1/968: dread d2/dcf/d7e/db9/fbc [0,4194304] 0 2024-09-17T07:20:07.530 INFO:tasks.workunit.client.1.smithi139.stdout:4/830: dwrite d0/f9e [0,4194304] 0 2024-09-17T07:20:07.532 INFO:tasks.workunit.client.1.smithi139.stdout:7/659: fsync d5/d17/d4e/d63/fb9 0 2024-09-17T07:20:07.532 INFO:tasks.workunit.client.0.smithi087.stdout:7/894: unlink d0/d3/d10/f38 0 2024-09-17T07:20:07.532 INFO:tasks.workunit.client.0.smithi087.stdout:1/969: write d2/d3d/d35/d57/f124 [257825,63026] 0 2024-09-17T07:20:07.535 INFO:tasks.workunit.client.1.smithi139.stdout:7/660: chown d5/d10/d2b/d40/f81 58910 1 2024-09-17T07:20:07.536 INFO:tasks.workunit.client.0.smithi087.stdout:1/970: chown d2/d3d/d35/c64 154231406 1 2024-09-17T07:20:07.538 INFO:tasks.workunit.client.0.smithi087.stdout:2/905: dwrite d2/d7/dd/d10/d4c/f11b [0,4194304] 0 2024-09-17T07:20:07.539 INFO:tasks.workunit.client.0.smithi087.stdout:7/895: getdents d0/d3/d23/d2d 0 2024-09-17T07:20:07.540 INFO:tasks.workunit.client.0.smithi087.stdout:2/906: chown d2/d96 1437 1 2024-09-17T07:20:07.546 INFO:tasks.workunit.client.0.smithi087.stdout:2/907: unlink d2/d12/d85/lad 0 2024-09-17T07:20:07.548 INFO:tasks.workunit.client.0.smithi087.stdout:9/926: sync 2024-09-17T07:20:07.549 INFO:tasks.workunit.client.0.smithi087.stdout:1/971: rename d2/dc/l32 to d2/d1a/d117/l152 0 2024-09-17T07:20:07.550 INFO:tasks.workunit.client.0.smithi087.stdout:9/927: chown d3/d4/d6/d8/d22/d43/d84 0 1 2024-09-17T07:20:07.550 INFO:tasks.workunit.client.0.smithi087.stdout:1/972: chown d2/d14/fb 5 1 2024-09-17T07:20:07.551 INFO:tasks.workunit.client.1.smithi139.stdout:4/831: rename d0/d1/d54/d93/da2/cd4 to d0/d1/d29/d6a/db6/d102/c108 0 2024-09-17T07:20:07.552 INFO:tasks.workunit.client.1.smithi139.stdout:7/661: symlink d5/d10/d2b/d40/ld4 0 2024-09-17T07:20:07.552 INFO:tasks.workunit.client.0.smithi087.stdout:2/908: dread - d2/d7/d60/fb6 zero size 2024-09-17T07:20:07.553 INFO:tasks.workunit.client.0.smithi087.stdout:9/928: creat d3/d4/d16/f141 x:0 0 0 2024-09-17T07:20:07.554 INFO:tasks.workunit.client.1.smithi139.stdout:7/662: mkdir d5/d17/d4e/d66/dd5 0 2024-09-17T07:20:07.554 INFO:tasks.workunit.client.0.smithi087.stdout:1/973: symlink d2/d48/d61/l153 0 2024-09-17T07:20:07.554 INFO:tasks.workunit.client.0.smithi087.stdout:9/929: chown d3/d4/cfa 1021 1 2024-09-17T07:20:07.554 INFO:tasks.workunit.client.1.smithi139.stdout:7/663: readlink d5/d10/d4d/l57 0 2024-09-17T07:20:07.555 INFO:tasks.workunit.client.0.smithi087.stdout:2/909: creat d2/d24/d113/f11e x:0 0 0 2024-09-17T07:20:07.557 INFO:tasks.workunit.client.1.smithi139.stdout:7/664: mkdir d5/d10/d4d/d59/dd1/dd6 0 2024-09-17T07:20:07.557 INFO:tasks.workunit.client.0.smithi087.stdout:9/930: write d3/d4/d6/d71/d116/f131 [1017964,114850] 0 2024-09-17T07:20:07.557 INFO:tasks.workunit.client.0.smithi087.stdout:1/974: symlink d2/d3d/d45/d90/d37/l154 0 2024-09-17T07:20:07.559 INFO:tasks.workunit.client.1.smithi139.stdout:7/665: symlink d5/d17/d4e/d7a/ld7 0 2024-09-17T07:20:07.559 INFO:tasks.workunit.client.1.smithi139.stdout:4/832: dwrite d0/d37/f9c [0,4194304] 0 2024-09-17T07:20:07.562 INFO:tasks.workunit.client.0.smithi087.stdout:2/910: link d2/d7/l26 d2/d15/dce/dd1/l11f 0 2024-09-17T07:20:07.562 INFO:tasks.workunit.client.1.smithi139.stdout:7/666: readlink d5/d17/d4e/l50 0 2024-09-17T07:20:07.564 INFO:tasks.workunit.client.0.smithi087.stdout:9/931: getdents d3/d4/d6/d8/d12/d38 0 2024-09-17T07:20:07.564 INFO:tasks.workunit.client.0.smithi087.stdout:2/911: write d2/d24/d36/f118 [790957,24488] 0 2024-09-17T07:20:07.565 INFO:tasks.workunit.client.1.smithi139.stdout:7/667: creat d5/d17/d4e/fd8 x:0 0 0 2024-09-17T07:20:07.566 INFO:tasks.workunit.client.0.smithi087.stdout:9/932: dread - d3/d4/d16/d69/d8a/d1e/d90/d93/dff/f133 zero size 2024-09-17T07:20:07.567 INFO:tasks.workunit.client.1.smithi139.stdout:7/668: mknod d5/d96/cd9 0 2024-09-17T07:20:07.573 INFO:tasks.workunit.client.0.smithi087.stdout:9/933: dwrite d3/d25/d83/fad [0,4194304] 0 2024-09-17T07:20:07.576 INFO:tasks.workunit.client.1.smithi139.stdout:4/833: dread d0/d1/d29/d6d/f86 [0,4194304] 0 2024-09-17T07:20:07.577 INFO:tasks.workunit.client.1.smithi139.stdout:4/834: fdatasync d0/db/d58/f5e 0 2024-09-17T07:20:07.581 INFO:tasks.workunit.client.1.smithi139.stdout:4/835: rename d0/d1/d29/c69 to d0/db/db2/db5/c109 0 2024-09-17T07:20:07.582 INFO:tasks.workunit.client.0.smithi087.stdout:9/934: dwrite d3/d4/d6/d8/d22/d43/d84/f112 [0,4194304] 0 2024-09-17T07:20:07.583 INFO:tasks.workunit.client.0.smithi087.stdout:9/935: readlink d3/d4/d6/d8/d22/l79 0 2024-09-17T07:20:07.583 INFO:tasks.workunit.client.1.smithi139.stdout:7/669: dread d5/d10/d2b/f62 [0,4194304] 0 2024-09-17T07:20:07.586 INFO:tasks.workunit.client.0.smithi087.stdout:9/936: truncate d3/d4/f26 7471471 0 2024-09-17T07:20:07.589 INFO:tasks.workunit.client.1.smithi139.stdout:7/670: rename d5/d10/d4d/l57 to d5/d17/d4e/d66/dd5/lda 0 2024-09-17T07:20:07.591 INFO:tasks.workunit.client.1.smithi139.stdout:7/671: dread - d5/d10/fc6 zero size 2024-09-17T07:20:07.592 INFO:tasks.workunit.client.1.smithi139.stdout:4/836: dwrite d0/d1/d29/d6d/f86 [4194304,4194304] 0 2024-09-17T07:20:07.594 INFO:tasks.workunit.client.1.smithi139.stdout:4/837: mknod d0/d10/c10a 0 2024-09-17T07:20:07.595 INFO:tasks.workunit.client.1.smithi139.stdout:4/838: chown d0/d1/d29/d6a/fd0 3633 1 2024-09-17T07:20:07.596 INFO:tasks.workunit.client.0.smithi087.stdout:7/896: dwrite d0/d3/d10/d32/f4c [0,4194304] 0 2024-09-17T07:20:07.599 INFO:tasks.workunit.client.1.smithi139.stdout:7/672: rename d5/d10/f83 to d5/fdb 0 2024-09-17T07:20:07.599 INFO:tasks.workunit.client.0.smithi087.stdout:7/897: write d0/d3/d23/f53 [5161832,2641] 0 2024-09-17T07:20:07.600 INFO:tasks.workunit.client.1.smithi139.stdout:7/673: fsync d5/f18 0 2024-09-17T07:20:07.606 INFO:tasks.workunit.client.0.smithi087.stdout:1/975: dwrite d2/d3d/d8e/fba [0,4194304] 0 2024-09-17T07:20:07.606 INFO:tasks.workunit.client.0.smithi087.stdout:7/898: dread d0/d3/d10/f20 [0,4194304] 0 2024-09-17T07:20:07.607 INFO:tasks.workunit.client.1.smithi139.stdout:7/674: dwrite d5/d10/f2e [0,4194304] 0 2024-09-17T07:20:07.610 INFO:tasks.workunit.client.0.smithi087.stdout:1/976: mknod d2/d1a/d117/c155 0 2024-09-17T07:20:07.612 INFO:tasks.workunit.client.1.smithi139.stdout:7/675: rename d5/d10/d8c/c99 to d5/d96/cdc 0 2024-09-17T07:20:07.613 INFO:tasks.workunit.client.0.smithi087.stdout:7/899: symlink d0/d7a/dfa/l112 0 2024-09-17T07:20:07.616 INFO:tasks.workunit.client.0.smithi087.stdout:1/977: link d2/d3d/d35/f147 d2/dc/d108/f156 0 2024-09-17T07:20:07.617 INFO:tasks.workunit.client.1.smithi139.stdout:7/676: creat d5/d10/fdd x:0 0 0 2024-09-17T07:20:07.618 INFO:tasks.workunit.client.0.smithi087.stdout:9/937: dwrite d3/d4/d6/d8/d12/f60 [0,4194304] 0 2024-09-17T07:20:07.619 INFO:tasks.workunit.client.0.smithi087.stdout:7/900: fsync d0/d3/d23/d2d/fe6 0 2024-09-17T07:20:07.620 INFO:tasks.workunit.client.0.smithi087.stdout:7/901: stat d0/d3/l55 0 2024-09-17T07:20:07.621 INFO:tasks.workunit.client.0.smithi087.stdout:1/978: truncate d2/dcf/f6b 681409 0 2024-09-17T07:20:07.622 INFO:tasks.workunit.client.0.smithi087.stdout:1/979: fsync d2/dcf/d12f/f14f 0 2024-09-17T07:20:07.622 INFO:tasks.workunit.client.0.smithi087.stdout:7/902: fdatasync d0/d3/d23/d17/d7b/dad/f109 0 2024-09-17T07:20:07.623 INFO:tasks.workunit.client.1.smithi139.stdout:7/677: dread d5/d10/d4d/d59/f5f [0,4194304] 0 2024-09-17T07:20:07.623 INFO:tasks.workunit.client.0.smithi087.stdout:1/980: readlink d2/dcf/l122 0 2024-09-17T07:20:07.623 INFO:tasks.workunit.client.0.smithi087.stdout:9/938: fdatasync d3/d4/d6/d8/d12/d32/da1/fed 0 2024-09-17T07:20:07.624 INFO:tasks.workunit.client.0.smithi087.stdout:7/903: dread - d0/d3/d10/d87/d96/db2/fc3 zero size 2024-09-17T07:20:07.625 INFO:tasks.workunit.client.0.smithi087.stdout:1/981: mknod d2/d3d/d8e/c157 0 2024-09-17T07:20:07.628 INFO:tasks.workunit.client.0.smithi087.stdout:1/982: dread - d2/d3d/d45/d90/d43/d5d/f71 zero size 2024-09-17T07:20:07.629 INFO:tasks.workunit.client.0.smithi087.stdout:9/939: creat d3/d4/d6/d71/f142 x:0 0 0 2024-09-17T07:20:07.629 INFO:tasks.workunit.client.1.smithi139.stdout:6/829: dwrite db/df/d4e/d64/d56/d98/fd9 [0,4194304] 0 2024-09-17T07:20:07.631 INFO:tasks.workunit.client.0.smithi087.stdout:7/904: creat d0/d3/d10/d32/d62/f113 x:0 0 0 2024-09-17T07:20:07.632 INFO:tasks.workunit.client.0.smithi087.stdout:7/905: dread - d0/d3/d10/d32/d62/f113 zero size 2024-09-17T07:20:07.633 INFO:tasks.workunit.client.1.smithi139.stdout:6/830: rmdir db/df/d4e/d64/d83/dd5 39 2024-09-17T07:20:07.633 INFO:tasks.workunit.client.0.smithi087.stdout:9/940: dread d3/d4/d6/d8/d22/d43/f77 [0,4194304] 0 2024-09-17T07:20:07.637 INFO:tasks.workunit.client.1.smithi139.stdout:6/831: fdatasync db/df/d4e/d64/d83/dd5/ff9 0 2024-09-17T07:20:07.637 INFO:tasks.workunit.client.0.smithi087.stdout:9/941: symlink d3/d4/d6/d8/d12/db1/l143 0 2024-09-17T07:20:07.640 INFO:tasks.workunit.client.0.smithi087.stdout:9/942: rmdir d3/d4/d16/d69/d8a/d1e/d90/d93/dff 39 2024-09-17T07:20:07.641 INFO:tasks.workunit.client.1.smithi139.stdout:4/839: write d0/d1/dbe/f60 [958916,89454] 0 2024-09-17T07:20:07.645 INFO:tasks.workunit.client.1.smithi139.stdout:4/840: rename d0/d1/dbe/dfd/d106 to d0/d1/d54/d93/da2/d10b 0 2024-09-17T07:20:07.645 INFO:tasks.workunit.client.1.smithi139.stdout:4/841: dread - d0/d1/d29/d6a/fbf zero size 2024-09-17T07:20:07.645 INFO:tasks.workunit.client.1.smithi139.stdout:4/842: read d0/f30 [208295,33321] 0 2024-09-17T07:20:07.647 INFO:tasks.workunit.client.0.smithi087.stdout:9/943: dwrite d3/d4/d6/d8/d22/d92/da3/d113/f129 [0,4194304] 0 2024-09-17T07:20:07.647 INFO:tasks.workunit.client.1.smithi139.stdout:4/843: mknod d0/d10/c10c 0 2024-09-17T07:20:07.652 INFO:tasks.workunit.client.0.smithi087.stdout:9/944: truncate d3/d4/d16/f3a 5024908 0 2024-09-17T07:20:07.652 INFO:tasks.workunit.client.0.smithi087.stdout:9/945: stat d3/d4/d16/d69/d8a/d1e/d90/d93/dff/f133 0 2024-09-17T07:20:07.658 INFO:tasks.workunit.client.1.smithi139.stdout:7/678: dread d5/d67/f82 [0,4194304] 0 2024-09-17T07:20:07.659 INFO:tasks.workunit.client.1.smithi139.stdout:7/679: creat d5/d10/d4d/d59/fde x:0 0 0 2024-09-17T07:20:07.660 INFO:tasks.workunit.client.1.smithi139.stdout:4/844: truncate d0/f71 571751 0 2024-09-17T07:20:07.661 INFO:tasks.workunit.client.0.smithi087.stdout:9/946: dwrite d3/d4/d6/d8/d12/f12d [0,4194304] 0 2024-09-17T07:20:07.661 INFO:tasks.workunit.client.0.smithi087.stdout:1/983: dread d2/d14/fc0 [0,4194304] 0 2024-09-17T07:20:07.661 INFO:tasks.workunit.client.0.smithi087.stdout:7/906: rmdir d0/d3 39 2024-09-17T07:20:07.662 INFO:tasks.workunit.client.1.smithi139.stdout:7/680: mknod d5/d10/d8c/cdf 0 2024-09-17T07:20:07.663 INFO:tasks.workunit.client.1.smithi139.stdout:6/832: dwrite db/d18/d1b/f1d [0,4194304] 0 2024-09-17T07:20:07.663 INFO:tasks.workunit.client.1.smithi139.stdout:4/845: dread d0/f30 [0,4194304] 0 2024-09-17T07:20:07.664 INFO:tasks.workunit.client.0.smithi087.stdout:1/984: symlink d2/dcf/l158 0 2024-09-17T07:20:07.664 INFO:tasks.workunit.client.1.smithi139.stdout:4/846: chown d0/d1/dbe/dfd 235508 1 2024-09-17T07:20:07.665 INFO:tasks.workunit.client.0.smithi087.stdout:7/907: mkdir d0/d36/deb/d114 0 2024-09-17T07:20:07.665 INFO:tasks.workunit.client.1.smithi139.stdout:6/833: symlink db/d18/d9f/l120 0 2024-09-17T07:20:07.668 INFO:tasks.workunit.client.1.smithi139.stdout:7/681: creat d5/d10/d2b/d78/d9e/db1/db7/fe0 x:0 0 0 2024-09-17T07:20:07.670 INFO:tasks.workunit.client.0.smithi087.stdout:9/947: rename d3/d4/d6/d8/d12/db1/fbf to d3/d4/d6/d8/d22/d43/d84/f144 0 2024-09-17T07:20:07.671 INFO:tasks.workunit.client.1.smithi139.stdout:4/847: rmdir d0/db 39 2024-09-17T07:20:07.671 INFO:tasks.workunit.client.1.smithi139.stdout:7/682: write d5/d17/d4e/d63/fb9 [6558779,40154] 0 2024-09-17T07:20:07.671 INFO:tasks.workunit.client.1.smithi139.stdout:6/834: rmdir db/df/d73/da4 39 2024-09-17T07:20:07.671 INFO:tasks.workunit.client.1.smithi139.stdout:6/835: chown db/d18/ca3 199 1 2024-09-17T07:20:07.671 INFO:tasks.workunit.client.1.smithi139.stdout:4/848: write d0/d1/dbe/fab [969024,7293] 0 2024-09-17T07:20:07.673 INFO:tasks.workunit.client.1.smithi139.stdout:4/849: rmdir d0/d1/d54/d93 39 2024-09-17T07:20:07.674 INFO:tasks.workunit.client.0.smithi087.stdout:7/908: getdents d0/d3/d10/d87 0 2024-09-17T07:20:07.674 INFO:tasks.workunit.client.1.smithi139.stdout:7/683: truncate d5/d10/d4d/f88 4891441 0 2024-09-17T07:20:07.674 INFO:tasks.workunit.client.0.smithi087.stdout:1/985: dwrite d2/dcf/d7e/db9/dfb/d101/f10e [0,4194304] 0 2024-09-17T07:20:07.675 INFO:tasks.workunit.client.0.smithi087.stdout:9/948: mkdir d3/d4/d6/d8/d22/d92/d145 0 2024-09-17T07:20:07.676 INFO:tasks.workunit.client.0.smithi087.stdout:2/912: sync 2024-09-17T07:20:07.677 INFO:tasks.workunit.client.1.smithi139.stdout:7/684: mknod d5/d10/d2b/d40/d47/ce1 0 2024-09-17T07:20:07.678 INFO:tasks.workunit.client.1.smithi139.stdout:6/836: creat db/df/d4e/d64/d83/f121 x:0 0 0 2024-09-17T07:20:07.679 INFO:tasks.workunit.client.1.smithi139.stdout:7/685: creat d5/d10/d2b/d71/fe2 x:0 0 0 2024-09-17T07:20:07.680 INFO:tasks.workunit.client.0.smithi087.stdout:1/986: chown d2/d69/d8d/da6/dd6/lef 66 1 2024-09-17T07:20:07.680 INFO:tasks.workunit.client.0.smithi087.stdout:7/909: symlink d0/d3/d10/l115 0 2024-09-17T07:20:07.681 INFO:tasks.workunit.client.0.smithi087.stdout:7/910: chown d0/d3/d10/f20 447 1 2024-09-17T07:20:07.682 INFO:tasks.workunit.client.0.smithi087.stdout:2/913: creat d2/d15/dce/dd1/d114/f120 x:0 0 0 2024-09-17T07:20:07.682 INFO:tasks.workunit.client.0.smithi087.stdout:7/911: truncate d0/fd 2251883 0 2024-09-17T07:20:07.682 INFO:tasks.workunit.client.1.smithi139.stdout:6/837: creat db/d18/d1b/dfa/f122 x:0 0 0 2024-09-17T07:20:07.683 INFO:tasks.workunit.client.0.smithi087.stdout:1/987: unlink d2/d3d/d8e/c157 0 2024-09-17T07:20:07.684 INFO:tasks.workunit.client.0.smithi087.stdout:2/914: creat d2/d7/d60/d100/f121 x:0 0 0 2024-09-17T07:20:07.685 INFO:tasks.workunit.client.0.smithi087.stdout:7/912: creat d0/dbb/f116 x:0 0 0 2024-09-17T07:20:07.686 INFO:tasks.workunit.client.1.smithi139.stdout:6/838: fdatasync db/d18/d38/d60/f94 0 2024-09-17T07:20:07.686 INFO:tasks.workunit.client.0.smithi087.stdout:2/915: read d2/d7/db/fd6 [3098907,98637] 0 2024-09-17T07:20:07.686 INFO:tasks.workunit.client.0.smithi087.stdout:1/988: creat d2/dcf/f159 x:0 0 0 2024-09-17T07:20:07.688 INFO:tasks.workunit.client.1.smithi139.stdout:7/686: link d5/d10/f2e d5/d10/d2b/d78/d9e/db1/db7/fe3 0 2024-09-17T07:20:07.688 INFO:tasks.workunit.client.1.smithi139.stdout:4/850: write d0/d1/dbe/f3e [1929759,28205] 0 2024-09-17T07:20:07.690 INFO:tasks.workunit.client.1.smithi139.stdout:6/839: creat db/df/d4e/d64/d56/d98/f123 x:0 0 0 2024-09-17T07:20:07.690 INFO:tasks.workunit.client.0.smithi087.stdout:1/989: rmdir d2/dcf/d7e 39 2024-09-17T07:20:07.691 INFO:tasks.workunit.client.1.smithi139.stdout:7/687: rename d5/d17/dd0 to d5/d10/d4d/de4 0 2024-09-17T07:20:07.692 INFO:tasks.workunit.client.0.smithi087.stdout:7/913: symlink d0/d7a/df0/l117 0 2024-09-17T07:20:07.692 INFO:tasks.workunit.client.1.smithi139.stdout:7/688: fdatasync d5/d10/d2b/d78/d9e/db1/db7/fe0 0 2024-09-17T07:20:07.693 INFO:tasks.workunit.client.0.smithi087.stdout:2/916: mknod d2/d12/d85/c122 0 2024-09-17T07:20:07.693 INFO:tasks.workunit.client.1.smithi139.stdout:6/840: link db/d18/d38/d60/l82 db/d18/d9f/l124 0 2024-09-17T07:20:07.693 INFO:tasks.workunit.client.0.smithi087.stdout:1/990: rmdir d2/d69/d8d/da6/dd6 39 2024-09-17T07:20:07.694 INFO:tasks.workunit.client.1.smithi139.stdout:6/841: chown db/d18/d1b/dfa/f122 2 1 2024-09-17T07:20:07.694 INFO:tasks.workunit.client.1.smithi139.stdout:7/689: creat d5/d96/fe5 x:0 0 0 2024-09-17T07:20:07.694 INFO:tasks.workunit.client.0.smithi087.stdout:2/917: chown d2/d7/dd/d10/d4c/dcc/f55 333695574 1 2024-09-17T07:20:07.694 INFO:tasks.workunit.client.0.smithi087.stdout:9/949: write d3/d4/d16/ffd [938910,66987] 0 2024-09-17T07:20:07.696 INFO:tasks.workunit.client.0.smithi087.stdout:2/918: mknod d2/d7/db/de1/c123 0 2024-09-17T07:20:07.698 INFO:tasks.workunit.client.0.smithi087.stdout:7/914: rename d0/d3 to d0/d36/d8e/df1/d118 0 2024-09-17T07:20:07.698 INFO:tasks.workunit.client.0.smithi087.stdout:9/950: creat d3/d4/d16/d69/d8a/d1e/f146 x:0 0 0 2024-09-17T07:20:07.700 INFO:tasks.workunit.client.0.smithi087.stdout:9/951: truncate d3/d4/da/de9/f105 636981 0 2024-09-17T07:20:07.702 INFO:tasks.workunit.client.0.smithi087.stdout:2/919: link d2/d15/dce/dd1/d3f/fdc d2/d24/d113/f124 0 2024-09-17T07:20:07.702 INFO:tasks.workunit.client.0.smithi087.stdout:9/952: dread - d3/d4/d6/d8/d22/f137 zero size 2024-09-17T07:20:07.705 INFO:tasks.workunit.client.0.smithi087.stdout:2/920: mkdir d2/d7/db/d125 0 2024-09-17T07:20:07.708 INFO:tasks.workunit.client.0.smithi087.stdout:2/921: mknod d2/d7/d33/daa/c126 0 2024-09-17T07:20:07.708 INFO:tasks.workunit.client.0.smithi087.stdout:9/953: creat d3/d4/d6/d8/d12/f147 x:0 0 0 2024-09-17T07:20:07.710 INFO:tasks.workunit.client.0.smithi087.stdout:2/922: rmdir d2/d12/d85 39 2024-09-17T07:20:07.712 INFO:tasks.workunit.client.0.smithi087.stdout:1/991: write d2/d48/d61/fb6 [988330,610] 0 2024-09-17T07:20:07.714 INFO:tasks.workunit.client.0.smithi087.stdout:2/923: mknod d2/d96/c127 0 2024-09-17T07:20:07.715 INFO:tasks.workunit.client.0.smithi087.stdout:7/915: truncate d0/d36/d8e/df1/d118/d10/d32/d8c/fc4 2206014 0 2024-09-17T07:20:07.718 INFO:tasks.workunit.client.0.smithi087.stdout:7/916: symlink d0/d36/d8e/da2/l119 0 2024-09-17T07:20:07.720 INFO:tasks.workunit.client.0.smithi087.stdout:1/992: link d2/dcf/d7e/db9/feb d2/dcf/d7e/db9/dfb/d101/f15a 0 2024-09-17T07:20:07.720 INFO:tasks.workunit.client.0.smithi087.stdout:9/954: write d3/d4/d6/d8/d12/d38/fea [4534194,73212] 0 2024-09-17T07:20:07.725 INFO:tasks.workunit.client.0.smithi087.stdout:1/993: creat d2/d3d/d35/d57/d73/f15b x:0 0 0 2024-09-17T07:20:07.726 INFO:tasks.workunit.client.0.smithi087.stdout:7/917: creat d0/f11a x:0 0 0 2024-09-17T07:20:07.728 INFO:tasks.workunit.client.0.smithi087.stdout:2/924: dwrite d2/d15/dce/dd1/d3f/f93 [0,4194304] 0 2024-09-17T07:20:07.729 INFO:tasks.workunit.client.1.smithi139.stdout:6/842: rmdir db/db7/ddb 39 2024-09-17T07:20:07.729 INFO:tasks.workunit.client.0.smithi087.stdout:1/994: chown d2/dcf/d9a/ld8 57 1 2024-09-17T07:20:07.730 INFO:tasks.workunit.client.1.smithi139.stdout:7/690: mkdir d5/d10/d2b/d40/d47/de6 0 2024-09-17T07:20:07.733 INFO:tasks.workunit.client.0.smithi087.stdout:7/918: creat d0/d36/d8e/df1/d118/d10/d87/d10a/f11b x:0 0 0 2024-09-17T07:20:07.734 INFO:tasks.workunit.client.1.smithi139.stdout:7/691: rmdir d5/d10/d2b/d40/d47/de6 0 2024-09-17T07:20:07.735 INFO:tasks.workunit.client.0.smithi087.stdout:1/995: unlink d2/d3d/d45/d90/ff 0 2024-09-17T07:20:07.737 INFO:tasks.workunit.client.0.smithi087.stdout:9/955: dwrite d3/d4/da/ff8 [0,4194304] 0 2024-09-17T07:20:07.740 INFO:tasks.workunit.client.0.smithi087.stdout:1/996: creat d2/d3d/d35/d57/d73/d137/f15c x:0 0 0 2024-09-17T07:20:07.740 INFO:tasks.workunit.client.0.smithi087.stdout:9/956: symlink d3/d4/d16/d69/d8a/l148 0 2024-09-17T07:20:07.742 INFO:tasks.workunit.client.0.smithi087.stdout:9/957: dread d3/d4/d16/fc2 [0,4194304] 0 2024-09-17T07:20:07.744 INFO:tasks.workunit.client.0.smithi087.stdout:1/997: creat d2/d3d/d45/d90/f15d x:0 0 0 2024-09-17T07:20:07.746 INFO:tasks.workunit.client.0.smithi087.stdout:9/958: chown d3/d4/d6/d8/d22/d92/da3/fa9 1288743 1 2024-09-17T07:20:07.747 INFO:tasks.workunit.client.0.smithi087.stdout:1/998: rmdir d2/d48/d6f 39 2024-09-17T07:20:07.748 INFO:tasks.workunit.client.0.smithi087.stdout:2/925: truncate d2/d50/fec 1795058 0 2024-09-17T07:20:07.749 INFO:tasks.workunit.client.0.smithi087.stdout:1/999: fsync d2/dcf/d7e/db9/dfb/d101/f15a 0 2024-09-17T07:20:07.752 INFO:tasks.workunit.client.1.smithi139.stdout:7/692: dwrite d5/d17/fb0 [0,4194304] 0 2024-09-17T07:20:07.752 INFO:tasks.workunit.client.0.smithi087.stdout:9/959: getdents d3/d4 0 2024-09-17T07:20:07.753 INFO:tasks.workunit.client.1.smithi139.stdout:6/843: dwrite db/d18/d1b/f37 [0,4194304] 0 2024-09-17T07:20:07.753 INFO:tasks.workunit.client.0.smithi087.stdout:2/926: creat d2/d15/dce/dd1/f128 x:0 0 0 2024-09-17T07:20:07.753 INFO:tasks.workunit.client.0.smithi087.stdout:9/960: read - d3/d4/d6/d8/d12/d32/f139 zero size 2024-09-17T07:20:07.757 INFO:tasks.workunit.client.1.smithi139.stdout:6/844: rename db/df/d4e/d64/d83/f110 to db/d18/d38/d60/dc2/f125 0 2024-09-17T07:20:07.758 INFO:tasks.workunit.client.1.smithi139.stdout:7/693: write d5/d10/d2b/d71/fbc [817734,127037] 0 2024-09-17T07:20:07.761 INFO:tasks.workunit.client.1.smithi139.stdout:7/694: read d5/d10/d4d/fc9 [6880555,8737] 0 2024-09-17T07:20:07.762 INFO:tasks.workunit.client.0.smithi087.stdout:9/961: dwrite d3/d4/d16/d69/d8a/d1e/f107 [0,4194304] 0 2024-09-17T07:20:07.764 INFO:tasks.workunit.client.0.smithi087.stdout:7/919: dread d0/d36/d8e/df1/d118/d23/d17/f65 [0,4194304] 0 2024-09-17T07:20:07.764 INFO:tasks.workunit.client.1.smithi139.stdout:7/695: truncate d5/d10/d2b/d78/d9e/db1/db7/fe0 191850 0 2024-09-17T07:20:07.773 INFO:tasks.workunit.client.1.smithi139.stdout:6/845: dwrite db/df/d4e/d64/d80/fb5 [0,4194304] 0 2024-09-17T07:20:07.778 INFO:tasks.workunit.client.0.smithi087.stdout:7/920: write d0/d36/d8e/df1/d118/d10/dfe/dff/ffc [827049,111864] 0 2024-09-17T07:20:07.781 INFO:tasks.workunit.client.0.smithi087.stdout:7/921: rmdir d0/d36/d8e/df1/d118/d23/d17/d7b/dad 39 2024-09-17T07:20:07.781 INFO:tasks.workunit.client.1.smithi139.stdout:6/846: dwrite db/d18/d1b/da7/fb1 [0,4194304] 0 2024-09-17T07:20:07.782 INFO:tasks.workunit.client.0.smithi087.stdout:7/922: rmdir d0/d36/d8e/df1/d118/d23/d2d 39 2024-09-17T07:20:07.783 INFO:tasks.workunit.client.1.smithi139.stdout:6/847: chown db/df/d73/f7a 22 1 2024-09-17T07:20:07.785 INFO:tasks.workunit.client.1.smithi139.stdout:6/848: mkdir db/df/d4c/dbc/d126 0 2024-09-17T07:20:07.786 INFO:tasks.workunit.client.0.smithi087.stdout:7/923: mknod d0/d36/d8e/df1/d118/d23/d17/d7b/dad/daf/df6/c11c 0 2024-09-17T07:20:07.787 INFO:tasks.workunit.client.0.smithi087.stdout:7/924: chown d0/d36/d8e/df1/d118/d23/d17/f3a 7 1 2024-09-17T07:20:07.788 INFO:tasks.workunit.client.1.smithi139.stdout:6/849: symlink db/df/d4e/d5e/de5/l127 0 2024-09-17T07:20:07.789 INFO:tasks.workunit.client.0.smithi087.stdout:7/925: symlink d0/d36/d8e/df1/d118/d23/d17/d7b/dad/daf/df6/l11d 0 2024-09-17T07:20:07.792 INFO:tasks.workunit.client.0.smithi087.stdout:7/926: rmdir d0/d36/d8e/df1/d118/d23/d17 39 2024-09-17T07:20:07.793 INFO:tasks.workunit.client.0.smithi087.stdout:7/927: dread d0/d36/d8e/df1/d118/d10/fb7 [0,4194304] 0 2024-09-17T07:20:07.794 INFO:tasks.workunit.client.0.smithi087.stdout:7/928: write d0/d36/d8e/df1/d118/d23/d4e/fe7 [557056,5438] 0 2024-09-17T07:20:07.796 INFO:tasks.workunit.client.0.smithi087.stdout:7/929: mkdir d0/d36/d8e/df1/d118/d10/d87/d10a/d11e 0 2024-09-17T07:20:07.798 INFO:tasks.workunit.client.0.smithi087.stdout:7/930: mkdir d0/d36/d8e/df1/d118/d10/d32/d62/d76/d11f 0 2024-09-17T07:20:07.799 INFO:tasks.workunit.client.0.smithi087.stdout:9/962: truncate d3/d4/d6/d8/d22/d92/fbd 451251 0 2024-09-17T07:20:07.800 INFO:tasks.workunit.client.0.smithi087.stdout:9/963: fsync d3/d4/d16/f141 0 2024-09-17T07:20:07.800 INFO:tasks.workunit.client.0.smithi087.stdout:7/931: write d0/d36/d8e/df1/d118/d10/f20 [3516461,94753] 0 2024-09-17T07:20:07.803 INFO:tasks.workunit.client.1.smithi139.stdout:6/850: dwrite db/df/d4e/d64/fb2 [0,4194304] 0 2024-09-17T07:20:07.808 INFO:tasks.workunit.client.1.smithi139.stdout:6/851: creat db/d18/d9f/f128 x:0 0 0 2024-09-17T07:20:07.809 INFO:tasks.workunit.client.1.smithi139.stdout:6/852: creat db/d18/d1b/dfa/f129 x:0 0 0 2024-09-17T07:20:07.810 INFO:tasks.workunit.client.0.smithi087.stdout:7/932: truncate d0/d36/d8e/df1/d118/d10/d32/d62/d76/f84 537110 0 2024-09-17T07:20:07.814 INFO:tasks.workunit.client.1.smithi139.stdout:6/853: write db/df/fe0 [767938,34621] 0 2024-09-17T07:20:07.816 INFO:tasks.workunit.client.1.smithi139.stdout:6/854: creat db/d21/d96/f12a x:0 0 0 2024-09-17T07:20:07.817 INFO:tasks.workunit.client.1.smithi139.stdout:0/577: sync 2024-09-17T07:20:07.819 INFO:tasks.workunit.client.1.smithi139.stdout:0/578: mknod d1/cd4 0 2024-09-17T07:20:07.820 INFO:tasks.workunit.client.1.smithi139.stdout:6/855: getdents db/df/d4e/d64 0 2024-09-17T07:20:07.822 INFO:tasks.workunit.client.1.smithi139.stdout:6/856: chown db/df/d4e/d64/d54/f3a 194270 1 2024-09-17T07:20:07.824 INFO:tasks.workunit.client.0.smithi087.stdout:7/933: write d0/d36/d8e/df1/d118/d10/d32/d62/d76/f84 [599378,13763] 0 2024-09-17T07:20:07.824 INFO:tasks.workunit.client.1.smithi139.stdout:6/857: creat db/df/d4e/d64/d83/dc5/f12b x:0 0 0 2024-09-17T07:20:07.825 INFO:tasks.workunit.client.1.smithi139.stdout:0/579: write d1/da/d17/f34 [478619,80930] 0 2024-09-17T07:20:07.825 INFO:tasks.workunit.client.1.smithi139.stdout:6/858: dread - db/df/d4e/d64/f52 zero size 2024-09-17T07:20:07.826 INFO:tasks.workunit.client.0.smithi087.stdout:7/934: creat d0/d36/d8e/df1/d118/d10/d32/d8c/f120 x:0 0 0 2024-09-17T07:20:07.828 INFO:tasks.workunit.client.1.smithi139.stdout:6/859: symlink db/d18/l12c 0 2024-09-17T07:20:07.828 INFO:tasks.workunit.client.0.smithi087.stdout:7/935: creat d0/d36/d8e/df1/d118/d23/f121 x:0 0 0 2024-09-17T07:20:07.830 INFO:tasks.workunit.client.0.smithi087.stdout:7/936: creat d0/d36/d8e/da2/f122 x:0 0 0 2024-09-17T07:20:07.832 INFO:tasks.workunit.client.1.smithi139.stdout:6/860: symlink db/d18/d38/d60/dc2/l12d 0 2024-09-17T07:20:07.832 INFO:tasks.workunit.client.1.smithi139.stdout:0/580: dwrite d1/da/d17/d72/d66/fcf [0,4194304] 0 2024-09-17T07:20:07.832 INFO:tasks.workunit.client.0.smithi087.stdout:7/937: creat d0/d36/d8e/df1/d118/d10/d32/d8c/de8/f123 x:0 0 0 2024-09-17T07:20:07.835 INFO:tasks.workunit.client.1.smithi139.stdout:6/861: chown db/d21/l4b 15436233 1 2024-09-17T07:20:07.838 INFO:tasks.workunit.client.1.smithi139.stdout:0/581: rename d1/da/fc to d1/da/d1b/d3d/d5a/d75/d91/fd5 0 2024-09-17T07:20:07.839 INFO:tasks.workunit.client.1.smithi139.stdout:6/862: mkdir db/df/d4e/d64/d12e 0 2024-09-17T07:20:07.840 INFO:tasks.workunit.client.1.smithi139.stdout:0/582: mkdir d1/da/d1b/d32/d9a/dd6 0 2024-09-17T07:20:07.841 INFO:tasks.workunit.client.1.smithi139.stdout:6/863: mkdir db/df/daa/d12f 0 2024-09-17T07:20:07.842 INFO:tasks.workunit.client.1.smithi139.stdout:0/583: unlink d1/da/d17/f34 0 2024-09-17T07:20:07.844 INFO:tasks.workunit.client.1.smithi139.stdout:0/584: creat d1/da/d1b/db6/fd7 x:0 0 0 2024-09-17T07:20:07.845 INFO:tasks.workunit.client.1.smithi139.stdout:6/864: creat db/df/d73/da4/f130 x:0 0 0 2024-09-17T07:20:07.848 INFO:tasks.workunit.client.1.smithi139.stdout:6/865: rmdir db/df/d4e/d5e/d8a 39 2024-09-17T07:20:07.850 INFO:tasks.workunit.client.1.smithi139.stdout:0/585: getdents d1/da/d17/d65/d8b 0 2024-09-17T07:20:07.850 INFO:tasks.workunit.client.1.smithi139.stdout:6/866: truncate db/d21/d96/df4/ffc 1015259 0 2024-09-17T07:20:07.853 INFO:tasks.workunit.client.1.smithi139.stdout:6/867: write db/df/d4e/f55 [2545952,33248] 0 2024-09-17T07:20:07.854 INFO:tasks.workunit.client.1.smithi139.stdout:6/868: dread - db/d18/d1b/dfa/f129 zero size 2024-09-17T07:20:07.855 INFO:tasks.workunit.client.1.smithi139.stdout:6/869: write db/d21/d96/f12a [365473,105172] 0 2024-09-17T07:20:07.856 INFO:tasks.workunit.client.1.smithi139.stdout:0/586: rename d1/da/d1b/l86 to d1/da/d1b/d32/d81/ld8 0 2024-09-17T07:20:07.860 INFO:tasks.workunit.client.1.smithi139.stdout:6/870: mkdir db/df/d4e/d64/d80/d131 0 2024-09-17T07:20:07.862 INFO:tasks.workunit.client.1.smithi139.stdout:6/871: dread db/d18/f8e [0,4194304] 0 2024-09-17T07:20:07.862 INFO:tasks.workunit.client.1.smithi139.stdout:6/872: dread - db/df/daa/f11d zero size 2024-09-17T07:20:07.865 INFO:tasks.workunit.client.1.smithi139.stdout:6/873: dread - db/df/d4e/d64/d83/dc5/fe8 zero size 2024-09-17T07:20:07.867 INFO:tasks.workunit.client.1.smithi139.stdout:6/874: unlink db/df/d4e/d64/d83/dc5/f12b 0 2024-09-17T07:20:07.871 INFO:tasks.workunit.client.1.smithi139.stdout:0/587: dread d1/da/d1b/d32/f37 [0,4194304] 0 2024-09-17T07:20:07.873 INFO:tasks.workunit.client.1.smithi139.stdout:0/588: symlink d1/da/d1b/d3d/ld9 0 2024-09-17T07:20:07.875 INFO:tasks.workunit.client.1.smithi139.stdout:0/589: unlink d1/da/d1b/d32/f73 0 2024-09-17T07:20:07.876 INFO:tasks.workunit.client.1.smithi139.stdout:0/590: chown d1/da/d1b/d3d/d5a/fb9 7 1 2024-09-17T07:20:07.886 INFO:tasks.workunit.client.1.smithi139.stdout:0/591: dread d1/da/d1b/f42 [0,4194304] 0 2024-09-17T07:20:07.887 INFO:tasks.workunit.client.1.smithi139.stdout:0/592: dread - d1/da/d1b/db6/fd7 zero size 2024-09-17T07:20:07.892 INFO:tasks.workunit.client.1.smithi139.stdout:0/593: dwrite d1/da/d1b/db6/fd7 [0,4194304] 0 2024-09-17T07:20:07.896 INFO:tasks.workunit.client.1.smithi139.stdout:0/594: mknod d1/da/d1b/cda 0 2024-09-17T07:20:07.898 INFO:tasks.workunit.client.1.smithi139.stdout:0/595: rmdir d1/da/d17/d72/d66 39 2024-09-17T07:20:07.900 INFO:tasks.workunit.client.1.smithi139.stdout:0/596: mkdir d1/da/d1b/ddb 0 2024-09-17T07:20:07.901 INFO:tasks.workunit.client.1.smithi139.stdout:0/597: rmdir d1/da/d17/d72/d66 39 2024-09-17T07:20:07.902 INFO:tasks.workunit.client.1.smithi139.stdout:0/598: mknod d1/da/d17/db8/cdc 0 2024-09-17T07:20:07.905 INFO:tasks.workunit.client.1.smithi139.stdout:0/599: link d1/da/d17/db8/fce d1/da/d17/d72/d66/fdd 0 2024-09-17T07:20:07.916 INFO:tasks.workunit.client.1.smithi139.stdout:0/600: dwrite d1/da/d17/d72/f22 [4194304,4194304] 0 2024-09-17T07:20:07.923 INFO:tasks.workunit.client.1.smithi139.stdout:0/601: dwrite d1/da/d17/d72/d66/fcf [0,4194304] 0 2024-09-17T07:20:07.926 INFO:tasks.workunit.client.1.smithi139.stdout:0/602: symlink d1/da/d17/d72/d66/d6c/lde 0 2024-09-17T07:20:07.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:07 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:20:07.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:07 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:20:07.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:07 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T07:20:07.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:07 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-17T07:20:07.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:07 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-17T07:20:07.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:07 smithi087 ceph-mon[27636]: Adjusting osd_memory_target on smithi087 to 1557M 2024-09-17T07:20:07.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:07 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:20:07.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:07 smithi087 ceph-mon[27636]: pgmap v17: 65 pgs: 65 active+clean; 3.6 GiB data, 12 GiB used, 525 GiB / 536 GiB avail; 149 MiB/s rd, 370 MiB/s wr, 788 op/s 2024-09-17T07:20:07.928 INFO:tasks.workunit.client.1.smithi139.stdout:0/603: truncate d1/da/d17/d72/d66/f89 816243 0 2024-09-17T07:20:07.929 INFO:tasks.workunit.client.1.smithi139.stdout:0/604: chown d1/da/d17/d65/d8b 317 1 2024-09-17T07:20:07.930 INFO:tasks.workunit.client.1.smithi139.stdout:0/605: write d1/da/d17/d72/d66/fcf [1954380,75394] 0 2024-09-17T07:20:07.933 INFO:tasks.workunit.client.0.smithi087.stdout:2/927: sync 2024-09-17T07:20:07.934 INFO:tasks.workunit.client.1.smithi139.stdout:0/606: read d1/da/d17/d72/f22 [1634919,64726] 0 2024-09-17T07:20:07.935 INFO:tasks.workunit.client.0.smithi087.stdout:2/928: creat d2/d7/f129 x:0 0 0 2024-09-17T07:20:07.936 INFO:tasks.workunit.client.1.smithi139.stdout:0/607: creat d1/da/d1b/d3d/d5a/d75/d93/fdf x:0 0 0 2024-09-17T07:20:07.940 INFO:tasks.workunit.client.1.smithi139.stdout:0/608: fsync d1/da/d1b/d3d/d5a/d75/d93/fdf 0 2024-09-17T07:20:07.941 INFO:tasks.workunit.client.0.smithi087.stdout:2/929: dwrite d2/d7/dd/f27 [0,4194304] 0 2024-09-17T07:20:07.943 INFO:tasks.workunit.client.0.smithi087.stdout:2/930: mknod d2/d96/d101/da4/c12a 0 2024-09-17T07:20:07.945 INFO:tasks.workunit.client.0.smithi087.stdout:2/931: getdents d2/d15/dce/dd1/d103 0 2024-09-17T07:20:07.947 INFO:tasks.workunit.client.0.smithi087.stdout:2/932: mknod d2/d24/d113/c12b 0 2024-09-17T07:20:07.948 INFO:tasks.workunit.client.1.smithi139.stdout:0/609: dwrite d1/da/d1b/d3d/d50/f55 [0,4194304] 0 2024-09-17T07:20:07.949 INFO:tasks.workunit.client.1.smithi139.stdout:0/610: chown d1/da/d1b/d32/f47 10109 1 2024-09-17T07:20:07.951 INFO:tasks.workunit.client.1.smithi139.stdout:0/611: mknod d1/da/d1b/d3d/ce0 0 2024-09-17T07:20:07.955 INFO:tasks.workunit.client.0.smithi087.stdout:2/933: write d2/d50/fec [1240692,43041] 0 2024-09-17T07:20:07.957 INFO:tasks.workunit.client.1.smithi139.stdout:0/612: dwrite d1/da/d1b/d32/f4f [0,4194304] 0 2024-09-17T07:20:07.959 INFO:tasks.workunit.client.1.smithi139.stdout:0/613: fsync d1/da/d1b/d32/f47 0 2024-09-17T07:20:07.960 INFO:tasks.workunit.client.0.smithi087.stdout:2/934: rename d2/d7/db/c2f to d2/d15/dce/dd1/d3f/df3/c12c 0 2024-09-17T07:20:07.963 INFO:tasks.workunit.client.1.smithi139.stdout:0/614: rename d1/da/d17/d65/l84 to d1/da/d1b/d3d/le1 0 2024-09-17T07:20:07.963 INFO:tasks.workunit.client.0.smithi087.stdout:2/935: truncate d2/d7/dd/d6a/d6d/fe4 391108 0 2024-09-17T07:20:07.964 INFO:tasks.workunit.client.0.smithi087.stdout:2/936: symlink d2/d50/db8/l12d 0 2024-09-17T07:20:07.970 INFO:tasks.workunit.client.1.smithi139.stdout:0/615: dread d1/da/d17/d65/f85 [0,4194304] 0 2024-09-17T07:20:07.971 INFO:tasks.workunit.client.0.smithi087.stdout:2/937: dwrite d2/d48/f10d [0,4194304] 0 2024-09-17T07:20:07.971 INFO:tasks.workunit.client.1.smithi139.stdout:0/616: stat d1/d58/c63 0 2024-09-17T07:20:07.973 INFO:tasks.workunit.client.0.smithi087.stdout:2/938: mkdir d2/d96/d101/da4/d12e 0 2024-09-17T07:20:07.973 INFO:tasks.workunit.client.1.smithi139.stdout:0/617: symlink d1/da/d17/d72/le2 0 2024-09-17T07:20:07.978 INFO:tasks.workunit.client.0.smithi087.stdout:2/939: rename d2/d7/dd/d10/d4c/d6c/ccb to d2/d15/dce/dd1/d99/c12f 0 2024-09-17T07:20:07.981 INFO:tasks.workunit.client.1.smithi139.stdout:3/862: sync 2024-09-17T07:20:07.981 INFO:tasks.workunit.client.1.smithi139.stdout:5/884: sync 2024-09-17T07:20:07.981 INFO:tasks.workunit.client.1.smithi139.stdout:8/972: sync 2024-09-17T07:20:07.981 INFO:tasks.workunit.client.1.smithi139.stdout:2/955: sync 2024-09-17T07:20:07.981 INFO:tasks.workunit.client.1.smithi139.stdout:1/724: sync 2024-09-17T07:20:07.984 INFO:tasks.workunit.client.1.smithi139.stdout:8/973: chown d0/d20/d28/d52/d65/d7f/ld5 1220 1 2024-09-17T07:20:07.985 INFO:tasks.workunit.client.1.smithi139.stdout:5/885: truncate d4/d16/d1b/d20/d28/f1f 9098167 0 2024-09-17T07:20:07.985 INFO:tasks.workunit.client.1.smithi139.stdout:8/974: readlink d0/d1a/d4d/lc3 0 2024-09-17T07:20:07.985 INFO:tasks.workunit.client.1.smithi139.stdout:3/863: mkdir d5/d21/dba/d10d 0 2024-09-17T07:20:07.986 INFO:tasks.workunit.client.1.smithi139.stdout:5/886: dread - d4/f43 zero size 2024-09-17T07:20:07.986 INFO:tasks.workunit.client.1.smithi139.stdout:2/956: dread d0/d7/d86/da4/d12/fc2 [0,4194304] 0 2024-09-17T07:20:07.986 INFO:tasks.workunit.client.1.smithi139.stdout:3/864: fdatasync d5/d15/d20/ff1 0 2024-09-17T07:20:07.987 INFO:tasks.workunit.client.1.smithi139.stdout:5/887: stat d4/d16/d69 0 2024-09-17T07:20:07.987 INFO:tasks.workunit.client.1.smithi139.stdout:1/725: creat d2/d10/d12/d1a/dd7/d2b/fe1 x:0 0 0 2024-09-17T07:20:07.988 INFO:tasks.workunit.client.1.smithi139.stdout:2/957: read - d0/df8/f121 zero size 2024-09-17T07:20:07.988 INFO:tasks.workunit.client.0.smithi087.stdout:2/940: write d2/d7/d33/fc5 [761830,26991] 0 2024-09-17T07:20:07.989 INFO:tasks.workunit.client.1.smithi139.stdout:3/865: fdatasync d5/d15/f51 0 2024-09-17T07:20:07.989 INFO:tasks.workunit.client.0.smithi087.stdout:2/941: creat d2/d96/d101/da4/f130 x:0 0 0 2024-09-17T07:20:07.991 INFO:tasks.workunit.client.1.smithi139.stdout:0/618: truncate d1/da/d17/d65/f85 20763 0 2024-09-17T07:20:07.991 INFO:tasks.workunit.client.0.smithi087.stdout:9/964: sync 2024-09-17T07:20:07.992 INFO:tasks.workunit.client.0.smithi087.stdout:7/938: sync 2024-09-17T07:20:07.992 INFO:tasks.workunit.client.1.smithi139.stdout:5/888: chown d4/d16/d1b/d20/d67/d88/d9f/dfc/l10a 2 1 2024-09-17T07:20:07.992 INFO:tasks.workunit.client.0.smithi087.stdout:2/942: creat d2/d15/dce/dd1/f131 x:0 0 0 2024-09-17T07:20:07.993 INFO:tasks.workunit.client.1.smithi139.stdout:3/866: creat d5/d63/db3/f10e x:0 0 0 2024-09-17T07:20:07.997 INFO:tasks.workunit.client.1.smithi139.stdout:8/975: dwrite d0/f7 [4194304,4194304] 0 2024-09-17T07:20:08.042 INFO:tasks.workunit.client.1.smithi139.stdout:2/958: getdents d0/d4e/d76 0 2024-09-17T07:20:08.046 INFO:tasks.workunit.client.0.smithi087.stdout:7/939: creat d0/d36/d8e/df1/d118/d23/d17/d7b/dad/daf/f124 x:0 0 0 2024-09-17T07:20:08.046 INFO:tasks.workunit.client.0.smithi087.stdout:9/965: dwrite d3/d4/da/ff8 [0,4194304] 0 2024-09-17T07:20:08.046 INFO:tasks.workunit.client.0.smithi087.stdout:7/940: dread d0/d36/d8e/df1/d118/d10/d32/f99 [0,4194304] 0 2024-09-17T07:20:08.046 INFO:tasks.workunit.client.0.smithi087.stdout:9/966: rename d3/d4/da/d4b/f140 to d3/d4/d16/d69/d8a/d1e/d90/d93/f149 0 2024-09-17T07:20:08.046 INFO:tasks.workunit.client.0.smithi087.stdout:7/941: dread - d0/d7a/fed zero size 2024-09-17T07:20:08.046 INFO:tasks.workunit.client.0.smithi087.stdout:9/967: mkdir d3/d4/d16/d69/d8a/d1e/d90/d14a 0 2024-09-17T07:20:08.046 INFO:tasks.workunit.client.0.smithi087.stdout:9/968: mkdir d3/d4/d6/d8/d22/d10c/d14b 0 2024-09-17T07:20:08.046 INFO:tasks.workunit.client.0.smithi087.stdout:7/942: dwrite d0/d36/d8e/df1/d118/d10/d32/d8c/de8/f123 [0,4194304] 0 2024-09-17T07:20:08.046 INFO:tasks.workunit.client.0.smithi087.stdout:7/943: dread d0/d36/d8e/df1/d118/d10/d32/d62/d76/f84 [0,4194304] 0 2024-09-17T07:20:08.046 INFO:tasks.workunit.client.0.smithi087.stdout:7/944: unlink d0/d36/d8e/df1/d118/d23/d17/l39 0 2024-09-17T07:20:08.047 INFO:tasks.workunit.client.0.smithi087.stdout:7/945: stat d0/d36/d8e/df1/d118/d23/d17/d7b/dad/d89/f98 0 2024-09-17T07:20:08.047 INFO:tasks.workunit.client.0.smithi087.stdout:7/946: chown d0/d36/d8e/df1/d118/d23/d4e/cbf 94 1 2024-09-17T07:20:08.049 INFO:tasks.workunit.client.1.smithi139.stdout:5/889: write d4/d16/d1b/d20/f56 [3230017,11686] 0 2024-09-17T07:20:08.049 INFO:tasks.workunit.client.1.smithi139.stdout:8/976: chown d0/d20/fdc 6594 1 2024-09-17T07:20:08.049 INFO:tasks.workunit.client.1.smithi139.stdout:3/867: mknod d5/da7/dca/dab/dd6/d28/db5/c10f 0 2024-09-17T07:20:08.049 INFO:tasks.workunit.client.1.smithi139.stdout:0/619: dwrite d1/da/d17/f9f [0,4194304] 0 2024-09-17T07:20:08.049 INFO:tasks.workunit.client.1.smithi139.stdout:3/868: chown d5/d21/d23/d69/dd5 18 1 2024-09-17T07:20:08.049 INFO:tasks.workunit.client.1.smithi139.stdout:3/869: write d5/d21/d23/f5d [800023,112323] 0 2024-09-17T07:20:08.049 INFO:tasks.workunit.client.1.smithi139.stdout:5/890: symlink d4/d16/d1b/d20/d32/d3d/l125 0 2024-09-17T07:20:08.049 INFO:tasks.workunit.client.1.smithi139.stdout:2/959: dread d0/d7/d67/da1/d10d/d15/f23 [4194304,4194304] 0 2024-09-17T07:20:08.050 INFO:tasks.workunit.client.1.smithi139.stdout:1/726: link d2/d10/d12/d1a/dd7/d2b/f42 d2/d10/d12/d1a/dd7/d2b/fe2 0 2024-09-17T07:20:08.050 INFO:tasks.workunit.client.1.smithi139.stdout:8/977: dwrite d0/fff [0,4194304] 0 2024-09-17T07:20:08.050 INFO:tasks.workunit.client.1.smithi139.stdout:2/960: creat d0/d3b/ddc/f139 x:0 0 0 2024-09-17T07:20:08.050 INFO:tasks.workunit.client.1.smithi139.stdout:5/891: symlink d4/d16/d1b/de7/l126 0 2024-09-17T07:20:08.050 INFO:tasks.workunit.client.1.smithi139.stdout:1/727: rename d2/d10/d12/d1a/dd7/d49/d8d/fbc to d2/d10/d12/d24/d38/d3d/fe3 0 2024-09-17T07:20:08.050 INFO:tasks.workunit.client.1.smithi139.stdout:8/978: link d0/d20/d28/d48/f139 d0/d1a/d3a/d71/d127/f13d 0 2024-09-17T07:20:08.050 INFO:tasks.workunit.client.1.smithi139.stdout:8/979: chown d0/d20/d28/d52/d65/d7f/db6/fb9 19341 1 2024-09-17T07:20:08.051 INFO:tasks.workunit.client.1.smithi139.stdout:5/892: truncate d4/f36 848230 0 2024-09-17T07:20:08.051 INFO:tasks.workunit.client.1.smithi139.stdout:1/728: symlink d2/d10/d12/d1a/dd7/d2b/d4a/d6f/le4 0 2024-09-17T07:20:08.051 INFO:tasks.workunit.client.1.smithi139.stdout:2/961: truncate d0/d7/fdb 7900643 0 2024-09-17T07:20:08.051 INFO:tasks.workunit.client.1.smithi139.stdout:3/870: creat d5/da7/dca/dab/dd6/d28/d54/f110 x:0 0 0 2024-09-17T07:20:08.051 INFO:tasks.workunit.client.1.smithi139.stdout:5/893: rmdir d4/d16/d1b/d20/d32/d3d/d10d 39 2024-09-17T07:20:08.051 INFO:tasks.workunit.client.1.smithi139.stdout:2/962: mknod d0/de/df/d56/c13a 0 2024-09-17T07:20:08.051 INFO:tasks.workunit.client.1.smithi139.stdout:8/980: dwrite d0/d96/fda [0,4194304] 0 2024-09-17T07:20:08.051 INFO:tasks.workunit.client.1.smithi139.stdout:2/963: rmdir d0/d7/d86/da4/d12 39 2024-09-17T07:20:08.051 INFO:tasks.workunit.client.1.smithi139.stdout:8/981: write d0/f7 [3108659,95614] 0 2024-09-17T07:20:08.052 INFO:tasks.workunit.client.1.smithi139.stdout:5/894: rename d4/d16/d1b/de7/l126 to d4/d16/d69/l127 0 2024-09-17T07:20:08.052 INFO:tasks.workunit.client.1.smithi139.stdout:1/729: dwrite d2/d10/d12/d1a/dd7/d2b/fe1 [0,4194304] 0 2024-09-17T07:20:08.053 INFO:tasks.workunit.client.0.smithi087.stdout:7/947: mknod d0/d36/deb/d114/c125 0 2024-09-17T07:20:08.053 INFO:tasks.workunit.client.1.smithi139.stdout:2/964: mkdir d0/d7/d1a/d13b 0 2024-09-17T07:20:08.053 INFO:tasks.workunit.client.1.smithi139.stdout:5/895: read d4/d16/f19 [1700242,65646] 0 2024-09-17T07:20:08.054 INFO:tasks.workunit.client.1.smithi139.stdout:0/620: dread d1/da/d1b/d3d/f95 [0,4194304] 0 2024-09-17T07:20:08.055 INFO:tasks.workunit.client.1.smithi139.stdout:0/621: readlink d1/da/l3b 0 2024-09-17T07:20:08.056 INFO:tasks.workunit.client.1.smithi139.stdout:1/730: creat d2/d10/d12/d13/d4f/d5c/d92/fe5 x:0 0 0 2024-09-17T07:20:08.057 INFO:tasks.workunit.client.1.smithi139.stdout:8/982: dwrite d0/d20/d28/d52/d65/d7f/db6/f4e [0,4194304] 0 2024-09-17T07:20:08.059 INFO:tasks.workunit.client.1.smithi139.stdout:5/896: creat d4/d16/d1b/d20/d67/d88/f128 x:0 0 0 2024-09-17T07:20:08.061 INFO:tasks.workunit.client.0.smithi087.stdout:9/969: dwrite d3/d4/d6/d8/d22/fa5 [0,4194304] 0 2024-09-17T07:20:08.062 INFO:tasks.workunit.client.1.smithi139.stdout:5/897: dread - d4/d16/d1b/f115 zero size 2024-09-17T07:20:08.064 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:07 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:20:08.064 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:07 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:20:08.064 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:07 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T07:20:08.065 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:07 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-17T07:20:08.065 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:07 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-17T07:20:08.065 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:07 smithi139 ceph-mon[34403]: Adjusting osd_memory_target on smithi087 to 1557M 2024-09-17T07:20:08.065 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:07 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:20:08.065 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:07 smithi139 ceph-mon[34403]: pgmap v17: 65 pgs: 65 active+clean; 3.6 GiB data, 12 GiB used, 525 GiB / 536 GiB avail; 149 MiB/s rd, 370 MiB/s wr, 788 op/s 2024-09-17T07:20:08.066 INFO:tasks.workunit.client.0.smithi087.stdout:9/970: write d3/d4/d6/fbe [142419,110597] 0 2024-09-17T07:20:08.066 INFO:tasks.workunit.client.1.smithi139.stdout:8/983: symlink d0/d1a/d3a/d8d/d102/d113/l13e 0 2024-09-17T07:20:08.067 INFO:tasks.workunit.client.1.smithi139.stdout:1/731: symlink d2/d10/le6 0 2024-09-17T07:20:08.069 INFO:tasks.workunit.client.0.smithi087.stdout:7/948: dwrite d0/d36/d8e/df1/d118/d23/d4e/fd6 [0,4194304] 0 2024-09-17T07:20:08.070 INFO:tasks.workunit.client.1.smithi139.stdout:8/984: mkdir d0/d20/d13f 0 2024-09-17T07:20:08.072 INFO:tasks.workunit.client.1.smithi139.stdout:1/732: dread d2/d10/d12/d1a/dd7/d2b/fc5 [0,4194304] 0 2024-09-17T07:20:08.074 INFO:tasks.workunit.client.1.smithi139.stdout:8/985: rmdir d0/d1a/dc9 39 2024-09-17T07:20:08.076 INFO:tasks.workunit.client.1.smithi139.stdout:3/871: dwrite d5/da7/dca/dab/dd6/d28/d54/d58/f72 [0,4194304] 0 2024-09-17T07:20:08.076 INFO:tasks.workunit.client.1.smithi139.stdout:5/898: dread d4/d16/d69/fd7 [0,4194304] 0 2024-09-17T07:20:08.077 INFO:tasks.workunit.client.1.smithi139.stdout:8/986: chown d0/d1a/l92 47821 1 2024-09-17T07:20:08.087 INFO:tasks.workunit.client.1.smithi139.stdout:3/872: symlink d5/d63/db3/ddb/l111 0 2024-09-17T07:20:08.088 INFO:tasks.workunit.client.1.smithi139.stdout:1/733: dread d2/d10/d12/d1a/dd7/f44 [0,4194304] 0 2024-09-17T07:20:08.095 INFO:tasks.workunit.client.1.smithi139.stdout:3/873: dwrite d5/d15/d20/d3b/dc1/ff6 [0,4194304] 0 2024-09-17T07:20:08.098 INFO:tasks.workunit.client.1.smithi139.stdout:1/734: dwrite d2/d10/d12/d13/d4f/d5c/d74/fbb [0,4194304] 0 2024-09-17T07:20:08.099 INFO:tasks.workunit.client.0.smithi087.stdout:2/943: sync 2024-09-17T07:20:08.101 INFO:tasks.workunit.client.1.smithi139.stdout:3/874: creat d5/d21/dba/f112 x:0 0 0 2024-09-17T07:20:08.107 INFO:tasks.workunit.client.1.smithi139.stdout:2/965: truncate d0/d7/fdb 6500716 0 2024-09-17T07:20:08.107 INFO:tasks.workunit.client.0.smithi087.stdout:7/949: mknod d0/d36/d8e/df1/d118/d10/d32/d62/c126 0 2024-09-17T07:20:08.108 INFO:tasks.workunit.client.0.smithi087.stdout:2/944: symlink d2/d15/dce/dd1/d3f/l132 0 2024-09-17T07:20:08.108 INFO:tasks.workunit.client.1.smithi139.stdout:8/987: dwrite d0/d1a/fb8 [4194304,4194304] 0 2024-09-17T07:20:08.110 INFO:tasks.workunit.client.0.smithi087.stdout:9/971: dread d3/d4/da/f55 [0,4194304] 0 2024-09-17T07:20:08.111 INFO:tasks.workunit.client.0.smithi087.stdout:7/950: write d0/d36/d8e/df1/d118/d10/f14 [125704,39594] 0 2024-09-17T07:20:08.111 INFO:tasks.workunit.client.1.smithi139.stdout:3/875: symlink d5/d21/d23/d38/dbd/l113 0 2024-09-17T07:20:08.114 INFO:tasks.workunit.client.1.smithi139.stdout:5/899: dread d4/d16/d1b/d20/d28/f3e [4194304,4194304] 0 2024-09-17T07:20:08.114 INFO:tasks.workunit.client.0.smithi087.stdout:9/972: symlink d3/d4/d16/dc0/l14c 0 2024-09-17T07:20:08.115 INFO:tasks.workunit.client.1.smithi139.stdout:8/988: mkdir d0/d20/d28/d52/d65/dbe/d140 0 2024-09-17T07:20:08.116 INFO:tasks.workunit.client.0.smithi087.stdout:9/973: stat d3/d4/d16/d69/d8a/f21 0 2024-09-17T07:20:08.118 INFO:tasks.workunit.client.1.smithi139.stdout:8/989: fdatasync d0/d1a/d4d/fc2 0 2024-09-17T07:20:08.118 INFO:tasks.workunit.client.0.smithi087.stdout:2/945: dwrite d2/d15/dce/dd1/f131 [0,4194304] 0 2024-09-17T07:20:08.120 INFO:tasks.workunit.client.0.smithi087.stdout:2/946: write d2/d15/dce/dd1/f128 [904464,122561] 0 2024-09-17T07:20:08.122 INFO:tasks.workunit.client.1.smithi139.stdout:3/876: dwrite d5/d21/d23/d69/f84 [0,4194304] 0 2024-09-17T07:20:08.123 INFO:tasks.workunit.client.0.smithi087.stdout:7/951: link d0/f2 d0/d36/d8e/df1/d118/d23/d17/d7b/f127 0 2024-09-17T07:20:08.126 INFO:tasks.workunit.client.1.smithi139.stdout:3/877: read d5/f11 [216754,10458] 0 2024-09-17T07:20:08.127 INFO:tasks.workunit.client.0.smithi087.stdout:7/952: symlink d0/d36/d8e/df1/d118/d10/d87/l128 0 2024-09-17T07:20:08.128 INFO:tasks.workunit.client.0.smithi087.stdout:2/947: mknod d2/d96/d101/c133 0 2024-09-17T07:20:08.129 INFO:tasks.workunit.client.0.smithi087.stdout:2/948: write d2/d15/f2c [7025189,103841] 0 2024-09-17T07:20:08.130 INFO:tasks.workunit.client.1.smithi139.stdout:3/878: chown d5/da7/dca/dab/dd6/d28/db5/fcd 59962 1 2024-09-17T07:20:08.130 INFO:tasks.workunit.client.1.smithi139.stdout:8/990: dwrite d0/d20/d28/d52/d99/db4/f134 [0,4194304] 0 2024-09-17T07:20:08.132 INFO:tasks.workunit.client.0.smithi087.stdout:7/953: dread d0/d36/deb/ffd [0,4194304] 0 2024-09-17T07:20:08.133 INFO:tasks.workunit.client.1.smithi139.stdout:8/991: chown d0/fff 811 1 2024-09-17T07:20:08.134 INFO:tasks.workunit.client.0.smithi087.stdout:7/954: write d0/d7a/fc5 [2492984,37730] 0 2024-09-17T07:20:08.137 INFO:tasks.workunit.client.0.smithi087.stdout:7/955: chown d0/d36/d8e/df1/d118/d23/d17/d7b/dad/f109 177762 1 2024-09-17T07:20:08.139 INFO:tasks.workunit.client.1.smithi139.stdout:8/992: chown d0/d1a/dc9/ff2 476762 1 2024-09-17T07:20:08.140 INFO:tasks.workunit.client.0.smithi087.stdout:2/949: link d2/d12/d85/le0 d2/d15/dce/dd1/d114/l134 0 2024-09-17T07:20:08.142 INFO:tasks.workunit.client.0.smithi087.stdout:2/950: unlink d2/d7/d33/daa/cda 0 2024-09-17T07:20:08.143 INFO:tasks.workunit.client.0.smithi087.stdout:7/956: fsync d0/d36/d8e/df1/d118/d23/d2d/f79 0 2024-09-17T07:20:08.144 INFO:tasks.workunit.client.1.smithi139.stdout:2/966: dwrite d0/f6 [0,4194304] 0 2024-09-17T07:20:08.144 INFO:tasks.workunit.client.1.smithi139.stdout:8/993: readlink d0/d20/d28/d52/d65/dbe/deb/l11d 0 2024-09-17T07:20:08.145 INFO:tasks.workunit.client.1.smithi139.stdout:3/879: dwrite d5/da7/dca/dab/dd6/ff9 [0,4194304] 0 2024-09-17T07:20:08.146 INFO:tasks.workunit.client.0.smithi087.stdout:2/951: symlink d2/d7/dd/d6a/d6d/d111/l135 0 2024-09-17T07:20:08.148 INFO:tasks.workunit.client.0.smithi087.stdout:7/957: mkdir d0/d36/d8e/df1/d118/d10/dfe/dff/d129 0 2024-09-17T07:20:08.149 INFO:tasks.workunit.client.1.smithi139.stdout:2/967: rmdir d0/d7/d1a 39 2024-09-17T07:20:08.149 INFO:tasks.workunit.client.0.smithi087.stdout:2/952: creat d2/d50/db8/f136 x:0 0 0 2024-09-17T07:20:08.150 INFO:tasks.workunit.client.0.smithi087.stdout:7/958: fdatasync d0/f3b 0 2024-09-17T07:20:08.151 INFO:tasks.workunit.client.1.smithi139.stdout:2/968: write d0/d7/fd [223448,64927] 0 2024-09-17T07:20:08.151 INFO:tasks.workunit.client.1.smithi139.stdout:5/900: write d4/f6 [1198473,68321] 0 2024-09-17T07:20:08.153 INFO:tasks.workunit.client.0.smithi087.stdout:2/953: stat d2/d7/dd/d10/d4c/d5f/d8b/cae 0 2024-09-17T07:20:08.153 INFO:tasks.workunit.client.1.smithi139.stdout:3/880: rename d5/c100 to d5/d63/d6d/d6f/d81/c114 0 2024-09-17T07:20:08.154 INFO:tasks.workunit.client.0.smithi087.stdout:9/974: dread d3/d4/d16/ffd [0,4194304] 0 2024-09-17T07:20:08.154 INFO:tasks.workunit.client.0.smithi087.stdout:7/959: fdatasync d0/d36/d8e/df1/d118/d10/d32/d62/d76/f84 0 2024-09-17T07:20:08.155 INFO:tasks.workunit.client.1.smithi139.stdout:5/901: truncate d4/d16/d1b/d20/d32/d6c/dc9/dcb/ff2 108128 0 2024-09-17T07:20:08.155 INFO:tasks.workunit.client.1.smithi139.stdout:2/969: mkdir d0/d7/d67/da1/d10d/d3a/d13c 0 2024-09-17T07:20:08.156 INFO:tasks.workunit.client.1.smithi139.stdout:3/881: truncate d5/d21/fcc 753457 0 2024-09-17T07:20:08.156 INFO:tasks.workunit.client.0.smithi087.stdout:7/960: chown d0/d36/d8e/df1/d118/d23/d2d 30420314 1 2024-09-17T07:20:08.157 INFO:tasks.workunit.client.1.smithi139.stdout:5/902: chown d4/d16/d1b/d20/d67/d88/d9f/dfc/dbf/fd0 2697 1 2024-09-17T07:20:08.158 INFO:tasks.workunit.client.1.smithi139.stdout:3/882: read d5/d15/d20/d3b/dc1/ff6 [2983105,95323] 0 2024-09-17T07:20:08.159 INFO:tasks.workunit.client.0.smithi087.stdout:9/975: mkdir d3/d25/d83/d14d 0 2024-09-17T07:20:08.159 INFO:tasks.workunit.client.0.smithi087.stdout:7/961: stat d0/d36/d8e/df1/d118/d23/d17/d7b/dad/daf/df6/l11d 0 2024-09-17T07:20:08.163 INFO:tasks.workunit.client.1.smithi139.stdout:5/903: read d4/f6 [835206,97046] 0 2024-09-17T07:20:08.163 INFO:tasks.workunit.client.1.smithi139.stdout:2/970: dread d0/d4e/d76/f133 [0,4194304] 0 2024-09-17T07:20:08.163 INFO:tasks.workunit.client.0.smithi087.stdout:2/954: dwrite d2/d50/db8/fd0 [0,4194304] 0 2024-09-17T07:20:08.164 INFO:tasks.workunit.client.1.smithi139.stdout:3/883: rename d5/da7/dca/dab/dd6/d28/d54/d58/dd4 to d5/d15/d20/d3b/d115 0 2024-09-17T07:20:08.165 INFO:tasks.workunit.client.1.smithi139.stdout:3/884: truncate d5/fe 4376270 0 2024-09-17T07:20:08.165 INFO:tasks.workunit.client.0.smithi087.stdout:9/976: symlink d3/d4/da/l14e 0 2024-09-17T07:20:08.166 INFO:tasks.workunit.client.1.smithi139.stdout:8/994: write d0/d1a/d3a/fdb [111798,45217] 0 2024-09-17T07:20:08.167 INFO:tasks.workunit.client.0.smithi087.stdout:9/977: fdatasync d3/d4/d16/dc0/f8c 0 2024-09-17T07:20:08.169 INFO:tasks.workunit.client.0.smithi087.stdout:9/978: chown d3/d4/d6/d71/fd0 1 1 2024-09-17T07:20:08.169 INFO:tasks.workunit.client.1.smithi139.stdout:8/995: dread - d0/d20/d28/d52/d65/f115 zero size 2024-09-17T07:20:08.170 INFO:tasks.workunit.client.0.smithi087.stdout:2/955: creat d2/d7/dd/d10/d4c/f137 x:0 0 0 2024-09-17T07:20:08.170 INFO:tasks.workunit.client.1.smithi139.stdout:3/885: mkdir d5/d63/d6d/d6f/d8b/def/d116 0 2024-09-17T07:20:08.171 INFO:tasks.workunit.client.0.smithi087.stdout:7/962: dwrite d0/d36/d8e/df1/d118/d10/d32/d8c/fbe [0,4194304] 0 2024-09-17T07:20:08.172 INFO:tasks.workunit.client.1.smithi139.stdout:5/904: creat d4/d16/d1b/d20/d11a/f129 x:0 0 0 2024-09-17T07:20:08.174 INFO:tasks.workunit.client.0.smithi087.stdout:2/956: creat d2/d15/dce/dd1/d114/f138 x:0 0 0 2024-09-17T07:20:08.174 INFO:tasks.workunit.client.1.smithi139.stdout:2/971: dread d0/d7/d1a/fcc [0,4194304] 0 2024-09-17T07:20:08.175 INFO:tasks.workunit.client.0.smithi087.stdout:7/963: symlink d0/d36/deb/l12a 0 2024-09-17T07:20:08.176 INFO:tasks.workunit.client.0.smithi087.stdout:2/957: symlink d2/d48/d69/l139 0 2024-09-17T07:20:08.177 INFO:tasks.workunit.client.1.smithi139.stdout:7/696: sync 2024-09-17T07:20:08.177 INFO:tasks.workunit.client.1.smithi139.stdout:4/851: sync 2024-09-17T07:20:08.180 INFO:tasks.workunit.client.1.smithi139.stdout:5/905: read d4/d5d/dc0/ffe [889907,35590] 0 2024-09-17T07:20:08.183 INFO:tasks.workunit.client.0.smithi087.stdout:7/964: getdents d0/d36/d8e/df1/d118/d10/d32/d8c/de8 0 2024-09-17T07:20:08.183 INFO:tasks.workunit.client.1.smithi139.stdout:3/886: dwrite d5/f1d [0,4194304] 0 2024-09-17T07:20:08.183 INFO:tasks.workunit.client.1.smithi139.stdout:7/697: unlink d5/d10/d2b/fb4 0 2024-09-17T07:20:08.183 INFO:tasks.workunit.client.0.smithi087.stdout:2/958: dwrite d2/d15/f2c [0,4194304] 0 2024-09-17T07:20:08.187 INFO:tasks.workunit.client.1.smithi139.stdout:2/972: mknod d0/d7/d67/da1/d10d/d3a/d13c/c13d 0 2024-09-17T07:20:08.188 INFO:tasks.workunit.client.0.smithi087.stdout:2/959: rename d2/d7/d60/fc4 to d2/d96/d101/f13a 0 2024-09-17T07:20:08.189 INFO:tasks.workunit.client.0.smithi087.stdout:7/965: read d0/f6 [3785516,69180] 0 2024-09-17T07:20:08.191 INFO:tasks.workunit.client.0.smithi087.stdout:7/966: chown d0/d36/d8e/df1/d118/d10/d31/l42 0 1 2024-09-17T07:20:08.191 INFO:tasks.workunit.client.0.smithi087.stdout:2/960: creat d2/d96/d101/da4/f13b x:0 0 0 2024-09-17T07:20:08.193 INFO:tasks.workunit.client.1.smithi139.stdout:3/887: read d5/d15/d56/f29 [457911,68457] 0 2024-09-17T07:20:08.195 INFO:tasks.workunit.client.0.smithi087.stdout:7/967: creat d0/d36/d8e/df1/d118/d10/d87/d96/f12b x:0 0 0 2024-09-17T07:20:08.197 INFO:tasks.workunit.client.1.smithi139.stdout:7/698: creat d5/d10/fe7 x:0 0 0 2024-09-17T07:20:08.198 INFO:tasks.workunit.client.1.smithi139.stdout:3/888: read f2 [3615374,105553] 0 2024-09-17T07:20:08.200 INFO:tasks.workunit.client.0.smithi087.stdout:2/961: dwrite d2/d7/dd/d10/d4c/f137 [0,4194304] 0 2024-09-17T07:20:08.202 INFO:tasks.workunit.client.0.smithi087.stdout:2/962: write d2/d50/db8/fd0 [34687,80171] 0 2024-09-17T07:20:08.203 INFO:tasks.workunit.client.1.smithi139.stdout:8/996: truncate d0/d20/d28/d52/d65/f98 1209683 0 2024-09-17T07:20:08.205 INFO:tasks.workunit.client.0.smithi087.stdout:2/963: creat d2/d12/d85/f13c x:0 0 0 2024-09-17T07:20:08.205 INFO:tasks.workunit.client.1.smithi139.stdout:3/889: creat d5/d21/dba/d10d/f117 x:0 0 0 2024-09-17T07:20:08.206 INFO:tasks.workunit.client.1.smithi139.stdout:4/852: write d0/de9/d83/f96 [370283,26036] 0 2024-09-17T07:20:08.209 INFO:tasks.workunit.client.0.smithi087.stdout:2/964: mkdir d2/d7/dd/d10/d4c/d13d 0 2024-09-17T07:20:08.210 INFO:tasks.workunit.client.1.smithi139.stdout:3/890: creat d5/da7/dca/dab/dd6/d28/db5/f118 x:0 0 0 2024-09-17T07:20:08.211 INFO:tasks.workunit.client.1.smithi139.stdout:4/853: creat d0/de9/f10d x:0 0 0 2024-09-17T07:20:08.212 INFO:tasks.workunit.client.1.smithi139.stdout:3/891: read - d5/d63/d6d/da0/f106 zero size 2024-09-17T07:20:08.212 INFO:tasks.workunit.client.1.smithi139.stdout:5/906: dread d4/da5/fef [0,4194304] 0 2024-09-17T07:20:08.214 INFO:tasks.workunit.client.1.smithi139.stdout:4/854: unlink d0/d1/d29/d6a/db6/de4/cd6 0 2024-09-17T07:20:08.214 INFO:tasks.workunit.client.1.smithi139.stdout:8/997: dread d0/d20/d28/d52/d54/f84 [0,4194304] 0 2024-09-17T07:20:08.216 INFO:tasks.workunit.client.1.smithi139.stdout:3/892: truncate d5/d15/d20/d3b/fae 142622 0 2024-09-17T07:20:08.217 INFO:tasks.workunit.client.1.smithi139.stdout:4/855: chown d0/db/d7f/f90 1 1 2024-09-17T07:20:08.218 INFO:tasks.workunit.client.1.smithi139.stdout:4/856: fdatasync d0/d1/d29/d6d/db3/fee 0 2024-09-17T07:20:08.218 INFO:tasks.workunit.client.1.smithi139.stdout:8/998: dread d0/d1a/d3a/d71/ff0 [0,4194304] 0 2024-09-17T07:20:08.219 INFO:tasks.workunit.client.0.smithi087.stdout:7/968: write d0/f2 [985962,57713] 0 2024-09-17T07:20:08.222 INFO:tasks.workunit.client.0.smithi087.stdout:7/969: truncate d0/d36/d8e/df1/d118/d10/d32/d8c/fd9 33575 0 2024-09-17T07:20:08.222 INFO:tasks.workunit.client.1.smithi139.stdout:8/999: chown d0/d20/d28/d52/d65/dd3 41269282 1 2024-09-17T07:20:08.223 INFO:tasks.workunit.client.1.smithi139.stdout:4/857: mkdir d0/de9/d10e 0 2024-09-17T07:20:08.224 INFO:tasks.workunit.client.0.smithi087.stdout:7/970: creat d0/d36/d8e/df1/d118/d23/d17/d7b/dad/daf/f12c x:0 0 0 2024-09-17T07:20:08.224 INFO:tasks.workunit.client.1.smithi139.stdout:7/699: write d5/d10/d2b/d40/d47/f72 [2065375,80639] 0 2024-09-17T07:20:08.226 INFO:tasks.workunit.client.0.smithi087.stdout:7/971: symlink d0/d36/d8e/df1/d118/d10/d32/d8c/l12d 0 2024-09-17T07:20:08.227 INFO:tasks.workunit.client.1.smithi139.stdout:2/973: dwrite d0/d7/d67/da1/d10d/dc4/fca [0,4194304] 0 2024-09-17T07:20:08.229 INFO:tasks.workunit.client.0.smithi087.stdout:7/972: getdents d0/d36/d8e/df1/d118/d10/d32/d62/d76/d11f 0 2024-09-17T07:20:08.231 INFO:tasks.workunit.client.0.smithi087.stdout:7/973: fdatasync d0/d36/d8e/df1/d118/d10/d32/d62/d76/f7f 0 2024-09-17T07:20:08.231 INFO:tasks.workunit.client.1.smithi139.stdout:7/700: chown d5/d10/d2b/d40/f4a 167770 1 2024-09-17T07:20:08.236 INFO:tasks.workunit.client.1.smithi139.stdout:7/701: unlink d5/d10/lcd 0 2024-09-17T07:20:08.239 INFO:tasks.workunit.client.0.smithi087.stdout:7/974: dwrite d0/d36/d8e/df1/d118/d23/d17/d7b/fba [4194304,4194304] 0 2024-09-17T07:20:08.240 INFO:tasks.workunit.client.1.smithi139.stdout:3/893: truncate d5/d21/d23/d38/f9d 1825111 0 2024-09-17T07:20:08.240 INFO:tasks.workunit.client.1.smithi139.stdout:5/907: dwrite d4/d16/d1b/d20/d28/f46 [0,4194304] 0 2024-09-17T07:20:08.241 INFO:tasks.workunit.client.0.smithi087.stdout:2/965: dread d2/f7c [0,4194304] 0 2024-09-17T07:20:08.243 INFO:tasks.workunit.client.0.smithi087.stdout:2/966: chown d2/d7/dd/d10/d4c/cca 7462281 1 2024-09-17T07:20:08.243 INFO:tasks.workunit.client.1.smithi139.stdout:7/702: write d5/d17/f49 [1167243,28998] 0 2024-09-17T07:20:08.243 INFO:tasks.workunit.client.0.smithi087.stdout:7/975: mkdir d0/d36/d8e/df1/d118/d10/dfe/dff/d12e 0 2024-09-17T07:20:08.246 INFO:tasks.workunit.client.1.smithi139.stdout:3/894: dread - d5/d21/d23/d38/ffc zero size 2024-09-17T07:20:08.247 INFO:tasks.workunit.client.0.smithi087.stdout:7/976: dread d0/d36/d8e/df1/d118/d23/d17/f68 [0,4194304] 0 2024-09-17T07:20:08.248 INFO:tasks.workunit.client.0.smithi087.stdout:7/977: chown d0/d36/d8e/df1/d118/d10/d31/cce 1 1 2024-09-17T07:20:08.250 INFO:tasks.workunit.client.0.smithi087.stdout:7/978: rmdir d0/d36/deb/d114 39 2024-09-17T07:20:08.250 INFO:tasks.workunit.client.1.smithi139.stdout:6/875: sync 2024-09-17T07:20:08.250 INFO:tasks.workunit.client.1.smithi139.stdout:4/858: dwrite d0/db/d58/f9a [0,4194304] 0 2024-09-17T07:20:08.254 INFO:tasks.workunit.client.0.smithi087.stdout:7/979: rmdir d0/d36/d8e/df1/d118/d23/d2d/def 0 2024-09-17T07:20:08.255 INFO:tasks.workunit.client.0.smithi087.stdout:7/980: chown d0/d36/d8e/df1/d118/d10/d87/d96 6931261 1 2024-09-17T07:20:08.256 INFO:tasks.workunit.client.1.smithi139.stdout:4/859: rename d0/d10/f40 to d0/d49/f10f 0 2024-09-17T07:20:08.257 INFO:tasks.workunit.client.1.smithi139.stdout:6/876: truncate db/d21/f31 199267 0 2024-09-17T07:20:08.257 INFO:tasks.workunit.client.1.smithi139.stdout:7/703: rmdir d5/d10 39 2024-09-17T07:20:08.258 INFO:tasks.workunit.client.0.smithi087.stdout:7/981: creat d0/d36/d8e/df1/d118/d10/d87/f12f x:0 0 0 2024-09-17T07:20:08.258 INFO:tasks.workunit.client.1.smithi139.stdout:5/908: creat d4/d16/d1b/d20/d67/f12a x:0 0 0 2024-09-17T07:20:08.259 INFO:tasks.workunit.client.0.smithi087.stdout:2/967: write d2/f25 [2036769,31615] 0 2024-09-17T07:20:08.259 INFO:tasks.workunit.client.1.smithi139.stdout:2/974: write d0/d7/d86/da4/d12/d8c/fd5 [561972,65835] 0 2024-09-17T07:20:08.260 INFO:tasks.workunit.client.1.smithi139.stdout:3/895: symlink d5/d63/d6d/d108/l119 0 2024-09-17T07:20:08.261 INFO:tasks.workunit.client.0.smithi087.stdout:7/982: unlink d0/d36/d8e/df1/d118/c9c 0 2024-09-17T07:20:08.261 INFO:tasks.workunit.client.1.smithi139.stdout:3/896: chown d5/da7/dca/dab/dd6/d28/db5/fcd 14005 1 2024-09-17T07:20:08.262 INFO:tasks.workunit.client.1.smithi139.stdout:3/897: chown d5/c1e 2295 1 2024-09-17T07:20:08.265 INFO:tasks.workunit.client.0.smithi087.stdout:2/968: creat d2/d7/db/d125/f13e x:0 0 0 2024-09-17T07:20:08.267 INFO:tasks.workunit.client.1.smithi139.stdout:4/860: creat d0/de9/d10e/f110 x:0 0 0 2024-09-17T07:20:08.267 INFO:tasks.workunit.client.1.smithi139.stdout:4/861: read - d0/f107 zero size 2024-09-17T07:20:08.270 INFO:tasks.workunit.client.0.smithi087.stdout:7/983: dwrite d0/d36/d8e/df1/d118/d10/d87/d96/db2/fc3 [0,4194304] 0 2024-09-17T07:20:08.271 INFO:tasks.workunit.client.0.smithi087.stdout:2/969: rename d2/d7/dd/d10/d4c/dcc to d2/d50/db8/d13f 0 2024-09-17T07:20:08.271 INFO:tasks.workunit.client.1.smithi139.stdout:4/862: creat d0/d1/d29/d6a/db6/de4/f111 x:0 0 0 2024-09-17T07:20:08.271 INFO:tasks.workunit.client.0.smithi087.stdout:2/970: fdatasync d2/d7/d33/fa9 0 2024-09-17T07:20:08.272 INFO:tasks.workunit.client.1.smithi139.stdout:4/863: fdatasync d0/db/d58/f7e 0 2024-09-17T07:20:08.274 INFO:tasks.workunit.client.1.smithi139.stdout:4/864: mknod d0/db/d17/dc3/c112 0 2024-09-17T07:20:08.276 INFO:tasks.workunit.client.0.smithi087.stdout:2/971: creat d2/d15/dce/dd1/d3f/f140 x:0 0 0 2024-09-17T07:20:08.277 INFO:tasks.workunit.client.1.smithi139.stdout:4/865: creat d0/f113 x:0 0 0 2024-09-17T07:20:08.278 INFO:tasks.workunit.client.0.smithi087.stdout:2/972: creat d2/d96/d101/f141 x:0 0 0 2024-09-17T07:20:08.279 INFO:tasks.workunit.client.0.smithi087.stdout:2/973: mknod d2/d48/d69/c142 0 2024-09-17T07:20:08.286 INFO:tasks.workunit.client.1.smithi139.stdout:6/877: write db/d21/f42 [484200,22529] 0 2024-09-17T07:20:08.287 INFO:tasks.workunit.client.1.smithi139.stdout:2/975: write d0/fb [2058318,113854] 0 2024-09-17T07:20:08.288 INFO:tasks.workunit.client.1.smithi139.stdout:3/898: write d5/d63/d6d/d6f/fb8 [780979,93805] 0 2024-09-17T07:20:08.289 INFO:tasks.workunit.client.1.smithi139.stdout:7/704: write d5/d10/d2b/d40/f94 [4653101,56483] 0 2024-09-17T07:20:08.290 INFO:tasks.workunit.client.1.smithi139.stdout:2/976: chown d0/d7/d86/da4/d12/fc2 71 1 2024-09-17T07:20:08.291 INFO:tasks.workunit.client.1.smithi139.stdout:3/899: dread - d5/d63/d6d/da0/f109 zero size 2024-09-17T07:20:08.292 INFO:tasks.workunit.client.1.smithi139.stdout:2/977: truncate d0/de/f122 622308 0 2024-09-17T07:20:08.293 INFO:tasks.workunit.client.1.smithi139.stdout:3/900: dread - d5/d21/d23/d69/fbf zero size 2024-09-17T07:20:08.293 INFO:tasks.workunit.client.1.smithi139.stdout:7/705: mknod d5/d17/d4e/d66/ce8 0 2024-09-17T07:20:08.294 INFO:tasks.workunit.client.0.smithi087.stdout:2/974: dwrite d2/d7/dd/d6a/d6d/f86 [0,4194304] 0 2024-09-17T07:20:08.295 INFO:tasks.workunit.client.1.smithi139.stdout:3/901: truncate d5/d15/d20/f42 5112332 0 2024-09-17T07:20:08.297 INFO:tasks.workunit.client.1.smithi139.stdout:7/706: truncate d5/d67/fa2 868335 0 2024-09-17T07:20:08.298 INFO:tasks.workunit.client.1.smithi139.stdout:2/978: rename d0/d7/d86/da4/d12/dcd/fe8 to d0/de/d25/d120/f13e 0 2024-09-17T07:20:08.300 INFO:tasks.workunit.client.0.smithi087.stdout:2/975: dwrite d2/f67 [0,4194304] 0 2024-09-17T07:20:08.300 INFO:tasks.workunit.client.1.smithi139.stdout:6/878: write db/df/d4e/d64/d54/f2b [3836080,112385] 0 2024-09-17T07:20:08.301 INFO:tasks.workunit.client.1.smithi139.stdout:7/707: creat d5/d10/d4d/fe9 x:0 0 0 2024-09-17T07:20:08.303 INFO:tasks.workunit.client.1.smithi139.stdout:4/866: dwrite d0/d49/f10f [0,4194304] 0 2024-09-17T07:20:08.303 INFO:tasks.workunit.client.1.smithi139.stdout:2/979: mknod d0/d4e/d76/d82/c13f 0 2024-09-17T07:20:08.305 INFO:tasks.workunit.client.1.smithi139.stdout:3/902: rename d5/c2d to d5/d15/d20/c11a 0 2024-09-17T07:20:08.306 INFO:tasks.workunit.client.1.smithi139.stdout:6/879: mkdir db/df/d4e/d5e/deb/d112/d132 0 2024-09-17T07:20:08.307 INFO:tasks.workunit.client.1.smithi139.stdout:3/903: write d5/d21/d23/f88 [696496,20909] 0 2024-09-17T07:20:08.307 INFO:tasks.workunit.client.0.smithi087.stdout:2/976: dwrite d2/d50/fa8 [4194304,4194304] 0 2024-09-17T07:20:08.311 INFO:tasks.workunit.client.0.smithi087.stdout:2/977: mknod d2/d96/c143 0 2024-09-17T07:20:08.313 INFO:tasks.workunit.client.1.smithi139.stdout:3/904: symlink d5/d63/d6d/d6f/d81/l11b 0 2024-09-17T07:20:08.314 INFO:tasks.workunit.client.0.smithi087.stdout:2/978: mkdir d2/d7/dd/d10/d91/dea/d144 0 2024-09-17T07:20:08.316 INFO:tasks.workunit.client.0.smithi087.stdout:2/979: write d2/d12/fbc [443117,14989] 0 2024-09-17T07:20:08.317 INFO:tasks.workunit.client.1.smithi139.stdout:3/905: unlink d5/fe 0 2024-09-17T07:20:08.319 INFO:tasks.workunit.client.1.smithi139.stdout:4/867: rename d0/d1/d54/d93/da1/ccb to d0/de9/d83/da9/c114 0 2024-09-17T07:20:08.319 INFO:tasks.workunit.client.0.smithi087.stdout:2/980: getdents d2/d48/d69/da0 0 2024-09-17T07:20:08.320 INFO:tasks.workunit.client.1.smithi139.stdout:4/868: chown d0/db/f4a 194 1 2024-09-17T07:20:08.321 INFO:tasks.workunit.client.1.smithi139.stdout:3/906: mkdir d5/d63/db3/ddb/d11c 0 2024-09-17T07:20:08.322 INFO:tasks.workunit.client.1.smithi139.stdout:4/869: rmdir d0/db/d58/df0 39 2024-09-17T07:20:08.322 INFO:tasks.workunit.client.0.smithi087.stdout:2/981: mknod d2/d96/d101/c145 0 2024-09-17T07:20:08.322 INFO:tasks.workunit.client.1.smithi139.stdout:3/907: write f2 [2333671,118664] 0 2024-09-17T07:20:08.323 INFO:tasks.workunit.client.0.smithi087.stdout:2/982: mknod d2/d7/d33/daa/c146 0 2024-09-17T07:20:08.324 INFO:tasks.workunit.client.1.smithi139.stdout:4/870: dread d0/d1/f4f [0,4194304] 0 2024-09-17T07:20:08.325 INFO:tasks.workunit.client.0.smithi087.stdout:2/983: unlink d2/d7/dd/fd9 0 2024-09-17T07:20:08.326 INFO:tasks.workunit.client.0.smithi087.stdout:2/984: write d2/d7/dd/d6a/d6d/f109 [45091,4706] 0 2024-09-17T07:20:08.329 INFO:tasks.workunit.client.0.smithi087.stdout:2/985: creat d2/d7/dd/d10/d91/dea/d104/f147 x:0 0 0 2024-09-17T07:20:08.330 INFO:tasks.workunit.client.1.smithi139.stdout:4/871: mkdir d0/de9/d92/d115 0 2024-09-17T07:20:08.331 INFO:tasks.workunit.client.1.smithi139.stdout:6/880: truncate db/df/d73/d81/f113 3682265 0 2024-09-17T07:20:08.337 INFO:tasks.workunit.client.1.smithi139.stdout:7/708: dwrite d5/d10/f42 [0,4194304] 0 2024-09-17T07:20:08.342 INFO:tasks.workunit.client.1.smithi139.stdout:7/709: mkdir d5/d17/dea 0 2024-09-17T07:20:08.343 INFO:tasks.workunit.client.1.smithi139.stdout:6/881: dwrite db/d18/d1b/dfa/f129 [0,4194304] 0 2024-09-17T07:20:08.344 INFO:tasks.workunit.client.1.smithi139.stdout:3/908: dwrite d5/da7/dca/dab/dd6/d28/f50 [0,4194304] 0 2024-09-17T07:20:08.344 INFO:tasks.workunit.client.1.smithi139.stdout:7/710: chown d5/l13 1156 1 2024-09-17T07:20:08.345 INFO:tasks.workunit.client.0.smithi087.stdout:2/986: dread d2/d15/f45 [0,4194304] 0 2024-09-17T07:20:08.346 INFO:tasks.workunit.client.0.smithi087.stdout:2/987: read d2/d7/dd/fd3 [153350,25927] 0 2024-09-17T07:20:08.347 INFO:tasks.workunit.client.0.smithi087.stdout:2/988: stat d2/d48/d69/da0 0 2024-09-17T07:20:08.348 INFO:tasks.workunit.client.1.smithi139.stdout:7/711: fdatasync d5/d17/fb0 0 2024-09-17T07:20:08.348 INFO:tasks.workunit.client.0.smithi087.stdout:2/989: readlink d2/d48/l9e 0 2024-09-17T07:20:08.348 INFO:tasks.workunit.client.0.smithi087.stdout:2/990: dread - d2/d7/db/fe2 zero size 2024-09-17T07:20:08.349 INFO:tasks.workunit.client.0.smithi087.stdout:2/991: write d2/d50/fb9 [5003616,8560] 0 2024-09-17T07:20:08.353 INFO:tasks.workunit.client.0.smithi087.stdout:2/992: rmdir d2/d7/dd/d10/d91/dea 39 2024-09-17T07:20:08.353 INFO:tasks.workunit.client.1.smithi139.stdout:6/882: rmdir db/df/d4e/d64/d56 39 2024-09-17T07:20:08.353 INFO:tasks.workunit.client.1.smithi139.stdout:7/712: write d5/d10/fdd [473914,61726] 0 2024-09-17T07:20:08.354 INFO:tasks.workunit.client.1.smithi139.stdout:6/883: readlink db/df/d4e/d64/d54/l3e 0 2024-09-17T07:20:08.355 INFO:tasks.workunit.client.0.smithi087.stdout:2/993: link d2/d7/d60/fe6 d2/d7/dd/d10/d91/dea/d104/f148 0 2024-09-17T07:20:08.355 INFO:tasks.workunit.client.1.smithi139.stdout:7/713: write d5/d10/d2b/d71/fe2 [609201,91140] 0 2024-09-17T07:20:08.355 INFO:tasks.workunit.client.1.smithi139.stdout:4/872: dread d0/d1/d29/d41/fbb [0,4194304] 0 2024-09-17T07:20:08.357 INFO:tasks.workunit.client.1.smithi139.stdout:4/873: write d0/db/db2/fcf [890076,126998] 0 2024-09-17T07:20:08.357 INFO:tasks.workunit.client.0.smithi087.stdout:2/994: unlink d2/d15/dce/dd1/cf0 0 2024-09-17T07:20:08.359 INFO:tasks.workunit.client.1.smithi139.stdout:4/874: stat d0/d37/c72 0 2024-09-17T07:20:08.361 INFO:tasks.workunit.client.1.smithi139.stdout:4/875: unlink d0/f5 0 2024-09-17T07:20:08.363 INFO:tasks.workunit.client.0.smithi087.stdout:2/995: rename d2/d50/l10e to d2/d7/dd/d6a/d6d/l149 0 2024-09-17T07:20:08.363 INFO:tasks.workunit.client.1.smithi139.stdout:4/876: creat d0/f116 x:0 0 0 2024-09-17T07:20:08.365 INFO:tasks.workunit.client.1.smithi139.stdout:4/877: symlink d0/d1/d54/d93/l117 0 2024-09-17T07:20:08.368 INFO:tasks.workunit.client.1.smithi139.stdout:4/878: creat d0/de9/d92/d115/f118 x:0 0 0 2024-09-17T07:20:08.370 INFO:tasks.workunit.client.1.smithi139.stdout:4/879: rename d0/d37/l64 to d0/d1/d29/d6a/db6/de4/l119 0 2024-09-17T07:20:08.371 INFO:tasks.workunit.client.1.smithi139.stdout:4/880: readlink d0/d1/l99 0 2024-09-17T07:20:08.371 INFO:tasks.workunit.client.1.smithi139.stdout:4/881: dread - d0/d1/d29/d6d/db3/fcc zero size 2024-09-17T07:20:08.375 INFO:tasks.workunit.client.1.smithi139.stdout:4/882: rename d0/d10/c10a to d0/d1/d29/d6d/c11a 0 2024-09-17T07:20:08.378 INFO:tasks.workunit.client.1.smithi139.stdout:4/883: truncate d0/d37/f42 1277794 0 2024-09-17T07:20:08.378 INFO:tasks.workunit.client.0.smithi087.stdout:2/996: truncate d2/d15/f2c 1141867 0 2024-09-17T07:20:08.379 INFO:tasks.workunit.client.0.smithi087.stdout:2/997: truncate d2/d50/db8/f136 1017861 0 2024-09-17T07:20:08.382 INFO:tasks.workunit.client.1.smithi139.stdout:4/884: mknod d0/db/d58/c11b 0 2024-09-17T07:20:08.382 INFO:tasks.workunit.client.1.smithi139.stdout:3/909: dwrite d5/d15/d56/f29 [0,4194304] 0 2024-09-17T07:20:08.384 INFO:tasks.workunit.client.1.smithi139.stdout:4/885: read - d0/d1/d29/feb zero size 2024-09-17T07:20:08.384 INFO:tasks.workunit.client.0.smithi087.stdout:2/998: write d2/d96/fa3 [356615,129595] 0 2024-09-17T07:20:08.387 INFO:tasks.workunit.client.0.smithi087.stdout:2/999: unlink d2/d7/dd/d6a/d6d/f109 0 2024-09-17T07:20:08.389 INFO:tasks.workunit.client.1.smithi139.stdout:7/714: dread d5/d17/f32 [0,4194304] 0 2024-09-17T07:20:08.390 INFO:tasks.workunit.client.1.smithi139.stdout:4/886: rename d0/f71 to d0/d37/f11c 0 2024-09-17T07:20:08.390 INFO:tasks.workunit.client.1.smithi139.stdout:6/884: dread db/df/d73/da4/fa9 [0,4194304] 0 2024-09-17T07:20:08.391 INFO:tasks.workunit.client.1.smithi139.stdout:3/910: readlink d5/da7/dca/dab/dd6/d28/d54/d58/lc8 0 2024-09-17T07:20:08.394 INFO:tasks.workunit.client.1.smithi139.stdout:3/911: readlink d5/d63/d6d/d108/l119 0 2024-09-17T07:20:08.395 INFO:tasks.workunit.client.1.smithi139.stdout:6/885: creat db/df/d4e/d5e/deb/d112/d132/f133 x:0 0 0 2024-09-17T07:20:08.399 INFO:tasks.workunit.client.0.smithi087.stdout:9/979: sync 2024-09-17T07:20:08.401 INFO:tasks.workunit.client.1.smithi139.stdout:6/886: write db/d18/d1b/dfa/f122 [915520,103941] 0 2024-09-17T07:20:08.401 INFO:tasks.workunit.client.1.smithi139.stdout:7/715: mknod d5/d17/d4e/d63/ceb 0 2024-09-17T07:20:08.402 INFO:tasks.workunit.client.1.smithi139.stdout:4/887: dwrite d0/d1/d29/d6a/db6/de4/f111 [0,4194304] 0 2024-09-17T07:20:08.405 INFO:tasks.workunit.client.1.smithi139.stdout:3/912: dwrite d5/da7/dca/dab/dd6/d28/d54/fee [0,4194304] 0 2024-09-17T07:20:08.406 INFO:tasks.workunit.client.1.smithi139.stdout:7/716: mkdir d5/d10/d2b/d78/dec 0 2024-09-17T07:20:08.407 INFO:tasks.workunit.client.0.smithi087.stdout:9/980: dread d3/d4/da/f115 [0,4194304] 0 2024-09-17T07:20:08.407 INFO:tasks.workunit.client.0.smithi087.stdout:9/981: chown d3/d25/c36 4 1 2024-09-17T07:20:08.408 INFO:tasks.workunit.client.1.smithi139.stdout:3/913: write d5/da7/dca/dd7/fdc [884300,99226] 0 2024-09-17T07:20:08.410 INFO:tasks.workunit.client.1.smithi139.stdout:7/717: rmdir d5/d10/d2b/d78/d9e/db1 39 2024-09-17T07:20:08.412 INFO:tasks.workunit.client.0.smithi087.stdout:9/982: rename d3/d4/d6/d8/d12/d32/f138 to d3/d4/da/d4b/ddb/f14f 0 2024-09-17T07:20:08.413 INFO:tasks.workunit.client.1.smithi139.stdout:6/887: getdents db/d18/d1b 0 2024-09-17T07:20:08.415 INFO:tasks.workunit.client.0.smithi087.stdout:9/983: mkdir d3/d4/d6/d8/d22/d10c/d14b/d150 0 2024-09-17T07:20:08.415 INFO:tasks.workunit.client.1.smithi139.stdout:6/888: readlink db/d18/d38/d60/dc2/l12d 0 2024-09-17T07:20:08.417 INFO:tasks.workunit.client.1.smithi139.stdout:3/914: link d5/d63/fe5 d5/d63/db3/ddb/d11c/f11d 0 2024-09-17T07:20:08.418 INFO:tasks.workunit.client.1.smithi139.stdout:6/889: truncate db/df/d73/f7a 941461 0 2024-09-17T07:20:08.419 INFO:tasks.workunit.client.1.smithi139.stdout:7/718: getdents d5/d17/d4e 0 2024-09-17T07:20:08.421 INFO:tasks.workunit.client.1.smithi139.stdout:3/915: chown d5/d15/d20/d3b/fae 45116677 1 2024-09-17T07:20:08.421 INFO:tasks.workunit.client.1.smithi139.stdout:7/719: fdatasync d5/d17/d4e/f9f 0 2024-09-17T07:20:08.422 INFO:tasks.workunit.client.1.smithi139.stdout:3/916: readlink d5/d63/l75 0 2024-09-17T07:20:08.422 INFO:tasks.workunit.client.1.smithi139.stdout:4/888: dwrite d0/db/d7f/fbc [0,4194304] 0 2024-09-17T07:20:08.425 INFO:tasks.workunit.client.1.smithi139.stdout:4/889: write d0/d1/d29/d41/ff1 [473010,102663] 0 2024-09-17T07:20:08.425 INFO:tasks.workunit.client.1.smithi139.stdout:3/917: mknod d5/d15/d20/d3b/c11e 0 2024-09-17T07:20:08.426 INFO:tasks.workunit.client.1.smithi139.stdout:3/918: fdatasync d5/d21/dba/d10d/f117 0 2024-09-17T07:20:08.427 INFO:tasks.workunit.client.1.smithi139.stdout:7/720: rename d5/d17/d4e/d55 to d5/d10/d8c/ded 0 2024-09-17T07:20:08.427 INFO:tasks.workunit.client.1.smithi139.stdout:4/890: mkdir d0/d1/d54/d93/da1/d11d 0 2024-09-17T07:20:08.446 INFO:tasks.workunit.client.1.smithi139.stdout:7/721: write d5/d10/d2b/d78/d9e/db1/fc2 [737637,76336] 0 2024-09-17T07:20:08.448 INFO:tasks.workunit.client.1.smithi139.stdout:6/890: write db/df/d4e/d64/f52 [244304,100351] 0 2024-09-17T07:20:08.452 INFO:tasks.workunit.client.1.smithi139.stdout:7/722: mknod d5/cee 0 2024-09-17T07:20:08.454 INFO:tasks.workunit.client.1.smithi139.stdout:4/891: write d0/db/d17/f38 [137051,19507] 0 2024-09-17T07:20:08.455 INFO:tasks.workunit.client.1.smithi139.stdout:6/891: write db/d18/d9f/fdf [46040,97130] 0 2024-09-17T07:20:08.461 INFO:tasks.workunit.client.1.smithi139.stdout:3/919: dwrite d5/d21/d23/d69/f76 [0,4194304] 0 2024-09-17T07:20:08.462 INFO:tasks.workunit.client.1.smithi139.stdout:7/723: dwrite d5/d10/fc6 [0,4194304] 0 2024-09-17T07:20:08.463 INFO:tasks.workunit.client.1.smithi139.stdout:3/920: chown d5/d63/d6d/d6f/d8b 2 1 2024-09-17T07:20:08.465 INFO:tasks.workunit.client.1.smithi139.stdout:4/892: truncate d0/d1/d29/f66 2982959 0 2024-09-17T07:20:08.466 INFO:tasks.workunit.client.1.smithi139.stdout:4/893: dread - d0/d1/d29/d6a/fd0 zero size 2024-09-17T07:20:08.467 INFO:tasks.workunit.client.1.smithi139.stdout:6/892: link db/df/d73/dc1/lda db/df/d4e/d5e/l134 0 2024-09-17T07:20:08.468 INFO:tasks.workunit.client.1.smithi139.stdout:7/724: chown d5/d17/f31 4555 1 2024-09-17T07:20:08.468 INFO:tasks.workunit.client.1.smithi139.stdout:4/894: fdatasync d0/f30 0 2024-09-17T07:20:08.472 INFO:tasks.workunit.client.1.smithi139.stdout:6/893: rmdir db/d21 39 2024-09-17T07:20:08.472 INFO:tasks.workunit.client.1.smithi139.stdout:4/895: rmdir d0/d1/d29/d6a/db6 39 2024-09-17T07:20:08.474 INFO:tasks.workunit.client.1.smithi139.stdout:4/896: unlink d0/db/d7f/f94 0 2024-09-17T07:20:08.476 INFO:tasks.workunit.client.1.smithi139.stdout:6/894: unlink db/df/d4e/d5e/d8a/lcb 0 2024-09-17T07:20:08.476 INFO:tasks.workunit.client.1.smithi139.stdout:6/895: fsync db/df/f13 0 2024-09-17T07:20:08.477 INFO:tasks.workunit.client.1.smithi139.stdout:4/897: symlink d0/d1/d29/d6d/l11e 0 2024-09-17T07:20:08.477 INFO:tasks.workunit.client.1.smithi139.stdout:6/896: dread - db/df/d73/d81/f10c zero size 2024-09-17T07:20:08.478 INFO:tasks.workunit.client.1.smithi139.stdout:4/898: mknod d0/d49/c11f 0 2024-09-17T07:20:08.478 INFO:tasks.workunit.client.1.smithi139.stdout:6/897: write db/df/d73/f95 [3540187,39532] 0 2024-09-17T07:20:08.484 INFO:tasks.workunit.client.1.smithi139.stdout:4/899: link d0/d1/d54/l7b d0/d10/l120 0 2024-09-17T07:20:08.486 INFO:tasks.workunit.client.1.smithi139.stdout:7/725: dwrite d5/d10/d8c/ded/f6f [0,4194304] 0 2024-09-17T07:20:08.486 INFO:tasks.workunit.client.1.smithi139.stdout:4/900: write d0/de9/d83/fdb [1014828,8897] 0 2024-09-17T07:20:08.487 INFO:tasks.workunit.client.1.smithi139.stdout:4/901: read - d0/de9/f10d zero size 2024-09-17T07:20:08.493 INFO:tasks.workunit.client.1.smithi139.stdout:6/898: write db/df/d4e/d64/d83/dc5/fc4 [993069,38502] 0 2024-09-17T07:20:08.495 INFO:tasks.workunit.client.1.smithi139.stdout:7/726: symlink d5/d17/lef 0 2024-09-17T07:20:08.498 INFO:tasks.workunit.client.0.smithi087.stdout:7/984: sync 2024-09-17T07:20:08.498 INFO:tasks.workunit.client.1.smithi139.stdout:4/902: dread d0/d1/d29/d6d/f86 [0,4194304] 0 2024-09-17T07:20:08.500 INFO:tasks.workunit.client.1.smithi139.stdout:4/903: write d0/d1/dbe/ff9 [33434,86980] 0 2024-09-17T07:20:08.500 INFO:tasks.workunit.client.1.smithi139.stdout:6/899: mknod db/df/daa/d12f/c135 0 2024-09-17T07:20:08.507 INFO:tasks.workunit.client.1.smithi139.stdout:7/727: write d5/d17/d4e/f69 [1475958,33224] 0 2024-09-17T07:20:08.511 INFO:tasks.workunit.client.1.smithi139.stdout:7/728: creat d5/d17/d4e/ff0 x:0 0 0 2024-09-17T07:20:08.514 INFO:tasks.workunit.client.1.smithi139.stdout:4/904: dwrite d0/db/d58/f73 [0,4194304] 0 2024-09-17T07:20:08.516 INFO:tasks.workunit.client.1.smithi139.stdout:4/905: truncate d0/db/d7f/f90 4398674 0 2024-09-17T07:20:08.520 INFO:tasks.workunit.client.1.smithi139.stdout:4/906: mkdir d0/d49/d121 0 2024-09-17T07:20:08.520 INFO:tasks.workunit.client.1.smithi139.stdout:7/729: dread d5/d10/d8c/ded/f6f [0,4194304] 0 2024-09-17T07:20:08.521 INFO:tasks.workunit.client.1.smithi139.stdout:4/907: dread - d0/d1/d29/d6d/db3/fcc zero size 2024-09-17T07:20:08.528 INFO:tasks.workunit.client.1.smithi139.stdout:6/900: dread db/df/d73/d81/f113 [0,4194304] 0 2024-09-17T07:20:08.544 INFO:tasks.workunit.client.1.smithi139.stdout:6/901: mkdir db/df/d4e/d64/d83/dd5/d136 0 2024-09-17T07:20:08.545 INFO:tasks.workunit.client.1.smithi139.stdout:6/902: chown db/df/d4e/d64/d83/dc5/ccd 142781805 1 2024-09-17T07:20:08.552 INFO:tasks.workunit.client.1.smithi139.stdout:6/903: dwrite db/df/d4e/d64/fb2 [0,4194304] 0 2024-09-17T07:20:08.559 INFO:tasks.workunit.client.0.smithi087.stdout:9/984: sync 2024-09-17T07:20:08.562 INFO:tasks.workunit.client.1.smithi139.stdout:7/730: fsync d5/d17/f91 0 2024-09-17T07:20:08.562 INFO:tasks.workunit.client.0.smithi087.stdout:9/985: rmdir d3/d4/d6/d8/d22/d92/da3/d13a 0 2024-09-17T07:20:08.563 INFO:tasks.workunit.client.1.smithi139.stdout:4/908: truncate d0/f4c 5876332 0 2024-09-17T07:20:08.564 INFO:tasks.workunit.client.1.smithi139.stdout:6/904: write db/df/f84 [4799326,24664] 0 2024-09-17T07:20:08.566 INFO:tasks.workunit.client.1.smithi139.stdout:7/731: dread d5/d17/d4e/faf [0,4194304] 0 2024-09-17T07:20:08.571 INFO:tasks.workunit.client.0.smithi087.stdout:9/986: write d3/d4/d6/d8/d12/d32/da1/fed [2451518,129826] 0 2024-09-17T07:20:08.571 INFO:tasks.workunit.client.1.smithi139.stdout:7/732: rename d5/d17/c6a to d5/d10/d4d/d59/dd1/dd6/cf1 0 2024-09-17T07:20:08.573 INFO:tasks.workunit.client.1.smithi139.stdout:4/909: truncate d0/de9/d83/f48 4619278 0 2024-09-17T07:20:08.574 INFO:tasks.workunit.client.0.smithi087.stdout:9/987: dread d3/d4/d6/d8/d22/d43/d84/dc7/fdd [0,4194304] 0 2024-09-17T07:20:08.575 INFO:tasks.workunit.client.0.smithi087.stdout:9/988: stat d3/d4/d6/d8/d22/d92/da3/d113/c132 0 2024-09-17T07:20:08.576 INFO:tasks.workunit.client.0.smithi087.stdout:9/989: creat d3/d4/da/d4b/f151 x:0 0 0 2024-09-17T07:20:08.577 INFO:tasks.workunit.client.0.smithi087.stdout:9/990: chown d3/d4/d6/d8/d22/d92/da3/d113 13417924 1 2024-09-17T07:20:08.578 INFO:tasks.workunit.client.1.smithi139.stdout:6/905: rename db/df/d4e/d64/d56/d98/f123 to db/df/d4e/d64/d54/f137 0 2024-09-17T07:20:08.579 INFO:tasks.workunit.client.0.smithi087.stdout:9/991: dread - d3/d4/d6/d8/d12/d32/da1/f106 zero size 2024-09-17T07:20:08.581 INFO:tasks.workunit.client.1.smithi139.stdout:6/906: mknod db/df/d73/c138 0 2024-09-17T07:20:08.582 INFO:tasks.workunit.client.0.smithi087.stdout:9/992: getdents d3/d4/d6/d8/d12 0 2024-09-17T07:20:08.584 INFO:tasks.workunit.client.1.smithi139.stdout:6/907: mknod db/d21/d96/c139 0 2024-09-17T07:20:08.585 INFO:tasks.workunit.client.0.smithi087.stdout:9/993: truncate d3/d4/d6/d8/d22/d43/f61 534681 0 2024-09-17T07:20:08.585 INFO:tasks.workunit.client.1.smithi139.stdout:6/908: write db/df/d4e/d64/d54/f2b [3025306,77985] 0 2024-09-17T07:20:08.586 INFO:tasks.workunit.client.1.smithi139.stdout:4/910: truncate d0/d10/f25 155969 0 2024-09-17T07:20:08.586 INFO:tasks.workunit.client.0.smithi087.stdout:9/994: fdatasync d3/d4/d16/d69/d8a/d1e/fb0 0 2024-09-17T07:20:08.589 INFO:tasks.workunit.client.1.smithi139.stdout:4/911: fdatasync d0/d49/f52 0 2024-09-17T07:20:08.590 INFO:tasks.workunit.client.0.smithi087.stdout:9/995: symlink d3/d4/d6/d8/d12/d38/d13c/l152 0 2024-09-17T07:20:08.591 INFO:tasks.workunit.client.0.smithi087.stdout:9/996: fdatasync d3/d4/d16/d69/f7b 0 2024-09-17T07:20:08.591 INFO:tasks.workunit.client.1.smithi139.stdout:4/912: chown d0/d1/d29/d41/f63 0 1 2024-09-17T07:20:08.593 INFO:tasks.workunit.client.1.smithi139.stdout:7/733: dread d5/d10/d2b/d40/f94 [0,4194304] 0 2024-09-17T07:20:08.593 INFO:tasks.workunit.client.1.smithi139.stdout:6/909: dwrite db/df/d4e/d64/d80/fb5 [0,4194304] 0 2024-09-17T07:20:08.594 INFO:tasks.workunit.client.0.smithi087.stdout:9/997: fdatasync d3/d4/d6/d8/d22/d43/f61 0 2024-09-17T07:20:08.597 INFO:tasks.workunit.client.1.smithi139.stdout:6/910: symlink db/d18/d9f/dd2/l13a 0 2024-09-17T07:20:08.600 INFO:tasks.workunit.client.0.smithi087.stdout:9/998: dwrite d3/d4/da/d4b/f151 [0,4194304] 0 2024-09-17T07:20:08.601 INFO:tasks.workunit.client.0.smithi087.stdout:7/985: sync 2024-09-17T07:20:08.601 INFO:tasks.workunit.client.1.smithi139.stdout:6/911: fdatasync db/df/d73/dc1/fe9 0 2024-09-17T07:20:08.602 INFO:tasks.workunit.client.1.smithi139.stdout:4/913: link d0/d10/ce1 d0/d49/d121/c122 0 2024-09-17T07:20:08.603 INFO:tasks.workunit.client.0.smithi087.stdout:7/986: fdatasync d0/f8 0 2024-09-17T07:20:08.603 INFO:tasks.workunit.client.1.smithi139.stdout:6/912: dread db/d18/f8e [0,4194304] 0 2024-09-17T07:20:08.606 INFO:tasks.workunit.client.1.smithi139.stdout:6/913: mknod db/df/d4e/d64/d83/dd5/c13b 0 2024-09-17T07:20:08.607 INFO:tasks.workunit.client.0.smithi087.stdout:7/987: creat d0/d36/d8e/df1/d118/d10/d87/f130 x:0 0 0 2024-09-17T07:20:08.608 INFO:tasks.workunit.client.0.smithi087.stdout:9/999: getdents d3/d4/d6/d8/d12/d38 0 2024-09-17T07:20:08.611 INFO:tasks.workunit.client.0.smithi087.stdout:7/988: mknod d0/d36/d8e/df1/d118/d10/d32/d62/d76/d11f/c131 0 2024-09-17T07:20:08.611 INFO:tasks.workunit.client.1.smithi139.stdout:6/914: link db/d18/d38/c41 db/df/d4e/d64/d83/dd5/d11b/c13c 0 2024-09-17T07:20:08.612 INFO:tasks.workunit.client.1.smithi139.stdout:4/914: write d0/d37/fb7 [686218,104679] 0 2024-09-17T07:20:08.613 INFO:tasks.workunit.client.1.smithi139.stdout:6/915: symlink db/d18/d38/d60/dc2/l13d 0 2024-09-17T07:20:08.618 INFO:tasks.workunit.client.0.smithi087.stdout:7/989: dwrite d0/d36/d8e/df1/d118/d23/d2d/f35 [4194304,4194304] 0 2024-09-17T07:20:08.618 INFO:tasks.workunit.client.1.smithi139.stdout:4/915: dwrite d0/d1/dbe/fab [0,4194304] 0 2024-09-17T07:20:08.619 INFO:tasks.workunit.client.1.smithi139.stdout:4/916: chown d0/d1/d29/d6a 66 1 2024-09-17T07:20:08.620 INFO:tasks.workunit.client.1.smithi139.stdout:4/917: truncate d0/db/d58/ff4 1443380 0 2024-09-17T07:20:08.621 INFO:tasks.workunit.client.0.smithi087.stdout:7/990: creat d0/d7a/f132 x:0 0 0 2024-09-17T07:20:08.622 INFO:tasks.workunit.client.0.smithi087.stdout:7/991: write d0/d36/d8e/df1/d118/d23/d17/d7b/dad/f109 [935132,84] 0 2024-09-17T07:20:08.624 INFO:tasks.workunit.client.0.smithi087.stdout:7/992: dread d0/d36/d8e/df1/d118/d23/d17/f3a [0,4194304] 0 2024-09-17T07:20:08.640 INFO:tasks.workunit.client.0.smithi087.stdout:7/993: truncate d0/d36/d8e/df1/d118/d23/f53 6238986 0 2024-09-17T07:20:08.640 INFO:tasks.workunit.client.0.smithi087.stdout:7/994: write d0/dbb/f116 [123416,22800] 0 2024-09-17T07:20:08.642 INFO:tasks.workunit.client.0.smithi087.stdout:7/995: write d0/d36/d8e/df1/d118/d10/d87/fd3 [13976,34997] 0 2024-09-17T07:20:08.644 INFO:tasks.workunit.client.0.smithi087.stdout:7/996: mkdir d0/d36/deb/d133 0 2024-09-17T07:20:08.645 INFO:tasks.workunit.client.0.smithi087.stdout:7/997: symlink d0/d36/d8e/df1/d118/d10/d87/d96/l134 0 2024-09-17T07:20:08.646 INFO:tasks.workunit.client.0.smithi087.stdout:7/998: write d0/d36/d8e/df1/d118/d10/d32/d62/d76/f7f [2493527,108991] 0 2024-09-17T07:20:08.653 INFO:tasks.workunit.client.0.smithi087.stdout:7/999: dwrite d0/d36/d8e/df1/d118/d10/d32/d8c/de8/f123 [4194304,4194304] 0 2024-09-17T07:20:08.658 INFO:tasks.workunit.client.0.smithi087.stderr:+ rm -rf -- ./tmp.v7LFrnt2kC 2024-09-17T07:20:08.721 INFO:tasks.workunit.client.1.smithi139.stdout:4/918: link d0/d1/dbe/ddd/f101 d0/d1/d29/d6a/db6/f123 0 2024-09-17T07:20:08.721 INFO:tasks.workunit.client.1.smithi139.stdout:7/734: dread d5/f1e [0,4194304] 0 2024-09-17T07:20:08.724 INFO:tasks.workunit.client.1.smithi139.stdout:7/735: chown d5/d17/d4e/d63/cac 7037737 1 2024-09-17T07:20:08.725 INFO:tasks.workunit.client.1.smithi139.stdout:7/736: chown d5/d10/d4d/d59/fa6 68 1 2024-09-17T07:20:08.729 INFO:tasks.workunit.client.1.smithi139.stdout:7/737: write d5/d17/f32 [529493,35977] 0 2024-09-17T07:20:08.732 INFO:tasks.workunit.client.1.smithi139.stdout:4/919: dwrite d0/d10/f53 [0,4194304] 0 2024-09-17T07:20:08.735 INFO:tasks.workunit.client.1.smithi139.stdout:7/738: rename d5/d17/d4e/d66/ce8 to d5/d10/d2b/d78/d9e/db1/db7/cf2 0 2024-09-17T07:20:08.736 INFO:tasks.workunit.client.1.smithi139.stdout:4/920: creat d0/d1/d54/d93/f124 x:0 0 0 2024-09-17T07:20:08.738 INFO:tasks.workunit.client.1.smithi139.stdout:7/739: mknod d5/cf3 0 2024-09-17T07:20:08.739 INFO:tasks.workunit.client.1.smithi139.stdout:4/921: mkdir d0/d1/d29/d41/d125 0 2024-09-17T07:20:08.741 INFO:tasks.workunit.client.1.smithi139.stdout:4/922: chown d0/d1/d54/d93/f124 491 1 2024-09-17T07:20:08.743 INFO:tasks.workunit.client.1.smithi139.stdout:4/923: creat d0/d1/dbe/f126 x:0 0 0 2024-09-17T07:20:08.744 INFO:tasks.workunit.client.1.smithi139.stdout:7/740: dwrite d5/d10/d2b/d40/d47/f72 [4194304,4194304] 0 2024-09-17T07:20:08.748 INFO:tasks.workunit.client.1.smithi139.stdout:7/741: symlink d5/d10/d2b/lf4 0 2024-09-17T07:20:08.749 INFO:tasks.workunit.client.1.smithi139.stdout:4/924: rename d0/db/f35 to d0/de9/f127 0 2024-09-17T07:20:08.750 INFO:tasks.workunit.client.1.smithi139.stdout:4/925: stat d0/de9/d83/f3a 0 2024-09-17T07:20:08.753 INFO:tasks.workunit.client.1.smithi139.stdout:4/926: dread d0/d1/dbe/fab [0,4194304] 0 2024-09-17T07:20:08.758 INFO:tasks.workunit.client.1.smithi139.stdout:4/927: dwrite d0/d1/dbe/f95 [0,4194304] 0 2024-09-17T07:20:08.762 INFO:tasks.workunit.client.1.smithi139.stdout:4/928: creat d0/d1/d29/d41/d125/f128 x:0 0 0 2024-09-17T07:20:08.769 INFO:tasks.workunit.client.1.smithi139.stdout:4/929: dwrite d0/d1/d54/d93/da2/fda [4194304,4194304] 0 2024-09-17T07:20:08.782 INFO:tasks.workunit.client.1.smithi139.stdout:7/742: write d5/d10/d2b/f3c [3329336,12159] 0 2024-09-17T07:20:08.787 INFO:tasks.workunit.client.1.smithi139.stdout:4/930: write d0/db/d7f/f8c [842518,58096] 0 2024-09-17T07:20:08.788 INFO:tasks.workunit.client.1.smithi139.stdout:4/931: write d0/db/d58/f9a [4058686,67253] 0 2024-09-17T07:20:08.797 INFO:tasks.workunit.client.1.smithi139.stdout:4/932: dwrite d0/d49/f52 [0,4194304] 0 2024-09-17T07:20:08.799 INFO:tasks.workunit.client.1.smithi139.stdout:4/933: symlink d0/d37/l129 0 2024-09-17T07:20:08.804 INFO:tasks.workunit.client.1.smithi139.stdout:4/934: dwrite d0/de9/f127 [0,4194304] 0 2024-09-17T07:20:08.805 INFO:tasks.workunit.client.1.smithi139.stdout:4/935: chown d0/d1/d54/d93/da1 4202 1 2024-09-17T07:20:08.830 INFO:tasks.workunit.client.1.smithi139.stdout:1/735: sync 2024-09-17T07:20:08.830 INFO:tasks.workunit.client.1.smithi139.stdout:0/622: sync 2024-09-17T07:20:08.832 INFO:tasks.workunit.client.1.smithi139.stdout:0/623: chown d1/da/d1b/d32/d9a/f9d 367 1 2024-09-17T07:20:08.833 INFO:tasks.workunit.client.1.smithi139.stdout:1/736: mknod d2/d10/d12/d24/d38/ce7 0 2024-09-17T07:20:08.840 INFO:tasks.workunit.client.1.smithi139.stdout:0/624: write d1/da/d1b/f33 [1226499,73123] 0 2024-09-17T07:20:08.842 INFO:tasks.workunit.client.1.smithi139.stdout:0/625: creat d1/da/d1b/d32/d9a/fe3 x:0 0 0 2024-09-17T07:20:08.842 INFO:tasks.workunit.client.1.smithi139.stdout:0/626: fdatasync d1/da/d1b/d32/f3a 0 2024-09-17T07:20:08.935 INFO:tasks.workunit.client.1.smithi139.stdout:0/627: dwrite d1/da/d1b/d32/f37 [0,4194304] 0 2024-09-17T07:20:08.938 INFO:tasks.workunit.client.1.smithi139.stdout:0/628: creat d1/da/d1b/d3d/fe4 x:0 0 0 2024-09-17T07:20:08.944 INFO:tasks.workunit.client.1.smithi139.stdout:0/629: dwrite d1/da/d2a/f80 [0,4194304] 0 2024-09-17T07:20:08.949 INFO:tasks.workunit.client.1.smithi139.stdout:0/630: getdents d1 0 2024-09-17T07:20:08.950 INFO:tasks.workunit.client.1.smithi139.stdout:0/631: fdatasync d1/da/d1b/db6/fd7 0 2024-09-17T07:20:08.955 INFO:tasks.workunit.client.1.smithi139.stdout:0/632: dread d1/da/d2a/f62 [0,4194304] 0 2024-09-17T07:20:08.958 INFO:tasks.workunit.client.1.smithi139.stdout:0/633: dread d1/da/d1b/d32/f47 [0,4194304] 0 2024-09-17T07:20:08.959 INFO:tasks.workunit.client.1.smithi139.stdout:0/634: read - d1/da/d2a/fd3 zero size 2024-09-17T07:20:08.959 INFO:tasks.workunit.client.1.smithi139.stdout:0/635: write d1/da/f60 [4556853,12382] 0 2024-09-17T07:20:08.962 INFO:tasks.workunit.client.1.smithi139.stdout:0/636: rename d1/da/d1b/d32/d81/la4 to d1/d58/le5 0 2024-09-17T07:20:08.963 INFO:tasks.workunit.client.1.smithi139.stdout:0/637: truncate d1/da/d1b/f33 1704217 0 2024-09-17T07:20:09.082 INFO:tasks.workunit.client.1.smithi139.stdout:5/909: sync 2024-09-17T07:20:09.082 INFO:tasks.workunit.client.1.smithi139.stdout:2/980: sync 2024-09-17T07:20:09.084 INFO:tasks.workunit.client.1.smithi139.stdout:5/910: fsync d4/d16/d1b/d20/d28/d3f/fb7 0 2024-09-17T07:20:09.085 INFO:tasks.workunit.client.1.smithi139.stdout:5/911: readlink d4/l44 0 2024-09-17T07:20:09.088 INFO:tasks.workunit.client.1.smithi139.stdout:2/981: dwrite d0/de/d69/fa3 [4194304,4194304] 0 2024-09-17T07:20:09.089 INFO:tasks.workunit.client.1.smithi139.stdout:2/982: dread - d0/d7/d1a/d59/f138 zero size 2024-09-17T07:20:09.090 INFO:tasks.workunit.client.1.smithi139.stdout:5/912: dread d4/d16/d1b/d20/d28/f3e [4194304,4194304] 0 2024-09-17T07:20:09.090 INFO:tasks.workunit.client.1.smithi139.stdout:5/913: readlink d4/d16/d1b/l47 0 2024-09-17T07:20:09.091 INFO:tasks.workunit.client.1.smithi139.stdout:2/983: fdatasync d0/de/df/d56/fab 0 2024-09-17T07:20:09.091 INFO:tasks.workunit.client.1.smithi139.stdout:5/914: chown d4/d16/d1b/d20/l105 270907529 1 2024-09-17T07:20:09.096 INFO:tasks.workunit.client.1.smithi139.stdout:5/915: creat d4/d16/d1b/d20/d32/d3d/d10d/f12b x:0 0 0 2024-09-17T07:20:09.096 INFO:tasks.workunit.client.1.smithi139.stdout:2/984: write d0/d7/d67/d92/d99/f4f [5026295,116815] 0 2024-09-17T07:20:09.097 INFO:tasks.workunit.client.1.smithi139.stdout:5/916: chown d4/d16/d1b/d20/d28/f26 237080463 1 2024-09-17T07:20:09.099 INFO:tasks.workunit.client.1.smithi139.stdout:5/917: write d4/d16/d1b/d20/d28/d3f/de8/f103 [653743,109266] 0 2024-09-17T07:20:09.102 INFO:tasks.workunit.client.1.smithi139.stdout:5/918: symlink d4/d16/d1b/d20/d32/d76/l12c 0 2024-09-17T07:20:09.104 INFO:tasks.workunit.client.1.smithi139.stdout:5/919: mknod d4/d16/d1b/d20/d32/d3d/d10d/c12d 0 2024-09-17T07:20:09.115 INFO:tasks.workunit.client.1.smithi139.stdout:5/920: write d4/d16/d1b/d20/d67/f75 [893065,79671] 0 2024-09-17T07:20:09.117 INFO:tasks.workunit.client.1.smithi139.stdout:5/921: unlink d4/d16/ce3 0 2024-09-17T07:20:09.117 INFO:tasks.workunit.client.1.smithi139.stdout:2/985: dwrite d0/d7/d67/da1/d10d/d15/d9f/d118/f90 [0,4194304] 0 2024-09-17T07:20:09.118 INFO:tasks.workunit.client.1.smithi139.stdout:2/986: truncate d0/df8/f121 617048 0 2024-09-17T07:20:09.127 INFO:tasks.workunit.client.1.smithi139.stdout:2/987: dwrite d0/d7/d86/f11c [0,4194304] 0 2024-09-17T07:20:09.129 INFO:tasks.workunit.client.1.smithi139.stdout:5/922: dwrite d4/d16/d1b/d20/d67/d88/fad [0,4194304] 0 2024-09-17T07:20:09.133 INFO:tasks.workunit.client.1.smithi139.stdout:5/923: creat d4/d16/d1b/d20/d38/d4f/f12e x:0 0 0 2024-09-17T07:20:09.134 INFO:tasks.workunit.client.1.smithi139.stdout:5/924: truncate d4/f6 2241991 0 2024-09-17T07:20:09.143 INFO:tasks.workunit.client.1.smithi139.stdout:4/936: sync 2024-09-17T07:20:09.143 INFO:tasks.workunit.client.1.smithi139.stdout:6/916: sync 2024-09-17T07:20:09.143 INFO:tasks.workunit.client.1.smithi139.stdout:3/921: sync 2024-09-17T07:20:09.144 INFO:tasks.workunit.client.1.smithi139.stdout:6/917: readlink db/d18/l5f 0 2024-09-17T07:20:09.147 INFO:tasks.workunit.client.1.smithi139.stdout:6/918: mknod db/df/d4e/d64/d80/c13e 0 2024-09-17T07:20:09.152 INFO:tasks.workunit.client.1.smithi139.stdout:6/919: read db/d18/d1b/dfa/f122 [516237,70400] 0 2024-09-17T07:20:09.155 INFO:tasks.workunit.client.1.smithi139.stdout:6/920: creat db/db7/f13f x:0 0 0 2024-09-17T07:20:09.156 INFO:tasks.workunit.client.1.smithi139.stdout:6/921: creat db/d18/d1b/dfa/f140 x:0 0 0 2024-09-17T07:20:09.157 INFO:tasks.workunit.client.1.smithi139.stdout:6/922: creat db/df/d4e/d5e/d8a/f141 x:0 0 0 2024-09-17T07:20:09.159 INFO:tasks.workunit.client.1.smithi139.stdout:6/923: mkdir db/db7/d142 0 2024-09-17T07:20:09.160 INFO:tasks.workunit.client.1.smithi139.stdout:6/924: chown db/df/d4e/d64/d80/c13e 26 1 2024-09-17T07:20:09.162 INFO:tasks.workunit.client.1.smithi139.stdout:6/925: mknod db/df/d4e/d64/c143 0 2024-09-17T07:20:09.172 INFO:tasks.workunit.client.1.smithi139.stdout:5/925: dwrite d4/d16/d1b/d20/d28/f83 [0,4194304] 0 2024-09-17T07:20:09.173 INFO:tasks.workunit.client.1.smithi139.stdout:5/926: truncate d4/d16/d1b/d20/d28/d61/fc1 4240603 0 2024-09-17T07:20:09.175 INFO:tasks.workunit.client.1.smithi139.stdout:5/927: chown d4/d16/d1b/d20/d38/d4f 0 1 2024-09-17T07:20:09.176 INFO:tasks.workunit.client.1.smithi139.stdout:3/922: truncate d5/da7/dca/dab/dd6/d28/f50 3165722 0 2024-09-17T07:20:09.179 INFO:tasks.workunit.client.1.smithi139.stdout:5/928: rmdir d4/d16/d1b/d20/d28/d61 39 2024-09-17T07:20:09.182 INFO:tasks.workunit.client.1.smithi139.stdout:4/937: dwrite d0/db/d58/f7e [4194304,4194304] 0 2024-09-17T07:20:09.182 INFO:tasks.workunit.client.1.smithi139.stdout:2/988: dread d0/de/d69/de1/d126/f2d [0,4194304] 0 2024-09-17T07:20:09.183 INFO:tasks.workunit.client.1.smithi139.stdout:2/989: stat d0/d4e/d76/d111/f12a 0 2024-09-17T07:20:09.184 INFO:tasks.workunit.client.1.smithi139.stdout:3/923: rename d5/d63/d6d/le9 to d5/d21/d23/d38/l11f 0 2024-09-17T07:20:09.186 INFO:tasks.workunit.client.1.smithi139.stdout:4/938: rmdir d0/db/d7f 39 2024-09-17T07:20:09.189 INFO:tasks.workunit.client.1.smithi139.stdout:3/924: creat d5/d15/d16/d105/f120 x:0 0 0 2024-09-17T07:20:09.189 INFO:tasks.workunit.client.1.smithi139.stdout:4/939: rmdir d0/de9 39 2024-09-17T07:20:09.190 INFO:tasks.workunit.client.1.smithi139.stdout:2/990: rename d0/d7/l75 to d0/de/d69/de1/l140 0 2024-09-17T07:20:09.192 INFO:tasks.workunit.client.1.smithi139.stdout:3/925: creat d5/d63/d6d/d6f/d8b/def/d116/f121 x:0 0 0 2024-09-17T07:20:09.192 INFO:tasks.workunit.client.1.smithi139.stdout:2/991: chown d0/d7/d67/da1/d10d/d15/d9f/f114 7927401 1 2024-09-17T07:20:09.193 INFO:tasks.workunit.client.1.smithi139.stdout:4/940: rename d0/db/db2/c105 to d0/d1/dbe/ddd/c12a 0 2024-09-17T07:20:09.194 INFO:tasks.workunit.client.1.smithi139.stdout:3/926: symlink d5/da7/dca/dd7/l122 0 2024-09-17T07:20:09.195 INFO:tasks.workunit.client.1.smithi139.stdout:4/941: write d0/d1/d29/d41/ff1 [154867,88701] 0 2024-09-17T07:20:09.196 INFO:tasks.workunit.client.1.smithi139.stdout:2/992: dread d0/d7/d67/da1/d10d/d3a/f3d [0,4194304] 0 2024-09-17T07:20:09.197 INFO:tasks.workunit.client.1.smithi139.stdout:3/927: fdatasync d5/da7/dca/dab/dd6/d28/f3d 0 2024-09-17T07:20:09.202 INFO:tasks.workunit.client.1.smithi139.stdout:5/929: write d4/d16/d1b/d20/d28/dca/fdf [134625,111296] 0 2024-09-17T07:20:09.207 INFO:tasks.workunit.client.1.smithi139.stdout:2/993: rename d0/d7/d86/da4/d12/fc2 to d0/d7/d67/da1/d10d/d15/d9f/f141 0 2024-09-17T07:20:09.209 INFO:tasks.workunit.client.1.smithi139.stdout:3/928: dwrite d5/da7/dca/dd7/ff3 [0,4194304] 0 2024-09-17T07:20:09.212 INFO:tasks.workunit.client.1.smithi139.stdout:5/930: symlink d4/d5d/d97/l12f 0 2024-09-17T07:20:09.212 INFO:tasks.workunit.client.1.smithi139.stdout:2/994: dread - d0/d7/d1a/d59/f132 zero size 2024-09-17T07:20:09.214 INFO:tasks.workunit.client.1.smithi139.stdout:3/929: write d5/d15/d20/d83/f94 [4440472,77034] 0 2024-09-17T07:20:09.216 INFO:tasks.workunit.client.1.smithi139.stdout:2/995: chown d0/d4e/d76/f133 31509367 1 2024-09-17T07:20:09.218 INFO:tasks.workunit.client.1.smithi139.stdout:4/942: dwrite d0/de9/d10e/f110 [0,4194304] 0 2024-09-17T07:20:09.220 INFO:tasks.workunit.client.1.smithi139.stdout:3/930: truncate d5/d21/dba/d10d/f117 756820 0 2024-09-17T07:20:09.221 INFO:tasks.workunit.client.1.smithi139.stdout:5/931: chown d4/d16/d1b/d20/d32/d3d/c74 559031 1 2024-09-17T07:20:09.221 INFO:tasks.workunit.client.1.smithi139.stdout:2/996: rmdir d0/d7/d86/da4/d12 39 2024-09-17T07:20:09.223 INFO:tasks.workunit.client.1.smithi139.stdout:3/931: creat d5/d15/d20/d3b/dc1/f123 x:0 0 0 2024-09-17T07:20:09.224 INFO:tasks.workunit.client.1.smithi139.stdout:2/997: read d0/d7/d86/f11c [51852,62536] 0 2024-09-17T07:20:09.225 INFO:tasks.workunit.client.1.smithi139.stdout:5/932: creat d4/d16/d1b/d20/d28/d3f/f130 x:0 0 0 2024-09-17T07:20:09.229 INFO:tasks.workunit.client.1.smithi139.stdout:5/933: rmdir d4/d16/d1b/d20/d28/d3f/de8 39 2024-09-17T07:20:09.229 INFO:tasks.workunit.client.1.smithi139.stdout:3/932: chown d5/d15/ced 1627323945 1 2024-09-17T07:20:09.231 INFO:tasks.workunit.client.1.smithi139.stdout:3/933: stat d5/da7/dca/dd7/l122 0 2024-09-17T07:20:09.236 INFO:tasks.workunit.client.1.smithi139.stdout:3/934: mkdir d5/d63/db3/ddb/d11c/d124 0 2024-09-17T07:20:09.237 INFO:tasks.workunit.client.1.smithi139.stdout:2/998: dwrite d0/d7/d86/da4/d12/f77 [0,4194304] 0 2024-09-17T07:20:09.237 INFO:tasks.workunit.client.1.smithi139.stdout:4/943: dread d0/d1/d29/f2b [0,4194304] 0 2024-09-17T07:20:09.238 INFO:tasks.workunit.client.1.smithi139.stdout:4/944: dread - d0/d10/f100 zero size 2024-09-17T07:20:09.241 INFO:tasks.workunit.client.1.smithi139.stdout:4/945: mknod d0/d1/d54/d93/da2/d10b/c12b 0 2024-09-17T07:20:09.244 INFO:tasks.workunit.client.1.smithi139.stdout:2/999: truncate d0/de/d25/d120/f13e 1330670 0 2024-09-17T07:20:09.247 INFO:tasks.workunit.client.1.smithi139.stdout:5/934: dwrite d4/d16/d1b/d20/d38/fbb [0,4194304] 0 2024-09-17T07:20:09.247 INFO:tasks.workunit.client.1.smithi139.stdout:4/946: creat d0/d1/d29/f12c x:0 0 0 2024-09-17T07:20:09.252 INFO:tasks.workunit.client.1.smithi139.stdout:5/935: creat d4/d16/d1b/d20/d32/d72/f131 x:0 0 0 2024-09-17T07:20:09.254 INFO:tasks.workunit.client.1.smithi139.stdout:5/936: chown d4/d16/d1b/d20/d32/d6c/c121 83 1 2024-09-17T07:20:09.255 INFO:tasks.workunit.client.1.smithi139.stdout:4/947: dread d0/d1/d29/d41/fbb [0,4194304] 0 2024-09-17T07:20:09.256 INFO:tasks.workunit.client.1.smithi139.stdout:5/937: mkdir d4/d16/d1b/d20/d67/d88/d132 0 2024-09-17T07:20:09.257 INFO:tasks.workunit.client.1.smithi139.stdout:3/935: dread d5/d21/d23/d38/f40 [0,4194304] 0 2024-09-17T07:20:09.260 INFO:tasks.workunit.client.1.smithi139.stdout:3/936: creat d5/d21/d23/d69/dd5/f125 x:0 0 0 2024-09-17T07:20:09.265 INFO:tasks.workunit.client.1.smithi139.stdout:4/948: write d0/db/d17/dc3/fc8 [31654,102539] 0 2024-09-17T07:20:09.265 INFO:tasks.workunit.client.1.smithi139.stdout:4/949: fdatasync d0/d37/fb7 0 2024-09-17T07:20:09.265 INFO:tasks.workunit.client.1.smithi139.stdout:0/638: sync 2024-09-17T07:20:09.266 INFO:tasks.workunit.client.1.smithi139.stdout:7/743: sync 2024-09-17T07:20:09.266 INFO:tasks.workunit.client.1.smithi139.stdout:1/737: sync 2024-09-17T07:20:09.268 INFO:tasks.workunit.client.1.smithi139.stdout:0/639: creat d1/da/d1b/dba/dc5/fe6 x:0 0 0 2024-09-17T07:20:09.269 INFO:tasks.workunit.client.1.smithi139.stdout:7/744: symlink d5/d10/d2b/d40/lf5 0 2024-09-17T07:20:09.271 INFO:tasks.workunit.client.1.smithi139.stdout:0/640: read - d1/da/d17/d72/d66/d6c/fc0 zero size 2024-09-17T07:20:09.274 INFO:tasks.workunit.client.1.smithi139.stdout:7/745: symlink d5/d10/d2b/d78/d9e/db1/db8/lf6 0 2024-09-17T07:20:09.276 INFO:tasks.workunit.client.1.smithi139.stdout:1/738: dwrite d2/d10/d12/d13/d4f/d5c/d74/fbe [0,4194304] 0 2024-09-17T07:20:09.277 INFO:tasks.workunit.client.1.smithi139.stdout:7/746: fdatasync d5/d17/f27 0 2024-09-17T07:20:09.278 INFO:tasks.workunit.client.1.smithi139.stdout:4/950: truncate d0/d49/f8b 2036128 0 2024-09-17T07:20:09.280 INFO:tasks.workunit.client.1.smithi139.stdout:7/747: chown d5/c54 47 1 2024-09-17T07:20:09.280 INFO:tasks.workunit.client.1.smithi139.stdout:5/938: dread d4/d16/d1b/d20/d38/d4f/f5c [0,4194304] 0 2024-09-17T07:20:09.281 INFO:tasks.workunit.client.1.smithi139.stdout:4/951: write d0/de9/d83/f3a [633436,114644] 0 2024-09-17T07:20:09.284 INFO:tasks.workunit.client.1.smithi139.stdout:1/739: creat d2/fe8 x:0 0 0 2024-09-17T07:20:09.285 INFO:tasks.workunit.client.1.smithi139.stdout:5/939: readlink d4/d16/d1b/d20/d28/d3f/dcc/df1/d10c/l110 0 2024-09-17T07:20:09.287 INFO:tasks.workunit.client.1.smithi139.stdout:7/748: creat d5/d10/d2b/d40/d47/dc7/ff7 x:0 0 0 2024-09-17T07:20:09.288 INFO:tasks.workunit.client.1.smithi139.stdout:3/937: dread d5/d21/f4e [0,4194304] 0 2024-09-17T07:20:09.289 INFO:tasks.workunit.client.1.smithi139.stdout:5/940: mknod d4/d16/d1b/d20/d11a/c133 0 2024-09-17T07:20:09.289 INFO:tasks.workunit.client.1.smithi139.stdout:4/952: dread d0/db/d58/ff4 [0,4194304] 0 2024-09-17T07:20:09.292 INFO:tasks.workunit.client.1.smithi139.stdout:3/938: write d5/f11 [2904970,101327] 0 2024-09-17T07:20:09.293 INFO:tasks.workunit.client.1.smithi139.stdout:4/953: symlink d0/d1/d54/d93/da2/l12d 0 2024-09-17T07:20:09.297 INFO:tasks.workunit.client.1.smithi139.stdout:1/740: dwrite d2/d10/d12/d24/d38/da6/fdc [0,4194304] 0 2024-09-17T07:20:09.297 INFO:tasks.workunit.client.1.smithi139.stdout:5/941: dread - d4/d16/d1b/d20/d32/d6c/dc9/ff0 zero size 2024-09-17T07:20:09.297 INFO:tasks.workunit.client.1.smithi139.stdout:4/954: readlink d0/d1/d54/d93/da2/lca 0 2024-09-17T07:20:09.300 INFO:tasks.workunit.client.1.smithi139.stdout:7/749: write d5/d10/d4d/f7d [2550787,12559] 0 2024-09-17T07:20:09.301 INFO:tasks.workunit.client.1.smithi139.stdout:7/750: readlink d5/d10/lca 0 2024-09-17T07:20:09.304 INFO:tasks.workunit.client.1.smithi139.stdout:5/942: truncate d4/da5/fe2 269470 0 2024-09-17T07:20:09.304 INFO:tasks.workunit.client.1.smithi139.stdout:3/939: link d5/da7/dca/dd7/fe3 d5/d21/dba/d10d/f126 0 2024-09-17T07:20:09.305 INFO:tasks.workunit.client.1.smithi139.stdout:5/943: fdatasync d4/d16/d1b/d20/d32/d3d/f112 0 2024-09-17T07:20:09.306 INFO:tasks.workunit.client.1.smithi139.stdout:3/940: truncate d5/d21/d23/f88 4565058 0 2024-09-17T07:20:09.306 INFO:tasks.workunit.client.1.smithi139.stdout:7/751: mknod d5/d10/d2b/d78/dec/cf8 0 2024-09-17T07:20:09.309 INFO:tasks.workunit.client.1.smithi139.stdout:1/741: getdents d2/d10/d12/d1a/dd7/d2b 0 2024-09-17T07:20:09.310 INFO:tasks.workunit.client.1.smithi139.stdout:1/742: rename d2 to d2/d10/d12/d1a/d61/de9 22 2024-09-17T07:20:09.310 INFO:tasks.workunit.client.1.smithi139.stdout:7/752: fsync d5/f1e 0 2024-09-17T07:20:09.315 INFO:tasks.workunit.client.1.smithi139.stdout:1/743: read d2/d10/d12/d13/f16 [2035965,33714] 0 2024-09-17T07:20:09.315 INFO:tasks.workunit.client.1.smithi139.stdout:7/753: creat d5/d17/dea/ff9 x:0 0 0 2024-09-17T07:20:09.317 INFO:tasks.workunit.client.1.smithi139.stdout:1/744: write d2/d10/d12/d1a/d61/faf [3424812,29983] 0 2024-09-17T07:20:09.318 INFO:tasks.workunit.client.1.smithi139.stdout:4/955: dread d0/f82 [0,4194304] 0 2024-09-17T07:20:09.320 INFO:tasks.workunit.client.1.smithi139.stdout:5/944: link d4/d16/d1b/d20/d38/fa3 d4/d16/d1b/d20/d38/f134 0 2024-09-17T07:20:09.321 INFO:tasks.workunit.client.1.smithi139.stdout:3/941: write d5/d15/d20/d3b/fae [508066,1364] 0 2024-09-17T07:20:09.324 INFO:tasks.workunit.client.1.smithi139.stdout:7/754: write d5/d96/fa3 [766191,50838] 0 2024-09-17T07:20:09.325 INFO:tasks.workunit.client.1.smithi139.stdout:4/956: symlink d0/de9/d92/d115/l12e 0 2024-09-17T07:20:09.325 INFO:tasks.workunit.client.1.smithi139.stdout:4/957: chown d0/d1 25 1 2024-09-17T07:20:09.326 INFO:tasks.workunit.client.1.smithi139.stdout:7/755: write d5/d17/f27 [4092024,8044] 0 2024-09-17T07:20:09.326 INFO:tasks.workunit.client.1.smithi139.stdout:5/945: symlink d4/d16/d1b/d20/d67/d88/d132/l135 0 2024-09-17T07:20:09.326 INFO:tasks.workunit.client.1.smithi139.stdout:4/958: chown d0/d1/d29/d6d/db3 1012179719 1 2024-09-17T07:20:09.327 INFO:tasks.workunit.client.1.smithi139.stdout:3/942: mkdir d5/d63/db3/ddb/d127 0 2024-09-17T07:20:09.329 INFO:tasks.workunit.client.1.smithi139.stdout:4/959: truncate d0/db/d17/f38 1419101 0 2024-09-17T07:20:09.330 INFO:tasks.workunit.client.1.smithi139.stdout:5/946: read - d4/d16/d1b/d20/d67/d88/d9f/fe1 zero size 2024-09-17T07:20:09.333 INFO:tasks.workunit.client.1.smithi139.stdout:1/745: dread d2/d10/d12/d1a/dd7/d2b/f97 [0,4194304] 0 2024-09-17T07:20:09.334 INFO:tasks.workunit.client.1.smithi139.stdout:3/943: truncate d5/da7/dca/dab/dd6/d28/d54/d58/f8f 916100 0 2024-09-17T07:20:09.335 INFO:tasks.workunit.client.1.smithi139.stdout:7/756: write d5/d17/f31 [204156,125016] 0 2024-09-17T07:20:09.336 INFO:tasks.workunit.client.1.smithi139.stdout:5/947: write d4/d16/f19 [2201844,17005] 0 2024-09-17T07:20:09.337 INFO:tasks.workunit.client.1.smithi139.stdout:1/746: mkdir d2/d10/d12/d1a/db1/dc7/dc2/dea 0 2024-09-17T07:20:09.339 INFO:tasks.workunit.client.1.smithi139.stdout:1/747: readlink d2/d10/d12/d1a/dd7/d49/d8b/lb6 0 2024-09-17T07:20:09.340 INFO:tasks.workunit.client.1.smithi139.stdout:4/960: rename d0/d1/d29/d6d/db3 to d0/d10/db4/d12f 0 2024-09-17T07:20:09.342 INFO:tasks.workunit.client.1.smithi139.stdout:1/748: mknod d2/d10/d12/d13/ceb 0 2024-09-17T07:20:09.343 INFO:tasks.workunit.client.1.smithi139.stdout:7/757: rename d5/c54 to d5/d17/dea/cfa 0 2024-09-17T07:20:09.343 INFO:tasks.workunit.client.1.smithi139.stdout:1/749: chown d2/d10/d12/d1a/dd7/d2b/d4a/c5e 6 1 2024-09-17T07:20:09.348 INFO:tasks.workunit.client.1.smithi139.stdout:7/758: rename d5/d17/f32 to d5/d96/ffb 0 2024-09-17T07:20:09.350 INFO:tasks.workunit.client.1.smithi139.stdout:7/759: write d5/d17/f27 [3551019,11236] 0 2024-09-17T07:20:09.351 INFO:tasks.workunit.client.1.smithi139.stdout:3/944: dread d5/da7/dca/dab/dd6/d28/d54/d58/f8f [0,4194304] 0 2024-09-17T07:20:09.353 INFO:tasks.workunit.client.1.smithi139.stdout:5/948: creat d4/d16/d1b/d20/d67/f136 x:0 0 0 2024-09-17T07:20:09.356 INFO:tasks.workunit.client.1.smithi139.stdout:1/750: write d2/d10/d12/d13/fcb [1032532,32657] 0 2024-09-17T07:20:09.359 INFO:tasks.workunit.client.1.smithi139.stdout:7/760: write d5/d17/fcf [4806215,102394] 0 2024-09-17T07:20:09.361 INFO:tasks.workunit.client.1.smithi139.stdout:3/945: dwrite d5/da7/dca/dab/dd6/d28/f52 [0,4194304] 0 2024-09-17T07:20:09.362 INFO:tasks.workunit.client.1.smithi139.stdout:7/761: write d5/d17/fb0 [2976915,87395] 0 2024-09-17T07:20:09.363 INFO:tasks.workunit.client.1.smithi139.stdout:1/751: symlink d2/d10/d12/d1a/dd7/d49/d8d/lec 0 2024-09-17T07:20:09.364 INFO:tasks.workunit.client.1.smithi139.stdout:5/949: dwrite d4/d16/d1b/d20/d67/f75 [0,4194304] 0 2024-09-17T07:20:09.369 INFO:tasks.workunit.client.1.smithi139.stdout:4/961: dread d0/db/d7f/f90 [0,4194304] 0 2024-09-17T07:20:09.371 INFO:tasks.workunit.client.1.smithi139.stdout:4/962: chown d0/d1/d29/d41/f43 56 1 2024-09-17T07:20:09.372 INFO:tasks.workunit.client.1.smithi139.stdout:7/762: getdents d5/d17/d4e 0 2024-09-17T07:20:09.374 INFO:tasks.workunit.client.1.smithi139.stdout:7/763: dread - d5/f37 zero size 2024-09-17T07:20:09.374 INFO:tasks.workunit.client.1.smithi139.stdout:5/950: creat d4/d16/d1b/d20/d67/d88/d9f/dfc/dbf/f137 x:0 0 0 2024-09-17T07:20:09.376 INFO:tasks.workunit.client.1.smithi139.stdout:1/752: dwrite d2/d10/d12/f69 [4194304,4194304] 0 2024-09-17T07:20:09.376 INFO:tasks.workunit.client.1.smithi139.stdout:4/963: symlink d0/d1/d29/d41/dad/l130 0 2024-09-17T07:20:09.378 INFO:tasks.workunit.client.1.smithi139.stdout:7/764: mkdir d5/d10/d4d/d59/dfc 0 2024-09-17T07:20:09.381 INFO:tasks.workunit.client.1.smithi139.stdout:4/964: chown d0/l88 5 1 2024-09-17T07:20:09.382 INFO:tasks.workunit.client.1.smithi139.stdout:7/765: creat d5/d17/d4e/d66/dd5/ffd x:0 0 0 2024-09-17T07:20:09.384 INFO:tasks.workunit.client.1.smithi139.stdout:4/965: mkdir d0/d1/d29/d131 0 2024-09-17T07:20:09.385 INFO:tasks.workunit.client.1.smithi139.stdout:7/766: creat d5/d10/d4d/d59/ffe x:0 0 0 2024-09-17T07:20:09.388 INFO:tasks.workunit.client.1.smithi139.stdout:7/767: creat d5/d10/d2b/d78/d9e/db1/db8/fff x:0 0 0 2024-09-17T07:20:09.388 INFO:tasks.workunit.client.1.smithi139.stdout:7/768: chown d5/d10/d4d/d59/l8d 0 1 2024-09-17T07:20:09.390 INFO:tasks.workunit.client.1.smithi139.stdout:7/769: mkdir d5/d10/d4d/d59/dd1/d100 0 2024-09-17T07:20:09.396 INFO:tasks.workunit.client.1.smithi139.stdout:7/770: dwrite d5/d10/d2b/d40/d47/dc7/ff7 [0,4194304] 0 2024-09-17T07:20:09.398 INFO:tasks.workunit.client.1.smithi139.stdout:7/771: write d5/d10/d2b/d40/d47/dc7/ff7 [1251433,72957] 0 2024-09-17T07:20:09.403 INFO:tasks.workunit.client.1.smithi139.stdout:7/772: creat d5/d10/d2b/d78/d9e/db1/db8/f101 x:0 0 0 2024-09-17T07:20:09.405 INFO:tasks.workunit.client.1.smithi139.stdout:1/753: dwrite d2/d10/d12/d13/f16 [0,4194304] 0 2024-09-17T07:20:09.411 INFO:tasks.workunit.client.1.smithi139.stdout:7/773: dread d5/d10/fc6 [0,4194304] 0 2024-09-17T07:20:09.412 INFO:tasks.workunit.client.1.smithi139.stdout:4/966: dread d0/de9/d83/f48 [0,4194304] 0 2024-09-17T07:20:09.415 INFO:tasks.workunit.client.1.smithi139.stdout:4/967: read d0/de9/ffc [4153168,18379] 0 2024-09-17T07:20:09.418 INFO:tasks.workunit.client.1.smithi139.stdout:4/968: getdents d0/d49/d121 0 2024-09-17T07:20:09.419 INFO:tasks.workunit.client.1.smithi139.stdout:1/754: write d2/d10/d12/d1a/dd7/d49/f7b [999815,91519] 0 2024-09-17T07:20:09.424 INFO:tasks.workunit.client.1.smithi139.stdout:1/755: link d2/d10/d12/f88 d2/d10/d12/d24/d38/fed 0 2024-09-17T07:20:09.424 INFO:tasks.workunit.client.1.smithi139.stdout:7/774: dwrite d5/d10/d2b/d40/f81 [0,4194304] 0 2024-09-17T07:20:09.426 INFO:tasks.workunit.client.1.smithi139.stdout:1/756: write d2/d10/d12/fa0 [4161043,10332] 0 2024-09-17T07:20:09.429 INFO:tasks.workunit.client.1.smithi139.stdout:1/757: mkdir d2/d10/d12/d1a/dd7/d49/d8d/dee 0 2024-09-17T07:20:09.430 INFO:tasks.workunit.client.1.smithi139.stdout:1/758: chown d2/d10/d12/d13/d4f/d5c/d74/ld8 1 1 2024-09-17T07:20:09.432 INFO:tasks.workunit.client.1.smithi139.stdout:4/969: dwrite d0/de9/d83/f48 [4194304,4194304] 0 2024-09-17T07:20:09.437 INFO:tasks.workunit.client.1.smithi139.stdout:4/970: creat d0/d1/d29/d131/f132 x:0 0 0 2024-09-17T07:20:09.441 INFO:tasks.workunit.client.1.smithi139.stdout:1/759: truncate d2/f58 975447 0 2024-09-17T07:20:09.444 INFO:tasks.workunit.client.1.smithi139.stdout:4/971: rmdir d0/d1/d29/d131 39 2024-09-17T07:20:09.445 INFO:tasks.workunit.client.1.smithi139.stdout:1/760: symlink d2/d10/d12/d1a/dd7/d2b/d4a/d6f/lef 0 2024-09-17T07:20:09.447 INFO:tasks.workunit.client.1.smithi139.stdout:1/761: truncate d2/d10/d12/fa0 4413068 0 2024-09-17T07:20:09.448 INFO:tasks.workunit.client.1.smithi139.stdout:4/972: rmdir d0/d1/d54/d93/da1/d11d 0 2024-09-17T07:20:09.450 INFO:tasks.workunit.client.1.smithi139.stdout:1/762: creat d2/d10/dce/ff0 x:0 0 0 2024-09-17T07:20:09.453 INFO:tasks.workunit.client.1.smithi139.stdout:4/973: dread d0/db/d58/f73 [0,4194304] 0 2024-09-17T07:20:09.454 INFO:tasks.workunit.client.1.smithi139.stdout:4/974: fdatasync d0/d1/d54/d93/fcd 0 2024-09-17T07:20:09.455 INFO:tasks.workunit.client.1.smithi139.stdout:1/763: rename d2/d10/l2f to d2/d10/d12/d13/d4f/d5c/d92/lf1 0 2024-09-17T07:20:09.456 INFO:tasks.workunit.client.1.smithi139.stdout:7/775: dread d5/f18 [0,4194304] 0 2024-09-17T07:20:09.460 INFO:tasks.workunit.client.1.smithi139.stdout:1/764: truncate d2/d10/d12/d13/f82 4275969 0 2024-09-17T07:20:09.465 INFO:tasks.workunit.client.1.smithi139.stdout:4/975: dwrite d0/d37/f9c [0,4194304] 0 2024-09-17T07:20:09.465 INFO:tasks.workunit.client.1.smithi139.stdout:1/765: mkdir d2/d10/d12/d24/db2/df2 0 2024-09-17T07:20:09.465 INFO:tasks.workunit.client.1.smithi139.stdout:7/776: dwrite d5/d96/fa3 [0,4194304] 0 2024-09-17T07:20:09.468 INFO:tasks.workunit.client.1.smithi139.stdout:7/777: dread - d5/d10/d4d/d59/fde zero size 2024-09-17T07:20:09.469 INFO:tasks.workunit.client.1.smithi139.stdout:7/778: readlink d5/d17/d4e/d90/laa 0 2024-09-17T07:20:09.470 INFO:tasks.workunit.client.1.smithi139.stdout:4/976: creat d0/d1/d29/d41/dad/f133 x:0 0 0 2024-09-17T07:20:09.471 INFO:tasks.workunit.client.1.smithi139.stdout:7/779: mkdir d5/d10/d4d/d102 0 2024-09-17T07:20:09.474 INFO:tasks.workunit.client.1.smithi139.stdout:7/780: mkdir d5/d10/d2b/d40/d47/dc7/d103 0 2024-09-17T07:20:09.481 INFO:tasks.workunit.client.1.smithi139.stdout:7/781: dwrite d5/d17/f49 [0,4194304] 0 2024-09-17T07:20:09.492 INFO:tasks.workunit.client.1.smithi139.stdout:7/782: write d5/f58 [624206,85131] 0 2024-09-17T07:20:09.496 INFO:tasks.workunit.client.1.smithi139.stdout:7/783: unlink d5/d10/d2b/d78/d9e/db1/db7/fe0 0 2024-09-17T07:20:09.496 INFO:tasks.workunit.client.1.smithi139.stdout:7/784: chown d5/d10/d2b/d40/fd3 11672301 1 2024-09-17T07:20:09.499 INFO:tasks.workunit.client.1.smithi139.stdout:4/977: dread d0/d1/dbe/f3e [0,4194304] 0 2024-09-17T07:20:09.500 INFO:tasks.workunit.client.1.smithi139.stdout:7/785: truncate d5/d10/d2b/d40/f61 2093873 0 2024-09-17T07:20:09.501 INFO:tasks.workunit.client.1.smithi139.stdout:4/978: mkdir d0/d1/dbe/ddd/d134 0 2024-09-17T07:20:09.501 INFO:tasks.workunit.client.1.smithi139.stdout:7/786: fsync d5/d10/d2b/f62 0 2024-09-17T07:20:09.503 INFO:tasks.workunit.client.1.smithi139.stdout:4/979: mkdir d0/d1/d135 0 2024-09-17T07:20:09.505 INFO:tasks.workunit.client.1.smithi139.stdout:4/980: fdatasync d0/db/f1c 0 2024-09-17T07:20:09.510 INFO:tasks.workunit.client.1.smithi139.stdout:7/787: truncate d5/d10/d2b/d40/f81 786410 0 2024-09-17T07:20:09.510 INFO:tasks.workunit.client.1.smithi139.stdout:4/981: write d0/f1d [3014621,83384] 0 2024-09-17T07:20:09.512 INFO:tasks.workunit.client.1.smithi139.stdout:4/982: write d0/d1/d29/d6a/fd0 [893779,18197] 0 2024-09-17T07:20:09.513 INFO:tasks.workunit.client.1.smithi139.stdout:4/983: mkdir d0/db/db2/d136 0 2024-09-17T07:20:09.514 INFO:tasks.workunit.client.1.smithi139.stdout:4/984: readlink d0/de9/d92/d115/l12e 0 2024-09-17T07:20:09.517 INFO:tasks.workunit.client.1.smithi139.stdout:7/788: dread d5/d10/d2b/f3f [0,4194304] 0 2024-09-17T07:20:09.518 INFO:tasks.workunit.client.1.smithi139.stdout:7/789: chown d5/l8 2 1 2024-09-17T07:20:09.520 INFO:tasks.workunit.client.1.smithi139.stdout:7/790: write d5/d10/d4d/d59/f5f [581894,862] 0 2024-09-17T07:20:09.521 INFO:tasks.workunit.client.1.smithi139.stdout:7/791: fsync d5/d10/d2b/d40/fd3 0 2024-09-17T07:20:09.522 INFO:tasks.workunit.client.1.smithi139.stdout:4/985: dwrite d0/db/d7f/f90 [0,4194304] 0 2024-09-17T07:20:09.525 INFO:tasks.workunit.client.1.smithi139.stdout:7/792: symlink d5/d67/l104 0 2024-09-17T07:20:09.526 INFO:tasks.workunit.client.1.smithi139.stdout:4/986: truncate d0/d1/d29/d41/f43 1422091 0 2024-09-17T07:20:09.531 INFO:tasks.workunit.client.1.smithi139.stdout:4/987: rmdir d0/d1 39 2024-09-17T07:20:09.540 INFO:tasks.workunit.client.1.smithi139.stdout:7/793: dread d5/d10/d2b/d71/fbc [0,4194304] 0 2024-09-17T07:20:09.552 INFO:tasks.workunit.client.1.smithi139.stdout:4/988: mknod d0/de9/d92/c137 0 2024-09-17T07:20:09.552 INFO:tasks.workunit.client.1.smithi139.stdout:7/794: dread d5/d17/fb0 [0,4194304] 0 2024-09-17T07:20:09.554 INFO:tasks.workunit.client.1.smithi139.stdout:4/989: write d0/d1/d29/d41/f63 [2619269,47333] 0 2024-09-17T07:20:09.554 INFO:tasks.workunit.client.1.smithi139.stdout:4/990: truncate d0/f113 22736 0 2024-09-17T07:20:09.555 INFO:tasks.workunit.client.1.smithi139.stdout:4/991: dread - d0/d1/d29/d41/d125/f128 zero size 2024-09-17T07:20:09.558 INFO:tasks.workunit.client.1.smithi139.stdout:6/926: sync 2024-09-17T07:20:09.560 INFO:tasks.workunit.client.1.smithi139.stdout:4/992: dread d0/de9/d83/f96 [0,4194304] 0 2024-09-17T07:20:09.564 INFO:tasks.workunit.client.1.smithi139.stdout:4/993: read d0/d1/d29/f66 [2521455,34687] 0 2024-09-17T07:20:09.565 INFO:tasks.workunit.client.1.smithi139.stdout:4/994: read d0/de9/d10e/f110 [3824030,86678] 0 2024-09-17T07:20:09.566 INFO:tasks.workunit.client.1.smithi139.stdout:4/995: chown d0/d1/d29/d41 923164 1 2024-09-17T07:20:09.578 INFO:tasks.workunit.client.1.smithi139.stdout:4/996: rmdir d0 39 2024-09-17T07:20:09.580 INFO:tasks.workunit.client.1.smithi139.stdout:7/795: truncate d5/d10/f42 2145425 0 2024-09-17T07:20:09.580 INFO:tasks.workunit.client.1.smithi139.stdout:7/796: readlink d5/d10/d4d/la0 0 2024-09-17T07:20:09.581 INFO:tasks.workunit.client.1.smithi139.stdout:4/997: creat d0/db/d17/daf/dd3/f138 x:0 0 0 2024-09-17T07:20:09.583 INFO:tasks.workunit.client.1.smithi139.stdout:4/998: fsync d0/db/d58/f7e 0 2024-09-17T07:20:09.586 INFO:tasks.workunit.client.1.smithi139.stdout:4/999: rename d0/d1/l99 to d0/db/d17/daf/l139 0 2024-09-17T07:20:09.586 INFO:tasks.workunit.client.1.smithi139.stdout:7/797: dwrite d5/f58 [0,4194304] 0 2024-09-17T07:20:09.595 INFO:tasks.workunit.client.1.smithi139.stdout:7/798: dwrite d5/d10/d2b/d71/fbc [0,4194304] 0 2024-09-17T07:20:09.596 INFO:tasks.workunit.client.1.smithi139.stdout:7/799: chown d5/d17/d4e/d66/dc8 37 1 2024-09-17T07:20:09.607 INFO:tasks.workunit.client.1.smithi139.stdout:7/800: write d5/d96/ffb [2502973,50497] 0 2024-09-17T07:20:09.610 INFO:tasks.workunit.client.1.smithi139.stdout:7/801: creat d5/d17/d4e/d90/f105 x:0 0 0 2024-09-17T07:20:09.613 INFO:tasks.workunit.client.1.smithi139.stdout:7/802: rename d5/d10/d2b/d78/dec/cf8 to d5/d10/d2b/d78/d9e/db1/c106 0 2024-09-17T07:20:09.614 INFO:tasks.workunit.client.1.smithi139.stdout:7/803: mknod d5/d17/d4e/d66/c107 0 2024-09-17T07:20:09.615 INFO:tasks.workunit.client.1.smithi139.stdout:7/804: write d5/d10/f2e [763197,43953] 0 2024-09-17T07:20:09.616 INFO:tasks.workunit.client.1.smithi139.stdout:7/805: write d5/d17/f31 [1137794,69255] 0 2024-09-17T07:20:09.618 INFO:tasks.workunit.client.1.smithi139.stdout:7/806: symlink d5/d10/d2b/d40/l108 0 2024-09-17T07:20:09.619 INFO:tasks.workunit.client.1.smithi139.stdout:7/807: truncate d5/d17/f31 2979415 0 2024-09-17T07:20:09.620 INFO:tasks.workunit.client.1.smithi139.stdout:7/808: write d5/d10/d2b/d78/d9e/fba [114050,102719] 0 2024-09-17T07:20:09.654 INFO:tasks.workunit.client.1.smithi139.stdout:7/809: dwrite d5/d10/f2e [0,4194304] 0 2024-09-17T07:20:09.655 INFO:tasks.workunit.client.1.smithi139.stdout:7/810: stat d5/d17/d4e/c74 0 2024-09-17T07:20:09.657 INFO:tasks.workunit.client.1.smithi139.stdout:7/811: symlink d5/d10/d4d/d59/l109 0 2024-09-17T07:20:09.666 INFO:tasks.workunit.client.1.smithi139.stdout:0/641: sync 2024-09-17T07:20:09.668 INFO:tasks.workunit.client.1.smithi139.stdout:7/812: dwrite d5/d10/d2b/f3f [0,4194304] 0 2024-09-17T07:20:09.670 INFO:tasks.workunit.client.1.smithi139.stdout:0/642: write d1/da/d17/d72/f5b [2693772,83601] 0 2024-09-17T07:20:09.675 INFO:tasks.workunit.client.1.smithi139.stdout:0/643: symlink d1/da/d1b/d3d/d5a/d75/d91/d92/le7 0 2024-09-17T07:20:09.675 INFO:tasks.workunit.client.1.smithi139.stdout:7/813: mkdir d5/d10/d4d/d59/dfc/d10a 0 2024-09-17T07:20:09.677 INFO:tasks.workunit.client.1.smithi139.stdout:7/814: symlink d5/d10/d4d/d59/dd1/l10b 0 2024-09-17T07:20:09.681 INFO:tasks.workunit.client.1.smithi139.stdout:7/815: dread d5/d10/f2e [0,4194304] 0 2024-09-17T07:20:09.681 INFO:tasks.workunit.client.1.smithi139.stdout:7/816: read d5/d10/f2e [3328239,123821] 0 2024-09-17T07:20:09.682 INFO:tasks.workunit.client.1.smithi139.stdout:7/817: fdatasync d5/d10/d4d/f60 0 2024-09-17T07:20:09.796 INFO:tasks.workunit.client.1.smithi139.stdout:0/644: getdents d1/da/d1b/dba/dc5 0 2024-09-17T07:20:09.797 INFO:tasks.workunit.client.1.smithi139.stdout:7/818: unlink d5/d10/d2b/d78/d9e/db1/cb3 0 2024-09-17T07:20:09.798 INFO:tasks.workunit.client.1.smithi139.stdout:0/645: symlink d1/da/d1b/d3d/d5a/d98/le8 0 2024-09-17T07:20:09.798 INFO:tasks.workunit.client.1.smithi139.stdout:7/819: fsync d5/d10/d4d/d59/fa6 0 2024-09-17T07:20:09.799 INFO:tasks.workunit.client.1.smithi139.stdout:7/820: readlink d5/d10/d2b/d40/l41 0 2024-09-17T07:20:09.800 INFO:tasks.workunit.client.1.smithi139.stdout:0/646: mkdir d1/da/d1b/dba/de9 0 2024-09-17T07:20:09.801 INFO:tasks.workunit.client.1.smithi139.stdout:7/821: truncate d5/d67/fa2 1480827 0 2024-09-17T07:20:09.802 INFO:tasks.workunit.client.1.smithi139.stdout:0/647: fsync d1/da/d2a/f2e 0 2024-09-17T07:20:09.807 INFO:tasks.workunit.client.1.smithi139.stdout:7/822: link d5/d17/d4e/d63/cac d5/d96/c10c 0 2024-09-17T07:20:09.808 INFO:tasks.workunit.client.1.smithi139.stdout:7/823: chown d5/d10/fdd 25 1 2024-09-17T07:20:09.808 INFO:tasks.workunit.client.1.smithi139.stdout:0/648: dwrite d1/da/d2a/f38 [0,4194304] 0 2024-09-17T07:20:09.813 INFO:tasks.workunit.client.1.smithi139.stdout:7/824: dread d5/d10/fdd [0,4194304] 0 2024-09-17T07:20:09.813 INFO:tasks.workunit.client.1.smithi139.stdout:7/825: readlink d5/l13 0 2024-09-17T07:20:09.816 INFO:tasks.workunit.client.1.smithi139.stdout:7/826: creat d5/d10/d4d/d59/dd1/d100/f10d x:0 0 0 2024-09-17T07:20:09.817 INFO:tasks.workunit.client.1.smithi139.stdout:7/827: write d5/d10/d2b/d78/d9e/fba [328873,79342] 0 2024-09-17T07:20:09.820 INFO:tasks.workunit.client.1.smithi139.stdout:7/828: unlink d5/d10/d4d/f88 0 2024-09-17T07:20:09.826 INFO:tasks.workunit.client.1.smithi139.stdout:7/829: dwrite d5/d10/d8c/ded/f6f [0,4194304] 0 2024-09-17T07:20:09.826 INFO:tasks.workunit.client.1.smithi139.stdout:7/830: fdatasync d5/d17/f49 0 2024-09-17T07:20:09.830 INFO:tasks.workunit.client.1.smithi139.stdout:7/831: creat d5/d10/d2b/d40/d47/dc7/d103/f10e x:0 0 0 2024-09-17T07:20:09.833 INFO:tasks.workunit.client.1.smithi139.stdout:7/832: creat d5/d67/f10f x:0 0 0 2024-09-17T07:20:09.836 INFO:tasks.workunit.client.1.smithi139.stdout:7/833: write d5/d17/d4e/d63/fc0 [2313994,115906] 0 2024-09-17T07:20:09.845 INFO:tasks.workunit.client.1.smithi139.stdout:7/834: dwrite d5/fad [0,4194304] 0 2024-09-17T07:20:09.849 INFO:tasks.workunit.client.1.smithi139.stdout:7/835: rename d5/d17/d4e/l5c to d5/d67/l110 0 2024-09-17T07:20:09.860 INFO:tasks.workunit.client.1.smithi139.stdout:7/836: dwrite d5/f1e [0,4194304] 0 2024-09-17T07:20:09.871 INFO:tasks.workunit.client.1.smithi139.stdout:7/837: dwrite d5/d17/fb0 [0,4194304] 0 2024-09-17T07:20:09.873 INFO:tasks.workunit.client.1.smithi139.stdout:7/838: mknod d5/d17/dea/c111 0 2024-09-17T07:20:09.876 INFO:tasks.workunit.client.1.smithi139.stdout:7/839: creat d5/d10/d4d/d102/f112 x:0 0 0 2024-09-17T07:20:09.884 INFO:tasks.workunit.client.1.smithi139.stdout:7/840: dwrite d5/d17/d4e/fc1 [0,4194304] 0 2024-09-17T07:20:09.888 INFO:tasks.workunit.client.1.smithi139.stdout:7/841: rename d5/d10/d2b/d40/l9d to d5/d10/d2b/d40/d47/dc7/l113 0 2024-09-17T07:20:09.890 INFO:tasks.workunit.client.1.smithi139.stdout:7/842: write d5/d17/f2a [5284912,118647] 0 2024-09-17T07:20:09.892 INFO:tasks.workunit.client.1.smithi139.stdout:7/843: mkdir d5/d10/d4d/de4/d114 0 2024-09-17T07:20:09.893 INFO:tasks.workunit.client.1.smithi139.stdout:7/844: write d5/d17/f49 [4621485,760] 0 2024-09-17T07:20:09.902 INFO:tasks.workunit.client.1.smithi139.stdout:7/845: truncate d5/d17/f2a 6916316 0 2024-09-17T07:20:09.904 INFO:tasks.workunit.client.1.smithi139.stdout:7/846: rmdir d5/d17/d4e/d66/dd5 39 2024-09-17T07:20:09.906 INFO:tasks.workunit.client.1.smithi139.stdout:7/847: symlink d5/d10/d2b/d40/l115 0 2024-09-17T07:20:09.908 INFO:tasks.workunit.client.1.smithi139.stdout:7/848: truncate f2 6630138 0 2024-09-17T07:20:09.910 INFO:tasks.workunit.client.1.smithi139.stdout:7/849: mkdir d5/d17/d4e/d7a/d116 0 2024-09-17T07:20:09.916 INFO:tasks.workunit.client.1.smithi139.stdout:7/850: truncate d5/f23 8079094 0 2024-09-17T07:20:09.918 INFO:tasks.workunit.client.1.smithi139.stdout:7/851: truncate d5/d10/d2b/d40/f4a 3475829 0 2024-09-17T07:20:09.931 INFO:tasks.workunit.client.1.smithi139.stdout:7/852: dread d5/d67/f82 [0,4194304] 0 2024-09-17T07:20:09.936 INFO:tasks.workunit.client.1.smithi139.stdout:7/853: write d5/d10/d4d/fc9 [8145908,98870] 0 2024-09-17T07:20:09.938 INFO:tasks.workunit.client.1.smithi139.stdout:7/854: mknod d5/d10/d4d/d102/c117 0 2024-09-17T07:20:09.941 INFO:tasks.workunit.client.1.smithi139.stdout:7/855: creat d5/d10/d2b/f118 x:0 0 0 2024-09-17T07:20:09.942 INFO:tasks.workunit.client.1.smithi139.stdout:7/856: chown d5/d17/d4e/d90/laa 126395 1 2024-09-17T07:20:09.943 INFO:tasks.workunit.client.1.smithi139.stdout:7/857: write d5/d10/d2b/fcb [685507,119767] 0 2024-09-17T07:20:09.944 INFO:tasks.workunit.client.1.smithi139.stdout:7/858: chown d5/d17/d4e/c56 1674743 1 2024-09-17T07:20:09.949 INFO:tasks.workunit.client.1.smithi139.stdout:7/859: write d5/d17/d4e/faf [553819,80642] 0 2024-09-17T07:20:09.951 INFO:tasks.workunit.client.1.smithi139.stdout:7/860: creat d5/d10/d4d/d59/dd1/f119 x:0 0 0 2024-09-17T07:20:09.951 INFO:tasks.workunit.client.1.smithi139.stdout:7/861: chown d5/d10/d2b/d78/la9 36611786 1 2024-09-17T07:20:09.953 INFO:tasks.workunit.client.1.smithi139.stdout:7/862: unlink d5/d10/d2b/d78/la9 0 2024-09-17T07:20:09.954 INFO:tasks.workunit.client.1.smithi139.stdout:7/863: write d5/d10/d2b/d40/d47/f8e [3211841,69581] 0 2024-09-17T07:20:09.954 INFO:tasks.workunit.client.1.smithi139.stdout:7/864: stat d5/d10/d4d/d59/dd1 0 2024-09-17T07:20:09.955 INFO:tasks.workunit.client.1.smithi139.stdout:7/865: readlink d5/l13 0 2024-09-17T07:20:09.956 INFO:tasks.workunit.client.1.smithi139.stdout:7/866: write d5/d10/fdd [560828,79168] 0 2024-09-17T07:20:09.958 INFO:tasks.workunit.client.1.smithi139.stdout:7/867: write d5/d10/fc6 [4387806,29728] 0 2024-09-17T07:20:09.962 INFO:tasks.workunit.client.1.smithi139.stdout:7/868: dread d5/d10/d4d/d59/f5f [0,4194304] 0 2024-09-17T07:20:09.964 INFO:tasks.workunit.client.1.smithi139.stdout:7/869: creat d5/d10/f11a x:0 0 0 2024-09-17T07:20:09.966 INFO:tasks.workunit.client.1.smithi139.stdout:7/870: creat d5/d17/d4e/d66/f11b x:0 0 0 2024-09-17T07:20:09.967 INFO:tasks.workunit.client.1.smithi139.stdout:7/871: dread - d5/d17/d4e/fd8 zero size 2024-09-17T07:20:09.968 INFO:tasks.workunit.client.1.smithi139.stdout:7/872: chown d5/d10/d8c/c95 135669 1 2024-09-17T07:20:09.968 INFO:tasks.workunit.client.1.smithi139.stdout:7/873: read d5/d10/d4d/d59/f5f [1073860,8009] 0 2024-09-17T07:20:09.970 INFO:tasks.workunit.client.1.smithi139.stdout:7/874: creat d5/d10/d4d/d59/dd1/d100/f11c x:0 0 0 2024-09-17T07:20:09.970 INFO:tasks.workunit.client.1.smithi139.stdout:7/875: chown d5/d10/d4d/d59/ffe 126154 1 2024-09-17T07:20:09.971 INFO:tasks.workunit.client.1.smithi139.stdout:7/876: chown d5/d17/d4e/faf 30767400 1 2024-09-17T07:20:09.972 INFO:tasks.workunit.client.1.smithi139.stdout:7/877: write d5/d10/d4d/d59/dd1/d100/f11c [199471,78873] 0 2024-09-17T07:20:09.974 INFO:tasks.workunit.client.1.smithi139.stdout:7/878: dread d5/d67/fa2 [0,4194304] 0 2024-09-17T07:20:09.975 INFO:tasks.workunit.client.1.smithi139.stdout:7/879: truncate d5/d10/d4d/d102/f112 824499 0 2024-09-17T07:20:09.976 INFO:tasks.workunit.client.1.smithi139.stdout:7/880: mknod d5/d10/d4d/d59/dfc/d10a/c11d 0 2024-09-17T07:20:09.982 INFO:tasks.workunit.client.1.smithi139.stdout:7/881: dwrite d5/d17/d4e/ff0 [0,4194304] 0 2024-09-17T07:20:09.985 INFO:tasks.workunit.client.1.smithi139.stdout:7/882: symlink d5/d10/d2b/d40/l11e 0 2024-09-17T07:20:09.988 INFO:tasks.workunit.client.1.smithi139.stdout:7/883: truncate d5/d17/d4e/f9f 1577954 0 2024-09-17T07:20:09.989 INFO:tasks.workunit.client.1.smithi139.stdout:7/884: write d5/d10/d4d/d59/ffe [174377,71813] 0 2024-09-17T07:20:09.992 INFO:tasks.workunit.client.1.smithi139.stdout:7/885: rmdir d5/d10/d2b/d78/d9e/db1/db7 39 2024-09-17T07:20:09.995 INFO:tasks.workunit.client.1.smithi139.stdout:3/946: sync 2024-09-17T07:20:09.995 INFO:tasks.workunit.client.1.smithi139.stdout:7/886: creat d5/d10/d2b/d78/d9e/f11f x:0 0 0 2024-09-17T07:20:09.996 INFO:tasks.workunit.client.1.smithi139.stdout:3/947: write d5/d21/d23/d69/f76 [2494684,110450] 0 2024-09-17T07:20:09.997 INFO:tasks.workunit.client.1.smithi139.stdout:3/948: read - d5/d63/db3/f10e zero size 2024-09-17T07:20:09.998 INFO:tasks.workunit.client.1.smithi139.stdout:7/887: dread d5/d10/d4d/d59/dd1/d100/f11c [0,4194304] 0 2024-09-17T07:20:10.005 INFO:tasks.workunit.client.1.smithi139.stdout:3/949: dwrite d5/d21/d23/d69/dd5/fc3 [0,4194304] 0 2024-09-17T07:20:10.007 INFO:tasks.workunit.client.1.smithi139.stdout:7/888: dwrite d5/d10/d4d/d102/f112 [0,4194304] 0 2024-09-17T07:20:10.008 INFO:tasks.workunit.client.1.smithi139.stdout:7/889: chown d5/d17/dea 3153641 1 2024-09-17T07:20:10.010 INFO:tasks.workunit.client.1.smithi139.stdout:3/950: creat d5/d15/d56/f128 x:0 0 0 2024-09-17T07:20:10.014 INFO:tasks.workunit.client.1.smithi139.stdout:3/951: rename d5/d63/d6d/d6f to d5/d21/d23/d69/d129 0 2024-09-17T07:20:10.016 INFO:tasks.workunit.client.1.smithi139.stdout:3/952: fdatasync d5/d21/d23/f9c 0 2024-09-17T07:20:10.019 INFO:tasks.workunit.client.1.smithi139.stdout:3/953: symlink d5/da7/dca/dfd/l12a 0 2024-09-17T07:20:10.022 INFO:tasks.workunit.client.1.smithi139.stdout:3/954: truncate d5/da7/dca/dab/dd6/d28/d54/d8e/fbe 4825170 0 2024-09-17T07:20:10.033 INFO:tasks.workunit.client.1.smithi139.stdout:3/955: dwrite d5/f77 [0,4194304] 0 2024-09-17T07:20:10.036 INFO:tasks.workunit.client.1.smithi139.stdout:3/956: mkdir d5/d21/d23/d69/d129/d8b/def/d116/d12b 0 2024-09-17T07:20:10.039 INFO:tasks.workunit.client.1.smithi139.stdout:3/957: dread d5/da7/dca/dd7/ff3 [0,4194304] 0 2024-09-17T07:20:10.040 INFO:tasks.workunit.client.1.smithi139.stdout:3/958: write d5/da7/dca/dab/dd6/ff9 [4523914,39589] 0 2024-09-17T07:20:10.042 INFO:tasks.workunit.client.1.smithi139.stdout:3/959: symlink d5/d21/d23/d38/deb/l12c 0 2024-09-17T07:20:10.043 INFO:tasks.workunit.client.1.smithi139.stdout:3/960: fdatasync d5/d21/dba/fea 0 2024-09-17T07:20:10.045 INFO:tasks.workunit.client.1.smithi139.stdout:3/961: creat d5/d21/d23/d38/deb/f12d x:0 0 0 2024-09-17T07:20:10.048 INFO:tasks.workunit.client.1.smithi139.stdout:3/962: creat d5/d21/d23/d69/d129/d8b/def/d116/f12e x:0 0 0 2024-09-17T07:20:10.055 INFO:tasks.workunit.client.1.smithi139.stdout:3/963: dwrite d5/da7/dca/dab/dd6/d28/f50 [0,4194304] 0 2024-09-17T07:20:10.059 INFO:tasks.workunit.client.1.smithi139.stdout:3/964: creat d5/d21/d23/d38/dbd/f12f x:0 0 0 2024-09-17T07:20:10.060 INFO:tasks.workunit.client.1.smithi139.stdout:3/965: write d5/d21/d23/d69/d129/d8b/def/d116/f121 [554156,26254] 0 2024-09-17T07:20:10.185 INFO:tasks.workunit.client.1.smithi139.stdout:1/766: sync 2024-09-17T07:20:10.185 INFO:tasks.workunit.client.1.smithi139.stdout:5/951: sync 2024-09-17T07:20:10.186 INFO:tasks.workunit.client.1.smithi139.stdout:5/952: write d4/da5/fef [748083,88971] 0 2024-09-17T07:20:10.186 INFO:tasks.workunit.client.1.smithi139.stdout:1/767: rename d2/d10/d12/d13/d4f/d5c/d74 to d2/d10/d12/d13/d4f/d5c/d74/df3 22 2024-09-17T07:20:10.186 INFO:tasks.workunit.client.1.smithi139.stdout:5/953: readlink d4/d5d/d97/l11b 0 2024-09-17T07:20:10.187 INFO:tasks.workunit.client.1.smithi139.stdout:1/768: fdatasync d2/d10/d12/d1a/dd7/d2b/f9f 0 2024-09-17T07:20:10.190 INFO:tasks.workunit.client.1.smithi139.stdout:5/954: truncate d4/d16/d1b/d20/fb6 1227204 0 2024-09-17T07:20:10.191 INFO:tasks.workunit.client.1.smithi139.stdout:1/769: link d2/d10/d12/d1a/dd7/d49/f80 d2/d10/d12/d1a/dd7/d49/d8d/ff4 0 2024-09-17T07:20:10.192 INFO:tasks.workunit.client.1.smithi139.stdout:5/955: rmdir d4/d16/d1b/d20/d28 39 2024-09-17T07:20:10.194 INFO:tasks.workunit.client.1.smithi139.stdout:5/956: creat d4/d16/d69/dd8/dd9/f138 x:0 0 0 2024-09-17T07:20:10.198 INFO:tasks.workunit.client.1.smithi139.stdout:1/770: dwrite d2/d10/d12/d1a/dd7/d49/d8d/fd6 [0,4194304] 0 2024-09-17T07:20:10.198 INFO:tasks.workunit.client.1.smithi139.stdout:5/957: write d4/d16/d1b/d20/d28/f4d [4775848,94148] 0 2024-09-17T07:20:10.200 INFO:tasks.workunit.client.1.smithi139.stdout:1/771: read d2/f11 [430999,20400] 0 2024-09-17T07:20:10.202 INFO:tasks.workunit.client.1.smithi139.stdout:5/958: readlink d4/d16/d1b/d20/d67/d88/d132/l135 0 2024-09-17T07:20:10.205 INFO:tasks.workunit.client.1.smithi139.stdout:5/959: rmdir d4/d16/d1b/d20/d28/d3f 39 2024-09-17T07:20:10.208 INFO:tasks.workunit.client.1.smithi139.stdout:1/772: rmdir d2/d10/d12/d1a/db1/dc7/dc2/dea 0 2024-09-17T07:20:10.212 INFO:tasks.workunit.client.1.smithi139.stdout:1/773: truncate d2/d10/d12/d1a/dd7/d2b/fe2 4419852 0 2024-09-17T07:20:10.214 INFO:tasks.workunit.client.1.smithi139.stdout:1/774: unlink d2/d10/d12/d1a/dd7/c6c 0 2024-09-17T07:20:10.218 INFO:tasks.workunit.client.1.smithi139.stdout:1/775: dread d2/d10/d12/d13/d4f/d5c/d74/fbe [0,4194304] 0 2024-09-17T07:20:10.218 INFO:tasks.workunit.client.1.smithi139.stdout:1/776: chown d2/d10/d12/f31 440212 1 2024-09-17T07:20:10.228 INFO:tasks.workunit.client.1.smithi139.stdout:1/777: dwrite d2/f6 [0,4194304] 0 2024-09-17T07:20:10.229 INFO:tasks.workunit.client.1.smithi139.stdout:5/960: dread d4/d16/d1b/f55 [0,4194304] 0 2024-09-17T07:20:10.231 INFO:tasks.workunit.client.1.smithi139.stdout:1/778: symlink d2/d10/d12/d13/dca/lf5 0 2024-09-17T07:20:10.233 INFO:tasks.workunit.client.1.smithi139.stdout:1/779: chown d2/d10/ca9 209183666 1 2024-09-17T07:20:10.233 INFO:tasks.workunit.client.1.smithi139.stdout:5/961: mknod d4/d16/d1b/d20/c139 0 2024-09-17T07:20:10.234 INFO:tasks.workunit.client.1.smithi139.stdout:5/962: dread - d4/d16/d1b/d20/d67/f12a zero size 2024-09-17T07:20:10.234 INFO:tasks.workunit.client.1.smithi139.stdout:1/780: write d2/d10/d12/d13/d4f/d5c/fb3 [1992870,24832] 0 2024-09-17T07:20:10.237 INFO:tasks.workunit.client.1.smithi139.stdout:1/781: creat d2/d10/db4/ff6 x:0 0 0 2024-09-17T07:20:10.240 INFO:tasks.workunit.client.1.smithi139.stdout:1/782: chown d2/d10/d12/d1a/dd7/d2b/d4a/c5e 19821563 1 2024-09-17T07:20:10.242 INFO:tasks.workunit.client.1.smithi139.stdout:1/783: fsync d2/d10/d12/fa7 0 2024-09-17T07:20:10.242 INFO:tasks.workunit.client.1.smithi139.stdout:5/963: dwrite d4/d16/d1b/d20/d28/f2a [4194304,4194304] 0 2024-09-17T07:20:10.247 INFO:tasks.workunit.client.1.smithi139.stdout:5/964: creat d4/d16/d1b/d20/f13a x:0 0 0 2024-09-17T07:20:10.250 INFO:tasks.workunit.client.1.smithi139.stdout:5/965: unlink d4/d16/d1b/d20/d38/fbb 0 2024-09-17T07:20:10.257 INFO:tasks.workunit.client.1.smithi139.stdout:5/966: fdatasync d4/d16/d1b/d20/d28/f2a 0 2024-09-17T07:20:10.258 INFO:tasks.workunit.client.1.smithi139.stdout:5/967: mknod d4/d16/d1b/d20/d67/d88/c13b 0 2024-09-17T07:20:10.259 INFO:tasks.workunit.client.1.smithi139.stdout:5/968: mknod d4/d16/d1b/c13c 0 2024-09-17T07:20:10.279 INFO:tasks.workunit.client.1.smithi139.stdout:5/969: rename d4/d16/d1b/d20/f13a to d4/d5d/dc0/f13d 0 2024-09-17T07:20:10.280 INFO:tasks.workunit.client.1.smithi139.stdout:5/970: dread - d4/d5d/d97/fc2 zero size 2024-09-17T07:20:10.281 INFO:tasks.workunit.client.1.smithi139.stdout:5/971: chown d4/d16/d1b/cf6 29700849 1 2024-09-17T07:20:10.289 INFO:tasks.workunit.client.1.smithi139.stdout:5/972: dwrite d4/d16/d1b/d20/d38/d4f/f57 [0,4194304] 0 2024-09-17T07:20:10.291 INFO:tasks.workunit.client.1.smithi139.stdout:5/973: chown d4/d16/d1b/d20/d67/d88/fad 24362 1 2024-09-17T07:20:10.294 INFO:tasks.workunit.client.1.smithi139.stdout:5/974: mkdir d4/d16/d1b/d20/d32/d72/d13e 0 2024-09-17T07:20:10.297 INFO:tasks.workunit.client.1.smithi139.stdout:5/975: unlink d4/d16/d69/dbc/cc5 0 2024-09-17T07:20:10.300 INFO:tasks.workunit.client.1.smithi139.stdout:5/976: creat d4/d16/d1b/d20/d32/d6c/dc9/f13f x:0 0 0 2024-09-17T07:20:10.300 INFO:tasks.workunit.client.1.smithi139.stdout:5/977: stat d4/d5d/d97/l12f 0 2024-09-17T07:20:10.305 INFO:tasks.workunit.client.1.smithi139.stdout:5/978: rename d4/d16/d69/dd8 to d4/d16/d1b/d20/d32/d76/d140 0 2024-09-17T07:20:10.306 INFO:tasks.workunit.client.1.smithi139.stdout:5/979: dread - d4/d16/d1b/d20/d32/d6c/f11f zero size 2024-09-17T07:20:10.310 INFO:tasks.workunit.client.1.smithi139.stdout:5/980: creat d4/d16/d1b/d20/d28/d3f/dcc/df1/d10c/f141 x:0 0 0 2024-09-17T07:20:10.312 INFO:tasks.workunit.client.1.smithi139.stdout:5/981: chown d4/d5d/dc0/cce 1522783 1 2024-09-17T07:20:10.312 INFO:tasks.workunit.client.1.smithi139.stdout:5/982: mknod d4/d16/d1b/d20/d67/d88/de0/c142 0 2024-09-17T07:20:10.317 INFO:tasks.workunit.client.1.smithi139.stdout:5/983: dwrite d4/d16/f1d [0,4194304] 0 2024-09-17T07:20:10.317 INFO:tasks.workunit.client.1.smithi139.stdout:5/984: chown d4/d16/d1b 821688790 1 2024-09-17T07:20:10.335 INFO:tasks.workunit.client.1.smithi139.stdout:5/985: dread d4/d16/d1b/d20/fd1 [0,4194304] 0 2024-09-17T07:20:10.337 INFO:tasks.workunit.client.1.smithi139.stdout:5/986: write d4/d16/d1b/d20/d67/d88/f99 [303854,37133] 0 2024-09-17T07:20:10.340 INFO:tasks.workunit.client.1.smithi139.stdout:6/927: sync 2024-09-17T07:20:10.340 INFO:tasks.workunit.client.1.smithi139.stdout:0/649: sync 2024-09-17T07:20:10.344 INFO:tasks.workunit.client.1.smithi139.stdout:5/987: dwrite d4/d16/d1b/d20/d67/f136 [0,4194304] 0 2024-09-17T07:20:10.346 INFO:tasks.workunit.client.1.smithi139.stdout:0/650: truncate d1/da/d1b/d32/fbc 2436 0 2024-09-17T07:20:10.347 INFO:tasks.workunit.client.1.smithi139.stdout:5/988: readlink d4/d16/d1b/d20/d32/d3d/l6b 0 2024-09-17T07:20:10.347 INFO:tasks.workunit.client.1.smithi139.stdout:6/928: getdents db/d18/d1b 0 2024-09-17T07:20:10.350 INFO:tasks.workunit.client.1.smithi139.stdout:5/989: mkdir d4/d16/d1b/d20/d67/d143 0 2024-09-17T07:20:10.350 INFO:tasks.workunit.client.1.smithi139.stdout:0/651: creat d1/da/fea x:0 0 0 2024-09-17T07:20:10.353 INFO:tasks.workunit.client.1.smithi139.stdout:0/652: fsync d1/da/d17/d72/d66/fcf 0 2024-09-17T07:20:10.353 INFO:tasks.workunit.client.1.smithi139.stdout:5/990: mkdir d4/d16/d1b/d20/d67/d144 0 2024-09-17T07:20:10.355 INFO:tasks.workunit.client.1.smithi139.stdout:6/929: dwrite db/d18/f4a [0,4194304] 0 2024-09-17T07:20:10.360 INFO:tasks.workunit.client.1.smithi139.stdout:5/991: unlink d4/d16/d1b/d20/cf3 0 2024-09-17T07:20:10.362 INFO:tasks.workunit.client.1.smithi139.stdout:6/930: getdents db/df/d4e/d5e/de5 0 2024-09-17T07:20:10.366 INFO:tasks.workunit.client.1.smithi139.stdout:5/992: rename d4/d16/d1b/d20/d32/c10f to d4/d16/d1b/d20/d28/dca/c145 0 2024-09-17T07:20:10.369 INFO:tasks.workunit.client.1.smithi139.stdout:5/993: mkdir d4/d16/d1b/d20/d28/d3f/d146 0 2024-09-17T07:20:10.370 INFO:tasks.workunit.client.1.smithi139.stdout:0/653: write d1/f3 [1992858,45868] 0 2024-09-17T07:20:10.372 INFO:tasks.workunit.client.1.smithi139.stdout:0/654: fdatasync d1/da/d1b/d3d/d50/f55 0 2024-09-17T07:20:10.373 INFO:tasks.workunit.client.1.smithi139.stdout:6/931: dwrite db/d18/d38/d60/dc2/f125 [0,4194304] 0 2024-09-17T07:20:10.373 INFO:tasks.workunit.client.1.smithi139.stdout:5/994: fsync d4/d16/d1b/d20/f7d 0 2024-09-17T07:20:10.375 INFO:tasks.workunit.client.1.smithi139.stdout:5/995: stat d4/d16/d1b/d20/d67/d88/d9f 0 2024-09-17T07:20:10.376 INFO:tasks.workunit.client.1.smithi139.stdout:6/932: write db/d18/d9f/dd2/fec [814979,106295] 0 2024-09-17T07:20:10.381 INFO:tasks.workunit.client.1.smithi139.stdout:5/996: fsync d4/d5d/d97/fa2 0 2024-09-17T07:20:10.383 INFO:tasks.workunit.client.1.smithi139.stdout:3/966: sync 2024-09-17T07:20:10.383 INFO:tasks.workunit.client.1.smithi139.stdout:7/890: sync 2024-09-17T07:20:10.383 INFO:tasks.workunit.client.1.smithi139.stdout:3/967: chown d5/d63/d6d 11 1 2024-09-17T07:20:10.384 INFO:tasks.workunit.client.1.smithi139.stdout:7/891: fsync d5/d17/f49 0 2024-09-17T07:20:10.384 INFO:tasks.workunit.client.1.smithi139.stdout:6/933: symlink db/db7/l144 0 2024-09-17T07:20:10.385 INFO:tasks.workunit.client.1.smithi139.stdout:3/968: chown d5/d63/db3/l10c 15 1 2024-09-17T07:20:10.385 INFO:tasks.workunit.client.1.smithi139.stdout:7/892: fdatasync d5/d17/d4e/faf 0 2024-09-17T07:20:10.387 INFO:tasks.workunit.client.1.smithi139.stdout:3/969: dread - d5/d21/d23/d38/deb/f12d zero size 2024-09-17T07:20:10.390 INFO:tasks.workunit.client.1.smithi139.stdout:6/934: symlink db/df/d4e/d64/d83/dd5/l145 0 2024-09-17T07:20:10.391 INFO:tasks.workunit.client.1.smithi139.stdout:6/935: chown db/d21/l4b 18897781 1 2024-09-17T07:20:10.393 INFO:tasks.workunit.client.1.smithi139.stdout:3/970: creat d5/d63/d6d/f130 x:0 0 0 2024-09-17T07:20:10.393 INFO:tasks.workunit.client.1.smithi139.stdout:0/655: link d1/da/d1b/d32/l4a d1/da/d1b/d3d/d5a/d75/d91/leb 0 2024-09-17T07:20:10.395 INFO:tasks.workunit.client.1.smithi139.stdout:5/997: creat d4/d16/f147 x:0 0 0 2024-09-17T07:20:10.396 INFO:tasks.workunit.client.1.smithi139.stdout:3/971: write d5/da7/dca/dab/dd6/d28/d54/f110 [363931,56536] 0 2024-09-17T07:20:10.396 INFO:tasks.workunit.client.1.smithi139.stdout:0/656: mknod d1/da/d17/db8/cec 0 2024-09-17T07:20:10.397 INFO:tasks.workunit.client.1.smithi139.stdout:5/998: read - d4/d16/d69/f120 zero size 2024-09-17T07:20:10.400 INFO:tasks.workunit.client.1.smithi139.stdout:7/893: creat d5/d17/d4e/d63/f120 x:0 0 0 2024-09-17T07:20:10.401 INFO:tasks.workunit.client.1.smithi139.stdout:6/936: rename db/df/d4e/d5e/d8a/f141 to db/df/d4e/d64/d83/dd5/d136/f146 0 2024-09-17T07:20:10.402 INFO:tasks.workunit.client.1.smithi139.stdout:7/894: dread - d5/d67/f10f zero size 2024-09-17T07:20:10.403 INFO:tasks.workunit.client.1.smithi139.stdout:3/972: creat d5/d21/d23/d69/d129/d8b/f131 x:0 0 0 2024-09-17T07:20:10.404 INFO:tasks.workunit.client.1.smithi139.stdout:5/999: unlink d4/d16/d1b/d20/d67/d88/c13b 0 2024-09-17T07:20:10.406 INFO:tasks.workunit.client.1.smithi139.stdout:0/657: dwrite d1/da/f78 [0,4194304] 0 2024-09-17T07:20:10.410 INFO:tasks.workunit.client.1.smithi139.stdout:0/658: rmdir d1/da/d2a/dae 39 2024-09-17T07:20:10.410 INFO:tasks.workunit.client.1.smithi139.stdout:3/973: creat d5/da7/dca/dab/d107/f132 x:0 0 0 2024-09-17T07:20:10.411 INFO:tasks.workunit.client.1.smithi139.stdout:0/659: chown d1/da/d2a 457426 1 2024-09-17T07:20:10.414 INFO:tasks.workunit.client.1.smithi139.stdout:0/660: dread d1/da/d1b/d32/fbc [0,4194304] 0 2024-09-17T07:20:10.415 INFO:tasks.workunit.client.1.smithi139.stdout:3/974: mknod d5/d21/d23/d38/c133 0 2024-09-17T07:20:10.423 INFO:tasks.workunit.client.1.smithi139.stdout:3/975: dwrite d5/d63/db3/f10e [0,4194304] 0 2024-09-17T07:20:10.423 INFO:tasks.workunit.client.1.smithi139.stdout:0/661: link d1/d58/c63 d1/da/d1b/dba/ced 0 2024-09-17T07:20:10.425 INFO:tasks.workunit.client.1.smithi139.stdout:6/937: write db/df/d73/d81/f67 [497561,42519] 0 2024-09-17T07:20:10.425 INFO:tasks.workunit.client.1.smithi139.stdout:7/895: write d5/d10/d4d/d59/f75 [1068185,30071] 0 2024-09-17T07:20:10.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:10 smithi087 ceph-mon[27636]: pgmap v18: 65 pgs: 65 active+clean; 3.6 GiB data, 12 GiB used, 525 GiB / 536 GiB avail; 105 MiB/s rd, 245 MiB/s wr, 531 op/s 2024-09-17T07:20:10.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:10 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:20:10.431 INFO:tasks.workunit.client.1.smithi139.stdout:6/938: chown db/df/d4e/d64/l93 80715063 1 2024-09-17T07:20:10.431 INFO:tasks.workunit.client.1.smithi139.stdout:3/976: symlink d5/d21/d23/d69/d129/d8b/def/l134 0 2024-09-17T07:20:10.432 INFO:tasks.workunit.client.1.smithi139.stdout:0/662: getdents d1/da/d1b/d32/d9a/dd6 0 2024-09-17T07:20:10.435 INFO:tasks.workunit.client.1.smithi139.stdout:7/896: dwrite d5/d17/d4e/d90/f105 [0,4194304] 0 2024-09-17T07:20:10.441 INFO:tasks.workunit.client.1.smithi139.stdout:7/897: readlink d5/d10/d2b/d78/d9e/db1/db8/lf6 0 2024-09-17T07:20:10.441 INFO:tasks.workunit.client.1.smithi139.stdout:7/898: readlink d5/d10/d4d/l64 0 2024-09-17T07:20:10.444 INFO:tasks.workunit.client.1.smithi139.stdout:0/663: dwrite d1/da/f14 [0,4194304] 0 2024-09-17T07:20:10.449 INFO:tasks.workunit.client.1.smithi139.stdout:7/899: creat d5/d67/f121 x:0 0 0 2024-09-17T07:20:10.449 INFO:tasks.workunit.client.1.smithi139.stdout:1/784: sync 2024-09-17T07:20:10.450 INFO:tasks.workunit.client.1.smithi139.stdout:0/664: unlink d1/da/d17/d72/d66/fcf 0 2024-09-17T07:20:10.451 INFO:tasks.workunit.client.1.smithi139.stdout:3/977: truncate d5/da7/dca/dab/dd6/d28/db5/fcd 803527 0 2024-09-17T07:20:10.453 INFO:tasks.workunit.client.1.smithi139.stdout:7/900: creat d5/d10/d4d/de4/f122 x:0 0 0 2024-09-17T07:20:10.455 INFO:tasks.workunit.client.1.smithi139.stdout:3/978: symlink d5/d21/d23/d38/dbd/l135 0 2024-09-17T07:20:10.462 INFO:tasks.workunit.client.1.smithi139.stdout:7/901: dwrite d5/d10/d2b/d71/fe2 [0,4194304] 0 2024-09-17T07:20:10.463 INFO:tasks.workunit.client.1.smithi139.stdout:7/902: stat d5/d10/d2b/d40/d47/dc7/d103/f10e 0 2024-09-17T07:20:10.468 INFO:tasks.workunit.client.1.smithi139.stdout:3/979: write d5/f64 [1038334,60436] 0 2024-09-17T07:20:10.473 INFO:tasks.workunit.client.1.smithi139.stdout:7/903: truncate d5/d17/f91 513916 0 2024-09-17T07:20:10.475 INFO:tasks.workunit.client.1.smithi139.stdout:3/980: mkdir d5/d15/d20/d3b/dc1/d136 0 2024-09-17T07:20:10.477 INFO:tasks.workunit.client.1.smithi139.stdout:3/981: write d5/da7/fac [4918127,353] 0 2024-09-17T07:20:10.480 INFO:tasks.workunit.client.1.smithi139.stdout:0/665: dread d1/da/d1b/d3d/d50/f55 [0,4194304] 0 2024-09-17T07:20:10.483 INFO:tasks.workunit.client.1.smithi139.stdout:1/785: dread d2/d10/d12/d24/db2/fcf [0,4194304] 0 2024-09-17T07:20:10.484 INFO:tasks.workunit.client.1.smithi139.stdout:0/666: creat d1/da/d1b/d3d/d50/fee x:0 0 0 2024-09-17T07:20:10.490 INFO:tasks.workunit.client.1.smithi139.stdout:7/904: write d5/f23 [5945301,118711] 0 2024-09-17T07:20:10.492 INFO:tasks.workunit.client.1.smithi139.stdout:0/667: write d1/da/d1b/d3d/d50/f61 [1062486,31293] 0 2024-09-17T07:20:10.494 INFO:tasks.workunit.client.1.smithi139.stdout:7/905: mknod d5/d10/d2b/c123 0 2024-09-17T07:20:10.494 INFO:tasks.workunit.client.1.smithi139.stdout:0/668: creat d1/da/d1b/d3d/d50/fef x:0 0 0 2024-09-17T07:20:10.495 INFO:tasks.workunit.client.1.smithi139.stdout:7/906: write d5/d10/d4d/fe9 [743291,20366] 0 2024-09-17T07:20:10.498 INFO:tasks.workunit.client.1.smithi139.stdout:3/982: dread d5/f3c [0,4194304] 0 2024-09-17T07:20:10.498 INFO:tasks.workunit.client.1.smithi139.stdout:7/907: truncate d5/d17/d4e/faf 1015906 0 2024-09-17T07:20:10.499 INFO:tasks.workunit.client.1.smithi139.stdout:0/669: creat d1/da/d1b/d3d/d5a/db2/ff0 x:0 0 0 2024-09-17T07:20:10.501 INFO:tasks.workunit.client.1.smithi139.stdout:7/908: write d5/d17/d4e/ff0 [5160401,34549] 0 2024-09-17T07:20:10.502 INFO:tasks.workunit.client.1.smithi139.stdout:3/983: mknod d5/d63/d6d/d108/c137 0 2024-09-17T07:20:10.505 INFO:tasks.workunit.client.1.smithi139.stdout:3/984: write d5/d15/d20/d83/f94 [3143459,109137] 0 2024-09-17T07:20:10.506 INFO:tasks.workunit.client.1.smithi139.stdout:7/909: mknod d5/d17/d4e/c124 0 2024-09-17T07:20:10.506 INFO:tasks.workunit.client.1.smithi139.stdout:1/786: dread d2/d10/d12/d1a/dd7/f44 [0,4194304] 0 2024-09-17T07:20:10.509 INFO:tasks.workunit.client.1.smithi139.stdout:0/670: dwrite d1/da/d1b/d32/f37 [0,4194304] 0 2024-09-17T07:20:10.510 INFO:tasks.workunit.client.1.smithi139.stdout:3/985: truncate d5/d63/d6d/da0/f106 862673 0 2024-09-17T07:20:10.511 INFO:tasks.workunit.client.1.smithi139.stdout:7/910: symlink d5/d10/d2b/d40/d47/l125 0 2024-09-17T07:20:10.511 INFO:tasks.workunit.client.1.smithi139.stdout:3/986: chown d5/d63/l75 103 1 2024-09-17T07:20:10.511 INFO:tasks.workunit.client.1.smithi139.stdout:1/787: chown d2/d10/d12/d1a/dd7/d49/d8b/fa8 0 1 2024-09-17T07:20:10.513 INFO:tasks.workunit.client.1.smithi139.stdout:1/788: stat d2/d10/d12/d13/d4f/d5c/f86 0 2024-09-17T07:20:10.516 INFO:tasks.workunit.client.1.smithi139.stdout:0/671: rename d1/da/d2a/dae to d1/da/d1b/dba/df1 0 2024-09-17T07:20:10.516 INFO:tasks.workunit.client.1.smithi139.stdout:0/672: stat d1/da/d17/d72 0 2024-09-17T07:20:10.516 INFO:tasks.workunit.client.1.smithi139.stdout:7/911: creat d5/d10/d2b/d78/f126 x:0 0 0 2024-09-17T07:20:10.517 INFO:tasks.workunit.client.1.smithi139.stdout:1/789: creat d2/d10/d12/d1a/db1/ff7 x:0 0 0 2024-09-17T07:20:10.518 INFO:tasks.workunit.client.1.smithi139.stdout:0/673: write d1/da/d1b/d3d/d50/f61 [1491566,126522] 0 2024-09-17T07:20:10.520 INFO:tasks.workunit.client.1.smithi139.stdout:3/987: write d5/f39 [611442,73408] 0 2024-09-17T07:20:10.523 INFO:tasks.workunit.client.1.smithi139.stdout:1/790: symlink d2/d10/d12/d1a/dd7/d2b/d4a/lf8 0 2024-09-17T07:20:10.525 INFO:tasks.workunit.client.1.smithi139.stdout:7/912: dwrite d5/d10/d2b/d40/d47/f72 [4194304,4194304] 0 2024-09-17T07:20:10.528 INFO:tasks.workunit.client.1.smithi139.stdout:7/913: write d5/d10/d2b/f62 [1616053,119144] 0 2024-09-17T07:20:10.529 INFO:tasks.workunit.client.1.smithi139.stdout:3/988: getdents d5/d15/d16 0 2024-09-17T07:20:10.531 INFO:tasks.workunit.client.1.smithi139.stdout:3/989: write d5/d21/d23/d38/deb/f12d [689515,89090] 0 2024-09-17T07:20:10.532 INFO:tasks.workunit.client.1.smithi139.stdout:1/791: rename d2/d10/ca9 to d2/d10/d12/d7c/cf9 0 2024-09-17T07:20:10.539 INFO:tasks.workunit.client.1.smithi139.stdout:7/914: rmdir d5/d10 39 2024-09-17T07:20:10.546 INFO:tasks.workunit.client.1.smithi139.stdout:0/674: dwrite d1/da/d1b/d32/f35 [0,4194304] 0 2024-09-17T07:20:10.548 INFO:tasks.workunit.client.1.smithi139.stdout:0/675: chown d1/da/d1b/dba/de9 4706 1 2024-09-17T07:20:10.549 INFO:tasks.workunit.client.1.smithi139.stdout:0/676: write d1/da/d2a/f80 [3425282,96227] 0 2024-09-17T07:20:10.585 INFO:tasks.workunit.client.1.smithi139.stdout:1/792: rename d2/d10/d12/d13/d4f/fa3 to d2/d10/d12/d1a/dd7/d49/d8d/ffa 0 2024-09-17T07:20:10.587 INFO:tasks.workunit.client.1.smithi139.stdout:7/915: symlink d5/d10/d4d/d59/dd1/d100/l127 0 2024-09-17T07:20:10.590 INFO:tasks.workunit.client.1.smithi139.stdout:3/990: creat d5/d21/f138 x:0 0 0 2024-09-17T07:20:10.591 INFO:tasks.workunit.client.1.smithi139.stdout:3/991: fsync d5/d63/db3/f10e 0 2024-09-17T07:20:10.592 INFO:tasks.workunit.client.1.smithi139.stdout:3/992: stat d5/da7/dca/dab/dd6/d28/d54/d58/fd1 0 2024-09-17T07:20:10.598 INFO:tasks.workunit.client.1.smithi139.stdout:3/993: rmdir d5/d21/d23/d69/d129/d8b 39 2024-09-17T07:20:10.605 INFO:tasks.workunit.client.1.smithi139.stdout:3/994: rename d5/d21/d23/d69/fbf to d5/d63/d6d/da0/f139 0 2024-09-17T07:20:10.608 INFO:tasks.workunit.client.1.smithi139.stdout:3/995: mkdir d5/da7/dca/d13a 0 2024-09-17T07:20:10.612 INFO:tasks.workunit.client.1.smithi139.stdout:3/996: creat d5/da7/dca/dab/f13b x:0 0 0 2024-09-17T07:20:10.614 INFO:tasks.workunit.client.1.smithi139.stdout:3/997: write d5/da7/dca/dab/d107/f132 [409142,127350] 0 2024-09-17T07:20:10.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:10 smithi139 ceph-mon[34403]: pgmap v18: 65 pgs: 65 active+clean; 3.6 GiB data, 12 GiB used, 525 GiB / 536 GiB avail; 105 MiB/s rd, 245 MiB/s wr, 531 op/s 2024-09-17T07:20:10.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:10 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:20:10.616 INFO:tasks.workunit.client.1.smithi139.stdout:3/998: chown d5/d63/db3/ddb/d127 3 1 2024-09-17T07:20:10.617 INFO:tasks.workunit.client.1.smithi139.stdout:3/999: fsync d5/d63/d6d/f130 0 2024-09-17T07:20:10.629 INFO:tasks.workunit.client.1.smithi139.stdout:1/793: truncate d2/d10/d12/d1a/dd7/d49/f7b 1002194 0 2024-09-17T07:20:10.633 INFO:tasks.workunit.client.1.smithi139.stdout:1/794: mknod d2/d10/d12/d13/d4f/d5c/d92/dab/ddd/cfb 0 2024-09-17T07:20:10.634 INFO:tasks.workunit.client.1.smithi139.stdout:7/916: dwrite d5/d17/d4e/f9f [0,4194304] 0 2024-09-17T07:20:10.641 INFO:tasks.workunit.client.1.smithi139.stdout:1/795: getdents d2/d10/d12/d13 0 2024-09-17T07:20:10.645 INFO:tasks.workunit.client.1.smithi139.stdout:1/796: rmdir d2/d10/d12/d1a/dd7/d2b/d4a 39 2024-09-17T07:20:10.649 INFO:tasks.workunit.client.1.smithi139.stdout:1/797: creat d2/d10/d12/d1a/db1/ffc x:0 0 0 2024-09-17T07:20:10.657 INFO:tasks.workunit.client.1.smithi139.stdout:1/798: write d2/d10/d12/d1a/dd7/d49/d8d/ff4 [2850562,67672] 0 2024-09-17T07:20:10.658 INFO:tasks.workunit.client.1.smithi139.stdout:1/799: chown d2/l9a 5 1 2024-09-17T07:20:10.660 INFO:tasks.workunit.client.1.smithi139.stdout:1/800: chown d2/d10/c28 324 1 2024-09-17T07:20:10.664 INFO:tasks.workunit.client.1.smithi139.stdout:1/801: rename d2/d10/d12/d13/d4f/d5c/fb3 to d2/d10/d12/d13/d4f/d5c/ffd 0 2024-09-17T07:20:10.668 INFO:tasks.workunit.client.1.smithi139.stdout:1/802: creat d2/d10/d12/d1a/dd7/d49/d8b/db8/ffe x:0 0 0 2024-09-17T07:20:10.680 INFO:tasks.workunit.client.1.smithi139.stdout:1/803: write d2/d10/d12/d24/f4e [1314359,105781] 0 2024-09-17T07:20:10.683 INFO:tasks.workunit.client.1.smithi139.stdout:1/804: symlink d2/d10/d12/d1a/dd7/d49/d8b/db8/lff 0 2024-09-17T07:20:10.687 INFO:tasks.workunit.client.1.smithi139.stdout:1/805: getdents d2/d10/d12/d1a 0 2024-09-17T07:20:10.689 INFO:tasks.workunit.client.1.smithi139.stdout:1/806: chown d2/d10/d12/d13/d4f/d5c/d92/fe5 114631 1 2024-09-17T07:20:10.694 INFO:tasks.workunit.client.1.smithi139.stdout:1/807: link d2/d10/d12/d13/d4f/d5c/d92/fe5 d2/d10/d12/d7c/f100 0 2024-09-17T07:20:10.707 INFO:tasks.workunit.client.1.smithi139.stdout:1/808: dwrite d2/d10/d71/f8f [0,4194304] 0 2024-09-17T07:20:10.715 INFO:tasks.workunit.client.1.smithi139.stdout:1/809: read d2/d10/d12/d1a/dd7/d2b/f42 [912989,79544] 0 2024-09-17T07:20:10.716 INFO:tasks.workunit.client.1.smithi139.stdout:1/810: readlink d2/d10/le6 0 2024-09-17T07:20:10.718 INFO:tasks.workunit.client.1.smithi139.stdout:1/811: creat d2/d10/d12/d1a/dd7/d49/d8d/f101 x:0 0 0 2024-09-17T07:20:10.720 INFO:tasks.workunit.client.1.smithi139.stdout:1/812: unlink d2/d10/d12/d1a/dd7/d49/l65 0 2024-09-17T07:20:10.720 INFO:tasks.workunit.client.1.smithi139.stdout:1/813: chown d2/f15 3731 1 2024-09-17T07:20:10.723 INFO:tasks.workunit.client.1.smithi139.stdout:1/814: symlink d2/d10/d12/d24/l102 0 2024-09-17T07:20:10.725 INFO:tasks.workunit.client.1.smithi139.stdout:1/815: readlink d2/d10/d12/l22 0 2024-09-17T07:20:10.744 INFO:tasks.workunit.client.1.smithi139.stdout:1/816: dread d2/f91 [0,4194304] 0 2024-09-17T07:20:10.747 INFO:tasks.workunit.client.1.smithi139.stdout:1/817: mkdir d2/d10/d12/d1a/dd7/d49/d8b/d103 0 2024-09-17T07:20:10.753 INFO:tasks.workunit.client.1.smithi139.stdout:1/818: getdents d2/d10/d12/d1a/dd7/d2b/d4a 0 2024-09-17T07:20:10.754 INFO:tasks.workunit.client.1.smithi139.stdout:1/819: fdatasync d2/d10/d12/d1a/d61/faa 0 2024-09-17T07:20:10.756 INFO:tasks.workunit.client.1.smithi139.stdout:1/820: fdatasync d2/d10/d12/d24/f8c 0 2024-09-17T07:20:10.761 INFO:tasks.workunit.client.1.smithi139.stdout:1/821: creat d2/d10/d12/d1a/dd7/d49/d8b/d103/f104 x:0 0 0 2024-09-17T07:20:10.762 INFO:tasks.workunit.client.1.smithi139.stdout:1/822: chown d2/d10/d12/d1a/db1/dc7/dc2 7 1 2024-09-17T07:20:10.771 INFO:tasks.workunit.client.1.smithi139.stdout:1/823: dwrite d2/d10/d12/d13/d4f/d5c/ffd [0,4194304] 0 2024-09-17T07:20:10.779 INFO:tasks.workunit.client.1.smithi139.stdout:1/824: write d2/d10/d12/d1a/dd7/d2b/fc5 [1153346,92552] 0 2024-09-17T07:20:10.783 INFO:tasks.workunit.client.1.smithi139.stdout:1/825: getdents d2/d10/d12/d1a/db1 0 2024-09-17T07:20:10.787 INFO:tasks.workunit.client.1.smithi139.stdout:1/826: write d2/d10/d71/d94/fb9 [115866,9444] 0 2024-09-17T07:20:10.790 INFO:tasks.workunit.client.1.smithi139.stdout:1/827: getdents d2/d10/d12/d13 0 2024-09-17T07:20:10.795 INFO:tasks.workunit.client.1.smithi139.stdout:1/828: dwrite d2/d10/d12/d13/f82 [0,4194304] 0 2024-09-17T07:20:10.797 INFO:tasks.workunit.client.1.smithi139.stdout:1/829: chown d2/d10/c37 1 1 2024-09-17T07:20:10.802 INFO:tasks.workunit.client.1.smithi139.stdout:1/830: rename d2/d10/d12/d1a/dd7/l64 to d2/d10/d12/d1a/dd7/d49/d8b/db8/l105 0 2024-09-17T07:20:10.813 INFO:tasks.workunit.client.1.smithi139.stdout:1/831: write d2/d10/d12/d1a/fae [3544,44531] 0 2024-09-17T07:20:10.823 INFO:tasks.workunit.client.1.smithi139.stdout:1/832: dwrite d2/d10/d12/d1a/dd7/d49/f7b [0,4194304] 0 2024-09-17T07:20:10.833 INFO:tasks.workunit.client.1.smithi139.stdout:1/833: dwrite d2/d10/d12/d13/f43 [4194304,4194304] 0 2024-09-17T07:20:10.835 INFO:tasks.workunit.client.1.smithi139.stdout:6/939: sync 2024-09-17T07:20:10.840 INFO:tasks.workunit.client.1.smithi139.stdout:1/834: rename d2/d10/d12/d1a/l7e to d2/d10/d12/d1a/dd7/d2b/d4a/l106 0 2024-09-17T07:20:10.841 INFO:tasks.workunit.client.1.smithi139.stdout:6/940: rmdir db/db7/ddb/d103 39 2024-09-17T07:20:10.844 INFO:tasks.workunit.client.1.smithi139.stdout:1/835: mkdir d2/d10/d12/d1a/dd7/d49/d8d/d107 0 2024-09-17T07:20:10.846 INFO:tasks.workunit.client.1.smithi139.stdout:1/836: write d2/d10/d12/d1a/dd7/d2b/f41 [200232,102960] 0 2024-09-17T07:20:10.846 INFO:tasks.workunit.client.1.smithi139.stdout:6/941: link db/df/d4e/d64/d83/fc6 db/df/daa/de3/d107/f147 0 2024-09-17T07:20:10.848 INFO:tasks.workunit.client.1.smithi139.stdout:1/837: creat d2/d10/d12/d24/d38/da6/f108 x:0 0 0 2024-09-17T07:20:10.850 INFO:tasks.workunit.client.1.smithi139.stdout:1/838: mknod d2/d10/db4/c109 0 2024-09-17T07:20:10.855 INFO:tasks.workunit.client.1.smithi139.stdout:1/839: rename d2/d10/d12/d1a/dd7/d49/d8b/db8 to d2/d10/d71/d10a 0 2024-09-17T07:20:10.858 INFO:tasks.workunit.client.1.smithi139.stdout:1/840: symlink d2/d10/d12/d13/d4f/d5c/d92/l10b 0 2024-09-17T07:20:10.860 INFO:tasks.workunit.client.1.smithi139.stdout:1/841: mkdir d2/d10/d12/d13/dca/d10c 0 2024-09-17T07:20:10.863 INFO:tasks.workunit.client.1.smithi139.stdout:1/842: mknod d2/d10/d12/d1a/dd7/d2b/d4a/c10d 0 2024-09-17T07:20:10.863 INFO:tasks.workunit.client.1.smithi139.stdout:6/942: dread db/df/d73/da4/fa9 [0,4194304] 0 2024-09-17T07:20:10.865 INFO:tasks.workunit.client.1.smithi139.stdout:1/843: symlink d2/d10/dce/l10e 0 2024-09-17T07:20:10.866 INFO:tasks.workunit.client.1.smithi139.stdout:6/943: dread - db/d21/f10d zero size 2024-09-17T07:20:10.873 INFO:tasks.workunit.client.1.smithi139.stdout:6/944: dwrite db/df/d73/d81/f67 [0,4194304] 0 2024-09-17T07:20:10.877 INFO:tasks.workunit.client.1.smithi139.stdout:1/844: dwrite d2/d10/d12/d24/d38/d3d/f4d [0,4194304] 0 2024-09-17T07:20:10.880 INFO:tasks.workunit.client.1.smithi139.stdout:6/945: rename db/df/d4e/d64/d54 to db/df/d4e/d64/d80/d131/d148 0 2024-09-17T07:20:10.881 INFO:tasks.workunit.client.1.smithi139.stdout:1/845: write d2/d10/d12/f31 [5415611,81871] 0 2024-09-17T07:20:10.890 INFO:tasks.workunit.client.1.smithi139.stdout:6/946: dwrite db/d18/d9f/dd2/fec [0,4194304] 0 2024-09-17T07:20:10.894 INFO:tasks.workunit.client.1.smithi139.stdout:6/947: symlink db/df/d4e/l149 0 2024-09-17T07:20:10.898 INFO:tasks.workunit.client.1.smithi139.stdout:6/948: unlink db/df/daa/de3/d107/l10b 0 2024-09-17T07:20:10.905 INFO:tasks.workunit.client.1.smithi139.stdout:6/949: write db/d21/f102 [856668,13152] 0 2024-09-17T07:20:10.908 INFO:tasks.workunit.client.1.smithi139.stdout:1/846: dread d2/d10/d12/d13/d4f/d5c/d74/fbb [0,4194304] 0 2024-09-17T07:20:10.908 INFO:tasks.workunit.client.1.smithi139.stdout:6/950: creat db/df/daa/de3/d107/f14a x:0 0 0 2024-09-17T07:20:10.909 INFO:tasks.workunit.client.1.smithi139.stdout:1/847: dread - d2/d10/d12/d7c/f100 zero size 2024-09-17T07:20:10.912 INFO:tasks.workunit.client.1.smithi139.stdout:6/951: truncate db/d18/d1b/f5a 573472 0 2024-09-17T07:20:10.913 INFO:tasks.workunit.client.1.smithi139.stdout:1/848: fsync d2/d10/d12/d1a/dd7/d2b/fe2 0 2024-09-17T07:20:10.914 INFO:tasks.workunit.client.1.smithi139.stdout:1/849: dread - d2/d10/d12/d1a/dd7/d49/d8b/d103/f104 zero size 2024-09-17T07:20:10.917 INFO:tasks.workunit.client.1.smithi139.stdout:6/952: link db/d18/d1b/f3f db/df/f14b 0 2024-09-17T07:20:10.920 INFO:tasks.workunit.client.1.smithi139.stdout:1/850: getdents d2/d10/d12/d1a/dd7/d2b/d4a/d6f 0 2024-09-17T07:20:10.923 INFO:tasks.workunit.client.1.smithi139.stdout:7/917: sync 2024-09-17T07:20:10.924 INFO:tasks.workunit.client.1.smithi139.stdout:0/677: sync 2024-09-17T07:20:10.924 INFO:tasks.workunit.client.1.smithi139.stdout:1/851: getdents d2/d10/d71 0 2024-09-17T07:20:10.926 INFO:tasks.workunit.client.1.smithi139.stdout:6/953: dwrite db/df/d4e/d64/d80/d131/d148/f2b [4194304,4194304] 0 2024-09-17T07:20:10.929 INFO:tasks.workunit.client.1.smithi139.stdout:7/918: mkdir d5/d17/d128 0 2024-09-17T07:20:10.931 INFO:tasks.workunit.client.1.smithi139.stdout:6/954: truncate db/df/d4e/f68 171852 0 2024-09-17T07:20:10.932 INFO:tasks.workunit.client.1.smithi139.stdout:6/955: chown db/fde 42 1 2024-09-17T07:20:10.944 INFO:tasks.workunit.client.1.smithi139.stdout:1/852: dwrite d2/d10/d12/d1a/d61/fc3 [0,4194304] 0 2024-09-17T07:20:10.945 INFO:tasks.workunit.client.1.smithi139.stdout:0/678: dwrite d1/da/d1b/d32/d9a/f9d [0,4194304] 0 2024-09-17T07:20:10.947 INFO:tasks.workunit.client.1.smithi139.stdout:0/679: truncate d1/da/d1b/d3d/d50/fef 856527 0 2024-09-17T07:20:10.950 INFO:tasks.workunit.client.1.smithi139.stdout:0/680: mknod d1/da/d1b/d3d/d50/cf2 0 2024-09-17T07:20:10.951 INFO:tasks.workunit.client.1.smithi139.stdout:0/681: fsync d1/da/d1b/d3d/fe4 0 2024-09-17T07:20:10.957 INFO:tasks.workunit.client.1.smithi139.stdout:7/919: truncate d5/d96/fab 3788960 0 2024-09-17T07:20:10.957 INFO:tasks.workunit.client.1.smithi139.stdout:7/920: stat d5/d17/d4e/d90/lbb 0 2024-09-17T07:20:10.958 INFO:tasks.workunit.client.1.smithi139.stdout:1/853: link d2/d10/d71/d10a/ffe d2/d10/d12/d1a/dd7/d2b/f10f 0 2024-09-17T07:20:10.960 INFO:tasks.workunit.client.1.smithi139.stdout:1/854: rmdir d2/d10/d12/d1a 39 2024-09-17T07:20:10.965 INFO:tasks.workunit.client.1.smithi139.stdout:6/956: dwrite db/df/d4e/fb8 [0,4194304] 0 2024-09-17T07:20:10.968 INFO:tasks.workunit.client.1.smithi139.stdout:6/957: stat db/d21/d96/df4/ffc 0 2024-09-17T07:20:10.968 INFO:tasks.workunit.client.1.smithi139.stdout:7/921: creat d5/d10/d2b/f129 x:0 0 0 2024-09-17T07:20:10.977 INFO:tasks.workunit.client.1.smithi139.stdout:1/855: read d2/d10/d12/d1a/dd7/d49/f80 [2262127,88239] 0 2024-09-17T07:20:10.978 INFO:tasks.workunit.client.1.smithi139.stdout:1/856: write d2/d10/d12/d1a/fae [483776,108147] 0 2024-09-17T07:20:10.979 INFO:tasks.workunit.client.1.smithi139.stdout:1/857: chown d2/d10/d12/l4c 482800095 1 2024-09-17T07:20:10.979 INFO:tasks.workunit.client.1.smithi139.stdout:7/922: rename d5/d17/d4e/c74 to d5/d10/d2b/d40/d47/c12a 0 2024-09-17T07:20:10.981 INFO:tasks.workunit.client.1.smithi139.stdout:1/858: stat d2/d10/d12/d13/d4f/d5c/d74/fbe 0 2024-09-17T07:20:10.981 INFO:tasks.workunit.client.1.smithi139.stdout:7/923: fsync d5/d10/d4d/fe9 0 2024-09-17T07:20:10.982 INFO:tasks.workunit.client.1.smithi139.stdout:7/924: chown d5/cee 83 1 2024-09-17T07:20:10.982 INFO:tasks.workunit.client.1.smithi139.stdout:1/859: stat d2/d10/d12/d1a/c5d 0 2024-09-17T07:20:10.987 INFO:tasks.workunit.client.1.smithi139.stdout:7/925: mknod d5/d10/d4d/d59/dd1/c12b 0 2024-09-17T07:20:10.989 INFO:tasks.workunit.client.1.smithi139.stdout:1/860: write d2/d10/d12/d24/d38/d3d/fe3 [231447,12226] 0 2024-09-17T07:20:10.994 INFO:tasks.workunit.client.1.smithi139.stdout:6/958: dwrite db/d21/f10d [0,4194304] 0 2024-09-17T07:20:10.996 INFO:tasks.workunit.client.1.smithi139.stdout:1/861: readlink d2/d10/d12/d1a/d61/le0 0 2024-09-17T07:20:11.001 INFO:tasks.workunit.client.1.smithi139.stdout:7/926: dwrite d5/d10/d2b/d71/fe2 [0,4194304] 0 2024-09-17T07:20:11.001 INFO:tasks.workunit.client.1.smithi139.stdout:6/959: rename db/df/d4e/d64/d83/fbf to db/d18/d9f/dd2/f14c 0 2024-09-17T07:20:11.003 INFO:tasks.workunit.client.1.smithi139.stdout:1/862: creat d2/d10/d12/d1a/dd7/d2b/d4a/d6f/f110 x:0 0 0 2024-09-17T07:20:11.004 INFO:tasks.workunit.client.1.smithi139.stdout:6/960: creat db/df/daa/de3/f14d x:0 0 0 2024-09-17T07:20:11.006 INFO:tasks.workunit.client.1.smithi139.stdout:7/927: creat d5/d10/d2b/d78/dec/f12c x:0 0 0 2024-09-17T07:20:11.009 INFO:tasks.workunit.client.1.smithi139.stdout:6/961: mkdir db/d18/d14e 0 2024-09-17T07:20:11.014 INFO:tasks.workunit.client.1.smithi139.stdout:6/962: rename db/d18/f6c to db/df/d73/d81/f14f 0 2024-09-17T07:20:11.014 INFO:tasks.workunit.client.1.smithi139.stdout:1/863: dread d2/d10/d12/d1a/f96 [0,4194304] 0 2024-09-17T07:20:11.016 INFO:tasks.workunit.client.1.smithi139.stdout:6/963: fdatasync db/db7/fd7 0 2024-09-17T07:20:11.017 INFO:tasks.workunit.client.1.smithi139.stdout:7/928: getdents d5/d17/d4e/d66/dd5 0 2024-09-17T07:20:11.024 INFO:tasks.workunit.client.1.smithi139.stdout:1/864: dread d2/d10/d12/f76 [4194304,4194304] 0 2024-09-17T07:20:11.025 INFO:tasks.workunit.client.1.smithi139.stdout:6/964: dwrite db/d18/d9f/fdf [4194304,4194304] 0 2024-09-17T07:20:11.029 INFO:tasks.workunit.client.1.smithi139.stdout:6/965: fdatasync db/d18/d38/d60/fc8 0 2024-09-17T07:20:11.040 INFO:tasks.workunit.client.1.smithi139.stdout:7/929: dread d5/f58 [0,4194304] 0 2024-09-17T07:20:11.048 INFO:tasks.workunit.client.1.smithi139.stdout:7/930: link d5/d10/d2b/d40/d47/f8e d5/d10/d2b/d78/d9e/db1/f12d 0 2024-09-17T07:20:11.050 INFO:tasks.workunit.client.1.smithi139.stdout:7/931: truncate d5/d10/d2b/d78/d9e/f11f 1010378 0 2024-09-17T07:20:11.057 INFO:tasks.workunit.client.1.smithi139.stdout:7/932: dwrite d5/d17/d4e/d90/f105 [0,4194304] 0 2024-09-17T07:20:11.061 INFO:tasks.workunit.client.1.smithi139.stdout:7/933: mkdir d5/d10/d8c/ded/d12e 0 2024-09-17T07:20:11.062 INFO:tasks.workunit.client.1.smithi139.stdout:7/934: chown d5/d10/d2b/f118 6864048 1 2024-09-17T07:20:11.068 INFO:tasks.workunit.client.1.smithi139.stdout:7/935: creat d5/d10/d2b/d78/d9e/db1/f12f x:0 0 0 2024-09-17T07:20:11.069 INFO:tasks.workunit.client.1.smithi139.stdout:7/936: rename d5/d10 to d5/d10/d4d/d59/dfc/d10a/d130 22 2024-09-17T07:20:11.071 INFO:tasks.workunit.client.1.smithi139.stdout:7/937: read d5/d17/f31 [260642,14933] 0 2024-09-17T07:20:11.078 INFO:tasks.workunit.client.1.smithi139.stdout:7/938: dread d5/d10/d2b/d78/d9e/db1/fc2 [0,4194304] 0 2024-09-17T07:20:11.081 INFO:tasks.workunit.client.1.smithi139.stdout:7/939: symlink d5/d10/l131 0 2024-09-17T07:20:11.085 INFO:tasks.workunit.client.1.smithi139.stdout:7/940: creat d5/d17/d4e/d66/f132 x:0 0 0 2024-09-17T07:20:11.086 INFO:tasks.workunit.client.1.smithi139.stdout:7/941: fsync d5/d10/d2b/fcb 0 2024-09-17T07:20:11.095 INFO:tasks.workunit.client.1.smithi139.stdout:7/942: write d5/d10/d2b/d78/d9e/db1/db7/fe3 [4809480,17572] 0 2024-09-17T07:20:11.097 INFO:tasks.workunit.client.1.smithi139.stdout:7/943: creat d5/d96/f133 x:0 0 0 2024-09-17T07:20:11.098 INFO:tasks.workunit.client.1.smithi139.stdout:7/944: chown d5/d10/d2b/d40/d47/c52 114 1 2024-09-17T07:20:11.101 INFO:tasks.workunit.client.1.smithi139.stdout:7/945: mknod d5/d10/d4d/d59/dfc/d10a/c134 0 2024-09-17T07:20:11.103 INFO:tasks.workunit.client.1.smithi139.stdout:7/946: mknod d5/d10/d4d/d59/c135 0 2024-09-17T07:20:11.105 INFO:tasks.workunit.client.1.smithi139.stdout:7/947: write d5/d10/d2b/d40/d47/dc7/ff7 [2348976,35927] 0 2024-09-17T07:20:11.106 INFO:tasks.workunit.client.1.smithi139.stdout:7/948: write d5/d10/d8c/ded/fc5 [858243,113781] 0 2024-09-17T07:20:11.109 INFO:tasks.workunit.client.1.smithi139.stdout:7/949: chown d5/d10/d2b/d40/d47/c8b 136727 1 2024-09-17T07:20:11.110 INFO:tasks.workunit.client.1.smithi139.stdout:7/950: chown d5/l26 3 1 2024-09-17T07:20:11.125 INFO:tasks.workunit.client.1.smithi139.stdout:7/951: dread d5/d17/f20 [0,4194304] 0 2024-09-17T07:20:11.132 INFO:tasks.workunit.client.1.smithi139.stdout:7/952: rename d5/d17/d4e/d63/la8 to d5/d10/d2b/d40/d47/dc7/d103/l136 0 2024-09-17T07:20:11.133 INFO:tasks.workunit.client.1.smithi139.stdout:7/953: unlink d5/d10/f2e 0 2024-09-17T07:20:11.136 INFO:tasks.workunit.client.1.smithi139.stdout:7/954: mkdir d5/d10/d4d/d59/dd1/d137 0 2024-09-17T07:20:11.143 INFO:tasks.workunit.client.1.smithi139.stdout:7/955: dwrite d5/d96/fe5 [0,4194304] 0 2024-09-17T07:20:11.162 INFO:tasks.workunit.client.1.smithi139.stdout:7/956: truncate d5/d17/f2a 2645964 0 2024-09-17T07:20:11.170 INFO:tasks.workunit.client.1.smithi139.stdout:7/957: write d5/d17/f31 [2592412,52671] 0 2024-09-17T07:20:11.173 INFO:tasks.workunit.client.1.smithi139.stdout:7/958: rmdir d5/d10/d4d/de4 39 2024-09-17T07:20:11.177 INFO:tasks.workunit.client.1.smithi139.stdout:7/959: symlink d5/d10/d2b/d78/d9e/db1/l138 0 2024-09-17T07:20:11.180 INFO:tasks.workunit.client.1.smithi139.stdout:7/960: chown d5/d10/d2b/d78/d9e/db1/db7/fe3 27 1 2024-09-17T07:20:11.183 INFO:tasks.workunit.client.1.smithi139.stdout:7/961: creat d5/d10/d2b/d40/d47/f139 x:0 0 0 2024-09-17T07:20:11.188 INFO:tasks.workunit.client.1.smithi139.stdout:7/962: dread d5/d10/d2b/d78/d9e/fba [0,4194304] 0 2024-09-17T07:20:11.197 INFO:tasks.workunit.client.1.smithi139.stdout:7/963: getdents d5/d10/d2b/d40/d47 0 2024-09-17T07:20:11.197 INFO:tasks.workunit.client.1.smithi139.stdout:7/964: read - d5/d17/d4e/d66/f132 zero size 2024-09-17T07:20:11.198 INFO:tasks.workunit.client.1.smithi139.stdout:7/965: fdatasync d5/d10/d8c/ded/f6f 0 2024-09-17T07:20:11.202 INFO:tasks.workunit.client.1.smithi139.stdout:7/966: truncate d5/d10/d2b/f3c 1318606 0 2024-09-17T07:20:11.209 INFO:tasks.workunit.client.1.smithi139.stdout:7/967: dwrite d5/d10/d2b/d78/d9e/f11f [0,4194304] 0 2024-09-17T07:20:11.229 INFO:tasks.workunit.client.1.smithi139.stdout:7/968: dread d5/d10/d2b/d40/f81 [0,4194304] 0 2024-09-17T07:20:11.232 INFO:tasks.workunit.client.1.smithi139.stdout:7/969: unlink d5/d10/d2b/d78/d9e/db1/f12f 0 2024-09-17T07:20:11.233 INFO:tasks.workunit.client.1.smithi139.stdout:7/970: chown d5/d10/d2b/d40/l46 851482284 1 2024-09-17T07:20:11.234 INFO:tasks.workunit.client.1.smithi139.stdout:7/971: truncate d5/d10/d2b/fcb 1427206 0 2024-09-17T07:20:11.236 INFO:tasks.workunit.client.1.smithi139.stdout:7/972: symlink d5/d10/d8c/ded/l13a 0 2024-09-17T07:20:11.243 INFO:tasks.workunit.client.1.smithi139.stdout:7/973: dwrite d5/d10/d2b/d40/d47/dc7/d103/f10e [0,4194304] 0 2024-09-17T07:20:11.247 INFO:tasks.workunit.client.1.smithi139.stdout:7/974: symlink d5/d67/l13b 0 2024-09-17T07:20:11.249 INFO:tasks.workunit.client.1.smithi139.stdout:7/975: creat d5/d17/d128/f13c x:0 0 0 2024-09-17T07:20:11.253 INFO:tasks.workunit.client.1.smithi139.stdout:7/976: dread d5/d10/d2b/d78/d9e/f11f [0,4194304] 0 2024-09-17T07:20:11.261 INFO:tasks.workunit.client.1.smithi139.stdout:7/977: truncate d5/d17/d4e/faf 422609 0 2024-09-17T07:20:11.267 INFO:tasks.workunit.client.1.smithi139.stdout:7/978: truncate d5/d17/d4e/f9f 2289542 0 2024-09-17T07:20:11.273 INFO:tasks.workunit.client.1.smithi139.stdout:7/979: truncate d5/f58 3714525 0 2024-09-17T07:20:11.275 INFO:tasks.workunit.client.1.smithi139.stdout:7/980: symlink d5/d10/d4d/l13d 0 2024-09-17T07:20:11.278 INFO:tasks.workunit.client.1.smithi139.stdout:7/981: rename d5/d10/d8c/la4 to d5/d10/d2b/d78/d9e/l13e 0 2024-09-17T07:20:11.282 INFO:tasks.workunit.client.1.smithi139.stdout:7/982: rename d5/l13 to d5/d10/d4d/de4/d114/l13f 0 2024-09-17T07:20:11.286 INFO:tasks.workunit.client.1.smithi139.stdout:7/983: creat d5/d10/d4d/d59/dd1/dd6/f140 x:0 0 0 2024-09-17T07:20:11.286 INFO:tasks.workunit.client.1.smithi139.stdout:7/984: chown d5/d96/cd9 13 1 2024-09-17T07:20:11.288 INFO:tasks.workunit.client.1.smithi139.stdout:7/985: rmdir d5/d17/d4e/d7a 39 2024-09-17T07:20:11.292 INFO:tasks.workunit.client.1.smithi139.stdout:7/986: mkdir d5/d10/d4d/d59/dd1/d137/d141 0 2024-09-17T07:20:11.295 INFO:tasks.workunit.client.1.smithi139.stdout:7/987: chown d5/d10/d4d/d59/l8d 1290772 1 2024-09-17T07:20:11.297 INFO:tasks.workunit.client.1.smithi139.stdout:7/988: dread - d5/d10/d4d/d59/fde zero size 2024-09-17T07:20:11.297 INFO:tasks.workunit.client.1.smithi139.stdout:7/989: dread - d5/d10/fe7 zero size 2024-09-17T07:20:11.300 INFO:tasks.workunit.client.1.smithi139.stdout:7/990: mkdir d5/d67/d142 0 2024-09-17T07:20:11.301 INFO:tasks.workunit.client.1.smithi139.stdout:7/991: stat d5/d10/d4d/d102 0 2024-09-17T07:20:11.303 INFO:tasks.workunit.client.1.smithi139.stdout:7/992: mknod d5/d10/d2b/d78/d9e/db1/db8/c143 0 2024-09-17T07:20:11.307 INFO:tasks.workunit.client.1.smithi139.stdout:7/993: dwrite d5/d17/fb0 [0,4194304] 0 2024-09-17T07:20:11.309 INFO:tasks.workunit.client.1.smithi139.stdout:7/994: dread - d5/d10/d4d/d59/dd1/d100/f10d zero size 2024-09-17T07:20:11.312 INFO:tasks.workunit.client.1.smithi139.stdout:7/995: creat d5/d10/d4d/de4/f144 x:0 0 0 2024-09-17T07:20:11.313 INFO:tasks.workunit.client.1.smithi139.stdout:7/996: fdatasync d5/d10/d4d/d59/dd1/dd6/f140 0 2024-09-17T07:20:11.317 INFO:tasks.workunit.client.1.smithi139.stdout:7/997: rename d5/d96/c10c to d5/d10/d4d/c145 0 2024-09-17T07:20:11.318 INFO:tasks.workunit.client.1.smithi139.stdout:7/998: truncate d5/d10/f11a 167715 0 2024-09-17T07:20:11.322 INFO:tasks.workunit.client.1.smithi139.stdout:7/999: dread d5/d10/d2b/d40/d47/dc7/d103/f10e [0,4194304] 0 2024-09-17T07:20:11.491 INFO:tasks.workunit.client.1.smithi139.stdout:0/682: sync 2024-09-17T07:20:11.494 INFO:tasks.workunit.client.1.smithi139.stdout:0/683: symlink d1/da/d1b/lf3 0 2024-09-17T07:20:11.494 INFO:tasks.workunit.client.1.smithi139.stdout:0/684: chown d1/da/d17/d72/d66/l67 918722 1 2024-09-17T07:20:11.502 INFO:tasks.workunit.client.1.smithi139.stdout:0/685: dread d1/da/d1b/d3d/d50/f61 [0,4194304] 0 2024-09-17T07:20:11.502 INFO:tasks.workunit.client.1.smithi139.stdout:0/686: readlink d1/da/d1b/dba/dc5/lcd 0 2024-09-17T07:20:11.506 INFO:tasks.workunit.client.1.smithi139.stdout:0/687: dread d1/da/d1b/d3d/d5a/d75/d93/fa1 [0,4194304] 0 2024-09-17T07:20:11.515 INFO:tasks.workunit.client.1.smithi139.stdout:0/688: dwrite d1/da/d1b/d3d/d50/f96 [0,4194304] 0 2024-09-17T07:20:11.517 INFO:tasks.workunit.client.1.smithi139.stdout:0/689: symlink d1/da/d1b/d3d/d5a/d98/lf4 0 2024-09-17T07:20:11.519 INFO:tasks.workunit.client.1.smithi139.stdout:0/690: write d1/da/d1b/d3d/fe4 [750368,28338] 0 2024-09-17T07:20:11.520 INFO:tasks.workunit.client.1.smithi139.stdout:0/691: fsync d1/f3 0 2024-09-17T07:20:11.521 INFO:tasks.workunit.client.1.smithi139.stdout:0/692: dread - d1/da/d1b/dba/dc5/fe6 zero size 2024-09-17T07:20:11.521 INFO:tasks.workunit.client.1.smithi139.stdout:0/693: stat d1/da/d1b/ddb 0 2024-09-17T07:20:11.521 INFO:tasks.workunit.client.1.smithi139.stdout:0/694: readlink d1/da/l46 0 2024-09-17T07:20:11.524 INFO:tasks.workunit.client.1.smithi139.stdout:0/695: symlink d1/da/d1b/d3d/d5a/d75/lf5 0 2024-09-17T07:20:11.526 INFO:tasks.workunit.client.1.smithi139.stdout:0/696: creat d1/da/d1b/d3d/d5a/ff6 x:0 0 0 2024-09-17T07:20:11.527 INFO:tasks.workunit.client.1.smithi139.stdout:0/697: rmdir d1/d58/d7d 39 2024-09-17T07:20:11.529 INFO:tasks.workunit.client.1.smithi139.stdout:0/698: symlink d1/da/d1b/d3d/d5a/d75/d91/lf7 0 2024-09-17T07:20:11.659 INFO:tasks.workunit.client.1.smithi139.stdout:6/966: sync 2024-09-17T07:20:11.659 INFO:tasks.workunit.client.1.smithi139.stdout:1/865: sync 2024-09-17T07:20:11.662 INFO:tasks.workunit.client.1.smithi139.stdout:6/967: symlink db/df/d4e/d64/d80/d131/d148/l150 0 2024-09-17T07:20:11.664 INFO:tasks.workunit.client.1.smithi139.stdout:6/968: dread - db/db7/fe1 zero size 2024-09-17T07:20:11.666 INFO:tasks.workunit.client.1.smithi139.stdout:1/866: dwrite d2/f91 [0,4194304] 0 2024-09-17T07:20:11.667 INFO:tasks.workunit.client.1.smithi139.stdout:6/969: dread - db/df/daa/de3/d107/f147 zero size 2024-09-17T07:20:11.672 INFO:tasks.workunit.client.1.smithi139.stdout:6/970: unlink db/d18/d38/d60/dc2/l106 0 2024-09-17T07:20:11.673 INFO:tasks.workunit.client.1.smithi139.stdout:1/867: dwrite d2/d10/d12/d1a/db1/ff7 [0,4194304] 0 2024-09-17T07:20:11.680 INFO:tasks.workunit.client.1.smithi139.stdout:6/971: creat db/d18/d1b/dfb/f151 x:0 0 0 2024-09-17T07:20:11.692 INFO:tasks.workunit.client.1.smithi139.stdout:1/868: write d2/d10/d12/d24/f8c [475980,123900] 0 2024-09-17T07:20:11.693 INFO:tasks.workunit.client.1.smithi139.stdout:6/972: write db/df/d4e/d5e/deb/ff2 [407377,23140] 0 2024-09-17T07:20:11.694 INFO:tasks.workunit.client.1.smithi139.stdout:1/869: creat d2/d10/d12/d13/dca/f111 x:0 0 0 2024-09-17T07:20:11.695 INFO:tasks.workunit.client.1.smithi139.stdout:6/973: mkdir db/df/d4e/d64/d80/d152 0 2024-09-17T07:20:11.697 INFO:tasks.workunit.client.1.smithi139.stdout:6/974: mkdir db/df/d153 0 2024-09-17T07:20:11.700 INFO:tasks.workunit.client.1.smithi139.stdout:1/870: rename d2/d10/d12/d24/d38/d3d/c3f to d2/d10/d12/d1a/dd7/d49/d8b/d103/c112 0 2024-09-17T07:20:11.701 INFO:tasks.workunit.client.1.smithi139.stdout:6/975: link db/df/d4e/d64/d80/d131/d148/f137 db/df/d4e/d5e/deb/d112/d132/f154 0 2024-09-17T07:20:11.705 INFO:tasks.workunit.client.1.smithi139.stdout:6/976: rename db/df/d4e/d64/c143 to db/df/d73/d81/c155 0 2024-09-17T07:20:11.710 INFO:tasks.workunit.client.1.smithi139.stdout:1/871: write d2/d10/d12/d1a/dd7/f44 [1678064,96457] 0 2024-09-17T07:20:11.711 INFO:tasks.workunit.client.1.smithi139.stdout:6/977: dread db/df/d4e/d64/d80/d131/d148/f2b [4194304,4194304] 0 2024-09-17T07:20:11.714 INFO:tasks.workunit.client.1.smithi139.stdout:1/872: creat d2/d10/d12/d13/d4f/d5c/d92/dab/ddd/f113 x:0 0 0 2024-09-17T07:20:11.717 INFO:tasks.workunit.client.1.smithi139.stdout:6/978: dwrite db/df/d4e/d64/d80/fb5 [0,4194304] 0 2024-09-17T07:20:11.718 INFO:tasks.workunit.client.1.smithi139.stdout:6/979: rmdir db/df 39 2024-09-17T07:20:11.720 INFO:tasks.workunit.client.1.smithi139.stdout:1/873: dwrite d2/d10/d12/d13/f16 [0,4194304] 0 2024-09-17T07:20:11.725 INFO:tasks.workunit.client.1.smithi139.stdout:1/874: readlink d2/d10/d12/d1a/dd7/d49/d8b/lc1 0 2024-09-17T07:20:11.733 INFO:tasks.workunit.client.1.smithi139.stdout:6/980: dwrite db/d18/d38/f43 [0,4194304] 0 2024-09-17T07:20:11.735 INFO:tasks.workunit.client.1.smithi139.stdout:6/981: readlink db/df/d4c/dbc/le4 0 2024-09-17T07:20:11.739 INFO:tasks.workunit.client.1.smithi139.stdout:0/699: sync 2024-09-17T07:20:11.741 INFO:tasks.workunit.client.1.smithi139.stdout:0/700: stat d1/c29 0 2024-09-17T07:20:11.742 INFO:tasks.workunit.client.1.smithi139.stdout:1/875: write d2/d10/d12/d24/d38/d3d/f99 [1342624,41409] 0 2024-09-17T07:20:11.744 INFO:tasks.workunit.client.1.smithi139.stdout:6/982: dwrite db/df/d4e/d64/f52 [0,4194304] 0 2024-09-17T07:20:11.746 INFO:tasks.workunit.client.1.smithi139.stdout:6/983: chown db/df/d4e/d64/d83/dc5 24981 1 2024-09-17T07:20:11.747 INFO:tasks.workunit.client.1.smithi139.stdout:1/876: write d2/d10/d12/d13/d4f/d5c/d74/fbe [2283544,30995] 0 2024-09-17T07:20:11.749 INFO:tasks.workunit.client.1.smithi139.stdout:0/701: dread d1/da/d1b/d3d/d50/f55 [0,4194304] 0 2024-09-17T07:20:11.750 INFO:tasks.workunit.client.1.smithi139.stdout:6/984: mkdir db/d18/d38/d60/dc2/d156 0 2024-09-17T07:20:11.751 INFO:tasks.workunit.client.1.smithi139.stdout:1/877: rmdir d2/d10/d12/d1a/dd7/d49/d8d 39 2024-09-17T07:20:11.757 INFO:tasks.workunit.client.1.smithi139.stdout:1/878: creat d2/d10/f114 x:0 0 0 2024-09-17T07:20:11.759 INFO:tasks.workunit.client.1.smithi139.stdout:0/702: dwrite d1/da/d2a/f80 [4194304,4194304] 0 2024-09-17T07:20:11.760 INFO:tasks.workunit.client.1.smithi139.stdout:0/703: fsync d1/da/f78 0 2024-09-17T07:20:11.763 INFO:tasks.workunit.client.1.smithi139.stdout:1/879: fsync d2/d10/f114 0 2024-09-17T07:20:11.764 INFO:tasks.workunit.client.1.smithi139.stdout:1/880: dread - d2/d10/d12/d7c/f100 zero size 2024-09-17T07:20:11.766 INFO:tasks.workunit.client.1.smithi139.stdout:0/704: dread d1/da/d1b/dba/df1/fd0 [0,4194304] 0 2024-09-17T07:20:11.770 INFO:tasks.workunit.client.1.smithi139.stdout:0/705: rename d1/c8d to d1/cf8 0 2024-09-17T07:20:11.770 INFO:tasks.workunit.client.1.smithi139.stdout:1/881: dread d2/d10/d12/d1a/db1/ff7 [0,4194304] 0 2024-09-17T07:20:11.772 INFO:tasks.workunit.client.1.smithi139.stdout:1/882: write d2/d10/d12/d13/f82 [2210004,48414] 0 2024-09-17T07:20:11.773 INFO:tasks.workunit.client.1.smithi139.stdout:0/706: symlink d1/da/d1b/d3d/d5a/d98/lf9 0 2024-09-17T07:20:11.775 INFO:tasks.workunit.client.1.smithi139.stdout:6/985: dread db/df/d73/dc1/f11e [0,4194304] 0 2024-09-17T07:20:11.776 INFO:tasks.workunit.client.1.smithi139.stdout:1/883: readlink d2/d10/d12/d1a/dd7/d49/d8d/lec 0 2024-09-17T07:20:11.777 INFO:tasks.workunit.client.1.smithi139.stdout:6/986: truncate db/db7/f13f 1010207 0 2024-09-17T07:20:11.777 INFO:tasks.workunit.client.1.smithi139.stdout:0/707: mknod d1/da/d1b/d32/d9a/dd6/cfa 0 2024-09-17T07:20:11.778 INFO:tasks.workunit.client.1.smithi139.stdout:1/884: chown d2/d10/d12/d13/d4f/d5c/l8e 543826 1 2024-09-17T07:20:11.779 INFO:tasks.workunit.client.1.smithi139.stdout:6/987: write db/db7/f13f [1037483,64672] 0 2024-09-17T07:20:11.779 INFO:tasks.workunit.client.1.smithi139.stdout:0/708: dread - d1/da/d17/db8/fce zero size 2024-09-17T07:20:11.781 INFO:tasks.workunit.client.1.smithi139.stdout:1/885: mkdir d2/d10/d115 0 2024-09-17T07:20:11.785 INFO:tasks.workunit.client.1.smithi139.stdout:0/709: rename d1/d58/fbd to d1/da/d1b/d3d/d5a/d75/ffb 0 2024-09-17T07:20:11.786 INFO:tasks.workunit.client.1.smithi139.stdout:1/886: symlink d2/d10/d12/d1a/db1/dc7/dc2/l116 0 2024-09-17T07:20:11.788 INFO:tasks.workunit.client.1.smithi139.stdout:1/887: chown d2/d10/d12/d1a/dd7/d2b/d4a/d6f/c84 0 1 2024-09-17T07:20:11.789 INFO:tasks.workunit.client.1.smithi139.stdout:6/988: getdents db/df/d4e/d64/d83/dc5 0 2024-09-17T07:20:11.794 INFO:tasks.workunit.client.1.smithi139.stdout:0/710: dwrite d1/da/d1b/d3d/d5a/d75/d91/fd5 [0,4194304] 0 2024-09-17T07:20:11.799 INFO:tasks.workunit.client.1.smithi139.stdout:0/711: dread d1/da/d2a/f2e [0,4194304] 0 2024-09-17T07:20:11.802 INFO:tasks.workunit.client.1.smithi139.stdout:0/712: mkdir d1/da/d1b/d3d/d5a/d75/d93/dfc 0 2024-09-17T07:20:11.804 INFO:tasks.workunit.client.1.smithi139.stdout:0/713: write d1/da/f14 [1899150,125629] 0 2024-09-17T07:20:11.807 INFO:tasks.workunit.client.1.smithi139.stdout:0/714: getdents d1/da/d1b/d3d 0 2024-09-17T07:20:11.811 INFO:tasks.workunit.client.1.smithi139.stdout:6/989: dread db/d18/d38/d60/f7c [0,4194304] 0 2024-09-17T07:20:11.812 INFO:tasks.workunit.client.1.smithi139.stdout:6/990: symlink db/d21/l157 0 2024-09-17T07:20:11.813 INFO:tasks.workunit.client.1.smithi139.stdout:0/715: truncate d1/da/d1b/d32/f35 3472080 0 2024-09-17T07:20:11.816 INFO:tasks.workunit.client.1.smithi139.stdout:0/716: creat d1/da/d1b/d3d/d5a/d75/ffd x:0 0 0 2024-09-17T07:20:11.819 INFO:tasks.workunit.client.1.smithi139.stdout:6/991: dwrite db/d18/f4a [0,4194304] 0 2024-09-17T07:20:11.820 INFO:tasks.workunit.client.1.smithi139.stdout:0/717: creat d1/ffe x:0 0 0 2024-09-17T07:20:11.823 INFO:tasks.workunit.client.1.smithi139.stdout:6/992: creat db/df/daa/f158 x:0 0 0 2024-09-17T07:20:11.827 INFO:tasks.workunit.client.1.smithi139.stdout:0/718: dread d1/da/d1b/d3d/d5a/d75/d91/fd5 [0,4194304] 0 2024-09-17T07:20:11.828 INFO:tasks.workunit.client.1.smithi139.stdout:0/719: fsync d1/da/d17/d65/f85 0 2024-09-17T07:20:11.829 INFO:tasks.workunit.client.1.smithi139.stdout:0/720: read - d1/da/d1b/d3d/d5a/ff6 zero size 2024-09-17T07:20:11.829 INFO:tasks.workunit.client.1.smithi139.stdout:6/993: link db/l26 db/db7/l159 0 2024-09-17T07:20:11.830 INFO:tasks.workunit.client.1.smithi139.stdout:6/994: chown db/df/cc7 94132453 1 2024-09-17T07:20:11.831 INFO:tasks.workunit.client.1.smithi139.stdout:0/721: chown d1/da/d1b/d3d/d5a/d75/d91/cc4 789 1 2024-09-17T07:20:11.833 INFO:tasks.workunit.client.1.smithi139.stdout:6/995: creat db/df/daa/d12f/f15a x:0 0 0 2024-09-17T07:20:11.834 INFO:tasks.workunit.client.1.smithi139.stdout:6/996: readlink db/df/d4c/dbc/le4 0 2024-09-17T07:20:11.834 INFO:tasks.workunit.client.1.smithi139.stdout:0/722: creat d1/da/fff x:0 0 0 2024-09-17T07:20:11.836 INFO:tasks.workunit.client.1.smithi139.stdout:0/723: creat d1/da/d17/d65/f100 x:0 0 0 2024-09-17T07:20:11.846 INFO:tasks.workunit.client.1.smithi139.stdout:0/724: dwrite d1/da/d2a/f62 [0,4194304] 0 2024-09-17T07:20:11.848 INFO:tasks.workunit.client.1.smithi139.stdout:0/725: chown d1/da/d1b/d3d/d5a/d75/d91 851 1 2024-09-17T07:20:11.849 INFO:tasks.workunit.client.1.smithi139.stdout:0/726: creat d1/f101 x:0 0 0 2024-09-17T07:20:11.851 INFO:tasks.workunit.client.1.smithi139.stdout:0/727: symlink d1/da/d1b/db6/l102 0 2024-09-17T07:20:11.852 INFO:tasks.workunit.client.1.smithi139.stdout:0/728: chown d1/da/d1b/d3d/d50/f96 13420 1 2024-09-17T07:20:11.855 INFO:tasks.workunit.client.1.smithi139.stdout:0/729: unlink d1/da/d17/d72/c82 0 2024-09-17T07:20:11.856 INFO:tasks.workunit.client.1.smithi139.stdout:0/730: write d1/da/d2a/fd3 [119632,34747] 0 2024-09-17T07:20:11.857 INFO:tasks.workunit.client.1.smithi139.stdout:0/731: chown d1/da/d1b/d32/d9a/f9d 131 1 2024-09-17T07:20:11.864 INFO:tasks.workunit.client.1.smithi139.stdout:0/732: write d1/da/d1b/dba/dc5/fd1 [51766,25989] 0 2024-09-17T07:20:11.916 INFO:tasks.workunit.client.1.smithi139.stdout:0/733: truncate d1/da/d1b/d3d/d5a/d75/f77 3254217 0 2024-09-17T07:20:11.920 INFO:tasks.workunit.client.1.smithi139.stdout:0/734: unlink d1/da/d17/db8/cdc 0 2024-09-17T07:20:11.923 INFO:tasks.workunit.client.1.smithi139.stdout:0/735: truncate d1/da/d1b/d3d/d5a/fb9 66708 0 2024-09-17T07:20:11.928 INFO:tasks.workunit.client.1.smithi139.stdout:0/736: truncate d1/da/d17/d65/f6e 134715 0 2024-09-17T07:20:11.930 INFO:tasks.workunit.client.1.smithi139.stdout:0/737: readlink d1/da/d1b/d32/d81/ld8 0 2024-09-17T07:20:11.931 INFO:tasks.workunit.client.1.smithi139.stdout:0/738: fsync d1/da/d1b/d32/d9a/fe3 0 2024-09-17T07:20:11.975 INFO:tasks.workunit.client.1.smithi139.stdout:0/739: write d1/da/d1b/d32/d9a/fb3 [343205,73731] 0 2024-09-17T07:20:11.976 INFO:tasks.workunit.client.1.smithi139.stdout:0/740: chown d1/da/d1b/dba/de9 42 1 2024-09-17T07:20:11.979 INFO:tasks.workunit.client.1.smithi139.stdout:0/741: mknod d1/da/d1b/d3d/d5a/d75/d93/c103 0 2024-09-17T07:20:11.981 INFO:tasks.workunit.client.1.smithi139.stdout:0/742: mkdir d1/da/d17/db8/d104 0 2024-09-17T07:20:11.983 INFO:tasks.workunit.client.1.smithi139.stdout:0/743: rmdir d1/da/d1b/db6 39 2024-09-17T07:20:11.986 INFO:tasks.workunit.client.1.smithi139.stdout:0/744: mkdir d1/da/d1b/d3d/d5a/d75/d93/dfc/d105 0 2024-09-17T07:20:11.987 INFO:tasks.workunit.client.1.smithi139.stdout:0/745: chown d1/da/l90 31081 1 2024-09-17T07:20:11.987 INFO:tasks.workunit.client.1.smithi139.stdout:0/746: chown d1/da/fff 436219038 1 2024-09-17T07:20:11.989 INFO:tasks.workunit.client.1.smithi139.stdout:0/747: chown d1/d58/d7d 1242 1 2024-09-17T07:20:11.991 INFO:tasks.workunit.client.1.smithi139.stdout:0/748: creat d1/da/d17/d72/d66/f106 x:0 0 0 2024-09-17T07:20:11.993 INFO:tasks.workunit.client.1.smithi139.stdout:0/749: creat d1/da/d1b/dba/f107 x:0 0 0 2024-09-17T07:20:11.995 INFO:tasks.workunit.client.1.smithi139.stdout:0/750: symlink d1/da/d1b/d3d/d5a/l108 0 2024-09-17T07:20:11.996 INFO:tasks.workunit.client.1.smithi139.stdout:0/751: truncate d1/da/d1b/d3d/d5a/db2/ff0 551852 0 2024-09-17T07:20:11.998 INFO:tasks.workunit.client.1.smithi139.stdout:0/752: write d1/da/d1b/d3d/d5a/db2/ff0 [803414,121752] 0 2024-09-17T07:20:12.001 INFO:tasks.workunit.client.1.smithi139.stdout:0/753: link d1/da/d2a/c8f d1/da/d1b/dba/de9/c109 0 2024-09-17T07:20:12.003 INFO:tasks.workunit.client.1.smithi139.stdout:0/754: mkdir d1/da/d1b/d3d/d5a/d98/d10a 0 2024-09-17T07:20:12.201 INFO:tasks.workunit.client.1.smithi139.stdout:1/888: sync 2024-09-17T07:20:12.201 INFO:tasks.workunit.client.1.smithi139.stdout:0/755: sync 2024-09-17T07:20:12.201 INFO:tasks.workunit.client.1.smithi139.stdout:6/997: sync 2024-09-17T07:20:12.203 INFO:tasks.workunit.client.1.smithi139.stdout:0/756: symlink d1/l10b 0 2024-09-17T07:20:12.203 INFO:tasks.workunit.client.1.smithi139.stdout:0/757: stat d1/da/d1b/l1a 0 2024-09-17T07:20:12.205 INFO:tasks.workunit.client.1.smithi139.stdout:1/889: mkdir d2/d10/d12/d24/d38/d3d/d117 0 2024-09-17T07:20:12.205 INFO:tasks.workunit.client.1.smithi139.stdout:6/998: dread db/d18/f4a [0,4194304] 0 2024-09-17T07:20:12.206 INFO:tasks.workunit.client.1.smithi139.stdout:1/890: write d2/d10/d12/f31 [2865140,123525] 0 2024-09-17T07:20:12.208 INFO:tasks.workunit.client.1.smithi139.stdout:1/891: creat d2/d10/d71/f118 x:0 0 0 2024-09-17T07:20:12.210 INFO:tasks.workunit.client.1.smithi139.stdout:0/758: link d1/da/d1b/d32/d81/f5e d1/da/d1b/d3d/d5a/d75/d93/f10c 0 2024-09-17T07:20:12.212 INFO:tasks.workunit.client.1.smithi139.stdout:1/892: symlink d2/d10/d12/d24/db2/df2/l119 0 2024-09-17T07:20:12.218 INFO:tasks.workunit.client.1.smithi139.stdout:0/759: dwrite d1/da/d1b/d3d/d5a/d75/d91/fd5 [0,4194304] 0 2024-09-17T07:20:12.219 INFO:tasks.workunit.client.1.smithi139.stdout:1/893: dread d2/f58 [0,4194304] 0 2024-09-17T07:20:12.222 INFO:tasks.workunit.client.1.smithi139.stdout:6/999: dwrite db/d18/d9f/fd4 [0,4194304] 0 2024-09-17T07:20:12.225 INFO:tasks.workunit.client.1.smithi139.stdout:0/760: mknod d1/da/d1b/c10d 0 2024-09-17T07:20:12.230 INFO:tasks.workunit.client.1.smithi139.stdout:0/761: mkdir d1/da/d1b/d32/d9a/d10e 0 2024-09-17T07:20:12.235 INFO:tasks.workunit.client.1.smithi139.stdout:1/894: dwrite d2/f15 [0,4194304] 0 2024-09-17T07:20:12.235 INFO:tasks.workunit.client.1.smithi139.stdout:0/762: dread d1/da/d1b/d32/f3a [0,4194304] 0 2024-09-17T07:20:12.236 INFO:tasks.workunit.client.1.smithi139.stdout:1/895: readlink d2/d10/d12/d13/d4f/d5c/l8e 0 2024-09-17T07:20:12.238 INFO:tasks.workunit.client.1.smithi139.stdout:0/763: write d1/da/d17/d72/d66/f89 [709263,7763] 0 2024-09-17T07:20:12.242 INFO:tasks.workunit.client.1.smithi139.stdout:1/896: rmdir d2/d10/d12/d1a/dd7/d49/d8d/dee 0 2024-09-17T07:20:12.242 INFO:tasks.workunit.client.1.smithi139.stdout:0/764: symlink d1/da/d1b/d3d/d5a/d98/d10a/l10f 0 2024-09-17T07:20:12.244 INFO:tasks.workunit.client.1.smithi139.stdout:0/765: fdatasync d1/da/d1b/dba/df1/fd0 0 2024-09-17T07:20:12.244 INFO:tasks.workunit.client.1.smithi139.stdout:1/897: write d2/d10/d12/d1a/dd7/d49/d8d/fd6 [4861343,35547] 0 2024-09-17T07:20:12.245 INFO:tasks.workunit.client.1.smithi139.stdout:1/898: readlink d2/d10/d12/d13/d4f/d5c/l8e 0 2024-09-17T07:20:12.246 INFO:tasks.workunit.client.1.smithi139.stdout:0/766: rmdir d1/da/d17/db8 39 2024-09-17T07:20:12.248 INFO:tasks.workunit.client.1.smithi139.stdout:1/899: fdatasync d2/d10/d12/d24/f57 0 2024-09-17T07:20:12.248 INFO:tasks.workunit.client.1.smithi139.stdout:0/767: mknod d1/d58/d7d/c110 0 2024-09-17T07:20:12.250 INFO:tasks.workunit.client.1.smithi139.stdout:1/900: mknod d2/d10/d12/d1a/db1/dc7/dbf/c11a 0 2024-09-17T07:20:12.250 INFO:tasks.workunit.client.1.smithi139.stdout:1/901: write d2/f15 [6705786,77820] 0 2024-09-17T07:20:12.251 INFO:tasks.workunit.client.1.smithi139.stdout:0/768: creat d1/da/d1b/d3d/d5a/d98/d10a/f111 x:0 0 0 2024-09-17T07:20:12.253 INFO:tasks.workunit.client.1.smithi139.stdout:0/769: read d1/da/d1b/d3d/d5a/d75/d91/fd5 [3259972,42000] 0 2024-09-17T07:20:12.258 INFO:tasks.workunit.client.1.smithi139.stdout:1/902: dwrite d2/d10/d12/d13/dca/f111 [0,4194304] 0 2024-09-17T07:20:12.260 INFO:tasks.workunit.client.1.smithi139.stdout:0/770: rename d1/da/d1b/d3d/d5a/d75/d93/f10c to d1/da/d1b/d32/d9a/dd6/f112 0 2024-09-17T07:20:12.262 INFO:tasks.workunit.client.1.smithi139.stdout:0/771: dread d1/da/d2a/f2e [0,4194304] 0 2024-09-17T07:20:12.264 INFO:tasks.workunit.client.1.smithi139.stdout:0/772: truncate d1/da/d17/d65/d8b/f9e 6740 0 2024-09-17T07:20:12.267 INFO:tasks.workunit.client.1.smithi139.stdout:0/773: unlink d1/da/d1b/dba/dc5/fcc 0 2024-09-17T07:20:12.269 INFO:tasks.workunit.client.1.smithi139.stdout:1/903: write d2/d10/d12/fa7 [1567558,57549] 0 2024-09-17T07:20:12.274 INFO:tasks.workunit.client.1.smithi139.stdout:0/774: dwrite d1/da/d2a/f62 [4194304,4194304] 0 2024-09-17T07:20:12.277 INFO:tasks.workunit.client.1.smithi139.stdout:0/775: creat d1/da/d2a/da5/f113 x:0 0 0 2024-09-17T07:20:12.279 INFO:tasks.workunit.client.1.smithi139.stdout:1/904: truncate f0 1752489 0 2024-09-17T07:20:12.281 INFO:tasks.workunit.client.1.smithi139.stdout:0/776: fdatasync d1/da/d1b/d3d/d5a/d75/f77 0 2024-09-17T07:20:12.282 INFO:tasks.workunit.client.1.smithi139.stdout:0/777: read d1/da/d1b/d3d/d5a/d75/ffb [3971836,73696] 0 2024-09-17T07:20:12.283 INFO:tasks.workunit.client.1.smithi139.stdout:1/905: creat d2/d10/d12/d1a/dd7/d2b/d4a/f11b x:0 0 0 2024-09-17T07:20:12.285 INFO:tasks.workunit.client.1.smithi139.stdout:1/906: write d2/d10/d12/d1a/dd7/d2b/fc5 [2220234,112116] 0 2024-09-17T07:20:12.287 INFO:tasks.workunit.client.1.smithi139.stdout:0/778: rename d1/d58/cca to d1/da/d1b/dba/c114 0 2024-09-17T07:20:12.291 INFO:tasks.workunit.client.1.smithi139.stdout:1/907: rename d2/f7 to d2/d10/d12/d1a/dd7/d49/d8d/d107/f11c 0 2024-09-17T07:20:12.292 INFO:tasks.workunit.client.1.smithi139.stdout:1/908: write d2/d10/d12/fa7 [1992380,45882] 0 2024-09-17T07:20:12.294 INFO:tasks.workunit.client.1.smithi139.stdout:1/909: mkdir d2/d10/d12/d1a/db1/dc7/d11d 0 2024-09-17T07:20:12.296 INFO:tasks.workunit.client.1.smithi139.stdout:1/910: mkdir d2/d10/d71/d94/d11e 0 2024-09-17T07:20:12.297 INFO:tasks.workunit.client.1.smithi139.stdout:0/779: dwrite d1/da/d1b/db6/fd7 [0,4194304] 0 2024-09-17T07:20:12.298 INFO:tasks.workunit.client.1.smithi139.stdout:1/911: dread - d2/d10/d12/d13/d4f/f87 zero size 2024-09-17T07:20:12.301 INFO:tasks.workunit.client.1.smithi139.stdout:0/780: dread d1/da/d1b/d32/f7a [0,4194304] 0 2024-09-17T07:20:12.302 INFO:tasks.workunit.client.1.smithi139.stdout:1/912: mkdir d2/d10/d12/d1a/db1/dc7/d11f 0 2024-09-17T07:20:12.309 INFO:tasks.workunit.client.1.smithi139.stdout:0/781: dwrite d1/da/d17/d72/f5b [4194304,4194304] 0 2024-09-17T07:20:12.311 INFO:tasks.workunit.client.1.smithi139.stdout:0/782: mknod d1/da/d1b/dba/df1/c115 0 2024-09-17T07:20:12.316 INFO:tasks.workunit.client.1.smithi139.stdout:1/913: dwrite d2/d10/d12/d13/d4f/d5c/d92/fe5 [0,4194304] 0 2024-09-17T07:20:12.318 INFO:tasks.workunit.client.1.smithi139.stdout:1/914: symlink d2/d10/d12/d1a/dd7/d49/d8d/d107/l120 0 2024-09-17T07:20:12.319 INFO:tasks.workunit.client.1.smithi139.stdout:1/915: write d2/f6 [693275,102565] 0 2024-09-17T07:20:12.323 INFO:tasks.workunit.client.1.smithi139.stdout:1/916: mknod d2/d10/d12/d13/d4f/d5c/d74/c121 0 2024-09-17T07:20:12.324 INFO:tasks.workunit.client.1.smithi139.stdout:0/783: write d1/da/d1b/d3d/f64 [4505438,43351] 0 2024-09-17T07:20:12.330 INFO:tasks.workunit.client.1.smithi139.stdout:0/784: write d1/da/d1b/f42 [3599777,119209] 0 2024-09-17T07:20:12.332 INFO:tasks.workunit.client.1.smithi139.stdout:1/917: dread d2/d10/d12/d1a/dd7/d49/f80 [0,4194304] 0 2024-09-17T07:20:12.333 INFO:tasks.workunit.client.1.smithi139.stdout:0/785: symlink d1/da/d1b/d3d/d5a/db2/l116 0 2024-09-17T07:20:12.334 INFO:tasks.workunit.client.1.smithi139.stdout:0/786: chown d1/ffe 29977 1 2024-09-17T07:20:12.334 INFO:tasks.workunit.client.1.smithi139.stdout:1/918: mkdir d2/d10/d12/d1a/dd7/d2b/d122 0 2024-09-17T07:20:12.335 INFO:tasks.workunit.client.1.smithi139.stdout:0/787: readlink d1/da/d17/d72/d66/d6c/lde 0 2024-09-17T07:20:12.338 INFO:tasks.workunit.client.1.smithi139.stdout:0/788: fsync d1/da/d1b/d3d/d5a/d75/f77 0 2024-09-17T07:20:12.339 INFO:tasks.workunit.client.1.smithi139.stdout:0/789: read d1/da/d2a/fd3 [135528,59826] 0 2024-09-17T07:20:12.340 INFO:tasks.workunit.client.1.smithi139.stdout:0/790: readlink d1/lb 0 2024-09-17T07:20:12.340 INFO:tasks.workunit.client.1.smithi139.stdout:0/791: dread - d1/ffe zero size 2024-09-17T07:20:12.342 INFO:tasks.workunit.client.1.smithi139.stdout:1/919: dwrite d2/d10/d12/d13/d4f/d5c/d92/fe5 [4194304,4194304] 0 2024-09-17T07:20:12.346 INFO:tasks.workunit.client.1.smithi139.stdout:0/792: rename d1/da/d2a/c7b to d1/da/d17/d65/d8b/c117 0 2024-09-17T07:20:12.349 INFO:tasks.workunit.client.1.smithi139.stdout:1/920: dwrite d2/fd [0,4194304] 0 2024-09-17T07:20:12.352 INFO:tasks.workunit.client.1.smithi139.stdout:1/921: unlink d2/d10/d12/d1a/dd7/d49/f80 0 2024-09-17T07:20:12.354 INFO:tasks.workunit.client.1.smithi139.stdout:1/922: creat d2/d10/d12/d1a/dd7/d2b/d4a/d6f/f123 x:0 0 0 2024-09-17T07:20:12.356 INFO:tasks.workunit.client.1.smithi139.stdout:1/923: mknod d2/d10/d12/d13/dca/c124 0 2024-09-17T07:20:12.359 INFO:tasks.workunit.client.1.smithi139.stdout:1/924: mkdir d2/d10/d12/d7c/d125 0 2024-09-17T07:20:12.366 INFO:tasks.workunit.client.1.smithi139.stdout:0/793: dread d1/da/f60 [0,4194304] 0 2024-09-17T07:20:12.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:12 smithi139 ceph-mon[34403]: pgmap v19: 65 pgs: 65 active+clean; 4.1 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 137 MiB/s rd, 337 MiB/s wr, 741 op/s 2024-09-17T07:20:12.370 INFO:tasks.workunit.client.1.smithi139.stdout:0/794: mknod d1/da/d17/db8/d104/c118 0 2024-09-17T07:20:12.371 INFO:tasks.workunit.client.1.smithi139.stdout:0/795: write d1/da/f78 [786033,50332] 0 2024-09-17T07:20:12.374 INFO:tasks.workunit.client.1.smithi139.stdout:0/796: mknod d1/da/d17/c119 0 2024-09-17T07:20:12.380 INFO:tasks.workunit.client.1.smithi139.stdout:1/925: dread d2/d10/d12/f31 [0,4194304] 0 2024-09-17T07:20:12.381 INFO:tasks.workunit.client.1.smithi139.stdout:1/926: chown d2/d10/c28 25689 1 2024-09-17T07:20:12.381 INFO:tasks.workunit.client.1.smithi139.stdout:0/797: dwrite d1/da/d1b/d3d/d50/f61 [0,4194304] 0 2024-09-17T07:20:12.385 INFO:tasks.workunit.client.1.smithi139.stdout:1/927: unlink d2/fd 0 2024-09-17T07:20:12.389 INFO:tasks.workunit.client.1.smithi139.stdout:1/928: rename d2/d10/d12/d13/f16 to d2/d10/d12/d13/d4f/d5c/d92/f126 0 2024-09-17T07:20:12.393 INFO:tasks.workunit.client.1.smithi139.stdout:1/929: creat d2/d10/d12/d13/d4f/d5c/f127 x:0 0 0 2024-09-17T07:20:12.394 INFO:tasks.workunit.client.1.smithi139.stdout:0/798: rmdir d1/da/d1b/d32/d9a/d10e 0 2024-09-17T07:20:12.395 INFO:tasks.workunit.client.1.smithi139.stdout:0/799: readlink d1/da/d1b/d3d/le1 0 2024-09-17T07:20:12.400 INFO:tasks.workunit.client.1.smithi139.stdout:1/930: unlink d2/d10/d12/d1a/dd7/d2b/d4a/d6f/c98 0 2024-09-17T07:20:12.409 INFO:tasks.workunit.client.1.smithi139.stdout:0/800: dwrite d1/da/d2a/fd3 [0,4194304] 0 2024-09-17T07:20:12.414 INFO:tasks.workunit.client.1.smithi139.stdout:0/801: rename d1/da/d1b/d32/l2c to d1/da/d1b/l11a 0 2024-09-17T07:20:12.414 INFO:tasks.workunit.client.1.smithi139.stdout:0/802: readlink d1/d58/l71 0 2024-09-17T07:20:12.417 INFO:tasks.workunit.client.1.smithi139.stdout:0/803: link d1/da/d1b/f33 d1/da/d17/db8/d104/f11b 0 2024-09-17T07:20:12.418 INFO:tasks.workunit.client.1.smithi139.stdout:0/804: symlink d1/da/d17/d65/l11c 0 2024-09-17T07:20:12.420 INFO:tasks.workunit.client.1.smithi139.stdout:0/805: mknod d1/d58/c11d 0 2024-09-17T07:20:12.420 INFO:tasks.workunit.client.1.smithi139.stdout:0/806: chown d1/da/d17/d72/f30 414 1 2024-09-17T07:20:12.423 INFO:tasks.workunit.client.1.smithi139.stdout:0/807: rename d1/da/d17/db8/fce to d1/da/d1b/ddb/f11e 0 2024-09-17T07:20:12.425 INFO:tasks.workunit.client.1.smithi139.stdout:0/808: creat d1/da/d17/f11f x:0 0 0 2024-09-17T07:20:12.425 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:12 smithi087 ceph-mon[27636]: pgmap v19: 65 pgs: 65 active+clean; 4.1 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 137 MiB/s rd, 337 MiB/s wr, 741 op/s 2024-09-17T07:20:12.426 INFO:tasks.workunit.client.1.smithi139.stdout:0/809: write d1/da/d17/db8/d104/f11b [2052716,72002] 0 2024-09-17T07:20:12.427 INFO:tasks.workunit.client.1.smithi139.stdout:0/810: readlink d1/da/d17/d72/le2 0 2024-09-17T07:20:12.430 INFO:tasks.workunit.client.1.smithi139.stdout:0/811: truncate d1/da/d1b/d3d/d5a/fb9 987485 0 2024-09-17T07:20:12.438 INFO:tasks.workunit.client.1.smithi139.stdout:0/812: dwrite d1/da/d1b/f33 [0,4194304] 0 2024-09-17T07:20:12.439 INFO:tasks.workunit.client.1.smithi139.stdout:0/813: chown d1/da/d1b/d3d/d5a/ff6 414515447 1 2024-09-17T07:20:12.442 INFO:tasks.workunit.client.1.smithi139.stdout:0/814: mkdir d1/da/d1b/d32/d9a/dd6/d120 0 2024-09-17T07:20:12.443 INFO:tasks.workunit.client.1.smithi139.stdout:0/815: chown d1/da/d1b/dba/dc5/fd1 13 1 2024-09-17T07:20:12.457 INFO:tasks.workunit.client.1.smithi139.stdout:0/816: dread d1/da/f78 [0,4194304] 0 2024-09-17T07:20:12.458 INFO:tasks.workunit.client.1.smithi139.stdout:0/817: chown d1/da/cd 6736213 1 2024-09-17T07:20:12.458 INFO:tasks.workunit.client.1.smithi139.stdout:0/818: read d1/da/d2a/f80 [6577864,100301] 0 2024-09-17T07:20:12.459 INFO:tasks.workunit.client.1.smithi139.stdout:0/819: dread - d1/da/fea zero size 2024-09-17T07:20:12.460 INFO:tasks.workunit.client.1.smithi139.stdout:0/820: fdatasync d1/da/d17/f11f 0 2024-09-17T07:20:12.463 INFO:tasks.workunit.client.1.smithi139.stdout:0/821: creat d1/da/d17/d72/f121 x:0 0 0 2024-09-17T07:20:12.464 INFO:tasks.workunit.client.1.smithi139.stdout:0/822: truncate d1/da/d1b/dba/dc5/fd1 199590 0 2024-09-17T07:20:12.465 INFO:tasks.workunit.client.1.smithi139.stdout:0/823: write d1/da/d1b/d3d/d5a/db2/ff0 [1025218,105326] 0 2024-09-17T07:20:12.470 INFO:tasks.workunit.client.1.smithi139.stdout:0/824: dwrite d1/da/d2a/fd3 [0,4194304] 0 2024-09-17T07:20:12.473 INFO:tasks.workunit.client.1.smithi139.stdout:0/825: creat d1/da/d1b/ddb/f122 x:0 0 0 2024-09-17T07:20:12.475 INFO:tasks.workunit.client.1.smithi139.stdout:0/826: rmdir d1/da/d1b/dba 39 2024-09-17T07:20:12.477 INFO:tasks.workunit.client.1.smithi139.stdout:0/827: creat d1/da/d17/d65/d8b/f123 x:0 0 0 2024-09-17T07:20:12.478 INFO:tasks.workunit.client.1.smithi139.stdout:0/828: truncate d1/da/d1b/d3d/d5a/d75/ffb 5664959 0 2024-09-17T07:20:12.480 INFO:tasks.workunit.client.1.smithi139.stdout:0/829: read d1/da/d1b/d3d/f64 [1423713,22921] 0 2024-09-17T07:20:12.483 INFO:tasks.workunit.client.1.smithi139.stdout:0/830: dread d1/da/d1b/d3d/d5a/d75/ffb [0,4194304] 0 2024-09-17T07:20:12.486 INFO:tasks.workunit.client.1.smithi139.stdout:0/831: creat d1/da/d1b/d32/d9a/dd6/d120/f124 x:0 0 0 2024-09-17T07:20:12.487 INFO:tasks.workunit.client.1.smithi139.stdout:0/832: write d1/da/d1b/d3d/d5a/d75/ffd [219682,68041] 0 2024-09-17T07:20:12.490 INFO:tasks.workunit.client.1.smithi139.stdout:0/833: rename d1/da/d1b/d3d/d50/fef to d1/da/d1b/dba/df1/f125 0 2024-09-17T07:20:12.491 INFO:tasks.workunit.client.1.smithi139.stdout:0/834: read - d1/da/d17/d72/d66/d6c/fc0 zero size 2024-09-17T07:20:12.491 INFO:tasks.workunit.client.1.smithi139.stdout:0/835: readlink d1/da/d1b/d3d/d5a/d98/lf9 0 2024-09-17T07:20:12.494 INFO:tasks.workunit.client.1.smithi139.stdout:0/836: creat d1/da/d1b/f126 x:0 0 0 2024-09-17T07:20:12.496 INFO:tasks.workunit.client.1.smithi139.stdout:0/837: creat d1/da/d17/d72/d66/d6c/f127 x:0 0 0 2024-09-17T07:20:12.497 INFO:tasks.workunit.client.1.smithi139.stdout:0/838: dread - d1/da/d1b/d32/d9a/fe3 zero size 2024-09-17T07:20:12.498 INFO:tasks.workunit.client.1.smithi139.stdout:0/839: symlink d1/da/d17/d72/d66/l128 0 2024-09-17T07:20:12.500 INFO:tasks.workunit.client.1.smithi139.stdout:0/840: truncate d1/da/d2a/f2e 1731969 0 2024-09-17T07:20:12.501 INFO:tasks.workunit.client.1.smithi139.stdout:0/841: mknod d1/d58/c129 0 2024-09-17T07:20:12.504 INFO:tasks.workunit.client.1.smithi139.stdout:0/842: rmdir d1/da/d1b/d3d/d5a/d75/d93/dfc/d105 0 2024-09-17T07:20:12.506 INFO:tasks.workunit.client.1.smithi139.stdout:0/843: symlink d1/da/d1b/dba/de9/l12a 0 2024-09-17T07:20:12.508 INFO:tasks.workunit.client.1.smithi139.stdout:0/844: rename d1/da/d17/d72/l36 to d1/da/d1b/d32/d9a/dd6/d120/l12b 0 2024-09-17T07:20:12.518 INFO:tasks.workunit.client.1.smithi139.stdout:0/845: truncate d1/da/d1b/d32/f37 363756 0 2024-09-17T07:20:12.522 INFO:tasks.workunit.client.1.smithi139.stdout:0/846: write d1/f26 [3043620,101312] 0 2024-09-17T07:20:12.528 INFO:tasks.workunit.client.1.smithi139.stdout:0/847: dwrite d1/da/d17/d72/f121 [0,4194304] 0 2024-09-17T07:20:12.532 INFO:tasks.workunit.client.1.smithi139.stdout:0/848: mknod d1/da/d1b/d32/d9a/dd6/c12c 0 2024-09-17T07:20:12.534 INFO:tasks.workunit.client.1.smithi139.stdout:0/849: truncate d1/da/d1b/d3d/d5a/ff6 126482 0 2024-09-17T07:20:12.535 INFO:tasks.workunit.client.1.smithi139.stdout:0/850: rmdir d1 39 2024-09-17T07:20:12.541 INFO:tasks.workunit.client.1.smithi139.stdout:0/851: dwrite d1/da/d1b/db6/fd7 [0,4194304] 0 2024-09-17T07:20:12.566 INFO:tasks.workunit.client.1.smithi139.stdout:0/852: mkdir d1/da/d17/db8/d104/d12d 0 2024-09-17T07:20:12.590 INFO:tasks.workunit.client.1.smithi139.stdout:0/853: dwrite d1/da/d1b/d3d/d5a/d75/d93/fa1 [0,4194304] 0 2024-09-17T07:20:12.591 INFO:tasks.workunit.client.1.smithi139.stdout:0/854: read d1/da/d1b/d32/f3a [755326,91725] 0 2024-09-17T07:20:12.606 INFO:tasks.workunit.client.1.smithi139.stdout:0/855: truncate d1/da/d1b/d32/f4f 2948259 0 2024-09-17T07:20:12.607 INFO:tasks.workunit.client.1.smithi139.stdout:0/856: write d1/da/d1b/d3d/d50/f96 [3875778,86725] 0 2024-09-17T07:20:12.612 INFO:tasks.workunit.client.1.smithi139.stdout:0/857: creat d1/da/d17/d72/f12e x:0 0 0 2024-09-17T07:20:12.642 INFO:tasks.workunit.client.1.smithi139.stdout:0/858: dread d1/da/d17/d72/f22 [4194304,4194304] 0 2024-09-17T07:20:12.644 INFO:tasks.workunit.client.1.smithi139.stdout:0/859: truncate d1/da/d2a/da5/f113 392474 0 2024-09-17T07:20:12.648 INFO:tasks.workunit.client.1.smithi139.stdout:0/860: fsync d1/da/d17/d65/d8b/f9e 0 2024-09-17T07:20:12.649 INFO:tasks.workunit.client.1.smithi139.stdout:0/861: fsync d1/da/d17/d65/f100 0 2024-09-17T07:20:12.651 INFO:tasks.workunit.client.1.smithi139.stdout:0/862: symlink d1/da/d17/db8/l12f 0 2024-09-17T07:20:12.663 INFO:tasks.workunit.client.1.smithi139.stdout:0/863: write d1/da/d1b/d32/f37 [845787,82732] 0 2024-09-17T07:20:12.672 INFO:tasks.workunit.client.1.smithi139.stdout:0/864: dwrite d1/da/d1b/d3d/d5a/d75/d93/fa1 [4194304,4194304] 0 2024-09-17T07:20:12.698 INFO:tasks.workunit.client.1.smithi139.stdout:1/931: sync 2024-09-17T07:20:12.700 INFO:tasks.workunit.client.1.smithi139.stdout:1/932: creat d2/d10/d12/d13/d4f/d5c/f128 x:0 0 0 2024-09-17T07:20:12.701 INFO:tasks.workunit.client.1.smithi139.stdout:1/933: write d2/d10/d12/d13/d4f/d5c/d92/dab/ddd/f113 [658612,7782] 0 2024-09-17T07:20:12.703 INFO:tasks.workunit.client.1.smithi139.stdout:0/865: dread d1/da/d1b/d3d/f64 [0,4194304] 0 2024-09-17T07:20:12.704 INFO:tasks.workunit.client.1.smithi139.stdout:1/934: chown d2/d10/d12/d1a/dd7/d49/d8d/f101 1 1 2024-09-17T07:20:12.709 INFO:tasks.workunit.client.1.smithi139.stdout:0/866: dwrite d1/da/d1b/dba/dc5/fe6 [0,4194304] 0 2024-09-17T07:20:12.709 INFO:tasks.workunit.client.1.smithi139.stdout:1/935: write d2/d10/d12/d1a/f36 [1310771,46376] 0 2024-09-17T07:20:12.712 INFO:tasks.workunit.client.1.smithi139.stdout:1/936: write d2/d10/d12/d1a/d61/faf [3204986,69995] 0 2024-09-17T07:20:12.712 INFO:tasks.workunit.client.1.smithi139.stdout:0/867: truncate d1/da/d1b/d32/f7a 1987384 0 2024-09-17T07:20:12.714 INFO:tasks.workunit.client.1.smithi139.stdout:1/937: creat d2/d10/d12/d1a/d61/f129 x:0 0 0 2024-09-17T07:20:12.715 INFO:tasks.workunit.client.1.smithi139.stdout:0/868: symlink d1/da/d1b/dba/l130 0 2024-09-17T07:20:12.716 INFO:tasks.workunit.client.1.smithi139.stdout:1/938: fsync d2/d10/d12/d1a/dd7/d2b/d4a/d6f/f110 0 2024-09-17T07:20:12.720 INFO:tasks.workunit.client.1.smithi139.stdout:1/939: mkdir d2/d10/d12a 0 2024-09-17T07:20:12.720 INFO:tasks.workunit.client.1.smithi139.stdout:0/869: dread d1/da/d1b/d3d/d50/f61 [0,4194304] 0 2024-09-17T07:20:12.723 INFO:tasks.workunit.client.1.smithi139.stdout:0/870: rename d1/da/d1b/ddb/f122 to d1/da/d1b/d3d/d5a/d98/d10a/f131 0 2024-09-17T07:20:12.726 INFO:tasks.workunit.client.1.smithi139.stdout:0/871: fdatasync d1/da/d17/d65/d8b/f9e 0 2024-09-17T07:20:12.727 INFO:tasks.workunit.client.1.smithi139.stdout:1/940: dwrite d2/d10/d12/d1a/dd7/d2b/d4a/d6f/f123 [0,4194304] 0 2024-09-17T07:20:12.731 INFO:tasks.workunit.client.1.smithi139.stdout:1/941: symlink d2/d10/d12/d13/dca/l12b 0 2024-09-17T07:20:12.732 INFO:tasks.workunit.client.1.smithi139.stdout:1/942: write d2/d10/d12/d24/f8c [5520075,51174] 0 2024-09-17T07:20:12.733 INFO:tasks.workunit.client.1.smithi139.stdout:0/872: dread d1/da/d1b/d32/d9a/fb3 [0,4194304] 0 2024-09-17T07:20:12.733 INFO:tasks.workunit.client.1.smithi139.stdout:1/943: chown d2/d10/d12 225 1 2024-09-17T07:20:12.734 INFO:tasks.workunit.client.1.smithi139.stdout:1/944: stat d2/d10/f114 0 2024-09-17T07:20:12.734 INFO:tasks.workunit.client.1.smithi139.stdout:0/873: chown d1/da/d1b/d3d/f70 128223 1 2024-09-17T07:20:12.736 INFO:tasks.workunit.client.1.smithi139.stdout:0/874: creat d1/da/d2a/da5/f132 x:0 0 0 2024-09-17T07:20:12.738 INFO:tasks.workunit.client.1.smithi139.stdout:1/945: mknod d2/d10/d12/d1a/dd7/d2b/d4a/d6f/c12c 0 2024-09-17T07:20:12.739 INFO:tasks.workunit.client.1.smithi139.stdout:1/946: rmdir d2/d10/d12/d24/d38/d3d 39 2024-09-17T07:20:12.742 INFO:tasks.workunit.client.1.smithi139.stdout:1/947: rename d2/c2e to d2/d10/d12/d13/d4f/d5c/d92/dab/c12d 0 2024-09-17T07:20:12.747 INFO:tasks.workunit.client.1.smithi139.stdout:1/948: dwrite d2/d10/d12/d1a/db1/ff7 [0,4194304] 0 2024-09-17T07:20:12.749 INFO:tasks.workunit.client.1.smithi139.stdout:1/949: dread d2/d10/d71/d94/fb9 [0,4194304] 0 2024-09-17T07:20:12.756 INFO:tasks.workunit.client.1.smithi139.stdout:1/950: dwrite d2/d10/d12/d13/d4f/d5c/d92/f126 [0,4194304] 0 2024-09-17T07:20:12.758 INFO:tasks.workunit.client.1.smithi139.stdout:1/951: creat d2/f12e x:0 0 0 2024-09-17T07:20:12.759 INFO:tasks.workunit.client.1.smithi139.stdout:1/952: fdatasync d2/d10/d12/d1a/dd7/d2b/d4a/f11b 0 2024-09-17T07:20:12.761 INFO:tasks.workunit.client.1.smithi139.stdout:1/953: stat d2/d10/d12/d24/d38/da6/fdc 0 2024-09-17T07:20:12.761 INFO:tasks.workunit.client.1.smithi139.stdout:1/954: readlink d2/d10/d12/d13/d4f/d5c/d92/l10b 0 2024-09-17T07:20:12.764 INFO:tasks.workunit.client.1.smithi139.stdout:1/955: creat d2/d10/d12/d7c/d125/f12f x:0 0 0 2024-09-17T07:20:12.766 INFO:tasks.workunit.client.1.smithi139.stdout:1/956: creat d2/d10/d12/d1a/dd7/d2b/d4a/f130 x:0 0 0 2024-09-17T07:20:12.767 INFO:tasks.workunit.client.1.smithi139.stdout:1/957: mkdir d2/d10/d12/d24/d38/d131 0 2024-09-17T07:20:12.771 INFO:tasks.workunit.client.1.smithi139.stdout:1/958: dread d2/d10/d12/d1a/dd7/d49/d8d/ff4 [0,4194304] 0 2024-09-17T07:20:12.777 INFO:tasks.workunit.client.1.smithi139.stdout:1/959: creat d2/d10/d12/f132 x:0 0 0 2024-09-17T07:20:12.777 INFO:tasks.workunit.client.1.smithi139.stdout:1/960: mknod d2/d10/d12/d13/dca/d10c/c133 0 2024-09-17T07:20:12.777 INFO:tasks.workunit.client.1.smithi139.stdout:1/961: chown d2/d10/d12/d1a/db1 182220387 1 2024-09-17T07:20:12.777 INFO:tasks.workunit.client.1.smithi139.stdout:1/962: chown d2/d10/d12/d1a/dd7/d2b/f9f 0 1 2024-09-17T07:20:12.780 INFO:tasks.workunit.client.1.smithi139.stdout:1/963: link d2/d10/d12/d24/d38/da6/lc4 d2/d10/d12/d24/d38/da6/l134 0 2024-09-17T07:20:12.786 INFO:tasks.workunit.client.1.smithi139.stdout:1/964: dwrite d2/d10/d12/d1a/dd7/d49/d8d/ff4 [0,4194304] 0 2024-09-17T07:20:12.792 INFO:tasks.workunit.client.1.smithi139.stdout:1/965: rename d2/d10/d12/d1a/dd7/d49/d8d/d107/l120 to d2/d10/d12/d1a/db1/l135 0 2024-09-17T07:20:12.794 INFO:tasks.workunit.client.1.smithi139.stdout:1/966: creat d2/d10/d12a/f136 x:0 0 0 2024-09-17T07:20:12.795 INFO:tasks.workunit.client.1.smithi139.stdout:1/967: fsync d2/d10/d12/d13/d4f/d5c/ffd 0 2024-09-17T07:20:12.798 INFO:tasks.workunit.client.1.smithi139.stdout:1/968: creat d2/d10/d12/d24/d38/d3d/d117/f137 x:0 0 0 2024-09-17T07:20:12.799 INFO:tasks.workunit.client.1.smithi139.stdout:1/969: chown d2/d10/d12/d1a/c1c 3 1 2024-09-17T07:20:12.809 INFO:tasks.workunit.client.1.smithi139.stdout:1/970: write d2/d10/d12/d1a/dd7/f44 [660837,56423] 0 2024-09-17T07:20:12.811 INFO:tasks.workunit.client.1.smithi139.stdout:1/971: mkdir d2/d138 0 2024-09-17T07:20:12.816 INFO:tasks.workunit.client.1.smithi139.stdout:1/972: dwrite d2/d10/d12/d1a/dd7/d2b/d4a/f130 [0,4194304] 0 2024-09-17T07:20:12.821 INFO:tasks.workunit.client.1.smithi139.stdout:1/973: dwrite d2/f6 [0,4194304] 0 2024-09-17T07:20:12.824 INFO:tasks.workunit.client.1.smithi139.stdout:1/974: mknod d2/d138/c139 0 2024-09-17T07:20:12.827 INFO:tasks.workunit.client.1.smithi139.stdout:1/975: creat d2/d10/d115/f13a x:0 0 0 2024-09-17T07:20:12.830 INFO:tasks.workunit.client.1.smithi139.stdout:1/976: creat d2/d10/d12/d1a/dd7/d49/d8b/d103/f13b x:0 0 0 2024-09-17T07:20:12.832 INFO:tasks.workunit.client.1.smithi139.stdout:1/977: readlink d2/d10/d71/d94/la1 0 2024-09-17T07:20:12.835 INFO:tasks.workunit.client.1.smithi139.stdout:1/978: mknod d2/d10/d12/d1a/dd7/d49/c13c 0 2024-09-17T07:20:12.835 INFO:tasks.workunit.client.1.smithi139.stdout:1/979: chown d2/d10/db4 2858 1 2024-09-17T07:20:12.837 INFO:tasks.workunit.client.1.smithi139.stdout:1/980: write d2/d10/d12/d1a/dd7/f44 [2270198,85396] 0 2024-09-17T07:20:12.838 INFO:tasks.workunit.client.1.smithi139.stdout:1/981: chown d2/d10/d12/f88 24 1 2024-09-17T07:20:12.840 INFO:tasks.workunit.client.1.smithi139.stdout:1/982: unlink d2/d10/d12/d1a/dd7/d2b/c68 0 2024-09-17T07:20:12.841 INFO:tasks.workunit.client.1.smithi139.stdout:1/983: readlink d2/d10/d12/d1a/d61/le0 0 2024-09-17T07:20:12.842 INFO:tasks.workunit.client.1.smithi139.stdout:1/984: dread - d2/d10/d71/f118 zero size 2024-09-17T07:20:12.844 INFO:tasks.workunit.client.1.smithi139.stdout:1/985: mkdir d2/d10/d13d 0 2024-09-17T07:20:12.849 INFO:tasks.workunit.client.1.smithi139.stdout:1/986: read d2/d10/d12/d13/d4f/d5c/d74/fbe [2224537,78447] 0 2024-09-17T07:20:12.854 INFO:tasks.workunit.client.1.smithi139.stdout:1/987: dwrite d2/d10/d12/d13/d4f/d5c/f127 [0,4194304] 0 2024-09-17T07:20:12.863 INFO:tasks.workunit.client.1.smithi139.stdout:1/988: dwrite d2/d10/d12/d24/db2/fcf [4194304,4194304] 0 2024-09-17T07:20:12.865 INFO:tasks.workunit.client.1.smithi139.stdout:1/989: creat d2/d10/d12/d1a/dd7/d2b/d4a/f13e x:0 0 0 2024-09-17T07:20:12.867 INFO:tasks.workunit.client.1.smithi139.stdout:1/990: dread - d2/d10/d12/d1a/dd7/d2b/f10f zero size 2024-09-17T07:20:12.874 INFO:tasks.workunit.client.1.smithi139.stdout:1/991: dwrite d2/f91 [4194304,4194304] 0 2024-09-17T07:20:12.876 INFO:tasks.workunit.client.1.smithi139.stdout:1/992: mkdir d2/d10/d12/d1a/db1/dc7/d13f 0 2024-09-17T07:20:12.877 INFO:tasks.workunit.client.1.smithi139.stdout:1/993: stat d2/d10/d71 0 2024-09-17T07:20:12.888 INFO:tasks.workunit.client.1.smithi139.stdout:1/994: dwrite d2/d10/d12/d1a/dd7/d49/d8d/ffa [0,4194304] 0 2024-09-17T07:20:12.890 INFO:tasks.workunit.client.1.smithi139.stdout:1/995: readlink d2/d10/d12/d24/l5a 0 2024-09-17T07:20:12.892 INFO:tasks.workunit.client.1.smithi139.stdout:1/996: mkdir d2/d10/d71/d94/d11e/d140 0 2024-09-17T07:20:12.894 INFO:tasks.workunit.client.1.smithi139.stdout:1/997: mknod d2/d10/d12/d1a/dd7/d2b/c141 0 2024-09-17T07:20:12.900 INFO:tasks.workunit.client.1.smithi139.stdout:1/998: dwrite d2/d10/d12/d1a/dd7/d2b/d4a/d6f/f110 [0,4194304] 0 2024-09-17T07:20:12.902 INFO:tasks.workunit.client.1.smithi139.stdout:1/999: rmdir d2/d10/d115 39 2024-09-17T07:20:13.093 INFO:tasks.workunit.client.1.smithi139.stdout:0/875: sync 2024-09-17T07:20:13.094 INFO:tasks.workunit.client.1.smithi139.stdout:0/876: mkdir d1/da/d1b/ddb/d133 0 2024-09-17T07:20:13.095 INFO:tasks.workunit.client.1.smithi139.stdout:0/877: creat d1/da/d2a/da5/f134 x:0 0 0 2024-09-17T07:20:13.103 INFO:tasks.workunit.client.1.smithi139.stdout:0/878: dwrite d1/da/d2a/f38 [4194304,4194304] 0 2024-09-17T07:20:13.110 INFO:tasks.workunit.client.1.smithi139.stdout:0/879: dwrite d1/da/d17/d72/f121 [0,4194304] 0 2024-09-17T07:20:13.112 INFO:tasks.workunit.client.1.smithi139.stdout:0/880: symlink d1/da/d1b/d3d/d5a/db2/l135 0 2024-09-17T07:20:13.115 INFO:tasks.workunit.client.1.smithi139.stdout:0/881: mknod d1/da/d2a/da5/c136 0 2024-09-17T07:20:13.118 INFO:tasks.workunit.client.1.smithi139.stdout:0/882: fsync d1/da/d1b/d32/d9a/dd6/f112 0 2024-09-17T07:20:13.135 INFO:tasks.workunit.client.1.smithi139.stdout:0/883: dread d1/da/d1b/d3d/d5a/d75/f77 [0,4194304] 0 2024-09-17T07:20:13.138 INFO:tasks.workunit.client.1.smithi139.stdout:0/884: symlink d1/da/d17/d72/l137 0 2024-09-17T07:20:13.143 INFO:tasks.workunit.client.1.smithi139.stdout:0/885: dwrite d1/da/d1b/dba/df1/fd0 [4194304,4194304] 0 2024-09-17T07:20:13.146 INFO:tasks.workunit.client.1.smithi139.stdout:0/886: creat d1/da/d17/db8/d104/d12d/f138 x:0 0 0 2024-09-17T07:20:13.147 INFO:tasks.workunit.client.1.smithi139.stdout:0/887: fdatasync d1/da/d1b/db6/fd7 0 2024-09-17T07:20:13.159 INFO:tasks.workunit.client.1.smithi139.stdout:0/888: dwrite d1/f7c [0,4194304] 0 2024-09-17T07:20:13.161 INFO:tasks.workunit.client.1.smithi139.stdout:0/889: stat d1/d58/c8e 0 2024-09-17T07:20:13.164 INFO:tasks.workunit.client.1.smithi139.stdout:0/890: creat d1/da/d1b/f139 x:0 0 0 2024-09-17T07:20:13.168 INFO:tasks.workunit.client.1.smithi139.stdout:0/891: link d1/da/d17/d72/c7e d1/da/d1b/db6/c13a 0 2024-09-17T07:20:13.169 INFO:tasks.workunit.client.1.smithi139.stdout:0/892: write d1/da/d17/d65/f100 [798188,108098] 0 2024-09-17T07:20:13.171 INFO:tasks.workunit.client.1.smithi139.stdout:0/893: unlink d1/da/d1b/d32/c56 0 2024-09-17T07:20:13.177 INFO:tasks.workunit.client.1.smithi139.stdout:0/894: dwrite d1/da/d1b/d32/f3a [0,4194304] 0 2024-09-17T07:20:13.183 INFO:tasks.workunit.client.1.smithi139.stdout:0/895: write d1/da/d2a/f80 [6960731,104146] 0 2024-09-17T07:20:13.184 INFO:tasks.workunit.client.1.smithi139.stdout:0/896: stat d1/da/cbf 0 2024-09-17T07:20:13.184 INFO:tasks.workunit.client.1.smithi139.stdout:0/897: stat d1/f3 0 2024-09-17T07:20:13.185 INFO:tasks.workunit.client.1.smithi139.stdout:0/898: write d1/da/d17/d72/d66/f89 [38449,80542] 0 2024-09-17T07:20:13.187 INFO:tasks.workunit.client.1.smithi139.stdout:0/899: mkdir d1/da/d1b/ddb/d13b 0 2024-09-17T07:20:13.190 INFO:tasks.workunit.client.1.smithi139.stdout:0/900: rename d1/da/d17/d72/f22 to d1/da/f13c 0 2024-09-17T07:20:13.196 INFO:tasks.workunit.client.1.smithi139.stdout:0/901: dwrite d1/da/d1b/d32/d9a/fe3 [0,4194304] 0 2024-09-17T07:20:13.198 INFO:tasks.workunit.client.1.smithi139.stdout:0/902: write d1/da/d1b/d3d/d5a/ff6 [715195,111526] 0 2024-09-17T07:20:13.199 INFO:tasks.workunit.client.1.smithi139.stdout:0/903: read - d1/da/d17/d72/d66/d6c/f127 zero size 2024-09-17T07:20:13.201 INFO:tasks.workunit.client.1.smithi139.stdout:0/904: write d1/da/d17/f9f [3854587,43677] 0 2024-09-17T07:20:13.203 INFO:tasks.workunit.client.1.smithi139.stdout:0/905: mknod d1/d58/c13d 0 2024-09-17T07:20:13.205 INFO:tasks.workunit.client.1.smithi139.stdout:0/906: creat d1/da/d1b/d32/d9a/dd6/d120/f13e x:0 0 0 2024-09-17T07:20:13.208 INFO:tasks.workunit.client.1.smithi139.stdout:0/907: link d1/da/d17/d65/c76 d1/da/d1b/ddb/d133/c13f 0 2024-09-17T07:20:13.209 INFO:tasks.workunit.client.1.smithi139.stdout:0/908: creat d1/da/d1b/d3d/f140 x:0 0 0 2024-09-17T07:20:13.212 INFO:tasks.workunit.client.1.smithi139.stdout:0/909: dread d1/da/d1b/dba/dc5/fd1 [0,4194304] 0 2024-09-17T07:20:13.213 INFO:tasks.workunit.client.1.smithi139.stdout:0/910: creat d1/da/d1b/d3d/d5a/d98/d10a/f141 x:0 0 0 2024-09-17T07:20:13.214 INFO:tasks.workunit.client.1.smithi139.stdout:0/911: chown d1/da/d17 2 1 2024-09-17T07:20:13.217 INFO:tasks.workunit.client.1.smithi139.stdout:0/912: rename d1/da/d17/d72/d66/d6c/fc0 to d1/da/d1b/d32/d81/f142 0 2024-09-17T07:20:13.223 INFO:tasks.workunit.client.1.smithi139.stdout:0/913: dwrite d1/da/d17/d72/f5b [0,4194304] 0 2024-09-17T07:20:13.224 INFO:tasks.workunit.client.1.smithi139.stdout:0/914: write d1/da/f14 [613245,23404] 0 2024-09-17T07:20:13.232 INFO:tasks.workunit.client.1.smithi139.stdout:0/915: dwrite d1/da/d17/d65/f85 [4194304,4194304] 0 2024-09-17T07:20:13.235 INFO:tasks.workunit.client.1.smithi139.stdout:0/916: creat d1/da/d17/d65/d8b/f143 x:0 0 0 2024-09-17T07:20:13.237 INFO:tasks.workunit.client.1.smithi139.stdout:0/917: read d1/da/d17/db8/d104/f11b [1912901,99952] 0 2024-09-17T07:20:13.245 INFO:tasks.workunit.client.1.smithi139.stdout:0/918: dread d1/da/d1b/d3d/fe4 [0,4194304] 0 2024-09-17T07:20:13.246 INFO:tasks.workunit.client.1.smithi139.stdout:0/919: creat d1/da/d1b/d3d/d5a/f144 x:0 0 0 2024-09-17T07:20:13.248 INFO:tasks.workunit.client.1.smithi139.stdout:0/920: creat d1/da/d17/d72/d66/f145 x:0 0 0 2024-09-17T07:20:13.249 INFO:tasks.workunit.client.1.smithi139.stdout:0/921: creat d1/da/d2a/da5/f146 x:0 0 0 2024-09-17T07:20:13.252 INFO:tasks.workunit.client.1.smithi139.stdout:0/922: rename d1/da/d2a/c8f to d1/da/d1b/d32/d9a/dd6/c147 0 2024-09-17T07:20:13.260 INFO:tasks.workunit.client.1.smithi139.stdout:0/923: dwrite d1/da/d17/d65/d8b/f9e [0,4194304] 0 2024-09-17T07:20:13.266 INFO:tasks.workunit.client.1.smithi139.stdout:0/924: dwrite d1/da/d1b/d32/f35 [4194304,4194304] 0 2024-09-17T07:20:13.283 INFO:tasks.workunit.client.1.smithi139.stdout:0/925: dwrite d1/da/d17/d72/d66/fdd [0,4194304] 0 2024-09-17T07:20:13.286 INFO:tasks.workunit.client.1.smithi139.stdout:0/926: rename d1/da/d1b/l1a to d1/da/d1b/dba/df1/l148 0 2024-09-17T07:20:13.290 INFO:tasks.workunit.client.1.smithi139.stdout:0/927: dread d1/da/d1b/d3d/d5a/d75/f77 [0,4194304] 0 2024-09-17T07:20:13.293 INFO:tasks.workunit.client.1.smithi139.stdout:0/928: rename d1/da/d17/d65/f100 to d1/da/d1b/dba/df1/f149 0 2024-09-17T07:20:13.296 INFO:tasks.workunit.client.1.smithi139.stdout:0/929: link d1/da/f14 d1/da/d17/d65/f14a 0 2024-09-17T07:20:13.297 INFO:tasks.workunit.client.1.smithi139.stdout:0/930: dread d1/da/d1b/dba/df1/f125 [0,4194304] 0 2024-09-17T07:20:13.298 INFO:tasks.workunit.client.1.smithi139.stdout:0/931: chown d1/da/d2a/l54 57066984 1 2024-09-17T07:20:13.298 INFO:tasks.workunit.client.1.smithi139.stdout:0/932: chown d1/da/d1b/d3d/d5a/l108 211385 1 2024-09-17T07:20:13.304 INFO:tasks.workunit.client.1.smithi139.stdout:0/933: dwrite d1/da/d1b/d3d/d5a/f144 [0,4194304] 0 2024-09-17T07:20:13.310 INFO:tasks.workunit.client.1.smithi139.stdout:0/934: dwrite d1/da/d1b/d3d/d5a/db2/ff0 [0,4194304] 0 2024-09-17T07:20:13.314 INFO:tasks.workunit.client.1.smithi139.stdout:0/935: truncate d1/da/d1b/d3d/f70 4620311 0 2024-09-17T07:20:13.328 INFO:tasks.workunit.client.1.smithi139.stdout:0/936: truncate d1/da/d1b/d3d/d50/f96 3307115 0 2024-09-17T07:20:13.543 INFO:tasks.workunit.client.1.smithi139.stdout:0/937: sync 2024-09-17T07:20:13.544 INFO:tasks.workunit.client.1.smithi139.stdout:0/938: fdatasync d1/da/d1b/f42 0 2024-09-17T07:20:13.555 INFO:tasks.workunit.client.1.smithi139.stdout:0/939: dwrite d1/da/d1b/d3d/d5a/db2/ff0 [0,4194304] 0 2024-09-17T07:20:13.588 INFO:tasks.workunit.client.1.smithi139.stdout:0/940: rmdir d1/da/d2a 39 2024-09-17T07:20:13.590 INFO:tasks.workunit.client.1.smithi139.stdout:0/941: mknod d1/da/d1b/d32/d9a/dd6/d120/c14b 0 2024-09-17T07:20:13.591 INFO:tasks.workunit.client.1.smithi139.stdout:0/942: creat d1/da/d1b/dba/df1/f14c x:0 0 0 2024-09-17T07:20:13.593 INFO:tasks.workunit.client.1.smithi139.stdout:0/943: mkdir d1/d58/d14d 0 2024-09-17T07:20:13.594 INFO:tasks.workunit.client.1.smithi139.stdout:0/944: chown d1/da/d17/d65/f14a 1 1 2024-09-17T07:20:13.595 INFO:tasks.workunit.client.1.smithi139.stdout:0/945: write d1/da/d1b/d3d/d50/f61 [2340196,75919] 0 2024-09-17T07:20:13.597 INFO:tasks.workunit.client.1.smithi139.stdout:0/946: truncate d1/da/d1b/dba/dc5/fd1 151623 0 2024-09-17T07:20:13.600 INFO:tasks.workunit.client.1.smithi139.stdout:0/947: dread d1/da/f78 [0,4194304] 0 2024-09-17T07:20:13.605 INFO:tasks.workunit.client.1.smithi139.stdout:0/948: creat d1/da/d17/db8/f14e x:0 0 0 2024-09-17T07:20:13.605 INFO:tasks.workunit.client.1.smithi139.stdout:0/949: dread - d1/da/d2a/da5/f134 zero size 2024-09-17T07:20:13.605 INFO:tasks.workunit.client.1.smithi139.stdout:0/950: symlink d1/da/d1b/ddb/l14f 0 2024-09-17T07:20:13.605 INFO:tasks.workunit.client.1.smithi139.stdout:0/951: chown d1/da/d1b/db6/fd7 325476 1 2024-09-17T07:20:13.607 INFO:tasks.workunit.client.1.smithi139.stdout:0/952: rmdir d1/da/d1b/dba 39 2024-09-17T07:20:13.611 INFO:tasks.workunit.client.1.smithi139.stdout:0/953: unlink d1/da/d17/d72/c7e 0 2024-09-17T07:20:13.611 INFO:tasks.workunit.client.1.smithi139.stdout:0/954: chown d1/da/d17/db8/d104/d12d/f138 129731 1 2024-09-17T07:20:13.612 INFO:tasks.workunit.client.1.smithi139.stdout:0/955: stat d1/da/d2a/da5 0 2024-09-17T07:20:13.613 INFO:tasks.workunit.client.1.smithi139.stdout:0/956: write d1/da/d17/f9f [2048027,60614] 0 2024-09-17T07:20:13.615 INFO:tasks.workunit.client.1.smithi139.stdout:0/957: mkdir d1/da/d17/d72/d150 0 2024-09-17T07:20:13.616 INFO:tasks.workunit.client.1.smithi139.stdout:0/958: read - d1/da/d17/d72/d66/f106 zero size 2024-09-17T07:20:13.618 INFO:tasks.workunit.client.1.smithi139.stdout:0/959: creat d1/da/d1b/dba/df1/f151 x:0 0 0 2024-09-17T07:20:13.620 INFO:tasks.workunit.client.1.smithi139.stdout:0/960: creat d1/da/d1b/db6/f152 x:0 0 0 2024-09-17T07:20:13.620 INFO:tasks.workunit.client.1.smithi139.stdout:0/961: chown d1/da/d1b/db6 13055185 1 2024-09-17T07:20:13.621 INFO:tasks.workunit.client.1.smithi139.stdout:0/962: read d1/da/d17/d65/f6e [16522,37759] 0 2024-09-17T07:20:13.622 INFO:tasks.workunit.client.1.smithi139.stdout:0/963: dread d1/da/d1b/d3d/fe4 [0,4194304] 0 2024-09-17T07:20:13.624 INFO:tasks.workunit.client.1.smithi139.stdout:0/964: unlink d1/da/d17/d72/d66/fdd 0 2024-09-17T07:20:13.661 INFO:tasks.workunit.client.1.smithi139.stdout:0/965: dwrite d1/da/d1b/d32/f4f [0,4194304] 0 2024-09-17T07:20:13.663 INFO:tasks.workunit.client.1.smithi139.stdout:0/966: creat d1/da/d17/db8/f153 x:0 0 0 2024-09-17T07:20:13.675 INFO:tasks.workunit.client.1.smithi139.stdout:0/967: dwrite d1/da/d1b/dba/dc5/fd1 [0,4194304] 0 2024-09-17T07:20:13.677 INFO:tasks.workunit.client.1.smithi139.stdout:0/968: creat d1/da/d1b/d3d/d50/f154 x:0 0 0 2024-09-17T07:20:13.679 INFO:tasks.workunit.client.1.smithi139.stdout:0/969: mkdir d1/da/d1b/d3d/d5a/d75/d91/d92/d155 0 2024-09-17T07:20:13.681 INFO:tasks.workunit.client.1.smithi139.stdout:0/970: mknod d1/da/d1b/d32/d9a/c156 0 2024-09-17T07:20:13.702 INFO:tasks.workunit.client.1.smithi139.stdout:0/971: dwrite d1/da/d17/db8/d104/f11b [0,4194304] 0 2024-09-17T07:20:13.710 INFO:tasks.workunit.client.1.smithi139.stdout:0/972: dwrite d1/da/d1b/dba/dc5/fe6 [0,4194304] 0 2024-09-17T07:20:13.712 INFO:tasks.workunit.client.1.smithi139.stdout:0/973: write d1/da/d1b/d3d/f64 [1614695,66484] 0 2024-09-17T07:20:13.715 INFO:tasks.workunit.client.1.smithi139.stdout:0/974: mkdir d1/da/d1b/d32/d9a/dd6/d120/d157 0 2024-09-17T07:20:13.718 INFO:tasks.workunit.client.1.smithi139.stdout:0/975: mknod d1/da/d1b/d3d/d5a/d75/d93/dfc/c158 0 2024-09-17T07:20:13.720 INFO:tasks.workunit.client.1.smithi139.stdout:0/976: read - d1/da/d1b/d3d/d5a/d75/d93/fdf zero size 2024-09-17T07:20:13.721 INFO:tasks.workunit.client.1.smithi139.stdout:0/977: write d1/da/d1b/d3d/d50/f55 [2440682,93334] 0 2024-09-17T07:20:13.723 INFO:tasks.workunit.client.1.smithi139.stdout:0/978: symlink d1/da/d1b/d3d/d5a/d75/d91/d92/d155/l159 0 2024-09-17T07:20:13.724 INFO:tasks.workunit.client.1.smithi139.stdout:0/979: chown d1/da/d17/d72/d66/d6c/lde 803958 1 2024-09-17T07:20:13.729 INFO:tasks.workunit.client.1.smithi139.stdout:0/980: dwrite d1/da/f13c [4194304,4194304] 0 2024-09-17T07:20:13.730 INFO:tasks.workunit.client.1.smithi139.stdout:0/981: dread - d1/da/d1b/dba/f107 zero size 2024-09-17T07:20:13.733 INFO:tasks.workunit.client.1.smithi139.stdout:0/982: creat d1/da/d1b/d3d/d5a/d75/d91/f15a x:0 0 0 2024-09-17T07:20:13.736 INFO:tasks.workunit.client.1.smithi139.stdout:0/983: mknod d1/da/d1b/d3d/d5a/d75/d91/d92/c15b 0 2024-09-17T07:20:13.739 INFO:tasks.workunit.client.1.smithi139.stdout:0/984: creat d1/da/d1b/d32/d9a/dd6/f15c x:0 0 0 2024-09-17T07:20:13.742 INFO:tasks.workunit.client.1.smithi139.stdout:0/985: rename d1/da/d17/db8/d104/d12d/f138 to d1/da/d1b/d3d/d5a/d75/d93/dfc/f15d 0 2024-09-17T07:20:13.743 INFO:tasks.workunit.client.1.smithi139.stdout:0/986: chown d1/da/d1b/d3d/d5a/d75/d91/d92/ca6 597230 1 2024-09-17T07:20:13.744 INFO:tasks.workunit.client.1.smithi139.stdout:0/987: rmdir d1/da/d1b/d32/d81 39 2024-09-17T07:20:13.750 INFO:tasks.workunit.client.1.smithi139.stdout:0/988: truncate d1/da/d1b/d3d/d5a/d75/d93/fa1 3178072 0 2024-09-17T07:20:13.760 INFO:tasks.workunit.client.1.smithi139.stdout:0/989: dread d1/da/d1b/d3d/f95 [0,4194304] 0 2024-09-17T07:20:13.762 INFO:tasks.workunit.client.1.smithi139.stdout:0/990: mkdir d1/da/d1b/d3d/d5a/d98/d15e 0 2024-09-17T07:20:13.762 INFO:tasks.workunit.client.1.smithi139.stdout:0/991: chown d1/l8 65227 1 2024-09-17T07:20:13.764 INFO:tasks.workunit.client.1.smithi139.stdout:0/992: mkdir d1/da/d1b/d32/d9a/dd6/d120/d15f 0 2024-09-17T07:20:13.767 INFO:tasks.workunit.client.1.smithi139.stdout:0/993: link d1/da/d1b/d32/d9a/c156 d1/da/d17/c160 0 2024-09-17T07:20:13.778 INFO:tasks.workunit.client.1.smithi139.stdout:0/994: dwrite d1/da/d2a/f2e [0,4194304] 0 2024-09-17T07:20:13.785 INFO:tasks.workunit.client.1.smithi139.stdout:0/995: dwrite d1/da/f78 [0,4194304] 0 2024-09-17T07:20:13.790 INFO:tasks.workunit.client.1.smithi139.stdout:0/996: creat d1/da/d1b/d32/d9a/dd6/d120/d157/f161 x:0 0 0 2024-09-17T07:20:13.791 INFO:tasks.workunit.client.1.smithi139.stdout:0/997: truncate d1/da/d17/d72/d66/f145 461812 0 2024-09-17T07:20:13.793 INFO:tasks.workunit.client.1.smithi139.stdout:0/998: truncate d1/da/d1b/d3d/f140 97888 0 2024-09-17T07:20:13.797 INFO:tasks.workunit.client.1.smithi139.stdout:0/999: dread d1/da/d1b/d3d/d5a/db2/ff0 [0,4194304] 0 2024-09-17T07:20:13.802 INFO:tasks.workunit.client.1.smithi139.stderr:+ rm -rf -- ./tmp.KTEkRAiRQN 2024-09-17T07:20:14.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:14 smithi087 ceph-mon[27636]: pgmap v20: 65 pgs: 65 active+clean; 4.1 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 85 MiB/s rd, 203 MiB/s wr, 465 op/s 2024-09-17T07:20:14.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:14 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:20:14.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:14 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:20:14.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:14 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-17T07:20:14.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:14 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-17T07:20:14.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:14 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-17T07:20:14.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:14 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:20:14.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:14 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:20:14.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:14 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:20:14.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:14 smithi139 ceph-mon[34403]: pgmap v20: 65 pgs: 65 active+clean; 4.1 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 85 MiB/s rd, 203 MiB/s wr, 465 op/s 2024-09-17T07:20:14.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:14 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:20:14.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:14 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:20:14.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:14 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-17T07:20:14.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:14 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-17T07:20:14.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:14 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-17T07:20:14.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:14 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:20:14.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:14 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:20:14.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:14 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:20:15.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:15 smithi087 ceph-mon[27636]: Adjusting osd_memory_target on smithi139 to 2581M 2024-09-17T07:20:15.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:15 smithi087 ceph-mon[27636]: Updating smithi087:/etc/ceph/ceph.conf 2024-09-17T07:20:15.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:15 smithi087 ceph-mon[27636]: Updating smithi139:/etc/ceph/ceph.conf 2024-09-17T07:20:15.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:15 smithi087 ceph-mon[27636]: Updating smithi087:/var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T07:20:15.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:15 smithi087 ceph-mon[27636]: Updating smithi139:/var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T07:20:15.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:15 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:20:15.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:15 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:20:15.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:15 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:20:15.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:15 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:20:15.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:15 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:20:15.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:15 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:20:15.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:15 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:20:15.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:15 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:20:15.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:15 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:20:15.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:15 smithi139 ceph-mon[34403]: Adjusting osd_memory_target on smithi139 to 2581M 2024-09-17T07:20:15.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:15 smithi139 ceph-mon[34403]: Updating smithi087:/etc/ceph/ceph.conf 2024-09-17T07:20:15.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:15 smithi139 ceph-mon[34403]: Updating smithi139:/etc/ceph/ceph.conf 2024-09-17T07:20:15.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:15 smithi139 ceph-mon[34403]: Updating smithi087:/var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T07:20:15.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:15 smithi139 ceph-mon[34403]: Updating smithi139:/var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T07:20:15.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:15 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:20:15.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:15 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:20:15.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:15 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:20:15.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:15 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:20:15.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:15 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:20:15.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:15 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:20:15.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:15 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:20:15.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:15 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:20:15.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:15 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:20:16.408 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:16 smithi087 ceph-mon[27636]: Updating smithi087:/etc/ceph/ceph.client.admin.keyring 2024-09-17T07:20:16.408 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:16 smithi087 ceph-mon[27636]: Updating smithi139:/etc/ceph/ceph.client.admin.keyring 2024-09-17T07:20:16.408 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:16 smithi087 ceph-mon[27636]: Updating smithi087:/var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T07:20:16.408 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:16 smithi087 ceph-mon[27636]: Updating smithi139:/var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T07:20:16.408 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:16 smithi087 ceph-mon[27636]: Reconfiguring node-exporter.smithi087 (dependencies changed)... 2024-09-17T07:20:16.408 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:16 smithi087 ceph-mon[27636]: Reconfiguring daemon node-exporter.smithi087 on smithi087 2024-09-17T07:20:16.408 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:16 smithi087 ceph-mon[27636]: pgmap v21: 65 pgs: 65 active+clean; 4.1 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 85 MiB/s rd, 203 MiB/s wr, 465 op/s 2024-09-17T07:20:16.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:16 smithi139 ceph-mon[34403]: Updating smithi087:/etc/ceph/ceph.client.admin.keyring 2024-09-17T07:20:16.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:16 smithi139 ceph-mon[34403]: Updating smithi139:/etc/ceph/ceph.client.admin.keyring 2024-09-17T07:20:16.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:16 smithi139 ceph-mon[34403]: Updating smithi087:/var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T07:20:16.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:16 smithi139 ceph-mon[34403]: Updating smithi139:/var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T07:20:16.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:16 smithi139 ceph-mon[34403]: Reconfiguring node-exporter.smithi087 (dependencies changed)... 2024-09-17T07:20:16.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:16 smithi139 ceph-mon[34403]: Reconfiguring daemon node-exporter.smithi087 on smithi087 2024-09-17T07:20:16.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:16 smithi139 ceph-mon[34403]: pgmap v21: 65 pgs: 65 active+clean; 4.1 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 85 MiB/s rd, 203 MiB/s wr, 465 op/s 2024-09-17T07:20:18.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:18 smithi139 ceph-mon[34403]: pgmap v22: 65 pgs: 65 active+clean; 3.3 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 93 MiB/s rd, 234 MiB/s wr, 611 op/s 2024-09-17T07:20:18.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:18 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:20:18.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:18 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:20:18.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:18 smithi139 ceph-mon[34403]: Reconfiguring alertmanager.smithi087 (dependencies changed)... 2024-09-17T07:20:18.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:18 smithi139 ceph-mon[34403]: Reconfiguring daemon alertmanager.smithi087 on smithi087 2024-09-17T07:20:18.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:18 smithi087 ceph-mon[27636]: pgmap v22: 65 pgs: 65 active+clean; 3.3 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 93 MiB/s rd, 234 MiB/s wr, 611 op/s 2024-09-17T07:20:18.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:18 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:20:18.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:18 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:20:18.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:18 smithi087 ceph-mon[27636]: Reconfiguring alertmanager.smithi087 (dependencies changed)... 2024-09-17T07:20:18.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:18 smithi087 ceph-mon[27636]: Reconfiguring daemon alertmanager.smithi087 on smithi087 2024-09-17T07:20:19.215 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-17T07:20:19.215 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-17T07:20:20.345 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:20 smithi087 ceph-mon[27636]: pgmap v23: 65 pgs: 65 active+clean; 3.3 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 40 MiB/s rd, 123 MiB/s wr, 355 op/s 2024-09-17T07:20:20.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:20 smithi139 ceph-mon[34403]: pgmap v23: 65 pgs: 65 active+clean; 3.3 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 40 MiB/s rd, 123 MiB/s wr, 355 op/s 2024-09-17T07:20:21.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:21.929+0000 7f15f0b65640 1 -- 172.21.15.87:0/4174751043 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15ec065c40 msgr2=0x7f15ec0fcf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:20:21.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:21.929+0000 7f15f0b65640 1 --2- 172.21.15.87:0/4174751043 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15ec065c40 0x7f15ec0fcf30 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f15dc0048d0 tx=0x7f15dc009da0 comp rx=0 tx=0).stop 2024-09-17T07:20:21.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:21.929+0000 7f15f0b65640 1 -- 172.21.15.87:0/4174751043 shutdown_connections 2024-09-17T07:20:21.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:21.929+0000 7f15f0b65640 1 --2- 172.21.15.87:0/4174751043 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f15ec0fd470 0x7f15ec0ff8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:21.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:21.929+0000 7f15f0b65640 1 --2- 172.21.15.87:0/4174751043 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15ec065c40 0x7f15ec0fcf30 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:21.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:21.929+0000 7f15f0b65640 1 -- 172.21.15.87:0/4174751043 >> 172.21.15.87:0/4174751043 conn(0x7f15ec0f6c10 msgr2=0x7f15ec0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:20:21.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:21.929+0000 7f15f0b65640 1 -- 172.21.15.87:0/4174751043 shutdown_connections 2024-09-17T07:20:21.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:21.930+0000 7f15f0b65640 1 -- 172.21.15.87:0/4174751043 wait complete. 2024-09-17T07:20:21.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:21.930+0000 7f15f0b65640 1 Processor -- start 2024-09-17T07:20:21.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:21.930+0000 7f15f0b65640 1 -- start start 2024-09-17T07:20:21.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:21.930+0000 7f15f0b65640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15ec065c40 0x7f15ec1135e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:20:21.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:21.930+0000 7f15f0b65640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f15ec0fd470 0x7f15ec113b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:20:21.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:21.930+0000 7f15f0b65640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec114170 con 0x7f15ec065c40 2024-09-17T07:20:21.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:21.930+0000 7f15f0b65640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec114990 con 0x7f15ec0fd470 2024-09-17T07:20:21.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:21.931+0000 7f15e9d9b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f15ec0fd470 0x7f15ec113b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:20:21.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:21.931+0000 7f15e9d9b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f15ec0fd470 0x7f15ec113b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.87:60064/0 (socket says 172.21.15.87:60064) 2024-09-17T07:20:21.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:21.931+0000 7f15e9d9b640 1 -- 172.21.15.87:0/3571802294 learned_addr learned my addr 172.21.15.87:0/3571802294 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:20:21.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:21.931+0000 7f15ea59c640 1 --2- 172.21.15.87:0/3571802294 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15ec065c40 0x7f15ec1135e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:20:21.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:21.931+0000 7f15e9d9b640 1 -- 172.21.15.87:0/3571802294 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15ec065c40 msgr2=0x7f15ec1135e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:20:21.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:21.931+0000 7f15e9d9b640 1 --2- 172.21.15.87:0/3571802294 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15ec065c40 0x7f15ec1135e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:21.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:21.931+0000 7f15e9d9b640 1 -- 172.21.15.87:0/3571802294 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15dc005040 con 0x7f15ec0fd470 2024-09-17T07:20:21.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:21.931+0000 7f15e9d9b640 1 --2- 172.21.15.87:0/3571802294 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f15ec0fd470 0x7f15ec113b20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f15e000eb70 tx=0x7f15e000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:20:21.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:21.932+0000 7f15daffd640 1 -- 172.21.15.87:0/3571802294 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f15e0007c30 con 0x7f15ec0fd470 2024-09-17T07:20:21.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:21.932+0000 7f15daffd640 1 -- 172.21.15.87:0/3571802294 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f15e000f040 con 0x7f15ec0fd470 2024-09-17T07:20:21.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:21.932+0000 7f15daffd640 1 -- 172.21.15.87:0/3571802294 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f15e0009310 con 0x7f15ec0fd470 2024-09-17T07:20:21.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:21.932+0000 7f15f0b65640 1 -- 172.21.15.87:0/3571802294 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15ec114bc0 con 0x7f15ec0fd470 2024-09-17T07:20:21.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:21.932+0000 7f15f0b65640 1 -- 172.21.15.87:0/3571802294 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15ec1150a0 con 0x7f15ec0fd470 2024-09-17T07:20:21.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:21.933+0000 7f15f0b65640 1 -- 172.21.15.87:0/3571802294 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15ec0fa890 con 0x7f15ec0fd470 2024-09-17T07:20:21.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:21.934+0000 7f15daffd640 1 -- 172.21.15.87:0/3571802294 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 24) v1 ==== 90881+0+0 (secure 0 0 0) 0x7f15e000c6a0 con 0x7f15ec0fd470 2024-09-17T07:20:21.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:21.935+0000 7f15daffd640 1 --2- 172.21.15.87:0/3571802294 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f15d406dbd0 0x7f15d4070080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:20:21.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:21.935+0000 7f15daffd640 1 -- 172.21.15.87:0/3571802294 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f15e008ccd0 con 0x7f15ec0fd470 2024-09-17T07:20:21.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:21.935+0000 7f15ea59c640 1 --2- 172.21.15.87:0/3571802294 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f15d406dbd0 0x7f15d4070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:20:21.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:21.936+0000 7f15ea59c640 1 --2- 172.21.15.87:0/3571802294 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f15d406dbd0 0x7f15d4070080 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f15dc000c00 tx=0x7f15dc035040 comp rx=0 tx=0).ready entity=mgr.24339 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:20:21.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:21.940+0000 7f15daffd640 1 -- 172.21.15.87:0/3571802294 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182127 (secure 0 0 0) 0x7f15e00571d0 con 0x7f15ec0fd470 2024-09-17T07:20:22.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.198+0000 7f15f0b65640 1 -- 172.21.15.87:0/3571802294 --> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f15ec115480 con 0x7f15d406dbd0 2024-09-17T07:20:22.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.199+0000 7f15daffd640 1 -- 172.21.15.87:0/3571802294 <== mgr.24339 v2:172.21.15.139:6828/3218632563 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f15ec115480 con 0x7f15d406dbd0 2024-09-17T07:20:22.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.201+0000 7f15f0b65640 1 -- 172.21.15.87:0/3571802294 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f15d406dbd0 msgr2=0x7f15d4070080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:20:22.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.201+0000 7f15f0b65640 1 --2- 172.21.15.87:0/3571802294 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f15d406dbd0 0x7f15d4070080 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f15dc000c00 tx=0x7f15dc035040 comp rx=0 tx=0).stop 2024-09-17T07:20:22.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.201+0000 7f15f0b65640 1 -- 172.21.15.87:0/3571802294 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f15ec0fd470 msgr2=0x7f15ec113b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:20:22.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.201+0000 7f15f0b65640 1 --2- 172.21.15.87:0/3571802294 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f15ec0fd470 0x7f15ec113b20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f15e000eb70 tx=0x7f15e000b040 comp rx=0 tx=0).stop 2024-09-17T07:20:22.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.201+0000 7f15f0b65640 1 -- 172.21.15.87:0/3571802294 shutdown_connections 2024-09-17T07:20:22.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.201+0000 7f15f0b65640 1 --2- 172.21.15.87:0/3571802294 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f15d406dbd0 0x7f15d4070080 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:22.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.201+0000 7f15f0b65640 1 --2- 172.21.15.87:0/3571802294 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f15ec0fd470 0x7f15ec113b20 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:22.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.201+0000 7f15f0b65640 1 --2- 172.21.15.87:0/3571802294 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15ec065c40 0x7f15ec1135e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:22.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.201+0000 7f15f0b65640 1 -- 172.21.15.87:0/3571802294 >> 172.21.15.87:0/3571802294 conn(0x7f15ec0f6c10 msgr2=0x7f15ec0f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:20:22.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.201+0000 7f15f0b65640 1 -- 172.21.15.87:0/3571802294 shutdown_connections 2024-09-17T07:20:22.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.201+0000 7f15f0b65640 1 -- 172.21.15.87:0/3571802294 wait complete. 2024-09-17T07:20:22.213 INFO:teuthology.orchestra.run.smithi087.stdout:true 2024-09-17T07:20:22.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.297+0000 7fc05202a640 1 -- 172.21.15.87:0/526648652 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc04c0fc520 msgr2=0x7fc04c0fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:20:22.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.297+0000 7fc05202a640 1 --2- 172.21.15.87:0/526648652 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc04c0fc520 0x7fc04c0fc930 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fc03c0048d0 tx=0x7fc03c009da0 comp rx=0 tx=0).stop 2024-09-17T07:20:22.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.297+0000 7fc05202a640 1 -- 172.21.15.87:0/526648652 shutdown_connections 2024-09-17T07:20:22.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.297+0000 7fc05202a640 1 --2- 172.21.15.87:0/526648652 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc04c0fd7f0 0x7fc04c0fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:22.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.297+0000 7fc05202a640 1 --2- 172.21.15.87:0/526648652 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc04c0fc520 0x7fc04c0fc930 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:22.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.297+0000 7fc05202a640 1 -- 172.21.15.87:0/526648652 >> 172.21.15.87:0/526648652 conn(0x7fc04c0f7ce0 msgr2=0x7fc04c0fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:20:22.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.297+0000 7fc05202a640 1 -- 172.21.15.87:0/526648652 shutdown_connections 2024-09-17T07:20:22.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.297+0000 7fc05202a640 1 -- 172.21.15.87:0/526648652 wait complete. 2024-09-17T07:20:22.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.298+0000 7fc05202a640 1 Processor -- start 2024-09-17T07:20:22.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.298+0000 7fc05202a640 1 -- start start 2024-09-17T07:20:22.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.298+0000 7fc05202a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc04c0fc520 0x7fc04c10ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:20:22.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.298+0000 7fc05202a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc04c0fd7f0 0x7fc04c10b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:20:22.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.299+0000 7fc05202a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc04c10b920 con 0x7fc04c0fc520 2024-09-17T07:20:22.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.299+0000 7fc05202a640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc04c10c190 con 0x7fc04c0fd7f0 2024-09-17T07:20:22.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.299+0000 7fc04affd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc04c0fd7f0 0x7fc04c10b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:20:22.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.299+0000 7fc04b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc04c0fc520 0x7fc04c10ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:20:22.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.299+0000 7fc04affd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc04c0fd7f0 0x7fc04c10b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.87:60084/0 (socket says 172.21.15.87:60084) 2024-09-17T07:20:22.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.299+0000 7fc04affd640 1 -- 172.21.15.87:0/2893408699 learned_addr learned my addr 172.21.15.87:0/2893408699 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:20:22.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.299+0000 7fc04affd640 1 -- 172.21.15.87:0/2893408699 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc04c0fc520 msgr2=0x7fc04c10ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:20:22.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.299+0000 7fc04affd640 1 --2- 172.21.15.87:0/2893408699 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc04c0fc520 0x7fc04c10ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:22.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.299+0000 7fc04affd640 1 -- 172.21.15.87:0/2893408699 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc03c005040 con 0x7fc04c0fd7f0 2024-09-17T07:20:22.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.299+0000 7fc04affd640 1 --2- 172.21.15.87:0/2893408699 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc04c0fd7f0 0x7fc04c10b320 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc04000eb70 tx=0x7fc04000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:20:22.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.300+0000 7fc033fff640 1 -- 172.21.15.87:0/2893408699 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc040007c30 con 0x7fc04c0fd7f0 2024-09-17T07:20:22.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.300+0000 7fc05202a640 1 -- 172.21.15.87:0/2893408699 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc04c10c410 con 0x7fc04c0fd7f0 2024-09-17T07:20:22.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.300+0000 7fc033fff640 1 -- 172.21.15.87:0/2893408699 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fc04000f040 con 0x7fc04c0fd7f0 2024-09-17T07:20:22.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.300+0000 7fc033fff640 1 -- 172.21.15.87:0/2893408699 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc040009420 con 0x7fc04c0fd7f0 2024-09-17T07:20:22.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.300+0000 7fc05202a640 1 -- 172.21.15.87:0/2893408699 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc04c10c9b0 con 0x7fc04c0fd7f0 2024-09-17T07:20:22.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.302+0000 7fc05202a640 1 -- 172.21.15.87:0/2893408699 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc04c0fb980 con 0x7fc04c0fd7f0 2024-09-17T07:20:22.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.302+0000 7fc033fff640 1 -- 172.21.15.87:0/2893408699 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 24) v1 ==== 90881+0+0 (secure 0 0 0) 0x7fc0400096c0 con 0x7fc04c0fd7f0 2024-09-17T07:20:22.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.302+0000 7fc033fff640 1 --2- 172.21.15.87:0/2893408699 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7fc03406dca0 0x7fc034070150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:20:22.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.302+0000 7fc033fff640 1 -- 172.21.15.87:0/2893408699 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fc04008cca0 con 0x7fc04c0fd7f0 2024-09-17T07:20:22.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.302+0000 7fc04b7fe640 1 --2- 172.21.15.87:0/2893408699 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7fc03406dca0 0x7fc034070150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:20:22.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.303+0000 7fc04b7fe640 1 --2- 172.21.15.87:0/2893408699 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7fc03406dca0 0x7fc034070150 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc03c000c00 tx=0x7fc03c035040 comp rx=0 tx=0).ready entity=mgr.24339 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:20:22.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.308+0000 7fc033fff640 1 -- 172.21.15.87:0/2893408699 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182127 (secure 0 0 0) 0x7fc040057120 con 0x7fc04c0fd7f0 2024-09-17T07:20:22.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:22 smithi087 ceph-mon[27636]: pgmap v24: 65 pgs: 65 active+clean; 1.6 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail; 41 MiB/s rd, 124 MiB/s wr, 488 op/s 2024-09-17T07:20:22.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.539+0000 7fc05202a640 1 -- 172.21.15.87:0/2893408699 --> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc04c10cc90 con 0x7fc03406dca0 2024-09-17T07:20:22.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.540+0000 7fc033fff640 1 -- 172.21.15.87:0/2893408699 <== mgr.24339 v2:172.21.15.139:6828/3218632563 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7fc04c10cc90 con 0x7fc03406dca0 2024-09-17T07:20:22.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.543+0000 7fc05202a640 1 -- 172.21.15.87:0/2893408699 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7fc03406dca0 msgr2=0x7fc034070150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:20:22.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.543+0000 7fc05202a640 1 --2- 172.21.15.87:0/2893408699 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7fc03406dca0 0x7fc034070150 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc03c000c00 tx=0x7fc03c035040 comp rx=0 tx=0).stop 2024-09-17T07:20:22.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.543+0000 7fc05202a640 1 -- 172.21.15.87:0/2893408699 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc04c0fd7f0 msgr2=0x7fc04c10b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:20:22.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.543+0000 7fc05202a640 1 --2- 172.21.15.87:0/2893408699 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc04c0fd7f0 0x7fc04c10b320 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc04000eb70 tx=0x7fc04000b040 comp rx=0 tx=0).stop 2024-09-17T07:20:22.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.543+0000 7fc05202a640 1 -- 172.21.15.87:0/2893408699 shutdown_connections 2024-09-17T07:20:22.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.543+0000 7fc05202a640 1 --2- 172.21.15.87:0/2893408699 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7fc03406dca0 0x7fc034070150 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:22.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.543+0000 7fc05202a640 1 --2- 172.21.15.87:0/2893408699 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc04c0fd7f0 0x7fc04c10b320 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:22.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.543+0000 7fc05202a640 1 --2- 172.21.15.87:0/2893408699 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc04c0fc520 0x7fc04c10ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:22.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.543+0000 7fc05202a640 1 -- 172.21.15.87:0/2893408699 >> 172.21.15.87:0/2893408699 conn(0x7fc04c0f7ce0 msgr2=0x7fc04c0f9530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:20:22.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.543+0000 7fc05202a640 1 -- 172.21.15.87:0/2893408699 shutdown_connections 2024-09-17T07:20:22.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.543+0000 7fc05202a640 1 -- 172.21.15.87:0/2893408699 wait complete. 2024-09-17T07:20:22.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:22 smithi139 ceph-mon[34403]: pgmap v24: 65 pgs: 65 active+clean; 1.6 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail; 41 MiB/s rd, 124 MiB/s wr, 488 op/s 2024-09-17T07:20:22.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.640+0000 7fd00475c640 1 -- 172.21.15.87:0/3761782004 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcffc065c40 msgr2=0x7fcffc0fcf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:20:22.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.640+0000 7fd00475c640 1 --2- 172.21.15.87:0/3761782004 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcffc065c40 0x7fcffc0fcf30 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fcff80048d0 tx=0x7fcff8009da0 comp rx=0 tx=0).stop 2024-09-17T07:20:22.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.640+0000 7fd00475c640 1 -- 172.21.15.87:0/3761782004 shutdown_connections 2024-09-17T07:20:22.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.640+0000 7fd00475c640 1 --2- 172.21.15.87:0/3761782004 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcffc0fd470 0x7fcffc0ff8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:22.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.640+0000 7fd00475c640 1 --2- 172.21.15.87:0/3761782004 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcffc065c40 0x7fcffc0fcf30 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:22.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.640+0000 7fd00475c640 1 -- 172.21.15.87:0/3761782004 >> 172.21.15.87:0/3761782004 conn(0x7fcffc0f6c10 msgr2=0x7fcffc0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:20:22.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.641+0000 7fd00475c640 1 -- 172.21.15.87:0/3761782004 shutdown_connections 2024-09-17T07:20:22.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.641+0000 7fd00475c640 1 -- 172.21.15.87:0/3761782004 wait complete. 2024-09-17T07:20:22.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.641+0000 7fd00475c640 1 Processor -- start 2024-09-17T07:20:22.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.641+0000 7fd00475c640 1 -- start start 2024-09-17T07:20:22.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.642+0000 7fd00475c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcffc065c40 0x7fcffc1135c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:20:22.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.642+0000 7fd00475c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcffc0fd470 0x7fcffc113b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:20:22.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.642+0000 7fd00475c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcffc114150 con 0x7fcffc065c40 2024-09-17T07:20:22.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.642+0000 7fd00475c640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcffc114970 con 0x7fcffc0fd470 2024-09-17T07:20:22.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.642+0000 7fd0024f8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcffc065c40 0x7fcffc1135c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:20:22.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.642+0000 7fd0024f8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcffc065c40 0x7fcffc1135c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40858/0 (socket says 172.21.15.87:40858) 2024-09-17T07:20:22.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.642+0000 7fd0024f8640 1 -- 172.21.15.87:0/3969063526 learned_addr learned my addr 172.21.15.87:0/3969063526 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:20:22.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.642+0000 7fd001cf7640 1 --2- 172.21.15.87:0/3969063526 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcffc0fd470 0x7fcffc113b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:20:22.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.642+0000 7fd0024f8640 1 -- 172.21.15.87:0/3969063526 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcffc0fd470 msgr2=0x7fcffc113b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:20:22.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.642+0000 7fd0024f8640 1 --2- 172.21.15.87:0/3969063526 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcffc0fd470 0x7fcffc113b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:22.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.642+0000 7fd0024f8640 1 -- 172.21.15.87:0/3969063526 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcff8005040 con 0x7fcffc065c40 2024-09-17T07:20:22.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.642+0000 7fd001cf7640 1 --2- 172.21.15.87:0/3969063526 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcffc0fd470 0x7fcffc113b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T07:20:22.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.642+0000 7fd0024f8640 1 --2- 172.21.15.87:0/3969063526 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcffc065c40 0x7fcffc1135c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fcff8009ac0 tx=0x7fcff8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:20:22.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.643+0000 7fcff2ffd640 1 -- 172.21.15.87:0/3969063526 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcff8038070 con 0x7fcffc065c40 2024-09-17T07:20:22.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.643+0000 7fcff2ffd640 1 -- 172.21.15.87:0/3969063526 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fcff802ade0 con 0x7fcffc065c40 2024-09-17T07:20:22.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.643+0000 7fd00475c640 1 -- 172.21.15.87:0/3969063526 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcffc114ba0 con 0x7fcffc065c40 2024-09-17T07:20:22.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.643+0000 7fcff2ffd640 1 -- 172.21.15.87:0/3969063526 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcff802c880 con 0x7fcffc065c40 2024-09-17T07:20:22.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.643+0000 7fd00475c640 1 -- 172.21.15.87:0/3969063526 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcffc115080 con 0x7fcffc065c40 2024-09-17T07:20:22.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.644+0000 7fd00475c640 1 -- 172.21.15.87:0/3969063526 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcffc0fa890 con 0x7fcffc065c40 2024-09-17T07:20:22.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.645+0000 7fcff2ffd640 1 -- 172.21.15.87:0/3969063526 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 24) v1 ==== 90881+0+0 (secure 0 0 0) 0x7fcff8030020 con 0x7fcffc065c40 2024-09-17T07:20:22.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.646+0000 7fcff2ffd640 1 --2- 172.21.15.87:0/3969063526 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7fcfe806dbd0 0x7fcfe8070080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:20:22.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.646+0000 7fcff2ffd640 1 -- 172.21.15.87:0/3969063526 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fcff80ad400 con 0x7fcffc065c40 2024-09-17T07:20:22.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.646+0000 7fd001cf7640 1 --2- 172.21.15.87:0/3969063526 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7fcfe806dbd0 0x7fcfe8070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:20:22.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.646+0000 7fd001cf7640 1 --2- 172.21.15.87:0/3969063526 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7fcfe806dbd0 0x7fcfe8070080 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fcfec004fd0 tx=0x7fcfec00b040 comp rx=0 tx=0).ready entity=mgr.24339 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:20:22.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.655+0000 7fcff2ffd640 1 -- 172.21.15.87:0/3969063526 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182127 (secure 0 0 0) 0x7fcff8077a20 con 0x7fcffc065c40 2024-09-17T07:20:22.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.961+0000 7fd00475c640 1 -- 172.21.15.87:0/3969063526 --> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fcffc115560 con 0x7fcfe806dbd0 2024-09-17T07:20:22.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.972+0000 7fcff2ffd640 1 -- 172.21.15.87:0/3969063526 <== mgr.24339 v2:172.21.15.139:6828/3218632563 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fcffc115560 con 0x7fcfe806dbd0 2024-09-17T07:20:22.973 INFO:teuthology.orchestra.run.smithi087.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T07:20:22.973 INFO:teuthology.orchestra.run.smithi087.stdout:alertmanager.smithi087 smithi087 *:9093,9094 starting - - - - 2024-09-17T07:20:22.973 INFO:teuthology.orchestra.run.smithi087.stdout:crash.smithi087 smithi087 running (8m) 17s ago 8m 6891k - 17.2.7-1635-g4a704134 f22ead590bad d9aaf9839ada 2024-09-17T07:20:22.973 INFO:teuthology.orchestra.run.smithi087.stdout:crash.smithi139 smithi139 running (7m) 27s ago 7m 6895k - 17.2.7-1635-g4a704134 f22ead590bad 354c853b318f 2024-09-17T07:20:22.973 INFO:teuthology.orchestra.run.smithi087.stdout:grafana.smithi087 smithi087 *:3000 running (6m) 17s ago 8m 86.2M - 9.4.7 954c08fa6188 738589686a89 2024-09-17T07:20:22.974 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi087.tjhpcs smithi087 running (2m) 17s ago 2m 123M - 17.2.7-1635-g4a704134 f22ead590bad f7142ad971ed 2024-09-17T07:20:22.974 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi087.vvbzss smithi087 running (3m) 17s ago 3m 128M - 17.2.7-1635-g4a704134 f22ead590bad 2dd82ff293d1 2024-09-17T07:20:22.974 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi139.ftvinf smithi139 running (2m) 27s ago 2m 113M - 17.2.7-1635-g4a704134 f22ead590bad d11edb295ad3 2024-09-17T07:20:22.974 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi139.gnwonz smithi139 running (3m) 27s ago 3m 130M - 17.2.7-1635-g4a704134 f22ead590bad 3b3d884aef02 2024-09-17T07:20:22.974 INFO:teuthology.orchestra.run.smithi087.stdout:mgr.smithi087.vuvjer smithi087 *:9283,8765,8443 running (9m) 17s ago 9m 182M - 17.2.7-1635-g4a704134 f22ead590bad 11130bf9b46c 2024-09-17T07:20:22.974 INFO:teuthology.orchestra.run.smithi087.stdout:mgr.smithi139.tuqnpn smithi139 *:8443,9283 running (75s) 27s ago 7m 467M - 18.2.4-855-g19e2a2be 980a0bfcd684 ea12b2e696b5 2024-09-17T07:20:22.974 INFO:teuthology.orchestra.run.smithi087.stdout:mon.smithi087 smithi087 running (9m) 17s ago 9m 53.6M 2048M 17.2.7-1635-g4a704134 f22ead590bad 175785e1fb86 2024-09-17T07:20:22.974 INFO:teuthology.orchestra.run.smithi087.stdout:mon.smithi139 smithi139 running (7m) 27s ago 7m 39.2M 2048M 17.2.7-1635-g4a704134 f22ead590bad a9a2552dc411 2024-09-17T07:20:22.974 INFO:teuthology.orchestra.run.smithi087.stdout:node-exporter.smithi087 smithi087 *:9100 starting - - - - 2024-09-17T07:20:22.974 INFO:teuthology.orchestra.run.smithi087.stdout:node-exporter.smithi139 smithi139 *:9100 running (7m) 27s ago 7m 15.3M - 1.5.0 0da6a335fe13 291c1abbb415 2024-09-17T07:20:22.974 INFO:teuthology.orchestra.run.smithi087.stdout:osd.0 smithi087 running (6m) 17s ago 6m 88.2M 1557M 17.2.7-1635-g4a704134 f22ead590bad 396801f9b539 2024-09-17T07:20:22.974 INFO:teuthology.orchestra.run.smithi087.stdout:osd.1 smithi087 running (6m) 17s ago 6m 99.7M 1557M 17.2.7-1635-g4a704134 f22ead590bad 9446985bfcd1 2024-09-17T07:20:22.974 INFO:teuthology.orchestra.run.smithi087.stdout:osd.2 smithi087 running (5m) 17s ago 5m 84.8M 1557M 17.2.7-1635-g4a704134 f22ead590bad 8fe1428a6878 2024-09-17T07:20:22.974 INFO:teuthology.orchestra.run.smithi087.stdout:osd.3 smithi139 running (5m) 27s ago 5m 100M 2581M 17.2.7-1635-g4a704134 f22ead590bad 0801999b17c4 2024-09-17T07:20:22.975 INFO:teuthology.orchestra.run.smithi087.stdout:osd.4 smithi139 running (4m) 27s ago 4m 92.2M 2581M 17.2.7-1635-g4a704134 f22ead590bad 299a8dfc47f5 2024-09-17T07:20:22.975 INFO:teuthology.orchestra.run.smithi087.stdout:osd.5 smithi139 running (4m) 27s ago 4m 96.1M 2581M 17.2.7-1635-g4a704134 f22ead590bad 609cf74f32e7 2024-09-17T07:20:22.975 INFO:teuthology.orchestra.run.smithi087.stdout:prometheus.smithi087 smithi087 *:9095 running (6m) 17s ago 7m 58.6M - 2.43.0 a07b618ecd1d 2c4f73cf5937 2024-09-17T07:20:22.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.974+0000 7fd00475c640 1 -- 172.21.15.87:0/3969063526 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7fcfe806dbd0 msgr2=0x7fcfe8070080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:20:22.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.974+0000 7fd00475c640 1 --2- 172.21.15.87:0/3969063526 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7fcfe806dbd0 0x7fcfe8070080 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fcfec004fd0 tx=0x7fcfec00b040 comp rx=0 tx=0).stop 2024-09-17T07:20:22.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.974+0000 7fd00475c640 1 -- 172.21.15.87:0/3969063526 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcffc065c40 msgr2=0x7fcffc1135c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:20:22.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.974+0000 7fd00475c640 1 --2- 172.21.15.87:0/3969063526 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcffc065c40 0x7fcffc1135c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fcff8009ac0 tx=0x7fcff8009da0 comp rx=0 tx=0).stop 2024-09-17T07:20:22.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.975+0000 7fd00475c640 1 -- 172.21.15.87:0/3969063526 shutdown_connections 2024-09-17T07:20:22.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.975+0000 7fd00475c640 1 --2- 172.21.15.87:0/3969063526 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7fcfe806dbd0 0x7fcfe8070080 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:22.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.975+0000 7fd00475c640 1 --2- 172.21.15.87:0/3969063526 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcffc0fd470 0x7fcffc113b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:22.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.975+0000 7fd00475c640 1 --2- 172.21.15.87:0/3969063526 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcffc065c40 0x7fcffc1135c0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:22.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.975+0000 7fd00475c640 1 -- 172.21.15.87:0/3969063526 >> 172.21.15.87:0/3969063526 conn(0x7fcffc0f6c10 msgr2=0x7fcffc0f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:20:22.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.975+0000 7fd00475c640 1 -- 172.21.15.87:0/3969063526 shutdown_connections 2024-09-17T07:20:22.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:22.975+0000 7fd00475c640 1 -- 172.21.15.87:0/3969063526 wait complete. 2024-09-17T07:20:23.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.082+0000 7f60b02e8640 1 -- 172.21.15.87:0/458753550 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60a80fe760 msgr2=0x7f60a80feb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:20:23.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.082+0000 7f60b02e8640 1 --2- 172.21.15.87:0/458753550 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60a80fe760 0x7f60a80feb70 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f60a40048d0 tx=0x7f60a4009da0 comp rx=0 tx=0).stop 2024-09-17T07:20:23.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.082+0000 7f60b02e8640 1 -- 172.21.15.87:0/458753550 shutdown_connections 2024-09-17T07:20:23.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.082+0000 7f60b02e8640 1 --2- 172.21.15.87:0/458753550 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f60a80ffa30 0x7f60a80ffea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:23.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.082+0000 7f60b02e8640 1 --2- 172.21.15.87:0/458753550 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60a80fe760 0x7f60a80feb70 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:23.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.082+0000 7f60b02e8640 1 -- 172.21.15.87:0/458753550 >> 172.21.15.87:0/458753550 conn(0x7f60a80fa060 msgr2=0x7f60a80fc440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:20:23.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.082+0000 7f60b02e8640 1 -- 172.21.15.87:0/458753550 shutdown_connections 2024-09-17T07:20:23.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.083+0000 7f60b02e8640 1 -- 172.21.15.87:0/458753550 wait complete. 2024-09-17T07:20:23.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.083+0000 7f60b02e8640 1 Processor -- start 2024-09-17T07:20:23.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.083+0000 7f60b02e8640 1 -- start start 2024-09-17T07:20:23.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.083+0000 7f60b02e8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60a80fe760 0x7f60a810f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:20:23.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.084+0000 7f60b02e8640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f60a80ffa30 0x7f60a810f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:20:23.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.084+0000 7f60b02e8640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a810fd10 con 0x7f60a80fe760 2024-09-17T07:20:23.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.084+0000 7f60b02e8640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a8110530 con 0x7f60a80ffa30 2024-09-17T07:20:23.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.084+0000 7f60ae084640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60a80fe760 0x7f60a810f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:20:23.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.084+0000 7f60ae084640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60a80fe760 0x7f60a810f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40870/0 (socket says 172.21.15.87:40870) 2024-09-17T07:20:23.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.084+0000 7f60ae084640 1 -- 172.21.15.87:0/1431572803 learned_addr learned my addr 172.21.15.87:0/1431572803 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:20:23.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.084+0000 7f60ae084640 1 -- 172.21.15.87:0/1431572803 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f60a80ffa30 msgr2=0x7f60a810f6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T07:20:23.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.084+0000 7f60ae084640 1 --2- 172.21.15.87:0/1431572803 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f60a80ffa30 0x7f60a810f6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:23.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.084+0000 7f60ae084640 1 -- 172.21.15.87:0/1431572803 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a4005040 con 0x7f60a80fe760 2024-09-17T07:20:23.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.085+0000 7f60ae084640 1 --2- 172.21.15.87:0/1431572803 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60a80fe760 0x7f60a810f180 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f60a4009ac0 tx=0x7f60a4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:20:23.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.085+0000 7f609effd640 1 -- 172.21.15.87:0/1431572803 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f60a4038070 con 0x7f60a80fe760 2024-09-17T07:20:23.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.085+0000 7f60b02e8640 1 -- 172.21.15.87:0/1431572803 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60a8110760 con 0x7f60a80fe760 2024-09-17T07:20:23.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.085+0000 7f60b02e8640 1 -- 172.21.15.87:0/1431572803 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60a8110d00 con 0x7f60a80fe760 2024-09-17T07:20:23.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.085+0000 7f609effd640 1 -- 172.21.15.87:0/1431572803 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f60a402ade0 con 0x7f60a80fe760 2024-09-17T07:20:23.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.085+0000 7f609effd640 1 -- 172.21.15.87:0/1431572803 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f60a402c580 con 0x7f60a80fe760 2024-09-17T07:20:23.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.087+0000 7f60b02e8640 1 -- 172.21.15.87:0/1431572803 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f608c005240 con 0x7f60a80fe760 2024-09-17T07:20:23.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.088+0000 7f609effd640 1 -- 172.21.15.87:0/1431572803 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 24) v1 ==== 90881+0+0 (secure 0 0 0) 0x7f60a4030020 con 0x7f60a80fe760 2024-09-17T07:20:23.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.088+0000 7f609effd640 1 --2- 172.21.15.87:0/1431572803 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f609406dbd0 0x7f6094070080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:20:23.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.089+0000 7f609effd640 1 -- 172.21.15.87:0/1431572803 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f60a40ad480 con 0x7f60a80fe760 2024-09-17T07:20:23.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.089+0000 7f60ad883640 1 --2- 172.21.15.87:0/1431572803 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f609406dbd0 0x7f6094070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:20:23.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.089+0000 7f60ad883640 1 --2- 172.21.15.87:0/1431572803 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f609406dbd0 0x7f6094070080 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f60a810ef30 tx=0x7f609800b040 comp rx=0 tx=0).ready entity=mgr.24339 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:20:23.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.097+0000 7f609effd640 1 -- 172.21.15.87:0/1431572803 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182127 (secure 0 0 0) 0x7f60a4077960 con 0x7f60a80fe760 2024-09-17T07:20:23.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.422+0000 7f60b02e8640 1 -- 172.21.15.87:0/1431572803 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f608c0057c0 con 0x7f60a80fe760 2024-09-17T07:20:23.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.423+0000 7f609effd640 1 -- 172.21.15.87:0/1431572803 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+853 (secure 0 0 0) 0x7f60a407af80 con 0x7f60a80fe760 2024-09-17T07:20:23.425 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T07:20:23.425 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": { 2024-09-17T07:20:23.425 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 2 2024-09-17T07:20:23.425 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:20:23.425 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr": { 2024-09-17T07:20:23.426 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 1, 2024-09-17T07:20:23.426 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 1 2024-09-17T07:20:23.426 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:20:23.426 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": { 2024-09-17T07:20:23.426 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 6 2024-09-17T07:20:23.426 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:20:23.427 INFO:teuthology.orchestra.run.smithi087.stdout: "mds": { 2024-09-17T07:20:23.427 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 4 2024-09-17T07:20:23.427 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:20:23.427 INFO:teuthology.orchestra.run.smithi087.stdout: "overall": { 2024-09-17T07:20:23.427 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 13, 2024-09-17T07:20:23.427 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 1 2024-09-17T07:20:23.427 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T07:20:23.427 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T07:20:23.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.425+0000 7f60b02e8640 1 -- 172.21.15.87:0/1431572803 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f609406dbd0 msgr2=0x7f6094070080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:20:23.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.425+0000 7f60b02e8640 1 --2- 172.21.15.87:0/1431572803 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f609406dbd0 0x7f6094070080 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f60a810ef30 tx=0x7f609800b040 comp rx=0 tx=0).stop 2024-09-17T07:20:23.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.425+0000 7f60b02e8640 1 -- 172.21.15.87:0/1431572803 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60a80fe760 msgr2=0x7f60a810f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:20:23.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.425+0000 7f60b02e8640 1 --2- 172.21.15.87:0/1431572803 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60a80fe760 0x7f60a810f180 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f60a4009ac0 tx=0x7f60a4009da0 comp rx=0 tx=0).stop 2024-09-17T07:20:23.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.425+0000 7f60b02e8640 1 -- 172.21.15.87:0/1431572803 shutdown_connections 2024-09-17T07:20:23.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.425+0000 7f60b02e8640 1 --2- 172.21.15.87:0/1431572803 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f609406dbd0 0x7f6094070080 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:23.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.425+0000 7f60b02e8640 1 --2- 172.21.15.87:0/1431572803 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f60a80ffa30 0x7f60a810f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:23.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.425+0000 7f60b02e8640 1 --2- 172.21.15.87:0/1431572803 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60a80fe760 0x7f60a810f180 secure :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f60a4009ac0 tx=0x7f60a4009da0 comp rx=0 tx=0).stop 2024-09-17T07:20:23.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.425+0000 7f60b02e8640 1 -- 172.21.15.87:0/1431572803 >> 172.21.15.87:0/1431572803 conn(0x7f60a80fa060 msgr2=0x7f60a80fc860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:20:23.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.425+0000 7f60b02e8640 1 -- 172.21.15.87:0/1431572803 shutdown_connections 2024-09-17T07:20:23.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.425+0000 7f60b02e8640 1 -- 172.21.15.87:0/1431572803 wait complete. 2024-09-17T07:20:23.522 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:23 smithi087 ceph-mon[27636]: from='client.24425 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:20:23.522 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:23 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:20:23.522 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:23 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:20:23.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.533+0000 7f908e7fc640 1 -- 172.21.15.87:0/3938814908 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f908002a9f0 con 0x7f90900715d0 2024-09-17T07:20:23.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.534+0000 7f90960ac640 1 -- 172.21.15.87:0/3938814908 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90900715d0 msgr2=0x7f909006fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:20:23.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.534+0000 7f90960ac640 1 --2- 172.21.15.87:0/3938814908 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90900715d0 0x7f909006fb00 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f90800048d0 tx=0x7f9080009da0 comp rx=0 tx=0).stop 2024-09-17T07:20:23.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.534+0000 7f90960ac640 1 -- 172.21.15.87:0/3938814908 shutdown_connections 2024-09-17T07:20:23.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.534+0000 7f90960ac640 1 --2- 172.21.15.87:0/3938814908 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9090070040 0x7f90900704b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:23.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.534+0000 7f90960ac640 1 --2- 172.21.15.87:0/3938814908 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90900715d0 0x7f909006fb00 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:23.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.534+0000 7f90960ac640 1 -- 172.21.15.87:0/3938814908 >> 172.21.15.87:0/3938814908 conn(0x7f90900f7d30 msgr2=0x7f90900fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:20:23.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.535+0000 7f90960ac640 1 -- 172.21.15.87:0/3938814908 shutdown_connections 2024-09-17T07:20:23.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.535+0000 7f90960ac640 1 -- 172.21.15.87:0/3938814908 wait complete. 2024-09-17T07:20:23.536 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.536+0000 7f90960ac640 1 Processor -- start 2024-09-17T07:20:23.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.536+0000 7f90960ac640 1 -- start start 2024-09-17T07:20:23.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.536+0000 7f90960ac640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9090070040 0x7f90901135d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:20:23.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.536+0000 7f90960ac640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f90900715d0 0x7f9090113b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:20:23.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.536+0000 7f90960ac640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9090114160 con 0x7f9090070040 2024-09-17T07:20:23.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.536+0000 7f90960ac640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9090114980 con 0x7f90900715d0 2024-09-17T07:20:23.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.537+0000 7f908effd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f90900715d0 0x7f9090113b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:20:23.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.537+0000 7f908f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9090070040 0x7f90901135d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:20:23.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.537+0000 7f908effd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f90900715d0 0x7f9090113b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.87:60132/0 (socket says 172.21.15.87:60132) 2024-09-17T07:20:23.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.537+0000 7f908effd640 1 -- 172.21.15.87:0/674914630 learned_addr learned my addr 172.21.15.87:0/674914630 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:20:23.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.537+0000 7f908effd640 1 -- 172.21.15.87:0/674914630 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9090070040 msgr2=0x7f90901135d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:20:23.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.537+0000 7f908effd640 1 --2- 172.21.15.87:0/674914630 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9090070040 0x7f90901135d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:23.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.537+0000 7f908effd640 1 -- 172.21.15.87:0/674914630 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9080005040 con 0x7f90900715d0 2024-09-17T07:20:23.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.537+0000 7f908effd640 1 --2- 172.21.15.87:0/674914630 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f90900715d0 0x7f9090113b10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f908400eb70 tx=0x7f908400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:20:23.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.537+0000 7f9077fff640 1 -- 172.21.15.87:0/674914630 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9084007c30 con 0x7f90900715d0 2024-09-17T07:20:23.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.538+0000 7f90960ac640 1 -- 172.21.15.87:0/674914630 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9090114bb0 con 0x7f90900715d0 2024-09-17T07:20:23.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.538+0000 7f90960ac640 1 -- 172.21.15.87:0/674914630 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90901150d0 con 0x7f90900715d0 2024-09-17T07:20:23.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.538+0000 7f9077fff640 1 -- 172.21.15.87:0/674914630 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f908400f040 con 0x7f90900715d0 2024-09-17T07:20:23.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.538+0000 7f9077fff640 1 -- 172.21.15.87:0/674914630 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90840093e0 con 0x7f90900715d0 2024-09-17T07:20:23.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.539+0000 7f90960ac640 1 -- 172.21.15.87:0/674914630 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f907c005240 con 0x7f90900715d0 2024-09-17T07:20:23.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.540+0000 7f9077fff640 1 -- 172.21.15.87:0/674914630 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 24) v1 ==== 90881+0+0 (secure 0 0 0) 0x7f9084009650 con 0x7f90900715d0 2024-09-17T07:20:23.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.541+0000 7f9077fff640 1 --2- 172.21.15.87:0/674914630 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f907806dbd0 0x7f9078070080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:20:23.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.541+0000 7f9077fff640 1 -- 172.21.15.87:0/674914630 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f908408ccd0 con 0x7f90900715d0 2024-09-17T07:20:23.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.541+0000 7f908f7fe640 1 --2- 172.21.15.87:0/674914630 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f907806dbd0 0x7f9078070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:20:23.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.542+0000 7f908f7fe640 1 --2- 172.21.15.87:0/674914630 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f907806dbd0 0x7f9078070080 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f90800048a0 tx=0x7f9080035040 comp rx=0 tx=0).ready entity=mgr.24339 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:20:23.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.546+0000 7f9077fff640 1 -- 172.21.15.87:0/674914630 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182127 (secure 0 0 0) 0x7f908404f780 con 0x7f90900715d0 2024-09-17T07:20:23.575 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-17T07:20:23.575 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-09-17T07:20:23.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:23 smithi139 ceph-mon[34403]: from='client.24425 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:20:23.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:23 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:20:23.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:23 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:20:23.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.911+0000 7f90960ac640 1 -- 172.21.15.87:0/674914630 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f907c0057c0 con 0x7f90900715d0 2024-09-17T07:20:23.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.911+0000 7f9077fff640 1 -- 172.21.15.87:0/674914630 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1850 (secure 0 0 0) 0x7f908405abe0 con 0x7f90900715d0 2024-09-17T07:20:23.913 INFO:teuthology.orchestra.run.smithi087.stdout:e20 2024-09-17T07:20:23.913 INFO:teuthology.orchestra.run.smithi087.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T07:20:23.913 INFO:teuthology.orchestra.run.smithi087.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T07:20:23.913 INFO:teuthology.orchestra.run.smithi087.stdout:legacy client fscid: 1 2024-09-17T07:20:23.913 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:20:23.913 INFO:teuthology.orchestra.run.smithi087.stdout:Filesystem 'cephfs' (1) 2024-09-17T07:20:23.913 INFO:teuthology.orchestra.run.smithi087.stdout:fs_name cephfs 2024-09-17T07:20:23.913 INFO:teuthology.orchestra.run.smithi087.stdout:epoch 20 2024-09-17T07:20:23.913 INFO:teuthology.orchestra.run.smithi087.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T07:20:23.913 INFO:teuthology.orchestra.run.smithi087.stdout:created 2024-09-17T07:17:15.368053+0000 2024-09-17T07:20:23.913 INFO:teuthology.orchestra.run.smithi087.stdout:modified 2024-09-17T07:19:06.657406+0000 2024-09-17T07:20:23.914 INFO:teuthology.orchestra.run.smithi087.stdout:tableserver 0 2024-09-17T07:20:23.914 INFO:teuthology.orchestra.run.smithi087.stdout:root 0 2024-09-17T07:20:23.914 INFO:teuthology.orchestra.run.smithi087.stdout:session_timeout 60 2024-09-17T07:20:23.914 INFO:teuthology.orchestra.run.smithi087.stdout:session_autoclose 300 2024-09-17T07:20:23.914 INFO:teuthology.orchestra.run.smithi087.stdout:max_file_size 1099511627776 2024-09-17T07:20:23.914 INFO:teuthology.orchestra.run.smithi087.stdout:required_client_features {} 2024-09-17T07:20:23.914 INFO:teuthology.orchestra.run.smithi087.stdout:last_failure 0 2024-09-17T07:20:23.914 INFO:teuthology.orchestra.run.smithi087.stdout:last_failure_osd_epoch 44 2024-09-17T07:20:23.914 INFO:teuthology.orchestra.run.smithi087.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T07:20:23.914 INFO:teuthology.orchestra.run.smithi087.stdout:max_mds 2 2024-09-17T07:20:23.914 INFO:teuthology.orchestra.run.smithi087.stdout:in 0,1 2024-09-17T07:20:23.914 INFO:teuthology.orchestra.run.smithi087.stdout:up {0=14478,1=24243} 2024-09-17T07:20:23.914 INFO:teuthology.orchestra.run.smithi087.stdout:failed 2024-09-17T07:20:23.914 INFO:teuthology.orchestra.run.smithi087.stdout:damaged 2024-09-17T07:20:23.914 INFO:teuthology.orchestra.run.smithi087.stdout:stopped 2024-09-17T07:20:23.915 INFO:teuthology.orchestra.run.smithi087.stdout:data_pools [3] 2024-09-17T07:20:23.915 INFO:teuthology.orchestra.run.smithi087.stdout:metadata_pool 2 2024-09-17T07:20:23.915 INFO:teuthology.orchestra.run.smithi087.stdout:inline_data enabled 2024-09-17T07:20:23.915 INFO:teuthology.orchestra.run.smithi087.stdout:balancer 2024-09-17T07:20:23.915 INFO:teuthology.orchestra.run.smithi087.stdout:standby_count_wanted 1 2024-09-17T07:20:23.915 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi087.tjhpcs{0:14478} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.87:6828/2255237099,v1:172.21.15.87:6829/2255237099] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:20:23.915 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi087.vvbzss{0:14490} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.87:6826/4022268353,v1:172.21.15.87:6827/4022268353] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:20:23.915 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi139.gnwonz{1:24243} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.139:6824/3946792151,v1:172.21.15.139:6825/3946792151] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:20:23.915 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi139.ftvinf{1:24253} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.139:6826/3292073323,v1:172.21.15.139:6827/3292073323] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:20:23.915 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:20:23.915 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:20:23.915 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 20 2024-09-17T07:20:23.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.915+0000 7f90960ac640 1 -- 172.21.15.87:0/674914630 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f907806dbd0 msgr2=0x7f9078070080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:20:23.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.915+0000 7f90960ac640 1 --2- 172.21.15.87:0/674914630 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f907806dbd0 0x7f9078070080 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f90800048a0 tx=0x7f9080035040 comp rx=0 tx=0).stop 2024-09-17T07:20:23.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.915+0000 7f90960ac640 1 -- 172.21.15.87:0/674914630 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f90900715d0 msgr2=0x7f9090113b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:20:23.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.915+0000 7f90960ac640 1 --2- 172.21.15.87:0/674914630 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f90900715d0 0x7f9090113b10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f908400eb70 tx=0x7f908400b040 comp rx=0 tx=0).stop 2024-09-17T07:20:23.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.918+0000 7f90960ac640 1 -- 172.21.15.87:0/674914630 shutdown_connections 2024-09-17T07:20:23.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.918+0000 7f90960ac640 1 --2- 172.21.15.87:0/674914630 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f907806dbd0 0x7f9078070080 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:23.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.918+0000 7f90960ac640 1 --2- 172.21.15.87:0/674914630 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f90900715d0 0x7f9090113b10 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:23.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.918+0000 7f90960ac640 1 --2- 172.21.15.87:0/674914630 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9090070040 0x7f90901135d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:23.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.918+0000 7f90960ac640 1 -- 172.21.15.87:0/674914630 >> 172.21.15.87:0/674914630 conn(0x7f90900f7d30 msgr2=0x7f90900f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:20:23.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.918+0000 7f90960ac640 1 -- 172.21.15.87:0/674914630 shutdown_connections 2024-09-17T07:20:23.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:23.918+0000 7f90960ac640 1 -- 172.21.15.87:0/674914630 wait complete. 2024-09-17T07:20:24.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.022+0000 7f939deb1640 1 -- 172.21.15.87:0/2766412815 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93980fe580 msgr2=0x7f93980fa6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:20:24.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.022+0000 7f939deb1640 1 --2- 172.21.15.87:0/2766412815 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93980fe580 0x7f93980fa6e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f938c0048d0 tx=0x7f938c009da0 comp rx=0 tx=0).stop 2024-09-17T07:20:24.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.022+0000 7f939deb1640 1 -- 172.21.15.87:0/2766412815 shutdown_connections 2024-09-17T07:20:24.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.022+0000 7f939deb1640 1 --2- 172.21.15.87:0/2766412815 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93980fe580 0x7f93980fa6e0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:24.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.022+0000 7f939deb1640 1 --2- 172.21.15.87:0/2766412815 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f93980fdc30 0x7f93980fe040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:24.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.022+0000 7f939deb1640 1 -- 172.21.15.87:0/2766412815 >> 172.21.15.87:0/2766412815 conn(0x7f93980f6390 msgr2=0x7f93980f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:20:24.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.022+0000 7f939deb1640 1 -- 172.21.15.87:0/2766412815 shutdown_connections 2024-09-17T07:20:24.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.022+0000 7f939deb1640 1 -- 172.21.15.87:0/2766412815 wait complete. 2024-09-17T07:20:24.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.023+0000 7f939deb1640 1 Processor -- start 2024-09-17T07:20:24.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.023+0000 7f939deb1640 1 -- start start 2024-09-17T07:20:24.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.023+0000 7f939deb1640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f93980fdc30 0x7f93981135f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:20:24.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.023+0000 7f939deb1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93980fe580 0x7f9398113b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:20:24.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.023+0000 7f939deb1640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9398114180 con 0x7f93980fe580 2024-09-17T07:20:24.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.023+0000 7f939deb1640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93981149a0 con 0x7f93980fdc30 2024-09-17T07:20:24.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.024+0000 7f93977fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f93980fdc30 0x7f93981135f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:20:24.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.024+0000 7f93977fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f93980fdc30 0x7f93981135f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.87:60150/0 (socket says 172.21.15.87:60150) 2024-09-17T07:20:24.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.024+0000 7f93977fe640 1 -- 172.21.15.87:0/291473410 learned_addr learned my addr 172.21.15.87:0/291473410 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:20:24.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.024+0000 7f9396ffd640 1 --2- 172.21.15.87:0/291473410 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93980fe580 0x7f9398113b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:20:24.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.024+0000 7f93977fe640 1 -- 172.21.15.87:0/291473410 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93980fe580 msgr2=0x7f9398113b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:20:24.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.024+0000 7f93977fe640 1 --2- 172.21.15.87:0/291473410 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93980fe580 0x7f9398113b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:24.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.024+0000 7f93977fe640 1 -- 172.21.15.87:0/291473410 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f938c005040 con 0x7f93980fdc30 2024-09-17T07:20:24.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.024+0000 7f93977fe640 1 --2- 172.21.15.87:0/291473410 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f93980fdc30 0x7f93981135f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f938800eb70 tx=0x7f938800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:20:24.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.025+0000 7f937ffff640 1 -- 172.21.15.87:0/291473410 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9388007c30 con 0x7f93980fdc30 2024-09-17T07:20:24.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.025+0000 7f937ffff640 1 -- 172.21.15.87:0/291473410 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f938800f040 con 0x7f93980fdc30 2024-09-17T07:20:24.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.025+0000 7f937ffff640 1 -- 172.21.15.87:0/291473410 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9388009420 con 0x7f93980fdc30 2024-09-17T07:20:24.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.025+0000 7f939deb1640 1 -- 172.21.15.87:0/291473410 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9398114bd0 con 0x7f93980fdc30 2024-09-17T07:20:24.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.025+0000 7f939deb1640 1 -- 172.21.15.87:0/291473410 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9398115140 con 0x7f93980fdc30 2024-09-17T07:20:24.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.026+0000 7f937dffb640 1 -- 172.21.15.87:0/291473410 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9378005210 con 0x7f93980fdc30 2024-09-17T07:20:24.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.027+0000 7f937ffff640 1 -- 172.21.15.87:0/291473410 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 24) v1 ==== 90881+0+0 (secure 0 0 0) 0x7f938800c6f0 con 0x7f93980fdc30 2024-09-17T07:20:24.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.027+0000 7f937ffff640 1 --2- 172.21.15.87:0/291473410 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f938006dbd0 0x7f9380070080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:20:24.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.028+0000 7f937ffff640 1 -- 172.21.15.87:0/291473410 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f938808cd00 con 0x7f93980fdc30 2024-09-17T07:20:24.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.028+0000 7f9396ffd640 1 --2- 172.21.15.87:0/291473410 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f938006dbd0 0x7f9380070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:20:24.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.028+0000 7f9396ffd640 1 --2- 172.21.15.87:0/291473410 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f938006dbd0 0x7f9380070080 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f938c000c00 tx=0x7f938c035040 comp rx=0 tx=0).ready entity=mgr.24339 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:20:24.034 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.033+0000 7f937ffff640 1 -- 172.21.15.87:0/291473410 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182127 (secure 0 0 0) 0x7f938804f780 con 0x7f93980fdc30 2024-09-17T07:20:24.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.330+0000 7f937dffb640 1 -- 172.21.15.87:0/291473410 --> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9378000bc0 con 0x7f938006dbd0 2024-09-17T07:20:24.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.331+0000 7f937ffff640 1 -- 172.21.15.87:0/291473410 <== mgr.24339 v2:172.21.15.139:6828/3218632563 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f9378000bc0 con 0x7f938006dbd0 2024-09-17T07:20:24.333 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T07:20:24.333 INFO:teuthology.orchestra.run.smithi087.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9", 2024-09-17T07:20:24.333 INFO:teuthology.orchestra.run.smithi087.stdout: "in_progress": true, 2024-09-17T07:20:24.333 INFO:teuthology.orchestra.run.smithi087.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T07:20:24.333 INFO:teuthology.orchestra.run.smithi087.stdout: "services_complete": [], 2024-09-17T07:20:24.333 INFO:teuthology.orchestra.run.smithi087.stdout: "progress": "1/21 daemons upgraded", 2024-09-17T07:20:24.333 INFO:teuthology.orchestra.run.smithi087.stdout: "message": "", 2024-09-17T07:20:24.333 INFO:teuthology.orchestra.run.smithi087.stdout: "is_paused": false 2024-09-17T07:20:24.333 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T07:20:24.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.335+0000 7f937dffb640 1 -- 172.21.15.87:0/291473410 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f938006dbd0 msgr2=0x7f9380070080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:20:24.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.335+0000 7f937dffb640 1 --2- 172.21.15.87:0/291473410 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f938006dbd0 0x7f9380070080 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f938c000c00 tx=0x7f938c035040 comp rx=0 tx=0).stop 2024-09-17T07:20:24.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.335+0000 7f937dffb640 1 -- 172.21.15.87:0/291473410 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f93980fdc30 msgr2=0x7f93981135f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:20:24.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.335+0000 7f937dffb640 1 --2- 172.21.15.87:0/291473410 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f93980fdc30 0x7f93981135f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f938800eb70 tx=0x7f938800b040 comp rx=0 tx=0).stop 2024-09-17T07:20:24.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.335+0000 7f937dffb640 1 -- 172.21.15.87:0/291473410 shutdown_connections 2024-09-17T07:20:24.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.335+0000 7f937dffb640 1 --2- 172.21.15.87:0/291473410 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f938006dbd0 0x7f9380070080 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:24.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.335+0000 7f937dffb640 1 --2- 172.21.15.87:0/291473410 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93980fe580 0x7f9398113b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:24.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.335+0000 7f937dffb640 1 --2- 172.21.15.87:0/291473410 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f93980fdc30 0x7f93981135f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:24.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.335+0000 7f937dffb640 1 -- 172.21.15.87:0/291473410 >> 172.21.15.87:0/291473410 conn(0x7f93980f6390 msgr2=0x7f93980f7bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:20:24.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.335+0000 7f937dffb640 1 -- 172.21.15.87:0/291473410 shutdown_connections 2024-09-17T07:20:24.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.335+0000 7f937dffb640 1 -- 172.21.15.87:0/291473410 wait complete. 2024-09-17T07:20:24.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.434+0000 7f232a0c6640 1 -- 172.21.15.87:0/1977673612 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23240ff6e0 msgr2=0x7f2324101ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:20:24.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.434+0000 7f232a0c6640 1 --2- 172.21.15.87:0/1977673612 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23240ff6e0 0x7f2324101ac0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f23180048d0 tx=0x7f2318009da0 comp rx=0 tx=0).stop 2024-09-17T07:20:24.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.434+0000 7f232a0c6640 1 -- 172.21.15.87:0/1977673612 shutdown_connections 2024-09-17T07:20:24.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.434+0000 7f232a0c6640 1 --2- 172.21.15.87:0/1977673612 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23240ff6e0 0x7f2324101ac0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:24.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.434+0000 7f232a0c6640 1 --2- 172.21.15.87:0/1977673612 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2324065be0 0x7f23240ff1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:24.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.434+0000 7f232a0c6640 1 -- 172.21.15.87:0/1977673612 >> 172.21.15.87:0/1977673612 conn(0x7f23240f6c10 msgr2=0x7f23240f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:20:24.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.435+0000 7f232a0c6640 1 -- 172.21.15.87:0/1977673612 shutdown_connections 2024-09-17T07:20:24.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.435+0000 7f232a0c6640 1 -- 172.21.15.87:0/1977673612 wait complete. 2024-09-17T07:20:24.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.435+0000 7f232a0c6640 1 Processor -- start 2024-09-17T07:20:24.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.435+0000 7f232a0c6640 1 -- start start 2024-09-17T07:20:24.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.436+0000 7f232a0c6640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2324065be0 0x7f232410d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:20:24.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.436+0000 7f232a0c6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23240ff6e0 0x7f232410d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:20:24.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.436+0000 7f232a0c6640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f232410dbb0 con 0x7f23240ff6e0 2024-09-17T07:20:24.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.436+0000 7f232a0c6640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f232410e380 con 0x7f2324065be0 2024-09-17T07:20:24.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.436+0000 7f23237fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2324065be0 0x7f232410d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:20:24.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.436+0000 7f23237fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2324065be0 0x7f232410d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.87:36234/0 (socket says 172.21.15.87:36234) 2024-09-17T07:20:24.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.436+0000 7f2322ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23240ff6e0 0x7f232410d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:20:24.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.436+0000 7f23237fe640 1 -- 172.21.15.87:0/3226890269 learned_addr learned my addr 172.21.15.87:0/3226890269 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:20:24.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.436+0000 7f2322ffd640 1 -- 172.21.15.87:0/3226890269 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2324065be0 msgr2=0x7f232410d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:20:24.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.436+0000 7f2322ffd640 1 --2- 172.21.15.87:0/3226890269 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2324065be0 0x7f232410d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:24.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.436+0000 7f2322ffd640 1 -- 172.21.15.87:0/3226890269 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2318005040 con 0x7f23240ff6e0 2024-09-17T07:20:24.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.437+0000 7f2322ffd640 1 --2- 172.21.15.87:0/3226890269 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23240ff6e0 0x7f232410d560 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f2318000c00 tx=0x7f2318009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:20:24.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.437+0000 7f230bfff640 1 -- 172.21.15.87:0/3226890269 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2318038070 con 0x7f23240ff6e0 2024-09-17T07:20:24.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.437+0000 7f230bfff640 1 -- 172.21.15.87:0/3226890269 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f2318004290 con 0x7f23240ff6e0 2024-09-17T07:20:24.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.437+0000 7f230bfff640 1 -- 172.21.15.87:0/3226890269 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f231803c650 con 0x7f23240ff6e0 2024-09-17T07:20:24.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.437+0000 7f232a0c6640 1 -- 172.21.15.87:0/3226890269 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f232410e5b0 con 0x7f23240ff6e0 2024-09-17T07:20:24.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.437+0000 7f232a0c6640 1 -- 172.21.15.87:0/3226890269 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f232410eaf0 con 0x7f23240ff6e0 2024-09-17T07:20:24.439 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.438+0000 7f232a0c6640 1 -- 172.21.15.87:0/3226890269 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23240fa890 con 0x7f23240ff6e0 2024-09-17T07:20:24.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.440+0000 7f230bfff640 1 -- 172.21.15.87:0/3226890269 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 24) v1 ==== 90881+0+0 (secure 0 0 0) 0x7f2318030020 con 0x7f23240ff6e0 2024-09-17T07:20:24.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.440+0000 7f230bfff640 1 --2- 172.21.15.87:0/3226890269 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f230c06dbd0 0x7f230c070080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:20:24.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.440+0000 7f230bfff640 1 -- 172.21.15.87:0/3226890269 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f23180ad110 con 0x7f23240ff6e0 2024-09-17T07:20:24.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.440+0000 7f23237fe640 1 --2- 172.21.15.87:0/3226890269 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f230c06dbd0 0x7f230c070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:20:24.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.441+0000 7f23237fe640 1 --2- 172.21.15.87:0/3226890269 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f230c06dbd0 0x7f230c070080 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2314004a30 tx=0x7f231400b040 comp rx=0 tx=0).ready entity=mgr.24339 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:20:24.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.445+0000 7f230bfff640 1 -- 172.21.15.87:0/3226890269 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182127 (secure 0 0 0) 0x7f2318077730 con 0x7f23240ff6e0 2024-09-17T07:20:24.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:24 smithi139 ceph-mon[34403]: from='client.24429 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:20:24.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:24 smithi139 ceph-mon[34403]: Reconfiguring grafana.smithi087 (dependencies changed)... 2024-09-17T07:20:24.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:24 smithi139 ceph-mon[34403]: Reconfiguring daemon grafana.smithi087 on smithi087 2024-09-17T07:20:24.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:24 smithi139 ceph-mon[34403]: from='client.14708 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:20:24.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:24 smithi139 ceph-mon[34403]: pgmap v25: 65 pgs: 65 active+clean; 1.6 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail; 8.9 MiB/s rd, 33 MiB/s wr, 278 op/s 2024-09-17T07:20:24.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:24 smithi139 ceph-mon[34403]: from='client.? 172.21.15.87:0/1431572803' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:20:24.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:24 smithi139 ceph-mon[34403]: from='client.? 172.21.15.87:0/674914630' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T07:20:24.631 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:24 smithi087 ceph-mon[27636]: from='client.24429 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:20:24.632 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:24 smithi087 ceph-mon[27636]: Reconfiguring grafana.smithi087 (dependencies changed)... 2024-09-17T07:20:24.632 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:24 smithi087 ceph-mon[27636]: Reconfiguring daemon grafana.smithi087 on smithi087 2024-09-17T07:20:24.632 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:24 smithi087 ceph-mon[27636]: from='client.14708 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:20:24.632 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:24 smithi087 ceph-mon[27636]: pgmap v25: 65 pgs: 65 active+clean; 1.6 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail; 8.9 MiB/s rd, 33 MiB/s wr, 278 op/s 2024-09-17T07:20:24.632 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:24 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/1431572803' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:20:24.632 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:24 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/674914630' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T07:20:24.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.789+0000 7f232a0c6640 1 -- 172.21.15.87:0/3226890269 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f232404b720 con 0x7f23240ff6e0 2024-09-17T07:20:24.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.789+0000 7f230bfff640 1 -- 172.21.15.87:0/3226890269 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f231807ad50 con 0x7f23240ff6e0 2024-09-17T07:20:24.791 INFO:teuthology.orchestra.run.smithi087.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T07:20:24.791 INFO:teuthology.orchestra.run.smithi087.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T07:20:24.791 INFO:teuthology.orchestra.run.smithi087.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T07:20:24.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.792+0000 7f232a0c6640 1 -- 172.21.15.87:0/3226890269 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f230c06dbd0 msgr2=0x7f230c070080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:20:24.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.792+0000 7f232a0c6640 1 --2- 172.21.15.87:0/3226890269 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f230c06dbd0 0x7f230c070080 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2314004a30 tx=0x7f231400b040 comp rx=0 tx=0).stop 2024-09-17T07:20:24.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.793+0000 7f232a0c6640 1 -- 172.21.15.87:0/3226890269 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23240ff6e0 msgr2=0x7f232410d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:20:24.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.793+0000 7f232a0c6640 1 --2- 172.21.15.87:0/3226890269 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23240ff6e0 0x7f232410d560 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f2318000c00 tx=0x7f2318009da0 comp rx=0 tx=0).stop 2024-09-17T07:20:24.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.793+0000 7f232a0c6640 1 -- 172.21.15.87:0/3226890269 shutdown_connections 2024-09-17T07:20:24.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.793+0000 7f232a0c6640 1 --2- 172.21.15.87:0/3226890269 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f230c06dbd0 0x7f230c070080 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:24.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.793+0000 7f232a0c6640 1 --2- 172.21.15.87:0/3226890269 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23240ff6e0 0x7f232410d560 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:24.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.793+0000 7f232a0c6640 1 --2- 172.21.15.87:0/3226890269 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2324065be0 0x7f232410d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:24.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.793+0000 7f232a0c6640 1 -- 172.21.15.87:0/3226890269 >> 172.21.15.87:0/3226890269 conn(0x7f23240f6c10 msgr2=0x7f23240f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:20:24.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.795+0000 7f232a0c6640 1 -- 172.21.15.87:0/3226890269 shutdown_connections 2024-09-17T07:20:24.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:24.795+0000 7f232a0c6640 1 -- 172.21.15.87:0/3226890269 wait complete. 2024-09-17T07:20:25.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:25 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:20:25.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:25 smithi139 ceph-mon[34403]: from='client.? 172.21.15.87:0/3226890269' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T07:20:25.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:25 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:20:25.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:25 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/3226890269' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T07:20:26.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:26 smithi139 ceph-mon[34403]: from='client.24443 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:20:26.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:26 smithi139 ceph-mon[34403]: pgmap v26: 65 pgs: 65 active+clean; 1.6 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail; 8.9 MiB/s rd, 33 MiB/s wr, 278 op/s 2024-09-17T07:20:26.643 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:26 smithi087 ceph-mon[27636]: from='client.24443 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:20:26.643 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:26 smithi087 ceph-mon[27636]: pgmap v26: 65 pgs: 65 active+clean; 1.6 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail; 8.9 MiB/s rd, 33 MiB/s wr, 278 op/s 2024-09-17T07:20:28.582 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:28 smithi087 ceph-mon[27636]: pgmap v27: 65 pgs: 65 active+clean; 294 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 10 MiB/s rd, 34 MiB/s wr, 398 op/s 2024-09-17T07:20:28.583 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:28 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:20:28.583 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:28 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:20:28.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:28 smithi139 ceph-mon[34403]: pgmap v27: 65 pgs: 65 active+clean; 294 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 10 MiB/s rd, 34 MiB/s wr, 398 op/s 2024-09-17T07:20:28.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:28 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:20:28.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:28 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:20:29.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:29 smithi139 ceph-mon[34403]: Reconfiguring prometheus.smithi087 (dependencies changed)... 2024-09-17T07:20:29.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:29 smithi139 ceph-mon[34403]: Reconfiguring daemon prometheus.smithi087 on smithi087 2024-09-17T07:20:29.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:29 smithi087 ceph-mon[27636]: Reconfiguring prometheus.smithi087 (dependencies changed)... 2024-09-17T07:20:29.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:29 smithi087 ceph-mon[27636]: Reconfiguring daemon prometheus.smithi087 on smithi087 2024-09-17T07:20:30.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:30 smithi087 ceph-mon[27636]: pgmap v28: 65 pgs: 65 active+clean; 294 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 252 op/s 2024-09-17T07:20:30.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:30 smithi139 ceph-mon[34403]: pgmap v28: 65 pgs: 65 active+clean; 294 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 252 op/s 2024-09-17T07:20:32.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:32 smithi139 ceph-mon[34403]: pgmap v29: 65 pgs: 65 active+clean; 297 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 3.4 MiB/s rd, 3.4 MiB/s wr, 333 op/s 2024-09-17T07:20:32.634 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:32 smithi087 ceph-mon[27636]: pgmap v29: 65 pgs: 65 active+clean; 297 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 3.4 MiB/s rd, 3.4 MiB/s wr, 333 op/s 2024-09-17T07:20:33.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:33 smithi139 ceph-mon[34403]: pgmap v30: 65 pgs: 65 active+clean; 297 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 200 op/s 2024-09-17T07:20:33.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:33 smithi087 ceph-mon[27636]: pgmap v30: 65 pgs: 65 active+clean; 297 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 200 op/s 2024-09-17T07:20:36.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:36 smithi087 ceph-mon[27636]: pgmap v31: 65 pgs: 65 active+clean; 297 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 200 op/s 2024-09-17T07:20:36.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:36 smithi139 ceph-mon[34403]: pgmap v31: 65 pgs: 65 active+clean; 297 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 200 op/s 2024-09-17T07:20:38.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:38 smithi087 ceph-mon[27636]: pgmap v32: 65 pgs: 65 active+clean; 307 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 3.4 MiB/s rd, 3.5 MiB/s wr, 273 op/s 2024-09-17T07:20:38.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:38 smithi087 ceph-mon[27636]: fsmap cephfs:2 {0=cephfs.smithi087.tjhpcs=up:active,1=cephfs.smithi139.gnwonz=up:active} 2 up:standby-replay 2024-09-17T07:20:38.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:38 smithi139 ceph-mon[34403]: pgmap v32: 65 pgs: 65 active+clean; 307 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 3.4 MiB/s rd, 3.5 MiB/s wr, 273 op/s 2024-09-17T07:20:38.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:38 smithi139 ceph-mon[34403]: fsmap cephfs:2 {0=cephfs.smithi087.tjhpcs=up:active,1=cephfs.smithi139.gnwonz=up:active} 2 up:standby-replay 2024-09-17T07:20:40.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:40 smithi087 ceph-mon[27636]: pgmap v33: 65 pgs: 65 active+clean; 307 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 153 op/s 2024-09-17T07:20:40.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:40 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:20:40.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:40 smithi139 ceph-mon[34403]: pgmap v33: 65 pgs: 65 active+clean; 307 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 153 op/s 2024-09-17T07:20:40.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:40 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:20:42.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:42 smithi087 ceph-mon[27636]: pgmap v34: 65 pgs: 65 active+clean; 310 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 4.1 MiB/s rd, 4.3 MiB/s wr, 220 op/s 2024-09-17T07:20:42.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:42 smithi139 ceph-mon[34403]: pgmap v34: 65 pgs: 65 active+clean; 310 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 4.1 MiB/s rd, 4.3 MiB/s wr, 220 op/s 2024-09-17T07:20:44.418 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:44 smithi139 ceph-mon[34403]: pgmap v35: 65 pgs: 65 active+clean; 310 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.8 MiB/s rd, 2.9 MiB/s wr, 139 op/s 2024-09-17T07:20:44.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:44 smithi087 ceph-mon[27636]: pgmap v35: 65 pgs: 65 active+clean; 310 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.8 MiB/s rd, 2.9 MiB/s wr, 139 op/s 2024-09-17T07:20:46.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:46 smithi087 ceph-mon[27636]: pgmap v36: 65 pgs: 65 active+clean; 310 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.8 MiB/s rd, 2.9 MiB/s wr, 139 op/s 2024-09-17T07:20:46.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:46 smithi139 ceph-mon[34403]: pgmap v36: 65 pgs: 65 active+clean; 310 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.8 MiB/s rd, 2.9 MiB/s wr, 139 op/s 2024-09-17T07:20:48.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:48 smithi087 ceph-mon[27636]: pgmap v37: 65 pgs: 65 active+clean; 310 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 3.8 MiB/s rd, 3.8 MiB/s wr, 189 op/s 2024-09-17T07:20:48.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:48 smithi139 ceph-mon[34403]: pgmap v37: 65 pgs: 65 active+clean; 310 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 3.8 MiB/s rd, 3.8 MiB/s wr, 189 op/s 2024-09-17T07:20:50.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:50 smithi087 ceph-mon[27636]: pgmap v38: 65 pgs: 65 active+clean; 310 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.8 MiB/s rd, 2.7 MiB/s wr, 116 op/s 2024-09-17T07:20:50.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:50 smithi139 ceph-mon[34403]: pgmap v38: 65 pgs: 65 active+clean; 310 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.8 MiB/s rd, 2.7 MiB/s wr, 116 op/s 2024-09-17T07:20:52.214 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:52 smithi139 ceph-mon[34403]: pgmap v39: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 3.6 MiB/s rd, 3.7 MiB/s wr, 166 op/s 2024-09-17T07:20:52.214 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:52 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:20:52.214 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:52 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:20:52.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:52 smithi087 ceph-mon[27636]: pgmap v39: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 3.6 MiB/s rd, 3.7 MiB/s wr, 166 op/s 2024-09-17T07:20:52.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:52 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:20:52.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:52 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:20:53.319 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:53 smithi139 ceph-mon[34403]: Reconfiguring node-exporter.smithi139 (dependencies changed)... 2024-09-17T07:20:53.320 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:53 smithi139 ceph-mon[34403]: Reconfiguring daemon node-exporter.smithi139 on smithi139 2024-09-17T07:20:53.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:53 smithi087 ceph-mon[27636]: Reconfiguring node-exporter.smithi139 (dependencies changed)... 2024-09-17T07:20:53.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:53 smithi087 ceph-mon[27636]: Reconfiguring daemon node-exporter.smithi139 on smithi139 2024-09-17T07:20:54.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:54 smithi087 ceph-mon[27636]: pgmap v40: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 100 op/s 2024-09-17T07:20:54.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:54 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:20:54.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:54 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:20:54.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:54 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-17T07:20:54.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:54 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-17T07:20:54.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:54 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T07:20:54.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:54 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:20:54.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:54 smithi139 ceph-mon[34403]: pgmap v40: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 100 op/s 2024-09-17T07:20:54.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:54 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:20:54.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:54 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:20:54.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:54 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-17T07:20:54.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:54 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-17T07:20:54.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:54 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T07:20:54.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:54 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:20:54.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:54.909+0000 7fc91f66d640 1 -- 172.21.15.87:0/1861071723 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc918065c40 msgr2=0x7fc9180fcf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:20:54.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:54.909+0000 7fc91f66d640 1 --2- 172.21.15.87:0/1861071723 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc918065c40 0x7fc9180fcf30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc9140048d0 tx=0x7fc914009da0 comp rx=0 tx=0).stop 2024-09-17T07:20:54.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:54.909+0000 7fc91f66d640 1 -- 172.21.15.87:0/1861071723 shutdown_connections 2024-09-17T07:20:54.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:54.909+0000 7fc91f66d640 1 --2- 172.21.15.87:0/1861071723 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9180fd470 0x7fc9180ff8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:54.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:54.909+0000 7fc91f66d640 1 --2- 172.21.15.87:0/1861071723 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc918065c40 0x7fc9180fcf30 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:54.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:54.909+0000 7fc91f66d640 1 -- 172.21.15.87:0/1861071723 >> 172.21.15.87:0/1861071723 conn(0x7fc9180f6c10 msgr2=0x7fc9180f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:20:54.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:54.910+0000 7fc91f66d640 1 -- 172.21.15.87:0/1861071723 shutdown_connections 2024-09-17T07:20:54.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:54.910+0000 7fc91f66d640 1 -- 172.21.15.87:0/1861071723 wait complete. 2024-09-17T07:20:54.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:54.910+0000 7fc91f66d640 1 Processor -- start 2024-09-17T07:20:54.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:54.911+0000 7fc91f66d640 1 -- start start 2024-09-17T07:20:54.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:54.911+0000 7fc91f66d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc918065c40 0x7fc9181135c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:20:54.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:54.911+0000 7fc91f66d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9180fd470 0x7fc918113b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:20:54.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:54.911+0000 7fc91f66d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc918114150 con 0x7fc9180fd470 2024-09-17T07:20:54.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:54.911+0000 7fc91f66d640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc918114970 con 0x7fc918065c40 2024-09-17T07:20:54.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:54.911+0000 7fc91d409640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc918065c40 0x7fc9181135c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:20:54.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:54.911+0000 7fc91d409640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc918065c40 0x7fc9181135c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.87:51740/0 (socket says 172.21.15.87:51740) 2024-09-17T07:20:54.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:54.911+0000 7fc91cc08640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9180fd470 0x7fc918113b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:20:54.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:54.911+0000 7fc91d409640 1 -- 172.21.15.87:0/2378239399 learned_addr learned my addr 172.21.15.87:0/2378239399 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:20:54.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:54.911+0000 7fc91d409640 1 -- 172.21.15.87:0/2378239399 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9180fd470 msgr2=0x7fc918113b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:20:54.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:54.911+0000 7fc91d409640 1 --2- 172.21.15.87:0/2378239399 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9180fd470 0x7fc918113b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:54.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:54.911+0000 7fc91d409640 1 -- 172.21.15.87:0/2378239399 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc908005040 con 0x7fc918065c40 2024-09-17T07:20:54.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:54.912+0000 7fc91d409640 1 --2- 172.21.15.87:0/2378239399 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc918065c40 0x7fc9181135c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc914009ac0 tx=0x7fc914009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:20:54.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:54.912+0000 7fc90dffb640 1 -- 172.21.15.87:0/2378239399 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc914038070 con 0x7fc918065c40 2024-09-17T07:20:54.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:54.912+0000 7fc90dffb640 1 -- 172.21.15.87:0/2378239399 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fc9140096c0 con 0x7fc918065c40 2024-09-17T07:20:54.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:54.912+0000 7fc91f66d640 1 -- 172.21.15.87:0/2378239399 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc914005040 con 0x7fc918065c40 2024-09-17T07:20:54.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:54.912+0000 7fc90dffb640 1 -- 172.21.15.87:0/2378239399 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc91403d420 con 0x7fc918065c40 2024-09-17T07:20:54.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:54.912+0000 7fc91f66d640 1 -- 172.21.15.87:0/2378239399 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc918114fb0 con 0x7fc918065c40 2024-09-17T07:20:54.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:54.914+0000 7fc91f66d640 1 -- 172.21.15.87:0/2378239399 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc91810bc00 con 0x7fc918065c40 2024-09-17T07:20:54.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:54.915+0000 7fc90dffb640 1 -- 172.21.15.87:0/2378239399 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 24) v1 ==== 90881+0+0 (secure 0 0 0) 0x7fc914030020 con 0x7fc918065c40 2024-09-17T07:20:54.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:54.916+0000 7fc90dffb640 1 --2- 172.21.15.87:0/2378239399 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7fc90406dbd0 0x7fc904070080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:20:54.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:54.916+0000 7fc90dffb640 1 -- 172.21.15.87:0/2378239399 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fc9140ad9b0 con 0x7fc918065c40 2024-09-17T07:20:54.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:54.917+0000 7fc91cc08640 1 --2- 172.21.15.87:0/2378239399 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7fc90406dbd0 0x7fc904070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:20:54.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:54.917+0000 7fc91cc08640 1 --2- 172.21.15.87:0/2378239399 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7fc90406dbd0 0x7fc904070080 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc918113370 tx=0x7fc90800b040 comp rx=0 tx=0).ready entity=mgr.24339 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:20:54.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:54.919+0000 7fc90dffb640 1 -- 172.21.15.87:0/2378239399 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182127 (secure 0 0 0) 0x7fc914078090 con 0x7fc918065c40 2024-09-17T07:20:55.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.190+0000 7fc91f66d640 1 -- 172.21.15.87:0/2378239399 --> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc918115350 con 0x7fc90406dbd0 2024-09-17T07:20:55.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.191+0000 7fc90dffb640 1 -- 172.21.15.87:0/2378239399 <== mgr.24339 v2:172.21.15.139:6828/3218632563 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7fc918115350 con 0x7fc90406dbd0 2024-09-17T07:20:55.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.194+0000 7fc91f66d640 1 -- 172.21.15.87:0/2378239399 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7fc90406dbd0 msgr2=0x7fc904070080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:20:55.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.194+0000 7fc91f66d640 1 --2- 172.21.15.87:0/2378239399 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7fc90406dbd0 0x7fc904070080 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc918113370 tx=0x7fc90800b040 comp rx=0 tx=0).stop 2024-09-17T07:20:55.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.194+0000 7fc91f66d640 1 -- 172.21.15.87:0/2378239399 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc918065c40 msgr2=0x7fc9181135c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:20:55.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.194+0000 7fc91f66d640 1 --2- 172.21.15.87:0/2378239399 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc918065c40 0x7fc9181135c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc914009ac0 tx=0x7fc914009da0 comp rx=0 tx=0).stop 2024-09-17T07:20:55.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.194+0000 7fc91f66d640 1 -- 172.21.15.87:0/2378239399 shutdown_connections 2024-09-17T07:20:55.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.194+0000 7fc91f66d640 1 --2- 172.21.15.87:0/2378239399 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7fc90406dbd0 0x7fc904070080 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:55.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.194+0000 7fc91f66d640 1 --2- 172.21.15.87:0/2378239399 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9180fd470 0x7fc918113b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:55.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.194+0000 7fc91f66d640 1 --2- 172.21.15.87:0/2378239399 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc918065c40 0x7fc9181135c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:55.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.194+0000 7fc91f66d640 1 -- 172.21.15.87:0/2378239399 >> 172.21.15.87:0/2378239399 conn(0x7fc9180f6c10 msgr2=0x7fc9180f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:20:55.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.194+0000 7fc91f66d640 1 -- 172.21.15.87:0/2378239399 shutdown_connections 2024-09-17T07:20:55.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.194+0000 7fc91f66d640 1 -- 172.21.15.87:0/2378239399 wait complete. 2024-09-17T07:20:55.203 INFO:teuthology.orchestra.run.smithi087.stdout:true 2024-09-17T07:20:55.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.294+0000 7f989fb64640 1 -- 172.21.15.87:0/1459615294 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98980ff6e0 msgr2=0x7f9898101ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:20:55.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.294+0000 7f989fb64640 1 --2- 172.21.15.87:0/1459615294 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98980ff6e0 0x7f9898101ac0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f98880048d0 tx=0x7f9888009da0 comp rx=0 tx=0).stop 2024-09-17T07:20:55.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.294+0000 7f989fb64640 1 -- 172.21.15.87:0/1459615294 shutdown_connections 2024-09-17T07:20:55.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.294+0000 7f989fb64640 1 --2- 172.21.15.87:0/1459615294 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98980ff6e0 0x7f9898101ac0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:55.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.294+0000 7f989fb64640 1 --2- 172.21.15.87:0/1459615294 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9898065be0 0x7f98980ff1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:55.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.294+0000 7f989fb64640 1 -- 172.21.15.87:0/1459615294 >> 172.21.15.87:0/1459615294 conn(0x7f98980f6c10 msgr2=0x7f98980f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:20:55.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.294+0000 7f989fb64640 1 -- 172.21.15.87:0/1459615294 shutdown_connections 2024-09-17T07:20:55.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.294+0000 7f989fb64640 1 -- 172.21.15.87:0/1459615294 wait complete. 2024-09-17T07:20:55.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.295+0000 7f989fb64640 1 Processor -- start 2024-09-17T07:20:55.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.295+0000 7f989fb64640 1 -- start start 2024-09-17T07:20:55.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.295+0000 7f989fb64640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9898065be0 0x7f98980fcb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:20:55.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.295+0000 7f989fb64640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98980ff6e0 0x7f98980fb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:20:55.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.295+0000 7f989fb64640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98980fb5e0 con 0x7f98980ff6e0 2024-09-17T07:20:55.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.295+0000 7f989fb64640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98980fb720 con 0x7f9898065be0 2024-09-17T07:20:55.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.296+0000 7f989d900640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9898065be0 0x7f98980fcb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:20:55.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.295+0000 7f989d0ff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98980ff6e0 0x7f98980fb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:20:55.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.296+0000 7f989d900640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9898065be0 0x7f98980fcb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.87:51756/0 (socket says 172.21.15.87:51756) 2024-09-17T07:20:55.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.296+0000 7f989d900640 1 -- 172.21.15.87:0/4134321872 learned_addr learned my addr 172.21.15.87:0/4134321872 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:20:55.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.296+0000 7f989d900640 1 -- 172.21.15.87:0/4134321872 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98980ff6e0 msgr2=0x7f98980fb0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:20:55.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.296+0000 7f989d900640 1 --2- 172.21.15.87:0/4134321872 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98980ff6e0 0x7f98980fb0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:55.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.296+0000 7f989d900640 1 -- 172.21.15.87:0/4134321872 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9888005040 con 0x7f9898065be0 2024-09-17T07:20:55.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.296+0000 7f989d900640 1 --2- 172.21.15.87:0/4134321872 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9898065be0 0x7f98980fcb60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f989400eb70 tx=0x7f989400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:20:55.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.296+0000 7f988e7fc640 1 -- 172.21.15.87:0/4134321872 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9894007c30 con 0x7f9898065be0 2024-09-17T07:20:55.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.296+0000 7f988e7fc640 1 -- 172.21.15.87:0/4134321872 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f989400f040 con 0x7f9898065be0 2024-09-17T07:20:55.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.296+0000 7f989fb64640 1 -- 172.21.15.87:0/4134321872 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98980fba00 con 0x7f9898065be0 2024-09-17T07:20:55.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.296+0000 7f988e7fc640 1 -- 172.21.15.87:0/4134321872 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f989400cad0 con 0x7f9898065be0 2024-09-17T07:20:55.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.296+0000 7f989fb64640 1 -- 172.21.15.87:0/4134321872 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9898115050 con 0x7f9898065be0 2024-09-17T07:20:55.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.297+0000 7f989fb64640 1 -- 172.21.15.87:0/4134321872 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98980fa890 con 0x7f9898065be0 2024-09-17T07:20:55.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.298+0000 7f988e7fc640 1 -- 172.21.15.87:0/4134321872 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 24) v1 ==== 90881+0+0 (secure 0 0 0) 0x7f989400cc30 con 0x7f9898065be0 2024-09-17T07:20:55.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.298+0000 7f988e7fc640 1 --2- 172.21.15.87:0/4134321872 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f988406dbd0 0x7f9884070080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:20:55.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.298+0000 7f988e7fc640 1 -- 172.21.15.87:0/4134321872 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f989408d110 con 0x7f9898065be0 2024-09-17T07:20:55.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.298+0000 7f989d0ff640 1 --2- 172.21.15.87:0/4134321872 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f988406dbd0 0x7f9884070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:20:55.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.299+0000 7f989d0ff640 1 --2- 172.21.15.87:0/4134321872 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f988406dbd0 0x7f9884070080 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9888009ac0 tx=0x7f9888035040 comp rx=0 tx=0).ready entity=mgr.24339 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:20:55.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.303+0000 7f988e7fc640 1 -- 172.21.15.87:0/4134321872 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182127 (secure 0 0 0) 0x7f9894057680 con 0x7f9898065be0 2024-09-17T07:20:55.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:55 smithi087 ceph-mon[27636]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-17T07:20:55.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:55 smithi087 ceph-mon[27636]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-17T07:20:55.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:55 smithi087 ceph-mon[27636]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T07:20:55.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:55 smithi087 ceph-mon[27636]: Upgrade: Need to upgrade myself (mgr.smithi139.tuqnpn) 2024-09-17T07:20:55.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:55 smithi087 ceph-mon[27636]: Upgrade: Need to upgrade myself (mgr.smithi139.tuqnpn) 2024-09-17T07:20:55.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:55 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:20:55.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.564+0000 7f989fb64640 1 -- 172.21.15.87:0/4134321872 --> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f98980f8700 con 0x7f988406dbd0 2024-09-17T07:20:55.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.565+0000 7f988e7fc640 1 -- 172.21.15.87:0/4134321872 <== mgr.24339 v2:172.21.15.139:6828/3218632563 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7f98980f8700 con 0x7f988406dbd0 2024-09-17T07:20:55.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.569+0000 7f989fb64640 1 -- 172.21.15.87:0/4134321872 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f988406dbd0 msgr2=0x7f9884070080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:20:55.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.569+0000 7f989fb64640 1 --2- 172.21.15.87:0/4134321872 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f988406dbd0 0x7f9884070080 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9888009ac0 tx=0x7f9888035040 comp rx=0 tx=0).stop 2024-09-17T07:20:55.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.569+0000 7f989fb64640 1 -- 172.21.15.87:0/4134321872 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9898065be0 msgr2=0x7f98980fcb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:20:55.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.569+0000 7f989fb64640 1 --2- 172.21.15.87:0/4134321872 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9898065be0 0x7f98980fcb60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f989400eb70 tx=0x7f989400b040 comp rx=0 tx=0).stop 2024-09-17T07:20:55.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.569+0000 7f989fb64640 1 -- 172.21.15.87:0/4134321872 shutdown_connections 2024-09-17T07:20:55.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.569+0000 7f989fb64640 1 --2- 172.21.15.87:0/4134321872 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f988406dbd0 0x7f9884070080 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:55.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.569+0000 7f989fb64640 1 --2- 172.21.15.87:0/4134321872 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98980ff6e0 0x7f98980fb0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:55.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.569+0000 7f989fb64640 1 --2- 172.21.15.87:0/4134321872 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9898065be0 0x7f98980fcb60 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:55.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.569+0000 7f989fb64640 1 -- 172.21.15.87:0/4134321872 >> 172.21.15.87:0/4134321872 conn(0x7f98980f6c10 msgr2=0x7f98980f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:20:55.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.570+0000 7f989fb64640 1 -- 172.21.15.87:0/4134321872 shutdown_connections 2024-09-17T07:20:55.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.570+0000 7f989fb64640 1 -- 172.21.15.87:0/4134321872 wait complete. 2024-09-17T07:20:55.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:55 smithi139 ceph-mon[34403]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-17T07:20:55.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:55 smithi139 ceph-mon[34403]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-17T07:20:55.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:55 smithi139 ceph-mon[34403]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T07:20:55.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:55 smithi139 ceph-mon[34403]: Upgrade: Need to upgrade myself (mgr.smithi139.tuqnpn) 2024-09-17T07:20:55.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:55 smithi139 ceph-mon[34403]: Upgrade: Need to upgrade myself (mgr.smithi139.tuqnpn) 2024-09-17T07:20:55.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:55 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:20:55.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.695+0000 7ff098ba1640 1 -- 172.21.15.87:0/532764714 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0940fb280 msgr2=0x7ff0940fb690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:20:55.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.695+0000 7ff098ba1640 1 --2- 172.21.15.87:0/532764714 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0940fb280 0x7ff0940fb690 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7ff0840048d0 tx=0x7ff084009da0 comp rx=0 tx=0).stop 2024-09-17T07:20:55.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.695+0000 7ff098ba1640 1 -- 172.21.15.87:0/532764714 shutdown_connections 2024-09-17T07:20:55.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.695+0000 7ff098ba1640 1 --2- 172.21.15.87:0/532764714 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff0940fc550 0x7ff0940fc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:55.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.695+0000 7ff098ba1640 1 --2- 172.21.15.87:0/532764714 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0940fb280 0x7ff0940fb690 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:55.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.695+0000 7ff098ba1640 1 -- 172.21.15.87:0/532764714 >> 172.21.15.87:0/532764714 conn(0x7ff0940f6a40 msgr2=0x7ff0940f8e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:20:55.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.695+0000 7ff098ba1640 1 -- 172.21.15.87:0/532764714 shutdown_connections 2024-09-17T07:20:55.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.695+0000 7ff098ba1640 1 -- 172.21.15.87:0/532764714 wait complete. 2024-09-17T07:20:55.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.695+0000 7ff098ba1640 1 Processor -- start 2024-09-17T07:20:55.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.695+0000 7ff098ba1640 1 -- start start 2024-09-17T07:20:55.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.696+0000 7ff098ba1640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff0940fb280 0x7ff09410eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:20:55.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.696+0000 7ff098ba1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0940fc550 0x7ff09410f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:20:55.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.696+0000 7ff098ba1640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff09410fb80 con 0x7ff0940fc550 2024-09-17T07:20:55.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.696+0000 7ff098ba1640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0941103a0 con 0x7ff0940fb280 2024-09-17T07:20:55.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.696+0000 7ff0937fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff0940fb280 0x7ff09410eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:20:55.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.696+0000 7ff092ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0940fc550 0x7ff09410f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:20:55.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.696+0000 7ff092ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0940fc550 0x7ff09410f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:50810/0 (socket says 172.21.15.87:50810) 2024-09-17T07:20:55.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.696+0000 7ff0937fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff0940fb280 0x7ff09410eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.87:51774/0 (socket says 172.21.15.87:51774) 2024-09-17T07:20:55.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.696+0000 7ff092ffd640 1 -- 172.21.15.87:0/90269254 learned_addr learned my addr 172.21.15.87:0/90269254 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:20:55.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.696+0000 7ff0937fe640 1 -- 172.21.15.87:0/90269254 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0940fc550 msgr2=0x7ff09410f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:20:55.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.696+0000 7ff0937fe640 1 --2- 172.21.15.87:0/90269254 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0940fc550 0x7ff09410f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:55.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.696+0000 7ff0937fe640 1 -- 172.21.15.87:0/90269254 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff084005040 con 0x7ff0940fb280 2024-09-17T07:20:55.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.696+0000 7ff092ffd640 1 --2- 172.21.15.87:0/90269254 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0940fc550 0x7ff09410f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T07:20:55.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.696+0000 7ff0937fe640 1 --2- 172.21.15.87:0/90269254 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff0940fb280 0x7ff09410eff0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff0840043d0 tx=0x7ff084009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:20:55.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.697+0000 7ff07bfff640 1 -- 172.21.15.87:0/90269254 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff084038070 con 0x7ff0940fb280 2024-09-17T07:20:55.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.697+0000 7ff098ba1640 1 -- 172.21.15.87:0/90269254 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0941105d0 con 0x7ff0940fb280 2024-09-17T07:20:55.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.697+0000 7ff07bfff640 1 -- 172.21.15.87:0/90269254 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7ff0840096c0 con 0x7ff0940fb280 2024-09-17T07:20:55.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.697+0000 7ff07bfff640 1 -- 172.21.15.87:0/90269254 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff08403d420 con 0x7ff0940fb280 2024-09-17T07:20:55.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.697+0000 7ff098ba1640 1 -- 172.21.15.87:0/90269254 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff094110b40 con 0x7ff0940fb280 2024-09-17T07:20:55.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.698+0000 7ff098ba1640 1 -- 172.21.15.87:0/90269254 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff094104370 con 0x7ff0940fb280 2024-09-17T07:20:55.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.698+0000 7ff07bfff640 1 -- 172.21.15.87:0/90269254 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 24) v1 ==== 90881+0+0 (secure 0 0 0) 0x7ff084030020 con 0x7ff0940fb280 2024-09-17T07:20:55.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.699+0000 7ff07bfff640 1 --2- 172.21.15.87:0/90269254 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7ff07c06dbd0 0x7ff07c070080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:20:55.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.699+0000 7ff07bfff640 1 -- 172.21.15.87:0/90269254 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7ff0840ad570 con 0x7ff0940fb280 2024-09-17T07:20:55.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.699+0000 7ff092ffd640 1 --2- 172.21.15.87:0/90269254 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7ff07c06dbd0 0x7ff07c070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:20:55.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.700+0000 7ff092ffd640 1 --2- 172.21.15.87:0/90269254 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7ff07c06dbd0 0x7ff07c070080 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff088004fd0 tx=0x7ff08800b040 comp rx=0 tx=0).ready entity=mgr.24339 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:20:55.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.703+0000 7ff07bfff640 1 -- 172.21.15.87:0/90269254 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182127 (secure 0 0 0) 0x7ff084077a50 con 0x7ff0940fb280 2024-09-17T07:20:55.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.943+0000 7ff098ba1640 1 -- 172.21.15.87:0/90269254 --> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff094103bd0 con 0x7ff07c06dbd0 2024-09-17T07:20:55.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.951+0000 7ff07bfff640 1 -- 172.21.15.87:0/90269254 <== mgr.24339 v2:172.21.15.139:6828/3218632563 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7ff094103bd0 con 0x7ff07c06dbd0 2024-09-17T07:20:55.951 INFO:teuthology.orchestra.run.smithi087.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T07:20:55.951 INFO:teuthology.orchestra.run.smithi087.stdout:alertmanager.smithi087 smithi087 *:9093,9094 starting - - - - 2024-09-17T07:20:55.952 INFO:teuthology.orchestra.run.smithi087.stdout:crash.smithi087 smithi087 running (9m) 50s ago 9m 6891k - 17.2.7-1635-g4a704134 f22ead590bad d9aaf9839ada 2024-09-17T07:20:55.952 INFO:teuthology.orchestra.run.smithi087.stdout:crash.smithi139 smithi139 running (8m) 60s ago 8m 6895k - 17.2.7-1635-g4a704134 f22ead590bad 354c853b318f 2024-09-17T07:20:55.952 INFO:teuthology.orchestra.run.smithi087.stdout:grafana.smithi087 smithi087 *:3000 starting - - - - 2024-09-17T07:20:55.952 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi087.tjhpcs smithi087 running (3m) 50s ago 3m 123M - 17.2.7-1635-g4a704134 f22ead590bad f7142ad971ed 2024-09-17T07:20:55.952 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi087.vvbzss smithi087 running (3m) 50s ago 3m 128M - 17.2.7-1635-g4a704134 f22ead590bad 2dd82ff293d1 2024-09-17T07:20:55.952 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi139.ftvinf smithi139 running (3m) 60s ago 3m 113M - 17.2.7-1635-g4a704134 f22ead590bad d11edb295ad3 2024-09-17T07:20:55.952 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi139.gnwonz smithi139 running (3m) 60s ago 3m 130M - 17.2.7-1635-g4a704134 f22ead590bad 3b3d884aef02 2024-09-17T07:20:55.952 INFO:teuthology.orchestra.run.smithi087.stdout:mgr.smithi087.vuvjer smithi087 *:9283,8765,8443 running (10m) 50s ago 10m 182M - 17.2.7-1635-g4a704134 f22ead590bad 11130bf9b46c 2024-09-17T07:20:55.952 INFO:teuthology.orchestra.run.smithi087.stdout:mgr.smithi139.tuqnpn smithi139 *:8443,9283 running (108s) 60s ago 8m 467M - 18.2.4-855-g19e2a2be 980a0bfcd684 ea12b2e696b5 2024-09-17T07:20:55.952 INFO:teuthology.orchestra.run.smithi087.stdout:mon.smithi087 smithi087 running (10m) 50s ago 10m 53.6M 2048M 17.2.7-1635-g4a704134 f22ead590bad 175785e1fb86 2024-09-17T07:20:55.952 INFO:teuthology.orchestra.run.smithi087.stdout:mon.smithi139 smithi139 running (7m) 60s ago 7m 39.2M 2048M 17.2.7-1635-g4a704134 f22ead590bad a9a2552dc411 2024-09-17T07:20:55.952 INFO:teuthology.orchestra.run.smithi087.stdout:node-exporter.smithi087 smithi087 *:9100 starting - - - - 2024-09-17T07:20:55.952 INFO:teuthology.orchestra.run.smithi087.stdout:node-exporter.smithi139 smithi139 *:9100 starting - - - - 2024-09-17T07:20:55.953 INFO:teuthology.orchestra.run.smithi087.stdout:osd.0 smithi087 running (7m) 50s ago 7m 88.2M 1557M 17.2.7-1635-g4a704134 f22ead590bad 396801f9b539 2024-09-17T07:20:55.953 INFO:teuthology.orchestra.run.smithi087.stdout:osd.1 smithi087 running (6m) 50s ago 6m 99.7M 1557M 17.2.7-1635-g4a704134 f22ead590bad 9446985bfcd1 2024-09-17T07:20:55.953 INFO:teuthology.orchestra.run.smithi087.stdout:osd.2 smithi087 running (6m) 50s ago 6m 84.8M 1557M 17.2.7-1635-g4a704134 f22ead590bad 8fe1428a6878 2024-09-17T07:20:55.953 INFO:teuthology.orchestra.run.smithi087.stdout:osd.3 smithi139 running (5m) 60s ago 5m 100M 2581M 17.2.7-1635-g4a704134 f22ead590bad 0801999b17c4 2024-09-17T07:20:55.953 INFO:teuthology.orchestra.run.smithi087.stdout:osd.4 smithi139 running (5m) 60s ago 5m 92.2M 2581M 17.2.7-1635-g4a704134 f22ead590bad 299a8dfc47f5 2024-09-17T07:20:55.953 INFO:teuthology.orchestra.run.smithi087.stdout:osd.5 smithi139 running (5m) 60s ago 5m 96.1M 2581M 17.2.7-1635-g4a704134 f22ead590bad 609cf74f32e7 2024-09-17T07:20:55.953 INFO:teuthology.orchestra.run.smithi087.stdout:prometheus.smithi087 smithi087 *:9095 starting - - - - 2024-09-17T07:20:55.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.953+0000 7ff098ba1640 1 -- 172.21.15.87:0/90269254 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7ff07c06dbd0 msgr2=0x7ff07c070080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:20:55.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.953+0000 7ff098ba1640 1 --2- 172.21.15.87:0/90269254 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7ff07c06dbd0 0x7ff07c070080 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff088004fd0 tx=0x7ff08800b040 comp rx=0 tx=0).stop 2024-09-17T07:20:55.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.953+0000 7ff098ba1640 1 -- 172.21.15.87:0/90269254 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff0940fb280 msgr2=0x7ff09410eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:20:55.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.953+0000 7ff098ba1640 1 --2- 172.21.15.87:0/90269254 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff0940fb280 0x7ff09410eff0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff0840043d0 tx=0x7ff084009da0 comp rx=0 tx=0).stop 2024-09-17T07:20:55.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.953+0000 7ff098ba1640 1 -- 172.21.15.87:0/90269254 shutdown_connections 2024-09-17T07:20:55.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.953+0000 7ff098ba1640 1 --2- 172.21.15.87:0/90269254 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7ff07c06dbd0 0x7ff07c070080 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:55.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.953+0000 7ff098ba1640 1 --2- 172.21.15.87:0/90269254 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0940fc550 0x7ff09410f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:55.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.953+0000 7ff098ba1640 1 --2- 172.21.15.87:0/90269254 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff0940fb280 0x7ff09410eff0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:55.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.953+0000 7ff098ba1640 1 -- 172.21.15.87:0/90269254 >> 172.21.15.87:0/90269254 conn(0x7ff0940f6a40 msgr2=0x7ff0940655a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:20:55.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.954+0000 7ff098ba1640 1 -- 172.21.15.87:0/90269254 shutdown_connections 2024-09-17T07:20:55.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:55.954+0000 7ff098ba1640 1 -- 172.21.15.87:0/90269254 wait complete. 2024-09-17T07:20:56.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.057+0000 7f1e271b6640 1 -- 172.21.15.87:0/2555557570 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e200fb430 msgr2=0x7f1e200fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:20:56.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.057+0000 7f1e271b6640 1 --2- 172.21.15.87:0/2555557570 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e200fb430 0x7f1e200fb840 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f1e140048d0 tx=0x7f1e14009da0 comp rx=0 tx=0).stop 2024-09-17T07:20:56.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.058+0000 7f1e271b6640 1 -- 172.21.15.87:0/2555557570 shutdown_connections 2024-09-17T07:20:56.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.058+0000 7f1e271b6640 1 --2- 172.21.15.87:0/2555557570 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1e200fc700 0x7f1e200fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:56.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.058+0000 7f1e271b6640 1 --2- 172.21.15.87:0/2555557570 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e200fb430 0x7f1e200fb840 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:56.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.058+0000 7f1e271b6640 1 -- 172.21.15.87:0/2555557570 >> 172.21.15.87:0/2555557570 conn(0x7f1e200f6c10 msgr2=0x7f1e200f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:20:56.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.058+0000 7f1e271b6640 1 -- 172.21.15.87:0/2555557570 shutdown_connections 2024-09-17T07:20:56.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.058+0000 7f1e271b6640 1 -- 172.21.15.87:0/2555557570 wait complete. 2024-09-17T07:20:56.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.059+0000 7f1e271b6640 1 Processor -- start 2024-09-17T07:20:56.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.059+0000 7f1e271b6640 1 -- start start 2024-09-17T07:20:56.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.059+0000 7f1e271b6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e200fb430 0x7f1e2010bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:20:56.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.059+0000 7f1e271b6640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1e200fc700 0x7f1e2010c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:20:56.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.060+0000 7f1e24f52640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e200fb430 0x7f1e2010bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:20:56.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.060+0000 7f1e24f52640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e200fb430 0x7f1e2010bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:50834/0 (socket says 172.21.15.87:50834) 2024-09-17T07:20:56.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.060+0000 7f1e24f52640 1 -- 172.21.15.87:0/1147130467 learned_addr learned my addr 172.21.15.87:0/1147130467 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:20:56.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.060+0000 7f1e271b6640 1 -- 172.21.15.87:0/1147130467 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2010d2b0 con 0x7f1e200fb430 2024-09-17T07:20:56.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.060+0000 7f1e271b6640 1 -- 172.21.15.87:0/1147130467 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2010d420 con 0x7f1e200fc700 2024-09-17T07:20:56.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.060+0000 7f1e1ffff640 1 --2- 172.21.15.87:0/1147130467 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1e200fc700 0x7f1e2010c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:20:56.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.060+0000 7f1e24f52640 1 -- 172.21.15.87:0/1147130467 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1e200fc700 msgr2=0x7f1e2010c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:20:56.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.060+0000 7f1e24f52640 1 --2- 172.21.15.87:0/1147130467 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1e200fc700 0x7f1e2010c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:56.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.060+0000 7f1e24f52640 1 -- 172.21.15.87:0/1147130467 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e14005040 con 0x7f1e200fb430 2024-09-17T07:20:56.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.060+0000 7f1e1ffff640 1 --2- 172.21.15.87:0/1147130467 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1e200fc700 0x7f1e2010c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T07:20:56.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.060+0000 7f1e24f52640 1 --2- 172.21.15.87:0/1147130467 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e200fb430 0x7f1e2010bf00 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f1e14009ac0 tx=0x7f1e14009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:20:56.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.061+0000 7f1e1d7fa640 1 -- 172.21.15.87:0/1147130467 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e1403a070 con 0x7f1e200fb430 2024-09-17T07:20:56.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.061+0000 7f1e1d7fa640 1 -- 172.21.15.87:0/1147130467 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f1e1403fa80 con 0x7f1e200fb430 2024-09-17T07:20:56.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.061+0000 7f1e1d7fa640 1 -- 172.21.15.87:0/1147130467 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e140339c0 con 0x7f1e200fb430 2024-09-17T07:20:56.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.061+0000 7f1e271b6640 1 -- 172.21.15.87:0/1147130467 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e2010d6a0 con 0x7f1e200fb430 2024-09-17T07:20:56.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.062+0000 7f1e271b6640 1 -- 172.21.15.87:0/1147130467 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e2010db60 con 0x7f1e200fb430 2024-09-17T07:20:56.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.063+0000 7f1e271b6640 1 -- 172.21.15.87:0/1147130467 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e20104580 con 0x7f1e200fb430 2024-09-17T07:20:56.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.064+0000 7f1e1d7fa640 1 -- 172.21.15.87:0/1147130467 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 24) v1 ==== 90881+0+0 (secure 0 0 0) 0x7f1e14030020 con 0x7f1e200fb430 2024-09-17T07:20:56.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.064+0000 7f1e1d7fa640 1 --2- 172.21.15.87:0/1147130467 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f1e1006dca0 0x7f1e10070150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:20:56.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.064+0000 7f1e1d7fa640 1 -- 172.21.15.87:0/1147130467 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f1e140af7c0 con 0x7f1e200fb430 2024-09-17T07:20:56.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.065+0000 7f1e1ffff640 1 --2- 172.21.15.87:0/1147130467 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f1e1006dca0 0x7f1e10070150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:20:56.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.065+0000 7f1e1ffff640 1 --2- 172.21.15.87:0/1147130467 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f1e1006dca0 0x7f1e10070150 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1e2010bcb0 tx=0x7f1e0c009120 comp rx=0 tx=0).ready entity=mgr.24339 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:20:56.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.071+0000 7f1e1d7fa640 1 -- 172.21.15.87:0/1147130467 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182127 (secure 0 0 0) 0x7f1e14079de0 con 0x7f1e200fb430 2024-09-17T07:20:56.212 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:56 smithi087 ceph-mon[27636]: pgmap v41: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 100 op/s 2024-09-17T07:20:56.212 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:56 smithi087 ceph-mon[27636]: from='client.24451 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:20:56.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.468+0000 7f1e271b6640 1 -- 172.21.15.87:0/1147130467 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1e20103e90 con 0x7f1e200fb430 2024-09-17T07:20:56.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.469+0000 7f1e1d7fa640 1 -- 172.21.15.87:0/1147130467 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+853 (secure 0 0 0) 0x7f1e1407d400 con 0x7f1e200fb430 2024-09-17T07:20:56.469 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T07:20:56.469 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": { 2024-09-17T07:20:56.469 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 2 2024-09-17T07:20:56.469 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:20:56.469 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr": { 2024-09-17T07:20:56.469 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 1, 2024-09-17T07:20:56.469 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 1 2024-09-17T07:20:56.469 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:20:56.469 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": { 2024-09-17T07:20:56.470 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 6 2024-09-17T07:20:56.470 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:20:56.470 INFO:teuthology.orchestra.run.smithi087.stdout: "mds": { 2024-09-17T07:20:56.470 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 4 2024-09-17T07:20:56.470 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:20:56.470 INFO:teuthology.orchestra.run.smithi087.stdout: "overall": { 2024-09-17T07:20:56.470 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 13, 2024-09-17T07:20:56.470 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 1 2024-09-17T07:20:56.470 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T07:20:56.470 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T07:20:56.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.471+0000 7f1e271b6640 1 -- 172.21.15.87:0/1147130467 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f1e1006dca0 msgr2=0x7f1e10070150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:20:56.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.471+0000 7f1e271b6640 1 --2- 172.21.15.87:0/1147130467 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f1e1006dca0 0x7f1e10070150 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1e2010bcb0 tx=0x7f1e0c009120 comp rx=0 tx=0).stop 2024-09-17T07:20:56.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.471+0000 7f1e271b6640 1 -- 172.21.15.87:0/1147130467 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e200fb430 msgr2=0x7f1e2010bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:20:56.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.471+0000 7f1e271b6640 1 --2- 172.21.15.87:0/1147130467 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e200fb430 0x7f1e2010bf00 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f1e14009ac0 tx=0x7f1e14009da0 comp rx=0 tx=0).stop 2024-09-17T07:20:56.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.471+0000 7f1e271b6640 1 -- 172.21.15.87:0/1147130467 shutdown_connections 2024-09-17T07:20:56.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.471+0000 7f1e271b6640 1 --2- 172.21.15.87:0/1147130467 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f1e1006dca0 0x7f1e10070150 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:56.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.471+0000 7f1e271b6640 1 --2- 172.21.15.87:0/1147130467 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1e200fc700 0x7f1e2010c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:56.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.471+0000 7f1e271b6640 1 --2- 172.21.15.87:0/1147130467 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e200fb430 0x7f1e2010bf00 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:56.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.471+0000 7f1e271b6640 1 -- 172.21.15.87:0/1147130467 >> 172.21.15.87:0/1147130467 conn(0x7f1e200f6c10 msgr2=0x7f1e200f8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:20:56.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.471+0000 7f1e271b6640 1 -- 172.21.15.87:0/1147130467 shutdown_connections 2024-09-17T07:20:56.472 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.471+0000 7f1e271b6640 1 -- 172.21.15.87:0/1147130467 wait complete. 2024-09-17T07:20:56.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.564+0000 7f8e95498640 1 -- 172.21.15.87:0/2163448750 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e90065be0 msgr2=0x7f8e900ff1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:20:56.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.564+0000 7f8e95498640 1 --2- 172.21.15.87:0/2163448750 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e90065be0 0x7f8e900ff1a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f8e800048d0 tx=0x7f8e80009da0 comp rx=0 tx=0).stop 2024-09-17T07:20:56.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.564+0000 7f8e95498640 1 -- 172.21.15.87:0/2163448750 shutdown_connections 2024-09-17T07:20:56.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.564+0000 7f8e95498640 1 --2- 172.21.15.87:0/2163448750 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8e900ff6e0 0x7f8e90101ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:56.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.564+0000 7f8e95498640 1 --2- 172.21.15.87:0/2163448750 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e90065be0 0x7f8e900ff1a0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:56.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.564+0000 7f8e95498640 1 -- 172.21.15.87:0/2163448750 >> 172.21.15.87:0/2163448750 conn(0x7f8e900f6c10 msgr2=0x7f8e900f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:20:56.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.564+0000 7f8e95498640 1 -- 172.21.15.87:0/2163448750 shutdown_connections 2024-09-17T07:20:56.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.564+0000 7f8e95498640 1 -- 172.21.15.87:0/2163448750 wait complete. 2024-09-17T07:20:56.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.565+0000 7f8e95498640 1 Processor -- start 2024-09-17T07:20:56.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.565+0000 7f8e95498640 1 -- start start 2024-09-17T07:20:56.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.565+0000 7f8e95498640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e90065be0 0x7f8e9010cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:20:56.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.565+0000 7f8e95498640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8e900ff6e0 0x7f8e9010d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:20:56.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.565+0000 7f8e95498640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9010db50 con 0x7f8e90065be0 2024-09-17T07:20:56.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.565+0000 7f8e95498640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9010e370 con 0x7f8e900ff6e0 2024-09-17T07:20:56.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.565+0000 7f8e8effd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e90065be0 0x7f8e9010cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:20:56.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.565+0000 7f8e8effd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e90065be0 0x7f8e9010cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:50848/0 (socket says 172.21.15.87:50848) 2024-09-17T07:20:56.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.565+0000 7f8e8effd640 1 -- 172.21.15.87:0/467544529 learned_addr learned my addr 172.21.15.87:0/467544529 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:20:56.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.565+0000 7f8e8e7fc640 1 --2- 172.21.15.87:0/467544529 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8e900ff6e0 0x7f8e9010d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:20:56.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.566+0000 7f8e8effd640 1 -- 172.21.15.87:0/467544529 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8e900ff6e0 msgr2=0x7f8e9010d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:20:56.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.566+0000 7f8e8effd640 1 --2- 172.21.15.87:0/467544529 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8e900ff6e0 0x7f8e9010d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:56.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.566+0000 7f8e8effd640 1 -- 172.21.15.87:0/467544529 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e80005040 con 0x7f8e90065be0 2024-09-17T07:20:56.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.566+0000 7f8e8effd640 1 --2- 172.21.15.87:0/467544529 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e90065be0 0x7f8e9010cfc0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f8e80009ac0 tx=0x7f8e80009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:20:56.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.566+0000 7f8e777fe640 1 -- 172.21.15.87:0/467544529 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e80038070 con 0x7f8e90065be0 2024-09-17T07:20:56.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.566+0000 7f8e95498640 1 -- 172.21.15.87:0/467544529 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e9010e5a0 con 0x7f8e90065be0 2024-09-17T07:20:56.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.566+0000 7f8e777fe640 1 -- 172.21.15.87:0/467544529 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f8e800338a0 con 0x7f8e90065be0 2024-09-17T07:20:56.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.566+0000 7f8e777fe640 1 -- 172.21.15.87:0/467544529 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e8003c7b0 con 0x7f8e90065be0 2024-09-17T07:20:56.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.566+0000 7f8e95498640 1 -- 172.21.15.87:0/467544529 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e9010eae0 con 0x7f8e90065be0 2024-09-17T07:20:56.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.567+0000 7f8e95498640 1 -- 172.21.15.87:0/467544529 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e900fa890 con 0x7f8e90065be0 2024-09-17T07:20:56.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.568+0000 7f8e777fe640 1 -- 172.21.15.87:0/467544529 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 24) v1 ==== 90881+0+0 (secure 0 0 0) 0x7f8e80030020 con 0x7f8e90065be0 2024-09-17T07:20:56.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.569+0000 7f8e777fe640 1 --2- 172.21.15.87:0/467544529 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f8e7806dbd0 0x7f8e78070080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:20:56.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.569+0000 7f8e777fe640 1 -- 172.21.15.87:0/467544529 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f8e800acea0 con 0x7f8e90065be0 2024-09-17T07:20:56.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.569+0000 7f8e8e7fc640 1 --2- 172.21.15.87:0/467544529 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f8e7806dbd0 0x7f8e78070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:20:56.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.570+0000 7f8e8e7fc640 1 --2- 172.21.15.87:0/467544529 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f8e7806dbd0 0x7f8e78070080 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8e9010cd70 tx=0x7f8e8400b040 comp rx=0 tx=0).ready entity=mgr.24339 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:20:56.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.574+0000 7f8e777fe640 1 -- 172.21.15.87:0/467544529 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182127 (secure 0 0 0) 0x7f8e80077430 con 0x7f8e90065be0 2024-09-17T07:20:56.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:56 smithi139 ceph-mon[34403]: pgmap v41: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 100 op/s 2024-09-17T07:20:56.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:56 smithi139 ceph-mon[34403]: from='client.24451 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:20:56.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.830+0000 7f8e95498640 1 -- 172.21.15.87:0/467544529 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8e9010ede0 con 0x7f8e90065be0 2024-09-17T07:20:56.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.831+0000 7f8e777fe640 1 -- 172.21.15.87:0/467544529 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1867 (secure 0 0 0) 0x7f8e80041760 con 0x7f8e90065be0 2024-09-17T07:20:56.831 INFO:teuthology.orchestra.run.smithi087.stdout:e21 2024-09-17T07:20:56.831 INFO:teuthology.orchestra.run.smithi087.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T07:20:56.831 INFO:teuthology.orchestra.run.smithi087.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T07:20:56.831 INFO:teuthology.orchestra.run.smithi087.stdout:legacy client fscid: 1 2024-09-17T07:20:56.831 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:20:56.832 INFO:teuthology.orchestra.run.smithi087.stdout:Filesystem 'cephfs' (1) 2024-09-17T07:20:56.832 INFO:teuthology.orchestra.run.smithi087.stdout:fs_name cephfs 2024-09-17T07:20:56.832 INFO:teuthology.orchestra.run.smithi087.stdout:epoch 21 2024-09-17T07:20:56.832 INFO:teuthology.orchestra.run.smithi087.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T07:20:56.832 INFO:teuthology.orchestra.run.smithi087.stdout:created 2024-09-17T07:17:15.368053+0000 2024-09-17T07:20:56.832 INFO:teuthology.orchestra.run.smithi087.stdout:modified 2024-09-17T07:20:37.142055+0000 2024-09-17T07:20:56.832 INFO:teuthology.orchestra.run.smithi087.stdout:tableserver 0 2024-09-17T07:20:56.832 INFO:teuthology.orchestra.run.smithi087.stdout:root 0 2024-09-17T07:20:56.832 INFO:teuthology.orchestra.run.smithi087.stdout:session_timeout 60 2024-09-17T07:20:56.832 INFO:teuthology.orchestra.run.smithi087.stdout:session_autoclose 300 2024-09-17T07:20:56.832 INFO:teuthology.orchestra.run.smithi087.stdout:max_file_size 1099511627776 2024-09-17T07:20:56.832 INFO:teuthology.orchestra.run.smithi087.stdout:required_client_features {} 2024-09-17T07:20:56.833 INFO:teuthology.orchestra.run.smithi087.stdout:last_failure 0 2024-09-17T07:20:56.833 INFO:teuthology.orchestra.run.smithi087.stdout:last_failure_osd_epoch 44 2024-09-17T07:20:56.833 INFO:teuthology.orchestra.run.smithi087.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T07:20:56.833 INFO:teuthology.orchestra.run.smithi087.stdout:max_mds 2 2024-09-17T07:20:56.833 INFO:teuthology.orchestra.run.smithi087.stdout:in 0,1 2024-09-17T07:20:56.833 INFO:teuthology.orchestra.run.smithi087.stdout:up {0=14478,1=24243} 2024-09-17T07:20:56.833 INFO:teuthology.orchestra.run.smithi087.stdout:failed 2024-09-17T07:20:56.833 INFO:teuthology.orchestra.run.smithi087.stdout:damaged 2024-09-17T07:20:56.833 INFO:teuthology.orchestra.run.smithi087.stdout:stopped 2024-09-17T07:20:56.833 INFO:teuthology.orchestra.run.smithi087.stdout:data_pools [3] 2024-09-17T07:20:56.833 INFO:teuthology.orchestra.run.smithi087.stdout:metadata_pool 2 2024-09-17T07:20:56.833 INFO:teuthology.orchestra.run.smithi087.stdout:inline_data enabled 2024-09-17T07:20:56.833 INFO:teuthology.orchestra.run.smithi087.stdout:balancer 2024-09-17T07:20:56.834 INFO:teuthology.orchestra.run.smithi087.stdout:standby_count_wanted 1 2024-09-17T07:20:56.834 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi087.tjhpcs{0:14478} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.87:6828/2255237099,v1:172.21.15.87:6829/2255237099] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:20:56.834 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi087.vvbzss{0:14490} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.87:6826/4022268353,v1:172.21.15.87:6827/4022268353] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:20:56.834 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi139.gnwonz{1:24243} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.139:6824/3946792151,v1:172.21.15.139:6825/3946792151] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:20:56.834 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi139.ftvinf{1:24253} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.139:6826/3292073323,v1:172.21.15.139:6827/3292073323] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:20:56.834 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:20:56.834 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:20:56.835 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 21 2024-09-17T07:20:56.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.833+0000 7f8e95498640 1 -- 172.21.15.87:0/467544529 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f8e7806dbd0 msgr2=0x7f8e78070080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:20:56.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.833+0000 7f8e95498640 1 --2- 172.21.15.87:0/467544529 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f8e7806dbd0 0x7f8e78070080 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8e9010cd70 tx=0x7f8e8400b040 comp rx=0 tx=0).stop 2024-09-17T07:20:56.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.833+0000 7f8e95498640 1 -- 172.21.15.87:0/467544529 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e90065be0 msgr2=0x7f8e9010cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:20:56.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.833+0000 7f8e95498640 1 --2- 172.21.15.87:0/467544529 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e90065be0 0x7f8e9010cfc0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f8e80009ac0 tx=0x7f8e80009da0 comp rx=0 tx=0).stop 2024-09-17T07:20:56.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.833+0000 7f8e95498640 1 -- 172.21.15.87:0/467544529 shutdown_connections 2024-09-17T07:20:56.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.833+0000 7f8e95498640 1 --2- 172.21.15.87:0/467544529 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f8e7806dbd0 0x7f8e78070080 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:56.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.833+0000 7f8e95498640 1 --2- 172.21.15.87:0/467544529 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8e900ff6e0 0x7f8e9010d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:56.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.833+0000 7f8e95498640 1 --2- 172.21.15.87:0/467544529 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e90065be0 0x7f8e9010cfc0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:56.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.833+0000 7f8e95498640 1 -- 172.21.15.87:0/467544529 >> 172.21.15.87:0/467544529 conn(0x7f8e900f6c10 msgr2=0x7f8e900f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:20:56.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.833+0000 7f8e95498640 1 -- 172.21.15.87:0/467544529 shutdown_connections 2024-09-17T07:20:56.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.833+0000 7f8e95498640 1 -- 172.21.15.87:0/467544529 wait complete. 2024-09-17T07:20:56.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.929+0000 7fcabe2eb640 1 -- 172.21.15.87:0/3128535135 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcab80fe740 msgr2=0x7fcab80feb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:20:56.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.929+0000 7fcabe2eb640 1 --2- 172.21.15.87:0/3128535135 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcab80fe740 0x7fcab80feb50 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fcaa80048d0 tx=0x7fcaa8009da0 comp rx=0 tx=0).stop 2024-09-17T07:20:56.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.929+0000 7fcabe2eb640 1 -- 172.21.15.87:0/3128535135 shutdown_connections 2024-09-17T07:20:56.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.929+0000 7fcabe2eb640 1 --2- 172.21.15.87:0/3128535135 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcab80ffa10 0x7fcab80ffe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:56.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.929+0000 7fcabe2eb640 1 --2- 172.21.15.87:0/3128535135 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcab80fe740 0x7fcab80feb50 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:56.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.929+0000 7fcabe2eb640 1 -- 172.21.15.87:0/3128535135 >> 172.21.15.87:0/3128535135 conn(0x7fcab80fa060 msgr2=0x7fcab80fc440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:20:56.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.929+0000 7fcabe2eb640 1 -- 172.21.15.87:0/3128535135 shutdown_connections 2024-09-17T07:20:56.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.929+0000 7fcabe2eb640 1 -- 172.21.15.87:0/3128535135 wait complete. 2024-09-17T07:20:56.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.929+0000 7fcabe2eb640 1 Processor -- start 2024-09-17T07:20:56.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.930+0000 7fcabe2eb640 1 -- start start 2024-09-17T07:20:56.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.930+0000 7fcabe2eb640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcab80fe740 0x7fcab810f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:20:56.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.930+0000 7fcabe2eb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcab80ffa10 0x7fcab810f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:20:56.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.930+0000 7fcabe2eb640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcab810fcf0 con 0x7fcab80ffa10 2024-09-17T07:20:56.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.930+0000 7fcabe2eb640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcab8110510 con 0x7fcab80fe740 2024-09-17T07:20:56.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.930+0000 7fcab77fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcab80ffa10 0x7fcab810f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:20:56.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.930+0000 7fcab7fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcab80fe740 0x7fcab810f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:20:56.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.930+0000 7fcab77fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcab80ffa10 0x7fcab810f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:50870/0 (socket says 172.21.15.87:50870) 2024-09-17T07:20:56.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.930+0000 7fcab77fe640 1 -- 172.21.15.87:0/2938827577 learned_addr learned my addr 172.21.15.87:0/2938827577 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:20:56.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.930+0000 7fcab77fe640 1 -- 172.21.15.87:0/2938827577 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcab80fe740 msgr2=0x7fcab810f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:20:56.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.930+0000 7fcab77fe640 1 --2- 172.21.15.87:0/2938827577 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcab80fe740 0x7fcab810f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:56.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.930+0000 7fcab77fe640 1 -- 172.21.15.87:0/2938827577 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaa8005040 con 0x7fcab80ffa10 2024-09-17T07:20:56.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.930+0000 7fcab7fff640 1 --2- 172.21.15.87:0/2938827577 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcab80fe740 0x7fcab810f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T07:20:56.932 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.931+0000 7fcab77fe640 1 --2- 172.21.15.87:0/2938827577 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcab80ffa10 0x7fcab810f6a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fcaac002a80 tx=0x7fcaac004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:20:56.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.931+0000 7fcab4ff9640 1 -- 172.21.15.87:0/2938827577 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcaac007c30 con 0x7fcab80ffa10 2024-09-17T07:20:56.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.931+0000 7fcab4ff9640 1 -- 172.21.15.87:0/2938827577 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fcaac00f040 con 0x7fcab80ffa10 2024-09-17T07:20:56.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.931+0000 7fcabe2eb640 1 -- 172.21.15.87:0/2938827577 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcab81107a0 con 0x7fcab80ffa10 2024-09-17T07:20:56.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.931+0000 7fcab4ff9640 1 -- 172.21.15.87:0/2938827577 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcaac009470 con 0x7fcab80ffa10 2024-09-17T07:20:56.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.931+0000 7fcabe2eb640 1 -- 172.21.15.87:0/2938827577 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcab8110cc0 con 0x7fcab80ffa10 2024-09-17T07:20:56.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.932+0000 7fcabe2eb640 1 -- 172.21.15.87:0/2938827577 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcab80fdba0 con 0x7fcab80ffa10 2024-09-17T07:20:56.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.932+0000 7fcab4ff9640 1 -- 172.21.15.87:0/2938827577 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 24) v1 ==== 90881+0+0 (secure 0 0 0) 0x7fcaac0096f0 con 0x7fcab80ffa10 2024-09-17T07:20:56.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.933+0000 7fcab4ff9640 1 --2- 172.21.15.87:0/2938827577 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7fcaa006dbd0 0x7fcaa0070080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:20:56.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.933+0000 7fcab4ff9640 1 -- 172.21.15.87:0/2938827577 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fcaac08cfa0 con 0x7fcab80ffa10 2024-09-17T07:20:56.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.933+0000 7fcab7fff640 1 --2- 172.21.15.87:0/2938827577 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7fcaa006dbd0 0x7fcaa0070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:20:56.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.934+0000 7fcab7fff640 1 --2- 172.21.15.87:0/2938827577 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7fcaa006dbd0 0x7fcaa0070080 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fcaa8000c00 tx=0x7fcaa8035040 comp rx=0 tx=0).ready entity=mgr.24339 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:20:56.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:56.937+0000 7fcab4ff9640 1 -- 172.21.15.87:0/2938827577 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182127 (secure 0 0 0) 0x7fcaac0573f0 con 0x7fcab80ffa10 2024-09-17T07:20:57.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:57.166+0000 7fcabe2eb640 1 -- 172.21.15.87:0/2938827577 --> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcab8111040 con 0x7fcaa006dbd0 2024-09-17T07:20:57.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:57.168+0000 7fcab4ff9640 1 -- 172.21.15.87:0/2938827577 <== mgr.24339 v2:172.21.15.139:6828/3218632563 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7fcab8111040 con 0x7fcaa006dbd0 2024-09-17T07:20:57.168 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T07:20:57.168 INFO:teuthology.orchestra.run.smithi087.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9", 2024-09-17T07:20:57.168 INFO:teuthology.orchestra.run.smithi087.stdout: "in_progress": true, 2024-09-17T07:20:57.168 INFO:teuthology.orchestra.run.smithi087.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T07:20:57.168 INFO:teuthology.orchestra.run.smithi087.stdout: "services_complete": [], 2024-09-17T07:20:57.168 INFO:teuthology.orchestra.run.smithi087.stdout: "progress": "1/21 daemons upgraded", 2024-09-17T07:20:57.168 INFO:teuthology.orchestra.run.smithi087.stdout: "message": "Currently upgrading mgr daemons", 2024-09-17T07:20:57.168 INFO:teuthology.orchestra.run.smithi087.stdout: "is_paused": false 2024-09-17T07:20:57.168 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T07:20:57.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:57.171+0000 7fcabe2eb640 1 -- 172.21.15.87:0/2938827577 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7fcaa006dbd0 msgr2=0x7fcaa0070080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:20:57.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:57.171+0000 7fcabe2eb640 1 --2- 172.21.15.87:0/2938827577 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7fcaa006dbd0 0x7fcaa0070080 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fcaa8000c00 tx=0x7fcaa8035040 comp rx=0 tx=0).stop 2024-09-17T07:20:57.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:57.171+0000 7fcabe2eb640 1 -- 172.21.15.87:0/2938827577 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcab80ffa10 msgr2=0x7fcab810f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:20:57.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:57.171+0000 7fcabe2eb640 1 --2- 172.21.15.87:0/2938827577 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcab80ffa10 0x7fcab810f6a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fcaac002a80 tx=0x7fcaac004600 comp rx=0 tx=0).stop 2024-09-17T07:20:57.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:57.171+0000 7fcabe2eb640 1 -- 172.21.15.87:0/2938827577 shutdown_connections 2024-09-17T07:20:57.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:57.171+0000 7fcabe2eb640 1 --2- 172.21.15.87:0/2938827577 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7fcaa006dbd0 0x7fcaa0070080 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:57.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:57.171+0000 7fcabe2eb640 1 --2- 172.21.15.87:0/2938827577 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcab80ffa10 0x7fcab810f6a0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:57.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:57.171+0000 7fcabe2eb640 1 --2- 172.21.15.87:0/2938827577 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcab80fe740 0x7fcab810f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:57.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:57.171+0000 7fcabe2eb640 1 -- 172.21.15.87:0/2938827577 >> 172.21.15.87:0/2938827577 conn(0x7fcab80fa060 msgr2=0x7fcab80fc930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:20:57.172 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:57.171+0000 7fcabe2eb640 1 -- 172.21.15.87:0/2938827577 shutdown_connections 2024-09-17T07:20:57.172 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:57.171+0000 7fcabe2eb640 1 -- 172.21.15.87:0/2938827577 wait complete. 2024-09-17T07:20:57.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:57.268+0000 7f8385c31640 1 -- 172.21.15.87:0/1580178969 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83800fb420 msgr2=0x7f83800fb830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:20:57.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:57.268+0000 7f8385c31640 1 --2- 172.21.15.87:0/1580178969 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83800fb420 0x7f83800fb830 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f83700048d0 tx=0x7f8370009da0 comp rx=0 tx=0).stop 2024-09-17T07:20:57.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:57.269+0000 7f8385c31640 1 -- 172.21.15.87:0/1580178969 shutdown_connections 2024-09-17T07:20:57.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:57.269+0000 7f8385c31640 1 --2- 172.21.15.87:0/1580178969 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f83800fc6f0 0x7f83800fcb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:57.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:57.269+0000 7f8385c31640 1 --2- 172.21.15.87:0/1580178969 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83800fb420 0x7f83800fb830 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:57.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:57.269+0000 7f8385c31640 1 -- 172.21.15.87:0/1580178969 >> 172.21.15.87:0/1580178969 conn(0x7f83800f6c00 msgr2=0x7f83800f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:20:57.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:57.269+0000 7f8385c31640 1 -- 172.21.15.87:0/1580178969 shutdown_connections 2024-09-17T07:20:57.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:57.269+0000 7f8385c31640 1 -- 172.21.15.87:0/1580178969 wait complete. 2024-09-17T07:20:57.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:57.269+0000 7f8385c31640 1 Processor -- start 2024-09-17T07:20:57.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:57.269+0000 7f8385c31640 1 -- start start 2024-09-17T07:20:57.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:57.270+0000 7f8385c31640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83800fb420 0x7f838010cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:20:57.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:57.270+0000 7f8385c31640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f83800fc6f0 0x7f838010d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:20:57.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:57.270+0000 7f8385c31640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f838010db40 con 0x7f83800fb420 2024-09-17T07:20:57.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:57.270+0000 7f8385c31640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f838010e360 con 0x7f83800fc6f0 2024-09-17T07:20:57.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:57.270+0000 7f837f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83800fb420 0x7f838010cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:20:57.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:57.270+0000 7f837f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83800fb420 0x7f838010cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:50888/0 (socket says 172.21.15.87:50888) 2024-09-17T07:20:57.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:57.270+0000 7f837f7fe640 1 -- 172.21.15.87:0/3190838102 learned_addr learned my addr 172.21.15.87:0/3190838102 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:20:57.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:57.270+0000 7f837effd640 1 --2- 172.21.15.87:0/3190838102 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f83800fc6f0 0x7f838010d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:20:57.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:57.270+0000 7f837f7fe640 1 -- 172.21.15.87:0/3190838102 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f83800fc6f0 msgr2=0x7f838010d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:20:57.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:57.270+0000 7f837f7fe640 1 --2- 172.21.15.87:0/3190838102 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f83800fc6f0 0x7f838010d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:57.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:57.270+0000 7f837f7fe640 1 -- 172.21.15.87:0/3190838102 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8370005040 con 0x7f83800fb420 2024-09-17T07:20:57.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:57.270+0000 7f837f7fe640 1 --2- 172.21.15.87:0/3190838102 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83800fb420 0x7f838010cfb0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f83700043d0 tx=0x7f8370009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:20:57.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:57.270+0000 7f8367fff640 1 -- 172.21.15.87:0/3190838102 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8370038070 con 0x7f83800fb420 2024-09-17T07:20:57.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:57.270+0000 7f8367fff640 1 -- 172.21.15.87:0/3190838102 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f83700096c0 con 0x7f83800fb420 2024-09-17T07:20:57.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:57.270+0000 7f8385c31640 1 -- 172.21.15.87:0/3190838102 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f838010e590 con 0x7f83800fb420 2024-09-17T07:20:57.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:57.270+0000 7f8367fff640 1 -- 172.21.15.87:0/3190838102 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f837003d420 con 0x7f83800fb420 2024-09-17T07:20:57.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:57.270+0000 7f8385c31640 1 -- 172.21.15.87:0/3190838102 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f838010eb30 con 0x7f83800fb420 2024-09-17T07:20:57.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:57.271+0000 7f8385c31640 1 -- 172.21.15.87:0/3190838102 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83800fa880 con 0x7f83800fb420 2024-09-17T07:20:57.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:57.272+0000 7f8367fff640 1 -- 172.21.15.87:0/3190838102 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 24) v1 ==== 90881+0+0 (secure 0 0 0) 0x7f8370030020 con 0x7f83800fb420 2024-09-17T07:20:57.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:57.272+0000 7f8367fff640 1 --2- 172.21.15.87:0/3190838102 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f836806dbd0 0x7f8368070080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:20:57.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:57.273+0000 7f8367fff640 1 -- 172.21.15.87:0/3190838102 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f83700ad5c0 con 0x7f83800fb420 2024-09-17T07:20:57.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:57.273+0000 7f837effd640 1 --2- 172.21.15.87:0/3190838102 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f836806dbd0 0x7f8368070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:20:57.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:57.273+0000 7f837effd640 1 --2- 172.21.15.87:0/3190838102 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f836806dbd0 0x7f8368070080 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f838010cd60 tx=0x7f837400b040 comp rx=0 tx=0).ready entity=mgr.24339 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:20:57.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:57.277+0000 7f8367fff640 1 -- 172.21.15.87:0/3190838102 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182127 (secure 0 0 0) 0x7f8370077b60 con 0x7f83800fb420 2024-09-17T07:20:57.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:57 smithi087 ceph-mon[27636]: from='client.24455 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:20:57.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:57 smithi087 ceph-mon[27636]: from='client.24459 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:20:57.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:57 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/1147130467' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:20:57.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:57 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/467544529' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T07:20:57.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:57.556+0000 7f8385c31640 1 -- 172.21.15.87:0/3190838102 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f8380104e00 con 0x7f83800fb420 2024-09-17T07:20:57.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:57.556+0000 7f8367fff640 1 -- 172.21.15.87:0/3190838102 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f837007b180 con 0x7f83800fb420 2024-09-17T07:20:57.557 INFO:teuthology.orchestra.run.smithi087.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T07:20:57.557 INFO:teuthology.orchestra.run.smithi087.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T07:20:57.557 INFO:teuthology.orchestra.run.smithi087.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T07:20:57.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:57.558+0000 7f8385c31640 1 -- 172.21.15.87:0/3190838102 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f836806dbd0 msgr2=0x7f8368070080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:20:57.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:57.558+0000 7f8385c31640 1 --2- 172.21.15.87:0/3190838102 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f836806dbd0 0x7f8368070080 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f838010cd60 tx=0x7f837400b040 comp rx=0 tx=0).stop 2024-09-17T07:20:57.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:57.558+0000 7f8385c31640 1 -- 172.21.15.87:0/3190838102 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83800fb420 msgr2=0x7f838010cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:20:57.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:57.558+0000 7f8385c31640 1 --2- 172.21.15.87:0/3190838102 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83800fb420 0x7f838010cfb0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f83700043d0 tx=0x7f8370009da0 comp rx=0 tx=0).stop 2024-09-17T07:20:57.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:57.558+0000 7f8385c31640 1 -- 172.21.15.87:0/3190838102 shutdown_connections 2024-09-17T07:20:57.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:57.558+0000 7f8385c31640 1 --2- 172.21.15.87:0/3190838102 >> [v2:172.21.15.139:6828/3218632563,v1:172.21.15.139:6829/3218632563] conn(0x7f836806dbd0 0x7f8368070080 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:57.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:57.558+0000 7f8385c31640 1 --2- 172.21.15.87:0/3190838102 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f83800fc6f0 0x7f838010d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:57.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:57.558+0000 7f8385c31640 1 --2- 172.21.15.87:0/3190838102 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83800fb420 0x7f838010cfb0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:20:57.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:57.558+0000 7f8385c31640 1 -- 172.21.15.87:0/3190838102 >> 172.21.15.87:0/3190838102 conn(0x7f83800f6c00 msgr2=0x7f83800f8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:20:57.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:57.559+0000 7f8385c31640 1 -- 172.21.15.87:0/3190838102 shutdown_connections 2024-09-17T07:20:57.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:20:57.559+0000 7f8385c31640 1 -- 172.21.15.87:0/3190838102 wait complete. 2024-09-17T07:20:57.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:57 smithi139 ceph-mon[34403]: from='client.24455 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:20:57.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:57 smithi139 ceph-mon[34403]: from='client.24459 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:20:57.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:57 smithi139 ceph-mon[34403]: from='client.? 172.21.15.87:0/1147130467' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:20:57.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:57 smithi139 ceph-mon[34403]: from='client.? 172.21.15.87:0/467544529' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T07:20:58.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:58 smithi139 ceph-mon[34403]: pgmap v42: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.7 MiB/s rd, 2.6 MiB/s wr, 161 op/s 2024-09-17T07:20:58.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:58 smithi139 ceph-mon[34403]: from='client.14748 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:20:58.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:20:58 smithi139 ceph-mon[34403]: from='client.? 172.21.15.87:0/3190838102' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T07:20:58.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:58 smithi087 ceph-mon[27636]: pgmap v42: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.7 MiB/s rd, 2.6 MiB/s wr, 161 op/s 2024-09-17T07:20:58.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:58 smithi087 ceph-mon[27636]: from='client.14748 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:20:58.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:20:58 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/3190838102' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T07:21:00.478 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:00 smithi087 ceph-mon[27636]: pgmap v43: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 111 op/s 2024-09-17T07:21:00.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:00 smithi139 ceph-mon[34403]: pgmap v43: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 111 op/s 2024-09-17T07:21:02.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:02 smithi087 ceph-mon[27636]: pgmap v44: 65 pgs: 65 active+clean; 333 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 2.9 MiB/s rd, 3.0 MiB/s wr, 194 op/s 2024-09-17T07:21:02.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:02 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:21:02.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:02 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi087.vuvjer", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T07:21:02.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:02 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T07:21:02.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:02 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:21:02.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:02 smithi139 ceph-mon[34403]: pgmap v44: 65 pgs: 65 active+clean; 333 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 2.9 MiB/s rd, 3.0 MiB/s wr, 194 op/s 2024-09-17T07:21:02.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:02 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:21:02.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:02 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi087.vuvjer", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T07:21:02.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:02 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T07:21:02.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:02 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:21:03.357 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:03 smithi087 ceph-mon[27636]: Upgrade: Updating mgr.smithi087.vuvjer 2024-09-17T07:21:03.357 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:03 smithi087 ceph-mon[27636]: Deploying daemon mgr.smithi087.vuvjer on smithi087 2024-09-17T07:21:03.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:03 smithi139 ceph-mon[34403]: Upgrade: Updating mgr.smithi087.vuvjer 2024-09-17T07:21:03.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:03 smithi139 ceph-mon[34403]: Deploying daemon mgr.smithi087.vuvjer on smithi087 2024-09-17T07:21:04.455 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:04 smithi087 ceph-mon[27636]: pgmap v45: 65 pgs: 65 active+clean; 333 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 143 op/s 2024-09-17T07:21:04.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:04 smithi139 ceph-mon[34403]: pgmap v45: 65 pgs: 65 active+clean; 333 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 143 op/s 2024-09-17T07:21:06.470 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:06 smithi087 ceph-mon[27636]: pgmap v46: 65 pgs: 65 active+clean; 333 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 143 op/s 2024-09-17T07:21:06.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:06 smithi139 ceph-mon[34403]: pgmap v46: 65 pgs: 65 active+clean; 333 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 143 op/s 2024-09-17T07:21:08.487 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:08 smithi087 ceph-mon[27636]: pgmap v47: 65 pgs: 65 active+clean; 332 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 3.1 MiB/s rd, 3.1 MiB/s wr, 266 op/s 2024-09-17T07:21:08.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:08 smithi139 ceph-mon[34403]: pgmap v47: 65 pgs: 65 active+clean; 332 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 3.1 MiB/s rd, 3.1 MiB/s wr, 266 op/s 2024-09-17T07:21:09.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:09 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:21:09.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:09 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:21:09.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:09 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:21:09.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:09 smithi139 ceph-mon[34403]: pgmap v48: 65 pgs: 65 active+clean; 332 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 205 op/s 2024-09-17T07:21:09.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:09 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:21:09.891 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:09 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:21:09.891 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:09 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:21:09.891 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:09 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:21:09.891 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:09 smithi087 ceph-mon[27636]: pgmap v48: 65 pgs: 65 active+clean; 332 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 205 op/s 2024-09-17T07:21:09.891 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:09 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:21:11.274 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-09-17T07:21:11.275 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-17T07:21:11.687 DEBUG:teuthology.parallel:result is None 2024-09-17T07:21:11.850 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:11 smithi087 ceph-mon[27636]: mgrmap e25: smithi139.tuqnpn(active, since 91s), standbys: smithi087.vuvjer 2024-09-17T07:21:11.851 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:11 smithi087 ceph-mon[27636]: pgmap v49: 65 pgs: 65 active+clean; 332 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 3.1 MiB/s rd, 3.1 MiB/s wr, 360 op/s 2024-09-17T07:21:12.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:11 smithi139 ceph-mon[34403]: mgrmap e25: smithi139.tuqnpn(active, since 91s), standbys: smithi087.vuvjer 2024-09-17T07:21:12.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:11 smithi139 ceph-mon[34403]: pgmap v49: 65 pgs: 65 active+clean; 332 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 3.1 MiB/s rd, 3.1 MiB/s wr, 360 op/s 2024-09-17T07:21:14.135 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-09-17T07:21:14.135 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-09-17T07:21:14.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:14 smithi087 ceph-mon[27636]: pgmap v50: 65 pgs: 65 active+clean; 332 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 277 op/s 2024-09-17T07:21:14.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:14 smithi139 ceph-mon[34403]: pgmap v50: 65 pgs: 65 active+clean; 332 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 277 op/s 2024-09-17T07:21:14.626 DEBUG:teuthology.parallel:result is None 2024-09-17T07:21:14.627 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-17T07:21:14.661 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-17T07:21:14.661 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-09-17T07:21:14.737 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-09-17T07:21:14.737 DEBUG:teuthology.parallel:result is None 2024-09-17T07:21:15.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:15 smithi087 ceph-mon[27636]: Standby manager daemon smithi087.vuvjer restarted 2024-09-17T07:21:15.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:15 smithi087 ceph-mon[27636]: Standby manager daemon smithi087.vuvjer started 2024-09-17T07:21:15.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:15 smithi087 ceph-mon[27636]: from='mgr.? 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi087.vuvjer/crt"}]: dispatch 2024-09-17T07:21:15.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:15 smithi087 ceph-mon[27636]: from='mgr.? 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T07:21:15.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:15 smithi087 ceph-mon[27636]: from='mgr.? 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi087.vuvjer/key"}]: dispatch 2024-09-17T07:21:15.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:15 smithi087 ceph-mon[27636]: from='mgr.? 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T07:21:15.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:15 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:21:15.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:15 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:21:15.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:15 smithi139 ceph-mon[34403]: Standby manager daemon smithi087.vuvjer restarted 2024-09-17T07:21:15.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:15 smithi139 ceph-mon[34403]: Standby manager daemon smithi087.vuvjer started 2024-09-17T07:21:15.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:15 smithi139 ceph-mon[34403]: from='mgr.? 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi087.vuvjer/crt"}]: dispatch 2024-09-17T07:21:15.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:15 smithi139 ceph-mon[34403]: from='mgr.? 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T07:21:15.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:15 smithi139 ceph-mon[34403]: from='mgr.? 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi087.vuvjer/key"}]: dispatch 2024-09-17T07:21:15.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:15 smithi139 ceph-mon[34403]: from='mgr.? 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T07:21:15.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:15 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:21:15.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:15 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:21:16.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:16 smithi087 ceph-mon[27636]: pgmap v51: 65 pgs: 65 active+clean; 332 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 277 op/s 2024-09-17T07:21:16.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:16 smithi087 ceph-mon[27636]: mgrmap e26: smithi139.tuqnpn(active, since 96s), standbys: smithi087.vuvjer 2024-09-17T07:21:16.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:16 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:21:16.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:16 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:21:16.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:16 smithi139 ceph-mon[34403]: pgmap v51: 65 pgs: 65 active+clean; 332 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 277 op/s 2024-09-17T07:21:16.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:16 smithi139 ceph-mon[34403]: mgrmap e26: smithi139.tuqnpn(active, since 96s), standbys: smithi087.vuvjer 2024-09-17T07:21:16.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:16 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:21:16.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:16 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:21:18.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:18 smithi087 ceph-mon[27636]: pgmap v52: 65 pgs: 65 active+clean; 324 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 371 op/s 2024-09-17T07:21:18.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:18 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:21:18.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:18 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:21:18.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:18 smithi139 ceph-mon[34403]: pgmap v52: 65 pgs: 65 active+clean; 324 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 371 op/s 2024-09-17T07:21:18.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:18 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:21:18.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:18 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:21:19.854 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:19 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:21:19.854 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:19 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:21:19.854 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:19 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:21:19.855 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:19 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:21:19.855 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:19 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:21:19.855 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:19 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:21:19.855 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:19 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "mgr fail", "who": "smithi139.tuqnpn"}]: dispatch 2024-09-17T07:21:19.855 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:19 smithi139 ceph-mon[34403]: Activating manager daemon smithi087.vuvjer 2024-09-17T07:21:19.855 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:19 smithi139 ceph-mon[34403]: osdmap e46: 6 total, 6 up, 6 in 2024-09-17T07:21:19.855 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:19 smithi139 ceph-mon[34403]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd='[{"prefix": "mgr fail", "who": "smithi139.tuqnpn"}]': finished 2024-09-17T07:21:19.855 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:19 smithi139 ceph-mon[34403]: mgrmap e27: smithi087.vuvjer(active, starting, since 0.00911596s) 2024-09-17T07:21:19.855 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:19 smithi139 ceph-mon[34403]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mon metadata", "id": "smithi087"}]: dispatch 2024-09-17T07:21:19.855 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:19 smithi139 ceph-mon[34403]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mon metadata", "id": "smithi139"}]: dispatch 2024-09-17T07:21:19.855 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:19 smithi139 ceph-mon[34403]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi087.tjhpcs"}]: dispatch 2024-09-17T07:21:19.855 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:19 smithi139 ceph-mon[34403]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi087.vvbzss"}]: dispatch 2024-09-17T07:21:19.855 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:19 smithi139 ceph-mon[34403]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi139.gnwonz"}]: dispatch 2024-09-17T07:21:19.855 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:19 smithi139 ceph-mon[34403]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi139.ftvinf"}]: dispatch 2024-09-17T07:21:19.856 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:19 smithi139 ceph-mon[34403]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mgr metadata", "who": "smithi087.vuvjer", "id": "smithi087.vuvjer"}]: dispatch 2024-09-17T07:21:19.856 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:19 smithi139 ceph-mon[34403]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T07:21:19.856 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:19 smithi139 ceph-mon[34403]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T07:21:19.856 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:19 smithi139 ceph-mon[34403]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T07:21:19.856 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:19 smithi139 ceph-mon[34403]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T07:21:19.856 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:19 smithi139 ceph-mon[34403]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T07:21:19.856 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:19 smithi139 ceph-mon[34403]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T07:21:19.856 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:19 smithi139 ceph-mon[34403]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T07:21:19.856 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:19 smithi139 ceph-mon[34403]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T07:21:19.856 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:19 smithi139 ceph-mon[34403]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T07:21:19.856 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:19 smithi139 ceph-mon[34403]: Manager daemon smithi087.vuvjer is now available 2024-09-17T07:21:19.856 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:19 smithi139 ceph-mon[34403]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:21:19.856 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:19 smithi139 ceph-mon[34403]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:21:19.857 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:19 smithi139 ceph-mon[34403]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi087.vuvjer/mirror_snapshot_schedule"}]: dispatch 2024-09-17T07:21:19.857 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:19 smithi139 ceph-mon[34403]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi087.vuvjer/trash_purge_schedule"}]: dispatch 2024-09-17T07:21:19.857 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:19 smithi139 ceph-mon[34403]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' 2024-09-17T07:21:19.857 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:19 smithi139 ceph-mon[34403]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' 2024-09-17T07:21:20.029 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:19 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:21:20.029 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:19 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:21:20.030 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:19 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:21:20.030 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:19 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:21:20.030 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:19 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' 2024-09-17T07:21:20.030 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:19 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:21:20.030 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:19 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "mgr fail", "who": "smithi139.tuqnpn"}]: dispatch 2024-09-17T07:21:20.030 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:19 smithi087 ceph-mon[27636]: Activating manager daemon smithi087.vuvjer 2024-09-17T07:21:20.030 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:19 smithi087 ceph-mon[27636]: osdmap e46: 6 total, 6 up, 6 in 2024-09-17T07:21:20.030 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:19 smithi087 ceph-mon[27636]: from='mgr.24339 172.21.15.139:0/1609230928' entity='mgr.smithi139.tuqnpn' cmd='[{"prefix": "mgr fail", "who": "smithi139.tuqnpn"}]': finished 2024-09-17T07:21:20.030 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:19 smithi087 ceph-mon[27636]: mgrmap e27: smithi087.vuvjer(active, starting, since 0.00911596s) 2024-09-17T07:21:20.030 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:19 smithi087 ceph-mon[27636]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mon metadata", "id": "smithi087"}]: dispatch 2024-09-17T07:21:20.030 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:19 smithi087 ceph-mon[27636]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mon metadata", "id": "smithi139"}]: dispatch 2024-09-17T07:21:20.030 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:19 smithi087 ceph-mon[27636]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi087.tjhpcs"}]: dispatch 2024-09-17T07:21:20.030 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:19 smithi087 ceph-mon[27636]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi087.vvbzss"}]: dispatch 2024-09-17T07:21:20.031 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:19 smithi087 ceph-mon[27636]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi139.gnwonz"}]: dispatch 2024-09-17T07:21:20.031 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:19 smithi087 ceph-mon[27636]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi139.ftvinf"}]: dispatch 2024-09-17T07:21:20.031 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:19 smithi087 ceph-mon[27636]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mgr metadata", "who": "smithi087.vuvjer", "id": "smithi087.vuvjer"}]: dispatch 2024-09-17T07:21:20.031 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:19 smithi087 ceph-mon[27636]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T07:21:20.031 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:19 smithi087 ceph-mon[27636]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T07:21:20.031 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:19 smithi087 ceph-mon[27636]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T07:21:20.031 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:19 smithi087 ceph-mon[27636]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T07:21:20.031 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:19 smithi087 ceph-mon[27636]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T07:21:20.031 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:19 smithi087 ceph-mon[27636]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T07:21:20.031 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:19 smithi087 ceph-mon[27636]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T07:21:20.031 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:19 smithi087 ceph-mon[27636]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T07:21:20.031 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:19 smithi087 ceph-mon[27636]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T07:21:20.031 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:19 smithi087 ceph-mon[27636]: Manager daemon smithi087.vuvjer is now available 2024-09-17T07:21:20.031 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:19 smithi087 ceph-mon[27636]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:21:20.032 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:19 smithi087 ceph-mon[27636]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:21:20.032 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:19 smithi087 ceph-mon[27636]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi087.vuvjer/mirror_snapshot_schedule"}]: dispatch 2024-09-17T07:21:20.032 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:19 smithi087 ceph-mon[27636]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi087.vuvjer/trash_purge_schedule"}]: dispatch 2024-09-17T07:21:20.032 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:19 smithi087 ceph-mon[27636]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' 2024-09-17T07:21:20.032 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:19 smithi087 ceph-mon[27636]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' 2024-09-17T07:21:20.998 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:20 smithi139 ceph-mon[34403]: mgrmap e28: smithi087.vuvjer(active, since 1.01014s) 2024-09-17T07:21:20.999 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:20 smithi139 ceph-mon[34403]: [17/Sep/2024:07:21:19] ENGINE Bus STARTING 2024-09-17T07:21:20.999 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:20 smithi139 ceph-mon[34403]: [17/Sep/2024:07:21:20] ENGINE Serving on https://172.21.15.87:7150 2024-09-17T07:21:20.999 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:20 smithi139 ceph-mon[34403]: [17/Sep/2024:07:21:20] ENGINE Error in HTTPServer.serve 2024-09-17T07:21:20.999 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: Traceback (most recent call last): 2024-09-17T07:21:20.999 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T07:21:20.999 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: self._connections.run(self.expiration_interval) 2024-09-17T07:21:20.999 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T07:21:20.999 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: self._run(expiration_interval) 2024-09-17T07:21:20.999 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T07:21:20.999 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T07:21:20.999 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T07:21:20.999 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T07:21:21.000 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T07:21:21.000 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: s = self.context.wrap_socket( 2024-09-17T07:21:21.000 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T07:21:21.000 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: return self.sslsocket_class._create( 2024-09-17T07:21:21.000 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T07:21:21.000 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: self.do_handshake() 2024-09-17T07:21:21.000 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T07:21:21.000 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: self._sslobj.do_handshake() 2024-09-17T07:21:21.000 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T07:21:21.000 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:20 smithi139 ceph-mon[34403]: [17/Sep/2024:07:21:20] ENGINE Serving on http://172.21.15.87:8765 2024-09-17T07:21:21.000 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:20 smithi139 ceph-mon[34403]: [17/Sep/2024:07:21:20] ENGINE Bus STARTED 2024-09-17T07:21:21.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:20 smithi087 ceph-mon[27636]: mgrmap e28: smithi087.vuvjer(active, since 1.01014s) 2024-09-17T07:21:21.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:20 smithi087 ceph-mon[27636]: [17/Sep/2024:07:21:19] ENGINE Bus STARTING 2024-09-17T07:21:21.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:20 smithi087 ceph-mon[27636]: [17/Sep/2024:07:21:20] ENGINE Serving on https://172.21.15.87:7150 2024-09-17T07:21:21.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:20 smithi087 ceph-mon[27636]: [17/Sep/2024:07:21:20] ENGINE Error in HTTPServer.serve 2024-09-17T07:21:21.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Traceback (most recent call last): 2024-09-17T07:21:21.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T07:21:21.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: self._connections.run(self.expiration_interval) 2024-09-17T07:21:21.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T07:21:21.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: self._run(expiration_interval) 2024-09-17T07:21:21.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T07:21:21.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T07:21:21.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T07:21:21.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T07:21:21.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T07:21:21.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: s = self.context.wrap_socket( 2024-09-17T07:21:21.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T07:21:21.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: return self.sslsocket_class._create( 2024-09-17T07:21:21.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T07:21:21.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: self.do_handshake() 2024-09-17T07:21:21.178 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T07:21:21.178 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: self._sslobj.do_handshake() 2024-09-17T07:21:21.178 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T07:21:21.178 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:20 smithi087 ceph-mon[27636]: [17/Sep/2024:07:21:20] ENGINE Serving on http://172.21.15.87:8765 2024-09-17T07:21:21.178 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:20 smithi087 ceph-mon[27636]: [17/Sep/2024:07:21:20] ENGINE Bus STARTED 2024-09-17T07:21:22.074 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:21 smithi087 ceph-mon[27636]: pgmap v4: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-17T07:21:22.074 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:21 smithi087 ceph-mon[27636]: mgrmap e29: smithi087.vuvjer(active, since 2s) 2024-09-17T07:21:22.076 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:21 smithi139 ceph-mon[34403]: pgmap v4: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-17T07:21:22.076 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:21 smithi139 ceph-mon[34403]: mgrmap e29: smithi087.vuvjer(active, since 2s) 2024-09-17T07:21:23.505 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:23 smithi087 ceph-mon[27636]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' 2024-09-17T07:21:23.505 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:23 smithi087 ceph-mon[27636]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' 2024-09-17T07:21:23.506 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:23 smithi087 ceph-mon[27636]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' 2024-09-17T07:21:23.506 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:23 smithi087 ceph-mon[27636]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' 2024-09-17T07:21:23.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:23 smithi139 ceph-mon[34403]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' 2024-09-17T07:21:23.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:23 smithi139 ceph-mon[34403]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' 2024-09-17T07:21:23.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:23 smithi139 ceph-mon[34403]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' 2024-09-17T07:21:23.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:23 smithi139 ceph-mon[34403]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' 2024-09-17T07:21:24.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:24 smithi087 ceph-mon[27636]: pgmap v5: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-17T07:21:24.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:24 smithi087 ceph-mon[27636]: mgrmap e30: smithi087.vuvjer(active, since 4s) 2024-09-17T07:21:24.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:24 smithi087 ceph-mon[27636]: Standby manager daemon smithi139.tuqnpn started 2024-09-17T07:21:24.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:24 smithi087 ceph-mon[27636]: from='mgr.? 172.21.15.139:0/1483344560' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi139.tuqnpn/crt"}]: dispatch 2024-09-17T07:21:24.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:24 smithi087 ceph-mon[27636]: from='mgr.? 172.21.15.139:0/1483344560' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T07:21:24.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:24 smithi087 ceph-mon[27636]: from='mgr.? 172.21.15.139:0/1483344560' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi139.tuqnpn/key"}]: dispatch 2024-09-17T07:21:24.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:24 smithi087 ceph-mon[27636]: from='mgr.? 172.21.15.139:0/1483344560' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T07:21:24.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:24 smithi139 ceph-mon[34403]: pgmap v5: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-17T07:21:24.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:24 smithi139 ceph-mon[34403]: mgrmap e30: smithi087.vuvjer(active, since 4s) 2024-09-17T07:21:24.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:24 smithi139 ceph-mon[34403]: Standby manager daemon smithi139.tuqnpn started 2024-09-17T07:21:24.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:24 smithi139 ceph-mon[34403]: from='mgr.? 172.21.15.139:0/1483344560' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi139.tuqnpn/crt"}]: dispatch 2024-09-17T07:21:24.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:24 smithi139 ceph-mon[34403]: from='mgr.? 172.21.15.139:0/1483344560' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T07:21:24.618 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:24 smithi139 ceph-mon[34403]: from='mgr.? 172.21.15.139:0/1483344560' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi139.tuqnpn/key"}]: dispatch 2024-09-17T07:21:24.618 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:24 smithi139 ceph-mon[34403]: from='mgr.? 172.21.15.139:0/1483344560' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T07:21:25.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:25 smithi139 ceph-mon[34403]: mgrmap e31: smithi087.vuvjer(active, since 5s), standbys: smithi139.tuqnpn 2024-09-17T07:21:25.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:25 smithi139 ceph-mon[34403]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mgr metadata", "who": "smithi139.tuqnpn", "id": "smithi139.tuqnpn"}]: dispatch 2024-09-17T07:21:25.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:25 smithi139 ceph-mon[34403]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' 2024-09-17T07:21:25.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:25 smithi139 ceph-mon[34403]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' 2024-09-17T07:21:25.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:25 smithi087 ceph-mon[27636]: mgrmap e31: smithi087.vuvjer(active, since 5s), standbys: smithi139.tuqnpn 2024-09-17T07:21:25.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:25 smithi087 ceph-mon[27636]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mgr metadata", "who": "smithi139.tuqnpn", "id": "smithi139.tuqnpn"}]: dispatch 2024-09-17T07:21:25.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:25 smithi087 ceph-mon[27636]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' 2024-09-17T07:21:25.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:25 smithi087 ceph-mon[27636]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' 2024-09-17T07:21:26.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:26 smithi139 ceph-mon[34403]: pgmap v6: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-17T07:21:26.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:26 smithi139 ceph-mon[34403]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' 2024-09-17T07:21:26.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:26 smithi139 ceph-mon[34403]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' 2024-09-17T07:21:26.921 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:26 smithi087 ceph-mon[27636]: pgmap v6: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-17T07:21:26.921 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:26 smithi087 ceph-mon[27636]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' 2024-09-17T07:21:26.921 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:26 smithi087 ceph-mon[27636]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' 2024-09-17T07:21:27.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.650+0000 7f304e3e2640 1 -- 172.21.15.87:0/689669641 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3048065b80 msgr2=0x7f30480ff200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:21:27.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.650+0000 7f304e3e2640 1 --2- 172.21.15.87:0/689669641 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3048065b80 0x7f30480ff200 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f30380048d0 tx=0x7f3038009da0 comp rx=0 tx=0).stop 2024-09-17T07:21:27.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.650+0000 7f304e3e2640 1 -- 172.21.15.87:0/689669641 shutdown_connections 2024-09-17T07:21:27.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.650+0000 7f304e3e2640 1 --2- 172.21.15.87:0/689669641 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f30480ff740 0x7f3048101b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:21:27.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.650+0000 7f304e3e2640 1 --2- 172.21.15.87:0/689669641 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3048065b80 0x7f30480ff200 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:21:27.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.650+0000 7f304e3e2640 1 -- 172.21.15.87:0/689669641 >> 172.21.15.87:0/689669641 conn(0x7f30480f6c10 msgr2=0x7f30480f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:21:27.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.650+0000 7f304e3e2640 1 -- 172.21.15.87:0/689669641 shutdown_connections 2024-09-17T07:21:27.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.650+0000 7f304e3e2640 1 -- 172.21.15.87:0/689669641 wait complete. 2024-09-17T07:21:27.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.651+0000 7f304e3e2640 1 Processor -- start 2024-09-17T07:21:27.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.651+0000 7f304e3e2640 1 -- start start 2024-09-17T07:21:27.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.652+0000 7f304e3e2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3048065b80 0x7f304810d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:21:27.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.652+0000 7f304e3e2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f30480ff740 0x7f304810d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:21:27.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.652+0000 7f304e3e2640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f304810e3f0 con 0x7f30480ff740 2024-09-17T07:21:27.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.652+0000 7f304e3e2640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f304810e560 con 0x7f3048065b80 2024-09-17T07:21:27.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.652+0000 7f30477fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f30480ff740 0x7f304810d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:21:27.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.652+0000 7f30477fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f30480ff740 0x7f304810d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59890/0 (socket says 172.21.15.87:59890) 2024-09-17T07:21:27.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.652+0000 7f30477fe640 1 -- 172.21.15.87:0/62538876 learned_addr learned my addr 172.21.15.87:0/62538876 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:21:27.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.652+0000 7f3047fff640 1 --2- 172.21.15.87:0/62538876 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3048065b80 0x7f304810d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:21:27.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.652+0000 7f30477fe640 1 -- 172.21.15.87:0/62538876 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3048065b80 msgr2=0x7f304810d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:21:27.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.652+0000 7f30477fe640 1 --2- 172.21.15.87:0/62538876 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3048065b80 0x7f304810d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:21:27.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.652+0000 7f30477fe640 1 -- 172.21.15.87:0/62538876 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3038005040 con 0x7f30480ff740 2024-09-17T07:21:27.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.652+0000 7f30477fe640 1 --2- 172.21.15.87:0/62538876 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f30480ff740 0x7f304810d580 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f303c00b790 tx=0x7f303c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:21:27.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.653+0000 7f3044ff9640 1 -- 172.21.15.87:0/62538876 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f303c00c700 con 0x7f30480ff740 2024-09-17T07:21:27.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.653+0000 7f3044ff9640 1 -- 172.21.15.87:0/62538876 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f303c00cce0 con 0x7f30480ff740 2024-09-17T07:21:27.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.653+0000 7f3044ff9640 1 -- 172.21.15.87:0/62538876 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f303c015e30 con 0x7f30480ff740 2024-09-17T07:21:27.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.653+0000 7f304e3e2640 1 -- 172.21.15.87:0/62538876 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f304810e840 con 0x7f30480ff740 2024-09-17T07:21:27.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.653+0000 7f304e3e2640 1 -- 172.21.15.87:0/62538876 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f304810ed60 con 0x7f30480ff740 2024-09-17T07:21:27.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.654+0000 7f304e3e2640 1 -- 172.21.15.87:0/62538876 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30480fa890 con 0x7f30480ff740 2024-09-17T07:21:27.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.655+0000 7f3044ff9640 1 -- 172.21.15.87:0/62538876 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 31) v1 ==== 90813+0+0 (secure 0 0 0) 0x7f303c012070 con 0x7f30480ff740 2024-09-17T07:21:27.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.655+0000 7f3044ff9640 1 --2- 172.21.15.87:0/62538876 >> [v2:172.21.15.87:6800/3398669653,v1:172.21.15.87:6801/3398669653] conn(0x7f303006c940 0x7f303006edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:21:27.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.655+0000 7f3044ff9640 1 -- 172.21.15.87:0/62538876 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f303c08b490 con 0x7f30480ff740 2024-09-17T07:21:27.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.656+0000 7f3047fff640 1 --2- 172.21.15.87:0/62538876 >> [v2:172.21.15.87:6800/3398669653,v1:172.21.15.87:6801/3398669653] conn(0x7f303006c940 0x7f303006edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:21:27.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.656+0000 7f3047fff640 1 --2- 172.21.15.87:0/62538876 >> [v2:172.21.15.87:6800/3398669653,v1:172.21.15.87:6801/3398669653] conn(0x7f303006c940 0x7f303006edf0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3038003080 tx=0x7f3038035040 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:21:27.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.660+0000 7f3044ff9640 1 -- 172.21.15.87:0/62538876 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182127 (secure 0 0 0) 0x7f303c0558e0 con 0x7f30480ff740 2024-09-17T07:21:27.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.844+0000 7f304e3e2640 1 -- 172.21.15.87:0/62538876 --> [v2:172.21.15.87:6800/3398669653,v1:172.21.15.87:6801/3398669653] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3048105030 con 0x7f303006c940 2024-09-17T07:21:27.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.845+0000 7f3044ff9640 1 -- 172.21.15.87:0/62538876 <== mgr.14756 v2:172.21.15.87:6800/3398669653 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f3048105030 con 0x7f303006c940 2024-09-17T07:21:27.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.847+0000 7f304e3e2640 1 -- 172.21.15.87:0/62538876 >> [v2:172.21.15.87:6800/3398669653,v1:172.21.15.87:6801/3398669653] conn(0x7f303006c940 msgr2=0x7f303006edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:21:27.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.847+0000 7f304e3e2640 1 --2- 172.21.15.87:0/62538876 >> [v2:172.21.15.87:6800/3398669653,v1:172.21.15.87:6801/3398669653] conn(0x7f303006c940 0x7f303006edf0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3038003080 tx=0x7f3038035040 comp rx=0 tx=0).stop 2024-09-17T07:21:27.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.847+0000 7f304e3e2640 1 -- 172.21.15.87:0/62538876 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f30480ff740 msgr2=0x7f304810d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:21:27.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.847+0000 7f304e3e2640 1 --2- 172.21.15.87:0/62538876 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f30480ff740 0x7f304810d580 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f303c00b790 tx=0x7f303c0091d0 comp rx=0 tx=0).stop 2024-09-17T07:21:27.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.847+0000 7f304e3e2640 1 -- 172.21.15.87:0/62538876 shutdown_connections 2024-09-17T07:21:27.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.847+0000 7f304e3e2640 1 --2- 172.21.15.87:0/62538876 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f30480ff740 0x7f304810d580 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:21:27.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.847+0000 7f304e3e2640 1 --2- 172.21.15.87:0/62538876 >> [v2:172.21.15.87:6800/3398669653,v1:172.21.15.87:6801/3398669653] conn(0x7f303006c940 0x7f303006edf0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:21:27.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.847+0000 7f304e3e2640 1 --2- 172.21.15.87:0/62538876 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3048065b80 0x7f304810d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:21:27.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.847+0000 7f304e3e2640 1 -- 172.21.15.87:0/62538876 >> 172.21.15.87:0/62538876 conn(0x7f30480f6c10 msgr2=0x7f30480f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:21:27.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.848+0000 7f304e3e2640 1 -- 172.21.15.87:0/62538876 shutdown_connections 2024-09-17T07:21:27.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.848+0000 7f304e3e2640 1 -- 172.21.15.87:0/62538876 wait complete. 2024-09-17T07:21:27.857 INFO:teuthology.orchestra.run.smithi087.stdout:true 2024-09-17T07:21:27.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.929+0000 7fcb74b84640 1 -- 172.21.15.87:0/2032672429 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb700666b0 msgr2=0x7fcb700ff1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:21:27.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.929+0000 7fcb74b84640 1 --2- 172.21.15.87:0/2032672429 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb700666b0 0x7fcb700ff1c0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fcb600048d0 tx=0x7fcb60009da0 comp rx=0 tx=0).stop 2024-09-17T07:21:27.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.929+0000 7fcb74b84640 1 -- 172.21.15.87:0/2032672429 shutdown_connections 2024-09-17T07:21:27.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.929+0000 7fcb74b84640 1 --2- 172.21.15.87:0/2032672429 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcb700ff700 0x7fcb70101ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:21:27.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.929+0000 7fcb74b84640 1 --2- 172.21.15.87:0/2032672429 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb700666b0 0x7fcb700ff1c0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:21:27.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.929+0000 7fcb74b84640 1 -- 172.21.15.87:0/2032672429 >> 172.21.15.87:0/2032672429 conn(0x7fcb700f6c10 msgr2=0x7fcb700f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:21:27.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.929+0000 7fcb74b84640 1 -- 172.21.15.87:0/2032672429 shutdown_connections 2024-09-17T07:21:27.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.929+0000 7fcb74b84640 1 -- 172.21.15.87:0/2032672429 wait complete. 2024-09-17T07:21:27.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.930+0000 7fcb74b84640 1 Processor -- start 2024-09-17T07:21:27.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.930+0000 7fcb74b84640 1 -- start start 2024-09-17T07:21:27.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.930+0000 7fcb74b84640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcb700666b0 0x7fcb7010d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:21:27.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.930+0000 7fcb74b84640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb700ff700 0x7fcb7010d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:21:27.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.930+0000 7fcb74b84640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7010e480 con 0x7fcb700ff700 2024-09-17T07:21:27.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.930+0000 7fcb74b84640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7010e5f0 con 0x7fcb700666b0 2024-09-17T07:21:27.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.930+0000 7fcb6dd9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb700ff700 0x7fcb7010d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:21:27.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.930+0000 7fcb6dd9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb700ff700 0x7fcb7010d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59902/0 (socket says 172.21.15.87:59902) 2024-09-17T07:21:27.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.930+0000 7fcb6dd9b640 1 -- 172.21.15.87:0/3654531998 learned_addr learned my addr 172.21.15.87:0/3654531998 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:21:27.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.931+0000 7fcb6e59c640 1 --2- 172.21.15.87:0/3654531998 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcb700666b0 0x7fcb7010d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:21:27.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.931+0000 7fcb6dd9b640 1 -- 172.21.15.87:0/3654531998 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcb700666b0 msgr2=0x7fcb7010d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:21:27.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.931+0000 7fcb6dd9b640 1 --2- 172.21.15.87:0/3654531998 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcb700666b0 0x7fcb7010d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:21:27.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.931+0000 7fcb6dd9b640 1 -- 172.21.15.87:0/3654531998 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb60005040 con 0x7fcb700ff700 2024-09-17T07:21:27.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.931+0000 7fcb6dd9b640 1 --2- 172.21.15.87:0/3654531998 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb700ff700 0x7fcb7010d610 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fcb6400b790 tx=0x7fcb640091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:21:27.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.931+0000 7fcb5effd640 1 -- 172.21.15.87:0/3654531998 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb6400c700 con 0x7fcb700ff700 2024-09-17T07:21:27.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.931+0000 7fcb5effd640 1 -- 172.21.15.87:0/3654531998 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fcb6400cce0 con 0x7fcb700ff700 2024-09-17T07:21:27.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.931+0000 7fcb74b84640 1 -- 172.21.15.87:0/3654531998 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb7010e8d0 con 0x7fcb700ff700 2024-09-17T07:21:27.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.931+0000 7fcb5effd640 1 -- 172.21.15.87:0/3654531998 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb64015e10 con 0x7fcb700ff700 2024-09-17T07:21:27.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.931+0000 7fcb74b84640 1 -- 172.21.15.87:0/3654531998 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb7010eda0 con 0x7fcb700ff700 2024-09-17T07:21:27.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.932+0000 7fcb74b84640 1 -- 172.21.15.87:0/3654531998 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb700fa8b0 con 0x7fcb700ff700 2024-09-17T07:21:27.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.932+0000 7fcb5effd640 1 -- 172.21.15.87:0/3654531998 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 31) v1 ==== 90813+0+0 (secure 0 0 0) 0x7fcb64012070 con 0x7fcb700ff700 2024-09-17T07:21:27.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.933+0000 7fcb5effd640 1 --2- 172.21.15.87:0/3654531998 >> [v2:172.21.15.87:6800/3398669653,v1:172.21.15.87:6801/3398669653] conn(0x7fcb5806c940 0x7fcb5806edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:21:27.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.933+0000 7fcb5effd640 1 -- 172.21.15.87:0/3654531998 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fcb6408b850 con 0x7fcb700ff700 2024-09-17T07:21:27.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.933+0000 7fcb6e59c640 1 --2- 172.21.15.87:0/3654531998 >> [v2:172.21.15.87:6800/3398669653,v1:172.21.15.87:6801/3398669653] conn(0x7fcb5806c940 0x7fcb5806edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:21:27.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.934+0000 7fcb6e59c640 1 --2- 172.21.15.87:0/3654531998 >> [v2:172.21.15.87:6800/3398669653,v1:172.21.15.87:6801/3398669653] conn(0x7fcb5806c940 0x7fcb5806edf0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fcb6002afd0 tx=0x7fcb60035040 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:21:27.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:27.937+0000 7fcb5effd640 1 -- 172.21.15.87:0/3654531998 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182127 (secure 0 0 0) 0x7fcb64055c20 con 0x7fcb700ff700 2024-09-17T07:21:28.171 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.170+0000 7fcb74b84640 1 -- 172.21.15.87:0/3654531998 --> [v2:172.21.15.87:6800/3398669653,v1:172.21.15.87:6801/3398669653] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcb7010f020 con 0x7fcb5806c940 2024-09-17T07:21:28.172 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.171+0000 7fcb5effd640 1 -- 172.21.15.87:0/3654531998 <== mgr.14756 v2:172.21.15.87:6800/3398669653 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7fcb7010f020 con 0x7fcb5806c940 2024-09-17T07:21:28.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.173+0000 7fcb74b84640 1 -- 172.21.15.87:0/3654531998 >> [v2:172.21.15.87:6800/3398669653,v1:172.21.15.87:6801/3398669653] conn(0x7fcb5806c940 msgr2=0x7fcb5806edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:21:28.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.173+0000 7fcb74b84640 1 --2- 172.21.15.87:0/3654531998 >> [v2:172.21.15.87:6800/3398669653,v1:172.21.15.87:6801/3398669653] conn(0x7fcb5806c940 0x7fcb5806edf0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fcb6002afd0 tx=0x7fcb60035040 comp rx=0 tx=0).stop 2024-09-17T07:21:28.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.173+0000 7fcb74b84640 1 -- 172.21.15.87:0/3654531998 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb700ff700 msgr2=0x7fcb7010d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:21:28.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.173+0000 7fcb74b84640 1 --2- 172.21.15.87:0/3654531998 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb700ff700 0x7fcb7010d610 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fcb6400b790 tx=0x7fcb640091d0 comp rx=0 tx=0).stop 2024-09-17T07:21:28.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.173+0000 7fcb74b84640 1 -- 172.21.15.87:0/3654531998 shutdown_connections 2024-09-17T07:21:28.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.173+0000 7fcb74b84640 1 --2- 172.21.15.87:0/3654531998 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb700ff700 0x7fcb7010d610 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:21:28.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.173+0000 7fcb74b84640 1 --2- 172.21.15.87:0/3654531998 >> [v2:172.21.15.87:6800/3398669653,v1:172.21.15.87:6801/3398669653] conn(0x7fcb5806c940 0x7fcb5806edf0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:21:28.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.173+0000 7fcb74b84640 1 --2- 172.21.15.87:0/3654531998 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcb700666b0 0x7fcb7010d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:21:28.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.173+0000 7fcb74b84640 1 -- 172.21.15.87:0/3654531998 >> 172.21.15.87:0/3654531998 conn(0x7fcb700f6c10 msgr2=0x7fcb700f7030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:21:28.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.173+0000 7fcb74b84640 1 -- 172.21.15.87:0/3654531998 shutdown_connections 2024-09-17T07:21:28.175 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.173+0000 7fcb74b84640 1 -- 172.21.15.87:0/3654531998 wait complete. 2024-09-17T07:21:28.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.253+0000 7f4c2e18a640 1 -- 172.21.15.87:0/4264583365 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c280fc720 msgr2=0x7f4c280fcb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:21:28.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.253+0000 7f4c2e18a640 1 --2- 172.21.15.87:0/4264583365 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c280fc720 0x7f4c280fcb90 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c0048d0 tx=0x7f4c1c009da0 comp rx=0 tx=0).stop 2024-09-17T07:21:28.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.253+0000 7f4c2e18a640 1 -- 172.21.15.87:0/4264583365 shutdown_connections 2024-09-17T07:21:28.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.253+0000 7f4c2e18a640 1 --2- 172.21.15.87:0/4264583365 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c280fc720 0x7f4c280fcb90 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:21:28.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.253+0000 7f4c2e18a640 1 --2- 172.21.15.87:0/4264583365 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4c280fb450 0x7f4c280fb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:21:28.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.253+0000 7f4c2e18a640 1 -- 172.21.15.87:0/4264583365 >> 172.21.15.87:0/4264583365 conn(0x7f4c280f6c10 msgr2=0x7f4c280f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:21:28.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.253+0000 7f4c2e18a640 1 -- 172.21.15.87:0/4264583365 shutdown_connections 2024-09-17T07:21:28.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.253+0000 7f4c2e18a640 1 -- 172.21.15.87:0/4264583365 wait complete. 2024-09-17T07:21:28.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.254+0000 7f4c2e18a640 1 Processor -- start 2024-09-17T07:21:28.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.254+0000 7f4c2e18a640 1 -- start start 2024-09-17T07:21:28.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.254+0000 7f4c2e18a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4c280fb450 0x7f4c2810fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:21:28.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.254+0000 7f4c2e18a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c280fc720 0x7f4c28112280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:21:28.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.254+0000 7f4c2e18a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c28066730 con 0x7f4c280fc720 2024-09-17T07:21:28.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.254+0000 7f4c2e18a640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c280668a0 con 0x7f4c280fb450 2024-09-17T07:21:28.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.254+0000 7f4c26ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c280fc720 0x7f4c28112280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:21:28.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.254+0000 7f4c26ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c280fc720 0x7f4c28112280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59916/0 (socket says 172.21.15.87:59916) 2024-09-17T07:21:28.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.254+0000 7f4c26ffd640 1 -- 172.21.15.87:0/3111100001 learned_addr learned my addr 172.21.15.87:0/3111100001 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:21:28.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.254+0000 7f4c277fe640 1 --2- 172.21.15.87:0/3111100001 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4c280fb450 0x7f4c2810fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:21:28.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.255+0000 7f4c26ffd640 1 -- 172.21.15.87:0/3111100001 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4c280fb450 msgr2=0x7f4c2810fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:21:28.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.255+0000 7f4c26ffd640 1 --2- 172.21.15.87:0/3111100001 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4c280fb450 0x7f4c2810fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:21:28.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.255+0000 7f4c26ffd640 1 -- 172.21.15.87:0/3111100001 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c1c005040 con 0x7f4c280fc720 2024-09-17T07:21:28.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.255+0000 7f4c26ffd640 1 --2- 172.21.15.87:0/3111100001 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c280fc720 0x7f4c28112280 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c0043d0 tx=0x7f4c1c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:21:28.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.255+0000 7f4c0ffff640 1 -- 172.21.15.87:0/3111100001 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c1c038070 con 0x7f4c280fc720 2024-09-17T07:21:28.258 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.255+0000 7f4c0ffff640 1 -- 172.21.15.87:0/3111100001 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f4c1c009740 con 0x7f4c280fc720 2024-09-17T07:21:28.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.255+0000 7f4c2e18a640 1 -- 172.21.15.87:0/3111100001 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c281127c0 con 0x7f4c280fc720 2024-09-17T07:21:28.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.255+0000 7f4c0ffff640 1 -- 172.21.15.87:0/3111100001 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c1c03d420 con 0x7f4c280fc720 2024-09-17T07:21:28.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.255+0000 7f4c2e18a640 1 -- 172.21.15.87:0/3111100001 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c2810bcb0 con 0x7f4c280fc720 2024-09-17T07:21:28.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.256+0000 7f4c2e18a640 1 -- 172.21.15.87:0/3111100001 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c2804b720 con 0x7f4c280fc720 2024-09-17T07:21:28.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.256+0000 7f4c0ffff640 1 -- 172.21.15.87:0/3111100001 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 31) v1 ==== 90813+0+0 (secure 0 0 0) 0x7f4c1c030020 con 0x7f4c280fc720 2024-09-17T07:21:28.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.257+0000 7f4c0ffff640 1 --2- 172.21.15.87:0/3111100001 >> [v2:172.21.15.87:6800/3398669653,v1:172.21.15.87:6801/3398669653] conn(0x7f4c10070d50 0x7f4c10073200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:21:28.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.257+0000 7f4c0ffff640 1 -- 172.21.15.87:0/3111100001 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f4c1c0ac1e0 con 0x7f4c280fc720 2024-09-17T07:21:28.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.257+0000 7f4c277fe640 1 --2- 172.21.15.87:0/3111100001 >> [v2:172.21.15.87:6800/3398669653,v1:172.21.15.87:6801/3398669653] conn(0x7f4c10070d50 0x7f4c10073200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:21:28.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.258+0000 7f4c277fe640 1 --2- 172.21.15.87:0/3111100001 >> [v2:172.21.15.87:6800/3398669653,v1:172.21.15.87:6801/3398669653] conn(0x7f4c10070d50 0x7f4c10073200 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4c28066420 tx=0x7f4c18009040 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:21:28.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.261+0000 7f4c0ffff640 1 -- 172.21.15.87:0/3111100001 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182127 (secure 0 0 0) 0x7f4c1c0765b0 con 0x7f4c280fc720 2024-09-17T07:21:28.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.443+0000 7f4c2e18a640 1 -- 172.21.15.87:0/3111100001 --> [v2:172.21.15.87:6800/3398669653,v1:172.21.15.87:6801/3398669653] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4c28105eb0 con 0x7f4c10070d50 2024-09-17T07:21:28.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.452+0000 7f4c0ffff640 1 -- 172.21.15.87:0/3111100001 <== mgr.14756 v2:172.21.15.87:6800/3398669653 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f4c28105eb0 con 0x7f4c10070d50 2024-09-17T07:21:28.453 INFO:teuthology.orchestra.run.smithi087.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T07:21:28.453 INFO:teuthology.orchestra.run.smithi087.stdout:alertmanager.smithi087 smithi087 *:9093,9094 running (66s) 3s ago 9m 17.3M - 0.25.0 c8568f914cd2 594553f0b497 2024-09-17T07:21:28.453 INFO:teuthology.orchestra.run.smithi087.stdout:crash.smithi087 smithi087 running (9m) 3s ago 9m 6891k - 17.2.7-1635-g4a704134 f22ead590bad d9aaf9839ada 2024-09-17T07:21:28.453 INFO:teuthology.orchestra.run.smithi087.stdout:crash.smithi139 smithi139 running (8m) 6s ago 8m 6895k - 17.2.7-1635-g4a704134 f22ead590bad 354c853b318f 2024-09-17T07:21:28.453 INFO:teuthology.orchestra.run.smithi087.stdout:grafana.smithi087 smithi087 *:3000 running (61s) 3s ago 9m 78.1M - 9.4.7 954c08fa6188 e2f17ec6baa8 2024-09-17T07:21:28.454 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi087.tjhpcs smithi087 running (4m) 3s ago 4m 135M - 17.2.7-1635-g4a704134 f22ead590bad f7142ad971ed 2024-09-17T07:21:28.454 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi087.vvbzss smithi087 running (4m) 3s ago 4m 69.7M - 17.2.7-1635-g4a704134 f22ead590bad 2dd82ff293d1 2024-09-17T07:21:28.454 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi139.ftvinf smithi139 running (4m) 6s ago 3m 70.9M - 17.2.7-1635-g4a704134 f22ead590bad d11edb295ad3 2024-09-17T07:21:28.454 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi139.gnwonz smithi139 running (4m) 6s ago 4m 116M - 17.2.7-1635-g4a704134 f22ead590bad 3b3d884aef02 2024-09-17T07:21:28.454 INFO:teuthology.orchestra.run.smithi087.stdout:mgr.smithi087.vuvjer smithi087 *:8443,9283,8765 running (23s) 3s ago 10m 460M - 18.2.4-855-g19e2a2be 980a0bfcd684 5d10c647cb6b 2024-09-17T07:21:28.454 INFO:teuthology.orchestra.run.smithi087.stdout:mgr.smithi139.tuqnpn smithi139 *:8443,9283 running (2m) 6s ago 8m 90.9M - 18.2.4-855-g19e2a2be 980a0bfcd684 ea12b2e696b5 2024-09-17T07:21:28.454 INFO:teuthology.orchestra.run.smithi087.stdout:mon.smithi087 smithi087 running (10m) 3s ago 10m 57.3M 2048M 17.2.7-1635-g4a704134 f22ead590bad 175785e1fb86 2024-09-17T07:21:28.454 INFO:teuthology.orchestra.run.smithi087.stdout:mon.smithi139 smithi139 running (8m) 6s ago 8m 39.2M 2048M 17.2.7-1635-g4a704134 f22ead590bad a9a2552dc411 2024-09-17T07:21:28.454 INFO:teuthology.orchestra.run.smithi087.stdout:node-exporter.smithi087 smithi087 *:9100 running (71s) 3s ago 9m 8342k - 1.5.0 0da6a335fe13 39fa48de0e87 2024-09-17T07:21:28.454 INFO:teuthology.orchestra.run.smithi087.stdout:node-exporter.smithi139 smithi139 *:9100 running (35s) 6s ago 8m 13.7M - 1.5.0 0da6a335fe13 a5b99b7cbb06 2024-09-17T07:21:28.454 INFO:teuthology.orchestra.run.smithi087.stdout:osd.0 smithi087 running (7m) 3s ago 7m 192M 1557M 17.2.7-1635-g4a704134 f22ead590bad 396801f9b539 2024-09-17T07:21:28.454 INFO:teuthology.orchestra.run.smithi087.stdout:osd.1 smithi087 running (7m) 3s ago 7m 191M 1557M 17.2.7-1635-g4a704134 f22ead590bad 9446985bfcd1 2024-09-17T07:21:28.454 INFO:teuthology.orchestra.run.smithi087.stdout:osd.2 smithi087 running (6m) 3s ago 6m 160M 1557M 17.2.7-1635-g4a704134 f22ead590bad 8fe1428a6878 2024-09-17T07:21:28.455 INFO:teuthology.orchestra.run.smithi087.stdout:osd.3 smithi139 running (6m) 6s ago 6m 232M 2581M 17.2.7-1635-g4a704134 f22ead590bad 0801999b17c4 2024-09-17T07:21:28.455 INFO:teuthology.orchestra.run.smithi087.stdout:osd.4 smithi139 running (6m) 6s ago 6m 208M 2581M 17.2.7-1635-g4a704134 f22ead590bad 299a8dfc47f5 2024-09-17T07:21:28.455 INFO:teuthology.orchestra.run.smithi087.stdout:osd.5 smithi139 running (5m) 6s ago 5m 199M 2581M 17.2.7-1635-g4a704134 f22ead590bad 609cf74f32e7 2024-09-17T07:21:28.455 INFO:teuthology.orchestra.run.smithi087.stdout:prometheus.smithi087 smithi087 *:9095 running (37s) 3s ago 8m 45.0M - 2.43.0 a07b618ecd1d 00f681887208 2024-09-17T07:21:28.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.454+0000 7f4c2e18a640 1 -- 172.21.15.87:0/3111100001 >> [v2:172.21.15.87:6800/3398669653,v1:172.21.15.87:6801/3398669653] conn(0x7f4c10070d50 msgr2=0x7f4c10073200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:21:28.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.454+0000 7f4c2e18a640 1 --2- 172.21.15.87:0/3111100001 >> [v2:172.21.15.87:6800/3398669653,v1:172.21.15.87:6801/3398669653] conn(0x7f4c10070d50 0x7f4c10073200 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4c28066420 tx=0x7f4c18009040 comp rx=0 tx=0).stop 2024-09-17T07:21:28.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.454+0000 7f4c2e18a640 1 -- 172.21.15.87:0/3111100001 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c280fc720 msgr2=0x7f4c28112280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:21:28.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.454+0000 7f4c2e18a640 1 --2- 172.21.15.87:0/3111100001 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c280fc720 0x7f4c28112280 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c0043d0 tx=0x7f4c1c009da0 comp rx=0 tx=0).stop 2024-09-17T07:21:28.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.454+0000 7f4c2e18a640 1 -- 172.21.15.87:0/3111100001 shutdown_connections 2024-09-17T07:21:28.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.454+0000 7f4c2e18a640 1 --2- 172.21.15.87:0/3111100001 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c280fc720 0x7f4c28112280 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:21:28.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.454+0000 7f4c2e18a640 1 --2- 172.21.15.87:0/3111100001 >> [v2:172.21.15.87:6800/3398669653,v1:172.21.15.87:6801/3398669653] conn(0x7f4c10070d50 0x7f4c10073200 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:21:28.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.454+0000 7f4c2e18a640 1 --2- 172.21.15.87:0/3111100001 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4c280fb450 0x7f4c2810fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:21:28.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.454+0000 7f4c2e18a640 1 -- 172.21.15.87:0/3111100001 >> 172.21.15.87:0/3111100001 conn(0x7f4c280f6c10 msgr2=0x7f4c280ffb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:21:28.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.454+0000 7f4c2e18a640 1 -- 172.21.15.87:0/3111100001 shutdown_connections 2024-09-17T07:21:28.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.454+0000 7f4c2e18a640 1 -- 172.21.15.87:0/3111100001 wait complete. 2024-09-17T07:21:28.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.534+0000 7fe4f159d640 1 -- 172.21.15.87:0/2576163495 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4ec065be0 msgr2=0x7fe4ec0ff1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:21:28.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.534+0000 7fe4f159d640 1 --2- 172.21.15.87:0/2576163495 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4ec065be0 0x7fe4ec0ff1a0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fe4e40048d0 tx=0x7fe4e4009da0 comp rx=0 tx=0).stop 2024-09-17T07:21:28.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.534+0000 7fe4f159d640 1 -- 172.21.15.87:0/2576163495 shutdown_connections 2024-09-17T07:21:28.537 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.534+0000 7fe4f159d640 1 --2- 172.21.15.87:0/2576163495 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe4ec0ff6e0 0x7fe4ec101ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:21:28.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.534+0000 7fe4f159d640 1 --2- 172.21.15.87:0/2576163495 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4ec065be0 0x7fe4ec0ff1a0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:21:28.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.534+0000 7fe4f159d640 1 -- 172.21.15.87:0/2576163495 >> 172.21.15.87:0/2576163495 conn(0x7fe4ec0f6c10 msgr2=0x7fe4ec0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:21:28.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.534+0000 7fe4f159d640 1 -- 172.21.15.87:0/2576163495 shutdown_connections 2024-09-17T07:21:28.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.534+0000 7fe4f159d640 1 -- 172.21.15.87:0/2576163495 wait complete. 2024-09-17T07:21:28.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.535+0000 7fe4f159d640 1 Processor -- start 2024-09-17T07:21:28.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.535+0000 7fe4f159d640 1 -- start start 2024-09-17T07:21:28.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.535+0000 7fe4f159d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4ec065be0 0x7fe4ec0fcbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:21:28.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.535+0000 7fe4f159d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe4ec0ff6e0 0x7fe4ec0fb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:21:28.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.535+0000 7fe4f159d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ec0fb6c0 con 0x7fe4ec065be0 2024-09-17T07:21:28.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.535+0000 7fe4f159d640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ec0fb800 con 0x7fe4ec0ff6e0 2024-09-17T07:21:28.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.535+0000 7fe4eaffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4ec065be0 0x7fe4ec0fcbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:21:28.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.535+0000 7fe4eaffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4ec065be0 0x7fe4ec0fcbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59934/0 (socket says 172.21.15.87:59934) 2024-09-17T07:21:28.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.535+0000 7fe4eaffd640 1 -- 172.21.15.87:0/54881615 learned_addr learned my addr 172.21.15.87:0/54881615 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:21:28.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.536+0000 7fe4eaffd640 1 -- 172.21.15.87:0/54881615 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe4ec0ff6e0 msgr2=0x7fe4ec0fb0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:21:28.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.536+0000 7fe4eaffd640 1 --2- 172.21.15.87:0/54881615 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe4ec0ff6e0 0x7fe4ec0fb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:21:28.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.536+0000 7fe4eaffd640 1 -- 172.21.15.87:0/54881615 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4e4005040 con 0x7fe4ec065be0 2024-09-17T07:21:28.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.536+0000 7fe4eaffd640 1 --2- 172.21.15.87:0/54881615 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4ec065be0 0x7fe4ec0fcbb0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe4e4000c00 tx=0x7fe4e4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:21:28.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.536+0000 7fe4d37fe640 1 -- 172.21.15.87:0/54881615 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4e4038070 con 0x7fe4ec065be0 2024-09-17T07:21:28.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.536+0000 7fe4d37fe640 1 -- 172.21.15.87:0/54881615 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fe4e4033a80 con 0x7fe4ec065be0 2024-09-17T07:21:28.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.536+0000 7fe4f159d640 1 -- 172.21.15.87:0/54881615 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4ec0fba80 con 0x7fe4ec065be0 2024-09-17T07:21:28.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.536+0000 7fe4d37fe640 1 -- 172.21.15.87:0/54881615 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4e403c830 con 0x7fe4ec065be0 2024-09-17T07:21:28.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.536+0000 7fe4f159d640 1 -- 172.21.15.87:0/54881615 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4ec1150b0 con 0x7fe4ec065be0 2024-09-17T07:21:28.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.537+0000 7fe4f159d640 1 -- 172.21.15.87:0/54881615 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4ec0fa890 con 0x7fe4ec065be0 2024-09-17T07:21:28.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.537+0000 7fe4d37fe640 1 -- 172.21.15.87:0/54881615 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 31) v1 ==== 90813+0+0 (secure 0 0 0) 0x7fe4e4030020 con 0x7fe4ec065be0 2024-09-17T07:21:28.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.538+0000 7fe4d37fe640 1 --2- 172.21.15.87:0/54881615 >> [v2:172.21.15.87:6800/3398669653,v1:172.21.15.87:6801/3398669653] conn(0x7fe4d406c940 0x7fe4d406edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:21:28.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.538+0000 7fe4d37fe640 1 -- 172.21.15.87:0/54881615 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fe4e40abd70 con 0x7fe4ec065be0 2024-09-17T07:21:28.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.538+0000 7fe4ea7fc640 1 --2- 172.21.15.87:0/54881615 >> [v2:172.21.15.87:6800/3398669653,v1:172.21.15.87:6801/3398669653] conn(0x7fe4d406c940 0x7fe4d406edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:21:28.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.539+0000 7fe4ea7fc640 1 --2- 172.21.15.87:0/54881615 >> [v2:172.21.15.87:6800/3398669653,v1:172.21.15.87:6801/3398669653] conn(0x7fe4d406c940 0x7fe4d406edf0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe4e000acf0 tx=0x7fe4e0009370 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:21:28.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.542+0000 7fe4d37fe640 1 -- 172.21.15.87:0/54881615 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182127 (secure 0 0 0) 0x7fe4e4076140 con 0x7fe4ec065be0 2024-09-17T07:21:28.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.769+0000 7fe4f159d640 1 -- 172.21.15.87:0/54881615 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe4ec104e80 con 0x7fe4ec065be0 2024-09-17T07:21:28.770 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:28 smithi087 ceph-mon[27636]: pgmap v7: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 292 B/s wr, 20 op/s 2024-09-17T07:21:28.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.769+0000 7fe4d37fe640 1 -- 172.21.15.87:0/54881615 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+745 (secure 0 0 0) 0x7fe4e4079760 con 0x7fe4ec065be0 2024-09-17T07:21:28.771 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T07:21:28.771 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": { 2024-09-17T07:21:28.771 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 2 2024-09-17T07:21:28.771 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:21:28.771 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr": { 2024-09-17T07:21:28.771 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 2 2024-09-17T07:21:28.771 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:21:28.771 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": { 2024-09-17T07:21:28.771 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 6 2024-09-17T07:21:28.771 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:21:28.771 INFO:teuthology.orchestra.run.smithi087.stdout: "mds": { 2024-09-17T07:21:28.772 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 4 2024-09-17T07:21:28.772 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:21:28.772 INFO:teuthology.orchestra.run.smithi087.stdout: "overall": { 2024-09-17T07:21:28.772 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 12, 2024-09-17T07:21:28.772 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 2 2024-09-17T07:21:28.772 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T07:21:28.772 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T07:21:28.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.771+0000 7fe4f159d640 1 -- 172.21.15.87:0/54881615 >> [v2:172.21.15.87:6800/3398669653,v1:172.21.15.87:6801/3398669653] conn(0x7fe4d406c940 msgr2=0x7fe4d406edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:21:28.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.771+0000 7fe4f159d640 1 --2- 172.21.15.87:0/54881615 >> [v2:172.21.15.87:6800/3398669653,v1:172.21.15.87:6801/3398669653] conn(0x7fe4d406c940 0x7fe4d406edf0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe4e000acf0 tx=0x7fe4e0009370 comp rx=0 tx=0).stop 2024-09-17T07:21:28.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.771+0000 7fe4f159d640 1 -- 172.21.15.87:0/54881615 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4ec065be0 msgr2=0x7fe4ec0fcbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:21:28.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.771+0000 7fe4f159d640 1 --2- 172.21.15.87:0/54881615 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4ec065be0 0x7fe4ec0fcbb0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe4e4000c00 tx=0x7fe4e4009da0 comp rx=0 tx=0).stop 2024-09-17T07:21:28.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.771+0000 7fe4f159d640 1 -- 172.21.15.87:0/54881615 shutdown_connections 2024-09-17T07:21:28.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.771+0000 7fe4f159d640 1 --2- 172.21.15.87:0/54881615 >> [v2:172.21.15.87:6800/3398669653,v1:172.21.15.87:6801/3398669653] conn(0x7fe4d406c940 0x7fe4d406edf0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:21:28.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.771+0000 7fe4f159d640 1 --2- 172.21.15.87:0/54881615 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe4ec0ff6e0 0x7fe4ec0fb0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:21:28.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.771+0000 7fe4f159d640 1 --2- 172.21.15.87:0/54881615 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4ec065be0 0x7fe4ec0fcbb0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:21:28.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.771+0000 7fe4f159d640 1 -- 172.21.15.87:0/54881615 >> 172.21.15.87:0/54881615 conn(0x7fe4ec0f6c10 msgr2=0x7fe4ec0f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:21:28.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.771+0000 7fe4f159d640 1 -- 172.21.15.87:0/54881615 shutdown_connections 2024-09-17T07:21:28.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.771+0000 7fe4f159d640 1 -- 172.21.15.87:0/54881615 wait complete. 2024-09-17T07:21:28.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.851+0000 7f03c8cdc640 1 -- 172.21.15.87:0/73597483 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03c40fc570 msgr2=0x7f03c40fc980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:21:28.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.851+0000 7f03c8cdc640 1 --2- 172.21.15.87:0/73597483 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03c40fc570 0x7f03c40fc980 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f03b40048d0 tx=0x7f03b4009da0 comp rx=0 tx=0).stop 2024-09-17T07:21:28.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.851+0000 7f03c8cdc640 1 -- 172.21.15.87:0/73597483 shutdown_connections 2024-09-17T07:21:28.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.851+0000 7f03c8cdc640 1 --2- 172.21.15.87:0/73597483 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f03c40fd840 0x7f03c40fdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:21:28.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.851+0000 7f03c8cdc640 1 --2- 172.21.15.87:0/73597483 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03c40fc570 0x7f03c40fc980 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:21:28.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.851+0000 7f03c8cdc640 1 -- 172.21.15.87:0/73597483 >> 172.21.15.87:0/73597483 conn(0x7f03c40f7d30 msgr2=0x7f03c40fa160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:21:28.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.851+0000 7f03c8cdc640 1 -- 172.21.15.87:0/73597483 shutdown_connections 2024-09-17T07:21:28.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.851+0000 7f03c8cdc640 1 -- 172.21.15.87:0/73597483 wait complete. 2024-09-17T07:21:28.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.852+0000 7f03c8cdc640 1 Processor -- start 2024-09-17T07:21:28.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.852+0000 7f03c8cdc640 1 -- start start 2024-09-17T07:21:28.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.852+0000 7f03c8cdc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03c40fc570 0x7f03c4071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:21:28.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.852+0000 7f03c8cdc640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f03c40fd840 0x7f03c406fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:21:28.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.852+0000 7f03c8cdc640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c406fff0 con 0x7f03c40fc570 2024-09-17T07:21:28.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.852+0000 7f03c8cdc640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c4070130 con 0x7f03c40fd840 2024-09-17T07:21:28.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.852+0000 7f03c259c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03c40fc570 0x7f03c4071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:21:28.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.852+0000 7f03c259c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03c40fc570 0x7f03c4071570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59950/0 (socket says 172.21.15.87:59950) 2024-09-17T07:21:28.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.852+0000 7f03c259c640 1 -- 172.21.15.87:0/2741228454 learned_addr learned my addr 172.21.15.87:0/2741228454 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:21:28.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.853+0000 7f03c259c640 1 -- 172.21.15.87:0/2741228454 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f03c40fd840 msgr2=0x7f03c406fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:21:28.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.853+0000 7f03c1d9b640 1 --2- 172.21.15.87:0/2741228454 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f03c40fd840 0x7f03c406fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:21:28.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.853+0000 7f03c259c640 1 --2- 172.21.15.87:0/2741228454 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f03c40fd840 0x7f03c406fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:21:28.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.853+0000 7f03c259c640 1 -- 172.21.15.87:0/2741228454 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03b4005040 con 0x7f03c40fc570 2024-09-17T07:21:28.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.853+0000 7f03c1d9b640 1 --2- 172.21.15.87:0/2741228454 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f03c40fd840 0x7f03c406fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T07:21:28.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.853+0000 7f03c259c640 1 --2- 172.21.15.87:0/2741228454 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03c40fc570 0x7f03c4071570 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f03b4009ac0 tx=0x7f03b4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:21:28.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.853+0000 7f03b2ffd640 1 -- 172.21.15.87:0/2741228454 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03b4038070 con 0x7f03c40fc570 2024-09-17T07:21:28.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.853+0000 7f03c8cdc640 1 -- 172.21.15.87:0/2741228454 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03c40703b0 con 0x7f03c40fc570 2024-09-17T07:21:28.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.853+0000 7f03b2ffd640 1 -- 172.21.15.87:0/2741228454 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f03b402ae70 con 0x7f03c40fc570 2024-09-17T07:21:28.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.853+0000 7f03b2ffd640 1 -- 172.21.15.87:0/2741228454 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03b4033420 con 0x7f03c40fc570 2024-09-17T07:21:28.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.853+0000 7f03c8cdc640 1 -- 172.21.15.87:0/2741228454 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03c4114fe0 con 0x7f03c40fc570 2024-09-17T07:21:28.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.855+0000 7f03c8cdc640 1 -- 172.21.15.87:0/2741228454 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03c40fb9d0 con 0x7f03c40fc570 2024-09-17T07:21:28.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.855+0000 7f03b2ffd640 1 -- 172.21.15.87:0/2741228454 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 31) v1 ==== 90813+0+0 (secure 0 0 0) 0x7f03b4030020 con 0x7f03c40fc570 2024-09-17T07:21:28.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.855+0000 7f03b2ffd640 1 --2- 172.21.15.87:0/2741228454 >> [v2:172.21.15.87:6800/3398669653,v1:172.21.15.87:6801/3398669653] conn(0x7f03ac06c940 0x7f03ac06edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:21:28.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.855+0000 7f03b2ffd640 1 -- 172.21.15.87:0/2741228454 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f03b40abd00 con 0x7f03c40fc570 2024-09-17T07:21:28.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.855+0000 7f03c1d9b640 1 --2- 172.21.15.87:0/2741228454 >> [v2:172.21.15.87:6800/3398669653,v1:172.21.15.87:6801/3398669653] conn(0x7f03ac06c940 0x7f03ac06edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:21:28.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.856+0000 7f03c1d9b640 1 --2- 172.21.15.87:0/2741228454 >> [v2:172.21.15.87:6800/3398669653,v1:172.21.15.87:6801/3398669653] conn(0x7f03ac06c940 0x7f03ac06edf0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f03b8004c80 tx=0x7f03b8009040 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:21:28.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:28.863+0000 7f03b2ffd640 1 -- 172.21.15.87:0/2741228454 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182127 (secure 0 0 0) 0x7f03b40af030 con 0x7f03c40fc570 2024-09-17T07:21:28.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:28 smithi139 ceph-mon[34403]: pgmap v7: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 292 B/s wr, 20 op/s 2024-09-17T07:21:29.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.087+0000 7f03c8cdc640 1 -- 172.21.15.87:0/2741228454 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f03c4115170 con 0x7f03c40fc570 2024-09-17T07:21:29.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.087+0000 7f03b2ffd640 1 -- 172.21.15.87:0/2741228454 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1867 (secure 0 0 0) 0x7f03b40760d0 con 0x7f03c40fc570 2024-09-17T07:21:29.088 INFO:teuthology.orchestra.run.smithi087.stdout:e21 2024-09-17T07:21:29.089 INFO:teuthology.orchestra.run.smithi087.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T07:21:29.089 INFO:teuthology.orchestra.run.smithi087.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T07:21:29.089 INFO:teuthology.orchestra.run.smithi087.stdout:legacy client fscid: 1 2024-09-17T07:21:29.089 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:21:29.089 INFO:teuthology.orchestra.run.smithi087.stdout:Filesystem 'cephfs' (1) 2024-09-17T07:21:29.089 INFO:teuthology.orchestra.run.smithi087.stdout:fs_name cephfs 2024-09-17T07:21:29.089 INFO:teuthology.orchestra.run.smithi087.stdout:epoch 21 2024-09-17T07:21:29.089 INFO:teuthology.orchestra.run.smithi087.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T07:21:29.089 INFO:teuthology.orchestra.run.smithi087.stdout:created 2024-09-17T07:17:15.368053+0000 2024-09-17T07:21:29.089 INFO:teuthology.orchestra.run.smithi087.stdout:modified 2024-09-17T07:20:37.142055+0000 2024-09-17T07:21:29.089 INFO:teuthology.orchestra.run.smithi087.stdout:tableserver 0 2024-09-17T07:21:29.089 INFO:teuthology.orchestra.run.smithi087.stdout:root 0 2024-09-17T07:21:29.089 INFO:teuthology.orchestra.run.smithi087.stdout:session_timeout 60 2024-09-17T07:21:29.090 INFO:teuthology.orchestra.run.smithi087.stdout:session_autoclose 300 2024-09-17T07:21:29.090 INFO:teuthology.orchestra.run.smithi087.stdout:max_file_size 1099511627776 2024-09-17T07:21:29.090 INFO:teuthology.orchestra.run.smithi087.stdout:required_client_features {} 2024-09-17T07:21:29.090 INFO:teuthology.orchestra.run.smithi087.stdout:last_failure 0 2024-09-17T07:21:29.090 INFO:teuthology.orchestra.run.smithi087.stdout:last_failure_osd_epoch 44 2024-09-17T07:21:29.090 INFO:teuthology.orchestra.run.smithi087.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T07:21:29.090 INFO:teuthology.orchestra.run.smithi087.stdout:max_mds 2 2024-09-17T07:21:29.090 INFO:teuthology.orchestra.run.smithi087.stdout:in 0,1 2024-09-17T07:21:29.090 INFO:teuthology.orchestra.run.smithi087.stdout:up {0=14478,1=24243} 2024-09-17T07:21:29.090 INFO:teuthology.orchestra.run.smithi087.stdout:failed 2024-09-17T07:21:29.090 INFO:teuthology.orchestra.run.smithi087.stdout:damaged 2024-09-17T07:21:29.090 INFO:teuthology.orchestra.run.smithi087.stdout:stopped 2024-09-17T07:21:29.090 INFO:teuthology.orchestra.run.smithi087.stdout:data_pools [3] 2024-09-17T07:21:29.091 INFO:teuthology.orchestra.run.smithi087.stdout:metadata_pool 2 2024-09-17T07:21:29.091 INFO:teuthology.orchestra.run.smithi087.stdout:inline_data enabled 2024-09-17T07:21:29.091 INFO:teuthology.orchestra.run.smithi087.stdout:balancer 2024-09-17T07:21:29.091 INFO:teuthology.orchestra.run.smithi087.stdout:standby_count_wanted 1 2024-09-17T07:21:29.091 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi087.tjhpcs{0:14478} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.87:6828/2255237099,v1:172.21.15.87:6829/2255237099] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:21:29.091 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi087.vvbzss{0:14490} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.87:6826/4022268353,v1:172.21.15.87:6827/4022268353] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:21:29.091 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi139.gnwonz{1:24243} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.139:6824/3946792151,v1:172.21.15.139:6825/3946792151] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:21:29.091 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi139.ftvinf{1:24253} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.139:6826/3292073323,v1:172.21.15.139:6827/3292073323] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:21:29.091 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:21:29.091 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:21:29.092 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 21 2024-09-17T07:21:29.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.090+0000 7f03c8cdc640 1 -- 172.21.15.87:0/2741228454 >> [v2:172.21.15.87:6800/3398669653,v1:172.21.15.87:6801/3398669653] conn(0x7f03ac06c940 msgr2=0x7f03ac06edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:21:29.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.090+0000 7f03c8cdc640 1 --2- 172.21.15.87:0/2741228454 >> [v2:172.21.15.87:6800/3398669653,v1:172.21.15.87:6801/3398669653] conn(0x7f03ac06c940 0x7f03ac06edf0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f03b8004c80 tx=0x7f03b8009040 comp rx=0 tx=0).stop 2024-09-17T07:21:29.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.090+0000 7f03c8cdc640 1 -- 172.21.15.87:0/2741228454 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03c40fc570 msgr2=0x7f03c4071570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:21:29.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.090+0000 7f03c8cdc640 1 --2- 172.21.15.87:0/2741228454 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03c40fc570 0x7f03c4071570 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f03b4009ac0 tx=0x7f03b4009da0 comp rx=0 tx=0).stop 2024-09-17T07:21:29.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.090+0000 7f03c8cdc640 1 -- 172.21.15.87:0/2741228454 shutdown_connections 2024-09-17T07:21:29.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.090+0000 7f03c8cdc640 1 --2- 172.21.15.87:0/2741228454 >> [v2:172.21.15.87:6800/3398669653,v1:172.21.15.87:6801/3398669653] conn(0x7f03ac06c940 0x7f03ac06edf0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:21:29.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.090+0000 7f03c8cdc640 1 --2- 172.21.15.87:0/2741228454 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f03c40fd840 0x7f03c406fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:21:29.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.090+0000 7f03c8cdc640 1 --2- 172.21.15.87:0/2741228454 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03c40fc570 0x7f03c4071570 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:21:29.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.090+0000 7f03c8cdc640 1 -- 172.21.15.87:0/2741228454 >> 172.21.15.87:0/2741228454 conn(0x7f03c40f7d30 msgr2=0x7f03c40f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:21:29.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.090+0000 7f03c8cdc640 1 -- 172.21.15.87:0/2741228454 shutdown_connections 2024-09-17T07:21:29.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.090+0000 7f03c8cdc640 1 -- 172.21.15.87:0/2741228454 wait complete. 2024-09-17T07:21:29.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.174+0000 7f5b48912640 1 -- 172.21.15.87:0/3754938417 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b440fc540 msgr2=0x7f5b440fc950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:21:29.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.174+0000 7f5b48912640 1 --2- 172.21.15.87:0/3754938417 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b440fc540 0x7f5b440fc950 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f5b340048d0 tx=0x7f5b34009da0 comp rx=0 tx=0).stop 2024-09-17T07:21:29.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.175+0000 7f5b48912640 1 -- 172.21.15.87:0/3754938417 shutdown_connections 2024-09-17T07:21:29.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.175+0000 7f5b48912640 1 --2- 172.21.15.87:0/3754938417 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b440fd810 0x7f5b440fdc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:21:29.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.175+0000 7f5b48912640 1 --2- 172.21.15.87:0/3754938417 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b440fc540 0x7f5b440fc950 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:21:29.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.175+0000 7f5b48912640 1 -- 172.21.15.87:0/3754938417 >> 172.21.15.87:0/3754938417 conn(0x7f5b440f7d00 msgr2=0x7f5b440fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:21:29.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.175+0000 7f5b48912640 1 -- 172.21.15.87:0/3754938417 shutdown_connections 2024-09-17T07:21:29.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.175+0000 7f5b48912640 1 -- 172.21.15.87:0/3754938417 wait complete. 2024-09-17T07:21:29.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.175+0000 7f5b48912640 1 Processor -- start 2024-09-17T07:21:29.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.175+0000 7f5b48912640 1 -- start start 2024-09-17T07:21:29.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.175+0000 7f5b48912640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b440fc540 0x7f5b44071500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:21:29.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.175+0000 7f5b48912640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b440fd810 0x7f5b4406fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:21:29.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.175+0000 7f5b48912640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4406ffa0 con 0x7f5b440fd810 2024-09-17T07:21:29.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.175+0000 7f5b48912640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b44070110 con 0x7f5b440fc540 2024-09-17T07:21:29.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.176+0000 7f5b41d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b440fd810 0x7f5b4406fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:21:29.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.176+0000 7f5b41d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b440fd810 0x7f5b4406fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59970/0 (socket says 172.21.15.87:59970) 2024-09-17T07:21:29.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.176+0000 7f5b41d9b640 1 -- 172.21.15.87:0/3336412361 learned_addr learned my addr 172.21.15.87:0/3336412361 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:21:29.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.176+0000 7f5b4259c640 1 --2- 172.21.15.87:0/3336412361 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b440fc540 0x7f5b44071500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:21:29.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.176+0000 7f5b41d9b640 1 -- 172.21.15.87:0/3336412361 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b440fc540 msgr2=0x7f5b44071500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:21:29.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.176+0000 7f5b41d9b640 1 --2- 172.21.15.87:0/3336412361 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b440fc540 0x7f5b44071500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:21:29.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.176+0000 7f5b41d9b640 1 -- 172.21.15.87:0/3336412361 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b34005040 con 0x7f5b440fd810 2024-09-17T07:21:29.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.176+0000 7f5b41d9b640 1 --2- 172.21.15.87:0/3336412361 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b440fd810 0x7f5b4406fa60 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f5b38002a80 tx=0x7f5b38004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:21:29.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.176+0000 7f5b32ffd640 1 -- 172.21.15.87:0/3336412361 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b38007c30 con 0x7f5b440fd810 2024-09-17T07:21:29.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.176+0000 7f5b32ffd640 1 -- 172.21.15.87:0/3336412361 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f5b3800f040 con 0x7f5b440fd810 2024-09-17T07:21:29.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.176+0000 7f5b32ffd640 1 -- 172.21.15.87:0/3336412361 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b3800d9b0 con 0x7f5b440fd810 2024-09-17T07:21:29.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.176+0000 7f5b48912640 1 -- 172.21.15.87:0/3336412361 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b440703a0 con 0x7f5b440fd810 2024-09-17T07:21:29.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.176+0000 7f5b48912640 1 -- 172.21.15.87:0/3336412361 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b440708c0 con 0x7f5b440fd810 2024-09-17T07:21:29.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.177+0000 7f5b48912640 1 -- 172.21.15.87:0/3336412361 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b440fb9a0 con 0x7f5b440fd810 2024-09-17T07:21:29.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.178+0000 7f5b32ffd640 1 -- 172.21.15.87:0/3336412361 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 31) v1 ==== 90813+0+0 (secure 0 0 0) 0x7f5b3800db10 con 0x7f5b440fd810 2024-09-17T07:21:29.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.178+0000 7f5b32ffd640 1 --2- 172.21.15.87:0/3336412361 >> [v2:172.21.15.87:6800/3398669653,v1:172.21.15.87:6801/3398669653] conn(0x7f5b2c06c940 0x7f5b2c06edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:21:29.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.178+0000 7f5b32ffd640 1 -- 172.21.15.87:0/3336412361 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f5b3808b5d0 con 0x7f5b440fd810 2024-09-17T07:21:29.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.178+0000 7f5b4259c640 1 --2- 172.21.15.87:0/3336412361 >> [v2:172.21.15.87:6800/3398669653,v1:172.21.15.87:6801/3398669653] conn(0x7f5b2c06c940 0x7f5b2c06edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:21:29.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.179+0000 7f5b4259c640 1 --2- 172.21.15.87:0/3336412361 >> [v2:172.21.15.87:6800/3398669653,v1:172.21.15.87:6801/3398669653] conn(0x7f5b2c06c940 0x7f5b2c06edf0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5b440712b0 tx=0x7f5b34035040 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:21:29.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.183+0000 7f5b32ffd640 1 -- 172.21.15.87:0/3336412361 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182127 (secure 0 0 0) 0x7f5b380559c0 con 0x7f5b440fd810 2024-09-17T07:21:29.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.398+0000 7f5b48912640 1 -- 172.21.15.87:0/3336412361 --> [v2:172.21.15.87:6800/3398669653,v1:172.21.15.87:6801/3398669653] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5b44101d10 con 0x7f5b2c06c940 2024-09-17T07:21:29.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.400+0000 7f5b32ffd640 1 -- 172.21.15.87:0/3336412361 <== mgr.14756 v2:172.21.15.87:6800/3398669653 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f5b44101d10 con 0x7f5b2c06c940 2024-09-17T07:21:29.401 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T07:21:29.401 INFO:teuthology.orchestra.run.smithi087.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9", 2024-09-17T07:21:29.401 INFO:teuthology.orchestra.run.smithi087.stdout: "in_progress": true, 2024-09-17T07:21:29.401 INFO:teuthology.orchestra.run.smithi087.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T07:21:29.401 INFO:teuthology.orchestra.run.smithi087.stdout: "services_complete": [ 2024-09-17T07:21:29.401 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr" 2024-09-17T07:21:29.401 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-17T07:21:29.401 INFO:teuthology.orchestra.run.smithi087.stdout: "progress": "2/21 daemons upgraded", 2024-09-17T07:21:29.401 INFO:teuthology.orchestra.run.smithi087.stdout: "message": "", 2024-09-17T07:21:29.401 INFO:teuthology.orchestra.run.smithi087.stdout: "is_paused": false 2024-09-17T07:21:29.402 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T07:21:29.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.404+0000 7f5b48912640 1 -- 172.21.15.87:0/3336412361 >> [v2:172.21.15.87:6800/3398669653,v1:172.21.15.87:6801/3398669653] conn(0x7f5b2c06c940 msgr2=0x7f5b2c06edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:21:29.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.404+0000 7f5b48912640 1 --2- 172.21.15.87:0/3336412361 >> [v2:172.21.15.87:6800/3398669653,v1:172.21.15.87:6801/3398669653] conn(0x7f5b2c06c940 0x7f5b2c06edf0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5b440712b0 tx=0x7f5b34035040 comp rx=0 tx=0).stop 2024-09-17T07:21:29.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.404+0000 7f5b48912640 1 -- 172.21.15.87:0/3336412361 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b440fd810 msgr2=0x7f5b4406fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:21:29.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.404+0000 7f5b48912640 1 --2- 172.21.15.87:0/3336412361 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b440fd810 0x7f5b4406fa60 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f5b38002a80 tx=0x7f5b38004600 comp rx=0 tx=0).stop 2024-09-17T07:21:29.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.404+0000 7f5b48912640 1 -- 172.21.15.87:0/3336412361 shutdown_connections 2024-09-17T07:21:29.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.404+0000 7f5b48912640 1 --2- 172.21.15.87:0/3336412361 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b440fd810 0x7f5b4406fa60 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:21:29.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.404+0000 7f5b48912640 1 --2- 172.21.15.87:0/3336412361 >> [v2:172.21.15.87:6800/3398669653,v1:172.21.15.87:6801/3398669653] conn(0x7f5b2c06c940 0x7f5b2c06edf0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:21:29.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.404+0000 7f5b48912640 1 --2- 172.21.15.87:0/3336412361 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b440fc540 0x7f5b44071500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:21:29.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.404+0000 7f5b48912640 1 -- 172.21.15.87:0/3336412361 >> 172.21.15.87:0/3336412361 conn(0x7f5b440f7d00 msgr2=0x7f5b440f9620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:21:29.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.404+0000 7f5b48912640 1 -- 172.21.15.87:0/3336412361 shutdown_connections 2024-09-17T07:21:29.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.404+0000 7f5b48912640 1 -- 172.21.15.87:0/3336412361 wait complete. 2024-09-17T07:21:29.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.490+0000 7ff654635640 1 -- 172.21.15.87:0/3752250914 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff64c0ff6e0 msgr2=0x7ff64c101ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:21:29.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.490+0000 7ff654635640 1 --2- 172.21.15.87:0/3752250914 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff64c0ff6e0 0x7ff64c101ac0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ff63c0048d0 tx=0x7ff63c009da0 comp rx=0 tx=0).stop 2024-09-17T07:21:29.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.490+0000 7ff654635640 1 -- 172.21.15.87:0/3752250914 shutdown_connections 2024-09-17T07:21:29.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.490+0000 7ff654635640 1 --2- 172.21.15.87:0/3752250914 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff64c0ff6e0 0x7ff64c101ac0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:21:29.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.490+0000 7ff654635640 1 --2- 172.21.15.87:0/3752250914 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff64c065be0 0x7ff64c0ff1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:21:29.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.490+0000 7ff654635640 1 -- 172.21.15.87:0/3752250914 >> 172.21.15.87:0/3752250914 conn(0x7ff64c0f6c10 msgr2=0x7ff64c0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:21:29.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.490+0000 7ff654635640 1 -- 172.21.15.87:0/3752250914 shutdown_connections 2024-09-17T07:21:29.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.490+0000 7ff654635640 1 -- 172.21.15.87:0/3752250914 wait complete. 2024-09-17T07:21:29.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.491+0000 7ff654635640 1 Processor -- start 2024-09-17T07:21:29.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.491+0000 7ff654635640 1 -- start start 2024-09-17T07:21:29.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.491+0000 7ff654635640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff64c065be0 0x7ff64c0fcb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:21:29.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.491+0000 7ff654635640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff64c0ff6e0 0x7ff64c0fb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:21:29.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.491+0000 7ff654635640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff64c0fb5e0 con 0x7ff64c0ff6e0 2024-09-17T07:21:29.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.491+0000 7ff654635640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff64c0fb720 con 0x7ff64c065be0 2024-09-17T07:21:29.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.491+0000 7ff651bd0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff64c0ff6e0 0x7ff64c0fb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:21:29.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.492+0000 7ff651bd0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff64c0ff6e0 0x7ff64c0fb0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59994/0 (socket says 172.21.15.87:59994) 2024-09-17T07:21:29.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.492+0000 7ff651bd0640 1 -- 172.21.15.87:0/3832689951 learned_addr learned my addr 172.21.15.87:0/3832689951 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:21:29.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.492+0000 7ff6523d1640 1 --2- 172.21.15.87:0/3832689951 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff64c065be0 0x7ff64c0fcb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:21:29.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.492+0000 7ff651bd0640 1 -- 172.21.15.87:0/3832689951 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff64c065be0 msgr2=0x7ff64c0fcb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:21:29.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.492+0000 7ff651bd0640 1 --2- 172.21.15.87:0/3832689951 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff64c065be0 0x7ff64c0fcb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:21:29.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.492+0000 7ff651bd0640 1 -- 172.21.15.87:0/3832689951 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff63c005040 con 0x7ff64c0ff6e0 2024-09-17T07:21:29.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.492+0000 7ff6523d1640 1 --2- 172.21.15.87:0/3832689951 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff64c065be0 0x7ff64c0fcb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T07:21:29.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.492+0000 7ff651bd0640 1 --2- 172.21.15.87:0/3832689951 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff64c0ff6e0 0x7ff64c0fb0a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7ff63c0048a0 tx=0x7ff63c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:21:29.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.492+0000 7ff642ffd640 1 -- 172.21.15.87:0/3832689951 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff63c038070 con 0x7ff64c0ff6e0 2024-09-17T07:21:29.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.492+0000 7ff642ffd640 1 -- 172.21.15.87:0/3832689951 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7ff63c004290 con 0x7ff64c0ff6e0 2024-09-17T07:21:29.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.492+0000 7ff642ffd640 1 -- 172.21.15.87:0/3832689951 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff63c03c6e0 con 0x7ff64c0ff6e0 2024-09-17T07:21:29.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.492+0000 7ff654635640 1 -- 172.21.15.87:0/3832689951 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff64c0fb9a0 con 0x7ff64c0ff6e0 2024-09-17T07:21:29.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.492+0000 7ff654635640 1 -- 172.21.15.87:0/3832689951 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff64c0fbe90 con 0x7ff64c0ff6e0 2024-09-17T07:21:29.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.493+0000 7ff654635640 1 -- 172.21.15.87:0/3832689951 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff64c0fa890 con 0x7ff64c0ff6e0 2024-09-17T07:21:29.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.494+0000 7ff642ffd640 1 -- 172.21.15.87:0/3832689951 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 31) v1 ==== 90813+0+0 (secure 0 0 0) 0x7ff63c030020 con 0x7ff64c0ff6e0 2024-09-17T07:21:29.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.495+0000 7ff642ffd640 1 --2- 172.21.15.87:0/3832689951 >> [v2:172.21.15.87:6800/3398669653,v1:172.21.15.87:6801/3398669653] conn(0x7ff63806c940 0x7ff63806edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:21:29.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.495+0000 7ff642ffd640 1 -- 172.21.15.87:0/3832689951 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6066+0+0 (secure 0 0 0) 0x7ff63c0abcc0 con 0x7ff64c0ff6e0 2024-09-17T07:21:29.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.495+0000 7ff6523d1640 1 --2- 172.21.15.87:0/3832689951 >> [v2:172.21.15.87:6800/3398669653,v1:172.21.15.87:6801/3398669653] conn(0x7ff63806c940 0x7ff63806edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:21:29.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.495+0000 7ff6523d1640 1 --2- 172.21.15.87:0/3832689951 >> [v2:172.21.15.87:6800/3398669653,v1:172.21.15.87:6801/3398669653] conn(0x7ff63806c940 0x7ff63806edf0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff64c0fc910 tx=0x7ff64800b040 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:21:29.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.499+0000 7ff642ffd640 1 -- 172.21.15.87:0/3832689951 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182127 (secure 0 0 0) 0x7ff63c076150 con 0x7ff64c0ff6e0 2024-09-17T07:21:29.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:29 smithi087 ceph-mon[27636]: from='client.14788 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:21:29.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:29 smithi087 ceph-mon[27636]: from='client.14792 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:21:29.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:29 smithi087 ceph-mon[27636]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:21:29.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:29 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/54881615' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:21:29.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:29 smithi087 ceph-mon[27636]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' 2024-09-17T07:21:29.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:29 smithi087 ceph-mon[27636]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' 2024-09-17T07:21:29.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:29 smithi087 ceph-mon[27636]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:21:29.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:29 smithi087 ceph-mon[27636]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:21:29.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:29 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/2741228454' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T07:21:29.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.738+0000 7ff654635640 1 -- 172.21.15.87:0/3832689951 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7ff64c04b720 con 0x7ff64c0ff6e0 2024-09-17T07:21:29.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.738+0000 7ff642ffd640 1 -- 172.21.15.87:0/3832689951 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7ff63c079770 con 0x7ff64c0ff6e0 2024-09-17T07:21:29.740 INFO:teuthology.orchestra.run.smithi087.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T07:21:29.740 INFO:teuthology.orchestra.run.smithi087.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T07:21:29.740 INFO:teuthology.orchestra.run.smithi087.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T07:21:29.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.740+0000 7ff654635640 1 -- 172.21.15.87:0/3832689951 >> [v2:172.21.15.87:6800/3398669653,v1:172.21.15.87:6801/3398669653] conn(0x7ff63806c940 msgr2=0x7ff63806edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:21:29.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.740+0000 7ff654635640 1 --2- 172.21.15.87:0/3832689951 >> [v2:172.21.15.87:6800/3398669653,v1:172.21.15.87:6801/3398669653] conn(0x7ff63806c940 0x7ff63806edf0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff64c0fc910 tx=0x7ff64800b040 comp rx=0 tx=0).stop 2024-09-17T07:21:29.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.740+0000 7ff654635640 1 -- 172.21.15.87:0/3832689951 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff64c0ff6e0 msgr2=0x7ff64c0fb0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:21:29.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.740+0000 7ff654635640 1 --2- 172.21.15.87:0/3832689951 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff64c0ff6e0 0x7ff64c0fb0a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7ff63c0048a0 tx=0x7ff63c009da0 comp rx=0 tx=0).stop 2024-09-17T07:21:29.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.740+0000 7ff654635640 1 -- 172.21.15.87:0/3832689951 shutdown_connections 2024-09-17T07:21:29.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.740+0000 7ff654635640 1 --2- 172.21.15.87:0/3832689951 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff64c0ff6e0 0x7ff64c0fb0a0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:21:29.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.740+0000 7ff654635640 1 --2- 172.21.15.87:0/3832689951 >> [v2:172.21.15.87:6800/3398669653,v1:172.21.15.87:6801/3398669653] conn(0x7ff63806c940 0x7ff63806edf0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:21:29.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.740+0000 7ff654635640 1 --2- 172.21.15.87:0/3832689951 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff64c065be0 0x7ff64c0fcb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:21:29.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.740+0000 7ff654635640 1 -- 172.21.15.87:0/3832689951 >> 172.21.15.87:0/3832689951 conn(0x7ff64c0f6c10 msgr2=0x7ff64c0f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:21:29.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.741+0000 7ff654635640 1 -- 172.21.15.87:0/3832689951 shutdown_connections 2024-09-17T07:21:29.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:29.741+0000 7ff654635640 1 -- 172.21.15.87:0/3832689951 wait complete. 2024-09-17T07:21:29.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:29 smithi139 ceph-mon[34403]: from='client.14788 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:21:29.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:29 smithi139 ceph-mon[34403]: from='client.14792 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:21:29.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:29 smithi139 ceph-mon[34403]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:21:29.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:29 smithi139 ceph-mon[34403]: from='client.? 172.21.15.87:0/54881615' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:21:29.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:29 smithi139 ceph-mon[34403]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' 2024-09-17T07:21:29.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:29 smithi139 ceph-mon[34403]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' 2024-09-17T07:21:29.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:29 smithi139 ceph-mon[34403]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:21:29.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:29 smithi139 ceph-mon[34403]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:21:29.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:29 smithi139 ceph-mon[34403]: from='client.? 172.21.15.87:0/2741228454' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T07:21:30.788 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:30 smithi087 ceph-mon[27636]: pgmap v8: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 227 B/s wr, 16 op/s 2024-09-17T07:21:30.789 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:30 smithi087 ceph-mon[27636]: Updating smithi087:/etc/ceph/ceph.conf 2024-09-17T07:21:30.789 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:30 smithi087 ceph-mon[27636]: Updating smithi139:/etc/ceph/ceph.conf 2024-09-17T07:21:30.789 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:30 smithi087 ceph-mon[27636]: Updating smithi087:/var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T07:21:30.789 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:30 smithi087 ceph-mon[27636]: Updating smithi139:/var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T07:21:30.789 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:30 smithi087 ceph-mon[27636]: Updating smithi087:/etc/ceph/ceph.client.admin.keyring 2024-09-17T07:21:30.789 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:30 smithi087 ceph-mon[27636]: Updating smithi139:/etc/ceph/ceph.client.admin.keyring 2024-09-17T07:21:30.789 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:30 smithi087 ceph-mon[27636]: from='client.14808 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:21:30.789 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:30 smithi087 ceph-mon[27636]: from='client.? 172.21.15.87:0/3832689951' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T07:21:30.789 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:30 smithi087 ceph-mon[27636]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' 2024-09-17T07:21:30.789 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:30 smithi087 ceph-mon[27636]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' 2024-09-17T07:21:30.790 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:30 smithi087 ceph-mon[27636]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' 2024-09-17T07:21:30.790 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:30 smithi087 ceph-mon[27636]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' 2024-09-17T07:21:30.790 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:30 smithi087 ceph-mon[27636]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' 2024-09-17T07:21:30.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:30 smithi139 ceph-mon[34403]: pgmap v8: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 227 B/s wr, 16 op/s 2024-09-17T07:21:30.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:30 smithi139 ceph-mon[34403]: Updating smithi087:/etc/ceph/ceph.conf 2024-09-17T07:21:30.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:30 smithi139 ceph-mon[34403]: Updating smithi139:/etc/ceph/ceph.conf 2024-09-17T07:21:30.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:30 smithi139 ceph-mon[34403]: Updating smithi087:/var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T07:21:30.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:30 smithi139 ceph-mon[34403]: Updating smithi139:/var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T07:21:30.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:30 smithi139 ceph-mon[34403]: Updating smithi087:/etc/ceph/ceph.client.admin.keyring 2024-09-17T07:21:30.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:30 smithi139 ceph-mon[34403]: Updating smithi139:/etc/ceph/ceph.client.admin.keyring 2024-09-17T07:21:30.868 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:30 smithi139 ceph-mon[34403]: from='client.14808 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:21:30.868 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:30 smithi139 ceph-mon[34403]: from='client.? 172.21.15.87:0/3832689951' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T07:21:30.868 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:30 smithi139 ceph-mon[34403]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' 2024-09-17T07:21:30.868 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:30 smithi139 ceph-mon[34403]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' 2024-09-17T07:21:30.868 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:30 smithi139 ceph-mon[34403]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' 2024-09-17T07:21:30.868 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:30 smithi139 ceph-mon[34403]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' 2024-09-17T07:21:30.868 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:30 smithi139 ceph-mon[34403]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' 2024-09-17T07:21:31.817 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:31 smithi087 ceph-mon[27636]: Updating smithi087:/var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T07:21:31.817 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:31 smithi087 ceph-mon[27636]: Updating smithi139:/var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T07:21:31.817 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:31 smithi087 ceph-mon[27636]: Reconfiguring prometheus.smithi087 (dependencies changed)... 2024-09-17T07:21:31.817 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:31 smithi087 ceph-mon[27636]: Reconfiguring daemon prometheus.smithi087 on smithi087 2024-09-17T07:21:31.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:31 smithi139 ceph-mon[34403]: Updating smithi087:/var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T07:21:31.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:31 smithi139 ceph-mon[34403]: Updating smithi139:/var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T07:21:31.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:31 smithi139 ceph-mon[34403]: Reconfiguring prometheus.smithi087 (dependencies changed)... 2024-09-17T07:21:31.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:31 smithi139 ceph-mon[34403]: Reconfiguring daemon prometheus.smithi087 on smithi087 2024-09-17T07:21:32.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:32 smithi087 ceph-mon[27636]: pgmap v9: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 21 KiB/s rd, 372 B/s wr, 15 op/s 2024-09-17T07:21:32.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:32 smithi139 ceph-mon[34403]: pgmap v9: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 21 KiB/s rd, 372 B/s wr, 15 op/s 2024-09-17T07:21:33.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:33 smithi139 ceph-mon[34403]: pgmap v10: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 341 B/s wr, 14 op/s 2024-09-17T07:21:33.922 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:33 smithi087 ceph-mon[27636]: pgmap v10: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 341 B/s wr, 14 op/s 2024-09-17T07:21:34.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:34 smithi087 ceph-mon[27636]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:21:34.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:34 smithi139 ceph-mon[34403]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:21:36.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:36 smithi087 ceph-mon[27636]: pgmap v11: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 341 B/s wr, 14 op/s 2024-09-17T07:21:36.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:36 smithi087 ceph-mon[27636]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' 2024-09-17T07:21:36.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:36 smithi087 ceph-mon[27636]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' 2024-09-17T07:21:36.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:36 smithi087 ceph-mon[27636]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T07:21:36.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:36 smithi087 ceph-mon[27636]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T07:21:36.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:36 smithi087 ceph-mon[27636]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:21:36.516 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:36 smithi139 ceph-mon[34403]: pgmap v11: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 341 B/s wr, 14 op/s 2024-09-17T07:21:36.517 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:36 smithi139 ceph-mon[34403]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' 2024-09-17T07:21:36.517 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:36 smithi139 ceph-mon[34403]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' 2024-09-17T07:21:36.517 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:36 smithi139 ceph-mon[34403]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T07:21:36.517 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:36 smithi139 ceph-mon[34403]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T07:21:36.517 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:36 smithi139 ceph-mon[34403]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:21:37.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:37 smithi087 ceph-mon[27636]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi139.tuqnpn", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T07:21:37.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:37 smithi087 ceph-mon[27636]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T07:21:37.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:37 smithi087 ceph-mon[27636]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:21:37.551 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:37 smithi139 ceph-mon[34403]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi139.tuqnpn", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T07:21:37.552 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:37 smithi139 ceph-mon[34403]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T07:21:37.552 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:37 smithi139 ceph-mon[34403]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:21:38.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:38 smithi087 ceph-mon[27636]: Upgrade: Updating mgr.smithi139.tuqnpn 2024-09-17T07:21:38.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:38 smithi087 ceph-mon[27636]: Deploying daemon mgr.smithi139.tuqnpn on smithi139 2024-09-17T07:21:38.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:38 smithi087 ceph-mon[27636]: pgmap v12: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 511 B/s wr, 16 op/s 2024-09-17T07:21:38.593 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:38 smithi139 ceph-mon[34403]: Upgrade: Updating mgr.smithi139.tuqnpn 2024-09-17T07:21:38.593 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:38 smithi139 ceph-mon[34403]: Deploying daemon mgr.smithi139.tuqnpn on smithi139 2024-09-17T07:21:38.593 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:38 smithi139 ceph-mon[34403]: pgmap v12: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 511 B/s wr, 16 op/s 2024-09-17T07:21:40.303 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:40 smithi139 ceph-mon[34403]: pgmap v13: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 341 B/s wr, 4 op/s 2024-09-17T07:21:40.304 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:40 smithi139 ceph-mon[34403]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' 2024-09-17T07:21:40.304 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:40 smithi139 ceph-mon[34403]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' 2024-09-17T07:21:40.304 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:40 smithi139 ceph-mon[34403]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:21:40.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:40 smithi087 ceph-mon[27636]: pgmap v13: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 341 B/s wr, 4 op/s 2024-09-17T07:21:40.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:40 smithi087 ceph-mon[27636]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' 2024-09-17T07:21:40.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:40 smithi087 ceph-mon[27636]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' 2024-09-17T07:21:40.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:40 smithi087 ceph-mon[27636]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:21:42.184 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:42 smithi139 ceph-mon[34403]: pgmap v14: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.7 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-17T07:21:42.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:42 smithi087 ceph-mon[27636]: pgmap v14: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.7 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-17T07:21:43.889 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:43 smithi139 ceph-mon[34403]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' 2024-09-17T07:21:43.889 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:43 smithi139 ceph-mon[34403]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' 2024-09-17T07:21:43.889 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:43 smithi139 ceph-mon[34403]: pgmap v15: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-17T07:21:43.889 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:43 smithi139 ceph-mon[34403]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' 2024-09-17T07:21:43.890 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:43 smithi139 ceph-mon[34403]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' 2024-09-17T07:21:43.919 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:43 smithi087 ceph-mon[27636]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' 2024-09-17T07:21:43.919 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:43 smithi087 ceph-mon[27636]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' 2024-09-17T07:21:43.919 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:43 smithi087 ceph-mon[27636]: pgmap v15: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-17T07:21:43.919 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:43 smithi087 ceph-mon[27636]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' 2024-09-17T07:21:43.919 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:43 smithi087 ceph-mon[27636]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' 2024-09-17T07:21:45.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:45 smithi087 ceph-mon[27636]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' 2024-09-17T07:21:45.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:45 smithi087 ceph-mon[27636]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' 2024-09-17T07:21:45.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:45 smithi087 ceph-mon[27636]: Standby manager daemon smithi139.tuqnpn restarted 2024-09-17T07:21:45.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:45 smithi087 ceph-mon[27636]: Standby manager daemon smithi139.tuqnpn started 2024-09-17T07:21:45.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:45 smithi087 ceph-mon[27636]: from='mgr.? 172.21.15.139:0/3461691032' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi139.tuqnpn/crt"}]: dispatch 2024-09-17T07:21:45.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:45 smithi087 ceph-mon[27636]: from='mgr.? 172.21.15.139:0/3461691032' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T07:21:45.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:45 smithi087 ceph-mon[27636]: from='mgr.? 172.21.15.139:0/3461691032' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi139.tuqnpn/key"}]: dispatch 2024-09-17T07:21:45.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:45 smithi087 ceph-mon[27636]: from='mgr.? 172.21.15.139:0/3461691032' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T07:21:45.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:45 smithi087 ceph-mon[27636]: pgmap v16: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-17T07:21:46.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:45 smithi139 ceph-mon[34403]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' 2024-09-17T07:21:46.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:45 smithi139 ceph-mon[34403]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' 2024-09-17T07:21:46.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:45 smithi139 ceph-mon[34403]: Standby manager daemon smithi139.tuqnpn restarted 2024-09-17T07:21:46.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:45 smithi139 ceph-mon[34403]: Standby manager daemon smithi139.tuqnpn started 2024-09-17T07:21:46.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:45 smithi139 ceph-mon[34403]: from='mgr.? 172.21.15.139:0/3461691032' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi139.tuqnpn/crt"}]: dispatch 2024-09-17T07:21:46.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:45 smithi139 ceph-mon[34403]: from='mgr.? 172.21.15.139:0/3461691032' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T07:21:46.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:45 smithi139 ceph-mon[34403]: from='mgr.? 172.21.15.139:0/3461691032' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi139.tuqnpn/key"}]: dispatch 2024-09-17T07:21:46.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:45 smithi139 ceph-mon[34403]: from='mgr.? 172.21.15.139:0/3461691032' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T07:21:46.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:45 smithi139 ceph-mon[34403]: pgmap v16: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-17T07:21:46.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:46 smithi139 ceph-mon[34403]: mgrmap e32: smithi087.vuvjer(active, since 26s), standbys: smithi139.tuqnpn 2024-09-17T07:21:46.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:46 smithi139 ceph-mon[34403]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' 2024-09-17T07:21:46.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:46 smithi139 ceph-mon[34403]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' 2024-09-17T07:21:46.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:46 smithi139 ceph-mon[34403]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:21:46.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:46 smithi139 ceph-mon[34403]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:21:46.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:46 smithi139 ceph-mon[34403]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' 2024-09-17T07:21:46.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:46 smithi087 ceph-mon[27636]: mgrmap e32: smithi087.vuvjer(active, since 26s), standbys: smithi139.tuqnpn 2024-09-17T07:21:46.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:46 smithi087 ceph-mon[27636]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' 2024-09-17T07:21:46.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:46 smithi087 ceph-mon[27636]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' 2024-09-17T07:21:46.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:46 smithi087 ceph-mon[27636]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:21:46.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:46 smithi087 ceph-mon[27636]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:21:46.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:46 smithi087 ceph-mon[27636]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' 2024-09-17T07:21:47.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:47 smithi087 ceph-mon[27636]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:21:47.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:47 smithi087 ceph-mon[27636]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:21:47.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:47 smithi087 ceph-mon[27636]: Upgrade: Setting container_image for all mgr 2024-09-17T07:21:47.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:47 smithi087 ceph-mon[27636]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' 2024-09-17T07:21:47.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:47 smithi087 ceph-mon[27636]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi087.vuvjer"}]: dispatch 2024-09-17T07:21:47.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:47 smithi087 ceph-mon[27636]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi087.vuvjer"}]': finished 2024-09-17T07:21:47.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:47 smithi087 ceph-mon[27636]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi139.tuqnpn"}]: dispatch 2024-09-17T07:21:47.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:47 smithi087 ceph-mon[27636]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi139.tuqnpn"}]': finished 2024-09-17T07:21:47.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:47 smithi087 ceph-mon[27636]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-17T07:21:47.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:47 smithi087 ceph-mon[27636]: pgmap v17: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-17T07:21:48.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:47 smithi139 ceph-mon[34403]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:21:48.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:47 smithi139 ceph-mon[34403]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:21:48.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:47 smithi139 ceph-mon[34403]: Upgrade: Setting container_image for all mgr 2024-09-17T07:21:48.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:47 smithi139 ceph-mon[34403]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' 2024-09-17T07:21:48.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:47 smithi139 ceph-mon[34403]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi087.vuvjer"}]: dispatch 2024-09-17T07:21:48.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:47 smithi139 ceph-mon[34403]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi087.vuvjer"}]': finished 2024-09-17T07:21:48.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:47 smithi139 ceph-mon[34403]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi139.tuqnpn"}]: dispatch 2024-09-17T07:21:48.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:47 smithi139 ceph-mon[34403]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi139.tuqnpn"}]': finished 2024-09-17T07:21:48.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:47 smithi139 ceph-mon[34403]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-17T07:21:48.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:47 smithi139 ceph-mon[34403]: pgmap v17: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-17T07:21:49.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:49 smithi139 ceph-mon[34403]: Upgrade: Updating mon.smithi087 2024-09-17T07:21:49.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:49 smithi139 ceph-mon[34403]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' 2024-09-17T07:21:49.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:49 smithi139 ceph-mon[34403]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T07:21:49.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:49 smithi139 ceph-mon[34403]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T07:21:49.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:49 smithi139 ceph-mon[34403]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:21:49.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:49 smithi139 ceph-mon[34403]: Deploying daemon mon.smithi087 on smithi087 2024-09-17T07:21:49.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:49 smithi139 ceph-mon[34403]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:21:49.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:49 smithi087 ceph-mon[27636]: Upgrade: Updating mon.smithi087 2024-09-17T07:21:49.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:49 smithi087 ceph-mon[27636]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' 2024-09-17T07:21:49.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:49 smithi087 ceph-mon[27636]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T07:21:49.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:49 smithi087 ceph-mon[27636]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T07:21:49.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:49 smithi087 ceph-mon[27636]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:21:49.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:49 smithi087 ceph-mon[27636]: Deploying daemon mon.smithi087 on smithi087 2024-09-17T07:21:49.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:49 smithi087 ceph-mon[27636]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:21:50.008 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:49 smithi087 systemd[1]: Stopping Ceph mon.smithi087 for d5dbf8d6-74c3-11ef-bceb-c7b262605968... 2024-09-17T07:21:50.333 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:50 smithi087 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-mon-smithi087[27632]: 2024-09-17T07:21:50.006+0000 7f3daa897640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi087 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T07:21:50.334 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:50 smithi087 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-mon-smithi087[27632]: 2024-09-17T07:21:50.006+0000 7f3daa897640 -1 mon.smithi087@0(leader) e2 *** Got Signal Terminated *** 2024-09-17T07:21:50.334 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:50 smithi087 podman[90807]: 2024-09-17 07:21:50.241515537 +0000 UTC m=+0.346464937 container died 175785e1fb86e331535b3cbce3f96947927893ecbe509fc4a0fe912e080a9ae1 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-mon-smithi087, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=quincy-4a70413, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-17T07:21:51.065 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:50 smithi087 podman[90807]: 2024-09-17 07:21:50.715040254 +0000 UTC m=+0.819989693 container cleanup 175785e1fb86e331535b3cbce3f96947927893ecbe509fc4a0fe912e080a9ae1 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-mon-smithi087, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, RELEASE=quincy-4a70413, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-17T07:21:51.065 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:50 smithi087 bash[90807]: ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-mon-smithi087 2024-09-17T07:21:51.065 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:50 smithi087 podman[90830]: 2024-09-17 07:21:50.958077099 +0000 UTC m=+0.715427689 container remove 175785e1fb86e331535b3cbce3f96947927893ecbe509fc4a0fe912e080a9ae1 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-mon-smithi087, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=quincy-4a70413, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T07:21:51.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 systemd[1]: ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968@mon.smithi087.service: Deactivated successfully. 2024-09-17T07:21:51.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 systemd[1]: Stopped Ceph mon.smithi087 for d5dbf8d6-74c3-11ef-bceb-c7b262605968. 2024-09-17T07:21:51.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 systemd[1]: ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968@mon.smithi087.service: Consumed 10.070s CPU time. 2024-09-17T07:21:51.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 systemd[1]: Starting Ceph mon.smithi087 for d5dbf8d6-74c3-11ef-bceb-c7b262605968... 2024-09-17T07:21:51.761 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 podman[90963]: 2024-09-17 07:21:51.395957119 +0000 UTC m=+0.015769789 image pull 980a0bfcd684674f25c08d857ad8de3b1c8ae738870529edbf9aa463832c8d89 quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9 2024-09-17T07:21:51.762 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 podman[90963]: 2024-09-17 07:21:51.542747429 +0000 UTC m=+0.162560087 container create 305c72de1f9f1d1730f70b140c3c58f1905b1408c2f35c9371298cc5090ad0b5 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-mon-smithi087, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, RELEASE=reef-19e2a2b, io.buildah.version=1.37.2) 2024-09-17T07:21:51.762 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 podman[90963]: 2024-09-17 07:21:51.761664943 +0000 UTC m=+0.381477611 container init 305c72de1f9f1d1730f70b140c3c58f1905b1408c2f35c9371298cc5090ad0b5 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-mon-smithi087, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=reef-19e2a2b, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T07:21:52.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 podman[90963]: 2024-09-17 07:21:51.765153239 +0000 UTC m=+0.384965910 container start 305c72de1f9f1d1730f70b140c3c58f1905b1408c2f35c9371298cc5090ad0b5 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-mon-smithi087, org.label-schema.vendor=CentOS, RELEASE=reef-19e2a2b, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-17T07:21:52.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: set uid:gid to 167:167 (ceph:ceph) 2024-09-17T07:21:52.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable), process ceph-mon, pid 2 2024-09-17T07:21:52.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: pidfile_write: ignore empty --pid-file 2024-09-17T07:21:52.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: load: jerasure load: lrc 2024-09-17T07:21:52.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: RocksDB version: 7.9.2 2024-09-17T07:21:52.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Git sha 0 2024-09-17T07:21:52.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Compile date 2024-09-16 15:15:13 2024-09-17T07:21:52.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: DB SUMMARY 2024-09-17T07:21:52.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: DB Session ID: 4BM70PY0EVCRX8W6OP1X 2024-09-17T07:21:52.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: CURRENT file: CURRENT 2024-09-17T07:21:52.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: IDENTITY file: IDENTITY 2024-09-17T07:21:52.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: MANIFEST file: MANIFEST-000015 size: 971 Bytes 2024-09-17T07:21:52.178 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi087/store.db dir, Total Num: 1, files: 000030.sst 2024-09-17T07:21:52.178 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi087/store.db: 000028.log size: 1500107 ; 2024-09-17T07:21:52.178 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.error_if_exists: 0 2024-09-17T07:21:52.178 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.create_if_missing: 0 2024-09-17T07:21:52.178 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.paranoid_checks: 1 2024-09-17T07:21:52.178 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-17T07:21:52.178 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-17T07:21:52.178 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-17T07:21:52.178 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.env: 0x556fc0ed8bc0 2024-09-17T07:21:52.178 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.fs: PosixFileSystem 2024-09-17T07:21:52.178 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.info_log: 0x556fc2b46dc0 2024-09-17T07:21:52.178 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.max_file_opening_threads: 16 2024-09-17T07:21:52.178 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.statistics: (nil) 2024-09-17T07:21:52.178 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.use_fsync: 0 2024-09-17T07:21:52.179 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.max_log_file_size: 0 2024-09-17T07:21:52.179 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-17T07:21:52.179 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-17T07:21:52.179 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.keep_log_file_num: 1000 2024-09-17T07:21:52.179 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.recycle_log_file_num: 0 2024-09-17T07:21:52.179 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.allow_fallocate: 1 2024-09-17T07:21:52.181 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.allow_mmap_reads: 0 2024-09-17T07:21:52.181 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.allow_mmap_writes: 0 2024-09-17T07:21:52.181 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.use_direct_reads: 0 2024-09-17T07:21:52.181 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-17T07:21:52.181 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.create_missing_column_families: 0 2024-09-17T07:21:52.181 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.db_log_dir: 2024-09-17T07:21:52.181 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.wal_dir: 2024-09-17T07:21:52.181 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-17T07:21:52.181 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-17T07:21:52.181 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-17T07:21:52.181 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-17T07:21:52.181 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-17T07:21:52.182 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-17T07:21:52.182 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.advise_random_on_open: 1 2024-09-17T07:21:52.182 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.db_write_buffer_size: 0 2024-09-17T07:21:52.182 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.write_buffer_manager: 0x556fc2b54320 2024-09-17T07:21:52.182 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-17T07:21:52.182 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-17T07:21:52.182 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-17T07:21:52.182 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.rate_limiter: (nil) 2024-09-17T07:21:52.182 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-17T07:21:52.182 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.wal_recovery_mode: 2 2024-09-17T07:21:52.182 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.enable_thread_tracking: 0 2024-09-17T07:21:52.182 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.enable_pipelined_write: 0 2024-09-17T07:21:52.182 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.unordered_write: 0 2024-09-17T07:21:52.183 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-17T07:21:52.183 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-17T07:21:52.183 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-17T07:21:52.183 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-17T07:21:52.183 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.row_cache: None 2024-09-17T07:21:52.183 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.wal_filter: None 2024-09-17T07:21:52.183 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-17T07:21:52.183 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.allow_ingest_behind: 0 2024-09-17T07:21:52.183 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.two_write_queues: 0 2024-09-17T07:21:52.183 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.manual_wal_flush: 0 2024-09-17T07:21:52.183 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.wal_compression: 0 2024-09-17T07:21:52.183 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.atomic_flush: 0 2024-09-17T07:21:52.183 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-17T07:21:52.184 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-17T07:21:52.184 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-17T07:21:52.184 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.log_readahead_size: 0 2024-09-17T07:21:52.184 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-17T07:21:52.184 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.best_efforts_recovery: 0 2024-09-17T07:21:52.184 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-17T07:21:52.184 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-17T07:21:52.184 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.allow_data_in_errors: 0 2024-09-17T07:21:52.184 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.db_host_id: __hostname__ 2024-09-17T07:21:52.184 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-17T07:21:52.184 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.max_background_jobs: 2 2024-09-17T07:21:52.184 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.max_background_compactions: -1 2024-09-17T07:21:52.184 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.max_subcompactions: 1 2024-09-17T07:21:52.184 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-17T07:21:52.185 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-17T07:21:52.185 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-17T07:21:52.185 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.max_total_wal_size: 0 2024-09-17T07:21:52.185 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-17T07:21:52.185 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-17T07:21:52.185 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-17T07:21:52.185 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-17T07:21:52.185 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.max_open_files: -1 2024-09-17T07:21:52.185 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.bytes_per_sync: 0 2024-09-17T07:21:52.185 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-17T07:21:52.185 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-17T07:21:52.185 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.compaction_readahead_size: 0 2024-09-17T07:21:52.185 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.max_background_flushes: -1 2024-09-17T07:21:52.185 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Compression algorithms supported: 2024-09-17T07:21:52.185 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: kZSTD supported: 0 2024-09-17T07:21:52.186 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: kXpressCompression supported: 0 2024-09-17T07:21:52.186 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: kBZip2Compression supported: 0 2024-09-17T07:21:52.186 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-17T07:21:52.186 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: kLZ4Compression supported: 1 2024-09-17T07:21:52.186 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: kZlibCompression supported: 1 2024-09-17T07:21:52.186 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: kLZ4HCCompression supported: 1 2024-09-17T07:21:52.186 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: kSnappyCompression supported: 1 2024-09-17T07:21:52.186 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-17T07:21:52.186 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-17T07:21:52.186 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi087/store.db/MANIFEST-000015 2024-09-17T07:21:52.186 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-17T07:21:52.186 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-17T07:21:52.186 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.merge_operator: 2024-09-17T07:21:52.186 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.compaction_filter: None 2024-09-17T07:21:52.187 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.compaction_filter_factory: None 2024-09-17T07:21:52.187 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.sst_partitioner_factory: None 2024-09-17T07:21:52.187 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-17T07:21:52.187 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-17T07:21:52.187 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x556fc2b46a20) 2024-09-17T07:21:52.187 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: cache_index_and_filter_blocks: 1 2024-09-17T07:21:52.187 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-17T07:21:52.187 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-17T07:21:52.187 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: pin_top_level_index_and_filter: 1 2024-09-17T07:21:52.187 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: index_type: 0 2024-09-17T07:21:52.187 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: data_block_index_type: 0 2024-09-17T07:21:52.187 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: index_shortening: 1 2024-09-17T07:21:52.187 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-17T07:21:52.187 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: checksum: 4 2024-09-17T07:21:52.187 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: no_block_cache: 0 2024-09-17T07:21:52.188 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: block_cache: 0x556fc2b3b1f0 2024-09-17T07:21:52.188 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: block_cache_name: BinnedLRUCache 2024-09-17T07:21:52.188 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: block_cache_options: 2024-09-17T07:21:52.188 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: capacity : 536870912 2024-09-17T07:21:52.188 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: num_shard_bits : 4 2024-09-17T07:21:52.188 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: strict_capacity_limit : 0 2024-09-17T07:21:52.188 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: high_pri_pool_ratio: 0.000 2024-09-17T07:21:52.188 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: block_cache_compressed: (nil) 2024-09-17T07:21:52.188 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: persistent_cache: (nil) 2024-09-17T07:21:52.188 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: block_size: 4096 2024-09-17T07:21:52.188 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: block_size_deviation: 10 2024-09-17T07:21:52.188 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: block_restart_interval: 16 2024-09-17T07:21:52.188 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: index_block_restart_interval: 1 2024-09-17T07:21:52.188 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: metadata_block_size: 4096 2024-09-17T07:21:52.189 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: partition_filters: 0 2024-09-17T07:21:52.189 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: use_delta_encoding: 1 2024-09-17T07:21:52.189 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: filter_policy: bloomfilter 2024-09-17T07:21:52.189 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: whole_key_filtering: 1 2024-09-17T07:21:52.189 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: verify_compression: 0 2024-09-17T07:21:52.189 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: read_amp_bytes_per_bit: 0 2024-09-17T07:21:52.189 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: format_version: 5 2024-09-17T07:21:52.189 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: enable_index_compression: 1 2024-09-17T07:21:52.189 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: block_align: 0 2024-09-17T07:21:52.189 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: max_auto_readahead_size: 262144 2024-09-17T07:21:52.189 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: prepopulate_block_cache: 0 2024-09-17T07:21:52.189 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: initial_auto_readahead_size: 8192 2024-09-17T07:21:52.189 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: num_file_reads_for_auto_readahead: 2 2024-09-17T07:21:52.189 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.write_buffer_size: 33554432 2024-09-17T07:21:52.190 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.max_write_buffer_number: 2 2024-09-17T07:21:52.190 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.compression: NoCompression 2024-09-17T07:21:52.190 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.bottommost_compression: Disabled 2024-09-17T07:21:52.190 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.prefix_extractor: nullptr 2024-09-17T07:21:52.190 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-17T07:21:52.190 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.num_levels: 7 2024-09-17T07:21:52.190 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-17T07:21:52.190 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-17T07:21:52.190 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-17T07:21:52.191 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-17T07:21:52.191 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-17T07:21:52.191 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-17T07:21:52.191 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-17T07:21:52.191 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-17T07:21:52.191 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-17T07:21:52.191 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-17T07:21:52.191 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-17T07:21:52.191 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-17T07:21:52.191 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-17T07:21:52.191 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.compression_opts.level: 32767 2024-09-17T07:21:52.191 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.compression_opts.strategy: 0 2024-09-17T07:21:52.191 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-17T07:21:52.192 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-17T07:21:52.192 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-17T07:21:52.192 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-17T07:21:52.192 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.compression_opts.enabled: false 2024-09-17T07:21:52.192 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-17T07:21:52.192 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-17T07:21:52.192 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-17T07:21:52.192 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-17T07:21:52.192 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.target_file_size_base: 67108864 2024-09-17T07:21:52.192 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-17T07:21:52.192 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-17T07:21:52.192 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-17T07:21:52.192 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-17T07:21:52.192 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-17T07:21:52.193 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-17T07:21:52.193 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-17T07:21:52.193 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-17T07:21:52.193 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-17T07:21:52.193 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-17T07:21:52.193 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-17T07:21:52.193 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-17T07:21:52.193 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-17T07:21:52.193 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-17T07:21:52.193 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.arena_block_size: 1048576 2024-09-17T07:21:52.193 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-17T07:21:52.193 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-17T07:21:52.193 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.disable_auto_compactions: 0 2024-09-17T07:21:52.193 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-17T07:21:52.194 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-17T07:21:52.194 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-17T07:21:52.194 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-17T07:21:52.194 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-17T07:21:52.194 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-17T07:21:52.194 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-17T07:21:52.194 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-17T07:21:52.194 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-17T07:21:52.194 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-17T07:21:52.194 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-17T07:21:52.194 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.inplace_update_support: 0 2024-09-17T07:21:52.194 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-17T07:21:52.194 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-17T07:21:52.194 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-17T07:21:52.195 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-17T07:21:52.195 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.bloom_locality: 0 2024-09-17T07:21:52.195 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.max_successive_merges: 0 2024-09-17T07:21:52.195 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-17T07:21:52.195 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.paranoid_file_checks: 0 2024-09-17T07:21:52.195 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.force_consistency_checks: 1 2024-09-17T07:21:52.195 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.report_bg_io_stats: 0 2024-09-17T07:21:52.195 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.ttl: 2592000 2024-09-17T07:21:52.195 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-17T07:21:52.195 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-17T07:21:52.195 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-17T07:21:52.195 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.enable_blob_files: false 2024-09-17T07:21:52.195 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.min_blob_size: 0 2024-09-17T07:21:52.195 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.blob_file_size: 268435456 2024-09-17T07:21:52.195 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-17T07:21:52.196 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-17T07:21:52.196 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-17T07:21:52.196 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-17T07:21:52.196 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-17T07:21:52.196 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.blob_file_starting_level: 0 2024-09-17T07:21:52.196 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-17T07:21:52.196 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 30.sst 2024-09-17T07:21:52.196 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-17T07:21:52.196 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi087/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 32, last_sequence is 10458, log_number is 28,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-17T07:21:52.196 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 28 2024-09-17T07:21:52.196 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 959c34fc-1edc-4e4c-b911-38d18c38c915 2024-09-17T07:21:52.196 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726557711790847, "job": 1, "event": "recovery_started", "wal_files": [28]} 2024-09-17T07:21:52.196 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #28 mode 2 2024-09-17T07:21:52.197 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726557711795934, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 33, "file_size": 1351770, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 10459, "largest_seqno": 11088, "table_properties": {"data_size": 1347933, "index_size": 2029, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 6903, "raw_average_key_size": 23, "raw_value_size": 1341471, "raw_average_value_size": 4625, "num_data_blocks": 93, "num_entries": 290, "num_filter_entries": 290, "num_deletions": 2, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726557711, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "959c34fc-1edc-4e4c-b911-38d18c38c915", "db_session_id": "4BM70PY0EVCRX8W6OP1X", "orig_file_number": 33, "seqno_to_time_mapping": "N/A"}} 2024-09-17T07:21:52.197 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726557711796079, "job": 1, "event": "recovery_finished"} 2024-09-17T07:21:52.197 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: [db/version_set.cc:5047] Creating manifest 35 2024-09-17T07:21:52.197 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-17T07:21:52.197 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi087/store.db/000028.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-17T07:21:52.197 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x556fc2b66e00 2024-09-17T07:21:52.197 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: DB pointer 0x556fc2c5a000 2024-09-17T07:21:52.197 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-17T07:21:52.197 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-17T07:21:52.197 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: ** DB Stats ** 2024-09-17T07:21:52.197 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-17T07:21:52.198 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-17T07:21:52.198 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-17T07:21:52.198 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-17T07:21:52.198 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-17T07:21:52.198 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-17T07:21:52.198 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-17T07:21:52.198 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: 2024-09-17T07:21:52.198 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: ** Compaction Stats [default] ** 2024-09-17T07:21:52.198 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-17T07:21:52.198 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-17T07:21:52.198 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: L0 1/0 1.29 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 430.7 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-17T07:21:52.198 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: L6 1/0 5.94 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-17T07:21:52.198 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Sum 2/0 7.23 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 430.7 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-17T07:21:52.199 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 430.7 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-17T07:21:52.199 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: 2024-09-17T07:21:52.199 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: ** Compaction Stats [default] ** 2024-09-17T07:21:52.199 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-17T07:21:52.199 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-17T07:21:52.199 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 430.7 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-17T07:21:52.199 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: 2024-09-17T07:21:52.199 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-17T07:21:52.199 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: 2024-09-17T07:21:52.199 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-17T07:21:52.199 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Flush(GB): cumulative 0.001, interval 0.001 2024-09-17T07:21:52.199 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-17T07:21:52.199 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-17T07:21:52.199 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-17T07:21:52.200 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-17T07:21:52.200 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Cumulative compaction: 0.00 GB write, 143.19 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-17T07:21:52.200 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Interval compaction: 0.00 GB write, 143.19 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-17T07:21:52.200 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-17T07:21:52.200 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Block cache BinnedLRUCache@0x556fc2b3b1f0#2 capacity: 512.00 MB usage: 2.98 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-17T07:21:52.200 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.91 KB,0.000172853%) IndexBlock(1,2.08 KB,0.000396371%) Misc(1,0.00 KB,0%) 2024-09-17T07:21:52.200 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: 2024-09-17T07:21:52.200 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-17T07:21:52.200 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: starting mon.smithi087 rank 0 at public addrs [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] at bind addrs [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi087 fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 2024-09-17T07:21:52.200 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: mon.smithi087@-1(???) e2 preinit fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 2024-09-17T07:21:52.200 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: mon.smithi087@-1(???).mds e21 new map 2024-09-17T07:21:52.200 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: mon.smithi087@-1(???).mds e21 print_map 2024-09-17T07:21:52.200 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: e21 2024-09-17T07:21:52.200 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T07:21:52.201 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T07:21:52.201 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: legacy client fscid: 1 2024-09-17T07:21:52.201 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: 2024-09-17T07:21:52.201 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Filesystem 'cephfs' (1) 2024-09-17T07:21:52.201 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: fs_name cephfs 2024-09-17T07:21:52.201 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: epoch 21 2024-09-17T07:21:52.201 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T07:21:52.201 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: created 2024-09-17T07:17:15.368053+0000 2024-09-17T07:21:52.201 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: modified 2024-09-17T07:20:37.142055+0000 2024-09-17T07:21:52.201 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: tableserver 0 2024-09-17T07:21:52.201 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: root 0 2024-09-17T07:21:52.201 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: session_timeout 60 2024-09-17T07:21:52.201 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: session_autoclose 300 2024-09-17T07:21:52.202 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: max_file_size 1099511627776 2024-09-17T07:21:52.202 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: max_xattr_size 65536 2024-09-17T07:21:52.202 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: required_client_features {} 2024-09-17T07:21:52.202 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: last_failure 0 2024-09-17T07:21:52.202 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: last_failure_osd_epoch 44 2024-09-17T07:21:52.202 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T07:21:52.202 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: max_mds 2 2024-09-17T07:21:52.202 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: in 0,1 2024-09-17T07:21:52.202 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: up {0=14478,1=24243} 2024-09-17T07:21:52.202 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: failed 2024-09-17T07:21:52.202 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: damaged 2024-09-17T07:21:52.202 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: stopped 2024-09-17T07:21:52.202 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: data_pools [3] 2024-09-17T07:21:52.202 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: metadata_pool 2 2024-09-17T07:21:52.202 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: inline_data enabled 2024-09-17T07:21:52.203 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: balancer 2024-09-17T07:21:52.203 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: bal_rank_mask -1 2024-09-17T07:21:52.203 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: standby_count_wanted 1 2024-09-17T07:21:52.203 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: [mds.cephfs.smithi087.tjhpcs{0:14478} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.87:6828/2255237099,v1:172.21.15.87:6829/2255237099] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:21:52.203 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: [mds.cephfs.smithi087.vvbzss{0:14490} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.87:6826/4022268353,v1:172.21.15.87:6827/4022268353] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:21:52.203 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: [mds.cephfs.smithi139.gnwonz{1:24243} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.139:6824/3946792151,v1:172.21.15.139:6825/3946792151] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:21:52.203 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: [mds.cephfs.smithi139.ftvinf{1:24253} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.139:6826/3292073323,v1:172.21.15.139:6827/3292073323] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:21:52.203 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: 2024-09-17T07:21:52.203 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: 2024-09-17T07:21:52.203 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: mon.smithi087@-1(???).osd e46 crush map has features 3314933000852226048, adjusting msgr requires 2024-09-17T07:21:52.203 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: mon.smithi087@-1(???).osd e46 crush map has features 288514051259236352, adjusting msgr requires 2024-09-17T07:21:52.203 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: mon.smithi087@-1(???).osd e46 crush map has features 288514051259236352, adjusting msgr requires 2024-09-17T07:21:52.203 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: mon.smithi087@-1(???).osd e46 crush map has features 288514051259236352, adjusting msgr requires 2024-09-17T07:21:52.203 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 ceph-mon[90982]: mon.smithi087@-1(???).paxosservice(auth 1..20) refresh upgraded, format 0 -> 3 2024-09-17T07:21:52.203 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 bash[90963]: 305c72de1f9f1d1730f70b140c3c58f1905b1408c2f35c9371298cc5090ad0b5 2024-09-17T07:21:52.204 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:51 smithi087 systemd[1]: Started Ceph mon.smithi087 for d5dbf8d6-74c3-11ef-bceb-c7b262605968. 2024-09-17T07:21:53.504 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:53 smithi087 ceph-mon[90982]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mon metadata", "id": "smithi087"}]: dispatch 2024-09-17T07:21:53.504 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:53 smithi087 ceph-mon[90982]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mon metadata", "id": "smithi139"}]: dispatch 2024-09-17T07:21:53.504 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:53 smithi087 ceph-mon[90982]: pgmap v19: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:21:53.505 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:53 smithi087 ceph-mon[90982]: mon.smithi087 calling monitor election 2024-09-17T07:21:53.505 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:53 smithi087 ceph-mon[90982]: mon.smithi087 is new leader, mons smithi087,smithi139 in quorum (ranks 0,1) 2024-09-17T07:21:53.505 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:53 smithi087 ceph-mon[90982]: monmap e2: 2 mons at {smithi087=[v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0],smithi139=[v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-17T07:21:53.505 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:53 smithi087 ceph-mon[90982]: fsmap cephfs:2 {0=cephfs.smithi087.tjhpcs=up:active,1=cephfs.smithi139.gnwonz=up:active} 2 up:standby-replay 2024-09-17T07:21:53.505 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:53 smithi087 ceph-mon[90982]: osdmap e46: 6 total, 6 up, 6 in 2024-09-17T07:21:53.505 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:53 smithi087 ceph-mon[90982]: mgrmap e32: smithi087.vuvjer(active, since 34s), standbys: smithi139.tuqnpn 2024-09-17T07:21:53.505 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:53 smithi087 ceph-mon[90982]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T07:21:53.505 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:53 smithi087 ceph-mon[90982]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T07:21:53.505 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:53 smithi087 ceph-mon[90982]: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T07:21:53.505 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:53 smithi087 ceph-mon[90982]: mgrmap e33: smithi087.vuvjer(active, since 34s), standbys: smithi139.tuqnpn 2024-09-17T07:21:53.505 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:53 smithi087 ceph-mon[90982]: from='mgr.14756 ' entity='' 2024-09-17T07:21:53.578 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:53 smithi139 ceph-mon[34403]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mon metadata", "id": "smithi087"}]: dispatch 2024-09-17T07:21:53.579 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:53 smithi139 ceph-mon[34403]: from='mgr.14756 172.21.15.87:0/1579421613' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mon metadata", "id": "smithi139"}]: dispatch 2024-09-17T07:21:53.579 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:53 smithi139 ceph-mon[34403]: pgmap v19: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:21:53.579 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:53 smithi139 ceph-mon[34403]: mon.smithi087 calling monitor election 2024-09-17T07:21:53.579 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:53 smithi139 ceph-mon[34403]: mon.smithi087 is new leader, mons smithi087,smithi139 in quorum (ranks 0,1) 2024-09-17T07:21:53.579 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:53 smithi139 ceph-mon[34403]: monmap e2: 2 mons at {smithi087=[v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0],smithi139=[v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-17T07:21:53.579 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:53 smithi139 ceph-mon[34403]: fsmap cephfs:2 {0=cephfs.smithi087.tjhpcs=up:active,1=cephfs.smithi139.gnwonz=up:active} 2 up:standby-replay 2024-09-17T07:21:53.579 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:53 smithi139 ceph-mon[34403]: osdmap e46: 6 total, 6 up, 6 in 2024-09-17T07:21:53.579 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:53 smithi139 ceph-mon[34403]: mgrmap e32: smithi087.vuvjer(active, since 34s), standbys: smithi139.tuqnpn 2024-09-17T07:21:53.579 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:53 smithi139 ceph-mon[34403]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T07:21:53.579 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:53 smithi139 ceph-mon[34403]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T07:21:53.580 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:53 smithi139 ceph-mon[34403]: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T07:21:53.580 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:53 smithi139 ceph-mon[34403]: mgrmap e33: smithi087.vuvjer(active, since 34s), standbys: smithi139.tuqnpn 2024-09-17T07:21:53.580 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:53 smithi139 ceph-mon[34403]: from='mgr.14756 ' entity='' 2024-09-17T07:21:58.218 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:58 smithi139 ceph-mon[34403]: Standby manager daemon smithi139.tuqnpn restarted 2024-09-17T07:21:58.218 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:58 smithi139 ceph-mon[34403]: Standby manager daemon smithi139.tuqnpn started 2024-09-17T07:21:58.218 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:58 smithi139 ceph-mon[34403]: from='mgr.? 172.21.15.139:0/503729357' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi139.tuqnpn/crt"}]: dispatch 2024-09-17T07:21:58.218 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:58 smithi139 ceph-mon[34403]: from='mgr.? 172.21.15.139:0/503729357' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T07:21:58.218 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:58 smithi139 ceph-mon[34403]: from='mgr.? 172.21.15.139:0/503729357' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi139.tuqnpn/key"}]: dispatch 2024-09-17T07:21:58.218 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:58 smithi139 ceph-mon[34403]: from='mgr.? 172.21.15.139:0/503729357' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T07:21:58.279 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:58 smithi087 ceph-mon[90982]: Standby manager daemon smithi139.tuqnpn restarted 2024-09-17T07:21:58.280 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:58 smithi087 ceph-mon[90982]: Standby manager daemon smithi139.tuqnpn started 2024-09-17T07:21:58.280 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:58 smithi087 ceph-mon[90982]: from='mgr.? 172.21.15.139:0/503729357' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi139.tuqnpn/crt"}]: dispatch 2024-09-17T07:21:58.280 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:58 smithi087 ceph-mon[90982]: from='mgr.? 172.21.15.139:0/503729357' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T07:21:58.280 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:58 smithi087 ceph-mon[90982]: from='mgr.? 172.21.15.139:0/503729357' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi139.tuqnpn/key"}]: dispatch 2024-09-17T07:21:58.280 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:58 smithi087 ceph-mon[90982]: from='mgr.? 172.21.15.139:0/503729357' entity='mgr.smithi139.tuqnpn' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T07:21:59.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:59 smithi087 ceph-mon[90982]: mgrmap e34: smithi087.vuvjer(active, since 39s), standbys: smithi139.tuqnpn 2024-09-17T07:21:59.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:59 smithi087 ceph-mon[90982]: Active manager daemon smithi087.vuvjer restarted 2024-09-17T07:21:59.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:59 smithi087 ceph-mon[90982]: Activating manager daemon smithi087.vuvjer 2024-09-17T07:21:59.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:59 smithi087 ceph-mon[90982]: osdmap e47: 6 total, 6 up, 6 in 2024-09-17T07:21:59.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:59 smithi087 ceph-mon[90982]: mgrmap e35: smithi087.vuvjer(active, starting, since 0.00577152s), standbys: smithi139.tuqnpn 2024-09-17T07:21:59.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:59 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mon metadata", "id": "smithi087"}]: dispatch 2024-09-17T07:21:59.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:59 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mon metadata", "id": "smithi139"}]: dispatch 2024-09-17T07:21:59.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:59 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi087.tjhpcs"}]: dispatch 2024-09-17T07:21:59.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:59 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi087.vvbzss"}]: dispatch 2024-09-17T07:21:59.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:59 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi139.gnwonz"}]: dispatch 2024-09-17T07:21:59.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:59 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi139.ftvinf"}]: dispatch 2024-09-17T07:21:59.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:59 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mgr metadata", "who": "smithi087.vuvjer", "id": "smithi087.vuvjer"}]: dispatch 2024-09-17T07:21:59.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:59 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mgr metadata", "who": "smithi139.tuqnpn", "id": "smithi139.tuqnpn"}]: dispatch 2024-09-17T07:21:59.178 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:59 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T07:21:59.178 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:59 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T07:21:59.178 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:59 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T07:21:59.178 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:59 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T07:21:59.178 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:59 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T07:21:59.178 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:59 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T07:21:59.178 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:59 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T07:21:59.178 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:59 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T07:21:59.178 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:59 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T07:21:59.178 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:59 smithi087 ceph-mon[90982]: Manager daemon smithi087.vuvjer is now available 2024-09-17T07:21:59.178 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:59 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:21:59.178 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:59 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:21:59.178 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:59 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi087.vuvjer/mirror_snapshot_schedule"}]: dispatch 2024-09-17T07:21:59.178 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:21:59 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi087.vuvjer/trash_purge_schedule"}]: dispatch 2024-09-17T07:21:59.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:59 smithi139 ceph-mon[34403]: mgrmap e34: smithi087.vuvjer(active, since 39s), standbys: smithi139.tuqnpn 2024-09-17T07:21:59.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:59 smithi139 ceph-mon[34403]: Active manager daemon smithi087.vuvjer restarted 2024-09-17T07:21:59.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:59 smithi139 ceph-mon[34403]: Activating manager daemon smithi087.vuvjer 2024-09-17T07:21:59.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:59 smithi139 ceph-mon[34403]: osdmap e47: 6 total, 6 up, 6 in 2024-09-17T07:21:59.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:59 smithi139 ceph-mon[34403]: mgrmap e35: smithi087.vuvjer(active, starting, since 0.00577152s), standbys: smithi139.tuqnpn 2024-09-17T07:21:59.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:59 smithi139 ceph-mon[34403]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mon metadata", "id": "smithi087"}]: dispatch 2024-09-17T07:21:59.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:59 smithi139 ceph-mon[34403]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mon metadata", "id": "smithi139"}]: dispatch 2024-09-17T07:21:59.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:59 smithi139 ceph-mon[34403]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi087.tjhpcs"}]: dispatch 2024-09-17T07:21:59.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:59 smithi139 ceph-mon[34403]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi087.vvbzss"}]: dispatch 2024-09-17T07:21:59.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:59 smithi139 ceph-mon[34403]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi139.gnwonz"}]: dispatch 2024-09-17T07:21:59.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:59 smithi139 ceph-mon[34403]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi139.ftvinf"}]: dispatch 2024-09-17T07:21:59.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:59 smithi139 ceph-mon[34403]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mgr metadata", "who": "smithi087.vuvjer", "id": "smithi087.vuvjer"}]: dispatch 2024-09-17T07:21:59.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:59 smithi139 ceph-mon[34403]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mgr metadata", "who": "smithi139.tuqnpn", "id": "smithi139.tuqnpn"}]: dispatch 2024-09-17T07:21:59.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:59 smithi139 ceph-mon[34403]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T07:21:59.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:59 smithi139 ceph-mon[34403]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T07:21:59.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:59 smithi139 ceph-mon[34403]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T07:21:59.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:59 smithi139 ceph-mon[34403]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T07:21:59.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:59 smithi139 ceph-mon[34403]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T07:21:59.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:59 smithi139 ceph-mon[34403]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T07:21:59.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:59 smithi139 ceph-mon[34403]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T07:21:59.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:59 smithi139 ceph-mon[34403]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T07:21:59.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:59 smithi139 ceph-mon[34403]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T07:21:59.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:59 smithi139 ceph-mon[34403]: Manager daemon smithi087.vuvjer is now available 2024-09-17T07:21:59.369 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:59 smithi139 ceph-mon[34403]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:21:59.369 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:59 smithi139 ceph-mon[34403]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:21:59.369 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:59 smithi139 ceph-mon[34403]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi087.vuvjer/mirror_snapshot_schedule"}]: dispatch 2024-09-17T07:21:59.369 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:21:59 smithi139 ceph-mon[34403]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi087.vuvjer/trash_purge_schedule"}]: dispatch 2024-09-17T07:21:59.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:59.825+0000 7f75dfbba640 1 -- 172.21.15.87:0/4127058193 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75d80ff740 msgr2=0x7f75d8101b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:21:59.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:59.825+0000 7f75dfbba640 1 --2- 172.21.15.87:0/4127058193 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75d80ff740 0x7f75d8101b20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f75c80048d0 tx=0x7f75c8009da0 comp rx=0 tx=0).stop 2024-09-17T07:21:59.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:59.825+0000 7f75dfbba640 1 -- 172.21.15.87:0/4127058193 shutdown_connections 2024-09-17T07:21:59.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:59.825+0000 7f75dfbba640 1 --2- 172.21.15.87:0/4127058193 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75d80ff740 0x7f75d8101b20 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:21:59.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:59.825+0000 7f75dfbba640 1 --2- 172.21.15.87:0/4127058193 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f75d8065b80 0x7f75d80ff200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:21:59.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:59.825+0000 7f75dfbba640 1 -- 172.21.15.87:0/4127058193 >> 172.21.15.87:0/4127058193 conn(0x7f75d80f6c10 msgr2=0x7f75d80f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:21:59.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:59.825+0000 7f75dfbba640 1 -- 172.21.15.87:0/4127058193 shutdown_connections 2024-09-17T07:21:59.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:59.825+0000 7f75dfbba640 1 -- 172.21.15.87:0/4127058193 wait complete. 2024-09-17T07:21:59.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:59.825+0000 7f75dfbba640 1 Processor -- start 2024-09-17T07:21:59.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:59.825+0000 7f75dfbba640 1 -- start start 2024-09-17T07:21:59.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:59.825+0000 7f75dfbba640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f75d8065b80 0x7f75d810f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:21:59.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:59.826+0000 7f75dfbba640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75d80ff740 0x7f75d810f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:21:59.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:59.826+0000 7f75dfbba640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d810fd60 con 0x7f75d80ff740 2024-09-17T07:21:59.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:59.826+0000 7f75dfbba640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d8110580 con 0x7f75d8065b80 2024-09-17T07:21:59.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:59.826+0000 7f75dd956640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f75d8065b80 0x7f75d810f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:21:59.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:59.826+0000 7f75dd956640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f75d8065b80 0x7f75d810f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.87:36692/0 (socket says 172.21.15.87:36692) 2024-09-17T07:21:59.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:59.826+0000 7f75dd956640 1 -- 172.21.15.87:0/703855118 learned_addr learned my addr 172.21.15.87:0/703855118 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:21:59.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:59.826+0000 7f75dd155640 1 --2- 172.21.15.87:0/703855118 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75d80ff740 0x7f75d810f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:21:59.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:59.826+0000 7f75dd155640 1 -- 172.21.15.87:0/703855118 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f75d8065b80 msgr2=0x7f75d810f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:21:59.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:59.826+0000 7f75dd155640 1 --2- 172.21.15.87:0/703855118 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f75d8065b80 0x7f75d810f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:21:59.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:59.826+0000 7f75dd155640 1 -- 172.21.15.87:0/703855118 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75c8005040 con 0x7f75d80ff740 2024-09-17T07:21:59.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:59.827+0000 7f75dd155640 1 --2- 172.21.15.87:0/703855118 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75d80ff740 0x7f75d810f710 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f75c80043d0 tx=0x7f75c8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:21:59.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:59.827+0000 7f75ce7fc640 1 -- 172.21.15.87:0/703855118 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75c8038070 con 0x7f75d80ff740 2024-09-17T07:21:59.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:59.827+0000 7f75ce7fc640 1 -- 172.21.15.87:0/703855118 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f75c80096c0 con 0x7f75d80ff740 2024-09-17T07:21:59.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:59.827+0000 7f75dfbba640 1 -- 172.21.15.87:0/703855118 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75d81107b0 con 0x7f75d80ff740 2024-09-17T07:21:59.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:59.827+0000 7f75ce7fc640 1 -- 172.21.15.87:0/703855118 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75c803d420 con 0x7f75d80ff740 2024-09-17T07:21:59.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:59.827+0000 7f75dfbba640 1 -- 172.21.15.87:0/703855118 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75d8110d20 con 0x7f75d80ff740 2024-09-17T07:21:59.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:59.828+0000 7f75dfbba640 1 -- 172.21.15.87:0/703855118 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75d80fa890 con 0x7f75d80ff740 2024-09-17T07:21:59.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:59.828+0000 7f75ce7fc640 1 -- 172.21.15.87:0/703855118 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 36) v1 ==== 90602+0+0 (secure 0 0 0) 0x7f75c8030020 con 0x7f75d80ff740 2024-09-17T07:21:59.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:59.829+0000 7f75ce7fc640 1 --2- 172.21.15.87:0/703855118 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f75c406c8a0 0x7f75c406ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:21:59.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:59.829+0000 7f75ce7fc640 1 -- 172.21.15.87:0/703855118 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f75c80ac080 con 0x7f75d80ff740 2024-09-17T07:21:59.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:59.829+0000 7f75dd956640 1 --2- 172.21.15.87:0/703855118 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f75c406c8a0 0x7f75c406ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:21:59.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:59.829+0000 7f75dd956640 1 --2- 172.21.15.87:0/703855118 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f75c406c8a0 0x7f75c406ed50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f75d4009fd0 tx=0x7f75d400b040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:21:59.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:21:59.834+0000 7f75ce7fc640 1 -- 172.21.15.87:0/703855118 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f75c8076370 con 0x7f75d80ff740 2024-09-17T07:22:00.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.013+0000 7f75dfbba640 1 -- 172.21.15.87:0/703855118 --> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f75d8104f80 con 0x7f75c406c8a0 2024-09-17T07:22:00.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.014+0000 7f75ce7fc640 1 -- 172.21.15.87:0/703855118 <== mgr.24529 v2:172.21.15.87:6800/1359413180 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f75d8104f80 con 0x7f75c406c8a0 2024-09-17T07:22:00.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.016+0000 7f75dfbba640 1 -- 172.21.15.87:0/703855118 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f75c406c8a0 msgr2=0x7f75c406ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:22:00.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.016+0000 7f75dfbba640 1 --2- 172.21.15.87:0/703855118 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f75c406c8a0 0x7f75c406ed50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f75d4009fd0 tx=0x7f75d400b040 comp rx=0 tx=0).stop 2024-09-17T07:22:00.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.016+0000 7f75dfbba640 1 -- 172.21.15.87:0/703855118 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75d80ff740 msgr2=0x7f75d810f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:22:00.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.016+0000 7f75dfbba640 1 --2- 172.21.15.87:0/703855118 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75d80ff740 0x7f75d810f710 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f75c80043d0 tx=0x7f75c8009da0 comp rx=0 tx=0).stop 2024-09-17T07:22:00.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.016+0000 7f75dfbba640 1 -- 172.21.15.87:0/703855118 shutdown_connections 2024-09-17T07:22:00.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.016+0000 7f75dfbba640 1 --2- 172.21.15.87:0/703855118 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75d80ff740 0x7f75d810f710 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:00.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.016+0000 7f75dfbba640 1 --2- 172.21.15.87:0/703855118 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f75c406c8a0 0x7f75c406ed50 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:00.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.016+0000 7f75dfbba640 1 --2- 172.21.15.87:0/703855118 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f75d8065b80 0x7f75d810f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:00.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.016+0000 7f75dfbba640 1 -- 172.21.15.87:0/703855118 >> 172.21.15.87:0/703855118 conn(0x7f75d80f6c10 msgr2=0x7f75d80fb440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:22:00.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.016+0000 7f75dfbba640 1 -- 172.21.15.87:0/703855118 shutdown_connections 2024-09-17T07:22:00.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.016+0000 7f75dfbba640 1 -- 172.21.15.87:0/703855118 wait complete. 2024-09-17T07:22:00.027 INFO:teuthology.orchestra.run.smithi087.stdout:true 2024-09-17T07:22:00.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.105+0000 7f83c720b640 1 -- 172.21.15.87:0/975016984 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83c00fb450 msgr2=0x7f83c00fb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:22:00.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.105+0000 7f83c720b640 1 --2- 172.21.15.87:0/975016984 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83c00fb450 0x7f83c00fb860 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f83bc0048d0 tx=0x7f83bc009da0 comp rx=0 tx=0).stop 2024-09-17T07:22:00.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.105+0000 7f83c720b640 1 -- 172.21.15.87:0/975016984 shutdown_connections 2024-09-17T07:22:00.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.105+0000 7f83c720b640 1 --2- 172.21.15.87:0/975016984 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f83c00fc720 0x7f83c00fcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:00.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.105+0000 7f83c720b640 1 --2- 172.21.15.87:0/975016984 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83c00fb450 0x7f83c00fb860 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:00.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.105+0000 7f83c720b640 1 -- 172.21.15.87:0/975016984 >> 172.21.15.87:0/975016984 conn(0x7f83c00f6c10 msgr2=0x7f83c00f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:22:00.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.105+0000 7f83c720b640 1 -- 172.21.15.87:0/975016984 shutdown_connections 2024-09-17T07:22:00.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.105+0000 7f83c720b640 1 -- 172.21.15.87:0/975016984 wait complete. 2024-09-17T07:22:00.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.105+0000 7f83c720b640 1 Processor -- start 2024-09-17T07:22:00.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.105+0000 7f83c720b640 1 -- start start 2024-09-17T07:22:00.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.106+0000 7f83c720b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83c00fb450 0x7f83c010f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:22:00.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.106+0000 7f83c720b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f83c00fc720 0x7f83c010f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:22:00.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.106+0000 7f83c720b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c010fe20 con 0x7f83c00fb450 2024-09-17T07:22:00.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.106+0000 7f83c720b640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c01105f0 con 0x7f83c00fc720 2024-09-17T07:22:00.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.106+0000 7f83c4fa7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83c00fb450 0x7f83c010f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:22:00.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.106+0000 7f83b7fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f83c00fc720 0x7f83c010f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:22:00.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.106+0000 7f83c4fa7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83c00fb450 0x7f83c010f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:43792/0 (socket says 172.21.15.87:43792) 2024-09-17T07:22:00.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.106+0000 7f83c4fa7640 1 -- 172.21.15.87:0/3833035699 learned_addr learned my addr 172.21.15.87:0/3833035699 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:22:00.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.106+0000 7f83b7fff640 1 -- 172.21.15.87:0/3833035699 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83c00fb450 msgr2=0x7f83c010f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:22:00.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.106+0000 7f83b7fff640 1 --2- 172.21.15.87:0/3833035699 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83c00fb450 0x7f83c010f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:00.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.106+0000 7f83b7fff640 1 -- 172.21.15.87:0/3833035699 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83b0005040 con 0x7f83c00fc720 2024-09-17T07:22:00.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.107+0000 7f83b7fff640 1 --2- 172.21.15.87:0/3833035699 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f83c00fc720 0x7f83c010f7d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f83b0009380 tx=0x7f83b0009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:22:00.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.107+0000 7f83b57fa640 1 -- 172.21.15.87:0/3833035699 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83b0009970 con 0x7f83c00fc720 2024-09-17T07:22:00.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.107+0000 7f83b57fa640 1 -- 172.21.15.87:0/3833035699 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f83b000f040 con 0x7f83c00fc720 2024-09-17T07:22:00.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.107+0000 7f83c720b640 1 -- 172.21.15.87:0/3833035699 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83bc005040 con 0x7f83c00fc720 2024-09-17T07:22:00.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.107+0000 7f83b57fa640 1 -- 172.21.15.87:0/3833035699 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83b0013c40 con 0x7f83c00fc720 2024-09-17T07:22:00.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.107+0000 7f83c720b640 1 -- 172.21.15.87:0/3833035699 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83c0110c30 con 0x7f83c00fc720 2024-09-17T07:22:00.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.108+0000 7f83c720b640 1 -- 172.21.15.87:0/3833035699 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83c00fa8b0 con 0x7f83c00fc720 2024-09-17T07:22:00.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.108+0000 7f83b57fa640 1 -- 172.21.15.87:0/3833035699 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 37) v1 ==== 90896+0+0 (secure 0 0 0) 0x7f83b000e8d0 con 0x7f83c00fc720 2024-09-17T07:22:00.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.109+0000 7f83b57fa640 1 --2- 172.21.15.87:0/3833035699 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f83a806cc20 0x7f83a806f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:22:00.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.109+0000 7f83b57fa640 1 -- 172.21.15.87:0/3833035699 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f83b008bfb0 con 0x7f83c00fc720 2024-09-17T07:22:00.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.109+0000 7f83c4fa7640 1 --2- 172.21.15.87:0/3833035699 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f83a806cc20 0x7f83a806f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:22:00.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.109+0000 7f83c4fa7640 1 --2- 172.21.15.87:0/3833035699 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f83a806cc20 0x7f83a806f0d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f83bc00b020 tx=0x7f83bc035040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:22:00.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.113+0000 7f83b57fa640 1 -- 172.21.15.87:0/3833035699 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f83b0055e80 con 0x7f83c00fc720 2024-09-17T07:22:00.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.311+0000 7f83c720b640 1 -- 172.21.15.87:0/3833035699 --> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f83c0110fb0 con 0x7f83a806cc20 2024-09-17T07:22:00.313 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:00 smithi087 ceph-mon[90982]: [17/Sep/2024:07:21:59] ENGINE Bus STARTING 2024-09-17T07:22:00.313 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:00 smithi087 ceph-mon[90982]: mgrmap e36: smithi087.vuvjer(active, since 1.01037s), standbys: smithi139.tuqnpn 2024-09-17T07:22:00.313 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:00 smithi087 ceph-mon[90982]: pgmap v3: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-17T07:22:00.313 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:00 smithi087 ceph-mon[90982]: [17/Sep/2024:07:21:59] ENGINE Serving on https://172.21.15.87:7150 2024-09-17T07:22:00.313 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:00 smithi087 ceph-mon[90982]: [17/Sep/2024:07:21:59] ENGINE Error in HTTPServer.serve 2024-09-17T07:22:00.313 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: Traceback (most recent call last): 2024-09-17T07:22:00.313 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T07:22:00.313 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: self._connections.run(self.expiration_interval) 2024-09-17T07:22:00.313 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T07:22:00.313 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: self._run(expiration_interval) 2024-09-17T07:22:00.313 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T07:22:00.313 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T07:22:00.313 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T07:22:00.314 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T07:22:00.314 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T07:22:00.314 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: s = self.context.wrap_socket( 2024-09-17T07:22:00.314 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T07:22:00.314 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: return self.sslsocket_class._create( 2024-09-17T07:22:00.314 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T07:22:00.314 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: self.do_handshake() 2024-09-17T07:22:00.314 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T07:22:00.314 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: self._sslobj.do_handshake() 2024-09-17T07:22:00.314 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T07:22:00.314 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:00 smithi087 ceph-mon[90982]: [17/Sep/2024:07:21:59] ENGINE Serving on http://172.21.15.87:8765 2024-09-17T07:22:00.314 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:00 smithi087 ceph-mon[90982]: [17/Sep/2024:07:21:59] ENGINE Bus STARTED 2024-09-17T07:22:00.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.312+0000 7f83b57fa640 1 -- 172.21.15.87:0/3833035699 <== mgr.24529 v2:172.21.15.87:6800/1359413180 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f83c0110fb0 con 0x7f83a806cc20 2024-09-17T07:22:00.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.314+0000 7f83c720b640 1 -- 172.21.15.87:0/3833035699 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f83a806cc20 msgr2=0x7f83a806f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:22:00.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.314+0000 7f83c720b640 1 --2- 172.21.15.87:0/3833035699 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f83a806cc20 0x7f83a806f0d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f83bc00b020 tx=0x7f83bc035040 comp rx=0 tx=0).stop 2024-09-17T07:22:00.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.314+0000 7f83c720b640 1 -- 172.21.15.87:0/3833035699 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f83c00fc720 msgr2=0x7f83c010f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:22:00.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.314+0000 7f83c720b640 1 --2- 172.21.15.87:0/3833035699 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f83c00fc720 0x7f83c010f7d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f83b0009380 tx=0x7f83b0009da0 comp rx=0 tx=0).stop 2024-09-17T07:22:00.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.314+0000 7f83c720b640 1 -- 172.21.15.87:0/3833035699 shutdown_connections 2024-09-17T07:22:00.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.314+0000 7f83c720b640 1 --2- 172.21.15.87:0/3833035699 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f83a806cc20 0x7f83a806f0d0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:00.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.314+0000 7f83c720b640 1 --2- 172.21.15.87:0/3833035699 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f83c00fc720 0x7f83c010f7d0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:00.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.314+0000 7f83c720b640 1 --2- 172.21.15.87:0/3833035699 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83c00fb450 0x7f83c010f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:00.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.314+0000 7f83c720b640 1 -- 172.21.15.87:0/3833035699 >> 172.21.15.87:0/3833035699 conn(0x7f83c00f6c10 msgr2=0x7f83c0065b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:22:00.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.314+0000 7f83c720b640 1 -- 172.21.15.87:0/3833035699 shutdown_connections 2024-09-17T07:22:00.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.315+0000 7f83c720b640 1 -- 172.21.15.87:0/3833035699 wait complete. 2024-09-17T07:22:00.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:00 smithi139 ceph-mon[34403]: [17/Sep/2024:07:21:59] ENGINE Bus STARTING 2024-09-17T07:22:00.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:00 smithi139 ceph-mon[34403]: mgrmap e36: smithi087.vuvjer(active, since 1.01037s), standbys: smithi139.tuqnpn 2024-09-17T07:22:00.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:00 smithi139 ceph-mon[34403]: pgmap v3: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-17T07:22:00.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:00 smithi139 ceph-mon[34403]: [17/Sep/2024:07:21:59] ENGINE Serving on https://172.21.15.87:7150 2024-09-17T07:22:00.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:00 smithi139 ceph-mon[34403]: [17/Sep/2024:07:21:59] ENGINE Error in HTTPServer.serve 2024-09-17T07:22:00.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: Traceback (most recent call last): 2024-09-17T07:22:00.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T07:22:00.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: self._connections.run(self.expiration_interval) 2024-09-17T07:22:00.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T07:22:00.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: self._run(expiration_interval) 2024-09-17T07:22:00.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T07:22:00.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T07:22:00.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T07:22:00.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T07:22:00.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T07:22:00.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: s = self.context.wrap_socket( 2024-09-17T07:22:00.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T07:22:00.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: return self.sslsocket_class._create( 2024-09-17T07:22:00.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T07:22:00.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: self.do_handshake() 2024-09-17T07:22:00.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T07:22:00.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: self._sslobj.do_handshake() 2024-09-17T07:22:00.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T07:22:00.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:00 smithi139 ceph-mon[34403]: [17/Sep/2024:07:21:59] ENGINE Serving on http://172.21.15.87:8765 2024-09-17T07:22:00.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:00 smithi139 ceph-mon[34403]: [17/Sep/2024:07:21:59] ENGINE Bus STARTED 2024-09-17T07:22:00.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.392+0000 7f1150838640 1 -- 172.21.15.87:0/612161444 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f114c0ff700 msgr2=0x7f114c101ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:22:00.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.392+0000 7f1150838640 1 --2- 172.21.15.87:0/612161444 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f114c0ff700 0x7f114c101ae0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f1140009c50 tx=0x7f1140004d10 comp rx=0 tx=0).stop 2024-09-17T07:22:00.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.392+0000 7f1150838640 1 -- 172.21.15.87:0/612161444 shutdown_connections 2024-09-17T07:22:00.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.392+0000 7f1150838640 1 --2- 172.21.15.87:0/612161444 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f114c0ff700 0x7f114c101ae0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:00.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.392+0000 7f1150838640 1 --2- 172.21.15.87:0/612161444 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f114c065bc0 0x7f114c0ff1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:00.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.392+0000 7f1150838640 1 -- 172.21.15.87:0/612161444 >> 172.21.15.87:0/612161444 conn(0x7f114c0f6c10 msgr2=0x7f114c0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:22:00.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.393+0000 7f1150838640 1 -- 172.21.15.87:0/612161444 shutdown_connections 2024-09-17T07:22:00.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.393+0000 7f1150838640 1 -- 172.21.15.87:0/612161444 wait complete. 2024-09-17T07:22:00.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.393+0000 7f1150838640 1 Processor -- start 2024-09-17T07:22:00.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.393+0000 7f1150838640 1 -- start start 2024-09-17T07:22:00.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.393+0000 7f1150838640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f114c065bc0 0x7f114c10cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:22:00.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.393+0000 7f1150838640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f114c0ff700 0x7f114c10d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:22:00.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.393+0000 7f1150838640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f114c10db80 con 0x7f114c065bc0 2024-09-17T07:22:00.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.393+0000 7f1150838640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f114c10e3a0 con 0x7f114c0ff700 2024-09-17T07:22:00.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.393+0000 7f114a59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f114c065bc0 0x7f114c10cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:22:00.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.393+0000 7f114a59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f114c065bc0 0x7f114c10cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:43796/0 (socket says 172.21.15.87:43796) 2024-09-17T07:22:00.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.393+0000 7f114a59c640 1 -- 172.21.15.87:0/1326685651 learned_addr learned my addr 172.21.15.87:0/1326685651 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:22:00.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.393+0000 7f1149d9b640 1 --2- 172.21.15.87:0/1326685651 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f114c0ff700 0x7f114c10d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:22:00.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.394+0000 7f114a59c640 1 -- 172.21.15.87:0/1326685651 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f114c0ff700 msgr2=0x7f114c10d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:22:00.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.394+0000 7f114a59c640 1 --2- 172.21.15.87:0/1326685651 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f114c0ff700 0x7f114c10d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:00.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.394+0000 7f114a59c640 1 -- 172.21.15.87:0/1326685651 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11400098b0 con 0x7f114c065bc0 2024-09-17T07:22:00.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.394+0000 7f1149d9b640 1 --2- 172.21.15.87:0/1326685651 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f114c0ff700 0x7f114c10d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T07:22:00.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.394+0000 7f114a59c640 1 --2- 172.21.15.87:0/1326685651 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f114c065bc0 0x7f114c10cff0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1144002840 tx=0x7f1144004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:22:00.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.394+0000 7f113affd640 1 -- 172.21.15.87:0/1326685651 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1144007c30 con 0x7f114c065bc0 2024-09-17T07:22:00.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.394+0000 7f113affd640 1 -- 172.21.15.87:0/1326685651 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f114400f040 con 0x7f114c065bc0 2024-09-17T07:22:00.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.394+0000 7f1150838640 1 -- 172.21.15.87:0/1326685651 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f114c10e630 con 0x7f114c065bc0 2024-09-17T07:22:00.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.394+0000 7f113affd640 1 -- 172.21.15.87:0/1326685651 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1144009470 con 0x7f114c065bc0 2024-09-17T07:22:00.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.394+0000 7f1150838640 1 -- 172.21.15.87:0/1326685651 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f114c10ebd0 con 0x7f114c065bc0 2024-09-17T07:22:00.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.395+0000 7f1150838640 1 -- 172.21.15.87:0/1326685651 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f114c0fa890 con 0x7f114c065bc0 2024-09-17T07:22:00.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.395+0000 7f113affd640 1 -- 172.21.15.87:0/1326685651 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 37) v1 ==== 90896+0+0 (secure 0 0 0) 0x7f11440096e0 con 0x7f114c065bc0 2024-09-17T07:22:00.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.396+0000 7f113affd640 1 --2- 172.21.15.87:0/1326685651 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f113406cc20 0x7f113406f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:22:00.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.396+0000 7f113affd640 1 -- 172.21.15.87:0/1326685651 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f114408bfe0 con 0x7f114c065bc0 2024-09-17T07:22:00.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.396+0000 7f1149d9b640 1 --2- 172.21.15.87:0/1326685651 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f113406cc20 0x7f113406f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:22:00.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.396+0000 7f1149d9b640 1 --2- 172.21.15.87:0/1326685651 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f113406cc20 0x7f113406f0d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f114c10cda0 tx=0x7f1140004d10 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:22:00.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.400+0000 7f113affd640 1 -- 172.21.15.87:0/1326685651 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f1144055f30 con 0x7f114c065bc0 2024-09-17T07:22:00.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.576+0000 7f1150838640 1 -- 172.21.15.87:0/1326685651 --> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f114c10efd0 con 0x7f113406cc20 2024-09-17T07:22:00.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.585+0000 7f113affd640 1 -- 172.21.15.87:0/1326685651 <== mgr.24529 v2:172.21.15.87:6800/1359413180 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f114c10efd0 con 0x7f113406cc20 2024-09-17T07:22:00.586 INFO:teuthology.orchestra.run.smithi087.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T07:22:00.586 INFO:teuthology.orchestra.run.smithi087.stdout:alertmanager.smithi087 smithi087 *:9093,9094 running (98s) 15s ago 9m 17.3M - 0.25.0 c8568f914cd2 594553f0b497 2024-09-17T07:22:00.587 INFO:teuthology.orchestra.run.smithi087.stdout:crash.smithi087 smithi087 running (10m) 15s ago 10m 6891k - 17.2.7-1635-g4a704134 f22ead590bad d9aaf9839ada 2024-09-17T07:22:00.587 INFO:teuthology.orchestra.run.smithi087.stdout:crash.smithi139 smithi139 running (9m) 17s ago 9m 6895k - 17.2.7-1635-g4a704134 f22ead590bad 354c853b318f 2024-09-17T07:22:00.587 INFO:teuthology.orchestra.run.smithi087.stdout:grafana.smithi087 smithi087 *:3000 running (93s) 15s ago 9m 80.4M - 9.4.7 954c08fa6188 e2f17ec6baa8 2024-09-17T07:22:00.587 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi087.tjhpcs smithi087 running (4m) 15s ago 4m 130M - 17.2.7-1635-g4a704134 f22ead590bad f7142ad971ed 2024-09-17T07:22:00.587 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi087.vvbzss smithi087 running (4m) 15s ago 4m 69.8M - 17.2.7-1635-g4a704134 f22ead590bad 2dd82ff293d1 2024-09-17T07:22:00.587 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi139.ftvinf smithi139 running (4m) 17s ago 4m 57.1M - 17.2.7-1635-g4a704134 f22ead590bad d11edb295ad3 2024-09-17T07:22:00.587 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi139.gnwonz smithi139 running (4m) 17s ago 4m 116M - 17.2.7-1635-g4a704134 f22ead590bad 3b3d884aef02 2024-09-17T07:22:00.587 INFO:teuthology.orchestra.run.smithi087.stdout:mgr.smithi087.vuvjer smithi087 *:8443,9283,8765 running (55s) 15s ago 11m 481M - 18.2.4-855-g19e2a2be 980a0bfcd684 5d10c647cb6b 2024-09-17T07:22:00.587 INFO:teuthology.orchestra.run.smithi087.stdout:mgr.smithi139.tuqnpn smithi139 *:8443,9283,8765 running (21s) 17s ago 9m 65.2M - 18.2.4-855-g19e2a2be 980a0bfcd684 6e0bf371d44c 2024-09-17T07:22:00.587 INFO:teuthology.orchestra.run.smithi087.stdout:mon.smithi087 smithi087 running (11m) 15s ago 11m 59.7M 2048M 17.2.7-1635-g4a704134 f22ead590bad 175785e1fb86 2024-09-17T07:22:00.587 INFO:teuthology.orchestra.run.smithi087.stdout:mon.smithi139 smithi139 running (9m) 17s ago 9m 40.7M 2048M 17.2.7-1635-g4a704134 f22ead590bad a9a2552dc411 2024-09-17T07:22:00.588 INFO:teuthology.orchestra.run.smithi087.stdout:node-exporter.smithi087 smithi087 *:9100 running (103s) 15s ago 10m 8242k - 1.5.0 0da6a335fe13 39fa48de0e87 2024-09-17T07:22:00.588 INFO:teuthology.orchestra.run.smithi087.stdout:node-exporter.smithi139 smithi139 *:9100 running (67s) 17s ago 9m 15.9M - 1.5.0 0da6a335fe13 a5b99b7cbb06 2024-09-17T07:22:00.588 INFO:teuthology.orchestra.run.smithi087.stdout:osd.0 smithi087 running (8m) 15s ago 8m 192M 1557M 17.2.7-1635-g4a704134 f22ead590bad 396801f9b539 2024-09-17T07:22:00.588 INFO:teuthology.orchestra.run.smithi087.stdout:osd.1 smithi087 running (7m) 15s ago 7m 191M 1557M 17.2.7-1635-g4a704134 f22ead590bad 9446985bfcd1 2024-09-17T07:22:00.588 INFO:teuthology.orchestra.run.smithi087.stdout:osd.2 smithi087 running (7m) 15s ago 7m 161M 1557M 17.2.7-1635-g4a704134 f22ead590bad 8fe1428a6878 2024-09-17T07:22:00.588 INFO:teuthology.orchestra.run.smithi087.stdout:osd.3 smithi139 running (6m) 17s ago 6m 233M 2581M 17.2.7-1635-g4a704134 f22ead590bad 0801999b17c4 2024-09-17T07:22:00.588 INFO:teuthology.orchestra.run.smithi087.stdout:osd.4 smithi139 running (6m) 17s ago 6m 208M 2581M 17.2.7-1635-g4a704134 f22ead590bad 299a8dfc47f5 2024-09-17T07:22:00.588 INFO:teuthology.orchestra.run.smithi087.stdout:osd.5 smithi139 running (6m) 17s ago 6m 198M 2581M 17.2.7-1635-g4a704134 f22ead590bad 609cf74f32e7 2024-09-17T07:22:00.588 INFO:teuthology.orchestra.run.smithi087.stdout:prometheus.smithi087 smithi087 *:9095 running (25s) 15s ago 9m 40.1M - 2.43.0 a07b618ecd1d 63d18b7469fc 2024-09-17T07:22:00.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.587+0000 7f1150838640 1 -- 172.21.15.87:0/1326685651 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f113406cc20 msgr2=0x7f113406f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:22:00.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.587+0000 7f1150838640 1 --2- 172.21.15.87:0/1326685651 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f113406cc20 0x7f113406f0d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f114c10cda0 tx=0x7f1140004d10 comp rx=0 tx=0).stop 2024-09-17T07:22:00.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.587+0000 7f1150838640 1 -- 172.21.15.87:0/1326685651 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f114c065bc0 msgr2=0x7f114c10cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:22:00.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.587+0000 7f1150838640 1 --2- 172.21.15.87:0/1326685651 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f114c065bc0 0x7f114c10cff0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1144002840 tx=0x7f1144004570 comp rx=0 tx=0).stop 2024-09-17T07:22:00.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.587+0000 7f1150838640 1 -- 172.21.15.87:0/1326685651 shutdown_connections 2024-09-17T07:22:00.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.587+0000 7f1150838640 1 --2- 172.21.15.87:0/1326685651 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f113406cc20 0x7f113406f0d0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:00.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.587+0000 7f1150838640 1 --2- 172.21.15.87:0/1326685651 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f114c0ff700 0x7f114c10d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:00.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.587+0000 7f1150838640 1 --2- 172.21.15.87:0/1326685651 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f114c065bc0 0x7f114c10cff0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:00.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.588+0000 7f1150838640 1 -- 172.21.15.87:0/1326685651 >> 172.21.15.87:0/1326685651 conn(0x7f114c0f6c10 msgr2=0x7f114c0f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:22:00.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.588+0000 7f1150838640 1 -- 172.21.15.87:0/1326685651 shutdown_connections 2024-09-17T07:22:00.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.588+0000 7f1150838640 1 -- 172.21.15.87:0/1326685651 wait complete. 2024-09-17T07:22:00.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.664+0000 7f16b8a30640 1 -- 172.21.15.87:0/2706010276 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f16b40fc720 msgr2=0x7f16b40fcb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:22:00.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.664+0000 7f16b8a30640 1 --2- 172.21.15.87:0/2706010276 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f16b40fc720 0x7f16b40fcb90 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f16a80048d0 tx=0x7f16a8009da0 comp rx=0 tx=0).stop 2024-09-17T07:22:00.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.664+0000 7f16b8a30640 1 -- 172.21.15.87:0/2706010276 shutdown_connections 2024-09-17T07:22:00.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.664+0000 7f16b8a30640 1 --2- 172.21.15.87:0/2706010276 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f16b40fc720 0x7f16b40fcb90 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:00.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.664+0000 7f16b8a30640 1 --2- 172.21.15.87:0/2706010276 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f16b40fb450 0x7f16b40fb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:00.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.664+0000 7f16b8a30640 1 -- 172.21.15.87:0/2706010276 >> 172.21.15.87:0/2706010276 conn(0x7f16b40f6c10 msgr2=0x7f16b40f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:22:00.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.664+0000 7f16b8a30640 1 -- 172.21.15.87:0/2706010276 shutdown_connections 2024-09-17T07:22:00.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.664+0000 7f16b8a30640 1 -- 172.21.15.87:0/2706010276 wait complete. 2024-09-17T07:22:00.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.664+0000 7f16b8a30640 1 Processor -- start 2024-09-17T07:22:00.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.664+0000 7f16b8a30640 1 -- start start 2024-09-17T07:22:00.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.665+0000 7f16b8a30640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f16b40fb450 0x7f16b410fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:22:00.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.665+0000 7f16b8a30640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f16b40fc720 0x7f16b4112270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:22:00.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.665+0000 7f16b8a30640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16b4066780 con 0x7f16b40fb450 2024-09-17T07:22:00.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.665+0000 7f16b8a30640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16b40668f0 con 0x7f16b40fc720 2024-09-17T07:22:00.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.665+0000 7f16b259c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f16b40fb450 0x7f16b410fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:22:00.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.665+0000 7f16b259c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f16b40fb450 0x7f16b410fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:43814/0 (socket says 172.21.15.87:43814) 2024-09-17T07:22:00.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.665+0000 7f16b259c640 1 -- 172.21.15.87:0/414968622 learned_addr learned my addr 172.21.15.87:0/414968622 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:22:00.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.665+0000 7f16b1d9b640 1 --2- 172.21.15.87:0/414968622 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f16b40fc720 0x7f16b4112270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:22:00.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.665+0000 7f16b259c640 1 -- 172.21.15.87:0/414968622 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f16b40fc720 msgr2=0x7f16b4112270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:22:00.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.665+0000 7f16b259c640 1 --2- 172.21.15.87:0/414968622 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f16b40fc720 0x7f16b4112270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:00.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.665+0000 7f16b259c640 1 -- 172.21.15.87:0/414968622 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16a8005040 con 0x7f16b40fb450 2024-09-17T07:22:00.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.665+0000 7f16b259c640 1 --2- 172.21.15.87:0/414968622 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f16b40fb450 0x7f16b410fd20 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f16a4002a50 tx=0x7f16a4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:22:00.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.665+0000 7f16a2ffd640 1 -- 172.21.15.87:0/414968622 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16a4007c30 con 0x7f16b40fb450 2024-09-17T07:22:00.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.665+0000 7f16a2ffd640 1 -- 172.21.15.87:0/414968622 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f16a400f040 con 0x7f16b40fb450 2024-09-17T07:22:00.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.665+0000 7f16a2ffd640 1 -- 172.21.15.87:0/414968622 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16a400da30 con 0x7f16b40fb450 2024-09-17T07:22:00.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.665+0000 7f16b8a30640 1 -- 172.21.15.87:0/414968622 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16b41127b0 con 0x7f16b40fb450 2024-09-17T07:22:00.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.665+0000 7f16b8a30640 1 -- 172.21.15.87:0/414968622 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16b4112d00 con 0x7f16b40fb450 2024-09-17T07:22:00.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.666+0000 7f16b8a30640 1 -- 172.21.15.87:0/414968622 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16b404b720 con 0x7f16b40fb450 2024-09-17T07:22:00.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.667+0000 7f16a2ffd640 1 -- 172.21.15.87:0/414968622 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 37) v1 ==== 90896+0+0 (secure 0 0 0) 0x7f16a400db90 con 0x7f16b40fb450 2024-09-17T07:22:00.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.667+0000 7f16a2ffd640 1 --2- 172.21.15.87:0/414968622 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f169c06cc20 0x7f169c06f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:22:00.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.667+0000 7f16a2ffd640 1 -- 172.21.15.87:0/414968622 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f16a408c030 con 0x7f16b40fb450 2024-09-17T07:22:00.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.667+0000 7f16b1d9b640 1 --2- 172.21.15.87:0/414968622 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f169c06cc20 0x7f169c06f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:22:00.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.668+0000 7f16b1d9b640 1 --2- 172.21.15.87:0/414968622 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f169c06cc20 0x7f169c06f0d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f16a8000c00 tx=0x7f16a8035040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:22:00.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.671+0000 7f16a2ffd640 1 -- 172.21.15.87:0/414968622 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f16a4055f00 con 0x7f16b40fb450 2024-09-17T07:22:00.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.907+0000 7f16b8a30640 1 -- 172.21.15.87:0/414968622 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f16b4105bf0 con 0x7f16b40fb450 2024-09-17T07:22:00.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.907+0000 7f16a2ffd640 1 -- 172.21.15.87:0/414968622 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+850 (secure 0 0 0) 0x7f16a4059520 con 0x7f16b40fb450 2024-09-17T07:22:00.908 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T07:22:00.909 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": { 2024-09-17T07:22:00.909 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 1, 2024-09-17T07:22:00.909 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 1 2024-09-17T07:22:00.909 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:22:00.909 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr": { 2024-09-17T07:22:00.909 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 2 2024-09-17T07:22:00.909 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:22:00.909 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": { 2024-09-17T07:22:00.909 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 6 2024-09-17T07:22:00.909 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:22:00.909 INFO:teuthology.orchestra.run.smithi087.stdout: "mds": { 2024-09-17T07:22:00.909 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 4 2024-09-17T07:22:00.910 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:22:00.910 INFO:teuthology.orchestra.run.smithi087.stdout: "overall": { 2024-09-17T07:22:00.910 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 11, 2024-09-17T07:22:00.910 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 3 2024-09-17T07:22:00.910 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T07:22:00.910 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T07:22:00.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.911+0000 7f16b8a30640 1 -- 172.21.15.87:0/414968622 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f169c06cc20 msgr2=0x7f169c06f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:22:00.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.911+0000 7f16b8a30640 1 --2- 172.21.15.87:0/414968622 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f169c06cc20 0x7f169c06f0d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f16a8000c00 tx=0x7f16a8035040 comp rx=0 tx=0).stop 2024-09-17T07:22:00.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.911+0000 7f16b8a30640 1 -- 172.21.15.87:0/414968622 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f16b40fb450 msgr2=0x7f16b410fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:22:00.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.911+0000 7f16b8a30640 1 --2- 172.21.15.87:0/414968622 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f16b40fb450 0x7f16b410fd20 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f16a4002a50 tx=0x7f16a4004600 comp rx=0 tx=0).stop 2024-09-17T07:22:00.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.911+0000 7f16b8a30640 1 -- 172.21.15.87:0/414968622 shutdown_connections 2024-09-17T07:22:00.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.911+0000 7f16b8a30640 1 --2- 172.21.15.87:0/414968622 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f169c06cc20 0x7f169c06f0d0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:00.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.911+0000 7f16b8a30640 1 --2- 172.21.15.87:0/414968622 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f16b40fc720 0x7f16b4112270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:00.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.911+0000 7f16b8a30640 1 --2- 172.21.15.87:0/414968622 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f16b40fb450 0x7f16b410fd20 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:00.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.911+0000 7f16b8a30640 1 -- 172.21.15.87:0/414968622 >> 172.21.15.87:0/414968622 conn(0x7f16b40f6c10 msgr2=0x7f16b40ffab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:22:00.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.911+0000 7f16b8a30640 1 -- 172.21.15.87:0/414968622 shutdown_connections 2024-09-17T07:22:00.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.911+0000 7f16b8a30640 1 -- 172.21.15.87:0/414968622 wait complete. 2024-09-17T07:22:00.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.995+0000 7f43322c3640 1 -- 172.21.15.87:0/145954514 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f432c0fc700 msgr2=0x7f432c0fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:22:00.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.995+0000 7f43322c3640 1 --2- 172.21.15.87:0/145954514 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f432c0fc700 0x7f432c0fcb70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f43200048d0 tx=0x7f4320009da0 comp rx=0 tx=0).stop 2024-09-17T07:22:00.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.995+0000 7f43322c3640 1 -- 172.21.15.87:0/145954514 shutdown_connections 2024-09-17T07:22:00.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.995+0000 7f43322c3640 1 --2- 172.21.15.87:0/145954514 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f432c0fc700 0x7f432c0fcb70 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:00.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.995+0000 7f43322c3640 1 --2- 172.21.15.87:0/145954514 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f432c0fb430 0x7f432c0fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:00.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.995+0000 7f43322c3640 1 -- 172.21.15.87:0/145954514 >> 172.21.15.87:0/145954514 conn(0x7f432c0f6c10 msgr2=0x7f432c0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:22:00.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.996+0000 7f43322c3640 1 -- 172.21.15.87:0/145954514 shutdown_connections 2024-09-17T07:22:00.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.996+0000 7f43322c3640 1 -- 172.21.15.87:0/145954514 wait complete. 2024-09-17T07:22:00.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.996+0000 7f43322c3640 1 Processor -- start 2024-09-17T07:22:00.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.996+0000 7f43322c3640 1 -- start start 2024-09-17T07:22:00.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.997+0000 7f43322c3640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f432c0fb430 0x7f432c065b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:22:00.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.997+0000 7f43322c3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f432c0fc700 0x7f432c111d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:22:00.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.997+0000 7f43322c3640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f432c112360 con 0x7f432c0fc700 2024-09-17T07:22:00.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.997+0000 7f43322c3640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f432c1124a0 con 0x7f432c0fb430 2024-09-17T07:22:00.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.997+0000 7f432b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f432c0fc700 0x7f432c111d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:22:00.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.997+0000 7f432bfff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f432c0fb430 0x7f432c065b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:22:00.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.997+0000 7f432bfff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f432c0fb430 0x7f432c065b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.87:36788/0 (socket says 172.21.15.87:36788) 2024-09-17T07:22:00.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.997+0000 7f432b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f432c0fc700 0x7f432c111d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:43842/0 (socket says 172.21.15.87:43842) 2024-09-17T07:22:01.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.997+0000 7f432bfff640 1 -- 172.21.15.87:0/1763479578 learned_addr learned my addr 172.21.15.87:0/1763479578 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:22:01.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.997+0000 7f432bfff640 1 -- 172.21.15.87:0/1763479578 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f432c0fc700 msgr2=0x7f432c111d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:22:01.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.997+0000 7f432bfff640 1 --2- 172.21.15.87:0/1763479578 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f432c0fc700 0x7f432c111d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:01.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.997+0000 7f432bfff640 1 -- 172.21.15.87:0/1763479578 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4320005040 con 0x7f432c0fb430 2024-09-17T07:22:01.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.997+0000 7f432bfff640 1 --2- 172.21.15.87:0/1763479578 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f432c0fb430 0x7f432c065b50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f431c00eb70 tx=0x7f431c00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:22:01.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.997+0000 7f4328ff9640 1 -- 172.21.15.87:0/1763479578 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f431c007c30 con 0x7f432c0fb430 2024-09-17T07:22:01.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.997+0000 7f4328ff9640 1 -- 172.21.15.87:0/1763479578 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f431c00f040 con 0x7f432c0fb430 2024-09-17T07:22:01.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.997+0000 7f43322c3640 1 -- 172.21.15.87:0/1763479578 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f432c112720 con 0x7f432c0fb430 2024-09-17T07:22:01.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.998+0000 7f4328ff9640 1 -- 172.21.15.87:0/1763479578 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f431c009420 con 0x7f432c0fb430 2024-09-17T07:22:01.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.998+0000 7f43322c3640 1 -- 172.21.15.87:0/1763479578 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f432c112cc0 con 0x7f432c0fb430 2024-09-17T07:22:01.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.999+0000 7f43322c3640 1 -- 172.21.15.87:0/1763479578 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f432c04b720 con 0x7f432c0fb430 2024-09-17T07:22:01.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.999+0000 7f4328ff9640 1 -- 172.21.15.87:0/1763479578 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 37) v1 ==== 90896+0+0 (secure 0 0 0) 0x7f431c009690 con 0x7f432c0fb430 2024-09-17T07:22:01.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:00.999+0000 7f4328ff9640 1 --2- 172.21.15.87:0/1763479578 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f431406cc20 0x7f431406f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:22:01.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.000+0000 7f432b7fe640 1 --2- 172.21.15.87:0/1763479578 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f431406cc20 0x7f431406f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:22:01.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.000+0000 7f4328ff9640 1 -- 172.21.15.87:0/1763479578 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f431c08bdc0 con 0x7f432c0fb430 2024-09-17T07:22:01.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.000+0000 7f432b7fe640 1 --2- 172.21.15.87:0/1763479578 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f431406cc20 0x7f431406f0d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f4320007ac0 tx=0x7f4320035040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:22:01.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.004+0000 7f4328ff9640 1 -- 172.21.15.87:0/1763479578 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f431c055d40 con 0x7f432c0fb430 2024-09-17T07:22:01.158 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:01 smithi087 ceph-mon[90982]: from='client.34128 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:22:01.158 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:01 smithi087 ceph-mon[90982]: pgmap v4: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-17T07:22:01.158 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:01 smithi087 ceph-mon[90982]: mgrmap e37: smithi087.vuvjer(active, since 2s), standbys: smithi139.tuqnpn 2024-09-17T07:22:01.158 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:01 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/414968622' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:22:01.159 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:01 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:01.159 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:01 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:01.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.212+0000 7f43322c3640 1 -- 172.21.15.87:0/1763479578 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f432c02aa40 con 0x7f432c0fb430 2024-09-17T07:22:01.213 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.212+0000 7f4328ff9640 1 -- 172.21.15.87:0/1763479578 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1867 (secure 0 0 0) 0x7f431c059360 con 0x7f432c0fb430 2024-09-17T07:22:01.214 INFO:teuthology.orchestra.run.smithi087.stdout:e21 2024-09-17T07:22:01.214 INFO:teuthology.orchestra.run.smithi087.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T07:22:01.214 INFO:teuthology.orchestra.run.smithi087.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T07:22:01.214 INFO:teuthology.orchestra.run.smithi087.stdout:legacy client fscid: 1 2024-09-17T07:22:01.214 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:22:01.214 INFO:teuthology.orchestra.run.smithi087.stdout:Filesystem 'cephfs' (1) 2024-09-17T07:22:01.214 INFO:teuthology.orchestra.run.smithi087.stdout:fs_name cephfs 2024-09-17T07:22:01.214 INFO:teuthology.orchestra.run.smithi087.stdout:epoch 21 2024-09-17T07:22:01.214 INFO:teuthology.orchestra.run.smithi087.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T07:22:01.214 INFO:teuthology.orchestra.run.smithi087.stdout:created 2024-09-17T07:17:15.368053+0000 2024-09-17T07:22:01.214 INFO:teuthology.orchestra.run.smithi087.stdout:modified 2024-09-17T07:20:37.142055+0000 2024-09-17T07:22:01.214 INFO:teuthology.orchestra.run.smithi087.stdout:tableserver 0 2024-09-17T07:22:01.214 INFO:teuthology.orchestra.run.smithi087.stdout:root 0 2024-09-17T07:22:01.215 INFO:teuthology.orchestra.run.smithi087.stdout:session_timeout 60 2024-09-17T07:22:01.215 INFO:teuthology.orchestra.run.smithi087.stdout:session_autoclose 300 2024-09-17T07:22:01.215 INFO:teuthology.orchestra.run.smithi087.stdout:max_file_size 1099511627776 2024-09-17T07:22:01.215 INFO:teuthology.orchestra.run.smithi087.stdout:required_client_features {} 2024-09-17T07:22:01.215 INFO:teuthology.orchestra.run.smithi087.stdout:last_failure 0 2024-09-17T07:22:01.215 INFO:teuthology.orchestra.run.smithi087.stdout:last_failure_osd_epoch 44 2024-09-17T07:22:01.215 INFO:teuthology.orchestra.run.smithi087.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T07:22:01.215 INFO:teuthology.orchestra.run.smithi087.stdout:max_mds 2 2024-09-17T07:22:01.215 INFO:teuthology.orchestra.run.smithi087.stdout:in 0,1 2024-09-17T07:22:01.215 INFO:teuthology.orchestra.run.smithi087.stdout:up {0=14478,1=24243} 2024-09-17T07:22:01.215 INFO:teuthology.orchestra.run.smithi087.stdout:failed 2024-09-17T07:22:01.215 INFO:teuthology.orchestra.run.smithi087.stdout:damaged 2024-09-17T07:22:01.215 INFO:teuthology.orchestra.run.smithi087.stdout:stopped 2024-09-17T07:22:01.215 INFO:teuthology.orchestra.run.smithi087.stdout:data_pools [3] 2024-09-17T07:22:01.216 INFO:teuthology.orchestra.run.smithi087.stdout:metadata_pool 2 2024-09-17T07:22:01.216 INFO:teuthology.orchestra.run.smithi087.stdout:inline_data enabled 2024-09-17T07:22:01.216 INFO:teuthology.orchestra.run.smithi087.stdout:balancer 2024-09-17T07:22:01.216 INFO:teuthology.orchestra.run.smithi087.stdout:standby_count_wanted 1 2024-09-17T07:22:01.216 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi087.tjhpcs{0:14478} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.87:6828/2255237099,v1:172.21.15.87:6829/2255237099] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:22:01.216 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi087.vvbzss{0:14490} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.87:6826/4022268353,v1:172.21.15.87:6827/4022268353] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:22:01.216 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi139.gnwonz{1:24243} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.139:6824/3946792151,v1:172.21.15.139:6825/3946792151] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:22:01.216 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi139.ftvinf{1:24253} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.139:6826/3292073323,v1:172.21.15.139:6827/3292073323] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:22:01.216 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:22:01.216 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:22:01.217 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 21 2024-09-17T07:22:01.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.215+0000 7f43322c3640 1 -- 172.21.15.87:0/1763479578 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f431406cc20 msgr2=0x7f431406f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:22:01.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.215+0000 7f43322c3640 1 --2- 172.21.15.87:0/1763479578 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f431406cc20 0x7f431406f0d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f4320007ac0 tx=0x7f4320035040 comp rx=0 tx=0).stop 2024-09-17T07:22:01.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.215+0000 7f43322c3640 1 -- 172.21.15.87:0/1763479578 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f432c0fb430 msgr2=0x7f432c065b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:22:01.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.215+0000 7f43322c3640 1 --2- 172.21.15.87:0/1763479578 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f432c0fb430 0x7f432c065b50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f431c00eb70 tx=0x7f431c00b040 comp rx=0 tx=0).stop 2024-09-17T07:22:01.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.215+0000 7f43322c3640 1 -- 172.21.15.87:0/1763479578 shutdown_connections 2024-09-17T07:22:01.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.215+0000 7f43322c3640 1 --2- 172.21.15.87:0/1763479578 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f432c0fc700 0x7f432c111d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:01.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.215+0000 7f43322c3640 1 --2- 172.21.15.87:0/1763479578 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f431406cc20 0x7f431406f0d0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:01.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.215+0000 7f43322c3640 1 --2- 172.21.15.87:0/1763479578 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f432c0fb430 0x7f432c065b50 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:01.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.215+0000 7f43322c3640 1 -- 172.21.15.87:0/1763479578 >> 172.21.15.87:0/1763479578 conn(0x7f432c0f6c10 msgr2=0x7f432c0ffa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:22:01.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.215+0000 7f43322c3640 1 -- 172.21.15.87:0/1763479578 shutdown_connections 2024-09-17T07:22:01.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.215+0000 7f43322c3640 1 -- 172.21.15.87:0/1763479578 wait complete. 2024-09-17T07:22:01.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.295+0000 7fc48e9c3640 1 -- 172.21.15.87:0/2694763317 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4880fb430 msgr2=0x7fc4880fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:22:01.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.295+0000 7fc48e9c3640 1 --2- 172.21.15.87:0/2694763317 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4880fb430 0x7fc4880fb840 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc4780048d0 tx=0x7fc478009da0 comp rx=0 tx=0).stop 2024-09-17T07:22:01.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.295+0000 7fc48e9c3640 1 -- 172.21.15.87:0/2694763317 shutdown_connections 2024-09-17T07:22:01.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.295+0000 7fc48e9c3640 1 --2- 172.21.15.87:0/2694763317 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc4880fc700 0x7fc4880fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:01.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.295+0000 7fc48e9c3640 1 --2- 172.21.15.87:0/2694763317 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4880fb430 0x7fc4880fb840 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:01.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.295+0000 7fc48e9c3640 1 -- 172.21.15.87:0/2694763317 >> 172.21.15.87:0/2694763317 conn(0x7fc4880f6c10 msgr2=0x7fc4880f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:22:01.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.295+0000 7fc48e9c3640 1 -- 172.21.15.87:0/2694763317 shutdown_connections 2024-09-17T07:22:01.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.295+0000 7fc48e9c3640 1 -- 172.21.15.87:0/2694763317 wait complete. 2024-09-17T07:22:01.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.296+0000 7fc48e9c3640 1 Processor -- start 2024-09-17T07:22:01.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.296+0000 7fc48e9c3640 1 -- start start 2024-09-17T07:22:01.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.296+0000 7fc48e9c3640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc4880fb430 0x7fc4881120c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:22:01.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.296+0000 7fc48e9c3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4880fc700 0x7fc488114610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:22:01.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.296+0000 7fc48e9c3640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc48810db70 con 0x7fc4880fc700 2024-09-17T07:22:01.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.296+0000 7fc48e9c3640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc488065bd0 con 0x7fc4880fb430 2024-09-17T07:22:01.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.296+0000 7fc4877fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4880fc700 0x7fc488114610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:22:01.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.296+0000 7fc4877fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4880fc700 0x7fc488114610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:43856/0 (socket says 172.21.15.87:43856) 2024-09-17T07:22:01.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.296+0000 7fc4877fe640 1 -- 172.21.15.87:0/2248547737 learned_addr learned my addr 172.21.15.87:0/2248547737 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:22:01.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.297+0000 7fc487fff640 1 --2- 172.21.15.87:0/2248547737 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc4880fb430 0x7fc4881120c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:22:01.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.297+0000 7fc4877fe640 1 -- 172.21.15.87:0/2248547737 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc4880fb430 msgr2=0x7fc4881120c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:22:01.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.297+0000 7fc4877fe640 1 --2- 172.21.15.87:0/2248547737 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc4880fb430 0x7fc4881120c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:01.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.297+0000 7fc4877fe640 1 -- 172.21.15.87:0/2248547737 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc478005040 con 0x7fc4880fc700 2024-09-17T07:22:01.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.297+0000 7fc4877fe640 1 --2- 172.21.15.87:0/2248547737 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4880fc700 0x7fc488114610 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc47c002a80 tx=0x7fc47c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:22:01.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.297+0000 7fc484ff9640 1 -- 172.21.15.87:0/2248547737 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc47c007c30 con 0x7fc4880fc700 2024-09-17T07:22:01.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.297+0000 7fc484ff9640 1 -- 172.21.15.87:0/2248547737 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fc47c00f040 con 0x7fc4880fc700 2024-09-17T07:22:01.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.297+0000 7fc48e9c3640 1 -- 172.21.15.87:0/2248547737 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc488065eb0 con 0x7fc4880fc700 2024-09-17T07:22:01.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.297+0000 7fc484ff9640 1 -- 172.21.15.87:0/2248547737 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc47c00d9b0 con 0x7fc4880fc700 2024-09-17T07:22:01.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.297+0000 7fc48e9c3640 1 -- 172.21.15.87:0/2248547737 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc488114e90 con 0x7fc4880fc700 2024-09-17T07:22:01.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.298+0000 7fc48e9c3640 1 -- 172.21.15.87:0/2248547737 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc48804b720 con 0x7fc4880fc700 2024-09-17T07:22:01.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.299+0000 7fc484ff9640 1 -- 172.21.15.87:0/2248547737 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 37) v1 ==== 90896+0+0 (secure 0 0 0) 0x7fc47c00dc20 con 0x7fc4880fc700 2024-09-17T07:22:01.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.299+0000 7fc484ff9640 1 --2- 172.21.15.87:0/2248547737 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fc47006cc20 0x7fc47006f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:22:01.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.299+0000 7fc484ff9640 1 -- 172.21.15.87:0/2248547737 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fc47c08bb10 con 0x7fc4880fc700 2024-09-17T07:22:01.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.299+0000 7fc487fff640 1 --2- 172.21.15.87:0/2248547737 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fc47006cc20 0x7fc47006f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:22:01.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.299+0000 7fc487fff640 1 --2- 172.21.15.87:0/2248547737 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fc47006cc20 0x7fc47006f0d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc488065950 tx=0x7fc478035040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:22:01.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.303+0000 7fc484ff9640 1 -- 172.21.15.87:0/2248547737 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc47c055a90 con 0x7fc4880fc700 2024-09-17T07:22:01.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:01 smithi139 ceph-mon[34403]: from='client.34128 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:22:01.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:01 smithi139 ceph-mon[34403]: pgmap v4: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-17T07:22:01.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:01 smithi139 ceph-mon[34403]: mgrmap e37: smithi087.vuvjer(active, since 2s), standbys: smithi139.tuqnpn 2024-09-17T07:22:01.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:01 smithi139 ceph-mon[34403]: from='client.? 172.21.15.87:0/414968622' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:22:01.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:01 smithi139 ceph-mon[34403]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:01.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:01 smithi139 ceph-mon[34403]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:01.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.485+0000 7fc48e9c3640 1 -- 172.21.15.87:0/2248547737 --> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc488101170 con 0x7fc47006cc20 2024-09-17T07:22:01.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.487+0000 7fc484ff9640 1 -- 172.21.15.87:0/2248547737 <== mgr.24529 v2:172.21.15.87:6800/1359413180 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7fc488101170 con 0x7fc47006cc20 2024-09-17T07:22:01.488 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T07:22:01.488 INFO:teuthology.orchestra.run.smithi087.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9", 2024-09-17T07:22:01.488 INFO:teuthology.orchestra.run.smithi087.stdout: "in_progress": true, 2024-09-17T07:22:01.488 INFO:teuthology.orchestra.run.smithi087.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T07:22:01.488 INFO:teuthology.orchestra.run.smithi087.stdout: "services_complete": [ 2024-09-17T07:22:01.488 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr" 2024-09-17T07:22:01.488 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-17T07:22:01.488 INFO:teuthology.orchestra.run.smithi087.stdout: "progress": "2/21 daemons upgraded", 2024-09-17T07:22:01.488 INFO:teuthology.orchestra.run.smithi087.stdout: "message": "", 2024-09-17T07:22:01.489 INFO:teuthology.orchestra.run.smithi087.stdout: "is_paused": false 2024-09-17T07:22:01.489 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T07:22:01.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.489+0000 7fc48e9c3640 1 -- 172.21.15.87:0/2248547737 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fc47006cc20 msgr2=0x7fc47006f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:22:01.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.489+0000 7fc48e9c3640 1 --2- 172.21.15.87:0/2248547737 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fc47006cc20 0x7fc47006f0d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc488065950 tx=0x7fc478035040 comp rx=0 tx=0).stop 2024-09-17T07:22:01.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.489+0000 7fc48e9c3640 1 -- 172.21.15.87:0/2248547737 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4880fc700 msgr2=0x7fc488114610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:22:01.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.489+0000 7fc48e9c3640 1 --2- 172.21.15.87:0/2248547737 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4880fc700 0x7fc488114610 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc47c002a80 tx=0x7fc47c004600 comp rx=0 tx=0).stop 2024-09-17T07:22:01.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.489+0000 7fc48e9c3640 1 -- 172.21.15.87:0/2248547737 shutdown_connections 2024-09-17T07:22:01.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.489+0000 7fc48e9c3640 1 --2- 172.21.15.87:0/2248547737 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4880fc700 0x7fc488114610 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:01.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.489+0000 7fc48e9c3640 1 --2- 172.21.15.87:0/2248547737 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fc47006cc20 0x7fc47006f0d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:01.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.489+0000 7fc48e9c3640 1 --2- 172.21.15.87:0/2248547737 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc4880fb430 0x7fc4881120c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:01.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.489+0000 7fc48e9c3640 1 -- 172.21.15.87:0/2248547737 >> 172.21.15.87:0/2248547737 conn(0x7fc4880f6c10 msgr2=0x7fc4880ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:22:01.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.489+0000 7fc48e9c3640 1 -- 172.21.15.87:0/2248547737 shutdown_connections 2024-09-17T07:22:01.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.489+0000 7fc48e9c3640 1 -- 172.21.15.87:0/2248547737 wait complete. 2024-09-17T07:22:01.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.568+0000 7fede929e640 1 -- 172.21.15.87:0/3991255040 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fede40666d0 msgr2=0x7fede40ff1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:22:01.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.568+0000 7fede929e640 1 --2- 172.21.15.87:0/3991255040 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fede40666d0 0x7fede40ff1a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7feddc0048d0 tx=0x7feddc009da0 comp rx=0 tx=0).stop 2024-09-17T07:22:01.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.568+0000 7fede929e640 1 -- 172.21.15.87:0/3991255040 shutdown_connections 2024-09-17T07:22:01.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.568+0000 7fede929e640 1 --2- 172.21.15.87:0/3991255040 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fede40ff6e0 0x7fede4101ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:01.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.568+0000 7fede929e640 1 --2- 172.21.15.87:0/3991255040 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fede40666d0 0x7fede40ff1a0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:01.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.568+0000 7fede929e640 1 -- 172.21.15.87:0/3991255040 >> 172.21.15.87:0/3991255040 conn(0x7fede40f6c10 msgr2=0x7fede40f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:22:01.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.568+0000 7fede929e640 1 -- 172.21.15.87:0/3991255040 shutdown_connections 2024-09-17T07:22:01.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.568+0000 7fede929e640 1 -- 172.21.15.87:0/3991255040 wait complete. 2024-09-17T07:22:01.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.568+0000 7fede929e640 1 Processor -- start 2024-09-17T07:22:01.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.568+0000 7fede929e640 1 -- start start 2024-09-17T07:22:01.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.569+0000 7fede929e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fede40666d0 0x7fede410f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:22:01.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.569+0000 7fede929e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fede40ff6e0 0x7fede410f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:22:01.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.569+0000 7fede929e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede410fe40 con 0x7fede40666d0 2024-09-17T07:22:01.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.569+0000 7fede929e640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede4110660 con 0x7fede40ff6e0 2024-09-17T07:22:01.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.569+0000 7fede2ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fede40666d0 0x7fede410f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:22:01.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.569+0000 7fede2ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fede40666d0 0x7fede410f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:43880/0 (socket says 172.21.15.87:43880) 2024-09-17T07:22:01.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.569+0000 7fede2ffd640 1 -- 172.21.15.87:0/274170093 learned_addr learned my addr 172.21.15.87:0/274170093 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:22:01.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.569+0000 7fede27fc640 1 --2- 172.21.15.87:0/274170093 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fede40ff6e0 0x7fede410f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:22:01.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.569+0000 7fede2ffd640 1 -- 172.21.15.87:0/274170093 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fede40ff6e0 msgr2=0x7fede410f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:22:01.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.569+0000 7fede2ffd640 1 --2- 172.21.15.87:0/274170093 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fede40ff6e0 0x7fede410f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:01.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.569+0000 7fede2ffd640 1 -- 172.21.15.87:0/274170093 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feddc005040 con 0x7fede40666d0 2024-09-17T07:22:01.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.569+0000 7fede2ffd640 1 --2- 172.21.15.87:0/274170093 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fede40666d0 0x7fede410f2b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7feddc0043d0 tx=0x7feddc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:22:01.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.569+0000 7feddb7fe640 1 -- 172.21.15.87:0/274170093 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feddc038070 con 0x7fede40666d0 2024-09-17T07:22:01.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.569+0000 7fede929e640 1 -- 172.21.15.87:0/274170093 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fede4110890 con 0x7fede40666d0 2024-09-17T07:22:01.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.569+0000 7feddb7fe640 1 -- 172.21.15.87:0/274170093 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7feddc009740 con 0x7fede40666d0 2024-09-17T07:22:01.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.569+0000 7feddb7fe640 1 -- 172.21.15.87:0/274170093 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feddc03d420 con 0x7fede40666d0 2024-09-17T07:22:01.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.570+0000 7fede929e640 1 -- 172.21.15.87:0/274170093 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fede4110db0 con 0x7fede40666d0 2024-09-17T07:22:01.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.571+0000 7fede929e640 1 -- 172.21.15.87:0/274170093 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fede40fa8b0 con 0x7fede40666d0 2024-09-17T07:22:01.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.571+0000 7feddb7fe640 1 -- 172.21.15.87:0/274170093 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 37) v1 ==== 90896+0+0 (secure 0 0 0) 0x7feddc030020 con 0x7fede40666d0 2024-09-17T07:22:01.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.571+0000 7feddb7fe640 1 --2- 172.21.15.87:0/274170093 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fedd006cc20 0x7fedd006f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:22:01.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.571+0000 7feddb7fe640 1 -- 172.21.15.87:0/274170093 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6410+0+0 (secure 0 0 0) 0x7feddc0ac6c0 con 0x7fede40666d0 2024-09-17T07:22:01.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.571+0000 7fede27fc640 1 --2- 172.21.15.87:0/274170093 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fedd006cc20 0x7fedd006f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:22:01.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.572+0000 7fede27fc640 1 --2- 172.21.15.87:0/274170093 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fedd006cc20 0x7fedd006f0d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fede410f060 tx=0x7fedcc00b040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:22:01.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.576+0000 7feddb7fe640 1 -- 172.21.15.87:0/274170093 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7feddc0766a0 con 0x7fede40666d0 2024-09-17T07:22:01.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.819+0000 7fede929e640 1 -- 172.21.15.87:0/274170093 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fede40f8700 con 0x7fede40666d0 2024-09-17T07:22:01.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.820+0000 7feddb7fe640 1 -- 172.21.15.87:0/274170093 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7feddc035050 con 0x7fede40666d0 2024-09-17T07:22:01.821 INFO:teuthology.orchestra.run.smithi087.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T07:22:01.821 INFO:teuthology.orchestra.run.smithi087.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T07:22:01.821 INFO:teuthology.orchestra.run.smithi087.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T07:22:01.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.821+0000 7fede929e640 1 -- 172.21.15.87:0/274170093 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fedd006cc20 msgr2=0x7fedd006f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:22:01.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.821+0000 7fede929e640 1 --2- 172.21.15.87:0/274170093 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fedd006cc20 0x7fedd006f0d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fede410f060 tx=0x7fedcc00b040 comp rx=0 tx=0).stop 2024-09-17T07:22:01.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.821+0000 7fede929e640 1 -- 172.21.15.87:0/274170093 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fede40666d0 msgr2=0x7fede410f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:22:01.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.821+0000 7fede929e640 1 --2- 172.21.15.87:0/274170093 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fede40666d0 0x7fede410f2b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7feddc0043d0 tx=0x7feddc009da0 comp rx=0 tx=0).stop 2024-09-17T07:22:01.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.821+0000 7fede929e640 1 -- 172.21.15.87:0/274170093 shutdown_connections 2024-09-17T07:22:01.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.821+0000 7fede929e640 1 --2- 172.21.15.87:0/274170093 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fedd006cc20 0x7fedd006f0d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:01.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.821+0000 7fede929e640 1 --2- 172.21.15.87:0/274170093 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fede40ff6e0 0x7fede410f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:01.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.821+0000 7fede929e640 1 --2- 172.21.15.87:0/274170093 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fede40666d0 0x7fede410f2b0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:01.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.821+0000 7fede929e640 1 -- 172.21.15.87:0/274170093 >> 172.21.15.87:0/274170093 conn(0x7fede40f6c10 msgr2=0x7fede40fb440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:22:01.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.822+0000 7fede929e640 1 -- 172.21.15.87:0/274170093 shutdown_connections 2024-09-17T07:22:01.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:01.822+0000 7fede929e640 1 -- 172.21.15.87:0/274170093 wait complete. 2024-09-17T07:22:02.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:02 smithi139 ceph-mon[34403]: from='client.24559 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:22:02.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:02 smithi139 ceph-mon[34403]: from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:22:02.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:02 smithi139 ceph-mon[34403]: from='client.? 172.21.15.87:0/1763479578' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T07:22:02.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:02 smithi139 ceph-mon[34403]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:02.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:02 smithi139 ceph-mon[34403]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:02.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:02 smithi139 ceph-mon[34403]: from='client.? 172.21.15.87:0/274170093' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T07:22:02.121 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:02 smithi087 ceph-mon[90982]: from='client.24559 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:22:02.121 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:02 smithi087 ceph-mon[90982]: from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:22:02.122 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:02 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/1763479578' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T07:22:02.122 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:02 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:02.122 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:02 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:02.122 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:02 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/274170093' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T07:22:03.223 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:03 smithi087 ceph-mon[90982]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:22:03.223 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:03 smithi087 ceph-mon[90982]: pgmap v5: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-17T07:22:03.223 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:03 smithi087 ceph-mon[90982]: mgrmap e38: smithi087.vuvjer(active, since 4s), standbys: smithi139.tuqnpn 2024-09-17T07:22:03.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:03 smithi139 ceph-mon[34403]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:22:03.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:03 smithi139 ceph-mon[34403]: pgmap v5: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-17T07:22:03.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:03 smithi139 ceph-mon[34403]: mgrmap e38: smithi087.vuvjer(active, since 4s), standbys: smithi139.tuqnpn 2024-09-17T07:22:04.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:04 smithi139 ceph-mon[34403]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:04.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:04 smithi139 ceph-mon[34403]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:04.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:04 smithi139 ceph-mon[34403]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:04.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:04 smithi139 ceph-mon[34403]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:04.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:04 smithi139 ceph-mon[34403]: pgmap v6: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-17T07:22:04.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:04 smithi139 ceph-mon[34403]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:04.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:04 smithi139 ceph-mon[34403]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:04.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:04 smithi139 ceph-mon[34403]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:22:04.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:04 smithi139 ceph-mon[34403]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:22:04.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:04 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:04.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:04 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:04.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:04 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:04.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:04 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:04.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:04 smithi087 ceph-mon[90982]: pgmap v6: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-17T07:22:04.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:04 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:04.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:04 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:04.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:04 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:22:04.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:04 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:22:06.589 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:06 smithi139 ceph-mon[34403]: Updating smithi087:/etc/ceph/ceph.conf 2024-09-17T07:22:06.589 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:06 smithi139 ceph-mon[34403]: Updating smithi139:/etc/ceph/ceph.conf 2024-09-17T07:22:06.590 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:06 smithi139 ceph-mon[34403]: Updating smithi087:/var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T07:22:06.590 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:06 smithi139 ceph-mon[34403]: Updating smithi139:/var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T07:22:06.590 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:06 smithi139 ceph-mon[34403]: Updating smithi087:/etc/ceph/ceph.client.admin.keyring 2024-09-17T07:22:06.590 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:06 smithi139 ceph-mon[34403]: Updating smithi139:/etc/ceph/ceph.client.admin.keyring 2024-09-17T07:22:06.590 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:06 smithi139 ceph-mon[34403]: Updating smithi087:/var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T07:22:06.590 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:06 smithi139 ceph-mon[34403]: Updating smithi139:/var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T07:22:06.590 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:06 smithi139 ceph-mon[34403]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:06.590 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:06 smithi139 ceph-mon[34403]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:06.590 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:06 smithi139 ceph-mon[34403]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:06.590 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:06 smithi139 ceph-mon[34403]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:06.590 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:06 smithi139 ceph-mon[34403]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:06.590 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:06 smithi139 ceph-mon[34403]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:22:06.591 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:06 smithi139 ceph-mon[34403]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:22:06.591 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:06 smithi139 ceph-mon[34403]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-17T07:22:06.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:06 smithi087 ceph-mon[90982]: Updating smithi087:/etc/ceph/ceph.conf 2024-09-17T07:22:06.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:06 smithi087 ceph-mon[90982]: Updating smithi139:/etc/ceph/ceph.conf 2024-09-17T07:22:06.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:06 smithi087 ceph-mon[90982]: Updating smithi087:/var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T07:22:06.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:06 smithi087 ceph-mon[90982]: Updating smithi139:/var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T07:22:06.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:06 smithi087 ceph-mon[90982]: Updating smithi087:/etc/ceph/ceph.client.admin.keyring 2024-09-17T07:22:06.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:06 smithi087 ceph-mon[90982]: Updating smithi139:/etc/ceph/ceph.client.admin.keyring 2024-09-17T07:22:06.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:06 smithi087 ceph-mon[90982]: Updating smithi087:/var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T07:22:06.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:06 smithi087 ceph-mon[90982]: Updating smithi139:/var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T07:22:06.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:06 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:06.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:06 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:06.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:06 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:06.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:06 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:06.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:06 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:06.678 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:06 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:22:06.678 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:06 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:22:06.678 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:06 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-17T07:22:07.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:07 smithi139 ceph-mon[34403]: pgmap v7: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 0 B/s wr, 19 op/s 2024-09-17T07:22:07.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:07 smithi139 ceph-mon[34403]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:07.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:07 smithi139 ceph-mon[34403]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T07:22:07.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:07 smithi139 ceph-mon[34403]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T07:22:07.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:07 smithi139 ceph-mon[34403]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:22:07.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:07 smithi087 ceph-mon[90982]: pgmap v7: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 0 B/s wr, 19 op/s 2024-09-17T07:22:07.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:07 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:07.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:07 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T07:22:07.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:07 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T07:22:07.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:07 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:22:08.250 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:08 smithi139 systemd[1]: Stopping Ceph mon.smithi139 for d5dbf8d6-74c3-11ef-bceb-c7b262605968... 2024-09-17T07:22:08.615 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:08 smithi139 ceph-mon[34403]: Upgrade: Updating mon.smithi139 2024-09-17T07:22:08.615 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:08 smithi139 ceph-mon[34403]: Deploying daemon mon.smithi139 on smithi139 2024-09-17T07:22:08.615 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:08 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-mon-smithi139[34362]: 2024-09-17T07:22:08.440+0000 7f927b279640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi139 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T07:22:08.615 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:08 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-mon-smithi139[34362]: 2024-09-17T07:22:08.440+0000 7f927b279640 -1 mon.smithi139@1(peon) e2 *** Got Signal Terminated *** 2024-09-17T07:22:08.659 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:08 smithi087 ceph-mon[90982]: Upgrade: Updating mon.smithi139 2024-09-17T07:22:08.659 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:08 smithi087 ceph-mon[90982]: Deploying daemon mon.smithi139 on smithi139 2024-09-17T07:22:08.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:08 smithi139 podman[79713]: 2024-09-17 07:22:08.615145939 +0000 UTC m=+0.298420401 container died a9a2552dc411d943252cc85b92e3cf4af5df505407d821fe8b75b08639893a5c (image=quay.ceph.io/ceph-ci/ceph@sha256:c5428a59091f5674ce6e26540d9db0f28844a507e2a324b8305a00f1687ce028, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-mon-smithi139, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=quincy-4a70413, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-17T07:22:09.259 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:08 smithi139 podman[79713]: 2024-09-17 07:22:08.982955931 +0000 UTC m=+0.666230395 container cleanup a9a2552dc411d943252cc85b92e3cf4af5df505407d821fe8b75b08639893a5c (image=quay.ceph.io/ceph-ci/ceph@sha256:c5428a59091f5674ce6e26540d9db0f28844a507e2a324b8305a00f1687ce028, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-mon-smithi139, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=quincy-4a70413, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-17T07:22:09.259 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:08 smithi139 bash[79713]: ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-mon-smithi139 2024-09-17T07:22:09.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:09 smithi139 podman[79725]: 2024-09-17 07:22:09.259014614 +0000 UTC m=+0.640595411 container remove a9a2552dc411d943252cc85b92e3cf4af5df505407d821fe8b75b08639893a5c (image=quay.ceph.io/ceph-ci/ceph@sha256:c5428a59091f5674ce6e26540d9db0f28844a507e2a324b8305a00f1687ce028, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-mon-smithi139, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=quincy-4a70413, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T07:22:09.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:09 smithi139 systemd[1]: ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968@mon.smithi139.service: Deactivated successfully. 2024-09-17T07:22:09.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:09 smithi139 systemd[1]: Stopped Ceph mon.smithi139 for d5dbf8d6-74c3-11ef-bceb-c7b262605968. 2024-09-17T07:22:09.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:09 smithi139 systemd[1]: ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968@mon.smithi139.service: Consumed 5.465s CPU time. 2024-09-17T07:22:09.982 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:09 smithi139 systemd[1]: Starting Ceph mon.smithi139 for d5dbf8d6-74c3-11ef-bceb-c7b262605968... 2024-09-17T07:22:09.982 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:09 smithi139 podman[79853]: 2024-09-17 07:22:09.734893074 +0000 UTC m=+0.015612041 image pull 980a0bfcd684674f25c08d857ad8de3b1c8ae738870529edbf9aa463832c8d89 quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9 2024-09-17T07:22:09.982 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:09 smithi139 podman[79853]: 2024-09-17 07:22:09.852507583 +0000 UTC m=+0.133226537 container create 0b159495af0ffd6af32ae2c34c8c0c4d57d509e725c388b5ecbfd46ed205690a (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-mon-smithi139, ceph=True, maintainer=Guillaume Abrioux , RELEASE=reef-19e2a2b, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-17T07:22:10.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 podman[79853]: 2024-09-17 07:22:10.0798064 +0000 UTC m=+0.360525358 container init 0b159495af0ffd6af32ae2c34c8c0c4d57d509e725c388b5ecbfd46ed205690a (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-mon-smithi139, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, RELEASE=reef-19e2a2b, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-17T07:22:10.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 podman[79853]: 2024-09-17 07:22:10.083260424 +0000 UTC m=+0.363979379 container start 0b159495af0ffd6af32ae2c34c8c0c4d57d509e725c388b5ecbfd46ed205690a (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-mon-smithi139, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=reef-19e2a2b, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-17T07:22:10.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: set uid:gid to 167:167 (ceph:ceph) 2024-09-17T07:22:10.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable), process ceph-mon, pid 2 2024-09-17T07:22:10.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: pidfile_write: ignore empty --pid-file 2024-09-17T07:22:10.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: load: jerasure load: lrc 2024-09-17T07:22:10.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: RocksDB version: 7.9.2 2024-09-17T07:22:10.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Git sha 0 2024-09-17T07:22:10.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Compile date 2024-09-16 15:15:13 2024-09-17T07:22:10.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: DB SUMMARY 2024-09-17T07:22:10.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: DB Session ID: QVEJQTS3QJCV954HX1P1 2024-09-17T07:22:10.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: CURRENT file: CURRENT 2024-09-17T07:22:10.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: IDENTITY file: IDENTITY 2024-09-17T07:22:10.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: MANIFEST file: MANIFEST-000009 size: 895 Bytes 2024-09-17T07:22:10.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi139/store.db dir, Total Num: 1, files: 000024.sst 2024-09-17T07:22:10.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi139/store.db: 000022.log size: 5034633 ; 2024-09-17T07:22:10.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.error_if_exists: 0 2024-09-17T07:22:10.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.create_if_missing: 0 2024-09-17T07:22:10.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.paranoid_checks: 1 2024-09-17T07:22:10.369 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-17T07:22:10.369 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-17T07:22:10.369 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-17T07:22:10.369 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.env: 0x55ddea7b9bc0 2024-09-17T07:22:10.369 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.fs: PosixFileSystem 2024-09-17T07:22:10.369 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.info_log: 0x55ddeba94dc0 2024-09-17T07:22:10.369 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.max_file_opening_threads: 16 2024-09-17T07:22:10.369 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.statistics: (nil) 2024-09-17T07:22:10.369 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.use_fsync: 0 2024-09-17T07:22:10.369 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.max_log_file_size: 0 2024-09-17T07:22:10.369 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-17T07:22:10.369 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-17T07:22:10.369 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.keep_log_file_num: 1000 2024-09-17T07:22:10.369 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.recycle_log_file_num: 0 2024-09-17T07:22:10.370 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.allow_fallocate: 1 2024-09-17T07:22:10.370 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.allow_mmap_reads: 0 2024-09-17T07:22:10.370 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.allow_mmap_writes: 0 2024-09-17T07:22:10.370 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.use_direct_reads: 0 2024-09-17T07:22:10.370 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-17T07:22:10.370 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.create_missing_column_families: 0 2024-09-17T07:22:10.370 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.db_log_dir: 2024-09-17T07:22:10.370 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.wal_dir: 2024-09-17T07:22:10.370 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-17T07:22:10.370 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-17T07:22:10.370 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-17T07:22:10.370 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-17T07:22:10.370 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-17T07:22:10.370 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-17T07:22:10.370 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.advise_random_on_open: 1 2024-09-17T07:22:10.371 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.db_write_buffer_size: 0 2024-09-17T07:22:10.371 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.write_buffer_manager: 0x55ddebaa2320 2024-09-17T07:22:10.371 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-17T07:22:10.371 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-17T07:22:10.371 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-17T07:22:10.371 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.rate_limiter: (nil) 2024-09-17T07:22:10.371 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-17T07:22:10.371 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.wal_recovery_mode: 2 2024-09-17T07:22:10.371 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.enable_thread_tracking: 0 2024-09-17T07:22:10.371 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.enable_pipelined_write: 0 2024-09-17T07:22:10.371 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.unordered_write: 0 2024-09-17T07:22:10.371 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-17T07:22:10.371 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-17T07:22:10.371 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-17T07:22:10.372 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-17T07:22:10.372 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.row_cache: None 2024-09-17T07:22:10.372 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.wal_filter: None 2024-09-17T07:22:10.373 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-17T07:22:10.373 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.allow_ingest_behind: 0 2024-09-17T07:22:10.373 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.two_write_queues: 0 2024-09-17T07:22:10.373 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.manual_wal_flush: 0 2024-09-17T07:22:10.373 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.wal_compression: 0 2024-09-17T07:22:10.373 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.atomic_flush: 0 2024-09-17T07:22:10.373 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-17T07:22:10.374 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-17T07:22:10.374 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-17T07:22:10.374 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.log_readahead_size: 0 2024-09-17T07:22:10.374 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-17T07:22:10.374 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.best_efforts_recovery: 0 2024-09-17T07:22:10.374 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-17T07:22:10.374 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-17T07:22:10.374 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.allow_data_in_errors: 0 2024-09-17T07:22:10.374 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.db_host_id: __hostname__ 2024-09-17T07:22:10.374 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-17T07:22:10.374 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.max_background_jobs: 2 2024-09-17T07:22:10.374 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.max_background_compactions: -1 2024-09-17T07:22:10.374 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.max_subcompactions: 1 2024-09-17T07:22:10.374 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-17T07:22:10.375 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-17T07:22:10.375 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-17T07:22:10.375 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.max_total_wal_size: 0 2024-09-17T07:22:10.375 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-17T07:22:10.375 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-17T07:22:10.375 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-17T07:22:10.375 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-17T07:22:10.375 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.max_open_files: -1 2024-09-17T07:22:10.375 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.bytes_per_sync: 0 2024-09-17T07:22:10.375 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-17T07:22:10.375 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-17T07:22:10.375 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.compaction_readahead_size: 0 2024-09-17T07:22:10.375 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.max_background_flushes: -1 2024-09-17T07:22:10.375 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Compression algorithms supported: 2024-09-17T07:22:10.376 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: kZSTD supported: 0 2024-09-17T07:22:10.376 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: kXpressCompression supported: 0 2024-09-17T07:22:10.376 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: kBZip2Compression supported: 0 2024-09-17T07:22:10.376 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-17T07:22:10.376 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: kLZ4Compression supported: 1 2024-09-17T07:22:10.376 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: kZlibCompression supported: 1 2024-09-17T07:22:10.376 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: kLZ4HCCompression supported: 1 2024-09-17T07:22:10.376 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: kSnappyCompression supported: 1 2024-09-17T07:22:10.376 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-17T07:22:10.376 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-17T07:22:10.376 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi139/store.db/MANIFEST-000009 2024-09-17T07:22:10.376 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-17T07:22:10.376 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-17T07:22:10.376 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.merge_operator: 2024-09-17T07:22:10.377 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.compaction_filter: None 2024-09-17T07:22:10.377 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.compaction_filter_factory: None 2024-09-17T07:22:10.377 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.sst_partitioner_factory: None 2024-09-17T07:22:10.377 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-17T07:22:10.377 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-17T07:22:10.377 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55ddeba94a20) 2024-09-17T07:22:10.377 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: cache_index_and_filter_blocks: 1 2024-09-17T07:22:10.377 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-17T07:22:10.377 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-17T07:22:10.377 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: pin_top_level_index_and_filter: 1 2024-09-17T07:22:10.377 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: index_type: 0 2024-09-17T07:22:10.377 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: data_block_index_type: 0 2024-09-17T07:22:10.377 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: index_shortening: 1 2024-09-17T07:22:10.378 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-17T07:22:10.378 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: checksum: 4 2024-09-17T07:22:10.378 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: no_block_cache: 0 2024-09-17T07:22:10.378 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: block_cache: 0x55ddeba891f0 2024-09-17T07:22:10.378 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: block_cache_name: BinnedLRUCache 2024-09-17T07:22:10.378 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: block_cache_options: 2024-09-17T07:22:10.378 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: capacity : 536870912 2024-09-17T07:22:10.378 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: num_shard_bits : 4 2024-09-17T07:22:10.378 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: strict_capacity_limit : 0 2024-09-17T07:22:10.378 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: high_pri_pool_ratio: 0.000 2024-09-17T07:22:10.378 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: block_cache_compressed: (nil) 2024-09-17T07:22:10.378 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: persistent_cache: (nil) 2024-09-17T07:22:10.378 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: block_size: 4096 2024-09-17T07:22:10.378 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: block_size_deviation: 10 2024-09-17T07:22:10.379 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: block_restart_interval: 16 2024-09-17T07:22:10.379 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: index_block_restart_interval: 1 2024-09-17T07:22:10.379 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: metadata_block_size: 4096 2024-09-17T07:22:10.379 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: partition_filters: 0 2024-09-17T07:22:10.379 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: use_delta_encoding: 1 2024-09-17T07:22:10.379 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: filter_policy: bloomfilter 2024-09-17T07:22:10.379 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: whole_key_filtering: 1 2024-09-17T07:22:10.379 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: verify_compression: 0 2024-09-17T07:22:10.379 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: read_amp_bytes_per_bit: 0 2024-09-17T07:22:10.379 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: format_version: 5 2024-09-17T07:22:10.379 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: enable_index_compression: 1 2024-09-17T07:22:10.379 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: block_align: 0 2024-09-17T07:22:10.379 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: max_auto_readahead_size: 262144 2024-09-17T07:22:10.379 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: prepopulate_block_cache: 0 2024-09-17T07:22:10.380 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: initial_auto_readahead_size: 8192 2024-09-17T07:22:10.380 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: num_file_reads_for_auto_readahead: 2 2024-09-17T07:22:10.380 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.write_buffer_size: 33554432 2024-09-17T07:22:10.380 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.max_write_buffer_number: 2 2024-09-17T07:22:10.380 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.compression: NoCompression 2024-09-17T07:22:10.380 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.bottommost_compression: Disabled 2024-09-17T07:22:10.380 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.prefix_extractor: nullptr 2024-09-17T07:22:10.380 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-17T07:22:10.380 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.num_levels: 7 2024-09-17T07:22:10.380 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-17T07:22:10.380 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-17T07:22:10.380 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-17T07:22:10.380 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-17T07:22:10.381 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-17T07:22:10.381 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-17T07:22:10.381 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-17T07:22:10.381 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-17T07:22:10.381 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-17T07:22:10.381 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-17T07:22:10.381 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-17T07:22:10.381 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-17T07:22:10.381 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-17T07:22:10.381 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.compression_opts.level: 32767 2024-09-17T07:22:10.381 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.compression_opts.strategy: 0 2024-09-17T07:22:10.381 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-17T07:22:10.381 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-17T07:22:10.382 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-17T07:22:10.382 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-17T07:22:10.382 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.compression_opts.enabled: false 2024-09-17T07:22:10.382 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-17T07:22:10.382 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-17T07:22:10.382 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-17T07:22:10.382 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-17T07:22:10.382 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.target_file_size_base: 67108864 2024-09-17T07:22:10.382 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-17T07:22:10.382 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-17T07:22:10.382 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-17T07:22:10.382 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-17T07:22:10.382 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-17T07:22:10.382 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-17T07:22:10.383 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-17T07:22:10.383 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-17T07:22:10.383 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-17T07:22:10.383 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-17T07:22:10.383 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-17T07:22:10.383 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-17T07:22:10.383 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-17T07:22:10.383 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-17T07:22:10.383 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.arena_block_size: 1048576 2024-09-17T07:22:10.384 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-17T07:22:10.384 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-17T07:22:10.384 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.disable_auto_compactions: 0 2024-09-17T07:22:10.384 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-17T07:22:10.384 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-17T07:22:10.384 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-17T07:22:10.384 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-17T07:22:10.384 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-17T07:22:10.384 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-17T07:22:10.384 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-17T07:22:10.384 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-17T07:22:10.384 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-17T07:22:10.384 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-17T07:22:10.384 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-17T07:22:10.385 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.inplace_update_support: 0 2024-09-17T07:22:10.385 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-17T07:22:10.385 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-17T07:22:10.385 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-17T07:22:10.385 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-17T07:22:10.385 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.bloom_locality: 0 2024-09-17T07:22:10.385 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.max_successive_merges: 0 2024-09-17T07:22:10.385 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-17T07:22:10.385 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.paranoid_file_checks: 0 2024-09-17T07:22:10.385 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.force_consistency_checks: 1 2024-09-17T07:22:10.385 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.report_bg_io_stats: 0 2024-09-17T07:22:10.385 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.ttl: 2592000 2024-09-17T07:22:10.385 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-17T07:22:10.385 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-17T07:22:10.386 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-17T07:22:10.386 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.enable_blob_files: false 2024-09-17T07:22:10.386 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.min_blob_size: 0 2024-09-17T07:22:10.386 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.blob_file_size: 268435456 2024-09-17T07:22:10.386 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-17T07:22:10.386 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-17T07:22:10.386 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-17T07:22:10.386 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-17T07:22:10.386 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-17T07:22:10.386 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.blob_file_starting_level: 0 2024-09-17T07:22:10.386 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-17T07:22:10.386 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 24.sst 2024-09-17T07:22:10.387 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-17T07:22:10.387 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi139/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 26, last_sequence is 10568, log_number is 22,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-17T07:22:10.387 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 22 2024-09-17T07:22:10.387 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: f0e778d0-6dc4-4fbc-a9e2-8f0676f74539 2024-09-17T07:22:10.387 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726557730109806, "job": 1, "event": "recovery_started", "wal_files": [22]} 2024-09-17T07:22:10.387 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #22 mode 2 2024-09-17T07:22:10.387 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726557730120541, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 27, "file_size": 3110847, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 10573, "largest_seqno": 11716, "table_properties": {"data_size": 3105143, "index_size": 3379, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1285, "raw_key_size": 11669, "raw_average_key_size": 23, "raw_value_size": 3094387, "raw_average_value_size": 6289, "num_data_blocks": 155, "num_entries": 492, "num_filter_entries": 492, "num_deletions": 2, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726557730, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "f0e778d0-6dc4-4fbc-a9e2-8f0676f74539", "db_session_id": "QVEJQTS3QJCV954HX1P1", "orig_file_number": 27, "seqno_to_time_mapping": "N/A"}} 2024-09-17T07:22:10.387 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726557730120669, "job": 1, "event": "recovery_finished"} 2024-09-17T07:22:10.387 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: [db/version_set.cc:5047] Creating manifest 29 2024-09-17T07:22:10.387 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-17T07:22:10.387 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi139/store.db/000022.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-17T07:22:10.387 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55ddebab4e00 2024-09-17T07:22:10.387 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: DB pointer 0x55ddebba8000 2024-09-17T07:22:10.387 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-17T07:22:10.388 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-17T07:22:10.388 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: ** DB Stats ** 2024-09-17T07:22:10.388 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-17T07:22:10.388 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-17T07:22:10.388 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-17T07:22:10.388 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-17T07:22:10.388 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-17T07:22:10.388 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-17T07:22:10.388 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-17T07:22:10.388 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: 2024-09-17T07:22:10.388 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: ** Compaction Stats [default] ** 2024-09-17T07:22:10.388 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-17T07:22:10.388 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-17T07:22:10.388 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: L0 1/0 2.97 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 680.4 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-17T07:22:10.388 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: L6 1/0 5.94 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-17T07:22:10.389 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: Sum 2/0 8.91 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 680.4 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-17T07:22:10.389 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 680.4 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-17T07:22:10.389 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: 2024-09-17T07:22:10.389 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: ** Compaction Stats [default] ** 2024-09-17T07:22:10.389 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-17T07:22:10.389 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-17T07:22:10.389 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 680.4 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-17T07:22:10.389 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: 2024-09-17T07:22:10.389 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-17T07:22:10.389 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: 2024-09-17T07:22:10.389 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-17T07:22:10.389 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: Flush(GB): cumulative 0.003, interval 0.003 2024-09-17T07:22:10.389 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-17T07:22:10.389 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-17T07:22:10.389 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-17T07:22:10.390 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-17T07:22:10.390 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: Cumulative compaction: 0.00 GB write, 190.48 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-17T07:22:10.390 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: Interval compaction: 0.00 GB write, 190.48 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-17T07:22:10.390 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-17T07:22:10.390 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: Block cache BinnedLRUCache@0x55ddeba891f0#2 capacity: 512.00 MB usage: 5.48 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-17T07:22:10.390 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,1.41 KB,0.000268221%) IndexBlock(1,4.08 KB,0.000777841%) Misc(1,0.00 KB,0%) 2024-09-17T07:22:10.390 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: 2024-09-17T07:22:10.390 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-17T07:22:10.390 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: starting mon.smithi139 rank 1 at public addrs [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] at bind addrs [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi139 fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 2024-09-17T07:22:10.390 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: mon.smithi139@-1(???) e2 preinit fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 2024-09-17T07:22:10.390 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: mon.smithi139@-1(???).mds e21 new map 2024-09-17T07:22:10.390 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: mon.smithi139@-1(???).mds e21 print_map 2024-09-17T07:22:10.390 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: e21 2024-09-17T07:22:10.390 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T07:22:10.390 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T07:22:10.391 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: legacy client fscid: 1 2024-09-17T07:22:10.391 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: 2024-09-17T07:22:10.391 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: Filesystem 'cephfs' (1) 2024-09-17T07:22:10.391 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: fs_name cephfs 2024-09-17T07:22:10.391 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: epoch 21 2024-09-17T07:22:10.391 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T07:22:10.391 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: created 2024-09-17T07:17:15.368053+0000 2024-09-17T07:22:10.391 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: modified 2024-09-17T07:20:37.142055+0000 2024-09-17T07:22:10.391 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: tableserver 0 2024-09-17T07:22:10.391 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: root 0 2024-09-17T07:22:10.391 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: session_timeout 60 2024-09-17T07:22:10.391 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: session_autoclose 300 2024-09-17T07:22:10.391 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: max_file_size 1099511627776 2024-09-17T07:22:10.391 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: max_xattr_size 65536 2024-09-17T07:22:10.392 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: required_client_features {} 2024-09-17T07:22:10.392 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: last_failure 0 2024-09-17T07:22:10.392 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: last_failure_osd_epoch 44 2024-09-17T07:22:10.392 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T07:22:10.392 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: max_mds 2 2024-09-17T07:22:10.392 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: in 0,1 2024-09-17T07:22:10.392 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: up {0=14478,1=24243} 2024-09-17T07:22:10.392 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: failed 2024-09-17T07:22:10.392 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: damaged 2024-09-17T07:22:10.392 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: stopped 2024-09-17T07:22:10.392 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: data_pools [3] 2024-09-17T07:22:10.392 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: metadata_pool 2 2024-09-17T07:22:10.392 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: inline_data enabled 2024-09-17T07:22:10.392 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: balancer 2024-09-17T07:22:10.393 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: bal_rank_mask -1 2024-09-17T07:22:10.393 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: standby_count_wanted 1 2024-09-17T07:22:10.393 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: [mds.cephfs.smithi087.tjhpcs{0:14478} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.87:6828/2255237099,v1:172.21.15.87:6829/2255237099] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:22:10.393 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: [mds.cephfs.smithi087.vvbzss{0:14490} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.87:6826/4022268353,v1:172.21.15.87:6827/4022268353] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:22:10.393 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: [mds.cephfs.smithi139.gnwonz{1:24243} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.139:6824/3946792151,v1:172.21.15.139:6825/3946792151] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:22:10.393 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: [mds.cephfs.smithi139.ftvinf{1:24253} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.139:6826/3292073323,v1:172.21.15.139:6827/3292073323] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:22:10.393 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: 2024-09-17T07:22:10.393 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout: 2024-09-17T07:22:10.393 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: mon.smithi139@-1(???).osd e47 crush map has features 3314933000852226048, adjusting msgr requires 2024-09-17T07:22:10.393 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: mon.smithi139@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-17T07:22:10.393 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: mon.smithi139@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-17T07:22:10.393 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: mon.smithi139@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-17T07:22:10.393 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: mon.smithi139@-1(???).paxosservice(auth 1..21) refresh upgraded, format 0 -> 3 2024-09-17T07:22:10.393 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 bash[79853]: 0b159495af0ffd6af32ae2c34c8c0c4d57d509e725c388b5ecbfd46ed205690a 2024-09-17T07:22:10.393 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 systemd[1]: Started Ceph mon.smithi139 for d5dbf8d6-74c3-11ef-bceb-c7b262605968. 2024-09-17T07:22:10.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:10 smithi087 ceph-mon[90982]: pgmap v8: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 0 B/s wr, 15 op/s 2024-09-17T07:22:11.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:10 smithi139 ceph-mon[79872]: pgmap v8: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 0 B/s wr, 15 op/s 2024-09-17T07:22:11.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:11 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mon metadata", "id": "smithi087"}]: dispatch 2024-09-17T07:22:11.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:11 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mon metadata", "id": "smithi139"}]: dispatch 2024-09-17T07:22:11.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:11 smithi087 ceph-mon[90982]: mon.smithi087 calling monitor election 2024-09-17T07:22:11.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:11 smithi087 ceph-mon[90982]: mon.smithi139 calling monitor election 2024-09-17T07:22:11.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:11 smithi087 ceph-mon[90982]: mon.smithi087 is new leader, mons smithi087,smithi139 in quorum (ranks 0,1) 2024-09-17T07:22:11.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:11 smithi087 ceph-mon[90982]: monmap e3: 2 mons at {smithi087=[v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0],smithi139=[v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-17T07:22:11.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:11 smithi087 ceph-mon[90982]: fsmap cephfs:2 {0=cephfs.smithi087.tjhpcs=up:active,1=cephfs.smithi139.gnwonz=up:active} 2 up:standby-replay 2024-09-17T07:22:11.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:11 smithi087 ceph-mon[90982]: osdmap e47: 6 total, 6 up, 6 in 2024-09-17T07:22:11.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:11 smithi087 ceph-mon[90982]: mgrmap e38: smithi087.vuvjer(active, since 12s), standbys: smithi139.tuqnpn 2024-09-17T07:22:11.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:11 smithi087 ceph-mon[90982]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T07:22:11.928 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:11 smithi087 ceph-mon[90982]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T07:22:11.928 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:11 smithi087 ceph-mon[90982]: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T07:22:11.928 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:11 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:11.928 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:11 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:11.928 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:11 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:22:11.968 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:11 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mon metadata", "id": "smithi087"}]: dispatch 2024-09-17T07:22:11.968 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:11 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mon metadata", "id": "smithi139"}]: dispatch 2024-09-17T07:22:11.968 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:11 smithi139 ceph-mon[79872]: mon.smithi087 calling monitor election 2024-09-17T07:22:11.968 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:11 smithi139 ceph-mon[79872]: mon.smithi139 calling monitor election 2024-09-17T07:22:11.968 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:11 smithi139 ceph-mon[79872]: mon.smithi087 is new leader, mons smithi087,smithi139 in quorum (ranks 0,1) 2024-09-17T07:22:11.968 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:11 smithi139 ceph-mon[79872]: monmap e3: 2 mons at {smithi087=[v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0],smithi139=[v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-17T07:22:11.968 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:11 smithi139 ceph-mon[79872]: fsmap cephfs:2 {0=cephfs.smithi087.tjhpcs=up:active,1=cephfs.smithi139.gnwonz=up:active} 2 up:standby-replay 2024-09-17T07:22:11.969 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:11 smithi139 ceph-mon[79872]: osdmap e47: 6 total, 6 up, 6 in 2024-09-17T07:22:11.969 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:11 smithi139 ceph-mon[79872]: mgrmap e38: smithi087.vuvjer(active, since 12s), standbys: smithi139.tuqnpn 2024-09-17T07:22:11.969 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:11 smithi139 ceph-mon[79872]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T07:22:11.969 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:11 smithi139 ceph-mon[79872]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T07:22:11.969 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:11 smithi139 ceph-mon[79872]: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T07:22:11.969 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:11 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:11.969 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:11 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:11.969 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:11 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:22:12.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:12 smithi139 ceph-mon[79872]: pgmap v10: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-17T07:22:12.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:12 smithi087 ceph-mon[90982]: pgmap v10: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-17T07:22:13.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:13 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:22:13.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:13 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:13.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:13 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:14.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:13 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:22:14.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:13 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:14.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:13 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:15.114 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:14 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:15.114 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:14 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:15.114 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:14 smithi139 ceph-mon[79872]: pgmap v11: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 0 B/s wr, 14 op/s 2024-09-17T07:22:15.133 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:14 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:15.134 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:14 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:15.134 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:14 smithi087 ceph-mon[90982]: pgmap v11: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 0 B/s wr, 14 op/s 2024-09-17T07:22:17.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:17 smithi087 ceph-mon[90982]: pgmap v12: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 0 B/s wr, 14 op/s 2024-09-17T07:22:17.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:17 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:17.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:17 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:17.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:17 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:22:17.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:17 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:22:17.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:17 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:17.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:17 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T07:22:17.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:17 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T07:22:17.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:17 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:22:17.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:17 smithi139 ceph-mon[79872]: pgmap v12: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 0 B/s wr, 14 op/s 2024-09-17T07:22:17.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:17 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:17.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:17 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:17.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:17 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:22:17.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:17 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:22:17.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:17 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:17.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:17 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T07:22:17.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:17 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T07:22:17.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:17 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:22:18.403 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:18 smithi087 ceph-mon[90982]: Reconfiguring mon.smithi087 (monmap changed)... 2024-09-17T07:22:18.403 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:18 smithi087 ceph-mon[90982]: Reconfiguring daemon mon.smithi087 on smithi087 2024-09-17T07:22:18.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:18 smithi139 ceph-mon[79872]: Reconfiguring mon.smithi087 (monmap changed)... 2024-09-17T07:22:18.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:18 smithi139 ceph-mon[79872]: Reconfiguring daemon mon.smithi087 on smithi087 2024-09-17T07:22:19.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:19 smithi087 ceph-mon[90982]: pgmap v13: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:22:19.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:19 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:19.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:19 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:19.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:19 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi087.vuvjer", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T07:22:19.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:19 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T07:22:19.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:19 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:22:19.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:19 smithi139 ceph-mon[79872]: pgmap v13: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:22:19.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:19 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:19.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:19 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:19.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:19 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi087.vuvjer", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T07:22:19.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:19 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T07:22:19.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:19 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:22:20.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:20 smithi087 ceph-mon[90982]: Reconfiguring mgr.smithi087.vuvjer (monmap changed)... 2024-09-17T07:22:20.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:20 smithi087 ceph-mon[90982]: Reconfiguring daemon mgr.smithi087.vuvjer on smithi087 2024-09-17T07:22:20.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:20 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:20.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:20 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:20.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:20 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi087", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-17T07:22:20.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:20 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:22:20.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:20 smithi139 ceph-mon[79872]: Reconfiguring mgr.smithi087.vuvjer (monmap changed)... 2024-09-17T07:22:20.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:20 smithi139 ceph-mon[79872]: Reconfiguring daemon mgr.smithi087.vuvjer on smithi087 2024-09-17T07:22:20.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:20 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:20.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:20 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:20.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:20 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi087", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-17T07:22:20.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:20 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:22:21.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:21 smithi087 ceph-mon[90982]: Reconfiguring crash.smithi087 (monmap changed)... 2024-09-17T07:22:21.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:21 smithi087 ceph-mon[90982]: Reconfiguring daemon crash.smithi087 on smithi087 2024-09-17T07:22:21.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:21 smithi087 ceph-mon[90982]: pgmap v14: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:22:21.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:21 smithi139 ceph-mon[79872]: Reconfiguring crash.smithi087 (monmap changed)... 2024-09-17T07:22:21.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:21 smithi139 ceph-mon[79872]: Reconfiguring daemon crash.smithi087 on smithi087 2024-09-17T07:22:21.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:21 smithi139 ceph-mon[79872]: pgmap v14: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:22:22.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:22 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:22.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:22 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:22.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:22 smithi139 ceph-mon[79872]: Reconfiguring osd.0 (monmap changed)... 2024-09-17T07:22:22.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:22 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-17T07:22:22.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:22 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:22:22.868 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:22 smithi139 ceph-mon[79872]: Reconfiguring daemon osd.0 on smithi087 2024-09-17T07:22:22.868 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:22 smithi139 ceph-mon[79872]: pgmap v15: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:22:22.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:22 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:22.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:22 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:22.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:22 smithi087 ceph-mon[90982]: Reconfiguring osd.0 (monmap changed)... 2024-09-17T07:22:22.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:22 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-17T07:22:22.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:22 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:22:22.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:22 smithi087 ceph-mon[90982]: Reconfiguring daemon osd.0 on smithi087 2024-09-17T07:22:22.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:22 smithi087 ceph-mon[90982]: pgmap v15: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:22:24.355 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:24 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:24.356 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:24 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:24.356 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:24 smithi087 ceph-mon[90982]: Reconfiguring osd.1 (monmap changed)... 2024-09-17T07:22:24.356 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:24 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-17T07:22:24.356 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:24 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:22:24.356 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:24 smithi087 ceph-mon[90982]: Reconfiguring daemon osd.1 on smithi087 2024-09-17T07:22:24.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:24 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:24.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:24 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:24.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:24 smithi139 ceph-mon[79872]: Reconfiguring osd.1 (monmap changed)... 2024-09-17T07:22:24.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:24 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-17T07:22:24.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:24 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:22:24.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:24 smithi139 ceph-mon[79872]: Reconfiguring daemon osd.1 on smithi087 2024-09-17T07:22:25.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:25 smithi139 ceph-mon[79872]: pgmap v16: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:22:25.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:25 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:25.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:25 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:25.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:25 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-17T07:22:25.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:25 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:22:25.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:25 smithi087 ceph-mon[90982]: pgmap v16: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:22:25.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:25 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:25.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:25 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:25.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:25 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-17T07:22:25.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:25 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:22:26.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:26 smithi139 ceph-mon[79872]: Reconfiguring osd.2 (monmap changed)... 2024-09-17T07:22:26.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:26 smithi139 ceph-mon[79872]: Reconfiguring daemon osd.2 on smithi087 2024-09-17T07:22:26.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:26 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:26.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:26 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:26.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:26 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi087.vvbzss", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T07:22:26.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:26 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:22:26.399 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:26 smithi087 ceph-mon[90982]: Reconfiguring osd.2 (monmap changed)... 2024-09-17T07:22:26.399 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:26 smithi087 ceph-mon[90982]: Reconfiguring daemon osd.2 on smithi087 2024-09-17T07:22:26.399 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:26 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:26.399 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:26 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:26.399 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:26 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi087.vvbzss", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T07:22:26.399 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:26 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:22:27.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:27 smithi139 ceph-mon[79872]: Reconfiguring mds.cephfs.smithi087.vvbzss (monmap changed)... 2024-09-17T07:22:27.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:27 smithi139 ceph-mon[79872]: Reconfiguring daemon mds.cephfs.smithi087.vvbzss on smithi087 2024-09-17T07:22:27.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:27 smithi139 ceph-mon[79872]: pgmap v17: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:22:27.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:27 smithi087 ceph-mon[90982]: Reconfiguring mds.cephfs.smithi087.vvbzss (monmap changed)... 2024-09-17T07:22:27.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:27 smithi087 ceph-mon[90982]: Reconfiguring daemon mds.cephfs.smithi087.vvbzss on smithi087 2024-09-17T07:22:27.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:27 smithi087 ceph-mon[90982]: pgmap v17: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:22:28.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:28 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:28.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:28 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:28.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:28 smithi139 ceph-mon[79872]: Reconfiguring mds.cephfs.smithi087.tjhpcs (monmap changed)... 2024-09-17T07:22:28.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:28 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi087.tjhpcs", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T07:22:28.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:28 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:22:28.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:28 smithi139 ceph-mon[79872]: Reconfiguring daemon mds.cephfs.smithi087.tjhpcs on smithi087 2024-09-17T07:22:28.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:28 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:22:28.634 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:28 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:28.634 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:28 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:28.634 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:28 smithi087 ceph-mon[90982]: Reconfiguring mds.cephfs.smithi087.tjhpcs (monmap changed)... 2024-09-17T07:22:28.634 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:28 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi087.tjhpcs", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T07:22:28.635 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:28 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:22:28.635 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:28 smithi087 ceph-mon[90982]: Reconfiguring daemon mds.cephfs.smithi087.tjhpcs on smithi087 2024-09-17T07:22:28.635 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:28 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:22:29.267 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:29 smithi139 ceph-mon[79872]: pgmap v18: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:22:29.267 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:29 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:29.267 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:29 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:29.267 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:29 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi139", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-17T07:22:29.267 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:29 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:22:29.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:29 smithi087 ceph-mon[90982]: pgmap v18: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:22:29.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:29 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:29.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:29 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:29.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:29 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi139", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-17T07:22:29.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:29 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:22:30.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:30 smithi139 ceph-mon[79872]: Reconfiguring crash.smithi139 (monmap changed)... 2024-09-17T07:22:30.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:30 smithi139 ceph-mon[79872]: Reconfiguring daemon crash.smithi139 on smithi139 2024-09-17T07:22:30.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:30 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:30.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:30 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:30.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:30 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi139.tuqnpn", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T07:22:30.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:30 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T07:22:30.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:30 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:22:30.578 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:30 smithi087 ceph-mon[90982]: Reconfiguring crash.smithi139 (monmap changed)... 2024-09-17T07:22:30.578 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:30 smithi087 ceph-mon[90982]: Reconfiguring daemon crash.smithi139 on smithi139 2024-09-17T07:22:30.578 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:30 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:30.578 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:30 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:30.579 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:30 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi139.tuqnpn", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T07:22:30.579 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:30 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T07:22:30.579 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:30 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:22:31.343 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:31 smithi139 ceph-mon[79872]: pgmap v19: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:22:31.344 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:31 smithi139 ceph-mon[79872]: Reconfiguring mgr.smithi139.tuqnpn (monmap changed)... 2024-09-17T07:22:31.344 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:31 smithi139 ceph-mon[79872]: Reconfiguring daemon mgr.smithi139.tuqnpn on smithi139 2024-09-17T07:22:31.590 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:31 smithi087 ceph-mon[90982]: pgmap v19: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:22:31.590 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:31 smithi087 ceph-mon[90982]: Reconfiguring mgr.smithi139.tuqnpn (monmap changed)... 2024-09-17T07:22:31.591 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:31 smithi087 ceph-mon[90982]: Reconfiguring daemon mgr.smithi139.tuqnpn on smithi139 2024-09-17T07:22:31.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:31.905+0000 7fe18cbc2640 1 -- 172.21.15.87:0/681555734 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1880fc6f0 msgr2=0x7fe1880fcb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:22:31.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:31.905+0000 7fe18cbc2640 1 --2- 172.21.15.87:0/681555734 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1880fc6f0 0x7fe1880fcb60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe1780048d0 tx=0x7fe178009da0 comp rx=0 tx=0).stop 2024-09-17T07:22:31.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:31.906+0000 7fe18cbc2640 1 -- 172.21.15.87:0/681555734 shutdown_connections 2024-09-17T07:22:31.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:31.906+0000 7fe18cbc2640 1 --2- 172.21.15.87:0/681555734 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1880fc6f0 0x7fe1880fcb60 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:31.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:31.906+0000 7fe18cbc2640 1 --2- 172.21.15.87:0/681555734 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe1880fb420 0x7fe1880fb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:31.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:31.906+0000 7fe18cbc2640 1 -- 172.21.15.87:0/681555734 >> 172.21.15.87:0/681555734 conn(0x7fe1880f6c00 msgr2=0x7fe1880f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:22:31.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:31.906+0000 7fe18cbc2640 1 -- 172.21.15.87:0/681555734 shutdown_connections 2024-09-17T07:22:31.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:31.906+0000 7fe18cbc2640 1 -- 172.21.15.87:0/681555734 wait complete. 2024-09-17T07:22:31.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:31.906+0000 7fe18cbc2640 1 Processor -- start 2024-09-17T07:22:31.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:31.906+0000 7fe18cbc2640 1 -- start start 2024-09-17T07:22:31.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:31.906+0000 7fe18cbc2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe1880fb420 0x7fe188113590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:22:31.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:31.906+0000 7fe18cbc2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1880fc6f0 0x7fe188113ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:22:31.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:31.907+0000 7fe18cbc2640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe188114120 con 0x7fe1880fc6f0 2024-09-17T07:22:31.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:31.907+0000 7fe18cbc2640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe188114940 con 0x7fe1880fb420 2024-09-17T07:22:31.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:31.907+0000 7fe185d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1880fc6f0 0x7fe188113ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:22:31.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:31.907+0000 7fe185d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1880fc6f0 0x7fe188113ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55982/0 (socket says 172.21.15.87:55982) 2024-09-17T07:22:31.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:31.907+0000 7fe185d9b640 1 -- 172.21.15.87:0/440053231 learned_addr learned my addr 172.21.15.87:0/440053231 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:22:31.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:31.907+0000 7fe18659c640 1 --2- 172.21.15.87:0/440053231 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe1880fb420 0x7fe188113590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:22:31.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:31.907+0000 7fe185d9b640 1 -- 172.21.15.87:0/440053231 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe1880fb420 msgr2=0x7fe188113590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:22:31.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:31.907+0000 7fe185d9b640 1 --2- 172.21.15.87:0/440053231 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe1880fb420 0x7fe188113590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:31.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:31.907+0000 7fe185d9b640 1 -- 172.21.15.87:0/440053231 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe178005040 con 0x7fe1880fc6f0 2024-09-17T07:22:31.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:31.907+0000 7fe185d9b640 1 --2- 172.21.15.87:0/440053231 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1880fc6f0 0x7fe188113ad0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe178009ac0 tx=0x7fe178009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:22:31.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:31.907+0000 7fe17effd640 1 -- 172.21.15.87:0/440053231 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe178038070 con 0x7fe1880fc6f0 2024-09-17T07:22:31.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:31.907+0000 7fe17effd640 1 -- 172.21.15.87:0/440053231 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fe1780096c0 con 0x7fe1880fc6f0 2024-09-17T07:22:31.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:31.907+0000 7fe18cbc2640 1 -- 172.21.15.87:0/440053231 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe188114b70 con 0x7fe1880fc6f0 2024-09-17T07:22:31.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:31.907+0000 7fe17effd640 1 -- 172.21.15.87:0/440053231 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe17803d420 con 0x7fe1880fc6f0 2024-09-17T07:22:31.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:31.907+0000 7fe18cbc2640 1 -- 172.21.15.87:0/440053231 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe188115110 con 0x7fe1880fc6f0 2024-09-17T07:22:31.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:31.909+0000 7fe18cbc2640 1 -- 172.21.15.87:0/440053231 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe188105690 con 0x7fe1880fc6f0 2024-09-17T07:22:31.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:31.909+0000 7fe17effd640 1 -- 172.21.15.87:0/440053231 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 38) v1 ==== 90952+0+0 (secure 0 0 0) 0x7fe178030020 con 0x7fe1880fc6f0 2024-09-17T07:22:31.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:31.909+0000 7fe17effd640 1 --2- 172.21.15.87:0/440053231 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fe17406ccc0 0x7fe17406f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:22:31.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:31.910+0000 7fe17effd640 1 -- 172.21.15.87:0/440053231 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fe1780ac7e0 con 0x7fe1880fc6f0 2024-09-17T07:22:31.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:31.910+0000 7fe18659c640 1 --2- 172.21.15.87:0/440053231 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fe17406ccc0 0x7fe17406f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:22:31.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:31.910+0000 7fe18659c640 1 --2- 172.21.15.87:0/440053231 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fe17406ccc0 0x7fe17406f170 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe170009af0 tx=0x7fe17000b040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:22:31.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:31.914+0000 7fe17effd640 1 -- 172.21.15.87:0/440053231 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe1780766e0 con 0x7fe1880fc6f0 2024-09-17T07:22:32.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.098+0000 7fe18cbc2640 1 -- 172.21.15.87:0/440053231 --> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe188115400 con 0x7fe17406ccc0 2024-09-17T07:22:32.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.100+0000 7fe17effd640 1 -- 172.21.15.87:0/440053231 <== mgr.24529 v2:172.21.15.87:6800/1359413180 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7fe188115400 con 0x7fe17406ccc0 2024-09-17T07:22:32.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.102+0000 7fe18cbc2640 1 -- 172.21.15.87:0/440053231 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fe17406ccc0 msgr2=0x7fe17406f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:22:32.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.102+0000 7fe18cbc2640 1 --2- 172.21.15.87:0/440053231 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fe17406ccc0 0x7fe17406f170 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe170009af0 tx=0x7fe17000b040 comp rx=0 tx=0).stop 2024-09-17T07:22:32.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.102+0000 7fe18cbc2640 1 -- 172.21.15.87:0/440053231 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1880fc6f0 msgr2=0x7fe188113ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:22:32.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.102+0000 7fe18cbc2640 1 --2- 172.21.15.87:0/440053231 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1880fc6f0 0x7fe188113ad0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe178009ac0 tx=0x7fe178009da0 comp rx=0 tx=0).stop 2024-09-17T07:22:32.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.102+0000 7fe18cbc2640 1 -- 172.21.15.87:0/440053231 shutdown_connections 2024-09-17T07:22:32.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.102+0000 7fe18cbc2640 1 --2- 172.21.15.87:0/440053231 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1880fc6f0 0x7fe188113ad0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:32.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.102+0000 7fe18cbc2640 1 --2- 172.21.15.87:0/440053231 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fe17406ccc0 0x7fe17406f170 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:32.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.102+0000 7fe18cbc2640 1 --2- 172.21.15.87:0/440053231 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe1880fb420 0x7fe188113590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:32.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.102+0000 7fe18cbc2640 1 -- 172.21.15.87:0/440053231 >> 172.21.15.87:0/440053231 conn(0x7fe1880f6c00 msgr2=0x7fe188065890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:22:32.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.102+0000 7fe18cbc2640 1 -- 172.21.15.87:0/440053231 shutdown_connections 2024-09-17T07:22:32.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.102+0000 7fe18cbc2640 1 -- 172.21.15.87:0/440053231 wait complete. 2024-09-17T07:22:32.112 INFO:teuthology.orchestra.run.smithi087.stdout:true 2024-09-17T07:22:32.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.184+0000 7fd8de8c7640 1 -- 172.21.15.87:0/3360105175 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8d80fb430 msgr2=0x7fd8d80fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:22:32.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.184+0000 7fd8de8c7640 1 --2- 172.21.15.87:0/3360105175 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8d80fb430 0x7fd8d80fb840 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd8c80048d0 tx=0x7fd8c8009da0 comp rx=0 tx=0).stop 2024-09-17T07:22:32.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.184+0000 7fd8de8c7640 1 -- 172.21.15.87:0/3360105175 shutdown_connections 2024-09-17T07:22:32.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.184+0000 7fd8de8c7640 1 --2- 172.21.15.87:0/3360105175 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd8d80fc700 0x7fd8d80fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:32.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.184+0000 7fd8de8c7640 1 --2- 172.21.15.87:0/3360105175 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8d80fb430 0x7fd8d80fb840 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:32.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.184+0000 7fd8de8c7640 1 -- 172.21.15.87:0/3360105175 >> 172.21.15.87:0/3360105175 conn(0x7fd8d80f6c10 msgr2=0x7fd8d80f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:22:32.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.184+0000 7fd8de8c7640 1 -- 172.21.15.87:0/3360105175 shutdown_connections 2024-09-17T07:22:32.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.184+0000 7fd8de8c7640 1 -- 172.21.15.87:0/3360105175 wait complete. 2024-09-17T07:22:32.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.184+0000 7fd8de8c7640 1 Processor -- start 2024-09-17T07:22:32.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.185+0000 7fd8de8c7640 1 -- start start 2024-09-17T07:22:32.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.185+0000 7fd8de8c7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8d80fb430 0x7fd8d810fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:22:32.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.185+0000 7fd8de8c7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd8d80fc700 0x7fd8d8112210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:22:32.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.185+0000 7fd8de8c7640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d8065c80 con 0x7fd8d80fb430 2024-09-17T07:22:32.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.185+0000 7fd8de8c7640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d8065df0 con 0x7fd8d80fc700 2024-09-17T07:22:32.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.185+0000 7fd8d7fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8d80fb430 0x7fd8d810fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:22:32.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.185+0000 7fd8d7fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8d80fb430 0x7fd8d810fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55998/0 (socket says 172.21.15.87:55998) 2024-09-17T07:22:32.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.185+0000 7fd8d7fff640 1 -- 172.21.15.87:0/211006464 learned_addr learned my addr 172.21.15.87:0/211006464 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:22:32.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.185+0000 7fd8d77fe640 1 --2- 172.21.15.87:0/211006464 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd8d80fc700 0x7fd8d8112210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:22:32.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.185+0000 7fd8d7fff640 1 -- 172.21.15.87:0/211006464 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd8d80fc700 msgr2=0x7fd8d8112210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:22:32.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.185+0000 7fd8d7fff640 1 --2- 172.21.15.87:0/211006464 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd8d80fc700 0x7fd8d8112210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:32.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.185+0000 7fd8d7fff640 1 -- 172.21.15.87:0/211006464 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8c8005040 con 0x7fd8d80fb430 2024-09-17T07:22:32.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.186+0000 7fd8d7fff640 1 --2- 172.21.15.87:0/211006464 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8d80fb430 0x7fd8d810fcc0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd8c8009ac0 tx=0x7fd8c8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:22:32.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.186+0000 7fd8d4ff9640 1 -- 172.21.15.87:0/211006464 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8c8038070 con 0x7fd8d80fb430 2024-09-17T07:22:32.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.186+0000 7fd8d4ff9640 1 -- 172.21.15.87:0/211006464 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fd8c802ae70 con 0x7fd8d80fb430 2024-09-17T07:22:32.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.186+0000 7fd8de8c7640 1 -- 172.21.15.87:0/211006464 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8d8112750 con 0x7fd8d80fb430 2024-09-17T07:22:32.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.186+0000 7fd8d4ff9640 1 -- 172.21.15.87:0/211006464 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8c8033420 con 0x7fd8d80fb430 2024-09-17T07:22:32.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.186+0000 7fd8de8c7640 1 -- 172.21.15.87:0/211006464 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8d8112c40 con 0x7fd8d80fb430 2024-09-17T07:22:32.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.187+0000 7fd8d4ff9640 1 -- 172.21.15.87:0/211006464 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 38) v1 ==== 90952+0+0 (secure 0 0 0) 0x7fd8c8030020 con 0x7fd8d80fb430 2024-09-17T07:22:32.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.187+0000 7fd8de8c7640 1 -- 172.21.15.87:0/211006464 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8d804b720 con 0x7fd8d80fb430 2024-09-17T07:22:32.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.188+0000 7fd8d4ff9640 1 --2- 172.21.15.87:0/211006464 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fd8c006ccc0 0x7fd8c006f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:22:32.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.188+0000 7fd8d4ff9640 1 -- 172.21.15.87:0/211006464 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fd8c80ac170 con 0x7fd8d80fb430 2024-09-17T07:22:32.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.188+0000 7fd8d77fe640 1 --2- 172.21.15.87:0/211006464 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fd8c006ccc0 0x7fd8c006f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:22:32.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.188+0000 7fd8d77fe640 1 --2- 172.21.15.87:0/211006464 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fd8c006ccc0 0x7fd8c006f170 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc0041d0 tx=0x7fd8cc004330 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:22:32.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.192+0000 7fd8d4ff9640 1 -- 172.21.15.87:0/211006464 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd8c8076120 con 0x7fd8d80fb430 2024-09-17T07:22:32.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.377+0000 7fd8de8c7640 1 -- 172.21.15.87:0/211006464 --> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd8d8101170 con 0x7fd8c006ccc0 2024-09-17T07:22:32.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.379+0000 7fd8d4ff9640 1 -- 172.21.15.87:0/211006464 <== mgr.24529 v2:172.21.15.87:6800/1359413180 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7fd8d8101170 con 0x7fd8c006ccc0 2024-09-17T07:22:32.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.381+0000 7fd8de8c7640 1 -- 172.21.15.87:0/211006464 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fd8c006ccc0 msgr2=0x7fd8c006f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:22:32.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.381+0000 7fd8de8c7640 1 --2- 172.21.15.87:0/211006464 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fd8c006ccc0 0x7fd8c006f170 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc0041d0 tx=0x7fd8cc004330 comp rx=0 tx=0).stop 2024-09-17T07:22:32.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.381+0000 7fd8de8c7640 1 -- 172.21.15.87:0/211006464 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8d80fb430 msgr2=0x7fd8d810fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:22:32.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.381+0000 7fd8de8c7640 1 --2- 172.21.15.87:0/211006464 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8d80fb430 0x7fd8d810fcc0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd8c8009ac0 tx=0x7fd8c8009da0 comp rx=0 tx=0).stop 2024-09-17T07:22:32.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.381+0000 7fd8de8c7640 1 -- 172.21.15.87:0/211006464 shutdown_connections 2024-09-17T07:22:32.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.381+0000 7fd8de8c7640 1 --2- 172.21.15.87:0/211006464 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fd8c006ccc0 0x7fd8c006f170 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:32.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.381+0000 7fd8de8c7640 1 --2- 172.21.15.87:0/211006464 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd8d80fc700 0x7fd8d8112210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:32.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.381+0000 7fd8de8c7640 1 --2- 172.21.15.87:0/211006464 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8d80fb430 0x7fd8d810fcc0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:32.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.381+0000 7fd8de8c7640 1 -- 172.21.15.87:0/211006464 >> 172.21.15.87:0/211006464 conn(0x7fd8d80f6c10 msgr2=0x7fd8d80ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:22:32.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.381+0000 7fd8de8c7640 1 -- 172.21.15.87:0/211006464 shutdown_connections 2024-09-17T07:22:32.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.381+0000 7fd8de8c7640 1 -- 172.21.15.87:0/211006464 wait complete. 2024-09-17T07:22:32.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.463+0000 7f388c045640 1 -- 172.21.15.87:0/2750169657 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38840fd7f0 msgr2=0x7f38840fdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:22:32.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.463+0000 7f388c045640 1 --2- 172.21.15.87:0/2750169657 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38840fd7f0 0x7f38840fdc60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f38800048d0 tx=0x7f3880009da0 comp rx=0 tx=0).stop 2024-09-17T07:22:32.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.464+0000 7f388c045640 1 -- 172.21.15.87:0/2750169657 shutdown_connections 2024-09-17T07:22:32.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.464+0000 7f388c045640 1 --2- 172.21.15.87:0/2750169657 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38840fd7f0 0x7f38840fdc60 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:32.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.464+0000 7f388c045640 1 --2- 172.21.15.87:0/2750169657 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f38840fc520 0x7f38840fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:32.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.464+0000 7f388c045640 1 -- 172.21.15.87:0/2750169657 >> 172.21.15.87:0/2750169657 conn(0x7f38840f7ce0 msgr2=0x7f38840fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:22:32.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:32 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:32.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:32 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:32.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:32 smithi087 ceph-mon[90982]: Reconfiguring mon.smithi139 (monmap changed)... 2024-09-17T07:22:32.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:32 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T07:22:32.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:32 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T07:22:32.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:32 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:22:32.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:32 smithi087 ceph-mon[90982]: Reconfiguring daemon mon.smithi139 on smithi139 2024-09-17T07:22:32.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:32 smithi087 ceph-mon[90982]: pgmap v20: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:22:32.466 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:32 smithi087 ceph-mon[90982]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:22:32.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.464+0000 7f388c045640 1 -- 172.21.15.87:0/2750169657 shutdown_connections 2024-09-17T07:22:32.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.464+0000 7f388c045640 1 -- 172.21.15.87:0/2750169657 wait complete. 2024-09-17T07:22:32.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.464+0000 7f388c045640 1 Processor -- start 2024-09-17T07:22:32.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.464+0000 7f388c045640 1 -- start start 2024-09-17T07:22:32.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.465+0000 7f388c045640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f38840fc520 0x7f388410cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:22:32.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.465+0000 7f388c045640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38840fd7f0 0x7f388410d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:22:32.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.465+0000 7f388c045640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f388410db50 con 0x7f38840fd7f0 2024-09-17T07:22:32.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.465+0000 7f388c045640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f388410e370 con 0x7f38840fc520 2024-09-17T07:22:32.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.465+0000 7f38895e0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38840fd7f0 0x7f388410d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:22:32.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.465+0000 7f3889de1640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f38840fc520 0x7f388410cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:22:32.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.465+0000 7f38895e0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38840fd7f0 0x7f388410d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56008/0 (socket says 172.21.15.87:56008) 2024-09-17T07:22:32.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.465+0000 7f38895e0640 1 -- 172.21.15.87:0/408053060 learned_addr learned my addr 172.21.15.87:0/408053060 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:22:32.469 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.465+0000 7f38895e0640 1 -- 172.21.15.87:0/408053060 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f38840fc520 msgr2=0x7f388410cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:22:32.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.465+0000 7f38895e0640 1 --2- 172.21.15.87:0/408053060 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f38840fc520 0x7f388410cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:32.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.465+0000 7f38895e0640 1 -- 172.21.15.87:0/408053060 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3880005040 con 0x7f38840fd7f0 2024-09-17T07:22:32.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.465+0000 7f38895e0640 1 --2- 172.21.15.87:0/408053060 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38840fd7f0 0x7f388410d500 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f38800043d0 tx=0x7f3880009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:22:32.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.466+0000 7f387a7fc640 1 -- 172.21.15.87:0/408053060 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3880038070 con 0x7f38840fd7f0 2024-09-17T07:22:32.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.466+0000 7f388c045640 1 -- 172.21.15.87:0/408053060 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f388410e5a0 con 0x7f38840fd7f0 2024-09-17T07:22:32.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.466+0000 7f387a7fc640 1 -- 172.21.15.87:0/408053060 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f38800096c0 con 0x7f38840fd7f0 2024-09-17T07:22:32.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.466+0000 7f387a7fc640 1 -- 172.21.15.87:0/408053060 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f388003d420 con 0x7f38840fd7f0 2024-09-17T07:22:32.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.466+0000 7f388c045640 1 -- 172.21.15.87:0/408053060 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f388410eb40 con 0x7f38840fd7f0 2024-09-17T07:22:32.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.467+0000 7f388c045640 1 -- 172.21.15.87:0/408053060 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38840fb980 con 0x7f38840fd7f0 2024-09-17T07:22:32.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.467+0000 7f387a7fc640 1 -- 172.21.15.87:0/408053060 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 38) v1 ==== 90952+0+0 (secure 0 0 0) 0x7f3880030020 con 0x7f38840fd7f0 2024-09-17T07:22:32.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.468+0000 7f387a7fc640 1 --2- 172.21.15.87:0/408053060 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f387006ccc0 0x7f387006f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:22:32.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.468+0000 7f387a7fc640 1 -- 172.21.15.87:0/408053060 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f38800ac7e0 con 0x7f38840fd7f0 2024-09-17T07:22:32.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.468+0000 7f3889de1640 1 --2- 172.21.15.87:0/408053060 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f387006ccc0 0x7f387006f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:22:32.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.468+0000 7f3889de1640 1 --2- 172.21.15.87:0/408053060 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f387006ccc0 0x7f387006f170 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3874004ed0 tx=0x7f387400b040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:22:32.473 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.472+0000 7f387a7fc640 1 -- 172.21.15.87:0/408053060 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f38800766e0 con 0x7f38840fd7f0 2024-09-17T07:22:32.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.647+0000 7f388c045640 1 -- 172.21.15.87:0/408053060 --> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f388410ee70 con 0x7f387006ccc0 2024-09-17T07:22:32.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.656+0000 7f387a7fc640 1 -- 172.21.15.87:0/408053060 <== mgr.24529 v2:172.21.15.87:6800/1359413180 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f388410ee70 con 0x7f387006ccc0 2024-09-17T07:22:32.657 INFO:teuthology.orchestra.run.smithi087.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T07:22:32.657 INFO:teuthology.orchestra.run.smithi087.stdout:alertmanager.smithi087 smithi087 *:9093,9094 running (2m) 29s ago 10m 17.3M - 0.25.0 c8568f914cd2 594553f0b497 2024-09-17T07:22:32.657 INFO:teuthology.orchestra.run.smithi087.stdout:crash.smithi087 smithi087 running (10m) 29s ago 10m 6891k - 17.2.7-1635-g4a704134 f22ead590bad d9aaf9839ada 2024-09-17T07:22:32.657 INFO:teuthology.orchestra.run.smithi087.stdout:crash.smithi139 smithi139 running (9m) 19s ago 9m 6895k - 17.2.7-1635-g4a704134 f22ead590bad 354c853b318f 2024-09-17T07:22:32.657 INFO:teuthology.orchestra.run.smithi087.stdout:grafana.smithi087 smithi087 *:3000 running (2m) 29s ago 10m 80.4M - 9.4.7 954c08fa6188 e2f17ec6baa8 2024-09-17T07:22:32.657 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi087.tjhpcs smithi087 running (5m) 29s ago 5m 130M - 17.2.7-1635-g4a704134 f22ead590bad f7142ad971ed 2024-09-17T07:22:32.657 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi087.vvbzss smithi087 running (5m) 29s ago 5m 70.1M - 17.2.7-1635-g4a704134 f22ead590bad 2dd82ff293d1 2024-09-17T07:22:32.657 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi139.ftvinf smithi139 running (5m) 19s ago 5m 57.4M - 17.2.7-1635-g4a704134 f22ead590bad d11edb295ad3 2024-09-17T07:22:32.657 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi139.gnwonz smithi139 running (5m) 19s ago 5m 116M - 17.2.7-1635-g4a704134 f22ead590bad 3b3d884aef02 2024-09-17T07:22:32.658 INFO:teuthology.orchestra.run.smithi087.stdout:mgr.smithi087.vuvjer smithi087 *:8443,9283,8765 running (87s) 29s ago 11m 458M - 18.2.4-855-g19e2a2be 980a0bfcd684 5d10c647cb6b 2024-09-17T07:22:32.658 INFO:teuthology.orchestra.run.smithi087.stdout:mgr.smithi139.tuqnpn smithi139 *:8443,9283,8765 running (53s) 19s ago 9m 436M - 18.2.4-855-g19e2a2be 980a0bfcd684 6e0bf371d44c 2024-09-17T07:22:32.658 INFO:teuthology.orchestra.run.smithi087.stdout:mon.smithi087 smithi087 running (41s) 29s ago 11m 26.1M 2048M 18.2.4-855-g19e2a2be 980a0bfcd684 305c72de1f9f 2024-09-17T07:22:32.658 INFO:teuthology.orchestra.run.smithi087.stdout:mon.smithi139 smithi139 running (22s) 19s ago 9m 21.6M 2048M 18.2.4-855-g19e2a2be 980a0bfcd684 0b159495af0f 2024-09-17T07:22:32.658 INFO:teuthology.orchestra.run.smithi087.stdout:node-exporter.smithi087 smithi087 *:9100 running (2m) 29s ago 10m 8434k - 1.5.0 0da6a335fe13 39fa48de0e87 2024-09-17T07:22:32.658 INFO:teuthology.orchestra.run.smithi087.stdout:node-exporter.smithi139 smithi139 *:9100 running (99s) 19s ago 9m 15.5M - 1.5.0 0da6a335fe13 a5b99b7cbb06 2024-09-17T07:22:32.658 INFO:teuthology.orchestra.run.smithi087.stdout:osd.0 smithi087 running (8m) 29s ago 8m 192M 1557M 17.2.7-1635-g4a704134 f22ead590bad 396801f9b539 2024-09-17T07:22:32.658 INFO:teuthology.orchestra.run.smithi087.stdout:osd.1 smithi087 running (8m) 29s ago 8m 191M 1557M 17.2.7-1635-g4a704134 f22ead590bad 9446985bfcd1 2024-09-17T07:22:32.658 INFO:teuthology.orchestra.run.smithi087.stdout:osd.2 smithi087 running (7m) 29s ago 7m 161M 1557M 17.2.7-1635-g4a704134 f22ead590bad 8fe1428a6878 2024-09-17T07:22:32.658 INFO:teuthology.orchestra.run.smithi087.stdout:osd.3 smithi139 running (7m) 19s ago 7m 234M 2581M 17.2.7-1635-g4a704134 f22ead590bad 0801999b17c4 2024-09-17T07:22:32.658 INFO:teuthology.orchestra.run.smithi087.stdout:osd.4 smithi139 running (7m) 19s ago 7m 208M 2581M 17.2.7-1635-g4a704134 f22ead590bad 299a8dfc47f5 2024-09-17T07:22:32.658 INFO:teuthology.orchestra.run.smithi087.stdout:osd.5 smithi139 running (6m) 19s ago 6m 199M 2581M 17.2.7-1635-g4a704134 f22ead590bad 609cf74f32e7 2024-09-17T07:22:32.659 INFO:teuthology.orchestra.run.smithi087.stdout:prometheus.smithi087 smithi087 *:9095 running (57s) 29s ago 10m 49.1M - 2.43.0 a07b618ecd1d 63d18b7469fc 2024-09-17T07:22:32.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.658+0000 7f388c045640 1 -- 172.21.15.87:0/408053060 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f387006ccc0 msgr2=0x7f387006f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:22:32.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.658+0000 7f388c045640 1 --2- 172.21.15.87:0/408053060 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f387006ccc0 0x7f387006f170 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3874004ed0 tx=0x7f387400b040 comp rx=0 tx=0).stop 2024-09-17T07:22:32.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.658+0000 7f388c045640 1 -- 172.21.15.87:0/408053060 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38840fd7f0 msgr2=0x7f388410d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:22:32.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.658+0000 7f388c045640 1 --2- 172.21.15.87:0/408053060 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38840fd7f0 0x7f388410d500 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f38800043d0 tx=0x7f3880009da0 comp rx=0 tx=0).stop 2024-09-17T07:22:32.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.658+0000 7f388c045640 1 -- 172.21.15.87:0/408053060 shutdown_connections 2024-09-17T07:22:32.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.658+0000 7f388c045640 1 --2- 172.21.15.87:0/408053060 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38840fd7f0 0x7f388410d500 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:32.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.658+0000 7f388c045640 1 --2- 172.21.15.87:0/408053060 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f387006ccc0 0x7f387006f170 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:32.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.658+0000 7f388c045640 1 --2- 172.21.15.87:0/408053060 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f38840fc520 0x7f388410cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:32.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.658+0000 7f388c045640 1 -- 172.21.15.87:0/408053060 >> 172.21.15.87:0/408053060 conn(0x7f38840f7ce0 msgr2=0x7f38840f95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:22:32.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.658+0000 7f388c045640 1 -- 172.21.15.87:0/408053060 shutdown_connections 2024-09-17T07:22:32.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.658+0000 7f388c045640 1 -- 172.21.15.87:0/408053060 wait complete. 2024-09-17T07:22:32.710 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:32 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:32.710 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:32 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:32.710 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:32 smithi139 ceph-mon[79872]: Reconfiguring mon.smithi139 (monmap changed)... 2024-09-17T07:22:32.710 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:32 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T07:22:32.710 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:32 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T07:22:32.710 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:32 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:22:32.710 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:32 smithi139 ceph-mon[79872]: Reconfiguring daemon mon.smithi139 on smithi139 2024-09-17T07:22:32.710 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:32 smithi139 ceph-mon[79872]: pgmap v20: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:22:32.710 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:32 smithi139 ceph-mon[79872]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:22:32.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.736+0000 7f8befc88640 1 -- 172.21.15.87:0/2026720074 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8be80fd7f0 msgr2=0x7f8be80fdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:22:32.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.736+0000 7f8befc88640 1 --2- 172.21.15.87:0/2026720074 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8be80fd7f0 0x7f8be80fdc60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8bd80048d0 tx=0x7f8bd8009da0 comp rx=0 tx=0).stop 2024-09-17T07:22:32.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.736+0000 7f8befc88640 1 -- 172.21.15.87:0/2026720074 shutdown_connections 2024-09-17T07:22:32.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.736+0000 7f8befc88640 1 --2- 172.21.15.87:0/2026720074 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8be80fd7f0 0x7f8be80fdc60 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:32.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.736+0000 7f8befc88640 1 --2- 172.21.15.87:0/2026720074 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8be80fc520 0x7f8be80fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:32.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.736+0000 7f8befc88640 1 -- 172.21.15.87:0/2026720074 >> 172.21.15.87:0/2026720074 conn(0x7f8be80f7ce0 msgr2=0x7f8be80fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:22:32.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.736+0000 7f8befc88640 1 -- 172.21.15.87:0/2026720074 shutdown_connections 2024-09-17T07:22:32.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.736+0000 7f8befc88640 1 -- 172.21.15.87:0/2026720074 wait complete. 2024-09-17T07:22:32.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.737+0000 7f8befc88640 1 Processor -- start 2024-09-17T07:22:32.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.737+0000 7f8befc88640 1 -- start start 2024-09-17T07:22:32.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.737+0000 7f8befc88640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8be80fc520 0x7f8be8071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:22:32.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.737+0000 7f8befc88640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8be80fd7f0 0x7f8be806fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:22:32.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.737+0000 7f8befc88640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be806fff0 con 0x7f8be80fd7f0 2024-09-17T07:22:32.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.737+0000 7f8befc88640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be8070130 con 0x7f8be80fc520 2024-09-17T07:22:32.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.737+0000 7f8bed223640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8be80fd7f0 0x7f8be806fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:22:32.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.737+0000 7f8bed223640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8be80fd7f0 0x7f8be806fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56014/0 (socket says 172.21.15.87:56014) 2024-09-17T07:22:32.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.737+0000 7f8beda24640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8be80fc520 0x7f8be8071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:22:32.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.737+0000 7f8bed223640 1 -- 172.21.15.87:0/3321126085 learned_addr learned my addr 172.21.15.87:0/3321126085 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:22:32.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.737+0000 7f8bed223640 1 -- 172.21.15.87:0/3321126085 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8be80fc520 msgr2=0x7f8be8071570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:22:32.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.737+0000 7f8bed223640 1 --2- 172.21.15.87:0/3321126085 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8be80fc520 0x7f8be8071570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:32.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.738+0000 7f8bed223640 1 -- 172.21.15.87:0/3321126085 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bd8005040 con 0x7f8be80fd7f0 2024-09-17T07:22:32.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.738+0000 7f8bed223640 1 --2- 172.21.15.87:0/3321126085 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8be80fd7f0 0x7f8be806fa60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8bd80043d0 tx=0x7f8bd8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:22:32.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.738+0000 7f8bde7fc640 1 -- 172.21.15.87:0/3321126085 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8bd8038070 con 0x7f8be80fd7f0 2024-09-17T07:22:32.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.738+0000 7f8bde7fc640 1 -- 172.21.15.87:0/3321126085 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f8bd80096c0 con 0x7f8be80fd7f0 2024-09-17T07:22:32.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.738+0000 7f8bde7fc640 1 -- 172.21.15.87:0/3321126085 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8bd803d420 con 0x7f8be80fd7f0 2024-09-17T07:22:32.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.738+0000 7f8befc88640 1 -- 172.21.15.87:0/3321126085 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8be80703b0 con 0x7f8be80fd7f0 2024-09-17T07:22:32.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.738+0000 7f8befc88640 1 -- 172.21.15.87:0/3321126085 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8be8115010 con 0x7f8be80fd7f0 2024-09-17T07:22:32.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.739+0000 7f8bde7fc640 1 -- 172.21.15.87:0/3321126085 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 38) v1 ==== 90952+0+0 (secure 0 0 0) 0x7f8bd8030020 con 0x7f8be80fd7f0 2024-09-17T07:22:32.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.739+0000 7f8befc88640 1 -- 172.21.15.87:0/3321126085 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8be80fb980 con 0x7f8be80fd7f0 2024-09-17T07:22:32.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.740+0000 7f8bde7fc640 1 --2- 172.21.15.87:0/3321126085 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f8bd406ccc0 0x7f8bd406f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:22:32.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.740+0000 7f8bde7fc640 1 -- 172.21.15.87:0/3321126085 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f8bd80ac710 con 0x7f8be80fd7f0 2024-09-17T07:22:32.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.740+0000 7f8beda24640 1 --2- 172.21.15.87:0/3321126085 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f8bd406ccc0 0x7f8bd406f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:22:32.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.741+0000 7f8beda24640 1 --2- 172.21.15.87:0/3321126085 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f8bd406ccc0 0x7f8bd406f170 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8be8071320 tx=0x7f8be400b040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:22:32.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.744+0000 7f8bde7fc640 1 -- 172.21.15.87:0/3321126085 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f8bd8076690 con 0x7f8be80fd7f0 2024-09-17T07:22:32.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.977+0000 7f8befc88640 1 -- 172.21.15.87:0/3321126085 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8be8104e10 con 0x7f8be80fd7f0 2024-09-17T07:22:32.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.978+0000 7f8bde7fc640 1 -- 172.21.15.87:0/3321126085 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+742 (secure 0 0 0) 0x7f8bd8079cb0 con 0x7f8be80fd7f0 2024-09-17T07:22:32.979 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T07:22:32.979 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": { 2024-09-17T07:22:32.979 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 2 2024-09-17T07:22:32.979 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:22:32.979 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr": { 2024-09-17T07:22:32.979 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 2 2024-09-17T07:22:32.979 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:22:32.979 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": { 2024-09-17T07:22:32.979 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 6 2024-09-17T07:22:32.979 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:22:32.980 INFO:teuthology.orchestra.run.smithi087.stdout: "mds": { 2024-09-17T07:22:32.980 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 4 2024-09-17T07:22:32.980 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:22:32.980 INFO:teuthology.orchestra.run.smithi087.stdout: "overall": { 2024-09-17T07:22:32.980 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 10, 2024-09-17T07:22:32.980 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 4 2024-09-17T07:22:32.980 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T07:22:32.980 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T07:22:32.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.980+0000 7f8befc88640 1 -- 172.21.15.87:0/3321126085 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f8bd406ccc0 msgr2=0x7f8bd406f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:22:32.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.980+0000 7f8befc88640 1 --2- 172.21.15.87:0/3321126085 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f8bd406ccc0 0x7f8bd406f170 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8be8071320 tx=0x7f8be400b040 comp rx=0 tx=0).stop 2024-09-17T07:22:32.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.980+0000 7f8befc88640 1 -- 172.21.15.87:0/3321126085 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8be80fd7f0 msgr2=0x7f8be806fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:22:32.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.980+0000 7f8befc88640 1 --2- 172.21.15.87:0/3321126085 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8be80fd7f0 0x7f8be806fa60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8bd80043d0 tx=0x7f8bd8009da0 comp rx=0 tx=0).stop 2024-09-17T07:22:32.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.980+0000 7f8befc88640 1 -- 172.21.15.87:0/3321126085 shutdown_connections 2024-09-17T07:22:32.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.980+0000 7f8befc88640 1 --2- 172.21.15.87:0/3321126085 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8be80fd7f0 0x7f8be806fa60 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:32.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.980+0000 7f8befc88640 1 --2- 172.21.15.87:0/3321126085 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f8bd406ccc0 0x7f8bd406f170 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:32.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.980+0000 7f8befc88640 1 --2- 172.21.15.87:0/3321126085 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8be80fc520 0x7f8be8071570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:32.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.980+0000 7f8befc88640 1 -- 172.21.15.87:0/3321126085 >> 172.21.15.87:0/3321126085 conn(0x7f8be80f7ce0 msgr2=0x7f8be80f95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:22:32.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.980+0000 7f8befc88640 1 -- 172.21.15.87:0/3321126085 shutdown_connections 2024-09-17T07:22:32.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:32.980+0000 7f8befc88640 1 -- 172.21.15.87:0/3321126085 wait complete. 2024-09-17T07:22:33.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.057+0000 7f765d8d9640 1 -- 172.21.15.87:0/251548061 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76580fba70 msgr2=0x7f76580fbe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:22:33.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.057+0000 7f765d8d9640 1 --2- 172.21.15.87:0/251548061 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76580fba70 0x7f76580fbe80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f76480048d0 tx=0x7f7648009da0 comp rx=0 tx=0).stop 2024-09-17T07:22:33.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.057+0000 7f765d8d9640 1 -- 172.21.15.87:0/251548061 shutdown_connections 2024-09-17T07:22:33.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.057+0000 7f765d8d9640 1 --2- 172.21.15.87:0/251548061 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f76580fc3c0 0x7f76580fc810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:33.058 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.057+0000 7f765d8d9640 1 --2- 172.21.15.87:0/251548061 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76580fba70 0x7f76580fbe80 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:33.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.057+0000 7f765d8d9640 1 -- 172.21.15.87:0/251548061 >> 172.21.15.87:0/251548061 conn(0x7f76580f63a0 msgr2=0x7f76580f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:22:33.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.057+0000 7f765d8d9640 1 -- 172.21.15.87:0/251548061 shutdown_connections 2024-09-17T07:22:33.059 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.057+0000 7f765d8d9640 1 -- 172.21.15.87:0/251548061 wait complete. 2024-09-17T07:22:33.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.058+0000 7f765d8d9640 1 Processor -- start 2024-09-17T07:22:33.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.058+0000 7f765d8d9640 1 -- start start 2024-09-17T07:22:33.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.058+0000 7f765d8d9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76580fba70 0x7f765810fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:22:33.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.058+0000 7f765d8d9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f76580fc3c0 0x7f7658112220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:22:33.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.058+0000 7f765d8d9640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76580fb430 con 0x7f76580fba70 2024-09-17T07:22:33.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.058+0000 7f765d8d9640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76580fb5a0 con 0x7f76580fc3c0 2024-09-17T07:22:33.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.058+0000 7f7656ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76580fba70 0x7f765810fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:22:33.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.058+0000 7f7656ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76580fba70 0x7f765810fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56028/0 (socket says 172.21.15.87:56028) 2024-09-17T07:22:33.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.058+0000 7f7656ffd640 1 -- 172.21.15.87:0/2460605965 learned_addr learned my addr 172.21.15.87:0/2460605965 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:22:33.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.058+0000 7f76567fc640 1 --2- 172.21.15.87:0/2460605965 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f76580fc3c0 0x7f7658112220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:22:33.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.058+0000 7f7656ffd640 1 -- 172.21.15.87:0/2460605965 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f76580fc3c0 msgr2=0x7f7658112220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:22:33.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.058+0000 7f7656ffd640 1 --2- 172.21.15.87:0/2460605965 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f76580fc3c0 0x7f7658112220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:33.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.058+0000 7f7656ffd640 1 -- 172.21.15.87:0/2460605965 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7648005040 con 0x7f76580fba70 2024-09-17T07:22:33.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.059+0000 7f7656ffd640 1 --2- 172.21.15.87:0/2460605965 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76580fba70 0x7f765810fcd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f76480043d0 tx=0x7f7648009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:22:33.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.059+0000 7f764f7fe640 1 -- 172.21.15.87:0/2460605965 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7648038070 con 0x7f76580fba70 2024-09-17T07:22:33.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.059+0000 7f764f7fe640 1 -- 172.21.15.87:0/2460605965 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f76480096c0 con 0x7f76580fba70 2024-09-17T07:22:33.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.059+0000 7f765d8d9640 1 -- 172.21.15.87:0/2460605965 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7658112760 con 0x7f76580fba70 2024-09-17T07:22:33.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.059+0000 7f764f7fe640 1 -- 172.21.15.87:0/2460605965 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f764803d420 con 0x7f76580fba70 2024-09-17T07:22:33.062 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.059+0000 7f765d8d9640 1 -- 172.21.15.87:0/2460605965 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7658112d00 con 0x7f76580fba70 2024-09-17T07:22:33.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.060+0000 7f765d8d9640 1 -- 172.21.15.87:0/2460605965 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f765804b720 con 0x7f76580fba70 2024-09-17T07:22:33.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.060+0000 7f764f7fe640 1 -- 172.21.15.87:0/2460605965 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 38) v1 ==== 90952+0+0 (secure 0 0 0) 0x7f7648030020 con 0x7f76580fba70 2024-09-17T07:22:33.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.061+0000 7f764f7fe640 1 --2- 172.21.15.87:0/2460605965 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f764406ccc0 0x7f764406f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:22:33.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.061+0000 7f764f7fe640 1 -- 172.21.15.87:0/2460605965 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f76480ac710 con 0x7f76580fba70 2024-09-17T07:22:33.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.061+0000 7f76567fc640 1 --2- 172.21.15.87:0/2460605965 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f764406ccc0 0x7f764406f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:22:33.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.061+0000 7f76567fc640 1 --2- 172.21.15.87:0/2460605965 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f764406ccc0 0x7f764406f170 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7640004ed0 tx=0x7f764000b040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:22:33.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.065+0000 7f764f7fe640 1 -- 172.21.15.87:0/2460605965 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7648076690 con 0x7f76580fba70 2024-09-17T07:22:33.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.262+0000 7f765d8d9640 1 -- 172.21.15.87:0/2460605965 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7658112f40 con 0x7f76580fba70 2024-09-17T07:22:33.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.262+0000 7f764f7fe640 1 -- 172.21.15.87:0/2460605965 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1905 (secure 0 0 0) 0x7f7648079cb0 con 0x7f76580fba70 2024-09-17T07:22:33.264 INFO:teuthology.orchestra.run.smithi087.stdout:e21 2024-09-17T07:22:33.264 INFO:teuthology.orchestra.run.smithi087.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T07:22:33.264 INFO:teuthology.orchestra.run.smithi087.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T07:22:33.264 INFO:teuthology.orchestra.run.smithi087.stdout:legacy client fscid: 1 2024-09-17T07:22:33.264 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:22:33.264 INFO:teuthology.orchestra.run.smithi087.stdout:Filesystem 'cephfs' (1) 2024-09-17T07:22:33.264 INFO:teuthology.orchestra.run.smithi087.stdout:fs_name cephfs 2024-09-17T07:22:33.264 INFO:teuthology.orchestra.run.smithi087.stdout:epoch 21 2024-09-17T07:22:33.264 INFO:teuthology.orchestra.run.smithi087.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T07:22:33.264 INFO:teuthology.orchestra.run.smithi087.stdout:created 2024-09-17T07:17:15.368053+0000 2024-09-17T07:22:33.265 INFO:teuthology.orchestra.run.smithi087.stdout:modified 2024-09-17T07:20:37.142055+0000 2024-09-17T07:22:33.265 INFO:teuthology.orchestra.run.smithi087.stdout:tableserver 0 2024-09-17T07:22:33.265 INFO:teuthology.orchestra.run.smithi087.stdout:root 0 2024-09-17T07:22:33.265 INFO:teuthology.orchestra.run.smithi087.stdout:session_timeout 60 2024-09-17T07:22:33.265 INFO:teuthology.orchestra.run.smithi087.stdout:session_autoclose 300 2024-09-17T07:22:33.265 INFO:teuthology.orchestra.run.smithi087.stdout:max_file_size 1099511627776 2024-09-17T07:22:33.265 INFO:teuthology.orchestra.run.smithi087.stdout:max_xattr_size 65536 2024-09-17T07:22:33.265 INFO:teuthology.orchestra.run.smithi087.stdout:required_client_features {} 2024-09-17T07:22:33.265 INFO:teuthology.orchestra.run.smithi087.stdout:last_failure 0 2024-09-17T07:22:33.265 INFO:teuthology.orchestra.run.smithi087.stdout:last_failure_osd_epoch 44 2024-09-17T07:22:33.265 INFO:teuthology.orchestra.run.smithi087.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T07:22:33.265 INFO:teuthology.orchestra.run.smithi087.stdout:max_mds 2 2024-09-17T07:22:33.265 INFO:teuthology.orchestra.run.smithi087.stdout:in 0,1 2024-09-17T07:22:33.265 INFO:teuthology.orchestra.run.smithi087.stdout:up {0=14478,1=24243} 2024-09-17T07:22:33.266 INFO:teuthology.orchestra.run.smithi087.stdout:failed 2024-09-17T07:22:33.266 INFO:teuthology.orchestra.run.smithi087.stdout:damaged 2024-09-17T07:22:33.266 INFO:teuthology.orchestra.run.smithi087.stdout:stopped 2024-09-17T07:22:33.266 INFO:teuthology.orchestra.run.smithi087.stdout:data_pools [3] 2024-09-17T07:22:33.266 INFO:teuthology.orchestra.run.smithi087.stdout:metadata_pool 2 2024-09-17T07:22:33.266 INFO:teuthology.orchestra.run.smithi087.stdout:inline_data enabled 2024-09-17T07:22:33.266 INFO:teuthology.orchestra.run.smithi087.stdout:balancer 2024-09-17T07:22:33.266 INFO:teuthology.orchestra.run.smithi087.stdout:bal_rank_mask -1 2024-09-17T07:22:33.266 INFO:teuthology.orchestra.run.smithi087.stdout:standby_count_wanted 1 2024-09-17T07:22:33.266 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi087.tjhpcs{0:14478} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.87:6828/2255237099,v1:172.21.15.87:6829/2255237099] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:22:33.266 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi087.vvbzss{0:14490} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.87:6826/4022268353,v1:172.21.15.87:6827/4022268353] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:22:33.266 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi139.gnwonz{1:24243} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.139:6824/3946792151,v1:172.21.15.139:6825/3946792151] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:22:33.266 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi139.ftvinf{1:24253} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.139:6826/3292073323,v1:172.21.15.139:6827/3292073323] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:22:33.267 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:22:33.267 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:22:33.267 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 21 2024-09-17T07:22:33.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.264+0000 7f765d8d9640 1 -- 172.21.15.87:0/2460605965 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f764406ccc0 msgr2=0x7f764406f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:22:33.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.264+0000 7f765d8d9640 1 --2- 172.21.15.87:0/2460605965 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f764406ccc0 0x7f764406f170 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7640004ed0 tx=0x7f764000b040 comp rx=0 tx=0).stop 2024-09-17T07:22:33.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.264+0000 7f765d8d9640 1 -- 172.21.15.87:0/2460605965 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76580fba70 msgr2=0x7f765810fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:22:33.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.264+0000 7f765d8d9640 1 --2- 172.21.15.87:0/2460605965 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76580fba70 0x7f765810fcd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f76480043d0 tx=0x7f7648009da0 comp rx=0 tx=0).stop 2024-09-17T07:22:33.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.264+0000 7f765d8d9640 1 -- 172.21.15.87:0/2460605965 shutdown_connections 2024-09-17T07:22:33.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.264+0000 7f765d8d9640 1 --2- 172.21.15.87:0/2460605965 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f764406ccc0 0x7f764406f170 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:33.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.264+0000 7f765d8d9640 1 --2- 172.21.15.87:0/2460605965 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f76580fc3c0 0x7f7658112220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:33.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.264+0000 7f765d8d9640 1 --2- 172.21.15.87:0/2460605965 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76580fba70 0x7f765810fcd0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:33.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.264+0000 7f765d8d9640 1 -- 172.21.15.87:0/2460605965 >> 172.21.15.87:0/2460605965 conn(0x7f76580f63a0 msgr2=0x7f76580f7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:22:33.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.264+0000 7f765d8d9640 1 -- 172.21.15.87:0/2460605965 shutdown_connections 2024-09-17T07:22:33.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.264+0000 7f765d8d9640 1 -- 172.21.15.87:0/2460605965 wait complete. 2024-09-17T07:22:33.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.343+0000 7ff2f9a70640 1 -- 172.21.15.87:0/2162724670 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2f4101b20 msgr2=0x7ff2f4103f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:22:33.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.343+0000 7ff2f9a70640 1 --2- 172.21.15.87:0/2162724670 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2f4101b20 0x7ff2f4103f00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff2e80048d0 tx=0x7ff2e8009da0 comp rx=0 tx=0).stop 2024-09-17T07:22:33.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.343+0000 7ff2f9a70640 1 -- 172.21.15.87:0/2162724670 shutdown_connections 2024-09-17T07:22:33.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.343+0000 7ff2f9a70640 1 --2- 172.21.15.87:0/2162724670 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2f4101b20 0x7ff2f4103f00 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:33.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.343+0000 7ff2f9a70640 1 --2- 172.21.15.87:0/2162724670 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff2f40666b0 0x7ff2f41015e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:33.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.343+0000 7ff2f9a70640 1 -- 172.21.15.87:0/2162724670 >> 172.21.15.87:0/2162724670 conn(0x7ff2f40f6c10 msgr2=0x7ff2f40f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:22:33.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.343+0000 7ff2f9a70640 1 -- 172.21.15.87:0/2162724670 shutdown_connections 2024-09-17T07:22:33.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.343+0000 7ff2f9a70640 1 -- 172.21.15.87:0/2162724670 wait complete. 2024-09-17T07:22:33.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.344+0000 7ff2f9a70640 1 Processor -- start 2024-09-17T07:22:33.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.344+0000 7ff2f9a70640 1 -- start start 2024-09-17T07:22:33.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.344+0000 7ff2f9a70640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2f40666b0 0x7ff2f410f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:22:33.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.344+0000 7ff2f9a70640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff2f4101b20 0x7ff2f410f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:22:33.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.344+0000 7ff2f9a70640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f4110620 con 0x7ff2f40666b0 2024-09-17T07:22:33.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.344+0000 7ff2f9a70640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f4110790 con 0x7ff2f4101b20 2024-09-17T07:22:33.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.344+0000 7ff2f37fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2f40666b0 0x7ff2f410f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:22:33.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.345+0000 7ff2f37fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2f40666b0 0x7ff2f410f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56034/0 (socket says 172.21.15.87:56034) 2024-09-17T07:22:33.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.345+0000 7ff2f37fe640 1 -- 172.21.15.87:0/1252597735 learned_addr learned my addr 172.21.15.87:0/1252597735 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:22:33.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.345+0000 7ff2f2ffd640 1 --2- 172.21.15.87:0/1252597735 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff2f4101b20 0x7ff2f410f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:22:33.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.345+0000 7ff2f37fe640 1 -- 172.21.15.87:0/1252597735 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff2f4101b20 msgr2=0x7ff2f410f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:22:33.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.345+0000 7ff2f37fe640 1 --2- 172.21.15.87:0/1252597735 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff2f4101b20 0x7ff2f410f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:33.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.345+0000 7ff2f37fe640 1 -- 172.21.15.87:0/1252597735 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e8005040 con 0x7ff2f40666b0 2024-09-17T07:22:33.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.345+0000 7ff2f37fe640 1 --2- 172.21.15.87:0/1252597735 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2f40666b0 0x7ff2f410f270 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff2e400b580 tx=0x7ff2e40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:22:33.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.345+0000 7ff2dbfff640 1 -- 172.21.15.87:0/1252597735 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2e400f570 con 0x7ff2f40666b0 2024-09-17T07:22:33.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.345+0000 7ff2dbfff640 1 -- 172.21.15.87:0/1252597735 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7ff2e400fb50 con 0x7ff2f40666b0 2024-09-17T07:22:33.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.345+0000 7ff2dbfff640 1 -- 172.21.15.87:0/1252597735 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2e4010c90 con 0x7ff2f40666b0 2024-09-17T07:22:33.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.345+0000 7ff2f9a70640 1 -- 172.21.15.87:0/1252597735 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2f4110a70 con 0x7ff2f40666b0 2024-09-17T07:22:33.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.345+0000 7ff2f9a70640 1 -- 172.21.15.87:0/1252597735 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2f4110f90 con 0x7ff2f40666b0 2024-09-17T07:22:33.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.346+0000 7ff2f9a70640 1 -- 172.21.15.87:0/1252597735 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2f41078d0 con 0x7ff2f40666b0 2024-09-17T07:22:33.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.347+0000 7ff2dbfff640 1 -- 172.21.15.87:0/1252597735 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 38) v1 ==== 90952+0+0 (secure 0 0 0) 0x7ff2e400fcc0 con 0x7ff2f40666b0 2024-09-17T07:22:33.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.347+0000 7ff2dbfff640 1 --2- 172.21.15.87:0/1252597735 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7ff2dc06ccc0 0x7ff2dc06f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:22:33.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.348+0000 7ff2dbfff640 1 -- 172.21.15.87:0/1252597735 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6410+0+0 (secure 0 0 0) 0x7ff2e408bfc0 con 0x7ff2f40666b0 2024-09-17T07:22:33.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.348+0000 7ff2f2ffd640 1 --2- 172.21.15.87:0/1252597735 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7ff2dc06ccc0 0x7ff2dc06f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:22:33.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.348+0000 7ff2f2ffd640 1 --2- 172.21.15.87:0/1252597735 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7ff2dc06ccc0 0x7ff2dc06f170 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff2f410f020 tx=0x7ff2e8035040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:22:33.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.352+0000 7ff2dbfff640 1 -- 172.21.15.87:0/1252597735 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff2e4055fe0 con 0x7ff2f40666b0 2024-09-17T07:22:33.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.530+0000 7ff2f9a70640 1 -- 172.21.15.87:0/1252597735 --> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff2f4111200 con 0x7ff2dc06ccc0 2024-09-17T07:22:33.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.531+0000 7ff2dbfff640 1 -- 172.21.15.87:0/1252597735 <== mgr.24529 v2:172.21.15.87:6800/1359413180 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7ff2f4111200 con 0x7ff2dc06ccc0 2024-09-17T07:22:33.532 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T07:22:33.533 INFO:teuthology.orchestra.run.smithi087.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9", 2024-09-17T07:22:33.533 INFO:teuthology.orchestra.run.smithi087.stdout: "in_progress": true, 2024-09-17T07:22:33.533 INFO:teuthology.orchestra.run.smithi087.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T07:22:33.533 INFO:teuthology.orchestra.run.smithi087.stdout: "services_complete": [ 2024-09-17T07:22:33.533 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr", 2024-09-17T07:22:33.533 INFO:teuthology.orchestra.run.smithi087.stdout: "mon" 2024-09-17T07:22:33.533 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-17T07:22:33.533 INFO:teuthology.orchestra.run.smithi087.stdout: "progress": "4/21 daemons upgraded", 2024-09-17T07:22:33.533 INFO:teuthology.orchestra.run.smithi087.stdout: "message": "Currently upgrading mon daemons", 2024-09-17T07:22:33.533 INFO:teuthology.orchestra.run.smithi087.stdout: "is_paused": false 2024-09-17T07:22:33.533 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T07:22:33.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.533+0000 7ff2f9a70640 1 -- 172.21.15.87:0/1252597735 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7ff2dc06ccc0 msgr2=0x7ff2dc06f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:22:33.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.533+0000 7ff2f9a70640 1 --2- 172.21.15.87:0/1252597735 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7ff2dc06ccc0 0x7ff2dc06f170 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff2f410f020 tx=0x7ff2e8035040 comp rx=0 tx=0).stop 2024-09-17T07:22:33.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.533+0000 7ff2f9a70640 1 -- 172.21.15.87:0/1252597735 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2f40666b0 msgr2=0x7ff2f410f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:22:33.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.533+0000 7ff2f9a70640 1 --2- 172.21.15.87:0/1252597735 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2f40666b0 0x7ff2f410f270 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff2e400b580 tx=0x7ff2e40091a0 comp rx=0 tx=0).stop 2024-09-17T07:22:33.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.534+0000 7ff2f9a70640 1 -- 172.21.15.87:0/1252597735 shutdown_connections 2024-09-17T07:22:33.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.534+0000 7ff2f9a70640 1 --2- 172.21.15.87:0/1252597735 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7ff2dc06ccc0 0x7ff2dc06f170 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:33.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.534+0000 7ff2f9a70640 1 --2- 172.21.15.87:0/1252597735 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff2f4101b20 0x7ff2f410f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:33.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.534+0000 7ff2f9a70640 1 --2- 172.21.15.87:0/1252597735 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2f40666b0 0x7ff2f410f270 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:33.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.534+0000 7ff2f9a70640 1 -- 172.21.15.87:0/1252597735 >> 172.21.15.87:0/1252597735 conn(0x7ff2f40f6c10 msgr2=0x7ff2f40f7030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:22:33.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.534+0000 7ff2f9a70640 1 -- 172.21.15.87:0/1252597735 shutdown_connections 2024-09-17T07:22:33.535 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.534+0000 7ff2f9a70640 1 -- 172.21.15.87:0/1252597735 wait complete. 2024-09-17T07:22:33.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.611+0000 7fafdfd39640 1 -- 172.21.15.87:0/2712534236 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fafd80fd800 msgr2=0x7fafd80fdc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:22:33.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.611+0000 7fafdfd39640 1 --2- 172.21.15.87:0/2712534236 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fafd80fd800 0x7fafd80fdc70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fafd40048d0 tx=0x7fafd4009da0 comp rx=0 tx=0).stop 2024-09-17T07:22:33.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.611+0000 7fafdfd39640 1 -- 172.21.15.87:0/2712534236 shutdown_connections 2024-09-17T07:22:33.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.611+0000 7fafdfd39640 1 --2- 172.21.15.87:0/2712534236 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fafd80fd800 0x7fafd80fdc70 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:33.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.611+0000 7fafdfd39640 1 --2- 172.21.15.87:0/2712534236 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fafd80fc530 0x7fafd80fc940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:33.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.611+0000 7fafdfd39640 1 -- 172.21.15.87:0/2712534236 >> 172.21.15.87:0/2712534236 conn(0x7fafd80f7d10 msgr2=0x7fafd80fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:22:33.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.611+0000 7fafdfd39640 1 -- 172.21.15.87:0/2712534236 shutdown_connections 2024-09-17T07:22:33.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.611+0000 7fafdfd39640 1 -- 172.21.15.87:0/2712534236 wait complete. 2024-09-17T07:22:33.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.611+0000 7fafdfd39640 1 Processor -- start 2024-09-17T07:22:33.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.611+0000 7fafdfd39640 1 -- start start 2024-09-17T07:22:33.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.612+0000 7fafdfd39640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fafd80fc530 0x7fafd810d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:22:33.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.612+0000 7fafdfd39640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fafd80fd800 0x7fafd810d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:22:33.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.612+0000 7fafdfd39640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd810dbb0 con 0x7fafd80fd800 2024-09-17T07:22:33.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.612+0000 7fafdfd39640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd810e360 con 0x7fafd80fc530 2024-09-17T07:22:33.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.612+0000 7fafdd2d4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fafd80fd800 0x7fafd810d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:22:33.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.612+0000 7fafdd2d4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fafd80fd800 0x7fafd810d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56042/0 (socket says 172.21.15.87:56042) 2024-09-17T07:22:33.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.612+0000 7fafdd2d4640 1 -- 172.21.15.87:0/1673670990 learned_addr learned my addr 172.21.15.87:0/1673670990 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:22:33.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.612+0000 7fafddad5640 1 --2- 172.21.15.87:0/1673670990 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fafd80fc530 0x7fafd810d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:22:33.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.612+0000 7fafdd2d4640 1 -- 172.21.15.87:0/1673670990 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fafd80fc530 msgr2=0x7fafd810d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:22:33.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.612+0000 7fafdd2d4640 1 --2- 172.21.15.87:0/1673670990 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fafd80fc530 0x7fafd810d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:33.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.612+0000 7fafdd2d4640 1 -- 172.21.15.87:0/1673670990 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafd4005040 con 0x7fafd80fd800 2024-09-17T07:22:33.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.612+0000 7fafdd2d4640 1 --2- 172.21.15.87:0/1673670990 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fafd80fd800 0x7fafd810d560 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fafd40043d0 tx=0x7fafd4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:22:33.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.612+0000 7fafca7fc640 1 -- 172.21.15.87:0/1673670990 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fafd4038070 con 0x7fafd80fd800 2024-09-17T07:22:33.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.612+0000 7fafdfd39640 1 -- 172.21.15.87:0/1673670990 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafd810e590 con 0x7fafd80fd800 2024-09-17T07:22:33.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.612+0000 7fafca7fc640 1 -- 172.21.15.87:0/1673670990 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fafd40096c0 con 0x7fafd80fd800 2024-09-17T07:22:33.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.612+0000 7fafca7fc640 1 -- 172.21.15.87:0/1673670990 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fafd403d420 con 0x7fafd80fd800 2024-09-17T07:22:33.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.612+0000 7fafdfd39640 1 -- 172.21.15.87:0/1673670990 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafd810eab0 con 0x7fafd80fd800 2024-09-17T07:22:33.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.613+0000 7fafdfd39640 1 -- 172.21.15.87:0/1673670990 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafd80fb990 con 0x7fafd80fd800 2024-09-17T07:22:33.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.614+0000 7fafca7fc640 1 -- 172.21.15.87:0/1673670990 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 38) v1 ==== 90952+0+0 (secure 0 0 0) 0x7fafd4030020 con 0x7fafd80fd800 2024-09-17T07:22:33.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.614+0000 7fafca7fc640 1 --2- 172.21.15.87:0/1673670990 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fafc406ccc0 0x7fafc406f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:22:33.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.614+0000 7fafca7fc640 1 -- 172.21.15.87:0/1673670990 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fafd40ac7e0 con 0x7fafd80fd800 2024-09-17T07:22:33.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.614+0000 7fafddad5640 1 --2- 172.21.15.87:0/1673670990 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fafc406ccc0 0x7fafc406f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:22:33.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.615+0000 7fafddad5640 1 --2- 172.21.15.87:0/1673670990 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fafc406ccc0 0x7fafc406f170 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fafcc009fd0 tx=0x7fafcc00b040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:22:33.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.618+0000 7fafca7fc640 1 -- 172.21.15.87:0/1673670990 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fafd40766e0 con 0x7fafd80fd800 2024-09-17T07:22:33.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.847+0000 7fafdfd39640 1 -- 172.21.15.87:0/1673670990 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fafd8104e00 con 0x7fafd80fd800 2024-09-17T07:22:33.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.847+0000 7fafca7fc640 1 -- 172.21.15.87:0/1673670990 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fafd40aae60 con 0x7fafd80fd800 2024-09-17T07:22:33.849 INFO:teuthology.orchestra.run.smithi087.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T07:22:33.849 INFO:teuthology.orchestra.run.smithi087.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T07:22:33.849 INFO:teuthology.orchestra.run.smithi087.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T07:22:33.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.849+0000 7fafdfd39640 1 -- 172.21.15.87:0/1673670990 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fafc406ccc0 msgr2=0x7fafc406f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:22:33.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.849+0000 7fafdfd39640 1 --2- 172.21.15.87:0/1673670990 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fafc406ccc0 0x7fafc406f170 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fafcc009fd0 tx=0x7fafcc00b040 comp rx=0 tx=0).stop 2024-09-17T07:22:33.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.849+0000 7fafdfd39640 1 -- 172.21.15.87:0/1673670990 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fafd80fd800 msgr2=0x7fafd810d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:22:33.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.849+0000 7fafdfd39640 1 --2- 172.21.15.87:0/1673670990 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fafd80fd800 0x7fafd810d560 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fafd40043d0 tx=0x7fafd4009da0 comp rx=0 tx=0).stop 2024-09-17T07:22:33.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.850+0000 7fafdfd39640 1 -- 172.21.15.87:0/1673670990 shutdown_connections 2024-09-17T07:22:33.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.850+0000 7fafdfd39640 1 --2- 172.21.15.87:0/1673670990 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fafd80fd800 0x7fafd810d560 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:33.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.850+0000 7fafdfd39640 1 --2- 172.21.15.87:0/1673670990 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fafc406ccc0 0x7fafc406f170 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:33.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.850+0000 7fafdfd39640 1 --2- 172.21.15.87:0/1673670990 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fafd80fc530 0x7fafd810d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:22:33.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.850+0000 7fafdfd39640 1 -- 172.21.15.87:0/1673670990 >> 172.21.15.87:0/1673670990 conn(0x7fafd80f7d10 msgr2=0x7fafd80f9610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:22:33.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.850+0000 7fafdfd39640 1 -- 172.21.15.87:0/1673670990 shutdown_connections 2024-09-17T07:22:33.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:22:33.850+0000 7fafdfd39640 1 -- 172.21.15.87:0/1673670990 wait complete. 2024-09-17T07:22:33.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:33 smithi087 ceph-mon[90982]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:22:33.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:33 smithi087 ceph-mon[90982]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:22:33.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:33 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:33.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:33 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:33.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:33 smithi087 ceph-mon[90982]: Reconfiguring osd.3 (monmap changed)... 2024-09-17T07:22:33.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:33 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-17T07:22:33.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:33 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:22:33.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:33 smithi087 ceph-mon[90982]: Reconfiguring daemon osd.3 on smithi139 2024-09-17T07:22:33.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:33 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/3321126085' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:22:33.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:33 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/2460605965' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T07:22:34.007 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:33 smithi139 ceph-mon[79872]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:22:34.008 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:33 smithi139 ceph-mon[79872]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:22:34.008 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:33 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:34.008 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:33 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:34.008 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:33 smithi139 ceph-mon[79872]: Reconfiguring osd.3 (monmap changed)... 2024-09-17T07:22:34.008 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:33 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-17T07:22:34.008 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:33 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:22:34.008 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:33 smithi139 ceph-mon[79872]: Reconfiguring daemon osd.3 on smithi139 2024-09-17T07:22:34.008 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:33 smithi139 ceph-mon[79872]: from='client.? 172.21.15.87:0/3321126085' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:22:34.008 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:33 smithi139 ceph-mon[79872]: from='client.? 172.21.15.87:0/2460605965' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T07:22:35.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:34 smithi139 ceph-mon[79872]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:22:35.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:34 smithi139 ceph-mon[79872]: from='client.? 172.21.15.87:0/1673670990' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T07:22:35.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:34 smithi139 ceph-mon[79872]: pgmap v21: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:22:35.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:34 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:35.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:34 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:35.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:34 smithi139 ceph-mon[79872]: Reconfiguring osd.4 (monmap changed)... 2024-09-17T07:22:35.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:34 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-17T07:22:35.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:34 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:22:35.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:34 smithi139 ceph-mon[79872]: Reconfiguring daemon osd.4 on smithi139 2024-09-17T07:22:35.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:34 smithi087 ceph-mon[90982]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:22:35.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:34 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/1673670990' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T07:22:35.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:34 smithi087 ceph-mon[90982]: pgmap v21: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:22:35.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:34 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:35.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:34 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:35.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:34 smithi087 ceph-mon[90982]: Reconfiguring osd.4 (monmap changed)... 2024-09-17T07:22:35.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:34 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-17T07:22:35.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:34 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:22:35.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:34 smithi087 ceph-mon[90982]: Reconfiguring daemon osd.4 on smithi139 2024-09-17T07:22:36.772 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:36 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:36.772 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:36 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:36.772 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:36 smithi139 ceph-mon[79872]: Reconfiguring osd.5 (monmap changed)... 2024-09-17T07:22:36.772 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:36 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-17T07:22:36.772 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:36 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:22:36.772 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:36 smithi139 ceph-mon[79872]: Reconfiguring daemon osd.5 on smithi139 2024-09-17T07:22:36.772 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:36 smithi139 ceph-mon[79872]: pgmap v22: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:22:36.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:36 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:36.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:36 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:36.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:36 smithi087 ceph-mon[90982]: Reconfiguring osd.5 (monmap changed)... 2024-09-17T07:22:36.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:36 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-17T07:22:36.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:36 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:22:36.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:36 smithi087 ceph-mon[90982]: Reconfiguring daemon osd.5 on smithi139 2024-09-17T07:22:36.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:36 smithi087 ceph-mon[90982]: pgmap v22: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:22:38.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:37 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:38.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:37 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:38.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:37 smithi139 ceph-mon[79872]: Reconfiguring mds.cephfs.smithi139.gnwonz (monmap changed)... 2024-09-17T07:22:38.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:37 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi139.gnwonz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T07:22:38.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:37 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:22:38.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:37 smithi139 ceph-mon[79872]: Reconfiguring daemon mds.cephfs.smithi139.gnwonz on smithi139 2024-09-17T07:22:38.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:37 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:38.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:37 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:38.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:37 smithi087 ceph-mon[90982]: Reconfiguring mds.cephfs.smithi139.gnwonz (monmap changed)... 2024-09-17T07:22:38.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:37 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi139.gnwonz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T07:22:38.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:37 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:22:38.178 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:37 smithi087 ceph-mon[90982]: Reconfiguring daemon mds.cephfs.smithi139.gnwonz on smithi139 2024-09-17T07:22:39.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:39 smithi139 ceph-mon[79872]: pgmap v23: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:22:39.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:39 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:39.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:39 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:39.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:39 smithi139 ceph-mon[79872]: Reconfiguring mds.cephfs.smithi139.ftvinf (monmap changed)... 2024-09-17T07:22:39.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:39 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi139.ftvinf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T07:22:39.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:39 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:22:39.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:39 smithi139 ceph-mon[79872]: Reconfiguring daemon mds.cephfs.smithi139.ftvinf on smithi139 2024-09-17T07:22:39.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:39 smithi087 ceph-mon[90982]: pgmap v23: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:22:39.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:39 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:39.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:39 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:39.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:39 smithi087 ceph-mon[90982]: Reconfiguring mds.cephfs.smithi139.ftvinf (monmap changed)... 2024-09-17T07:22:39.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:39 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi139.ftvinf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T07:22:39.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:39 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:22:39.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:39 smithi087 ceph-mon[90982]: Reconfiguring daemon mds.cephfs.smithi139.ftvinf on smithi139 2024-09-17T07:22:40.841 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:40 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:40.842 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:40 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:40.842 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:40 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:22:40.842 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:40 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:22:40.842 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:40 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:22:40.842 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:40 smithi087 ceph-mon[90982]: Upgrade: Setting container_image for all mon 2024-09-17T07:22:40.842 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:40 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:40.842 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:40 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi087"}]: dispatch 2024-09-17T07:22:40.842 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:40 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi087"}]': finished 2024-09-17T07:22:40.842 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:40 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi139"}]: dispatch 2024-09-17T07:22:40.842 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:40 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi139"}]': finished 2024-09-17T07:22:40.843 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:40 smithi087 ceph-mon[90982]: pgmap v24: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:22:40.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:40 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:40.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:40 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:40.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:40 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:22:40.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:40 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:22:40.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:40 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:22:40.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:40 smithi139 ceph-mon[79872]: Upgrade: Setting container_image for all mon 2024-09-17T07:22:40.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:40 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:40.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:40 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi087"}]: dispatch 2024-09-17T07:22:40.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:40 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi087"}]': finished 2024-09-17T07:22:40.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:40 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi139"}]: dispatch 2024-09-17T07:22:40.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:40 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi139"}]': finished 2024-09-17T07:22:40.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:40 smithi139 ceph-mon[79872]: pgmap v24: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:22:42.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:41 smithi087 ceph-mon[90982]: Upgrade: Updating crash.smithi087 (1/2) 2024-09-17T07:22:42.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:41 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:42.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:41 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi087", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-17T07:22:42.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:41 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:22:42.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:41 smithi087 ceph-mon[90982]: Deploying daemon crash.smithi087 on smithi087 2024-09-17T07:22:42.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:41 smithi139 ceph-mon[79872]: Upgrade: Updating crash.smithi087 (1/2) 2024-09-17T07:22:42.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:41 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:42.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:41 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi087", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-17T07:22:42.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:41 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:22:42.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:41 smithi139 ceph-mon[79872]: Deploying daemon crash.smithi087 on smithi087 2024-09-17T07:22:43.111 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:42 smithi087 ceph-mon[90982]: pgmap v25: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:22:43.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:42 smithi139 ceph-mon[79872]: pgmap v25: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:22:44.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:22:44.268 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:22:45.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:44 smithi087 ceph-mon[90982]: pgmap v26: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:22:45.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:44 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:45.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:44 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:45.188 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:44 smithi139 ceph-mon[79872]: pgmap v26: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:22:45.188 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:44 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:45.188 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:44 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:46.865 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:46 smithi139 ceph-mon[79872]: Upgrade: Updating crash.smithi139 (2/2) 2024-09-17T07:22:46.865 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:46 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:46.865 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:46 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi139", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-17T07:22:47.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:46 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:22:47.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:46 smithi139 ceph-mon[79872]: Deploying daemon crash.smithi139 on smithi139 2024-09-17T07:22:47.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:46 smithi139 ceph-mon[79872]: pgmap v27: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:22:47.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:46 smithi087 ceph-mon[90982]: Upgrade: Updating crash.smithi139 (2/2) 2024-09-17T07:22:47.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:46 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:47.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:46 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi139", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-17T07:22:47.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:46 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:22:47.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:46 smithi087 ceph-mon[90982]: Deploying daemon crash.smithi139 on smithi139 2024-09-17T07:22:47.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:46 smithi087 ceph-mon[90982]: pgmap v27: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:22:49.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:49 smithi139 ceph-mon[79872]: pgmap v28: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:22:49.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:49 smithi087 ceph-mon[90982]: pgmap v28: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:22:50.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:50 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:50.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:50 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:50.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:50 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:22:50.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:50 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:50.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:50 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:50.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:50 smithi087 ceph-mon[90982]: pgmap v29: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:22:50.718 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:50 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:50.718 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:50 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:50.718 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:50 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:22:50.718 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:50 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:50.718 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:50 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:50.718 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:50 smithi139 ceph-mon[79872]: pgmap v29: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:22:53.271 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:53 smithi139 ceph-mon[79872]: pgmap v30: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:22:53.271 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:53 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:53.271 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:53 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:53.271 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:53 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:53.271 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:53 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:53.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:53 smithi087 ceph-mon[90982]: pgmap v30: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:22:53.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:53 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:53.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:53 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:53.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:53 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:53.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:53 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:55.298 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:55 smithi087 ceph-mon[90982]: pgmap v31: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:22:55.298 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:55 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:55.298 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:55 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:55.298 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:55 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:55.298 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:55 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:55.334 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:55 smithi139 ceph-mon[79872]: pgmap v31: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:22:55.334 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:55 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:55.334 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:55 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:55.334 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:55 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:55.334 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:55 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:56.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:56 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:56.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:56 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:56.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:56 smithi087 ceph-mon[90982]: pgmap v32: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:22:57.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:56 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:57.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:56 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:57.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:56 smithi139 ceph-mon[79872]: pgmap v32: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:22:58.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:58 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:58.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:58 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:58.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:58 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:22:58.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:58 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:22:58.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:58 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:58.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:58 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:22:58.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:58 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:22:58.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:58 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:22:58.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:58 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:22:58.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:58 smithi087 ceph-mon[90982]: Upgrade: Setting container_image for all crash 2024-09-17T07:22:58.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:58 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:58.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:58 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi087"}]: dispatch 2024-09-17T07:22:58.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:58 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi087"}]': finished 2024-09-17T07:22:58.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:58 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi139"}]: dispatch 2024-09-17T07:22:58.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:58 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi139"}]': finished 2024-09-17T07:22:58.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:58 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-17T07:22:58.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:58 smithi087 ceph-mon[90982]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-17T07:22:58.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:58 smithi087 ceph-mon[90982]: Upgrade: osd.0 is safe to restart 2024-09-17T07:22:58.928 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:58 smithi087 ceph-mon[90982]: pgmap v33: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:22:58.928 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:22:58 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:22:59.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:58 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:59.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:58 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:59.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:58 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:22:59.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:58 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:22:59.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:58 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:59.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:58 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:22:59.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:58 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:22:59.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:58 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:22:59.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:58 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:22:59.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:58 smithi139 ceph-mon[79872]: Upgrade: Setting container_image for all crash 2024-09-17T07:22:59.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:58 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:22:59.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:58 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi087"}]: dispatch 2024-09-17T07:22:59.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:58 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi087"}]': finished 2024-09-17T07:22:59.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:58 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi139"}]: dispatch 2024-09-17T07:22:59.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:58 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi139"}]': finished 2024-09-17T07:22:59.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:58 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-17T07:22:59.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:58 smithi139 ceph-mon[79872]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-17T07:22:59.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:58 smithi139 ceph-mon[79872]: Upgrade: osd.0 is safe to restart 2024-09-17T07:22:59.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:58 smithi139 ceph-mon[79872]: pgmap v33: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:22:59.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:22:58 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:23:00.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:00 smithi087 ceph-mon[90982]: Upgrade: Updating osd.0 2024-09-17T07:23:00.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:00 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:23:00.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:00 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-17T07:23:00.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:00 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:23:00.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:00 smithi087 ceph-mon[90982]: Deploying daemon osd.0 on smithi087 2024-09-17T07:23:00.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:00 smithi087 ceph-mon[90982]: pgmap v34: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:23:01.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:00 smithi139 ceph-mon[79872]: Upgrade: Updating osd.0 2024-09-17T07:23:01.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:00 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:23:01.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:00 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-17T07:23:01.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:00 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:23:01.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:00 smithi139 ceph-mon[79872]: Deploying daemon osd.0 on smithi087 2024-09-17T07:23:01.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:00 smithi139 ceph-mon[79872]: pgmap v34: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:23:03.114 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 17 07:23:02 smithi087 systemd[1]: Stopping Ceph osd.0 for d5dbf8d6-74c3-11ef-bceb-c7b262605968... 2024-09-17T07:23:03.114 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 17 07:23:03 smithi087 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-0[45497]: 2024-09-17T07:23:03.052+0000 7f3e373b2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T07:23:03.114 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 17 07:23:03 smithi087 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-0[45497]: 2024-09-17T07:23:03.052+0000 7f3e373b2640 -1 osd.0 47 *** Got signal Terminated *** 2024-09-17T07:23:03.114 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 17 07:23:03 smithi087 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-0[45497]: 2024-09-17T07:23:03.052+0000 7f3e373b2640 -1 osd.0 47 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T07:23:03.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:03 smithi139 ceph-mon[79872]: pgmap v35: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:23:03.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:03 smithi139 ceph-mon[79872]: osd.0 marked itself down and dead 2024-09-17T07:23:03.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:03 smithi087 ceph-mon[90982]: pgmap v35: 65 pgs: 65 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:23:03.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:03 smithi087 ceph-mon[90982]: osd.0 marked itself down and dead 2024-09-17T07:23:03.919 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 17 07:23:03 smithi087 podman[98971]: 2024-09-17 07:23:03.644676664 +0000 UTC m=+0.684201748 container died 396801f9b539808a6aa2466e3509ff55b3ed8404e5d0b12529b35cab91a98419 (image=quay.ceph.io/ceph-ci/ceph@sha256:c5428a59091f5674ce6e26540d9db0f28844a507e2a324b8305a00f1687ce028, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-0, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=quincy-4a70413) 2024-09-17T07:23:03.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:03.934+0000 7f7fced2a640 1 -- 172.21.15.87:0/4210032565 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fc80fc740 msgr2=0x7f7fc80fcbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:23:03.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:03.934+0000 7f7fced2a640 1 --2- 172.21.15.87:0/4210032565 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fc80fc740 0x7f7fc80fcbb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7fb40048d0 tx=0x7f7fb4009da0 comp rx=0 tx=0).stop 2024-09-17T07:23:03.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:03.934+0000 7f7fced2a640 1 -- 172.21.15.87:0/4210032565 shutdown_connections 2024-09-17T07:23:03.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:03.934+0000 7f7fced2a640 1 --2- 172.21.15.87:0/4210032565 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fc80fc740 0x7f7fc80fcbb0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:03.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:03.934+0000 7f7fced2a640 1 --2- 172.21.15.87:0/4210032565 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7fc80fb470 0x7f7fc80fb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:03.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:03.934+0000 7f7fced2a640 1 -- 172.21.15.87:0/4210032565 >> 172.21.15.87:0/4210032565 conn(0x7f7fc80f6c30 msgr2=0x7f7fc80f9060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:23:03.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:03.934+0000 7f7fced2a640 1 -- 172.21.15.87:0/4210032565 shutdown_connections 2024-09-17T07:23:03.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:03.934+0000 7f7fced2a640 1 -- 172.21.15.87:0/4210032565 wait complete. 2024-09-17T07:23:03.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:03.934+0000 7f7fced2a640 1 Processor -- start 2024-09-17T07:23:03.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:03.934+0000 7f7fced2a640 1 -- start start 2024-09-17T07:23:03.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:03.935+0000 7f7fced2a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fc80fb470 0x7f7fc810fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:23:03.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:03.935+0000 7f7fced2a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7fc80fc740 0x7f7fc8112270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:23:03.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:03.935+0000 7f7fced2a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc8066750 con 0x7f7fc80fb470 2024-09-17T07:23:03.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:03.935+0000 7f7fced2a640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc80668c0 con 0x7f7fc80fc740 2024-09-17T07:23:03.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:03.935+0000 7f7fccac6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fc80fb470 0x7f7fc810fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:23:03.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:03.935+0000 7f7fccac6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fc80fb470 0x7f7fc810fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60236/0 (socket says 172.21.15.87:60236) 2024-09-17T07:23:03.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:03.935+0000 7f7fccac6640 1 -- 172.21.15.87:0/3663576785 learned_addr learned my addr 172.21.15.87:0/3663576785 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:23:03.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:03.935+0000 7f7fc7fff640 1 --2- 172.21.15.87:0/3663576785 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7fc80fc740 0x7f7fc8112270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:23:03.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:03.935+0000 7f7fccac6640 1 -- 172.21.15.87:0/3663576785 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7fc80fc740 msgr2=0x7f7fc8112270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:23:03.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:03.935+0000 7f7fccac6640 1 --2- 172.21.15.87:0/3663576785 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7fc80fc740 0x7f7fc8112270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:03.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:03.935+0000 7f7fccac6640 1 -- 172.21.15.87:0/3663576785 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fb4005040 con 0x7f7fc80fb470 2024-09-17T07:23:03.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:03.935+0000 7f7fccac6640 1 --2- 172.21.15.87:0/3663576785 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fc80fb470 0x7f7fc810fd20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc00c830 tx=0x7f7fbc004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:23:03.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:03.935+0000 7f7fc57fa640 1 -- 172.21.15.87:0/3663576785 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7fbc00a850 con 0x7f7fc80fb470 2024-09-17T07:23:03.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:03.935+0000 7f7fced2a640 1 -- 172.21.15.87:0/3663576785 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fc8112810 con 0x7f7fc80fb470 2024-09-17T07:23:03.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:03.935+0000 7f7fc57fa640 1 -- 172.21.15.87:0/3663576785 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f7fbc00ae30 con 0x7f7fc80fb470 2024-09-17T07:23:03.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:03.935+0000 7f7fc57fa640 1 -- 172.21.15.87:0/3663576785 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7fbc0113a0 con 0x7f7fc80fb470 2024-09-17T07:23:03.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:03.936+0000 7f7fced2a640 1 -- 172.21.15.87:0/3663576785 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fc8112d80 con 0x7f7fc80fb470 2024-09-17T07:23:03.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:03.937+0000 7f7fced2a640 1 -- 172.21.15.87:0/3663576785 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fc80fa8d0 con 0x7f7fc80fb470 2024-09-17T07:23:03.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:03.937+0000 7f7fc57fa640 1 -- 172.21.15.87:0/3663576785 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 38) v1 ==== 90952+0+0 (secure 0 0 0) 0x7f7fbc012400 con 0x7f7fc80fb470 2024-09-17T07:23:03.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:03.937+0000 7f7fc57fa640 1 --2- 172.21.15.87:0/3663576785 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f7fb806ccc0 0x7f7fb806f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:23:03.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:03.938+0000 7f7fc57fa640 1 -- 172.21.15.87:0/3663576785 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f7fbc08c3c0 con 0x7f7fc80fb470 2024-09-17T07:23:03.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:03.938+0000 7f7fc7fff640 1 --2- 172.21.15.87:0/3663576785 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f7fb806ccc0 0x7f7fb806f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:23:03.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:03.938+0000 7f7fc7fff640 1 --2- 172.21.15.87:0/3663576785 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f7fb806ccc0 0x7f7fb806f170 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7fb400b020 tx=0x7f7fb4035040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:23:03.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:03.942+0000 7f7fc57fa640 1 -- 172.21.15.87:0/3663576785 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7fbc056340 con 0x7f7fc80fb470 2024-09-17T07:23:04.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.124+0000 7f7fced2a640 1 -- 172.21.15.87:0/3663576785 --> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7fc8100c30 con 0x7f7fb806ccc0 2024-09-17T07:23:04.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.125+0000 7f7fc57fa640 1 -- 172.21.15.87:0/3663576785 <== mgr.24529 v2:172.21.15.87:6800/1359413180 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f7fc8100c30 con 0x7f7fb806ccc0 2024-09-17T07:23:04.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.127+0000 7f7fced2a640 1 -- 172.21.15.87:0/3663576785 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f7fb806ccc0 msgr2=0x7f7fb806f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:23:04.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.127+0000 7f7fced2a640 1 --2- 172.21.15.87:0/3663576785 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f7fb806ccc0 0x7f7fb806f170 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7fb400b020 tx=0x7f7fb4035040 comp rx=0 tx=0).stop 2024-09-17T07:23:04.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.127+0000 7f7fced2a640 1 -- 172.21.15.87:0/3663576785 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fc80fb470 msgr2=0x7f7fc810fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:23:04.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.127+0000 7f7fced2a640 1 --2- 172.21.15.87:0/3663576785 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fc80fb470 0x7f7fc810fd20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc00c830 tx=0x7f7fbc004430 comp rx=0 tx=0).stop 2024-09-17T07:23:04.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.130+0000 7f7fced2a640 1 -- 172.21.15.87:0/3663576785 shutdown_connections 2024-09-17T07:23:04.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.130+0000 7f7fced2a640 1 --2- 172.21.15.87:0/3663576785 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f7fb806ccc0 0x7f7fb806f170 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:04.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.130+0000 7f7fced2a640 1 --2- 172.21.15.87:0/3663576785 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7fc80fc740 0x7f7fc8112270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:04.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.130+0000 7f7fced2a640 1 --2- 172.21.15.87:0/3663576785 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fc80fb470 0x7f7fc810fd20 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:04.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.130+0000 7f7fced2a640 1 -- 172.21.15.87:0/3663576785 >> 172.21.15.87:0/3663576785 conn(0x7f7fc80f6c30 msgr2=0x7f7fc80f8470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:23:04.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.130+0000 7f7fced2a640 1 -- 172.21.15.87:0/3663576785 shutdown_connections 2024-09-17T07:23:04.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.130+0000 7f7fced2a640 1 -- 172.21.15.87:0/3663576785 wait complete. 2024-09-17T07:23:04.141 INFO:teuthology.orchestra.run.smithi087.stdout:true 2024-09-17T07:23:04.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:04 smithi087 ceph-mon[90982]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T07:23:04.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:04 smithi087 ceph-mon[90982]: osdmap e48: 6 total, 5 up, 6 in 2024-09-17T07:23:04.176 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 17 07:23:04 smithi087 podman[98971]: 2024-09-17 07:23:04.085248779 +0000 UTC m=+1.124773855 container cleanup 396801f9b539808a6aa2466e3509ff55b3ed8404e5d0b12529b35cab91a98419 (image=quay.ceph.io/ceph-ci/ceph@sha256:c5428a59091f5674ce6e26540d9db0f28844a507e2a324b8305a00f1687ce028, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=quincy-4a70413, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-17T07:23:04.176 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 17 07:23:04 smithi087 bash[98971]: ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-0 2024-09-17T07:23:04.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.214+0000 7f55fa4c1640 1 -- 172.21.15.87:0/1842416869 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55f40fb430 msgr2=0x7f55f40fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:23:04.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.214+0000 7f55fa4c1640 1 --2- 172.21.15.87:0/1842416869 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55f40fb430 0x7f55f40fb840 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f55e40048d0 tx=0x7f55e4009da0 comp rx=0 tx=0).stop 2024-09-17T07:23:04.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.214+0000 7f55fa4c1640 1 -- 172.21.15.87:0/1842416869 shutdown_connections 2024-09-17T07:23:04.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.214+0000 7f55fa4c1640 1 --2- 172.21.15.87:0/1842416869 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f55f40fc700 0x7f55f40fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:04.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.214+0000 7f55fa4c1640 1 --2- 172.21.15.87:0/1842416869 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55f40fb430 0x7f55f40fb840 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:04.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.214+0000 7f55fa4c1640 1 -- 172.21.15.87:0/1842416869 >> 172.21.15.87:0/1842416869 conn(0x7f55f40f6c10 msgr2=0x7f55f40f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:23:04.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.214+0000 7f55fa4c1640 1 -- 172.21.15.87:0/1842416869 shutdown_connections 2024-09-17T07:23:04.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.214+0000 7f55fa4c1640 1 -- 172.21.15.87:0/1842416869 wait complete. 2024-09-17T07:23:04.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.214+0000 7f55fa4c1640 1 Processor -- start 2024-09-17T07:23:04.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.215+0000 7f55fa4c1640 1 -- start start 2024-09-17T07:23:04.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.215+0000 7f55fa4c1640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f55f40fb430 0x7f55f40ff550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:23:04.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.215+0000 7f55fa4c1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55f40fc700 0x7f55f40fda40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:23:04.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.215+0000 7f55fa4c1640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f40fdfd0 con 0x7f55f40fc700 2024-09-17T07:23:04.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.215+0000 7f55fa4c1640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f40fe110 con 0x7f55f40fb430 2024-09-17T07:23:04.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.215+0000 7f55f37fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55f40fc700 0x7f55f40fda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:23:04.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.215+0000 7f55f37fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55f40fc700 0x7f55f40fda40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56092/0 (socket says 172.21.15.87:56092) 2024-09-17T07:23:04.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.215+0000 7f55f37fe640 1 -- 172.21.15.87:0/204956140 learned_addr learned my addr 172.21.15.87:0/204956140 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:23:04.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.215+0000 7f55f3fff640 1 --2- 172.21.15.87:0/204956140 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f55f40fb430 0x7f55f40ff550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:23:04.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.215+0000 7f55f37fe640 1 -- 172.21.15.87:0/204956140 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f55f40fb430 msgr2=0x7f55f40ff550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:23:04.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.215+0000 7f55f37fe640 1 --2- 172.21.15.87:0/204956140 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f55f40fb430 0x7f55f40ff550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:04.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.215+0000 7f55f37fe640 1 -- 172.21.15.87:0/204956140 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55e4005040 con 0x7f55f40fc700 2024-09-17T07:23:04.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.216+0000 7f55f37fe640 1 --2- 172.21.15.87:0/204956140 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55f40fc700 0x7f55f40fda40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f55e800c790 tx=0x7f55e80043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:23:04.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.216+0000 7f55f0ff9640 1 -- 172.21.15.87:0/204956140 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55e800a820 con 0x7f55f40fc700 2024-09-17T07:23:04.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.216+0000 7f55f0ff9640 1 -- 172.21.15.87:0/204956140 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f55e800ae00 con 0x7f55f40fc700 2024-09-17T07:23:04.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.216+0000 7f55fa4c1640 1 -- 172.21.15.87:0/204956140 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55f40fe3f0 con 0x7f55f40fc700 2024-09-17T07:23:04.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.216+0000 7f55f0ff9640 1 -- 172.21.15.87:0/204956140 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55e80113a0 con 0x7f55f40fc700 2024-09-17T07:23:04.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.216+0000 7f55fa4c1640 1 -- 172.21.15.87:0/204956140 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55f4115000 con 0x7f55f40fc700 2024-09-17T07:23:04.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.217+0000 7f55fa4c1640 1 -- 172.21.15.87:0/204956140 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55f40fa890 con 0x7f55f40fc700 2024-09-17T07:23:04.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.217+0000 7f55f0ff9640 1 -- 172.21.15.87:0/204956140 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 38) v1 ==== 90952+0+0 (secure 0 0 0) 0x7f55e800a980 con 0x7f55f40fc700 2024-09-17T07:23:04.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.218+0000 7f55f0ff9640 1 --2- 172.21.15.87:0/204956140 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f55dc06ccc0 0x7f55dc06f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:23:04.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.218+0000 7f55f0ff9640 1 -- 172.21.15.87:0/204956140 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f55e808c270 con 0x7f55f40fc700 2024-09-17T07:23:04.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.218+0000 7f55f3fff640 1 --2- 172.21.15.87:0/204956140 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f55dc06ccc0 0x7f55dc06f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:23:04.219 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.218+0000 7f55f3fff640 1 --2- 172.21.15.87:0/204956140 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f55dc06ccc0 0x7f55dc06f170 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f55e4009ac0 tx=0x7f55e4035040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:23:04.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.222+0000 7f55f0ff9640 1 -- 172.21.15.87:0/204956140 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f55e8056290 con 0x7f55f40fc700 2024-09-17T07:23:04.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:04 smithi139 ceph-mon[79872]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T07:23:04.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:04 smithi139 ceph-mon[79872]: osdmap e48: 6 total, 5 up, 6 in 2024-09-17T07:23:04.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.401+0000 7f55fa4c1640 1 -- 172.21.15.87:0/204956140 --> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f55f4065710 con 0x7f55dc06ccc0 2024-09-17T07:23:04.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.402+0000 7f55f0ff9640 1 -- 172.21.15.87:0/204956140 <== mgr.24529 v2:172.21.15.87:6800/1359413180 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f55f4065710 con 0x7f55dc06ccc0 2024-09-17T07:23:04.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.404+0000 7f55fa4c1640 1 -- 172.21.15.87:0/204956140 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f55dc06ccc0 msgr2=0x7f55dc06f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:23:04.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.404+0000 7f55fa4c1640 1 --2- 172.21.15.87:0/204956140 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f55dc06ccc0 0x7f55dc06f170 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f55e4009ac0 tx=0x7f55e4035040 comp rx=0 tx=0).stop 2024-09-17T07:23:04.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.404+0000 7f55fa4c1640 1 -- 172.21.15.87:0/204956140 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55f40fc700 msgr2=0x7f55f40fda40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:23:04.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.404+0000 7f55fa4c1640 1 --2- 172.21.15.87:0/204956140 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55f40fc700 0x7f55f40fda40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f55e800c790 tx=0x7f55e80043c0 comp rx=0 tx=0).stop 2024-09-17T07:23:04.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.404+0000 7f55fa4c1640 1 -- 172.21.15.87:0/204956140 shutdown_connections 2024-09-17T07:23:04.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.404+0000 7f55fa4c1640 1 --2- 172.21.15.87:0/204956140 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55f40fc700 0x7f55f40fda40 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:04.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.404+0000 7f55fa4c1640 1 --2- 172.21.15.87:0/204956140 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f55dc06ccc0 0x7f55dc06f170 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:04.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.404+0000 7f55fa4c1640 1 --2- 172.21.15.87:0/204956140 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f55f40fb430 0x7f55f40ff550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:04.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.404+0000 7f55fa4c1640 1 -- 172.21.15.87:0/204956140 >> 172.21.15.87:0/204956140 conn(0x7f55f40f6c10 msgr2=0x7f55f4065000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:23:04.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.404+0000 7f55fa4c1640 1 -- 172.21.15.87:0/204956140 shutdown_connections 2024-09-17T07:23:04.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.404+0000 7f55fa4c1640 1 -- 172.21.15.87:0/204956140 wait complete. 2024-09-17T07:23:04.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.483+0000 7fe9ffffb640 1 -- 172.21.15.87:0/1677392235 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9f80fc700 msgr2=0x7fe9f80fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:23:04.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.483+0000 7fe9ffffb640 1 --2- 172.21.15.87:0/1677392235 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9f80fc700 0x7fe9f80fcb70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe9e80048d0 tx=0x7fe9e8009da0 comp rx=0 tx=0).stop 2024-09-17T07:23:04.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.484+0000 7fe9ffffb640 1 -- 172.21.15.87:0/1677392235 shutdown_connections 2024-09-17T07:23:04.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.484+0000 7fe9ffffb640 1 --2- 172.21.15.87:0/1677392235 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9f80fc700 0x7fe9f80fcb70 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:04.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.484+0000 7fe9ffffb640 1 --2- 172.21.15.87:0/1677392235 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe9f80fb430 0x7fe9f80fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:04.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.484+0000 7fe9ffffb640 1 -- 172.21.15.87:0/1677392235 >> 172.21.15.87:0/1677392235 conn(0x7fe9f80f6c10 msgr2=0x7fe9f80f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:23:04.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.484+0000 7fe9ffffb640 1 -- 172.21.15.87:0/1677392235 shutdown_connections 2024-09-17T07:23:04.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.484+0000 7fe9ffffb640 1 -- 172.21.15.87:0/1677392235 wait complete. 2024-09-17T07:23:04.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.484+0000 7fe9ffffb640 1 Processor -- start 2024-09-17T07:23:04.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.484+0000 7fe9ffffb640 1 -- start start 2024-09-17T07:23:04.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.484+0000 7fe9ffffb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9f80fb430 0x7fe9f810fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:23:04.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.484+0000 7fe9ffffb640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe9f80fc700 0x7fe9f8112290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:23:04.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.484+0000 7fe9ffffb640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f8065cf0 con 0x7fe9f80fb430 2024-09-17T07:23:04.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.484+0000 7fe9ffffb640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f8065e60 con 0x7fe9f80fc700 2024-09-17T07:23:04.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.485+0000 7fe9fdd97640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9f80fb430 0x7fe9f810fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:23:04.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.485+0000 7fe9fdd97640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9f80fb430 0x7fe9f810fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56102/0 (socket says 172.21.15.87:56102) 2024-09-17T07:23:04.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.485+0000 7fe9fdd97640 1 -- 172.21.15.87:0/1934819896 learned_addr learned my addr 172.21.15.87:0/1934819896 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:23:04.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.485+0000 7fe9fd596640 1 --2- 172.21.15.87:0/1934819896 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe9f80fc700 0x7fe9f8112290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:23:04.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.485+0000 7fe9fdd97640 1 -- 172.21.15.87:0/1934819896 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe9f80fc700 msgr2=0x7fe9f8112290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:23:04.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.485+0000 7fe9fdd97640 1 --2- 172.21.15.87:0/1934819896 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe9f80fc700 0x7fe9f8112290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:04.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.485+0000 7fe9fdd97640 1 -- 172.21.15.87:0/1934819896 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e8005040 con 0x7fe9f80fb430 2024-09-17T07:23:04.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.485+0000 7fe9fdd97640 1 --2- 172.21.15.87:0/1934819896 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9f80fb430 0x7fe9f810fd40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe9f400b790 tx=0x7fe9f40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:23:04.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.485+0000 7fe9ee7fc640 1 -- 172.21.15.87:0/1934819896 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9f400c700 con 0x7fe9f80fb430 2024-09-17T07:23:04.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.485+0000 7fe9ee7fc640 1 -- 172.21.15.87:0/1934819896 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fe9f400cce0 con 0x7fe9f80fb430 2024-09-17T07:23:04.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.485+0000 7fe9ffffb640 1 -- 172.21.15.87:0/1934819896 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9f8112890 con 0x7fe9f80fb430 2024-09-17T07:23:04.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.485+0000 7fe9ee7fc640 1 -- 172.21.15.87:0/1934819896 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9f4015e30 con 0x7fe9f80fb430 2024-09-17T07:23:04.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.485+0000 7fe9ffffb640 1 -- 172.21.15.87:0/1934819896 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9f8112db0 con 0x7fe9f80fb430 2024-09-17T07:23:04.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.486+0000 7fe9ffffb640 1 -- 172.21.15.87:0/1934819896 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9f80fa890 con 0x7fe9f80fb430 2024-09-17T07:23:04.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.487+0000 7fe9ee7fc640 1 -- 172.21.15.87:0/1934819896 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 38) v1 ==== 90952+0+0 (secure 0 0 0) 0x7fe9f4012070 con 0x7fe9f80fb430 2024-09-17T07:23:04.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.487+0000 7fe9ee7fc640 1 --2- 172.21.15.87:0/1934819896 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fe9e406ccc0 0x7fe9e406f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:23:04.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.487+0000 7fe9ee7fc640 1 -- 172.21.15.87:0/1934819896 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fe9f408ba50 con 0x7fe9f80fb430 2024-09-17T07:23:04.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.487+0000 7fe9fd596640 1 --2- 172.21.15.87:0/1934819896 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fe9e406ccc0 0x7fe9e406f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:23:04.490 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.488+0000 7fe9fd596640 1 --2- 172.21.15.87:0/1934819896 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fe9e406ccc0 0x7fe9e406f170 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe9e8000c00 tx=0x7fe9e8035040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:23:04.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.492+0000 7fe9ee7fc640 1 -- 172.21.15.87:0/1934819896 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe9f40559d0 con 0x7fe9f80fb430 2024-09-17T07:23:04.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.683+0000 7fe9ffffb640 1 -- 172.21.15.87:0/1934819896 --> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe9f8100bf0 con 0x7fe9e406ccc0 2024-09-17T07:23:04.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.692+0000 7fe9ee7fc640 1 -- 172.21.15.87:0/1934819896 <== mgr.24529 v2:172.21.15.87:6800/1359413180 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fe9f8100bf0 con 0x7fe9e406ccc0 2024-09-17T07:23:04.693 INFO:teuthology.orchestra.run.smithi087.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T07:23:04.693 INFO:teuthology.orchestra.run.smithi087.stdout:alertmanager.smithi087 smithi087 *:9093,9094 running (2m) 10s ago 11m 18.5M - 0.25.0 c8568f914cd2 594553f0b497 2024-09-17T07:23:04.693 INFO:teuthology.orchestra.run.smithi087.stdout:crash.smithi087 smithi087 running (20s) 10s ago 11m 6895k - 18.2.4-855-g19e2a2be 980a0bfcd684 0ff8a9330162 2024-09-17T07:23:04.693 INFO:teuthology.orchestra.run.smithi087.stdout:crash.smithi139 smithi139 running (15s) 12s ago 10m 6899k - 18.2.4-855-g19e2a2be 980a0bfcd684 10541e3b202e 2024-09-17T07:23:04.693 INFO:teuthology.orchestra.run.smithi087.stdout:grafana.smithi087 smithi087 *:3000 running (2m) 10s ago 10m 79.9M - 9.4.7 954c08fa6188 e2f17ec6baa8 2024-09-17T07:23:04.694 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi087.tjhpcs smithi087 running (5m) 10s ago 5m 130M - 17.2.7-1635-g4a704134 f22ead590bad f7142ad971ed 2024-09-17T07:23:04.694 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi087.vvbzss smithi087 running (5m) 10s ago 5m 70.0M - 17.2.7-1635-g4a704134 f22ead590bad 2dd82ff293d1 2024-09-17T07:23:04.694 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi139.ftvinf smithi139 running (5m) 12s ago 5m 57.4M - 17.2.7-1635-g4a704134 f22ead590bad d11edb295ad3 2024-09-17T07:23:04.694 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi139.gnwonz smithi139 running (5m) 12s ago 5m 116M - 17.2.7-1635-g4a704134 f22ead590bad 3b3d884aef02 2024-09-17T07:23:04.694 INFO:teuthology.orchestra.run.smithi087.stdout:mgr.smithi087.vuvjer smithi087 *:8443,9283,8765 running (119s) 10s ago 12m 482M - 18.2.4-855-g19e2a2be 980a0bfcd684 5d10c647cb6b 2024-09-17T07:23:04.694 INFO:teuthology.orchestra.run.smithi087.stdout:mgr.smithi139.tuqnpn smithi139 *:8443,9283,8765 running (85s) 12s ago 10m 437M - 18.2.4-855-g19e2a2be 980a0bfcd684 6e0bf371d44c 2024-09-17T07:23:04.694 INFO:teuthology.orchestra.run.smithi087.stdout:mon.smithi087 smithi087 running (73s) 10s ago 12m 40.3M 2048M 18.2.4-855-g19e2a2be 980a0bfcd684 305c72de1f9f 2024-09-17T07:23:04.694 INFO:teuthology.orchestra.run.smithi087.stdout:mon.smithi139 smithi139 running (54s) 12s ago 10m 34.0M 2048M 18.2.4-855-g19e2a2be 980a0bfcd684 0b159495af0f 2024-09-17T07:23:04.694 INFO:teuthology.orchestra.run.smithi087.stdout:node-exporter.smithi087 smithi087 *:9100 running (2m) 10s ago 11m 15.4M - 1.5.0 0da6a335fe13 39fa48de0e87 2024-09-17T07:23:04.694 INFO:teuthology.orchestra.run.smithi087.stdout:node-exporter.smithi139 smithi139 *:9100 running (2m) 12s ago 10m 15.6M - 1.5.0 0da6a335fe13 a5b99b7cbb06 2024-09-17T07:23:04.694 INFO:teuthology.orchestra.run.smithi087.stdout:osd.0 smithi087 running (9m) 10s ago 9m 193M 1557M 17.2.7-1635-g4a704134 f22ead590bad 396801f9b539 2024-09-17T07:23:04.694 INFO:teuthology.orchestra.run.smithi087.stdout:osd.1 smithi087 running (8m) 10s ago 8m 193M 1557M 17.2.7-1635-g4a704134 f22ead590bad 9446985bfcd1 2024-09-17T07:23:04.694 INFO:teuthology.orchestra.run.smithi087.stdout:osd.2 smithi087 running (8m) 10s ago 8m 162M 1557M 17.2.7-1635-g4a704134 f22ead590bad 8fe1428a6878 2024-09-17T07:23:04.694 INFO:teuthology.orchestra.run.smithi087.stdout:osd.3 smithi139 running (8m) 12s ago 8m 234M 2581M 17.2.7-1635-g4a704134 f22ead590bad 0801999b17c4 2024-09-17T07:23:04.694 INFO:teuthology.orchestra.run.smithi087.stdout:osd.4 smithi139 running (7m) 12s ago 7m 210M 2581M 17.2.7-1635-g4a704134 f22ead590bad 299a8dfc47f5 2024-09-17T07:23:04.695 INFO:teuthology.orchestra.run.smithi087.stdout:osd.5 smithi139 running (7m) 12s ago 7m 200M 2581M 17.2.7-1635-g4a704134 f22ead590bad 609cf74f32e7 2024-09-17T07:23:04.695 INFO:teuthology.orchestra.run.smithi087.stdout:prometheus.smithi087 smithi087 *:9095 running (90s) 10s ago 10m 54.0M - 2.43.0 a07b618ecd1d 63d18b7469fc 2024-09-17T07:23:04.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.694+0000 7fe9ffffb640 1 -- 172.21.15.87:0/1934819896 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fe9e406ccc0 msgr2=0x7fe9e406f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:23:04.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.694+0000 7fe9ffffb640 1 --2- 172.21.15.87:0/1934819896 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fe9e406ccc0 0x7fe9e406f170 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe9e8000c00 tx=0x7fe9e8035040 comp rx=0 tx=0).stop 2024-09-17T07:23:04.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.694+0000 7fe9ffffb640 1 -- 172.21.15.87:0/1934819896 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9f80fb430 msgr2=0x7fe9f810fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:23:04.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.694+0000 7fe9ffffb640 1 --2- 172.21.15.87:0/1934819896 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9f80fb430 0x7fe9f810fd40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe9f400b790 tx=0x7fe9f40091d0 comp rx=0 tx=0).stop 2024-09-17T07:23:04.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.694+0000 7fe9ffffb640 1 -- 172.21.15.87:0/1934819896 shutdown_connections 2024-09-17T07:23:04.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.694+0000 7fe9ffffb640 1 --2- 172.21.15.87:0/1934819896 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fe9e406ccc0 0x7fe9e406f170 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:04.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.694+0000 7fe9ffffb640 1 --2- 172.21.15.87:0/1934819896 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe9f80fc700 0x7fe9f8112290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:04.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.694+0000 7fe9ffffb640 1 --2- 172.21.15.87:0/1934819896 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9f80fb430 0x7fe9f810fd40 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:04.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.694+0000 7fe9ffffb640 1 -- 172.21.15.87:0/1934819896 >> 172.21.15.87:0/1934819896 conn(0x7fe9f80f6c10 msgr2=0x7fe9f80f8440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:23:04.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.694+0000 7fe9ffffb640 1 -- 172.21.15.87:0/1934819896 shutdown_connections 2024-09-17T07:23:04.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.694+0000 7fe9ffffb640 1 -- 172.21.15.87:0/1934819896 wait complete. 2024-09-17T07:23:04.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.776+0000 7f5876c88640 1 -- 172.21.15.87:0/3936991999 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58700fc550 msgr2=0x7f58700fc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:23:04.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.776+0000 7f5876c88640 1 --2- 172.21.15.87:0/3936991999 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58700fc550 0x7f58700fc960 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f58640048d0 tx=0x7f5864009da0 comp rx=0 tx=0).stop 2024-09-17T07:23:04.778 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 17 07:23:04 smithi087 podman[98985]: 2024-09-17 07:23:04.504627313 +0000 UTC m=+0.853865588 container remove 396801f9b539808a6aa2466e3509ff55b3ed8404e5d0b12529b35cab91a98419 (image=quay.ceph.io/ceph-ci/ceph@sha256:c5428a59091f5674ce6e26540d9db0f28844a507e2a324b8305a00f1687ce028, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=quincy-4a70413, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-17T07:23:04.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.776+0000 7f5876c88640 1 -- 172.21.15.87:0/3936991999 shutdown_connections 2024-09-17T07:23:04.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.776+0000 7f5876c88640 1 --2- 172.21.15.87:0/3936991999 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f58700fd820 0x7f58700fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:04.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.777+0000 7f5876c88640 1 --2- 172.21.15.87:0/3936991999 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58700fc550 0x7f58700fc960 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:04.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.777+0000 7f5876c88640 1 -- 172.21.15.87:0/3936991999 >> 172.21.15.87:0/3936991999 conn(0x7f58700f7d30 msgr2=0x7f58700fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:23:04.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.777+0000 7f5876c88640 1 -- 172.21.15.87:0/3936991999 shutdown_connections 2024-09-17T07:23:04.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.777+0000 7f5876c88640 1 -- 172.21.15.87:0/3936991999 wait complete. 2024-09-17T07:23:04.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.777+0000 7f5876c88640 1 Processor -- start 2024-09-17T07:23:04.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.777+0000 7f5876c88640 1 -- start start 2024-09-17T07:23:04.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.778+0000 7f5876c88640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58700fc550 0x7f587010cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:23:04.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.778+0000 7f5876c88640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f58700fd820 0x7f587010d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:23:04.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.778+0000 7f5876c88640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f587010db70 con 0x7f58700fc550 2024-09-17T07:23:04.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.778+0000 7f5876c88640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f587010e390 con 0x7f58700fd820 2024-09-17T07:23:04.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.778+0000 7f5874a24640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58700fc550 0x7f587010cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:23:04.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.778+0000 7f5874a24640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58700fc550 0x7f587010cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56112/0 (socket says 172.21.15.87:56112) 2024-09-17T07:23:04.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.778+0000 7f5874a24640 1 -- 172.21.15.87:0/3472152430 learned_addr learned my addr 172.21.15.87:0/3472152430 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:23:04.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.778+0000 7f586ffff640 1 --2- 172.21.15.87:0/3472152430 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f58700fd820 0x7f587010d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:23:04.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.778+0000 7f586ffff640 1 -- 172.21.15.87:0/3472152430 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58700fc550 msgr2=0x7f587010cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:23:04.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.778+0000 7f586ffff640 1 --2- 172.21.15.87:0/3472152430 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58700fc550 0x7f587010cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:04.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.778+0000 7f586ffff640 1 -- 172.21.15.87:0/3472152430 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5864005040 con 0x7f58700fd820 2024-09-17T07:23:04.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.778+0000 7f5874a24640 1 --2- 172.21.15.87:0/3472152430 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58700fc550 0x7f587010cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T07:23:04.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.778+0000 7f586ffff640 1 --2- 172.21.15.87:0/3472152430 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f58700fd820 0x7f587010d520 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f585c0027d0 tx=0x7f585c009f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:23:04.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.779+0000 7f586d7fa640 1 -- 172.21.15.87:0/3472152430 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f585c002dc0 con 0x7f58700fd820 2024-09-17T07:23:04.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.779+0000 7f586d7fa640 1 -- 172.21.15.87:0/3472152430 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f585c00f040 con 0x7f58700fd820 2024-09-17T07:23:04.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.779+0000 7f5876c88640 1 -- 172.21.15.87:0/3472152430 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f587010e620 con 0x7f58700fd820 2024-09-17T07:23:04.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.779+0000 7f586d7fa640 1 -- 172.21.15.87:0/3472152430 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f585c00d980 con 0x7f58700fd820 2024-09-17T07:23:04.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.779+0000 7f5876c88640 1 -- 172.21.15.87:0/3472152430 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f587010ebc0 con 0x7f58700fd820 2024-09-17T07:23:04.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.780+0000 7f5876c88640 1 -- 172.21.15.87:0/3472152430 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58700fb9b0 con 0x7f58700fd820 2024-09-17T07:23:04.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.780+0000 7f586d7fa640 1 -- 172.21.15.87:0/3472152430 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 38) v1 ==== 90952+0+0 (secure 0 0 0) 0x7f585c007c30 con 0x7f58700fd820 2024-09-17T07:23:04.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.781+0000 7f586d7fa640 1 --2- 172.21.15.87:0/3472152430 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f586006ccc0 0x7f586006f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:23:04.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.781+0000 7f586d7fa640 1 -- 172.21.15.87:0/3472152430 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f585c08ba90 con 0x7f58700fd820 2024-09-17T07:23:04.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.781+0000 7f5874a24640 1 --2- 172.21.15.87:0/3472152430 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f586006ccc0 0x7f586006f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:23:04.783 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.782+0000 7f5874a24640 1 --2- 172.21.15.87:0/3472152430 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f586006ccc0 0x7f586006f170 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f586400b020 tx=0x7f5864035040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:23:04.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:04.786+0000 7f586d7fa640 1 -- 172.21.15.87:0/3472152430 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f585c055890 con 0x7f58700fd820 2024-09-17T07:23:05.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.022+0000 7f5876c88640 1 -- 172.21.15.87:0/3472152430 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f587004b720 con 0x7f58700fd820 2024-09-17T07:23:05.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.023+0000 7f586d7fa640 1 -- 172.21.15.87:0/3472152430 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+741 (secure 0 0 0) 0x7f585c058eb0 con 0x7f58700fd820 2024-09-17T07:23:05.024 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T07:23:05.024 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": { 2024-09-17T07:23:05.024 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 2 2024-09-17T07:23:05.024 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:23:05.024 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr": { 2024-09-17T07:23:05.024 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 2 2024-09-17T07:23:05.024 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:23:05.024 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": { 2024-09-17T07:23:05.025 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 5 2024-09-17T07:23:05.025 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:23:05.025 INFO:teuthology.orchestra.run.smithi087.stdout: "mds": { 2024-09-17T07:23:05.025 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 4 2024-09-17T07:23:05.025 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:23:05.025 INFO:teuthology.orchestra.run.smithi087.stdout: "overall": { 2024-09-17T07:23:05.025 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 9, 2024-09-17T07:23:05.025 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 4 2024-09-17T07:23:05.025 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T07:23:05.025 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T07:23:05.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.025+0000 7f5876c88640 1 -- 172.21.15.87:0/3472152430 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f586006ccc0 msgr2=0x7f586006f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:23:05.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.025+0000 7f5876c88640 1 --2- 172.21.15.87:0/3472152430 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f586006ccc0 0x7f586006f170 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f586400b020 tx=0x7f5864035040 comp rx=0 tx=0).stop 2024-09-17T07:23:05.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.025+0000 7f5876c88640 1 -- 172.21.15.87:0/3472152430 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f58700fd820 msgr2=0x7f587010d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:23:05.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.025+0000 7f5876c88640 1 --2- 172.21.15.87:0/3472152430 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f58700fd820 0x7f587010d520 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f585c0027d0 tx=0x7f585c009f70 comp rx=0 tx=0).stop 2024-09-17T07:23:05.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.025+0000 7f5876c88640 1 -- 172.21.15.87:0/3472152430 shutdown_connections 2024-09-17T07:23:05.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.025+0000 7f5876c88640 1 --2- 172.21.15.87:0/3472152430 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f586006ccc0 0x7f586006f170 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:05.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.025+0000 7f5876c88640 1 --2- 172.21.15.87:0/3472152430 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f58700fd820 0x7f587010d520 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:05.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.025+0000 7f5876c88640 1 --2- 172.21.15.87:0/3472152430 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58700fc550 0x7f587010cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:05.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.025+0000 7f5876c88640 1 -- 172.21.15.87:0/3472152430 >> 172.21.15.87:0/3472152430 conn(0x7f58700f7d30 msgr2=0x7f58700f95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:23:05.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.025+0000 7f5876c88640 1 -- 172.21.15.87:0/3472152430 shutdown_connections 2024-09-17T07:23:05.027 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.025+0000 7f5876c88640 1 -- 172.21.15.87:0/3472152430 wait complete. 2024-09-17T07:23:05.062 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 17 07:23:04 smithi087 podman[99166]: 2024-09-17 07:23:04.855830939 +0000 UTC m=+0.015633747 image pull 980a0bfcd684674f25c08d857ad8de3b1c8ae738870529edbf9aa463832c8d89 quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9 2024-09-17T07:23:05.064 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 17 07:23:04 smithi087 podman[99166]: 2024-09-17 07:23:04.957404948 +0000 UTC m=+0.117207754 container create 171a33f73c8a7f141b640385b6174062835dc82eb6df1730594c38040bc33006 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=reef-19e2a2b, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-17T07:23:05.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.107+0000 7fcdf0156640 1 -- 172.21.15.87:0/234030968 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcde80fb420 msgr2=0x7fcde80fb830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:23:05.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.107+0000 7fcdf0156640 1 --2- 172.21.15.87:0/234030968 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcde80fb420 0x7fcde80fb830 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcde40048d0 tx=0x7fcde4009da0 comp rx=0 tx=0).stop 2024-09-17T07:23:05.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.108+0000 7fcdf0156640 1 -- 172.21.15.87:0/234030968 shutdown_connections 2024-09-17T07:23:05.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.108+0000 7fcdf0156640 1 --2- 172.21.15.87:0/234030968 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcde80fc6f0 0x7fcde80fcb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:05.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.108+0000 7fcdf0156640 1 --2- 172.21.15.87:0/234030968 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcde80fb420 0x7fcde80fb830 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:05.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.108+0000 7fcdf0156640 1 -- 172.21.15.87:0/234030968 >> 172.21.15.87:0/234030968 conn(0x7fcde80f6c00 msgr2=0x7fcde80f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:23:05.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.108+0000 7fcdf0156640 1 -- 172.21.15.87:0/234030968 shutdown_connections 2024-09-17T07:23:05.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.108+0000 7fcdf0156640 1 -- 172.21.15.87:0/234030968 wait complete. 2024-09-17T07:23:05.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.108+0000 7fcdf0156640 1 Processor -- start 2024-09-17T07:23:05.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.109+0000 7fcdf0156640 1 -- start start 2024-09-17T07:23:05.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.109+0000 7fcdf0156640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcde80fb420 0x7fcde80663e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:23:05.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.109+0000 7fcdf0156640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcde80fc6f0 0x7fcde8114120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:23:05.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.109+0000 7fcdf0156640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcde810dbc0 con 0x7fcde80fc6f0 2024-09-17T07:23:05.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.109+0000 7fcdf0156640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcde8114690 con 0x7fcde80fb420 2024-09-17T07:23:05.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.109+0000 7fcded6f1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcde80fc6f0 0x7fcde8114120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:23:05.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.109+0000 7fcded6f1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcde80fc6f0 0x7fcde8114120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56132/0 (socket says 172.21.15.87:56132) 2024-09-17T07:23:05.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.109+0000 7fcded6f1640 1 -- 172.21.15.87:0/482585333 learned_addr learned my addr 172.21.15.87:0/482585333 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:23:05.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.109+0000 7fcdedef2640 1 --2- 172.21.15.87:0/482585333 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcde80fb420 0x7fcde80663e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:23:05.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.109+0000 7fcded6f1640 1 -- 172.21.15.87:0/482585333 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcde80fb420 msgr2=0x7fcde80663e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:23:05.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.109+0000 7fcded6f1640 1 --2- 172.21.15.87:0/482585333 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcde80fb420 0x7fcde80663e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:05.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.109+0000 7fcded6f1640 1 -- 172.21.15.87:0/482585333 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcde4005040 con 0x7fcde80fc6f0 2024-09-17T07:23:05.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.109+0000 7fcded6f1640 1 --2- 172.21.15.87:0/482585333 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcde80fc6f0 0x7fcde8114120 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcdd8002a50 tx=0x7fcdd8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:23:05.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.109+0000 7fcdde7fc640 1 -- 172.21.15.87:0/482585333 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcdd8007c30 con 0x7fcde80fc6f0 2024-09-17T07:23:05.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.109+0000 7fcdde7fc640 1 -- 172.21.15.87:0/482585333 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fcdd800f040 con 0x7fcde80fc6f0 2024-09-17T07:23:05.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.109+0000 7fcdf0156640 1 -- 172.21.15.87:0/482585333 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcde8114970 con 0x7fcde80fc6f0 2024-09-17T07:23:05.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.109+0000 7fcdde7fc640 1 -- 172.21.15.87:0/482585333 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcdd800da30 con 0x7fcde80fc6f0 2024-09-17T07:23:05.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.109+0000 7fcdf0156640 1 -- 172.21.15.87:0/482585333 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcde8114ec0 con 0x7fcde80fc6f0 2024-09-17T07:23:05.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.109+0000 7fcdf0156640 1 -- 172.21.15.87:0/482585333 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcde804b720 con 0x7fcde80fc6f0 2024-09-17T07:23:05.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.109+0000 7fcdde7fc640 1 -- 172.21.15.87:0/482585333 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 38) v1 ==== 90952+0+0 (secure 0 0 0) 0x7fcdd800db90 con 0x7fcde80fc6f0 2024-09-17T07:23:05.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.109+0000 7fcdde7fc640 1 --2- 172.21.15.87:0/482585333 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fcdd406ccc0 0x7fcdd406f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:23:05.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.109+0000 7fcdde7fc640 1 -- 172.21.15.87:0/482585333 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fcdd808c7f0 con 0x7fcde80fc6f0 2024-09-17T07:23:05.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.109+0000 7fcdedef2640 1 --2- 172.21.15.87:0/482585333 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fcdd406ccc0 0x7fcdd406f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:23:05.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.109+0000 7fcdedef2640 1 --2- 172.21.15.87:0/482585333 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fcdd406ccc0 0x7fcdd406f170 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fcde8066190 tx=0x7fcde4035040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:23:05.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.115+0000 7fcdde7fc640 1 -- 172.21.15.87:0/482585333 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fcdd8056660 con 0x7fcde80fc6f0 2024-09-17T07:23:05.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.320+0000 7fcdf0156640 1 -- 172.21.15.87:0/482585333 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fcde8114b00 con 0x7fcde80fc6f0 2024-09-17T07:23:05.322 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:05 smithi087 ceph-mon[90982]: pgmap v37: 65 pgs: 34 peering, 31 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s 2024-09-17T07:23:05.322 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:05 smithi087 ceph-mon[90982]: Health check failed: Reduced data availability: 34 pgs peering (PG_AVAILABILITY) 2024-09-17T07:23:05.322 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:05 smithi087 ceph-mon[90982]: from='client.34188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:23:05.322 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:05 smithi087 ceph-mon[90982]: osdmap e49: 6 total, 5 up, 6 in 2024-09-17T07:23:05.322 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:05 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/3472152430' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:23:05.323 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 17 07:23:05 smithi087 podman[99166]: 2024-09-17 07:23:05.193373223 +0000 UTC m=+0.353176034 container init 171a33f73c8a7f141b640385b6174062835dc82eb6df1730594c38040bc33006 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=reef-19e2a2b, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T07:23:05.323 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 17 07:23:05 smithi087 podman[99166]: 2024-09-17 07:23:05.197217398 +0000 UTC m=+0.357020200 container start 171a33f73c8a7f141b640385b6174062835dc82eb6df1730594c38040bc33006 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=reef-19e2a2b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-17T07:23:05.323 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 17 07:23:05 smithi087 podman[99166]: 2024-09-17 07:23:05.276534453 +0000 UTC m=+0.436337273 container attach 171a33f73c8a7f141b640385b6174062835dc82eb6df1730594c38040bc33006 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=reef-19e2a2b, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T07:23:05.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.321+0000 7fcdde7fc640 1 -- 172.21.15.87:0/482585333 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1905 (secure 0 0 0) 0x7fcde8114b00 con 0x7fcde80fc6f0 2024-09-17T07:23:05.323 INFO:teuthology.orchestra.run.smithi087.stdout:e21 2024-09-17T07:23:05.324 INFO:teuthology.orchestra.run.smithi087.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T07:23:05.324 INFO:teuthology.orchestra.run.smithi087.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T07:23:05.324 INFO:teuthology.orchestra.run.smithi087.stdout:legacy client fscid: 1 2024-09-17T07:23:05.324 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:23:05.324 INFO:teuthology.orchestra.run.smithi087.stdout:Filesystem 'cephfs' (1) 2024-09-17T07:23:05.324 INFO:teuthology.orchestra.run.smithi087.stdout:fs_name cephfs 2024-09-17T07:23:05.324 INFO:teuthology.orchestra.run.smithi087.stdout:epoch 21 2024-09-17T07:23:05.324 INFO:teuthology.orchestra.run.smithi087.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T07:23:05.324 INFO:teuthology.orchestra.run.smithi087.stdout:created 2024-09-17T07:17:15.368053+0000 2024-09-17T07:23:05.324 INFO:teuthology.orchestra.run.smithi087.stdout:modified 2024-09-17T07:20:37.142055+0000 2024-09-17T07:23:05.324 INFO:teuthology.orchestra.run.smithi087.stdout:tableserver 0 2024-09-17T07:23:05.324 INFO:teuthology.orchestra.run.smithi087.stdout:root 0 2024-09-17T07:23:05.324 INFO:teuthology.orchestra.run.smithi087.stdout:session_timeout 60 2024-09-17T07:23:05.325 INFO:teuthology.orchestra.run.smithi087.stdout:session_autoclose 300 2024-09-17T07:23:05.325 INFO:teuthology.orchestra.run.smithi087.stdout:max_file_size 1099511627776 2024-09-17T07:23:05.325 INFO:teuthology.orchestra.run.smithi087.stdout:max_xattr_size 65536 2024-09-17T07:23:05.325 INFO:teuthology.orchestra.run.smithi087.stdout:required_client_features {} 2024-09-17T07:23:05.325 INFO:teuthology.orchestra.run.smithi087.stdout:last_failure 0 2024-09-17T07:23:05.325 INFO:teuthology.orchestra.run.smithi087.stdout:last_failure_osd_epoch 44 2024-09-17T07:23:05.325 INFO:teuthology.orchestra.run.smithi087.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T07:23:05.325 INFO:teuthology.orchestra.run.smithi087.stdout:max_mds 2 2024-09-17T07:23:05.325 INFO:teuthology.orchestra.run.smithi087.stdout:in 0,1 2024-09-17T07:23:05.325 INFO:teuthology.orchestra.run.smithi087.stdout:up {0=14478,1=24243} 2024-09-17T07:23:05.325 INFO:teuthology.orchestra.run.smithi087.stdout:failed 2024-09-17T07:23:05.325 INFO:teuthology.orchestra.run.smithi087.stdout:damaged 2024-09-17T07:23:05.325 INFO:teuthology.orchestra.run.smithi087.stdout:stopped 2024-09-17T07:23:05.325 INFO:teuthology.orchestra.run.smithi087.stdout:data_pools [3] 2024-09-17T07:23:05.326 INFO:teuthology.orchestra.run.smithi087.stdout:metadata_pool 2 2024-09-17T07:23:05.326 INFO:teuthology.orchestra.run.smithi087.stdout:inline_data enabled 2024-09-17T07:23:05.326 INFO:teuthology.orchestra.run.smithi087.stdout:balancer 2024-09-17T07:23:05.326 INFO:teuthology.orchestra.run.smithi087.stdout:bal_rank_mask -1 2024-09-17T07:23:05.326 INFO:teuthology.orchestra.run.smithi087.stdout:standby_count_wanted 1 2024-09-17T07:23:05.326 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi087.tjhpcs{0:14478} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.87:6828/2255237099,v1:172.21.15.87:6829/2255237099] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:23:05.326 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi087.vvbzss{0:14490} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.87:6826/4022268353,v1:172.21.15.87:6827/4022268353] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:23:05.326 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi139.gnwonz{1:24243} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.139:6824/3946792151,v1:172.21.15.139:6825/3946792151] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:23:05.326 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi139.ftvinf{1:24253} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.139:6826/3292073323,v1:172.21.15.139:6827/3292073323] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:23:05.326 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:23:05.326 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:23:05.327 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 21 2024-09-17T07:23:05.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.324+0000 7fcdf0156640 1 -- 172.21.15.87:0/482585333 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fcdd406ccc0 msgr2=0x7fcdd406f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:23:05.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.324+0000 7fcdf0156640 1 --2- 172.21.15.87:0/482585333 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fcdd406ccc0 0x7fcdd406f170 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fcde8066190 tx=0x7fcde4035040 comp rx=0 tx=0).stop 2024-09-17T07:23:05.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.324+0000 7fcdf0156640 1 -- 172.21.15.87:0/482585333 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcde80fc6f0 msgr2=0x7fcde8114120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:23:05.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.324+0000 7fcdf0156640 1 --2- 172.21.15.87:0/482585333 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcde80fc6f0 0x7fcde8114120 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcdd8002a50 tx=0x7fcdd8004600 comp rx=0 tx=0).stop 2024-09-17T07:23:05.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.324+0000 7fcdf0156640 1 -- 172.21.15.87:0/482585333 shutdown_connections 2024-09-17T07:23:05.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.324+0000 7fcdf0156640 1 --2- 172.21.15.87:0/482585333 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcde80fc6f0 0x7fcde8114120 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:05.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.324+0000 7fcdf0156640 1 --2- 172.21.15.87:0/482585333 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fcdd406ccc0 0x7fcdd406f170 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:05.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.324+0000 7fcdf0156640 1 --2- 172.21.15.87:0/482585333 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcde80fb420 0x7fcde80663e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:05.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.324+0000 7fcdf0156640 1 -- 172.21.15.87:0/482585333 >> 172.21.15.87:0/482585333 conn(0x7fcde80f6c00 msgr2=0x7fcde80ffa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:23:05.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.324+0000 7fcdf0156640 1 -- 172.21.15.87:0/482585333 shutdown_connections 2024-09-17T07:23:05.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.324+0000 7fcdf0156640 1 -- 172.21.15.87:0/482585333 wait complete. 2024-09-17T07:23:05.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.411+0000 7f061cd04640 1 -- 172.21.15.87:0/3819030723 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06180fc700 msgr2=0x7f06180fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:23:05.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.411+0000 7f061cd04640 1 --2- 172.21.15.87:0/3819030723 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06180fc700 0x7f06180fcb70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f060c0048d0 tx=0x7f060c009da0 comp rx=0 tx=0).stop 2024-09-17T07:23:05.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.411+0000 7f061cd04640 1 -- 172.21.15.87:0/3819030723 shutdown_connections 2024-09-17T07:23:05.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.411+0000 7f061cd04640 1 --2- 172.21.15.87:0/3819030723 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06180fc700 0x7f06180fcb70 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:05.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.411+0000 7f061cd04640 1 --2- 172.21.15.87:0/3819030723 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f06180fb430 0x7f06180fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:05.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.411+0000 7f061cd04640 1 -- 172.21.15.87:0/3819030723 >> 172.21.15.87:0/3819030723 conn(0x7f06180f6c10 msgr2=0x7f06180f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:23:05.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.411+0000 7f061cd04640 1 -- 172.21.15.87:0/3819030723 shutdown_connections 2024-09-17T07:23:05.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.411+0000 7f061cd04640 1 -- 172.21.15.87:0/3819030723 wait complete. 2024-09-17T07:23:05.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.411+0000 7f061cd04640 1 Processor -- start 2024-09-17T07:23:05.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.411+0000 7f061cd04640 1 -- start start 2024-09-17T07:23:05.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.412+0000 7f061cd04640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06180fb430 0x7f061810fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:23:05.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.412+0000 7f061cd04640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f06180fc700 0x7f0618112290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:23:05.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.412+0000 7f061cd04640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0618065cf0 con 0x7f06180fb430 2024-09-17T07:23:05.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.412+0000 7f061cd04640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0618065e60 con 0x7f06180fc700 2024-09-17T07:23:05.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.412+0000 7f061659c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06180fb430 0x7f061810fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:23:05.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.412+0000 7f061659c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06180fb430 0x7f061810fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56156/0 (socket says 172.21.15.87:56156) 2024-09-17T07:23:05.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.412+0000 7f061659c640 1 -- 172.21.15.87:0/2891954344 learned_addr learned my addr 172.21.15.87:0/2891954344 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:23:05.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.412+0000 7f0615d9b640 1 --2- 172.21.15.87:0/2891954344 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f06180fc700 0x7f0618112290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:23:05.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.412+0000 7f061659c640 1 -- 172.21.15.87:0/2891954344 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f06180fc700 msgr2=0x7f0618112290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:23:05.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.412+0000 7f061659c640 1 --2- 172.21.15.87:0/2891954344 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f06180fc700 0x7f0618112290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:05.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.412+0000 7f061659c640 1 -- 172.21.15.87:0/2891954344 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f060c005040 con 0x7f06180fb430 2024-09-17T07:23:05.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.412+0000 7f061659c640 1 --2- 172.21.15.87:0/2891954344 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06180fb430 0x7f061810fd40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f060800b790 tx=0x7f06080091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:23:05.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.412+0000 7f0606ffd640 1 -- 172.21.15.87:0/2891954344 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f060800c700 con 0x7f06180fb430 2024-09-17T07:23:05.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.412+0000 7f0606ffd640 1 -- 172.21.15.87:0/2891954344 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f060800cce0 con 0x7f06180fb430 2024-09-17T07:23:05.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.412+0000 7f0606ffd640 1 -- 172.21.15.87:0/2891954344 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0608015e10 con 0x7f06180fb430 2024-09-17T07:23:05.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.412+0000 7f061cd04640 1 -- 172.21.15.87:0/2891954344 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0618112890 con 0x7f06180fb430 2024-09-17T07:23:05.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.412+0000 7f061cd04640 1 -- 172.21.15.87:0/2891954344 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0618112d10 con 0x7f06180fb430 2024-09-17T07:23:05.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.413+0000 7f061cd04640 1 -- 172.21.15.87:0/2891954344 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06180fa890 con 0x7f06180fb430 2024-09-17T07:23:05.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.414+0000 7f0606ffd640 1 -- 172.21.15.87:0/2891954344 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 38) v1 ==== 90952+0+0 (secure 0 0 0) 0x7f0608012070 con 0x7f06180fb430 2024-09-17T07:23:05.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.414+0000 7f0606ffd640 1 --2- 172.21.15.87:0/2891954344 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f060006ccc0 0x7f060006f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:23:05.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.415+0000 7f0606ffd640 1 -- 172.21.15.87:0/2891954344 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f060808be30 con 0x7f06180fb430 2024-09-17T07:23:05.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.415+0000 7f0615d9b640 1 --2- 172.21.15.87:0/2891954344 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f060006ccc0 0x7f060006f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:23:05.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.415+0000 7f0615d9b640 1 --2- 172.21.15.87:0/2891954344 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f060006ccc0 0x7f060006f170 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f060c007ac0 tx=0x7f060c009da0 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:23:05.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.419+0000 7f0606ffd640 1 -- 172.21.15.87:0/2891954344 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f0608055d30 con 0x7f06180fb430 2024-09-17T07:23:05.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.597+0000 7f061cd04640 1 -- 172.21.15.87:0/2891954344 --> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0618100bf0 con 0x7f060006ccc0 2024-09-17T07:23:05.599 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 17 07:23:05 smithi087 podman[99166]: 2024-09-17 07:23:05.390817197 +0000 UTC m=+0.550620008 container died 171a33f73c8a7f141b640385b6174062835dc82eb6df1730594c38040bc33006 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=reef-19e2a2b, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True) 2024-09-17T07:23:05.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.598+0000 7f0606ffd640 1 -- 172.21.15.87:0/2891954344 <== mgr.24529 v2:172.21.15.87:6800/1359413180 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f0618100bf0 con 0x7f060006ccc0 2024-09-17T07:23:05.599 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T07:23:05.599 INFO:teuthology.orchestra.run.smithi087.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9", 2024-09-17T07:23:05.599 INFO:teuthology.orchestra.run.smithi087.stdout: "in_progress": true, 2024-09-17T07:23:05.600 INFO:teuthology.orchestra.run.smithi087.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T07:23:05.600 INFO:teuthology.orchestra.run.smithi087.stdout: "services_complete": [ 2024-09-17T07:23:05.600 INFO:teuthology.orchestra.run.smithi087.stdout: "crash", 2024-09-17T07:23:05.600 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr", 2024-09-17T07:23:05.600 INFO:teuthology.orchestra.run.smithi087.stdout: "mon" 2024-09-17T07:23:05.600 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-17T07:23:05.600 INFO:teuthology.orchestra.run.smithi087.stdout: "progress": "6/21 daemons upgraded", 2024-09-17T07:23:05.600 INFO:teuthology.orchestra.run.smithi087.stdout: "message": "Currently upgrading osd daemons", 2024-09-17T07:23:05.600 INFO:teuthology.orchestra.run.smithi087.stdout: "is_paused": false 2024-09-17T07:23:05.600 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T07:23:05.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.601+0000 7f061cd04640 1 -- 172.21.15.87:0/2891954344 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f060006ccc0 msgr2=0x7f060006f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:23:05.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.601+0000 7f061cd04640 1 --2- 172.21.15.87:0/2891954344 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f060006ccc0 0x7f060006f170 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f060c007ac0 tx=0x7f060c009da0 comp rx=0 tx=0).stop 2024-09-17T07:23:05.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.601+0000 7f061cd04640 1 -- 172.21.15.87:0/2891954344 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06180fb430 msgr2=0x7f061810fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:23:05.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.601+0000 7f061cd04640 1 --2- 172.21.15.87:0/2891954344 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06180fb430 0x7f061810fd40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f060800b790 tx=0x7f06080091d0 comp rx=0 tx=0).stop 2024-09-17T07:23:05.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.601+0000 7f061cd04640 1 -- 172.21.15.87:0/2891954344 shutdown_connections 2024-09-17T07:23:05.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.601+0000 7f061cd04640 1 --2- 172.21.15.87:0/2891954344 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f060006ccc0 0x7f060006f170 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:05.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.601+0000 7f061cd04640 1 --2- 172.21.15.87:0/2891954344 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f06180fc700 0x7f0618112290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:05.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.601+0000 7f061cd04640 1 --2- 172.21.15.87:0/2891954344 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06180fb430 0x7f061810fd40 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:05.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.601+0000 7f061cd04640 1 -- 172.21.15.87:0/2891954344 >> 172.21.15.87:0/2891954344 conn(0x7f06180f6c10 msgr2=0x7f06180f8440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:23:05.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.601+0000 7f061cd04640 1 -- 172.21.15.87:0/2891954344 shutdown_connections 2024-09-17T07:23:05.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.601+0000 7f061cd04640 1 -- 172.21.15.87:0/2891954344 wait complete. 2024-09-17T07:23:05.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:05 smithi139 ceph-mon[79872]: pgmap v37: 65 pgs: 34 peering, 31 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s 2024-09-17T07:23:05.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:05 smithi139 ceph-mon[79872]: Health check failed: Reduced data availability: 34 pgs peering (PG_AVAILABILITY) 2024-09-17T07:23:05.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:05 smithi139 ceph-mon[79872]: from='client.34188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:23:05.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:05 smithi139 ceph-mon[79872]: osdmap e49: 6 total, 5 up, 6 in 2024-09-17T07:23:05.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:05 smithi139 ceph-mon[79872]: from='client.? 172.21.15.87:0/3472152430' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:23:05.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.680+0000 7fdc1fcdf640 1 -- 172.21.15.87:0/2737722619 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdc180ff680 msgr2=0x7fdc18101a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:23:05.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.680+0000 7fdc1fcdf640 1 --2- 172.21.15.87:0/2737722619 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdc180ff680 0x7fdc18101a60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c0048d0 tx=0x7fdc0c009da0 comp rx=0 tx=0).stop 2024-09-17T07:23:05.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.680+0000 7fdc1fcdf640 1 -- 172.21.15.87:0/2737722619 shutdown_connections 2024-09-17T07:23:05.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.680+0000 7fdc1fcdf640 1 --2- 172.21.15.87:0/2737722619 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdc180ff680 0x7fdc18101a60 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:05.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.680+0000 7fdc1fcdf640 1 --2- 172.21.15.87:0/2737722619 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdc18065c40 0x7fdc180ff140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:05.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.680+0000 7fdc1fcdf640 1 -- 172.21.15.87:0/2737722619 >> 172.21.15.87:0/2737722619 conn(0x7fdc180f6c10 msgr2=0x7fdc180f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:23:05.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.681+0000 7fdc1fcdf640 1 -- 172.21.15.87:0/2737722619 shutdown_connections 2024-09-17T07:23:05.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.681+0000 7fdc1fcdf640 1 -- 172.21.15.87:0/2737722619 wait complete. 2024-09-17T07:23:05.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.681+0000 7fdc1fcdf640 1 Processor -- start 2024-09-17T07:23:05.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.681+0000 7fdc1fcdf640 1 -- start start 2024-09-17T07:23:05.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.681+0000 7fdc1fcdf640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdc18065c40 0x7fdc1810cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:23:05.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.681+0000 7fdc1fcdf640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdc180ff680 0x7fdc1810d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:23:05.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.681+0000 7fdc1fcdf640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1810db60 con 0x7fdc180ff680 2024-09-17T07:23:05.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.681+0000 7fdc1fcdf640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1810e330 con 0x7fdc18065c40 2024-09-17T07:23:05.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.681+0000 7fdc1d27a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdc180ff680 0x7fdc1810d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:23:05.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.681+0000 7fdc1d27a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdc180ff680 0x7fdc1810d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56184/0 (socket says 172.21.15.87:56184) 2024-09-17T07:23:05.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.681+0000 7fdc1d27a640 1 -- 172.21.15.87:0/2215452985 learned_addr learned my addr 172.21.15.87:0/2215452985 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:23:05.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.681+0000 7fdc1da7b640 1 --2- 172.21.15.87:0/2215452985 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdc18065c40 0x7fdc1810cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:23:05.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.682+0000 7fdc1d27a640 1 -- 172.21.15.87:0/2215452985 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdc18065c40 msgr2=0x7fdc1810cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:23:05.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.682+0000 7fdc1d27a640 1 --2- 172.21.15.87:0/2215452985 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdc18065c40 0x7fdc1810cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:05.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.682+0000 7fdc1d27a640 1 -- 172.21.15.87:0/2215452985 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc0c005040 con 0x7fdc180ff680 2024-09-17T07:23:05.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.682+0000 7fdc1da7b640 1 --2- 172.21.15.87:0/2215452985 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdc18065c40 0x7fdc1810cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T07:23:05.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.682+0000 7fdc1d27a640 1 --2- 172.21.15.87:0/2215452985 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdc180ff680 0x7fdc1810d510 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c009ac0 tx=0x7fdc0c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:23:05.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.682+0000 7fdc167fc640 1 -- 172.21.15.87:0/2215452985 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc0c038070 con 0x7fdc180ff680 2024-09-17T07:23:05.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.682+0000 7fdc167fc640 1 -- 172.21.15.87:0/2215452985 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fdc0c02ae70 con 0x7fdc180ff680 2024-09-17T07:23:05.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.682+0000 7fdc1fcdf640 1 -- 172.21.15.87:0/2215452985 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc1810e560 con 0x7fdc180ff680 2024-09-17T07:23:05.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.682+0000 7fdc167fc640 1 -- 172.21.15.87:0/2215452985 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc0c033420 con 0x7fdc180ff680 2024-09-17T07:23:05.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.682+0000 7fdc1fcdf640 1 -- 172.21.15.87:0/2215452985 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc1810eaa0 con 0x7fdc180ff680 2024-09-17T07:23:05.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.683+0000 7fdc1fcdf640 1 -- 172.21.15.87:0/2215452985 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc180fa890 con 0x7fdc180ff680 2024-09-17T07:23:05.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.683+0000 7fdc167fc640 1 -- 172.21.15.87:0/2215452985 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 38) v1 ==== 90952+0+0 (secure 0 0 0) 0x7fdc0c030020 con 0x7fdc180ff680 2024-09-17T07:23:05.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.684+0000 7fdc167fc640 1 --2- 172.21.15.87:0/2215452985 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fdc0006ccc0 0x7fdc0006f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:23:05.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.684+0000 7fdc167fc640 1 -- 172.21.15.87:0/2215452985 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fdc0c0ac220 con 0x7fdc180ff680 2024-09-17T07:23:05.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.684+0000 7fdc1da7b640 1 --2- 172.21.15.87:0/2215452985 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fdc0006ccc0 0x7fdc0006f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:23:05.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.684+0000 7fdc1da7b640 1 --2- 172.21.15.87:0/2215452985 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fdc0006ccc0 0x7fdc0006f170 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fdc180659a0 tx=0x7fdc08009040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:23:05.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.688+0000 7fdc167fc640 1 -- 172.21.15.87:0/2215452985 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fdc0c076120 con 0x7fdc180ff680 2024-09-17T07:23:05.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.915+0000 7fdc1fcdf640 1 -- 172.21.15.87:0/2215452985 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fdc1810ed80 con 0x7fdc180ff680 2024-09-17T07:23:05.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.916+0000 7fdc167fc640 1 -- 172.21.15.87:0/2215452985 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+3072 (secure 0 0 0) 0x7fdc0c041c10 con 0x7fdc180ff680 2024-09-17T07:23:05.917 INFO:teuthology.orchestra.run.smithi087.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Reduced data availability: 34 pgs peering 2024-09-17T07:23:05.917 INFO:teuthology.orchestra.run.smithi087.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T07:23:05.917 INFO:teuthology.orchestra.run.smithi087.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T07:23:05.917 INFO:teuthology.orchestra.run.smithi087.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-17T07:23:05.918 INFO:teuthology.orchestra.run.smithi087.stdout: osd.0 (root=default,host=smithi087) is down 2024-09-17T07:23:05.918 INFO:teuthology.orchestra.run.smithi087.stdout:[WRN] PG_AVAILABILITY: Reduced data availability: 34 pgs peering 2024-09-17T07:23:05.918 INFO:teuthology.orchestra.run.smithi087.stdout: pg 1.0 is stuck peering for 63s, current state peering, last acting [3,1] 2024-09-17T07:23:05.918 INFO:teuthology.orchestra.run.smithi087.stdout: pg 2.0 is stuck peering for 66s, current state peering, last acting [3,1] 2024-09-17T07:23:05.918 INFO:teuthology.orchestra.run.smithi087.stdout: pg 2.1 is stuck peering for 66s, current state peering, last acting [2,1] 2024-09-17T07:23:05.918 INFO:teuthology.orchestra.run.smithi087.stdout: pg 2.2 is stuck peering for 66s, current state peering, last acting [5,1] 2024-09-17T07:23:05.918 INFO:teuthology.orchestra.run.smithi087.stdout: pg 2.4 is stuck peering for 66s, current state peering, last acting [1,4] 2024-09-17T07:23:05.918 INFO:teuthology.orchestra.run.smithi087.stdout: pg 2.5 is stuck peering for 66s, current state peering, last acting [3,4] 2024-09-17T07:23:05.918 INFO:teuthology.orchestra.run.smithi087.stdout: pg 2.8 is stuck peering for 66s, current state peering, last acting [3,5] 2024-09-17T07:23:05.918 INFO:teuthology.orchestra.run.smithi087.stdout: pg 2.9 is stuck peering for 66s, current state peering, last acting [1,4] 2024-09-17T07:23:05.918 INFO:teuthology.orchestra.run.smithi087.stdout: pg 2.c is stuck peering for 66s, current state peering, last acting [2,3] 2024-09-17T07:23:05.918 INFO:teuthology.orchestra.run.smithi087.stdout: pg 2.e is stuck peering for 66s, current state peering, last acting [2,3] 2024-09-17T07:23:05.918 INFO:teuthology.orchestra.run.smithi087.stdout: pg 2.f is stuck peering for 66s, current state peering, last acting [4,5] 2024-09-17T07:23:05.918 INFO:teuthology.orchestra.run.smithi087.stdout: pg 2.10 is stuck peering for 66s, current state peering, last acting [2,1] 2024-09-17T07:23:05.919 INFO:teuthology.orchestra.run.smithi087.stdout: pg 2.12 is stuck peering for 66s, current state peering, last acting [3,1] 2024-09-17T07:23:05.919 INFO:teuthology.orchestra.run.smithi087.stdout: pg 2.13 is stuck peering for 3m, current state peering, last acting [4,2] 2024-09-17T07:23:05.919 INFO:teuthology.orchestra.run.smithi087.stdout: pg 2.15 is stuck peering for 66s, current state peering, last acting [1,3] 2024-09-17T07:23:05.919 INFO:teuthology.orchestra.run.smithi087.stdout: pg 2.19 is stuck peering for 105s, current state peering, last acting [4,2] 2024-09-17T07:23:05.919 INFO:teuthology.orchestra.run.smithi087.stdout: pg 2.1b is stuck peering for 66s, current state peering, last acting [1,5] 2024-09-17T07:23:05.919 INFO:teuthology.orchestra.run.smithi087.stdout: pg 2.1d is stuck peering for 66s, current state peering, last acting [3,5] 2024-09-17T07:23:05.919 INFO:teuthology.orchestra.run.smithi087.stdout: pg 2.1e is stuck peering for 66s, current state peering, last acting [2,5] 2024-09-17T07:23:05.919 INFO:teuthology.orchestra.run.smithi087.stdout: pg 2.1f is stuck peering for 2m, current state peering, last acting [3,4] 2024-09-17T07:23:05.919 INFO:teuthology.orchestra.run.smithi087.stdout: pg 3.1 is stuck peering for 108s, current state peering, last acting [4,2] 2024-09-17T07:23:05.919 INFO:teuthology.orchestra.run.smithi087.stdout: pg 3.3 is stuck peering for 66s, current state peering, last acting [4,3] 2024-09-17T07:23:05.920 INFO:teuthology.orchestra.run.smithi087.stdout: pg 3.6 is stuck peering for 108s, current state peering, last acting [1,4] 2024-09-17T07:23:05.920 INFO:teuthology.orchestra.run.smithi087.stdout: pg 3.b is stuck peering for 66s, current state peering, last acting [1,4] 2024-09-17T07:23:05.920 INFO:teuthology.orchestra.run.smithi087.stdout: pg 3.c is stuck peering for 66s, current state peering, last acting [5,3] 2024-09-17T07:23:05.920 INFO:teuthology.orchestra.run.smithi087.stdout: pg 3.f is stuck peering for 66s, current state peering, last acting [5,3] 2024-09-17T07:23:05.920 INFO:teuthology.orchestra.run.smithi087.stdout: pg 3.10 is stuck peering for 66s, current state peering, last acting [5,1] 2024-09-17T07:23:05.921 INFO:teuthology.orchestra.run.smithi087.stdout: pg 3.11 is stuck peering for 66s, current state peering, last acting [3,4] 2024-09-17T07:23:05.921 INFO:teuthology.orchestra.run.smithi087.stdout: pg 3.12 is stuck peering for 108s, current state peering, last acting [3,1] 2024-09-17T07:23:05.921 INFO:teuthology.orchestra.run.smithi087.stdout: pg 3.15 is stuck peering for 66s, current state peering, last acting [3,4] 2024-09-17T07:23:05.921 INFO:teuthology.orchestra.run.smithi087.stdout: pg 3.17 is stuck peering for 108s, current state peering, last acting [5,2] 2024-09-17T07:23:05.922 INFO:teuthology.orchestra.run.smithi087.stdout: pg 3.18 is stuck peering for 66s, current state peering, last acting [2,1] 2024-09-17T07:23:05.922 INFO:teuthology.orchestra.run.smithi087.stdout: pg 3.1b is stuck peering for 108s, current state peering, last acting [4,3] 2024-09-17T07:23:05.922 INFO:teuthology.orchestra.run.smithi087.stdout: pg 3.1f is stuck peering for 108s, current state peering, last acting [3,2] 2024-09-17T07:23:05.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.918+0000 7fdc1fcdf640 1 -- 172.21.15.87:0/2215452985 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fdc0006ccc0 msgr2=0x7fdc0006f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:23:05.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.918+0000 7fdc1fcdf640 1 --2- 172.21.15.87:0/2215452985 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fdc0006ccc0 0x7fdc0006f170 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fdc180659a0 tx=0x7fdc08009040 comp rx=0 tx=0).stop 2024-09-17T07:23:05.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.918+0000 7fdc1fcdf640 1 -- 172.21.15.87:0/2215452985 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdc180ff680 msgr2=0x7fdc1810d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:23:05.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.918+0000 7fdc1fcdf640 1 --2- 172.21.15.87:0/2215452985 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdc180ff680 0x7fdc1810d510 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c009ac0 tx=0x7fdc0c009da0 comp rx=0 tx=0).stop 2024-09-17T07:23:05.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.918+0000 7fdc1fcdf640 1 -- 172.21.15.87:0/2215452985 shutdown_connections 2024-09-17T07:23:05.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.918+0000 7fdc1fcdf640 1 --2- 172.21.15.87:0/2215452985 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdc180ff680 0x7fdc1810d510 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:05.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.918+0000 7fdc1fcdf640 1 --2- 172.21.15.87:0/2215452985 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fdc0006ccc0 0x7fdc0006f170 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:05.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.918+0000 7fdc1fcdf640 1 --2- 172.21.15.87:0/2215452985 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdc18065c40 0x7fdc1810cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:05.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.918+0000 7fdc1fcdf640 1 -- 172.21.15.87:0/2215452985 >> 172.21.15.87:0/2215452985 conn(0x7fdc180f6c10 msgr2=0x7fdc180f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:23:05.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.918+0000 7fdc1fcdf640 1 -- 172.21.15.87:0/2215452985 shutdown_connections 2024-09-17T07:23:05.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:05.918+0000 7fdc1fcdf640 1 -- 172.21.15.87:0/2215452985 wait complete. 2024-09-17T07:23:06.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:06 smithi087 ceph-mon[90982]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:23:06.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:06 smithi087 ceph-mon[90982]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:23:06.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:06 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/482585333' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T07:23:06.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:06 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/2215452985' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T07:23:06.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:06 smithi139 ceph-mon[79872]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:23:06.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:06 smithi139 ceph-mon[79872]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:23:06.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:06 smithi139 ceph-mon[79872]: from='client.? 172.21.15.87:0/482585333' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T07:23:06.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:06 smithi139 ceph-mon[79872]: from='client.? 172.21.15.87:0/2215452985' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T07:23:06.673 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 17 07:23:06 smithi087 podman[99214]: 2024-09-17 07:23:06.223445344 +0000 UTC m=+0.826483522 container remove 171a33f73c8a7f141b640385b6174062835dc82eb6df1730594c38040bc33006 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=reef-19e2a2b, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-17T07:23:06.673 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 17 07:23:06 smithi087 systemd[1]: ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968@osd.0.service: Deactivated successfully. 2024-09-17T07:23:06.673 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 17 07:23:06 smithi087 systemd[1]: Stopped Ceph osd.0 for d5dbf8d6-74c3-11ef-bceb-c7b262605968. 2024-09-17T07:23:06.673 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 17 07:23:06 smithi087 systemd[1]: ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968@osd.0.service: Consumed 46.944s CPU time. 2024-09-17T07:23:06.673 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 17 07:23:06 smithi087 systemd[1]: Starting Ceph osd.0 for d5dbf8d6-74c3-11ef-bceb-c7b262605968... 2024-09-17T07:23:06.926 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 17 07:23:06 smithi087 podman[99357]: 2024-09-17 07:23:06.575316151 +0000 UTC m=+0.015639140 image pull 980a0bfcd684674f25c08d857ad8de3b1c8ae738870529edbf9aa463832c8d89 quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9 2024-09-17T07:23:06.926 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 17 07:23:06 smithi087 podman[99357]: 2024-09-17 07:23:06.674651816 +0000 UTC m=+0.114974804 container create ab9e906a5daeb74bc635917ae284a3900f09f2292ef4fecd4d952e7bc645512f (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-0-activate, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=reef-19e2a2b, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T07:23:06.926 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 17 07:23:06 smithi087 podman[99357]: 2024-09-17 07:23:06.918908567 +0000 UTC m=+0.359231563 container init ab9e906a5daeb74bc635917ae284a3900f09f2292ef4fecd4d952e7bc645512f (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-0-activate, RELEASE=reef-19e2a2b, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-17T07:23:06.926 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 17 07:23:06 smithi087 podman[99357]: 2024-09-17 07:23:06.922270224 +0000 UTC m=+0.362593216 container start ab9e906a5daeb74bc635917ae284a3900f09f2292ef4fecd4d952e7bc645512f (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-0-activate, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=reef-19e2a2b, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-17T07:23:07.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:07 smithi087 ceph-mon[90982]: from='client.34208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:23:07.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:07 smithi087 ceph-mon[90982]: pgmap v39: 65 pgs: 34 peering, 31 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s 2024-09-17T07:23:07.426 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 17 07:23:07 smithi087 podman[99357]: 2024-09-17 07:23:07.018940329 +0000 UTC m=+0.459263317 container attach ab9e906a5daeb74bc635917ae284a3900f09f2292ef4fecd4d952e7bc645512f (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-0-activate, RELEASE=reef-19e2a2b, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T07:23:07.426 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 17 07:23:07 smithi087 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-0-activate[99371]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-17T07:23:07.427 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 17 07:23:07 smithi087 bash[99357]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-17T07:23:07.427 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 17 07:23:07 smithi087 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-0-activate[99371]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-17T07:23:07.427 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 17 07:23:07 smithi087 bash[99357]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-17T07:23:07.427 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 17 07:23:07 smithi087 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-0-activate[99371]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-17T07:23:07.427 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 17 07:23:07 smithi087 bash[99357]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-17T07:23:07.427 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 17 07:23:07 smithi087 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-0-activate[99371]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-17T07:23:07.427 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 17 07:23:07 smithi087 bash[99357]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-17T07:23:07.427 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 17 07:23:07 smithi087 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-0-activate[99371]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-17T07:23:07.427 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 17 07:23:07 smithi087 bash[99357]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-17T07:23:07.427 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 17 07:23:07 smithi087 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-0-activate[99371]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-17T07:23:07.427 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 17 07:23:07 smithi087 bash[99357]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-17T07:23:07.427 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 17 07:23:07 smithi087 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-0-activate[99371]: --> ceph-volume raw activate successful for osd ID: 0 2024-09-17T07:23:07.427 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 17 07:23:07 smithi087 bash[99357]: --> ceph-volume raw activate successful for osd ID: 0 2024-09-17T07:23:07.428 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 17 07:23:07 smithi087 podman[99357]: 2024-09-17 07:23:07.26462515 +0000 UTC m=+0.704948141 container died ab9e906a5daeb74bc635917ae284a3900f09f2292ef4fecd4d952e7bc645512f (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-0-activate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=reef-19e2a2b) 2024-09-17T07:23:07.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:07 smithi139 ceph-mon[79872]: from='client.34208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:23:07.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:07 smithi139 ceph-mon[79872]: pgmap v39: 65 pgs: 34 peering, 31 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s 2024-09-17T07:23:08.399 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 17 07:23:08 smithi087 podman[99501]: 2024-09-17 07:23:08.023537468 +0000 UTC m=+0.752863240 container remove ab9e906a5daeb74bc635917ae284a3900f09f2292ef4fecd4d952e7bc645512f (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-0-activate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=reef-19e2a2b, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-17T07:23:08.399 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 17 07:23:08 smithi087 podman[99560]: 2024-09-17 07:23:08.136556649 +0000 UTC m=+0.016921483 image pull 980a0bfcd684674f25c08d857ad8de3b1c8ae738870529edbf9aa463832c8d89 quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9 2024-09-17T07:23:08.399 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 17 07:23:08 smithi087 podman[99560]: 2024-09-17 07:23:08.266187674 +0000 UTC m=+0.146552501 container create e97cb50e6aecb6b140794bc8f39fb4e45ea673bc74b01208e1666bb99312ef68 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=reef-19e2a2b, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-17T07:23:08.926 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 17 07:23:08 smithi087 podman[99560]: 2024-09-17 07:23:08.526786643 +0000 UTC m=+0.407151472 container init e97cb50e6aecb6b140794bc8f39fb4e45ea673bc74b01208e1666bb99312ef68 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=reef-19e2a2b, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T07:23:08.926 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 17 07:23:08 smithi087 podman[99560]: 2024-09-17 07:23:08.530036907 +0000 UTC m=+0.410401732 container start e97cb50e6aecb6b140794bc8f39fb4e45ea673bc74b01208e1666bb99312ef68 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-0, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, RELEASE=reef-19e2a2b, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-17T07:23:08.927 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 17 07:23:08 smithi087 ceph-osd[99578]: -- 172.21.15.87:0/2803035316 <== mon.0 v2:172.21.15.87:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x560e3ea811e0 con 0x560e3f800000 2024-09-17T07:23:08.927 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 17 07:23:08 smithi087 bash[99560]: e97cb50e6aecb6b140794bc8f39fb4e45ea673bc74b01208e1666bb99312ef68 2024-09-17T07:23:08.927 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 17 07:23:08 smithi087 systemd[1]: Started Ceph osd.0 for d5dbf8d6-74c3-11ef-bceb-c7b262605968. 2024-09-17T07:23:09.396 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 17 07:23:09 smithi087 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-0[99574]: 2024-09-17T07:23:09.065+0000 7fe21f1fb640 -1 Falling back to public interface 2024-09-17T07:23:09.396 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:09 smithi087 ceph-mon[90982]: pgmap v40: 65 pgs: 34 peering, 31 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-17T07:23:09.397 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:09 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:23:09.397 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:09 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:23:09.397 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:09 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:23:09.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:09 smithi139 ceph-mon[79872]: pgmap v40: 65 pgs: 34 peering, 31 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-17T07:23:09.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:09 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:23:09.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:09 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:23:09.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:09 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:23:10.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:10 smithi087 ceph-mon[90982]: Health check failed: Degraded data redundancy: 71/369 objects degraded (19.241%), 20 pgs degraded (PG_DEGRADED) 2024-09-17T07:23:10.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:10 smithi087 ceph-mon[90982]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 34 pgs peering) 2024-09-17T07:23:10.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:10 smithi139 ceph-mon[79872]: Health check failed: Degraded data redundancy: 71/369 objects degraded (19.241%), 20 pgs degraded (PG_DEGRADED) 2024-09-17T07:23:10.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:10 smithi139 ceph-mon[79872]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 34 pgs peering) 2024-09-17T07:23:11.497 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:11 smithi087 ceph-mon[90982]: pgmap v41: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 71/369 objects degraded (19.241%) 2024-09-17T07:23:11.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:11 smithi139 ceph-mon[79872]: pgmap v41: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 71/369 objects degraded (19.241%) 2024-09-17T07:23:13.504 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 17 07:23:13 smithi087 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-0[99574]: 2024-09-17T07:23:13.295+0000 7fe21f1fb640 -1 osd.0 47 log_to_monitors true 2024-09-17T07:23:13.504 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:13 smithi087 ceph-mon[90982]: pgmap v42: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 71/369 objects degraded (19.241%) 2024-09-17T07:23:13.504 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:13 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:23:13.504 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:13 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:23:13.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:13 smithi139 ceph-mon[79872]: pgmap v42: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 71/369 objects degraded (19.241%) 2024-09-17T07:23:13.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:13 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:23:13.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:13 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:23:14.454 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:14 smithi087 ceph-mon[90982]: from='osd.0 [v2:172.21.15.87:6802/1677183701,v1:172.21.15.87:6803/1677183701]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-17T07:23:14.454 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:14 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:23:14.454 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:14 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:23:14.454 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:14 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:23:14.454 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:14 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:23:14.518 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:14 smithi139 ceph-mon[79872]: from='osd.0 [v2:172.21.15.87:6802/1677183701,v1:172.21.15.87:6803/1677183701]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-17T07:23:14.518 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:14 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:23:14.518 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:14 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:23:14.518 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:14 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:23:14.518 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:14 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:23:15.370 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 17 07:23:14 smithi087 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-0[99574]: 2024-09-17T07:23:14.998+0000 7fe212f8c640 -1 osd.0 47 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T07:23:15.370 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:15 smithi087 ceph-mon[90982]: pgmap v43: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 71/369 objects degraded (19.241%) 2024-09-17T07:23:15.370 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:15 smithi087 ceph-mon[90982]: from='osd.0 [v2:172.21.15.87:6802/1677183701,v1:172.21.15.87:6803/1677183701]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-17T07:23:15.370 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:15 smithi087 ceph-mon[90982]: osdmap e50: 6 total, 5 up, 6 in 2024-09-17T07:23:15.371 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:15 smithi087 ceph-mon[90982]: from='osd.0 [v2:172.21.15.87:6802/1677183701,v1:172.21.15.87:6803/1677183701]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-09-17T07:23:15.371 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:15 smithi087 ceph-mon[90982]: from='osd.0 [v2:172.21.15.87:6802/1677183701,v1:172.21.15.87:6803/1677183701]' entity='osd.0' 2024-09-17T07:23:15.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:15 smithi139 ceph-mon[79872]: pgmap v43: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 322 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 71/369 objects degraded (19.241%) 2024-09-17T07:23:15.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:15 smithi139 ceph-mon[79872]: from='osd.0 [v2:172.21.15.87:6802/1677183701,v1:172.21.15.87:6803/1677183701]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-17T07:23:15.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:15 smithi139 ceph-mon[79872]: osdmap e50: 6 total, 5 up, 6 in 2024-09-17T07:23:15.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:15 smithi139 ceph-mon[79872]: from='osd.0 [v2:172.21.15.87:6802/1677183701,v1:172.21.15.87:6803/1677183701]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-09-17T07:23:15.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:15 smithi139 ceph-mon[79872]: from='osd.0 [v2:172.21.15.87:6802/1677183701,v1:172.21.15.87:6803/1677183701]' entity='osd.0' 2024-09-17T07:23:16.443 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:16 smithi087 ceph-mon[90982]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T07:23:16.443 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:16 smithi087 ceph-mon[90982]: osd.0 [v2:172.21.15.87:6802/1677183701,v1:172.21.15.87:6803/1677183701] boot 2024-09-17T07:23:16.443 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:16 smithi087 ceph-mon[90982]: osdmap e51: 6 total, 6 up, 6 in 2024-09-17T07:23:16.444 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:16 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T07:23:16.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:16 smithi139 ceph-mon[79872]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T07:23:16.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:16 smithi139 ceph-mon[79872]: osd.0 [v2:172.21.15.87:6802/1677183701,v1:172.21.15.87:6803/1677183701] boot 2024-09-17T07:23:16.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:16 smithi139 ceph-mon[79872]: osdmap e51: 6 total, 6 up, 6 in 2024-09-17T07:23:16.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:16 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T07:23:17.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:17 smithi087 ceph-mon[90982]: pgmap v46: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 322 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 71/369 objects degraded (19.241%) 2024-09-17T07:23:17.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:17 smithi087 ceph-mon[90982]: osdmap e52: 6 total, 6 up, 6 in 2024-09-17T07:23:17.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:17 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:23:17.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:17 smithi139 ceph-mon[79872]: pgmap v46: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 322 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 71/369 objects degraded (19.241%) 2024-09-17T07:23:17.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:17 smithi139 ceph-mon[79872]: osdmap e52: 6 total, 6 up, 6 in 2024-09-17T07:23:17.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:17 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:23:18.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:18 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:23:18.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:18 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:23:18.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:18 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:23:18.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:18 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:23:18.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:18 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:23:18.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:18 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:23:18.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:18 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:23:18.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:18 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:23:18.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:18 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-17T07:23:18.659 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:18 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:23:18.659 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:18 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:23:18.659 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:18 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:23:18.659 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:18 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:23:18.660 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:18 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:23:18.660 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:18 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:23:18.660 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:18 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:23:18.660 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:18 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:23:18.660 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:18 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-17T07:23:19.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:19 smithi139 ceph-mon[79872]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-17T07:23:19.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:19 smithi139 ceph-mon[79872]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-17T07:23:19.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:19 smithi139 ceph-mon[79872]: pgmap v48: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 322 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 71/369 objects degraded (19.241%) 2024-09-17T07:23:19.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:19 smithi087 ceph-mon[90982]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-17T07:23:19.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:19 smithi087 ceph-mon[90982]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-17T07:23:19.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:19 smithi087 ceph-mon[90982]: pgmap v48: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 322 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 71/369 objects degraded (19.241%) 2024-09-17T07:23:20.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:20 smithi139 ceph-mon[79872]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 71/369 objects degraded (19.241%), 20 pgs degraded) 2024-09-17T07:23:20.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:20 smithi087 ceph-mon[90982]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 71/369 objects degraded (19.241%), 20 pgs degraded) 2024-09-17T07:23:21.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:21 smithi139 ceph-mon[79872]: pgmap v49: 65 pgs: 65 active+clean; 322 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:23:21.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:21 smithi087 ceph-mon[90982]: pgmap v49: 65 pgs: 65 active+clean; 322 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:23:23.506 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:23 smithi087 ceph-mon[90982]: pgmap v50: 65 pgs: 65 active+clean; 322 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-17T07:23:23.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:23 smithi139 ceph-mon[79872]: pgmap v50: 65 pgs: 65 active+clean; 322 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-17T07:23:25.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:25 smithi139 ceph-mon[79872]: pgmap v51: 65 pgs: 65 active+clean; 322 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:23:25.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:25 smithi087 ceph-mon[90982]: pgmap v51: 65 pgs: 65 active+clean; 322 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:23:27.523 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:27 smithi087 ceph-mon[90982]: pgmap v52: 65 pgs: 65 active+clean; 322 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-17T07:23:27.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:27 smithi139 ceph-mon[79872]: pgmap v52: 65 pgs: 65 active+clean; 322 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-17T07:23:29.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:29 smithi139 ceph-mon[79872]: pgmap v53: 65 pgs: 65 active+clean; 322 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2024-09-17T07:23:29.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:29 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:23:29.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:29 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:23:29.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:29 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:23:29.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:29 smithi087 ceph-mon[90982]: pgmap v53: 65 pgs: 65 active+clean; 322 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2024-09-17T07:23:29.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:29 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:23:29.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:29 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:23:29.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:29 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:23:31.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:31 smithi139 ceph-mon[79872]: pgmap v54: 65 pgs: 65 active+clean; 322 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-17T07:23:31.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:31 smithi139 ceph-mon[79872]: mgrmap e39: smithi087.vuvjer(active, since 92s), standbys: smithi139.tuqnpn 2024-09-17T07:23:31.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:31 smithi087 ceph-mon[90982]: pgmap v54: 65 pgs: 65 active+clean; 322 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-17T07:23:31.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:31 smithi087 ceph-mon[90982]: mgrmap e39: smithi087.vuvjer(active, since 92s), standbys: smithi139.tuqnpn 2024-09-17T07:23:33.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:33 smithi139 ceph-mon[79872]: pgmap v55: 65 pgs: 65 active+clean; 322 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 511 B/s wr, 3 op/s 2024-09-17T07:23:33.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:33 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-17T07:23:33.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:33 smithi087 ceph-mon[90982]: pgmap v55: 65 pgs: 65 active+clean; 322 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 511 B/s wr, 3 op/s 2024-09-17T07:23:33.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:33 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-17T07:23:34.299 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:34 smithi087 ceph-mon[90982]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-17T07:23:34.299 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:34 smithi087 ceph-mon[90982]: Upgrade: osd.1 is safe to restart 2024-09-17T07:23:34.299 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:34 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:23:34.299 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:34 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-17T07:23:34.299 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:34 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:23:34.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:34 smithi139 ceph-mon[79872]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-17T07:23:34.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:34 smithi139 ceph-mon[79872]: Upgrade: osd.1 is safe to restart 2024-09-17T07:23:34.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:34 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:23:34.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:34 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-17T07:23:34.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:34 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:23:35.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:35 smithi139 ceph-mon[79872]: Upgrade: Updating osd.1 2024-09-17T07:23:35.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:35 smithi139 ceph-mon[79872]: Deploying daemon osd.1 on smithi087 2024-09-17T07:23:35.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:35 smithi139 ceph-mon[79872]: pgmap v56: 65 pgs: 65 active+clean; 322 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-17T07:23:35.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:35 smithi087 ceph-mon[90982]: Upgrade: Updating osd.1 2024-09-17T07:23:35.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:35 smithi087 ceph-mon[90982]: Deploying daemon osd.1 on smithi087 2024-09-17T07:23:35.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:35 smithi087 ceph-mon[90982]: pgmap v56: 65 pgs: 65 active+clean; 322 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-17T07:23:36.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.000+0000 7fcf87f47640 1 -- 172.21.15.87:0/987430875 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf800fb430 msgr2=0x7fcf800fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:23:36.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.000+0000 7fcf87f47640 1 --2- 172.21.15.87:0/987430875 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf800fb430 0x7fcf800fb840 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcf780048d0 tx=0x7fcf78009da0 comp rx=0 tx=0).stop 2024-09-17T07:23:36.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.000+0000 7fcf87f47640 1 -- 172.21.15.87:0/987430875 shutdown_connections 2024-09-17T07:23:36.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.000+0000 7fcf87f47640 1 --2- 172.21.15.87:0/987430875 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcf800fc700 0x7fcf800fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:36.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.000+0000 7fcf87f47640 1 --2- 172.21.15.87:0/987430875 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf800fb430 0x7fcf800fb840 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:36.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.000+0000 7fcf87f47640 1 -- 172.21.15.87:0/987430875 >> 172.21.15.87:0/987430875 conn(0x7fcf800f6c10 msgr2=0x7fcf800f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:23:36.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.000+0000 7fcf87f47640 1 -- 172.21.15.87:0/987430875 shutdown_connections 2024-09-17T07:23:36.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.000+0000 7fcf87f47640 1 -- 172.21.15.87:0/987430875 wait complete. 2024-09-17T07:23:36.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.000+0000 7fcf87f47640 1 Processor -- start 2024-09-17T07:23:36.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.001+0000 7fcf87f47640 1 -- start start 2024-09-17T07:23:36.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.001+0000 7fcf87f47640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcf800fb430 0x7fcf8010fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:23:36.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.001+0000 7fcf87f47640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf800fc700 0x7fcf80112210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:23:36.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.001+0000 7fcf87f47640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf80065c60 con 0x7fcf800fc700 2024-09-17T07:23:36.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.001+0000 7fcf87f47640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf80065dd0 con 0x7fcf800fb430 2024-09-17T07:23:36.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.001+0000 7fcf854e2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf800fc700 0x7fcf80112210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:23:36.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.001+0000 7fcf854e2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf800fc700 0x7fcf80112210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40832/0 (socket says 172.21.15.87:40832) 2024-09-17T07:23:36.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.001+0000 7fcf854e2640 1 -- 172.21.15.87:0/248289370 learned_addr learned my addr 172.21.15.87:0/248289370 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:23:36.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.001+0000 7fcf85ce3640 1 --2- 172.21.15.87:0/248289370 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcf800fb430 0x7fcf8010fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:23:36.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.001+0000 7fcf854e2640 1 -- 172.21.15.87:0/248289370 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcf800fb430 msgr2=0x7fcf8010fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:23:36.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.001+0000 7fcf854e2640 1 --2- 172.21.15.87:0/248289370 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcf800fb430 0x7fcf8010fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:36.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.001+0000 7fcf854e2640 1 -- 172.21.15.87:0/248289370 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf78005040 con 0x7fcf800fc700 2024-09-17T07:23:36.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.001+0000 7fcf854e2640 1 --2- 172.21.15.87:0/248289370 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf800fc700 0x7fcf80112210 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcf74002a50 tx=0x7fcf74004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:23:36.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.001+0000 7fcf7e7fc640 1 -- 172.21.15.87:0/248289370 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf74007c30 con 0x7fcf800fc700 2024-09-17T07:23:36.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.001+0000 7fcf7e7fc640 1 -- 172.21.15.87:0/248289370 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fcf7400f040 con 0x7fcf800fc700 2024-09-17T07:23:36.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.001+0000 7fcf87f47640 1 -- 172.21.15.87:0/248289370 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf801127b0 con 0x7fcf800fc700 2024-09-17T07:23:36.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.001+0000 7fcf7e7fc640 1 -- 172.21.15.87:0/248289370 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf7400dab0 con 0x7fcf800fc700 2024-09-17T07:23:36.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.002+0000 7fcf87f47640 1 -- 172.21.15.87:0/248289370 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf80112d20 con 0x7fcf800fc700 2024-09-17T07:23:36.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.002+0000 7fcf87f47640 1 -- 172.21.15.87:0/248289370 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf8004b720 con 0x7fcf800fc700 2024-09-17T07:23:36.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.003+0000 7fcf7e7fc640 1 -- 172.21.15.87:0/248289370 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fcf7400dc10 con 0x7fcf800fc700 2024-09-17T07:23:36.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.003+0000 7fcf7e7fc640 1 --2- 172.21.15.87:0/248289370 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fcf6806cb90 0x7fcf6806f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:23:36.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.004+0000 7fcf7e7fc640 1 -- 172.21.15.87:0/248289370 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fcf7408c000 con 0x7fcf800fc700 2024-09-17T07:23:36.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.004+0000 7fcf85ce3640 1 --2- 172.21.15.87:0/248289370 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fcf6806cb90 0x7fcf6806f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:23:36.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.004+0000 7fcf85ce3640 1 --2- 172.21.15.87:0/248289370 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fcf6806cb90 0x7fcf6806f040 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fcf78009ac0 tx=0x7fcf78035040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:23:36.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.009+0000 7fcf7e7fc640 1 -- 172.21.15.87:0/248289370 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fcf74056010 con 0x7fcf800fc700 2024-09-17T07:23:36.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.188+0000 7fcf87f47640 1 -- 172.21.15.87:0/248289370 --> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcf80101170 con 0x7fcf6806cb90 2024-09-17T07:23:36.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.189+0000 7fcf7e7fc640 1 -- 172.21.15.87:0/248289370 <== mgr.24529 v2:172.21.15.87:6800/1359413180 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fcf80101170 con 0x7fcf6806cb90 2024-09-17T07:23:36.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.191+0000 7fcf87f47640 1 -- 172.21.15.87:0/248289370 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fcf6806cb90 msgr2=0x7fcf6806f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:23:36.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.191+0000 7fcf87f47640 1 --2- 172.21.15.87:0/248289370 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fcf6806cb90 0x7fcf6806f040 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fcf78009ac0 tx=0x7fcf78035040 comp rx=0 tx=0).stop 2024-09-17T07:23:36.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.191+0000 7fcf87f47640 1 -- 172.21.15.87:0/248289370 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf800fc700 msgr2=0x7fcf80112210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:23:36.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.191+0000 7fcf87f47640 1 --2- 172.21.15.87:0/248289370 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf800fc700 0x7fcf80112210 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcf74002a50 tx=0x7fcf74004600 comp rx=0 tx=0).stop 2024-09-17T07:23:36.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.191+0000 7fcf87f47640 1 -- 172.21.15.87:0/248289370 shutdown_connections 2024-09-17T07:23:36.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.191+0000 7fcf87f47640 1 --2- 172.21.15.87:0/248289370 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf800fc700 0x7fcf80112210 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:36.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.191+0000 7fcf87f47640 1 --2- 172.21.15.87:0/248289370 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fcf6806cb90 0x7fcf6806f040 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:36.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.191+0000 7fcf87f47640 1 --2- 172.21.15.87:0/248289370 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcf800fb430 0x7fcf8010fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:36.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.191+0000 7fcf87f47640 1 -- 172.21.15.87:0/248289370 >> 172.21.15.87:0/248289370 conn(0x7fcf800f6c10 msgr2=0x7fcf800ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:23:36.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.191+0000 7fcf87f47640 1 -- 172.21.15.87:0/248289370 shutdown_connections 2024-09-17T07:23:36.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.191+0000 7fcf87f47640 1 -- 172.21.15.87:0/248289370 wait complete. 2024-09-17T07:23:36.200 INFO:teuthology.orchestra.run.smithi087.stdout:true 2024-09-17T07:23:36.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.287+0000 7f607b769640 1 -- 172.21.15.87:0/3445054506 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60740fb430 msgr2=0x7f60740fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:23:36.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.287+0000 7f607b769640 1 --2- 172.21.15.87:0/3445054506 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60740fb430 0x7f60740fb840 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f60700048d0 tx=0x7f6070009da0 comp rx=0 tx=0).stop 2024-09-17T07:23:36.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.287+0000 7f607b769640 1 -- 172.21.15.87:0/3445054506 shutdown_connections 2024-09-17T07:23:36.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.287+0000 7f607b769640 1 --2- 172.21.15.87:0/3445054506 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f60740fc700 0x7f60740fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:36.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.287+0000 7f607b769640 1 --2- 172.21.15.87:0/3445054506 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60740fb430 0x7f60740fb840 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:36.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.287+0000 7f607b769640 1 -- 172.21.15.87:0/3445054506 >> 172.21.15.87:0/3445054506 conn(0x7f60740f6c10 msgr2=0x7f60740f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:23:36.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.288+0000 7f607b769640 1 -- 172.21.15.87:0/3445054506 shutdown_connections 2024-09-17T07:23:36.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.288+0000 7f607b769640 1 -- 172.21.15.87:0/3445054506 wait complete. 2024-09-17T07:23:36.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.288+0000 7f607b769640 1 Processor -- start 2024-09-17T07:23:36.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.288+0000 7f607b769640 1 -- start start 2024-09-17T07:23:36.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.288+0000 7f607b769640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f60740fb430 0x7f607410cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:23:36.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.288+0000 7f607b769640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60740fc700 0x7f607410d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:23:36.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.288+0000 7f607b769640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f607410db20 con 0x7f60740fc700 2024-09-17T07:23:36.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.288+0000 7f607b769640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f607410e340 con 0x7f60740fb430 2024-09-17T07:23:36.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.288+0000 7f6078d04640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60740fc700 0x7f607410d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:23:36.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.289+0000 7f6078d04640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60740fc700 0x7f607410d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40854/0 (socket says 172.21.15.87:40854) 2024-09-17T07:23:36.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.289+0000 7f6078d04640 1 -- 172.21.15.87:0/3546571818 learned_addr learned my addr 172.21.15.87:0/3546571818 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:23:36.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.289+0000 7f6079505640 1 --2- 172.21.15.87:0/3546571818 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f60740fb430 0x7f607410cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:23:36.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.289+0000 7f6078d04640 1 -- 172.21.15.87:0/3546571818 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f60740fb430 msgr2=0x7f607410cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:23:36.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.289+0000 7f6078d04640 1 --2- 172.21.15.87:0/3546571818 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f60740fb430 0x7f607410cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:36.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.289+0000 7f6078d04640 1 -- 172.21.15.87:0/3546571818 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6070005040 con 0x7f60740fc700 2024-09-17T07:23:36.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.289+0000 7f6078d04640 1 --2- 172.21.15.87:0/3546571818 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60740fc700 0x7f607410d4d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6064002a50 tx=0x7f6064004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:23:36.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.289+0000 7f6069ffb640 1 -- 172.21.15.87:0/3546571818 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6064007c30 con 0x7f60740fc700 2024-09-17T07:23:36.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.289+0000 7f6069ffb640 1 -- 172.21.15.87:0/3546571818 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f606400f040 con 0x7f60740fc700 2024-09-17T07:23:36.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.289+0000 7f607b769640 1 -- 172.21.15.87:0/3546571818 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f607410e5d0 con 0x7f60740fc700 2024-09-17T07:23:36.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.289+0000 7f6069ffb640 1 -- 172.21.15.87:0/3546571818 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f606400da30 con 0x7f60740fc700 2024-09-17T07:23:36.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.290+0000 7f607b769640 1 -- 172.21.15.87:0/3546571818 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f607410eb70 con 0x7f60740fc700 2024-09-17T07:23:36.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.290+0000 7f607b769640 1 -- 172.21.15.87:0/3546571818 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60740fa890 con 0x7f60740fc700 2024-09-17T07:23:36.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.291+0000 7f6069ffb640 1 -- 172.21.15.87:0/3546571818 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f606400db90 con 0x7f60740fc700 2024-09-17T07:23:36.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.291+0000 7f6069ffb640 1 --2- 172.21.15.87:0/3546571818 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f606006cb90 0x7f606006f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:23:36.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.291+0000 7f6069ffb640 1 -- 172.21.15.87:0/3546571818 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f606408bed0 con 0x7f60740fc700 2024-09-17T07:23:36.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.292+0000 7f6079505640 1 --2- 172.21.15.87:0/3546571818 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f606006cb90 0x7f606006f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:23:36.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.292+0000 7f6079505640 1 --2- 172.21.15.87:0/3546571818 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f606006cb90 0x7f606006f040 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6070000c00 tx=0x7f6070035040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:23:36.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.296+0000 7f6069ffb640 1 -- 172.21.15.87:0/3546571818 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f6064055ee0 con 0x7f60740fc700 2024-09-17T07:23:36.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.490+0000 7f607b769640 1 -- 172.21.15.87:0/3546571818 --> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f607410ef00 con 0x7f606006cb90 2024-09-17T07:23:36.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.492+0000 7f6069ffb640 1 -- 172.21.15.87:0/3546571818 <== mgr.24529 v2:172.21.15.87:6800/1359413180 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f607410ef00 con 0x7f606006cb90 2024-09-17T07:23:36.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.495+0000 7f607b769640 1 -- 172.21.15.87:0/3546571818 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f606006cb90 msgr2=0x7f606006f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:23:36.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.495+0000 7f607b769640 1 --2- 172.21.15.87:0/3546571818 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f606006cb90 0x7f606006f040 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6070000c00 tx=0x7f6070035040 comp rx=0 tx=0).stop 2024-09-17T07:23:36.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.495+0000 7f607b769640 1 -- 172.21.15.87:0/3546571818 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60740fc700 msgr2=0x7f607410d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:23:36.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.495+0000 7f607b769640 1 --2- 172.21.15.87:0/3546571818 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60740fc700 0x7f607410d4d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6064002a50 tx=0x7f6064004600 comp rx=0 tx=0).stop 2024-09-17T07:23:36.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.495+0000 7f607b769640 1 -- 172.21.15.87:0/3546571818 shutdown_connections 2024-09-17T07:23:36.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.495+0000 7f607b769640 1 --2- 172.21.15.87:0/3546571818 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60740fc700 0x7f607410d4d0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:36.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.495+0000 7f607b769640 1 --2- 172.21.15.87:0/3546571818 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f606006cb90 0x7f606006f040 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:36.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.495+0000 7f607b769640 1 --2- 172.21.15.87:0/3546571818 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f60740fb430 0x7f607410cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:36.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.495+0000 7f607b769640 1 -- 172.21.15.87:0/3546571818 >> 172.21.15.87:0/3546571818 conn(0x7f60740f6c10 msgr2=0x7f6074064f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:23:36.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.495+0000 7f607b769640 1 -- 172.21.15.87:0/3546571818 shutdown_connections 2024-09-17T07:23:36.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.495+0000 7f607b769640 1 -- 172.21.15.87:0/3546571818 wait complete. 2024-09-17T07:23:36.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.579+0000 7f7d07150640 1 -- 172.21.15.87:0/2804161335 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d000fb420 msgr2=0x7f7d000fb830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:23:36.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.579+0000 7f7d07150640 1 --2- 172.21.15.87:0/2804161335 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d000fb420 0x7f7d000fb830 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7cf40048d0 tx=0x7f7cf4009da0 comp rx=0 tx=0).stop 2024-09-17T07:23:36.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.579+0000 7f7d07150640 1 -- 172.21.15.87:0/2804161335 shutdown_connections 2024-09-17T07:23:36.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.579+0000 7f7d07150640 1 --2- 172.21.15.87:0/2804161335 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7d000fc6f0 0x7f7d000fcb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:36.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.579+0000 7f7d07150640 1 --2- 172.21.15.87:0/2804161335 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d000fb420 0x7f7d000fb830 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:36.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.579+0000 7f7d07150640 1 -- 172.21.15.87:0/2804161335 >> 172.21.15.87:0/2804161335 conn(0x7f7d000f6c00 msgr2=0x7f7d000f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:23:36.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.579+0000 7f7d07150640 1 -- 172.21.15.87:0/2804161335 shutdown_connections 2024-09-17T07:23:36.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.579+0000 7f7d07150640 1 -- 172.21.15.87:0/2804161335 wait complete. 2024-09-17T07:23:36.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.580+0000 7f7d07150640 1 Processor -- start 2024-09-17T07:23:36.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.580+0000 7f7d07150640 1 -- start start 2024-09-17T07:23:36.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.580+0000 7f7d07150640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7d000fb420 0x7f7d0010fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:23:36.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.580+0000 7f7d07150640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d000fc6f0 0x7f7d001122a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:23:36.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.580+0000 7f7d07150640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d00066580 con 0x7f7d000fc6f0 2024-09-17T07:23:36.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.580+0000 7f7d07150640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d000666f0 con 0x7f7d000fb420 2024-09-17T07:23:36.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.580+0000 7f7cfffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d000fc6f0 0x7f7d001122a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:23:36.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.580+0000 7f7cfffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d000fc6f0 0x7f7d001122a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40870/0 (socket says 172.21.15.87:40870) 2024-09-17T07:23:36.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.580+0000 7f7cfffff640 1 -- 172.21.15.87:0/3619475620 learned_addr learned my addr 172.21.15.87:0/3619475620 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:23:36.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.580+0000 7f7d04eec640 1 --2- 172.21.15.87:0/3619475620 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7d000fb420 0x7f7d0010fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:23:36.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.580+0000 7f7cfffff640 1 -- 172.21.15.87:0/3619475620 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7d000fb420 msgr2=0x7f7d0010fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:23:36.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.580+0000 7f7cfffff640 1 --2- 172.21.15.87:0/3619475620 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7d000fb420 0x7f7d0010fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:36.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.580+0000 7f7cfffff640 1 -- 172.21.15.87:0/3619475620 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cf4005040 con 0x7f7d000fc6f0 2024-09-17T07:23:36.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.581+0000 7f7cfffff640 1 --2- 172.21.15.87:0/3619475620 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d000fc6f0 0x7f7d001122a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7cec00b790 tx=0x7f7cec0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:23:36.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.581+0000 7f7cfd7fa640 1 -- 172.21.15.87:0/3619475620 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7cec00c700 con 0x7f7d000fc6f0 2024-09-17T07:23:36.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.581+0000 7f7d07150640 1 -- 172.21.15.87:0/3619475620 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d001128a0 con 0x7f7d000fc6f0 2024-09-17T07:23:36.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.581+0000 7f7cfd7fa640 1 -- 172.21.15.87:0/3619475620 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f7cec00cce0 con 0x7f7d000fc6f0 2024-09-17T07:23:36.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.581+0000 7f7cfd7fa640 1 -- 172.21.15.87:0/3619475620 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7cec015e10 con 0x7f7d000fc6f0 2024-09-17T07:23:36.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.581+0000 7f7d07150640 1 -- 172.21.15.87:0/3619475620 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d00112dc0 con 0x7f7d000fc6f0 2024-09-17T07:23:36.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.582+0000 7f7d07150640 1 -- 172.21.15.87:0/3619475620 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d000fa880 con 0x7f7d000fc6f0 2024-09-17T07:23:36.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.583+0000 7f7cfd7fa640 1 -- 172.21.15.87:0/3619475620 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f7cec012070 con 0x7f7d000fc6f0 2024-09-17T07:23:36.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.583+0000 7f7cfd7fa640 1 --2- 172.21.15.87:0/3619475620 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f7cf006cb90 0x7f7cf006f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:23:36.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.583+0000 7f7cfd7fa640 1 -- 172.21.15.87:0/3619475620 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f7cec08bcc0 con 0x7f7d000fc6f0 2024-09-17T07:23:36.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.583+0000 7f7d04eec640 1 --2- 172.21.15.87:0/3619475620 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f7cf006cb90 0x7f7cf006f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:23:36.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.584+0000 7f7d04eec640 1 --2- 172.21.15.87:0/3619475620 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f7cf006cb90 0x7f7cf006f040 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7cf4009ac0 tx=0x7f7cf4035040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:23:36.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.588+0000 7f7cfd7fa640 1 -- 172.21.15.87:0/3619475620 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7cec055cd0 con 0x7f7d000fc6f0 2024-09-17T07:23:36.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.775+0000 7f7d07150640 1 -- 172.21.15.87:0/3619475620 --> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7d00100bc0 con 0x7f7cf006cb90 2024-09-17T07:23:36.776 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 17 07:23:36 smithi087 systemd[1]: Stopping Ceph osd.1 for d5dbf8d6-74c3-11ef-bceb-c7b262605968... 2024-09-17T07:23:36.786 INFO:teuthology.orchestra.run.smithi087.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T07:23:36.786 INFO:teuthology.orchestra.run.smithi087.stdout:alertmanager.smithi087 smithi087 *:9093,9094 running (3m) 23s ago 11m 25.6M - 0.25.0 c8568f914cd2 594553f0b497 2024-09-17T07:23:36.787 INFO:teuthology.orchestra.run.smithi087.stdout:crash.smithi087 smithi087 running (52s) 23s ago 11m 6895k - 18.2.4-855-g19e2a2be 980a0bfcd684 0ff8a9330162 2024-09-17T07:23:36.787 INFO:teuthology.orchestra.run.smithi087.stdout:crash.smithi139 smithi139 running (47s) 44s ago 10m 6899k - 18.2.4-855-g19e2a2be 980a0bfcd684 10541e3b202e 2024-09-17T07:23:36.787 INFO:teuthology.orchestra.run.smithi087.stdout:grafana.smithi087 smithi087 *:3000 running (3m) 23s ago 11m 80.0M - 9.4.7 954c08fa6188 e2f17ec6baa8 2024-09-17T07:23:36.787 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi087.tjhpcs smithi087 running (6m) 23s ago 6m 130M - 17.2.7-1635-g4a704134 f22ead590bad f7142ad971ed 2024-09-17T07:23:36.787 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi087.vvbzss smithi087 running (6m) 23s ago 6m 70.1M - 17.2.7-1635-g4a704134 f22ead590bad 2dd82ff293d1 2024-09-17T07:23:36.787 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi139.ftvinf smithi139 running (6m) 44s ago 6m 57.4M - 17.2.7-1635-g4a704134 f22ead590bad d11edb295ad3 2024-09-17T07:23:36.787 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi139.gnwonz smithi139 running (6m) 44s ago 6m 116M - 17.2.7-1635-g4a704134 f22ead590bad 3b3d884aef02 2024-09-17T07:23:36.787 INFO:teuthology.orchestra.run.smithi087.stdout:mgr.smithi087.vuvjer smithi087 *:8443,9283,8765 running (2m) 23s ago 12m 485M - 18.2.4-855-g19e2a2be 980a0bfcd684 5d10c647cb6b 2024-09-17T07:23:36.787 INFO:teuthology.orchestra.run.smithi087.stdout:mgr.smithi139.tuqnpn smithi139 *:8443,9283,8765 running (117s) 44s ago 10m 437M - 18.2.4-855-g19e2a2be 980a0bfcd684 6e0bf371d44c 2024-09-17T07:23:36.787 INFO:teuthology.orchestra.run.smithi087.stdout:mon.smithi087 smithi087 running (105s) 23s ago 13m 41.3M 2048M 18.2.4-855-g19e2a2be 980a0bfcd684 305c72de1f9f 2024-09-17T07:23:36.787 INFO:teuthology.orchestra.run.smithi087.stdout:mon.smithi139 smithi139 running (87s) 44s ago 10m 34.0M 2048M 18.2.4-855-g19e2a2be 980a0bfcd684 0b159495af0f 2024-09-17T07:23:36.787 INFO:teuthology.orchestra.run.smithi087.stdout:node-exporter.smithi087 smithi087 *:9100 running (3m) 23s ago 11m 15.2M - 1.5.0 0da6a335fe13 39fa48de0e87 2024-09-17T07:23:36.787 INFO:teuthology.orchestra.run.smithi087.stdout:node-exporter.smithi139 smithi139 *:9100 running (2m) 44s ago 10m 15.6M - 1.5.0 0da6a335fe13 a5b99b7cbb06 2024-09-17T07:23:36.787 INFO:teuthology.orchestra.run.smithi087.stdout:osd.0 smithi087 running (28s) 23s ago 9m 11.9M 1557M 18.2.4-855-g19e2a2be 980a0bfcd684 e97cb50e6aec 2024-09-17T07:23:36.788 INFO:teuthology.orchestra.run.smithi087.stdout:osd.1 smithi087 running (9m) 23s ago 9m 193M 1557M 17.2.7-1635-g4a704134 f22ead590bad 9446985bfcd1 2024-09-17T07:23:36.788 INFO:teuthology.orchestra.run.smithi087.stdout:osd.2 smithi087 running (8m) 23s ago 8m 160M 1557M 17.2.7-1635-g4a704134 f22ead590bad 8fe1428a6878 2024-09-17T07:23:36.788 INFO:teuthology.orchestra.run.smithi087.stdout:osd.3 smithi139 running (8m) 44s ago 8m 234M 2581M 17.2.7-1635-g4a704134 f22ead590bad 0801999b17c4 2024-09-17T07:23:36.788 INFO:teuthology.orchestra.run.smithi087.stdout:osd.4 smithi139 running (8m) 44s ago 8m 210M 2581M 17.2.7-1635-g4a704134 f22ead590bad 299a8dfc47f5 2024-09-17T07:23:36.788 INFO:teuthology.orchestra.run.smithi087.stdout:osd.5 smithi139 running (7m) 44s ago 7m 200M 2581M 17.2.7-1635-g4a704134 f22ead590bad 609cf74f32e7 2024-09-17T07:23:36.788 INFO:teuthology.orchestra.run.smithi087.stdout:prometheus.smithi087 smithi087 *:9095 running (2m) 23s ago 11m 54.0M - 2.43.0 a07b618ecd1d 63d18b7469fc 2024-09-17T07:23:36.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.786+0000 7f7cfd7fa640 1 -- 172.21.15.87:0/3619475620 <== mgr.24529 v2:172.21.15.87:6800/1359413180 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f7d00100bc0 con 0x7f7cf006cb90 2024-09-17T07:23:36.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.788+0000 7f7d07150640 1 -- 172.21.15.87:0/3619475620 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f7cf006cb90 msgr2=0x7f7cf006f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:23:36.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.788+0000 7f7d07150640 1 --2- 172.21.15.87:0/3619475620 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f7cf006cb90 0x7f7cf006f040 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7cf4009ac0 tx=0x7f7cf4035040 comp rx=0 tx=0).stop 2024-09-17T07:23:36.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.788+0000 7f7d07150640 1 -- 172.21.15.87:0/3619475620 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d000fc6f0 msgr2=0x7f7d001122a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:23:36.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.788+0000 7f7d07150640 1 --2- 172.21.15.87:0/3619475620 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d000fc6f0 0x7f7d001122a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7cec00b790 tx=0x7f7cec0091d0 comp rx=0 tx=0).stop 2024-09-17T07:23:36.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.788+0000 7f7d07150640 1 -- 172.21.15.87:0/3619475620 shutdown_connections 2024-09-17T07:23:36.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.788+0000 7f7d07150640 1 --2- 172.21.15.87:0/3619475620 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d000fc6f0 0x7f7d001122a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:36.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.788+0000 7f7d07150640 1 --2- 172.21.15.87:0/3619475620 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f7cf006cb90 0x7f7cf006f040 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:36.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.788+0000 7f7d07150640 1 --2- 172.21.15.87:0/3619475620 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7d000fb420 0x7f7d0010fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:36.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.788+0000 7f7d07150640 1 -- 172.21.15.87:0/3619475620 >> 172.21.15.87:0/3619475620 conn(0x7f7d000f6c00 msgr2=0x7f7d000f8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:23:36.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.788+0000 7f7d07150640 1 -- 172.21.15.87:0/3619475620 shutdown_connections 2024-09-17T07:23:36.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.788+0000 7f7d07150640 1 -- 172.21.15.87:0/3619475620 wait complete. 2024-09-17T07:23:36.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.866+0000 7efc9bf65640 1 -- 172.21.15.87:0/2190449844 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc940fc3c0 msgr2=0x7efc940fc810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:23:36.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.866+0000 7efc9bf65640 1 --2- 172.21.15.87:0/2190449844 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc940fc3c0 0x7efc940fc810 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7efc840048d0 tx=0x7efc84009da0 comp rx=0 tx=0).stop 2024-09-17T07:23:36.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.866+0000 7efc9bf65640 1 -- 172.21.15.87:0/2190449844 shutdown_connections 2024-09-17T07:23:36.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.866+0000 7efc9bf65640 1 --2- 172.21.15.87:0/2190449844 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc940fc3c0 0x7efc940fc810 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:36.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.866+0000 7efc9bf65640 1 --2- 172.21.15.87:0/2190449844 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efc940fba70 0x7efc940fbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:36.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.866+0000 7efc9bf65640 1 -- 172.21.15.87:0/2190449844 >> 172.21.15.87:0/2190449844 conn(0x7efc940f63a0 msgr2=0x7efc940f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:23:36.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.866+0000 7efc9bf65640 1 -- 172.21.15.87:0/2190449844 shutdown_connections 2024-09-17T07:23:36.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.866+0000 7efc9bf65640 1 -- 172.21.15.87:0/2190449844 wait complete. 2024-09-17T07:23:36.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.867+0000 7efc9bf65640 1 Processor -- start 2024-09-17T07:23:36.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.867+0000 7efc9bf65640 1 -- start start 2024-09-17T07:23:36.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.867+0000 7efc9bf65640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efc940fba70 0x7efc940fb300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:23:36.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.867+0000 7efc9bf65640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc940fc3c0 0x7efc94111d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:23:36.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.867+0000 7efc9bf65640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc941123b0 con 0x7efc940fc3c0 2024-09-17T07:23:36.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.867+0000 7efc9bf65640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc941124f0 con 0x7efc940fba70 2024-09-17T07:23:36.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.867+0000 7efc99500640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc940fc3c0 0x7efc94111d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:23:36.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.867+0000 7efc99500640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc940fc3c0 0x7efc94111d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40896/0 (socket says 172.21.15.87:40896) 2024-09-17T07:23:36.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.867+0000 7efc99500640 1 -- 172.21.15.87:0/1275709100 learned_addr learned my addr 172.21.15.87:0/1275709100 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:23:36.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.867+0000 7efc99d01640 1 --2- 172.21.15.87:0/1275709100 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efc940fba70 0x7efc940fb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:23:36.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.867+0000 7efc99500640 1 -- 172.21.15.87:0/1275709100 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efc940fba70 msgr2=0x7efc940fb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:23:36.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.867+0000 7efc99500640 1 --2- 172.21.15.87:0/1275709100 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efc940fba70 0x7efc940fb300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:36.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.867+0000 7efc99500640 1 -- 172.21.15.87:0/1275709100 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc84005040 con 0x7efc940fc3c0 2024-09-17T07:23:36.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.867+0000 7efc99d01640 1 --2- 172.21.15.87:0/1275709100 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efc940fba70 0x7efc940fb300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T07:23:36.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.868+0000 7efc99500640 1 --2- 172.21.15.87:0/1275709100 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc940fc3c0 0x7efc94111d80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7efc840043d0 tx=0x7efc84009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:23:36.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.868+0000 7efc8a7fc640 1 -- 172.21.15.87:0/1275709100 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc84038070 con 0x7efc940fc3c0 2024-09-17T07:23:36.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.868+0000 7efc8a7fc640 1 -- 172.21.15.87:0/1275709100 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7efc840096c0 con 0x7efc940fc3c0 2024-09-17T07:23:36.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.868+0000 7efc9bf65640 1 -- 172.21.15.87:0/1275709100 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc94112770 con 0x7efc940fc3c0 2024-09-17T07:23:36.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.868+0000 7efc8a7fc640 1 -- 172.21.15.87:0/1275709100 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc8403d420 con 0x7efc940fc3c0 2024-09-17T07:23:36.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.868+0000 7efc9bf65640 1 -- 172.21.15.87:0/1275709100 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc94112d10 con 0x7efc940fc3c0 2024-09-17T07:23:36.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.869+0000 7efc9bf65640 1 -- 172.21.15.87:0/1275709100 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc940fa040 con 0x7efc940fc3c0 2024-09-17T07:23:36.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.869+0000 7efc8a7fc640 1 -- 172.21.15.87:0/1275709100 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7efc84030020 con 0x7efc940fc3c0 2024-09-17T07:23:36.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.870+0000 7efc8a7fc640 1 --2- 172.21.15.87:0/1275709100 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7efc8006cb90 0x7efc8006f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:23:36.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.870+0000 7efc8a7fc640 1 -- 172.21.15.87:0/1275709100 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6410+0+0 (secure 0 0 0) 0x7efc840ac6f0 con 0x7efc940fc3c0 2024-09-17T07:23:36.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.870+0000 7efc99d01640 1 --2- 172.21.15.87:0/1275709100 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7efc8006cb90 0x7efc8006f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:23:36.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.870+0000 7efc99d01640 1 --2- 172.21.15.87:0/1275709100 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7efc8006cb90 0x7efc8006f040 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7efc940fb0b0 tx=0x7efc9000b040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:23:36.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:36.874+0000 7efc8a7fc640 1 -- 172.21.15.87:0/1275709100 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7efc84076700 con 0x7efc940fc3c0 2024-09-17T07:23:37.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.099+0000 7efc9bf65640 1 -- 172.21.15.87:0/1275709100 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7efc94103d40 con 0x7efc940fc3c0 2024-09-17T07:23:37.100 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 17 07:23:36 smithi087 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-1[52723]: 2024-09-17T07:23:36.882+0000 7f973a513640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T07:23:37.100 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 17 07:23:36 smithi087 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-1[52723]: 2024-09-17T07:23:36.882+0000 7f973a513640 -1 osd.1 52 *** Got signal Terminated *** 2024-09-17T07:23:37.100 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 17 07:23:36 smithi087 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-1[52723]: 2024-09-17T07:23:36.882+0000 7f973a513640 -1 osd.1 52 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T07:23:37.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.100+0000 7efc8a7fc640 1 -- 172.21.15.87:0/1275709100 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+846 (secure 0 0 0) 0x7efc84079d20 con 0x7efc940fc3c0 2024-09-17T07:23:37.101 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T07:23:37.101 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": { 2024-09-17T07:23:37.101 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 2 2024-09-17T07:23:37.101 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:23:37.101 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr": { 2024-09-17T07:23:37.101 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 2 2024-09-17T07:23:37.101 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:23:37.101 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": { 2024-09-17T07:23:37.101 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 5, 2024-09-17T07:23:37.101 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 1 2024-09-17T07:23:37.101 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:23:37.101 INFO:teuthology.orchestra.run.smithi087.stdout: "mds": { 2024-09-17T07:23:37.102 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 4 2024-09-17T07:23:37.102 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:23:37.102 INFO:teuthology.orchestra.run.smithi087.stdout: "overall": { 2024-09-17T07:23:37.102 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 9, 2024-09-17T07:23:37.102 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 5 2024-09-17T07:23:37.102 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T07:23:37.102 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T07:23:37.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.102+0000 7efc9bf65640 1 -- 172.21.15.87:0/1275709100 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7efc8006cb90 msgr2=0x7efc8006f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:23:37.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.102+0000 7efc9bf65640 1 --2- 172.21.15.87:0/1275709100 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7efc8006cb90 0x7efc8006f040 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7efc940fb0b0 tx=0x7efc9000b040 comp rx=0 tx=0).stop 2024-09-17T07:23:37.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.102+0000 7efc9bf65640 1 -- 172.21.15.87:0/1275709100 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc940fc3c0 msgr2=0x7efc94111d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:23:37.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.102+0000 7efc9bf65640 1 --2- 172.21.15.87:0/1275709100 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc940fc3c0 0x7efc94111d80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7efc840043d0 tx=0x7efc84009da0 comp rx=0 tx=0).stop 2024-09-17T07:23:37.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.102+0000 7efc9bf65640 1 -- 172.21.15.87:0/1275709100 shutdown_connections 2024-09-17T07:23:37.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.102+0000 7efc9bf65640 1 --2- 172.21.15.87:0/1275709100 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc940fc3c0 0x7efc94111d80 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:37.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.102+0000 7efc9bf65640 1 --2- 172.21.15.87:0/1275709100 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7efc8006cb90 0x7efc8006f040 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:37.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.102+0000 7efc9bf65640 1 --2- 172.21.15.87:0/1275709100 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efc940fba70 0x7efc940fb300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:37.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.102+0000 7efc9bf65640 1 -- 172.21.15.87:0/1275709100 >> 172.21.15.87:0/1275709100 conn(0x7efc940f63a0 msgr2=0x7efc940f7f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:23:37.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.102+0000 7efc9bf65640 1 -- 172.21.15.87:0/1275709100 shutdown_connections 2024-09-17T07:23:37.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.102+0000 7efc9bf65640 1 -- 172.21.15.87:0/1275709100 wait complete. 2024-09-17T07:23:37.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.187+0000 7f1ab9167640 1 -- 172.21.15.87:0/3795836489 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ab40fc550 msgr2=0x7f1ab40fc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:23:37.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.187+0000 7f1ab9167640 1 --2- 172.21.15.87:0/3795836489 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ab40fc550 0x7f1ab40fc960 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1aac009c50 tx=0x7f1aac004d10 comp rx=0 tx=0).stop 2024-09-17T07:23:37.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.187+0000 7f1ab9167640 1 -- 172.21.15.87:0/3795836489 shutdown_connections 2024-09-17T07:23:37.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.187+0000 7f1ab9167640 1 --2- 172.21.15.87:0/3795836489 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1ab40fd820 0x7f1ab40fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:37.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.187+0000 7f1ab9167640 1 --2- 172.21.15.87:0/3795836489 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ab40fc550 0x7f1ab40fc960 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:37.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.187+0000 7f1ab9167640 1 -- 172.21.15.87:0/3795836489 >> 172.21.15.87:0/3795836489 conn(0x7f1ab40f7d30 msgr2=0x7f1ab40fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:23:37.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.187+0000 7f1ab9167640 1 -- 172.21.15.87:0/3795836489 shutdown_connections 2024-09-17T07:23:37.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.187+0000 7f1ab9167640 1 -- 172.21.15.87:0/3795836489 wait complete. 2024-09-17T07:23:37.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.188+0000 7f1ab9167640 1 Processor -- start 2024-09-17T07:23:37.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.188+0000 7f1ab9167640 1 -- start start 2024-09-17T07:23:37.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.188+0000 7f1ab9167640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ab40fc550 0x7f1ab410cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:23:37.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.188+0000 7f1ab9167640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1ab40fd820 0x7f1ab410d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:23:37.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.188+0000 7f1ab9167640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab410db50 con 0x7f1ab40fc550 2024-09-17T07:23:37.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.188+0000 7f1ab9167640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab410e370 con 0x7f1ab40fd820 2024-09-17T07:23:37.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.188+0000 7f1ab2d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ab40fc550 0x7f1ab410cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:23:37.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.188+0000 7f1ab2d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ab40fc550 0x7f1ab410cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40924/0 (socket says 172.21.15.87:40924) 2024-09-17T07:23:37.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.188+0000 7f1ab2d9d640 1 -- 172.21.15.87:0/4206598681 learned_addr learned my addr 172.21.15.87:0/4206598681 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:23:37.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.188+0000 7f1ab259c640 1 --2- 172.21.15.87:0/4206598681 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1ab40fd820 0x7f1ab410d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:23:37.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.188+0000 7f1ab2d9d640 1 -- 172.21.15.87:0/4206598681 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1ab40fd820 msgr2=0x7f1ab410d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:23:37.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.188+0000 7f1ab2d9d640 1 --2- 172.21.15.87:0/4206598681 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1ab40fd820 0x7f1ab410d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:37.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.188+0000 7f1ab2d9d640 1 -- 172.21.15.87:0/4206598681 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aac0098b0 con 0x7f1ab40fc550 2024-09-17T07:23:37.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.188+0000 7f1ab259c640 1 --2- 172.21.15.87:0/4206598681 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1ab40fd820 0x7f1ab410d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T07:23:37.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.188+0000 7f1ab2d9d640 1 --2- 172.21.15.87:0/4206598681 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ab40fc550 0x7f1ab410cfc0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1aac004750 tx=0x7f1aac004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:23:37.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.189+0000 7f1aab7fe640 1 -- 172.21.15.87:0/4206598681 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1aac032750 con 0x7f1ab40fc550 2024-09-17T07:23:37.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.189+0000 7f1aab7fe640 1 -- 172.21.15.87:0/4206598681 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f1aac009710 con 0x7f1ab40fc550 2024-09-17T07:23:37.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.189+0000 7f1ab9167640 1 -- 172.21.15.87:0/4206598681 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ab410e5a0 con 0x7f1ab40fc550 2024-09-17T07:23:37.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.189+0000 7f1aab7fe640 1 -- 172.21.15.87:0/4206598681 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1aac03dab0 con 0x7f1ab40fc550 2024-09-17T07:23:37.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.189+0000 7f1ab9167640 1 -- 172.21.15.87:0/4206598681 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ab410eb40 con 0x7f1ab40fc550 2024-09-17T07:23:37.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.190+0000 7f1ab9167640 1 -- 172.21.15.87:0/4206598681 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ab40fb9b0 con 0x7f1ab40fc550 2024-09-17T07:23:37.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.190+0000 7f1aab7fe640 1 -- 172.21.15.87:0/4206598681 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f1aac02f030 con 0x7f1ab40fc550 2024-09-17T07:23:37.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.190+0000 7f1aab7fe640 1 --2- 172.21.15.87:0/4206598681 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f1aa006cb90 0x7f1aa006f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:23:37.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.191+0000 7f1aab7fe640 1 -- 172.21.15.87:0/4206598681 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f1aac0ad780 con 0x7f1ab40fc550 2024-09-17T07:23:37.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.191+0000 7f1ab259c640 1 --2- 172.21.15.87:0/4206598681 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f1aa006cb90 0x7f1aa006f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:23:37.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.191+0000 7f1ab259c640 1 --2- 172.21.15.87:0/4206598681 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f1aa006cb90 0x7f1aa006f040 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c009fd0 tx=0x7f1a9c009e50 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:23:37.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.195+0000 7f1aab7fe640 1 -- 172.21.15.87:0/4206598681 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f1aac077790 con 0x7f1ab40fc550 2024-09-17T07:23:37.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:37 smithi139 ceph-mon[79872]: pgmap v57: 65 pgs: 65 active+clean; 322 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 511 B/s wr, 3 op/s 2024-09-17T07:23:37.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:37 smithi139 ceph-mon[79872]: from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:23:37.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:37 smithi139 ceph-mon[79872]: osd.1 marked itself down and dead 2024-09-17T07:23:37.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:37 smithi139 ceph-mon[79872]: from='client.? 172.21.15.87:0/1275709100' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:23:37.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.389+0000 7f1ab9167640 1 -- 172.21.15.87:0/4206598681 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1ab410ee70 con 0x7f1ab40fc550 2024-09-17T07:23:37.390 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:37 smithi087 ceph-mon[90982]: pgmap v57: 65 pgs: 65 active+clean; 322 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 511 B/s wr, 3 op/s 2024-09-17T07:23:37.390 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:37 smithi087 ceph-mon[90982]: from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:23:37.390 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:37 smithi087 ceph-mon[90982]: osd.1 marked itself down and dead 2024-09-17T07:23:37.390 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:37 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/1275709100' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:23:37.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.389+0000 7f1aab7fe640 1 -- 172.21.15.87:0/4206598681 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1905 (secure 0 0 0) 0x7f1aac07adb0 con 0x7f1ab40fc550 2024-09-17T07:23:37.390 INFO:teuthology.orchestra.run.smithi087.stdout:e21 2024-09-17T07:23:37.391 INFO:teuthology.orchestra.run.smithi087.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T07:23:37.391 INFO:teuthology.orchestra.run.smithi087.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T07:23:37.391 INFO:teuthology.orchestra.run.smithi087.stdout:legacy client fscid: 1 2024-09-17T07:23:37.391 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:23:37.391 INFO:teuthology.orchestra.run.smithi087.stdout:Filesystem 'cephfs' (1) 2024-09-17T07:23:37.391 INFO:teuthology.orchestra.run.smithi087.stdout:fs_name cephfs 2024-09-17T07:23:37.391 INFO:teuthology.orchestra.run.smithi087.stdout:epoch 21 2024-09-17T07:23:37.391 INFO:teuthology.orchestra.run.smithi087.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T07:23:37.391 INFO:teuthology.orchestra.run.smithi087.stdout:created 2024-09-17T07:17:15.368053+0000 2024-09-17T07:23:37.391 INFO:teuthology.orchestra.run.smithi087.stdout:modified 2024-09-17T07:20:37.142055+0000 2024-09-17T07:23:37.391 INFO:teuthology.orchestra.run.smithi087.stdout:tableserver 0 2024-09-17T07:23:37.391 INFO:teuthology.orchestra.run.smithi087.stdout:root 0 2024-09-17T07:23:37.392 INFO:teuthology.orchestra.run.smithi087.stdout:session_timeout 60 2024-09-17T07:23:37.392 INFO:teuthology.orchestra.run.smithi087.stdout:session_autoclose 300 2024-09-17T07:23:37.392 INFO:teuthology.orchestra.run.smithi087.stdout:max_file_size 1099511627776 2024-09-17T07:23:37.392 INFO:teuthology.orchestra.run.smithi087.stdout:max_xattr_size 65536 2024-09-17T07:23:37.392 INFO:teuthology.orchestra.run.smithi087.stdout:required_client_features {} 2024-09-17T07:23:37.392 INFO:teuthology.orchestra.run.smithi087.stdout:last_failure 0 2024-09-17T07:23:37.392 INFO:teuthology.orchestra.run.smithi087.stdout:last_failure_osd_epoch 44 2024-09-17T07:23:37.392 INFO:teuthology.orchestra.run.smithi087.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T07:23:37.392 INFO:teuthology.orchestra.run.smithi087.stdout:max_mds 2 2024-09-17T07:23:37.392 INFO:teuthology.orchestra.run.smithi087.stdout:in 0,1 2024-09-17T07:23:37.392 INFO:teuthology.orchestra.run.smithi087.stdout:up {0=14478,1=24243} 2024-09-17T07:23:37.393 INFO:teuthology.orchestra.run.smithi087.stdout:failed 2024-09-17T07:23:37.393 INFO:teuthology.orchestra.run.smithi087.stdout:damaged 2024-09-17T07:23:37.393 INFO:teuthology.orchestra.run.smithi087.stdout:stopped 2024-09-17T07:23:37.393 INFO:teuthology.orchestra.run.smithi087.stdout:data_pools [3] 2024-09-17T07:23:37.393 INFO:teuthology.orchestra.run.smithi087.stdout:metadata_pool 2 2024-09-17T07:23:37.393 INFO:teuthology.orchestra.run.smithi087.stdout:inline_data enabled 2024-09-17T07:23:37.393 INFO:teuthology.orchestra.run.smithi087.stdout:balancer 2024-09-17T07:23:37.393 INFO:teuthology.orchestra.run.smithi087.stdout:bal_rank_mask -1 2024-09-17T07:23:37.393 INFO:teuthology.orchestra.run.smithi087.stdout:standby_count_wanted 1 2024-09-17T07:23:37.393 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi087.tjhpcs{0:14478} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.87:6828/2255237099,v1:172.21.15.87:6829/2255237099] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:23:37.393 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi087.vvbzss{0:14490} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.87:6826/4022268353,v1:172.21.15.87:6827/4022268353] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:23:37.393 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi139.gnwonz{1:24243} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.139:6824/3946792151,v1:172.21.15.139:6825/3946792151] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:23:37.393 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi139.ftvinf{1:24253} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.139:6826/3292073323,v1:172.21.15.139:6827/3292073323] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:23:37.394 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:23:37.394 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:23:37.394 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 21 2024-09-17T07:23:37.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.391+0000 7f1ab9167640 1 -- 172.21.15.87:0/4206598681 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f1aa006cb90 msgr2=0x7f1aa006f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:23:37.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.391+0000 7f1ab9167640 1 --2- 172.21.15.87:0/4206598681 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f1aa006cb90 0x7f1aa006f040 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c009fd0 tx=0x7f1a9c009e50 comp rx=0 tx=0).stop 2024-09-17T07:23:37.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.391+0000 7f1ab9167640 1 -- 172.21.15.87:0/4206598681 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ab40fc550 msgr2=0x7f1ab410cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:23:37.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.391+0000 7f1ab9167640 1 --2- 172.21.15.87:0/4206598681 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ab40fc550 0x7f1ab410cfc0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1aac004750 tx=0x7f1aac004d10 comp rx=0 tx=0).stop 2024-09-17T07:23:37.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.392+0000 7f1ab9167640 1 -- 172.21.15.87:0/4206598681 shutdown_connections 2024-09-17T07:23:37.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.392+0000 7f1ab9167640 1 --2- 172.21.15.87:0/4206598681 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f1aa006cb90 0x7f1aa006f040 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:37.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.392+0000 7f1ab9167640 1 --2- 172.21.15.87:0/4206598681 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1ab40fd820 0x7f1ab410d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:37.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.392+0000 7f1ab9167640 1 --2- 172.21.15.87:0/4206598681 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ab40fc550 0x7f1ab410cfc0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:37.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.392+0000 7f1ab9167640 1 -- 172.21.15.87:0/4206598681 >> 172.21.15.87:0/4206598681 conn(0x7f1ab40f7d30 msgr2=0x7f1ab40f9640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:23:37.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.392+0000 7f1ab9167640 1 -- 172.21.15.87:0/4206598681 shutdown_connections 2024-09-17T07:23:37.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.392+0000 7f1ab9167640 1 -- 172.21.15.87:0/4206598681 wait complete. 2024-09-17T07:23:37.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.472+0000 7f05a30c8640 1 -- 172.21.15.87:0/468823142 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f059c0fb430 msgr2=0x7f059c0fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:23:37.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.472+0000 7f05a30c8640 1 --2- 172.21.15.87:0/468823142 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f059c0fb430 0x7f059c0fb840 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f05900048d0 tx=0x7f0590009da0 comp rx=0 tx=0).stop 2024-09-17T07:23:37.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.472+0000 7f05a30c8640 1 -- 172.21.15.87:0/468823142 shutdown_connections 2024-09-17T07:23:37.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.472+0000 7f05a30c8640 1 --2- 172.21.15.87:0/468823142 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f059c0fc700 0x7f059c0fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:37.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.472+0000 7f05a30c8640 1 --2- 172.21.15.87:0/468823142 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f059c0fb430 0x7f059c0fb840 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:37.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.472+0000 7f05a30c8640 1 -- 172.21.15.87:0/468823142 >> 172.21.15.87:0/468823142 conn(0x7f059c0f6c10 msgr2=0x7f059c0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:23:37.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.472+0000 7f05a30c8640 1 -- 172.21.15.87:0/468823142 shutdown_connections 2024-09-17T07:23:37.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.472+0000 7f05a30c8640 1 -- 172.21.15.87:0/468823142 wait complete. 2024-09-17T07:23:37.474 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.472+0000 7f05a30c8640 1 Processor -- start 2024-09-17T07:23:37.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.472+0000 7f05a30c8640 1 -- start start 2024-09-17T07:23:37.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.473+0000 7f05a30c8640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f059c0fb430 0x7f059c10fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:23:37.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.473+0000 7f05a30c8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f059c0fc700 0x7f059c112230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:23:37.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.473+0000 7f05a30c8640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f059c065c60 con 0x7f059c0fc700 2024-09-17T07:23:37.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.473+0000 7f05a30c8640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f059c065dd0 con 0x7f059c0fb430 2024-09-17T07:23:37.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.473+0000 7f059bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f059c0fc700 0x7f059c112230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:23:37.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.473+0000 7f059bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f059c0fc700 0x7f059c112230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40942/0 (socket says 172.21.15.87:40942) 2024-09-17T07:23:37.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.473+0000 7f059bfff640 1 -- 172.21.15.87:0/946028025 learned_addr learned my addr 172.21.15.87:0/946028025 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:23:37.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.473+0000 7f05a0e64640 1 --2- 172.21.15.87:0/946028025 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f059c0fb430 0x7f059c10fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:23:37.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.473+0000 7f059bfff640 1 -- 172.21.15.87:0/946028025 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f059c0fb430 msgr2=0x7f059c10fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:23:37.475 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.473+0000 7f059bfff640 1 --2- 172.21.15.87:0/946028025 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f059c0fb430 0x7f059c10fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:37.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.473+0000 7f059bfff640 1 -- 172.21.15.87:0/946028025 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0590005040 con 0x7f059c0fc700 2024-09-17T07:23:37.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.473+0000 7f059bfff640 1 --2- 172.21.15.87:0/946028025 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f059c0fc700 0x7f059c112230 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f058800eb70 tx=0x7f058800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:23:37.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.474+0000 7f05997fa640 1 -- 172.21.15.87:0/946028025 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0588007c30 con 0x7f059c0fc700 2024-09-17T07:23:37.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.474+0000 7f05a30c8640 1 -- 172.21.15.87:0/946028025 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f059c112770 con 0x7f059c0fc700 2024-09-17T07:23:37.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.474+0000 7f05997fa640 1 -- 172.21.15.87:0/946028025 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f058800f040 con 0x7f059c0fc700 2024-09-17T07:23:37.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.474+0000 7f05997fa640 1 -- 172.21.15.87:0/946028025 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0588009430 con 0x7f059c0fc700 2024-09-17T07:23:37.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.474+0000 7f05a30c8640 1 -- 172.21.15.87:0/946028025 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f059c112ce0 con 0x7f059c0fc700 2024-09-17T07:23:37.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.475+0000 7f05a30c8640 1 -- 172.21.15.87:0/946028025 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f059c04b720 con 0x7f059c0fc700 2024-09-17T07:23:37.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.475+0000 7f05997fa640 1 -- 172.21.15.87:0/946028025 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f05880095b0 con 0x7f059c0fc700 2024-09-17T07:23:37.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.475+0000 7f05997fa640 1 --2- 172.21.15.87:0/946028025 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f058c06cb90 0x7f058c06f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:23:37.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.476+0000 7f05997fa640 1 -- 172.21.15.87:0/946028025 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f058808bde0 con 0x7f059c0fc700 2024-09-17T07:23:37.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.476+0000 7f05a0e64640 1 --2- 172.21.15.87:0/946028025 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f058c06cb90 0x7f058c06f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:23:37.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.476+0000 7f05a0e64640 1 --2- 172.21.15.87:0/946028025 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f058c06cb90 0x7f058c06f040 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0590009ac0 tx=0x7f0590035040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:23:37.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.480+0000 7f05997fa640 1 -- 172.21.15.87:0/946028025 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f0588055df0 con 0x7f059c0fc700 2024-09-17T07:23:37.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.675+0000 7f05a30c8640 1 -- 172.21.15.87:0/946028025 --> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f059c101170 con 0x7f058c06cb90 2024-09-17T07:23:37.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.676+0000 7f05997fa640 1 -- 172.21.15.87:0/946028025 <== mgr.24529 v2:172.21.15.87:6800/1359413180 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f059c101170 con 0x7f058c06cb90 2024-09-17T07:23:37.676 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T07:23:37.676 INFO:teuthology.orchestra.run.smithi087.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9", 2024-09-17T07:23:37.676 INFO:teuthology.orchestra.run.smithi087.stdout: "in_progress": true, 2024-09-17T07:23:37.677 INFO:teuthology.orchestra.run.smithi087.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T07:23:37.677 INFO:teuthology.orchestra.run.smithi087.stdout: "services_complete": [ 2024-09-17T07:23:37.677 INFO:teuthology.orchestra.run.smithi087.stdout: "crash", 2024-09-17T07:23:37.677 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr", 2024-09-17T07:23:37.677 INFO:teuthology.orchestra.run.smithi087.stdout: "mon" 2024-09-17T07:23:37.677 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-17T07:23:37.677 INFO:teuthology.orchestra.run.smithi087.stdout: "progress": "7/21 daemons upgraded", 2024-09-17T07:23:37.677 INFO:teuthology.orchestra.run.smithi087.stdout: "message": "Currently upgrading osd daemons", 2024-09-17T07:23:37.677 INFO:teuthology.orchestra.run.smithi087.stdout: "is_paused": false 2024-09-17T07:23:37.677 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T07:23:37.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.679+0000 7f05a30c8640 1 -- 172.21.15.87:0/946028025 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f058c06cb90 msgr2=0x7f058c06f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:23:37.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.679+0000 7f05a30c8640 1 --2- 172.21.15.87:0/946028025 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f058c06cb90 0x7f058c06f040 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0590009ac0 tx=0x7f0590035040 comp rx=0 tx=0).stop 2024-09-17T07:23:37.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.679+0000 7f05a30c8640 1 -- 172.21.15.87:0/946028025 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f059c0fc700 msgr2=0x7f059c112230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:23:37.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.679+0000 7f05a30c8640 1 --2- 172.21.15.87:0/946028025 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f059c0fc700 0x7f059c112230 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f058800eb70 tx=0x7f058800b040 comp rx=0 tx=0).stop 2024-09-17T07:23:37.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.679+0000 7f05a30c8640 1 -- 172.21.15.87:0/946028025 shutdown_connections 2024-09-17T07:23:37.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.679+0000 7f05a30c8640 1 --2- 172.21.15.87:0/946028025 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f059c0fc700 0x7f059c112230 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:37.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.679+0000 7f05a30c8640 1 --2- 172.21.15.87:0/946028025 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f058c06cb90 0x7f058c06f040 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:37.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.679+0000 7f05a30c8640 1 --2- 172.21.15.87:0/946028025 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f059c0fb430 0x7f059c10fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:37.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.679+0000 7f05a30c8640 1 -- 172.21.15.87:0/946028025 >> 172.21.15.87:0/946028025 conn(0x7f059c0f6c10 msgr2=0x7f059c0ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:23:37.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.679+0000 7f05a30c8640 1 -- 172.21.15.87:0/946028025 shutdown_connections 2024-09-17T07:23:37.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.679+0000 7f05a30c8640 1 -- 172.21.15.87:0/946028025 wait complete. 2024-09-17T07:23:37.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.758+0000 7fa72dd2d640 1 -- 172.21.15.87:0/2060821564 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7280fdba0 msgr2=0x7fa7280fdfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:23:37.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.758+0000 7fa72dd2d640 1 --2- 172.21.15.87:0/2060821564 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7280fdba0 0x7fa7280fdfb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa7180048d0 tx=0x7fa718009da0 comp rx=0 tx=0).stop 2024-09-17T07:23:37.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.758+0000 7fa72dd2d640 1 -- 172.21.15.87:0/2060821564 shutdown_connections 2024-09-17T07:23:37.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.758+0000 7fa72dd2d640 1 --2- 172.21.15.87:0/2060821564 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa7280fe4f0 0x7fa7280fa650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:37.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.758+0000 7fa72dd2d640 1 --2- 172.21.15.87:0/2060821564 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7280fdba0 0x7fa7280fdfb0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:37.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.758+0000 7fa72dd2d640 1 -- 172.21.15.87:0/2060821564 >> 172.21.15.87:0/2060821564 conn(0x7fa7280f63a0 msgr2=0x7fa7280f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:23:37.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.758+0000 7fa72dd2d640 1 -- 172.21.15.87:0/2060821564 shutdown_connections 2024-09-17T07:23:37.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.758+0000 7fa72dd2d640 1 -- 172.21.15.87:0/2060821564 wait complete. 2024-09-17T07:23:37.759 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.759+0000 7fa72dd2d640 1 Processor -- start 2024-09-17T07:23:37.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.759+0000 7fa72dd2d640 1 -- start start 2024-09-17T07:23:37.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.759+0000 7fa72dd2d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa7280fdba0 0x7fa72810d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:23:37.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.759+0000 7fa72dd2d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7280fe4f0 0x7fa72810d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:23:37.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.759+0000 7fa72dd2d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa72810dbc0 con 0x7fa7280fe4f0 2024-09-17T07:23:37.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.759+0000 7fa72dd2d640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa72810e370 con 0x7fa7280fdba0 2024-09-17T07:23:37.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.759+0000 7fa726ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7280fe4f0 0x7fa72810d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:23:37.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.759+0000 7fa726ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7280fe4f0 0x7fa72810d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:40958/0 (socket says 172.21.15.87:40958) 2024-09-17T07:23:37.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.759+0000 7fa726ffd640 1 -- 172.21.15.87:0/1258159831 learned_addr learned my addr 172.21.15.87:0/1258159831 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:23:37.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.759+0000 7fa7277fe640 1 --2- 172.21.15.87:0/1258159831 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa7280fdba0 0x7fa72810d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:23:37.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.760+0000 7fa726ffd640 1 -- 172.21.15.87:0/1258159831 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa7280fdba0 msgr2=0x7fa72810d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:23:37.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.760+0000 7fa726ffd640 1 --2- 172.21.15.87:0/1258159831 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa7280fdba0 0x7fa72810d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:37.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.760+0000 7fa726ffd640 1 -- 172.21.15.87:0/1258159831 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa718005040 con 0x7fa7280fe4f0 2024-09-17T07:23:37.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.760+0000 7fa726ffd640 1 --2- 172.21.15.87:0/1258159831 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7280fe4f0 0x7fa72810d570 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa71c00c800 tx=0x7fa71c004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:23:37.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.760+0000 7fa70ffff640 1 -- 172.21.15.87:0/1258159831 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa71c00a7a0 con 0x7fa7280fe4f0 2024-09-17T07:23:37.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.760+0000 7fa72dd2d640 1 -- 172.21.15.87:0/1258159831 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa72810e600 con 0x7fa7280fe4f0 2024-09-17T07:23:37.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.760+0000 7fa70ffff640 1 -- 172.21.15.87:0/1258159831 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fa71c00ad80 con 0x7fa7280fe4f0 2024-09-17T07:23:37.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.760+0000 7fa70ffff640 1 -- 172.21.15.87:0/1258159831 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa71c012e80 con 0x7fa7280fe4f0 2024-09-17T07:23:37.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.760+0000 7fa72dd2d640 1 -- 172.21.15.87:0/1258159831 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa72810eba0 con 0x7fa7280fe4f0 2024-09-17T07:23:37.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.761+0000 7fa72dd2d640 1 -- 172.21.15.87:0/1258159831 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7280fa040 con 0x7fa7280fe4f0 2024-09-17T07:23:37.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.761+0000 7fa70ffff640 1 -- 172.21.15.87:0/1258159831 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fa71c012670 con 0x7fa7280fe4f0 2024-09-17T07:23:37.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.762+0000 7fa70ffff640 1 --2- 172.21.15.87:0/1258159831 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fa71006cb90 0x7fa71006f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:23:37.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.762+0000 7fa70ffff640 1 -- 172.21.15.87:0/1258159831 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fa71c08c120 con 0x7fa7280fe4f0 2024-09-17T07:23:37.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.762+0000 7fa7277fe640 1 --2- 172.21.15.87:0/1258159831 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fa71006cb90 0x7fa71006f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:23:37.763 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.762+0000 7fa7277fe640 1 --2- 172.21.15.87:0/1258159831 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fa71006cb90 0x7fa71006f040 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa718000c00 tx=0x7fa718035040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:23:37.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.766+0000 7fa70ffff640 1 -- 172.21.15.87:0/1258159831 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa71c0561b0 con 0x7fa7280fe4f0 2024-09-17T07:23:37.926 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 17 07:23:37 smithi087 podman[104775]: 2024-09-17 07:23:37.664344025 +0000 UTC m=+0.895701104 container died 9446985bfcd174ed93aa4ae40eff015f5e3ccfdc5dce61838730f364a2cac7b0 (image=quay.ceph.io/ceph-ci/ceph@sha256:c5428a59091f5674ce6e26540d9db0f28844a507e2a324b8305a00f1687ce028, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-1, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=quincy-4a70413, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-17T07:23:37.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.996+0000 7fa72dd2d640 1 -- 172.21.15.87:0/1258159831 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fa72804b720 con 0x7fa7280fe4f0 2024-09-17T07:23:37.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.997+0000 7fa70ffff640 1 -- 172.21.15.87:0/1258159831 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+290 (secure 0 0 0) 0x7fa71c0597d0 con 0x7fa7280fe4f0 2024-09-17T07:23:37.997 INFO:teuthology.orchestra.run.smithi087.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down 2024-09-17T07:23:37.997 INFO:teuthology.orchestra.run.smithi087.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T07:23:37.997 INFO:teuthology.orchestra.run.smithi087.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T07:23:37.998 INFO:teuthology.orchestra.run.smithi087.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-17T07:23:37.998 INFO:teuthology.orchestra.run.smithi087.stdout: osd.1 (root=default,host=smithi087) is down 2024-09-17T07:23:37.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.999+0000 7fa72dd2d640 1 -- 172.21.15.87:0/1258159831 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fa71006cb90 msgr2=0x7fa71006f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:23:37.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.999+0000 7fa72dd2d640 1 --2- 172.21.15.87:0/1258159831 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fa71006cb90 0x7fa71006f040 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa718000c00 tx=0x7fa718035040 comp rx=0 tx=0).stop 2024-09-17T07:23:37.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.999+0000 7fa72dd2d640 1 -- 172.21.15.87:0/1258159831 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7280fe4f0 msgr2=0x7fa72810d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:23:37.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.999+0000 7fa72dd2d640 1 --2- 172.21.15.87:0/1258159831 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7280fe4f0 0x7fa72810d570 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa71c00c800 tx=0x7fa71c004430 comp rx=0 tx=0).stop 2024-09-17T07:23:37.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.999+0000 7fa72dd2d640 1 -- 172.21.15.87:0/1258159831 shutdown_connections 2024-09-17T07:23:37.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.999+0000 7fa72dd2d640 1 --2- 172.21.15.87:0/1258159831 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7280fe4f0 0x7fa72810d570 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:38.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.999+0000 7fa72dd2d640 1 --2- 172.21.15.87:0/1258159831 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fa71006cb90 0x7fa71006f040 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:38.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.999+0000 7fa72dd2d640 1 --2- 172.21.15.87:0/1258159831 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa7280fdba0 0x7fa72810d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:23:38.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.999+0000 7fa72dd2d640 1 -- 172.21.15.87:0/1258159831 >> 172.21.15.87:0/1258159831 conn(0x7fa7280f63a0 msgr2=0x7fa7280f7cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:23:38.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.999+0000 7fa72dd2d640 1 -- 172.21.15.87:0/1258159831 shutdown_connections 2024-09-17T07:23:38.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:23:37.999+0000 7fa72dd2d640 1 -- 172.21.15.87:0/1258159831 wait complete. 2024-09-17T07:23:38.284 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 17 07:23:38 smithi087 podman[104775]: 2024-09-17 07:23:38.082617991 +0000 UTC m=+1.313975069 container cleanup 9446985bfcd174ed93aa4ae40eff015f5e3ccfdc5dce61838730f364a2cac7b0 (image=quay.ceph.io/ceph-ci/ceph@sha256:c5428a59091f5674ce6e26540d9db0f28844a507e2a324b8305a00f1687ce028, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-1, ceph=True, RELEASE=quincy-4a70413, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-17T07:23:38.284 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 17 07:23:38 smithi087 bash[104775]: ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-1 2024-09-17T07:23:38.284 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:38 smithi087 ceph-mon[90982]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:23:38.284 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:38 smithi087 ceph-mon[90982]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:23:38.284 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:38 smithi087 ceph-mon[90982]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T07:23:38.284 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:38 smithi087 ceph-mon[90982]: osdmap e53: 6 total, 5 up, 6 in 2024-09-17T07:23:38.284 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:38 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/4206598681' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T07:23:38.285 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:38 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/1258159831' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T07:23:38.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:38 smithi139 ceph-mon[79872]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:23:38.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:38 smithi139 ceph-mon[79872]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:23:38.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:38 smithi139 ceph-mon[79872]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T07:23:38.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:38 smithi139 ceph-mon[79872]: osdmap e53: 6 total, 5 up, 6 in 2024-09-17T07:23:38.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:38 smithi139 ceph-mon[79872]: from='client.? 172.21.15.87:0/4206598681' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T07:23:38.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:38 smithi139 ceph-mon[79872]: from='client.? 172.21.15.87:0/1258159831' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T07:23:38.658 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 17 07:23:38 smithi087 podman[104860]: 2024-09-17 07:23:38.283949449 +0000 UTC m=+0.619786399 container remove 9446985bfcd174ed93aa4ae40eff015f5e3ccfdc5dce61838730f364a2cac7b0 (image=quay.ceph.io/ceph-ci/ceph@sha256:c5428a59091f5674ce6e26540d9db0f28844a507e2a324b8305a00f1687ce028, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-1, org.label-schema.vendor=CentOS, RELEASE=quincy-4a70413, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-17T07:23:38.920 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 17 07:23:38 smithi087 podman[104971]: 2024-09-17 07:23:38.684954255 +0000 UTC m=+0.109412216 container create b8e8e134b93504e20d3fbf10db12ae0e69e3ded88c891db86de121a3a691a6c2 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=reef-19e2a2b, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-17T07:23:38.920 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 17 07:23:38 smithi087 podman[104971]: 2024-09-17 07:23:38.59139411 +0000 UTC m=+0.015852072 image pull 980a0bfcd684674f25c08d857ad8de3b1c8ae738870529edbf9aa463832c8d89 quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9 2024-09-17T07:23:38.921 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 17 07:23:38 smithi087 podman[104971]: 2024-09-17 07:23:38.920637251 +0000 UTC m=+0.345095230 container init b8e8e134b93504e20d3fbf10db12ae0e69e3ded88c891db86de121a3a691a6c2 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=reef-19e2a2b, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-17T07:23:39.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:39 smithi087 ceph-mon[90982]: from='client.34240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:23:39.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:39 smithi087 ceph-mon[90982]: pgmap v59: 65 pgs: 12 stale+active+clean, 53 active+clean; 322 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.2 KiB/s rd, 614 B/s wr, 4 op/s 2024-09-17T07:23:39.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:39 smithi087 ceph-mon[90982]: osdmap e54: 6 total, 5 up, 6 in 2024-09-17T07:23:39.177 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 17 07:23:38 smithi087 podman[104971]: 2024-09-17 07:23:38.924037902 +0000 UTC m=+0.348495863 container start b8e8e134b93504e20d3fbf10db12ae0e69e3ded88c891db86de121a3a691a6c2 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=reef-19e2a2b, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True) 2024-09-17T07:23:39.177 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 17 07:23:39 smithi087 podman[104971]: 2024-09-17 07:23:39.01227055 +0000 UTC m=+0.436728512 container attach b8e8e134b93504e20d3fbf10db12ae0e69e3ded88c891db86de121a3a691a6c2 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=reef-19e2a2b, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-17T07:23:39.177 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 17 07:23:39 smithi087 podman[104971]: 2024-09-17 07:23:39.112616431 +0000 UTC m=+0.537074399 container died b8e8e134b93504e20d3fbf10db12ae0e69e3ded88c891db86de121a3a691a6c2 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=reef-19e2a2b, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-17T07:23:39.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:39 smithi139 ceph-mon[79872]: from='client.34240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:23:39.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:39 smithi139 ceph-mon[79872]: pgmap v59: 65 pgs: 12 stale+active+clean, 53 active+clean; 322 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.2 KiB/s rd, 614 B/s wr, 4 op/s 2024-09-17T07:23:39.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:39 smithi139 ceph-mon[79872]: osdmap e54: 6 total, 5 up, 6 in 2024-09-17T07:23:40.176 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 17 07:23:39 smithi087 podman[104995]: 2024-09-17 07:23:39.75806163 +0000 UTC m=+0.639223844 container remove b8e8e134b93504e20d3fbf10db12ae0e69e3ded88c891db86de121a3a691a6c2 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-1-deactivate, RELEASE=reef-19e2a2b, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-17T07:23:40.176 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 17 07:23:39 smithi087 systemd[1]: ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968@osd.1.service: Deactivated successfully. 2024-09-17T07:23:40.177 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 17 07:23:39 smithi087 systemd[1]: Stopped Ceph osd.1 for d5dbf8d6-74c3-11ef-bceb-c7b262605968. 2024-09-17T07:23:40.177 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 17 07:23:39 smithi087 systemd[1]: ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968@osd.1.service: Consumed 50.445s CPU time. 2024-09-17T07:23:40.177 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 17 07:23:39 smithi087 systemd[1]: Starting Ceph osd.1 for d5dbf8d6-74c3-11ef-bceb-c7b262605968... 2024-09-17T07:23:40.445 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:40 smithi087 ceph-mon[90982]: Health check failed: Degraded data redundancy: 56/369 objects degraded (15.176%), 16 pgs degraded (PG_DEGRADED) 2024-09-17T07:23:40.445 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 17 07:23:40 smithi087 podman[105093]: 2024-09-17 07:23:40.106944206 +0000 UTC m=+0.015612308 image pull 980a0bfcd684674f25c08d857ad8de3b1c8ae738870529edbf9aa463832c8d89 quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9 2024-09-17T07:23:40.445 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 17 07:23:40 smithi087 podman[105093]: 2024-09-17 07:23:40.226270653 +0000 UTC m=+0.134938808 container create 39f906b66e28ffe44c4cf56d8709137f2c30cbd0aa9f4b781d445d165f0fb232 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-1-activate, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=reef-19e2a2b, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True) 2024-09-17T07:23:40.445 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 17 07:23:40 smithi087 podman[105093]: 2024-09-17 07:23:40.445026206 +0000 UTC m=+0.353694303 container init 39f906b66e28ffe44c4cf56d8709137f2c30cbd0aa9f4b781d445d165f0fb232 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-1-activate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=reef-19e2a2b, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-17T07:23:40.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:40 smithi139 ceph-mon[79872]: Health check failed: Degraded data redundancy: 56/369 objects degraded (15.176%), 16 pgs degraded (PG_DEGRADED) 2024-09-17T07:23:40.745 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 17 07:23:40 smithi087 podman[105093]: 2024-09-17 07:23:40.448488899 +0000 UTC m=+0.357157000 container start 39f906b66e28ffe44c4cf56d8709137f2c30cbd0aa9f4b781d445d165f0fb232 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-1-activate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, RELEASE=reef-19e2a2b, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-17T07:23:40.745 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 17 07:23:40 smithi087 podman[105093]: 2024-09-17 07:23:40.661832827 +0000 UTC m=+0.570500933 container attach 39f906b66e28ffe44c4cf56d8709137f2c30cbd0aa9f4b781d445d165f0fb232 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-1-activate, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=reef-19e2a2b, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-17T07:23:41.176 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 17 07:23:40 smithi087 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-1-activate[105108]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-17T07:23:41.176 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 17 07:23:40 smithi087 bash[105093]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-17T07:23:41.177 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 17 07:23:40 smithi087 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-1-activate[105108]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-17T07:23:41.177 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 17 07:23:40 smithi087 bash[105093]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-17T07:23:41.177 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 17 07:23:40 smithi087 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-1-activate[105108]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-17T07:23:41.177 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 17 07:23:40 smithi087 bash[105093]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-17T07:23:41.177 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 17 07:23:40 smithi087 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-1-activate[105108]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-17T07:23:41.177 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 17 07:23:40 smithi087 bash[105093]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-17T07:23:41.177 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 17 07:23:40 smithi087 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-1-activate[105108]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-17T07:23:41.177 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 17 07:23:40 smithi087 bash[105093]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-17T07:23:41.177 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 17 07:23:40 smithi087 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-1-activate[105108]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-17T07:23:41.177 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 17 07:23:40 smithi087 bash[105093]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-17T07:23:41.177 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 17 07:23:40 smithi087 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-1-activate[105108]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-17T07:23:41.177 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 17 07:23:40 smithi087 bash[105093]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-17T07:23:41.177 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 17 07:23:40 smithi087 podman[105093]: 2024-09-17 07:23:40.793055371 +0000 UTC m=+0.701723468 container died 39f906b66e28ffe44c4cf56d8709137f2c30cbd0aa9f4b781d445d165f0fb232 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-1-activate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=reef-19e2a2b, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T07:23:41.609 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:41 smithi087 ceph-mon[90982]: pgmap v61: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 322 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 56/369 objects degraded (15.176%) 2024-09-17T07:23:41.609 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 17 07:23:41 smithi087 podman[105243]: 2024-09-17 07:23:41.407557141 +0000 UTC m=+0.605620308 container remove 39f906b66e28ffe44c4cf56d8709137f2c30cbd0aa9f4b781d445d165f0fb232 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-1-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=reef-19e2a2b, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-17T07:23:41.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:41 smithi139 ceph-mon[79872]: pgmap v61: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 322 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 56/369 objects degraded (15.176%) 2024-09-17T07:23:41.877 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 17 07:23:41 smithi087 podman[105298]: 2024-09-17 07:23:41.511699458 +0000 UTC m=+0.016069534 image pull 980a0bfcd684674f25c08d857ad8de3b1c8ae738870529edbf9aa463832c8d89 quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9 2024-09-17T07:23:41.877 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 17 07:23:41 smithi087 podman[105298]: 2024-09-17 07:23:41.625219117 +0000 UTC m=+0.129589192 container create b108771d0b8e19d82b715ab9784c4ec246ef575b85434ef0ea20624750223c82 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-1, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=reef-19e2a2b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T07:23:41.877 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 17 07:23:41 smithi087 podman[105298]: 2024-09-17 07:23:41.85241596 +0000 UTC m=+0.356786038 container init b108771d0b8e19d82b715ab9784c4ec246ef575b85434ef0ea20624750223c82 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-1, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, RELEASE=reef-19e2a2b, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-17T07:23:41.878 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 17 07:23:41 smithi087 podman[105298]: 2024-09-17 07:23:41.856419302 +0000 UTC m=+0.360789387 container start b108771d0b8e19d82b715ab9784c4ec246ef575b85434ef0ea20624750223c82 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-1, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=reef-19e2a2b) 2024-09-17T07:23:41.878 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 17 07:23:41 smithi087 ceph-osd[105316]: -- 172.21.15.87:0/4166572928 <== mon.0 v2:172.21.15.87:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55b5a42511e0 con 0x55b5a41efc00 2024-09-17T07:23:42.176 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 17 07:23:41 smithi087 bash[105298]: b108771d0b8e19d82b715ab9784c4ec246ef575b85434ef0ea20624750223c82 2024-09-17T07:23:42.176 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 17 07:23:41 smithi087 systemd[1]: Started Ceph osd.1 for d5dbf8d6-74c3-11ef-bceb-c7b262605968. 2024-09-17T07:23:42.644 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 17 07:23:42 smithi087 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-1[105312]: 2024-09-17T07:23:42.396+0000 7f06ed2de640 -1 Falling back to public interface 2024-09-17T07:23:43.333 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:23:43.334 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:23:43.334 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:23:43.334 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:43 smithi087 ceph-mon[90982]: pgmap v62: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 322 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 56/369 objects degraded (15.176%) 2024-09-17T07:23:43.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:23:43.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:23:43.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:23:43.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:43 smithi139 ceph-mon[79872]: pgmap v62: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 322 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 56/369 objects degraded (15.176%) 2024-09-17T07:23:44.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:44 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:23:44.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:44 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:23:44.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:44 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:23:44.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:44 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:23:45.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:45 smithi139 ceph-mon[79872]: pgmap v63: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 322 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 56/369 objects degraded (15.176%) 2024-09-17T07:23:45.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:45 smithi087 ceph-mon[90982]: pgmap v63: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 322 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 56/369 objects degraded (15.176%) 2024-09-17T07:23:47.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:47 smithi139 ceph-mon[79872]: pgmap v64: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 322 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 56/369 objects degraded (15.176%) 2024-09-17T07:23:47.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:47 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:23:47.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:47 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:23:47.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:47 smithi139 ceph-mon[79872]: from='osd.1 [v2:172.21.15.87:6810/952896512,v1:172.21.15.87:6811/952896512]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-17T07:23:47.426 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 17 07:23:46 smithi087 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-1[105312]: 2024-09-17T07:23:46.926+0000 7f06ed2de640 -1 osd.1 52 log_to_monitors true 2024-09-17T07:23:47.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:47 smithi087 ceph-mon[90982]: pgmap v64: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 322 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 56/369 objects degraded (15.176%) 2024-09-17T07:23:47.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:47 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:23:47.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:47 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:23:47.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:47 smithi087 ceph-mon[90982]: from='osd.1 [v2:172.21.15.87:6810/952896512,v1:172.21.15.87:6811/952896512]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-17T07:23:48.614 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:48 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:23:48.614 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:48 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:23:48.614 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:48 smithi087 ceph-mon[90982]: from='osd.1 [v2:172.21.15.87:6810/952896512,v1:172.21.15.87:6811/952896512]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-17T07:23:48.614 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:48 smithi087 ceph-mon[90982]: osdmap e55: 6 total, 5 up, 6 in 2024-09-17T07:23:48.614 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:48 smithi087 ceph-mon[90982]: from='osd.1 [v2:172.21.15.87:6810/952896512,v1:172.21.15.87:6811/952896512]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-09-17T07:23:48.614 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:48 smithi087 ceph-mon[90982]: pgmap v66: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 322 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 56/369 objects degraded (15.176%) 2024-09-17T07:23:48.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:48 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:23:48.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:48 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:23:48.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:48 smithi139 ceph-mon[79872]: from='osd.1 [v2:172.21.15.87:6810/952896512,v1:172.21.15.87:6811/952896512]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-17T07:23:48.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:48 smithi139 ceph-mon[79872]: osdmap e55: 6 total, 5 up, 6 in 2024-09-17T07:23:48.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:48 smithi139 ceph-mon[79872]: from='osd.1 [v2:172.21.15.87:6810/952896512,v1:172.21.15.87:6811/952896512]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-09-17T07:23:48.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:48 smithi139 ceph-mon[79872]: pgmap v66: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 322 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 56/369 objects degraded (15.176%) 2024-09-17T07:23:48.907 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 17 07:23:48 smithi087 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-1[105312]: 2024-09-17T07:23:48.612+0000 7f06e106f640 -1 osd.1 52 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T07:23:49.735 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:49 smithi087 ceph-mon[90982]: from='osd.1 [v2:172.21.15.87:6810/952896512,v1:172.21.15.87:6811/952896512]' entity='osd.1' 2024-09-17T07:23:49.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:49 smithi139 ceph-mon[79872]: from='osd.1 [v2:172.21.15.87:6810/952896512,v1:172.21.15.87:6811/952896512]' entity='osd.1' 2024-09-17T07:23:50.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:50 smithi087 ceph-mon[90982]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T07:23:50.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:50 smithi087 ceph-mon[90982]: osd.1 [v2:172.21.15.87:6810/952896512,v1:172.21.15.87:6811/952896512] boot 2024-09-17T07:23:50.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:50 smithi087 ceph-mon[90982]: osdmap e56: 6 total, 6 up, 6 in 2024-09-17T07:23:50.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:50 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T07:23:50.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:50 smithi087 ceph-mon[90982]: pgmap v68: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 322 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 56/369 objects degraded (15.176%) 2024-09-17T07:23:50.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:50 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:23:50.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:50 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:23:50.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:50 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:23:50.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:50 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:23:50.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:50 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:23:50.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:50 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:23:50.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:50 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:23:50.678 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:50 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:23:50.678 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:50 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:23:50.678 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:50 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-17T07:23:50.678 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:50 smithi087 ceph-mon[90982]: osdmap e57: 6 total, 6 up, 6 in 2024-09-17T07:23:51.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:50 smithi139 ceph-mon[79872]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T07:23:51.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:50 smithi139 ceph-mon[79872]: osd.1 [v2:172.21.15.87:6810/952896512,v1:172.21.15.87:6811/952896512] boot 2024-09-17T07:23:51.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:50 smithi139 ceph-mon[79872]: osdmap e56: 6 total, 6 up, 6 in 2024-09-17T07:23:51.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:50 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T07:23:51.118 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:50 smithi139 ceph-mon[79872]: pgmap v68: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 322 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 56/369 objects degraded (15.176%) 2024-09-17T07:23:51.118 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:50 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:23:51.118 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:50 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:23:51.118 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:50 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:23:51.118 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:50 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:23:51.119 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:50 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:23:51.119 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:50 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:23:51.119 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:50 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:23:51.119 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:50 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:23:51.119 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:50 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:23:51.120 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:50 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-17T07:23:51.120 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:50 smithi139 ceph-mon[79872]: osdmap e57: 6 total, 6 up, 6 in 2024-09-17T07:23:51.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:51 smithi087 ceph-mon[90982]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-17T07:23:51.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:51 smithi087 ceph-mon[90982]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-17T07:23:52.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:51 smithi139 ceph-mon[79872]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-17T07:23:52.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:51 smithi139 ceph-mon[79872]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-17T07:23:52.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:52 smithi087 ceph-mon[90982]: pgmap v70: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 322 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 56/369 objects degraded (15.176%) 2024-09-17T07:23:53.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:52 smithi139 ceph-mon[79872]: pgmap v70: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 322 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 56/369 objects degraded (15.176%) 2024-09-17T07:23:54.453 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:54 smithi087 ceph-mon[90982]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 56/369 objects degraded (15.176%), 16 pgs degraded) 2024-09-17T07:23:54.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:54 smithi139 ceph-mon[79872]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 56/369 objects degraded (15.176%), 16 pgs degraded) 2024-09-17T07:23:55.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:55 smithi139 ceph-mon[79872]: pgmap v71: 65 pgs: 2 active+undersized, 63 active+clean; 322 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-17T07:23:55.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:55 smithi087 ceph-mon[90982]: pgmap v71: 65 pgs: 2 active+undersized, 63 active+clean; 322 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-17T07:23:57.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:57 smithi139 ceph-mon[79872]: pgmap v72: 65 pgs: 65 active+clean; 322 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s 2024-09-17T07:23:57.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:57 smithi087 ceph-mon[90982]: pgmap v72: 65 pgs: 65 active+clean; 322 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s 2024-09-17T07:23:58.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:58 smithi139 ceph-mon[79872]: fsmap cephfs:2 {0=cephfs.smithi087.tjhpcs=up:active,1=cephfs.smithi139.gnwonz=up:active} 2 up:standby-replay 2024-09-17T07:23:58.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:58 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:23:58.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:58 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:23:58.658 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:58 smithi087 ceph-mon[90982]: fsmap cephfs:2 {0=cephfs.smithi087.tjhpcs=up:active,1=cephfs.smithi139.gnwonz=up:active} 2 up:standby-replay 2024-09-17T07:23:58.658 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:58 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:23:58.658 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:58 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:23:59.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:23:59 smithi139 ceph-mon[79872]: pgmap v73: 65 pgs: 65 active+clean; 322 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 967 B/s rd, 2 op/s 2024-09-17T07:23:59.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:23:59 smithi087 ceph-mon[90982]: pgmap v73: 65 pgs: 65 active+clean; 322 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 967 B/s rd, 2 op/s 2024-09-17T07:24:01.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:01 smithi139 ceph-mon[79872]: pgmap v74: 65 pgs: 65 active+clean; 322 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2024-09-17T07:24:01.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:01 smithi087 ceph-mon[90982]: pgmap v74: 65 pgs: 65 active+clean; 322 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2024-09-17T07:24:03.508 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:03 smithi087 ceph-mon[90982]: pgmap v75: 65 pgs: 65 active+clean; 322 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-17T07:24:03.508 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:03 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:24:03.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:03 smithi139 ceph-mon[79872]: pgmap v75: 65 pgs: 65 active+clean; 322 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-17T07:24:03.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:03 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:24:05.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:05 smithi139 ceph-mon[79872]: pgmap v76: 65 pgs: 65 active+clean; 322 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 2.3 KiB/s rd, 4 op/s 2024-09-17T07:24:05.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:05 smithi087 ceph-mon[90982]: pgmap v76: 65 pgs: 65 active+clean; 322 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 2.3 KiB/s rd, 4 op/s 2024-09-17T07:24:06.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:06 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-17T07:24:06.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:06 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-17T07:24:07.516 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:07 smithi087 ceph-mon[90982]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-17T07:24:07.516 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:07 smithi087 ceph-mon[90982]: Upgrade: osd.2 is safe to restart 2024-09-17T07:24:07.516 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:07 smithi087 ceph-mon[90982]: pgmap v77: 65 pgs: 65 active+clean; 322 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:24:07.516 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:07 smithi087 ceph-mon[90982]: fsmap cephfs:2 {0=cephfs.smithi087.tjhpcs=up:active,1=cephfs.smithi139.gnwonz=up:active} 2 up:standby-replay 2024-09-17T07:24:07.517 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:07 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:24:07.517 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:07 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-17T07:24:07.517 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:07 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:24:07.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:07 smithi139 ceph-mon[79872]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-17T07:24:07.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:07 smithi139 ceph-mon[79872]: Upgrade: osd.2 is safe to restart 2024-09-17T07:24:07.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:07 smithi139 ceph-mon[79872]: pgmap v77: 65 pgs: 65 active+clean; 322 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:24:07.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:07 smithi139 ceph-mon[79872]: fsmap cephfs:2 {0=cephfs.smithi087.tjhpcs=up:active,1=cephfs.smithi139.gnwonz=up:active} 2 up:standby-replay 2024-09-17T07:24:07.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:07 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:24:07.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:07 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-17T07:24:07.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:07 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:24:08.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.082+0000 7f9063acb640 1 -- 172.21.15.87:0/4251624015 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f905c0fdb70 msgr2=0x7f905c0fdf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:24:08.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.082+0000 7f9063acb640 1 --2- 172.21.15.87:0/4251624015 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f905c0fdb70 0x7f905c0fdf80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f90580048d0 tx=0x7f9058009da0 comp rx=0 tx=0).stop 2024-09-17T07:24:08.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.082+0000 7f9063acb640 1 -- 172.21.15.87:0/4251624015 shutdown_connections 2024-09-17T07:24:08.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.082+0000 7f9063acb640 1 --2- 172.21.15.87:0/4251624015 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f905c0fe4c0 0x7f905c0fa620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:08.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.082+0000 7f9063acb640 1 --2- 172.21.15.87:0/4251624015 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f905c0fdb70 0x7f905c0fdf80 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:08.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.082+0000 7f9063acb640 1 -- 172.21.15.87:0/4251624015 >> 172.21.15.87:0/4251624015 conn(0x7f905c0f6390 msgr2=0x7f905c0f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:24:08.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.082+0000 7f9063acb640 1 -- 172.21.15.87:0/4251624015 shutdown_connections 2024-09-17T07:24:08.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.082+0000 7f9063acb640 1 -- 172.21.15.87:0/4251624015 wait complete. 2024-09-17T07:24:08.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.083+0000 7f9063acb640 1 Processor -- start 2024-09-17T07:24:08.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.083+0000 7f9063acb640 1 -- start start 2024-09-17T07:24:08.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.083+0000 7f9063acb640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f905c0fdb70 0x7f905c10cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:24:08.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.083+0000 7f9063acb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f905c0fe4c0 0x7f905c10d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:24:08.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.083+0000 7f9063acb640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f905c10db60 con 0x7f905c0fe4c0 2024-09-17T07:24:08.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.083+0000 7f9063acb640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f905c10e380 con 0x7f905c0fdb70 2024-09-17T07:24:08.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.083+0000 7f9061066640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f905c0fe4c0 0x7f905c10d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:24:08.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.083+0000 7f9061066640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f905c0fe4c0 0x7f905c10d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41984/0 (socket says 172.21.15.87:41984) 2024-09-17T07:24:08.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.083+0000 7f9061066640 1 -- 172.21.15.87:0/3091087577 learned_addr learned my addr 172.21.15.87:0/3091087577 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:24:08.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.083+0000 7f9061867640 1 --2- 172.21.15.87:0/3091087577 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f905c0fdb70 0x7f905c10cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:24:08.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.083+0000 7f9061066640 1 -- 172.21.15.87:0/3091087577 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f905c0fdb70 msgr2=0x7f905c10cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:24:08.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.083+0000 7f9061066640 1 --2- 172.21.15.87:0/3091087577 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f905c0fdb70 0x7f905c10cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:08.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.083+0000 7f9061066640 1 -- 172.21.15.87:0/3091087577 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9058005040 con 0x7f905c0fe4c0 2024-09-17T07:24:08.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.084+0000 7f9061066640 1 --2- 172.21.15.87:0/3091087577 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f905c0fe4c0 0x7f905c10d510 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f904c00c7e0 tx=0x7f904c0043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:24:08.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.084+0000 7f90527fc640 1 -- 172.21.15.87:0/3091087577 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f904c00a7a0 con 0x7f905c0fe4c0 2024-09-17T07:24:08.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.084+0000 7f90527fc640 1 -- 172.21.15.87:0/3091087577 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f904c00ad80 con 0x7f905c0fe4c0 2024-09-17T07:24:08.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.084+0000 7f9063acb640 1 -- 172.21.15.87:0/3091087577 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f905c10e610 con 0x7f905c0fe4c0 2024-09-17T07:24:08.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.084+0000 7f90527fc640 1 -- 172.21.15.87:0/3091087577 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f904c012e40 con 0x7f905c0fe4c0 2024-09-17T07:24:08.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.084+0000 7f9063acb640 1 -- 172.21.15.87:0/3091087577 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f905c10ebb0 con 0x7f905c0fe4c0 2024-09-17T07:24:08.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.085+0000 7f9063acb640 1 -- 172.21.15.87:0/3091087577 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f905c0fa010 con 0x7f905c0fe4c0 2024-09-17T07:24:08.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.085+0000 7f90527fc640 1 -- 172.21.15.87:0/3091087577 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f904c012400 con 0x7f905c0fe4c0 2024-09-17T07:24:08.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.086+0000 7f90527fc640 1 --2- 172.21.15.87:0/3091087577 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f904806cb90 0x7f904806f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:24:08.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.086+0000 7f90527fc640 1 -- 172.21.15.87:0/3091087577 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f904c08c000 con 0x7f905c0fe4c0 2024-09-17T07:24:08.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.086+0000 7f9061867640 1 --2- 172.21.15.87:0/3091087577 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f904806cb90 0x7f904806f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:24:08.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.086+0000 7f9061867640 1 --2- 172.21.15.87:0/3091087577 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f904806cb90 0x7f904806f040 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9058000c00 tx=0x7f9058035040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:24:08.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.090+0000 7f90527fc640 1 -- 172.21.15.87:0/3091087577 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f904c056130 con 0x7f905c0fe4c0 2024-09-17T07:24:08.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.275+0000 7f9063acb640 1 -- 172.21.15.87:0/3091087577 --> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f905c10ef30 con 0x7f904806cb90 2024-09-17T07:24:08.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.276+0000 7f90527fc640 1 -- 172.21.15.87:0/3091087577 <== mgr.24529 v2:172.21.15.87:6800/1359413180 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f905c10ef30 con 0x7f904806cb90 2024-09-17T07:24:08.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.278+0000 7f9063acb640 1 -- 172.21.15.87:0/3091087577 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f904806cb90 msgr2=0x7f904806f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:24:08.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.278+0000 7f9063acb640 1 --2- 172.21.15.87:0/3091087577 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f904806cb90 0x7f904806f040 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9058000c00 tx=0x7f9058035040 comp rx=0 tx=0).stop 2024-09-17T07:24:08.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.278+0000 7f9063acb640 1 -- 172.21.15.87:0/3091087577 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f905c0fe4c0 msgr2=0x7f905c10d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:24:08.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.278+0000 7f9063acb640 1 --2- 172.21.15.87:0/3091087577 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f905c0fe4c0 0x7f905c10d510 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f904c00c7e0 tx=0x7f904c0043c0 comp rx=0 tx=0).stop 2024-09-17T07:24:08.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.278+0000 7f9063acb640 1 -- 172.21.15.87:0/3091087577 shutdown_connections 2024-09-17T07:24:08.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.278+0000 7f9063acb640 1 --2- 172.21.15.87:0/3091087577 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f905c0fe4c0 0x7f905c10d510 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:08.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.278+0000 7f9063acb640 1 --2- 172.21.15.87:0/3091087577 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f904806cb90 0x7f904806f040 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:08.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.278+0000 7f9063acb640 1 --2- 172.21.15.87:0/3091087577 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f905c0fdb70 0x7f905c10cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:08.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.278+0000 7f9063acb640 1 -- 172.21.15.87:0/3091087577 >> 172.21.15.87:0/3091087577 conn(0x7f905c0f6390 msgr2=0x7f905c0f7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:24:08.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.278+0000 7f9063acb640 1 -- 172.21.15.87:0/3091087577 shutdown_connections 2024-09-17T07:24:08.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.278+0000 7f9063acb640 1 -- 172.21.15.87:0/3091087577 wait complete. 2024-09-17T07:24:08.289 INFO:teuthology.orchestra.run.smithi087.stdout:true 2024-09-17T07:24:08.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.361+0000 7f616c42f640 1 -- 172.21.15.87:0/3687824790 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f61640fd840 msgr2=0x7f61640fdcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:24:08.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.361+0000 7f616c42f640 1 --2- 172.21.15.87:0/3687824790 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f61640fd840 0x7f61640fdcb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f61540048d0 tx=0x7f6154009da0 comp rx=0 tx=0).stop 2024-09-17T07:24:08.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.361+0000 7f616c42f640 1 -- 172.21.15.87:0/3687824790 shutdown_connections 2024-09-17T07:24:08.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.361+0000 7f616c42f640 1 --2- 172.21.15.87:0/3687824790 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f61640fd840 0x7f61640fdcb0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:08.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.361+0000 7f616c42f640 1 --2- 172.21.15.87:0/3687824790 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f61640fc570 0x7f61640fc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:08.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.361+0000 7f616c42f640 1 -- 172.21.15.87:0/3687824790 >> 172.21.15.87:0/3687824790 conn(0x7f61640f7d30 msgr2=0x7f61640fa160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:24:08.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.361+0000 7f616c42f640 1 -- 172.21.15.87:0/3687824790 shutdown_connections 2024-09-17T07:24:08.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.361+0000 7f616c42f640 1 -- 172.21.15.87:0/3687824790 wait complete. 2024-09-17T07:24:08.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.362+0000 7f616c42f640 1 Processor -- start 2024-09-17T07:24:08.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.362+0000 7f616c42f640 1 -- start start 2024-09-17T07:24:08.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.362+0000 7f616c42f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f61640fc570 0x7f616410cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:24:08.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.362+0000 7f616c42f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f61640fd840 0x7f616410d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:24:08.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.362+0000 7f616c42f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f616410db60 con 0x7f61640fd840 2024-09-17T07:24:08.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.362+0000 7f616c42f640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f616410e380 con 0x7f61640fc570 2024-09-17T07:24:08.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.362+0000 7f61699ca640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f61640fd840 0x7f616410d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:24:08.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.362+0000 7f61699ca640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f61640fd840 0x7f616410d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42004/0 (socket says 172.21.15.87:42004) 2024-09-17T07:24:08.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.362+0000 7f61699ca640 1 -- 172.21.15.87:0/1340801736 learned_addr learned my addr 172.21.15.87:0/1340801736 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:24:08.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.363+0000 7f616a1cb640 1 --2- 172.21.15.87:0/1340801736 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f61640fc570 0x7f616410cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:24:08.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.363+0000 7f61699ca640 1 -- 172.21.15.87:0/1340801736 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f61640fc570 msgr2=0x7f616410cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:24:08.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.363+0000 7f61699ca640 1 --2- 172.21.15.87:0/1340801736 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f61640fc570 0x7f616410cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:08.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.363+0000 7f61699ca640 1 -- 172.21.15.87:0/1340801736 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6154005040 con 0x7f61640fd840 2024-09-17T07:24:08.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.363+0000 7f61699ca640 1 --2- 172.21.15.87:0/1340801736 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f61640fd840 0x7f616410d510 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6154009ac0 tx=0x7f6154009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:24:08.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.363+0000 7f615affd640 1 -- 172.21.15.87:0/1340801736 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6154038070 con 0x7f61640fd840 2024-09-17T07:24:08.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.363+0000 7f615affd640 1 -- 172.21.15.87:0/1340801736 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f615402ae70 con 0x7f61640fd840 2024-09-17T07:24:08.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.363+0000 7f616c42f640 1 -- 172.21.15.87:0/1340801736 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f616410e5b0 con 0x7f61640fd840 2024-09-17T07:24:08.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.363+0000 7f615affd640 1 -- 172.21.15.87:0/1340801736 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6154033420 con 0x7f61640fd840 2024-09-17T07:24:08.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.363+0000 7f616c42f640 1 -- 172.21.15.87:0/1340801736 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f616410eaf0 con 0x7f61640fd840 2024-09-17T07:24:08.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.364+0000 7f616c42f640 1 -- 172.21.15.87:0/1340801736 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61640fb9d0 con 0x7f61640fd840 2024-09-17T07:24:08.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.365+0000 7f615affd640 1 -- 172.21.15.87:0/1340801736 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f6154030020 con 0x7f61640fd840 2024-09-17T07:24:08.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.365+0000 7f615affd640 1 --2- 172.21.15.87:0/1340801736 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f615006cb90 0x7f615006f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:24:08.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.365+0000 7f615affd640 1 -- 172.21.15.87:0/1340801736 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f61540ac0b0 con 0x7f61640fd840 2024-09-17T07:24:08.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.365+0000 7f616a1cb640 1 --2- 172.21.15.87:0/1340801736 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f615006cb90 0x7f615006f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:24:08.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.366+0000 7f616a1cb640 1 --2- 172.21.15.87:0/1340801736 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f615006cb90 0x7f615006f040 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f61600041d0 tx=0x7f6160009040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:24:08.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.369+0000 7f615affd640 1 -- 172.21.15.87:0/1340801736 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f61540760c0 con 0x7f61640fd840 2024-09-17T07:24:08.522 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:08 smithi087 ceph-mon[90982]: Upgrade: Updating osd.2 2024-09-17T07:24:08.522 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:08 smithi087 ceph-mon[90982]: Deploying daemon osd.2 on smithi087 2024-09-17T07:24:08.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.556+0000 7f616c42f640 1 -- 172.21.15.87:0/1340801736 --> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f616410ee80 con 0x7f615006cb90 2024-09-17T07:24:08.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.557+0000 7f615affd640 1 -- 172.21.15.87:0/1340801736 <== mgr.24529 v2:172.21.15.87:6800/1359413180 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f616410ee80 con 0x7f615006cb90 2024-09-17T07:24:08.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.559+0000 7f616c42f640 1 -- 172.21.15.87:0/1340801736 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f615006cb90 msgr2=0x7f615006f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:24:08.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.559+0000 7f616c42f640 1 --2- 172.21.15.87:0/1340801736 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f615006cb90 0x7f615006f040 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f61600041d0 tx=0x7f6160009040 comp rx=0 tx=0).stop 2024-09-17T07:24:08.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.559+0000 7f616c42f640 1 -- 172.21.15.87:0/1340801736 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f61640fd840 msgr2=0x7f616410d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:24:08.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.559+0000 7f616c42f640 1 --2- 172.21.15.87:0/1340801736 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f61640fd840 0x7f616410d510 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6154009ac0 tx=0x7f6154009da0 comp rx=0 tx=0).stop 2024-09-17T07:24:08.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.559+0000 7f616c42f640 1 -- 172.21.15.87:0/1340801736 shutdown_connections 2024-09-17T07:24:08.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.559+0000 7f616c42f640 1 --2- 172.21.15.87:0/1340801736 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f61640fd840 0x7f616410d510 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:08.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.559+0000 7f616c42f640 1 --2- 172.21.15.87:0/1340801736 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f615006cb90 0x7f615006f040 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:08.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.559+0000 7f616c42f640 1 --2- 172.21.15.87:0/1340801736 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f61640fc570 0x7f616410cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:08.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.559+0000 7f616c42f640 1 -- 172.21.15.87:0/1340801736 >> 172.21.15.87:0/1340801736 conn(0x7f61640f7d30 msgr2=0x7f61640f95a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:24:08.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.560+0000 7f616c42f640 1 -- 172.21.15.87:0/1340801736 shutdown_connections 2024-09-17T07:24:08.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.560+0000 7f616c42f640 1 -- 172.21.15.87:0/1340801736 wait complete. 2024-09-17T07:24:08.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:08 smithi139 ceph-mon[79872]: Upgrade: Updating osd.2 2024-09-17T07:24:08.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:08 smithi139 ceph-mon[79872]: Deploying daemon osd.2 on smithi087 2024-09-17T07:24:08.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.639+0000 7f4f99d19640 1 -- 172.21.15.87:0/3797990403 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4f940fd830 msgr2=0x7f4f940fdca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:24:08.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.639+0000 7f4f99d19640 1 --2- 172.21.15.87:0/3797990403 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4f940fd830 0x7f4f940fdca0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4f88009c50 tx=0x7f4f88004d10 comp rx=0 tx=0).stop 2024-09-17T07:24:08.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.640+0000 7f4f99d19640 1 -- 172.21.15.87:0/3797990403 shutdown_connections 2024-09-17T07:24:08.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.640+0000 7f4f99d19640 1 --2- 172.21.15.87:0/3797990403 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4f940fd830 0x7f4f940fdca0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:08.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.640+0000 7f4f99d19640 1 --2- 172.21.15.87:0/3797990403 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4f940fc560 0x7f4f940fc970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:08.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.640+0000 7f4f99d19640 1 -- 172.21.15.87:0/3797990403 >> 172.21.15.87:0/3797990403 conn(0x7f4f940f7d20 msgr2=0x7f4f940fa150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:24:08.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.640+0000 7f4f99d19640 1 -- 172.21.15.87:0/3797990403 shutdown_connections 2024-09-17T07:24:08.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.640+0000 7f4f99d19640 1 -- 172.21.15.87:0/3797990403 wait complete. 2024-09-17T07:24:08.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.640+0000 7f4f99d19640 1 Processor -- start 2024-09-17T07:24:08.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.640+0000 7f4f99d19640 1 -- start start 2024-09-17T07:24:08.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.640+0000 7f4f99d19640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4f940fc560 0x7f4f9410cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:24:08.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.640+0000 7f4f99d19640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4f940fd830 0x7f4f9410d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:24:08.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.640+0000 7f4f99d19640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9410dad0 con 0x7f4f940fc560 2024-09-17T07:24:08.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.640+0000 7f4f99d19640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9410e2f0 con 0x7f4f940fd830 2024-09-17T07:24:08.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.641+0000 7f4f937fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4f940fc560 0x7f4f9410cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:24:08.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.641+0000 7f4f937fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4f940fc560 0x7f4f9410cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42022/0 (socket says 172.21.15.87:42022) 2024-09-17T07:24:08.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.641+0000 7f4f937fe640 1 -- 172.21.15.87:0/1232622506 learned_addr learned my addr 172.21.15.87:0/1232622506 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:24:08.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.641+0000 7f4f92ffd640 1 --2- 172.21.15.87:0/1232622506 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4f940fd830 0x7f4f9410d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:24:08.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.641+0000 7f4f937fe640 1 -- 172.21.15.87:0/1232622506 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4f940fd830 msgr2=0x7f4f9410d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:24:08.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.641+0000 7f4f937fe640 1 --2- 172.21.15.87:0/1232622506 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4f940fd830 0x7f4f9410d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:08.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.641+0000 7f4f937fe640 1 -- 172.21.15.87:0/1232622506 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f880098b0 con 0x7f4f940fc560 2024-09-17T07:24:08.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.641+0000 7f4f92ffd640 1 --2- 172.21.15.87:0/1232622506 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4f940fd830 0x7f4f9410d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T07:24:08.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.641+0000 7f4f937fe640 1 --2- 172.21.15.87:0/1232622506 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4f940fc560 0x7f4f9410cf40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4f8400c830 tx=0x7f4f84004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:24:08.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.641+0000 7f4f7bfff640 1 -- 172.21.15.87:0/1232622506 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f8400a850 con 0x7f4f940fc560 2024-09-17T07:24:08.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.641+0000 7f4f7bfff640 1 -- 172.21.15.87:0/1232622506 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f4f8400ae30 con 0x7f4f940fc560 2024-09-17T07:24:08.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.641+0000 7f4f7bfff640 1 -- 172.21.15.87:0/1232622506 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f840113a0 con 0x7f4f940fc560 2024-09-17T07:24:08.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.641+0000 7f4f99d19640 1 -- 172.21.15.87:0/1232622506 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f9410e580 con 0x7f4f940fc560 2024-09-17T07:24:08.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.641+0000 7f4f99d19640 1 -- 172.21.15.87:0/1232622506 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f9410eb20 con 0x7f4f940fc560 2024-09-17T07:24:08.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.642+0000 7f4f99d19640 1 -- 172.21.15.87:0/1232622506 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f940fb9c0 con 0x7f4f940fc560 2024-09-17T07:24:08.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.643+0000 7f4f7bfff640 1 -- 172.21.15.87:0/1232622506 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f4f84012400 con 0x7f4f940fc560 2024-09-17T07:24:08.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.643+0000 7f4f7bfff640 1 --2- 172.21.15.87:0/1232622506 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f4f7c06cb90 0x7f4f7c06f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:24:08.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.643+0000 7f4f7bfff640 1 -- 172.21.15.87:0/1232622506 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f4f8408c170 con 0x7f4f940fc560 2024-09-17T07:24:08.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.643+0000 7f4f92ffd640 1 --2- 172.21.15.87:0/1232622506 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f4f7c06cb90 0x7f4f7c06f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:24:08.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.644+0000 7f4f92ffd640 1 --2- 172.21.15.87:0/1232622506 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f4f7c06cb90 0x7f4f7c06f040 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4f88032470 tx=0x7f4f88004d10 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:24:08.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.647+0000 7f4f7bfff640 1 -- 172.21.15.87:0/1232622506 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f4f840562a0 con 0x7f4f940fc560 2024-09-17T07:24:08.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.828+0000 7f4f99d19640 1 -- 172.21.15.87:0/1232622506 --> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4f9410ef00 con 0x7f4f7c06cb90 2024-09-17T07:24:08.838 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.836+0000 7f4f7bfff640 1 -- 172.21.15.87:0/1232622506 <== mgr.24529 v2:172.21.15.87:6800/1359413180 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f4f9410ef00 con 0x7f4f7c06cb90 2024-09-17T07:24:08.838 INFO:teuthology.orchestra.run.smithi087.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T07:24:08.838 INFO:teuthology.orchestra.run.smithi087.stdout:alertmanager.smithi087 smithi087 *:9093,9094 running (3m) 22s ago 12m 25.6M - 0.25.0 c8568f914cd2 594553f0b497 2024-09-17T07:24:08.838 INFO:teuthology.orchestra.run.smithi087.stdout:crash.smithi087 smithi087 running (84s) 22s ago 12m 6895k - 18.2.4-855-g19e2a2be 980a0bfcd684 0ff8a9330162 2024-09-17T07:24:08.838 INFO:teuthology.orchestra.run.smithi087.stdout:crash.smithi139 smithi139 running (79s) 76s ago 11m 6899k - 18.2.4-855-g19e2a2be 980a0bfcd684 10541e3b202e 2024-09-17T07:24:08.838 INFO:teuthology.orchestra.run.smithi087.stdout:grafana.smithi087 smithi087 *:3000 running (3m) 22s ago 11m 78.5M - 9.4.7 954c08fa6188 e2f17ec6baa8 2024-09-17T07:24:08.838 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi087.tjhpcs smithi087 running (6m) 22s ago 6m 130M - 17.2.7-1635-g4a704134 f22ead590bad f7142ad971ed 2024-09-17T07:24:08.838 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi087.vvbzss smithi087 running (6m) 22s ago 6m 70.1M - 17.2.7-1635-g4a704134 f22ead590bad 2dd82ff293d1 2024-09-17T07:24:08.839 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi139.ftvinf smithi139 running (6m) 76s ago 6m 57.4M - 17.2.7-1635-g4a704134 f22ead590bad d11edb295ad3 2024-09-17T07:24:08.839 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi139.gnwonz smithi139 running (6m) 76s ago 6m 116M - 17.2.7-1635-g4a704134 f22ead590bad 3b3d884aef02 2024-09-17T07:24:08.839 INFO:teuthology.orchestra.run.smithi087.stdout:mgr.smithi087.vuvjer smithi087 *:8443,9283,8765 running (3m) 22s ago 13m 486M - 18.2.4-855-g19e2a2be 980a0bfcd684 5d10c647cb6b 2024-09-17T07:24:08.839 INFO:teuthology.orchestra.run.smithi087.stdout:mgr.smithi139.tuqnpn smithi139 *:8443,9283,8765 running (2m) 76s ago 11m 437M - 18.2.4-855-g19e2a2be 980a0bfcd684 6e0bf371d44c 2024-09-17T07:24:08.839 INFO:teuthology.orchestra.run.smithi087.stdout:mon.smithi087 smithi087 running (2m) 22s ago 13m 43.2M 2048M 18.2.4-855-g19e2a2be 980a0bfcd684 305c72de1f9f 2024-09-17T07:24:08.839 INFO:teuthology.orchestra.run.smithi087.stdout:mon.smithi139 smithi139 running (119s) 76s ago 11m 34.0M 2048M 18.2.4-855-g19e2a2be 980a0bfcd684 0b159495af0f 2024-09-17T07:24:08.839 INFO:teuthology.orchestra.run.smithi087.stdout:node-exporter.smithi087 smithi087 *:9100 running (3m) 22s ago 12m 15.3M - 1.5.0 0da6a335fe13 39fa48de0e87 2024-09-17T07:24:08.839 INFO:teuthology.orchestra.run.smithi087.stdout:node-exporter.smithi139 smithi139 *:9100 running (3m) 76s ago 11m 15.6M - 1.5.0 0da6a335fe13 a5b99b7cbb06 2024-09-17T07:24:08.839 INFO:teuthology.orchestra.run.smithi087.stdout:osd.0 smithi087 running (60s) 22s ago 10m 84.9M 1557M 18.2.4-855-g19e2a2be 980a0bfcd684 e97cb50e6aec 2024-09-17T07:24:08.839 INFO:teuthology.orchestra.run.smithi087.stdout:osd.1 smithi087 running (27s) 22s ago 9m 14.4M 1557M 18.2.4-855-g19e2a2be 980a0bfcd684 b108771d0b8e 2024-09-17T07:24:08.839 INFO:teuthology.orchestra.run.smithi087.stdout:osd.2 smithi087 running (9m) 22s ago 9m 160M 1557M 17.2.7-1635-g4a704134 f22ead590bad 8fe1428a6878 2024-09-17T07:24:08.839 INFO:teuthology.orchestra.run.smithi087.stdout:osd.3 smithi139 running (9m) 76s ago 9m 234M 2581M 17.2.7-1635-g4a704134 f22ead590bad 0801999b17c4 2024-09-17T07:24:08.839 INFO:teuthology.orchestra.run.smithi087.stdout:osd.4 smithi139 running (8m) 76s ago 8m 210M 2581M 17.2.7-1635-g4a704134 f22ead590bad 299a8dfc47f5 2024-09-17T07:24:08.839 INFO:teuthology.orchestra.run.smithi087.stdout:osd.5 smithi139 running (8m) 76s ago 8m 200M 2581M 17.2.7-1635-g4a704134 f22ead590bad 609cf74f32e7 2024-09-17T07:24:08.840 INFO:teuthology.orchestra.run.smithi087.stdout:prometheus.smithi087 smithi087 *:9095 running (2m) 22s ago 11m 56.4M - 2.43.0 a07b618ecd1d 63d18b7469fc 2024-09-17T07:24:08.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.838+0000 7f4f99d19640 1 -- 172.21.15.87:0/1232622506 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f4f7c06cb90 msgr2=0x7f4f7c06f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:24:08.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.838+0000 7f4f99d19640 1 --2- 172.21.15.87:0/1232622506 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f4f7c06cb90 0x7f4f7c06f040 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4f88032470 tx=0x7f4f88004d10 comp rx=0 tx=0).stop 2024-09-17T07:24:08.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.838+0000 7f4f99d19640 1 -- 172.21.15.87:0/1232622506 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4f940fc560 msgr2=0x7f4f9410cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:24:08.840 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.838+0000 7f4f99d19640 1 --2- 172.21.15.87:0/1232622506 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4f940fc560 0x7f4f9410cf40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4f8400c830 tx=0x7f4f84004430 comp rx=0 tx=0).stop 2024-09-17T07:24:08.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.839+0000 7f4f99d19640 1 -- 172.21.15.87:0/1232622506 shutdown_connections 2024-09-17T07:24:08.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.839+0000 7f4f99d19640 1 --2- 172.21.15.87:0/1232622506 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f4f7c06cb90 0x7f4f7c06f040 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:08.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.839+0000 7f4f99d19640 1 --2- 172.21.15.87:0/1232622506 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4f940fd830 0x7f4f9410d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:08.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.839+0000 7f4f99d19640 1 --2- 172.21.15.87:0/1232622506 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4f940fc560 0x7f4f9410cf40 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:08.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.839+0000 7f4f99d19640 1 -- 172.21.15.87:0/1232622506 >> 172.21.15.87:0/1232622506 conn(0x7f4f940f7d20 msgr2=0x7f4f940f9560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:24:08.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.839+0000 7f4f99d19640 1 -- 172.21.15.87:0/1232622506 shutdown_connections 2024-09-17T07:24:08.841 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.839+0000 7f4f99d19640 1 -- 172.21.15.87:0/1232622506 wait complete. 2024-09-17T07:24:08.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.916+0000 7f7e5759e640 1 -- 172.21.15.87:0/2997675842 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e580fb280 msgr2=0x7f7e580fb690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:24:08.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.916+0000 7f7e5759e640 1 --2- 172.21.15.87:0/2997675842 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e580fb280 0x7f7e580fb690 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7e480048d0 tx=0x7f7e48009da0 comp rx=0 tx=0).stop 2024-09-17T07:24:08.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.916+0000 7f7e5759e640 1 -- 172.21.15.87:0/2997675842 shutdown_connections 2024-09-17T07:24:08.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.916+0000 7f7e5759e640 1 --2- 172.21.15.87:0/2997675842 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7e580fc550 0x7f7e580fc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:08.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.916+0000 7f7e5759e640 1 --2- 172.21.15.87:0/2997675842 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e580fb280 0x7f7e580fb690 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:08.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.916+0000 7f7e5759e640 1 -- 172.21.15.87:0/2997675842 >> 172.21.15.87:0/2997675842 conn(0x7f7e580f6a40 msgr2=0x7f7e580f8e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:24:08.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.916+0000 7f7e5759e640 1 -- 172.21.15.87:0/2997675842 shutdown_connections 2024-09-17T07:24:08.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.916+0000 7f7e5759e640 1 -- 172.21.15.87:0/2997675842 wait complete. 2024-09-17T07:24:08.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.917+0000 7f7e5759e640 1 Processor -- start 2024-09-17T07:24:08.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.917+0000 7f7e5759e640 1 -- start start 2024-09-17T07:24:08.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.917+0000 7f7e5759e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e580fb280 0x7f7e58103370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:24:08.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.917+0000 7f7e5759e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7e580fc550 0x7f7e581018b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:24:08.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.917+0000 7f7e5759e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e58101e80 con 0x7f7e580fb280 2024-09-17T07:24:08.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.917+0000 7f7e5759e640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e58101fc0 con 0x7f7e580fc550 2024-09-17T07:24:08.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.917+0000 7f7e5659c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e580fb280 0x7f7e58103370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:24:08.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.917+0000 7f7e5659c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e580fb280 0x7f7e58103370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42036/0 (socket says 172.21.15.87:42036) 2024-09-17T07:24:08.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.917+0000 7f7e5659c640 1 -- 172.21.15.87:0/2976057885 learned_addr learned my addr 172.21.15.87:0/2976057885 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:24:08.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.918+0000 7f7e55d9b640 1 --2- 172.21.15.87:0/2976057885 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7e580fc550 0x7f7e581018b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:24:08.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.918+0000 7f7e5659c640 1 -- 172.21.15.87:0/2976057885 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7e580fc550 msgr2=0x7f7e581018b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:24:08.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.918+0000 7f7e5659c640 1 --2- 172.21.15.87:0/2976057885 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7e580fc550 0x7f7e581018b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:08.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.918+0000 7f7e5659c640 1 -- 172.21.15.87:0/2976057885 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e48005040 con 0x7f7e580fb280 2024-09-17T07:24:08.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.918+0000 7f7e55d9b640 1 --2- 172.21.15.87:0/2976057885 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7e580fc550 0x7f7e581018b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T07:24:08.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.918+0000 7f7e5659c640 1 --2- 172.21.15.87:0/2976057885 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e580fb280 0x7f7e58103370 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7e4800b020 tx=0x7f7e48009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:24:08.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.918+0000 7f7e46ffd640 1 -- 172.21.15.87:0/2976057885 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e48038070 con 0x7f7e580fb280 2024-09-17T07:24:08.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.918+0000 7f7e46ffd640 1 -- 172.21.15.87:0/2976057885 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f7e4802ae70 con 0x7f7e580fb280 2024-09-17T07:24:08.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.918+0000 7f7e5759e640 1 -- 172.21.15.87:0/2976057885 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e58102240 con 0x7f7e580fb280 2024-09-17T07:24:08.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.918+0000 7f7e5759e640 1 -- 172.21.15.87:0/2976057885 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e58114f20 con 0x7f7e580fb280 2024-09-17T07:24:08.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.918+0000 7f7e46ffd640 1 -- 172.21.15.87:0/2976057885 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e4803d420 con 0x7f7e580fb280 2024-09-17T07:24:08.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.919+0000 7f7e5759e640 1 -- 172.21.15.87:0/2976057885 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e5804b720 con 0x7f7e580fb280 2024-09-17T07:24:08.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.920+0000 7f7e46ffd640 1 -- 172.21.15.87:0/2976057885 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f7e48030020 con 0x7f7e580fb280 2024-09-17T07:24:08.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.920+0000 7f7e46ffd640 1 --2- 172.21.15.87:0/2976057885 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f7e4006cba0 0x7f7e4006f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:24:08.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.920+0000 7f7e46ffd640 1 -- 172.21.15.87:0/2976057885 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f7e480ac6f0 con 0x7f7e580fb280 2024-09-17T07:24:08.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.920+0000 7f7e55d9b640 1 --2- 172.21.15.87:0/2976057885 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f7e4006cba0 0x7f7e4006f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:24:08.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.921+0000 7f7e55d9b640 1 --2- 172.21.15.87:0/2976057885 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f7e4006cba0 0x7f7e4006f050 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c006fd0 tx=0x7f7e4c008040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:24:08.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:08.924+0000 7f7e46ffd640 1 -- 172.21.15.87:0/2976057885 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7e48076780 con 0x7f7e580fb280 2024-09-17T07:24:09.158 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.157+0000 7f7e5759e640 1 -- 172.21.15.87:0/2976057885 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7e5802aa40 con 0x7f7e580fb280 2024-09-17T07:24:09.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.158+0000 7f7e46ffd640 1 -- 172.21.15.87:0/2976057885 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+846 (secure 0 0 0) 0x7f7e48079da0 con 0x7f7e580fb280 2024-09-17T07:24:09.159 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T07:24:09.159 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": { 2024-09-17T07:24:09.159 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 2 2024-09-17T07:24:09.159 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:24:09.159 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr": { 2024-09-17T07:24:09.159 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 2 2024-09-17T07:24:09.160 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:24:09.160 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": { 2024-09-17T07:24:09.160 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 4, 2024-09-17T07:24:09.160 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 2 2024-09-17T07:24:09.160 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:24:09.160 INFO:teuthology.orchestra.run.smithi087.stdout: "mds": { 2024-09-17T07:24:09.160 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 4 2024-09-17T07:24:09.160 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:24:09.160 INFO:teuthology.orchestra.run.smithi087.stdout: "overall": { 2024-09-17T07:24:09.160 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 8, 2024-09-17T07:24:09.160 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 6 2024-09-17T07:24:09.160 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T07:24:09.160 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T07:24:09.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.160+0000 7f7e5759e640 1 -- 172.21.15.87:0/2976057885 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f7e4006cba0 msgr2=0x7f7e4006f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:24:09.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.160+0000 7f7e5759e640 1 --2- 172.21.15.87:0/2976057885 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f7e4006cba0 0x7f7e4006f050 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c006fd0 tx=0x7f7e4c008040 comp rx=0 tx=0).stop 2024-09-17T07:24:09.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.160+0000 7f7e5759e640 1 -- 172.21.15.87:0/2976057885 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e580fb280 msgr2=0x7f7e58103370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:24:09.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.160+0000 7f7e5759e640 1 --2- 172.21.15.87:0/2976057885 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e580fb280 0x7f7e58103370 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7e4800b020 tx=0x7f7e48009da0 comp rx=0 tx=0).stop 2024-09-17T07:24:09.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.160+0000 7f7e5759e640 1 -- 172.21.15.87:0/2976057885 shutdown_connections 2024-09-17T07:24:09.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.160+0000 7f7e5759e640 1 --2- 172.21.15.87:0/2976057885 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f7e4006cba0 0x7f7e4006f050 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:09.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.160+0000 7f7e5759e640 1 --2- 172.21.15.87:0/2976057885 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7e580fc550 0x7f7e581018b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:09.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.160+0000 7f7e5759e640 1 --2- 172.21.15.87:0/2976057885 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e580fb280 0x7f7e58103370 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:09.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.160+0000 7f7e5759e640 1 -- 172.21.15.87:0/2976057885 >> 172.21.15.87:0/2976057885 conn(0x7f7e580f6a40 msgr2=0x7f7e580ff8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:24:09.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.160+0000 7f7e5759e640 1 -- 172.21.15.87:0/2976057885 shutdown_connections 2024-09-17T07:24:09.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.160+0000 7f7e5759e640 1 -- 172.21.15.87:0/2976057885 wait complete. 2024-09-17T07:24:09.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.240+0000 7fae7009c640 1 -- 172.21.15.87:0/2217782450 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae680fdba0 msgr2=0x7fae680fdfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:24:09.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.240+0000 7fae7009c640 1 --2- 172.21.15.87:0/2217782450 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae680fdba0 0x7fae680fdfb0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fae640048d0 tx=0x7fae64009da0 comp rx=0 tx=0).stop 2024-09-17T07:24:09.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.240+0000 7fae7009c640 1 -- 172.21.15.87:0/2217782450 shutdown_connections 2024-09-17T07:24:09.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.240+0000 7fae7009c640 1 --2- 172.21.15.87:0/2217782450 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fae680fe4f0 0x7fae680fa650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:09.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.240+0000 7fae7009c640 1 --2- 172.21.15.87:0/2217782450 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae680fdba0 0x7fae680fdfb0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:09.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.240+0000 7fae7009c640 1 -- 172.21.15.87:0/2217782450 >> 172.21.15.87:0/2217782450 conn(0x7fae680f63a0 msgr2=0x7fae680f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:24:09.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.240+0000 7fae7009c640 1 -- 172.21.15.87:0/2217782450 shutdown_connections 2024-09-17T07:24:09.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.240+0000 7fae7009c640 1 -- 172.21.15.87:0/2217782450 wait complete. 2024-09-17T07:24:09.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.241+0000 7fae7009c640 1 Processor -- start 2024-09-17T07:24:09.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.241+0000 7fae7009c640 1 -- start start 2024-09-17T07:24:09.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.241+0000 7fae7009c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fae680fdba0 0x7fae6810d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:24:09.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.241+0000 7fae7009c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae680fe4f0 0x7fae6810d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:24:09.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.241+0000 7fae7009c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae6810e410 con 0x7fae680fe4f0 2024-09-17T07:24:09.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.241+0000 7fae7009c640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae6810e580 con 0x7fae680fdba0 2024-09-17T07:24:09.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.241+0000 7fae6d637640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae680fe4f0 0x7fae6810d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:24:09.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.241+0000 7fae6d637640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae680fe4f0 0x7fae6810d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42056/0 (socket says 172.21.15.87:42056) 2024-09-17T07:24:09.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.241+0000 7fae6d637640 1 -- 172.21.15.87:0/337387373 learned_addr learned my addr 172.21.15.87:0/337387373 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:24:09.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.241+0000 7fae6de38640 1 --2- 172.21.15.87:0/337387373 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fae680fdba0 0x7fae6810d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:24:09.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.242+0000 7fae6d637640 1 -- 172.21.15.87:0/337387373 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fae680fdba0 msgr2=0x7fae6810d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:24:09.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.242+0000 7fae6d637640 1 --2- 172.21.15.87:0/337387373 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fae680fdba0 0x7fae6810d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:09.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.242+0000 7fae6d637640 1 -- 172.21.15.87:0/337387373 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae64005040 con 0x7fae680fe4f0 2024-09-17T07:24:09.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.242+0000 7fae6de38640 1 --2- 172.21.15.87:0/337387373 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fae680fdba0 0x7fae6810d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T07:24:09.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.242+0000 7fae6d637640 1 --2- 172.21.15.87:0/337387373 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae680fe4f0 0x7fae6810d5a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fae5c00b580 tx=0x7fae5c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:24:09.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.242+0000 7fae5a7fc640 1 -- 172.21.15.87:0/337387373 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae5c00f570 con 0x7fae680fe4f0 2024-09-17T07:24:09.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.242+0000 7fae5a7fc640 1 -- 172.21.15.87:0/337387373 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fae5c00fb50 con 0x7fae680fe4f0 2024-09-17T07:24:09.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.242+0000 7fae7009c640 1 -- 172.21.15.87:0/337387373 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae6810e860 con 0x7fae680fe4f0 2024-09-17T07:24:09.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.242+0000 7fae5a7fc640 1 -- 172.21.15.87:0/337387373 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae5c010c90 con 0x7fae680fe4f0 2024-09-17T07:24:09.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.242+0000 7fae7009c640 1 -- 172.21.15.87:0/337387373 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae6810ed80 con 0x7fae680fe4f0 2024-09-17T07:24:09.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.243+0000 7fae7009c640 1 -- 172.21.15.87:0/337387373 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae680fa040 con 0x7fae680fe4f0 2024-09-17T07:24:09.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.244+0000 7fae5a7fc640 1 -- 172.21.15.87:0/337387373 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fae5c00fcc0 con 0x7fae680fe4f0 2024-09-17T07:24:09.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.244+0000 7fae5a7fc640 1 --2- 172.21.15.87:0/337387373 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fae5406cb90 0x7fae5406f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:24:09.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.244+0000 7fae5a7fc640 1 -- 172.21.15.87:0/337387373 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fae5c08bf00 con 0x7fae680fe4f0 2024-09-17T07:24:09.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.244+0000 7fae6de38640 1 --2- 172.21.15.87:0/337387373 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fae5406cb90 0x7fae5406f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:24:09.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.245+0000 7fae6de38640 1 --2- 172.21.15.87:0/337387373 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fae5406cb90 0x7fae5406f040 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fae64009ac0 tx=0x7fae64009da0 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:24:09.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.248+0000 7fae5a7fc640 1 -- 172.21.15.87:0/337387373 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fae5c055f90 con 0x7fae680fe4f0 2024-09-17T07:24:09.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:09 smithi087 ceph-mon[90982]: pgmap v78: 65 pgs: 65 active+clean; 322 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:24:09.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:09 smithi087 ceph-mon[90982]: from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:24:09.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:09 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/2976057885' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:24:09.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.446+0000 7fae7009c640 1 -- 172.21.15.87:0/337387373 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fae6810e9f0 con 0x7fae680fe4f0 2024-09-17T07:24:09.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.446+0000 7fae5a7fc640 1 -- 172.21.15.87:0/337387373 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 23 v23) v1 ==== 76+0+1871 (secure 0 0 0) 0x7fae6810e9f0 con 0x7fae680fe4f0 2024-09-17T07:24:09.449 INFO:teuthology.orchestra.run.smithi087.stdout:e23 2024-09-17T07:24:09.449 INFO:teuthology.orchestra.run.smithi087.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T07:24:09.449 INFO:teuthology.orchestra.run.smithi087.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T07:24:09.449 INFO:teuthology.orchestra.run.smithi087.stdout:legacy client fscid: 1 2024-09-17T07:24:09.449 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:24:09.450 INFO:teuthology.orchestra.run.smithi087.stdout:Filesystem 'cephfs' (1) 2024-09-17T07:24:09.450 INFO:teuthology.orchestra.run.smithi087.stdout:fs_name cephfs 2024-09-17T07:24:09.450 INFO:teuthology.orchestra.run.smithi087.stdout:epoch 23 2024-09-17T07:24:09.450 INFO:teuthology.orchestra.run.smithi087.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T07:24:09.450 INFO:teuthology.orchestra.run.smithi087.stdout:created 2024-09-17T07:17:15.368053+0000 2024-09-17T07:24:09.450 INFO:teuthology.orchestra.run.smithi087.stdout:modified 2024-09-17T07:24:06.203553+0000 2024-09-17T07:24:09.450 INFO:teuthology.orchestra.run.smithi087.stdout:tableserver 0 2024-09-17T07:24:09.450 INFO:teuthology.orchestra.run.smithi087.stdout:root 0 2024-09-17T07:24:09.450 INFO:teuthology.orchestra.run.smithi087.stdout:session_timeout 60 2024-09-17T07:24:09.450 INFO:teuthology.orchestra.run.smithi087.stdout:session_autoclose 300 2024-09-17T07:24:09.450 INFO:teuthology.orchestra.run.smithi087.stdout:max_file_size 1099511627776 2024-09-17T07:24:09.450 INFO:teuthology.orchestra.run.smithi087.stdout:max_xattr_size 65536 2024-09-17T07:24:09.450 INFO:teuthology.orchestra.run.smithi087.stdout:required_client_features {} 2024-09-17T07:24:09.450 INFO:teuthology.orchestra.run.smithi087.stdout:last_failure 0 2024-09-17T07:24:09.451 INFO:teuthology.orchestra.run.smithi087.stdout:last_failure_osd_epoch 44 2024-09-17T07:24:09.451 INFO:teuthology.orchestra.run.smithi087.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T07:24:09.451 INFO:teuthology.orchestra.run.smithi087.stdout:max_mds 2 2024-09-17T07:24:09.451 INFO:teuthology.orchestra.run.smithi087.stdout:in 0,1 2024-09-17T07:24:09.451 INFO:teuthology.orchestra.run.smithi087.stdout:up {0=14478,1=24243} 2024-09-17T07:24:09.451 INFO:teuthology.orchestra.run.smithi087.stdout:failed 2024-09-17T07:24:09.451 INFO:teuthology.orchestra.run.smithi087.stdout:damaged 2024-09-17T07:24:09.451 INFO:teuthology.orchestra.run.smithi087.stdout:stopped 2024-09-17T07:24:09.451 INFO:teuthology.orchestra.run.smithi087.stdout:data_pools [3] 2024-09-17T07:24:09.451 INFO:teuthology.orchestra.run.smithi087.stdout:metadata_pool 2 2024-09-17T07:24:09.451 INFO:teuthology.orchestra.run.smithi087.stdout:inline_data enabled 2024-09-17T07:24:09.451 INFO:teuthology.orchestra.run.smithi087.stdout:balancer 2024-09-17T07:24:09.451 INFO:teuthology.orchestra.run.smithi087.stdout:bal_rank_mask -1 2024-09-17T07:24:09.451 INFO:teuthology.orchestra.run.smithi087.stdout:standby_count_wanted 1 2024-09-17T07:24:09.452 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi087.tjhpcs{0:14478} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.87:6828/2255237099,v1:172.21.15.87:6829/2255237099] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:24:09.452 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi087.vvbzss{0:14490} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.87:6826/4022268353,v1:172.21.15.87:6827/4022268353] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:24:09.452 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi139.gnwonz{1:24243} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.139:6824/3946792151,v1:172.21.15.139:6825/3946792151] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:24:09.452 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi139.ftvinf{1:24253} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.139:6826/3292073323,v1:172.21.15.139:6827/3292073323] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:24:09.452 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:24:09.452 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:24:09.453 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 23 2024-09-17T07:24:09.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.448+0000 7fae7009c640 1 -- 172.21.15.87:0/337387373 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fae5406cb90 msgr2=0x7fae5406f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:24:09.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.448+0000 7fae7009c640 1 --2- 172.21.15.87:0/337387373 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fae5406cb90 0x7fae5406f040 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fae64009ac0 tx=0x7fae64009da0 comp rx=0 tx=0).stop 2024-09-17T07:24:09.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.448+0000 7fae7009c640 1 -- 172.21.15.87:0/337387373 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae680fe4f0 msgr2=0x7fae6810d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:24:09.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.448+0000 7fae7009c640 1 --2- 172.21.15.87:0/337387373 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae680fe4f0 0x7fae6810d5a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fae5c00b580 tx=0x7fae5c0091a0 comp rx=0 tx=0).stop 2024-09-17T07:24:09.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.448+0000 7fae7009c640 1 -- 172.21.15.87:0/337387373 shutdown_connections 2024-09-17T07:24:09.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.448+0000 7fae7009c640 1 --2- 172.21.15.87:0/337387373 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae680fe4f0 0x7fae6810d5a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:09.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.448+0000 7fae7009c640 1 --2- 172.21.15.87:0/337387373 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fae5406cb90 0x7fae5406f040 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:09.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.448+0000 7fae7009c640 1 --2- 172.21.15.87:0/337387373 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fae680fdba0 0x7fae6810d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:09.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.448+0000 7fae7009c640 1 -- 172.21.15.87:0/337387373 >> 172.21.15.87:0/337387373 conn(0x7fae680f63a0 msgr2=0x7fae680f7f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:24:09.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.448+0000 7fae7009c640 1 -- 172.21.15.87:0/337387373 shutdown_connections 2024-09-17T07:24:09.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.448+0000 7fae7009c640 1 -- 172.21.15.87:0/337387373 wait complete. 2024-09-17T07:24:09.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.528+0000 7f5007f9f640 1 -- 172.21.15.87:0/3222883952 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50000fc520 msgr2=0x7f50000fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:24:09.530 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.529+0000 7f5007f9f640 1 --2- 172.21.15.87:0/3222883952 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50000fc520 0x7f50000fc930 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc0048d0 tx=0x7f4ffc009da0 comp rx=0 tx=0).stop 2024-09-17T07:24:09.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.529+0000 7f5007f9f640 1 -- 172.21.15.87:0/3222883952 shutdown_connections 2024-09-17T07:24:09.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.529+0000 7f5007f9f640 1 --2- 172.21.15.87:0/3222883952 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f50000fd7f0 0x7f50000fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:09.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.529+0000 7f5007f9f640 1 --2- 172.21.15.87:0/3222883952 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50000fc520 0x7f50000fc930 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:09.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.529+0000 7f5007f9f640 1 -- 172.21.15.87:0/3222883952 >> 172.21.15.87:0/3222883952 conn(0x7f50000f7ce0 msgr2=0x7f50000fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:24:09.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.529+0000 7f5007f9f640 1 -- 172.21.15.87:0/3222883952 shutdown_connections 2024-09-17T07:24:09.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.529+0000 7f5007f9f640 1 -- 172.21.15.87:0/3222883952 wait complete. 2024-09-17T07:24:09.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.529+0000 7f5007f9f640 1 Processor -- start 2024-09-17T07:24:09.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.529+0000 7f5007f9f640 1 -- start start 2024-09-17T07:24:09.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.529+0000 7f5007f9f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50000fc520 0x7f5000071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:24:09.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.529+0000 7f5007f9f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f50000fd7f0 0x7f500006fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:24:09.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.529+0000 7f5007f9f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f500006fff0 con 0x7f50000fc520 2024-09-17T07:24:09.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.529+0000 7f5007f9f640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5000070130 con 0x7f50000fd7f0 2024-09-17T07:24:09.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.530+0000 7f5005d3b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50000fc520 0x7f5000071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:24:09.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.530+0000 7f5005d3b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50000fc520 0x7f5000071570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42078/0 (socket says 172.21.15.87:42078) 2024-09-17T07:24:09.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.530+0000 7f5005d3b640 1 -- 172.21.15.87:0/1939863695 learned_addr learned my addr 172.21.15.87:0/1939863695 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:24:09.532 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.530+0000 7f500553a640 1 --2- 172.21.15.87:0/1939863695 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f50000fd7f0 0x7f500006fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:24:09.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.530+0000 7f5005d3b640 1 -- 172.21.15.87:0/1939863695 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f50000fd7f0 msgr2=0x7f500006fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:24:09.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.530+0000 7f5005d3b640 1 --2- 172.21.15.87:0/1939863695 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f50000fd7f0 0x7f500006fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:09.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.530+0000 7f5005d3b640 1 -- 172.21.15.87:0/1939863695 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ffc005040 con 0x7f50000fc520 2024-09-17T07:24:09.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.530+0000 7f5005d3b640 1 --2- 172.21.15.87:0/1939863695 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50000fc520 0x7f5000071570 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc00b020 tx=0x7f4ffc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:24:09.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.530+0000 7f4ff67fc640 1 -- 172.21.15.87:0/1939863695 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ffc038070 con 0x7f50000fc520 2024-09-17T07:24:09.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.530+0000 7f5007f9f640 1 -- 172.21.15.87:0/1939863695 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50000703b0 con 0x7f50000fc520 2024-09-17T07:24:09.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.530+0000 7f4ff67fc640 1 -- 172.21.15.87:0/1939863695 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f4ffc02ae70 con 0x7f50000fc520 2024-09-17T07:24:09.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.530+0000 7f4ff67fc640 1 -- 172.21.15.87:0/1939863695 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ffc03d420 con 0x7f50000fc520 2024-09-17T07:24:09.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.530+0000 7f5007f9f640 1 -- 172.21.15.87:0/1939863695 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5000115040 con 0x7f50000fc520 2024-09-17T07:24:09.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.531+0000 7f5007f9f640 1 -- 172.21.15.87:0/1939863695 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f500004b720 con 0x7f50000fc520 2024-09-17T07:24:09.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.532+0000 7f4ff67fc640 1 -- 172.21.15.87:0/1939863695 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f4ffc030020 con 0x7f50000fc520 2024-09-17T07:24:09.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.533+0000 7f4ff67fc640 1 --2- 172.21.15.87:0/1939863695 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f4fec06cb90 0x7f4fec06f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:24:09.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.533+0000 7f4ff67fc640 1 -- 172.21.15.87:0/1939863695 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f4ffc0ac7c0 con 0x7f50000fc520 2024-09-17T07:24:09.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.533+0000 7f500553a640 1 --2- 172.21.15.87:0/1939863695 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f4fec06cb90 0x7f4fec06f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:24:09.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.533+0000 7f500553a640 1 --2- 172.21.15.87:0/1939863695 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f4fec06cb90 0x7f4fec06f040 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4ff00041d0 tx=0x7f4ff0009040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:24:09.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.537+0000 7f4ff67fc640 1 -- 172.21.15.87:0/1939863695 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f4ffc0767d0 con 0x7f50000fc520 2024-09-17T07:24:09.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:09 smithi139 ceph-mon[79872]: pgmap v78: 65 pgs: 65 active+clean; 322 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:24:09.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:09 smithi139 ceph-mon[79872]: from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:24:09.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:09 smithi139 ceph-mon[79872]: from='client.? 172.21.15.87:0/2976057885' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:24:09.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.726+0000 7f5007f9f640 1 -- 172.21.15.87:0/1939863695 --> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5000070540 con 0x7f4fec06cb90 2024-09-17T07:24:09.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.727+0000 7f4ff67fc640 1 -- 172.21.15.87:0/1939863695 <== mgr.24529 v2:172.21.15.87:6800/1359413180 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f5000070540 con 0x7f4fec06cb90 2024-09-17T07:24:09.728 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T07:24:09.728 INFO:teuthology.orchestra.run.smithi087.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9", 2024-09-17T07:24:09.728 INFO:teuthology.orchestra.run.smithi087.stdout: "in_progress": true, 2024-09-17T07:24:09.729 INFO:teuthology.orchestra.run.smithi087.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T07:24:09.729 INFO:teuthology.orchestra.run.smithi087.stdout: "services_complete": [ 2024-09-17T07:24:09.729 INFO:teuthology.orchestra.run.smithi087.stdout: "crash", 2024-09-17T07:24:09.729 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr", 2024-09-17T07:24:09.729 INFO:teuthology.orchestra.run.smithi087.stdout: "mon" 2024-09-17T07:24:09.729 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-17T07:24:09.729 INFO:teuthology.orchestra.run.smithi087.stdout: "progress": "8/21 daemons upgraded", 2024-09-17T07:24:09.729 INFO:teuthology.orchestra.run.smithi087.stdout: "message": "Currently upgrading osd daemons", 2024-09-17T07:24:09.729 INFO:teuthology.orchestra.run.smithi087.stdout: "is_paused": false 2024-09-17T07:24:09.729 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T07:24:09.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.729+0000 7f5007f9f640 1 -- 172.21.15.87:0/1939863695 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f4fec06cb90 msgr2=0x7f4fec06f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:24:09.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.729+0000 7f5007f9f640 1 --2- 172.21.15.87:0/1939863695 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f4fec06cb90 0x7f4fec06f040 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4ff00041d0 tx=0x7f4ff0009040 comp rx=0 tx=0).stop 2024-09-17T07:24:09.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.729+0000 7f5007f9f640 1 -- 172.21.15.87:0/1939863695 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50000fc520 msgr2=0x7f5000071570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:24:09.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.729+0000 7f5007f9f640 1 --2- 172.21.15.87:0/1939863695 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50000fc520 0x7f5000071570 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc00b020 tx=0x7f4ffc009da0 comp rx=0 tx=0).stop 2024-09-17T07:24:09.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.730+0000 7f5007f9f640 1 -- 172.21.15.87:0/1939863695 shutdown_connections 2024-09-17T07:24:09.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.730+0000 7f5007f9f640 1 --2- 172.21.15.87:0/1939863695 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f4fec06cb90 0x7f4fec06f040 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:09.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.730+0000 7f5007f9f640 1 --2- 172.21.15.87:0/1939863695 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f50000fd7f0 0x7f500006fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:09.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.730+0000 7f5007f9f640 1 --2- 172.21.15.87:0/1939863695 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50000fc520 0x7f5000071570 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:09.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.730+0000 7f5007f9f640 1 -- 172.21.15.87:0/1939863695 >> 172.21.15.87:0/1939863695 conn(0x7f50000f7ce0 msgr2=0x7f50000f9610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:24:09.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.730+0000 7f5007f9f640 1 -- 172.21.15.87:0/1939863695 shutdown_connections 2024-09-17T07:24:09.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.730+0000 7f5007f9f640 1 -- 172.21.15.87:0/1939863695 wait complete. 2024-09-17T07:24:09.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.810+0000 7fc89d257640 1 -- 172.21.15.87:0/2681240313 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc8980fc700 msgr2=0x7fc8980fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:24:09.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.810+0000 7fc89d257640 1 --2- 172.21.15.87:0/2681240313 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc8980fc700 0x7fc8980fcb70 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc88c0048d0 tx=0x7fc88c009da0 comp rx=0 tx=0).stop 2024-09-17T07:24:09.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.810+0000 7fc89d257640 1 -- 172.21.15.87:0/2681240313 shutdown_connections 2024-09-17T07:24:09.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.810+0000 7fc89d257640 1 --2- 172.21.15.87:0/2681240313 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc8980fc700 0x7fc8980fcb70 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:09.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.810+0000 7fc89d257640 1 --2- 172.21.15.87:0/2681240313 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc8980fb430 0x7fc8980fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:09.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.810+0000 7fc89d257640 1 -- 172.21.15.87:0/2681240313 >> 172.21.15.87:0/2681240313 conn(0x7fc8980f6c10 msgr2=0x7fc8980f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:24:09.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.810+0000 7fc89d257640 1 -- 172.21.15.87:0/2681240313 shutdown_connections 2024-09-17T07:24:09.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.810+0000 7fc89d257640 1 -- 172.21.15.87:0/2681240313 wait complete. 2024-09-17T07:24:09.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.811+0000 7fc89d257640 1 Processor -- start 2024-09-17T07:24:09.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.811+0000 7fc89d257640 1 -- start start 2024-09-17T07:24:09.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.811+0000 7fc89d257640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc8980fb430 0x7fc898065b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:24:09.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.811+0000 7fc89d257640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc8980fc700 0x7fc898111d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:24:09.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.811+0000 7fc89d257640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc898112360 con 0x7fc8980fb430 2024-09-17T07:24:09.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.811+0000 7fc89d257640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8981124a0 con 0x7fc8980fc700 2024-09-17T07:24:09.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.811+0000 7fc896d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc8980fb430 0x7fc898065b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:24:09.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.811+0000 7fc896d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc8980fb430 0x7fc898065b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42092/0 (socket says 172.21.15.87:42092) 2024-09-17T07:24:09.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.811+0000 7fc896d9d640 1 -- 172.21.15.87:0/65763508 learned_addr learned my addr 172.21.15.87:0/65763508 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:24:09.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.811+0000 7fc89659c640 1 --2- 172.21.15.87:0/65763508 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc8980fc700 0x7fc898111d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:24:09.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.811+0000 7fc896d9d640 1 -- 172.21.15.87:0/65763508 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc8980fc700 msgr2=0x7fc898111d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:24:09.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.811+0000 7fc896d9d640 1 --2- 172.21.15.87:0/65763508 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc8980fc700 0x7fc898111d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:09.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.811+0000 7fc896d9d640 1 -- 172.21.15.87:0/65763508 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc88c005040 con 0x7fc8980fb430 2024-09-17T07:24:09.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.811+0000 7fc89659c640 1 --2- 172.21.15.87:0/65763508 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc8980fc700 0x7fc898111d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T07:24:09.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.812+0000 7fc896d9d640 1 --2- 172.21.15.87:0/65763508 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc8980fb430 0x7fc898065b50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc888002a50 tx=0x7fc888004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:24:09.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.812+0000 7fc87f7fe640 1 -- 172.21.15.87:0/65763508 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc888007c30 con 0x7fc8980fb430 2024-09-17T07:24:09.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.812+0000 7fc87f7fe640 1 -- 172.21.15.87:0/65763508 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fc88800f040 con 0x7fc8980fb430 2024-09-17T07:24:09.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.812+0000 7fc87f7fe640 1 -- 172.21.15.87:0/65763508 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc88800dab0 con 0x7fc8980fb430 2024-09-17T07:24:09.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.812+0000 7fc89d257640 1 -- 172.21.15.87:0/65763508 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc898112780 con 0x7fc8980fb430 2024-09-17T07:24:09.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.812+0000 7fc89d257640 1 -- 172.21.15.87:0/65763508 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc898112d20 con 0x7fc8980fb430 2024-09-17T07:24:09.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.813+0000 7fc89d257640 1 -- 172.21.15.87:0/65763508 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc89804b720 con 0x7fc8980fb430 2024-09-17T07:24:09.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.813+0000 7fc87f7fe640 1 -- 172.21.15.87:0/65763508 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fc88800dc10 con 0x7fc8980fb430 2024-09-17T07:24:09.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.814+0000 7fc87f7fe640 1 --2- 172.21.15.87:0/65763508 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fc88006cb90 0x7fc88006f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:24:09.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.814+0000 7fc87f7fe640 1 -- 172.21.15.87:0/65763508 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fc88808c030 con 0x7fc8980fb430 2024-09-17T07:24:09.816 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.814+0000 7fc89659c640 1 --2- 172.21.15.87:0/65763508 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fc88006cb90 0x7fc88006f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:24:09.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.814+0000 7fc89659c640 1 --2- 172.21.15.87:0/65763508 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fc88006cb90 0x7fc88006f040 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc88c00b020 tx=0x7fc88c035040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:24:09.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:09.818+0000 7fc87f7fe640 1 -- 172.21.15.87:0/65763508 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc888056040 con 0x7fc8980fb430 2024-09-17T07:24:10.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:10.076+0000 7fc89d257640 1 -- 172.21.15.87:0/65763508 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fc89802aa40 con 0x7fc8980fb430 2024-09-17T07:24:10.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:10.077+0000 7fc87f7fe640 1 -- 172.21.15.87:0/65763508 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fc888059660 con 0x7fc8980fb430 2024-09-17T07:24:10.079 INFO:journalctl@ceph.osd.2.smithi087.stdout:Sep 17 07:24:09 smithi087 systemd[1]: Stopping Ceph osd.2 for d5dbf8d6-74c3-11ef-bceb-c7b262605968... 2024-09-17T07:24:10.079 INFO:teuthology.orchestra.run.smithi087.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T07:24:10.079 INFO:teuthology.orchestra.run.smithi087.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T07:24:10.079 INFO:teuthology.orchestra.run.smithi087.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T07:24:10.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:10.079+0000 7fc89d257640 1 -- 172.21.15.87:0/65763508 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fc88006cb90 msgr2=0x7fc88006f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:24:10.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:10.079+0000 7fc89d257640 1 --2- 172.21.15.87:0/65763508 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fc88006cb90 0x7fc88006f040 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc88c00b020 tx=0x7fc88c035040 comp rx=0 tx=0).stop 2024-09-17T07:24:10.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:10.079+0000 7fc89d257640 1 -- 172.21.15.87:0/65763508 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc8980fb430 msgr2=0x7fc898065b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:24:10.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:10.079+0000 7fc89d257640 1 --2- 172.21.15.87:0/65763508 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc8980fb430 0x7fc898065b50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc888002a50 tx=0x7fc888004600 comp rx=0 tx=0).stop 2024-09-17T07:24:10.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:10.079+0000 7fc89d257640 1 -- 172.21.15.87:0/65763508 shutdown_connections 2024-09-17T07:24:10.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:10.079+0000 7fc89d257640 1 --2- 172.21.15.87:0/65763508 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fc88006cb90 0x7fc88006f040 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:10.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:10.079+0000 7fc89d257640 1 --2- 172.21.15.87:0/65763508 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc8980fc700 0x7fc898111d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:10.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:10.079+0000 7fc89d257640 1 --2- 172.21.15.87:0/65763508 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc8980fb430 0x7fc898065b50 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:10.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:10.079+0000 7fc89d257640 1 -- 172.21.15.87:0/65763508 >> 172.21.15.87:0/65763508 conn(0x7fc8980f6c10 msgr2=0x7fc8980ffa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:24:10.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:10.080+0000 7fc89d257640 1 -- 172.21.15.87:0/65763508 shutdown_connections 2024-09-17T07:24:10.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:10.080+0000 7fc89d257640 1 -- 172.21.15.87:0/65763508 wait complete. 2024-09-17T07:24:10.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:10 smithi087 ceph-mon[90982]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:24:10.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:10 smithi087 ceph-mon[90982]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:24:10.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:10 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/337387373' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T07:24:10.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:10 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/65763508' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T07:24:10.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:10 smithi087 ceph-mon[90982]: osd.2 marked itself down and dead 2024-09-17T07:24:10.427 INFO:journalctl@ceph.osd.2.smithi087.stdout:Sep 17 07:24:10 smithi087 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-2[59990]: 2024-09-17T07:24:10.199+0000 7fdd2ba09640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T07:24:10.427 INFO:journalctl@ceph.osd.2.smithi087.stdout:Sep 17 07:24:10 smithi087 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-2[59990]: 2024-09-17T07:24:10.199+0000 7fdd2ba09640 -1 osd.2 57 *** Got signal Terminated *** 2024-09-17T07:24:10.427 INFO:journalctl@ceph.osd.2.smithi087.stdout:Sep 17 07:24:10 smithi087 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-2[59990]: 2024-09-17T07:24:10.199+0000 7fdd2ba09640 -1 osd.2 57 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T07:24:10.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:10 smithi139 ceph-mon[79872]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:24:10.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:10 smithi139 ceph-mon[79872]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:24:10.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:10 smithi139 ceph-mon[79872]: from='client.? 172.21.15.87:0/337387373' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T07:24:10.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:10 smithi139 ceph-mon[79872]: from='client.? 172.21.15.87:0/65763508' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T07:24:10.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:10 smithi139 ceph-mon[79872]: osd.2 marked itself down and dead 2024-09-17T07:24:11.094 INFO:journalctl@ceph.osd.2.smithi087.stdout:Sep 17 07:24:10 smithi087 podman[110623]: 2024-09-17 07:24:10.773561318 +0000 UTC m=+0.729695171 container died 8fe1428a687896f484045e7784901d53a323e29275e026a5c1c26322289e8605 (image=quay.ceph.io/ceph-ci/ceph@sha256:c5428a59091f5674ce6e26540d9db0f28844a507e2a324b8305a00f1687ce028, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=quincy-4a70413, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-17T07:24:11.393 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:11 smithi087 ceph-mon[90982]: from='client.34272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:24:11.393 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:11 smithi087 ceph-mon[90982]: pgmap v79: 65 pgs: 65 active+clean; 322 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:24:11.393 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:11 smithi087 ceph-mon[90982]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T07:24:11.393 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:11 smithi087 ceph-mon[90982]: osdmap e58: 6 total, 5 up, 6 in 2024-09-17T07:24:11.393 INFO:journalctl@ceph.osd.2.smithi087.stdout:Sep 17 07:24:11 smithi087 podman[110623]: 2024-09-17 07:24:11.183169861 +0000 UTC m=+1.139303698 container cleanup 8fe1428a687896f484045e7784901d53a323e29275e026a5c1c26322289e8605 (image=quay.ceph.io/ceph-ci/ceph@sha256:c5428a59091f5674ce6e26540d9db0f28844a507e2a324b8305a00f1687ce028, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-2, RELEASE=quincy-4a70413, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-17T07:24:11.393 INFO:journalctl@ceph.osd.2.smithi087.stdout:Sep 17 07:24:11 smithi087 bash[110623]: ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-2 2024-09-17T07:24:11.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:11 smithi139 ceph-mon[79872]: from='client.34272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:24:11.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:11 smithi139 ceph-mon[79872]: pgmap v79: 65 pgs: 65 active+clean; 322 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:24:11.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:11 smithi139 ceph-mon[79872]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T07:24:11.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:11 smithi139 ceph-mon[79872]: osdmap e58: 6 total, 5 up, 6 in 2024-09-17T07:24:11.676 INFO:journalctl@ceph.osd.2.smithi087.stdout:Sep 17 07:24:11 smithi087 podman[110643]: 2024-09-17 07:24:11.392950645 +0000 UTC m=+0.621410230 container remove 8fe1428a687896f484045e7784901d53a323e29275e026a5c1c26322289e8605 (image=quay.ceph.io/ceph-ci/ceph@sha256:c5428a59091f5674ce6e26540d9db0f28844a507e2a324b8305a00f1687ce028, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=quincy-4a70413, GIT_BRANCH=HEAD) 2024-09-17T07:24:12.046 INFO:journalctl@ceph.osd.2.smithi087.stdout:Sep 17 07:24:11 smithi087 podman[110732]: 2024-09-17 07:24:11.696476142 +0000 UTC m=+0.015984272 image pull 980a0bfcd684674f25c08d857ad8de3b1c8ae738870529edbf9aa463832c8d89 quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9 2024-09-17T07:24:12.046 INFO:journalctl@ceph.osd.2.smithi087.stdout:Sep 17 07:24:11 smithi087 podman[110732]: 2024-09-17 07:24:11.802304595 +0000 UTC m=+0.121812750 container create 400399305a74f42da8d665c3774587092cf808e9f3e31dd1ce9fdd5fc3681f35 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, RELEASE=reef-19e2a2b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T07:24:12.046 INFO:journalctl@ceph.osd.2.smithi087.stdout:Sep 17 07:24:12 smithi087 podman[110732]: 2024-09-17 07:24:12.046618582 +0000 UTC m=+0.366126704 container init 400399305a74f42da8d665c3774587092cf808e9f3e31dd1ce9fdd5fc3681f35 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=reef-19e2a2b, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-17T07:24:12.313 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:12 smithi087 ceph-mon[90982]: osdmap e59: 6 total, 5 up, 6 in 2024-09-17T07:24:12.314 INFO:journalctl@ceph.osd.2.smithi087.stdout:Sep 17 07:24:12 smithi087 podman[110732]: 2024-09-17 07:24:12.049856002 +0000 UTC m=+0.369364126 container start 400399305a74f42da8d665c3774587092cf808e9f3e31dd1ce9fdd5fc3681f35 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-2-deactivate, RELEASE=reef-19e2a2b, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-17T07:24:12.314 INFO:journalctl@ceph.osd.2.smithi087.stdout:Sep 17 07:24:12 smithi087 podman[110732]: 2024-09-17 07:24:12.121555257 +0000 UTC m=+0.441063383 container attach 400399305a74f42da8d665c3774587092cf808e9f3e31dd1ce9fdd5fc3681f35 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, RELEASE=reef-19e2a2b, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-17T07:24:12.314 INFO:journalctl@ceph.osd.2.smithi087.stdout:Sep 17 07:24:12 smithi087 podman[110732]: 2024-09-17 07:24:12.231273889 +0000 UTC m=+0.550782009 container died 400399305a74f42da8d665c3774587092cf808e9f3e31dd1ce9fdd5fc3681f35 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , RELEASE=reef-19e2a2b, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-17T07:24:12.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:12 smithi139 ceph-mon[79872]: osdmap e59: 6 total, 5 up, 6 in 2024-09-17T07:24:13.176 INFO:journalctl@ceph.osd.2.smithi087.stdout:Sep 17 07:24:12 smithi087 podman[110754]: 2024-09-17 07:24:12.941681375 +0000 UTC m=+0.703924104 container remove 400399305a74f42da8d665c3774587092cf808e9f3e31dd1ce9fdd5fc3681f35 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=reef-19e2a2b, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-17T07:24:13.177 INFO:journalctl@ceph.osd.2.smithi087.stdout:Sep 17 07:24:12 smithi087 systemd[1]: ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968@osd.2.service: Deactivated successfully. 2024-09-17T07:24:13.177 INFO:journalctl@ceph.osd.2.smithi087.stdout:Sep 17 07:24:12 smithi087 systemd[1]: Stopped Ceph osd.2 for d5dbf8d6-74c3-11ef-bceb-c7b262605968. 2024-09-17T07:24:13.177 INFO:journalctl@ceph.osd.2.smithi087.stdout:Sep 17 07:24:12 smithi087 systemd[1]: ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968@osd.2.service: Consumed 40.619s CPU time. 2024-09-17T07:24:13.505 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:13 smithi087 ceph-mon[90982]: pgmap v82: 65 pgs: 9 stale+active+clean, 56 active+clean; 322 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T07:24:13.505 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:13 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:24:13.505 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:13 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:24:13.506 INFO:journalctl@ceph.osd.2.smithi087.stdout:Sep 17 07:24:13 smithi087 systemd[1]: Starting Ceph osd.2 for d5dbf8d6-74c3-11ef-bceb-c7b262605968... 2024-09-17T07:24:13.506 INFO:journalctl@ceph.osd.2.smithi087.stdout:Sep 17 07:24:13 smithi087 podman[110854]: 2024-09-17 07:24:13.296816801 +0000 UTC m=+0.015698103 image pull 980a0bfcd684674f25c08d857ad8de3b1c8ae738870529edbf9aa463832c8d89 quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9 2024-09-17T07:24:13.506 INFO:journalctl@ceph.osd.2.smithi087.stdout:Sep 17 07:24:13 smithi087 podman[110854]: 2024-09-17 07:24:13.418509047 +0000 UTC m=+0.137390334 container create 00b34258b487458878ff66c099e02a3b27af73d6ecbf0ce7bf7c3adc8e58354e (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-2-activate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=reef-19e2a2b, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-17T07:24:13.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:13 smithi139 ceph-mon[79872]: pgmap v82: 65 pgs: 9 stale+active+clean, 56 active+clean; 322 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T07:24:13.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:13 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:24:13.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:13 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:24:13.926 INFO:journalctl@ceph.osd.2.smithi087.stdout:Sep 17 07:24:13 smithi087 podman[110854]: 2024-09-17 07:24:13.646304136 +0000 UTC m=+0.365185432 container init 00b34258b487458878ff66c099e02a3b27af73d6ecbf0ce7bf7c3adc8e58354e (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-2-activate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=reef-19e2a2b, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T07:24:13.926 INFO:journalctl@ceph.osd.2.smithi087.stdout:Sep 17 07:24:13 smithi087 podman[110854]: 2024-09-17 07:24:13.649583163 +0000 UTC m=+0.368464454 container start 00b34258b487458878ff66c099e02a3b27af73d6ecbf0ce7bf7c3adc8e58354e (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-2-activate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=reef-19e2a2b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-17T07:24:13.926 INFO:journalctl@ceph.osd.2.smithi087.stdout:Sep 17 07:24:13 smithi087 podman[110854]: 2024-09-17 07:24:13.73783422 +0000 UTC m=+0.456715517 container attach 00b34258b487458878ff66c099e02a3b27af73d6ecbf0ce7bf7c3adc8e58354e (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-2-activate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, RELEASE=reef-19e2a2b, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-17T07:24:14.290 INFO:journalctl@ceph.osd.2.smithi087.stdout:Sep 17 07:24:13 smithi087 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-2-activate[110869]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-17T07:24:14.290 INFO:journalctl@ceph.osd.2.smithi087.stdout:Sep 17 07:24:13 smithi087 bash[110854]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-17T07:24:14.290 INFO:journalctl@ceph.osd.2.smithi087.stdout:Sep 17 07:24:13 smithi087 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-2-activate[110869]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-17T07:24:14.290 INFO:journalctl@ceph.osd.2.smithi087.stdout:Sep 17 07:24:13 smithi087 bash[110854]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-17T07:24:14.290 INFO:journalctl@ceph.osd.2.smithi087.stdout:Sep 17 07:24:13 smithi087 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-2-activate[110869]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-17T07:24:14.290 INFO:journalctl@ceph.osd.2.smithi087.stdout:Sep 17 07:24:13 smithi087 bash[110854]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-17T07:24:14.290 INFO:journalctl@ceph.osd.2.smithi087.stdout:Sep 17 07:24:13 smithi087 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-2-activate[110869]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-17T07:24:14.290 INFO:journalctl@ceph.osd.2.smithi087.stdout:Sep 17 07:24:13 smithi087 bash[110854]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-17T07:24:14.290 INFO:journalctl@ceph.osd.2.smithi087.stdout:Sep 17 07:24:13 smithi087 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-2-activate[110869]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-17T07:24:14.290 INFO:journalctl@ceph.osd.2.smithi087.stdout:Sep 17 07:24:13 smithi087 bash[110854]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-17T07:24:14.291 INFO:journalctl@ceph.osd.2.smithi087.stdout:Sep 17 07:24:13 smithi087 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-2-activate[110869]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-17T07:24:14.291 INFO:journalctl@ceph.osd.2.smithi087.stdout:Sep 17 07:24:13 smithi087 bash[110854]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-17T07:24:14.291 INFO:journalctl@ceph.osd.2.smithi087.stdout:Sep 17 07:24:13 smithi087 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-2-activate[110869]: --> ceph-volume raw activate successful for osd ID: 2 2024-09-17T07:24:14.291 INFO:journalctl@ceph.osd.2.smithi087.stdout:Sep 17 07:24:13 smithi087 bash[110854]: --> ceph-volume raw activate successful for osd ID: 2 2024-09-17T07:24:14.291 INFO:journalctl@ceph.osd.2.smithi087.stdout:Sep 17 07:24:13 smithi087 podman[110854]: 2024-09-17 07:24:13.995055117 +0000 UTC m=+0.713936407 container died 00b34258b487458878ff66c099e02a3b27af73d6ecbf0ce7bf7c3adc8e58354e (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-2-activate, org.label-schema.vendor=CentOS, RELEASE=reef-19e2a2b, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-17T07:24:14.608 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:14 smithi087 ceph-mon[90982]: Health check failed: Degraded data redundancy: 30/369 objects degraded (8.130%), 9 pgs degraded (PG_DEGRADED) 2024-09-17T07:24:14.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:14 smithi139 ceph-mon[79872]: Health check failed: Degraded data redundancy: 30/369 objects degraded (8.130%), 9 pgs degraded (PG_DEGRADED) 2024-09-17T07:24:14.926 INFO:journalctl@ceph.osd.2.smithi087.stdout:Sep 17 07:24:14 smithi087 podman[111005]: 2024-09-17 07:24:14.608373222 +0000 UTC m=+0.607368404 container remove 00b34258b487458878ff66c099e02a3b27af73d6ecbf0ce7bf7c3adc8e58354e (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-2-activate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=reef-19e2a2b, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-17T07:24:14.926 INFO:journalctl@ceph.osd.2.smithi087.stdout:Sep 17 07:24:14 smithi087 podman[111063]: 2024-09-17 07:24:14.716062404 +0000 UTC m=+0.016235190 image pull 980a0bfcd684674f25c08d857ad8de3b1c8ae738870529edbf9aa463832c8d89 quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9 2024-09-17T07:24:14.926 INFO:journalctl@ceph.osd.2.smithi087.stdout:Sep 17 07:24:14 smithi087 podman[111063]: 2024-09-17 07:24:14.81747136 +0000 UTC m=+0.117644139 container create 240cfb3b536678c7f7d5ef4666f84bd3f15ea51e26acd9200c3d83ef7722b744 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=reef-19e2a2b, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-17T07:24:15.291 INFO:journalctl@ceph.osd.2.smithi087.stdout:Sep 17 07:24:15 smithi087 podman[111063]: 2024-09-17 07:24:15.061682745 +0000 UTC m=+0.361855529 container init 240cfb3b536678c7f7d5ef4666f84bd3f15ea51e26acd9200c3d83ef7722b744 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=reef-19e2a2b, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T07:24:15.291 INFO:journalctl@ceph.osd.2.smithi087.stdout:Sep 17 07:24:15 smithi087 podman[111063]: 2024-09-17 07:24:15.064850206 +0000 UTC m=+0.365022980 container start 240cfb3b536678c7f7d5ef4666f84bd3f15ea51e26acd9200c3d83ef7722b744 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-2, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=reef-19e2a2b, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T07:24:15.291 INFO:journalctl@ceph.osd.2.smithi087.stdout:Sep 17 07:24:15 smithi087 ceph-osd[111082]: -- 172.21.15.87:0/1145523766 <== mon.0 v2:172.21.15.87:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55e83309d1e0 con 0x55e83303bc00 2024-09-17T07:24:15.291 INFO:journalctl@ceph.osd.2.smithi087.stdout:Sep 17 07:24:15 smithi087 bash[111063]: 240cfb3b536678c7f7d5ef4666f84bd3f15ea51e26acd9200c3d83ef7722b744 2024-09-17T07:24:15.291 INFO:journalctl@ceph.osd.2.smithi087.stdout:Sep 17 07:24:15 smithi087 systemd[1]: Started Ceph osd.2 for d5dbf8d6-74c3-11ef-bceb-c7b262605968. 2024-09-17T07:24:15.608 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:15 smithi087 ceph-mon[90982]: pgmap v83: 65 pgs: 10 active+undersized, 3 stale+active+clean, 9 active+undersized+degraded, 43 active+clean; 322 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 30/369 objects degraded (8.130%) 2024-09-17T07:24:15.608 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:15 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:24:15.608 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:15 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:24:15.608 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:15 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:24:15.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:15 smithi139 ceph-mon[79872]: pgmap v83: 65 pgs: 10 active+undersized, 3 stale+active+clean, 9 active+undersized+degraded, 43 active+clean; 322 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 30/369 objects degraded (8.130%) 2024-09-17T07:24:15.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:15 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:24:15.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:15 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:24:15.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:15 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:24:15.926 INFO:journalctl@ceph.osd.2.smithi087.stdout:Sep 17 07:24:15 smithi087 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-2[111078]: 2024-09-17T07:24:15.606+0000 7fd4c3a0d640 -1 Falling back to public interface 2024-09-17T07:24:17.605 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:17 smithi087 ceph-mon[90982]: pgmap v84: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 322 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 44/369 objects degraded (11.924%) 2024-09-17T07:24:17.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:17 smithi139 ceph-mon[79872]: pgmap v84: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 322 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 44/369 objects degraded (11.924%) 2024-09-17T07:24:19.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:19 smithi139 ceph-mon[79872]: pgmap v85: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 322 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 44/369 objects degraded (11.924%) 2024-09-17T07:24:19.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:19 smithi087 ceph-mon[90982]: pgmap v85: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 322 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 44/369 objects degraded (11.924%) 2024-09-17T07:24:20.032 INFO:journalctl@ceph.osd.2.smithi087.stdout:Sep 17 07:24:19 smithi087 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-2[111078]: 2024-09-17T07:24:19.737+0000 7fd4c3a0d640 -1 osd.2 57 log_to_monitors true 2024-09-17T07:24:20.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:20 smithi139 ceph-mon[79872]: from='osd.2 [v2:172.21.15.87:6818/3151708554,v1:172.21.15.87:6819/3151708554]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-17T07:24:20.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:20 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:24:20.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:20 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:24:20.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:20 smithi087 ceph-mon[90982]: from='osd.2 [v2:172.21.15.87:6818/3151708554,v1:172.21.15.87:6819/3151708554]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-17T07:24:20.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:20 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:24:20.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:20 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:24:21.422 INFO:journalctl@ceph.osd.2.smithi087.stdout:Sep 17 07:24:21 smithi087 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-2[111078]: 2024-09-17T07:24:21.152+0000 7fd4b779e640 -1 osd.2 57 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T07:24:21.422 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:21 smithi087 ceph-mon[90982]: pgmap v86: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 322 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 44/369 objects degraded (11.924%) 2024-09-17T07:24:21.422 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:21 smithi087 ceph-mon[90982]: from='osd.2 [v2:172.21.15.87:6818/3151708554,v1:172.21.15.87:6819/3151708554]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-17T07:24:21.422 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:21 smithi087 ceph-mon[90982]: osdmap e60: 6 total, 5 up, 6 in 2024-09-17T07:24:21.423 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:21 smithi087 ceph-mon[90982]: from='osd.2 [v2:172.21.15.87:6818/3151708554,v1:172.21.15.87:6819/3151708554]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-09-17T07:24:21.423 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:21 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:24:21.423 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:21 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:24:21.423 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:21 smithi087 ceph-mon[90982]: from='osd.2 [v2:172.21.15.87:6818/3151708554,v1:172.21.15.87:6819/3151708554]' entity='osd.2' 2024-09-17T07:24:21.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:21 smithi139 ceph-mon[79872]: pgmap v86: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 322 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 44/369 objects degraded (11.924%) 2024-09-17T07:24:21.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:21 smithi139 ceph-mon[79872]: from='osd.2 [v2:172.21.15.87:6818/3151708554,v1:172.21.15.87:6819/3151708554]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-17T07:24:21.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:21 smithi139 ceph-mon[79872]: osdmap e60: 6 total, 5 up, 6 in 2024-09-17T07:24:21.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:21 smithi139 ceph-mon[79872]: from='osd.2 [v2:172.21.15.87:6818/3151708554,v1:172.21.15.87:6819/3151708554]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi087", "root=default"]}]: dispatch 2024-09-17T07:24:21.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:21 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:24:21.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:21 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:24:21.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:21 smithi139 ceph-mon[79872]: from='osd.2 [v2:172.21.15.87:6818/3151708554,v1:172.21.15.87:6819/3151708554]' entity='osd.2' 2024-09-17T07:24:22.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:22 smithi139 ceph-mon[79872]: Health check update: Degraded data redundancy: 44/369 objects degraded (11.924%), 13 pgs degraded (PG_DEGRADED) 2024-09-17T07:24:22.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:22 smithi139 ceph-mon[79872]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T07:24:22.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:22 smithi139 ceph-mon[79872]: osd.2 [v2:172.21.15.87:6818/3151708554,v1:172.21.15.87:6819/3151708554] boot 2024-09-17T07:24:22.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:22 smithi139 ceph-mon[79872]: osdmap e61: 6 total, 6 up, 6 in 2024-09-17T07:24:22.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:22 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T07:24:22.617 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:22 smithi087 ceph-mon[90982]: Health check update: Degraded data redundancy: 44/369 objects degraded (11.924%), 13 pgs degraded (PG_DEGRADED) 2024-09-17T07:24:22.617 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:22 smithi087 ceph-mon[90982]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T07:24:22.617 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:22 smithi087 ceph-mon[90982]: osd.2 [v2:172.21.15.87:6818/3151708554,v1:172.21.15.87:6819/3151708554] boot 2024-09-17T07:24:22.617 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:22 smithi087 ceph-mon[90982]: osdmap e61: 6 total, 6 up, 6 in 2024-09-17T07:24:22.617 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:22 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T07:24:23.505 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:23 smithi087 ceph-mon[90982]: pgmap v88: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 322 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 44/369 objects degraded (11.924%) 2024-09-17T07:24:23.505 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:23 smithi087 ceph-mon[90982]: osdmap e62: 6 total, 6 up, 6 in 2024-09-17T07:24:23.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:23 smithi139 ceph-mon[79872]: pgmap v88: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 322 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 44/369 objects degraded (11.924%) 2024-09-17T07:24:23.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:23 smithi139 ceph-mon[79872]: osdmap e62: 6 total, 6 up, 6 in 2024-09-17T07:24:25.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:25 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:24:25.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:25 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:24:25.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:25 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:24:25.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:25 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:24:25.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:25 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:24:25.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:25 smithi139 ceph-mon[79872]: pgmap v91: 65 pgs: 3 peering, 7 active+undersized, 7 active+undersized+degraded, 48 active+clean; 322 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 2.8 KiB/s rd, 5 op/s; 25/369 objects degraded (6.775%) 2024-09-17T07:24:25.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:25 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:24:25.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:25 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:24:25.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:25 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:24:25.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:25 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:24:25.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:25 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-17T07:24:25.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:25 smithi139 ceph-mon[79872]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-17T07:24:25.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:25 smithi139 ceph-mon[79872]: Upgrade: unsafe to stop osd(s) at this time (6 PGs are or would become offline) 2024-09-17T07:24:25.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:25 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:24:25.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:25 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:24:25.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:25 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:24:25.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:25 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:24:25.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:25 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:24:25.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:25 smithi087 ceph-mon[90982]: pgmap v91: 65 pgs: 3 peering, 7 active+undersized, 7 active+undersized+degraded, 48 active+clean; 322 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 2.8 KiB/s rd, 5 op/s; 25/369 objects degraded (6.775%) 2024-09-17T07:24:25.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:25 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:24:25.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:25 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:24:25.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:25 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:24:25.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:25 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:24:25.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:25 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-17T07:24:25.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:25 smithi087 ceph-mon[90982]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-17T07:24:25.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:25 smithi087 ceph-mon[90982]: Upgrade: unsafe to stop osd(s) at this time (6 PGs are or would become offline) 2024-09-17T07:24:26.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:26 smithi139 ceph-mon[79872]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 25/369 objects degraded (6.775%), 7 pgs degraded) 2024-09-17T07:24:26.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:26 smithi087 ceph-mon[90982]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 25/369 objects degraded (6.775%), 7 pgs degraded) 2024-09-17T07:24:27.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:27 smithi139 ceph-mon[79872]: pgmap v92: 65 pgs: 3 peering, 62 active+clean; 322 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T07:24:27.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:27 smithi087 ceph-mon[90982]: pgmap v92: 65 pgs: 3 peering, 62 active+clean; 322 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T07:24:29.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:29 smithi139 ceph-mon[79872]: pgmap v93: 65 pgs: 65 active+clean; 322 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 921 B/s rd, 1 op/s 2024-09-17T07:24:29.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:29 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:24:29.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:29 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:24:29.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:29 smithi087 ceph-mon[90982]: pgmap v93: 65 pgs: 65 active+clean; 322 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 921 B/s rd, 1 op/s 2024-09-17T07:24:29.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:29 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:24:29.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:29 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:24:31.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:31 smithi139 ceph-mon[79872]: pgmap v94: 65 pgs: 65 active+clean; 322 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:24:31.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:31 smithi087 ceph-mon[90982]: pgmap v94: 65 pgs: 65 active+clean; 322 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:24:33.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:33 smithi139 ceph-mon[79872]: pgmap v95: 65 pgs: 65 active+clean; 322 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:24:33.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:33 smithi087 ceph-mon[90982]: pgmap v95: 65 pgs: 65 active+clean; 322 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:24:34.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:34 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:24:34.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:34 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:24:35.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:35 smithi087 ceph-mon[90982]: pgmap v96: 65 pgs: 65 active+clean; 322 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-17T07:24:35.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:35 smithi139 ceph-mon[79872]: pgmap v96: 65 pgs: 65 active+clean; 322 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-17T07:24:37.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:37 smithi087 ceph-mon[90982]: pgmap v97: 65 pgs: 65 active+clean; 322 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:24:37.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:37 smithi139 ceph-mon[79872]: pgmap v97: 65 pgs: 65 active+clean; 322 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:24:39.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:39 smithi087 ceph-mon[90982]: pgmap v98: 65 pgs: 65 active+clean; 322 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:24:39.541 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:39 smithi139 ceph-mon[79872]: pgmap v98: 65 pgs: 65 active+clean; 322 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:24:40.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.172+0000 7fe35051e640 1 -- 172.21.15.87:0/3755265974 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3480fb430 msgr2=0x7fe3480fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:24:40.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.172+0000 7fe35051e640 1 --2- 172.21.15.87:0/3755265974 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3480fb430 0x7fe3480fb840 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe33c0048d0 tx=0x7fe33c009da0 comp rx=0 tx=0).stop 2024-09-17T07:24:40.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.172+0000 7fe35051e640 1 -- 172.21.15.87:0/3755265974 shutdown_connections 2024-09-17T07:24:40.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.172+0000 7fe35051e640 1 --2- 172.21.15.87:0/3755265974 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe3480fc700 0x7fe3480fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:40.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.172+0000 7fe35051e640 1 --2- 172.21.15.87:0/3755265974 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3480fb430 0x7fe3480fb840 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:40.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.172+0000 7fe35051e640 1 -- 172.21.15.87:0/3755265974 >> 172.21.15.87:0/3755265974 conn(0x7fe3480f6c10 msgr2=0x7fe3480f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:24:40.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.172+0000 7fe35051e640 1 -- 172.21.15.87:0/3755265974 shutdown_connections 2024-09-17T07:24:40.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.172+0000 7fe35051e640 1 -- 172.21.15.87:0/3755265974 wait complete. 2024-09-17T07:24:40.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.173+0000 7fe35051e640 1 Processor -- start 2024-09-17T07:24:40.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.173+0000 7fe35051e640 1 -- start start 2024-09-17T07:24:40.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.173+0000 7fe35051e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe3480fb430 0x7fe34810bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:24:40.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.173+0000 7fe35051e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3480fc700 0x7fe34810c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:24:40.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.173+0000 7fe35051e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe34810ca30 con 0x7fe3480fc700 2024-09-17T07:24:40.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.173+0000 7fe35051e640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe34810d250 con 0x7fe3480fb430 2024-09-17T07:24:40.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.173+0000 7fe34dab9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3480fc700 0x7fe34810c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:24:40.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.173+0000 7fe34dab9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3480fc700 0x7fe34810c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45840/0 (socket says 172.21.15.87:45840) 2024-09-17T07:24:40.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.173+0000 7fe34dab9640 1 -- 172.21.15.87:0/4129778596 learned_addr learned my addr 172.21.15.87:0/4129778596 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:24:40.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.173+0000 7fe34e2ba640 1 --2- 172.21.15.87:0/4129778596 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe3480fb430 0x7fe34810bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:24:40.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.173+0000 7fe34dab9640 1 -- 172.21.15.87:0/4129778596 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe3480fb430 msgr2=0x7fe34810bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:24:40.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.173+0000 7fe34dab9640 1 --2- 172.21.15.87:0/4129778596 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe3480fb430 0x7fe34810bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:40.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.173+0000 7fe34dab9640 1 -- 172.21.15.87:0/4129778596 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe33c005040 con 0x7fe3480fc700 2024-09-17T07:24:40.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.173+0000 7fe34dab9640 1 --2- 172.21.15.87:0/4129778596 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3480fc700 0x7fe34810c3e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe34400eb70 tx=0x7fe34400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:24:40.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.174+0000 7fe33affd640 1 -- 172.21.15.87:0/4129778596 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe344007c30 con 0x7fe3480fc700 2024-09-17T07:24:40.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.174+0000 7fe33affd640 1 -- 172.21.15.87:0/4129778596 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fe34400f040 con 0x7fe3480fc700 2024-09-17T07:24:40.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.174+0000 7fe33affd640 1 -- 172.21.15.87:0/4129778596 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe344009430 con 0x7fe3480fc700 2024-09-17T07:24:40.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.174+0000 7fe35051e640 1 -- 172.21.15.87:0/4129778596 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe34810d480 con 0x7fe3480fc700 2024-09-17T07:24:40.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.174+0000 7fe35051e640 1 -- 172.21.15.87:0/4129778596 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe34810da20 con 0x7fe3480fc700 2024-09-17T07:24:40.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.175+0000 7fe35051e640 1 -- 172.21.15.87:0/4129778596 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe34804b720 con 0x7fe3480fc700 2024-09-17T07:24:40.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.175+0000 7fe33affd640 1 -- 172.21.15.87:0/4129778596 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fe3440095b0 con 0x7fe3480fc700 2024-09-17T07:24:40.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.176+0000 7fe33affd640 1 --2- 172.21.15.87:0/4129778596 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fe33406cb90 0x7fe33406f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:24:40.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.176+0000 7fe33affd640 1 -- 172.21.15.87:0/4129778596 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fe34408bde0 con 0x7fe3480fc700 2024-09-17T07:24:40.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.176+0000 7fe34e2ba640 1 --2- 172.21.15.87:0/4129778596 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fe33406cb90 0x7fe33406f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:24:40.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.177+0000 7fe34e2ba640 1 --2- 172.21.15.87:0/4129778596 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fe33406cb90 0x7fe33406f040 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe33c007ac0 tx=0x7fe33c009da0 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:24:40.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.180+0000 7fe33affd640 1 -- 172.21.15.87:0/4129778596 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe344055df0 con 0x7fe3480fc700 2024-09-17T07:24:40.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.359+0000 7fe35051e640 1 -- 172.21.15.87:0/4129778596 --> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe34810dd50 con 0x7fe33406cb90 2024-09-17T07:24:40.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.361+0000 7fe33affd640 1 -- 172.21.15.87:0/4129778596 <== mgr.24529 v2:172.21.15.87:6800/1359413180 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fe34810dd50 con 0x7fe33406cb90 2024-09-17T07:24:40.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.363+0000 7fe35051e640 1 -- 172.21.15.87:0/4129778596 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fe33406cb90 msgr2=0x7fe33406f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:24:40.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.363+0000 7fe35051e640 1 --2- 172.21.15.87:0/4129778596 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fe33406cb90 0x7fe33406f040 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe33c007ac0 tx=0x7fe33c009da0 comp rx=0 tx=0).stop 2024-09-17T07:24:40.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.363+0000 7fe35051e640 1 -- 172.21.15.87:0/4129778596 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3480fc700 msgr2=0x7fe34810c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:24:40.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.363+0000 7fe35051e640 1 --2- 172.21.15.87:0/4129778596 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3480fc700 0x7fe34810c3e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe34400eb70 tx=0x7fe34400b040 comp rx=0 tx=0).stop 2024-09-17T07:24:40.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.363+0000 7fe35051e640 1 -- 172.21.15.87:0/4129778596 shutdown_connections 2024-09-17T07:24:40.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.363+0000 7fe35051e640 1 --2- 172.21.15.87:0/4129778596 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3480fc700 0x7fe34810c3e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:40.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.363+0000 7fe35051e640 1 --2- 172.21.15.87:0/4129778596 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fe33406cb90 0x7fe33406f040 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:40.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.363+0000 7fe35051e640 1 --2- 172.21.15.87:0/4129778596 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe3480fb430 0x7fe34810bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:40.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.363+0000 7fe35051e640 1 -- 172.21.15.87:0/4129778596 >> 172.21.15.87:0/4129778596 conn(0x7fe3480f6c10 msgr2=0x7fe3480ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:24:40.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.363+0000 7fe35051e640 1 -- 172.21.15.87:0/4129778596 shutdown_connections 2024-09-17T07:24:40.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.363+0000 7fe35051e640 1 -- 172.21.15.87:0/4129778596 wait complete. 2024-09-17T07:24:40.373 INFO:teuthology.orchestra.run.smithi087.stdout:true 2024-09-17T07:24:40.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:40 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-17T07:24:40.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:40 smithi087 ceph-mon[90982]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-17T07:24:40.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:40 smithi087 ceph-mon[90982]: Upgrade: osd.3 is safe to restart 2024-09-17T07:24:40.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.442+0000 7f7e9dc0f640 1 -- 172.21.15.87:0/2605719409 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e980fc550 msgr2=0x7f7e980fc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:24:40.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.442+0000 7f7e9dc0f640 1 --2- 172.21.15.87:0/2605719409 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e980fc550 0x7f7e980fc960 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7e880048d0 tx=0x7f7e88009da0 comp rx=0 tx=0).stop 2024-09-17T07:24:40.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.442+0000 7f7e9dc0f640 1 -- 172.21.15.87:0/2605719409 shutdown_connections 2024-09-17T07:24:40.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.442+0000 7f7e9dc0f640 1 --2- 172.21.15.87:0/2605719409 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7e980fd820 0x7f7e980fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:40.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.442+0000 7f7e9dc0f640 1 --2- 172.21.15.87:0/2605719409 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e980fc550 0x7f7e980fc960 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:40.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.442+0000 7f7e9dc0f640 1 -- 172.21.15.87:0/2605719409 >> 172.21.15.87:0/2605719409 conn(0x7f7e980f7d30 msgr2=0x7f7e980fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:24:40.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.442+0000 7f7e9dc0f640 1 -- 172.21.15.87:0/2605719409 shutdown_connections 2024-09-17T07:24:40.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.442+0000 7f7e9dc0f640 1 -- 172.21.15.87:0/2605719409 wait complete. 2024-09-17T07:24:40.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.442+0000 7f7e9dc0f640 1 Processor -- start 2024-09-17T07:24:40.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.443+0000 7f7e9dc0f640 1 -- start start 2024-09-17T07:24:40.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.443+0000 7f7e9dc0f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7e980fc550 0x7f7e9810cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:24:40.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.443+0000 7f7e9dc0f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e980fd820 0x7f7e9810d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:24:40.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.443+0000 7f7e9dc0f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9810db50 con 0x7f7e980fd820 2024-09-17T07:24:40.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.443+0000 7f7e9dc0f640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9810e370 con 0x7f7e980fc550 2024-09-17T07:24:40.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.443+0000 7f7e96ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e980fd820 0x7f7e9810d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:24:40.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.443+0000 7f7e96ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e980fd820 0x7f7e9810d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45868/0 (socket says 172.21.15.87:45868) 2024-09-17T07:24:40.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.443+0000 7f7e96ffd640 1 -- 172.21.15.87:0/2393396330 learned_addr learned my addr 172.21.15.87:0/2393396330 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:24:40.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.443+0000 7f7e977fe640 1 --2- 172.21.15.87:0/2393396330 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7e980fc550 0x7f7e9810cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:24:40.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.443+0000 7f7e96ffd640 1 -- 172.21.15.87:0/2393396330 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7e980fc550 msgr2=0x7f7e9810cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:24:40.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.443+0000 7f7e96ffd640 1 --2- 172.21.15.87:0/2393396330 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7e980fc550 0x7f7e9810cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:40.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.443+0000 7f7e96ffd640 1 -- 172.21.15.87:0/2393396330 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e88005040 con 0x7f7e980fd820 2024-09-17T07:24:40.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.443+0000 7f7e96ffd640 1 --2- 172.21.15.87:0/2393396330 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e980fd820 0x7f7e9810d500 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7e8000c830 tx=0x7f7e80004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:24:40.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.443+0000 7f7e8ffff640 1 -- 172.21.15.87:0/2393396330 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e8000a850 con 0x7f7e980fd820 2024-09-17T07:24:40.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.444+0000 7f7e8ffff640 1 -- 172.21.15.87:0/2393396330 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f7e8000ae30 con 0x7f7e980fd820 2024-09-17T07:24:40.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.444+0000 7f7e9dc0f640 1 -- 172.21.15.87:0/2393396330 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e9810e600 con 0x7f7e980fd820 2024-09-17T07:24:40.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.444+0000 7f7e8ffff640 1 -- 172.21.15.87:0/2393396330 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e800113a0 con 0x7f7e980fd820 2024-09-17T07:24:40.447 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.444+0000 7f7e9dc0f640 1 -- 172.21.15.87:0/2393396330 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e9810eba0 con 0x7f7e980fd820 2024-09-17T07:24:40.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.445+0000 7f7e9dc0f640 1 -- 172.21.15.87:0/2393396330 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e980fb9b0 con 0x7f7e980fd820 2024-09-17T07:24:40.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.445+0000 7f7e8ffff640 1 -- 172.21.15.87:0/2393396330 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f7e80012400 con 0x7f7e980fd820 2024-09-17T07:24:40.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.445+0000 7f7e8ffff640 1 --2- 172.21.15.87:0/2393396330 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f7e8406cb90 0x7f7e8406f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:24:40.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.445+0000 7f7e8ffff640 1 -- 172.21.15.87:0/2393396330 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f7e8008c170 con 0x7f7e980fd820 2024-09-17T07:24:40.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.446+0000 7f7e977fe640 1 --2- 172.21.15.87:0/2393396330 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f7e8406cb90 0x7f7e8406f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:24:40.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.446+0000 7f7e977fe640 1 --2- 172.21.15.87:0/2393396330 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f7e8406cb90 0x7f7e8406f040 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7e88009ac0 tx=0x7f7e88035040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:24:40.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.450+0000 7f7e8ffff640 1 -- 172.21.15.87:0/2393396330 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7e800562a0 con 0x7f7e980fd820 2024-09-17T07:24:40.513 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:40 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-17T07:24:40.513 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:40 smithi139 ceph-mon[79872]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-17T07:24:40.513 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:40 smithi139 ceph-mon[79872]: Upgrade: osd.3 is safe to restart 2024-09-17T07:24:40.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.627+0000 7f7e9dc0f640 1 -- 172.21.15.87:0/2393396330 --> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7e9810ef10 con 0x7f7e8406cb90 2024-09-17T07:24:40.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.628+0000 7f7e8ffff640 1 -- 172.21.15.87:0/2393396330 <== mgr.24529 v2:172.21.15.87:6800/1359413180 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f7e9810ef10 con 0x7f7e8406cb90 2024-09-17T07:24:40.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.630+0000 7f7e9dc0f640 1 -- 172.21.15.87:0/2393396330 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f7e8406cb90 msgr2=0x7f7e8406f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:24:40.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.630+0000 7f7e9dc0f640 1 --2- 172.21.15.87:0/2393396330 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f7e8406cb90 0x7f7e8406f040 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7e88009ac0 tx=0x7f7e88035040 comp rx=0 tx=0).stop 2024-09-17T07:24:40.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.630+0000 7f7e9dc0f640 1 -- 172.21.15.87:0/2393396330 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e980fd820 msgr2=0x7f7e9810d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:24:40.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.630+0000 7f7e9dc0f640 1 --2- 172.21.15.87:0/2393396330 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e980fd820 0x7f7e9810d500 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7e8000c830 tx=0x7f7e80004430 comp rx=0 tx=0).stop 2024-09-17T07:24:40.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.631+0000 7f7e9dc0f640 1 -- 172.21.15.87:0/2393396330 shutdown_connections 2024-09-17T07:24:40.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.631+0000 7f7e9dc0f640 1 --2- 172.21.15.87:0/2393396330 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e980fd820 0x7f7e9810d500 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:40.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.631+0000 7f7e9dc0f640 1 --2- 172.21.15.87:0/2393396330 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f7e8406cb90 0x7f7e8406f040 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:40.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.631+0000 7f7e9dc0f640 1 --2- 172.21.15.87:0/2393396330 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7e980fc550 0x7f7e9810cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:40.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.631+0000 7f7e9dc0f640 1 -- 172.21.15.87:0/2393396330 >> 172.21.15.87:0/2393396330 conn(0x7f7e980f7d30 msgr2=0x7f7e980f9640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:24:40.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.631+0000 7f7e9dc0f640 1 -- 172.21.15.87:0/2393396330 shutdown_connections 2024-09-17T07:24:40.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.631+0000 7f7e9dc0f640 1 -- 172.21.15.87:0/2393396330 wait complete. 2024-09-17T07:24:40.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.709+0000 7f2e60fd7640 1 -- 172.21.15.87:0/1084503624 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e5c0fc700 msgr2=0x7f2e5c0fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:24:40.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.709+0000 7f2e60fd7640 1 --2- 172.21.15.87:0/1084503624 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e5c0fc700 0x7f2e5c0fcb70 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2e440048d0 tx=0x7f2e44009da0 comp rx=0 tx=0).stop 2024-09-17T07:24:40.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.709+0000 7f2e60fd7640 1 -- 172.21.15.87:0/1084503624 shutdown_connections 2024-09-17T07:24:40.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.709+0000 7f2e60fd7640 1 --2- 172.21.15.87:0/1084503624 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e5c0fc700 0x7f2e5c0fcb70 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:40.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.709+0000 7f2e60fd7640 1 --2- 172.21.15.87:0/1084503624 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2e5c0fb430 0x7f2e5c0fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:40.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.709+0000 7f2e60fd7640 1 -- 172.21.15.87:0/1084503624 >> 172.21.15.87:0/1084503624 conn(0x7f2e5c0f6c10 msgr2=0x7f2e5c0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:24:40.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.709+0000 7f2e60fd7640 1 -- 172.21.15.87:0/1084503624 shutdown_connections 2024-09-17T07:24:40.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.710+0000 7f2e60fd7640 1 -- 172.21.15.87:0/1084503624 wait complete. 2024-09-17T07:24:40.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.710+0000 7f2e60fd7640 1 Processor -- start 2024-09-17T07:24:40.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.710+0000 7f2e60fd7640 1 -- start start 2024-09-17T07:24:40.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.710+0000 7f2e60fd7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e5c0fb430 0x7f2e5c10bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:24:40.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.710+0000 7f2e60fd7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2e5c0fc700 0x7f2e5c10c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:24:40.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.710+0000 7f2e60fd7640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5c10cae0 con 0x7f2e5c0fb430 2024-09-17T07:24:40.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.710+0000 7f2e60fd7640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5c10d1d0 con 0x7f2e5c0fc700 2024-09-17T07:24:40.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.711+0000 7f2e5a59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e5c0fb430 0x7f2e5c10bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:24:40.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.711+0000 7f2e5a59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e5c0fb430 0x7f2e5c10bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45880/0 (socket says 172.21.15.87:45880) 2024-09-17T07:24:40.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.711+0000 7f2e5a59c640 1 -- 172.21.15.87:0/3175260407 learned_addr learned my addr 172.21.15.87:0/3175260407 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:24:40.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.711+0000 7f2e59d9b640 1 --2- 172.21.15.87:0/3175260407 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2e5c0fc700 0x7f2e5c10c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:24:40.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.711+0000 7f2e5a59c640 1 -- 172.21.15.87:0/3175260407 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2e5c0fc700 msgr2=0x7f2e5c10c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:24:40.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.711+0000 7f2e5a59c640 1 --2- 172.21.15.87:0/3175260407 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2e5c0fc700 0x7f2e5c10c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:40.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.711+0000 7f2e5a59c640 1 -- 172.21.15.87:0/3175260407 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e44005040 con 0x7f2e5c0fb430 2024-09-17T07:24:40.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.711+0000 7f2e5a59c640 1 --2- 172.21.15.87:0/3175260407 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e5c0fb430 0x7f2e5c10bf50 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c00db50 tx=0x7f2e4c004ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:24:40.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.711+0000 7f2e52ffd640 1 -- 172.21.15.87:0/3175260407 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e4c00b950 con 0x7f2e5c0fb430 2024-09-17T07:24:40.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.711+0000 7f2e60fd7640 1 -- 172.21.15.87:0/3175260407 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e5c10d460 con 0x7f2e5c0fb430 2024-09-17T07:24:40.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.711+0000 7f2e52ffd640 1 -- 172.21.15.87:0/3175260407 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f2e4c00f040 con 0x7f2e5c0fb430 2024-09-17T07:24:40.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.711+0000 7f2e52ffd640 1 -- 172.21.15.87:0/3175260407 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e4c012390 con 0x7f2e5c0fb430 2024-09-17T07:24:40.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.712+0000 7f2e60fd7640 1 -- 172.21.15.87:0/3175260407 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e5c10da00 con 0x7f2e5c0fb430 2024-09-17T07:24:40.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.713+0000 7f2e60fd7640 1 -- 172.21.15.87:0/3175260407 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e5c04b720 con 0x7f2e5c0fb430 2024-09-17T07:24:40.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.713+0000 7f2e52ffd640 1 -- 172.21.15.87:0/3175260407 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f2e4c00bab0 con 0x7f2e5c0fb430 2024-09-17T07:24:40.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.714+0000 7f2e52ffd640 1 --2- 172.21.15.87:0/3175260407 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f2e4806cb90 0x7f2e4806f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:24:40.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.714+0000 7f2e52ffd640 1 -- 172.21.15.87:0/3175260407 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f2e4c08bff0 con 0x7f2e5c0fb430 2024-09-17T07:24:40.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.714+0000 7f2e59d9b640 1 --2- 172.21.15.87:0/3175260407 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f2e4806cb90 0x7f2e4806f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:24:40.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.714+0000 7f2e59d9b640 1 --2- 172.21.15.87:0/3175260407 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f2e4806cb90 0x7f2e4806f040 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2e44000c00 tx=0x7f2e44035040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:24:40.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.718+0000 7f2e52ffd640 1 -- 172.21.15.87:0/3175260407 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2e4c056000 con 0x7f2e5c0fb430 2024-09-17T07:24:40.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.887+0000 7f2e60fd7640 1 -- 172.21.15.87:0/3175260407 --> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2e5c10dc50 con 0x7f2e4806cb90 2024-09-17T07:24:40.897 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.896+0000 7f2e52ffd640 1 -- 172.21.15.87:0/3175260407 <== mgr.24529 v2:172.21.15.87:6800/1359413180 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f2e5c10dc50 con 0x7f2e4806cb90 2024-09-17T07:24:40.897 INFO:teuthology.orchestra.run.smithi087.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T07:24:40.897 INFO:teuthology.orchestra.run.smithi087.stdout:alertmanager.smithi087 smithi087 *:9093,9094 running (4m) 20s ago 12m 25.6M - 0.25.0 c8568f914cd2 594553f0b497 2024-09-17T07:24:40.898 INFO:teuthology.orchestra.run.smithi087.stdout:crash.smithi087 smithi087 running (116s) 20s ago 12m 6895k - 18.2.4-855-g19e2a2be 980a0bfcd684 0ff8a9330162 2024-09-17T07:24:40.898 INFO:teuthology.orchestra.run.smithi087.stdout:crash.smithi139 smithi139 running (111s) 108s ago 11m 6899k - 18.2.4-855-g19e2a2be 980a0bfcd684 10541e3b202e 2024-09-17T07:24:40.898 INFO:teuthology.orchestra.run.smithi087.stdout:grafana.smithi087 smithi087 *:3000 running (4m) 20s ago 12m 80.1M - 9.4.7 954c08fa6188 e2f17ec6baa8 2024-09-17T07:24:40.898 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi087.tjhpcs smithi087 running (7m) 20s ago 7m 130M - 17.2.7-1635-g4a704134 f22ead590bad f7142ad971ed 2024-09-17T07:24:40.898 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi087.vvbzss smithi087 running (7m) 20s ago 7m 70.2M - 17.2.7-1635-g4a704134 f22ead590bad 2dd82ff293d1 2024-09-17T07:24:40.898 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi139.ftvinf smithi139 running (7m) 108s ago 7m 57.4M - 17.2.7-1635-g4a704134 f22ead590bad d11edb295ad3 2024-09-17T07:24:40.898 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi139.gnwonz smithi139 running (7m) 108s ago 7m 116M - 17.2.7-1635-g4a704134 f22ead590bad 3b3d884aef02 2024-09-17T07:24:40.898 INFO:teuthology.orchestra.run.smithi087.stdout:mgr.smithi087.vuvjer smithi087 *:8443,9283,8765 running (3m) 20s ago 13m 488M - 18.2.4-855-g19e2a2be 980a0bfcd684 5d10c647cb6b 2024-09-17T07:24:40.898 INFO:teuthology.orchestra.run.smithi087.stdout:mgr.smithi139.tuqnpn smithi139 *:8443,9283,8765 running (3m) 108s ago 11m 437M - 18.2.4-855-g19e2a2be 980a0bfcd684 6e0bf371d44c 2024-09-17T07:24:40.898 INFO:teuthology.orchestra.run.smithi087.stdout:mon.smithi087 smithi087 running (2m) 20s ago 14m 44.5M 2048M 18.2.4-855-g19e2a2be 980a0bfcd684 305c72de1f9f 2024-09-17T07:24:40.898 INFO:teuthology.orchestra.run.smithi087.stdout:mon.smithi139 smithi139 running (2m) 108s ago 11m 34.0M 2048M 18.2.4-855-g19e2a2be 980a0bfcd684 0b159495af0f 2024-09-17T07:24:40.898 INFO:teuthology.orchestra.run.smithi087.stdout:node-exporter.smithi087 smithi087 *:9100 running (4m) 20s ago 12m 15.3M - 1.5.0 0da6a335fe13 39fa48de0e87 2024-09-17T07:24:40.898 INFO:teuthology.orchestra.run.smithi087.stdout:node-exporter.smithi139 smithi139 *:9100 running (3m) 108s ago 11m 15.6M - 1.5.0 0da6a335fe13 a5b99b7cbb06 2024-09-17T07:24:40.899 INFO:teuthology.orchestra.run.smithi087.stdout:osd.0 smithi087 running (92s) 20s ago 10m 85.4M 1557M 18.2.4-855-g19e2a2be 980a0bfcd684 e97cb50e6aec 2024-09-17T07:24:40.899 INFO:teuthology.orchestra.run.smithi087.stdout:osd.1 smithi087 running (59s) 20s ago 10m 89.7M 1557M 18.2.4-855-g19e2a2be 980a0bfcd684 b108771d0b8e 2024-09-17T07:24:40.899 INFO:teuthology.orchestra.run.smithi087.stdout:osd.2 smithi087 running (26s) 20s ago 10m 11.8M 1557M 18.2.4-855-g19e2a2be 980a0bfcd684 240cfb3b5366 2024-09-17T07:24:40.899 INFO:teuthology.orchestra.run.smithi087.stdout:osd.3 smithi139 running (9m) 108s ago 9m 234M 2581M 17.2.7-1635-g4a704134 f22ead590bad 0801999b17c4 2024-09-17T07:24:40.899 INFO:teuthology.orchestra.run.smithi087.stdout:osd.4 smithi139 running (9m) 108s ago 9m 210M 2581M 17.2.7-1635-g4a704134 f22ead590bad 299a8dfc47f5 2024-09-17T07:24:40.899 INFO:teuthology.orchestra.run.smithi087.stdout:osd.5 smithi139 running (8m) 108s ago 8m 200M 2581M 17.2.7-1635-g4a704134 f22ead590bad 609cf74f32e7 2024-09-17T07:24:40.899 INFO:teuthology.orchestra.run.smithi087.stdout:prometheus.smithi087 smithi087 *:9095 running (3m) 20s ago 12m 56.5M - 2.43.0 a07b618ecd1d 63d18b7469fc 2024-09-17T07:24:40.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.898+0000 7f2e60fd7640 1 -- 172.21.15.87:0/3175260407 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f2e4806cb90 msgr2=0x7f2e4806f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:24:40.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.898+0000 7f2e60fd7640 1 --2- 172.21.15.87:0/3175260407 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f2e4806cb90 0x7f2e4806f040 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2e44000c00 tx=0x7f2e44035040 comp rx=0 tx=0).stop 2024-09-17T07:24:40.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.898+0000 7f2e60fd7640 1 -- 172.21.15.87:0/3175260407 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e5c0fb430 msgr2=0x7f2e5c10bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:24:40.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.898+0000 7f2e60fd7640 1 --2- 172.21.15.87:0/3175260407 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e5c0fb430 0x7f2e5c10bf50 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c00db50 tx=0x7f2e4c004ee0 comp rx=0 tx=0).stop 2024-09-17T07:24:40.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.898+0000 7f2e60fd7640 1 -- 172.21.15.87:0/3175260407 shutdown_connections 2024-09-17T07:24:40.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.898+0000 7f2e60fd7640 1 --2- 172.21.15.87:0/3175260407 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f2e4806cb90 0x7f2e4806f040 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:40.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.898+0000 7f2e60fd7640 1 --2- 172.21.15.87:0/3175260407 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2e5c0fc700 0x7f2e5c10c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:40.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.898+0000 7f2e60fd7640 1 --2- 172.21.15.87:0/3175260407 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e5c0fb430 0x7f2e5c10bf50 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:40.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.898+0000 7f2e60fd7640 1 -- 172.21.15.87:0/3175260407 >> 172.21.15.87:0/3175260407 conn(0x7f2e5c0f6c10 msgr2=0x7f2e5c0ffa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:24:40.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.898+0000 7f2e60fd7640 1 -- 172.21.15.87:0/3175260407 shutdown_connections 2024-09-17T07:24:40.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.898+0000 7f2e60fd7640 1 -- 172.21.15.87:0/3175260407 wait complete. 2024-09-17T07:24:40.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.975+0000 7f0e5e1b5640 1 -- 172.21.15.87:0/2593943958 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e580fdba0 msgr2=0x7f0e580fdfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:24:40.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.975+0000 7f0e5e1b5640 1 --2- 172.21.15.87:0/2593943958 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e580fdba0 0x7f0e580fdfb0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0e480048d0 tx=0x7f0e48009da0 comp rx=0 tx=0).stop 2024-09-17T07:24:40.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.975+0000 7f0e5e1b5640 1 -- 172.21.15.87:0/2593943958 shutdown_connections 2024-09-17T07:24:40.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.975+0000 7f0e5e1b5640 1 --2- 172.21.15.87:0/2593943958 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0e580fe4f0 0x7f0e580fa650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:40.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.975+0000 7f0e5e1b5640 1 --2- 172.21.15.87:0/2593943958 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e580fdba0 0x7f0e580fdfb0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:40.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.975+0000 7f0e5e1b5640 1 -- 172.21.15.87:0/2593943958 >> 172.21.15.87:0/2593943958 conn(0x7f0e580f63a0 msgr2=0x7f0e580f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:24:40.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.975+0000 7f0e5e1b5640 1 -- 172.21.15.87:0/2593943958 shutdown_connections 2024-09-17T07:24:40.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.975+0000 7f0e5e1b5640 1 -- 172.21.15.87:0/2593943958 wait complete. 2024-09-17T07:24:40.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.975+0000 7f0e5e1b5640 1 Processor -- start 2024-09-17T07:24:40.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.976+0000 7f0e5e1b5640 1 -- start start 2024-09-17T07:24:40.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.976+0000 7f0e5e1b5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0e580fdba0 0x7f0e580fd390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:24:40.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.976+0000 7f0e5e1b5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e580fe4f0 0x7f0e580fb880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:24:40.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.976+0000 7f0e5e1b5640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e580fbe10 con 0x7f0e580fe4f0 2024-09-17T07:24:40.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.976+0000 7f0e5e1b5640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e580fbf50 con 0x7f0e580fdba0 2024-09-17T07:24:40.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.976+0000 7f0e56ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e580fe4f0 0x7f0e580fb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:24:40.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.976+0000 7f0e56ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e580fe4f0 0x7f0e580fb880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45898/0 (socket says 172.21.15.87:45898) 2024-09-17T07:24:40.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.976+0000 7f0e56ffd640 1 -- 172.21.15.87:0/3975448539 learned_addr learned my addr 172.21.15.87:0/3975448539 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:24:40.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.976+0000 7f0e577fe640 1 --2- 172.21.15.87:0/3975448539 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0e580fdba0 0x7f0e580fd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:24:40.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.976+0000 7f0e56ffd640 1 -- 172.21.15.87:0/3975448539 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0e580fdba0 msgr2=0x7f0e580fd390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:24:40.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.976+0000 7f0e56ffd640 1 --2- 172.21.15.87:0/3975448539 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0e580fdba0 0x7f0e580fd390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:40.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.976+0000 7f0e56ffd640 1 -- 172.21.15.87:0/3975448539 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e48005040 con 0x7f0e580fe4f0 2024-09-17T07:24:40.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.976+0000 7f0e577fe640 1 --2- 172.21.15.87:0/3975448539 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0e580fdba0 0x7f0e580fd390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T07:24:40.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.977+0000 7f0e56ffd640 1 --2- 172.21.15.87:0/3975448539 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e580fe4f0 0x7f0e580fb880 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c002870 tx=0x7f0e4c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:24:40.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.977+0000 7f0e3ffff640 1 -- 172.21.15.87:0/3975448539 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e4c002e00 con 0x7f0e580fe4f0 2024-09-17T07:24:40.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.977+0000 7f0e5e1b5640 1 -- 172.21.15.87:0/3975448539 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e580fc230 con 0x7f0e580fe4f0 2024-09-17T07:24:40.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.977+0000 7f0e3ffff640 1 -- 172.21.15.87:0/3975448539 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f0e4c00f040 con 0x7f0e580fe4f0 2024-09-17T07:24:40.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.977+0000 7f0e3ffff640 1 -- 172.21.15.87:0/3975448539 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e4c009470 con 0x7f0e580fe4f0 2024-09-17T07:24:40.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.977+0000 7f0e5e1b5640 1 -- 172.21.15.87:0/3975448539 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e58115020 con 0x7f0e580fe4f0 2024-09-17T07:24:40.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.978+0000 7f0e5e1b5640 1 -- 172.21.15.87:0/3975448539 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e580fa040 con 0x7f0e580fe4f0 2024-09-17T07:24:40.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.978+0000 7f0e3ffff640 1 -- 172.21.15.87:0/3975448539 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f0e4c007c30 con 0x7f0e580fe4f0 2024-09-17T07:24:40.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.979+0000 7f0e3ffff640 1 --2- 172.21.15.87:0/3975448539 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f0e4006cb90 0x7f0e4006f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:24:40.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.979+0000 7f0e3ffff640 1 -- 172.21.15.87:0/3975448539 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f0e4c08b690 con 0x7f0e580fe4f0 2024-09-17T07:24:40.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.979+0000 7f0e577fe640 1 --2- 172.21.15.87:0/3975448539 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f0e4006cb90 0x7f0e4006f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:24:40.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.979+0000 7f0e577fe640 1 --2- 172.21.15.87:0/3975448539 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f0e4006cb90 0x7f0e4006f040 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0e580fd140 tx=0x7f0e48035040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:24:40.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:40.983+0000 7f0e3ffff640 1 -- 172.21.15.87:0/3975448539 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f0e4c0557d0 con 0x7f0e580fe4f0 2024-09-17T07:24:41.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.211+0000 7f0e5e1b5640 1 -- 172.21.15.87:0/3975448539 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0e5804b720 con 0x7f0e580fe4f0 2024-09-17T07:24:41.212 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.211+0000 7f0e3ffff640 1 -- 172.21.15.87:0/3975448539 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+846 (secure 0 0 0) 0x7f0e4c058df0 con 0x7f0e580fe4f0 2024-09-17T07:24:41.213 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T07:24:41.213 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": { 2024-09-17T07:24:41.213 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 2 2024-09-17T07:24:41.213 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:24:41.213 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr": { 2024-09-17T07:24:41.213 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 2 2024-09-17T07:24:41.213 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:24:41.213 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": { 2024-09-17T07:24:41.213 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 3, 2024-09-17T07:24:41.213 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 3 2024-09-17T07:24:41.214 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:24:41.214 INFO:teuthology.orchestra.run.smithi087.stdout: "mds": { 2024-09-17T07:24:41.214 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 4 2024-09-17T07:24:41.214 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:24:41.214 INFO:teuthology.orchestra.run.smithi087.stdout: "overall": { 2024-09-17T07:24:41.214 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 7, 2024-09-17T07:24:41.214 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 7 2024-09-17T07:24:41.214 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T07:24:41.214 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T07:24:41.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.213+0000 7f0e5e1b5640 1 -- 172.21.15.87:0/3975448539 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f0e4006cb90 msgr2=0x7f0e4006f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:24:41.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.213+0000 7f0e5e1b5640 1 --2- 172.21.15.87:0/3975448539 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f0e4006cb90 0x7f0e4006f040 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0e580fd140 tx=0x7f0e48035040 comp rx=0 tx=0).stop 2024-09-17T07:24:41.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.213+0000 7f0e5e1b5640 1 -- 172.21.15.87:0/3975448539 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e580fe4f0 msgr2=0x7f0e580fb880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:24:41.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.213+0000 7f0e5e1b5640 1 --2- 172.21.15.87:0/3975448539 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e580fe4f0 0x7f0e580fb880 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c002870 tx=0x7f0e4c004600 comp rx=0 tx=0).stop 2024-09-17T07:24:41.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.213+0000 7f0e5e1b5640 1 -- 172.21.15.87:0/3975448539 shutdown_connections 2024-09-17T07:24:41.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.213+0000 7f0e5e1b5640 1 --2- 172.21.15.87:0/3975448539 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e580fe4f0 0x7f0e580fb880 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:41.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.213+0000 7f0e5e1b5640 1 --2- 172.21.15.87:0/3975448539 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f0e4006cb90 0x7f0e4006f040 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:41.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.214+0000 7f0e5e1b5640 1 --2- 172.21.15.87:0/3975448539 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0e580fdba0 0x7f0e580fd390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:41.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.214+0000 7f0e5e1b5640 1 -- 172.21.15.87:0/3975448539 >> 172.21.15.87:0/3975448539 conn(0x7f0e580f63a0 msgr2=0x7f0e580f7bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:24:41.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.214+0000 7f0e5e1b5640 1 -- 172.21.15.87:0/3975448539 shutdown_connections 2024-09-17T07:24:41.216 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.214+0000 7f0e5e1b5640 1 -- 172.21.15.87:0/3975448539 wait complete. 2024-09-17T07:24:41.284 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:41 smithi087 ceph-mon[90982]: pgmap v99: 65 pgs: 65 active+clean; 322 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:24:41.284 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:41 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:24:41.284 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:41 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-17T07:24:41.284 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:41 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:24:41.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.298+0000 7fe3df2db640 1 -- 172.21.15.87:0/861727905 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3d80fc700 msgr2=0x7fe3d80fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:24:41.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.298+0000 7fe3df2db640 1 --2- 172.21.15.87:0/861727905 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3d80fc700 0x7fe3d80fcb70 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe3c80048d0 tx=0x7fe3c8009da0 comp rx=0 tx=0).stop 2024-09-17T07:24:41.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.298+0000 7fe3df2db640 1 -- 172.21.15.87:0/861727905 shutdown_connections 2024-09-17T07:24:41.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.298+0000 7fe3df2db640 1 --2- 172.21.15.87:0/861727905 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3d80fc700 0x7fe3d80fcb70 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:41.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.298+0000 7fe3df2db640 1 --2- 172.21.15.87:0/861727905 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe3d80fb430 0x7fe3d80fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:41.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.298+0000 7fe3df2db640 1 -- 172.21.15.87:0/861727905 >> 172.21.15.87:0/861727905 conn(0x7fe3d80f6c10 msgr2=0x7fe3d80f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:24:41.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.298+0000 7fe3df2db640 1 -- 172.21.15.87:0/861727905 shutdown_connections 2024-09-17T07:24:41.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.298+0000 7fe3df2db640 1 -- 172.21.15.87:0/861727905 wait complete. 2024-09-17T07:24:41.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.298+0000 7fe3df2db640 1 Processor -- start 2024-09-17T07:24:41.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.299+0000 7fe3df2db640 1 -- start start 2024-09-17T07:24:41.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.299+0000 7fe3df2db640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe3d80fb430 0x7fe3d80ff490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:24:41.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.299+0000 7fe3df2db640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3d80fc700 0x7fe3d80fda40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:24:41.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.299+0000 7fe3df2db640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d80fdf80 con 0x7fe3d80fc700 2024-09-17T07:24:41.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.299+0000 7fe3df2db640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d80fe0f0 con 0x7fe3d80fb430 2024-09-17T07:24:41.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.299+0000 7fe3dc876640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3d80fc700 0x7fe3d80fda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:24:41.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.299+0000 7fe3dc876640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3d80fc700 0x7fe3d80fda40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45910/0 (socket says 172.21.15.87:45910) 2024-09-17T07:24:41.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.299+0000 7fe3dc876640 1 -- 172.21.15.87:0/1698155646 learned_addr learned my addr 172.21.15.87:0/1698155646 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:24:41.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.299+0000 7fe3dd077640 1 --2- 172.21.15.87:0/1698155646 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe3d80fb430 0x7fe3d80ff490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:24:41.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.299+0000 7fe3dc876640 1 -- 172.21.15.87:0/1698155646 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe3d80fb430 msgr2=0x7fe3d80ff490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:24:41.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.299+0000 7fe3dc876640 1 --2- 172.21.15.87:0/1698155646 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe3d80fb430 0x7fe3d80ff490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:41.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.299+0000 7fe3dc876640 1 -- 172.21.15.87:0/1698155646 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c8005040 con 0x7fe3d80fc700 2024-09-17T07:24:41.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.299+0000 7fe3dc876640 1 --2- 172.21.15.87:0/1698155646 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3d80fc700 0x7fe3d80fda40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe3c80043d0 tx=0x7fe3c8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:24:41.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.300+0000 7fe3cdffb640 1 -- 172.21.15.87:0/1698155646 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe3c8038070 con 0x7fe3d80fc700 2024-09-17T07:24:41.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.300+0000 7fe3cdffb640 1 -- 172.21.15.87:0/1698155646 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fe3c80096c0 con 0x7fe3d80fc700 2024-09-17T07:24:41.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.300+0000 7fe3df2db640 1 -- 172.21.15.87:0/1698155646 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3d80fe370 con 0x7fe3d80fc700 2024-09-17T07:24:41.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.300+0000 7fe3cdffb640 1 -- 172.21.15.87:0/1698155646 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe3c803d420 con 0x7fe3d80fc700 2024-09-17T07:24:41.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.300+0000 7fe3df2db640 1 -- 172.21.15.87:0/1698155646 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3d80fe890 con 0x7fe3d80fc700 2024-09-17T07:24:41.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.301+0000 7fe3df2db640 1 -- 172.21.15.87:0/1698155646 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3d80fa890 con 0x7fe3d80fc700 2024-09-17T07:24:41.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.301+0000 7fe3cdffb640 1 -- 172.21.15.87:0/1698155646 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fe3c8030020 con 0x7fe3d80fc700 2024-09-17T07:24:41.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.302+0000 7fe3cdffb640 1 --2- 172.21.15.87:0/1698155646 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fe3c406cb90 0x7fe3c406f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:24:41.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.302+0000 7fe3cdffb640 1 -- 172.21.15.87:0/1698155646 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fe3c80ac5e0 con 0x7fe3d80fc700 2024-09-17T07:24:41.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.302+0000 7fe3dd077640 1 --2- 172.21.15.87:0/1698155646 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fe3c406cb90 0x7fe3c406f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:24:41.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.302+0000 7fe3dd077640 1 --2- 172.21.15.87:0/1698155646 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fe3c406cb90 0x7fe3c406f040 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe3d80ff240 tx=0x7fe3d400b040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:24:41.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.306+0000 7fe3cdffb640 1 -- 172.21.15.87:0/1698155646 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe3c80765f0 con 0x7fe3d80fc700 2024-09-17T07:24:41.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.506+0000 7fe3df2db640 1 -- 172.21.15.87:0/1698155646 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe3d8103cf0 con 0x7fe3d80fc700 2024-09-17T07:24:41.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.506+0000 7fe3cdffb640 1 -- 172.21.15.87:0/1698155646 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 23 v23) v1 ==== 76+0+1871 (secure 0 0 0) 0x7fe3c8079c10 con 0x7fe3d80fc700 2024-09-17T07:24:41.508 INFO:teuthology.orchestra.run.smithi087.stdout:e23 2024-09-17T07:24:41.508 INFO:teuthology.orchestra.run.smithi087.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T07:24:41.508 INFO:teuthology.orchestra.run.smithi087.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T07:24:41.508 INFO:teuthology.orchestra.run.smithi087.stdout:legacy client fscid: 1 2024-09-17T07:24:41.508 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:24:41.508 INFO:teuthology.orchestra.run.smithi087.stdout:Filesystem 'cephfs' (1) 2024-09-17T07:24:41.508 INFO:teuthology.orchestra.run.smithi087.stdout:fs_name cephfs 2024-09-17T07:24:41.508 INFO:teuthology.orchestra.run.smithi087.stdout:epoch 23 2024-09-17T07:24:41.508 INFO:teuthology.orchestra.run.smithi087.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T07:24:41.508 INFO:teuthology.orchestra.run.smithi087.stdout:created 2024-09-17T07:17:15.368053+0000 2024-09-17T07:24:41.508 INFO:teuthology.orchestra.run.smithi087.stdout:modified 2024-09-17T07:24:06.203553+0000 2024-09-17T07:24:41.509 INFO:teuthology.orchestra.run.smithi087.stdout:tableserver 0 2024-09-17T07:24:41.509 INFO:teuthology.orchestra.run.smithi087.stdout:root 0 2024-09-17T07:24:41.509 INFO:teuthology.orchestra.run.smithi087.stdout:session_timeout 60 2024-09-17T07:24:41.509 INFO:teuthology.orchestra.run.smithi087.stdout:session_autoclose 300 2024-09-17T07:24:41.509 INFO:teuthology.orchestra.run.smithi087.stdout:max_file_size 1099511627776 2024-09-17T07:24:41.509 INFO:teuthology.orchestra.run.smithi087.stdout:max_xattr_size 65536 2024-09-17T07:24:41.509 INFO:teuthology.orchestra.run.smithi087.stdout:required_client_features {} 2024-09-17T07:24:41.509 INFO:teuthology.orchestra.run.smithi087.stdout:last_failure 0 2024-09-17T07:24:41.509 INFO:teuthology.orchestra.run.smithi087.stdout:last_failure_osd_epoch 44 2024-09-17T07:24:41.509 INFO:teuthology.orchestra.run.smithi087.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T07:24:41.509 INFO:teuthology.orchestra.run.smithi087.stdout:max_mds 2 2024-09-17T07:24:41.509 INFO:teuthology.orchestra.run.smithi087.stdout:in 0,1 2024-09-17T07:24:41.510 INFO:teuthology.orchestra.run.smithi087.stdout:up {0=14478,1=24243} 2024-09-17T07:24:41.510 INFO:teuthology.orchestra.run.smithi087.stdout:failed 2024-09-17T07:24:41.510 INFO:teuthology.orchestra.run.smithi087.stdout:damaged 2024-09-17T07:24:41.510 INFO:teuthology.orchestra.run.smithi087.stdout:stopped 2024-09-17T07:24:41.510 INFO:teuthology.orchestra.run.smithi087.stdout:data_pools [3] 2024-09-17T07:24:41.510 INFO:teuthology.orchestra.run.smithi087.stdout:metadata_pool 2 2024-09-17T07:24:41.510 INFO:teuthology.orchestra.run.smithi087.stdout:inline_data enabled 2024-09-17T07:24:41.510 INFO:teuthology.orchestra.run.smithi087.stdout:balancer 2024-09-17T07:24:41.510 INFO:teuthology.orchestra.run.smithi087.stdout:bal_rank_mask -1 2024-09-17T07:24:41.510 INFO:teuthology.orchestra.run.smithi087.stdout:standby_count_wanted 1 2024-09-17T07:24:41.510 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi087.tjhpcs{0:14478} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.87:6828/2255237099,v1:172.21.15.87:6829/2255237099] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:24:41.510 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi087.vvbzss{0:14490} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.87:6826/4022268353,v1:172.21.15.87:6827/4022268353] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:24:41.510 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi139.gnwonz{1:24243} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.139:6824/3946792151,v1:172.21.15.139:6825/3946792151] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:24:41.510 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi139.ftvinf{1:24253} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.139:6826/3292073323,v1:172.21.15.139:6827/3292073323] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:24:41.511 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:24:41.511 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:24:41.511 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 23 2024-09-17T07:24:41.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.509+0000 7fe3df2db640 1 -- 172.21.15.87:0/1698155646 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fe3c406cb90 msgr2=0x7fe3c406f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:24:41.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.509+0000 7fe3df2db640 1 --2- 172.21.15.87:0/1698155646 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fe3c406cb90 0x7fe3c406f040 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe3d80ff240 tx=0x7fe3d400b040 comp rx=0 tx=0).stop 2024-09-17T07:24:41.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.509+0000 7fe3df2db640 1 -- 172.21.15.87:0/1698155646 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3d80fc700 msgr2=0x7fe3d80fda40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:24:41.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.509+0000 7fe3df2db640 1 --2- 172.21.15.87:0/1698155646 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3d80fc700 0x7fe3d80fda40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe3c80043d0 tx=0x7fe3c8009da0 comp rx=0 tx=0).stop 2024-09-17T07:24:41.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.509+0000 7fe3df2db640 1 -- 172.21.15.87:0/1698155646 shutdown_connections 2024-09-17T07:24:41.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.509+0000 7fe3df2db640 1 --2- 172.21.15.87:0/1698155646 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3d80fc700 0x7fe3d80fda40 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:41.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.509+0000 7fe3df2db640 1 --2- 172.21.15.87:0/1698155646 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fe3c406cb90 0x7fe3c406f040 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:41.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.509+0000 7fe3df2db640 1 --2- 172.21.15.87:0/1698155646 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe3d80fb430 0x7fe3d80ff490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:41.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.509+0000 7fe3df2db640 1 -- 172.21.15.87:0/1698155646 >> 172.21.15.87:0/1698155646 conn(0x7fe3d80f6c10 msgr2=0x7fe3d8065020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:24:41.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.509+0000 7fe3df2db640 1 -- 172.21.15.87:0/1698155646 shutdown_connections 2024-09-17T07:24:41.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.509+0000 7fe3df2db640 1 -- 172.21.15.87:0/1698155646 wait complete. 2024-09-17T07:24:41.549 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:41 smithi139 ceph-mon[79872]: pgmap v99: 65 pgs: 65 active+clean; 322 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:24:41.549 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:41 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:24:41.549 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:41 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-17T07:24:41.549 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:41 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:24:41.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.588+0000 7f483429a640 1 -- 172.21.15.87:0/1139501239 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f482c0fb430 msgr2=0x7f482c0fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:24:41.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.588+0000 7f483429a640 1 --2- 172.21.15.87:0/1139501239 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f482c0fb430 0x7f482c0fb840 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f481c009c50 tx=0x7f481c004d10 comp rx=0 tx=0).stop 2024-09-17T07:24:41.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.589+0000 7f483429a640 1 -- 172.21.15.87:0/1139501239 shutdown_connections 2024-09-17T07:24:41.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.589+0000 7f483429a640 1 --2- 172.21.15.87:0/1139501239 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f482c0fc700 0x7f482c0fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:41.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.589+0000 7f483429a640 1 --2- 172.21.15.87:0/1139501239 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f482c0fb430 0x7f482c0fb840 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:41.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.589+0000 7f483429a640 1 -- 172.21.15.87:0/1139501239 >> 172.21.15.87:0/1139501239 conn(0x7f482c0f6c10 msgr2=0x7f482c0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:24:41.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.589+0000 7f483429a640 1 -- 172.21.15.87:0/1139501239 shutdown_connections 2024-09-17T07:24:41.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.589+0000 7f483429a640 1 -- 172.21.15.87:0/1139501239 wait complete. 2024-09-17T07:24:41.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.589+0000 7f483429a640 1 Processor -- start 2024-09-17T07:24:41.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.589+0000 7f483429a640 1 -- start start 2024-09-17T07:24:41.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.589+0000 7f483429a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f482c0fb430 0x7f482c10cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:24:41.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.589+0000 7f483429a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f482c0fc700 0x7f482c10d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:24:41.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.589+0000 7f483429a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f482c10db40 con 0x7f482c0fc700 2024-09-17T07:24:41.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.589+0000 7f483429a640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f482c10e360 con 0x7f482c0fb430 2024-09-17T07:24:41.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.589+0000 7f4831835640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f482c0fc700 0x7f482c10d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:24:41.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.589+0000 7f4831835640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f482c0fc700 0x7f482c10d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45934/0 (socket says 172.21.15.87:45934) 2024-09-17T07:24:41.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.589+0000 7f4831835640 1 -- 172.21.15.87:0/3322151424 learned_addr learned my addr 172.21.15.87:0/3322151424 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:24:41.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.589+0000 7f4832036640 1 --2- 172.21.15.87:0/3322151424 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f482c0fb430 0x7f482c10cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:24:41.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.590+0000 7f4831835640 1 -- 172.21.15.87:0/3322151424 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f482c0fb430 msgr2=0x7f482c10cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:24:41.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.590+0000 7f4831835640 1 --2- 172.21.15.87:0/3322151424 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f482c0fb430 0x7f482c10cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:41.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.590+0000 7f4831835640 1 -- 172.21.15.87:0/3322151424 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f481c0098b0 con 0x7f482c0fc700 2024-09-17T07:24:41.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.590+0000 7f4831835640 1 --2- 172.21.15.87:0/3322151424 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f482c0fc700 0x7f482c10d4f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4820002a50 tx=0x7f4820004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:24:41.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.590+0000 7f482affd640 1 -- 172.21.15.87:0/3322151424 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4820007c30 con 0x7f482c0fc700 2024-09-17T07:24:41.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.590+0000 7f482affd640 1 -- 172.21.15.87:0/3322151424 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f482000f040 con 0x7f482c0fc700 2024-09-17T07:24:41.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.590+0000 7f483429a640 1 -- 172.21.15.87:0/3322151424 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f482c10e5f0 con 0x7f482c0fc700 2024-09-17T07:24:41.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.590+0000 7f483429a640 1 -- 172.21.15.87:0/3322151424 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f482c10eb90 con 0x7f482c0fc700 2024-09-17T07:24:41.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.590+0000 7f482affd640 1 -- 172.21.15.87:0/3322151424 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f482000d990 con 0x7f482c0fc700 2024-09-17T07:24:41.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.591+0000 7f483429a640 1 -- 172.21.15.87:0/3322151424 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f482c0fa890 con 0x7f482c0fc700 2024-09-17T07:24:41.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.592+0000 7f482affd640 1 -- 172.21.15.87:0/3322151424 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f482000dc20 con 0x7f482c0fc700 2024-09-17T07:24:41.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.593+0000 7f482affd640 1 --2- 172.21.15.87:0/3322151424 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f481406cb90 0x7f481406f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:24:41.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.593+0000 7f482affd640 1 -- 172.21.15.87:0/3322151424 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f482008b8f0 con 0x7f482c0fc700 2024-09-17T07:24:41.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.593+0000 7f4832036640 1 --2- 172.21.15.87:0/3322151424 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f481406cb90 0x7f481406f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:24:41.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.593+0000 7f4832036640 1 --2- 172.21.15.87:0/3322151424 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f481406cb90 0x7f481406f040 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f481c000f80 tx=0x7f481c004d10 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:24:41.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.597+0000 7f482affd640 1 -- 172.21.15.87:0/3322151424 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f4820055990 con 0x7f482c0fc700 2024-09-17T07:24:41.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.774+0000 7f483429a640 1 -- 172.21.15.87:0/3322151424 --> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f482c10ef40 con 0x7f481406cb90 2024-09-17T07:24:41.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.775+0000 7f482affd640 1 -- 172.21.15.87:0/3322151424 <== mgr.24529 v2:172.21.15.87:6800/1359413180 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f482c10ef40 con 0x7f481406cb90 2024-09-17T07:24:41.777 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T07:24:41.777 INFO:teuthology.orchestra.run.smithi087.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9", 2024-09-17T07:24:41.777 INFO:teuthology.orchestra.run.smithi087.stdout: "in_progress": true, 2024-09-17T07:24:41.777 INFO:teuthology.orchestra.run.smithi087.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T07:24:41.777 INFO:teuthology.orchestra.run.smithi087.stdout: "services_complete": [ 2024-09-17T07:24:41.777 INFO:teuthology.orchestra.run.smithi087.stdout: "crash", 2024-09-17T07:24:41.777 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr", 2024-09-17T07:24:41.777 INFO:teuthology.orchestra.run.smithi087.stdout: "mon" 2024-09-17T07:24:41.777 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-17T07:24:41.777 INFO:teuthology.orchestra.run.smithi087.stdout: "progress": "9/21 daemons upgraded", 2024-09-17T07:24:41.777 INFO:teuthology.orchestra.run.smithi087.stdout: "message": "Currently upgrading osd daemons", 2024-09-17T07:24:41.777 INFO:teuthology.orchestra.run.smithi087.stdout: "is_paused": false 2024-09-17T07:24:41.777 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T07:24:41.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.777+0000 7f483429a640 1 -- 172.21.15.87:0/3322151424 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f481406cb90 msgr2=0x7f481406f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:24:41.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.777+0000 7f483429a640 1 --2- 172.21.15.87:0/3322151424 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f481406cb90 0x7f481406f040 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f481c000f80 tx=0x7f481c004d10 comp rx=0 tx=0).stop 2024-09-17T07:24:41.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.777+0000 7f483429a640 1 -- 172.21.15.87:0/3322151424 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f482c0fc700 msgr2=0x7f482c10d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:24:41.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.777+0000 7f483429a640 1 --2- 172.21.15.87:0/3322151424 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f482c0fc700 0x7f482c10d4f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4820002a50 tx=0x7f4820004600 comp rx=0 tx=0).stop 2024-09-17T07:24:41.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.777+0000 7f483429a640 1 -- 172.21.15.87:0/3322151424 shutdown_connections 2024-09-17T07:24:41.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.777+0000 7f483429a640 1 --2- 172.21.15.87:0/3322151424 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f482c0fc700 0x7f482c10d4f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:41.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.778+0000 7f483429a640 1 --2- 172.21.15.87:0/3322151424 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f481406cb90 0x7f481406f040 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:41.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.778+0000 7f483429a640 1 --2- 172.21.15.87:0/3322151424 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f482c0fb430 0x7f482c10cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:41.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.778+0000 7f483429a640 1 -- 172.21.15.87:0/3322151424 >> 172.21.15.87:0/3322151424 conn(0x7f482c0f6c10 msgr2=0x7f482c064f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:24:41.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.778+0000 7f483429a640 1 -- 172.21.15.87:0/3322151424 shutdown_connections 2024-09-17T07:24:41.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.778+0000 7f483429a640 1 -- 172.21.15.87:0/3322151424 wait complete. 2024-09-17T07:24:41.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.854+0000 7fd1ce9e9640 1 -- 172.21.15.87:0/1408154807 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1c8065ba0 msgr2=0x7fd1c80ff1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:24:41.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.854+0000 7fd1ce9e9640 1 --2- 172.21.15.87:0/1408154807 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1c8065ba0 0x7fd1c80ff1e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd1b80048d0 tx=0x7fd1b8009da0 comp rx=0 tx=0).stop 2024-09-17T07:24:41.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.854+0000 7fd1ce9e9640 1 -- 172.21.15.87:0/1408154807 shutdown_connections 2024-09-17T07:24:41.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.854+0000 7fd1ce9e9640 1 --2- 172.21.15.87:0/1408154807 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd1c80ff720 0x7fd1c8101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:41.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.854+0000 7fd1ce9e9640 1 --2- 172.21.15.87:0/1408154807 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1c8065ba0 0x7fd1c80ff1e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:41.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.854+0000 7fd1ce9e9640 1 -- 172.21.15.87:0/1408154807 >> 172.21.15.87:0/1408154807 conn(0x7fd1c80f6c10 msgr2=0x7fd1c80f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:24:41.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.855+0000 7fd1ce9e9640 1 -- 172.21.15.87:0/1408154807 shutdown_connections 2024-09-17T07:24:41.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.855+0000 7fd1ce9e9640 1 -- 172.21.15.87:0/1408154807 wait complete. 2024-09-17T07:24:41.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.855+0000 7fd1ce9e9640 1 Processor -- start 2024-09-17T07:24:41.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.855+0000 7fd1ce9e9640 1 -- start start 2024-09-17T07:24:41.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.855+0000 7fd1ce9e9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd1c8065ba0 0x7fd1c810cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:24:41.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.855+0000 7fd1ce9e9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1c80ff720 0x7fd1c810d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:24:41.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.855+0000 7fd1ce9e9640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c810db80 con 0x7fd1c80ff720 2024-09-17T07:24:41.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.855+0000 7fd1ce9e9640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c810e3a0 con 0x7fd1c8065ba0 2024-09-17T07:24:41.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.856+0000 7fd1c77fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1c80ff720 0x7fd1c810d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:24:41.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.856+0000 7fd1c77fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1c80ff720 0x7fd1c810d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45946/0 (socket says 172.21.15.87:45946) 2024-09-17T07:24:41.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.856+0000 7fd1c77fe640 1 -- 172.21.15.87:0/809394890 learned_addr learned my addr 172.21.15.87:0/809394890 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:24:41.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.856+0000 7fd1c7fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd1c8065ba0 0x7fd1c810cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:24:41.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.856+0000 7fd1c77fe640 1 -- 172.21.15.87:0/809394890 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd1c8065ba0 msgr2=0x7fd1c810cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:24:41.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.856+0000 7fd1c77fe640 1 --2- 172.21.15.87:0/809394890 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd1c8065ba0 0x7fd1c810cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:41.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.856+0000 7fd1c77fe640 1 -- 172.21.15.87:0/809394890 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1b8005040 con 0x7fd1c80ff720 2024-09-17T07:24:41.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.856+0000 7fd1c77fe640 1 --2- 172.21.15.87:0/809394890 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1c80ff720 0x7fd1c810d530 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc002840 tx=0x7fd1bc004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:24:41.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.856+0000 7fd1c4ff9640 1 -- 172.21.15.87:0/809394890 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1bc007c30 con 0x7fd1c80ff720 2024-09-17T07:24:41.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.856+0000 7fd1c4ff9640 1 -- 172.21.15.87:0/809394890 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fd1bc00f040 con 0x7fd1c80ff720 2024-09-17T07:24:41.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.856+0000 7fd1c4ff9640 1 -- 172.21.15.87:0/809394890 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1bc00d900 con 0x7fd1c80ff720 2024-09-17T07:24:41.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.856+0000 7fd1ce9e9640 1 -- 172.21.15.87:0/809394890 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1c810e630 con 0x7fd1c80ff720 2024-09-17T07:24:41.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.856+0000 7fd1ce9e9640 1 -- 172.21.15.87:0/809394890 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1c810ebd0 con 0x7fd1c80ff720 2024-09-17T07:24:41.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.858+0000 7fd1ce9e9640 1 -- 172.21.15.87:0/809394890 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1c80fa890 con 0x7fd1c80ff720 2024-09-17T07:24:41.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.858+0000 7fd1c4ff9640 1 -- 172.21.15.87:0/809394890 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fd1bc00db70 con 0x7fd1c80ff720 2024-09-17T07:24:41.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.858+0000 7fd1c4ff9640 1 --2- 172.21.15.87:0/809394890 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fd1b006cb90 0x7fd1b006f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:24:41.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.859+0000 7fd1c4ff9640 1 -- 172.21.15.87:0/809394890 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fd1bc08be20 con 0x7fd1c80ff720 2024-09-17T07:24:41.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.859+0000 7fd1c7fff640 1 --2- 172.21.15.87:0/809394890 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fd1b006cb90 0x7fd1b006f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:24:41.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.859+0000 7fd1c7fff640 1 --2- 172.21.15.87:0/809394890 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fd1b006cb90 0x7fd1b006f040 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd1b8009ac0 tx=0x7fd1b8035040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:24:41.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:41.863+0000 7fd1c4ff9640 1 -- 172.21.15.87:0/809394890 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd1bc055e30 con 0x7fd1c80ff720 2024-09-17T07:24:42.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:42.085+0000 7fd1ce9e9640 1 -- 172.21.15.87:0/809394890 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fd1c810eee0 con 0x7fd1c80ff720 2024-09-17T07:24:42.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:42.085+0000 7fd1c4ff9640 1 -- 172.21.15.87:0/809394890 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fd1bc059450 con 0x7fd1c80ff720 2024-09-17T07:24:42.087 INFO:teuthology.orchestra.run.smithi087.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T07:24:42.087 INFO:teuthology.orchestra.run.smithi087.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T07:24:42.087 INFO:teuthology.orchestra.run.smithi087.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T07:24:42.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:42.087+0000 7fd1ce9e9640 1 -- 172.21.15.87:0/809394890 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fd1b006cb90 msgr2=0x7fd1b006f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:24:42.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:42.087+0000 7fd1ce9e9640 1 --2- 172.21.15.87:0/809394890 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fd1b006cb90 0x7fd1b006f040 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd1b8009ac0 tx=0x7fd1b8035040 comp rx=0 tx=0).stop 2024-09-17T07:24:42.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:42.087+0000 7fd1ce9e9640 1 -- 172.21.15.87:0/809394890 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1c80ff720 msgr2=0x7fd1c810d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:24:42.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:42.087+0000 7fd1ce9e9640 1 --2- 172.21.15.87:0/809394890 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1c80ff720 0x7fd1c810d530 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc002840 tx=0x7fd1bc004570 comp rx=0 tx=0).stop 2024-09-17T07:24:42.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:42.088+0000 7fd1ce9e9640 1 -- 172.21.15.87:0/809394890 shutdown_connections 2024-09-17T07:24:42.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:42.088+0000 7fd1ce9e9640 1 --2- 172.21.15.87:0/809394890 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1c80ff720 0x7fd1c810d530 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:42.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:42.088+0000 7fd1ce9e9640 1 --2- 172.21.15.87:0/809394890 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fd1b006cb90 0x7fd1b006f040 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:42.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:42.088+0000 7fd1ce9e9640 1 --2- 172.21.15.87:0/809394890 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd1c8065ba0 0x7fd1c810cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:24:42.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:42.088+0000 7fd1ce9e9640 1 -- 172.21.15.87:0/809394890 >> 172.21.15.87:0/809394890 conn(0x7fd1c80f6c10 msgr2=0x7fd1c80f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:24:42.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:42.088+0000 7fd1ce9e9640 1 -- 172.21.15.87:0/809394890 shutdown_connections 2024-09-17T07:24:42.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:24:42.088+0000 7fd1ce9e9640 1 -- 172.21.15.87:0/809394890 wait complete. 2024-09-17T07:24:42.247 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:42 smithi139 ceph-mon[79872]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:24:42.247 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:42 smithi139 ceph-mon[79872]: Upgrade: Updating osd.3 2024-09-17T07:24:42.247 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:42 smithi139 ceph-mon[79872]: Deploying daemon osd.3 on smithi139 2024-09-17T07:24:42.247 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:42 smithi139 ceph-mon[79872]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:24:42.247 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:42 smithi139 ceph-mon[79872]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:24:42.247 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:42 smithi139 ceph-mon[79872]: from='client.? 172.21.15.87:0/3975448539' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:24:42.247 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:42 smithi139 ceph-mon[79872]: from='client.? 172.21.15.87:0/1698155646' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T07:24:42.248 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:42 smithi139 ceph-mon[79872]: from='client.? 172.21.15.87:0/809394890' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T07:24:42.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:42 smithi087 ceph-mon[90982]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:24:42.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:42 smithi087 ceph-mon[90982]: Upgrade: Updating osd.3 2024-09-17T07:24:42.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:42 smithi087 ceph-mon[90982]: Deploying daemon osd.3 on smithi139 2024-09-17T07:24:42.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:42 smithi087 ceph-mon[90982]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:24:42.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:42 smithi087 ceph-mon[90982]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:24:42.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:42 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/3975448539' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:24:42.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:42 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/1698155646' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T07:24:42.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:42 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/809394890' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T07:24:43.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:43 smithi139 ceph-mon[79872]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:24:43.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:43 smithi139 ceph-mon[79872]: pgmap v100: 65 pgs: 65 active+clean; 322 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:24:43.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:24:43.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:43 smithi087 ceph-mon[90982]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:24:43.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:43 smithi087 ceph-mon[90982]: pgmap v100: 65 pgs: 65 active+clean; 322 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:24:43.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:24:43.675 INFO:journalctl@ceph.osd.3.smithi139.stdout:Sep 17 07:24:43 smithi139 systemd[1]: Stopping Ceph osd.3 for d5dbf8d6-74c3-11ef-bceb-c7b262605968... 2024-09-17T07:24:44.116 INFO:journalctl@ceph.osd.3.smithi139.stdout:Sep 17 07:24:43 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-3[39860]: 2024-09-17T07:24:43.705+0000 7f051add7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T07:24:44.116 INFO:journalctl@ceph.osd.3.smithi139.stdout:Sep 17 07:24:43 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-3[39860]: 2024-09-17T07:24:43.705+0000 7f051add7640 -1 osd.3 62 *** Got signal Terminated *** 2024-09-17T07:24:44.116 INFO:journalctl@ceph.osd.3.smithi139.stdout:Sep 17 07:24:43 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-3[39860]: 2024-09-17T07:24:43.705+0000 7f051add7640 -1 osd.3 62 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T07:24:44.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:44 smithi087 ceph-mon[90982]: osd.3 marked itself down and dead 2024-09-17T07:24:44.560 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:44 smithi139 ceph-mon[79872]: osd.3 marked itself down and dead 2024-09-17T07:24:44.866 INFO:journalctl@ceph.osd.3.smithi139.stdout:Sep 17 07:24:44 smithi139 podman[88520]: 2024-09-17 07:24:44.560411351 +0000 UTC m=+0.985363049 container died 0801999b17c4e826f3e5b907ac8255e6809a95b94a3f3921a82a4fda00437d85 (image=quay.ceph.io/ceph-ci/ceph@sha256:c5428a59091f5674ce6e26540d9db0f28844a507e2a324b8305a00f1687ce028, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-3, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=quincy-4a70413, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T07:24:45.169 INFO:journalctl@ceph.osd.3.smithi139.stdout:Sep 17 07:24:44 smithi139 podman[88520]: 2024-09-17 07:24:44.931148484 +0000 UTC m=+1.356100216 container cleanup 0801999b17c4e826f3e5b907ac8255e6809a95b94a3f3921a82a4fda00437d85 (image=quay.ceph.io/ceph-ci/ceph@sha256:c5428a59091f5674ce6e26540d9db0f28844a507e2a324b8305a00f1687ce028, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-3, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=quincy-4a70413) 2024-09-17T07:24:45.169 INFO:journalctl@ceph.osd.3.smithi139.stdout:Sep 17 07:24:44 smithi139 bash[88520]: ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-3 2024-09-17T07:24:45.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:45 smithi087 ceph-mon[90982]: pgmap v101: 65 pgs: 65 active+clean; 322 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:24:45.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:45 smithi087 ceph-mon[90982]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T07:24:45.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:45 smithi087 ceph-mon[90982]: osdmap e63: 6 total, 5 up, 6 in 2024-09-17T07:24:45.532 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:45 smithi139 ceph-mon[79872]: pgmap v101: 65 pgs: 65 active+clean; 322 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:24:45.532 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:45 smithi139 ceph-mon[79872]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T07:24:45.532 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:45 smithi139 ceph-mon[79872]: osdmap e63: 6 total, 5 up, 6 in 2024-09-17T07:24:45.533 INFO:journalctl@ceph.osd.3.smithi139.stdout:Sep 17 07:24:45 smithi139 podman[88544]: 2024-09-17 07:24:45.19937759 +0000 UTC m=+0.640930143 container remove 0801999b17c4e826f3e5b907ac8255e6809a95b94a3f3921a82a4fda00437d85 (image=quay.ceph.io/ceph-ci/ceph@sha256:c5428a59091f5674ce6e26540d9db0f28844a507e2a324b8305a00f1687ce028, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-3, RELEASE=quincy-4a70413, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-17T07:24:45.846 INFO:journalctl@ceph.osd.3.smithi139.stdout:Sep 17 07:24:45 smithi139 podman[88639]: 2024-09-17 07:24:45.435058292 +0000 UTC m=+0.015625398 image pull 980a0bfcd684674f25c08d857ad8de3b1c8ae738870529edbf9aa463832c8d89 quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9 2024-09-17T07:24:45.846 INFO:journalctl@ceph.osd.3.smithi139.stdout:Sep 17 07:24:45 smithi139 podman[88639]: 2024-09-17 07:24:45.548228619 +0000 UTC m=+0.128795711 container create 5bc32a7c7b5a77010d4072e890bb046f7f17d7379347dec3df9f8fae4b185142 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=reef-19e2a2b, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-17T07:24:45.846 INFO:journalctl@ceph.osd.3.smithi139.stdout:Sep 17 07:24:45 smithi139 podman[88639]: 2024-09-17 07:24:45.762818823 +0000 UTC m=+0.343385915 container init 5bc32a7c7b5a77010d4072e890bb046f7f17d7379347dec3df9f8fae4b185142 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=reef-19e2a2b, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T07:24:45.846 INFO:journalctl@ceph.osd.3.smithi139.stdout:Sep 17 07:24:45 smithi139 podman[88639]: 2024-09-17 07:24:45.766204377 +0000 UTC m=+0.346771473 container start 5bc32a7c7b5a77010d4072e890bb046f7f17d7379347dec3df9f8fae4b185142 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=reef-19e2a2b, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-17T07:24:45.846 INFO:journalctl@ceph.osd.3.smithi139.stdout:Sep 17 07:24:45 smithi139 podman[88639]: 2024-09-17 07:24:45.845955147 +0000 UTC m=+0.426522246 container attach 5bc32a7c7b5a77010d4072e890bb046f7f17d7379347dec3df9f8fae4b185142 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=reef-19e2a2b, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T07:24:46.116 INFO:journalctl@ceph.osd.3.smithi139.stdout:Sep 17 07:24:45 smithi139 podman[88639]: 2024-09-17 07:24:45.946277578 +0000 UTC m=+0.526844681 container died 5bc32a7c7b5a77010d4072e890bb046f7f17d7379347dec3df9f8fae4b185142 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=reef-19e2a2b, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T07:24:46.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:46 smithi087 ceph-mon[90982]: osdmap e64: 6 total, 5 up, 6 in 2024-09-17T07:24:46.524 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:46 smithi139 ceph-mon[79872]: osdmap e64: 6 total, 5 up, 6 in 2024-09-17T07:24:46.866 INFO:journalctl@ceph.osd.3.smithi139.stdout:Sep 17 07:24:46 smithi139 podman[88662]: 2024-09-17 07:24:46.524631557 +0000 UTC m=+0.572741827 container remove 5bc32a7c7b5a77010d4072e890bb046f7f17d7379347dec3df9f8fae4b185142 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=reef-19e2a2b, org.label-schema.vendor=CentOS) 2024-09-17T07:24:46.867 INFO:journalctl@ceph.osd.3.smithi139.stdout:Sep 17 07:24:46 smithi139 systemd[1]: ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968@osd.3.service: Deactivated successfully. 2024-09-17T07:24:46.867 INFO:journalctl@ceph.osd.3.smithi139.stdout:Sep 17 07:24:46 smithi139 systemd[1]: Stopped Ceph osd.3 for d5dbf8d6-74c3-11ef-bceb-c7b262605968. 2024-09-17T07:24:46.867 INFO:journalctl@ceph.osd.3.smithi139.stdout:Sep 17 07:24:46 smithi139 systemd[1]: ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968@osd.3.service: Consumed 1min 1.333s CPU time. 2024-09-17T07:24:46.867 INFO:journalctl@ceph.osd.3.smithi139.stdout:Sep 17 07:24:46 smithi139 systemd[1]: Starting Ceph osd.3 for d5dbf8d6-74c3-11ef-bceb-c7b262605968... 2024-09-17T07:24:47.261 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:47 smithi139 ceph-mon[79872]: pgmap v104: 65 pgs: 2 active+undersized, 7 peering, 12 stale+active+clean, 2 active+undersized+degraded, 42 active+clean; 322 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 2 op/s; 4/369 objects degraded (1.084%) 2024-09-17T07:24:47.261 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:47 smithi139 ceph-mon[79872]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-09-17T07:24:47.262 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:47 smithi139 ceph-mon[79872]: Health check failed: Degraded data redundancy: 4/369 objects degraded (1.084%), 2 pgs degraded (PG_DEGRADED) 2024-09-17T07:24:47.262 INFO:journalctl@ceph.osd.3.smithi139.stdout:Sep 17 07:24:46 smithi139 podman[88763]: 2024-09-17 07:24:46.85787656 +0000 UTC m=+0.015738831 image pull 980a0bfcd684674f25c08d857ad8de3b1c8ae738870529edbf9aa463832c8d89 quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9 2024-09-17T07:24:47.262 INFO:journalctl@ceph.osd.3.smithi139.stdout:Sep 17 07:24:46 smithi139 podman[88763]: 2024-09-17 07:24:46.984349987 +0000 UTC m=+0.142212248 container create 3cbf0ee75405b8c55bf1ac7523deabefdf99f861cd08e9d6aeaece3557f5bdf8 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-3-activate, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=reef-19e2a2b, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD) 2024-09-17T07:24:47.262 INFO:journalctl@ceph.osd.3.smithi139.stdout:Sep 17 07:24:47 smithi139 podman[88763]: 2024-09-17 07:24:47.186606076 +0000 UTC m=+0.344468342 container init 3cbf0ee75405b8c55bf1ac7523deabefdf99f861cd08e9d6aeaece3557f5bdf8 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-3-activate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=reef-19e2a2b, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-17T07:24:47.262 INFO:journalctl@ceph.osd.3.smithi139.stdout:Sep 17 07:24:47 smithi139 podman[88763]: 2024-09-17 07:24:47.190051557 +0000 UTC m=+0.347913814 container start 3cbf0ee75405b8c55bf1ac7523deabefdf99f861cd08e9d6aeaece3557f5bdf8 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-3-activate, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=reef-19e2a2b, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T07:24:47.262 INFO:journalctl@ceph.osd.3.smithi139.stdout:Sep 17 07:24:47 smithi139 podman[88763]: 2024-09-17 07:24:47.261579391 +0000 UTC m=+0.419441661 container attach 3cbf0ee75405b8c55bf1ac7523deabefdf99f861cd08e9d6aeaece3557f5bdf8 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-3-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=reef-19e2a2b, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-17T07:24:47.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:47 smithi087 ceph-mon[90982]: pgmap v104: 65 pgs: 2 active+undersized, 7 peering, 12 stale+active+clean, 2 active+undersized+degraded, 42 active+clean; 322 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 2 op/s; 4/369 objects degraded (1.084%) 2024-09-17T07:24:47.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:47 smithi087 ceph-mon[90982]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-09-17T07:24:47.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:47 smithi087 ceph-mon[90982]: Health check failed: Degraded data redundancy: 4/369 objects degraded (1.084%), 2 pgs degraded (PG_DEGRADED) 2024-09-17T07:24:47.512 INFO:journalctl@ceph.osd.3.smithi139.stdout:Sep 17 07:24:47 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-3-activate[88778]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-17T07:24:47.513 INFO:journalctl@ceph.osd.3.smithi139.stdout:Sep 17 07:24:47 smithi139 bash[88763]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-17T07:24:47.513 INFO:journalctl@ceph.osd.3.smithi139.stdout:Sep 17 07:24:47 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-3-activate[88778]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-17T07:24:47.513 INFO:journalctl@ceph.osd.3.smithi139.stdout:Sep 17 07:24:47 smithi139 bash[88763]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-17T07:24:47.513 INFO:journalctl@ceph.osd.3.smithi139.stdout:Sep 17 07:24:47 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-3-activate[88778]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-17T07:24:47.513 INFO:journalctl@ceph.osd.3.smithi139.stdout:Sep 17 07:24:47 smithi139 bash[88763]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-17T07:24:47.513 INFO:journalctl@ceph.osd.3.smithi139.stdout:Sep 17 07:24:47 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-3-activate[88778]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-17T07:24:47.513 INFO:journalctl@ceph.osd.3.smithi139.stdout:Sep 17 07:24:47 smithi139 bash[88763]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-17T07:24:47.513 INFO:journalctl@ceph.osd.3.smithi139.stdout:Sep 17 07:24:47 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-3-activate[88778]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-09-17T07:24:47.513 INFO:journalctl@ceph.osd.3.smithi139.stdout:Sep 17 07:24:47 smithi139 bash[88763]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-09-17T07:24:47.513 INFO:journalctl@ceph.osd.3.smithi139.stdout:Sep 17 07:24:47 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-3-activate[88778]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-17T07:24:47.513 INFO:journalctl@ceph.osd.3.smithi139.stdout:Sep 17 07:24:47 smithi139 bash[88763]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-17T07:24:47.866 INFO:journalctl@ceph.osd.3.smithi139.stdout:Sep 17 07:24:47 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-3-activate[88778]: --> ceph-volume raw activate successful for osd ID: 3 2024-09-17T07:24:47.866 INFO:journalctl@ceph.osd.3.smithi139.stdout:Sep 17 07:24:47 smithi139 bash[88763]: --> ceph-volume raw activate successful for osd ID: 3 2024-09-17T07:24:47.867 INFO:journalctl@ceph.osd.3.smithi139.stdout:Sep 17 07:24:47 smithi139 podman[88763]: 2024-09-17 07:24:47.532905977 +0000 UTC m=+0.690768248 container died 3cbf0ee75405b8c55bf1ac7523deabefdf99f861cd08e9d6aeaece3557f5bdf8 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-3-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, RELEASE=reef-19e2a2b, maintainer=Guillaume Abrioux , ceph=True) 2024-09-17T07:24:48.489 INFO:journalctl@ceph.osd.3.smithi139.stdout:Sep 17 07:24:48 smithi139 podman[88899]: 2024-09-17 07:24:48.157809265 +0000 UTC m=+0.619044007 container remove 3cbf0ee75405b8c55bf1ac7523deabefdf99f861cd08e9d6aeaece3557f5bdf8 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-3-activate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=reef-19e2a2b, maintainer=Guillaume Abrioux ) 2024-09-17T07:24:48.489 INFO:journalctl@ceph.osd.3.smithi139.stdout:Sep 17 07:24:48 smithi139 podman[88957]: 2024-09-17 07:24:48.264898293 +0000 UTC m=+0.015843286 image pull 980a0bfcd684674f25c08d857ad8de3b1c8ae738870529edbf9aa463832c8d89 quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9 2024-09-17T07:24:48.489 INFO:journalctl@ceph.osd.3.smithi139.stdout:Sep 17 07:24:48 smithi139 podman[88957]: 2024-09-17 07:24:48.383639344 +0000 UTC m=+0.134584326 container create b05ed3bf3f5c5d4bd3e4d46f44d573d37d8625e73b86938d988cfdcbacf86ec2 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-3, ceph=True, GIT_BRANCH=HEAD, RELEASE=reef-19e2a2b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2) 2024-09-17T07:24:48.866 INFO:journalctl@ceph.osd.3.smithi139.stdout:Sep 17 07:24:48 smithi139 podman[88957]: 2024-09-17 07:24:48.586536758 +0000 UTC m=+0.337481746 container init b05ed3bf3f5c5d4bd3e4d46f44d573d37d8625e73b86938d988cfdcbacf86ec2 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-3, RELEASE=reef-19e2a2b, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-17T07:24:48.866 INFO:journalctl@ceph.osd.3.smithi139.stdout:Sep 17 07:24:48 smithi139 podman[88957]: 2024-09-17 07:24:48.589703661 +0000 UTC m=+0.340648644 container start b05ed3bf3f5c5d4bd3e4d46f44d573d37d8625e73b86938d988cfdcbacf86ec2 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-3, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=reef-19e2a2b, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2) 2024-09-17T07:24:48.866 INFO:journalctl@ceph.osd.3.smithi139.stdout:Sep 17 07:24:48 smithi139 bash[88957]: b05ed3bf3f5c5d4bd3e4d46f44d573d37d8625e73b86938d988cfdcbacf86ec2 2024-09-17T07:24:48.866 INFO:journalctl@ceph.osd.3.smithi139.stdout:Sep 17 07:24:48 smithi139 systemd[1]: Started Ceph osd.3 for d5dbf8d6-74c3-11ef-bceb-c7b262605968. 2024-09-17T07:24:49.417 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:49 smithi139 ceph-mon[79872]: pgmap v105: 65 pgs: 5 active+undersized, 7 peering, 10 stale+active+clean, 8 active+undersized+degraded, 35 active+clean; 322 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 25/369 objects degraded (6.775%) 2024-09-17T07:24:49.417 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:49 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:24:49.417 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:49 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:24:49.417 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:49 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:24:49.417 INFO:journalctl@ceph.osd.3.smithi139.stdout:Sep 17 07:24:49 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-3[88972]: 2024-09-17T07:24:49.125+0000 7f7598324640 -1 Falling back to public interface 2024-09-17T07:24:49.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:49 smithi087 ceph-mon[90982]: pgmap v105: 65 pgs: 5 active+undersized, 7 peering, 10 stale+active+clean, 8 active+undersized+degraded, 35 active+clean; 322 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 25/369 objects degraded (6.775%) 2024-09-17T07:24:49.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:49 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:24:49.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:49 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:24:49.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:49 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:24:50.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:50 smithi139 ceph-mon[79872]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-09-17T07:24:50.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:50 smithi087 ceph-mon[90982]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-09-17T07:24:51.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:51 smithi139 ceph-mon[79872]: pgmap v106: 65 pgs: 18 active+undersized, 20 active+undersized+degraded, 27 active+clean; 322 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 78/369 objects degraded (21.138%) 2024-09-17T07:24:51.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:51 smithi087 ceph-mon[90982]: pgmap v106: 65 pgs: 18 active+undersized, 20 active+undersized+degraded, 27 active+clean; 322 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 78/369 objects degraded (21.138%) 2024-09-17T07:24:52.587 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:52 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:24:52.587 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:52 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:24:52.587 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:52 smithi139 ceph-mon[79872]: Health check update: Degraded data redundancy: 78/369 objects degraded (21.138%), 20 pgs degraded (PG_DEGRADED) 2024-09-17T07:24:52.588 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:52 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:24:52.588 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:52 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:24:52.588 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:52 smithi139 ceph-mon[79872]: pgmap v107: 65 pgs: 18 active+undersized, 20 active+undersized+degraded, 27 active+clean; 322 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 78/369 objects degraded (21.138%) 2024-09-17T07:24:52.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:52 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:24:52.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:52 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:24:52.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:52 smithi087 ceph-mon[90982]: Health check update: Degraded data redundancy: 78/369 objects degraded (21.138%), 20 pgs degraded (PG_DEGRADED) 2024-09-17T07:24:52.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:52 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:24:52.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:52 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:24:52.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:52 smithi087 ceph-mon[90982]: pgmap v107: 65 pgs: 18 active+undersized, 20 active+undersized+degraded, 27 active+clean; 322 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 78/369 objects degraded (21.138%) 2024-09-17T07:24:54.116 INFO:journalctl@ceph.osd.3.smithi139.stdout:Sep 17 07:24:53 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-3[88972]: 2024-09-17T07:24:53.992+0000 7f7598324640 -1 osd.3 62 log_to_monitors true 2024-09-17T07:24:54.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:54 smithi139 ceph-mon[79872]: from='osd.3 [v2:172.21.15.139:6800/3281602359,v1:172.21.15.139:6801/3281602359]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-17T07:24:54.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:54 smithi139 ceph-mon[79872]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-17T07:24:54.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:54 smithi087 ceph-mon[90982]: from='osd.3 [v2:172.21.15.139:6800/3281602359,v1:172.21.15.139:6801/3281602359]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-17T07:24:54.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:54 smithi087 ceph-mon[90982]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-17T07:24:55.116 INFO:journalctl@ceph.osd.3.smithi139.stdout:Sep 17 07:24:54 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-3[88972]: 2024-09-17T07:24:54.916+0000 7f758c0b5640 -1 osd.3 62 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T07:24:55.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:55 smithi139 ceph-mon[79872]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-17T07:24:55.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:55 smithi139 ceph-mon[79872]: osdmap e65: 6 total, 5 up, 6 in 2024-09-17T07:24:55.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:55 smithi139 ceph-mon[79872]: from='osd.3 [v2:172.21.15.139:6800/3281602359,v1:172.21.15.139:6801/3281602359]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-09-17T07:24:55.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:55 smithi139 ceph-mon[79872]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-09-17T07:24:55.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:55 smithi139 ceph-mon[79872]: pgmap v109: 65 pgs: 18 active+undersized, 20 active+undersized+degraded, 27 active+clean; 322 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 78/369 objects degraded (21.138%) 2024-09-17T07:24:55.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:55 smithi139 ceph-mon[79872]: from='osd.3 ' entity='osd.3' 2024-09-17T07:24:55.326 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:55 smithi087 ceph-mon[90982]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-17T07:24:55.326 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:55 smithi087 ceph-mon[90982]: osdmap e65: 6 total, 5 up, 6 in 2024-09-17T07:24:55.326 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:55 smithi087 ceph-mon[90982]: from='osd.3 [v2:172.21.15.139:6800/3281602359,v1:172.21.15.139:6801/3281602359]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-09-17T07:24:55.326 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:55 smithi087 ceph-mon[90982]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-09-17T07:24:55.326 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:55 smithi087 ceph-mon[90982]: pgmap v109: 65 pgs: 18 active+undersized, 20 active+undersized+degraded, 27 active+clean; 322 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 78/369 objects degraded (21.138%) 2024-09-17T07:24:55.326 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:55 smithi087 ceph-mon[90982]: from='osd.3 ' entity='osd.3' 2024-09-17T07:24:56.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:56 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:24:56.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:56 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:24:56.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:56 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:24:56.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:56 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:24:56.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:56 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:24:56.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:56 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:24:56.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:56 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:24:56.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:56 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:24:56.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:56 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:24:56.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:56 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-17T07:24:56.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:56 smithi139 ceph-mon[79872]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T07:24:56.618 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:56 smithi139 ceph-mon[79872]: osd.3 [v2:172.21.15.139:6800/3281602359,v1:172.21.15.139:6801/3281602359] boot 2024-09-17T07:24:56.618 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:56 smithi139 ceph-mon[79872]: osdmap e66: 6 total, 6 up, 6 in 2024-09-17T07:24:56.618 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:56 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T07:24:56.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:56 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:24:56.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:56 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:24:56.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:56 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:24:56.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:56 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:24:56.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:56 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:24:56.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:56 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:24:56.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:56 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:24:56.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:56 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:24:56.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:56 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:24:56.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:56 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-17T07:24:56.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:56 smithi087 ceph-mon[90982]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T07:24:56.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:56 smithi087 ceph-mon[90982]: osd.3 [v2:172.21.15.139:6800/3281602359,v1:172.21.15.139:6801/3281602359] boot 2024-09-17T07:24:56.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:56 smithi087 ceph-mon[90982]: osdmap e66: 6 total, 6 up, 6 in 2024-09-17T07:24:56.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:56 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T07:24:57.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:57 smithi139 ceph-mon[79872]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-17T07:24:57.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:57 smithi139 ceph-mon[79872]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-09-17T07:24:57.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:57 smithi139 ceph-mon[79872]: pgmap v111: 65 pgs: 18 active+undersized, 20 active+undersized+degraded, 27 active+clean; 322 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 78/369 objects degraded (21.138%) 2024-09-17T07:24:57.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:57 smithi139 ceph-mon[79872]: osdmap e67: 6 total, 6 up, 6 in 2024-09-17T07:24:57.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:57 smithi087 ceph-mon[90982]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-17T07:24:57.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:57 smithi087 ceph-mon[90982]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-09-17T07:24:57.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:57 smithi087 ceph-mon[90982]: pgmap v111: 65 pgs: 18 active+undersized, 20 active+undersized+degraded, 27 active+clean; 322 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 78/369 objects degraded (21.138%) 2024-09-17T07:24:57.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:57 smithi087 ceph-mon[90982]: osdmap e67: 6 total, 6 up, 6 in 2024-09-17T07:24:59.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:59 smithi139 ceph-mon[79872]: pgmap v113: 65 pgs: 15 active+undersized, 16 active+undersized+degraded, 34 active+clean; 322 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 65/369 objects degraded (17.615%) 2024-09-17T07:24:59.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:59 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:24:59.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:59 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:24:59.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:24:59 smithi139 ceph-mon[79872]: Health check update: Degraded data redundancy: 65/369 objects degraded (17.615%), 16 pgs degraded (PG_DEGRADED) 2024-09-17T07:24:59.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:59 smithi087 ceph-mon[90982]: pgmap v113: 65 pgs: 15 active+undersized, 16 active+undersized+degraded, 34 active+clean; 322 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 65/369 objects degraded (17.615%) 2024-09-17T07:24:59.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:59 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:24:59.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:59 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:24:59.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:24:59 smithi087 ceph-mon[90982]: Health check update: Degraded data redundancy: 65/369 objects degraded (17.615%), 16 pgs degraded (PG_DEGRADED) 2024-09-17T07:25:01.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:01 smithi139 ceph-mon[79872]: pgmap v114: 65 pgs: 1 active+undersized, 2 active+undersized+degraded, 62 active+clean; 322 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.0 KiB/s rd, 5 op/s; 4/369 objects degraded (1.084%) 2024-09-17T07:25:01.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:01 smithi087 ceph-mon[90982]: pgmap v114: 65 pgs: 1 active+undersized, 2 active+undersized+degraded, 62 active+clean; 322 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.0 KiB/s rd, 5 op/s; 4/369 objects degraded (1.084%) 2024-09-17T07:25:02.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:02 smithi087 ceph-mon[90982]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 4/369 objects degraded (1.084%), 2 pgs degraded) 2024-09-17T07:25:02.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:02 smithi139 ceph-mon[79872]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 4/369 objects degraded (1.084%), 2 pgs degraded) 2024-09-17T07:25:03.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:03 smithi087 ceph-mon[90982]: pgmap v115: 65 pgs: 65 active+clean; 322 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-17T07:25:03.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:03 smithi139 ceph-mon[79872]: pgmap v115: 65 pgs: 65 active+clean; 322 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-17T07:25:05.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:05 smithi087 ceph-mon[90982]: pgmap v116: 65 pgs: 65 active+clean; 322 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s 2024-09-17T07:25:05.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:05 smithi139 ceph-mon[79872]: pgmap v116: 65 pgs: 65 active+clean; 322 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s 2024-09-17T07:25:07.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:07 smithi087 ceph-mon[90982]: pgmap v117: 65 pgs: 65 active+clean; 322 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2024-09-17T07:25:07.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:07 smithi139 ceph-mon[79872]: pgmap v117: 65 pgs: 65 active+clean; 322 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2024-09-17T07:25:09.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:09 smithi087 ceph-mon[90982]: pgmap v118: 65 pgs: 65 active+clean; 322 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-17T07:25:09.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:09 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:25:09.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:09 smithi139 ceph-mon[79872]: pgmap v118: 65 pgs: 65 active+clean; 322 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-17T07:25:09.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:09 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:25:11.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:11 smithi139 ceph-mon[79872]: pgmap v119: 65 pgs: 65 active+clean; 322 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s rd, 4 op/s 2024-09-17T07:25:11.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:11 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-17T07:25:11.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:11 smithi087 ceph-mon[90982]: pgmap v119: 65 pgs: 65 active+clean; 322 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s rd, 4 op/s 2024-09-17T07:25:11.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:11 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-17T07:25:12.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.179+0000 7f50852f1640 1 -- 172.21.15.87:0/177978588 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50800fdba0 msgr2=0x7f50800fdfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:25:12.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.179+0000 7f50852f1640 1 --2- 172.21.15.87:0/177978588 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50800fdba0 0x7f50800fdfb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5070009c50 tx=0x7f5070004d10 comp rx=0 tx=0).stop 2024-09-17T07:25:12.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.179+0000 7f50852f1640 1 -- 172.21.15.87:0/177978588 shutdown_connections 2024-09-17T07:25:12.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.179+0000 7f50852f1640 1 --2- 172.21.15.87:0/177978588 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f50800fe4f0 0x7f50800fa650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:12.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.179+0000 7f50852f1640 1 --2- 172.21.15.87:0/177978588 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50800fdba0 0x7f50800fdfb0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:12.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.179+0000 7f50852f1640 1 -- 172.21.15.87:0/177978588 >> 172.21.15.87:0/177978588 conn(0x7f50800f63a0 msgr2=0x7f50800f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:25:12.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.179+0000 7f50852f1640 1 -- 172.21.15.87:0/177978588 shutdown_connections 2024-09-17T07:25:12.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.179+0000 7f50852f1640 1 -- 172.21.15.87:0/177978588 wait complete. 2024-09-17T07:25:12.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.180+0000 7f50852f1640 1 Processor -- start 2024-09-17T07:25:12.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.180+0000 7f50852f1640 1 -- start start 2024-09-17T07:25:12.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.180+0000 7f50852f1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50800fdba0 0x7f508010cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:25:12.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.180+0000 7f50852f1640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f50800fe4f0 0x7f508010d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:25:12.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.180+0000 7f50852f1640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f508010db70 con 0x7f50800fdba0 2024-09-17T07:25:12.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.180+0000 7f50852f1640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f508010e390 con 0x7f50800fe4f0 2024-09-17T07:25:12.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.180+0000 7f507effd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50800fdba0 0x7f508010cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:25:12.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.180+0000 7f507effd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50800fdba0 0x7f508010cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:58328/0 (socket says 172.21.15.87:58328) 2024-09-17T07:25:12.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.180+0000 7f507effd640 1 -- 172.21.15.87:0/3283736963 learned_addr learned my addr 172.21.15.87:0/3283736963 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:25:12.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.180+0000 7f507e7fc640 1 --2- 172.21.15.87:0/3283736963 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f50800fe4f0 0x7f508010d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:25:12.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.180+0000 7f507effd640 1 -- 172.21.15.87:0/3283736963 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f50800fe4f0 msgr2=0x7f508010d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:25:12.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.180+0000 7f507effd640 1 --2- 172.21.15.87:0/3283736963 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f50800fe4f0 0x7f508010d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:12.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.180+0000 7f507effd640 1 -- 172.21.15.87:0/3283736963 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50700098b0 con 0x7f50800fdba0 2024-09-17T07:25:12.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.181+0000 7f507effd640 1 --2- 172.21.15.87:0/3283736963 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50800fdba0 0x7f508010cfe0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5070004750 tx=0x7f5070004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:25:12.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.181+0000 7f50677fe640 1 -- 172.21.15.87:0/3283736963 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5070032750 con 0x7f50800fdba0 2024-09-17T07:25:12.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.181+0000 7f50852f1640 1 -- 172.21.15.87:0/3283736963 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f508010e5c0 con 0x7f50800fdba0 2024-09-17T07:25:12.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.181+0000 7f50677fe640 1 -- 172.21.15.87:0/3283736963 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f5070009710 con 0x7f50800fdba0 2024-09-17T07:25:12.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.181+0000 7f50677fe640 1 -- 172.21.15.87:0/3283736963 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f507003dab0 con 0x7f50800fdba0 2024-09-17T07:25:12.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.181+0000 7f50852f1640 1 -- 172.21.15.87:0/3283736963 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f508010eb60 con 0x7f50800fdba0 2024-09-17T07:25:12.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.182+0000 7f50852f1640 1 -- 172.21.15.87:0/3283736963 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50800fa040 con 0x7f50800fdba0 2024-09-17T07:25:12.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.182+0000 7f50677fe640 1 -- 172.21.15.87:0/3283736963 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f507002f030 con 0x7f50800fdba0 2024-09-17T07:25:12.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.183+0000 7f50677fe640 1 --2- 172.21.15.87:0/3283736963 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f506806cb90 0x7f506806f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:25:12.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.183+0000 7f50677fe640 1 -- 172.21.15.87:0/3283736963 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f50700ad710 con 0x7f50800fdba0 2024-09-17T07:25:12.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.183+0000 7f507e7fc640 1 --2- 172.21.15.87:0/3283736963 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f506806cb90 0x7f506806f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:25:12.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.183+0000 7f507e7fc640 1 --2- 172.21.15.87:0/3283736963 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f506806cb90 0x7f506806f040 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f508010cd90 tx=0x7f507400b040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:25:12.188 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.187+0000 7f50677fe640 1 -- 172.21.15.87:0/3283736963 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5070077720 con 0x7f50800fdba0 2024-09-17T07:25:12.301 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:12 smithi139 ceph-mon[79872]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-17T07:25:12.301 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:12 smithi139 ceph-mon[79872]: Upgrade: osd.4 is safe to restart 2024-09-17T07:25:12.301 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:12 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:25:12.301 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:12 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-17T07:25:12.302 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:12 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:25:12.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.367+0000 7f50852f1640 1 -- 172.21.15.87:0/3283736963 --> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f508010ee30 con 0x7f506806cb90 2024-09-17T07:25:12.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.368+0000 7f50677fe640 1 -- 172.21.15.87:0/3283736963 <== mgr.24529 v2:172.21.15.87:6800/1359413180 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f508010ee30 con 0x7f506806cb90 2024-09-17T07:25:12.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.370+0000 7f50852f1640 1 -- 172.21.15.87:0/3283736963 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f506806cb90 msgr2=0x7f506806f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:25:12.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.370+0000 7f50852f1640 1 --2- 172.21.15.87:0/3283736963 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f506806cb90 0x7f506806f040 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f508010cd90 tx=0x7f507400b040 comp rx=0 tx=0).stop 2024-09-17T07:25:12.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.370+0000 7f50852f1640 1 -- 172.21.15.87:0/3283736963 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50800fdba0 msgr2=0x7f508010cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:25:12.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.370+0000 7f50852f1640 1 --2- 172.21.15.87:0/3283736963 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50800fdba0 0x7f508010cfe0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5070004750 tx=0x7f5070004d10 comp rx=0 tx=0).stop 2024-09-17T07:25:12.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.370+0000 7f50852f1640 1 -- 172.21.15.87:0/3283736963 shutdown_connections 2024-09-17T07:25:12.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.370+0000 7f50852f1640 1 --2- 172.21.15.87:0/3283736963 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f506806cb90 0x7f506806f040 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:12.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.370+0000 7f50852f1640 1 --2- 172.21.15.87:0/3283736963 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f50800fe4f0 0x7f508010d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:12.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.370+0000 7f50852f1640 1 --2- 172.21.15.87:0/3283736963 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50800fdba0 0x7f508010cfe0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:12.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.370+0000 7f50852f1640 1 -- 172.21.15.87:0/3283736963 >> 172.21.15.87:0/3283736963 conn(0x7f50800f63a0 msgr2=0x7f50800f7c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:25:12.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.371+0000 7f50852f1640 1 -- 172.21.15.87:0/3283736963 shutdown_connections 2024-09-17T07:25:12.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.371+0000 7f50852f1640 1 -- 172.21.15.87:0/3283736963 wait complete. 2024-09-17T07:25:12.381 INFO:teuthology.orchestra.run.smithi087.stdout:true 2024-09-17T07:25:12.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:12 smithi087 ceph-mon[90982]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-17T07:25:12.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:12 smithi087 ceph-mon[90982]: Upgrade: osd.4 is safe to restart 2024-09-17T07:25:12.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:12 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:25:12.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:12 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-17T07:25:12.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:12 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:25:12.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.451+0000 7f6c4086c640 1 -- 172.21.15.87:0/3392147830 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6c3c0fd820 msgr2=0x7f6c3c0fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:25:12.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.451+0000 7f6c4086c640 1 --2- 172.21.15.87:0/3392147830 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6c3c0fd820 0x7f6c3c0fdc90 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6c300048d0 tx=0x7f6c30009da0 comp rx=0 tx=0).stop 2024-09-17T07:25:12.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.451+0000 7f6c4086c640 1 -- 172.21.15.87:0/3392147830 shutdown_connections 2024-09-17T07:25:12.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.451+0000 7f6c4086c640 1 --2- 172.21.15.87:0/3392147830 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6c3c0fd820 0x7f6c3c0fdc90 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:12.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.451+0000 7f6c4086c640 1 --2- 172.21.15.87:0/3392147830 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6c3c0fc550 0x7f6c3c0fc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:12.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.451+0000 7f6c4086c640 1 -- 172.21.15.87:0/3392147830 >> 172.21.15.87:0/3392147830 conn(0x7f6c3c0f7d30 msgr2=0x7f6c3c0fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:25:12.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.451+0000 7f6c4086c640 1 -- 172.21.15.87:0/3392147830 shutdown_connections 2024-09-17T07:25:12.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.451+0000 7f6c4086c640 1 -- 172.21.15.87:0/3392147830 wait complete. 2024-09-17T07:25:12.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.451+0000 7f6c4086c640 1 Processor -- start 2024-09-17T07:25:12.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.451+0000 7f6c4086c640 1 -- start start 2024-09-17T07:25:12.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.451+0000 7f6c4086c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6c3c0fc550 0x7f6c3c10d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:25:12.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.451+0000 7f6c4086c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6c3c0fd820 0x7f6c3c10d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:25:12.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.451+0000 7f6c4086c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3c10e3f0 con 0x7f6c3c0fc550 2024-09-17T07:25:12.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.451+0000 7f6c4086c640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3c10e560 con 0x7f6c3c0fd820 2024-09-17T07:25:12.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.452+0000 7f6c3a59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6c3c0fc550 0x7f6c3c10d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:25:12.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.452+0000 7f6c3a59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6c3c0fc550 0x7f6c3c10d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:58344/0 (socket says 172.21.15.87:58344) 2024-09-17T07:25:12.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.452+0000 7f6c3a59c640 1 -- 172.21.15.87:0/4242332956 learned_addr learned my addr 172.21.15.87:0/4242332956 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:25:12.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.452+0000 7f6c39d9b640 1 --2- 172.21.15.87:0/4242332956 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6c3c0fd820 0x7f6c3c10d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:25:12.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.452+0000 7f6c3a59c640 1 -- 172.21.15.87:0/4242332956 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6c3c0fd820 msgr2=0x7f6c3c10d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:25:12.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.452+0000 7f6c3a59c640 1 --2- 172.21.15.87:0/4242332956 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6c3c0fd820 0x7f6c3c10d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:12.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.452+0000 7f6c3a59c640 1 -- 172.21.15.87:0/4242332956 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c30005040 con 0x7f6c3c0fc550 2024-09-17T07:25:12.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.452+0000 7f6c3a59c640 1 --2- 172.21.15.87:0/4242332956 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6c3c0fc550 0x7f6c3c10d040 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c00b790 tx=0x7f6c2c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:25:12.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.452+0000 7f6c2affd640 1 -- 172.21.15.87:0/4242332956 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c2c00c700 con 0x7f6c3c0fc550 2024-09-17T07:25:12.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.452+0000 7f6c4086c640 1 -- 172.21.15.87:0/4242332956 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c3c10e840 con 0x7f6c3c0fc550 2024-09-17T07:25:12.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.452+0000 7f6c2affd640 1 -- 172.21.15.87:0/4242332956 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f6c2c00cce0 con 0x7f6c3c0fc550 2024-09-17T07:25:12.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.452+0000 7f6c2affd640 1 -- 172.21.15.87:0/4242332956 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c2c015e30 con 0x7f6c3c0fc550 2024-09-17T07:25:12.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.452+0000 7f6c4086c640 1 -- 172.21.15.87:0/4242332956 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c3c10ed30 con 0x7f6c3c0fc550 2024-09-17T07:25:12.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.453+0000 7f6c4086c640 1 -- 172.21.15.87:0/4242332956 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c3c10dc60 con 0x7f6c3c0fc550 2024-09-17T07:25:12.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.454+0000 7f6c2affd640 1 -- 172.21.15.87:0/4242332956 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f6c2c012070 con 0x7f6c3c0fc550 2024-09-17T07:25:12.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.454+0000 7f6c2affd640 1 --2- 172.21.15.87:0/4242332956 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f6c2406cb90 0x7f6c2406f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:25:12.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.454+0000 7f6c2affd640 1 -- 172.21.15.87:0/4242332956 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f6c2c08b940 con 0x7f6c3c0fc550 2024-09-17T07:25:12.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.454+0000 7f6c39d9b640 1 --2- 172.21.15.87:0/4242332956 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f6c2406cb90 0x7f6c2406f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:25:12.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.455+0000 7f6c39d9b640 1 --2- 172.21.15.87:0/4242332956 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f6c2406cb90 0x7f6c2406f040 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6c30000c00 tx=0x7f6c30035040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:25:12.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.458+0000 7f6c2affd640 1 -- 172.21.15.87:0/4242332956 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f6c2c055950 con 0x7f6c3c0fc550 2024-09-17T07:25:12.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.633+0000 7f6c4086c640 1 -- 172.21.15.87:0/4242332956 --> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6c3c10efb0 con 0x7f6c2406cb90 2024-09-17T07:25:12.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.634+0000 7f6c2affd640 1 -- 172.21.15.87:0/4242332956 <== mgr.24529 v2:172.21.15.87:6800/1359413180 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f6c3c10efb0 con 0x7f6c2406cb90 2024-09-17T07:25:12.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.636+0000 7f6c4086c640 1 -- 172.21.15.87:0/4242332956 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f6c2406cb90 msgr2=0x7f6c2406f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:25:12.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.636+0000 7f6c4086c640 1 --2- 172.21.15.87:0/4242332956 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f6c2406cb90 0x7f6c2406f040 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6c30000c00 tx=0x7f6c30035040 comp rx=0 tx=0).stop 2024-09-17T07:25:12.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.636+0000 7f6c4086c640 1 -- 172.21.15.87:0/4242332956 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6c3c0fc550 msgr2=0x7f6c3c10d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:25:12.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.636+0000 7f6c4086c640 1 --2- 172.21.15.87:0/4242332956 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6c3c0fc550 0x7f6c3c10d040 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c00b790 tx=0x7f6c2c0091d0 comp rx=0 tx=0).stop 2024-09-17T07:25:12.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.636+0000 7f6c4086c640 1 -- 172.21.15.87:0/4242332956 shutdown_connections 2024-09-17T07:25:12.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.636+0000 7f6c4086c640 1 --2- 172.21.15.87:0/4242332956 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f6c2406cb90 0x7f6c2406f040 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:12.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.636+0000 7f6c4086c640 1 --2- 172.21.15.87:0/4242332956 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6c3c0fd820 0x7f6c3c10d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:12.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.636+0000 7f6c4086c640 1 --2- 172.21.15.87:0/4242332956 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6c3c0fc550 0x7f6c3c10d040 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:12.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.636+0000 7f6c4086c640 1 -- 172.21.15.87:0/4242332956 >> 172.21.15.87:0/4242332956 conn(0x7f6c3c0f7d30 msgr2=0x7f6c3c0f9590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:25:12.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.636+0000 7f6c4086c640 1 -- 172.21.15.87:0/4242332956 shutdown_connections 2024-09-17T07:25:12.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.636+0000 7f6c4086c640 1 -- 172.21.15.87:0/4242332956 wait complete. 2024-09-17T07:25:12.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.714+0000 7f26c41a9640 1 -- 172.21.15.87:0/1891903120 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f26bc0fd820 msgr2=0x7f26bc0fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:25:12.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.714+0000 7f26c41a9640 1 --2- 172.21.15.87:0/1891903120 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f26bc0fd820 0x7f26bc0fdc90 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f26b00048d0 tx=0x7f26b0009da0 comp rx=0 tx=0).stop 2024-09-17T07:25:12.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.714+0000 7f26c41a9640 1 -- 172.21.15.87:0/1891903120 shutdown_connections 2024-09-17T07:25:12.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.714+0000 7f26c41a9640 1 --2- 172.21.15.87:0/1891903120 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f26bc0fd820 0x7f26bc0fdc90 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:12.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.714+0000 7f26c41a9640 1 --2- 172.21.15.87:0/1891903120 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f26bc0fc550 0x7f26bc0fc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:12.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.715+0000 7f26c41a9640 1 -- 172.21.15.87:0/1891903120 >> 172.21.15.87:0/1891903120 conn(0x7f26bc0f7d30 msgr2=0x7f26bc0fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:25:12.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.715+0000 7f26c41a9640 1 -- 172.21.15.87:0/1891903120 shutdown_connections 2024-09-17T07:25:12.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.715+0000 7f26c41a9640 1 -- 172.21.15.87:0/1891903120 wait complete. 2024-09-17T07:25:12.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.715+0000 7f26c41a9640 1 Processor -- start 2024-09-17T07:25:12.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.715+0000 7f26c41a9640 1 -- start start 2024-09-17T07:25:12.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.716+0000 7f26c41a9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f26bc0fc550 0x7f26bc10cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:25:12.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.716+0000 7f26c41a9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f26bc0fd820 0x7f26bc10d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:25:12.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.716+0000 7f26c41a9640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26bc10db60 con 0x7f26bc0fd820 2024-09-17T07:25:12.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.716+0000 7f26c41a9640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26bc10e380 con 0x7f26bc0fc550 2024-09-17T07:25:12.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.716+0000 7f26c1744640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f26bc0fd820 0x7f26bc10d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:25:12.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.716+0000 7f26c1f45640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f26bc0fc550 0x7f26bc10cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:25:12.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.716+0000 7f26c1744640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f26bc0fd820 0x7f26bc10d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:58358/0 (socket says 172.21.15.87:58358) 2024-09-17T07:25:12.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.716+0000 7f26c1744640 1 -- 172.21.15.87:0/2181320862 learned_addr learned my addr 172.21.15.87:0/2181320862 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:25:12.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.716+0000 7f26c1f45640 1 -- 172.21.15.87:0/2181320862 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f26bc0fd820 msgr2=0x7f26bc10d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:25:12.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.716+0000 7f26c1f45640 1 --2- 172.21.15.87:0/2181320862 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f26bc0fd820 0x7f26bc10d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:12.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.716+0000 7f26c1f45640 1 -- 172.21.15.87:0/2181320862 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26b0005040 con 0x7f26bc0fc550 2024-09-17T07:25:12.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.716+0000 7f26c1744640 1 --2- 172.21.15.87:0/2181320862 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f26bc0fd820 0x7f26bc10d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T07:25:12.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.716+0000 7f26c1f45640 1 --2- 172.21.15.87:0/2181320862 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f26bc0fc550 0x7f26bc10cfd0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f26b40027d0 tx=0x7f26b4009f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:25:12.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.717+0000 7f26ba7fc640 1 -- 172.21.15.87:0/2181320862 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f26b4002dc0 con 0x7f26bc0fc550 2024-09-17T07:25:12.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.717+0000 7f26c41a9640 1 -- 172.21.15.87:0/2181320862 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26bc10e610 con 0x7f26bc0fc550 2024-09-17T07:25:12.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.717+0000 7f26ba7fc640 1 -- 172.21.15.87:0/2181320862 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f26b400f040 con 0x7f26bc0fc550 2024-09-17T07:25:12.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.717+0000 7f26ba7fc640 1 -- 172.21.15.87:0/2181320862 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f26b400d980 con 0x7f26bc0fc550 2024-09-17T07:25:12.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.717+0000 7f26c41a9640 1 -- 172.21.15.87:0/2181320862 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26bc10ebb0 con 0x7f26bc0fc550 2024-09-17T07:25:12.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.718+0000 7f26c41a9640 1 -- 172.21.15.87:0/2181320862 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26bc0fb9b0 con 0x7f26bc0fc550 2024-09-17T07:25:12.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.718+0000 7f26ba7fc640 1 -- 172.21.15.87:0/2181320862 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f26b4007c30 con 0x7f26bc0fc550 2024-09-17T07:25:12.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.719+0000 7f26ba7fc640 1 --2- 172.21.15.87:0/2181320862 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f26a406cb90 0x7f26a406f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:25:12.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.719+0000 7f26ba7fc640 1 -- 172.21.15.87:0/2181320862 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f26b408b810 con 0x7f26bc0fc550 2024-09-17T07:25:12.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.719+0000 7f26c1744640 1 --2- 172.21.15.87:0/2181320862 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f26a406cb90 0x7f26a406f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:25:12.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.719+0000 7f26c1744640 1 --2- 172.21.15.87:0/2181320862 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f26a406cb90 0x7f26a406f040 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f26b000b020 tx=0x7f26b0035040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:25:12.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.723+0000 7f26ba7fc640 1 -- 172.21.15.87:0/2181320862 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f26b4055830 con 0x7f26bc0fc550 2024-09-17T07:25:12.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.891+0000 7f26c41a9640 1 -- 172.21.15.87:0/2181320862 --> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f26bc10eee0 con 0x7f26a406cb90 2024-09-17T07:25:12.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.899+0000 7f26ba7fc640 1 -- 172.21.15.87:0/2181320862 <== mgr.24529 v2:172.21.15.87:6800/1359413180 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f26bc10eee0 con 0x7f26a406cb90 2024-09-17T07:25:12.901 INFO:teuthology.orchestra.run.smithi087.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T07:25:12.901 INFO:teuthology.orchestra.run.smithi087.stdout:alertmanager.smithi087 smithi087 *:9093,9094 running (4m) 52s ago 13m 25.6M - 0.25.0 c8568f914cd2 594553f0b497 2024-09-17T07:25:12.901 INFO:teuthology.orchestra.run.smithi087.stdout:crash.smithi087 smithi087 running (2m) 52s ago 13m 6895k - 18.2.4-855-g19e2a2be 980a0bfcd684 0ff8a9330162 2024-09-17T07:25:12.901 INFO:teuthology.orchestra.run.smithi087.stdout:crash.smithi139 smithi139 running (2m) 21s ago 12m 6899k - 18.2.4-855-g19e2a2be 980a0bfcd684 10541e3b202e 2024-09-17T07:25:12.901 INFO:teuthology.orchestra.run.smithi087.stdout:grafana.smithi087 smithi087 *:3000 running (4m) 52s ago 12m 80.1M - 9.4.7 954c08fa6188 e2f17ec6baa8 2024-09-17T07:25:12.901 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi087.tjhpcs smithi087 running (7m) 52s ago 7m 130M - 17.2.7-1635-g4a704134 f22ead590bad f7142ad971ed 2024-09-17T07:25:12.901 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi087.vvbzss smithi087 running (7m) 52s ago 7m 70.2M - 17.2.7-1635-g4a704134 f22ead590bad 2dd82ff293d1 2024-09-17T07:25:12.902 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi139.ftvinf smithi139 running (7m) 21s ago 7m 57.3M - 17.2.7-1635-g4a704134 f22ead590bad d11edb295ad3 2024-09-17T07:25:12.902 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi139.gnwonz smithi139 running (7m) 21s ago 7m 116M - 17.2.7-1635-g4a704134 f22ead590bad 3b3d884aef02 2024-09-17T07:25:12.902 INFO:teuthology.orchestra.run.smithi087.stdout:mgr.smithi087.vuvjer smithi087 *:8443,9283,8765 running (4m) 52s ago 14m 488M - 18.2.4-855-g19e2a2be 980a0bfcd684 5d10c647cb6b 2024-09-17T07:25:12.902 INFO:teuthology.orchestra.run.smithi087.stdout:mgr.smithi139.tuqnpn smithi139 *:8443,9283,8765 running (3m) 21s ago 12m 439M - 18.2.4-855-g19e2a2be 980a0bfcd684 6e0bf371d44c 2024-09-17T07:25:12.902 INFO:teuthology.orchestra.run.smithi087.stdout:mon.smithi087 smithi087 running (3m) 52s ago 14m 44.5M 2048M 18.2.4-855-g19e2a2be 980a0bfcd684 305c72de1f9f 2024-09-17T07:25:12.902 INFO:teuthology.orchestra.run.smithi087.stdout:mon.smithi139 smithi139 running (3m) 21s ago 12m 38.1M 2048M 18.2.4-855-g19e2a2be 980a0bfcd684 0b159495af0f 2024-09-17T07:25:12.902 INFO:teuthology.orchestra.run.smithi087.stdout:node-exporter.smithi087 smithi087 *:9100 running (4m) 52s ago 13m 15.3M - 1.5.0 0da6a335fe13 39fa48de0e87 2024-09-17T07:25:12.902 INFO:teuthology.orchestra.run.smithi087.stdout:node-exporter.smithi139 smithi139 *:9100 running (4m) 21s ago 12m 15.6M - 1.5.0 0da6a335fe13 a5b99b7cbb06 2024-09-17T07:25:12.902 INFO:teuthology.orchestra.run.smithi087.stdout:osd.0 smithi087 running (2m) 52s ago 11m 85.4M 1557M 18.2.4-855-g19e2a2be 980a0bfcd684 e97cb50e6aec 2024-09-17T07:25:12.902 INFO:teuthology.orchestra.run.smithi087.stdout:osd.1 smithi087 running (91s) 52s ago 11m 89.7M 1557M 18.2.4-855-g19e2a2be 980a0bfcd684 b108771d0b8e 2024-09-17T07:25:12.902 INFO:teuthology.orchestra.run.smithi087.stdout:osd.2 smithi087 running (58s) 52s ago 10m 11.8M 1557M 18.2.4-855-g19e2a2be 980a0bfcd684 240cfb3b5366 2024-09-17T07:25:12.902 INFO:teuthology.orchestra.run.smithi087.stdout:osd.3 smithi139 running (24s) 21s ago 10m 12.1M 2581M 18.2.4-855-g19e2a2be 980a0bfcd684 b05ed3bf3f5c 2024-09-17T07:25:12.902 INFO:teuthology.orchestra.run.smithi087.stdout:osd.4 smithi139 running (9m) 21s ago 9m 211M 2581M 17.2.7-1635-g4a704134 f22ead590bad 299a8dfc47f5 2024-09-17T07:25:12.903 INFO:teuthology.orchestra.run.smithi087.stdout:osd.5 smithi139 running (9m) 21s ago 9m 201M 2581M 17.2.7-1635-g4a704134 f22ead590bad 609cf74f32e7 2024-09-17T07:25:12.903 INFO:teuthology.orchestra.run.smithi087.stdout:prometheus.smithi087 smithi087 *:9095 running (3m) 52s ago 12m 56.5M - 2.43.0 a07b618ecd1d 63d18b7469fc 2024-09-17T07:25:12.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.902+0000 7f26c41a9640 1 -- 172.21.15.87:0/2181320862 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f26a406cb90 msgr2=0x7f26a406f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:25:12.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.902+0000 7f26c41a9640 1 --2- 172.21.15.87:0/2181320862 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f26a406cb90 0x7f26a406f040 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f26b000b020 tx=0x7f26b0035040 comp rx=0 tx=0).stop 2024-09-17T07:25:12.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.902+0000 7f26c41a9640 1 -- 172.21.15.87:0/2181320862 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f26bc0fc550 msgr2=0x7f26bc10cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:25:12.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.902+0000 7f26c41a9640 1 --2- 172.21.15.87:0/2181320862 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f26bc0fc550 0x7f26bc10cfd0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f26b40027d0 tx=0x7f26b4009f70 comp rx=0 tx=0).stop 2024-09-17T07:25:12.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.902+0000 7f26c41a9640 1 -- 172.21.15.87:0/2181320862 shutdown_connections 2024-09-17T07:25:12.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.902+0000 7f26c41a9640 1 --2- 172.21.15.87:0/2181320862 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f26bc0fd820 0x7f26bc10d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:12.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.902+0000 7f26c41a9640 1 --2- 172.21.15.87:0/2181320862 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f26a406cb90 0x7f26a406f040 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:12.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.902+0000 7f26c41a9640 1 --2- 172.21.15.87:0/2181320862 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f26bc0fc550 0x7f26bc10cfd0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:12.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.902+0000 7f26c41a9640 1 -- 172.21.15.87:0/2181320862 >> 172.21.15.87:0/2181320862 conn(0x7f26bc0f7d30 msgr2=0x7f26bc0f9600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:25:12.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.902+0000 7f26c41a9640 1 -- 172.21.15.87:0/2181320862 shutdown_connections 2024-09-17T07:25:12.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.902+0000 7f26c41a9640 1 -- 172.21.15.87:0/2181320862 wait complete. 2024-09-17T07:25:12.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.981+0000 7fd118aca640 1 -- 172.21.15.87:0/3707296322 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1140fd800 msgr2=0x7fd1140fdc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:25:12.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.981+0000 7fd118aca640 1 --2- 172.21.15.87:0/3707296322 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1140fd800 0x7fd1140fdc70 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc0048d0 tx=0x7fd0fc009da0 comp rx=0 tx=0).stop 2024-09-17T07:25:12.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.981+0000 7fd118aca640 1 -- 172.21.15.87:0/3707296322 shutdown_connections 2024-09-17T07:25:12.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.981+0000 7fd118aca640 1 --2- 172.21.15.87:0/3707296322 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1140fd800 0x7fd1140fdc70 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:12.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.981+0000 7fd118aca640 1 --2- 172.21.15.87:0/3707296322 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd1140fc530 0x7fd1140fc940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:12.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.981+0000 7fd118aca640 1 -- 172.21.15.87:0/3707296322 >> 172.21.15.87:0/3707296322 conn(0x7fd1140f7d10 msgr2=0x7fd1140fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:25:12.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.981+0000 7fd118aca640 1 -- 172.21.15.87:0/3707296322 shutdown_connections 2024-09-17T07:25:12.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.981+0000 7fd118aca640 1 -- 172.21.15.87:0/3707296322 wait complete. 2024-09-17T07:25:12.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.981+0000 7fd118aca640 1 Processor -- start 2024-09-17T07:25:12.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.982+0000 7fd118aca640 1 -- start start 2024-09-17T07:25:12.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.982+0000 7fd118aca640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd1140fc530 0x7fd11410cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:25:12.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.982+0000 7fd118aca640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1140fd800 0x7fd11410d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:25:12.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.982+0000 7fd118aca640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd11410db40 con 0x7fd1140fd800 2024-09-17T07:25:12.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.982+0000 7fd118aca640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd11410e360 con 0x7fd1140fc530 2024-09-17T07:25:12.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.982+0000 7fd10bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1140fd800 0x7fd11410d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:25:12.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.982+0000 7fd11259c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd1140fc530 0x7fd11410cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:25:12.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.982+0000 7fd10bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1140fd800 0x7fd11410d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:58378/0 (socket says 172.21.15.87:58378) 2024-09-17T07:25:12.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.982+0000 7fd10bfff640 1 -- 172.21.15.87:0/3844012454 learned_addr learned my addr 172.21.15.87:0/3844012454 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:25:12.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.982+0000 7fd10bfff640 1 -- 172.21.15.87:0/3844012454 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd1140fc530 msgr2=0x7fd11410cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:25:12.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.982+0000 7fd10bfff640 1 --2- 172.21.15.87:0/3844012454 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd1140fc530 0x7fd11410cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:12.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.982+0000 7fd10bfff640 1 -- 172.21.15.87:0/3844012454 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0fc005040 con 0x7fd1140fd800 2024-09-17T07:25:12.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.982+0000 7fd10bfff640 1 --2- 172.21.15.87:0/3844012454 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1140fd800 0x7fd11410d4f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc00b020 tx=0x7fd0fc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:25:12.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.983+0000 7fd10affd640 1 -- 172.21.15.87:0/3844012454 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0fc038070 con 0x7fd1140fd800 2024-09-17T07:25:12.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.983+0000 7fd10affd640 1 -- 172.21.15.87:0/3844012454 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fd0fc02ae70 con 0x7fd1140fd800 2024-09-17T07:25:12.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.983+0000 7fd10affd640 1 -- 172.21.15.87:0/3844012454 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0fc03d420 con 0x7fd1140fd800 2024-09-17T07:25:12.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.983+0000 7fd118aca640 1 -- 172.21.15.87:0/3844012454 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd11410e590 con 0x7fd1140fd800 2024-09-17T07:25:12.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.983+0000 7fd118aca640 1 -- 172.21.15.87:0/3844012454 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd11410eb30 con 0x7fd1140fd800 2024-09-17T07:25:12.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.984+0000 7fd118aca640 1 -- 172.21.15.87:0/3844012454 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1140fb990 con 0x7fd1140fd800 2024-09-17T07:25:12.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.984+0000 7fd10affd640 1 -- 172.21.15.87:0/3844012454 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fd0fc030020 con 0x7fd1140fd800 2024-09-17T07:25:12.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.985+0000 7fd10affd640 1 --2- 172.21.15.87:0/3844012454 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fd10006cb90 0x7fd10006f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:25:12.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.985+0000 7fd10affd640 1 -- 172.21.15.87:0/3844012454 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fd0fc0ac680 con 0x7fd1140fd800 2024-09-17T07:25:12.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.985+0000 7fd11259c640 1 --2- 172.21.15.87:0/3844012454 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fd10006cb90 0x7fd10006f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:25:12.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.985+0000 7fd11259c640 1 --2- 172.21.15.87:0/3844012454 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fd10006cb90 0x7fd10006f040 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd1040041d0 tx=0x7fd104004330 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:25:12.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:12.989+0000 7fd10affd640 1 -- 172.21.15.87:0/3844012454 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd0fc076710 con 0x7fd1140fd800 2024-09-17T07:25:13.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.213+0000 7fd118aca640 1 -- 172.21.15.87:0/3844012454 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd11410edd0 con 0x7fd1140fd800 2024-09-17T07:25:13.215 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.214+0000 7fd10affd640 1 -- 172.21.15.87:0/3844012454 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+846 (secure 0 0 0) 0x7fd0fc079d30 con 0x7fd1140fd800 2024-09-17T07:25:13.215 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T07:25:13.215 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": { 2024-09-17T07:25:13.215 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 2 2024-09-17T07:25:13.215 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:25:13.216 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr": { 2024-09-17T07:25:13.216 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 2 2024-09-17T07:25:13.216 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:25:13.216 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": { 2024-09-17T07:25:13.216 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 2, 2024-09-17T07:25:13.216 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 4 2024-09-17T07:25:13.216 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:25:13.216 INFO:teuthology.orchestra.run.smithi087.stdout: "mds": { 2024-09-17T07:25:13.216 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 4 2024-09-17T07:25:13.216 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:25:13.216 INFO:teuthology.orchestra.run.smithi087.stdout: "overall": { 2024-09-17T07:25:13.216 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 6, 2024-09-17T07:25:13.216 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 8 2024-09-17T07:25:13.216 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T07:25:13.217 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T07:25:13.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.216+0000 7fd118aca640 1 -- 172.21.15.87:0/3844012454 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fd10006cb90 msgr2=0x7fd10006f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:25:13.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.216+0000 7fd118aca640 1 --2- 172.21.15.87:0/3844012454 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fd10006cb90 0x7fd10006f040 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd1040041d0 tx=0x7fd104004330 comp rx=0 tx=0).stop 2024-09-17T07:25:13.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.216+0000 7fd118aca640 1 -- 172.21.15.87:0/3844012454 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1140fd800 msgr2=0x7fd11410d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:25:13.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.216+0000 7fd118aca640 1 --2- 172.21.15.87:0/3844012454 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1140fd800 0x7fd11410d4f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc00b020 tx=0x7fd0fc009da0 comp rx=0 tx=0).stop 2024-09-17T07:25:13.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.216+0000 7fd118aca640 1 -- 172.21.15.87:0/3844012454 shutdown_connections 2024-09-17T07:25:13.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.216+0000 7fd118aca640 1 --2- 172.21.15.87:0/3844012454 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1140fd800 0x7fd11410d4f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:13.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.216+0000 7fd118aca640 1 --2- 172.21.15.87:0/3844012454 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fd10006cb90 0x7fd10006f040 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:13.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.216+0000 7fd118aca640 1 --2- 172.21.15.87:0/3844012454 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd1140fc530 0x7fd11410cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:13.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.216+0000 7fd118aca640 1 -- 172.21.15.87:0/3844012454 >> 172.21.15.87:0/3844012454 conn(0x7fd1140f7d10 msgr2=0x7fd1140f95c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:25:13.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.216+0000 7fd118aca640 1 -- 172.21.15.87:0/3844012454 shutdown_connections 2024-09-17T07:25:13.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.216+0000 7fd118aca640 1 -- 172.21.15.87:0/3844012454 wait complete. 2024-09-17T07:25:13.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.295+0000 7fab9c261640 1 -- 172.21.15.87:0/3296881211 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab94066610 msgr2=0x7fab940ff1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:25:13.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.295+0000 7fab9c261640 1 --2- 172.21.15.87:0/3296881211 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab94066610 0x7fab940ff1f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fab900048d0 tx=0x7fab90009da0 comp rx=0 tx=0).stop 2024-09-17T07:25:13.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.295+0000 7fab9c261640 1 -- 172.21.15.87:0/3296881211 shutdown_connections 2024-09-17T07:25:13.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.295+0000 7fab9c261640 1 --2- 172.21.15.87:0/3296881211 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fab940ff730 0x7fab94101b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:13.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.295+0000 7fab9c261640 1 --2- 172.21.15.87:0/3296881211 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab94066610 0x7fab940ff1f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:13.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.295+0000 7fab9c261640 1 -- 172.21.15.87:0/3296881211 >> 172.21.15.87:0/3296881211 conn(0x7fab940f6c20 msgr2=0x7fab940f9030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:25:13.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.295+0000 7fab9c261640 1 -- 172.21.15.87:0/3296881211 shutdown_connections 2024-09-17T07:25:13.297 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:13 smithi087 ceph-mon[90982]: Upgrade: Updating osd.4 2024-09-17T07:25:13.297 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:13 smithi087 ceph-mon[90982]: Deploying daemon osd.4 on smithi139 2024-09-17T07:25:13.297 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:13 smithi087 ceph-mon[90982]: pgmap v120: 65 pgs: 65 active+clean; 322 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:25:13.297 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:13 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:25:13.298 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:13 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:25:13.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.295+0000 7fab9c261640 1 -- 172.21.15.87:0/3296881211 wait complete. 2024-09-17T07:25:13.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.296+0000 7fab9c261640 1 Processor -- start 2024-09-17T07:25:13.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.296+0000 7fab9c261640 1 -- start start 2024-09-17T07:25:13.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.296+0000 7fab9c261640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab94066610 0x7fab9410d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:25:13.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.296+0000 7fab9c261640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fab940ff730 0x7fab9410d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:25:13.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.296+0000 7fab9c261640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab9410e4a0 con 0x7fab94066610 2024-09-17T07:25:13.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.296+0000 7fab9c261640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab9410e610 con 0x7fab940ff730 2024-09-17T07:25:13.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.296+0000 7fab99ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab94066610 0x7fab9410d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:25:13.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.296+0000 7fab99ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab94066610 0x7fab9410d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:58404/0 (socket says 172.21.15.87:58404) 2024-09-17T07:25:13.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.296+0000 7fab99ffd640 1 -- 172.21.15.87:0/2405939968 learned_addr learned my addr 172.21.15.87:0/2405939968 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:25:13.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.297+0000 7fab99ffd640 1 -- 172.21.15.87:0/2405939968 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fab940ff730 msgr2=0x7fab9410d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:25:13.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.297+0000 7fab99ffd640 1 --2- 172.21.15.87:0/2405939968 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fab940ff730 0x7fab9410d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:13.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.297+0000 7fab99ffd640 1 -- 172.21.15.87:0/2405939968 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab90005040 con 0x7fab94066610 2024-09-17T07:25:13.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.297+0000 7fab99ffd640 1 --2- 172.21.15.87:0/2405939968 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab94066610 0x7fab9410d160 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fab90003080 tx=0x7fab90009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:25:13.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.297+0000 7fab8a7fc640 1 -- 172.21.15.87:0/2405939968 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab90038070 con 0x7fab94066610 2024-09-17T07:25:13.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.297+0000 7fab8a7fc640 1 -- 172.21.15.87:0/2405939968 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fab900097c0 con 0x7fab94066610 2024-09-17T07:25:13.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.297+0000 7fab9c261640 1 -- 172.21.15.87:0/2405939968 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab9410e890 con 0x7fab94066610 2024-09-17T07:25:13.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.297+0000 7fab8a7fc640 1 -- 172.21.15.87:0/2405939968 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab9003d420 con 0x7fab94066610 2024-09-17T07:25:13.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.297+0000 7fab9c261640 1 -- 172.21.15.87:0/2405939968 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab9410edb0 con 0x7fab94066610 2024-09-17T07:25:13.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.298+0000 7fab9c261640 1 -- 172.21.15.87:0/2405939968 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab940fa8a0 con 0x7fab94066610 2024-09-17T07:25:13.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.299+0000 7fab8a7fc640 1 -- 172.21.15.87:0/2405939968 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fab90030020 con 0x7fab94066610 2024-09-17T07:25:13.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.299+0000 7fab8a7fc640 1 --2- 172.21.15.87:0/2405939968 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fab8006cb90 0x7fab8006f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:25:13.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.299+0000 7fab8a7fc640 1 -- 172.21.15.87:0/2405939968 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fab900ac730 con 0x7fab94066610 2024-09-17T07:25:13.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.299+0000 7fab997fc640 1 --2- 172.21.15.87:0/2405939968 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fab8006cb90 0x7fab8006f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:25:13.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.300+0000 7fab997fc640 1 --2- 172.21.15.87:0/2405939968 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fab8006cb90 0x7fab8006f040 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fab9410cf10 tx=0x7fab84006d20 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:25:13.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.304+0000 7fab8a7fc640 1 -- 172.21.15.87:0/2405939968 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fab90076740 con 0x7fab94066610 2024-09-17T07:25:13.348 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:13 smithi139 ceph-mon[79872]: Upgrade: Updating osd.4 2024-09-17T07:25:13.348 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:13 smithi139 ceph-mon[79872]: Deploying daemon osd.4 on smithi139 2024-09-17T07:25:13.348 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:13 smithi139 ceph-mon[79872]: pgmap v120: 65 pgs: 65 active+clean; 322 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:25:13.348 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:13 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:25:13.349 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:13 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:25:13.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.496+0000 7fab9c261640 1 -- 172.21.15.87:0/2405939968 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fab9410ef40 con 0x7fab94066610 2024-09-17T07:25:13.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.497+0000 7fab8a7fc640 1 -- 172.21.15.87:0/2405939968 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 23 v23) v1 ==== 76+0+1871 (secure 0 0 0) 0x7fab90079d60 con 0x7fab94066610 2024-09-17T07:25:13.498 INFO:teuthology.orchestra.run.smithi087.stdout:e23 2024-09-17T07:25:13.499 INFO:teuthology.orchestra.run.smithi087.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T07:25:13.499 INFO:teuthology.orchestra.run.smithi087.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T07:25:13.499 INFO:teuthology.orchestra.run.smithi087.stdout:legacy client fscid: 1 2024-09-17T07:25:13.499 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:25:13.499 INFO:teuthology.orchestra.run.smithi087.stdout:Filesystem 'cephfs' (1) 2024-09-17T07:25:13.499 INFO:teuthology.orchestra.run.smithi087.stdout:fs_name cephfs 2024-09-17T07:25:13.499 INFO:teuthology.orchestra.run.smithi087.stdout:epoch 23 2024-09-17T07:25:13.499 INFO:teuthology.orchestra.run.smithi087.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T07:25:13.499 INFO:teuthology.orchestra.run.smithi087.stdout:created 2024-09-17T07:17:15.368053+0000 2024-09-17T07:25:13.499 INFO:teuthology.orchestra.run.smithi087.stdout:modified 2024-09-17T07:24:06.203553+0000 2024-09-17T07:25:13.499 INFO:teuthology.orchestra.run.smithi087.stdout:tableserver 0 2024-09-17T07:25:13.499 INFO:teuthology.orchestra.run.smithi087.stdout:root 0 2024-09-17T07:25:13.499 INFO:teuthology.orchestra.run.smithi087.stdout:session_timeout 60 2024-09-17T07:25:13.500 INFO:teuthology.orchestra.run.smithi087.stdout:session_autoclose 300 2024-09-17T07:25:13.500 INFO:teuthology.orchestra.run.smithi087.stdout:max_file_size 1099511627776 2024-09-17T07:25:13.500 INFO:teuthology.orchestra.run.smithi087.stdout:max_xattr_size 65536 2024-09-17T07:25:13.500 INFO:teuthology.orchestra.run.smithi087.stdout:required_client_features {} 2024-09-17T07:25:13.500 INFO:teuthology.orchestra.run.smithi087.stdout:last_failure 0 2024-09-17T07:25:13.500 INFO:teuthology.orchestra.run.smithi087.stdout:last_failure_osd_epoch 44 2024-09-17T07:25:13.500 INFO:teuthology.orchestra.run.smithi087.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T07:25:13.500 INFO:teuthology.orchestra.run.smithi087.stdout:max_mds 2 2024-09-17T07:25:13.500 INFO:teuthology.orchestra.run.smithi087.stdout:in 0,1 2024-09-17T07:25:13.500 INFO:teuthology.orchestra.run.smithi087.stdout:up {0=14478,1=24243} 2024-09-17T07:25:13.500 INFO:teuthology.orchestra.run.smithi087.stdout:failed 2024-09-17T07:25:13.500 INFO:teuthology.orchestra.run.smithi087.stdout:damaged 2024-09-17T07:25:13.500 INFO:teuthology.orchestra.run.smithi087.stdout:stopped 2024-09-17T07:25:13.500 INFO:teuthology.orchestra.run.smithi087.stdout:data_pools [3] 2024-09-17T07:25:13.501 INFO:teuthology.orchestra.run.smithi087.stdout:metadata_pool 2 2024-09-17T07:25:13.501 INFO:teuthology.orchestra.run.smithi087.stdout:inline_data enabled 2024-09-17T07:25:13.501 INFO:teuthology.orchestra.run.smithi087.stdout:balancer 2024-09-17T07:25:13.501 INFO:teuthology.orchestra.run.smithi087.stdout:bal_rank_mask -1 2024-09-17T07:25:13.501 INFO:teuthology.orchestra.run.smithi087.stdout:standby_count_wanted 1 2024-09-17T07:25:13.501 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi087.tjhpcs{0:14478} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.87:6828/2255237099,v1:172.21.15.87:6829/2255237099] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:25:13.501 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi087.vvbzss{0:14490} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.87:6826/4022268353,v1:172.21.15.87:6827/4022268353] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:25:13.501 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi139.gnwonz{1:24243} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.139:6824/3946792151,v1:172.21.15.139:6825/3946792151] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:25:13.501 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi139.ftvinf{1:24253} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.139:6826/3292073323,v1:172.21.15.139:6827/3292073323] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:25:13.501 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:25:13.501 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:25:13.502 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 23 2024-09-17T07:25:13.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.499+0000 7fab9c261640 1 -- 172.21.15.87:0/2405939968 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fab8006cb90 msgr2=0x7fab8006f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:25:13.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.499+0000 7fab9c261640 1 --2- 172.21.15.87:0/2405939968 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fab8006cb90 0x7fab8006f040 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fab9410cf10 tx=0x7fab84006d20 comp rx=0 tx=0).stop 2024-09-17T07:25:13.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.499+0000 7fab9c261640 1 -- 172.21.15.87:0/2405939968 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab94066610 msgr2=0x7fab9410d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:25:13.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.499+0000 7fab9c261640 1 --2- 172.21.15.87:0/2405939968 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab94066610 0x7fab9410d160 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fab90003080 tx=0x7fab90009da0 comp rx=0 tx=0).stop 2024-09-17T07:25:13.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.499+0000 7fab9c261640 1 -- 172.21.15.87:0/2405939968 shutdown_connections 2024-09-17T07:25:13.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.499+0000 7fab9c261640 1 --2- 172.21.15.87:0/2405939968 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fab8006cb90 0x7fab8006f040 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:13.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.499+0000 7fab9c261640 1 --2- 172.21.15.87:0/2405939968 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fab940ff730 0x7fab9410d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:13.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.499+0000 7fab9c261640 1 --2- 172.21.15.87:0/2405939968 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab94066610 0x7fab9410d160 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:13.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.499+0000 7fab9c261640 1 -- 172.21.15.87:0/2405939968 >> 172.21.15.87:0/2405939968 conn(0x7fab940f6c20 msgr2=0x7fab940f9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:25:13.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.499+0000 7fab9c261640 1 -- 172.21.15.87:0/2405939968 shutdown_connections 2024-09-17T07:25:13.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.499+0000 7fab9c261640 1 -- 172.21.15.87:0/2405939968 wait complete. 2024-09-17T07:25:13.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.579+0000 7fac8e5a8640 1 -- 172.21.15.87:0/3324601521 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac880fc720 msgr2=0x7fac880fcb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:25:13.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.579+0000 7fac8e5a8640 1 --2- 172.21.15.87:0/3324601521 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac880fc720 0x7fac880fcb90 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fac7c0048d0 tx=0x7fac7c009da0 comp rx=0 tx=0).stop 2024-09-17T07:25:13.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.579+0000 7fac8e5a8640 1 -- 172.21.15.87:0/3324601521 shutdown_connections 2024-09-17T07:25:13.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.579+0000 7fac8e5a8640 1 --2- 172.21.15.87:0/3324601521 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac880fc720 0x7fac880fcb90 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:13.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.579+0000 7fac8e5a8640 1 --2- 172.21.15.87:0/3324601521 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fac880fb450 0x7fac880fb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:13.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.579+0000 7fac8e5a8640 1 -- 172.21.15.87:0/3324601521 >> 172.21.15.87:0/3324601521 conn(0x7fac880f6c10 msgr2=0x7fac880f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:25:13.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.579+0000 7fac8e5a8640 1 -- 172.21.15.87:0/3324601521 shutdown_connections 2024-09-17T07:25:13.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.579+0000 7fac8e5a8640 1 -- 172.21.15.87:0/3324601521 wait complete. 2024-09-17T07:25:13.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.580+0000 7fac8e5a8640 1 Processor -- start 2024-09-17T07:25:13.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.580+0000 7fac8e5a8640 1 -- start start 2024-09-17T07:25:13.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.580+0000 7fac8e5a8640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fac880fb450 0x7fac8810fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:25:13.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.580+0000 7fac8e5a8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac880fc720 0x7fac88112270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:25:13.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.580+0000 7fac8e5a8640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac88066750 con 0x7fac880fc720 2024-09-17T07:25:13.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.580+0000 7fac8e5a8640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac880668c0 con 0x7fac880fb450 2024-09-17T07:25:13.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.581+0000 7fac877fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac880fc720 0x7fac88112270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:25:13.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.581+0000 7fac877fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac880fc720 0x7fac88112270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:58426/0 (socket says 172.21.15.87:58426) 2024-09-17T07:25:13.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.581+0000 7fac877fe640 1 -- 172.21.15.87:0/2386332576 learned_addr learned my addr 172.21.15.87:0/2386332576 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:25:13.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.581+0000 7fac87fff640 1 --2- 172.21.15.87:0/2386332576 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fac880fb450 0x7fac8810fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:25:13.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.581+0000 7fac877fe640 1 -- 172.21.15.87:0/2386332576 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fac880fb450 msgr2=0x7fac8810fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:25:13.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.581+0000 7fac877fe640 1 --2- 172.21.15.87:0/2386332576 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fac880fb450 0x7fac8810fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:13.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.581+0000 7fac877fe640 1 -- 172.21.15.87:0/2386332576 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac7c005040 con 0x7fac880fc720 2024-09-17T07:25:13.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.581+0000 7fac87fff640 1 --2- 172.21.15.87:0/2386332576 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fac880fb450 0x7fac8810fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T07:25:13.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.581+0000 7fac877fe640 1 --2- 172.21.15.87:0/2386332576 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac880fc720 0x7fac88112270 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fac7c0043d0 tx=0x7fac7c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:25:13.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.581+0000 7fac84ff9640 1 -- 172.21.15.87:0/2386332576 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac7c038070 con 0x7fac880fc720 2024-09-17T07:25:13.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.581+0000 7fac8e5a8640 1 -- 172.21.15.87:0/2386332576 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac881127b0 con 0x7fac880fc720 2024-09-17T07:25:13.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.581+0000 7fac84ff9640 1 -- 172.21.15.87:0/2386332576 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fac7c0096c0 con 0x7fac880fc720 2024-09-17T07:25:13.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.582+0000 7fac84ff9640 1 -- 172.21.15.87:0/2386332576 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac7c03d420 con 0x7fac880fc720 2024-09-17T07:25:13.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.582+0000 7fac8e5a8640 1 -- 172.21.15.87:0/2386332576 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac88112d20 con 0x7fac880fc720 2024-09-17T07:25:13.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.583+0000 7fac8e5a8640 1 -- 172.21.15.87:0/2386332576 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac880fa8b0 con 0x7fac880fc720 2024-09-17T07:25:13.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.583+0000 7fac84ff9640 1 -- 172.21.15.87:0/2386332576 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fac7c030020 con 0x7fac880fc720 2024-09-17T07:25:13.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.584+0000 7fac84ff9640 1 --2- 172.21.15.87:0/2386332576 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fac7006cb90 0x7fac7006f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:25:13.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.584+0000 7fac84ff9640 1 -- 172.21.15.87:0/2386332576 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fac7c0ac670 con 0x7fac880fc720 2024-09-17T07:25:13.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.584+0000 7fac87fff640 1 --2- 172.21.15.87:0/2386332576 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fac7006cb90 0x7fac7006f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:25:13.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.584+0000 7fac87fff640 1 --2- 172.21.15.87:0/2386332576 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fac7006cb90 0x7fac7006f040 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fac88066440 tx=0x7fac7800b040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:25:13.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.588+0000 7fac84ff9640 1 -- 172.21.15.87:0/2386332576 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fac7c076680 con 0x7fac880fc720 2024-09-17T07:25:13.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.764+0000 7fac8e5a8640 1 -- 172.21.15.87:0/2386332576 --> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fac88100c30 con 0x7fac7006cb90 2024-09-17T07:25:13.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.765+0000 7fac84ff9640 1 -- 172.21.15.87:0/2386332576 <== mgr.24529 v2:172.21.15.87:6800/1359413180 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fac88100c30 con 0x7fac7006cb90 2024-09-17T07:25:13.766 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T07:25:13.767 INFO:teuthology.orchestra.run.smithi087.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9", 2024-09-17T07:25:13.767 INFO:teuthology.orchestra.run.smithi087.stdout: "in_progress": true, 2024-09-17T07:25:13.767 INFO:teuthology.orchestra.run.smithi087.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T07:25:13.767 INFO:teuthology.orchestra.run.smithi087.stdout: "services_complete": [ 2024-09-17T07:25:13.767 INFO:teuthology.orchestra.run.smithi087.stdout: "crash", 2024-09-17T07:25:13.767 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr", 2024-09-17T07:25:13.767 INFO:teuthology.orchestra.run.smithi087.stdout: "mon" 2024-09-17T07:25:13.767 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-17T07:25:13.767 INFO:teuthology.orchestra.run.smithi087.stdout: "progress": "10/21 daemons upgraded", 2024-09-17T07:25:13.767 INFO:teuthology.orchestra.run.smithi087.stdout: "message": "Currently upgrading osd daemons", 2024-09-17T07:25:13.767 INFO:teuthology.orchestra.run.smithi087.stdout: "is_paused": false 2024-09-17T07:25:13.767 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T07:25:13.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.767+0000 7fac8e5a8640 1 -- 172.21.15.87:0/2386332576 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fac7006cb90 msgr2=0x7fac7006f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:25:13.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.767+0000 7fac8e5a8640 1 --2- 172.21.15.87:0/2386332576 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fac7006cb90 0x7fac7006f040 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fac88066440 tx=0x7fac7800b040 comp rx=0 tx=0).stop 2024-09-17T07:25:13.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.767+0000 7fac8e5a8640 1 -- 172.21.15.87:0/2386332576 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac880fc720 msgr2=0x7fac88112270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:25:13.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.767+0000 7fac8e5a8640 1 --2- 172.21.15.87:0/2386332576 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac880fc720 0x7fac88112270 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fac7c0043d0 tx=0x7fac7c009da0 comp rx=0 tx=0).stop 2024-09-17T07:25:13.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.767+0000 7fac8e5a8640 1 -- 172.21.15.87:0/2386332576 shutdown_connections 2024-09-17T07:25:13.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.767+0000 7fac8e5a8640 1 --2- 172.21.15.87:0/2386332576 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac880fc720 0x7fac88112270 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:13.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.767+0000 7fac8e5a8640 1 --2- 172.21.15.87:0/2386332576 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fac7006cb90 0x7fac7006f040 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:13.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.767+0000 7fac8e5a8640 1 --2- 172.21.15.87:0/2386332576 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fac880fb450 0x7fac8810fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:13.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.767+0000 7fac8e5a8640 1 -- 172.21.15.87:0/2386332576 >> 172.21.15.87:0/2386332576 conn(0x7fac880f6c10 msgr2=0x7fac880f84d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:25:13.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.767+0000 7fac8e5a8640 1 -- 172.21.15.87:0/2386332576 shutdown_connections 2024-09-17T07:25:13.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.767+0000 7fac8e5a8640 1 -- 172.21.15.87:0/2386332576 wait complete. 2024-09-17T07:25:13.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.846+0000 7f022d59e640 1 -- 172.21.15.87:0/2203997601 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0228065a30 msgr2=0x7f02280ff050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:25:13.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.846+0000 7f022d59e640 1 --2- 172.21.15.87:0/2203997601 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0228065a30 0x7f02280ff050 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f02180048d0 tx=0x7f0218009da0 comp rx=0 tx=0).stop 2024-09-17T07:25:13.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.846+0000 7f022d59e640 1 -- 172.21.15.87:0/2203997601 shutdown_connections 2024-09-17T07:25:13.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.846+0000 7f022d59e640 1 --2- 172.21.15.87:0/2203997601 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f02280ff590 0x7f0228101970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:13.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.846+0000 7f022d59e640 1 --2- 172.21.15.87:0/2203997601 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0228065a30 0x7f02280ff050 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:13.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.846+0000 7f022d59e640 1 -- 172.21.15.87:0/2203997601 >> 172.21.15.87:0/2203997601 conn(0x7f02280f6a40 msgr2=0x7f02280f8e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:25:13.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.846+0000 7f022d59e640 1 -- 172.21.15.87:0/2203997601 shutdown_connections 2024-09-17T07:25:13.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.846+0000 7f022d59e640 1 -- 172.21.15.87:0/2203997601 wait complete. 2024-09-17T07:25:13.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.846+0000 7f022d59e640 1 Processor -- start 2024-09-17T07:25:13.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.847+0000 7f022d59e640 1 -- start start 2024-09-17T07:25:13.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.847+0000 7f022d59e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0228065a30 0x7f022810ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:25:13.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.847+0000 7f022d59e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f02280ff590 0x7f022810d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:25:13.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.847+0000 7f022d59e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f022810d9f0 con 0x7f0228065a30 2024-09-17T07:25:13.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.847+0000 7f022d59e640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f022810e130 con 0x7f02280ff590 2024-09-17T07:25:13.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.847+0000 7f0227fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0228065a30 0x7f022810ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:25:13.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.847+0000 7f0227fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0228065a30 0x7f022810ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:58442/0 (socket says 172.21.15.87:58442) 2024-09-17T07:25:13.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.847+0000 7f0227fff640 1 -- 172.21.15.87:0/282282500 learned_addr learned my addr 172.21.15.87:0/282282500 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:25:13.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.847+0000 7f02277fe640 1 --2- 172.21.15.87:0/282282500 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f02280ff590 0x7f022810d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:25:13.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.847+0000 7f0227fff640 1 -- 172.21.15.87:0/282282500 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f02280ff590 msgr2=0x7f022810d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:25:13.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.847+0000 7f0227fff640 1 --2- 172.21.15.87:0/282282500 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f02280ff590 0x7f022810d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:13.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.847+0000 7f0227fff640 1 -- 172.21.15.87:0/282282500 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0218005040 con 0x7f0228065a30 2024-09-17T07:25:13.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.847+0000 7f0227fff640 1 --2- 172.21.15.87:0/282282500 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0228065a30 0x7f022810ce60 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f021800b020 tx=0x7f0218009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:25:13.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.848+0000 7f0224ff9640 1 -- 172.21.15.87:0/282282500 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0218038070 con 0x7f0228065a30 2024-09-17T07:25:13.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.848+0000 7f0224ff9640 1 -- 172.21.15.87:0/282282500 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f021802ae70 con 0x7f0228065a30 2024-09-17T07:25:13.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.848+0000 7f022d59e640 1 -- 172.21.15.87:0/282282500 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f022810e360 con 0x7f0228065a30 2024-09-17T07:25:13.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.848+0000 7f022d59e640 1 -- 172.21.15.87:0/282282500 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f022810e900 con 0x7f0228065a30 2024-09-17T07:25:13.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.848+0000 7f0224ff9640 1 -- 172.21.15.87:0/282282500 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f021803d420 con 0x7f0228065a30 2024-09-17T07:25:13.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.849+0000 7f022d59e640 1 -- 172.21.15.87:0/282282500 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f022805ed70 con 0x7f0228065a30 2024-09-17T07:25:13.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.849+0000 7f0224ff9640 1 -- 172.21.15.87:0/282282500 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f0218030020 con 0x7f0228065a30 2024-09-17T07:25:13.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.850+0000 7f0224ff9640 1 --2- 172.21.15.87:0/282282500 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f021406cba0 0x7f021406f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:25:13.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.850+0000 7f0224ff9640 1 -- 172.21.15.87:0/282282500 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f02180ac6c0 con 0x7f0228065a30 2024-09-17T07:25:13.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.850+0000 7f02277fe640 1 --2- 172.21.15.87:0/282282500 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f021406cba0 0x7f021406f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:25:13.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.850+0000 7f02277fe640 1 --2- 172.21.15.87:0/282282500 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f021406cba0 0x7f021406f050 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f02100041d0 tx=0x7f0210004330 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:25:13.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:13.854+0000 7f0224ff9640 1 -- 172.21.15.87:0/282282500 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f0218076750 con 0x7f0228065a30 2024-09-17T07:25:14.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:14.079+0000 7f022d59e640 1 -- 172.21.15.87:0/282282500 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f022804b720 con 0x7f0228065a30 2024-09-17T07:25:14.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:14.079+0000 7f0224ff9640 1 -- 172.21.15.87:0/282282500 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f0218079d70 con 0x7f0228065a30 2024-09-17T07:25:14.081 INFO:teuthology.orchestra.run.smithi087.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T07:25:14.081 INFO:teuthology.orchestra.run.smithi087.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T07:25:14.081 INFO:teuthology.orchestra.run.smithi087.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T07:25:14.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:14.081+0000 7f022d59e640 1 -- 172.21.15.87:0/282282500 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f021406cba0 msgr2=0x7f021406f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:25:14.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:14.081+0000 7f022d59e640 1 --2- 172.21.15.87:0/282282500 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f021406cba0 0x7f021406f050 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f02100041d0 tx=0x7f0210004330 comp rx=0 tx=0).stop 2024-09-17T07:25:14.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:14.081+0000 7f022d59e640 1 -- 172.21.15.87:0/282282500 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0228065a30 msgr2=0x7f022810ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:25:14.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:14.081+0000 7f022d59e640 1 --2- 172.21.15.87:0/282282500 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0228065a30 0x7f022810ce60 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f021800b020 tx=0x7f0218009da0 comp rx=0 tx=0).stop 2024-09-17T07:25:14.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:14.082+0000 7f022d59e640 1 -- 172.21.15.87:0/282282500 shutdown_connections 2024-09-17T07:25:14.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:14.082+0000 7f022d59e640 1 --2- 172.21.15.87:0/282282500 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f021406cba0 0x7f021406f050 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:14.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:14.082+0000 7f022d59e640 1 --2- 172.21.15.87:0/282282500 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f02280ff590 0x7f022810d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:14.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:14.082+0000 7f022d59e640 1 --2- 172.21.15.87:0/282282500 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0228065a30 0x7f022810ce60 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:14.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:14.082+0000 7f022d59e640 1 -- 172.21.15.87:0/282282500 >> 172.21.15.87:0/282282500 conn(0x7f02280f6a40 msgr2=0x7f02280f6e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:25:14.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:14.082+0000 7f022d59e640 1 -- 172.21.15.87:0/282282500 shutdown_connections 2024-09-17T07:25:14.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:14.082+0000 7f022d59e640 1 -- 172.21.15.87:0/282282500 wait complete. 2024-09-17T07:25:14.264 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:14 smithi139 ceph-mon[79872]: from='client.34314 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:25:14.264 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:14 smithi139 ceph-mon[79872]: from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:25:14.265 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:14 smithi139 ceph-mon[79872]: from='client.44213 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:25:14.265 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:14 smithi139 ceph-mon[79872]: from='client.? 172.21.15.87:0/3844012454' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:25:14.265 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:14 smithi139 ceph-mon[79872]: from='client.? 172.21.15.87:0/2405939968' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T07:25:14.265 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:14 smithi139 ceph-mon[79872]: from='client.? 172.21.15.87:0/282282500' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T07:25:14.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:14 smithi087 ceph-mon[90982]: from='client.34314 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:25:14.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:14 smithi087 ceph-mon[90982]: from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:25:14.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:14 smithi087 ceph-mon[90982]: from='client.44213 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:25:14.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:14 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/3844012454' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:25:14.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:14 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/2405939968' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T07:25:14.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:14 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/282282500' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T07:25:14.892 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 17 07:25:14 smithi139 systemd[1]: Stopping Ceph osd.4 for d5dbf8d6-74c3-11ef-bceb-c7b262605968... 2024-09-17T07:25:15.161 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 17 07:25:14 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-4[46317]: 2024-09-17T07:25:14.901+0000 7f0c3a35a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T07:25:15.162 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 17 07:25:14 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-4[46317]: 2024-09-17T07:25:14.901+0000 7f0c3a35a640 -1 osd.4 67 *** Got signal Terminated *** 2024-09-17T07:25:15.162 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 17 07:25:14 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-4[46317]: 2024-09-17T07:25:14.901+0000 7f0c3a35a640 -1 osd.4 67 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T07:25:15.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:15 smithi087 ceph-mon[90982]: from='client.34334 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:25:15.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:15 smithi087 ceph-mon[90982]: pgmap v121: 65 pgs: 65 active+clean; 322 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:25:15.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:15 smithi087 ceph-mon[90982]: osd.4 marked itself down and dead 2024-09-17T07:25:15.533 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:15 smithi139 ceph-mon[79872]: from='client.34334 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:25:15.533 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:15 smithi139 ceph-mon[79872]: pgmap v121: 65 pgs: 65 active+clean; 322 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:25:15.533 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:15 smithi139 ceph-mon[79872]: osd.4 marked itself down and dead 2024-09-17T07:25:15.862 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 17 07:25:15 smithi139 podman[93328]: 2024-09-17 07:25:15.532933162 +0000 UTC m=+0.737853812 container died 299a8dfc47f5a74c94d1439dbd86ce05c11f13a81323761b0cdf66a4d552a98f (image=quay.ceph.io/ceph-ci/ceph@sha256:c5428a59091f5674ce6e26540d9db0f28844a507e2a324b8305a00f1687ce028, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=quincy-4a70413, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T07:25:16.116 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 17 07:25:16 smithi139 podman[93328]: 2024-09-17 07:25:16.102364834 +0000 UTC m=+1.307285496 container cleanup 299a8dfc47f5a74c94d1439dbd86ce05c11f13a81323761b0cdf66a4d552a98f (image=quay.ceph.io/ceph-ci/ceph@sha256:c5428a59091f5674ce6e26540d9db0f28844a507e2a324b8305a00f1687ce028, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-4, RELEASE=quincy-4a70413, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-17T07:25:16.116 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 17 07:25:16 smithi139 bash[93328]: ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-4 2024-09-17T07:25:16.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:16 smithi087 ceph-mon[90982]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T07:25:16.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:16 smithi087 ceph-mon[90982]: osdmap e68: 6 total, 5 up, 6 in 2024-09-17T07:25:16.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:16 smithi087 ceph-mon[90982]: osdmap e69: 6 total, 5 up, 6 in 2024-09-17T07:25:16.616 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 17 07:25:16 smithi139 podman[93353]: 2024-09-17 07:25:16.345237893 +0000 UTC m=+0.808138791 container remove 299a8dfc47f5a74c94d1439dbd86ce05c11f13a81323761b0cdf66a4d552a98f (image=quay.ceph.io/ceph-ci/ceph@sha256:c5428a59091f5674ce6e26540d9db0f28844a507e2a324b8305a00f1687ce028, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-4, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=quincy-4a70413, GIT_BRANCH=HEAD) 2024-09-17T07:25:16.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:16 smithi139 ceph-mon[79872]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T07:25:16.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:16 smithi139 ceph-mon[79872]: osdmap e68: 6 total, 5 up, 6 in 2024-09-17T07:25:16.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:16 smithi139 ceph-mon[79872]: osdmap e69: 6 total, 5 up, 6 in 2024-09-17T07:25:16.941 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 17 07:25:16 smithi139 podman[93443]: 2024-09-17 07:25:16.575837107 +0000 UTC m=+0.015909597 image pull 980a0bfcd684674f25c08d857ad8de3b1c8ae738870529edbf9aa463832c8d89 quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9 2024-09-17T07:25:16.941 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 17 07:25:16 smithi139 podman[93443]: 2024-09-17 07:25:16.704913661 +0000 UTC m=+0.144986151 container create 352eeaa4ab13a9b4af2d463597fec68b015bf5a2ccdeb0905c636d12061a61a1 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-4-deactivate, RELEASE=reef-19e2a2b, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True) 2024-09-17T07:25:17.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:17 smithi139 ceph-mon[79872]: pgmap v123: 65 pgs: 2 peering, 5 stale+active+clean, 58 active+clean; 322 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-17T07:25:17.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:17 smithi139 ceph-mon[79872]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-17T07:25:17.367 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 17 07:25:16 smithi139 podman[93443]: 2024-09-17 07:25:16.940623976 +0000 UTC m=+0.380696479 container init 352eeaa4ab13a9b4af2d463597fec68b015bf5a2ccdeb0905c636d12061a61a1 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=reef-19e2a2b, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T07:25:17.367 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 17 07:25:16 smithi139 podman[93443]: 2024-09-17 07:25:16.944458508 +0000 UTC m=+0.384530998 container start 352eeaa4ab13a9b4af2d463597fec68b015bf5a2ccdeb0905c636d12061a61a1 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-4-deactivate, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=reef-19e2a2b, GIT_BRANCH=HEAD) 2024-09-17T07:25:17.367 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 17 07:25:17 smithi139 podman[93443]: 2024-09-17 07:25:17.023962464 +0000 UTC m=+0.464034963 container attach 352eeaa4ab13a9b4af2d463597fec68b015bf5a2ccdeb0905c636d12061a61a1 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=reef-19e2a2b, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-17T07:25:17.367 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 17 07:25:17 smithi139 podman[93443]: 2024-09-17 07:25:17.131455216 +0000 UTC m=+0.571527710 container died 352eeaa4ab13a9b4af2d463597fec68b015bf5a2ccdeb0905c636d12061a61a1 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=reef-19e2a2b, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-17T07:25:17.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:17 smithi087 ceph-mon[90982]: pgmap v123: 65 pgs: 2 peering, 5 stale+active+clean, 58 active+clean; 322 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-17T07:25:17.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:17 smithi087 ceph-mon[90982]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-17T07:25:18.117 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 17 07:25:17 smithi139 podman[93467]: 2024-09-17 07:25:17.686125917 +0000 UTC m=+0.543760666 container remove 352eeaa4ab13a9b4af2d463597fec68b015bf5a2ccdeb0905c636d12061a61a1 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, RELEASE=reef-19e2a2b, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-17T07:25:18.117 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 17 07:25:17 smithi139 systemd[1]: ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968@osd.4.service: Deactivated successfully. 2024-09-17T07:25:18.117 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 17 07:25:17 smithi139 systemd[1]: Stopped Ceph osd.4 for d5dbf8d6-74c3-11ef-bceb-c7b262605968. 2024-09-17T07:25:18.117 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 17 07:25:17 smithi139 systemd[1]: ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968@osd.4.service: Consumed 49.821s CPU time. 2024-09-17T07:25:18.117 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 17 07:25:17 smithi139 systemd[1]: Starting Ceph osd.4 for d5dbf8d6-74c3-11ef-bceb-c7b262605968... 2024-09-17T07:25:18.373 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:18 smithi139 ceph-mon[79872]: Health check failed: Degraded data redundancy: 13/369 objects degraded (3.523%), 4 pgs degraded (PG_DEGRADED) 2024-09-17T07:25:18.373 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 17 07:25:18 smithi139 podman[93568]: 2024-09-17 07:25:18.023628621 +0000 UTC m=+0.015899271 image pull 980a0bfcd684674f25c08d857ad8de3b1c8ae738870529edbf9aa463832c8d89 quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9 2024-09-17T07:25:18.374 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 17 07:25:18 smithi139 podman[93568]: 2024-09-17 07:25:18.145874348 +0000 UTC m=+0.138145027 container create c4b3af0d277f617e517eea4e540b9e0f9619f79c08fbf6ba5008344c35563f2b (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-4-activate, RELEASE=reef-19e2a2b, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True) 2024-09-17T07:25:18.374 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 17 07:25:18 smithi139 podman[93568]: 2024-09-17 07:25:18.37369568 +0000 UTC m=+0.365966321 container init c4b3af0d277f617e517eea4e540b9e0f9619f79c08fbf6ba5008344c35563f2b (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-4-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=reef-19e2a2b, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-17T07:25:18.659 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:18 smithi087 ceph-mon[90982]: Health check failed: Degraded data redundancy: 13/369 objects degraded (3.523%), 4 pgs degraded (PG_DEGRADED) 2024-09-17T07:25:18.673 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 17 07:25:18 smithi139 podman[93568]: 2024-09-17 07:25:18.377238993 +0000 UTC m=+0.369509629 container start c4b3af0d277f617e517eea4e540b9e0f9619f79c08fbf6ba5008344c35563f2b (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-4-activate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=reef-19e2a2b, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-17T07:25:18.673 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 17 07:25:18 smithi139 podman[93568]: 2024-09-17 07:25:18.456803016 +0000 UTC m=+0.449073654 container attach c4b3af0d277f617e517eea4e540b9e0f9619f79c08fbf6ba5008344c35563f2b (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-4-activate, RELEASE=reef-19e2a2b, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T07:25:19.116 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 17 07:25:18 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-4-activate[93584]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-17T07:25:19.117 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 17 07:25:18 smithi139 bash[93568]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-17T07:25:19.117 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 17 07:25:18 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-4-activate[93584]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-17T07:25:19.117 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 17 07:25:18 smithi139 bash[93568]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-17T07:25:19.117 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 17 07:25:18 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-4-activate[93584]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-17T07:25:19.117 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 17 07:25:18 smithi139 bash[93568]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-17T07:25:19.117 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 17 07:25:18 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-4-activate[93584]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-17T07:25:19.117 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 17 07:25:18 smithi139 bash[93568]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-17T07:25:19.117 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 17 07:25:18 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-4-activate[93584]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-09-17T07:25:19.117 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 17 07:25:18 smithi139 bash[93568]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-09-17T07:25:19.117 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 17 07:25:18 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-4-activate[93584]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-17T07:25:19.117 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 17 07:25:18 smithi139 bash[93568]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-17T07:25:19.117 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 17 07:25:18 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-4-activate[93584]: --> ceph-volume raw activate successful for osd ID: 4 2024-09-17T07:25:19.117 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 17 07:25:18 smithi139 bash[93568]: --> ceph-volume raw activate successful for osd ID: 4 2024-09-17T07:25:19.118 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 17 07:25:18 smithi139 podman[93568]: 2024-09-17 07:25:18.72288452 +0000 UTC m=+0.715155155 container died c4b3af0d277f617e517eea4e540b9e0f9619f79c08fbf6ba5008344c35563f2b (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-4-activate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=reef-19e2a2b, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-17T07:25:19.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:19 smithi139 ceph-mon[79872]: pgmap v125: 65 pgs: 4 active+undersized, 2 peering, 4 stale+active+clean, 4 active+undersized+degraded, 51 active+clean; 322 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 13/369 objects degraded (3.523%) 2024-09-17T07:25:19.617 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 17 07:25:19 smithi139 podman[93715]: 2024-09-17 07:25:19.435604229 +0000 UTC m=+0.706602079 container remove c4b3af0d277f617e517eea4e540b9e0f9619f79c08fbf6ba5008344c35563f2b (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-4-activate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=reef-19e2a2b, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-17T07:25:19.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:19 smithi087 ceph-mon[90982]: pgmap v125: 65 pgs: 4 active+undersized, 2 peering, 4 stale+active+clean, 4 active+undersized+degraded, 51 active+clean; 322 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 13/369 objects degraded (3.523%) 2024-09-17T07:25:19.899 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 17 07:25:19 smithi139 podman[93774]: 2024-09-17 07:25:19.540638175 +0000 UTC m=+0.015320148 image pull 980a0bfcd684674f25c08d857ad8de3b1c8ae738870529edbf9aa463832c8d89 quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9 2024-09-17T07:25:19.899 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 17 07:25:19 smithi139 podman[93774]: 2024-09-17 07:25:19.644704004 +0000 UTC m=+0.119385961 container create 139bbfc915c8216b2511c050209cd2a5a252ba44b97c8b7e91b5a527b0b97b28 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-4, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.license=GPLv2, RELEASE=reef-19e2a2b, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-17T07:25:19.899 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 17 07:25:19 smithi139 podman[93774]: 2024-09-17 07:25:19.899407775 +0000 UTC m=+0.374089761 container init 139bbfc915c8216b2511c050209cd2a5a252ba44b97c8b7e91b5a527b0b97b28 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-4, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=reef-19e2a2b) 2024-09-17T07:25:20.367 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 17 07:25:19 smithi139 podman[93774]: 2024-09-17 07:25:19.90265702 +0000 UTC m=+0.377338978 container start 139bbfc915c8216b2511c050209cd2a5a252ba44b97c8b7e91b5a527b0b97b28 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-4, RELEASE=reef-19e2a2b, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True) 2024-09-17T07:25:20.382 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 17 07:25:19 smithi139 ceph-osd[93794]: -- 172.21.15.139:0/565982887 <== mon.1 v2:172.21.15.139:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x557bf8c211e0 con 0x557bf8bbfc00 2024-09-17T07:25:20.382 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 17 07:25:19 smithi139 bash[93774]: 139bbfc915c8216b2511c050209cd2a5a252ba44b97c8b7e91b5a527b0b97b28 2024-09-17T07:25:20.382 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 17 07:25:20 smithi139 systemd[1]: Started Ceph osd.4 for d5dbf8d6-74c3-11ef-bceb-c7b262605968. 2024-09-17T07:25:20.855 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 17 07:25:20 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-4[93790]: 2024-09-17T07:25:20.442+0000 7f8dc61bf640 -1 Falling back to public interface 2024-09-17T07:25:21.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:21 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:25:21.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:21 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:25:21.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:21 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:25:21.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:21 smithi139 ceph-mon[79872]: pgmap v126: 65 pgs: 16 active+undersized, 2 peering, 16 active+undersized+degraded, 31 active+clean; 322 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 63/369 objects degraded (17.073%) 2024-09-17T07:25:21.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:21 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:25:21.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:21 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:25:21.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:21 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:25:21.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:21 smithi087 ceph-mon[90982]: pgmap v126: 65 pgs: 16 active+undersized, 2 peering, 16 active+undersized+degraded, 31 active+clean; 322 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 63/369 objects degraded (17.073%) 2024-09-17T07:25:22.509 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:22 smithi139 ceph-mon[79872]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-17T07:25:22.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:22 smithi087 ceph-mon[90982]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-17T07:25:23.505 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:23 smithi087 ceph-mon[90982]: pgmap v127: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 322 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 63/369 objects degraded (17.073%) 2024-09-17T07:25:23.505 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:23 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:25:23.505 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:23 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:25:23.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:23 smithi139 ceph-mon[79872]: pgmap v127: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 322 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 63/369 objects degraded (17.073%) 2024-09-17T07:25:23.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:23 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:25:23.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:23 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:25:24.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:24 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:25:24.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:24 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:25:24.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:24 smithi139 ceph-mon[79872]: pgmap v128: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 322 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 63/369 objects degraded (17.073%) 2024-09-17T07:25:24.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:24 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:25:24.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:24 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:25:24.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:24 smithi087 ceph-mon[90982]: pgmap v128: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 322 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 63/369 objects degraded (17.073%) 2024-09-17T07:25:25.618 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:25 smithi139 ceph-mon[79872]: from='osd.4 [v2:172.21.15.139:6808/137480765,v1:172.21.15.139:6809/137480765]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-17T07:25:25.618 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:25 smithi139 ceph-mon[79872]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-17T07:25:25.619 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 17 07:25:25 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-4[93790]: 2024-09-17T07:25:25.279+0000 7f8dc61bf640 -1 osd.4 67 log_to_monitors true 2024-09-17T07:25:25.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:25 smithi087 ceph-mon[90982]: from='osd.4 [v2:172.21.15.139:6808/137480765,v1:172.21.15.139:6809/137480765]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-17T07:25:25.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:25 smithi087 ceph-mon[90982]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-17T07:25:26.600 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:26 smithi139 ceph-mon[79872]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-17T07:25:26.600 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:26 smithi139 ceph-mon[79872]: osdmap e70: 6 total, 5 up, 6 in 2024-09-17T07:25:26.600 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:26 smithi139 ceph-mon[79872]: from='osd.4 [v2:172.21.15.139:6808/137480765,v1:172.21.15.139:6809/137480765]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-09-17T07:25:26.600 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:26 smithi139 ceph-mon[79872]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-09-17T07:25:26.600 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:26 smithi139 ceph-mon[79872]: pgmap v130: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 322 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 63/369 objects degraded (17.073%) 2024-09-17T07:25:26.600 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:26 smithi139 ceph-mon[79872]: from='osd.4 ' entity='osd.4' 2024-09-17T07:25:26.601 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 17 07:25:26 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-4[93790]: 2024-09-17T07:25:26.219+0000 7f8db9f50640 -1 osd.4 67 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T07:25:26.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:26 smithi087 ceph-mon[90982]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-17T07:25:26.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:26 smithi087 ceph-mon[90982]: osdmap e70: 6 total, 5 up, 6 in 2024-09-17T07:25:26.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:26 smithi087 ceph-mon[90982]: from='osd.4 [v2:172.21.15.139:6808/137480765,v1:172.21.15.139:6809/137480765]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-09-17T07:25:26.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:26 smithi087 ceph-mon[90982]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-09-17T07:25:26.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:26 smithi087 ceph-mon[90982]: pgmap v130: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 322 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 63/369 objects degraded (17.073%) 2024-09-17T07:25:26.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:26 smithi087 ceph-mon[90982]: from='osd.4 ' entity='osd.4' 2024-09-17T07:25:27.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:27 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:25:27.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:27 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:25:27.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:27 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:25:27.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:27 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:25:27.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:27 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:25:27.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:27 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:25:27.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:27 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:25:27.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:27 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:25:27.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:27 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:25:27.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:27 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-17T07:25:27.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:27 smithi087 ceph-mon[90982]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-17T07:25:27.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:27 smithi087 ceph-mon[90982]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-17T07:25:27.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:27 smithi087 ceph-mon[90982]: Health check update: Degraded data redundancy: 63/369 objects degraded (17.073%), 16 pgs degraded (PG_DEGRADED) 2024-09-17T07:25:27.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:27 smithi087 ceph-mon[90982]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T07:25:27.928 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:27 smithi087 ceph-mon[90982]: osd.4 [v2:172.21.15.139:6808/137480765,v1:172.21.15.139:6809/137480765] boot 2024-09-17T07:25:27.928 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:27 smithi087 ceph-mon[90982]: osdmap e71: 6 total, 6 up, 6 in 2024-09-17T07:25:27.928 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:27 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T07:25:28.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:27 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:25:28.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:27 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:25:28.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:27 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:25:28.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:27 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:25:28.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:27 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:25:28.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:27 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:25:28.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:27 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:25:28.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:27 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:25:28.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:27 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:25:28.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:27 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-17T07:25:28.118 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:27 smithi139 ceph-mon[79872]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-17T07:25:28.118 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:27 smithi139 ceph-mon[79872]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-17T07:25:28.118 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:27 smithi139 ceph-mon[79872]: Health check update: Degraded data redundancy: 63/369 objects degraded (17.073%), 16 pgs degraded (PG_DEGRADED) 2024-09-17T07:25:28.118 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:27 smithi139 ceph-mon[79872]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T07:25:28.118 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:27 smithi139 ceph-mon[79872]: osd.4 [v2:172.21.15.139:6808/137480765,v1:172.21.15.139:6809/137480765] boot 2024-09-17T07:25:28.118 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:27 smithi139 ceph-mon[79872]: osdmap e71: 6 total, 6 up, 6 in 2024-09-17T07:25:28.118 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:27 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T07:25:29.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:29 smithi139 ceph-mon[79872]: pgmap v132: 65 pgs: 7 peering, 15 active+undersized, 12 active+undersized+degraded, 31 active+clean; 322 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 50/369 objects degraded (13.550%) 2024-09-17T07:25:29.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:29 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:25:29.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:29 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:25:29.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:29 smithi139 ceph-mon[79872]: osdmap e72: 6 total, 6 up, 6 in 2024-09-17T07:25:29.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:29 smithi087 ceph-mon[90982]: pgmap v132: 65 pgs: 7 peering, 15 active+undersized, 12 active+undersized+degraded, 31 active+clean; 322 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 50/369 objects degraded (13.550%) 2024-09-17T07:25:29.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:29 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:25:29.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:29 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:25:29.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:29 smithi087 ceph-mon[90982]: osdmap e72: 6 total, 6 up, 6 in 2024-09-17T07:25:31.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:31 smithi139 ceph-mon[79872]: pgmap v134: 65 pgs: 7 peering, 4 active+undersized, 3 active+undersized+degraded, 51 active+clean; 322 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s; 7/369 objects degraded (1.897%) 2024-09-17T07:25:31.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:31 smithi087 ceph-mon[90982]: pgmap v134: 65 pgs: 7 peering, 4 active+undersized, 3 active+undersized+degraded, 51 active+clean; 322 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s; 7/369 objects degraded (1.897%) 2024-09-17T07:25:32.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:32 smithi139 ceph-mon[79872]: Health check update: Degraded data redundancy: 7/369 objects degraded (1.897%), 3 pgs degraded (PG_DEGRADED) 2024-09-17T07:25:32.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:32 smithi087 ceph-mon[90982]: Health check update: Degraded data redundancy: 7/369 objects degraded (1.897%), 3 pgs degraded (PG_DEGRADED) 2024-09-17T07:25:33.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:33 smithi139 ceph-mon[79872]: pgmap v135: 65 pgs: 7 peering, 58 active+clean; 322 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T07:25:33.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:33 smithi139 ceph-mon[79872]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 7/369 objects degraded (1.897%), 3 pgs degraded) 2024-09-17T07:25:33.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:33 smithi087 ceph-mon[90982]: pgmap v135: 65 pgs: 7 peering, 58 active+clean; 322 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T07:25:33.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:33 smithi087 ceph-mon[90982]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 7/369 objects degraded (1.897%), 3 pgs degraded) 2024-09-17T07:25:35.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:35 smithi087 ceph-mon[90982]: pgmap v136: 65 pgs: 65 active+clean; 322 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s 2024-09-17T07:25:35.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:35 smithi139 ceph-mon[79872]: pgmap v136: 65 pgs: 65 active+clean; 322 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s 2024-09-17T07:25:37.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:37 smithi087 ceph-mon[90982]: pgmap v137: 65 pgs: 65 active+clean; 322 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-17T07:25:37.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:37 smithi139 ceph-mon[79872]: pgmap v137: 65 pgs: 65 active+clean; 322 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-17T07:25:39.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:39 smithi087 ceph-mon[90982]: pgmap v138: 65 pgs: 65 active+clean; 322 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2024-09-17T07:25:39.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:39 smithi139 ceph-mon[79872]: pgmap v138: 65 pgs: 65 active+clean; 322 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2024-09-17T07:25:41.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:41 smithi087 ceph-mon[90982]: pgmap v139: 65 pgs: 65 active+clean; 322 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-17T07:25:41.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:41 smithi139 ceph-mon[79872]: pgmap v139: 65 pgs: 65 active+clean; 322 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-17T07:25:42.362 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:42 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-17T07:25:42.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:42 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-17T07:25:43.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:43 smithi139 ceph-mon[79872]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-17T07:25:43.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:43 smithi139 ceph-mon[79872]: Upgrade: osd.5 is safe to restart 2024-09-17T07:25:43.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:43 smithi139 ceph-mon[79872]: pgmap v140: 65 pgs: 65 active+clean; 322 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:25:43.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:25:43.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:25:43.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:43 smithi087 ceph-mon[90982]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-17T07:25:43.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:43 smithi087 ceph-mon[90982]: Upgrade: osd.5 is safe to restart 2024-09-17T07:25:43.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:43 smithi087 ceph-mon[90982]: pgmap v140: 65 pgs: 65 active+clean; 322 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:25:43.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:25:43.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:25:44.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.175+0000 7f183598a640 1 -- 172.21.15.87:0/3838767379 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18300fe4f0 msgr2=0x7f18300fa650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:25:44.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.175+0000 7f183598a640 1 --2- 172.21.15.87:0/3838767379 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18300fe4f0 0x7f18300fa650 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f18180048d0 tx=0x7f1818009da0 comp rx=0 tx=0).stop 2024-09-17T07:25:44.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.175+0000 7f183598a640 1 -- 172.21.15.87:0/3838767379 shutdown_connections 2024-09-17T07:25:44.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.175+0000 7f183598a640 1 --2- 172.21.15.87:0/3838767379 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18300fe4f0 0x7f18300fa650 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:44.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.175+0000 7f183598a640 1 --2- 172.21.15.87:0/3838767379 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f18300fdba0 0x7f18300fdfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:44.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.175+0000 7f183598a640 1 -- 172.21.15.87:0/3838767379 >> 172.21.15.87:0/3838767379 conn(0x7f18300f63a0 msgr2=0x7f18300f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:25:44.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.175+0000 7f183598a640 1 -- 172.21.15.87:0/3838767379 shutdown_connections 2024-09-17T07:25:44.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.175+0000 7f183598a640 1 -- 172.21.15.87:0/3838767379 wait complete. 2024-09-17T07:25:44.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.176+0000 7f183598a640 1 Processor -- start 2024-09-17T07:25:44.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.176+0000 7f183598a640 1 -- start start 2024-09-17T07:25:44.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.176+0000 7f183598a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18300fdba0 0x7f183010f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:25:44.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.176+0000 7f183598a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f18300fe4f0 0x7f183010f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:25:44.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.176+0000 7f183598a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f183010fd90 con 0x7f18300fdba0 2024-09-17T07:25:44.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.176+0000 7f183598a640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18301105b0 con 0x7f18300fe4f0 2024-09-17T07:25:44.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.176+0000 7f182effd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18300fdba0 0x7f183010f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:25:44.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.177+0000 7f182effd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18300fdba0 0x7f183010f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:48370/0 (socket says 172.21.15.87:48370) 2024-09-17T07:25:44.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.177+0000 7f182effd640 1 -- 172.21.15.87:0/2044062927 learned_addr learned my addr 172.21.15.87:0/2044062927 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:25:44.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.177+0000 7f182e7fc640 1 --2- 172.21.15.87:0/2044062927 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f18300fe4f0 0x7f183010f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:25:44.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.177+0000 7f182effd640 1 -- 172.21.15.87:0/2044062927 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f18300fe4f0 msgr2=0x7f183010f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:25:44.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.177+0000 7f182effd640 1 --2- 172.21.15.87:0/2044062927 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f18300fe4f0 0x7f183010f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:44.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.177+0000 7f182effd640 1 -- 172.21.15.87:0/2044062927 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1818005040 con 0x7f18300fdba0 2024-09-17T07:25:44.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.177+0000 7f182e7fc640 1 --2- 172.21.15.87:0/2044062927 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f18300fe4f0 0x7f183010f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T07:25:44.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.177+0000 7f182effd640 1 --2- 172.21.15.87:0/2044062927 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18300fdba0 0x7f183010f200 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1820002a50 tx=0x7f1820004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:25:44.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.177+0000 7f18277fe640 1 -- 172.21.15.87:0/2044062927 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1820007c30 con 0x7f18300fdba0 2024-09-17T07:25:44.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.177+0000 7f183598a640 1 -- 172.21.15.87:0/2044062927 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1830110840 con 0x7f18300fdba0 2024-09-17T07:25:44.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.177+0000 7f18277fe640 1 -- 172.21.15.87:0/2044062927 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f182000f040 con 0x7f18300fdba0 2024-09-17T07:25:44.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.177+0000 7f18277fe640 1 -- 172.21.15.87:0/2044062927 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f182000d990 con 0x7f18300fdba0 2024-09-17T07:25:44.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.177+0000 7f183598a640 1 -- 172.21.15.87:0/2044062927 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1830110de0 con 0x7f18300fdba0 2024-09-17T07:25:44.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.178+0000 7f183598a640 1 -- 172.21.15.87:0/2044062927 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18300fa040 con 0x7f18300fdba0 2024-09-17T07:25:44.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.179+0000 7f18277fe640 1 -- 172.21.15.87:0/2044062927 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f182000dc50 con 0x7f18300fdba0 2024-09-17T07:25:44.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.179+0000 7f18277fe640 1 --2- 172.21.15.87:0/2044062927 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f181c06cb90 0x7f181c06f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:25:44.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.179+0000 7f18277fe640 1 -- 172.21.15.87:0/2044062927 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f182008b9d0 con 0x7f18300fdba0 2024-09-17T07:25:44.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.180+0000 7f182e7fc640 1 --2- 172.21.15.87:0/2044062927 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f181c06cb90 0x7f181c06f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:25:44.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.180+0000 7f182e7fc640 1 --2- 172.21.15.87:0/2044062927 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f181c06cb90 0x7f181c06f040 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f183010efb0 tx=0x7f1818035040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:25:44.184 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.184+0000 7f18277fe640 1 -- 172.21.15.87:0/2044062927 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f18200559e0 con 0x7f18300fdba0 2024-09-17T07:25:44.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.368+0000 7f183598a640 1 -- 172.21.15.87:0/2044062927 --> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1830111110 con 0x7f181c06cb90 2024-09-17T07:25:44.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.370+0000 7f18277fe640 1 -- 172.21.15.87:0/2044062927 <== mgr.24529 v2:172.21.15.87:6800/1359413180 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f1830111110 con 0x7f181c06cb90 2024-09-17T07:25:44.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.372+0000 7f183598a640 1 -- 172.21.15.87:0/2044062927 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f181c06cb90 msgr2=0x7f181c06f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:25:44.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.372+0000 7f183598a640 1 --2- 172.21.15.87:0/2044062927 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f181c06cb90 0x7f181c06f040 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f183010efb0 tx=0x7f1818035040 comp rx=0 tx=0).stop 2024-09-17T07:25:44.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.372+0000 7f183598a640 1 -- 172.21.15.87:0/2044062927 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18300fdba0 msgr2=0x7f183010f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:25:44.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.372+0000 7f183598a640 1 --2- 172.21.15.87:0/2044062927 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18300fdba0 0x7f183010f200 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1820002a50 tx=0x7f1820004600 comp rx=0 tx=0).stop 2024-09-17T07:25:44.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.372+0000 7f183598a640 1 -- 172.21.15.87:0/2044062927 shutdown_connections 2024-09-17T07:25:44.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.372+0000 7f183598a640 1 --2- 172.21.15.87:0/2044062927 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f181c06cb90 0x7f181c06f040 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:44.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.372+0000 7f183598a640 1 --2- 172.21.15.87:0/2044062927 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f18300fe4f0 0x7f183010f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:44.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.372+0000 7f183598a640 1 --2- 172.21.15.87:0/2044062927 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18300fdba0 0x7f183010f200 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:44.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.372+0000 7f183598a640 1 -- 172.21.15.87:0/2044062927 >> 172.21.15.87:0/2044062927 conn(0x7f18300f63a0 msgr2=0x7f18300f7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:25:44.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.372+0000 7f183598a640 1 -- 172.21.15.87:0/2044062927 shutdown_connections 2024-09-17T07:25:44.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.372+0000 7f183598a640 1 -- 172.21.15.87:0/2044062927 wait complete. 2024-09-17T07:25:44.381 INFO:teuthology.orchestra.run.smithi087.stdout:true 2024-09-17T07:25:44.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:44 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:25:44.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:44 smithi087 ceph-mon[90982]: Upgrade: Updating osd.5 2024-09-17T07:25:44.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:44 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:25:44.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:44 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-17T07:25:44.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:44 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:25:44.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:44 smithi087 ceph-mon[90982]: Deploying daemon osd.5 on smithi139 2024-09-17T07:25:44.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.453+0000 7f2b9c866640 1 -- 172.21.15.87:0/1900837702 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b980fb450 msgr2=0x7f2b980fb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:25:44.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.453+0000 7f2b9c866640 1 --2- 172.21.15.87:0/1900837702 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b980fb450 0x7f2b980fb860 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2b880048d0 tx=0x7f2b88009da0 comp rx=0 tx=0).stop 2024-09-17T07:25:44.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.453+0000 7f2b9c866640 1 -- 172.21.15.87:0/1900837702 shutdown_connections 2024-09-17T07:25:44.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.453+0000 7f2b9c866640 1 --2- 172.21.15.87:0/1900837702 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2b980fc720 0x7f2b980fcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:44.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.453+0000 7f2b9c866640 1 --2- 172.21.15.87:0/1900837702 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b980fb450 0x7f2b980fb860 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:44.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.453+0000 7f2b9c866640 1 -- 172.21.15.87:0/1900837702 >> 172.21.15.87:0/1900837702 conn(0x7f2b980f6c10 msgr2=0x7f2b980f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:25:44.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.453+0000 7f2b9c866640 1 -- 172.21.15.87:0/1900837702 shutdown_connections 2024-09-17T07:25:44.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.453+0000 7f2b9c866640 1 -- 172.21.15.87:0/1900837702 wait complete. 2024-09-17T07:25:44.455 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:44 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:25:44.455 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:44 smithi139 ceph-mon[79872]: Upgrade: Updating osd.5 2024-09-17T07:25:44.455 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:44 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:25:44.455 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:44 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-17T07:25:44.455 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:44 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:25:44.455 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:44 smithi139 ceph-mon[79872]: Deploying daemon osd.5 on smithi139 2024-09-17T07:25:44.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.454+0000 7f2b9c866640 1 Processor -- start 2024-09-17T07:25:44.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.454+0000 7f2b9c866640 1 -- start start 2024-09-17T07:25:44.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.454+0000 7f2b9c866640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b980fb450 0x7f2b9810fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:25:44.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.454+0000 7f2b9c866640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2b980fc720 0x7f2b98112330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:25:44.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.454+0000 7f2b9c866640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b980667c0 con 0x7f2b980fb450 2024-09-17T07:25:44.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.454+0000 7f2b9c866640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b98066930 con 0x7f2b980fc720 2024-09-17T07:25:44.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.454+0000 7f2b9659c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b980fb450 0x7f2b9810fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:25:44.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.454+0000 7f2b9659c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b980fb450 0x7f2b9810fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:48378/0 (socket says 172.21.15.87:48378) 2024-09-17T07:25:44.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.454+0000 7f2b9659c640 1 -- 172.21.15.87:0/1463944007 learned_addr learned my addr 172.21.15.87:0/1463944007 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:25:44.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.454+0000 7f2b95d9b640 1 --2- 172.21.15.87:0/1463944007 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2b980fc720 0x7f2b98112330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:25:44.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.455+0000 7f2b9659c640 1 -- 172.21.15.87:0/1463944007 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2b980fc720 msgr2=0x7f2b98112330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:25:44.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.455+0000 7f2b9659c640 1 --2- 172.21.15.87:0/1463944007 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2b980fc720 0x7f2b98112330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:44.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.455+0000 7f2b9659c640 1 -- 172.21.15.87:0/1463944007 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b88005040 con 0x7f2b980fb450 2024-09-17T07:25:44.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.455+0000 7f2b9659c640 1 --2- 172.21.15.87:0/1463944007 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b980fb450 0x7f2b9810fde0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2b88003080 tx=0x7f2b88009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:25:44.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.455+0000 7f2b86ffd640 1 -- 172.21.15.87:0/1463944007 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b88038070 con 0x7f2b980fb450 2024-09-17T07:25:44.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.455+0000 7f2b86ffd640 1 -- 172.21.15.87:0/1463944007 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f2b8802ae70 con 0x7f2b980fb450 2024-09-17T07:25:44.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.455+0000 7f2b9c866640 1 -- 172.21.15.87:0/1463944007 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b98112930 con 0x7f2b980fb450 2024-09-17T07:25:44.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.455+0000 7f2b86ffd640 1 -- 172.21.15.87:0/1463944007 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b8803d420 con 0x7f2b980fb450 2024-09-17T07:25:44.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.455+0000 7f2b9c866640 1 -- 172.21.15.87:0/1463944007 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b98112e50 con 0x7f2b980fb450 2024-09-17T07:25:44.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.456+0000 7f2b9c866640 1 -- 172.21.15.87:0/1463944007 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b980fa8b0 con 0x7f2b980fb450 2024-09-17T07:25:44.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.456+0000 7f2b86ffd640 1 -- 172.21.15.87:0/1463944007 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f2b88030020 con 0x7f2b980fb450 2024-09-17T07:25:44.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.457+0000 7f2b86ffd640 1 --2- 172.21.15.87:0/1463944007 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f2b8006cb90 0x7f2b8006f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:25:44.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.457+0000 7f2b86ffd640 1 -- 172.21.15.87:0/1463944007 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f2b880ac860 con 0x7f2b980fb450 2024-09-17T07:25:44.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.457+0000 7f2b95d9b640 1 --2- 172.21.15.87:0/1463944007 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f2b8006cb90 0x7f2b8006f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:25:44.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.457+0000 7f2b95d9b640 1 --2- 172.21.15.87:0/1463944007 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f2b8006cb90 0x7f2b8006f040 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c009b50 tx=0x7f2b8c009120 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:25:44.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.461+0000 7f2b86ffd640 1 -- 172.21.15.87:0/1463944007 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2b88076870 con 0x7f2b980fb450 2024-09-17T07:25:44.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.639+0000 7f2b9c866640 1 -- 172.21.15.87:0/1463944007 --> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2b98100c90 con 0x7f2b8006cb90 2024-09-17T07:25:44.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.640+0000 7f2b86ffd640 1 -- 172.21.15.87:0/1463944007 <== mgr.24529 v2:172.21.15.87:6800/1359413180 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f2b98100c90 con 0x7f2b8006cb90 2024-09-17T07:25:44.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.642+0000 7f2b9c866640 1 -- 172.21.15.87:0/1463944007 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f2b8006cb90 msgr2=0x7f2b8006f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:25:44.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.642+0000 7f2b9c866640 1 --2- 172.21.15.87:0/1463944007 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f2b8006cb90 0x7f2b8006f040 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c009b50 tx=0x7f2b8c009120 comp rx=0 tx=0).stop 2024-09-17T07:25:44.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.642+0000 7f2b9c866640 1 -- 172.21.15.87:0/1463944007 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b980fb450 msgr2=0x7f2b9810fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:25:44.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.642+0000 7f2b9c866640 1 --2- 172.21.15.87:0/1463944007 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b980fb450 0x7f2b9810fde0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2b88003080 tx=0x7f2b88009da0 comp rx=0 tx=0).stop 2024-09-17T07:25:44.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.642+0000 7f2b9c866640 1 -- 172.21.15.87:0/1463944007 shutdown_connections 2024-09-17T07:25:44.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.642+0000 7f2b9c866640 1 --2- 172.21.15.87:0/1463944007 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f2b8006cb90 0x7f2b8006f040 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:44.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.642+0000 7f2b9c866640 1 --2- 172.21.15.87:0/1463944007 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2b980fc720 0x7f2b98112330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:44.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.642+0000 7f2b9c866640 1 --2- 172.21.15.87:0/1463944007 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b980fb450 0x7f2b9810fde0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:44.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.642+0000 7f2b9c866640 1 -- 172.21.15.87:0/1463944007 >> 172.21.15.87:0/1463944007 conn(0x7f2b980f6c10 msgr2=0x7f2b980f8540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:25:44.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.642+0000 7f2b9c866640 1 -- 172.21.15.87:0/1463944007 shutdown_connections 2024-09-17T07:25:44.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.642+0000 7f2b9c866640 1 -- 172.21.15.87:0/1463944007 wait complete. 2024-09-17T07:25:44.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.721+0000 7f74420ec640 1 -- 172.21.15.87:0/293299620 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f743c0fe4f0 msgr2=0x7f743c0fa650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:25:44.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.721+0000 7f74420ec640 1 --2- 172.21.15.87:0/293299620 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f743c0fe4f0 0x7f743c0fa650 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f74300048d0 tx=0x7f7430009da0 comp rx=0 tx=0).stop 2024-09-17T07:25:44.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.721+0000 7f74420ec640 1 -- 172.21.15.87:0/293299620 shutdown_connections 2024-09-17T07:25:44.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.721+0000 7f74420ec640 1 --2- 172.21.15.87:0/293299620 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f743c0fe4f0 0x7f743c0fa650 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:44.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.721+0000 7f74420ec640 1 --2- 172.21.15.87:0/293299620 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f743c0fdba0 0x7f743c0fdfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:44.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.721+0000 7f74420ec640 1 -- 172.21.15.87:0/293299620 >> 172.21.15.87:0/293299620 conn(0x7f743c0f63a0 msgr2=0x7f743c0f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:25:44.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.721+0000 7f74420ec640 1 -- 172.21.15.87:0/293299620 shutdown_connections 2024-09-17T07:25:44.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.721+0000 7f74420ec640 1 -- 172.21.15.87:0/293299620 wait complete. 2024-09-17T07:25:44.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.721+0000 7f74420ec640 1 Processor -- start 2024-09-17T07:25:44.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.722+0000 7f74420ec640 1 -- start start 2024-09-17T07:25:44.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.722+0000 7f74420ec640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f743c0fdba0 0x7f743c10cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:25:44.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.722+0000 7f74420ec640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f743c0fe4f0 0x7f743c10d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:25:44.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.722+0000 7f74420ec640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f743c10db30 con 0x7f743c0fdba0 2024-09-17T07:25:44.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.722+0000 7f74420ec640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f743c10e350 con 0x7f743c0fe4f0 2024-09-17T07:25:44.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.722+0000 7f743b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f743c0fdba0 0x7f743c10cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:25:44.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.722+0000 7f743b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f743c0fdba0 0x7f743c10cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:48398/0 (socket says 172.21.15.87:48398) 2024-09-17T07:25:44.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.722+0000 7f743b7fe640 1 -- 172.21.15.87:0/463651476 learned_addr learned my addr 172.21.15.87:0/463651476 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:25:44.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.722+0000 7f743affd640 1 --2- 172.21.15.87:0/463651476 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f743c0fe4f0 0x7f743c10d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:25:44.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.722+0000 7f743b7fe640 1 -- 172.21.15.87:0/463651476 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f743c0fe4f0 msgr2=0x7f743c10d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:25:44.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.722+0000 7f743b7fe640 1 --2- 172.21.15.87:0/463651476 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f743c0fe4f0 0x7f743c10d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:44.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.722+0000 7f743b7fe640 1 -- 172.21.15.87:0/463651476 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7430005040 con 0x7f743c0fdba0 2024-09-17T07:25:44.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.723+0000 7f743b7fe640 1 --2- 172.21.15.87:0/463651476 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f743c0fdba0 0x7f743c10cfa0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f742c002a80 tx=0x7f742c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:25:44.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.723+0000 7f7423fff640 1 -- 172.21.15.87:0/463651476 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f742c007c30 con 0x7f743c0fdba0 2024-09-17T07:25:44.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.723+0000 7f74420ec640 1 -- 172.21.15.87:0/463651476 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f743c10e5e0 con 0x7f743c0fdba0 2024-09-17T07:25:44.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.723+0000 7f7423fff640 1 -- 172.21.15.87:0/463651476 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f742c00f040 con 0x7f743c0fdba0 2024-09-17T07:25:44.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.723+0000 7f7423fff640 1 -- 172.21.15.87:0/463651476 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f742c00d9b0 con 0x7f743c0fdba0 2024-09-17T07:25:44.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.723+0000 7f74420ec640 1 -- 172.21.15.87:0/463651476 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f743c10ead0 con 0x7f743c0fdba0 2024-09-17T07:25:44.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.724+0000 7f74420ec640 1 -- 172.21.15.87:0/463651476 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f743c105650 con 0x7f743c0fdba0 2024-09-17T07:25:44.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.725+0000 7f7423fff640 1 -- 172.21.15.87:0/463651476 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f742c00dc20 con 0x7f743c0fdba0 2024-09-17T07:25:44.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.725+0000 7f7423fff640 1 --2- 172.21.15.87:0/463651476 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f742406cb90 0x7f742406f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:25:44.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.726+0000 7f7423fff640 1 -- 172.21.15.87:0/463651476 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f742c08b9d0 con 0x7f743c0fdba0 2024-09-17T07:25:44.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.726+0000 7f743affd640 1 --2- 172.21.15.87:0/463651476 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f742406cb90 0x7f742406f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:25:44.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.726+0000 7f743affd640 1 --2- 172.21.15.87:0/463651476 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f742406cb90 0x7f742406f040 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7430009ac0 tx=0x7f7430035040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:25:44.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.731+0000 7f7423fff640 1 -- 172.21.15.87:0/463651476 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f742c055a90 con 0x7f743c0fdba0 2024-09-17T07:25:44.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.900+0000 7f74420ec640 1 -- 172.21.15.87:0/463651476 --> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f743c10ee00 con 0x7f742406cb90 2024-09-17T07:25:44.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.909+0000 7f7423fff640 1 -- 172.21.15.87:0/463651476 <== mgr.24529 v2:172.21.15.87:6800/1359413180 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f743c10ee00 con 0x7f742406cb90 2024-09-17T07:25:44.909 INFO:teuthology.orchestra.run.smithi087.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T07:25:44.910 INFO:teuthology.orchestra.run.smithi087.stdout:alertmanager.smithi087 smithi087 *:9093,9094 running (5m) 84s ago 13m 25.6M - 0.25.0 c8568f914cd2 594553f0b497 2024-09-17T07:25:44.910 INFO:teuthology.orchestra.run.smithi087.stdout:crash.smithi087 smithi087 running (3m) 84s ago 13m 6895k - 18.2.4-855-g19e2a2be 980a0bfcd684 0ff8a9330162 2024-09-17T07:25:44.910 INFO:teuthology.orchestra.run.smithi087.stdout:crash.smithi139 smithi139 running (2m) 22s ago 12m 6899k - 18.2.4-855-g19e2a2be 980a0bfcd684 10541e3b202e 2024-09-17T07:25:44.910 INFO:teuthology.orchestra.run.smithi087.stdout:grafana.smithi087 smithi087 *:3000 running (5m) 84s ago 13m 80.1M - 9.4.7 954c08fa6188 e2f17ec6baa8 2024-09-17T07:25:44.910 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi087.tjhpcs smithi087 running (8m) 84s ago 8m 130M - 17.2.7-1635-g4a704134 f22ead590bad f7142ad971ed 2024-09-17T07:25:44.910 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi087.vvbzss smithi087 running (8m) 84s ago 8m 70.2M - 17.2.7-1635-g4a704134 f22ead590bad 2dd82ff293d1 2024-09-17T07:25:44.910 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi139.ftvinf smithi139 running (8m) 22s ago 8m 57.3M - 17.2.7-1635-g4a704134 f22ead590bad d11edb295ad3 2024-09-17T07:25:44.910 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi139.gnwonz smithi139 running (8m) 22s ago 8m 116M - 17.2.7-1635-g4a704134 f22ead590bad 3b3d884aef02 2024-09-17T07:25:44.910 INFO:teuthology.orchestra.run.smithi087.stdout:mgr.smithi087.vuvjer smithi087 *:8443,9283,8765 running (4m) 84s ago 15m 488M - 18.2.4-855-g19e2a2be 980a0bfcd684 5d10c647cb6b 2024-09-17T07:25:44.910 INFO:teuthology.orchestra.run.smithi087.stdout:mgr.smithi139.tuqnpn smithi139 *:8443,9283,8765 running (4m) 22s ago 12m 439M - 18.2.4-855-g19e2a2be 980a0bfcd684 6e0bf371d44c 2024-09-17T07:25:44.910 INFO:teuthology.orchestra.run.smithi087.stdout:mon.smithi087 smithi087 running (3m) 84s ago 15m 44.5M 2048M 18.2.4-855-g19e2a2be 980a0bfcd684 305c72de1f9f 2024-09-17T07:25:44.910 INFO:teuthology.orchestra.run.smithi087.stdout:mon.smithi139 smithi139 running (3m) 22s ago 12m 38.8M 2048M 18.2.4-855-g19e2a2be 980a0bfcd684 0b159495af0f 2024-09-17T07:25:44.911 INFO:teuthology.orchestra.run.smithi087.stdout:node-exporter.smithi087 smithi087 *:9100 running (5m) 84s ago 13m 15.3M - 1.5.0 0da6a335fe13 39fa48de0e87 2024-09-17T07:25:44.911 INFO:teuthology.orchestra.run.smithi087.stdout:node-exporter.smithi139 smithi139 *:9100 running (4m) 22s ago 12m 15.7M - 1.5.0 0da6a335fe13 a5b99b7cbb06 2024-09-17T07:25:44.911 INFO:teuthology.orchestra.run.smithi087.stdout:osd.0 smithi087 running (2m) 84s ago 11m 85.4M 1557M 18.2.4-855-g19e2a2be 980a0bfcd684 e97cb50e6aec 2024-09-17T07:25:44.911 INFO:teuthology.orchestra.run.smithi087.stdout:osd.1 smithi087 running (2m) 84s ago 11m 89.7M 1557M 18.2.4-855-g19e2a2be 980a0bfcd684 b108771d0b8e 2024-09-17T07:25:44.911 INFO:teuthology.orchestra.run.smithi087.stdout:osd.2 smithi087 running (90s) 84s ago 11m 11.8M 1557M 18.2.4-855-g19e2a2be 980a0bfcd684 240cfb3b5366 2024-09-17T07:25:44.911 INFO:teuthology.orchestra.run.smithi087.stdout:osd.3 smithi139 running (56s) 22s ago 10m 101M 2581M 18.2.4-855-g19e2a2be 980a0bfcd684 b05ed3bf3f5c 2024-09-17T07:25:44.911 INFO:teuthology.orchestra.run.smithi087.stdout:osd.4 smithi139 running (25s) 22s ago 10m 14.3M 2581M 18.2.4-855-g19e2a2be 980a0bfcd684 139bbfc915c8 2024-09-17T07:25:44.911 INFO:teuthology.orchestra.run.smithi087.stdout:osd.5 smithi139 running (9m) 22s ago 9m 202M 2581M 17.2.7-1635-g4a704134 f22ead590bad 609cf74f32e7 2024-09-17T07:25:44.911 INFO:teuthology.orchestra.run.smithi087.stdout:prometheus.smithi087 smithi087 *:9095 running (4m) 84s ago 13m 56.5M - 2.43.0 a07b618ecd1d 63d18b7469fc 2024-09-17T07:25:44.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.911+0000 7f74420ec640 1 -- 172.21.15.87:0/463651476 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f742406cb90 msgr2=0x7f742406f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:25:44.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.911+0000 7f74420ec640 1 --2- 172.21.15.87:0/463651476 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f742406cb90 0x7f742406f040 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7430009ac0 tx=0x7f7430035040 comp rx=0 tx=0).stop 2024-09-17T07:25:44.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.911+0000 7f74420ec640 1 -- 172.21.15.87:0/463651476 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f743c0fdba0 msgr2=0x7f743c10cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:25:44.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.911+0000 7f74420ec640 1 --2- 172.21.15.87:0/463651476 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f743c0fdba0 0x7f743c10cfa0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f742c002a80 tx=0x7f742c004600 comp rx=0 tx=0).stop 2024-09-17T07:25:44.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.911+0000 7f74420ec640 1 -- 172.21.15.87:0/463651476 shutdown_connections 2024-09-17T07:25:44.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.911+0000 7f74420ec640 1 --2- 172.21.15.87:0/463651476 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f742406cb90 0x7f742406f040 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:44.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.911+0000 7f74420ec640 1 --2- 172.21.15.87:0/463651476 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f743c0fe4f0 0x7f743c10d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:44.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.911+0000 7f74420ec640 1 --2- 172.21.15.87:0/463651476 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f743c0fdba0 0x7f743c10cfa0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:44.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.911+0000 7f74420ec640 1 -- 172.21.15.87:0/463651476 >> 172.21.15.87:0/463651476 conn(0x7f743c0f63a0 msgr2=0x7f743c0f7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:25:44.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.912+0000 7f74420ec640 1 -- 172.21.15.87:0/463651476 shutdown_connections 2024-09-17T07:25:44.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.912+0000 7f74420ec640 1 -- 172.21.15.87:0/463651476 wait complete. 2024-09-17T07:25:44.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.990+0000 7f45236be640 1 -- 172.21.15.87:0/1578391514 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f451c0ff6f0 msgr2=0x7f451c101ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:25:44.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.990+0000 7f45236be640 1 --2- 172.21.15.87:0/1578391514 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f451c0ff6f0 0x7f451c101ad0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f45100048d0 tx=0x7f4510009da0 comp rx=0 tx=0).stop 2024-09-17T07:25:44.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.990+0000 7f45236be640 1 -- 172.21.15.87:0/1578391514 shutdown_connections 2024-09-17T07:25:44.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.990+0000 7f45236be640 1 --2- 172.21.15.87:0/1578391514 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f451c0ff6f0 0x7f451c101ad0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:44.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.990+0000 7f45236be640 1 --2- 172.21.15.87:0/1578391514 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f451c066450 0x7f451c0ff1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:44.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.990+0000 7f45236be640 1 -- 172.21.15.87:0/1578391514 >> 172.21.15.87:0/1578391514 conn(0x7f451c0f6c00 msgr2=0x7f451c0f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:25:44.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.991+0000 7f45236be640 1 -- 172.21.15.87:0/1578391514 shutdown_connections 2024-09-17T07:25:44.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.991+0000 7f45236be640 1 -- 172.21.15.87:0/1578391514 wait complete. 2024-09-17T07:25:44.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.991+0000 7f45236be640 1 Processor -- start 2024-09-17T07:25:44.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.991+0000 7f45236be640 1 -- start start 2024-09-17T07:25:44.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.991+0000 7f45236be640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f451c066450 0x7f451c10cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:25:44.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.991+0000 7f45236be640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f451c0ff6f0 0x7f451c10d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:25:44.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.991+0000 7f45236be640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f451c10db70 con 0x7f451c066450 2024-09-17T07:25:44.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.991+0000 7f45236be640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f451c10e390 con 0x7f451c0ff6f0 2024-09-17T07:25:44.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.991+0000 7f452145a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f451c066450 0x7f451c10cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:25:44.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.992+0000 7f452145a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f451c066450 0x7f451c10cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:48412/0 (socket says 172.21.15.87:48412) 2024-09-17T07:25:44.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.992+0000 7f452145a640 1 -- 172.21.15.87:0/4240562212 learned_addr learned my addr 172.21.15.87:0/4240562212 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:25:44.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.992+0000 7f4520c59640 1 --2- 172.21.15.87:0/4240562212 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f451c0ff6f0 0x7f451c10d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:25:44.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.992+0000 7f452145a640 1 -- 172.21.15.87:0/4240562212 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f451c0ff6f0 msgr2=0x7f451c10d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:25:44.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.992+0000 7f452145a640 1 --2- 172.21.15.87:0/4240562212 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f451c0ff6f0 0x7f451c10d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:44.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.992+0000 7f452145a640 1 -- 172.21.15.87:0/4240562212 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4510005040 con 0x7f451c066450 2024-09-17T07:25:44.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.992+0000 7f452145a640 1 --2- 172.21.15.87:0/4240562212 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f451c066450 0x7f451c10cfe0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f451400ece0 tx=0x7f451400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:25:44.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.992+0000 7f4519ffb640 1 -- 172.21.15.87:0/4240562212 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f451400cab0 con 0x7f451c066450 2024-09-17T07:25:44.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.992+0000 7f4519ffb640 1 -- 172.21.15.87:0/4240562212 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f451400f040 con 0x7f451c066450 2024-09-17T07:25:44.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.992+0000 7f4519ffb640 1 -- 172.21.15.87:0/4240562212 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4514009580 con 0x7f451c066450 2024-09-17T07:25:44.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.992+0000 7f45236be640 1 -- 172.21.15.87:0/4240562212 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f451c10e620 con 0x7f451c066450 2024-09-17T07:25:44.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.992+0000 7f45236be640 1 -- 172.21.15.87:0/4240562212 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f451c10eb40 con 0x7f451c066450 2024-09-17T07:25:44.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.993+0000 7f45236be640 1 -- 172.21.15.87:0/4240562212 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f451c0fa880 con 0x7f451c066450 2024-09-17T07:25:44.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.994+0000 7f4519ffb640 1 -- 172.21.15.87:0/4240562212 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f451400cca0 con 0x7f451c066450 2024-09-17T07:25:44.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.994+0000 7f4519ffb640 1 --2- 172.21.15.87:0/4240562212 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f450406cb90 0x7f450406f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:25:44.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.994+0000 7f4519ffb640 1 -- 172.21.15.87:0/4240562212 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f451408c6d0 con 0x7f451c066450 2024-09-17T07:25:44.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.994+0000 7f4520c59640 1 --2- 172.21.15.87:0/4240562212 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f450406cb90 0x7f450406f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:25:44.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.995+0000 7f4520c59640 1 --2- 172.21.15.87:0/4240562212 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f450406cb90 0x7f450406f040 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4510000c00 tx=0x7f4510035040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:25:44.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:44.999+0000 7f4519ffb640 1 -- 172.21.15.87:0/4240562212 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f451405a170 con 0x7f451c066450 2024-09-17T07:25:45.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.226+0000 7f45236be640 1 -- 172.21.15.87:0/4240562212 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f451c04b720 con 0x7f451c066450 2024-09-17T07:25:45.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.226+0000 7f4519ffb640 1 -- 172.21.15.87:0/4240562212 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+846 (secure 0 0 0) 0x7f4514059d00 con 0x7f451c066450 2024-09-17T07:25:45.227 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T07:25:45.227 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": { 2024-09-17T07:25:45.227 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 2 2024-09-17T07:25:45.227 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:25:45.227 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr": { 2024-09-17T07:25:45.227 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 2 2024-09-17T07:25:45.227 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:25:45.227 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": { 2024-09-17T07:25:45.227 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 1, 2024-09-17T07:25:45.227 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 5 2024-09-17T07:25:45.228 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:25:45.228 INFO:teuthology.orchestra.run.smithi087.stdout: "mds": { 2024-09-17T07:25:45.228 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 4 2024-09-17T07:25:45.228 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:25:45.228 INFO:teuthology.orchestra.run.smithi087.stdout: "overall": { 2024-09-17T07:25:45.228 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 5, 2024-09-17T07:25:45.228 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 9 2024-09-17T07:25:45.229 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T07:25:45.229 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T07:25:45.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.228+0000 7f45236be640 1 -- 172.21.15.87:0/4240562212 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f450406cb90 msgr2=0x7f450406f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:25:45.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.228+0000 7f45236be640 1 --2- 172.21.15.87:0/4240562212 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f450406cb90 0x7f450406f040 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4510000c00 tx=0x7f4510035040 comp rx=0 tx=0).stop 2024-09-17T07:25:45.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.228+0000 7f45236be640 1 -- 172.21.15.87:0/4240562212 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f451c066450 msgr2=0x7f451c10cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:25:45.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.228+0000 7f45236be640 1 --2- 172.21.15.87:0/4240562212 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f451c066450 0x7f451c10cfe0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f451400ece0 tx=0x7f451400b040 comp rx=0 tx=0).stop 2024-09-17T07:25:45.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.229+0000 7f45236be640 1 -- 172.21.15.87:0/4240562212 shutdown_connections 2024-09-17T07:25:45.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.229+0000 7f45236be640 1 --2- 172.21.15.87:0/4240562212 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f450406cb90 0x7f450406f040 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:45.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.229+0000 7f45236be640 1 --2- 172.21.15.87:0/4240562212 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f451c0ff6f0 0x7f451c10d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:45.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.229+0000 7f45236be640 1 --2- 172.21.15.87:0/4240562212 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f451c066450 0x7f451c10cfe0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:45.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.229+0000 7f45236be640 1 -- 172.21.15.87:0/4240562212 >> 172.21.15.87:0/4240562212 conn(0x7f451c0f6c00 msgr2=0x7f451c0f6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:25:45.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.229+0000 7f45236be640 1 -- 172.21.15.87:0/4240562212 shutdown_connections 2024-09-17T07:25:45.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.229+0000 7f45236be640 1 -- 172.21.15.87:0/4240562212 wait complete. 2024-09-17T07:25:45.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.306+0000 7ffacd2d9640 1 -- 172.21.15.87:0/2889515500 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffac80fc720 msgr2=0x7ffac80fcb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:25:45.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.306+0000 7ffacd2d9640 1 --2- 172.21.15.87:0/2889515500 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffac80fc720 0x7ffac80fcb90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ffabc0048d0 tx=0x7ffabc009da0 comp rx=0 tx=0).stop 2024-09-17T07:25:45.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.306+0000 7ffacd2d9640 1 -- 172.21.15.87:0/2889515500 shutdown_connections 2024-09-17T07:25:45.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.307+0000 7ffacd2d9640 1 --2- 172.21.15.87:0/2889515500 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffac80fc720 0x7ffac80fcb90 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:45.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.307+0000 7ffacd2d9640 1 --2- 172.21.15.87:0/2889515500 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffac80fb450 0x7ffac80fb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:45.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.307+0000 7ffacd2d9640 1 -- 172.21.15.87:0/2889515500 >> 172.21.15.87:0/2889515500 conn(0x7ffac80f6c10 msgr2=0x7ffac80f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:25:45.308 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:45 smithi087 ceph-mon[90982]: pgmap v141: 65 pgs: 65 active+clean; 322 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:25:45.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.307+0000 7ffacd2d9640 1 -- 172.21.15.87:0/2889515500 shutdown_connections 2024-09-17T07:25:45.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.307+0000 7ffacd2d9640 1 -- 172.21.15.87:0/2889515500 wait complete. 2024-09-17T07:25:45.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.307+0000 7ffacd2d9640 1 Processor -- start 2024-09-17T07:25:45.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.307+0000 7ffacd2d9640 1 -- start start 2024-09-17T07:25:45.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.307+0000 7ffacd2d9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffac80fb450 0x7ffac810d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:25:45.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.307+0000 7ffacd2d9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffac80fc720 0x7ffac810d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:25:45.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.307+0000 7ffacd2d9640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffac810dba0 con 0x7ffac80fb450 2024-09-17T07:25:45.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.307+0000 7ffacd2d9640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffac810e3c0 con 0x7ffac80fc720 2024-09-17T07:25:45.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.308+0000 7ffac6ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffac80fb450 0x7ffac810d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:25:45.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.308+0000 7ffac6ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffac80fb450 0x7ffac810d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:48424/0 (socket says 172.21.15.87:48424) 2024-09-17T07:25:45.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.308+0000 7ffac67fc640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffac80fc720 0x7ffac810d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:25:45.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.308+0000 7ffac6ffd640 1 -- 172.21.15.87:0/2262124900 learned_addr learned my addr 172.21.15.87:0/2262124900 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:25:45.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.308+0000 7ffac6ffd640 1 -- 172.21.15.87:0/2262124900 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffac80fc720 msgr2=0x7ffac810d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:25:45.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.308+0000 7ffac6ffd640 1 --2- 172.21.15.87:0/2262124900 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffac80fc720 0x7ffac810d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:45.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.308+0000 7ffac6ffd640 1 -- 172.21.15.87:0/2262124900 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffabc005040 con 0x7ffac80fb450 2024-09-17T07:25:45.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.308+0000 7ffac67fc640 1 --2- 172.21.15.87:0/2262124900 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffac80fc720 0x7ffac810d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T07:25:45.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.308+0000 7ffac6ffd640 1 --2- 172.21.15.87:0/2262124900 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffac80fb450 0x7ffac810d010 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ffab800eb70 tx=0x7ffab800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:25:45.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.308+0000 7ffaaf7fe640 1 -- 172.21.15.87:0/2262124900 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffab8007c30 con 0x7ffac80fb450 2024-09-17T07:25:45.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.308+0000 7ffaaf7fe640 1 -- 172.21.15.87:0/2262124900 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7ffab800f040 con 0x7ffac80fb450 2024-09-17T07:25:45.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.308+0000 7ffacd2d9640 1 -- 172.21.15.87:0/2262124900 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffac810e5f0 con 0x7ffac80fb450 2024-09-17T07:25:45.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.308+0000 7ffacd2d9640 1 -- 172.21.15.87:0/2262124900 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffac810eb90 con 0x7ffac80fb450 2024-09-17T07:25:45.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.308+0000 7ffaaf7fe640 1 -- 172.21.15.87:0/2262124900 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffab80093c0 con 0x7ffac80fb450 2024-09-17T07:25:45.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.310+0000 7ffacd2d9640 1 -- 172.21.15.87:0/2262124900 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffab4005210 con 0x7ffac80fb450 2024-09-17T07:25:45.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.310+0000 7ffaaf7fe640 1 -- 172.21.15.87:0/2262124900 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7ffab8009520 con 0x7ffac80fb450 2024-09-17T07:25:45.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.310+0000 7ffaaf7fe640 1 --2- 172.21.15.87:0/2262124900 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7ffab006cb90 0x7ffab006f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:25:45.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.311+0000 7ffaaf7fe640 1 -- 172.21.15.87:0/2262124900 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6410+0+0 (secure 0 0 0) 0x7ffab808bb80 con 0x7ffac80fb450 2024-09-17T07:25:45.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.311+0000 7ffac67fc640 1 --2- 172.21.15.87:0/2262124900 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7ffab006cb90 0x7ffab006f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:25:45.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.311+0000 7ffac67fc640 1 --2- 172.21.15.87:0/2262124900 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7ffab006cb90 0x7ffab006f040 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ffac810cdc0 tx=0x7ffabc035040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:25:45.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.315+0000 7ffaaf7fe640 1 -- 172.21.15.87:0/2262124900 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ffab8055cc0 con 0x7ffac80fb450 2024-09-17T07:25:45.344 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:45 smithi139 ceph-mon[79872]: pgmap v141: 65 pgs: 65 active+clean; 322 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:25:45.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.511+0000 7ffacd2d9640 1 -- 172.21.15.87:0/2262124900 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ffab4005cd0 con 0x7ffac80fb450 2024-09-17T07:25:45.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.512+0000 7ffaaf7fe640 1 -- 172.21.15.87:0/2262124900 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 23 v23) v1 ==== 76+0+1871 (secure 0 0 0) 0x7ffab8019760 con 0x7ffac80fb450 2024-09-17T07:25:45.512 INFO:teuthology.orchestra.run.smithi087.stdout:e23 2024-09-17T07:25:45.512 INFO:teuthology.orchestra.run.smithi087.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T07:25:45.512 INFO:teuthology.orchestra.run.smithi087.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T07:25:45.512 INFO:teuthology.orchestra.run.smithi087.stdout:legacy client fscid: 1 2024-09-17T07:25:45.512 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:25:45.512 INFO:teuthology.orchestra.run.smithi087.stdout:Filesystem 'cephfs' (1) 2024-09-17T07:25:45.513 INFO:teuthology.orchestra.run.smithi087.stdout:fs_name cephfs 2024-09-17T07:25:45.513 INFO:teuthology.orchestra.run.smithi087.stdout:epoch 23 2024-09-17T07:25:45.513 INFO:teuthology.orchestra.run.smithi087.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T07:25:45.513 INFO:teuthology.orchestra.run.smithi087.stdout:created 2024-09-17T07:17:15.368053+0000 2024-09-17T07:25:45.513 INFO:teuthology.orchestra.run.smithi087.stdout:modified 2024-09-17T07:24:06.203553+0000 2024-09-17T07:25:45.513 INFO:teuthology.orchestra.run.smithi087.stdout:tableserver 0 2024-09-17T07:25:45.513 INFO:teuthology.orchestra.run.smithi087.stdout:root 0 2024-09-17T07:25:45.513 INFO:teuthology.orchestra.run.smithi087.stdout:session_timeout 60 2024-09-17T07:25:45.513 INFO:teuthology.orchestra.run.smithi087.stdout:session_autoclose 300 2024-09-17T07:25:45.513 INFO:teuthology.orchestra.run.smithi087.stdout:max_file_size 1099511627776 2024-09-17T07:25:45.513 INFO:teuthology.orchestra.run.smithi087.stdout:max_xattr_size 65536 2024-09-17T07:25:45.513 INFO:teuthology.orchestra.run.smithi087.stdout:required_client_features {} 2024-09-17T07:25:45.513 INFO:teuthology.orchestra.run.smithi087.stdout:last_failure 0 2024-09-17T07:25:45.514 INFO:teuthology.orchestra.run.smithi087.stdout:last_failure_osd_epoch 44 2024-09-17T07:25:45.514 INFO:teuthology.orchestra.run.smithi087.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T07:25:45.514 INFO:teuthology.orchestra.run.smithi087.stdout:max_mds 2 2024-09-17T07:25:45.514 INFO:teuthology.orchestra.run.smithi087.stdout:in 0,1 2024-09-17T07:25:45.514 INFO:teuthology.orchestra.run.smithi087.stdout:up {0=14478,1=24243} 2024-09-17T07:25:45.514 INFO:teuthology.orchestra.run.smithi087.stdout:failed 2024-09-17T07:25:45.514 INFO:teuthology.orchestra.run.smithi087.stdout:damaged 2024-09-17T07:25:45.514 INFO:teuthology.orchestra.run.smithi087.stdout:stopped 2024-09-17T07:25:45.514 INFO:teuthology.orchestra.run.smithi087.stdout:data_pools [3] 2024-09-17T07:25:45.514 INFO:teuthology.orchestra.run.smithi087.stdout:metadata_pool 2 2024-09-17T07:25:45.514 INFO:teuthology.orchestra.run.smithi087.stdout:inline_data enabled 2024-09-17T07:25:45.514 INFO:teuthology.orchestra.run.smithi087.stdout:balancer 2024-09-17T07:25:45.515 INFO:teuthology.orchestra.run.smithi087.stdout:bal_rank_mask -1 2024-09-17T07:25:45.515 INFO:teuthology.orchestra.run.smithi087.stdout:standby_count_wanted 1 2024-09-17T07:25:45.515 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi087.tjhpcs{0:14478} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.87:6828/2255237099,v1:172.21.15.87:6829/2255237099] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:25:45.515 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi087.vvbzss{0:14490} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.87:6826/4022268353,v1:172.21.15.87:6827/4022268353] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:25:45.515 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi139.gnwonz{1:24243} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.139:6824/3946792151,v1:172.21.15.139:6825/3946792151] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:25:45.515 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi139.ftvinf{1:24253} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.139:6826/3292073323,v1:172.21.15.139:6827/3292073323] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:25:45.515 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:25:45.515 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:25:45.516 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 23 2024-09-17T07:25:45.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.514+0000 7ffacd2d9640 1 -- 172.21.15.87:0/2262124900 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7ffab006cb90 msgr2=0x7ffab006f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:25:45.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.514+0000 7ffacd2d9640 1 --2- 172.21.15.87:0/2262124900 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7ffab006cb90 0x7ffab006f040 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ffac810cdc0 tx=0x7ffabc035040 comp rx=0 tx=0).stop 2024-09-17T07:25:45.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.514+0000 7ffacd2d9640 1 -- 172.21.15.87:0/2262124900 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffac80fb450 msgr2=0x7ffac810d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:25:45.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.514+0000 7ffacd2d9640 1 --2- 172.21.15.87:0/2262124900 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffac80fb450 0x7ffac810d010 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ffab800eb70 tx=0x7ffab800b040 comp rx=0 tx=0).stop 2024-09-17T07:25:45.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.514+0000 7ffacd2d9640 1 -- 172.21.15.87:0/2262124900 shutdown_connections 2024-09-17T07:25:45.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.514+0000 7ffacd2d9640 1 --2- 172.21.15.87:0/2262124900 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7ffab006cb90 0x7ffab006f040 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:45.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.514+0000 7ffacd2d9640 1 --2- 172.21.15.87:0/2262124900 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffac80fc720 0x7ffac810d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:45.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.514+0000 7ffacd2d9640 1 --2- 172.21.15.87:0/2262124900 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffac80fb450 0x7ffac810d010 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:45.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.514+0000 7ffacd2d9640 1 -- 172.21.15.87:0/2262124900 >> 172.21.15.87:0/2262124900 conn(0x7ffac80f6c10 msgr2=0x7ffac80662a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:25:45.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.515+0000 7ffacd2d9640 1 -- 172.21.15.87:0/2262124900 shutdown_connections 2024-09-17T07:25:45.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.515+0000 7ffacd2d9640 1 -- 172.21.15.87:0/2262124900 wait complete. 2024-09-17T07:25:45.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.594+0000 7f429a595640 1 -- 172.21.15.87:0/3888261012 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f42940fb450 msgr2=0x7f42940fb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:25:45.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.594+0000 7f429a595640 1 --2- 172.21.15.87:0/3888261012 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f42940fb450 0x7f42940fb860 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f42840048d0 tx=0x7f4284009da0 comp rx=0 tx=0).stop 2024-09-17T07:25:45.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.594+0000 7f429a595640 1 -- 172.21.15.87:0/3888261012 shutdown_connections 2024-09-17T07:25:45.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.594+0000 7f429a595640 1 --2- 172.21.15.87:0/3888261012 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f42940fc720 0x7f42940fcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:45.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.594+0000 7f429a595640 1 --2- 172.21.15.87:0/3888261012 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f42940fb450 0x7f42940fb860 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:45.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.594+0000 7f429a595640 1 -- 172.21.15.87:0/3888261012 >> 172.21.15.87:0/3888261012 conn(0x7f42940f6c10 msgr2=0x7f42940f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:25:45.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.594+0000 7f429a595640 1 -- 172.21.15.87:0/3888261012 shutdown_connections 2024-09-17T07:25:45.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.594+0000 7f429a595640 1 -- 172.21.15.87:0/3888261012 wait complete. 2024-09-17T07:25:45.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.595+0000 7f429a595640 1 Processor -- start 2024-09-17T07:25:45.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.595+0000 7f429a595640 1 -- start start 2024-09-17T07:25:45.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.595+0000 7f429a595640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f42940fb450 0x7f429410d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:25:45.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.595+0000 7f429a595640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f42940fc720 0x7f429410d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:25:45.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.595+0000 7f429a595640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f429410dc10 con 0x7f42940fb450 2024-09-17T07:25:45.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.595+0000 7f429a595640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f429410e430 con 0x7f42940fc720 2024-09-17T07:25:45.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.596+0000 7f4293fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f42940fb450 0x7f429410d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:25:45.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.596+0000 7f4293fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f42940fb450 0x7f429410d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:48446/0 (socket says 172.21.15.87:48446) 2024-09-17T07:25:45.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.596+0000 7f4293fff640 1 -- 172.21.15.87:0/3090201952 learned_addr learned my addr 172.21.15.87:0/3090201952 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:25:45.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.596+0000 7f42937fe640 1 --2- 172.21.15.87:0/3090201952 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f42940fc720 0x7f429410d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:25:45.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.596+0000 7f4293fff640 1 -- 172.21.15.87:0/3090201952 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f42940fc720 msgr2=0x7f429410d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:25:45.598 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.596+0000 7f4293fff640 1 --2- 172.21.15.87:0/3090201952 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f42940fc720 0x7f429410d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:45.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.596+0000 7f4293fff640 1 -- 172.21.15.87:0/3090201952 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4284005040 con 0x7f42940fb450 2024-09-17T07:25:45.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.596+0000 7f42937fe640 1 --2- 172.21.15.87:0/3090201952 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f42940fc720 0x7f429410d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T07:25:45.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.596+0000 7f4293fff640 1 --2- 172.21.15.87:0/3090201952 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f42940fb450 0x7f429410d080 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f42840043d0 tx=0x7f4284009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:25:45.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.596+0000 7f4290ff9640 1 -- 172.21.15.87:0/3090201952 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4284038070 con 0x7f42940fb450 2024-09-17T07:25:45.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.596+0000 7f429a595640 1 -- 172.21.15.87:0/3090201952 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f429410e660 con 0x7f42940fb450 2024-09-17T07:25:45.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.596+0000 7f4290ff9640 1 -- 172.21.15.87:0/3090201952 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f428402ade0 con 0x7f42940fb450 2024-09-17T07:25:45.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.596+0000 7f4290ff9640 1 -- 172.21.15.87:0/3090201952 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f428402c870 con 0x7f42940fb450 2024-09-17T07:25:45.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.597+0000 7f429a595640 1 -- 172.21.15.87:0/3090201952 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f429410eba0 con 0x7f42940fb450 2024-09-17T07:25:45.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.597+0000 7f429a595640 1 -- 172.21.15.87:0/3090201952 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42940fa8b0 con 0x7f42940fb450 2024-09-17T07:25:45.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.598+0000 7f4290ff9640 1 -- 172.21.15.87:0/3090201952 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f4284030020 con 0x7f42940fb450 2024-09-17T07:25:45.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.598+0000 7f4290ff9640 1 --2- 172.21.15.87:0/3090201952 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f427c06cb90 0x7f427c06f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:25:45.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.599+0000 7f4290ff9640 1 -- 172.21.15.87:0/3090201952 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f42840abdc0 con 0x7f42940fb450 2024-09-17T07:25:45.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.599+0000 7f42937fe640 1 --2- 172.21.15.87:0/3090201952 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f427c06cb90 0x7f427c06f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:25:45.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.599+0000 7f42937fe640 1 --2- 172.21.15.87:0/3090201952 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f427c06cb90 0x7f427c06f040 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4288004fd0 tx=0x7f428800b040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:25:45.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.603+0000 7f4290ff9640 1 -- 172.21.15.87:0/3090201952 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f4284075e80 con 0x7f42940fb450 2024-09-17T07:25:45.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.780+0000 7f429a595640 1 -- 172.21.15.87:0/3090201952 --> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f429410edc0 con 0x7f427c06cb90 2024-09-17T07:25:45.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.781+0000 7f4290ff9640 1 -- 172.21.15.87:0/3090201952 <== mgr.24529 v2:172.21.15.87:6800/1359413180 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f429410edc0 con 0x7f427c06cb90 2024-09-17T07:25:45.781 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T07:25:45.781 INFO:teuthology.orchestra.run.smithi087.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9", 2024-09-17T07:25:45.781 INFO:teuthology.orchestra.run.smithi087.stdout: "in_progress": true, 2024-09-17T07:25:45.782 INFO:teuthology.orchestra.run.smithi087.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T07:25:45.782 INFO:teuthology.orchestra.run.smithi087.stdout: "services_complete": [ 2024-09-17T07:25:45.782 INFO:teuthology.orchestra.run.smithi087.stdout: "crash", 2024-09-17T07:25:45.782 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr", 2024-09-17T07:25:45.782 INFO:teuthology.orchestra.run.smithi087.stdout: "mon" 2024-09-17T07:25:45.782 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-17T07:25:45.782 INFO:teuthology.orchestra.run.smithi087.stdout: "progress": "11/21 daemons upgraded", 2024-09-17T07:25:45.782 INFO:teuthology.orchestra.run.smithi087.stdout: "message": "Currently upgrading osd daemons", 2024-09-17T07:25:45.782 INFO:teuthology.orchestra.run.smithi087.stdout: "is_paused": false 2024-09-17T07:25:45.782 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T07:25:45.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.783+0000 7f429a595640 1 -- 172.21.15.87:0/3090201952 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f427c06cb90 msgr2=0x7f427c06f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:25:45.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.783+0000 7f429a595640 1 --2- 172.21.15.87:0/3090201952 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f427c06cb90 0x7f427c06f040 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4288004fd0 tx=0x7f428800b040 comp rx=0 tx=0).stop 2024-09-17T07:25:45.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.783+0000 7f429a595640 1 -- 172.21.15.87:0/3090201952 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f42940fb450 msgr2=0x7f429410d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:25:45.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.783+0000 7f429a595640 1 --2- 172.21.15.87:0/3090201952 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f42940fb450 0x7f429410d080 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f42840043d0 tx=0x7f4284009da0 comp rx=0 tx=0).stop 2024-09-17T07:25:45.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.783+0000 7f429a595640 1 -- 172.21.15.87:0/3090201952 shutdown_connections 2024-09-17T07:25:45.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.783+0000 7f429a595640 1 --2- 172.21.15.87:0/3090201952 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f427c06cb90 0x7f427c06f040 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:45.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.784+0000 7f429a595640 1 --2- 172.21.15.87:0/3090201952 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f42940fc720 0x7f429410d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:45.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.784+0000 7f429a595640 1 --2- 172.21.15.87:0/3090201952 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f42940fb450 0x7f429410d080 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:45.784 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.784+0000 7f429a595640 1 -- 172.21.15.87:0/3090201952 >> 172.21.15.87:0/3090201952 conn(0x7f42940f6c10 msgr2=0x7f42940662e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:25:45.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.784+0000 7f429a595640 1 -- 172.21.15.87:0/3090201952 shutdown_connections 2024-09-17T07:25:45.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.784+0000 7f429a595640 1 -- 172.21.15.87:0/3090201952 wait complete. 2024-09-17T07:25:45.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.861+0000 7fa6d8abb640 1 -- 172.21.15.87:0/1016533627 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6d40fa970 msgr2=0x7fa6d40fad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:25:45.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.861+0000 7fa6d8abb640 1 --2- 172.21.15.87:0/1016533627 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6d40fa970 0x7fa6d40fad80 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa6c40048d0 tx=0x7fa6c4009da0 comp rx=0 tx=0).stop 2024-09-17T07:25:45.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.861+0000 7fa6d8abb640 1 -- 172.21.15.87:0/1016533627 shutdown_connections 2024-09-17T07:25:45.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.861+0000 7fa6d8abb640 1 --2- 172.21.15.87:0/1016533627 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa6d40fb2c0 0x7fa6d40fdb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:45.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.861+0000 7fa6d8abb640 1 --2- 172.21.15.87:0/1016533627 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6d40fa970 0x7fa6d40fad80 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:45.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.861+0000 7fa6d8abb640 1 -- 172.21.15.87:0/1016533627 >> 172.21.15.87:0/1016533627 conn(0x7fa6d40f63b0 msgr2=0x7fa6d40f87e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:25:45.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.861+0000 7fa6d8abb640 1 -- 172.21.15.87:0/1016533627 shutdown_connections 2024-09-17T07:25:45.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.861+0000 7fa6d8abb640 1 -- 172.21.15.87:0/1016533627 wait complete. 2024-09-17T07:25:45.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.862+0000 7fa6d8abb640 1 Processor -- start 2024-09-17T07:25:45.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.862+0000 7fa6d8abb640 1 -- start start 2024-09-17T07:25:45.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.862+0000 7fa6d8abb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6d40fa970 0x7fa6d410d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:25:45.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.862+0000 7fa6d8abb640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa6d40fb2c0 0x7fa6d410d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:25:45.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.862+0000 7fa6d8abb640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d410dd70 con 0x7fa6d40fa970 2024-09-17T07:25:45.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.862+0000 7fa6d8abb640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d410e590 con 0x7fa6d40fb2c0 2024-09-17T07:25:45.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.863+0000 7fa6d259c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6d40fa970 0x7fa6d410d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:25:45.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.863+0000 7fa6d259c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6d40fa970 0x7fa6d410d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:48468/0 (socket says 172.21.15.87:48468) 2024-09-17T07:25:45.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.863+0000 7fa6d259c640 1 -- 172.21.15.87:0/2721695847 learned_addr learned my addr 172.21.15.87:0/2721695847 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:25:45.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.863+0000 7fa6c9d9b640 1 --2- 172.21.15.87:0/2721695847 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa6d40fb2c0 0x7fa6d410d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:25:45.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.863+0000 7fa6d259c640 1 -- 172.21.15.87:0/2721695847 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa6d40fb2c0 msgr2=0x7fa6d410d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:25:45.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.863+0000 7fa6d259c640 1 --2- 172.21.15.87:0/2721695847 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa6d40fb2c0 0x7fa6d410d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:45.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.863+0000 7fa6d259c640 1 -- 172.21.15.87:0/2721695847 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6c4005040 con 0x7fa6d40fa970 2024-09-17T07:25:45.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.863+0000 7fa6c9d9b640 1 --2- 172.21.15.87:0/2721695847 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa6d40fb2c0 0x7fa6d410d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T07:25:45.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.863+0000 7fa6d259c640 1 --2- 172.21.15.87:0/2721695847 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6d40fa970 0x7fa6d410d1e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa6c40043d0 tx=0x7fa6c4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:25:45.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.863+0000 7fa6cb7fe640 1 -- 172.21.15.87:0/2721695847 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6c4038070 con 0x7fa6d40fa970 2024-09-17T07:25:45.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.863+0000 7fa6d8abb640 1 -- 172.21.15.87:0/2721695847 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6d410e7c0 con 0x7fa6d40fa970 2024-09-17T07:25:45.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.863+0000 7fa6d8abb640 1 -- 172.21.15.87:0/2721695847 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6d410ece0 con 0x7fa6d40fa970 2024-09-17T07:25:45.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.863+0000 7fa6cb7fe640 1 -- 172.21.15.87:0/2721695847 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fa6c40096c0 con 0x7fa6d40fa970 2024-09-17T07:25:45.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.863+0000 7fa6cb7fe640 1 -- 172.21.15.87:0/2721695847 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6c403d420 con 0x7fa6d40fa970 2024-09-17T07:25:45.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.864+0000 7fa6d8abb640 1 -- 172.21.15.87:0/2721695847 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6d40fa050 con 0x7fa6d40fa970 2024-09-17T07:25:45.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.865+0000 7fa6cb7fe640 1 -- 172.21.15.87:0/2721695847 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fa6c4030020 con 0x7fa6d40fa970 2024-09-17T07:25:45.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.865+0000 7fa6cb7fe640 1 --2- 172.21.15.87:0/2721695847 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fa6c006cb90 0x7fa6c006f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:25:45.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.866+0000 7fa6cb7fe640 1 -- 172.21.15.87:0/2721695847 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fa6c40ac570 con 0x7fa6d40fa970 2024-09-17T07:25:45.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.866+0000 7fa6c9d9b640 1 --2- 172.21.15.87:0/2721695847 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fa6c006cb90 0x7fa6c006f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:25:45.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.866+0000 7fa6c9d9b640 1 --2- 172.21.15.87:0/2721695847 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fa6c006cb90 0x7fa6c006f040 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa6d410cf90 tx=0x7fa6bc00b040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:25:45.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:45.870+0000 7fa6cb7fe640 1 -- 172.21.15.87:0/2721695847 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa6c4076600 con 0x7fa6d40fa970 2024-09-17T07:25:46.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:46.093+0000 7fa6d8abb640 1 -- 172.21.15.87:0/2721695847 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fa6d404b720 con 0x7fa6d40fa970 2024-09-17T07:25:46.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:46.094+0000 7fa6cb7fe640 1 -- 172.21.15.87:0/2721695847 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fa6c4079c20 con 0x7fa6d40fa970 2024-09-17T07:25:46.094 INFO:teuthology.orchestra.run.smithi087.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T07:25:46.094 INFO:teuthology.orchestra.run.smithi087.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T07:25:46.094 INFO:teuthology.orchestra.run.smithi087.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T07:25:46.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:46.095+0000 7fa6d8abb640 1 -- 172.21.15.87:0/2721695847 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fa6c006cb90 msgr2=0x7fa6c006f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:25:46.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:46.095+0000 7fa6d8abb640 1 --2- 172.21.15.87:0/2721695847 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fa6c006cb90 0x7fa6c006f040 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa6d410cf90 tx=0x7fa6bc00b040 comp rx=0 tx=0).stop 2024-09-17T07:25:46.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:46.095+0000 7fa6d8abb640 1 -- 172.21.15.87:0/2721695847 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6d40fa970 msgr2=0x7fa6d410d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:25:46.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:46.095+0000 7fa6d8abb640 1 --2- 172.21.15.87:0/2721695847 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6d40fa970 0x7fa6d410d1e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa6c40043d0 tx=0x7fa6c4009da0 comp rx=0 tx=0).stop 2024-09-17T07:25:46.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:46.096+0000 7fa6d8abb640 1 -- 172.21.15.87:0/2721695847 shutdown_connections 2024-09-17T07:25:46.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:46.096+0000 7fa6d8abb640 1 --2- 172.21.15.87:0/2721695847 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fa6c006cb90 0x7fa6c006f040 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:46.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:46.096+0000 7fa6d8abb640 1 --2- 172.21.15.87:0/2721695847 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa6d40fb2c0 0x7fa6d410d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:46.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:46.096+0000 7fa6d8abb640 1 --2- 172.21.15.87:0/2721695847 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6d40fa970 0x7fa6d410d1e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:25:46.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:46.096+0000 7fa6d8abb640 1 -- 172.21.15.87:0/2721695847 >> 172.21.15.87:0/2721695847 conn(0x7fa6d40f63b0 msgr2=0x7fa6d40f7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:25:46.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:46.096+0000 7fa6d8abb640 1 -- 172.21.15.87:0/2721695847 shutdown_connections 2024-09-17T07:25:46.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:25:46.096+0000 7fa6d8abb640 1 -- 172.21.15.87:0/2721695847 wait complete. 2024-09-17T07:25:46.359 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:25:46 smithi139 systemd[1]: Stopping Ceph osd.5 for d5dbf8d6-74c3-11ef-bceb-c7b262605968... 2024-09-17T07:25:46.359 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:46 smithi139 ceph-mon[79872]: from='client.34342 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:25:46.360 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:46 smithi139 ceph-mon[79872]: from='client.34346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:25:46.360 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:46 smithi139 ceph-mon[79872]: from='client.34350 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:25:46.360 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:46 smithi139 ceph-mon[79872]: from='client.? 172.21.15.87:0/4240562212' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:25:46.360 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:46 smithi139 ceph-mon[79872]: from='client.? 172.21.15.87:0/2262124900' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T07:25:46.360 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:46 smithi139 ceph-mon[79872]: from='client.? 172.21.15.87:0/2721695847' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T07:25:46.616 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:25:46 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-5[53021]: 2024-09-17T07:25:46.383+0000 7fe5f8993640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T07:25:46.617 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:25:46 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-5[53021]: 2024-09-17T07:25:46.383+0000 7fe5f8993640 -1 osd.5 72 *** Got signal Terminated *** 2024-09-17T07:25:46.617 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:25:46 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-5[53021]: 2024-09-17T07:25:46.383+0000 7fe5f8993640 -1 osd.5 72 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T07:25:46.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:46 smithi087 ceph-mon[90982]: from='client.34342 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:25:46.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:46 smithi087 ceph-mon[90982]: from='client.34346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:25:46.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:46 smithi087 ceph-mon[90982]: from='client.34350 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:25:46.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:46 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/4240562212' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:25:46.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:46 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/2262124900' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T07:25:46.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:46 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/2721695847' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T07:25:47.577 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:47 smithi139 ceph-mon[79872]: from='client.34362 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:25:47.577 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:47 smithi139 ceph-mon[79872]: pgmap v142: 65 pgs: 65 active+clean; 322 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:25:47.577 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:47 smithi139 ceph-mon[79872]: osd.5 marked itself down and dead 2024-09-17T07:25:47.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:47 smithi087 ceph-mon[90982]: from='client.34362 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:25:47.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:47 smithi087 ceph-mon[90982]: pgmap v142: 65 pgs: 65 active+clean; 322 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:25:47.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:47 smithi087 ceph-mon[90982]: osd.5 marked itself down and dead 2024-09-17T07:25:47.866 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:25:47 smithi139 podman[98158]: 2024-09-17 07:25:47.577558909 +0000 UTC m=+1.337767783 container died 609cf74f32e7108d13fd75906f3711c6f36adf520e97d639e7c853e088bbb8f0 (image=quay.ceph.io/ceph-ci/ceph@sha256:c5428a59091f5674ce6e26540d9db0f28844a507e2a324b8305a00f1687ce028, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=quincy-4a70413, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-17T07:25:48.200 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:25:47 smithi139 podman[98158]: 2024-09-17 07:25:47.982284979 +0000 UTC m=+1.742493846 container cleanup 609cf74f32e7108d13fd75906f3711c6f36adf520e97d639e7c853e088bbb8f0 (image=quay.ceph.io/ceph-ci/ceph@sha256:c5428a59091f5674ce6e26540d9db0f28844a507e2a324b8305a00f1687ce028, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , RELEASE=quincy-4a70413) 2024-09-17T07:25:48.200 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:25:47 smithi139 bash[98158]: ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-5 2024-09-17T07:25:48.534 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:48 smithi139 ceph-mon[79872]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T07:25:48.535 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:48 smithi139 ceph-mon[79872]: osdmap e73: 6 total, 5 up, 6 in 2024-09-17T07:25:48.535 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:25:48 smithi139 podman[98175]: 2024-09-17 07:25:48.200186971 +0000 UTC m=+0.622677283 container remove 609cf74f32e7108d13fd75906f3711c6f36adf520e97d639e7c853e088bbb8f0 (image=quay.ceph.io/ceph-ci/ceph@sha256:c5428a59091f5674ce6e26540d9db0f28844a507e2a324b8305a00f1687ce028, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=quincy-4a70413, io.buildah.version=1.37.2) 2024-09-17T07:25:48.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:48 smithi087 ceph-mon[90982]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T07:25:48.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:48 smithi087 ceph-mon[90982]: osdmap e73: 6 total, 5 up, 6 in 2024-09-17T07:25:48.820 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:25:48 smithi139 podman[98269]: 2024-09-17 07:25:48.437432466 +0000 UTC m=+0.015746603 image pull 980a0bfcd684674f25c08d857ad8de3b1c8ae738870529edbf9aa463832c8d89 quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9 2024-09-17T07:25:48.820 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:25:48 smithi139 podman[98269]: 2024-09-17 07:25:48.56779748 +0000 UTC m=+0.146111605 container create 00f0d217cfcef6798826e51e75ba9d6f271b666e1c48cd56e9a2868c093b4391 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, RELEASE=reef-19e2a2b, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T07:25:48.821 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:25:48 smithi139 podman[98269]: 2024-09-17 07:25:48.820547521 +0000 UTC m=+0.398861667 container init 00f0d217cfcef6798826e51e75ba9d6f271b666e1c48cd56e9a2868c093b4391 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=reef-19e2a2b, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-17T07:25:49.116 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:25:48 smithi139 podman[98269]: 2024-09-17 07:25:48.82393358 +0000 UTC m=+0.402247702 container start 00f0d217cfcef6798826e51e75ba9d6f271b666e1c48cd56e9a2868c093b4391 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=reef-19e2a2b, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-17T07:25:49.116 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:25:48 smithi139 podman[98269]: 2024-09-17 07:25:48.903856931 +0000 UTC m=+0.482171068 container attach 00f0d217cfcef6798826e51e75ba9d6f271b666e1c48cd56e9a2868c093b4391 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-5-deactivate, RELEASE=reef-19e2a2b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-17T07:25:49.117 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:25:49 smithi139 podman[98269]: 2024-09-17 07:25:49.011692358 +0000 UTC m=+0.590006481 container died 00f0d217cfcef6798826e51e75ba9d6f271b666e1c48cd56e9a2868c093b4391 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=reef-19e2a2b, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-17T07:25:49.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:49 smithi139 ceph-mon[79872]: pgmap v144: 65 pgs: 3 peering, 12 stale+active+clean, 50 active+clean; 322 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2 op/s 2024-09-17T07:25:49.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:49 smithi139 ceph-mon[79872]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-17T07:25:49.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:49 smithi139 ceph-mon[79872]: osdmap e74: 6 total, 5 up, 6 in 2024-09-17T07:25:49.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:49 smithi087 ceph-mon[90982]: pgmap v144: 65 pgs: 3 peering, 12 stale+active+clean, 50 active+clean; 322 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2 op/s 2024-09-17T07:25:49.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:49 smithi087 ceph-mon[90982]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-17T07:25:49.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:49 smithi087 ceph-mon[90982]: osdmap e74: 6 total, 5 up, 6 in 2024-09-17T07:25:50.054 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:25:49 smithi139 podman[98292]: 2024-09-17 07:25:49.624041939 +0000 UTC m=+0.606315586 container remove 00f0d217cfcef6798826e51e75ba9d6f271b666e1c48cd56e9a2868c093b4391 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-5-deactivate, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=reef-19e2a2b, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-17T07:25:50.055 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:25:49 smithi139 systemd[1]: ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968@osd.5.service: Deactivated successfully. 2024-09-17T07:25:50.055 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:25:49 smithi139 systemd[1]: Stopped Ceph osd.5 for d5dbf8d6-74c3-11ef-bceb-c7b262605968. 2024-09-17T07:25:50.055 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:25:49 smithi139 systemd[1]: ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968@osd.5.service: Consumed 51.195s CPU time. 2024-09-17T07:25:50.055 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:25:49 smithi139 systemd[1]: Starting Ceph osd.5 for d5dbf8d6-74c3-11ef-bceb-c7b262605968... 2024-09-17T07:25:50.344 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:50 smithi139 ceph-mon[79872]: Health check failed: Degraded data redundancy: 33/369 objects degraded (8.943%), 6 pgs degraded (PG_DEGRADED) 2024-09-17T07:25:50.345 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:25:50 smithi139 podman[98395]: 2024-09-17 07:25:49.957165286 +0000 UTC m=+0.016031267 image pull 980a0bfcd684674f25c08d857ad8de3b1c8ae738870529edbf9aa463832c8d89 quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9 2024-09-17T07:25:50.345 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:25:50 smithi139 podman[98395]: 2024-09-17 07:25:50.09370787 +0000 UTC m=+0.152573881 container create 2dadfea4f78dcb34c267e7987f4db07d521df5e9caf8de75aac22957724534e3 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-5-activate, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=reef-19e2a2b, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-17T07:25:50.345 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:25:50 smithi139 podman[98395]: 2024-09-17 07:25:50.344706278 +0000 UTC m=+0.403572251 container init 2dadfea4f78dcb34c267e7987f4db07d521df5e9caf8de75aac22957724534e3 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-5-activate, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=reef-19e2a2b, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T07:25:50.616 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:25:50 smithi139 podman[98395]: 2024-09-17 07:25:50.348153587 +0000 UTC m=+0.407019558 container start 2dadfea4f78dcb34c267e7987f4db07d521df5e9caf8de75aac22957724534e3 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-5-activate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, RELEASE=reef-19e2a2b, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-17T07:25:50.616 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:25:50 smithi139 podman[98395]: 2024-09-17 07:25:50.436371166 +0000 UTC m=+0.495237146 container attach 2dadfea4f78dcb34c267e7987f4db07d521df5e9caf8de75aac22957724534e3 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-5-activate, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=reef-19e2a2b, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T07:25:50.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:50 smithi087 ceph-mon[90982]: Health check failed: Degraded data redundancy: 33/369 objects degraded (8.943%), 6 pgs degraded (PG_DEGRADED) 2024-09-17T07:25:50.998 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:25:50 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-5-activate[98410]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-17T07:25:50.998 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:25:50 smithi139 bash[98395]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-17T07:25:50.998 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:25:50 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-5-activate[98410]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-17T07:25:50.998 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:25:50 smithi139 bash[98395]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-17T07:25:50.999 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:25:50 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-5-activate[98410]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-17T07:25:50.999 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:25:50 smithi139 bash[98395]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-17T07:25:50.999 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:25:50 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-5-activate[98410]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-17T07:25:50.999 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:25:50 smithi139 bash[98395]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-17T07:25:50.999 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:25:50 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-5-activate[98410]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-09-17T07:25:50.999 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:25:50 smithi139 bash[98395]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-09-17T07:25:50.999 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:25:50 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-5-activate[98410]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-17T07:25:50.999 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:25:50 smithi139 bash[98395]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-17T07:25:50.999 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:25:50 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-5-activate[98410]: --> ceph-volume raw activate successful for osd ID: 5 2024-09-17T07:25:50.999 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:25:50 smithi139 bash[98395]: --> ceph-volume raw activate successful for osd ID: 5 2024-09-17T07:25:50.999 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:25:50 smithi139 podman[98395]: 2024-09-17 07:25:50.694232025 +0000 UTC m=+0.753098004 container died 2dadfea4f78dcb34c267e7987f4db07d521df5e9caf8de75aac22957724534e3 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-5-activate, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=reef-19e2a2b, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-17T07:25:51.588 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:51 smithi139 ceph-mon[79872]: pgmap v146: 65 pgs: 7 active+undersized, 3 peering, 7 stale+active+clean, 6 active+undersized+degraded, 42 active+clean; 322 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 33/369 objects degraded (8.943%) 2024-09-17T07:25:51.589 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:25:51 smithi139 podman[98541]: 2024-09-17 07:25:51.382123208 +0000 UTC m=+0.682094082 container remove 2dadfea4f78dcb34c267e7987f4db07d521df5e9caf8de75aac22957724534e3 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-5-activate, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=reef-19e2a2b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-17T07:25:51.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:51 smithi087 ceph-mon[90982]: pgmap v146: 65 pgs: 7 active+undersized, 3 peering, 7 stale+active+clean, 6 active+undersized+degraded, 42 active+clean; 322 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 33/369 objects degraded (8.943%) 2024-09-17T07:25:51.843 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:25:51 smithi139 podman[98599]: 2024-09-17 07:25:51.491373819 +0000 UTC m=+0.015767068 image pull 980a0bfcd684674f25c08d857ad8de3b1c8ae738870529edbf9aa463832c8d89 quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9 2024-09-17T07:25:51.843 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:25:51 smithi139 podman[98599]: 2024-09-17 07:25:51.608185363 +0000 UTC m=+0.132578645 container create 5058216f1ee0e6472d3a5565e34b363c680619df41ec55d89e8d0ffe04688730 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=reef-19e2a2b, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-17T07:25:51.844 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:25:51 smithi139 podman[98599]: 2024-09-17 07:25:51.843554945 +0000 UTC m=+0.367948186 container init 5058216f1ee0e6472d3a5565e34b363c680619df41ec55d89e8d0ffe04688730 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-5, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=reef-19e2a2b, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-17T07:25:52.116 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:25:51 smithi139 podman[98599]: 2024-09-17 07:25:51.846885223 +0000 UTC m=+0.371278465 container start 5058216f1ee0e6472d3a5565e34b363c680619df41ec55d89e8d0ffe04688730 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-5, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=reef-19e2a2b, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-17T07:25:52.117 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:25:51 smithi139 ceph-osd[98620]: -- 172.21.15.139:0/3385791800 <== mon.1 v2:172.21.15.139:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56060af9f1e0 con 0x56060bd1e000 2024-09-17T07:25:52.117 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:25:51 smithi139 bash[98599]: 5058216f1ee0e6472d3a5565e34b363c680619df41ec55d89e8d0ffe04688730 2024-09-17T07:25:52.117 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:25:51 smithi139 systemd[1]: Started Ceph osd.5 for d5dbf8d6-74c3-11ef-bceb-c7b262605968. 2024-09-17T07:25:52.714 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:25:52 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-5[98616]: 2024-09-17T07:25:52.382+0000 7f1bb77e2640 -1 Falling back to public interface 2024-09-17T07:25:53.358 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:52 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:25:53.358 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:52 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:25:53.358 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:52 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:25:53.358 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:52 smithi139 ceph-mon[79872]: pgmap v147: 65 pgs: 13 active+undersized, 3 peering, 12 active+undersized+degraded, 37 active+clean; 322 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 50/369 objects degraded (13.550%) 2024-09-17T07:25:53.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:52 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:25:53.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:52 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:25:53.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:52 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:25:53.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:52 smithi087 ceph-mon[90982]: pgmap v147: 65 pgs: 13 active+undersized, 3 peering, 12 active+undersized+degraded, 37 active+clean; 322 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 50/369 objects degraded (13.550%) 2024-09-17T07:25:54.528 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:54 smithi139 ceph-mon[79872]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-17T07:25:54.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:54 smithi087 ceph-mon[90982]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-17T07:25:55.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:55 smithi139 ceph-mon[79872]: pgmap v148: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 322 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 57/369 objects degraded (15.447%) 2024-09-17T07:25:55.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:55 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:25:55.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:55 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:25:55.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:55 smithi087 ceph-mon[90982]: pgmap v148: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 322 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 57/369 objects degraded (15.447%) 2024-09-17T07:25:55.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:55 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:25:55.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:55 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:25:56.586 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:56 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:25:56.586 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:56 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:25:56.586 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:56 smithi139 ceph-mon[79872]: pgmap v149: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 322 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 57/369 objects degraded (15.447%) 2024-09-17T07:25:56.679 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:56 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:25:56.679 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:56 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:25:56.679 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:56 smithi087 ceph-mon[90982]: pgmap v149: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 322 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 57/369 objects degraded (15.447%) 2024-09-17T07:25:56.846 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:25:56 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-5[98616]: 2024-09-17T07:25:56.578+0000 7f1bb77e2640 -1 osd.5 72 log_to_monitors true 2024-09-17T07:25:57.532 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:57 smithi139 ceph-mon[79872]: from='osd.5 [v2:172.21.15.139:6816/4036107320,v1:172.21.15.139:6817/4036107320]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-17T07:25:57.532 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:57 smithi139 ceph-mon[79872]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-17T07:25:57.532 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:57 smithi139 ceph-mon[79872]: Health check update: Degraded data redundancy: 57/369 objects degraded (15.447%), 14 pgs degraded (PG_DEGRADED) 2024-09-17T07:25:57.532 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:25:57 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-5[98616]: 2024-09-17T07:25:57.362+0000 7f1baf57b640 -1 osd.5 72 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T07:25:57.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:57 smithi087 ceph-mon[90982]: from='osd.5 [v2:172.21.15.139:6816/4036107320,v1:172.21.15.139:6817/4036107320]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-17T07:25:57.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:57 smithi087 ceph-mon[90982]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-17T07:25:57.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:57 smithi087 ceph-mon[90982]: Health check update: Degraded data redundancy: 57/369 objects degraded (15.447%), 14 pgs degraded (PG_DEGRADED) 2024-09-17T07:25:58.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:58 smithi139 ceph-mon[79872]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-17T07:25:58.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:58 smithi139 ceph-mon[79872]: osdmap e75: 6 total, 5 up, 6 in 2024-09-17T07:25:58.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:58 smithi139 ceph-mon[79872]: from='osd.5 [v2:172.21.15.139:6816/4036107320,v1:172.21.15.139:6817/4036107320]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-09-17T07:25:58.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:58 smithi139 ceph-mon[79872]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-09-17T07:25:58.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:58 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:25:58.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:58 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:25:58.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:58 smithi139 ceph-mon[79872]: pgmap v151: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 322 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 57/369 objects degraded (15.447%) 2024-09-17T07:25:58.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:58 smithi087 ceph-mon[90982]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-17T07:25:58.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:58 smithi087 ceph-mon[90982]: osdmap e75: 6 total, 5 up, 6 in 2024-09-17T07:25:58.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:58 smithi087 ceph-mon[90982]: from='osd.5 [v2:172.21.15.139:6816/4036107320,v1:172.21.15.139:6817/4036107320]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-09-17T07:25:58.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:58 smithi087 ceph-mon[90982]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-09-17T07:25:58.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:58 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:25:58.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:58 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:25:58.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:58 smithi087 ceph-mon[90982]: pgmap v151: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 322 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 57/369 objects degraded (15.447%) 2024-09-17T07:25:59.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:59 smithi139 ceph-mon[79872]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T07:25:59.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:59 smithi139 ceph-mon[79872]: osd.5 [v2:172.21.15.139:6816/4036107320,v1:172.21.15.139:6817/4036107320] boot 2024-09-17T07:25:59.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:59 smithi139 ceph-mon[79872]: osdmap e76: 6 total, 6 up, 6 in 2024-09-17T07:25:59.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:59 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T07:25:59.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:59 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:25:59.618 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:59 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:25:59.618 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:59 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:25:59.618 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:59 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:25:59.618 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:59 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:25:59.618 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:59 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:25:59.618 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:59 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:25:59.618 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:59 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:25:59.618 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:59 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:25:59.618 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:59 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:25:59.618 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:59 smithi139 ceph-mon[79872]: Upgrade: Setting container_image for all osd 2024-09-17T07:25:59.618 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:59 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:25:59.618 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:59 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-09-17T07:25:59.618 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:59 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-17T07:25:59.619 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:59 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-09-17T07:25:59.619 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:59 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-17T07:25:59.619 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:59 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-09-17T07:25:59.619 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:59 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-17T07:25:59.619 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:59 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-09-17T07:25:59.619 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:59 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-17T07:25:59.619 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:59 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-09-17T07:25:59.619 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:59 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-17T07:25:59.619 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:59 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-09-17T07:25:59.619 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:59 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-17T07:25:59.619 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:59 smithi139 ceph-mon[79872]: Upgrade: Setting require_osd_release to 18 reef 2024-09-17T07:25:59.619 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:59 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd require-osd-release", "release": "reef"}]: dispatch 2024-09-17T07:25:59.619 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:59 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "osd require-osd-release", "release": "reef"}]': finished 2024-09-17T07:25:59.619 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:25:59 smithi139 ceph-mon[79872]: osdmap e77: 6 total, 6 up, 6 in 2024-09-17T07:25:59.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:59 smithi087 ceph-mon[90982]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T07:25:59.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:59 smithi087 ceph-mon[90982]: osd.5 [v2:172.21.15.139:6816/4036107320,v1:172.21.15.139:6817/4036107320] boot 2024-09-17T07:25:59.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:59 smithi087 ceph-mon[90982]: osdmap e76: 6 total, 6 up, 6 in 2024-09-17T07:25:59.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:59 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T07:25:59.678 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:59 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:25:59.678 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:59 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:25:59.678 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:59 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:25:59.678 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:59 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:25:59.678 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:59 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:25:59.678 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:59 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:25:59.678 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:59 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:25:59.678 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:59 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:25:59.679 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:59 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:25:59.679 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:59 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:25:59.679 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:59 smithi087 ceph-mon[90982]: Upgrade: Setting container_image for all osd 2024-09-17T07:25:59.679 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:59 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:25:59.679 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:59 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-09-17T07:25:59.679 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:59 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-17T07:25:59.680 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:59 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-09-17T07:25:59.680 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:59 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-17T07:25:59.680 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:59 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-09-17T07:25:59.680 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:59 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-17T07:25:59.680 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:59 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-09-17T07:25:59.681 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:59 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-17T07:25:59.681 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:59 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-09-17T07:25:59.681 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:59 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-17T07:25:59.681 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:59 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-09-17T07:25:59.681 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:59 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-17T07:25:59.681 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:59 smithi087 ceph-mon[90982]: Upgrade: Setting require_osd_release to 18 reef 2024-09-17T07:25:59.682 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:59 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd require-osd-release", "release": "reef"}]: dispatch 2024-09-17T07:25:59.682 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:59 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "osd require-osd-release", "release": "reef"}]': finished 2024-09-17T07:25:59.682 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:25:59 smithi087 ceph-mon[90982]: osdmap e77: 6 total, 6 up, 6 in 2024-09-17T07:26:00.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:00 smithi087 ceph-mon[90982]: Upgrade: Disabling standby-replay for filesystem cephfs 2024-09-17T07:26:00.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:00 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:26:00.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:00 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]: dispatch 2024-09-17T07:26:00.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:00 smithi087 ceph-mon[90982]: osdmap e78: 6 total, 6 up, 6 in 2024-09-17T07:26:00.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:00 smithi087 ceph-mon[90982]: pgmap v155: 65 pgs: 8 peering, 11 active+undersized, 9 active+undersized+degraded, 37 active+clean; 322 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 2 op/s; 28/369 objects degraded (7.588%) 2024-09-17T07:26:00.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:00 smithi139 ceph-mon[79872]: Upgrade: Disabling standby-replay for filesystem cephfs 2024-09-17T07:26:00.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:00 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:26:00.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:00 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]: dispatch 2024-09-17T07:26:00.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:00 smithi139 ceph-mon[79872]: osdmap e78: 6 total, 6 up, 6 in 2024-09-17T07:26:00.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:00 smithi139 ceph-mon[79872]: pgmap v155: 65 pgs: 8 peering, 11 active+undersized, 9 active+undersized+degraded, 37 active+clean; 322 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 2 op/s; 28/369 objects degraded (7.588%) 2024-09-17T07:26:01.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:01 smithi087 ceph-mon[90982]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-09-17T07:26:01.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:01 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2024-09-17T07:26:01.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:01 smithi087 ceph-mon[90982]: fsmap cephfs:2 {0=cephfs.smithi087.tjhpcs=up:active,1=cephfs.smithi139.gnwonz=up:active} 2024-09-17T07:26:01.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:01 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:26:01.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:01 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:26:01.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:01 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:26:01.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:01 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:26:01.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:01 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:26:01.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:01 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:26:01.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:01 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:26:01.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:01 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:26:01.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:01 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:26:01.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:01 smithi087 ceph-mon[90982]: Upgrade: Scaling down filesystem cephfs 2024-09-17T07:26:01.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:01 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:26:01.678 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:01 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-09-17T07:26:01.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:01 smithi139 ceph-mon[79872]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-09-17T07:26:01.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:01 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2024-09-17T07:26:01.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:01 smithi139 ceph-mon[79872]: fsmap cephfs:2 {0=cephfs.smithi087.tjhpcs=up:active,1=cephfs.smithi139.gnwonz=up:active} 2024-09-17T07:26:01.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:01 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:26:01.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:01 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:26:01.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:01 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:26:01.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:01 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:26:01.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:01 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:26:01.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:01 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:26:01.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:01 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:26:01.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:01 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:26:01.868 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:01 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:26:01.868 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:01 smithi139 ceph-mon[79872]: Upgrade: Scaling down filesystem cephfs 2024-09-17T07:26:01.868 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:01 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:26:01.868 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:01 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-09-17T07:26:02.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:02 smithi087 ceph-mon[90982]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-09-17T07:26:02.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:02 smithi087 ceph-mon[90982]: mds.? [v2:172.21.15.139:6826/641133838,v1:172.21.15.139:6827/641133838] up:boot 2024-09-17T07:26:02.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:02 smithi087 ceph-mon[90982]: mds.? [v2:172.21.15.87:6826/1835215411,v1:172.21.15.87:6827/1835215411] up:boot 2024-09-17T07:26:02.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:02 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-09-17T07:26:02.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:02 smithi087 ceph-mon[90982]: stopping daemon mds.cephfs.smithi139.gnwonz 2024-09-17T07:26:02.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:02 smithi087 ceph-mon[90982]: fsmap cephfs:2 {0=cephfs.smithi087.tjhpcs=up:active,1=cephfs.smithi139.gnwonz=up:active} 2 up:standby 2024-09-17T07:26:02.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:02 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi087.vvbzss"}]: dispatch 2024-09-17T07:26:02.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:02 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi139.ftvinf"}]: dispatch 2024-09-17T07:26:02.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:02 smithi087 ceph-mon[90982]: fsmap cephfs:2 {0=cephfs.smithi087.tjhpcs=up:active,1=cephfs.smithi139.gnwonz=up:stopping} 2 up:standby 2024-09-17T07:26:02.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:02 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:26:02.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:02 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:26:02.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:02 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:26:02.678 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:02 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:26:02.678 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:02 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:26:02.678 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:02 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:26:02.678 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:02 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:26:02.678 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:02 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:26:02.678 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:02 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:26:02.678 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:02 smithi087 ceph-mon[90982]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-09-17T07:26:02.678 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:02 smithi087 ceph-mon[90982]: Health check update: Degraded data redundancy: 28/369 objects degraded (7.588%), 9 pgs degraded (PG_DEGRADED) 2024-09-17T07:26:02.678 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:02 smithi087 ceph-mon[90982]: pgmap v156: 65 pgs: 8 peering, 9 active+undersized, 6 active+undersized+degraded, 42 active+clean; 322 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 860 B/s rd, 2 op/s; 21/369 objects degraded (5.691%) 2024-09-17T07:26:02.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:02 smithi139 ceph-mon[79872]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-09-17T07:26:02.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:02 smithi139 ceph-mon[79872]: mds.? [v2:172.21.15.139:6826/641133838,v1:172.21.15.139:6827/641133838] up:boot 2024-09-17T07:26:02.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:02 smithi139 ceph-mon[79872]: mds.? [v2:172.21.15.87:6826/1835215411,v1:172.21.15.87:6827/1835215411] up:boot 2024-09-17T07:26:02.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:02 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-09-17T07:26:02.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:02 smithi139 ceph-mon[79872]: stopping daemon mds.cephfs.smithi139.gnwonz 2024-09-17T07:26:02.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:02 smithi139 ceph-mon[79872]: fsmap cephfs:2 {0=cephfs.smithi087.tjhpcs=up:active,1=cephfs.smithi139.gnwonz=up:active} 2 up:standby 2024-09-17T07:26:02.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:02 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi087.vvbzss"}]: dispatch 2024-09-17T07:26:02.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:02 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi139.ftvinf"}]: dispatch 2024-09-17T07:26:02.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:02 smithi139 ceph-mon[79872]: fsmap cephfs:2 {0=cephfs.smithi087.tjhpcs=up:active,1=cephfs.smithi139.gnwonz=up:stopping} 2 up:standby 2024-09-17T07:26:02.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:02 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:26:02.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:02 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:26:02.868 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:02 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:26:02.868 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:02 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:26:02.868 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:02 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:26:02.868 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:02 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:26:02.868 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:02 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:26:02.868 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:02 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:26:02.868 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:02 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:26:02.868 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:02 smithi139 ceph-mon[79872]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-09-17T07:26:02.868 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:02 smithi139 ceph-mon[79872]: Health check update: Degraded data redundancy: 28/369 objects degraded (7.588%), 9 pgs degraded (PG_DEGRADED) 2024-09-17T07:26:02.868 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:02 smithi139 ceph-mon[79872]: pgmap v156: 65 pgs: 8 peering, 9 active+undersized, 6 active+undersized+degraded, 42 active+clean; 322 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 860 B/s rd, 2 op/s; 21/369 objects degraded (5.691%) 2024-09-17T07:26:04.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:04 smithi139 ceph-mon[79872]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 21/369 objects degraded (5.691%), 6 pgs degraded) 2024-09-17T07:26:04.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:04 smithi087 ceph-mon[90982]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 21/369 objects degraded (5.691%), 6 pgs degraded) 2024-09-17T07:26:05.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:05 smithi139 ceph-mon[79872]: pgmap v157: 65 pgs: 1 peering, 64 active+clean; 322 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 682 B/s wr, 1 op/s 2024-09-17T07:26:05.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:05 smithi087 ceph-mon[90982]: pgmap v157: 65 pgs: 1 peering, 64 active+clean; 322 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 682 B/s wr, 1 op/s 2024-09-17T07:26:07.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:07 smithi139 ceph-mon[79872]: pgmap v158: 65 pgs: 65 active+clean; 322 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 527 B/s wr, 1 op/s 2024-09-17T07:26:07.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:07 smithi087 ceph-mon[90982]: pgmap v158: 65 pgs: 65 active+clean; 322 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 527 B/s wr, 1 op/s 2024-09-17T07:26:09.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:09 smithi139 ceph-mon[79872]: pgmap v159: 65 pgs: 65 active+clean; 318 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s wr, 2 op/s 2024-09-17T07:26:09.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:09 smithi087 ceph-mon[90982]: pgmap v159: 65 pgs: 65 active+clean; 318 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s wr, 2 op/s 2024-09-17T07:26:11.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:11 smithi139 ceph-mon[79872]: pgmap v160: 65 pgs: 65 active+clean; 318 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1.1 KiB/s wr, 5 op/s 2024-09-17T07:26:11.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:11 smithi087 ceph-mon[90982]: pgmap v160: 65 pgs: 65 active+clean; 318 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1.1 KiB/s wr, 5 op/s 2024-09-17T07:26:12.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:12 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:26:12.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:12 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:26:12.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:12 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:26:12.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:12 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:26:12.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:12 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:26:12.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:12 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:26:12.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:12 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:26:12.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:12 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:26:12.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:12 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:26:12.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:12 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:26:12.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:12 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:26:12.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:12 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:26:12.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:12 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:26:12.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:12 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:26:12.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:12 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:26:12.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:12 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:26:12.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:12 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:26:12.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:12 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:26:13.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:13 smithi139 ceph-mon[79872]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-09-17T07:26:13.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:13 smithi139 ceph-mon[79872]: pgmap v161: 65 pgs: 65 active+clean; 318 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1023 B/s wr, 5 op/s 2024-09-17T07:26:13.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:13 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:26:13.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:13 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:26:13.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:13 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:26:13.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:13 smithi087 ceph-mon[90982]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-09-17T07:26:13.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:13 smithi087 ceph-mon[90982]: pgmap v161: 65 pgs: 65 active+clean; 318 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1023 B/s wr, 5 op/s 2024-09-17T07:26:13.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:13 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:26:13.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:13 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:26:13.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:13 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:26:15.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:15 smithi139 ceph-mon[79872]: pgmap v162: 65 pgs: 65 active+clean; 226 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-17T07:26:15.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:15 smithi087 ceph-mon[90982]: pgmap v162: 65 pgs: 65 active+clean; 226 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-17T07:26:16.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.188+0000 7f353fb48640 1 -- 172.21.15.87:0/78595012 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3538066730 msgr2=0x7f35380ff160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:26:16.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.188+0000 7f353fb48640 1 --2- 172.21.15.87:0/78595012 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3538066730 0x7f35380ff160 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f35280048d0 tx=0x7f3528009da0 comp rx=0 tx=0).stop 2024-09-17T07:26:16.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.188+0000 7f353fb48640 1 -- 172.21.15.87:0/78595012 shutdown_connections 2024-09-17T07:26:16.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.188+0000 7f353fb48640 1 --2- 172.21.15.87:0/78595012 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f35380ff6a0 0x7f3538101a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:16.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.188+0000 7f353fb48640 1 --2- 172.21.15.87:0/78595012 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3538066730 0x7f35380ff160 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:16.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.188+0000 7f353fb48640 1 -- 172.21.15.87:0/78595012 >> 172.21.15.87:0/78595012 conn(0x7f35380f6c10 msgr2=0x7f35380f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:26:16.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.188+0000 7f353fb48640 1 -- 172.21.15.87:0/78595012 shutdown_connections 2024-09-17T07:26:16.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.188+0000 7f353fb48640 1 -- 172.21.15.87:0/78595012 wait complete. 2024-09-17T07:26:16.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.188+0000 7f353fb48640 1 Processor -- start 2024-09-17T07:26:16.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.189+0000 7f353fb48640 1 -- start start 2024-09-17T07:26:16.192 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.189+0000 7f353fb48640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3538066730 0x7f35380fcb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:26:16.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.189+0000 7f353fb48640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35380ff6a0 0x7f35380fb060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:26:16.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.189+0000 7f353fb48640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35380fb5a0 con 0x7f35380ff6a0 2024-09-17T07:26:16.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.189+0000 7f353fb48640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35380fb6e0 con 0x7f3538066730 2024-09-17T07:26:16.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.189+0000 7f353d0e3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35380ff6a0 0x7f35380fb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:26:16.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.189+0000 7f353d0e3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35380ff6a0 0x7f35380fb060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:43510/0 (socket says 172.21.15.87:43510) 2024-09-17T07:26:16.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.189+0000 7f353d0e3640 1 -- 172.21.15.87:0/1337262031 learned_addr learned my addr 172.21.15.87:0/1337262031 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:26:16.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.189+0000 7f353d8e4640 1 --2- 172.21.15.87:0/1337262031 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3538066730 0x7f35380fcb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:26:16.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.189+0000 7f353d0e3640 1 -- 172.21.15.87:0/1337262031 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3538066730 msgr2=0x7f35380fcb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:26:16.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.189+0000 7f353d0e3640 1 --2- 172.21.15.87:0/1337262031 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3538066730 0x7f35380fcb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:16.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.189+0000 7f353d0e3640 1 -- 172.21.15.87:0/1337262031 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3528005040 con 0x7f35380ff6a0 2024-09-17T07:26:16.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.190+0000 7f353d0e3640 1 --2- 172.21.15.87:0/1337262031 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35380ff6a0 0x7f35380fb060 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f352c002a50 tx=0x7f352c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:26:16.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.190+0000 7f35367fc640 1 -- 172.21.15.87:0/1337262031 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f352c007c30 con 0x7f35380ff6a0 2024-09-17T07:26:16.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.190+0000 7f35367fc640 1 -- 172.21.15.87:0/1337262031 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f352c00f040 con 0x7f35380ff6a0 2024-09-17T07:26:16.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.190+0000 7f35367fc640 1 -- 172.21.15.87:0/1337262031 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f352c00d990 con 0x7f35380ff6a0 2024-09-17T07:26:16.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.190+0000 7f353fb48640 1 -- 172.21.15.87:0/1337262031 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35380fb9c0 con 0x7f35380ff6a0 2024-09-17T07:26:16.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.190+0000 7f353fb48640 1 -- 172.21.15.87:0/1337262031 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35381150b0 con 0x7f35380ff6a0 2024-09-17T07:26:16.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.191+0000 7f353fb48640 1 -- 172.21.15.87:0/1337262031 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35380fa8b0 con 0x7f35380ff6a0 2024-09-17T07:26:16.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.192+0000 7f35367fc640 1 -- 172.21.15.87:0/1337262031 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f352c00dc50 con 0x7f35380ff6a0 2024-09-17T07:26:16.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.192+0000 7f35367fc640 1 --2- 172.21.15.87:0/1337262031 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f352006cb90 0x7f352006f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:26:16.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.192+0000 7f35367fc640 1 -- 172.21.15.87:0/1337262031 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f352c08b9d0 con 0x7f35380ff6a0 2024-09-17T07:26:16.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.192+0000 7f353d8e4640 1 --2- 172.21.15.87:0/1337262031 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f352006cb90 0x7f352006f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:26:16.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.193+0000 7f353d8e4640 1 --2- 172.21.15.87:0/1337262031 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f352006cb90 0x7f352006f040 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3528007ac0 tx=0x7f3528009da0 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:26:16.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.197+0000 7f35367fc640 1 -- 172.21.15.87:0/1337262031 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f352c0559e0 con 0x7f35380ff6a0 2024-09-17T07:26:16.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.376+0000 7f353fb48640 1 -- 172.21.15.87:0/1337262031 --> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f35380f8750 con 0x7f352006cb90 2024-09-17T07:26:16.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.377+0000 7f35367fc640 1 -- 172.21.15.87:0/1337262031 <== mgr.24529 v2:172.21.15.87:6800/1359413180 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f35380f8750 con 0x7f352006cb90 2024-09-17T07:26:16.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.379+0000 7f353fb48640 1 -- 172.21.15.87:0/1337262031 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f352006cb90 msgr2=0x7f352006f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:26:16.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.379+0000 7f353fb48640 1 --2- 172.21.15.87:0/1337262031 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f352006cb90 0x7f352006f040 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3528007ac0 tx=0x7f3528009da0 comp rx=0 tx=0).stop 2024-09-17T07:26:16.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.379+0000 7f353fb48640 1 -- 172.21.15.87:0/1337262031 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35380ff6a0 msgr2=0x7f35380fb060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:26:16.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.379+0000 7f353fb48640 1 --2- 172.21.15.87:0/1337262031 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35380ff6a0 0x7f35380fb060 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f352c002a50 tx=0x7f352c004600 comp rx=0 tx=0).stop 2024-09-17T07:26:16.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.379+0000 7f353fb48640 1 -- 172.21.15.87:0/1337262031 shutdown_connections 2024-09-17T07:26:16.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.379+0000 7f353fb48640 1 --2- 172.21.15.87:0/1337262031 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35380ff6a0 0x7f35380fb060 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:16.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.379+0000 7f353fb48640 1 --2- 172.21.15.87:0/1337262031 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f352006cb90 0x7f352006f040 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:16.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.379+0000 7f353fb48640 1 --2- 172.21.15.87:0/1337262031 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3538066730 0x7f35380fcb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:16.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.379+0000 7f353fb48640 1 -- 172.21.15.87:0/1337262031 >> 172.21.15.87:0/1337262031 conn(0x7f35380f6c10 msgr2=0x7f35380f7030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:26:16.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.379+0000 7f353fb48640 1 -- 172.21.15.87:0/1337262031 shutdown_connections 2024-09-17T07:26:16.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.379+0000 7f353fb48640 1 -- 172.21.15.87:0/1337262031 wait complete. 2024-09-17T07:26:16.389 INFO:teuthology.orchestra.run.smithi087.stdout:true 2024-09-17T07:26:16.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.459+0000 7f94e4d11640 1 -- 172.21.15.87:0/2497849093 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f94e00ff720 msgr2=0x7f94e0101b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:26:16.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.459+0000 7f94e4d11640 1 --2- 172.21.15.87:0/2497849093 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f94e00ff720 0x7f94e0101b00 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f94c80048d0 tx=0x7f94c8009da0 comp rx=0 tx=0).stop 2024-09-17T07:26:16.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.459+0000 7f94e4d11640 1 -- 172.21.15.87:0/2497849093 shutdown_connections 2024-09-17T07:26:16.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.459+0000 7f94e4d11640 1 --2- 172.21.15.87:0/2497849093 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f94e00ff720 0x7f94e0101b00 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:16.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.459+0000 7f94e4d11640 1 --2- 172.21.15.87:0/2497849093 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f94e00666d0 0x7f94e00ff1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:16.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.459+0000 7f94e4d11640 1 -- 172.21.15.87:0/2497849093 >> 172.21.15.87:0/2497849093 conn(0x7f94e00f6c30 msgr2=0x7f94e00f9060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:26:16.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.459+0000 7f94e4d11640 1 -- 172.21.15.87:0/2497849093 shutdown_connections 2024-09-17T07:26:16.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.459+0000 7f94e4d11640 1 -- 172.21.15.87:0/2497849093 wait complete. 2024-09-17T07:26:16.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.459+0000 7f94e4d11640 1 Processor -- start 2024-09-17T07:26:16.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.459+0000 7f94e4d11640 1 -- start start 2024-09-17T07:26:16.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.460+0000 7f94e4d11640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f94e00666d0 0x7f94e010d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:26:16.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.460+0000 7f94e4d11640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f94e00ff720 0x7f94e010d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:26:16.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.460+0000 7f94e4d11640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e010dc00 con 0x7f94e00666d0 2024-09-17T07:26:16.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.460+0000 7f94e4d11640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e010e3d0 con 0x7f94e00ff720 2024-09-17T07:26:16.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.460+0000 7f94de59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f94e00666d0 0x7f94e010d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:26:16.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.460+0000 7f94de59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f94e00666d0 0x7f94e010d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:43534/0 (socket says 172.21.15.87:43534) 2024-09-17T07:26:16.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.460+0000 7f94de59c640 1 -- 172.21.15.87:0/2479878250 learned_addr learned my addr 172.21.15.87:0/2479878250 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:26:16.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.460+0000 7f94ddd9b640 1 --2- 172.21.15.87:0/2479878250 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f94e00ff720 0x7f94e010d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:26:16.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.460+0000 7f94de59c640 1 -- 172.21.15.87:0/2479878250 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f94e00ff720 msgr2=0x7f94e010d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:26:16.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.460+0000 7f94de59c640 1 --2- 172.21.15.87:0/2479878250 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f94e00ff720 0x7f94e010d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:16.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.460+0000 7f94de59c640 1 -- 172.21.15.87:0/2479878250 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c8005040 con 0x7f94e00666d0 2024-09-17T07:26:16.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.460+0000 7f94de59c640 1 --2- 172.21.15.87:0/2479878250 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f94e00666d0 0x7f94e010d070 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f94d000c810 tx=0x7f94d0004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:26:16.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.460+0000 7f94d6ffd640 1 -- 172.21.15.87:0/2479878250 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94d000a710 con 0x7f94e00666d0 2024-09-17T07:26:16.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.460+0000 7f94d6ffd640 1 -- 172.21.15.87:0/2479878250 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f94d000acf0 con 0x7f94e00666d0 2024-09-17T07:26:16.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.460+0000 7f94e4d11640 1 -- 172.21.15.87:0/2479878250 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94e010e660 con 0x7f94e00666d0 2024-09-17T07:26:16.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.460+0000 7f94d6ffd640 1 -- 172.21.15.87:0/2479878250 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94d0012e60 con 0x7f94e00666d0 2024-09-17T07:26:16.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.460+0000 7f94e4d11640 1 -- 172.21.15.87:0/2479878250 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94e010ec00 con 0x7f94e00666d0 2024-09-17T07:26:16.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.462+0000 7f94e4d11640 1 -- 172.21.15.87:0/2479878250 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94e00fa8d0 con 0x7f94e00666d0 2024-09-17T07:26:16.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.462+0000 7f94d6ffd640 1 -- 172.21.15.87:0/2479878250 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f94d000a870 con 0x7f94e00666d0 2024-09-17T07:26:16.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.463+0000 7f94d6ffd640 1 --2- 172.21.15.87:0/2479878250 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f94cc06cb90 0x7f94cc06f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:26:16.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.463+0000 7f94d6ffd640 1 -- 172.21.15.87:0/2479878250 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f94d008c050 con 0x7f94e00666d0 2024-09-17T07:26:16.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.463+0000 7f94ddd9b640 1 --2- 172.21.15.87:0/2479878250 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f94cc06cb90 0x7f94cc06f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:26:16.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.464+0000 7f94ddd9b640 1 --2- 172.21.15.87:0/2479878250 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f94cc06cb90 0x7f94cc06f040 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f94e010ce20 tx=0x7f94c8035040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:26:16.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.467+0000 7f94d6ffd640 1 -- 172.21.15.87:0/2479878250 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f94d0056180 con 0x7f94e00666d0 2024-09-17T07:26:16.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.643+0000 7f94e4d11640 1 -- 172.21.15.87:0/2479878250 --> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f94e010ef50 con 0x7f94cc06cb90 2024-09-17T07:26:16.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.644+0000 7f94d6ffd640 1 -- 172.21.15.87:0/2479878250 <== mgr.24529 v2:172.21.15.87:6800/1359413180 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f94e010ef50 con 0x7f94cc06cb90 2024-09-17T07:26:16.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.646+0000 7f94e4d11640 1 -- 172.21.15.87:0/2479878250 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f94cc06cb90 msgr2=0x7f94cc06f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:26:16.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.646+0000 7f94e4d11640 1 --2- 172.21.15.87:0/2479878250 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f94cc06cb90 0x7f94cc06f040 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f94e010ce20 tx=0x7f94c8035040 comp rx=0 tx=0).stop 2024-09-17T07:26:16.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.646+0000 7f94e4d11640 1 -- 172.21.15.87:0/2479878250 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f94e00666d0 msgr2=0x7f94e010d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:26:16.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.646+0000 7f94e4d11640 1 --2- 172.21.15.87:0/2479878250 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f94e00666d0 0x7f94e010d070 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f94d000c810 tx=0x7f94d0004430 comp rx=0 tx=0).stop 2024-09-17T07:26:16.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.646+0000 7f94e4d11640 1 -- 172.21.15.87:0/2479878250 shutdown_connections 2024-09-17T07:26:16.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.647+0000 7f94e4d11640 1 --2- 172.21.15.87:0/2479878250 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f94cc06cb90 0x7f94cc06f040 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:16.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.647+0000 7f94e4d11640 1 --2- 172.21.15.87:0/2479878250 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f94e00ff720 0x7f94e010d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:16.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.647+0000 7f94e4d11640 1 --2- 172.21.15.87:0/2479878250 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f94e00666d0 0x7f94e010d070 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:16.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.647+0000 7f94e4d11640 1 -- 172.21.15.87:0/2479878250 >> 172.21.15.87:0/2479878250 conn(0x7f94e00f6c30 msgr2=0x7f94e00f7050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:26:16.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.647+0000 7f94e4d11640 1 -- 172.21.15.87:0/2479878250 shutdown_connections 2024-09-17T07:26:16.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.647+0000 7f94e4d11640 1 -- 172.21.15.87:0/2479878250 wait complete. 2024-09-17T07:26:16.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.724+0000 7f3ae8538640 1 -- 172.21.15.87:0/1421692852 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ae00fc550 msgr2=0x7f3ae00fc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:26:16.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.724+0000 7f3ae8538640 1 --2- 172.21.15.87:0/1421692852 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ae00fc550 0x7f3ae00fc960 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3ad0009c50 tx=0x7f3ad0004d10 comp rx=0 tx=0).stop 2024-09-17T07:26:16.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.724+0000 7f3ae8538640 1 -- 172.21.15.87:0/1421692852 shutdown_connections 2024-09-17T07:26:16.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.724+0000 7f3ae8538640 1 --2- 172.21.15.87:0/1421692852 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3ae00fd820 0x7f3ae00fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:16.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.724+0000 7f3ae8538640 1 --2- 172.21.15.87:0/1421692852 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ae00fc550 0x7f3ae00fc960 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:16.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.725+0000 7f3ae8538640 1 -- 172.21.15.87:0/1421692852 >> 172.21.15.87:0/1421692852 conn(0x7f3ae00f7d30 msgr2=0x7f3ae00fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:26:16.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.725+0000 7f3ae8538640 1 -- 172.21.15.87:0/1421692852 shutdown_connections 2024-09-17T07:26:16.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.725+0000 7f3ae8538640 1 -- 172.21.15.87:0/1421692852 wait complete. 2024-09-17T07:26:16.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.725+0000 7f3ae8538640 1 Processor -- start 2024-09-17T07:26:16.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.725+0000 7f3ae8538640 1 -- start start 2024-09-17T07:26:16.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.725+0000 7f3ae8538640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ae00fc550 0x7f3ae010cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:26:16.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.725+0000 7f3ae8538640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3ae00fd820 0x7f3ae010d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:26:16.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.725+0000 7f3ae8538640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae010db50 con 0x7f3ae00fc550 2024-09-17T07:26:16.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.725+0000 7f3ae8538640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae010e370 con 0x7f3ae00fd820 2024-09-17T07:26:16.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.725+0000 7f3ae62d4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ae00fc550 0x7f3ae010cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:26:16.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.725+0000 7f3ae62d4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ae00fc550 0x7f3ae010cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:43550/0 (socket says 172.21.15.87:43550) 2024-09-17T07:26:16.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.725+0000 7f3ae62d4640 1 -- 172.21.15.87:0/2454860470 learned_addr learned my addr 172.21.15.87:0/2454860470 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:26:16.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.726+0000 7f3ae5ad3640 1 --2- 172.21.15.87:0/2454860470 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3ae00fd820 0x7f3ae010d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:26:16.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.726+0000 7f3ae62d4640 1 -- 172.21.15.87:0/2454860470 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3ae00fd820 msgr2=0x7f3ae010d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:26:16.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.726+0000 7f3ae62d4640 1 --2- 172.21.15.87:0/2454860470 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3ae00fd820 0x7f3ae010d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:16.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.726+0000 7f3ae62d4640 1 -- 172.21.15.87:0/2454860470 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ad00098b0 con 0x7f3ae00fc550 2024-09-17T07:26:16.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.726+0000 7f3ae62d4640 1 --2- 172.21.15.87:0/2454860470 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ae00fc550 0x7f3ae010cfc0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3ad0004750 tx=0x7f3ad0004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:26:16.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.726+0000 7f3adeffd640 1 -- 172.21.15.87:0/2454860470 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ad0032750 con 0x7f3ae00fc550 2024-09-17T07:26:16.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.726+0000 7f3adeffd640 1 -- 172.21.15.87:0/2454860470 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f3ad0009710 con 0x7f3ae00fc550 2024-09-17T07:26:16.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.726+0000 7f3ae8538640 1 -- 172.21.15.87:0/2454860470 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ae010e5a0 con 0x7f3ae00fc550 2024-09-17T07:26:16.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.726+0000 7f3adeffd640 1 -- 172.21.15.87:0/2454860470 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ad003dab0 con 0x7f3ae00fc550 2024-09-17T07:26:16.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.726+0000 7f3ae8538640 1 -- 172.21.15.87:0/2454860470 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ae010eb40 con 0x7f3ae00fc550 2024-09-17T07:26:16.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.727+0000 7f3ae8538640 1 -- 172.21.15.87:0/2454860470 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ae00fb9b0 con 0x7f3ae00fc550 2024-09-17T07:26:16.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.728+0000 7f3adeffd640 1 -- 172.21.15.87:0/2454860470 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f3ad002f030 con 0x7f3ae00fc550 2024-09-17T07:26:16.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.728+0000 7f3adeffd640 1 --2- 172.21.15.87:0/2454860470 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f3ac806cb90 0x7f3ac806f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:26:16.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.728+0000 7f3adeffd640 1 -- 172.21.15.87:0/2454860470 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f3ad00ad720 con 0x7f3ae00fc550 2024-09-17T07:26:16.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.728+0000 7f3ae5ad3640 1 --2- 172.21.15.87:0/2454860470 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f3ac806cb90 0x7f3ac806f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:26:16.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.729+0000 7f3ae5ad3640 1 --2- 172.21.15.87:0/2454860470 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f3ac806cb90 0x7f3ac806f040 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3ae010cd70 tx=0x7f3ad400b040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:26:16.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.732+0000 7f3adeffd640 1 -- 172.21.15.87:0/2454860470 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f3ad0077730 con 0x7f3ae00fc550 2024-09-17T07:26:16.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.902+0000 7f3ae8538640 1 -- 172.21.15.87:0/2454860470 --> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3ae010ee70 con 0x7f3ac806cb90 2024-09-17T07:26:16.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.910+0000 7f3adeffd640 1 -- 172.21.15.87:0/2454860470 <== mgr.24529 v2:172.21.15.87:6800/1359413180 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f3ae010ee70 con 0x7f3ac806cb90 2024-09-17T07:26:16.912 INFO:teuthology.orchestra.run.smithi087.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T07:26:16.912 INFO:teuthology.orchestra.run.smithi087.stdout:alertmanager.smithi087 smithi087 *:9093,9094 running (5m) 116s ago 14m 25.6M - 0.25.0 c8568f914cd2 594553f0b497 2024-09-17T07:26:16.912 INFO:teuthology.orchestra.run.smithi087.stdout:crash.smithi087 smithi087 running (3m) 116s ago 14m 6895k - 18.2.4-855-g19e2a2be 980a0bfcd684 0ff8a9330162 2024-09-17T07:26:16.912 INFO:teuthology.orchestra.run.smithi087.stdout:crash.smithi139 smithi139 running (3m) 22s ago 13m 6899k - 18.2.4-855-g19e2a2be 980a0bfcd684 10541e3b202e 2024-09-17T07:26:16.912 INFO:teuthology.orchestra.run.smithi087.stdout:grafana.smithi087 smithi087 *:3000 running (5m) 116s ago 14m 80.1M - 9.4.7 954c08fa6188 e2f17ec6baa8 2024-09-17T07:26:16.912 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi087.tjhpcs smithi087 running (8m) 116s ago 8m 130M - 17.2.7-1635-g4a704134 f22ead590bad f7142ad971ed 2024-09-17T07:26:16.912 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi087.vvbzss smithi087 running (8m) 116s ago 8m 70.2M - 17.2.7-1635-g4a704134 f22ead590bad 2dd82ff293d1 2024-09-17T07:26:16.912 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi139.ftvinf smithi139 running (8m) 22s ago 8m 57.3M - 17.2.7-1635-g4a704134 f22ead590bad d11edb295ad3 2024-09-17T07:26:16.912 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi139.gnwonz smithi139 running (8m) 22s ago 8m 116M - 17.2.7-1635-g4a704134 f22ead590bad 3b3d884aef02 2024-09-17T07:26:16.912 INFO:teuthology.orchestra.run.smithi087.stdout:mgr.smithi087.vuvjer smithi087 *:8443,9283,8765 running (5m) 116s ago 15m 488M - 18.2.4-855-g19e2a2be 980a0bfcd684 5d10c647cb6b 2024-09-17T07:26:16.912 INFO:teuthology.orchestra.run.smithi087.stdout:mgr.smithi139.tuqnpn smithi139 *:8443,9283,8765 running (4m) 22s ago 13m 439M - 18.2.4-855-g19e2a2be 980a0bfcd684 6e0bf371d44c 2024-09-17T07:26:16.912 INFO:teuthology.orchestra.run.smithi087.stdout:mon.smithi087 smithi087 running (4m) 116s ago 15m 44.5M 2048M 18.2.4-855-g19e2a2be 980a0bfcd684 305c72de1f9f 2024-09-17T07:26:16.913 INFO:teuthology.orchestra.run.smithi087.stdout:mon.smithi139 smithi139 running (4m) 22s ago 13m 39.9M 2048M 18.2.4-855-g19e2a2be 980a0bfcd684 0b159495af0f 2024-09-17T07:26:16.913 INFO:teuthology.orchestra.run.smithi087.stdout:node-exporter.smithi087 smithi087 *:9100 running (6m) 116s ago 14m 15.3M - 1.5.0 0da6a335fe13 39fa48de0e87 2024-09-17T07:26:16.913 INFO:teuthology.orchestra.run.smithi087.stdout:node-exporter.smithi139 smithi139 *:9100 running (5m) 22s ago 13m 15.5M - 1.5.0 0da6a335fe13 a5b99b7cbb06 2024-09-17T07:26:16.913 INFO:teuthology.orchestra.run.smithi087.stdout:osd.0 smithi087 running (3m) 116s ago 12m 85.4M 1557M 18.2.4-855-g19e2a2be 980a0bfcd684 e97cb50e6aec 2024-09-17T07:26:16.913 INFO:teuthology.orchestra.run.smithi087.stdout:osd.1 smithi087 running (2m) 116s ago 12m 89.7M 1557M 18.2.4-855-g19e2a2be 980a0bfcd684 b108771d0b8e 2024-09-17T07:26:16.913 INFO:teuthology.orchestra.run.smithi087.stdout:osd.2 smithi087 running (2m) 116s ago 11m 11.8M 1557M 18.2.4-855-g19e2a2be 980a0bfcd684 240cfb3b5366 2024-09-17T07:26:16.913 INFO:teuthology.orchestra.run.smithi087.stdout:osd.3 smithi139 running (88s) 22s ago 11m 102M 2581M 18.2.4-855-g19e2a2be 980a0bfcd684 b05ed3bf3f5c 2024-09-17T07:26:16.913 INFO:teuthology.orchestra.run.smithi087.stdout:osd.4 smithi139 running (57s) 22s ago 10m 93.2M 2581M 18.2.4-855-g19e2a2be 980a0bfcd684 139bbfc915c8 2024-09-17T07:26:16.913 INFO:teuthology.orchestra.run.smithi087.stdout:osd.5 smithi139 running (25s) 22s ago 10m 12.1M 2581M 18.2.4-855-g19e2a2be 980a0bfcd684 5058216f1ee0 2024-09-17T07:26:16.913 INFO:teuthology.orchestra.run.smithi087.stdout:prometheus.smithi087 smithi087 *:9095 running (4m) 116s ago 13m 56.5M - 2.43.0 a07b618ecd1d 63d18b7469fc 2024-09-17T07:26:16.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.912+0000 7f3ae8538640 1 -- 172.21.15.87:0/2454860470 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f3ac806cb90 msgr2=0x7f3ac806f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:26:16.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.912+0000 7f3ae8538640 1 --2- 172.21.15.87:0/2454860470 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f3ac806cb90 0x7f3ac806f040 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3ae010cd70 tx=0x7f3ad400b040 comp rx=0 tx=0).stop 2024-09-17T07:26:16.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.912+0000 7f3ae8538640 1 -- 172.21.15.87:0/2454860470 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ae00fc550 msgr2=0x7f3ae010cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:26:16.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.912+0000 7f3ae8538640 1 --2- 172.21.15.87:0/2454860470 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ae00fc550 0x7f3ae010cfc0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3ad0004750 tx=0x7f3ad0004d10 comp rx=0 tx=0).stop 2024-09-17T07:26:16.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.912+0000 7f3ae8538640 1 -- 172.21.15.87:0/2454860470 shutdown_connections 2024-09-17T07:26:16.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.912+0000 7f3ae8538640 1 --2- 172.21.15.87:0/2454860470 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f3ac806cb90 0x7f3ac806f040 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:16.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.912+0000 7f3ae8538640 1 --2- 172.21.15.87:0/2454860470 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3ae00fd820 0x7f3ae010d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:16.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.912+0000 7f3ae8538640 1 --2- 172.21.15.87:0/2454860470 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ae00fc550 0x7f3ae010cfc0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:16.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.913+0000 7f3ae8538640 1 -- 172.21.15.87:0/2454860470 >> 172.21.15.87:0/2454860470 conn(0x7f3ae00f7d30 msgr2=0x7f3ae00f9640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:26:16.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.913+0000 7f3ae8538640 1 -- 172.21.15.87:0/2454860470 shutdown_connections 2024-09-17T07:26:16.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.913+0000 7f3ae8538640 1 -- 172.21.15.87:0/2454860470 wait complete. 2024-09-17T07:26:16.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.991+0000 7f655205d640 1 -- 172.21.15.87:0/1868077192 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f654c0fc520 msgr2=0x7f654c0fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:26:16.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.991+0000 7f655205d640 1 --2- 172.21.15.87:0/1868077192 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f654c0fc520 0x7f654c0fc930 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f653c0048d0 tx=0x7f653c009da0 comp rx=0 tx=0).stop 2024-09-17T07:26:16.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.991+0000 7f655205d640 1 -- 172.21.15.87:0/1868077192 shutdown_connections 2024-09-17T07:26:16.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.991+0000 7f655205d640 1 --2- 172.21.15.87:0/1868077192 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f654c0fd7f0 0x7f654c0fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:16.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.991+0000 7f655205d640 1 --2- 172.21.15.87:0/1868077192 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f654c0fc520 0x7f654c0fc930 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:16.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.991+0000 7f655205d640 1 -- 172.21.15.87:0/1868077192 >> 172.21.15.87:0/1868077192 conn(0x7f654c0f7ce0 msgr2=0x7f654c0fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:26:16.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.991+0000 7f655205d640 1 -- 172.21.15.87:0/1868077192 shutdown_connections 2024-09-17T07:26:16.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.991+0000 7f655205d640 1 -- 172.21.15.87:0/1868077192 wait complete. 2024-09-17T07:26:16.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.991+0000 7f655205d640 1 Processor -- start 2024-09-17T07:26:16.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.992+0000 7f655205d640 1 -- start start 2024-09-17T07:26:16.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.992+0000 7f655205d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f654c0fc520 0x7f654c10cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:26:16.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.992+0000 7f655205d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f654c0fd7f0 0x7f654c10d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:26:16.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.992+0000 7f655205d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f654c10db80 con 0x7f654c0fc520 2024-09-17T07:26:16.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.992+0000 7f655205d640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f654c10e3a0 con 0x7f654c0fd7f0 2024-09-17T07:26:16.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.992+0000 7f654b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f654c0fc520 0x7f654c10cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:26:16.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.992+0000 7f654b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f654c0fc520 0x7f654c10cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:43566/0 (socket says 172.21.15.87:43566) 2024-09-17T07:26:16.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.992+0000 7f654b7fe640 1 -- 172.21.15.87:0/4274136124 learned_addr learned my addr 172.21.15.87:0/4274136124 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:26:16.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.992+0000 7f6543fff640 1 --2- 172.21.15.87:0/4274136124 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f654c0fd7f0 0x7f654c10d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:26:16.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.992+0000 7f654b7fe640 1 -- 172.21.15.87:0/4274136124 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f654c0fd7f0 msgr2=0x7f654c10d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:26:16.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.992+0000 7f654b7fe640 1 --2- 172.21.15.87:0/4274136124 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f654c0fd7f0 0x7f654c10d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:16.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.992+0000 7f654b7fe640 1 -- 172.21.15.87:0/4274136124 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f653c005040 con 0x7f654c0fc520 2024-09-17T07:26:16.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.992+0000 7f654b7fe640 1 --2- 172.21.15.87:0/4274136124 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f654c0fc520 0x7f654c10cff0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f653c0043d0 tx=0x7f653c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:26:16.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.993+0000 7f6548ff9640 1 -- 172.21.15.87:0/4274136124 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f653c038070 con 0x7f654c0fc520 2024-09-17T07:26:16.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.993+0000 7f6548ff9640 1 -- 172.21.15.87:0/4274136124 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f653c0096c0 con 0x7f654c0fc520 2024-09-17T07:26:16.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.993+0000 7f655205d640 1 -- 172.21.15.87:0/4274136124 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f654c10e5d0 con 0x7f654c0fc520 2024-09-17T07:26:16.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.993+0000 7f655205d640 1 -- 172.21.15.87:0/4274136124 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f654c10eb70 con 0x7f654c0fc520 2024-09-17T07:26:16.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.993+0000 7f6548ff9640 1 -- 172.21.15.87:0/4274136124 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f653c03d420 con 0x7f654c0fc520 2024-09-17T07:26:16.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.994+0000 7f655205d640 1 -- 172.21.15.87:0/4274136124 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f654c0fb980 con 0x7f654c0fc520 2024-09-17T07:26:16.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.994+0000 7f6548ff9640 1 -- 172.21.15.87:0/4274136124 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f653c030020 con 0x7f654c0fc520 2024-09-17T07:26:16.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.995+0000 7f6548ff9640 1 --2- 172.21.15.87:0/4274136124 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f653806cb90 0x7f653806f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:26:16.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.995+0000 7f6548ff9640 1 -- 172.21.15.87:0/4274136124 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f653c0ac680 con 0x7f654c0fc520 2024-09-17T07:26:16.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.995+0000 7f6543fff640 1 --2- 172.21.15.87:0/4274136124 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f653806cb90 0x7f653806f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:26:16.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.995+0000 7f6543fff640 1 --2- 172.21.15.87:0/4274136124 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f653806cb90 0x7f653806f040 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f654c10cda0 tx=0x7f653400b040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:26:17.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:16.999+0000 7f6548ff9640 1 -- 172.21.15.87:0/4274136124 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f653c076690 con 0x7f654c0fc520 2024-09-17T07:26:17.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.222+0000 7f655205d640 1 -- 172.21.15.87:0/4274136124 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f654c10eea0 con 0x7f654c0fc520 2024-09-17T07:26:17.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.223+0000 7f6548ff9640 1 -- 172.21.15.87:0/4274136124 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7f653c079cb0 con 0x7f654c0fc520 2024-09-17T07:26:17.224 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T07:26:17.224 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": { 2024-09-17T07:26:17.224 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 2 2024-09-17T07:26:17.224 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:26:17.224 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr": { 2024-09-17T07:26:17.224 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 2 2024-09-17T07:26:17.225 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:26:17.225 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": { 2024-09-17T07:26:17.225 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 6 2024-09-17T07:26:17.225 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:26:17.225 INFO:teuthology.orchestra.run.smithi087.stdout: "mds": { 2024-09-17T07:26:17.225 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 4 2024-09-17T07:26:17.225 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:26:17.225 INFO:teuthology.orchestra.run.smithi087.stdout: "overall": { 2024-09-17T07:26:17.225 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 4, 2024-09-17T07:26:17.225 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 10 2024-09-17T07:26:17.225 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T07:26:17.225 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T07:26:17.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.224+0000 7f655205d640 1 -- 172.21.15.87:0/4274136124 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f653806cb90 msgr2=0x7f653806f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:26:17.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.224+0000 7f655205d640 1 --2- 172.21.15.87:0/4274136124 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f653806cb90 0x7f653806f040 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f654c10cda0 tx=0x7f653400b040 comp rx=0 tx=0).stop 2024-09-17T07:26:17.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.224+0000 7f655205d640 1 -- 172.21.15.87:0/4274136124 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f654c0fc520 msgr2=0x7f654c10cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:26:17.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.224+0000 7f655205d640 1 --2- 172.21.15.87:0/4274136124 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f654c0fc520 0x7f654c10cff0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f653c0043d0 tx=0x7f653c009da0 comp rx=0 tx=0).stop 2024-09-17T07:26:17.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.225+0000 7f655205d640 1 -- 172.21.15.87:0/4274136124 shutdown_connections 2024-09-17T07:26:17.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.225+0000 7f655205d640 1 --2- 172.21.15.87:0/4274136124 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f653806cb90 0x7f653806f040 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:17.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.225+0000 7f655205d640 1 --2- 172.21.15.87:0/4274136124 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f654c0fd7f0 0x7f654c10d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:17.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.225+0000 7f655205d640 1 --2- 172.21.15.87:0/4274136124 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f654c0fc520 0x7f654c10cff0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:17.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.225+0000 7f655205d640 1 -- 172.21.15.87:0/4274136124 >> 172.21.15.87:0/4274136124 conn(0x7f654c0f7ce0 msgr2=0x7f654c0f9610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:26:17.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.225+0000 7f655205d640 1 -- 172.21.15.87:0/4274136124 shutdown_connections 2024-09-17T07:26:17.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.225+0000 7f655205d640 1 -- 172.21.15.87:0/4274136124 wait complete. 2024-09-17T07:26:17.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.302+0000 7f81be740640 1 -- 172.21.15.87:0/1730506260 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81b80fd840 msgr2=0x7f81b80fdcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:26:17.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.302+0000 7f81be740640 1 --2- 172.21.15.87:0/1730506260 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81b80fd840 0x7f81b80fdcb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f81ac0048d0 tx=0x7f81ac009da0 comp rx=0 tx=0).stop 2024-09-17T07:26:17.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.302+0000 7f81be740640 1 -- 172.21.15.87:0/1730506260 shutdown_connections 2024-09-17T07:26:17.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.302+0000 7f81be740640 1 --2- 172.21.15.87:0/1730506260 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81b80fd840 0x7f81b80fdcb0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:17.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.302+0000 7f81be740640 1 --2- 172.21.15.87:0/1730506260 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f81b80fc570 0x7f81b80fc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:17.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.302+0000 7f81be740640 1 -- 172.21.15.87:0/1730506260 >> 172.21.15.87:0/1730506260 conn(0x7f81b80f7d30 msgr2=0x7f81b80fa160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:26:17.305 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:17 smithi087 ceph-mon[90982]: pgmap v163: 65 pgs: 65 active+clean; 194 MiB data, 930 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 853 B/s wr, 7 op/s 2024-09-17T07:26:17.305 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:17 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/4274136124' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:26:17.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.302+0000 7f81be740640 1 -- 172.21.15.87:0/1730506260 shutdown_connections 2024-09-17T07:26:17.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.303+0000 7f81be740640 1 -- 172.21.15.87:0/1730506260 wait complete. 2024-09-17T07:26:17.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.303+0000 7f81be740640 1 Processor -- start 2024-09-17T07:26:17.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.303+0000 7f81be740640 1 -- start start 2024-09-17T07:26:17.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.303+0000 7f81be740640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81b80fc570 0x7f81b810cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:26:17.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.303+0000 7f81be740640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f81b80fd840 0x7f81b810d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:26:17.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.303+0000 7f81be740640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81b810db80 con 0x7f81b80fc570 2024-09-17T07:26:17.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.303+0000 7f81be740640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81b810e3a0 con 0x7f81b80fd840 2024-09-17T07:26:17.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.303+0000 7f81b7fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81b80fc570 0x7f81b810cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:26:17.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.304+0000 7f81b7fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81b80fc570 0x7f81b810cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:43584/0 (socket says 172.21.15.87:43584) 2024-09-17T07:26:17.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.304+0000 7f81b7fff640 1 -- 172.21.15.87:0/1891945937 learned_addr learned my addr 172.21.15.87:0/1891945937 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:26:17.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.304+0000 7f81b77fe640 1 --2- 172.21.15.87:0/1891945937 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f81b80fd840 0x7f81b810d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:26:17.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.304+0000 7f81b7fff640 1 -- 172.21.15.87:0/1891945937 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f81b80fd840 msgr2=0x7f81b810d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:26:17.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.304+0000 7f81b7fff640 1 --2- 172.21.15.87:0/1891945937 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f81b80fd840 0x7f81b810d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:17.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.304+0000 7f81b7fff640 1 -- 172.21.15.87:0/1891945937 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81ac005040 con 0x7f81b80fc570 2024-09-17T07:26:17.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.304+0000 7f81b7fff640 1 --2- 172.21.15.87:0/1891945937 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81b80fc570 0x7f81b810cff0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f81a800e940 tx=0x7f81a800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:26:17.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.304+0000 7f81b4ff9640 1 -- 172.21.15.87:0/1891945937 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81a8007bd0 con 0x7f81b80fc570 2024-09-17T07:26:17.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.304+0000 7f81b4ff9640 1 -- 172.21.15.87:0/1891945937 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f81a800f040 con 0x7f81b80fc570 2024-09-17T07:26:17.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.304+0000 7f81be740640 1 -- 172.21.15.87:0/1891945937 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81b810e5d0 con 0x7f81b80fc570 2024-09-17T07:26:17.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.305+0000 7f81b4ff9640 1 -- 172.21.15.87:0/1891945937 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81a800c940 con 0x7f81b80fc570 2024-09-17T07:26:17.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.305+0000 7f81be740640 1 -- 172.21.15.87:0/1891945937 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81b810eb10 con 0x7f81b80fc570 2024-09-17T07:26:17.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.306+0000 7f81be740640 1 -- 172.21.15.87:0/1891945937 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81b80fb9d0 con 0x7f81b80fc570 2024-09-17T07:26:17.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.306+0000 7f81b4ff9640 1 -- 172.21.15.87:0/1891945937 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f81a800caa0 con 0x7f81b80fc570 2024-09-17T07:26:17.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.306+0000 7f81b4ff9640 1 --2- 172.21.15.87:0/1891945937 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f81a006cb90 0x7f81a006f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:26:17.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.307+0000 7f81b4ff9640 1 -- 172.21.15.87:0/1891945937 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f81a808bbe0 con 0x7f81b80fc570 2024-09-17T07:26:17.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.307+0000 7f81b77fe640 1 --2- 172.21.15.87:0/1891945937 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f81a006cb90 0x7f81a006f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:26:17.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.307+0000 7f81b77fe640 1 --2- 172.21.15.87:0/1891945937 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f81a006cb90 0x7f81a006f040 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f81b810cda0 tx=0x7f81ac035040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:26:17.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.311+0000 7f81b4ff9640 1 -- 172.21.15.87:0/1891945937 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f81a8055d20 con 0x7f81b80fc570 2024-09-17T07:26:17.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.509+0000 7f81be740640 1 -- 172.21.15.87:0/1891945937 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f81b810ee20 con 0x7f81b80fc570 2024-09-17T07:26:17.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.509+0000 7f81b4ff9640 1 -- 172.21.15.87:0/1891945937 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) v1 ==== 76+0+1856 (secure 0 0 0) 0x7f81a8019750 con 0x7f81b80fc570 2024-09-17T07:26:17.511 INFO:teuthology.orchestra.run.smithi087.stdout:e26 2024-09-17T07:26:17.511 INFO:teuthology.orchestra.run.smithi087.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T07:26:17.511 INFO:teuthology.orchestra.run.smithi087.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T07:26:17.511 INFO:teuthology.orchestra.run.smithi087.stdout:legacy client fscid: 1 2024-09-17T07:26:17.511 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:26:17.511 INFO:teuthology.orchestra.run.smithi087.stdout:Filesystem 'cephfs' (1) 2024-09-17T07:26:17.511 INFO:teuthology.orchestra.run.smithi087.stdout:fs_name cephfs 2024-09-17T07:26:17.511 INFO:teuthology.orchestra.run.smithi087.stdout:epoch 26 2024-09-17T07:26:17.511 INFO:teuthology.orchestra.run.smithi087.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-17T07:26:17.512 INFO:teuthology.orchestra.run.smithi087.stdout:created 2024-09-17T07:17:15.368053+0000 2024-09-17T07:26:17.512 INFO:teuthology.orchestra.run.smithi087.stdout:modified 2024-09-17T07:26:01.394102+0000 2024-09-17T07:26:17.512 INFO:teuthology.orchestra.run.smithi087.stdout:tableserver 0 2024-09-17T07:26:17.512 INFO:teuthology.orchestra.run.smithi087.stdout:root 0 2024-09-17T07:26:17.512 INFO:teuthology.orchestra.run.smithi087.stdout:session_timeout 60 2024-09-17T07:26:17.512 INFO:teuthology.orchestra.run.smithi087.stdout:session_autoclose 300 2024-09-17T07:26:17.512 INFO:teuthology.orchestra.run.smithi087.stdout:max_file_size 1099511627776 2024-09-17T07:26:17.512 INFO:teuthology.orchestra.run.smithi087.stdout:max_xattr_size 65536 2024-09-17T07:26:17.512 INFO:teuthology.orchestra.run.smithi087.stdout:required_client_features {} 2024-09-17T07:26:17.512 INFO:teuthology.orchestra.run.smithi087.stdout:last_failure 0 2024-09-17T07:26:17.512 INFO:teuthology.orchestra.run.smithi087.stdout:last_failure_osd_epoch 0 2024-09-17T07:26:17.512 INFO:teuthology.orchestra.run.smithi087.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T07:26:17.512 INFO:teuthology.orchestra.run.smithi087.stdout:max_mds 1 2024-09-17T07:26:17.512 INFO:teuthology.orchestra.run.smithi087.stdout:in 0,1 2024-09-17T07:26:17.513 INFO:teuthology.orchestra.run.smithi087.stdout:up {0=14478,1=24243} 2024-09-17T07:26:17.513 INFO:teuthology.orchestra.run.smithi087.stdout:failed 2024-09-17T07:26:17.513 INFO:teuthology.orchestra.run.smithi087.stdout:damaged 2024-09-17T07:26:17.513 INFO:teuthology.orchestra.run.smithi087.stdout:stopped 2024-09-17T07:26:17.513 INFO:teuthology.orchestra.run.smithi087.stdout:data_pools [3] 2024-09-17T07:26:17.513 INFO:teuthology.orchestra.run.smithi087.stdout:metadata_pool 2 2024-09-17T07:26:17.513 INFO:teuthology.orchestra.run.smithi087.stdout:inline_data enabled 2024-09-17T07:26:17.513 INFO:teuthology.orchestra.run.smithi087.stdout:balancer 2024-09-17T07:26:17.513 INFO:teuthology.orchestra.run.smithi087.stdout:bal_rank_mask -1 2024-09-17T07:26:17.513 INFO:teuthology.orchestra.run.smithi087.stdout:standby_count_wanted 1 2024-09-17T07:26:17.513 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi087.tjhpcs{0:14478} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.87:6828/2255237099,v1:172.21.15.87:6829/2255237099] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:26:17.513 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi139.gnwonz{1:24243} state up:stopping seq 4 join_fscid=1 addr [v2:172.21.15.139:6824/3946792151,v1:172.21.15.139:6825/3946792151] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:26:17.513 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:26:17.514 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:26:17.514 INFO:teuthology.orchestra.run.smithi087.stdout:Standby daemons: 2024-09-17T07:26:17.514 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:26:17.514 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi087.vvbzss{-1:34376} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.87:6826/1835215411,v1:172.21.15.87:6827/1835215411] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:26:17.514 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi139.ftvinf{-1:44261} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.139:6826/641133838,v1:172.21.15.139:6827/641133838] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:26:17.514 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 26 2024-09-17T07:26:17.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.511+0000 7f81be740640 1 -- 172.21.15.87:0/1891945937 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f81a006cb90 msgr2=0x7f81a006f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:26:17.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.511+0000 7f81be740640 1 --2- 172.21.15.87:0/1891945937 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f81a006cb90 0x7f81a006f040 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f81b810cda0 tx=0x7f81ac035040 comp rx=0 tx=0).stop 2024-09-17T07:26:17.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.511+0000 7f81be740640 1 -- 172.21.15.87:0/1891945937 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81b80fc570 msgr2=0x7f81b810cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:26:17.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.511+0000 7f81be740640 1 --2- 172.21.15.87:0/1891945937 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81b80fc570 0x7f81b810cff0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f81a800e940 tx=0x7f81a800b040 comp rx=0 tx=0).stop 2024-09-17T07:26:17.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.511+0000 7f81be740640 1 -- 172.21.15.87:0/1891945937 shutdown_connections 2024-09-17T07:26:17.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.511+0000 7f81be740640 1 --2- 172.21.15.87:0/1891945937 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f81a006cb90 0x7f81a006f040 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:17.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.511+0000 7f81be740640 1 --2- 172.21.15.87:0/1891945937 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f81b80fd840 0x7f81b810d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:17.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.511+0000 7f81be740640 1 --2- 172.21.15.87:0/1891945937 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81b80fc570 0x7f81b810cff0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:17.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.511+0000 7f81be740640 1 -- 172.21.15.87:0/1891945937 >> 172.21.15.87:0/1891945937 conn(0x7f81b80f7d30 msgr2=0x7f81b80f9580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:26:17.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.512+0000 7f81be740640 1 -- 172.21.15.87:0/1891945937 shutdown_connections 2024-09-17T07:26:17.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.512+0000 7f81be740640 1 -- 172.21.15.87:0/1891945937 wait complete. 2024-09-17T07:26:17.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.589+0000 7f2c06f6a640 1 -- 172.21.15.87:0/260352472 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c00065c40 msgr2=0x7f2c000ff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:26:17.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.589+0000 7f2c06f6a640 1 --2- 172.21.15.87:0/260352472 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c00065c40 0x7f2c000ff140 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2bf00048d0 tx=0x7f2bf0009da0 comp rx=0 tx=0).stop 2024-09-17T07:26:17.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.589+0000 7f2c06f6a640 1 -- 172.21.15.87:0/260352472 shutdown_connections 2024-09-17T07:26:17.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.589+0000 7f2c06f6a640 1 --2- 172.21.15.87:0/260352472 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2c000ff680 0x7f2c00101a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:17.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.589+0000 7f2c06f6a640 1 --2- 172.21.15.87:0/260352472 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c00065c40 0x7f2c000ff140 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:17.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.589+0000 7f2c06f6a640 1 -- 172.21.15.87:0/260352472 >> 172.21.15.87:0/260352472 conn(0x7f2c000f6c10 msgr2=0x7f2c000f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:26:17.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.590+0000 7f2c06f6a640 1 -- 172.21.15.87:0/260352472 shutdown_connections 2024-09-17T07:26:17.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.590+0000 7f2c06f6a640 1 -- 172.21.15.87:0/260352472 wait complete. 2024-09-17T07:26:17.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.590+0000 7f2c06f6a640 1 Processor -- start 2024-09-17T07:26:17.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.590+0000 7f2c06f6a640 1 -- start start 2024-09-17T07:26:17.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.590+0000 7f2c06f6a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c00065c40 0x7f2c0010cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:26:17.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.590+0000 7f2c06f6a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2c000ff680 0x7f2c0010d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:26:17.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.590+0000 7f2c06f6a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c0010db40 con 0x7f2c00065c40 2024-09-17T07:26:17.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.590+0000 7f2c06f6a640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c0010e360 con 0x7f2c000ff680 2024-09-17T07:26:17.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.591+0000 7f2c04d06640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c00065c40 0x7f2c0010cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:26:17.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.591+0000 7f2c04d06640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c00065c40 0x7f2c0010cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:43592/0 (socket says 172.21.15.87:43592) 2024-09-17T07:26:17.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.591+0000 7f2c04d06640 1 -- 172.21.15.87:0/3724226382 learned_addr learned my addr 172.21.15.87:0/3724226382 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:26:17.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.591+0000 7f2bfffff640 1 --2- 172.21.15.87:0/3724226382 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2c000ff680 0x7f2c0010d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:26:17.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.591+0000 7f2bfffff640 1 -- 172.21.15.87:0/3724226382 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c00065c40 msgr2=0x7f2c0010cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:26:17.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.591+0000 7f2bfffff640 1 --2- 172.21.15.87:0/3724226382 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c00065c40 0x7f2c0010cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:17.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.591+0000 7f2bfffff640 1 -- 172.21.15.87:0/3724226382 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bf0005040 con 0x7f2c000ff680 2024-09-17T07:26:17.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.591+0000 7f2c04d06640 1 --2- 172.21.15.87:0/3724226382 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c00065c40 0x7f2c0010cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T07:26:17.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.591+0000 7f2bfffff640 1 --2- 172.21.15.87:0/3724226382 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2c000ff680 0x7f2c0010d4f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2bf400e910 tx=0x7f2bf400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:26:17.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.591+0000 7f2bfd7fa640 1 -- 172.21.15.87:0/3724226382 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2bf400eea0 con 0x7f2c000ff680 2024-09-17T07:26:17.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.591+0000 7f2c06f6a640 1 -- 172.21.15.87:0/3724226382 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c0010e590 con 0x7f2c000ff680 2024-09-17T07:26:17.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.591+0000 7f2bfd7fa640 1 -- 172.21.15.87:0/3724226382 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f2bf400f040 con 0x7f2c000ff680 2024-09-17T07:26:17.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.592+0000 7f2bfd7fa640 1 -- 172.21.15.87:0/3724226382 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2bf4009380 con 0x7f2c000ff680 2024-09-17T07:26:17.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.592+0000 7f2c06f6a640 1 -- 172.21.15.87:0/3724226382 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c0010eb30 con 0x7f2c000ff680 2024-09-17T07:26:17.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.592+0000 7f2c06f6a640 1 -- 172.21.15.87:0/3724226382 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c000fa890 con 0x7f2c000ff680 2024-09-17T07:26:17.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.593+0000 7f2bfd7fa640 1 -- 172.21.15.87:0/3724226382 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f2bf4007c30 con 0x7f2c000ff680 2024-09-17T07:26:17.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.594+0000 7f2bfd7fa640 1 --2- 172.21.15.87:0/3724226382 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f2be806cb90 0x7f2be806f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:26:17.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.594+0000 7f2bfd7fa640 1 -- 172.21.15.87:0/3724226382 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f2bf408bb70 con 0x7f2c000ff680 2024-09-17T07:26:17.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.594+0000 7f2c04d06640 1 --2- 172.21.15.87:0/3724226382 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f2be806cb90 0x7f2be806f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:26:17.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.594+0000 7f2c04d06640 1 --2- 172.21.15.87:0/3724226382 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f2be806cb90 0x7f2be806f040 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2bf00043d0 tx=0x7f2bf0035040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:26:17.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.602+0000 7f2bfd7fa640 1 -- 172.21.15.87:0/3724226382 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2bf4055c30 con 0x7f2c000ff680 2024-09-17T07:26:17.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:17 smithi139 ceph-mon[79872]: pgmap v163: 65 pgs: 65 active+clean; 194 MiB data, 930 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 853 B/s wr, 7 op/s 2024-09-17T07:26:17.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:17 smithi139 ceph-mon[79872]: from='client.? 172.21.15.87:0/4274136124' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:26:17.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.777+0000 7f2c06f6a640 1 -- 172.21.15.87:0/3724226382 --> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2c0010eeb0 con 0x7f2be806cb90 2024-09-17T07:26:17.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.779+0000 7f2bfd7fa640 1 -- 172.21.15.87:0/3724226382 <== mgr.24529 v2:172.21.15.87:6800/1359413180 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f2c0010eeb0 con 0x7f2be806cb90 2024-09-17T07:26:17.780 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T07:26:17.780 INFO:teuthology.orchestra.run.smithi087.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9", 2024-09-17T07:26:17.780 INFO:teuthology.orchestra.run.smithi087.stdout: "in_progress": true, 2024-09-17T07:26:17.780 INFO:teuthology.orchestra.run.smithi087.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T07:26:17.780 INFO:teuthology.orchestra.run.smithi087.stdout: "services_complete": [ 2024-09-17T07:26:17.780 INFO:teuthology.orchestra.run.smithi087.stdout: "crash", 2024-09-17T07:26:17.780 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr", 2024-09-17T07:26:17.780 INFO:teuthology.orchestra.run.smithi087.stdout: "mon", 2024-09-17T07:26:17.780 INFO:teuthology.orchestra.run.smithi087.stdout: "osd" 2024-09-17T07:26:17.780 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-17T07:26:17.780 INFO:teuthology.orchestra.run.smithi087.stdout: "progress": "12/21 daemons upgraded", 2024-09-17T07:26:17.781 INFO:teuthology.orchestra.run.smithi087.stdout: "message": "Currently upgrading osd daemons", 2024-09-17T07:26:17.781 INFO:teuthology.orchestra.run.smithi087.stdout: "is_paused": false 2024-09-17T07:26:17.781 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T07:26:17.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.780+0000 7f2c06f6a640 1 -- 172.21.15.87:0/3724226382 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f2be806cb90 msgr2=0x7f2be806f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:26:17.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.780+0000 7f2c06f6a640 1 --2- 172.21.15.87:0/3724226382 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f2be806cb90 0x7f2be806f040 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2bf00043d0 tx=0x7f2bf0035040 comp rx=0 tx=0).stop 2024-09-17T07:26:17.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.780+0000 7f2c06f6a640 1 -- 172.21.15.87:0/3724226382 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2c000ff680 msgr2=0x7f2c0010d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:26:17.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.780+0000 7f2c06f6a640 1 --2- 172.21.15.87:0/3724226382 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2c000ff680 0x7f2c0010d4f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2bf400e910 tx=0x7f2bf400b040 comp rx=0 tx=0).stop 2024-09-17T07:26:17.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.781+0000 7f2c06f6a640 1 -- 172.21.15.87:0/3724226382 shutdown_connections 2024-09-17T07:26:17.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.781+0000 7f2c06f6a640 1 --2- 172.21.15.87:0/3724226382 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f2be806cb90 0x7f2be806f040 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:17.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.781+0000 7f2c06f6a640 1 --2- 172.21.15.87:0/3724226382 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2c000ff680 0x7f2c0010d4f0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:17.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.781+0000 7f2c06f6a640 1 --2- 172.21.15.87:0/3724226382 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c00065c40 0x7f2c0010cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:17.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.781+0000 7f2c06f6a640 1 -- 172.21.15.87:0/3724226382 >> 172.21.15.87:0/3724226382 conn(0x7f2c000f6c10 msgr2=0x7f2c000f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:26:17.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.781+0000 7f2c06f6a640 1 -- 172.21.15.87:0/3724226382 shutdown_connections 2024-09-17T07:26:17.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.781+0000 7f2c06f6a640 1 -- 172.21.15.87:0/3724226382 wait complete. 2024-09-17T07:26:17.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.858+0000 7f0e3cf4d640 1 -- 172.21.15.87:0/1316209634 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e380fb450 msgr2=0x7f0e380fb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:26:17.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.858+0000 7f0e3cf4d640 1 --2- 172.21.15.87:0/1316209634 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e380fb450 0x7f0e380fb860 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0e280048d0 tx=0x7f0e28009da0 comp rx=0 tx=0).stop 2024-09-17T07:26:17.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.858+0000 7f0e3cf4d640 1 -- 172.21.15.87:0/1316209634 shutdown_connections 2024-09-17T07:26:17.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.858+0000 7f0e3cf4d640 1 --2- 172.21.15.87:0/1316209634 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0e380fc720 0x7f0e380fcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:17.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.858+0000 7f0e3cf4d640 1 --2- 172.21.15.87:0/1316209634 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e380fb450 0x7f0e380fb860 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:17.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.858+0000 7f0e3cf4d640 1 -- 172.21.15.87:0/1316209634 >> 172.21.15.87:0/1316209634 conn(0x7f0e380f6c10 msgr2=0x7f0e380f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:26:17.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.858+0000 7f0e3cf4d640 1 -- 172.21.15.87:0/1316209634 shutdown_connections 2024-09-17T07:26:17.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.858+0000 7f0e3cf4d640 1 -- 172.21.15.87:0/1316209634 wait complete. 2024-09-17T07:26:17.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.859+0000 7f0e3cf4d640 1 Processor -- start 2024-09-17T07:26:17.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.859+0000 7f0e3cf4d640 1 -- start start 2024-09-17T07:26:17.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.859+0000 7f0e3cf4d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0e380fb450 0x7f0e3810fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:26:17.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.859+0000 7f0e3cf4d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e380fc720 0x7f0e38112250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:26:17.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.859+0000 7f0e3cf4d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e38066770 con 0x7f0e380fc720 2024-09-17T07:26:17.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.859+0000 7f0e3cf4d640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e380668e0 con 0x7f0e380fb450 2024-09-17T07:26:17.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.859+0000 7f0e35d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e380fc720 0x7f0e38112250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:26:17.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.859+0000 7f0e35d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e380fc720 0x7f0e38112250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:43612/0 (socket says 172.21.15.87:43612) 2024-09-17T07:26:17.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.859+0000 7f0e35d9b640 1 -- 172.21.15.87:0/136507198 learned_addr learned my addr 172.21.15.87:0/136507198 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:26:17.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.859+0000 7f0e3659c640 1 --2- 172.21.15.87:0/136507198 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0e380fb450 0x7f0e3810fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:26:17.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.859+0000 7f0e35d9b640 1 -- 172.21.15.87:0/136507198 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0e380fb450 msgr2=0x7f0e3810fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:26:17.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.859+0000 7f0e35d9b640 1 --2- 172.21.15.87:0/136507198 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0e380fb450 0x7f0e3810fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:17.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.859+0000 7f0e35d9b640 1 -- 172.21.15.87:0/136507198 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e28005040 con 0x7f0e380fc720 2024-09-17T07:26:17.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.859+0000 7f0e3659c640 1 --2- 172.21.15.87:0/136507198 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0e380fb450 0x7f0e3810fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T07:26:17.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.860+0000 7f0e35d9b640 1 --2- 172.21.15.87:0/136507198 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e380fc720 0x7f0e38112250 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0e20002a50 tx=0x7f0e20004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:26:17.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.860+0000 7f0e2effd640 1 -- 172.21.15.87:0/136507198 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e20007c30 con 0x7f0e380fc720 2024-09-17T07:26:17.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.860+0000 7f0e2effd640 1 -- 172.21.15.87:0/136507198 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f0e2000f040 con 0x7f0e380fc720 2024-09-17T07:26:17.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.860+0000 7f0e3cf4d640 1 -- 172.21.15.87:0/136507198 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e381127f0 con 0x7f0e380fc720 2024-09-17T07:26:17.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.860+0000 7f0e2effd640 1 -- 172.21.15.87:0/136507198 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e2000d990 con 0x7f0e380fc720 2024-09-17T07:26:17.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.860+0000 7f0e3cf4d640 1 -- 172.21.15.87:0/136507198 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e38112d90 con 0x7f0e380fc720 2024-09-17T07:26:17.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.861+0000 7f0e3cf4d640 1 -- 172.21.15.87:0/136507198 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e380fa8b0 con 0x7f0e380fc720 2024-09-17T07:26:17.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.861+0000 7f0e2effd640 1 -- 172.21.15.87:0/136507198 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f0e2000dc50 con 0x7f0e380fc720 2024-09-17T07:26:17.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.862+0000 7f0e2effd640 1 --2- 172.21.15.87:0/136507198 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f0e2406cb90 0x7f0e2406f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:26:17.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.862+0000 7f0e2effd640 1 -- 172.21.15.87:0/136507198 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f0e2008b9d0 con 0x7f0e380fc720 2024-09-17T07:26:17.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.862+0000 7f0e3659c640 1 --2- 172.21.15.87:0/136507198 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f0e2406cb90 0x7f0e2406f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:26:17.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.862+0000 7f0e3659c640 1 --2- 172.21.15.87:0/136507198 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f0e2406cb90 0x7f0e2406f040 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0e280043d0 tx=0x7f0e28009da0 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:26:17.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:17.866+0000 7f0e2effd640 1 -- 172.21.15.87:0/136507198 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f0e200559e0 con 0x7f0e380fc720 2024-09-17T07:26:18.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:18.090+0000 7f0e3cf4d640 1 -- 172.21.15.87:0/136507198 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f0e38103d30 con 0x7f0e380fc720 2024-09-17T07:26:18.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:18.091+0000 7f0e2effd640 1 -- 172.21.15.87:0/136507198 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f0e20059000 con 0x7f0e380fc720 2024-09-17T07:26:18.092 INFO:teuthology.orchestra.run.smithi087.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T07:26:18.092 INFO:teuthology.orchestra.run.smithi087.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T07:26:18.092 INFO:teuthology.orchestra.run.smithi087.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T07:26:18.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:18.092+0000 7f0e3cf4d640 1 -- 172.21.15.87:0/136507198 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f0e2406cb90 msgr2=0x7f0e2406f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:26:18.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:18.092+0000 7f0e3cf4d640 1 --2- 172.21.15.87:0/136507198 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f0e2406cb90 0x7f0e2406f040 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0e280043d0 tx=0x7f0e28009da0 comp rx=0 tx=0).stop 2024-09-17T07:26:18.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:18.092+0000 7f0e3cf4d640 1 -- 172.21.15.87:0/136507198 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e380fc720 msgr2=0x7f0e38112250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:26:18.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:18.092+0000 7f0e3cf4d640 1 --2- 172.21.15.87:0/136507198 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e380fc720 0x7f0e38112250 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0e20002a50 tx=0x7f0e20004600 comp rx=0 tx=0).stop 2024-09-17T07:26:18.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:18.093+0000 7f0e3cf4d640 1 -- 172.21.15.87:0/136507198 shutdown_connections 2024-09-17T07:26:18.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:18.093+0000 7f0e3cf4d640 1 --2- 172.21.15.87:0/136507198 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e380fc720 0x7f0e38112250 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:18.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:18.093+0000 7f0e3cf4d640 1 --2- 172.21.15.87:0/136507198 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f0e2406cb90 0x7f0e2406f040 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:18.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:18.093+0000 7f0e3cf4d640 1 --2- 172.21.15.87:0/136507198 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0e380fb450 0x7f0e3810fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:18.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:18.093+0000 7f0e3cf4d640 1 -- 172.21.15.87:0/136507198 >> 172.21.15.87:0/136507198 conn(0x7f0e380f6c10 msgr2=0x7f0e380f84e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:26:18.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:18.093+0000 7f0e3cf4d640 1 -- 172.21.15.87:0/136507198 shutdown_connections 2024-09-17T07:26:18.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:18.093+0000 7f0e3cf4d640 1 -- 172.21.15.87:0/136507198 wait complete. 2024-09-17T07:26:18.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:18 smithi139 ceph-mon[79872]: from='client.34380 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:26:18.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:18 smithi139 ceph-mon[79872]: from='client.34384 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:26:18.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:18 smithi139 ceph-mon[79872]: from='client.34388 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:26:18.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:18 smithi139 ceph-mon[79872]: from='client.? 172.21.15.87:0/1891945937' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T07:26:18.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:18 smithi139 ceph-mon[79872]: from='client.? 172.21.15.87:0/136507198' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T07:26:18.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:18 smithi087 ceph-mon[90982]: from='client.34380 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:26:18.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:18 smithi087 ceph-mon[90982]: from='client.34384 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:26:18.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:18 smithi087 ceph-mon[90982]: from='client.34388 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:26:18.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:18 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/1891945937' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T07:26:18.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:18 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/136507198' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T07:26:19.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:19 smithi139 ceph-mon[79872]: from='client.44283 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:26:19.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:19 smithi139 ceph-mon[79872]: pgmap v164: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.1 KiB/s wr, 8 op/s 2024-09-17T07:26:19.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:19 smithi087 ceph-mon[90982]: from='client.44283 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:26:19.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:19 smithi087 ceph-mon[90982]: pgmap v164: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.1 KiB/s wr, 8 op/s 2024-09-17T07:26:21.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:21 smithi139 ceph-mon[79872]: pgmap v165: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 511 B/s wr, 5 op/s 2024-09-17T07:26:21.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:21 smithi087 ceph-mon[90982]: pgmap v165: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 511 B/s wr, 5 op/s 2024-09-17T07:26:22.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:22 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:26:22.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:22 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:26:22.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:22 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:26:22.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:22 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:26:22.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:22 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:26:22.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:22 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:26:22.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:22 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:26:22.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:22 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:26:22.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:22 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:26:22.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:22 smithi139 ceph-mon[79872]: daemon mds.cephfs.smithi139.gnwonz finished stopping rank 1 in filesystem cephfs (now has 1 ranks) 2024-09-17T07:26:22.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:22 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:26:22.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:22 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:26:22.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:22 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:26:22.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:22 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:26:22.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:22 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:26:22.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:22 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:26:22.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:22 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:26:22.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:22 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:26:22.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:22 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:26:22.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:22 smithi087 ceph-mon[90982]: daemon mds.cephfs.smithi139.gnwonz finished stopping rank 1 in filesystem cephfs (now has 1 ranks) 2024-09-17T07:26:23.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:23 smithi139 ceph-mon[79872]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-09-17T07:26:23.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:23 smithi139 ceph-mon[79872]: pgmap v166: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 426 B/s wr, 3 op/s 2024-09-17T07:26:23.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:23 smithi139 ceph-mon[79872]: mds.1 [v2:172.21.15.139:6824/3946792151,v1:172.21.15.139:6825/3946792151] down:stopped 2024-09-17T07:26:23.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:23 smithi139 ceph-mon[79872]: fsmap cephfs:1 {0=cephfs.smithi087.tjhpcs=up:active} 2 up:standby 2024-09-17T07:26:23.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:23 smithi087 ceph-mon[90982]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-09-17T07:26:23.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:23 smithi087 ceph-mon[90982]: pgmap v166: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 426 B/s wr, 3 op/s 2024-09-17T07:26:23.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:23 smithi087 ceph-mon[90982]: mds.1 [v2:172.21.15.139:6824/3946792151,v1:172.21.15.139:6825/3946792151] down:stopped 2024-09-17T07:26:23.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:23 smithi087 ceph-mon[90982]: fsmap cephfs:1 {0=cephfs.smithi087.tjhpcs=up:active} 2 up:standby 2024-09-17T07:26:25.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:24 smithi139 ceph-mon[79872]: mds.? [v2:172.21.15.139:6824/1004017136,v1:172.21.15.139:6825/1004017136] up:boot 2024-09-17T07:26:25.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:24 smithi139 ceph-mon[79872]: fsmap cephfs:1 {0=cephfs.smithi087.tjhpcs=up:active} 3 up:standby 2024-09-17T07:26:25.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:24 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi139.gnwonz"}]: dispatch 2024-09-17T07:26:25.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:24 smithi139 ceph-mon[79872]: pgmap v167: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 2 op/s 2024-09-17T07:26:25.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:24 smithi087 ceph-mon[90982]: mds.? [v2:172.21.15.139:6824/1004017136,v1:172.21.15.139:6825/1004017136] up:boot 2024-09-17T07:26:25.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:24 smithi087 ceph-mon[90982]: fsmap cephfs:1 {0=cephfs.smithi087.tjhpcs=up:active} 3 up:standby 2024-09-17T07:26:25.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:24 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi139.gnwonz"}]: dispatch 2024-09-17T07:26:25.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:24 smithi087 ceph-mon[90982]: pgmap v167: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 2 op/s 2024-09-17T07:26:27.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:27 smithi087 ceph-mon[90982]: pgmap v168: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-17T07:26:27.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:27 smithi139 ceph-mon[79872]: pgmap v168: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-17T07:26:28.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:28 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:26:28.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:28 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:26:29.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:29 smithi087 ceph-mon[90982]: pgmap v169: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-17T07:26:29.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:29 smithi139 ceph-mon[79872]: pgmap v169: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-17T07:26:31.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:31 smithi087 ceph-mon[90982]: pgmap v170: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail 2024-09-17T07:26:31.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:31 smithi139 ceph-mon[79872]: pgmap v170: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail 2024-09-17T07:26:32.533 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:32 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:26:32.534 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:32 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:26:32.534 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:32 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:26:32.534 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:32 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:26:32.534 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:32 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:26:32.534 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:32 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:26:32.534 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:32 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:26:32.534 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:32 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:26:32.534 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:32 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:26:32.534 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:32 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi087.vvbzss"]}]: dispatch 2024-09-17T07:26:32.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:32 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:26:32.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:32 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:26:32.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:32 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:26:32.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:32 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:26:32.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:32 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:26:32.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:32 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:26:32.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:32 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:26:32.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:32 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:26:32.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:32 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:26:32.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:32 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi087.vvbzss"]}]: dispatch 2024-09-17T07:26:33.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:33 smithi139 ceph-mon[79872]: Upgrade: It appears safe to stop mds.cephfs.smithi087.vvbzss 2024-09-17T07:26:33.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:33 smithi139 ceph-mon[79872]: pgmap v171: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail 2024-09-17T07:26:33.621 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:33 smithi087 ceph-mon[90982]: Upgrade: It appears safe to stop mds.cephfs.smithi087.vvbzss 2024-09-17T07:26:33.621 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:33 smithi087 ceph-mon[90982]: pgmap v171: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail 2024-09-17T07:26:34.611 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:34 smithi087 ceph-mon[90982]: Upgrade: Updating mds.cephfs.smithi087.vvbzss 2024-09-17T07:26:34.611 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:34 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:26:34.611 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:34 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi087.vvbzss", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T07:26:34.611 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:34 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:26:34.611 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:34 smithi087 ceph-mon[90982]: Deploying daemon mds.cephfs.smithi087.vvbzss on smithi087 2024-09-17T07:26:34.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:34 smithi139 ceph-mon[79872]: Upgrade: Updating mds.cephfs.smithi087.vvbzss 2024-09-17T07:26:34.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:34 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:26:34.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:34 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi087.vvbzss", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T07:26:34.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:34 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:26:34.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:34 smithi139 ceph-mon[79872]: Deploying daemon mds.cephfs.smithi087.vvbzss on smithi087 2024-09-17T07:26:35.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:35 smithi087 ceph-mon[90982]: pgmap v172: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail 2024-09-17T07:26:35.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:35 smithi087 ceph-mon[90982]: osdmap e79: 6 total, 6 up, 6 in 2024-09-17T07:26:35.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:35 smithi139 ceph-mon[79872]: pgmap v172: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail 2024-09-17T07:26:35.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:35 smithi139 ceph-mon[79872]: osdmap e79: 6 total, 6 up, 6 in 2024-09-17T07:26:36.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:36 smithi139 ceph-mon[79872]: fsmap cephfs:1 {0=cephfs.smithi087.tjhpcs=up:active} 2 up:standby 2024-09-17T07:26:36.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:36 smithi087 ceph-mon[90982]: fsmap cephfs:1 {0=cephfs.smithi087.tjhpcs=up:active} 2 up:standby 2024-09-17T07:26:37.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:37 smithi139 ceph-mon[79872]: pgmap v174: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail 2024-09-17T07:26:37.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:37 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi087.vvbzss"}]: dispatch 2024-09-17T07:26:37.642 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:37 smithi087 ceph-mon[90982]: pgmap v174: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail 2024-09-17T07:26:37.642 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:37 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi087.vvbzss"}]: dispatch 2024-09-17T07:26:39.357 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:39 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:26:39.357 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:39 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:26:39.357 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:39 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:26:39.357 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:39 smithi087 ceph-mon[90982]: pgmap v175: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail 2024-09-17T07:26:39.357 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:39 smithi087 ceph-mon[90982]: mds.? [v2:172.21.15.87:6826/1050918039,v1:172.21.15.87:6827/1050918039] up:boot 2024-09-17T07:26:39.357 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:39 smithi087 ceph-mon[90982]: fsmap cephfs:1 {0=cephfs.smithi087.tjhpcs=up:active} 3 up:standby 2024-09-17T07:26:39.357 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:39 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi087.vvbzss"}]: dispatch 2024-09-17T07:26:39.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:39 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:26:39.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:39 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:26:39.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:39 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:26:39.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:39 smithi139 ceph-mon[79872]: pgmap v175: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail 2024-09-17T07:26:39.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:39 smithi139 ceph-mon[79872]: mds.? [v2:172.21.15.87:6826/1050918039,v1:172.21.15.87:6827/1050918039] up:boot 2024-09-17T07:26:39.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:39 smithi139 ceph-mon[79872]: fsmap cephfs:1 {0=cephfs.smithi087.tjhpcs=up:active} 3 up:standby 2024-09-17T07:26:39.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:39 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi087.vvbzss"}]: dispatch 2024-09-17T07:26:41.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:41 smithi087 ceph-mon[90982]: pgmap v176: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail 2024-09-17T07:26:41.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:41 smithi139 ceph-mon[79872]: pgmap v176: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail 2024-09-17T07:26:42.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:42 smithi087 ceph-mon[90982]: pgmap v177: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail 2024-09-17T07:26:43.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:42 smithi139 ceph-mon[79872]: pgmap v177: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail 2024-09-17T07:26:44.073 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:26:44.073 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:26:44.073 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:26:44.074 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:26:44.074 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:26:44.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:26:44.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:26:44.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:26:44.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:26:44.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:26:45.020 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:44 smithi087 ceph-mon[90982]: pgmap v178: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail 2024-09-17T07:26:45.267 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:44 smithi139 ceph-mon[79872]: pgmap v178: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail 2024-09-17T07:26:47.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:47 smithi087 ceph-mon[90982]: pgmap v179: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail 2024-09-17T07:26:47.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:47 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:26:47.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:47 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:26:47.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:47 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:26:47.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:47 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:26:47.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:47 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:26:47.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:47 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:26:47.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:47 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:26:47.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:47 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:26:47.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:47 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:26:47.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:47 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:26:47.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:47 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi087.tjhpcs"]}]: dispatch 2024-09-17T07:26:47.486 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:47 smithi139 ceph-mon[79872]: pgmap v179: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail 2024-09-17T07:26:47.486 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:47 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:26:47.486 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:47 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:26:47.486 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:47 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:26:47.486 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:47 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:26:47.486 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:47 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:26:47.486 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:47 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:26:47.486 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:47 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:26:47.486 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:47 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:26:47.486 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:47 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:26:47.486 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:47 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:26:47.487 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:47 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi087.tjhpcs"]}]: dispatch 2024-09-17T07:26:48.177 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.176+0000 7fa6a27ec640 1 -- 172.21.15.87:0/2328877505 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa69c0fb430 msgr2=0x7fa69c0fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:26:48.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.176+0000 7fa6a27ec640 1 --2- 172.21.15.87:0/2328877505 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa69c0fb430 0x7fa69c0fb840 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa68c0048d0 tx=0x7fa68c009da0 comp rx=0 tx=0).stop 2024-09-17T07:26:48.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.176+0000 7fa6a27ec640 1 -- 172.21.15.87:0/2328877505 shutdown_connections 2024-09-17T07:26:48.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.176+0000 7fa6a27ec640 1 --2- 172.21.15.87:0/2328877505 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa69c0fc700 0x7fa69c0fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:48.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.176+0000 7fa6a27ec640 1 --2- 172.21.15.87:0/2328877505 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa69c0fb430 0x7fa69c0fb840 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:48.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.176+0000 7fa6a27ec640 1 -- 172.21.15.87:0/2328877505 >> 172.21.15.87:0/2328877505 conn(0x7fa69c0f6c10 msgr2=0x7fa69c0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:26:48.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.176+0000 7fa6a27ec640 1 -- 172.21.15.87:0/2328877505 shutdown_connections 2024-09-17T07:26:48.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.176+0000 7fa6a27ec640 1 -- 172.21.15.87:0/2328877505 wait complete. 2024-09-17T07:26:48.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.176+0000 7fa6a27ec640 1 Processor -- start 2024-09-17T07:26:48.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.177+0000 7fa6a27ec640 1 -- start start 2024-09-17T07:26:48.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.177+0000 7fa6a27ec640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa69c0fb430 0x7fa69c0ff550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:26:48.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.177+0000 7fa6a27ec640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa69c0fc700 0x7fa69c0fda40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:26:48.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.177+0000 7fa6a27ec640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa69c0fdfd0 con 0x7fa69c0fc700 2024-09-17T07:26:48.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.177+0000 7fa6a27ec640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa69c0fe110 con 0x7fa69c0fb430 2024-09-17T07:26:48.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.177+0000 7fa69b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa69c0fc700 0x7fa69c0fda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:26:48.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.177+0000 7fa69bfff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa69c0fb430 0x7fa69c0ff550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:26:48.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.177+0000 7fa69b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa69c0fc700 0x7fa69c0fda40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52578/0 (socket says 172.21.15.87:52578) 2024-09-17T07:26:48.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.177+0000 7fa69b7fe640 1 -- 172.21.15.87:0/4165722271 learned_addr learned my addr 172.21.15.87:0/4165722271 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:26:48.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.177+0000 7fa69b7fe640 1 -- 172.21.15.87:0/4165722271 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa69c0fb430 msgr2=0x7fa69c0ff550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:26:48.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.177+0000 7fa69b7fe640 1 --2- 172.21.15.87:0/4165722271 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa69c0fb430 0x7fa69c0ff550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:48.180 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.177+0000 7fa69b7fe640 1 -- 172.21.15.87:0/4165722271 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa68c005040 con 0x7fa69c0fc700 2024-09-17T07:26:48.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.178+0000 7fa69b7fe640 1 --2- 172.21.15.87:0/4165722271 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa69c0fc700 0x7fa69c0fda40 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa690002a80 tx=0x7fa690004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:26:48.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.178+0000 7fa698ff9640 1 -- 172.21.15.87:0/4165722271 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa690007c30 con 0x7fa69c0fc700 2024-09-17T07:26:48.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.178+0000 7fa698ff9640 1 -- 172.21.15.87:0/4165722271 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fa69000f040 con 0x7fa69c0fc700 2024-09-17T07:26:48.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.178+0000 7fa698ff9640 1 -- 172.21.15.87:0/4165722271 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa69000d9b0 con 0x7fa69c0fc700 2024-09-17T07:26:48.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.178+0000 7fa6a27ec640 1 -- 172.21.15.87:0/4165722271 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa69c0fe3f0 con 0x7fa69c0fc700 2024-09-17T07:26:48.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.178+0000 7fa6a27ec640 1 -- 172.21.15.87:0/4165722271 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa69c114fe0 con 0x7fa69c0fc700 2024-09-17T07:26:48.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.179+0000 7fa6a27ec640 1 -- 172.21.15.87:0/4165722271 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa69c104500 con 0x7fa69c0fc700 2024-09-17T07:26:48.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.180+0000 7fa698ff9640 1 -- 172.21.15.87:0/4165722271 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fa69000db10 con 0x7fa69c0fc700 2024-09-17T07:26:48.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.180+0000 7fa698ff9640 1 --2- 172.21.15.87:0/4165722271 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fa68406c980 0x7fa68406ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:26:48.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.180+0000 7fa698ff9640 1 -- 172.21.15.87:0/4165722271 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fa69008b9b0 con 0x7fa69c0fc700 2024-09-17T07:26:48.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.181+0000 7fa69bfff640 1 --2- 172.21.15.87:0/4165722271 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fa68406c980 0x7fa68406ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:26:48.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.181+0000 7fa69bfff640 1 --2- 172.21.15.87:0/4165722271 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fa68406c980 0x7fa68406ee30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa69c0ff300 tx=0x7fa68c035040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:26:48.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.185+0000 7fa698ff9640 1 -- 172.21.15.87:0/4165722271 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa690055a70 con 0x7fa69c0fc700 2024-09-17T07:26:48.343 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:48 smithi087 ceph-mon[90982]: Detected new or changed devices on smithi087 2024-09-17T07:26:48.343 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:48 smithi087 ceph-mon[90982]: Upgrade: It appears safe to stop mds.cephfs.smithi087.tjhpcs 2024-09-17T07:26:48.343 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:48 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:26:48.343 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:48 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi087.tjhpcs", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T07:26:48.343 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:48 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:26:48.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.379+0000 7fa6a27ec640 1 -- 172.21.15.87:0/4165722271 --> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa69c065690 con 0x7fa68406c980 2024-09-17T07:26:48.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.380+0000 7fa698ff9640 1 -- 172.21.15.87:0/4165722271 <== mgr.24529 v2:172.21.15.87:6800/1359413180 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fa69c065690 con 0x7fa68406c980 2024-09-17T07:26:48.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.382+0000 7fa6a27ec640 1 -- 172.21.15.87:0/4165722271 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fa68406c980 msgr2=0x7fa68406ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:26:48.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.382+0000 7fa6a27ec640 1 --2- 172.21.15.87:0/4165722271 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fa68406c980 0x7fa68406ee30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa69c0ff300 tx=0x7fa68c035040 comp rx=0 tx=0).stop 2024-09-17T07:26:48.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.382+0000 7fa6a27ec640 1 -- 172.21.15.87:0/4165722271 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa69c0fc700 msgr2=0x7fa69c0fda40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:26:48.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.382+0000 7fa6a27ec640 1 --2- 172.21.15.87:0/4165722271 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa69c0fc700 0x7fa69c0fda40 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa690002a80 tx=0x7fa690004600 comp rx=0 tx=0).stop 2024-09-17T07:26:48.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.382+0000 7fa6a27ec640 1 -- 172.21.15.87:0/4165722271 shutdown_connections 2024-09-17T07:26:48.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.382+0000 7fa6a27ec640 1 --2- 172.21.15.87:0/4165722271 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa69c0fc700 0x7fa69c0fda40 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:48.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.382+0000 7fa6a27ec640 1 --2- 172.21.15.87:0/4165722271 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fa68406c980 0x7fa68406ee30 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:48.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.382+0000 7fa6a27ec640 1 --2- 172.21.15.87:0/4165722271 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa69c0fb430 0x7fa69c0ff550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:48.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.382+0000 7fa6a27ec640 1 -- 172.21.15.87:0/4165722271 >> 172.21.15.87:0/4165722271 conn(0x7fa69c0f6c10 msgr2=0x7fa69c064f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:26:48.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.382+0000 7fa6a27ec640 1 -- 172.21.15.87:0/4165722271 shutdown_connections 2024-09-17T07:26:48.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.382+0000 7fa6a27ec640 1 -- 172.21.15.87:0/4165722271 wait complete. 2024-09-17T07:26:48.392 INFO:teuthology.orchestra.run.smithi087.stdout:true 2024-09-17T07:26:48.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.462+0000 7fa3b3f42640 1 -- 172.21.15.87:0/3597437467 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3ac0fb450 msgr2=0x7fa3ac0fb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:26:48.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.462+0000 7fa3b3f42640 1 --2- 172.21.15.87:0/3597437467 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3ac0fb450 0x7fa3ac0fb860 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa3a80048d0 tx=0x7fa3a8009da0 comp rx=0 tx=0).stop 2024-09-17T07:26:48.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.462+0000 7fa3b3f42640 1 -- 172.21.15.87:0/3597437467 shutdown_connections 2024-09-17T07:26:48.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.462+0000 7fa3b3f42640 1 --2- 172.21.15.87:0/3597437467 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3ac0fc720 0x7fa3ac0fcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:48.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.462+0000 7fa3b3f42640 1 --2- 172.21.15.87:0/3597437467 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3ac0fb450 0x7fa3ac0fb860 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:48.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.462+0000 7fa3b3f42640 1 -- 172.21.15.87:0/3597437467 >> 172.21.15.87:0/3597437467 conn(0x7fa3ac0f6c10 msgr2=0x7fa3ac0f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:26:48.464 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.462+0000 7fa3b3f42640 1 -- 172.21.15.87:0/3597437467 shutdown_connections 2024-09-17T07:26:48.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.462+0000 7fa3b3f42640 1 -- 172.21.15.87:0/3597437467 wait complete. 2024-09-17T07:26:48.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.462+0000 7fa3b3f42640 1 Processor -- start 2024-09-17T07:26:48.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.462+0000 7fa3b3f42640 1 -- start start 2024-09-17T07:26:48.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.463+0000 7fa3b3f42640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3ac0fb450 0x7fa3ac0ff520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:26:48.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.463+0000 7fa3b3f42640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3ac0fc720 0x7fa3ac0fda60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:26:48.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.463+0000 7fa3b3f42640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ac0fdfa0 con 0x7fa3ac0fb450 2024-09-17T07:26:48.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.463+0000 7fa3b3f42640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ac0fe0e0 con 0x7fa3ac0fc720 2024-09-17T07:26:48.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.463+0000 7fa3b1cde640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3ac0fb450 0x7fa3ac0ff520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:26:48.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.463+0000 7fa3b1cde640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3ac0fb450 0x7fa3ac0ff520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52604/0 (socket says 172.21.15.87:52604) 2024-09-17T07:26:48.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.463+0000 7fa3b1cde640 1 -- 172.21.15.87:0/2805897677 learned_addr learned my addr 172.21.15.87:0/2805897677 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:26:48.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.463+0000 7fa3b14dd640 1 --2- 172.21.15.87:0/2805897677 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3ac0fc720 0x7fa3ac0fda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:26:48.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.463+0000 7fa3b1cde640 1 -- 172.21.15.87:0/2805897677 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3ac0fc720 msgr2=0x7fa3ac0fda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:26:48.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.463+0000 7fa3b1cde640 1 --2- 172.21.15.87:0/2805897677 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3ac0fc720 0x7fa3ac0fda60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:48.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.463+0000 7fa3b1cde640 1 -- 172.21.15.87:0/2805897677 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a8005040 con 0x7fa3ac0fb450 2024-09-17T07:26:48.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.463+0000 7fa3b1cde640 1 --2- 172.21.15.87:0/2805897677 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3ac0fb450 0x7fa3ac0ff520 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa3a8009ac0 tx=0x7fa3a8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:26:48.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.463+0000 7fa39e7fc640 1 -- 172.21.15.87:0/2805897677 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3a8038070 con 0x7fa3ac0fb450 2024-09-17T07:26:48.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.463+0000 7fa39e7fc640 1 -- 172.21.15.87:0/2805897677 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fa3a802ae70 con 0x7fa3ac0fb450 2024-09-17T07:26:48.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.463+0000 7fa3b3f42640 1 -- 172.21.15.87:0/2805897677 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3ac0fe360 con 0x7fa3ac0fb450 2024-09-17T07:26:48.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.464+0000 7fa39e7fc640 1 -- 172.21.15.87:0/2805897677 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3a8033420 con 0x7fa3ac0fb450 2024-09-17T07:26:48.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.464+0000 7fa3b3f42640 1 -- 172.21.15.87:0/2805897677 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3ac0fe8a0 con 0x7fa3ac0fb450 2024-09-17T07:26:48.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.464+0000 7fa3b3f42640 1 -- 172.21.15.87:0/2805897677 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3ac0fa8b0 con 0x7fa3ac0fb450 2024-09-17T07:26:48.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.465+0000 7fa39e7fc640 1 -- 172.21.15.87:0/2805897677 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fa3a8030020 con 0x7fa3ac0fb450 2024-09-17T07:26:48.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.465+0000 7fa39e7fc640 1 --2- 172.21.15.87:0/2805897677 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fa39806cb90 0x7fa39806f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:26:48.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.466+0000 7fa3b14dd640 1 --2- 172.21.15.87:0/2805897677 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fa39806cb90 0x7fa39806f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:26:48.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.466+0000 7fa39e7fc640 1 -- 172.21.15.87:0/2805897677 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fa3a80ac040 con 0x7fa3ac0fb450 2024-09-17T07:26:48.468 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.466+0000 7fa3b14dd640 1 --2- 172.21.15.87:0/2805897677 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fa39806cb90 0x7fa39806f040 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa3a00041d0 tx=0x7fa3a0004330 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:26:48.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.470+0000 7fa39e7fc640 1 -- 172.21.15.87:0/2805897677 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa3a80761c0 con 0x7fa3ac0fb450 2024-09-17T07:26:48.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:48 smithi139 ceph-mon[79872]: Detected new or changed devices on smithi087 2024-09-17T07:26:48.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:48 smithi139 ceph-mon[79872]: Upgrade: It appears safe to stop mds.cephfs.smithi087.tjhpcs 2024-09-17T07:26:48.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:48 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:26:48.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:48 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi087.tjhpcs", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T07:26:48.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:48 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:26:48.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.661+0000 7fa3b3f42640 1 -- 172.21.15.87:0/2805897677 --> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa3ac103ea0 con 0x7fa39806cb90 2024-09-17T07:26:48.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.662+0000 7fa39e7fc640 1 -- 172.21.15.87:0/2805897677 <== mgr.24529 v2:172.21.15.87:6800/1359413180 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fa3ac103ea0 con 0x7fa39806cb90 2024-09-17T07:26:48.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.665+0000 7fa3b3f42640 1 -- 172.21.15.87:0/2805897677 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fa39806cb90 msgr2=0x7fa39806f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:26:48.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.665+0000 7fa3b3f42640 1 --2- 172.21.15.87:0/2805897677 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fa39806cb90 0x7fa39806f040 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa3a00041d0 tx=0x7fa3a0004330 comp rx=0 tx=0).stop 2024-09-17T07:26:48.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.665+0000 7fa3b3f42640 1 -- 172.21.15.87:0/2805897677 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3ac0fb450 msgr2=0x7fa3ac0ff520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:26:48.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.665+0000 7fa3b3f42640 1 --2- 172.21.15.87:0/2805897677 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3ac0fb450 0x7fa3ac0ff520 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa3a8009ac0 tx=0x7fa3a8009da0 comp rx=0 tx=0).stop 2024-09-17T07:26:48.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.665+0000 7fa3b3f42640 1 -- 172.21.15.87:0/2805897677 shutdown_connections 2024-09-17T07:26:48.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.665+0000 7fa3b3f42640 1 --2- 172.21.15.87:0/2805897677 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fa39806cb90 0x7fa39806f040 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:48.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.665+0000 7fa3b3f42640 1 --2- 172.21.15.87:0/2805897677 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3ac0fc720 0x7fa3ac0fda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:48.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.665+0000 7fa3b3f42640 1 --2- 172.21.15.87:0/2805897677 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3ac0fb450 0x7fa3ac0ff520 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:48.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.665+0000 7fa3b3f42640 1 -- 172.21.15.87:0/2805897677 >> 172.21.15.87:0/2805897677 conn(0x7fa3ac0f6c10 msgr2=0x7fa3ac066220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:26:48.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.665+0000 7fa3b3f42640 1 -- 172.21.15.87:0/2805897677 shutdown_connections 2024-09-17T07:26:48.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.665+0000 7fa3b3f42640 1 -- 172.21.15.87:0/2805897677 wait complete. 2024-09-17T07:26:48.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.744+0000 7fdcb97ad640 1 -- 172.21.15.87:0/999385050 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdcb4066630 msgr2=0x7fdcb40ff1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:26:48.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.744+0000 7fdcb97ad640 1 --2- 172.21.15.87:0/999385050 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdcb4066630 0x7fdcb40ff1d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fdca4009c50 tx=0x7fdca4004d10 comp rx=0 tx=0).stop 2024-09-17T07:26:48.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.744+0000 7fdcb97ad640 1 -- 172.21.15.87:0/999385050 shutdown_connections 2024-09-17T07:26:48.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.744+0000 7fdcb97ad640 1 --2- 172.21.15.87:0/999385050 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdcb40ff710 0x7fdcb4101af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:48.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.744+0000 7fdcb97ad640 1 --2- 172.21.15.87:0/999385050 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdcb4066630 0x7fdcb40ff1d0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:48.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.744+0000 7fdcb97ad640 1 -- 172.21.15.87:0/999385050 >> 172.21.15.87:0/999385050 conn(0x7fdcb40f6c20 msgr2=0x7fdcb40f9030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:26:48.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.744+0000 7fdcb97ad640 1 -- 172.21.15.87:0/999385050 shutdown_connections 2024-09-17T07:26:48.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.744+0000 7fdcb97ad640 1 -- 172.21.15.87:0/999385050 wait complete. 2024-09-17T07:26:48.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.744+0000 7fdcb97ad640 1 Processor -- start 2024-09-17T07:26:48.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.744+0000 7fdcb97ad640 1 -- start start 2024-09-17T07:26:48.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.745+0000 7fdcb97ad640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdcb4066630 0x7fdcb40fcbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:26:48.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.745+0000 7fdcb97ad640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdcb40ff710 0x7fdcb40fb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:26:48.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.745+0000 7fdcb97ad640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb40fb660 con 0x7fdcb4066630 2024-09-17T07:26:48.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.745+0000 7fdcb97ad640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb40fb7a0 con 0x7fdcb40ff710 2024-09-17T07:26:48.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.745+0000 7fdcb2ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdcb4066630 0x7fdcb40fcbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:26:48.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.745+0000 7fdcb2ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdcb4066630 0x7fdcb40fcbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52616/0 (socket says 172.21.15.87:52616) 2024-09-17T07:26:48.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.745+0000 7fdcb2ffd640 1 -- 172.21.15.87:0/2461222785 learned_addr learned my addr 172.21.15.87:0/2461222785 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:26:48.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.745+0000 7fdcb27fc640 1 --2- 172.21.15.87:0/2461222785 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdcb40ff710 0x7fdcb40fb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:26:48.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.745+0000 7fdcb2ffd640 1 -- 172.21.15.87:0/2461222785 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdcb40ff710 msgr2=0x7fdcb40fb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:26:48.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.745+0000 7fdcb2ffd640 1 --2- 172.21.15.87:0/2461222785 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdcb40ff710 0x7fdcb40fb0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:48.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.745+0000 7fdcb2ffd640 1 -- 172.21.15.87:0/2461222785 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca40098b0 con 0x7fdcb4066630 2024-09-17T07:26:48.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.745+0000 7fdcb27fc640 1 --2- 172.21.15.87:0/2461222785 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdcb40ff710 0x7fdcb40fb0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T07:26:48.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.745+0000 7fdcb2ffd640 1 --2- 172.21.15.87:0/2461222785 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdcb4066630 0x7fdcb40fcbe0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fdca4000f80 tx=0x7fdca4004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:26:48.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.745+0000 7fdcab7fe640 1 -- 172.21.15.87:0/2461222785 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdca4032750 con 0x7fdcb4066630 2024-09-17T07:26:48.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.746+0000 7fdcab7fe640 1 -- 172.21.15.87:0/2461222785 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fdca4009710 con 0x7fdcb4066630 2024-09-17T07:26:48.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.746+0000 7fdcb97ad640 1 -- 172.21.15.87:0/2461222785 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcb40fba20 con 0x7fdcb4066630 2024-09-17T07:26:48.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.746+0000 7fdcab7fe640 1 -- 172.21.15.87:0/2461222785 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdca403dab0 con 0x7fdcb4066630 2024-09-17T07:26:48.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.746+0000 7fdcb97ad640 1 -- 172.21.15.87:0/2461222785 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcb41150f0 con 0x7fdcb4066630 2024-09-17T07:26:48.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.747+0000 7fdcb97ad640 1 -- 172.21.15.87:0/2461222785 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcb40fa8a0 con 0x7fdcb4066630 2024-09-17T07:26:48.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.747+0000 7fdcab7fe640 1 -- 172.21.15.87:0/2461222785 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fdca402f030 con 0x7fdcb4066630 2024-09-17T07:26:48.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.748+0000 7fdcab7fe640 1 --2- 172.21.15.87:0/2461222785 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fdca006cb90 0x7fdca006f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:26:48.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.748+0000 7fdcab7fe640 1 -- 172.21.15.87:0/2461222785 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fdca40ad1f0 con 0x7fdcb4066630 2024-09-17T07:26:48.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.748+0000 7fdcb27fc640 1 --2- 172.21.15.87:0/2461222785 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fdca006cb90 0x7fdca006f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:26:48.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.748+0000 7fdcb27fc640 1 --2- 172.21.15.87:0/2461222785 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fdca006cb90 0x7fdca006f040 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c0041d0 tx=0x7fdc9c009040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:26:48.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.752+0000 7fdcab7fe640 1 -- 172.21.15.87:0/2461222785 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fdca40772c0 con 0x7fdcb4066630 2024-09-17T07:26:48.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.920+0000 7fdcb97ad640 1 -- 172.21.15.87:0/2461222785 --> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fdcb4101070 con 0x7fdca006cb90 2024-09-17T07:26:48.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.930+0000 7fdcab7fe640 1 -- 172.21.15.87:0/2461222785 <== mgr.24529 v2:172.21.15.87:6800/1359413180 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fdcb4101070 con 0x7fdca006cb90 2024-09-17T07:26:48.931 INFO:teuthology.orchestra.run.smithi087.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T07:26:48.931 INFO:teuthology.orchestra.run.smithi087.stdout:alertmanager.smithi087 smithi087 *:9093,9094 running (6m) 6s ago 14m 24.1M - 0.25.0 c8568f914cd2 594553f0b497 2024-09-17T07:26:48.932 INFO:teuthology.orchestra.run.smithi087.stdout:crash.smithi087 smithi087 running (4m) 6s ago 14m 6895k - 18.2.4-855-g19e2a2be 980a0bfcd684 0ff8a9330162 2024-09-17T07:26:48.932 INFO:teuthology.orchestra.run.smithi087.stdout:crash.smithi139 smithi139 running (3m) 54s ago 14m 6899k - 18.2.4-855-g19e2a2be 980a0bfcd684 10541e3b202e 2024-09-17T07:26:48.932 INFO:teuthology.orchestra.run.smithi087.stdout:grafana.smithi087 smithi087 *:3000 running (6m) 6s ago 14m 86.2M - 9.4.7 954c08fa6188 e2f17ec6baa8 2024-09-17T07:26:48.932 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi087.tjhpcs smithi087 running (9m) 6s ago 9m 129M - 17.2.7-1635-g4a704134 f22ead590bad f7142ad971ed 2024-09-17T07:26:48.932 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi087.vvbzss smithi087 running (11s) 6s ago 9m 11.7M - 18.2.4-855-g19e2a2be 980a0bfcd684 e50f437839ed 2024-09-17T07:26:48.932 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi139.ftvinf smithi139 running (9m) 54s ago 9m 57.3M - 17.2.7-1635-g4a704134 f22ead590bad d11edb295ad3 2024-09-17T07:26:48.932 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi139.gnwonz smithi139 running (9m) 54s ago 9m 116M - 17.2.7-1635-g4a704134 f22ead590bad 3b3d884aef02 2024-09-17T07:26:48.932 INFO:teuthology.orchestra.run.smithi087.stdout:mgr.smithi087.vuvjer smithi087 *:8443,9283,8765 running (5m) 6s ago 16m 494M - 18.2.4-855-g19e2a2be 980a0bfcd684 5d10c647cb6b 2024-09-17T07:26:48.932 INFO:teuthology.orchestra.run.smithi087.stdout:mgr.smithi139.tuqnpn smithi139 *:8443,9283,8765 running (5m) 54s ago 13m 439M - 18.2.4-855-g19e2a2be 980a0bfcd684 6e0bf371d44c 2024-09-17T07:26:48.932 INFO:teuthology.orchestra.run.smithi087.stdout:mon.smithi087 smithi087 running (4m) 6s ago 16m 49.9M 2048M 18.2.4-855-g19e2a2be 980a0bfcd684 305c72de1f9f 2024-09-17T07:26:48.932 INFO:teuthology.orchestra.run.smithi087.stdout:mon.smithi139 smithi139 running (4m) 54s ago 13m 39.9M 2048M 18.2.4-855-g19e2a2be 980a0bfcd684 0b159495af0f 2024-09-17T07:26:48.932 INFO:teuthology.orchestra.run.smithi087.stdout:node-exporter.smithi087 smithi087 *:9100 running (6m) 6s ago 14m 15.3M - 1.5.0 0da6a335fe13 39fa48de0e87 2024-09-17T07:26:48.932 INFO:teuthology.orchestra.run.smithi087.stdout:node-exporter.smithi139 smithi139 *:9100 running (5m) 54s ago 13m 15.5M - 1.5.0 0da6a335fe13 a5b99b7cbb06 2024-09-17T07:26:48.932 INFO:teuthology.orchestra.run.smithi087.stdout:osd.0 smithi087 running (3m) 6s ago 13m 91.1M 1557M 18.2.4-855-g19e2a2be 980a0bfcd684 e97cb50e6aec 2024-09-17T07:26:48.933 INFO:teuthology.orchestra.run.smithi087.stdout:osd.1 smithi087 running (3m) 6s ago 12m 95.2M 1557M 18.2.4-855-g19e2a2be 980a0bfcd684 b108771d0b8e 2024-09-17T07:26:48.933 INFO:teuthology.orchestra.run.smithi087.stdout:osd.2 smithi087 running (2m) 6s ago 12m 80.7M 1557M 18.2.4-855-g19e2a2be 980a0bfcd684 240cfb3b5366 2024-09-17T07:26:48.933 INFO:teuthology.orchestra.run.smithi087.stdout:osd.3 smithi139 running (2m) 54s ago 11m 102M 2581M 18.2.4-855-g19e2a2be 980a0bfcd684 b05ed3bf3f5c 2024-09-17T07:26:48.933 INFO:teuthology.orchestra.run.smithi087.stdout:osd.4 smithi139 running (89s) 54s ago 11m 93.2M 2581M 18.2.4-855-g19e2a2be 980a0bfcd684 139bbfc915c8 2024-09-17T07:26:48.933 INFO:teuthology.orchestra.run.smithi087.stdout:osd.5 smithi139 running (57s) 54s ago 10m 12.1M 2581M 18.2.4-855-g19e2a2be 980a0bfcd684 5058216f1ee0 2024-09-17T07:26:48.933 INFO:teuthology.orchestra.run.smithi087.stdout:prometheus.smithi087 smithi087 *:9095 running (5m) 6s ago 14m 65.4M - 2.43.0 a07b618ecd1d 63d18b7469fc 2024-09-17T07:26:48.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.932+0000 7fdcb97ad640 1 -- 172.21.15.87:0/2461222785 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fdca006cb90 msgr2=0x7fdca006f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:26:48.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.932+0000 7fdcb97ad640 1 --2- 172.21.15.87:0/2461222785 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fdca006cb90 0x7fdca006f040 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c0041d0 tx=0x7fdc9c009040 comp rx=0 tx=0).stop 2024-09-17T07:26:48.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.932+0000 7fdcb97ad640 1 -- 172.21.15.87:0/2461222785 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdcb4066630 msgr2=0x7fdcb40fcbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:26:48.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.932+0000 7fdcb97ad640 1 --2- 172.21.15.87:0/2461222785 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdcb4066630 0x7fdcb40fcbe0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fdca4000f80 tx=0x7fdca4004d10 comp rx=0 tx=0).stop 2024-09-17T07:26:48.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.932+0000 7fdcb97ad640 1 -- 172.21.15.87:0/2461222785 shutdown_connections 2024-09-17T07:26:48.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.932+0000 7fdcb97ad640 1 --2- 172.21.15.87:0/2461222785 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fdca006cb90 0x7fdca006f040 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:48.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.932+0000 7fdcb97ad640 1 --2- 172.21.15.87:0/2461222785 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdcb40ff710 0x7fdcb40fb0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:48.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.932+0000 7fdcb97ad640 1 --2- 172.21.15.87:0/2461222785 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdcb4066630 0x7fdcb40fcbe0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:48.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.932+0000 7fdcb97ad640 1 -- 172.21.15.87:0/2461222785 >> 172.21.15.87:0/2461222785 conn(0x7fdcb40f6c20 msgr2=0x7fdcb40f9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:26:48.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.932+0000 7fdcb97ad640 1 -- 172.21.15.87:0/2461222785 shutdown_connections 2024-09-17T07:26:48.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:48.932+0000 7fdcb97ad640 1 -- 172.21.15.87:0/2461222785 wait complete. 2024-09-17T07:26:49.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.010+0000 7fa8edba8640 1 -- 172.21.15.87:0/1586428943 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8e80fe750 msgr2=0x7fa8e80feb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:26:49.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.010+0000 7fa8edba8640 1 --2- 172.21.15.87:0/1586428943 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8e80fe750 0x7fa8e80feb60 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa8d80048d0 tx=0x7fa8d8009da0 comp rx=0 tx=0).stop 2024-09-17T07:26:49.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.010+0000 7fa8edba8640 1 -- 172.21.15.87:0/1586428943 shutdown_connections 2024-09-17T07:26:49.013 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.010+0000 7fa8edba8640 1 --2- 172.21.15.87:0/1586428943 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa8e80ffa20 0x7fa8e80ffe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:49.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.010+0000 7fa8edba8640 1 --2- 172.21.15.87:0/1586428943 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8e80fe750 0x7fa8e80feb60 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:49.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.010+0000 7fa8edba8640 1 -- 172.21.15.87:0/1586428943 >> 172.21.15.87:0/1586428943 conn(0x7fa8e80fa200 msgr2=0x7fa8e80fc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:26:49.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.010+0000 7fa8edba8640 1 -- 172.21.15.87:0/1586428943 shutdown_connections 2024-09-17T07:26:49.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.010+0000 7fa8edba8640 1 -- 172.21.15.87:0/1586428943 wait complete. 2024-09-17T07:26:49.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.011+0000 7fa8edba8640 1 Processor -- start 2024-09-17T07:26:49.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.011+0000 7fa8edba8640 1 -- start start 2024-09-17T07:26:49.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.011+0000 7fa8edba8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8e80fe750 0x7fa8e810f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:26:49.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.011+0000 7fa8edba8640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa8e80ffa20 0x7fa8e810f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:26:49.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.011+0000 7fa8edba8640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e810fd70 con 0x7fa8e80fe750 2024-09-17T07:26:49.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.011+0000 7fa8edba8640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e8110590 con 0x7fa8e80ffa20 2024-09-17T07:26:49.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.011+0000 7fa8e77fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8e80fe750 0x7fa8e810f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:26:49.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.011+0000 7fa8e77fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8e80fe750 0x7fa8e810f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52634/0 (socket says 172.21.15.87:52634) 2024-09-17T07:26:49.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.011+0000 7fa8e77fe640 1 -- 172.21.15.87:0/2370457657 learned_addr learned my addr 172.21.15.87:0/2370457657 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:26:49.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.011+0000 7fa8e6ffd640 1 --2- 172.21.15.87:0/2370457657 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa8e80ffa20 0x7fa8e810f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:26:49.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.012+0000 7fa8e77fe640 1 -- 172.21.15.87:0/2370457657 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa8e80ffa20 msgr2=0x7fa8e810f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:26:49.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.012+0000 7fa8e77fe640 1 --2- 172.21.15.87:0/2370457657 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa8e80ffa20 0x7fa8e810f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:49.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.012+0000 7fa8e77fe640 1 -- 172.21.15.87:0/2370457657 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d8005040 con 0x7fa8e80fe750 2024-09-17T07:26:49.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.012+0000 7fa8e6ffd640 1 --2- 172.21.15.87:0/2370457657 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa8e80ffa20 0x7fa8e810f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T07:26:49.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.012+0000 7fa8e77fe640 1 --2- 172.21.15.87:0/2370457657 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8e80fe750 0x7fa8e810f1e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa8d80043d0 tx=0x7fa8d8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:26:49.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.012+0000 7fa8cffff640 1 -- 172.21.15.87:0/2370457657 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa8d8038070 con 0x7fa8e80fe750 2024-09-17T07:26:49.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.012+0000 7fa8edba8640 1 -- 172.21.15.87:0/2370457657 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8e81107c0 con 0x7fa8e80fe750 2024-09-17T07:26:49.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.012+0000 7fa8cffff640 1 -- 172.21.15.87:0/2370457657 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fa8d80096c0 con 0x7fa8e80fe750 2024-09-17T07:26:49.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.012+0000 7fa8cffff640 1 -- 172.21.15.87:0/2370457657 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa8d803d420 con 0x7fa8e80fe750 2024-09-17T07:26:49.015 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.012+0000 7fa8edba8640 1 -- 172.21.15.87:0/2370457657 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8e8110d60 con 0x7fa8e80fe750 2024-09-17T07:26:49.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.013+0000 7fa8edba8640 1 -- 172.21.15.87:0/2370457657 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8e80fdd00 con 0x7fa8e80fe750 2024-09-17T07:26:49.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.014+0000 7fa8cffff640 1 -- 172.21.15.87:0/2370457657 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fa8d8030020 con 0x7fa8e80fe750 2024-09-17T07:26:49.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.014+0000 7fa8cffff640 1 --2- 172.21.15.87:0/2370457657 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fa8d006cb90 0x7fa8d006f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:26:49.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.014+0000 7fa8cffff640 1 -- 172.21.15.87:0/2370457657 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fa8d80ac710 con 0x7fa8e80fe750 2024-09-17T07:26:49.016 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.014+0000 7fa8e6ffd640 1 --2- 172.21.15.87:0/2370457657 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fa8d006cb90 0x7fa8d006f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:26:49.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.015+0000 7fa8e6ffd640 1 --2- 172.21.15.87:0/2370457657 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fa8d006cb90 0x7fa8d006f040 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc007fd0 tx=0x7fa8dc009e90 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:26:49.019 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.018+0000 7fa8cffff640 1 -- 172.21.15.87:0/2370457657 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa8d80767d0 con 0x7fa8e80fe750 2024-09-17T07:26:49.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.248+0000 7fa8edba8640 1 -- 172.21.15.87:0/2370457657 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa8e8111020 con 0x7fa8e80fe750 2024-09-17T07:26:49.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.249+0000 7fa8cffff640 1 -- 172.21.15.87:0/2370457657 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+844 (secure 0 0 0) 0x7fa8d8079df0 con 0x7fa8e80fe750 2024-09-17T07:26:49.250 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T07:26:49.250 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": { 2024-09-17T07:26:49.251 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 2 2024-09-17T07:26:49.251 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:26:49.251 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr": { 2024-09-17T07:26:49.251 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 2 2024-09-17T07:26:49.251 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:26:49.251 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": { 2024-09-17T07:26:49.251 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 6 2024-09-17T07:26:49.251 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:26:49.251 INFO:teuthology.orchestra.run.smithi087.stdout: "mds": { 2024-09-17T07:26:49.251 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 3, 2024-09-17T07:26:49.251 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 1 2024-09-17T07:26:49.251 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:26:49.251 INFO:teuthology.orchestra.run.smithi087.stdout: "overall": { 2024-09-17T07:26:49.251 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 3, 2024-09-17T07:26:49.252 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 11 2024-09-17T07:26:49.252 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T07:26:49.252 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T07:26:49.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.251+0000 7fa8edba8640 1 -- 172.21.15.87:0/2370457657 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fa8d006cb90 msgr2=0x7fa8d006f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:26:49.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.251+0000 7fa8edba8640 1 --2- 172.21.15.87:0/2370457657 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fa8d006cb90 0x7fa8d006f040 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc007fd0 tx=0x7fa8dc009e90 comp rx=0 tx=0).stop 2024-09-17T07:26:49.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.251+0000 7fa8edba8640 1 -- 172.21.15.87:0/2370457657 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8e80fe750 msgr2=0x7fa8e810f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:26:49.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.251+0000 7fa8edba8640 1 --2- 172.21.15.87:0/2370457657 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8e80fe750 0x7fa8e810f1e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa8d80043d0 tx=0x7fa8d8009da0 comp rx=0 tx=0).stop 2024-09-17T07:26:49.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.251+0000 7fa8edba8640 1 -- 172.21.15.87:0/2370457657 shutdown_connections 2024-09-17T07:26:49.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.251+0000 7fa8edba8640 1 --2- 172.21.15.87:0/2370457657 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fa8d006cb90 0x7fa8d006f040 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:49.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.251+0000 7fa8edba8640 1 --2- 172.21.15.87:0/2370457657 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa8e80ffa20 0x7fa8e810f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:49.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.251+0000 7fa8edba8640 1 --2- 172.21.15.87:0/2370457657 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8e80fe750 0x7fa8e810f1e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:49.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.251+0000 7fa8edba8640 1 -- 172.21.15.87:0/2370457657 >> 172.21.15.87:0/2370457657 conn(0x7fa8e80fa200 msgr2=0x7fa8e80fcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:26:49.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.251+0000 7fa8edba8640 1 -- 172.21.15.87:0/2370457657 shutdown_connections 2024-09-17T07:26:49.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.251+0000 7fa8edba8640 1 -- 172.21.15.87:0/2370457657 wait complete. 2024-09-17T07:26:49.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.329+0000 7f6288e35640 1 -- 172.21.15.87:0/3834192433 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62840fa970 msgr2=0x7f62840fad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:26:49.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.329+0000 7f6288e35640 1 --2- 172.21.15.87:0/3834192433 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62840fa970 0x7f62840fad80 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f62740048d0 tx=0x7f6274009da0 comp rx=0 tx=0).stop 2024-09-17T07:26:49.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.329+0000 7f6288e35640 1 -- 172.21.15.87:0/3834192433 shutdown_connections 2024-09-17T07:26:49.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.329+0000 7f6288e35640 1 --2- 172.21.15.87:0/3834192433 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f62840fb2c0 0x7f62840fdb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:49.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.329+0000 7f6288e35640 1 --2- 172.21.15.87:0/3834192433 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62840fa970 0x7f62840fad80 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:49.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.329+0000 7f6288e35640 1 -- 172.21.15.87:0/3834192433 >> 172.21.15.87:0/3834192433 conn(0x7f62840f63b0 msgr2=0x7f62840f87e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:26:49.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.329+0000 7f6288e35640 1 -- 172.21.15.87:0/3834192433 shutdown_connections 2024-09-17T07:26:49.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.329+0000 7f6288e35640 1 -- 172.21.15.87:0/3834192433 wait complete. 2024-09-17T07:26:49.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.329+0000 7f6288e35640 1 Processor -- start 2024-09-17T07:26:49.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.330+0000 7f6288e35640 1 -- start start 2024-09-17T07:26:49.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.330+0000 7f6288e35640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f62840fa970 0x7f62840fd480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:26:49.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.330+0000 7f6288e35640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62840fb2c0 0x7f62840fb970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:26:49.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.330+0000 7f6288e35640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62840fbf90 con 0x7f62840fb2c0 2024-09-17T07:26:49.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.330+0000 7f6288e35640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62840fc0d0 con 0x7f62840fa970 2024-09-17T07:26:49.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.330+0000 7f6281d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62840fb2c0 0x7f62840fb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:26:49.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.330+0000 7f6281d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62840fb2c0 0x7f62840fb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52644/0 (socket says 172.21.15.87:52644) 2024-09-17T07:26:49.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.330+0000 7f6281d9b640 1 -- 172.21.15.87:0/3018258411 learned_addr learned my addr 172.21.15.87:0/3018258411 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:26:49.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.330+0000 7f628259c640 1 --2- 172.21.15.87:0/3018258411 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f62840fa970 0x7f62840fd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:26:49.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.330+0000 7f6281d9b640 1 -- 172.21.15.87:0/3018258411 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f62840fa970 msgr2=0x7f62840fd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:26:49.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.330+0000 7f6281d9b640 1 --2- 172.21.15.87:0/3018258411 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f62840fa970 0x7f62840fd480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:49.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.330+0000 7f6281d9b640 1 -- 172.21.15.87:0/3018258411 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6274005040 con 0x7f62840fb2c0 2024-09-17T07:26:49.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.330+0000 7f628259c640 1 --2- 172.21.15.87:0/3018258411 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f62840fa970 0x7f62840fd480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T07:26:49.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.330+0000 7f6281d9b640 1 --2- 172.21.15.87:0/3018258411 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62840fb2c0 0x7f62840fb970 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f627800b580 tx=0x7f62780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:26:49.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.331+0000 7f6272ffd640 1 -- 172.21.15.87:0/3018258411 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f627800f570 con 0x7f62840fb2c0 2024-09-17T07:26:49.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.331+0000 7f6272ffd640 1 -- 172.21.15.87:0/3018258411 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f627800fb50 con 0x7f62840fb2c0 2024-09-17T07:26:49.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.331+0000 7f6288e35640 1 -- 172.21.15.87:0/3018258411 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62840fc3b0 con 0x7f62840fb2c0 2024-09-17T07:26:49.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.331+0000 7f6272ffd640 1 -- 172.21.15.87:0/3018258411 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6278010c90 con 0x7f62840fb2c0 2024-09-17T07:26:49.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.331+0000 7f6288e35640 1 -- 172.21.15.87:0/3018258411 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62841152b0 con 0x7f62840fb2c0 2024-09-17T07:26:49.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.332+0000 7f6288e35640 1 -- 172.21.15.87:0/3018258411 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f628404b720 con 0x7f62840fb2c0 2024-09-17T07:26:49.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.332+0000 7f6272ffd640 1 -- 172.21.15.87:0/3018258411 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f627800fcc0 con 0x7f62840fb2c0 2024-09-17T07:26:49.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.332+0000 7f6272ffd640 1 --2- 172.21.15.87:0/3018258411 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f626c06cb90 0x7f626c06f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:26:49.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.332+0000 7f6272ffd640 1 -- 172.21.15.87:0/3018258411 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f627808be20 con 0x7f62840fb2c0 2024-09-17T07:26:49.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.333+0000 7f628259c640 1 --2- 172.21.15.87:0/3018258411 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f626c06cb90 0x7f626c06f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:26:49.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.333+0000 7f628259c640 1 --2- 172.21.15.87:0/3018258411 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f626c06cb90 0x7f626c06f040 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6274009ac0 tx=0x7f6274035040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:26:49.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.337+0000 7f6272ffd640 1 -- 172.21.15.87:0/3018258411 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f6278055f50 con 0x7f62840fb2c0 2024-09-17T07:26:49.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:49 smithi087 ceph-mon[90982]: Upgrade: Updating mds.cephfs.smithi087.tjhpcs 2024-09-17T07:26:49.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:49 smithi087 ceph-mon[90982]: Deploying daemon mds.cephfs.smithi087.tjhpcs on smithi087 2024-09-17T07:26:49.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:49 smithi087 ceph-mon[90982]: pgmap v180: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail 2024-09-17T07:26:49.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.538+0000 7f6288e35640 1 -- 172.21.15.87:0/3018258411 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6284065870 con 0x7f62840fb2c0 2024-09-17T07:26:49.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.538+0000 7f6272ffd640 1 -- 172.21.15.87:0/3018258411 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 30 v30) v1 ==== 76+0+1847 (secure 0 0 0) 0x7f6278059570 con 0x7f62840fb2c0 2024-09-17T07:26:49.540 INFO:teuthology.orchestra.run.smithi087.stdout:e30 2024-09-17T07:26:49.540 INFO:teuthology.orchestra.run.smithi087.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T07:26:49.540 INFO:teuthology.orchestra.run.smithi087.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T07:26:49.540 INFO:teuthology.orchestra.run.smithi087.stdout:legacy client fscid: 1 2024-09-17T07:26:49.540 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:26:49.540 INFO:teuthology.orchestra.run.smithi087.stdout:Filesystem 'cephfs' (1) 2024-09-17T07:26:49.540 INFO:teuthology.orchestra.run.smithi087.stdout:fs_name cephfs 2024-09-17T07:26:49.540 INFO:teuthology.orchestra.run.smithi087.stdout:epoch 27 2024-09-17T07:26:49.540 INFO:teuthology.orchestra.run.smithi087.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-17T07:26:49.541 INFO:teuthology.orchestra.run.smithi087.stdout:created 2024-09-17T07:17:15.368053+0000 2024-09-17T07:26:49.541 INFO:teuthology.orchestra.run.smithi087.stdout:modified 2024-09-17T07:26:22.696739+0000 2024-09-17T07:26:49.541 INFO:teuthology.orchestra.run.smithi087.stdout:tableserver 0 2024-09-17T07:26:49.541 INFO:teuthology.orchestra.run.smithi087.stdout:root 0 2024-09-17T07:26:49.541 INFO:teuthology.orchestra.run.smithi087.stdout:session_timeout 60 2024-09-17T07:26:49.541 INFO:teuthology.orchestra.run.smithi087.stdout:session_autoclose 300 2024-09-17T07:26:49.541 INFO:teuthology.orchestra.run.smithi087.stdout:max_file_size 1099511627776 2024-09-17T07:26:49.541 INFO:teuthology.orchestra.run.smithi087.stdout:max_xattr_size 65536 2024-09-17T07:26:49.541 INFO:teuthology.orchestra.run.smithi087.stdout:required_client_features {} 2024-09-17T07:26:49.541 INFO:teuthology.orchestra.run.smithi087.stdout:last_failure 0 2024-09-17T07:26:49.541 INFO:teuthology.orchestra.run.smithi087.stdout:last_failure_osd_epoch 0 2024-09-17T07:26:49.541 INFO:teuthology.orchestra.run.smithi087.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T07:26:49.541 INFO:teuthology.orchestra.run.smithi087.stdout:max_mds 1 2024-09-17T07:26:49.542 INFO:teuthology.orchestra.run.smithi087.stdout:in 0 2024-09-17T07:26:49.542 INFO:teuthology.orchestra.run.smithi087.stdout:up {0=14478} 2024-09-17T07:26:49.542 INFO:teuthology.orchestra.run.smithi087.stdout:failed 2024-09-17T07:26:49.542 INFO:teuthology.orchestra.run.smithi087.stdout:damaged 2024-09-17T07:26:49.542 INFO:teuthology.orchestra.run.smithi087.stdout:stopped 1 2024-09-17T07:26:49.542 INFO:teuthology.orchestra.run.smithi087.stdout:data_pools [3] 2024-09-17T07:26:49.542 INFO:teuthology.orchestra.run.smithi087.stdout:metadata_pool 2 2024-09-17T07:26:49.542 INFO:teuthology.orchestra.run.smithi087.stdout:inline_data enabled 2024-09-17T07:26:49.542 INFO:teuthology.orchestra.run.smithi087.stdout:balancer 2024-09-17T07:26:49.542 INFO:teuthology.orchestra.run.smithi087.stdout:bal_rank_mask -1 2024-09-17T07:26:49.542 INFO:teuthology.orchestra.run.smithi087.stdout:standby_count_wanted 1 2024-09-17T07:26:49.542 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi087.tjhpcs{0:14478} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.87:6828/2255237099,v1:172.21.15.87:6829/2255237099] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:26:49.542 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:26:49.543 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:26:49.543 INFO:teuthology.orchestra.run.smithi087.stdout:Standby daemons: 2024-09-17T07:26:49.543 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:26:49.543 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi087.vvbzss{-1:34412} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.87:6826/1050918039,v1:172.21.15.87:6827/1050918039] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:26:49.543 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi139.ftvinf{-1:44261} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.139:6826/641133838,v1:172.21.15.139:6827/641133838] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:26:49.543 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi139.gnwonz{-1:44289} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.139:6824/1004017136,v1:172.21.15.139:6825/1004017136] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:26:49.544 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 30 2024-09-17T07:26:49.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.540+0000 7f6288e35640 1 -- 172.21.15.87:0/3018258411 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f626c06cb90 msgr2=0x7f626c06f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:26:49.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.540+0000 7f6288e35640 1 --2- 172.21.15.87:0/3018258411 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f626c06cb90 0x7f626c06f040 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6274009ac0 tx=0x7f6274035040 comp rx=0 tx=0).stop 2024-09-17T07:26:49.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.540+0000 7f6288e35640 1 -- 172.21.15.87:0/3018258411 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62840fb2c0 msgr2=0x7f62840fb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:26:49.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.540+0000 7f6288e35640 1 --2- 172.21.15.87:0/3018258411 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62840fb2c0 0x7f62840fb970 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f627800b580 tx=0x7f62780091a0 comp rx=0 tx=0).stop 2024-09-17T07:26:49.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.540+0000 7f6288e35640 1 -- 172.21.15.87:0/3018258411 shutdown_connections 2024-09-17T07:26:49.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.540+0000 7f6288e35640 1 --2- 172.21.15.87:0/3018258411 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62840fb2c0 0x7f62840fb970 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:49.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.540+0000 7f6288e35640 1 --2- 172.21.15.87:0/3018258411 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f626c06cb90 0x7f626c06f040 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:49.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.540+0000 7f6288e35640 1 --2- 172.21.15.87:0/3018258411 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f62840fa970 0x7f62840fd480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:49.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.540+0000 7f6288e35640 1 -- 172.21.15.87:0/3018258411 >> 172.21.15.87:0/3018258411 conn(0x7f62840f63b0 msgr2=0x7f62840f7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:26:49.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.540+0000 7f6288e35640 1 -- 172.21.15.87:0/3018258411 shutdown_connections 2024-09-17T07:26:49.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.540+0000 7f6288e35640 1 -- 172.21.15.87:0/3018258411 wait complete. 2024-09-17T07:26:49.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:49 smithi139 ceph-mon[79872]: Upgrade: Updating mds.cephfs.smithi087.tjhpcs 2024-09-17T07:26:49.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:49 smithi139 ceph-mon[79872]: Deploying daemon mds.cephfs.smithi087.tjhpcs on smithi087 2024-09-17T07:26:49.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:49 smithi139 ceph-mon[79872]: pgmap v180: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail 2024-09-17T07:26:49.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.621+0000 7f214f18b640 1 -- 172.21.15.87:0/1257696115 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f21480fb450 msgr2=0x7f21480fb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:26:49.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.621+0000 7f214f18b640 1 --2- 172.21.15.87:0/1257696115 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f21480fb450 0x7f21480fb860 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f21400048d0 tx=0x7f2140009da0 comp rx=0 tx=0).stop 2024-09-17T07:26:49.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.621+0000 7f214f18b640 1 -- 172.21.15.87:0/1257696115 shutdown_connections 2024-09-17T07:26:49.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.621+0000 7f214f18b640 1 --2- 172.21.15.87:0/1257696115 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f21480fc720 0x7f21480fcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:49.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.621+0000 7f214f18b640 1 --2- 172.21.15.87:0/1257696115 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f21480fb450 0x7f21480fb860 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:49.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.621+0000 7f214f18b640 1 -- 172.21.15.87:0/1257696115 >> 172.21.15.87:0/1257696115 conn(0x7f21480f6c10 msgr2=0x7f21480f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:26:49.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.621+0000 7f214f18b640 1 -- 172.21.15.87:0/1257696115 shutdown_connections 2024-09-17T07:26:49.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.621+0000 7f214f18b640 1 -- 172.21.15.87:0/1257696115 wait complete. 2024-09-17T07:26:49.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.621+0000 7f214f18b640 1 Processor -- start 2024-09-17T07:26:49.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.622+0000 7f214f18b640 1 -- start start 2024-09-17T07:26:49.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.622+0000 7f214f18b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f21480fb450 0x7f214810bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:26:49.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.622+0000 7f214f18b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f21480fc720 0x7f214810c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:26:49.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.622+0000 7f214f18b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f214810ca60 con 0x7f21480fc720 2024-09-17T07:26:49.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.622+0000 7f214f18b640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f214810d280 con 0x7f21480fb450 2024-09-17T07:26:49.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.622+0000 7f2147fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f21480fc720 0x7f214810c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:26:49.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.622+0000 7f2147fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f21480fc720 0x7f214810c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52654/0 (socket says 172.21.15.87:52654) 2024-09-17T07:26:49.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.622+0000 7f2147fff640 1 -- 172.21.15.87:0/4050923008 learned_addr learned my addr 172.21.15.87:0/4050923008 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:26:49.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.622+0000 7f214cf27640 1 --2- 172.21.15.87:0/4050923008 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f21480fb450 0x7f214810bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:26:49.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.622+0000 7f2147fff640 1 -- 172.21.15.87:0/4050923008 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f21480fb450 msgr2=0x7f214810bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:26:49.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.622+0000 7f2147fff640 1 --2- 172.21.15.87:0/4050923008 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f21480fb450 0x7f214810bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:49.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.622+0000 7f2147fff640 1 -- 172.21.15.87:0/4050923008 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2140005040 con 0x7f21480fc720 2024-09-17T07:26:49.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.623+0000 7f2147fff640 1 --2- 172.21.15.87:0/4050923008 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f21480fc720 0x7f214810c410 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f213800db50 tx=0x7f2138004ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:26:49.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.623+0000 7f21457fa640 1 -- 172.21.15.87:0/4050923008 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f213800b950 con 0x7f21480fc720 2024-09-17T07:26:49.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.623+0000 7f214f18b640 1 -- 172.21.15.87:0/4050923008 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f214810d510 con 0x7f21480fc720 2024-09-17T07:26:49.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.623+0000 7f21457fa640 1 -- 172.21.15.87:0/4050923008 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f213800f040 con 0x7f21480fc720 2024-09-17T07:26:49.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.623+0000 7f21457fa640 1 -- 172.21.15.87:0/4050923008 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2138012390 con 0x7f21480fc720 2024-09-17T07:26:49.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.623+0000 7f214f18b640 1 -- 172.21.15.87:0/4050923008 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f214810dab0 con 0x7f21480fc720 2024-09-17T07:26:49.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.624+0000 7f214f18b640 1 -- 172.21.15.87:0/4050923008 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21480fa8b0 con 0x7f21480fc720 2024-09-17T07:26:49.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.624+0000 7f21457fa640 1 -- 172.21.15.87:0/4050923008 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f213800bab0 con 0x7f21480fc720 2024-09-17T07:26:49.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.625+0000 7f21457fa640 1 --2- 172.21.15.87:0/4050923008 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f213406cb90 0x7f213406f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:26:49.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.625+0000 7f214cf27640 1 --2- 172.21.15.87:0/4050923008 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f213406cb90 0x7f213406f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:26:49.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.625+0000 7f21457fa640 1 -- 172.21.15.87:0/4050923008 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f213808c450 con 0x7f21480fc720 2024-09-17T07:26:49.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.625+0000 7f214cf27640 1 --2- 172.21.15.87:0/4050923008 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f213406cb90 0x7f213406f040 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2140000c00 tx=0x7f2140035040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:26:49.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.629+0000 7f21457fa640 1 -- 172.21.15.87:0/4050923008 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2138056460 con 0x7f21480fc720 2024-09-17T07:26:49.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.822+0000 7f214f18b640 1 -- 172.21.15.87:0/4050923008 --> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f214810de40 con 0x7f213406cb90 2024-09-17T07:26:49.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.823+0000 7f21457fa640 1 -- 172.21.15.87:0/4050923008 <== mgr.24529 v2:172.21.15.87:6800/1359413180 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f214810de40 con 0x7f213406cb90 2024-09-17T07:26:49.825 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T07:26:49.825 INFO:teuthology.orchestra.run.smithi087.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9", 2024-09-17T07:26:49.825 INFO:teuthology.orchestra.run.smithi087.stdout: "in_progress": true, 2024-09-17T07:26:49.825 INFO:teuthology.orchestra.run.smithi087.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T07:26:49.825 INFO:teuthology.orchestra.run.smithi087.stdout: "services_complete": [ 2024-09-17T07:26:49.825 INFO:teuthology.orchestra.run.smithi087.stdout: "crash", 2024-09-17T07:26:49.825 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr", 2024-09-17T07:26:49.825 INFO:teuthology.orchestra.run.smithi087.stdout: "mon", 2024-09-17T07:26:49.825 INFO:teuthology.orchestra.run.smithi087.stdout: "osd" 2024-09-17T07:26:49.825 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-17T07:26:49.825 INFO:teuthology.orchestra.run.smithi087.stdout: "progress": "13/21 daemons upgraded", 2024-09-17T07:26:49.825 INFO:teuthology.orchestra.run.smithi087.stdout: "message": "Currently upgrading mds daemons", 2024-09-17T07:26:49.826 INFO:teuthology.orchestra.run.smithi087.stdout: "is_paused": false 2024-09-17T07:26:49.826 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T07:26:49.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.826+0000 7f214f18b640 1 -- 172.21.15.87:0/4050923008 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f213406cb90 msgr2=0x7f213406f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:26:49.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.826+0000 7f214f18b640 1 --2- 172.21.15.87:0/4050923008 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f213406cb90 0x7f213406f040 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2140000c00 tx=0x7f2140035040 comp rx=0 tx=0).stop 2024-09-17T07:26:49.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.826+0000 7f214f18b640 1 -- 172.21.15.87:0/4050923008 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f21480fc720 msgr2=0x7f214810c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:26:49.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.826+0000 7f214f18b640 1 --2- 172.21.15.87:0/4050923008 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f21480fc720 0x7f214810c410 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f213800db50 tx=0x7f2138004ee0 comp rx=0 tx=0).stop 2024-09-17T07:26:49.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.826+0000 7f214f18b640 1 -- 172.21.15.87:0/4050923008 shutdown_connections 2024-09-17T07:26:49.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.826+0000 7f214f18b640 1 --2- 172.21.15.87:0/4050923008 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f21480fc720 0x7f214810c410 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:49.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.826+0000 7f214f18b640 1 --2- 172.21.15.87:0/4050923008 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f213406cb90 0x7f213406f040 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:49.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.826+0000 7f214f18b640 1 --2- 172.21.15.87:0/4050923008 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f21480fb450 0x7f214810bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:49.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.826+0000 7f214f18b640 1 -- 172.21.15.87:0/4050923008 >> 172.21.15.87:0/4050923008 conn(0x7f21480f6c10 msgr2=0x7f21480ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:26:49.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.826+0000 7f214f18b640 1 -- 172.21.15.87:0/4050923008 shutdown_connections 2024-09-17T07:26:49.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.826+0000 7f214f18b640 1 -- 172.21.15.87:0/4050923008 wait complete. 2024-09-17T07:26:49.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.908+0000 7fa01ce9e640 1 -- 172.21.15.87:0/3134233918 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa018065be0 msgr2=0x7fa0180ff1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:26:49.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.908+0000 7fa01ce9e640 1 --2- 172.21.15.87:0/3134233918 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa018065be0 0x7fa0180ff1a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa0080048d0 tx=0x7fa008009da0 comp rx=0 tx=0).stop 2024-09-17T07:26:49.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.908+0000 7fa01ce9e640 1 -- 172.21.15.87:0/3134233918 shutdown_connections 2024-09-17T07:26:49.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.908+0000 7fa01ce9e640 1 --2- 172.21.15.87:0/3134233918 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0180ff6e0 0x7fa018101ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:49.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.908+0000 7fa01ce9e640 1 --2- 172.21.15.87:0/3134233918 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa018065be0 0x7fa0180ff1a0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:49.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.908+0000 7fa01ce9e640 1 -- 172.21.15.87:0/3134233918 >> 172.21.15.87:0/3134233918 conn(0x7fa0180f6c10 msgr2=0x7fa0180f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:26:49.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.908+0000 7fa01ce9e640 1 -- 172.21.15.87:0/3134233918 shutdown_connections 2024-09-17T07:26:49.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.908+0000 7fa01ce9e640 1 -- 172.21.15.87:0/3134233918 wait complete. 2024-09-17T07:26:49.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.908+0000 7fa01ce9e640 1 Processor -- start 2024-09-17T07:26:49.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.909+0000 7fa01ce9e640 1 -- start start 2024-09-17T07:26:49.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.909+0000 7fa01ce9e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa018065be0 0x7fa01810d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:26:49.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.909+0000 7fa01ce9e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa0180ff6e0 0x7fa01810d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:26:49.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.909+0000 7fa01ce9e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa01810db90 con 0x7fa018065be0 2024-09-17T07:26:49.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.909+0000 7fa01ce9e640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa01810e3b0 con 0x7fa0180ff6e0 2024-09-17T07:26:49.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.909+0000 7fa01659c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa018065be0 0x7fa01810d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:26:49.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.909+0000 7fa01659c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa018065be0 0x7fa01810d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52682/0 (socket says 172.21.15.87:52682) 2024-09-17T07:26:49.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.909+0000 7fa01659c640 1 -- 172.21.15.87:0/763014248 learned_addr learned my addr 172.21.15.87:0/763014248 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:26:49.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.909+0000 7fa015d9b640 1 --2- 172.21.15.87:0/763014248 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa0180ff6e0 0x7fa01810d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:26:49.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.909+0000 7fa01659c640 1 -- 172.21.15.87:0/763014248 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa0180ff6e0 msgr2=0x7fa01810d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:26:49.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.909+0000 7fa01659c640 1 --2- 172.21.15.87:0/763014248 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa0180ff6e0 0x7fa01810d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:49.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.909+0000 7fa01659c640 1 -- 172.21.15.87:0/763014248 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa008005040 con 0x7fa018065be0 2024-09-17T07:26:49.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.909+0000 7fa01659c640 1 --2- 172.21.15.87:0/763014248 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa018065be0 0x7fa01810d000 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa008000c00 tx=0x7fa008009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:26:49.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.910+0000 7fa006ffd640 1 -- 172.21.15.87:0/763014248 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa008038070 con 0x7fa018065be0 2024-09-17T07:26:49.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.910+0000 7fa006ffd640 1 -- 172.21.15.87:0/763014248 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fa008004290 con 0x7fa018065be0 2024-09-17T07:26:49.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.910+0000 7fa01ce9e640 1 -- 172.21.15.87:0/763014248 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa01810e5e0 con 0x7fa018065be0 2024-09-17T07:26:49.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.910+0000 7fa01ce9e640 1 -- 172.21.15.87:0/763014248 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa01810eb20 con 0x7fa018065be0 2024-09-17T07:26:49.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.910+0000 7fa006ffd640 1 -- 172.21.15.87:0/763014248 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa00803c650 con 0x7fa018065be0 2024-09-17T07:26:49.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.911+0000 7fa01ce9e640 1 -- 172.21.15.87:0/763014248 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0180fa890 con 0x7fa018065be0 2024-09-17T07:26:49.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.912+0000 7fa006ffd640 1 -- 172.21.15.87:0/763014248 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fa008030020 con 0x7fa018065be0 2024-09-17T07:26:49.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.912+0000 7fa006ffd640 1 --2- 172.21.15.87:0/763014248 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fa00006cb90 0x7fa00006f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:26:49.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.912+0000 7fa006ffd640 1 -- 172.21.15.87:0/763014248 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fa0080abee0 con 0x7fa018065be0 2024-09-17T07:26:49.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.912+0000 7fa015d9b640 1 --2- 172.21.15.87:0/763014248 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fa00006cb90 0x7fa00006f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:26:49.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.913+0000 7fa015d9b640 1 --2- 172.21.15.87:0/763014248 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fa00006cb90 0x7fa00006f040 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa01810cdb0 tx=0x7fa00c00b040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:26:49.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:49.917+0000 7fa006ffd640 1 -- 172.21.15.87:0/763014248 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa008075fa0 con 0x7fa018065be0 2024-09-17T07:26:50.176 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:50.175+0000 7fa01ce9e640 1 -- 172.21.15.87:0/763014248 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fa01810ee80 con 0x7fa018065be0 2024-09-17T07:26:50.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:50.178+0000 7fa006ffd640 1 -- 172.21.15.87:0/763014248 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fa0080795c0 con 0x7fa018065be0 2024-09-17T07:26:50.179 INFO:teuthology.orchestra.run.smithi087.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T07:26:50.179 INFO:teuthology.orchestra.run.smithi087.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T07:26:50.179 INFO:teuthology.orchestra.run.smithi087.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T07:26:50.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:50.180+0000 7fa01ce9e640 1 -- 172.21.15.87:0/763014248 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fa00006cb90 msgr2=0x7fa00006f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:26:50.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:50.180+0000 7fa01ce9e640 1 --2- 172.21.15.87:0/763014248 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fa00006cb90 0x7fa00006f040 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa01810cdb0 tx=0x7fa00c00b040 comp rx=0 tx=0).stop 2024-09-17T07:26:50.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:50.180+0000 7fa01ce9e640 1 -- 172.21.15.87:0/763014248 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa018065be0 msgr2=0x7fa01810d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:26:50.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:50.180+0000 7fa01ce9e640 1 --2- 172.21.15.87:0/763014248 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa018065be0 0x7fa01810d000 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa008000c00 tx=0x7fa008009da0 comp rx=0 tx=0).stop 2024-09-17T07:26:50.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:50.180+0000 7fa01ce9e640 1 -- 172.21.15.87:0/763014248 shutdown_connections 2024-09-17T07:26:50.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:50.180+0000 7fa01ce9e640 1 --2- 172.21.15.87:0/763014248 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fa00006cb90 0x7fa00006f040 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:50.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:50.180+0000 7fa01ce9e640 1 --2- 172.21.15.87:0/763014248 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa0180ff6e0 0x7fa01810d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:50.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:50.180+0000 7fa01ce9e640 1 --2- 172.21.15.87:0/763014248 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa018065be0 0x7fa01810d000 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:26:50.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:50.180+0000 7fa01ce9e640 1 -- 172.21.15.87:0/763014248 >> 172.21.15.87:0/763014248 conn(0x7fa0180f6c10 msgr2=0x7fa0180f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:26:50.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:50.180+0000 7fa01ce9e640 1 -- 172.21.15.87:0/763014248 shutdown_connections 2024-09-17T07:26:50.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:26:50.181+0000 7fa01ce9e640 1 -- 172.21.15.87:0/763014248 wait complete. 2024-09-17T07:26:50.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:50 smithi139 ceph-mon[79872]: from='client.34416 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:26:50.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:50 smithi139 ceph-mon[79872]: from='client.34420 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:26:50.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:50 smithi139 ceph-mon[79872]: from='client.34424 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:26:50.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:50 smithi139 ceph-mon[79872]: from='client.? 172.21.15.87:0/2370457657' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:26:50.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:50 smithi139 ceph-mon[79872]: from='client.? 172.21.15.87:0/3018258411' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T07:26:50.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:50 smithi087 ceph-mon[90982]: from='client.34416 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:26:50.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:50 smithi087 ceph-mon[90982]: from='client.34420 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:26:50.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:50 smithi087 ceph-mon[90982]: from='client.34424 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:26:50.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:50 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/2370457657' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:26:50.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:50 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/3018258411' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T07:26:50.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:50 smithi087 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-mon-smithi087[90978]: 2024-09-17T07:26:50.197+0000 7fe8b898e640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T07:26:51.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:51 smithi139 ceph-mon[79872]: from='client.34436 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:26:51.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:51 smithi139 ceph-mon[79872]: pgmap v181: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail 2024-09-17T07:26:51.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:51 smithi139 ceph-mon[79872]: from='client.? 172.21.15.87:0/763014248' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T07:26:51.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:51 smithi139 ceph-mon[79872]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-17T07:26:51.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:51 smithi139 ceph-mon[79872]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T07:26:51.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:51 smithi139 ceph-mon[79872]: osdmap e80: 6 total, 6 up, 6 in 2024-09-17T07:26:51.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:51 smithi139 ceph-mon[79872]: Standby daemon mds.cephfs.smithi087.vvbzss assigned to filesystem cephfs as rank 0 2024-09-17T07:26:51.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:51 smithi139 ceph-mon[79872]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-17T07:26:51.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:51 smithi139 ceph-mon[79872]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-17T07:26:51.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:51 smithi139 ceph-mon[79872]: fsmap cephfs:1/1 {0=cephfs.smithi087.vvbzss=up:replay} 2 up:standby 2024-09-17T07:26:51.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:51 smithi087 ceph-mon[90982]: from='client.34436 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:26:51.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:51 smithi087 ceph-mon[90982]: pgmap v181: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail 2024-09-17T07:26:51.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:51 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/763014248' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T07:26:51.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:51 smithi087 ceph-mon[90982]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-17T07:26:51.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:51 smithi087 ceph-mon[90982]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T07:26:51.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:51 smithi087 ceph-mon[90982]: osdmap e80: 6 total, 6 up, 6 in 2024-09-17T07:26:51.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:51 smithi087 ceph-mon[90982]: Standby daemon mds.cephfs.smithi087.vvbzss assigned to filesystem cephfs as rank 0 2024-09-17T07:26:51.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:51 smithi087 ceph-mon[90982]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-17T07:26:51.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:51 smithi087 ceph-mon[90982]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-17T07:26:51.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:51 smithi087 ceph-mon[90982]: fsmap cephfs:1/1 {0=cephfs.smithi087.vvbzss=up:replay} 2 up:standby 2024-09-17T07:26:53.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:53 smithi139 ceph-mon[79872]: pgmap v183: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 410 KiB/s rd, 0 op/s 2024-09-17T07:26:53.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:53 smithi087 ceph-mon[90982]: pgmap v183: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 410 KiB/s rd, 0 op/s 2024-09-17T07:26:55.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:55 smithi139 ceph-mon[79872]: pgmap v184: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 3 op/s 2024-09-17T07:26:55.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:55 smithi087 ceph-mon[90982]: pgmap v184: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 3 op/s 2024-09-17T07:26:57.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:57 smithi139 ceph-mon[79872]: pgmap v185: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-09-17T07:26:57.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:57 smithi139 ceph-mon[79872]: reconnect by client.14530 192.168.0.1:0/1271707203 after 0 2024-09-17T07:26:57.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:57 smithi139 ceph-mon[79872]: reconnect by client.24283 192.168.0.1:0/2059462198 after 0.000999976 2024-09-17T07:26:57.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:57 smithi139 ceph-mon[79872]: mds.? [v2:172.21.15.87:6826/1050918039,v1:172.21.15.87:6827/1050918039] up:reconnect 2024-09-17T07:26:57.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:57 smithi139 ceph-mon[79872]: fsmap cephfs:1/1 {0=cephfs.smithi087.vvbzss=up:reconnect} 2 up:standby 2024-09-17T07:26:57.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:57 smithi087 ceph-mon[90982]: pgmap v185: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-09-17T07:26:57.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:57 smithi087 ceph-mon[90982]: reconnect by client.14530 192.168.0.1:0/1271707203 after 0 2024-09-17T07:26:57.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:57 smithi087 ceph-mon[90982]: reconnect by client.24283 192.168.0.1:0/2059462198 after 0.000999976 2024-09-17T07:26:57.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:57 smithi087 ceph-mon[90982]: mds.? [v2:172.21.15.87:6826/1050918039,v1:172.21.15.87:6827/1050918039] up:reconnect 2024-09-17T07:26:57.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:57 smithi087 ceph-mon[90982]: fsmap cephfs:1/1 {0=cephfs.smithi087.vvbzss=up:reconnect} 2 up:standby 2024-09-17T07:26:58.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:58 smithi139 ceph-mon[79872]: mds.? [v2:172.21.15.87:6826/1050918039,v1:172.21.15.87:6827/1050918039] up:rejoin 2024-09-17T07:26:58.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:58 smithi139 ceph-mon[79872]: fsmap cephfs:1/1 {0=cephfs.smithi087.vvbzss=up:rejoin} 2 up:standby 2024-09-17T07:26:58.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:58 smithi139 ceph-mon[79872]: daemon mds.cephfs.smithi087.vvbzss is now active in filesystem cephfs as rank 0 2024-09-17T07:26:58.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:58 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:26:58.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:58 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:26:58.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:58 smithi087 ceph-mon[90982]: mds.? [v2:172.21.15.87:6826/1050918039,v1:172.21.15.87:6827/1050918039] up:rejoin 2024-09-17T07:26:58.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:58 smithi087 ceph-mon[90982]: fsmap cephfs:1/1 {0=cephfs.smithi087.vvbzss=up:rejoin} 2 up:standby 2024-09-17T07:26:58.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:58 smithi087 ceph-mon[90982]: daemon mds.cephfs.smithi087.vvbzss is now active in filesystem cephfs as rank 0 2024-09-17T07:26:58.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:58 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:26:58.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:58 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:26:59.508 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:59 smithi087 ceph-mon[90982]: pgmap v186: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-09-17T07:26:59.509 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:59 smithi087 ceph-mon[90982]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-17T07:26:59.509 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:59 smithi087 ceph-mon[90982]: mds.? [v2:172.21.15.87:6826/1050918039,v1:172.21.15.87:6827/1050918039] up:active 2024-09-17T07:26:59.509 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:26:59 smithi087 ceph-mon[90982]: fsmap cephfs:1 {0=cephfs.smithi087.vvbzss=up:active} 2 up:standby 2024-09-17T07:26:59.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:59 smithi139 ceph-mon[79872]: pgmap v186: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-09-17T07:26:59.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:59 smithi139 ceph-mon[79872]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-17T07:26:59.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:59 smithi139 ceph-mon[79872]: mds.? [v2:172.21.15.87:6826/1050918039,v1:172.21.15.87:6827/1050918039] up:active 2024-09-17T07:26:59.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:26:59 smithi139 ceph-mon[79872]: fsmap cephfs:1 {0=cephfs.smithi087.vvbzss=up:active} 2 up:standby 2024-09-17T07:27:01.478 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:01 smithi087 ceph-mon[90982]: pgmap v187: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 204 B/s wr, 7 op/s 2024-09-17T07:27:01.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:01 smithi139 ceph-mon[79872]: pgmap v187: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 204 B/s wr, 7 op/s 2024-09-17T07:27:02.592 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:02 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:02.592 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:02 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:02.592 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:02 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:27:02.592 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:02 smithi087 ceph-mon[90982]: pgmap v188: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 257 B/s wr, 8 op/s 2024-09-17T07:27:02.593 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:02 smithi087 ceph-mon[90982]: mds.? [v2:172.21.15.87:6828/2375971201,v1:172.21.15.87:6829/2375971201] up:boot 2024-09-17T07:27:02.593 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:02 smithi087 ceph-mon[90982]: fsmap cephfs:1 {0=cephfs.smithi087.vvbzss=up:active} 3 up:standby 2024-09-17T07:27:02.593 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:02 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi087.tjhpcs"}]: dispatch 2024-09-17T07:27:02.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:02 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:02.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:02 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:02.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:02 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:27:02.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:02 smithi139 ceph-mon[79872]: pgmap v188: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 257 B/s wr, 8 op/s 2024-09-17T07:27:02.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:02 smithi139 ceph-mon[79872]: mds.? [v2:172.21.15.87:6828/2375971201,v1:172.21.15.87:6829/2375971201] up:boot 2024-09-17T07:27:02.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:02 smithi139 ceph-mon[79872]: fsmap cephfs:1 {0=cephfs.smithi087.vvbzss=up:active} 3 up:standby 2024-09-17T07:27:02.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:02 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi087.tjhpcs"}]: dispatch 2024-09-17T07:27:05.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:05 smithi087 ceph-mon[90982]: pgmap v189: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 4.7 KiB/s wr, 10 op/s 2024-09-17T07:27:05.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:05 smithi139 ceph-mon[79872]: pgmap v189: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 4.7 KiB/s wr, 10 op/s 2024-09-17T07:27:06.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:06 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:06.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:06 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:06.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:06 smithi087 ceph-mon[90982]: pgmap v190: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 6.0 MiB/s rd, 4.7 KiB/s wr, 7 op/s 2024-09-17T07:27:06.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:06 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:06.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:06 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:07.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:06 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:07.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:06 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:07.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:06 smithi139 ceph-mon[79872]: pgmap v190: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 6.0 MiB/s rd, 4.7 KiB/s wr, 7 op/s 2024-09-17T07:27:07.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:06 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:07.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:06 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:09.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:09 smithi087 ceph-mon[90982]: pgmap v191: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 4.7 KiB/s wr, 6 op/s 2024-09-17T07:27:09.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:09 smithi139 ceph-mon[79872]: pgmap v191: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 4.7 KiB/s wr, 6 op/s 2024-09-17T07:27:11.554 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:11 smithi087 ceph-mon[90982]: pgmap v192: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 339 KiB/s rd, 4.7 KiB/s wr, 5 op/s 2024-09-17T07:27:11.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:11 smithi139 ceph-mon[79872]: pgmap v192: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 339 KiB/s rd, 4.7 KiB/s wr, 5 op/s 2024-09-17T07:27:13.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:12 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:13.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:12 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:13.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:12 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:27:13.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:12 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:27:13.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:12 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:13.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:12 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:27:13.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:12 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:27:13.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:12 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:27:13.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:12 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:27:13.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:12 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:27:13.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:12 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi139.gnwonz"]}]: dispatch 2024-09-17T07:27:13.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:12 smithi087 ceph-mon[90982]: Upgrade: It appears safe to stop mds.cephfs.smithi139.gnwonz 2024-09-17T07:27:13.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:12 smithi087 ceph-mon[90982]: pgmap v193: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 4.6 KiB/s wr, 4 op/s 2024-09-17T07:27:13.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:12 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:13.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:12 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:13.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:12 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:27:13.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:12 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:27:13.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:12 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:13.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:12 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:27:13.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:12 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:27:13.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:12 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:27:13.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:12 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:27:13.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:12 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:27:13.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:12 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi139.gnwonz"]}]: dispatch 2024-09-17T07:27:13.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:12 smithi139 ceph-mon[79872]: Upgrade: It appears safe to stop mds.cephfs.smithi139.gnwonz 2024-09-17T07:27:13.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:12 smithi139 ceph-mon[79872]: pgmap v193: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 4.6 KiB/s wr, 4 op/s 2024-09-17T07:27:14.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:14 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:14.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:14 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:27:14.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:14 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:14.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:14 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi139.gnwonz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T07:27:14.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:14 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:27:14.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:14 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:14.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:14 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:27:14.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:14 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:14.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:14 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi139.gnwonz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T07:27:14.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:14 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:27:15.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:15 smithi139 ceph-mon[79872]: Upgrade: Updating mds.cephfs.smithi139.gnwonz 2024-09-17T07:27:15.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:15 smithi139 ceph-mon[79872]: Deploying daemon mds.cephfs.smithi139.gnwonz on smithi139 2024-09-17T07:27:15.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:15 smithi139 ceph-mon[79872]: pgmap v194: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 255 B/s rd, 4.5 KiB/s wr, 2 op/s 2024-09-17T07:27:15.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:15 smithi087 ceph-mon[90982]: Upgrade: Updating mds.cephfs.smithi139.gnwonz 2024-09-17T07:27:15.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:15 smithi087 ceph-mon[90982]: Deploying daemon mds.cephfs.smithi139.gnwonz on smithi139 2024-09-17T07:27:15.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:15 smithi087 ceph-mon[90982]: pgmap v194: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 255 B/s rd, 4.5 KiB/s wr, 2 op/s 2024-09-17T07:27:16.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:16 smithi139 ceph-mon[79872]: osdmap e81: 6 total, 6 up, 6 in 2024-09-17T07:27:16.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:16 smithi139 ceph-mon[79872]: fsmap cephfs:1 {0=cephfs.smithi087.vvbzss=up:active} 2 up:standby 2024-09-17T07:27:16.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:16 smithi139 ceph-mon[79872]: pgmap v196: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2024-09-17T07:27:16.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:16 smithi087 ceph-mon[90982]: osdmap e81: 6 total, 6 up, 6 in 2024-09-17T07:27:16.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:16 smithi087 ceph-mon[90982]: fsmap cephfs:1 {0=cephfs.smithi087.vvbzss=up:active} 2 up:standby 2024-09-17T07:27:16.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:16 smithi087 ceph-mon[90982]: pgmap v196: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2024-09-17T07:27:19.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:19 smithi139 ceph-mon[79872]: pgmap v197: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail 2024-09-17T07:27:19.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:19 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi139.gnwonz"}]: dispatch 2024-09-17T07:27:19.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:19 smithi087 ceph-mon[90982]: pgmap v197: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail 2024-09-17T07:27:19.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:19 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi139.gnwonz"}]: dispatch 2024-09-17T07:27:20.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.275+0000 7f435e26c640 1 -- 172.21.15.87:0/681639551 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43580fc550 msgr2=0x7f43580fc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:27:20.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.275+0000 7f435e26c640 1 --2- 172.21.15.87:0/681639551 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43580fc550 0x7f43580fc960 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f43480048d0 tx=0x7f4348009da0 comp rx=0 tx=0).stop 2024-09-17T07:27:20.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.275+0000 7f435e26c640 1 -- 172.21.15.87:0/681639551 shutdown_connections 2024-09-17T07:27:20.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.275+0000 7f435e26c640 1 --2- 172.21.15.87:0/681639551 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f43580fd820 0x7f43580fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:20.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.275+0000 7f435e26c640 1 --2- 172.21.15.87:0/681639551 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43580fc550 0x7f43580fc960 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:20.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.275+0000 7f435e26c640 1 -- 172.21.15.87:0/681639551 >> 172.21.15.87:0/681639551 conn(0x7f43580f7d30 msgr2=0x7f43580fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:27:20.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.275+0000 7f435e26c640 1 -- 172.21.15.87:0/681639551 shutdown_connections 2024-09-17T07:27:20.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.275+0000 7f435e26c640 1 -- 172.21.15.87:0/681639551 wait complete. 2024-09-17T07:27:20.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.275+0000 7f435e26c640 1 Processor -- start 2024-09-17T07:27:20.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.276+0000 7f435e26c640 1 -- start start 2024-09-17T07:27:20.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.276+0000 7f435e26c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f43580fc550 0x7f435810cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:27:20.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.276+0000 7f435e26c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43580fd820 0x7f435810d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:27:20.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.276+0000 7f435e26c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f435810db50 con 0x7f43580fd820 2024-09-17T07:27:20.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.276+0000 7f435e26c640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f435810e370 con 0x7f43580fc550 2024-09-17T07:27:20.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.276+0000 7f43577fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43580fd820 0x7f435810d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:27:20.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.276+0000 7f43577fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43580fd820 0x7f435810d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46216/0 (socket says 172.21.15.87:46216) 2024-09-17T07:27:20.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.276+0000 7f43577fe640 1 -- 172.21.15.87:0/1618740717 learned_addr learned my addr 172.21.15.87:0/1618740717 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:27:20.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.276+0000 7f4357fff640 1 --2- 172.21.15.87:0/1618740717 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f43580fc550 0x7f435810cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:27:20.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.276+0000 7f43577fe640 1 -- 172.21.15.87:0/1618740717 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f43580fc550 msgr2=0x7f435810cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:27:20.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.276+0000 7f43577fe640 1 --2- 172.21.15.87:0/1618740717 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f43580fc550 0x7f435810cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:20.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.276+0000 7f43577fe640 1 -- 172.21.15.87:0/1618740717 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4348005040 con 0x7f43580fd820 2024-09-17T07:27:20.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.276+0000 7f4357fff640 1 --2- 172.21.15.87:0/1618740717 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f43580fc550 0x7f435810cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T07:27:20.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.277+0000 7f43577fe640 1 --2- 172.21.15.87:0/1618740717 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43580fd820 0x7f435810d500 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f434c00eb70 tx=0x7f434c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:27:20.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.277+0000 7f4354ff9640 1 -- 172.21.15.87:0/1618740717 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f434c007c30 con 0x7f43580fd820 2024-09-17T07:27:20.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.277+0000 7f4354ff9640 1 -- 172.21.15.87:0/1618740717 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f434c00f040 con 0x7f43580fd820 2024-09-17T07:27:20.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.277+0000 7f435e26c640 1 -- 172.21.15.87:0/1618740717 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f435810e5a0 con 0x7f43580fd820 2024-09-17T07:27:20.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.277+0000 7f4354ff9640 1 -- 172.21.15.87:0/1618740717 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f434c009430 con 0x7f43580fd820 2024-09-17T07:27:20.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.277+0000 7f435e26c640 1 -- 172.21.15.87:0/1618740717 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f435810eb40 con 0x7f43580fd820 2024-09-17T07:27:20.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.278+0000 7f435e26c640 1 -- 172.21.15.87:0/1618740717 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43580fb9b0 con 0x7f43580fd820 2024-09-17T07:27:20.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.279+0000 7f4354ff9640 1 -- 172.21.15.87:0/1618740717 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f434c009670 con 0x7f43580fd820 2024-09-17T07:27:20.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.279+0000 7f4354ff9640 1 --2- 172.21.15.87:0/1618740717 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f434006cb90 0x7f434006f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:27:20.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.279+0000 7f4354ff9640 1 -- 172.21.15.87:0/1618740717 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f434c08bea0 con 0x7f43580fd820 2024-09-17T07:27:20.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.279+0000 7f4357fff640 1 --2- 172.21.15.87:0/1618740717 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f434006cb90 0x7f434006f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:27:20.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.280+0000 7f4357fff640 1 --2- 172.21.15.87:0/1618740717 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f434006cb90 0x7f434006f040 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f434800b020 tx=0x7f4348035040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:27:20.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.284+0000 7f4354ff9640 1 -- 172.21.15.87:0/1618740717 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f434c055e60 con 0x7f43580fd820 2024-09-17T07:27:20.466 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.465+0000 7f435e26c640 1 -- 172.21.15.87:0/1618740717 --> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f435810ee20 con 0x7f434006cb90 2024-09-17T07:27:20.467 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.466+0000 7f4354ff9640 1 -- 172.21.15.87:0/1618740717 <== mgr.24529 v2:172.21.15.87:6800/1359413180 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f435810ee20 con 0x7f434006cb90 2024-09-17T07:27:20.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.469+0000 7f435e26c640 1 -- 172.21.15.87:0/1618740717 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f434006cb90 msgr2=0x7f434006f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:27:20.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.469+0000 7f435e26c640 1 --2- 172.21.15.87:0/1618740717 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f434006cb90 0x7f434006f040 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f434800b020 tx=0x7f4348035040 comp rx=0 tx=0).stop 2024-09-17T07:27:20.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.469+0000 7f435e26c640 1 -- 172.21.15.87:0/1618740717 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43580fd820 msgr2=0x7f435810d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:27:20.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.469+0000 7f435e26c640 1 --2- 172.21.15.87:0/1618740717 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43580fd820 0x7f435810d500 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f434c00eb70 tx=0x7f434c00b040 comp rx=0 tx=0).stop 2024-09-17T07:27:20.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.469+0000 7f435e26c640 1 -- 172.21.15.87:0/1618740717 shutdown_connections 2024-09-17T07:27:20.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.469+0000 7f435e26c640 1 --2- 172.21.15.87:0/1618740717 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43580fd820 0x7f435810d500 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:20.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.469+0000 7f435e26c640 1 --2- 172.21.15.87:0/1618740717 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f434006cb90 0x7f434006f040 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:20.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.469+0000 7f435e26c640 1 --2- 172.21.15.87:0/1618740717 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f43580fc550 0x7f435810cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:20.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.469+0000 7f435e26c640 1 -- 172.21.15.87:0/1618740717 >> 172.21.15.87:0/1618740717 conn(0x7f43580f7d30 msgr2=0x7f43580f95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:27:20.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.469+0000 7f435e26c640 1 -- 172.21.15.87:0/1618740717 shutdown_connections 2024-09-17T07:27:20.471 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.469+0000 7f435e26c640 1 -- 172.21.15.87:0/1618740717 wait complete. 2024-09-17T07:27:20.479 INFO:teuthology.orchestra.run.smithi087.stdout:true 2024-09-17T07:27:20.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.548+0000 7f934cf50640 1 -- 172.21.15.87:0/1475642743 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93480ff6e0 msgr2=0x7f9348101ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:27:20.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.548+0000 7f934cf50640 1 --2- 172.21.15.87:0/1475642743 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93480ff6e0 0x7f9348101ac0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f933c0048d0 tx=0x7f933c009da0 comp rx=0 tx=0).stop 2024-09-17T07:27:20.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.548+0000 7f934cf50640 1 -- 172.21.15.87:0/1475642743 shutdown_connections 2024-09-17T07:27:20.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.548+0000 7f934cf50640 1 --2- 172.21.15.87:0/1475642743 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93480ff6e0 0x7f9348101ac0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:20.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.548+0000 7f934cf50640 1 --2- 172.21.15.87:0/1475642743 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f93480666d0 0x7f93480ff1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:20.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.548+0000 7f934cf50640 1 -- 172.21.15.87:0/1475642743 >> 172.21.15.87:0/1475642743 conn(0x7f93480f6c10 msgr2=0x7f93480f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:27:20.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.549+0000 7f934cf50640 1 -- 172.21.15.87:0/1475642743 shutdown_connections 2024-09-17T07:27:20.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.549+0000 7f934cf50640 1 -- 172.21.15.87:0/1475642743 wait complete. 2024-09-17T07:27:20.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.549+0000 7f934cf50640 1 Processor -- start 2024-09-17T07:27:20.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.549+0000 7f934cf50640 1 -- start start 2024-09-17T07:27:20.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.549+0000 7f934cf50640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93480666d0 0x7f934810d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:27:20.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.549+0000 7f934cf50640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f93480ff6e0 0x7f934810d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:27:20.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.549+0000 7f934cf50640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f934810dbd0 con 0x7f93480666d0 2024-09-17T07:27:20.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.549+0000 7f934cf50640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f934810e3f0 con 0x7f93480ff6e0 2024-09-17T07:27:20.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.549+0000 7f934659c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93480666d0 0x7f934810d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:27:20.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.549+0000 7f934659c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93480666d0 0x7f934810d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46232/0 (socket says 172.21.15.87:46232) 2024-09-17T07:27:20.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.549+0000 7f934659c640 1 -- 172.21.15.87:0/3202437154 learned_addr learned my addr 172.21.15.87:0/3202437154 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:27:20.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.549+0000 7f9345d9b640 1 --2- 172.21.15.87:0/3202437154 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f93480ff6e0 0x7f934810d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:27:20.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.550+0000 7f934659c640 1 -- 172.21.15.87:0/3202437154 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f93480ff6e0 msgr2=0x7f934810d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:27:20.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.550+0000 7f934659c640 1 --2- 172.21.15.87:0/3202437154 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f93480ff6e0 0x7f934810d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:20.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.550+0000 7f934659c640 1 -- 172.21.15.87:0/3202437154 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f933c005040 con 0x7f93480666d0 2024-09-17T07:27:20.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.550+0000 7f934659c640 1 --2- 172.21.15.87:0/3202437154 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93480666d0 0x7f934810d040 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f933800eb70 tx=0x7f933800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:27:20.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.550+0000 7f9336ffd640 1 -- 172.21.15.87:0/3202437154 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9338007c30 con 0x7f93480666d0 2024-09-17T07:27:20.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.550+0000 7f9336ffd640 1 -- 172.21.15.87:0/3202437154 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f933800f040 con 0x7f93480666d0 2024-09-17T07:27:20.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.550+0000 7f934cf50640 1 -- 172.21.15.87:0/3202437154 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f934810e680 con 0x7f93480666d0 2024-09-17T07:27:20.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.550+0000 7f9336ffd640 1 -- 172.21.15.87:0/3202437154 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f933800c9e0 con 0x7f93480666d0 2024-09-17T07:27:20.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.550+0000 7f934cf50640 1 -- 172.21.15.87:0/3202437154 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f934810ebf0 con 0x7f93480666d0 2024-09-17T07:27:20.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.551+0000 7f934cf50640 1 -- 172.21.15.87:0/3202437154 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9348105640 con 0x7f93480666d0 2024-09-17T07:27:20.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.552+0000 7f9336ffd640 1 -- 172.21.15.87:0/3202437154 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f9338009620 con 0x7f93480666d0 2024-09-17T07:27:20.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.552+0000 7f9336ffd640 1 --2- 172.21.15.87:0/3202437154 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f933006cb90 0x7f933006f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:27:20.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.552+0000 7f9336ffd640 1 -- 172.21.15.87:0/3202437154 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f933808c1f0 con 0x7f93480666d0 2024-09-17T07:27:20.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.552+0000 7f9345d9b640 1 --2- 172.21.15.87:0/3202437154 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f933006cb90 0x7f933006f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:27:20.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.553+0000 7f9345d9b640 1 --2- 172.21.15.87:0/3202437154 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f933006cb90 0x7f933006f040 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f933c000c00 tx=0x7f933c035040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:27:20.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.557+0000 7f9336ffd640 1 -- 172.21.15.87:0/3202437154 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f9338056230 con 0x7f93480666d0 2024-09-17T07:27:20.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.734+0000 7f934cf50640 1 -- 172.21.15.87:0/3202437154 --> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f934810efd0 con 0x7f933006cb90 2024-09-17T07:27:20.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.735+0000 7f9336ffd640 1 -- 172.21.15.87:0/3202437154 <== mgr.24529 v2:172.21.15.87:6800/1359413180 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f934810efd0 con 0x7f933006cb90 2024-09-17T07:27:20.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.737+0000 7f934cf50640 1 -- 172.21.15.87:0/3202437154 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f933006cb90 msgr2=0x7f933006f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:27:20.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.737+0000 7f934cf50640 1 --2- 172.21.15.87:0/3202437154 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f933006cb90 0x7f933006f040 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f933c000c00 tx=0x7f933c035040 comp rx=0 tx=0).stop 2024-09-17T07:27:20.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.737+0000 7f934cf50640 1 -- 172.21.15.87:0/3202437154 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93480666d0 msgr2=0x7f934810d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:27:20.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.737+0000 7f934cf50640 1 --2- 172.21.15.87:0/3202437154 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93480666d0 0x7f934810d040 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f933800eb70 tx=0x7f933800b040 comp rx=0 tx=0).stop 2024-09-17T07:27:20.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.737+0000 7f934cf50640 1 -- 172.21.15.87:0/3202437154 shutdown_connections 2024-09-17T07:27:20.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.737+0000 7f934cf50640 1 --2- 172.21.15.87:0/3202437154 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f933006cb90 0x7f933006f040 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:20.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.737+0000 7f934cf50640 1 --2- 172.21.15.87:0/3202437154 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f93480ff6e0 0x7f934810d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:20.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.737+0000 7f934cf50640 1 --2- 172.21.15.87:0/3202437154 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93480666d0 0x7f934810d040 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:20.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.737+0000 7f934cf50640 1 -- 172.21.15.87:0/3202437154 >> 172.21.15.87:0/3202437154 conn(0x7f93480f6c10 msgr2=0x7f93480f7030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:27:20.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.737+0000 7f934cf50640 1 -- 172.21.15.87:0/3202437154 shutdown_connections 2024-09-17T07:27:20.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.737+0000 7f934cf50640 1 -- 172.21.15.87:0/3202437154 wait complete. 2024-09-17T07:27:20.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.815+0000 7f632c839640 1 -- 172.21.15.87:0/3753222830 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6328066670 msgr2=0x7f63280ff200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:27:20.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.815+0000 7f632c839640 1 --2- 172.21.15.87:0/3753222830 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6328066670 0x7f63280ff200 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f63180048d0 tx=0x7f6318009da0 comp rx=0 tx=0).stop 2024-09-17T07:27:20.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.815+0000 7f632c839640 1 -- 172.21.15.87:0/3753222830 shutdown_connections 2024-09-17T07:27:20.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.815+0000 7f632c839640 1 --2- 172.21.15.87:0/3753222830 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f63280ff740 0x7f6328101b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:20.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.815+0000 7f632c839640 1 --2- 172.21.15.87:0/3753222830 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6328066670 0x7f63280ff200 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:20.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.815+0000 7f632c839640 1 -- 172.21.15.87:0/3753222830 >> 172.21.15.87:0/3753222830 conn(0x7f63280f6c10 msgr2=0x7f63280f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:27:20.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.815+0000 7f632c839640 1 -- 172.21.15.87:0/3753222830 shutdown_connections 2024-09-17T07:27:20.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.815+0000 7f632c839640 1 -- 172.21.15.87:0/3753222830 wait complete. 2024-09-17T07:27:20.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.816+0000 7f632c839640 1 Processor -- start 2024-09-17T07:27:20.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.816+0000 7f632c839640 1 -- start start 2024-09-17T07:27:20.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.816+0000 7f632c839640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6328066670 0x7f632810d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:27:20.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.816+0000 7f632c839640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63280ff740 0x7f632810d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:27:20.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.816+0000 7f632c839640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f632810dc40 con 0x7f63280ff740 2024-09-17T07:27:20.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.816+0000 7f632c839640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f632810e460 con 0x7f6328066670 2024-09-17T07:27:20.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.816+0000 7f631ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63280ff740 0x7f632810d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:27:20.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.816+0000 7f631ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63280ff740 0x7f632810d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46252/0 (socket says 172.21.15.87:46252) 2024-09-17T07:27:20.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.816+0000 7f631ffff640 1 -- 172.21.15.87:0/3622937728 learned_addr learned my addr 172.21.15.87:0/3622937728 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:27:20.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.816+0000 7f632659c640 1 --2- 172.21.15.87:0/3622937728 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6328066670 0x7f632810d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:27:20.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.816+0000 7f631ffff640 1 -- 172.21.15.87:0/3622937728 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6328066670 msgr2=0x7f632810d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:27:20.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.816+0000 7f631ffff640 1 --2- 172.21.15.87:0/3622937728 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6328066670 0x7f632810d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:20.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.816+0000 7f631ffff640 1 -- 172.21.15.87:0/3622937728 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6318005040 con 0x7f63280ff740 2024-09-17T07:27:20.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.817+0000 7f631ffff640 1 --2- 172.21.15.87:0/3622937728 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63280ff740 0x7f632810d5f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6310002870 tx=0x7f6310004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:27:20.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.817+0000 7f631effd640 1 -- 172.21.15.87:0/3622937728 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6310007c30 con 0x7f63280ff740 2024-09-17T07:27:20.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.817+0000 7f632c839640 1 -- 172.21.15.87:0/3622937728 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f632810e6f0 con 0x7f63280ff740 2024-09-17T07:27:20.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.817+0000 7f631effd640 1 -- 172.21.15.87:0/3622937728 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f631000f040 con 0x7f63280ff740 2024-09-17T07:27:20.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.817+0000 7f631effd640 1 -- 172.21.15.87:0/3622937728 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f631000d960 con 0x7f63280ff740 2024-09-17T07:27:20.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.817+0000 7f632c839640 1 -- 172.21.15.87:0/3622937728 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f632810ec90 con 0x7f63280ff740 2024-09-17T07:27:20.821 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.818+0000 7f632c839640 1 -- 172.21.15.87:0/3622937728 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63280fa8b0 con 0x7f63280ff740 2024-09-17T07:27:20.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.819+0000 7f631effd640 1 -- 172.21.15.87:0/3622937728 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f631000dae0 con 0x7f63280ff740 2024-09-17T07:27:20.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.819+0000 7f631effd640 1 --2- 172.21.15.87:0/3622937728 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f631406cb90 0x7f631406f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:27:20.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.820+0000 7f631effd640 1 -- 172.21.15.87:0/3622937728 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f631008b6f0 con 0x7f63280ff740 2024-09-17T07:27:20.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.820+0000 7f632659c640 1 --2- 172.21.15.87:0/3622937728 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f631406cb90 0x7f631406f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:27:20.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.820+0000 7f632659c640 1 --2- 172.21.15.87:0/3622937728 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f631406cb90 0x7f631406f040 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f63180043d0 tx=0x7f6318035040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:27:20.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.824+0000 7f631effd640 1 -- 172.21.15.87:0/3622937728 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f63100557e0 con 0x7f63280ff740 2024-09-17T07:27:20.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:20.994+0000 7f632c839640 1 -- 172.21.15.87:0/3622937728 --> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f632810f030 con 0x7f631406cb90 2024-09-17T07:27:21.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.002+0000 7f631effd640 1 -- 172.21.15.87:0/3622937728 <== mgr.24529 v2:172.21.15.87:6800/1359413180 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f632810f030 con 0x7f631406cb90 2024-09-17T07:27:21.004 INFO:teuthology.orchestra.run.smithi087.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T07:27:21.004 INFO:teuthology.orchestra.run.smithi087.stdout:alertmanager.smithi087 smithi087 *:9093,9094 running (6m) 15s ago 15m 24.1M - 0.25.0 c8568f914cd2 594553f0b497 2024-09-17T07:27:21.004 INFO:teuthology.orchestra.run.smithi087.stdout:crash.smithi087 smithi087 running (4m) 15s ago 15m 6895k - 18.2.4-855-g19e2a2be 980a0bfcd684 0ff8a9330162 2024-09-17T07:27:21.004 INFO:teuthology.orchestra.run.smithi087.stdout:crash.smithi139 smithi139 running (4m) 86s ago 14m 6899k - 18.2.4-855-g19e2a2be 980a0bfcd684 10541e3b202e 2024-09-17T07:27:21.004 INFO:teuthology.orchestra.run.smithi087.stdout:grafana.smithi087 smithi087 *:3000 running (6m) 15s ago 15m 82.6M - 9.4.7 954c08fa6188 e2f17ec6baa8 2024-09-17T07:27:21.004 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi087.tjhpcs smithi087 running (20s) 15s ago 9m 11.6M - 18.2.4-855-g19e2a2be 980a0bfcd684 593471a4a9e2 2024-09-17T07:27:21.004 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi087.vvbzss smithi087 running (43s) 15s ago 10m 67.1M - 18.2.4-855-g19e2a2be 980a0bfcd684 e50f437839ed 2024-09-17T07:27:21.004 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi139.ftvinf smithi139 running (9m) 86s ago 9m 57.3M - 17.2.7-1635-g4a704134 f22ead590bad d11edb295ad3 2024-09-17T07:27:21.004 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi139.gnwonz smithi139 starting - - - - 2024-09-17T07:27:21.005 INFO:teuthology.orchestra.run.smithi087.stdout:mgr.smithi087.vuvjer smithi087 *:8443,9283,8765 running (6m) 15s ago 16m 495M - 18.2.4-855-g19e2a2be 980a0bfcd684 5d10c647cb6b 2024-09-17T07:27:21.005 INFO:teuthology.orchestra.run.smithi087.stdout:mgr.smithi139.tuqnpn smithi139 *:8443,9283,8765 running (5m) 86s ago 14m 439M - 18.2.4-855-g19e2a2be 980a0bfcd684 6e0bf371d44c 2024-09-17T07:27:21.005 INFO:teuthology.orchestra.run.smithi087.stdout:mon.smithi087 smithi087 running (5m) 15s ago 16m 49.3M 2048M 18.2.4-855-g19e2a2be 980a0bfcd684 305c72de1f9f 2024-09-17T07:27:21.005 INFO:teuthology.orchestra.run.smithi087.stdout:mon.smithi139 smithi139 running (5m) 86s ago 14m 39.9M 2048M 18.2.4-855-g19e2a2be 980a0bfcd684 0b159495af0f 2024-09-17T07:27:21.005 INFO:teuthology.orchestra.run.smithi087.stdout:node-exporter.smithi087 smithi087 *:9100 running (7m) 15s ago 15m 15.8M - 1.5.0 0da6a335fe13 39fa48de0e87 2024-09-17T07:27:21.005 INFO:teuthology.orchestra.run.smithi087.stdout:node-exporter.smithi139 smithi139 *:9100 running (6m) 86s ago 14m 15.5M - 1.5.0 0da6a335fe13 a5b99b7cbb06 2024-09-17T07:27:21.005 INFO:teuthology.orchestra.run.smithi087.stdout:osd.0 smithi087 running (4m) 15s ago 13m 95.8M 1557M 18.2.4-855-g19e2a2be 980a0bfcd684 e97cb50e6aec 2024-09-17T07:27:21.005 INFO:teuthology.orchestra.run.smithi087.stdout:osd.1 smithi087 running (3m) 15s ago 13m 101M 1557M 18.2.4-855-g19e2a2be 980a0bfcd684 b108771d0b8e 2024-09-17T07:27:21.005 INFO:teuthology.orchestra.run.smithi087.stdout:osd.2 smithi087 running (3m) 15s ago 12m 86.3M 1557M 18.2.4-855-g19e2a2be 980a0bfcd684 240cfb3b5366 2024-09-17T07:27:21.005 INFO:teuthology.orchestra.run.smithi087.stdout:osd.3 smithi139 running (2m) 86s ago 12m 102M 2581M 18.2.4-855-g19e2a2be 980a0bfcd684 b05ed3bf3f5c 2024-09-17T07:27:21.005 INFO:teuthology.orchestra.run.smithi087.stdout:osd.4 smithi139 running (2m) 86s ago 11m 93.2M 2581M 18.2.4-855-g19e2a2be 980a0bfcd684 139bbfc915c8 2024-09-17T07:27:21.005 INFO:teuthology.orchestra.run.smithi087.stdout:osd.5 smithi139 running (89s) 86s ago 11m 12.1M 2581M 18.2.4-855-g19e2a2be 980a0bfcd684 5058216f1ee0 2024-09-17T07:27:21.005 INFO:teuthology.orchestra.run.smithi087.stdout:prometheus.smithi087 smithi087 *:9095 running (5m) 15s ago 14m 65.4M - 2.43.0 a07b618ecd1d 63d18b7469fc 2024-09-17T07:27:21.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.004+0000 7f632c839640 1 -- 172.21.15.87:0/3622937728 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f631406cb90 msgr2=0x7f631406f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:27:21.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.004+0000 7f632c839640 1 --2- 172.21.15.87:0/3622937728 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f631406cb90 0x7f631406f040 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f63180043d0 tx=0x7f6318035040 comp rx=0 tx=0).stop 2024-09-17T07:27:21.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.005+0000 7f632c839640 1 -- 172.21.15.87:0/3622937728 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63280ff740 msgr2=0x7f632810d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:27:21.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.005+0000 7f632c839640 1 --2- 172.21.15.87:0/3622937728 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63280ff740 0x7f632810d5f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6310002870 tx=0x7f6310004600 comp rx=0 tx=0).stop 2024-09-17T07:27:21.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.005+0000 7f632c839640 1 -- 172.21.15.87:0/3622937728 shutdown_connections 2024-09-17T07:27:21.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.005+0000 7f632c839640 1 --2- 172.21.15.87:0/3622937728 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63280ff740 0x7f632810d5f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:21.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.005+0000 7f632c839640 1 --2- 172.21.15.87:0/3622937728 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f631406cb90 0x7f631406f040 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:21.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.005+0000 7f632c839640 1 --2- 172.21.15.87:0/3622937728 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6328066670 0x7f632810d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:21.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.005+0000 7f632c839640 1 -- 172.21.15.87:0/3622937728 >> 172.21.15.87:0/3622937728 conn(0x7f63280f6c10 msgr2=0x7f63280f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:27:21.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.005+0000 7f632c839640 1 -- 172.21.15.87:0/3622937728 shutdown_connections 2024-09-17T07:27:21.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.005+0000 7f632c839640 1 -- 172.21.15.87:0/3622937728 wait complete. 2024-09-17T07:27:21.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.082+0000 7f50eba76640 1 -- 172.21.15.87:0/318954129 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50e40fd820 msgr2=0x7f50e40fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:27:21.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.082+0000 7f50eba76640 1 --2- 172.21.15.87:0/318954129 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50e40fd820 0x7f50e40fdc90 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f50d40048d0 tx=0x7f50d4009da0 comp rx=0 tx=0).stop 2024-09-17T07:27:21.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.082+0000 7f50eba76640 1 -- 172.21.15.87:0/318954129 shutdown_connections 2024-09-17T07:27:21.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.082+0000 7f50eba76640 1 --2- 172.21.15.87:0/318954129 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50e40fd820 0x7f50e40fdc90 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:21.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.082+0000 7f50eba76640 1 --2- 172.21.15.87:0/318954129 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f50e40fc550 0x7f50e40fc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:21.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.082+0000 7f50eba76640 1 -- 172.21.15.87:0/318954129 >> 172.21.15.87:0/318954129 conn(0x7f50e40f7d30 msgr2=0x7f50e40fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:27:21.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.082+0000 7f50eba76640 1 -- 172.21.15.87:0/318954129 shutdown_connections 2024-09-17T07:27:21.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.082+0000 7f50eba76640 1 -- 172.21.15.87:0/318954129 wait complete. 2024-09-17T07:27:21.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.083+0000 7f50eba76640 1 Processor -- start 2024-09-17T07:27:21.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.083+0000 7f50eba76640 1 -- start start 2024-09-17T07:27:21.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.083+0000 7f50eba76640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50e40fc550 0x7f50e410cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:27:21.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.083+0000 7f50eba76640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f50e40fd820 0x7f50e410d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:27:21.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.083+0000 7f50eba76640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e410db60 con 0x7f50e40fc550 2024-09-17T07:27:21.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.083+0000 7f50eba76640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e410e380 con 0x7f50e40fd820 2024-09-17T07:27:21.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.083+0000 7f50e9812640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50e40fc550 0x7f50e410cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:27:21.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.083+0000 7f50e9812640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50e40fc550 0x7f50e410cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46272/0 (socket says 172.21.15.87:46272) 2024-09-17T07:27:21.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.083+0000 7f50e9812640 1 -- 172.21.15.87:0/4074357489 learned_addr learned my addr 172.21.15.87:0/4074357489 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:27:21.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.083+0000 7f50e9011640 1 --2- 172.21.15.87:0/4074357489 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f50e40fd820 0x7f50e410d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:27:21.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.083+0000 7f50e9812640 1 -- 172.21.15.87:0/4074357489 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f50e40fd820 msgr2=0x7f50e410d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:27:21.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.083+0000 7f50e9812640 1 --2- 172.21.15.87:0/4074357489 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f50e40fd820 0x7f50e410d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:21.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.083+0000 7f50e9812640 1 -- 172.21.15.87:0/4074357489 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50d4005040 con 0x7f50e40fc550 2024-09-17T07:27:21.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.083+0000 7f50e9011640 1 --2- 172.21.15.87:0/4074357489 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f50e40fd820 0x7f50e410d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T07:27:21.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.084+0000 7f50e9812640 1 --2- 172.21.15.87:0/4074357489 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50e40fc550 0x7f50e410cfd0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f50dc00db00 tx=0x7f50dc004e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:27:21.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.084+0000 7f50da7fc640 1 -- 172.21.15.87:0/4074357489 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50dc017070 con 0x7f50e40fc550 2024-09-17T07:27:21.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.084+0000 7f50eba76640 1 -- 172.21.15.87:0/4074357489 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50e410e610 con 0x7f50e40fc550 2024-09-17T07:27:21.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.084+0000 7f50da7fc640 1 -- 172.21.15.87:0/4074357489 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f50dc00f040 con 0x7f50e40fc550 2024-09-17T07:27:21.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.084+0000 7f50da7fc640 1 -- 172.21.15.87:0/4074357489 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50dc0038d0 con 0x7f50e40fc550 2024-09-17T07:27:21.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.084+0000 7f50eba76640 1 -- 172.21.15.87:0/4074357489 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50e410ebb0 con 0x7f50e40fc550 2024-09-17T07:27:21.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.085+0000 7f50eba76640 1 -- 172.21.15.87:0/4074357489 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50e40fb9b0 con 0x7f50e40fc550 2024-09-17T07:27:21.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.086+0000 7f50da7fc640 1 -- 172.21.15.87:0/4074357489 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f50dc003ac0 con 0x7f50e40fc550 2024-09-17T07:27:21.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.086+0000 7f50da7fc640 1 --2- 172.21.15.87:0/4074357489 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f50d006cb90 0x7f50d006f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:27:21.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.086+0000 7f50da7fc640 1 -- 172.21.15.87:0/4074357489 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f50dc08c1e0 con 0x7f50e40fc550 2024-09-17T07:27:21.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.086+0000 7f50e9011640 1 --2- 172.21.15.87:0/4074357489 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f50d006cb90 0x7f50d006f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:27:21.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.087+0000 7f50e9011640 1 --2- 172.21.15.87:0/4074357489 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f50d006cb90 0x7f50d006f040 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f50d4009ac0 tx=0x7f50d4009da0 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:27:21.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.090+0000 7f50da7fc640 1 -- 172.21.15.87:0/4074357489 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f50dc0561a0 con 0x7f50e40fc550 2024-09-17T07:27:21.198 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:21 smithi139 ceph-mon[79872]: pgmap v198: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail 2024-09-17T07:27:21.199 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:21 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:21.199 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:21 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:21.199 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:21 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:27:21.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.330+0000 7f50eba76640 1 -- 172.21.15.87:0/4074357489 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f50e410ee90 con 0x7f50e40fc550 2024-09-17T07:27:21.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.330+0000 7f50da7fc640 1 -- 172.21.15.87:0/4074357489 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+844 (secure 0 0 0) 0x7f50dc0597c0 con 0x7f50e40fc550 2024-09-17T07:27:21.331 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T07:27:21.331 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": { 2024-09-17T07:27:21.332 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 2 2024-09-17T07:27:21.332 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:27:21.332 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr": { 2024-09-17T07:27:21.332 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 2 2024-09-17T07:27:21.332 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:27:21.332 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": { 2024-09-17T07:27:21.332 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 6 2024-09-17T07:27:21.332 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:27:21.332 INFO:teuthology.orchestra.run.smithi087.stdout: "mds": { 2024-09-17T07:27:21.332 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 1, 2024-09-17T07:27:21.332 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 3 2024-09-17T07:27:21.332 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:27:21.332 INFO:teuthology.orchestra.run.smithi087.stdout: "overall": { 2024-09-17T07:27:21.332 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 1, 2024-09-17T07:27:21.333 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 13 2024-09-17T07:27:21.333 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T07:27:21.333 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T07:27:21.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.332+0000 7f50eba76640 1 -- 172.21.15.87:0/4074357489 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f50d006cb90 msgr2=0x7f50d006f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:27:21.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.332+0000 7f50eba76640 1 --2- 172.21.15.87:0/4074357489 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f50d006cb90 0x7f50d006f040 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f50d4009ac0 tx=0x7f50d4009da0 comp rx=0 tx=0).stop 2024-09-17T07:27:21.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.332+0000 7f50eba76640 1 -- 172.21.15.87:0/4074357489 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50e40fc550 msgr2=0x7f50e410cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:27:21.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.332+0000 7f50eba76640 1 --2- 172.21.15.87:0/4074357489 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50e40fc550 0x7f50e410cfd0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f50dc00db00 tx=0x7f50dc004e60 comp rx=0 tx=0).stop 2024-09-17T07:27:21.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.332+0000 7f50eba76640 1 -- 172.21.15.87:0/4074357489 shutdown_connections 2024-09-17T07:27:21.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.332+0000 7f50eba76640 1 --2- 172.21.15.87:0/4074357489 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f50d006cb90 0x7f50d006f040 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:21.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.332+0000 7f50eba76640 1 --2- 172.21.15.87:0/4074357489 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f50e40fd820 0x7f50e410d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:21.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.332+0000 7f50eba76640 1 --2- 172.21.15.87:0/4074357489 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50e40fc550 0x7f50e410cfd0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:21.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.332+0000 7f50eba76640 1 -- 172.21.15.87:0/4074357489 >> 172.21.15.87:0/4074357489 conn(0x7f50e40f7d30 msgr2=0x7f50e40f9600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:27:21.334 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:21 smithi087 ceph-mon[90982]: pgmap v198: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail 2024-09-17T07:27:21.334 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:21 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:21.334 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:21 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:21.334 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:21 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:27:21.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.332+0000 7f50eba76640 1 -- 172.21.15.87:0/4074357489 shutdown_connections 2024-09-17T07:27:21.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.332+0000 7f50eba76640 1 -- 172.21.15.87:0/4074357489 wait complete. 2024-09-17T07:27:21.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.410+0000 7f980d9e5640 1 -- 172.21.15.87:0/4023918971 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98080fb450 msgr2=0x7f98080fb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:27:21.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.410+0000 7f980d9e5640 1 --2- 172.21.15.87:0/4023918971 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98080fb450 0x7f98080fb860 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f97f80048d0 tx=0x7f97f8009da0 comp rx=0 tx=0).stop 2024-09-17T07:27:21.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.410+0000 7f980d9e5640 1 -- 172.21.15.87:0/4023918971 shutdown_connections 2024-09-17T07:27:21.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.410+0000 7f980d9e5640 1 --2- 172.21.15.87:0/4023918971 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f98080fc720 0x7f98080fcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:21.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.410+0000 7f980d9e5640 1 --2- 172.21.15.87:0/4023918971 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98080fb450 0x7f98080fb860 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:21.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.410+0000 7f980d9e5640 1 -- 172.21.15.87:0/4023918971 >> 172.21.15.87:0/4023918971 conn(0x7f98080f6c10 msgr2=0x7f98080f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:27:21.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.410+0000 7f980d9e5640 1 -- 172.21.15.87:0/4023918971 shutdown_connections 2024-09-17T07:27:21.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.410+0000 7f980d9e5640 1 -- 172.21.15.87:0/4023918971 wait complete. 2024-09-17T07:27:21.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.411+0000 7f980d9e5640 1 Processor -- start 2024-09-17T07:27:21.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.411+0000 7f980d9e5640 1 -- start start 2024-09-17T07:27:21.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.411+0000 7f980d9e5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f98080fb450 0x7f9808112110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:27:21.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.411+0000 7f980d9e5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98080fc720 0x7f9808114660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:27:21.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.411+0000 7f980d9e5640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f980810dbc0 con 0x7f98080fc720 2024-09-17T07:27:21.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.411+0000 7f980d9e5640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98080666c0 con 0x7f98080fb450 2024-09-17T07:27:21.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.411+0000 7f98067fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98080fc720 0x7f9808114660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:27:21.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.411+0000 7f98067fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98080fc720 0x7f9808114660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46304/0 (socket says 172.21.15.87:46304) 2024-09-17T07:27:21.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.411+0000 7f98067fc640 1 -- 172.21.15.87:0/2796765879 learned_addr learned my addr 172.21.15.87:0/2796765879 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:27:21.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.411+0000 7f9806ffd640 1 --2- 172.21.15.87:0/2796765879 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f98080fb450 0x7f9808112110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:27:21.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.412+0000 7f98067fc640 1 -- 172.21.15.87:0/2796765879 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f98080fb450 msgr2=0x7f9808112110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:27:21.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.412+0000 7f98067fc640 1 --2- 172.21.15.87:0/2796765879 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f98080fb450 0x7f9808112110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:21.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.412+0000 7f98067fc640 1 -- 172.21.15.87:0/2796765879 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f8005040 con 0x7f98080fc720 2024-09-17T07:27:21.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.412+0000 7f98067fc640 1 --2- 172.21.15.87:0/2796765879 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98080fc720 0x7f9808114660 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f97fc002a80 tx=0x7f97fc004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:27:21.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.412+0000 7f97ef7fe640 1 -- 172.21.15.87:0/2796765879 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97fc007c30 con 0x7f98080fc720 2024-09-17T07:27:21.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.412+0000 7f97ef7fe640 1 -- 172.21.15.87:0/2796765879 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f97fc00f040 con 0x7f98080fc720 2024-09-17T07:27:21.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.412+0000 7f97ef7fe640 1 -- 172.21.15.87:0/2796765879 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97fc00d9b0 con 0x7f98080fc720 2024-09-17T07:27:21.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.412+0000 7f980d9e5640 1 -- 172.21.15.87:0/2796765879 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98080669a0 con 0x7f98080fc720 2024-09-17T07:27:21.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.412+0000 7f980d9e5640 1 -- 172.21.15.87:0/2796765879 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9808114ee0 con 0x7f98080fc720 2024-09-17T07:27:21.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.413+0000 7f980d9e5640 1 -- 172.21.15.87:0/2796765879 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98080fa8b0 con 0x7f98080fc720 2024-09-17T07:27:21.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.414+0000 7f97ef7fe640 1 -- 172.21.15.87:0/2796765879 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f97fc00db10 con 0x7f98080fc720 2024-09-17T07:27:21.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.414+0000 7f97ef7fe640 1 --2- 172.21.15.87:0/2796765879 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f97f006cb90 0x7f97f006f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:27:21.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.414+0000 7f97ef7fe640 1 -- 172.21.15.87:0/2796765879 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f97fc08b900 con 0x7f98080fc720 2024-09-17T07:27:21.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.414+0000 7f9806ffd640 1 --2- 172.21.15.87:0/2796765879 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f97f006cb90 0x7f97f006f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:27:21.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.415+0000 7f9806ffd640 1 --2- 172.21.15.87:0/2796765879 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f97f006cb90 0x7f97f006f040 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9808066440 tx=0x7f97f8035040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:27:21.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.418+0000 7f97ef7fe640 1 -- 172.21.15.87:0/2796765879 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f97fc0559f0 con 0x7f98080fc720 2024-09-17T07:27:21.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.611+0000 7f980d9e5640 1 -- 172.21.15.87:0/2796765879 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f980804b720 con 0x7f98080fc720 2024-09-17T07:27:21.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.612+0000 7f97ef7fe640 1 -- 172.21.15.87:0/2796765879 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 38 v38) v1 ==== 76+0+1848 (secure 0 0 0) 0x7f97fc059010 con 0x7f98080fc720 2024-09-17T07:27:21.613 INFO:teuthology.orchestra.run.smithi087.stdout:e38 2024-09-17T07:27:21.613 INFO:teuthology.orchestra.run.smithi087.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T07:27:21.614 INFO:teuthology.orchestra.run.smithi087.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T07:27:21.614 INFO:teuthology.orchestra.run.smithi087.stdout:legacy client fscid: 1 2024-09-17T07:27:21.614 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:27:21.614 INFO:teuthology.orchestra.run.smithi087.stdout:Filesystem 'cephfs' (1) 2024-09-17T07:27:21.614 INFO:teuthology.orchestra.run.smithi087.stdout:fs_name cephfs 2024-09-17T07:27:21.614 INFO:teuthology.orchestra.run.smithi087.stdout:epoch 35 2024-09-17T07:27:21.614 INFO:teuthology.orchestra.run.smithi087.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-17T07:27:21.614 INFO:teuthology.orchestra.run.smithi087.stdout:created 2024-09-17T07:17:15.368053+0000 2024-09-17T07:27:21.614 INFO:teuthology.orchestra.run.smithi087.stdout:modified 2024-09-17T07:26:58.204675+0000 2024-09-17T07:27:21.614 INFO:teuthology.orchestra.run.smithi087.stdout:tableserver 0 2024-09-17T07:27:21.614 INFO:teuthology.orchestra.run.smithi087.stdout:root 0 2024-09-17T07:27:21.614 INFO:teuthology.orchestra.run.smithi087.stdout:session_timeout 60 2024-09-17T07:27:21.614 INFO:teuthology.orchestra.run.smithi087.stdout:session_autoclose 300 2024-09-17T07:27:21.614 INFO:teuthology.orchestra.run.smithi087.stdout:max_file_size 1099511627776 2024-09-17T07:27:21.615 INFO:teuthology.orchestra.run.smithi087.stdout:max_xattr_size 65536 2024-09-17T07:27:21.615 INFO:teuthology.orchestra.run.smithi087.stdout:required_client_features {} 2024-09-17T07:27:21.615 INFO:teuthology.orchestra.run.smithi087.stdout:last_failure 0 2024-09-17T07:27:21.615 INFO:teuthology.orchestra.run.smithi087.stdout:last_failure_osd_epoch 80 2024-09-17T07:27:21.615 INFO:teuthology.orchestra.run.smithi087.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T07:27:21.615 INFO:teuthology.orchestra.run.smithi087.stdout:max_mds 1 2024-09-17T07:27:21.615 INFO:teuthology.orchestra.run.smithi087.stdout:in 0 2024-09-17T07:27:21.615 INFO:teuthology.orchestra.run.smithi087.stdout:up {0=34412} 2024-09-17T07:27:21.615 INFO:teuthology.orchestra.run.smithi087.stdout:failed 2024-09-17T07:27:21.615 INFO:teuthology.orchestra.run.smithi087.stdout:damaged 2024-09-17T07:27:21.615 INFO:teuthology.orchestra.run.smithi087.stdout:stopped 1 2024-09-17T07:27:21.615 INFO:teuthology.orchestra.run.smithi087.stdout:data_pools [3] 2024-09-17T07:27:21.615 INFO:teuthology.orchestra.run.smithi087.stdout:metadata_pool 2 2024-09-17T07:27:21.616 INFO:teuthology.orchestra.run.smithi087.stdout:inline_data enabled 2024-09-17T07:27:21.616 INFO:teuthology.orchestra.run.smithi087.stdout:balancer 2024-09-17T07:27:21.616 INFO:teuthology.orchestra.run.smithi087.stdout:bal_rank_mask -1 2024-09-17T07:27:21.616 INFO:teuthology.orchestra.run.smithi087.stdout:standby_count_wanted 1 2024-09-17T07:27:21.616 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi087.vvbzss{0:34412} state up:active seq 8 join_fscid=1 addr [v2:172.21.15.87:6826/1050918039,v1:172.21.15.87:6827/1050918039] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:27:21.616 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:27:21.616 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:27:21.616 INFO:teuthology.orchestra.run.smithi087.stdout:Standby daemons: 2024-09-17T07:27:21.616 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:27:21.616 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi087.tjhpcs{-1:34444} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.87:6828/2375971201,v1:172.21.15.87:6829/2375971201] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:27:21.616 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi139.ftvinf{-1:44261} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.139:6826/641133838,v1:172.21.15.139:6827/641133838] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:27:21.616 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi139.gnwonz{-1:44325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.139:6824/1289261341,v1:172.21.15.139:6825/1289261341] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:27:21.617 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 38 2024-09-17T07:27:21.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.614+0000 7f980d9e5640 1 -- 172.21.15.87:0/2796765879 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f97f006cb90 msgr2=0x7f97f006f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:27:21.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.614+0000 7f980d9e5640 1 --2- 172.21.15.87:0/2796765879 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f97f006cb90 0x7f97f006f040 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9808066440 tx=0x7f97f8035040 comp rx=0 tx=0).stop 2024-09-17T07:27:21.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.614+0000 7f980d9e5640 1 -- 172.21.15.87:0/2796765879 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98080fc720 msgr2=0x7f9808114660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:27:21.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.614+0000 7f980d9e5640 1 --2- 172.21.15.87:0/2796765879 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98080fc720 0x7f9808114660 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f97fc002a80 tx=0x7f97fc004600 comp rx=0 tx=0).stop 2024-09-17T07:27:21.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.614+0000 7f980d9e5640 1 -- 172.21.15.87:0/2796765879 shutdown_connections 2024-09-17T07:27:21.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.614+0000 7f980d9e5640 1 --2- 172.21.15.87:0/2796765879 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98080fc720 0x7f9808114660 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:21.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.614+0000 7f980d9e5640 1 --2- 172.21.15.87:0/2796765879 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f97f006cb90 0x7f97f006f040 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:21.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.614+0000 7f980d9e5640 1 --2- 172.21.15.87:0/2796765879 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f98080fb450 0x7f9808112110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:21.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.614+0000 7f980d9e5640 1 -- 172.21.15.87:0/2796765879 >> 172.21.15.87:0/2796765879 conn(0x7f98080f6c10 msgr2=0x7f98080ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:27:21.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.614+0000 7f980d9e5640 1 -- 172.21.15.87:0/2796765879 shutdown_connections 2024-09-17T07:27:21.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.614+0000 7f980d9e5640 1 -- 172.21.15.87:0/2796765879 wait complete. 2024-09-17T07:27:21.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.693+0000 7f0dbd6c6640 1 -- 172.21.15.87:0/3485340941 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0db80fd820 msgr2=0x7f0db80fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:27:21.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.693+0000 7f0dbd6c6640 1 --2- 172.21.15.87:0/3485340941 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0db80fd820 0x7f0db80fdc90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0da00048d0 tx=0x7f0da0009da0 comp rx=0 tx=0).stop 2024-09-17T07:27:21.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.694+0000 7f0dbd6c6640 1 -- 172.21.15.87:0/3485340941 shutdown_connections 2024-09-17T07:27:21.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.694+0000 7f0dbd6c6640 1 --2- 172.21.15.87:0/3485340941 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0db80fd820 0x7f0db80fdc90 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:21.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.694+0000 7f0dbd6c6640 1 --2- 172.21.15.87:0/3485340941 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0db80fc550 0x7f0db80fc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:21.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.694+0000 7f0dbd6c6640 1 -- 172.21.15.87:0/3485340941 >> 172.21.15.87:0/3485340941 conn(0x7f0db80f7d30 msgr2=0x7f0db80fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:27:21.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.694+0000 7f0dbd6c6640 1 -- 172.21.15.87:0/3485340941 shutdown_connections 2024-09-17T07:27:21.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.694+0000 7f0dbd6c6640 1 -- 172.21.15.87:0/3485340941 wait complete. 2024-09-17T07:27:21.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.694+0000 7f0dbd6c6640 1 Processor -- start 2024-09-17T07:27:21.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.694+0000 7f0dbd6c6640 1 -- start start 2024-09-17T07:27:21.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.694+0000 7f0dbd6c6640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0db80fc550 0x7f0db810cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:27:21.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.694+0000 7f0dbd6c6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0db80fd820 0x7f0db810d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:27:21.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.694+0000 7f0dbd6c6640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db810db60 con 0x7f0db80fd820 2024-09-17T07:27:21.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.694+0000 7f0dbd6c6640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db810e380 con 0x7f0db80fc550 2024-09-17T07:27:21.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.695+0000 7f0db67fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0db80fd820 0x7f0db810d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:27:21.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.695+0000 7f0db6ffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0db80fc550 0x7f0db810cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:27:21.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.695+0000 7f0db67fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0db80fd820 0x7f0db810d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46322/0 (socket says 172.21.15.87:46322) 2024-09-17T07:27:21.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.695+0000 7f0db67fc640 1 -- 172.21.15.87:0/2540244298 learned_addr learned my addr 172.21.15.87:0/2540244298 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:27:21.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.695+0000 7f0db67fc640 1 -- 172.21.15.87:0/2540244298 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0db80fc550 msgr2=0x7f0db810cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:27:21.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.695+0000 7f0db67fc640 1 --2- 172.21.15.87:0/2540244298 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0db80fc550 0x7f0db810cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:21.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.695+0000 7f0db67fc640 1 -- 172.21.15.87:0/2540244298 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0da0005040 con 0x7f0db80fd820 2024-09-17T07:27:21.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.695+0000 7f0db67fc640 1 --2- 172.21.15.87:0/2540244298 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0db80fd820 0x7f0db810d510 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0da00043d0 tx=0x7f0da0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:27:21.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.695+0000 7f0daf7fe640 1 -- 172.21.15.87:0/2540244298 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0da0038070 con 0x7f0db80fd820 2024-09-17T07:27:21.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.695+0000 7f0daf7fe640 1 -- 172.21.15.87:0/2540244298 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f0da00096c0 con 0x7f0db80fd820 2024-09-17T07:27:21.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.695+0000 7f0dbd6c6640 1 -- 172.21.15.87:0/2540244298 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0db810e5b0 con 0x7f0db80fd820 2024-09-17T07:27:21.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.695+0000 7f0daf7fe640 1 -- 172.21.15.87:0/2540244298 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0da003d420 con 0x7f0db80fd820 2024-09-17T07:27:21.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.695+0000 7f0dbd6c6640 1 -- 172.21.15.87:0/2540244298 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0db810eb50 con 0x7f0db80fd820 2024-09-17T07:27:21.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.696+0000 7f0dbd6c6640 1 -- 172.21.15.87:0/2540244298 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0db80fb9b0 con 0x7f0db80fd820 2024-09-17T07:27:21.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.697+0000 7f0daf7fe640 1 -- 172.21.15.87:0/2540244298 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f0da0030020 con 0x7f0db80fd820 2024-09-17T07:27:21.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.697+0000 7f0daf7fe640 1 --2- 172.21.15.87:0/2540244298 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f0da406cb90 0x7f0da406f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:27:21.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.697+0000 7f0daf7fe640 1 -- 172.21.15.87:0/2540244298 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f0da00ac600 con 0x7f0db80fd820 2024-09-17T07:27:21.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.697+0000 7f0db6ffd640 1 --2- 172.21.15.87:0/2540244298 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f0da406cb90 0x7f0da406f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:27:21.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.698+0000 7f0db6ffd640 1 --2- 172.21.15.87:0/2540244298 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f0da406cb90 0x7f0da406f040 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0da8004ed0 tx=0x7f0da800b040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:27:21.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.702+0000 7f0daf7fe640 1 -- 172.21.15.87:0/2540244298 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f0da0076640 con 0x7f0db80fd820 2024-09-17T07:27:21.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.877+0000 7f0dbd6c6640 1 -- 172.21.15.87:0/2540244298 --> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0db810ee80 con 0x7f0da406cb90 2024-09-17T07:27:21.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.878+0000 7f0daf7fe640 1 -- 172.21.15.87:0/2540244298 <== mgr.24529 v2:172.21.15.87:6800/1359413180 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f0db810ee80 con 0x7f0da406cb90 2024-09-17T07:27:21.880 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T07:27:21.880 INFO:teuthology.orchestra.run.smithi087.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9", 2024-09-17T07:27:21.880 INFO:teuthology.orchestra.run.smithi087.stdout: "in_progress": true, 2024-09-17T07:27:21.880 INFO:teuthology.orchestra.run.smithi087.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T07:27:21.880 INFO:teuthology.orchestra.run.smithi087.stdout: "services_complete": [ 2024-09-17T07:27:21.881 INFO:teuthology.orchestra.run.smithi087.stdout: "crash", 2024-09-17T07:27:21.881 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr", 2024-09-17T07:27:21.881 INFO:teuthology.orchestra.run.smithi087.stdout: "mon", 2024-09-17T07:27:21.881 INFO:teuthology.orchestra.run.smithi087.stdout: "osd" 2024-09-17T07:27:21.881 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-17T07:27:21.882 INFO:teuthology.orchestra.run.smithi087.stdout: "progress": "14/21 daemons upgraded", 2024-09-17T07:27:21.882 INFO:teuthology.orchestra.run.smithi087.stdout: "message": "Currently upgrading mds daemons", 2024-09-17T07:27:21.882 INFO:teuthology.orchestra.run.smithi087.stdout: "is_paused": false 2024-09-17T07:27:21.882 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T07:27:21.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.881+0000 7f0dbd6c6640 1 -- 172.21.15.87:0/2540244298 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f0da406cb90 msgr2=0x7f0da406f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:27:21.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.881+0000 7f0dbd6c6640 1 --2- 172.21.15.87:0/2540244298 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f0da406cb90 0x7f0da406f040 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0da8004ed0 tx=0x7f0da800b040 comp rx=0 tx=0).stop 2024-09-17T07:27:21.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.881+0000 7f0dbd6c6640 1 -- 172.21.15.87:0/2540244298 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0db80fd820 msgr2=0x7f0db810d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:27:21.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.881+0000 7f0dbd6c6640 1 --2- 172.21.15.87:0/2540244298 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0db80fd820 0x7f0db810d510 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0da00043d0 tx=0x7f0da0009da0 comp rx=0 tx=0).stop 2024-09-17T07:27:21.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.881+0000 7f0dbd6c6640 1 -- 172.21.15.87:0/2540244298 shutdown_connections 2024-09-17T07:27:21.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.881+0000 7f0dbd6c6640 1 --2- 172.21.15.87:0/2540244298 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0db80fd820 0x7f0db810d510 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:21.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.881+0000 7f0dbd6c6640 1 --2- 172.21.15.87:0/2540244298 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f0da406cb90 0x7f0da406f040 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:21.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.881+0000 7f0dbd6c6640 1 --2- 172.21.15.87:0/2540244298 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0db80fc550 0x7f0db810cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:21.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.881+0000 7f0dbd6c6640 1 -- 172.21.15.87:0/2540244298 >> 172.21.15.87:0/2540244298 conn(0x7f0db80f7d30 msgr2=0x7f0db80f9600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:27:21.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.882+0000 7f0dbd6c6640 1 -- 172.21.15.87:0/2540244298 shutdown_connections 2024-09-17T07:27:21.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.882+0000 7f0dbd6c6640 1 -- 172.21.15.87:0/2540244298 wait complete. 2024-09-17T07:27:21.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.959+0000 7f717f27c640 1 -- 172.21.15.87:0/903620659 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71780fc520 msgr2=0x7f71780fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:27:21.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.959+0000 7f717f27c640 1 --2- 172.21.15.87:0/903620659 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71780fc520 0x7f71780fc930 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f71680048d0 tx=0x7f7168009da0 comp rx=0 tx=0).stop 2024-09-17T07:27:21.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.959+0000 7f717f27c640 1 -- 172.21.15.87:0/903620659 shutdown_connections 2024-09-17T07:27:21.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.959+0000 7f717f27c640 1 --2- 172.21.15.87:0/903620659 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f71780fd7f0 0x7f71780fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:21.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.959+0000 7f717f27c640 1 --2- 172.21.15.87:0/903620659 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71780fc520 0x7f71780fc930 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:21.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.959+0000 7f717f27c640 1 -- 172.21.15.87:0/903620659 >> 172.21.15.87:0/903620659 conn(0x7f71780f7ce0 msgr2=0x7f71780fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:27:21.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.960+0000 7f717f27c640 1 -- 172.21.15.87:0/903620659 shutdown_connections 2024-09-17T07:27:21.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.960+0000 7f717f27c640 1 -- 172.21.15.87:0/903620659 wait complete. 2024-09-17T07:27:21.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.960+0000 7f717f27c640 1 Processor -- start 2024-09-17T07:27:21.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.960+0000 7f717f27c640 1 -- start start 2024-09-17T07:27:21.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.960+0000 7f717f27c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71780fc520 0x7f7178071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:27:21.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.960+0000 7f717f27c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f71780fd7f0 0x7f717806fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:27:21.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.960+0000 7f717f27c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f717806fff0 con 0x7f71780fc520 2024-09-17T07:27:21.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.960+0000 7f717f27c640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7178070130 con 0x7f71780fd7f0 2024-09-17T07:27:21.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.960+0000 7f717d018640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71780fc520 0x7f7178071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:27:21.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.960+0000 7f717d018640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71780fc520 0x7f7178071570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46338/0 (socket says 172.21.15.87:46338) 2024-09-17T07:27:21.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.960+0000 7f717d018640 1 -- 172.21.15.87:0/3499818598 learned_addr learned my addr 172.21.15.87:0/3499818598 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:27:21.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.961+0000 7f717c817640 1 --2- 172.21.15.87:0/3499818598 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f71780fd7f0 0x7f717806fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:27:21.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.961+0000 7f717d018640 1 -- 172.21.15.87:0/3499818598 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f71780fd7f0 msgr2=0x7f717806fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:27:21.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.961+0000 7f717d018640 1 --2- 172.21.15.87:0/3499818598 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f71780fd7f0 0x7f717806fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:21.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.961+0000 7f717d018640 1 -- 172.21.15.87:0/3499818598 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7168005040 con 0x7f71780fc520 2024-09-17T07:27:21.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.961+0000 7f717c817640 1 --2- 172.21.15.87:0/3499818598 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f71780fd7f0 0x7f717806fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T07:27:21.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.961+0000 7f717d018640 1 --2- 172.21.15.87:0/3499818598 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71780fc520 0x7f7178071570 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7168009ac0 tx=0x7f7168009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:27:21.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.961+0000 7f716dffb640 1 -- 172.21.15.87:0/3499818598 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7168038070 con 0x7f71780fc520 2024-09-17T07:27:21.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.961+0000 7f716dffb640 1 -- 172.21.15.87:0/3499818598 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f716802ae70 con 0x7f71780fc520 2024-09-17T07:27:21.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.961+0000 7f717f27c640 1 -- 172.21.15.87:0/3499818598 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71780703b0 con 0x7f71780fc520 2024-09-17T07:27:21.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.961+0000 7f716dffb640 1 -- 172.21.15.87:0/3499818598 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7168033420 con 0x7f71780fc520 2024-09-17T07:27:21.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.961+0000 7f717f27c640 1 -- 172.21.15.87:0/3499818598 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7178115040 con 0x7f71780fc520 2024-09-17T07:27:21.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.962+0000 7f717f27c640 1 -- 172.21.15.87:0/3499818598 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71780fb980 con 0x7f71780fc520 2024-09-17T07:27:21.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.963+0000 7f716dffb640 1 -- 172.21.15.87:0/3499818598 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f7168030020 con 0x7f71780fc520 2024-09-17T07:27:21.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.963+0000 7f716dffb640 1 --2- 172.21.15.87:0/3499818598 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f716406cb90 0x7f716406f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:27:21.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.963+0000 7f716dffb640 1 -- 172.21.15.87:0/3499818598 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f71680ac070 con 0x7f71780fc520 2024-09-17T07:27:21.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.963+0000 7f717c817640 1 --2- 172.21.15.87:0/3499818598 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f716406cb90 0x7f716406f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:27:21.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.964+0000 7f717c817640 1 --2- 172.21.15.87:0/3499818598 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f716406cb90 0x7f716406f040 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f71740041d0 tx=0x7f7174009040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:27:21.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:21.967+0000 7f716dffb640 1 -- 172.21.15.87:0/3499818598 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f71680760b0 con 0x7f71780fc520 2024-09-17T07:27:22.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:22.192+0000 7f717f27c640 1 -- 172.21.15.87:0/3499818598 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f717804b720 con 0x7f71780fc520 2024-09-17T07:27:22.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:22.193+0000 7f716dffb640 1 -- 172.21.15.87:0/3499818598 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f71680796d0 con 0x7f71780fc520 2024-09-17T07:27:22.194 INFO:teuthology.orchestra.run.smithi087.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T07:27:22.194 INFO:teuthology.orchestra.run.smithi087.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T07:27:22.194 INFO:teuthology.orchestra.run.smithi087.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T07:27:22.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:22.195+0000 7f717f27c640 1 -- 172.21.15.87:0/3499818598 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f716406cb90 msgr2=0x7f716406f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:27:22.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:22.195+0000 7f717f27c640 1 --2- 172.21.15.87:0/3499818598 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f716406cb90 0x7f716406f040 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f71740041d0 tx=0x7f7174009040 comp rx=0 tx=0).stop 2024-09-17T07:27:22.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:22.195+0000 7f717f27c640 1 -- 172.21.15.87:0/3499818598 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71780fc520 msgr2=0x7f7178071570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:27:22.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:22.195+0000 7f717f27c640 1 --2- 172.21.15.87:0/3499818598 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71780fc520 0x7f7178071570 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7168009ac0 tx=0x7f7168009da0 comp rx=0 tx=0).stop 2024-09-17T07:27:22.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:22.195+0000 7f717f27c640 1 -- 172.21.15.87:0/3499818598 shutdown_connections 2024-09-17T07:27:22.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:22.195+0000 7f717f27c640 1 --2- 172.21.15.87:0/3499818598 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f716406cb90 0x7f716406f040 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:22.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:22.195+0000 7f717f27c640 1 --2- 172.21.15.87:0/3499818598 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f71780fd7f0 0x7f717806fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:22.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:22.195+0000 7f717f27c640 1 --2- 172.21.15.87:0/3499818598 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71780fc520 0x7f7178071570 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:22.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:22.195+0000 7f717f27c640 1 -- 172.21.15.87:0/3499818598 >> 172.21.15.87:0/3499818598 conn(0x7f71780f7ce0 msgr2=0x7f71780f9610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:27:22.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:22.195+0000 7f717f27c640 1 -- 172.21.15.87:0/3499818598 shutdown_connections 2024-09-17T07:27:22.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:22.195+0000 7f717f27c640 1 -- 172.21.15.87:0/3499818598 wait complete. 2024-09-17T07:27:22.612 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:22 smithi139 ceph-mon[79872]: from='client.34448 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:27:22.612 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:22 smithi139 ceph-mon[79872]: from='client.34456 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:27:22.613 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:22 smithi139 ceph-mon[79872]: from='client.34460 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:27:22.613 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:22 smithi139 ceph-mon[79872]: mds.? [v2:172.21.15.139:6824/1289261341,v1:172.21.15.139:6825/1289261341] up:boot 2024-09-17T07:27:22.613 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:22 smithi139 ceph-mon[79872]: fsmap cephfs:1 {0=cephfs.smithi087.vvbzss=up:active} 3 up:standby 2024-09-17T07:27:22.613 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:22 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi139.gnwonz"}]: dispatch 2024-09-17T07:27:22.613 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:22 smithi139 ceph-mon[79872]: from='client.? 172.21.15.87:0/4074357489' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:27:22.613 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:22 smithi139 ceph-mon[79872]: from='client.? 172.21.15.87:0/2796765879' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T07:27:22.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:22 smithi087 ceph-mon[90982]: from='client.34448 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:27:22.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:22 smithi087 ceph-mon[90982]: from='client.34456 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:27:22.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:22 smithi087 ceph-mon[90982]: from='client.34460 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:27:22.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:22 smithi087 ceph-mon[90982]: mds.? [v2:172.21.15.139:6824/1289261341,v1:172.21.15.139:6825/1289261341] up:boot 2024-09-17T07:27:22.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:22 smithi087 ceph-mon[90982]: fsmap cephfs:1 {0=cephfs.smithi087.vvbzss=up:active} 3 up:standby 2024-09-17T07:27:22.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:22 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi139.gnwonz"}]: dispatch 2024-09-17T07:27:22.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:22 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/4074357489' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:27:22.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:22 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/2796765879' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T07:27:23.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:23 smithi139 ceph-mon[79872]: from='client.34472 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:27:23.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:23 smithi139 ceph-mon[79872]: pgmap v199: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail 2024-09-17T07:27:23.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:23 smithi139 ceph-mon[79872]: from='client.? 172.21.15.87:0/3499818598' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T07:27:23.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:23 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:23.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:23 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:23.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:23 smithi087 ceph-mon[90982]: from='client.34472 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:27:23.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:23 smithi087 ceph-mon[90982]: pgmap v199: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail 2024-09-17T07:27:23.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:23 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/3499818598' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T07:27:23.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:23 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:23.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:23 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:24.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:24 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:24.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:24 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:24.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:24 smithi139 ceph-mon[79872]: pgmap v200: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail 2024-09-17T07:27:24.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:24 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:24.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:24 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:24.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:24 smithi087 ceph-mon[90982]: pgmap v200: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail 2024-09-17T07:27:27.518 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:27 smithi139 ceph-mon[79872]: pgmap v201: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail 2024-09-17T07:27:27.518 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:27 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:27.518 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:27 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:27.518 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:27 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:27:27.518 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:27 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:27:27.519 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:27 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:27.519 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:27 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:27:27.519 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:27 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:27:27.519 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:27 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:27:27.519 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:27 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:27:27.519 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:27 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:27:27.519 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:27 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi139.ftvinf"]}]: dispatch 2024-09-17T07:27:27.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:27 smithi087 ceph-mon[90982]: pgmap v201: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail 2024-09-17T07:27:27.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:27 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:27.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:27 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:27.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:27 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:27:27.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:27 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:27:27.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:27 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:27.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:27 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:27:27.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:27 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:27:27.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:27 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:27:27.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:27 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:27:27.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:27 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:27:27.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:27 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi139.ftvinf"]}]: dispatch 2024-09-17T07:27:28.454 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:28 smithi139 ceph-mon[79872]: Detected new or changed devices on smithi139 2024-09-17T07:27:28.454 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:28 smithi139 ceph-mon[79872]: Upgrade: It appears safe to stop mds.cephfs.smithi139.ftvinf 2024-09-17T07:27:28.454 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:28 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:28.454 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:28 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi139.ftvinf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T07:27:28.454 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:28 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:27:28.454 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:28 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:27:28.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:28 smithi087 ceph-mon[90982]: Detected new or changed devices on smithi139 2024-09-17T07:27:28.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:28 smithi087 ceph-mon[90982]: Upgrade: It appears safe to stop mds.cephfs.smithi139.ftvinf 2024-09-17T07:27:28.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:28 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:28.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:28 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi139.ftvinf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T07:27:28.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:28 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:27:28.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:28 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:27:29.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:29 smithi139 ceph-mon[79872]: Upgrade: Updating mds.cephfs.smithi139.ftvinf 2024-09-17T07:27:29.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:29 smithi139 ceph-mon[79872]: Deploying daemon mds.cephfs.smithi139.ftvinf on smithi139 2024-09-17T07:27:29.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:29 smithi139 ceph-mon[79872]: pgmap v202: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail 2024-09-17T07:27:29.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:29 smithi087 ceph-mon[90982]: Upgrade: Updating mds.cephfs.smithi139.ftvinf 2024-09-17T07:27:29.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:29 smithi087 ceph-mon[90982]: Deploying daemon mds.cephfs.smithi139.ftvinf on smithi139 2024-09-17T07:27:29.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:29 smithi087 ceph-mon[90982]: pgmap v202: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail 2024-09-17T07:27:30.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:30 smithi087 ceph-mon[90982]: osdmap e82: 6 total, 6 up, 6 in 2024-09-17T07:27:30.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:30 smithi087 ceph-mon[90982]: pgmap v204: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail 2024-09-17T07:27:30.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:30 smithi087 ceph-mon[90982]: fsmap cephfs:1 {0=cephfs.smithi087.vvbzss=up:active} 2 up:standby 2024-09-17T07:27:31.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:30 smithi139 ceph-mon[79872]: osdmap e82: 6 total, 6 up, 6 in 2024-09-17T07:27:31.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:30 smithi139 ceph-mon[79872]: pgmap v204: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail 2024-09-17T07:27:31.117 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:30 smithi139 ceph-mon[79872]: fsmap cephfs:1 {0=cephfs.smithi087.vvbzss=up:active} 2 up:standby 2024-09-17T07:27:31.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:31 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi139.ftvinf"}]: dispatch 2024-09-17T07:27:32.116 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:31 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi139.ftvinf"}]: dispatch 2024-09-17T07:27:32.712 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:32 smithi139 ceph-mon[79872]: pgmap v205: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail 2024-09-17T07:27:32.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:32 smithi087 ceph-mon[90982]: pgmap v205: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail 2024-09-17T07:27:35.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:35 smithi139 ceph-mon[79872]: mds.? [v2:172.21.15.139:6826/1126774601,v1:172.21.15.139:6827/1126774601] up:boot 2024-09-17T07:27:35.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:35 smithi139 ceph-mon[79872]: fsmap cephfs:1 {0=cephfs.smithi087.vvbzss=up:active} 3 up:standby 2024-09-17T07:27:35.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:35 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi139.ftvinf"}]: dispatch 2024-09-17T07:27:35.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:35 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:35.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:35 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:35.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:35 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:27:35.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:35 smithi139 ceph-mon[79872]: pgmap v206: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail 2024-09-17T07:27:35.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:35 smithi087 ceph-mon[90982]: mds.? [v2:172.21.15.139:6826/1126774601,v1:172.21.15.139:6827/1126774601] up:boot 2024-09-17T07:27:35.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:35 smithi087 ceph-mon[90982]: fsmap cephfs:1 {0=cephfs.smithi087.vvbzss=up:active} 3 up:standby 2024-09-17T07:27:35.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:35 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi139.ftvinf"}]: dispatch 2024-09-17T07:27:35.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:35 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:35.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:35 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:35.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:35 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:27:35.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:35 smithi087 ceph-mon[90982]: pgmap v206: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail 2024-09-17T07:27:37.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:37 smithi139 ceph-mon[79872]: pgmap v207: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail 2024-09-17T07:27:37.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:37 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:37.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:37 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:37.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:37 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:37.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:37 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:37.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:37 smithi087 ceph-mon[90982]: pgmap v207: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail 2024-09-17T07:27:37.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:37 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:37.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:37 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:37.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:37 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:37.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:37 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:39.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:39 smithi139 ceph-mon[79872]: pgmap v208: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail 2024-09-17T07:27:39.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:39 smithi087 ceph-mon[90982]: pgmap v208: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail 2024-09-17T07:27:41.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:40 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:41.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:40 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:41.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:40 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:27:41.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:40 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:27:41.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:40 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:41.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:40 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:27:41.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:40 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:27:41.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:40 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:27:41.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:40 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:27:41.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:40 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:27:41.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:40 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:27:41.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:40 smithi087 ceph-mon[90982]: Upgrade: Setting container_image for all mds 2024-09-17T07:27:41.178 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:40 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:41.178 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:40 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi087.tjhpcs"}]: dispatch 2024-09-17T07:27:41.178 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:40 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi087.tjhpcs"}]': finished 2024-09-17T07:27:41.178 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:40 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi087.vvbzss"}]: dispatch 2024-09-17T07:27:41.178 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:40 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi087.vvbzss"}]': finished 2024-09-17T07:27:41.178 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:40 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi139.ftvinf"}]: dispatch 2024-09-17T07:27:41.178 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:40 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi139.ftvinf"}]': finished 2024-09-17T07:27:41.178 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:40 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi139.gnwonz"}]: dispatch 2024-09-17T07:27:41.178 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:40 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi139.gnwonz"}]': finished 2024-09-17T07:27:41.178 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:40 smithi087 ceph-mon[90982]: Upgrade: Scaling up filesystem cephfs max_mds to 2 2024-09-17T07:27:41.178 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:40 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-09-17T07:27:41.178 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:40 smithi087 ceph-mon[90982]: pgmap v209: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail 2024-09-17T07:27:41.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:40 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:41.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:40 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:41.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:40 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:27:41.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:40 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:27:41.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:40 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:41.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:40 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:27:41.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:40 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:27:41.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:40 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:27:41.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:40 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:27:41.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:40 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:27:41.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:40 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:27:41.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:40 smithi139 ceph-mon[79872]: Upgrade: Setting container_image for all mds 2024-09-17T07:27:41.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:40 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:41.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:40 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi087.tjhpcs"}]: dispatch 2024-09-17T07:27:41.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:40 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi087.tjhpcs"}]': finished 2024-09-17T07:27:41.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:40 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi087.vvbzss"}]: dispatch 2024-09-17T07:27:41.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:40 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi087.vvbzss"}]': finished 2024-09-17T07:27:41.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:40 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi139.ftvinf"}]: dispatch 2024-09-17T07:27:41.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:40 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi139.ftvinf"}]': finished 2024-09-17T07:27:41.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:40 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi139.gnwonz"}]: dispatch 2024-09-17T07:27:41.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:40 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi139.gnwonz"}]': finished 2024-09-17T07:27:41.369 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:40 smithi139 ceph-mon[79872]: Upgrade: Scaling up filesystem cephfs max_mds to 2 2024-09-17T07:27:41.369 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:40 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-09-17T07:27:41.369 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:40 smithi139 ceph-mon[79872]: pgmap v209: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail 2024-09-17T07:27:42.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:41 smithi087 ceph-mon[90982]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-17T07:27:42.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:41 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-09-17T07:27:42.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:41 smithi087 ceph-mon[90982]: daemon mds.cephfs.smithi087.tjhpcs assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-17T07:27:42.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:41 smithi087 ceph-mon[90982]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-17T07:27:42.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:41 smithi087 ceph-mon[90982]: fsmap cephfs:1 {0=cephfs.smithi087.vvbzss=up:active} 3 up:standby 2024-09-17T07:27:42.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:41 smithi087 ceph-mon[90982]: fsmap cephfs:2 {0=cephfs.smithi087.vvbzss=up:active,1=cephfs.smithi087.tjhpcs=up:starting} 2 up:standby 2024-09-17T07:27:42.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:41 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:42.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:41 smithi087 ceph-mon[90982]: daemon mds.cephfs.smithi087.tjhpcs is now active in filesystem cephfs as rank 1 2024-09-17T07:27:42.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:41 smithi087 ceph-mon[90982]: Upgrade: Enabling allow_standby_replay on filesystem cephfs 2024-09-17T07:27:42.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:41 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]: dispatch 2024-09-17T07:27:42.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:41 smithi087 ceph-mon[90982]: mds.? [v2:172.21.15.87:6828/2375971201,v1:172.21.15.87:6829/2375971201] up:active 2024-09-17T07:27:42.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:41 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]': finished 2024-09-17T07:27:42.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:41 smithi087 ceph-mon[90982]: fsmap cephfs:2 {0=cephfs.smithi087.vvbzss=up:active,1=cephfs.smithi087.tjhpcs=up:active} 2 up:standby-replay 2024-09-17T07:27:42.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:41 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:42.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:41 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:27:42.178 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:41 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:42.178 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:41 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:27:42.178 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:41 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:42.178 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:41 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:27:42.178 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:41 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:27:42.178 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:41 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:42.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:41 smithi139 ceph-mon[79872]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-17T07:27:42.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:41 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-09-17T07:27:42.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:41 smithi139 ceph-mon[79872]: daemon mds.cephfs.smithi087.tjhpcs assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-17T07:27:42.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:41 smithi139 ceph-mon[79872]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-17T07:27:42.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:41 smithi139 ceph-mon[79872]: fsmap cephfs:1 {0=cephfs.smithi087.vvbzss=up:active} 3 up:standby 2024-09-17T07:27:42.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:41 smithi139 ceph-mon[79872]: fsmap cephfs:2 {0=cephfs.smithi087.vvbzss=up:active,1=cephfs.smithi087.tjhpcs=up:starting} 2 up:standby 2024-09-17T07:27:42.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:41 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:42.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:41 smithi139 ceph-mon[79872]: daemon mds.cephfs.smithi087.tjhpcs is now active in filesystem cephfs as rank 1 2024-09-17T07:27:42.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:41 smithi139 ceph-mon[79872]: Upgrade: Enabling allow_standby_replay on filesystem cephfs 2024-09-17T07:27:42.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:41 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]: dispatch 2024-09-17T07:27:42.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:41 smithi139 ceph-mon[79872]: mds.? [v2:172.21.15.87:6828/2375971201,v1:172.21.15.87:6829/2375971201] up:active 2024-09-17T07:27:42.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:41 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]': finished 2024-09-17T07:27:42.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:41 smithi139 ceph-mon[79872]: fsmap cephfs:2 {0=cephfs.smithi087.vvbzss=up:active,1=cephfs.smithi087.tjhpcs=up:active} 2 up:standby-replay 2024-09-17T07:27:42.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:41 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:42.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:41 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:27:42.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:41 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:42.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:41 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:27:42.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:41 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:42.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:41 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:27:42.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:41 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:27:42.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:41 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:43.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:42 smithi087 ceph-mon[90982]: Upgrade: Setting container_image for all rgw 2024-09-17T07:27:43.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:42 smithi087 ceph-mon[90982]: Upgrade: Setting container_image for all rbd-mirror 2024-09-17T07:27:43.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:42 smithi087 ceph-mon[90982]: Upgrade: Setting container_image for all ceph-exporter 2024-09-17T07:27:43.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:42 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:27:43.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:42 smithi087 ceph-mon[90982]: Upgrade: Setting container_image for all iscsi 2024-09-17T07:27:43.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:42 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:43.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:42 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:27:43.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:42 smithi087 ceph-mon[90982]: Upgrade: Setting container_image for all nfs 2024-09-17T07:27:43.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:42 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:43.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:42 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:27:43.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:42 smithi087 ceph-mon[90982]: Upgrade: Setting container_image for all nvmeof 2024-09-17T07:27:43.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:42 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:43.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:42 smithi087 ceph-mon[90982]: pgmap v210: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail 2024-09-17T07:27:43.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:42 smithi139 ceph-mon[79872]: Upgrade: Setting container_image for all rgw 2024-09-17T07:27:43.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:42 smithi139 ceph-mon[79872]: Upgrade: Setting container_image for all rbd-mirror 2024-09-17T07:27:43.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:42 smithi139 ceph-mon[79872]: Upgrade: Setting container_image for all ceph-exporter 2024-09-17T07:27:43.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:42 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:27:43.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:42 smithi139 ceph-mon[79872]: Upgrade: Setting container_image for all iscsi 2024-09-17T07:27:43.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:42 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:43.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:42 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:27:43.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:42 smithi139 ceph-mon[79872]: Upgrade: Setting container_image for all nfs 2024-09-17T07:27:43.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:42 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:43.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:42 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:27:43.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:42 smithi139 ceph-mon[79872]: Upgrade: Setting container_image for all nvmeof 2024-09-17T07:27:43.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:42 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:43.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:42 smithi139 ceph-mon[79872]: pgmap v210: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail 2024-09-17T07:27:44.351 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:27:44.352 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:43 smithi087 ceph-mon[90982]: Upgrade: Updating node-exporter.smithi087 (1/2) 2024-09-17T07:27:44.352 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:43 smithi087 ceph-mon[90982]: Deploying daemon node-exporter.smithi087 on smithi087 2024-09-17T07:27:44.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:27:44.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:43 smithi139 ceph-mon[79872]: Upgrade: Updating node-exporter.smithi087 (1/2) 2024-09-17T07:27:44.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:43 smithi139 ceph-mon[79872]: Deploying daemon node-exporter.smithi087 on smithi087 2024-09-17T07:27:45.232 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:44 smithi087 ceph-mon[90982]: pgmap v211: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 6.3 MiB/s rd, 170 B/s wr, 7 op/s 2024-09-17T07:27:45.267 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:44 smithi139 ceph-mon[79872]: pgmap v211: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 6.3 MiB/s rd, 170 B/s wr, 7 op/s 2024-09-17T07:27:46.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:46 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:46.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:46 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:46.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:46 smithi139 ceph-mon[79872]: pgmap v212: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 9.7 MiB/s rd, 170 B/s wr, 10 op/s 2024-09-17T07:27:46.903 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:46 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:46.903 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:46 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:46.903 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:46 smithi087 ceph-mon[90982]: pgmap v212: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 9.7 MiB/s rd, 170 B/s wr, 10 op/s 2024-09-17T07:27:47.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:47 smithi139 ceph-mon[79872]: Upgrade: Updating node-exporter.smithi139 (2/2) 2024-09-17T07:27:47.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:47 smithi139 ceph-mon[79872]: Deploying daemon node-exporter.smithi139 on smithi139 2024-09-17T07:27:47.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:47 smithi087 ceph-mon[90982]: Upgrade: Updating node-exporter.smithi139 (2/2) 2024-09-17T07:27:47.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:47 smithi087 ceph-mon[90982]: Deploying daemon node-exporter.smithi139 on smithi139 2024-09-17T07:27:48.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:48 smithi087 ceph-mon[90982]: pgmap v213: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 170 B/s wr, 11 op/s 2024-09-17T07:27:49.001 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:48 smithi139 ceph-mon[79872]: pgmap v213: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 170 B/s wr, 11 op/s 2024-09-17T07:27:50.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:50 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:50.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:50 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:50.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:50 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:27:50.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:50 smithi087 ceph-mon[90982]: pgmap v214: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 170 B/s wr, 12 op/s 2024-09-17T07:27:50.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:50 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:50.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:50 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:50.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:50 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:27:50.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:50 smithi139 ceph-mon[79872]: pgmap v214: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 170 B/s wr, 12 op/s 2024-09-17T07:27:52.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.280+0000 7fb572a9a640 1 -- 172.21.15.87:0/3552807787 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb56c0fb430 msgr2=0x7fb56c0fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:27:52.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.280+0000 7fb572a9a640 1 --2- 172.21.15.87:0/3552807787 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb56c0fb430 0x7fb56c0fb840 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb568009c50 tx=0x7fb568004d10 comp rx=0 tx=0).stop 2024-09-17T07:27:52.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.280+0000 7fb572a9a640 1 -- 172.21.15.87:0/3552807787 shutdown_connections 2024-09-17T07:27:52.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.280+0000 7fb572a9a640 1 --2- 172.21.15.87:0/3552807787 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb56c0fc700 0x7fb56c0fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:52.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.280+0000 7fb572a9a640 1 --2- 172.21.15.87:0/3552807787 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb56c0fb430 0x7fb56c0fb840 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:52.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.280+0000 7fb572a9a640 1 -- 172.21.15.87:0/3552807787 >> 172.21.15.87:0/3552807787 conn(0x7fb56c0f6c10 msgr2=0x7fb56c0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:27:52.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.280+0000 7fb572a9a640 1 -- 172.21.15.87:0/3552807787 shutdown_connections 2024-09-17T07:27:52.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.280+0000 7fb572a9a640 1 -- 172.21.15.87:0/3552807787 wait complete. 2024-09-17T07:27:52.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.281+0000 7fb572a9a640 1 Processor -- start 2024-09-17T07:27:52.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.281+0000 7fb572a9a640 1 -- start start 2024-09-17T07:27:52.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.281+0000 7fb572a9a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb56c0fb430 0x7fb56c10cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:27:52.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.281+0000 7fb572a9a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb56c0fc700 0x7fb56c10d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:27:52.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.281+0000 7fb572a9a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb56c10db40 con 0x7fb56c0fb430 2024-09-17T07:27:52.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.281+0000 7fb572a9a640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb56c10e360 con 0x7fb56c0fc700 2024-09-17T07:27:52.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.281+0000 7fb570836640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb56c0fb430 0x7fb56c10cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:27:52.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.281+0000 7fb570836640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb56c0fb430 0x7fb56c10cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42002/0 (socket says 172.21.15.87:42002) 2024-09-17T07:27:52.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.281+0000 7fb570836640 1 -- 172.21.15.87:0/1225647731 learned_addr learned my addr 172.21.15.87:0/1225647731 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:27:52.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.281+0000 7fb563fff640 1 --2- 172.21.15.87:0/1225647731 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb56c0fc700 0x7fb56c10d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:27:52.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.281+0000 7fb570836640 1 -- 172.21.15.87:0/1225647731 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb56c0fc700 msgr2=0x7fb56c10d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:27:52.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.281+0000 7fb570836640 1 --2- 172.21.15.87:0/1225647731 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb56c0fc700 0x7fb56c10d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:52.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.282+0000 7fb570836640 1 -- 172.21.15.87:0/1225647731 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5680098b0 con 0x7fb56c0fb430 2024-09-17T07:27:52.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.282+0000 7fb570836640 1 --2- 172.21.15.87:0/1225647731 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb56c0fb430 0x7fb56c10cfb0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb568032470 tx=0x7fb568004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:27:52.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.282+0000 7fb5617fa640 1 -- 172.21.15.87:0/1225647731 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb568032570 con 0x7fb56c0fb430 2024-09-17T07:27:52.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.282+0000 7fb5617fa640 1 -- 172.21.15.87:0/1225647731 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fb568032b50 con 0x7fb56c0fb430 2024-09-17T07:27:52.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.282+0000 7fb5617fa640 1 -- 172.21.15.87:0/1225647731 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb56803d9e0 con 0x7fb56c0fb430 2024-09-17T07:27:52.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.282+0000 7fb572a9a640 1 -- 172.21.15.87:0/1225647731 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb56c10e590 con 0x7fb56c0fb430 2024-09-17T07:27:52.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.282+0000 7fb572a9a640 1 -- 172.21.15.87:0/1225647731 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb56c10eb30 con 0x7fb56c0fb430 2024-09-17T07:27:52.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.283+0000 7fb572a9a640 1 -- 172.21.15.87:0/1225647731 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb56c0fa890 con 0x7fb56c0fb430 2024-09-17T07:27:52.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.283+0000 7fb5617fa640 1 -- 172.21.15.87:0/1225647731 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fb56802f030 con 0x7fb56c0fb430 2024-09-17T07:27:52.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.284+0000 7fb5617fa640 1 --2- 172.21.15.87:0/1225647731 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fb55406cb90 0x7fb55406f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:27:52.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.284+0000 7fb5617fa640 1 -- 172.21.15.87:0/1225647731 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fb5680ad4d0 con 0x7fb56c0fb430 2024-09-17T07:27:52.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.284+0000 7fb563fff640 1 --2- 172.21.15.87:0/1225647731 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fb55406cb90 0x7fb55406f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:27:52.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.284+0000 7fb563fff640 1 --2- 172.21.15.87:0/1225647731 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fb55406cb90 0x7fb55406f040 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb56c10cd60 tx=0x7fb55c00b040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:27:52.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.288+0000 7fb5617fa640 1 -- 172.21.15.87:0/1225647731 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb5680775d0 con 0x7fb56c0fb430 2024-09-17T07:27:52.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.493+0000 7fb572a9a640 1 -- 172.21.15.87:0/1225647731 --> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb56c10eeb0 con 0x7fb55406cb90 2024-09-17T07:27:52.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.495+0000 7fb5617fa640 1 -- 172.21.15.87:0/1225647731 <== mgr.24529 v2:172.21.15.87:6800/1359413180 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7fb56c10eeb0 con 0x7fb55406cb90 2024-09-17T07:27:52.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.497+0000 7fb572a9a640 1 -- 172.21.15.87:0/1225647731 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fb55406cb90 msgr2=0x7fb55406f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:27:52.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.497+0000 7fb572a9a640 1 --2- 172.21.15.87:0/1225647731 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fb55406cb90 0x7fb55406f040 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb56c10cd60 tx=0x7fb55c00b040 comp rx=0 tx=0).stop 2024-09-17T07:27:52.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.497+0000 7fb572a9a640 1 -- 172.21.15.87:0/1225647731 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb56c0fb430 msgr2=0x7fb56c10cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:27:52.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.497+0000 7fb572a9a640 1 --2- 172.21.15.87:0/1225647731 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb56c0fb430 0x7fb56c10cfb0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb568032470 tx=0x7fb568004d10 comp rx=0 tx=0).stop 2024-09-17T07:27:52.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.497+0000 7fb572a9a640 1 -- 172.21.15.87:0/1225647731 shutdown_connections 2024-09-17T07:27:52.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.497+0000 7fb572a9a640 1 --2- 172.21.15.87:0/1225647731 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fb55406cb90 0x7fb55406f040 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:52.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.497+0000 7fb572a9a640 1 --2- 172.21.15.87:0/1225647731 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb56c0fc700 0x7fb56c10d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:52.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.497+0000 7fb572a9a640 1 --2- 172.21.15.87:0/1225647731 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb56c0fb430 0x7fb56c10cfb0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:52.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.497+0000 7fb572a9a640 1 -- 172.21.15.87:0/1225647731 >> 172.21.15.87:0/1225647731 conn(0x7fb56c0f6c10 msgr2=0x7fb56c064f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:27:52.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.497+0000 7fb572a9a640 1 -- 172.21.15.87:0/1225647731 shutdown_connections 2024-09-17T07:27:52.498 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.497+0000 7fb572a9a640 1 -- 172.21.15.87:0/1225647731 wait complete. 2024-09-17T07:27:52.506 INFO:teuthology.orchestra.run.smithi087.stdout:true 2024-09-17T07:27:52.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.581+0000 7f22adb82640 1 -- 172.21.15.87:0/1657316155 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22a80fc540 msgr2=0x7f22a80fc950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:27:52.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.581+0000 7f22adb82640 1 --2- 172.21.15.87:0/1657316155 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22a80fc540 0x7f22a80fc950 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f22980048d0 tx=0x7f2298009da0 comp rx=0 tx=0).stop 2024-09-17T07:27:52.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.582+0000 7f22adb82640 1 -- 172.21.15.87:0/1657316155 shutdown_connections 2024-09-17T07:27:52.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.582+0000 7f22adb82640 1 --2- 172.21.15.87:0/1657316155 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f22a80fd810 0x7f22a80fdc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:52.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.582+0000 7f22adb82640 1 --2- 172.21.15.87:0/1657316155 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22a80fc540 0x7f22a80fc950 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:52.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.582+0000 7f22adb82640 1 -- 172.21.15.87:0/1657316155 >> 172.21.15.87:0/1657316155 conn(0x7f22a80f7d00 msgr2=0x7f22a80fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:27:52.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.582+0000 7f22adb82640 1 -- 172.21.15.87:0/1657316155 shutdown_connections 2024-09-17T07:27:52.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.582+0000 7f22adb82640 1 -- 172.21.15.87:0/1657316155 wait complete. 2024-09-17T07:27:52.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.582+0000 7f22adb82640 1 Processor -- start 2024-09-17T07:27:52.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.582+0000 7f22adb82640 1 -- start start 2024-09-17T07:27:52.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.582+0000 7f22adb82640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22a80fc540 0x7f22a810d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:27:52.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.582+0000 7f22adb82640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f22a80fd810 0x7f22a810d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:27:52.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.582+0000 7f22adb82640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22a810dba0 con 0x7f22a80fc540 2024-09-17T07:27:52.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.582+0000 7f22adb82640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22a810e350 con 0x7f22a80fd810 2024-09-17T07:27:52.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.583+0000 7f22a77fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22a80fc540 0x7f22a810d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:27:52.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.583+0000 7f22a77fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22a80fc540 0x7f22a810d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42020/0 (socket says 172.21.15.87:42020) 2024-09-17T07:27:52.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.583+0000 7f22a77fe640 1 -- 172.21.15.87:0/3907575713 learned_addr learned my addr 172.21.15.87:0/3907575713 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:27:52.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.583+0000 7f22a6ffd640 1 --2- 172.21.15.87:0/3907575713 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f22a80fd810 0x7f22a810d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:27:52.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.583+0000 7f22a77fe640 1 -- 172.21.15.87:0/3907575713 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f22a80fd810 msgr2=0x7f22a810d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:27:52.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.583+0000 7f22a77fe640 1 --2- 172.21.15.87:0/3907575713 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f22a80fd810 0x7f22a810d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:52.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.583+0000 7f22a77fe640 1 -- 172.21.15.87:0/3907575713 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2298005040 con 0x7f22a80fc540 2024-09-17T07:27:52.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.583+0000 7f22a77fe640 1 --2- 172.21.15.87:0/3907575713 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22a80fc540 0x7f22a810d010 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2298009ac0 tx=0x7f2298009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:27:52.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.583+0000 7f228ffff640 1 -- 172.21.15.87:0/3907575713 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2298038070 con 0x7f22a80fc540 2024-09-17T07:27:52.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.583+0000 7f228ffff640 1 -- 172.21.15.87:0/3907575713 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f229802ae70 con 0x7f22a80fc540 2024-09-17T07:27:52.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.583+0000 7f228ffff640 1 -- 172.21.15.87:0/3907575713 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2298033420 con 0x7f22a80fc540 2024-09-17T07:27:52.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.583+0000 7f22adb82640 1 -- 172.21.15.87:0/3907575713 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22a810e580 con 0x7f22a80fc540 2024-09-17T07:27:52.585 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.583+0000 7f22adb82640 1 -- 172.21.15.87:0/3907575713 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22a810eac0 con 0x7f22a80fc540 2024-09-17T07:27:52.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.584+0000 7f22adb82640 1 -- 172.21.15.87:0/3907575713 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22a80fb9a0 con 0x7f22a80fc540 2024-09-17T07:27:52.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.585+0000 7f228ffff640 1 -- 172.21.15.87:0/3907575713 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f2298030020 con 0x7f22a80fc540 2024-09-17T07:27:52.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.585+0000 7f228ffff640 1 --2- 172.21.15.87:0/3907575713 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f229006cb90 0x7f229006f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:27:52.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.585+0000 7f228ffff640 1 -- 172.21.15.87:0/3907575713 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f22980ac070 con 0x7f22a80fc540 2024-09-17T07:27:52.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.585+0000 7f22a6ffd640 1 --2- 172.21.15.87:0/3907575713 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f229006cb90 0x7f229006f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:27:52.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.586+0000 7f22a6ffd640 1 --2- 172.21.15.87:0/3907575713 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f229006cb90 0x7f229006f040 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f22a810cdc0 tx=0x7f229c009040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:27:52.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.589+0000 7f228ffff640 1 -- 172.21.15.87:0/3907575713 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f22980760b0 con 0x7f22a80fc540 2024-09-17T07:27:52.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.768+0000 7f22adb82640 1 -- 172.21.15.87:0/3907575713 --> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f22a810ee40 con 0x7f229006cb90 2024-09-17T07:27:52.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.769+0000 7f228ffff640 1 -- 172.21.15.87:0/3907575713 <== mgr.24529 v2:172.21.15.87:6800/1359413180 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7f22a810ee40 con 0x7f229006cb90 2024-09-17T07:27:52.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.771+0000 7f22adb82640 1 -- 172.21.15.87:0/3907575713 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f229006cb90 msgr2=0x7f229006f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:27:52.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.771+0000 7f22adb82640 1 --2- 172.21.15.87:0/3907575713 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f229006cb90 0x7f229006f040 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f22a810cdc0 tx=0x7f229c009040 comp rx=0 tx=0).stop 2024-09-17T07:27:52.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.771+0000 7f22adb82640 1 -- 172.21.15.87:0/3907575713 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22a80fc540 msgr2=0x7f22a810d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:27:52.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.771+0000 7f22adb82640 1 --2- 172.21.15.87:0/3907575713 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22a80fc540 0x7f22a810d010 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2298009ac0 tx=0x7f2298009da0 comp rx=0 tx=0).stop 2024-09-17T07:27:52.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.772+0000 7f22adb82640 1 -- 172.21.15.87:0/3907575713 shutdown_connections 2024-09-17T07:27:52.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.772+0000 7f22adb82640 1 --2- 172.21.15.87:0/3907575713 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f229006cb90 0x7f229006f040 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:52.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.772+0000 7f22adb82640 1 --2- 172.21.15.87:0/3907575713 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f22a80fd810 0x7f22a810d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:52.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.772+0000 7f22adb82640 1 --2- 172.21.15.87:0/3907575713 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22a80fc540 0x7f22a810d010 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:52.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.772+0000 7f22adb82640 1 -- 172.21.15.87:0/3907575713 >> 172.21.15.87:0/3907575713 conn(0x7f22a80f7d00 msgr2=0x7f22a80f9620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:27:52.772 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.772+0000 7f22adb82640 1 -- 172.21.15.87:0/3907575713 shutdown_connections 2024-09-17T07:27:52.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.772+0000 7f22adb82640 1 -- 172.21.15.87:0/3907575713 wait complete. 2024-09-17T07:27:52.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.850+0000 7efea6060640 1 -- 172.21.15.87:0/1648555960 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efea00fd820 msgr2=0x7efea00fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:27:52.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.850+0000 7efea6060640 1 --2- 172.21.15.87:0/1648555960 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efea00fd820 0x7efea00fdc90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7efe940048d0 tx=0x7efe94009da0 comp rx=0 tx=0).stop 2024-09-17T07:27:52.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.850+0000 7efea6060640 1 -- 172.21.15.87:0/1648555960 shutdown_connections 2024-09-17T07:27:52.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.850+0000 7efea6060640 1 --2- 172.21.15.87:0/1648555960 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efea00fd820 0x7efea00fdc90 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:52.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.850+0000 7efea6060640 1 --2- 172.21.15.87:0/1648555960 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efea00fc550 0x7efea00fc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:52.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.850+0000 7efea6060640 1 -- 172.21.15.87:0/1648555960 >> 172.21.15.87:0/1648555960 conn(0x7efea00f7d30 msgr2=0x7efea00fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:27:52.851 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:52 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:52.851 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:52 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:52.851 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:52 smithi087 ceph-mon[90982]: pgmap v215: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 170 B/s wr, 12 op/s 2024-09-17T07:27:52.851 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:52 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:52.852 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:52 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:52.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.851+0000 7efea6060640 1 -- 172.21.15.87:0/1648555960 shutdown_connections 2024-09-17T07:27:52.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.851+0000 7efea6060640 1 -- 172.21.15.87:0/1648555960 wait complete. 2024-09-17T07:27:52.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.851+0000 7efea6060640 1 Processor -- start 2024-09-17T07:27:52.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.851+0000 7efea6060640 1 -- start start 2024-09-17T07:27:52.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.852+0000 7efea6060640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efea00fc550 0x7efea010cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:27:52.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.852+0000 7efea6060640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efea00fd820 0x7efea010d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:27:52.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.852+0000 7efea6060640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efea010db60 con 0x7efea00fc550 2024-09-17T07:27:52.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.852+0000 7efea6060640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efea010e380 con 0x7efea00fd820 2024-09-17T07:27:52.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.852+0000 7efe9f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efea00fc550 0x7efea010cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:27:52.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.852+0000 7efe9f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efea00fc550 0x7efea010cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42040/0 (socket says 172.21.15.87:42040) 2024-09-17T07:27:52.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.852+0000 7efe9f7fe640 1 -- 172.21.15.87:0/49617730 learned_addr learned my addr 172.21.15.87:0/49617730 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:27:52.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.852+0000 7efe9effd640 1 --2- 172.21.15.87:0/49617730 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efea00fd820 0x7efea010d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:27:52.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.852+0000 7efe9f7fe640 1 -- 172.21.15.87:0/49617730 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efea00fd820 msgr2=0x7efea010d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:27:52.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.852+0000 7efe9f7fe640 1 --2- 172.21.15.87:0/49617730 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efea00fd820 0x7efea010d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:52.854 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.852+0000 7efe9f7fe640 1 -- 172.21.15.87:0/49617730 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe94005040 con 0x7efea00fc550 2024-09-17T07:27:52.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.852+0000 7efe9effd640 1 --2- 172.21.15.87:0/49617730 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efea00fd820 0x7efea010d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T07:27:52.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.852+0000 7efe9f7fe640 1 --2- 172.21.15.87:0/49617730 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efea00fc550 0x7efea010cfd0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7efe9000c810 tx=0x7efe900043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:27:52.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.852+0000 7efe87fff640 1 -- 172.21.15.87:0/49617730 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe9000a820 con 0x7efea00fc550 2024-09-17T07:27:52.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.852+0000 7efe87fff640 1 -- 172.21.15.87:0/49617730 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7efe9000ae00 con 0x7efea00fc550 2024-09-17T07:27:52.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.852+0000 7efea6060640 1 -- 172.21.15.87:0/49617730 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efea010e610 con 0x7efea00fc550 2024-09-17T07:27:52.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.852+0000 7efe87fff640 1 -- 172.21.15.87:0/49617730 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe90011380 con 0x7efea00fc550 2024-09-17T07:27:52.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.853+0000 7efea6060640 1 -- 172.21.15.87:0/49617730 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efea010ebb0 con 0x7efea00fc550 2024-09-17T07:27:52.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.853+0000 7efea6060640 1 -- 172.21.15.87:0/49617730 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efea00fb9b0 con 0x7efea00fc550 2024-09-17T07:27:52.856 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:52 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:52.856 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:52 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:52.856 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:52 smithi139 ceph-mon[79872]: pgmap v215: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 170 B/s wr, 12 op/s 2024-09-17T07:27:52.856 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:52 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:52.856 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:52 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:52.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.854+0000 7efe87fff640 1 -- 172.21.15.87:0/49617730 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7efe90012790 con 0x7efea00fc550 2024-09-17T07:27:52.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.854+0000 7efe87fff640 1 --2- 172.21.15.87:0/49617730 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7efe8806cb90 0x7efe8806f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:27:52.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.854+0000 7efe87fff640 1 -- 172.21.15.87:0/49617730 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6496+0+0 (secure 0 0 0) 0x7efe9008c570 con 0x7efea00fc550 2024-09-17T07:27:52.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.854+0000 7efe9effd640 1 --2- 172.21.15.87:0/49617730 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7efe8806cb90 0x7efe8806f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:27:52.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.855+0000 7efe9effd640 1 --2- 172.21.15.87:0/49617730 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7efe8806cb90 0x7efe8806f040 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7efe94009ac0 tx=0x7efe94035040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:27:52.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:52.859+0000 7efe87fff640 1 -- 172.21.15.87:0/49617730 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7efe9005a040 con 0x7efea00fc550 2024-09-17T07:27:53.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.064+0000 7efea6060640 1 -- 172.21.15.87:0/49617730 --> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7efea010efc0 con 0x7efe8806cb90 2024-09-17T07:27:53.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.073+0000 7efe87fff640 1 -- 172.21.15.87:0/49617730 <== mgr.24529 v2:172.21.15.87:6800/1359413180 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7efea010efc0 con 0x7efe8806cb90 2024-09-17T07:27:53.073 INFO:teuthology.orchestra.run.smithi087.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T07:27:53.073 INFO:teuthology.orchestra.run.smithi087.stdout:alertmanager.smithi087 smithi087 *:9093,9094 running (7m) 47s ago 15m 24.1M - 0.25.0 c8568f914cd2 594553f0b497 2024-09-17T07:27:53.073 INFO:teuthology.orchestra.run.smithi087.stdout:crash.smithi087 smithi087 running (5m) 47s ago 16m 6895k - 18.2.4-855-g19e2a2be 980a0bfcd684 0ff8a9330162 2024-09-17T07:27:53.073 INFO:teuthology.orchestra.run.smithi087.stdout:crash.smithi139 smithi139 running (5m) 1s ago 15m 6899k - 18.2.4-855-g19e2a2be 980a0bfcd684 10541e3b202e 2024-09-17T07:27:53.073 INFO:teuthology.orchestra.run.smithi087.stdout:grafana.smithi087 smithi087 *:3000 running (7m) 47s ago 15m 82.6M - 9.4.7 954c08fa6188 e2f17ec6baa8 2024-09-17T07:27:53.074 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi087.tjhpcs smithi087 running (52s) 47s ago 10m 11.6M - 18.2.4-855-g19e2a2be 980a0bfcd684 593471a4a9e2 2024-09-17T07:27:53.074 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi087.vvbzss smithi087 running (75s) 47s ago 10m 67.1M - 18.2.4-855-g19e2a2be 980a0bfcd684 e50f437839ed 2024-09-17T07:27:53.074 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi139.ftvinf smithi139 running (19s) 1s ago 10m 14.1M - 18.2.4-855-g19e2a2be 980a0bfcd684 17708393d8d9 2024-09-17T07:27:53.074 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi139.gnwonz smithi139 running (33s) 1s ago 10m 225M - 18.2.4-855-g19e2a2be 980a0bfcd684 6ae45fadd7a2 2024-09-17T07:27:53.074 INFO:teuthology.orchestra.run.smithi087.stdout:mgr.smithi087.vuvjer smithi087 *:8443,9283,8765 running (6m) 47s ago 17m 495M - 18.2.4-855-g19e2a2be 980a0bfcd684 5d10c647cb6b 2024-09-17T07:27:53.074 INFO:teuthology.orchestra.run.smithi087.stdout:mgr.smithi139.tuqnpn smithi139 *:8443,9283,8765 running (6m) 1s ago 14m 440M - 18.2.4-855-g19e2a2be 980a0bfcd684 6e0bf371d44c 2024-09-17T07:27:53.074 INFO:teuthology.orchestra.run.smithi087.stdout:mon.smithi087 smithi087 running (6m) 47s ago 17m 49.3M 2048M 18.2.4-855-g19e2a2be 980a0bfcd684 305c72de1f9f 2024-09-17T07:27:53.074 INFO:teuthology.orchestra.run.smithi087.stdout:mon.smithi139 smithi139 running (5m) 1s ago 14m 40.0M 2048M 18.2.4-855-g19e2a2be 980a0bfcd684 0b159495af0f 2024-09-17T07:27:53.074 INFO:teuthology.orchestra.run.smithi087.stdout:node-exporter.smithi087 smithi087 *:9100 starting - - - - 2024-09-17T07:27:53.074 INFO:teuthology.orchestra.run.smithi087.stdout:node-exporter.smithi139 smithi139 *:9100 running (3s) 1s ago 15m 3401k - 1.5.0 0da6a335fe13 6d18794119c8 2024-09-17T07:27:53.074 INFO:teuthology.orchestra.run.smithi087.stdout:osd.0 smithi087 running (4m) 47s ago 14m 95.8M 1557M 18.2.4-855-g19e2a2be 980a0bfcd684 e97cb50e6aec 2024-09-17T07:27:53.074 INFO:teuthology.orchestra.run.smithi087.stdout:osd.1 smithi087 running (4m) 47s ago 13m 101M 1557M 18.2.4-855-g19e2a2be 980a0bfcd684 b108771d0b8e 2024-09-17T07:27:53.074 INFO:teuthology.orchestra.run.smithi087.stdout:osd.2 smithi087 running (3m) 47s ago 13m 86.3M 1557M 18.2.4-855-g19e2a2be 980a0bfcd684 240cfb3b5366 2024-09-17T07:27:53.075 INFO:teuthology.orchestra.run.smithi087.stdout:osd.3 smithi139 running (3m) 1s ago 12m 115M 2581M 18.2.4-855-g19e2a2be 980a0bfcd684 b05ed3bf3f5c 2024-09-17T07:27:53.075 INFO:teuthology.orchestra.run.smithi087.stdout:osd.4 smithi139 running (2m) 1s ago 12m 99.6M 2581M 18.2.4-855-g19e2a2be 980a0bfcd684 139bbfc915c8 2024-09-17T07:27:53.075 INFO:teuthology.orchestra.run.smithi087.stdout:osd.5 smithi139 running (2m) 1s ago 11m 88.5M 2581M 18.2.4-855-g19e2a2be 980a0bfcd684 5058216f1ee0 2024-09-17T07:27:53.075 INFO:teuthology.orchestra.run.smithi087.stdout:prometheus.smithi087 smithi087 *:9095 running (6m) 47s ago 15m 65.4M - 2.43.0 a07b618ecd1d 63d18b7469fc 2024-09-17T07:27:53.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.075+0000 7efea6060640 1 -- 172.21.15.87:0/49617730 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7efe8806cb90 msgr2=0x7efe8806f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:27:53.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.075+0000 7efea6060640 1 --2- 172.21.15.87:0/49617730 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7efe8806cb90 0x7efe8806f040 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7efe94009ac0 tx=0x7efe94035040 comp rx=0 tx=0).stop 2024-09-17T07:27:53.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.075+0000 7efea6060640 1 -- 172.21.15.87:0/49617730 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efea00fc550 msgr2=0x7efea010cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:27:53.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.075+0000 7efea6060640 1 --2- 172.21.15.87:0/49617730 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efea00fc550 0x7efea010cfd0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7efe9000c810 tx=0x7efe900043c0 comp rx=0 tx=0).stop 2024-09-17T07:27:53.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.075+0000 7efea6060640 1 -- 172.21.15.87:0/49617730 shutdown_connections 2024-09-17T07:27:53.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.075+0000 7efea6060640 1 --2- 172.21.15.87:0/49617730 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7efe8806cb90 0x7efe8806f040 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:53.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.075+0000 7efea6060640 1 --2- 172.21.15.87:0/49617730 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efea00fd820 0x7efea010d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:53.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.075+0000 7efea6060640 1 --2- 172.21.15.87:0/49617730 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efea00fc550 0x7efea010cfd0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:53.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.075+0000 7efea6060640 1 -- 172.21.15.87:0/49617730 >> 172.21.15.87:0/49617730 conn(0x7efea00f7d30 msgr2=0x7efea00f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:27:53.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.075+0000 7efea6060640 1 -- 172.21.15.87:0/49617730 shutdown_connections 2024-09-17T07:27:53.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.075+0000 7efea6060640 1 -- 172.21.15.87:0/49617730 wait complete. 2024-09-17T07:27:53.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.152+0000 7f2ada30a640 1 -- 172.21.15.87:0/1838179595 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ad40fd7f0 msgr2=0x7f2ad40fdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:27:53.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.152+0000 7f2ada30a640 1 --2- 172.21.15.87:0/1838179595 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ad40fd7f0 0x7f2ad40fdc60 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2ac80048d0 tx=0x7f2ac8009da0 comp rx=0 tx=0).stop 2024-09-17T07:27:53.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.152+0000 7f2ada30a640 1 -- 172.21.15.87:0/1838179595 shutdown_connections 2024-09-17T07:27:53.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.152+0000 7f2ada30a640 1 --2- 172.21.15.87:0/1838179595 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ad40fd7f0 0x7f2ad40fdc60 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:53.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.152+0000 7f2ada30a640 1 --2- 172.21.15.87:0/1838179595 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2ad40fc520 0x7f2ad40fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:53.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.152+0000 7f2ada30a640 1 -- 172.21.15.87:0/1838179595 >> 172.21.15.87:0/1838179595 conn(0x7f2ad40f7ce0 msgr2=0x7f2ad40fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:27:53.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.152+0000 7f2ada30a640 1 -- 172.21.15.87:0/1838179595 shutdown_connections 2024-09-17T07:27:53.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.152+0000 7f2ada30a640 1 -- 172.21.15.87:0/1838179595 wait complete. 2024-09-17T07:27:53.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.152+0000 7f2ada30a640 1 Processor -- start 2024-09-17T07:27:53.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.152+0000 7f2ada30a640 1 -- start start 2024-09-17T07:27:53.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.153+0000 7f2ada30a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2ad40fc520 0x7f2ad410cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:27:53.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.153+0000 7f2ada30a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ad40fd7f0 0x7f2ad410d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:27:53.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.153+0000 7f2ada30a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad410db50 con 0x7f2ad40fd7f0 2024-09-17T07:27:53.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.153+0000 7f2ada30a640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad410e370 con 0x7f2ad40fc520 2024-09-17T07:27:53.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.153+0000 7f2ad37fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ad40fd7f0 0x7f2ad410d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:27:53.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.153+0000 7f2ad37fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ad40fd7f0 0x7f2ad410d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42072/0 (socket says 172.21.15.87:42072) 2024-09-17T07:27:53.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.153+0000 7f2ad37fe640 1 -- 172.21.15.87:0/1511960582 learned_addr learned my addr 172.21.15.87:0/1511960582 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:27:53.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.153+0000 7f2ad3fff640 1 --2- 172.21.15.87:0/1511960582 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2ad40fc520 0x7f2ad410cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:27:53.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.153+0000 7f2ad37fe640 1 -- 172.21.15.87:0/1511960582 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2ad40fc520 msgr2=0x7f2ad410cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:27:53.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.153+0000 7f2ad37fe640 1 --2- 172.21.15.87:0/1511960582 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2ad40fc520 0x7f2ad410cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:53.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.153+0000 7f2ad37fe640 1 -- 172.21.15.87:0/1511960582 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ac8005040 con 0x7f2ad40fd7f0 2024-09-17T07:27:53.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.153+0000 7f2ad37fe640 1 --2- 172.21.15.87:0/1511960582 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ad40fd7f0 0x7f2ad410d500 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2ac80043d0 tx=0x7f2ac8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:27:53.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.153+0000 7f2ad0ff9640 1 -- 172.21.15.87:0/1511960582 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ac8038070 con 0x7f2ad40fd7f0 2024-09-17T07:27:53.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.154+0000 7f2ada30a640 1 -- 172.21.15.87:0/1511960582 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ad410e5a0 con 0x7f2ad40fd7f0 2024-09-17T07:27:53.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.154+0000 7f2ad0ff9640 1 -- 172.21.15.87:0/1511960582 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f2ac80096c0 con 0x7f2ad40fd7f0 2024-09-17T07:27:53.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.154+0000 7f2ad0ff9640 1 -- 172.21.15.87:0/1511960582 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ac803d420 con 0x7f2ad40fd7f0 2024-09-17T07:27:53.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.154+0000 7f2ada30a640 1 -- 172.21.15.87:0/1511960582 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ad410eb40 con 0x7f2ad40fd7f0 2024-09-17T07:27:53.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.155+0000 7f2ada30a640 1 -- 172.21.15.87:0/1511960582 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ad40fb980 con 0x7f2ad40fd7f0 2024-09-17T07:27:53.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.155+0000 7f2ad0ff9640 1 -- 172.21.15.87:0/1511960582 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f2ac8030020 con 0x7f2ad40fd7f0 2024-09-17T07:27:53.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.156+0000 7f2ad0ff9640 1 --2- 172.21.15.87:0/1511960582 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f2abc06cb90 0x7f2abc06f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:27:53.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.156+0000 7f2ad0ff9640 1 -- 172.21.15.87:0/1511960582 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f2ac80ac6d0 con 0x7f2ad40fd7f0 2024-09-17T07:27:53.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.156+0000 7f2ad3fff640 1 --2- 172.21.15.87:0/1511960582 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f2abc06cb90 0x7f2abc06f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:27:53.157 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.156+0000 7f2ad3fff640 1 --2- 172.21.15.87:0/1511960582 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f2abc06cb90 0x7f2abc06f040 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2ac4004ed0 tx=0x7f2ac400b040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:27:53.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.160+0000 7f2ad0ff9640 1 -- 172.21.15.87:0/1511960582 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2ac8076690 con 0x7f2ad40fd7f0 2024-09-17T07:27:53.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.398+0000 7f2ada30a640 1 -- 172.21.15.87:0/1511960582 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2ad404b720 con 0x7f2ad40fd7f0 2024-09-17T07:27:53.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.399+0000 7f2ad0ff9640 1 -- 172.21.15.87:0/1511960582 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7f2ac8079cb0 con 0x7f2ad40fd7f0 2024-09-17T07:27:53.399 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T07:27:53.399 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": { 2024-09-17T07:27:53.399 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 2 2024-09-17T07:27:53.399 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:27:53.399 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr": { 2024-09-17T07:27:53.399 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 2 2024-09-17T07:27:53.399 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:27:53.399 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": { 2024-09-17T07:27:53.399 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 6 2024-09-17T07:27:53.400 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:27:53.400 INFO:teuthology.orchestra.run.smithi087.stdout: "mds": { 2024-09-17T07:27:53.400 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 4 2024-09-17T07:27:53.400 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:27:53.400 INFO:teuthology.orchestra.run.smithi087.stdout: "overall": { 2024-09-17T07:27:53.400 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 14 2024-09-17T07:27:53.400 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T07:27:53.400 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T07:27:53.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.401+0000 7f2ada30a640 1 -- 172.21.15.87:0/1511960582 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f2abc06cb90 msgr2=0x7f2abc06f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:27:53.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.401+0000 7f2ada30a640 1 --2- 172.21.15.87:0/1511960582 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f2abc06cb90 0x7f2abc06f040 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2ac4004ed0 tx=0x7f2ac400b040 comp rx=0 tx=0).stop 2024-09-17T07:27:53.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.401+0000 7f2ada30a640 1 -- 172.21.15.87:0/1511960582 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ad40fd7f0 msgr2=0x7f2ad410d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:27:53.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.401+0000 7f2ada30a640 1 --2- 172.21.15.87:0/1511960582 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ad40fd7f0 0x7f2ad410d500 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2ac80043d0 tx=0x7f2ac8009da0 comp rx=0 tx=0).stop 2024-09-17T07:27:53.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.401+0000 7f2ada30a640 1 -- 172.21.15.87:0/1511960582 shutdown_connections 2024-09-17T07:27:53.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.401+0000 7f2ada30a640 1 --2- 172.21.15.87:0/1511960582 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ad40fd7f0 0x7f2ad410d500 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:53.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.401+0000 7f2ada30a640 1 --2- 172.21.15.87:0/1511960582 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f2abc06cb90 0x7f2abc06f040 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:53.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.401+0000 7f2ada30a640 1 --2- 172.21.15.87:0/1511960582 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2ad40fc520 0x7f2ad410cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:53.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.401+0000 7f2ada30a640 1 -- 172.21.15.87:0/1511960582 >> 172.21.15.87:0/1511960582 conn(0x7f2ad40f7ce0 msgr2=0x7f2ad40f95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:27:53.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.401+0000 7f2ada30a640 1 -- 172.21.15.87:0/1511960582 shutdown_connections 2024-09-17T07:27:53.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.401+0000 7f2ada30a640 1 -- 172.21.15.87:0/1511960582 wait complete. 2024-09-17T07:27:53.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.480+0000 7fb45e307640 1 -- 172.21.15.87:0/2514673188 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb4580fd800 msgr2=0x7fb4580fdc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:27:53.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.480+0000 7fb45e307640 1 --2- 172.21.15.87:0/2514673188 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb4580fd800 0x7fb4580fdc70 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb44c0048d0 tx=0x7fb44c009da0 comp rx=0 tx=0).stop 2024-09-17T07:27:53.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.480+0000 7fb45e307640 1 -- 172.21.15.87:0/2514673188 shutdown_connections 2024-09-17T07:27:53.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.480+0000 7fb45e307640 1 --2- 172.21.15.87:0/2514673188 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb4580fd800 0x7fb4580fdc70 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:53.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.480+0000 7fb45e307640 1 --2- 172.21.15.87:0/2514673188 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb4580fc530 0x7fb4580fc940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:53.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.480+0000 7fb45e307640 1 -- 172.21.15.87:0/2514673188 >> 172.21.15.87:0/2514673188 conn(0x7fb4580f7d10 msgr2=0x7fb4580fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:27:53.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.480+0000 7fb45e307640 1 -- 172.21.15.87:0/2514673188 shutdown_connections 2024-09-17T07:27:53.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.480+0000 7fb45e307640 1 -- 172.21.15.87:0/2514673188 wait complete. 2024-09-17T07:27:53.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.480+0000 7fb45e307640 1 Processor -- start 2024-09-17T07:27:53.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.481+0000 7fb45e307640 1 -- start start 2024-09-17T07:27:53.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.481+0000 7fb45e307640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb4580fc530 0x7fb45810cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:27:53.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.481+0000 7fb45e307640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb4580fd800 0x7fb45810d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:27:53.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.481+0000 7fb45e307640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45810db40 con 0x7fb4580fd800 2024-09-17T07:27:53.482 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.481+0000 7fb45e307640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45810e360 con 0x7fb4580fc530 2024-09-17T07:27:53.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.481+0000 7fb4577fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb4580fd800 0x7fb45810d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:27:53.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.481+0000 7fb4577fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb4580fd800 0x7fb45810d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42088/0 (socket says 172.21.15.87:42088) 2024-09-17T07:27:53.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.481+0000 7fb4577fe640 1 -- 172.21.15.87:0/1981570615 learned_addr learned my addr 172.21.15.87:0/1981570615 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:27:53.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.481+0000 7fb457fff640 1 --2- 172.21.15.87:0/1981570615 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb4580fc530 0x7fb45810cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:27:53.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.481+0000 7fb4577fe640 1 -- 172.21.15.87:0/1981570615 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb4580fc530 msgr2=0x7fb45810cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:27:53.483 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.481+0000 7fb4577fe640 1 --2- 172.21.15.87:0/1981570615 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb4580fc530 0x7fb45810cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:53.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.481+0000 7fb4577fe640 1 -- 172.21.15.87:0/1981570615 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb44c005040 con 0x7fb4580fd800 2024-09-17T07:27:53.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.481+0000 7fb4577fe640 1 --2- 172.21.15.87:0/1981570615 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb4580fd800 0x7fb45810d4f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb44c00b020 tx=0x7fb44c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:27:53.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.482+0000 7fb454ff9640 1 -- 172.21.15.87:0/1981570615 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb44c038070 con 0x7fb4580fd800 2024-09-17T07:27:53.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.482+0000 7fb454ff9640 1 -- 172.21.15.87:0/1981570615 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fb44c02ae70 con 0x7fb4580fd800 2024-09-17T07:27:53.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.482+0000 7fb45e307640 1 -- 172.21.15.87:0/1981570615 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb45810e590 con 0x7fb4580fd800 2024-09-17T07:27:53.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.482+0000 7fb454ff9640 1 -- 172.21.15.87:0/1981570615 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb44c03d420 con 0x7fb4580fd800 2024-09-17T07:27:53.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.482+0000 7fb45e307640 1 -- 172.21.15.87:0/1981570615 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb45810eb30 con 0x7fb4580fd800 2024-09-17T07:27:53.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.483+0000 7fb45e307640 1 -- 172.21.15.87:0/1981570615 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4580fb990 con 0x7fb4580fd800 2024-09-17T07:27:53.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.483+0000 7fb454ff9640 1 -- 172.21.15.87:0/1981570615 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fb44c030020 con 0x7fb4580fd800 2024-09-17T07:27:53.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.483+0000 7fb454ff9640 1 --2- 172.21.15.87:0/1981570615 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fb44006cb90 0x7fb44006f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:27:53.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.484+0000 7fb454ff9640 1 -- 172.21.15.87:0/1981570615 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fb44c0ac6d0 con 0x7fb4580fd800 2024-09-17T07:27:53.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.484+0000 7fb457fff640 1 --2- 172.21.15.87:0/1981570615 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fb44006cb90 0x7fb44006f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:27:53.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.484+0000 7fb457fff640 1 --2- 172.21.15.87:0/1981570615 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fb44006cb90 0x7fb44006f040 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb4480041d0 tx=0x7fb448004330 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:27:53.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.488+0000 7fb454ff9640 1 -- 172.21.15.87:0/1981570615 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb44c076710 con 0x7fb4580fd800 2024-09-17T07:27:53.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.695+0000 7fb45e307640 1 -- 172.21.15.87:0/1981570615 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb45804b720 con 0x7fb4580fd800 2024-09-17T07:27:53.696 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:53 smithi087 ceph-mon[90982]: from='client.34484 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:27:53.696 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:53 smithi087 ceph-mon[90982]: from='client.34488 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:27:53.696 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:53 smithi087 ceph-mon[90982]: from='client.34492 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:27:53.696 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:53 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/1511960582' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:27:53.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.696+0000 7fb454ff9640 1 -- 172.21.15.87:0/1981570615 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 43 v43) v1 ==== 76+0+1872 (secure 0 0 0) 0x7fb44c035050 con 0x7fb4580fd800 2024-09-17T07:27:53.696 INFO:teuthology.orchestra.run.smithi087.stdout:e43 2024-09-17T07:27:53.696 INFO:teuthology.orchestra.run.smithi087.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T07:27:53.697 INFO:teuthology.orchestra.run.smithi087.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T07:27:53.697 INFO:teuthology.orchestra.run.smithi087.stdout:legacy client fscid: 1 2024-09-17T07:27:53.697 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:27:53.697 INFO:teuthology.orchestra.run.smithi087.stdout:Filesystem 'cephfs' (1) 2024-09-17T07:27:53.697 INFO:teuthology.orchestra.run.smithi087.stdout:fs_name cephfs 2024-09-17T07:27:53.697 INFO:teuthology.orchestra.run.smithi087.stdout:epoch 43 2024-09-17T07:27:53.697 INFO:teuthology.orchestra.run.smithi087.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T07:27:53.697 INFO:teuthology.orchestra.run.smithi087.stdout:created 2024-09-17T07:17:15.368053+0000 2024-09-17T07:27:53.697 INFO:teuthology.orchestra.run.smithi087.stdout:modified 2024-09-17T07:27:41.863112+0000 2024-09-17T07:27:53.697 INFO:teuthology.orchestra.run.smithi087.stdout:tableserver 0 2024-09-17T07:27:53.697 INFO:teuthology.orchestra.run.smithi087.stdout:root 0 2024-09-17T07:27:53.697 INFO:teuthology.orchestra.run.smithi087.stdout:session_timeout 60 2024-09-17T07:27:53.697 INFO:teuthology.orchestra.run.smithi087.stdout:session_autoclose 300 2024-09-17T07:27:53.698 INFO:teuthology.orchestra.run.smithi087.stdout:max_file_size 1099511627776 2024-09-17T07:27:53.698 INFO:teuthology.orchestra.run.smithi087.stdout:max_xattr_size 65536 2024-09-17T07:27:53.698 INFO:teuthology.orchestra.run.smithi087.stdout:required_client_features {} 2024-09-17T07:27:53.698 INFO:teuthology.orchestra.run.smithi087.stdout:last_failure 0 2024-09-17T07:27:53.698 INFO:teuthology.orchestra.run.smithi087.stdout:last_failure_osd_epoch 80 2024-09-17T07:27:53.698 INFO:teuthology.orchestra.run.smithi087.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T07:27:53.698 INFO:teuthology.orchestra.run.smithi087.stdout:max_mds 2 2024-09-17T07:27:53.698 INFO:teuthology.orchestra.run.smithi087.stdout:in 0,1 2024-09-17T07:27:53.698 INFO:teuthology.orchestra.run.smithi087.stdout:up {0=34412,1=34444} 2024-09-17T07:27:53.698 INFO:teuthology.orchestra.run.smithi087.stdout:failed 2024-09-17T07:27:53.698 INFO:teuthology.orchestra.run.smithi087.stdout:damaged 2024-09-17T07:27:53.698 INFO:teuthology.orchestra.run.smithi087.stdout:stopped 2024-09-17T07:27:53.698 INFO:teuthology.orchestra.run.smithi087.stdout:data_pools [3] 2024-09-17T07:27:53.698 INFO:teuthology.orchestra.run.smithi087.stdout:metadata_pool 2 2024-09-17T07:27:53.699 INFO:teuthology.orchestra.run.smithi087.stdout:inline_data enabled 2024-09-17T07:27:53.699 INFO:teuthology.orchestra.run.smithi087.stdout:balancer 2024-09-17T07:27:53.699 INFO:teuthology.orchestra.run.smithi087.stdout:bal_rank_mask -1 2024-09-17T07:27:53.699 INFO:teuthology.orchestra.run.smithi087.stdout:standby_count_wanted 1 2024-09-17T07:27:53.699 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi087.vvbzss{0:34412} state up:active seq 8 join_fscid=1 addr [v2:172.21.15.87:6826/1050918039,v1:172.21.15.87:6827/1050918039] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:27:53.699 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi139.gnwonz{0:44325} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.139:6824/1289261341,v1:172.21.15.139:6825/1289261341] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:27:53.699 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi087.tjhpcs{1:34444} state up:active seq 11 join_fscid=1 addr [v2:172.21.15.87:6828/2375971201,v1:172.21.15.87:6829/2375971201] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:27:53.699 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi139.ftvinf{1:44347} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.139:6826/1126774601,v1:172.21.15.139:6827/1126774601] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:27:53.699 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:27:53.699 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:27:53.700 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 43 2024-09-17T07:27:53.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.698+0000 7fb45e307640 1 -- 172.21.15.87:0/1981570615 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fb44006cb90 msgr2=0x7fb44006f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:27:53.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.698+0000 7fb45e307640 1 --2- 172.21.15.87:0/1981570615 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fb44006cb90 0x7fb44006f040 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb4480041d0 tx=0x7fb448004330 comp rx=0 tx=0).stop 2024-09-17T07:27:53.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.698+0000 7fb45e307640 1 -- 172.21.15.87:0/1981570615 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb4580fd800 msgr2=0x7fb45810d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:27:53.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.698+0000 7fb45e307640 1 --2- 172.21.15.87:0/1981570615 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb4580fd800 0x7fb45810d4f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb44c00b020 tx=0x7fb44c009da0 comp rx=0 tx=0).stop 2024-09-17T07:27:53.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.698+0000 7fb45e307640 1 -- 172.21.15.87:0/1981570615 shutdown_connections 2024-09-17T07:27:53.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.698+0000 7fb45e307640 1 --2- 172.21.15.87:0/1981570615 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb4580fd800 0x7fb45810d4f0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:53.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.698+0000 7fb45e307640 1 --2- 172.21.15.87:0/1981570615 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fb44006cb90 0x7fb44006f040 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:53.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.698+0000 7fb45e307640 1 --2- 172.21.15.87:0/1981570615 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb4580fc530 0x7fb45810cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:53.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.698+0000 7fb45e307640 1 -- 172.21.15.87:0/1981570615 >> 172.21.15.87:0/1981570615 conn(0x7fb4580f7d10 msgr2=0x7fb4580f95c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:27:53.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.698+0000 7fb45e307640 1 -- 172.21.15.87:0/1981570615 shutdown_connections 2024-09-17T07:27:53.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.698+0000 7fb45e307640 1 -- 172.21.15.87:0/1981570615 wait complete. 2024-09-17T07:27:53.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.789+0000 7f3fa842d640 1 -- 172.21.15.87:0/2177538498 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fa0065be0 msgr2=0x7f3fa00ff1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:27:53.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.789+0000 7f3fa842d640 1 --2- 172.21.15.87:0/2177538498 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fa0065be0 0x7f3fa00ff1a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c0048d0 tx=0x7f3f9c009da0 comp rx=0 tx=0).stop 2024-09-17T07:27:53.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.789+0000 7f3fa842d640 1 -- 172.21.15.87:0/2177538498 shutdown_connections 2024-09-17T07:27:53.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.789+0000 7f3fa842d640 1 --2- 172.21.15.87:0/2177538498 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3fa00ff6e0 0x7f3fa0101ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:53.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.789+0000 7f3fa842d640 1 --2- 172.21.15.87:0/2177538498 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fa0065be0 0x7f3fa00ff1a0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:53.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.789+0000 7f3fa842d640 1 -- 172.21.15.87:0/2177538498 >> 172.21.15.87:0/2177538498 conn(0x7f3fa00f6c10 msgr2=0x7f3fa00f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:27:53.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.789+0000 7f3fa842d640 1 -- 172.21.15.87:0/2177538498 shutdown_connections 2024-09-17T07:27:53.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.789+0000 7f3fa842d640 1 -- 172.21.15.87:0/2177538498 wait complete. 2024-09-17T07:27:53.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.790+0000 7f3fa842d640 1 Processor -- start 2024-09-17T07:27:53.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.790+0000 7f3fa842d640 1 -- start start 2024-09-17T07:27:53.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.790+0000 7f3fa842d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fa0065be0 0x7f3fa00fcb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:27:53.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.790+0000 7f3fa61c9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fa0065be0 0x7f3fa00fcb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:27:53.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.790+0000 7f3fa61c9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fa0065be0 0x7f3fa00fcb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42118/0 (socket says 172.21.15.87:42118) 2024-09-17T07:27:53.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.790+0000 7f3fa842d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3fa00ff6e0 0x7f3fa00fb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:27:53.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.790+0000 7f3fa61c9640 1 -- 172.21.15.87:0/228841765 learned_addr learned my addr 172.21.15.87:0/228841765 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:27:53.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.790+0000 7f3fa842d640 1 -- 172.21.15.87:0/228841765 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa00fb5e0 con 0x7f3fa0065be0 2024-09-17T07:27:53.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.790+0000 7f3fa842d640 1 -- 172.21.15.87:0/228841765 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa00fb720 con 0x7f3fa00ff6e0 2024-09-17T07:27:53.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.790+0000 7f3fa61c9640 1 -- 172.21.15.87:0/228841765 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3fa00ff6e0 msgr2=0x7f3fa00fb0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:27:53.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.790+0000 7f3fa61c9640 1 --2- 172.21.15.87:0/228841765 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3fa00ff6e0 0x7f3fa00fb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:53.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.790+0000 7f3fa61c9640 1 -- 172.21.15.87:0/228841765 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f9c005040 con 0x7f3fa0065be0 2024-09-17T07:27:53.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.791+0000 7f3fa61c9640 1 --2- 172.21.15.87:0/228841765 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fa0065be0 0x7f3fa00fcb60 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c000c00 tx=0x7f3f9c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:27:53.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.791+0000 7f3f96ffd640 1 -- 172.21.15.87:0/228841765 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f9c038070 con 0x7f3fa0065be0 2024-09-17T07:27:53.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.791+0000 7f3fa842d640 1 -- 172.21.15.87:0/228841765 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fa00fb9a0 con 0x7f3fa0065be0 2024-09-17T07:27:53.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.791+0000 7f3f96ffd640 1 -- 172.21.15.87:0/228841765 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f3f9c033a80 con 0x7f3fa0065be0 2024-09-17T07:27:53.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.791+0000 7f3fa842d640 1 -- 172.21.15.87:0/228841765 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fa00fbee0 con 0x7f3fa0065be0 2024-09-17T07:27:53.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.791+0000 7f3f96ffd640 1 -- 172.21.15.87:0/228841765 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f9c03c830 con 0x7f3fa0065be0 2024-09-17T07:27:53.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.792+0000 7f3fa842d640 1 -- 172.21.15.87:0/228841765 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f84005240 con 0x7f3fa0065be0 2024-09-17T07:27:53.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.792+0000 7f3f96ffd640 1 -- 172.21.15.87:0/228841765 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f3f9c030020 con 0x7f3fa0065be0 2024-09-17T07:27:53.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.793+0000 7f3f96ffd640 1 --2- 172.21.15.87:0/228841765 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f3f8c06cb90 0x7f3f8c06f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:27:53.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.793+0000 7f3f96ffd640 1 -- 172.21.15.87:0/228841765 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f3f9c0ac030 con 0x7f3fa0065be0 2024-09-17T07:27:53.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.793+0000 7f3fa59c8640 1 --2- 172.21.15.87:0/228841765 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f3f8c06cb90 0x7f3f8c06f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:27:53.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.793+0000 7f3fa59c8640 1 --2- 172.21.15.87:0/228841765 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f3f8c06cb90 0x7f3f8c06f040 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3f90004a50 tx=0x7f3f90007cb0 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:27:53.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.797+0000 7f3f96ffd640 1 -- 172.21.15.87:0/228841765 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f3f9c076070 con 0x7f3fa0065be0 2024-09-17T07:27:53.851 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:53 smithi139 ceph-mon[79872]: from='client.34484 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:27:53.851 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:53 smithi139 ceph-mon[79872]: from='client.34488 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:27:53.852 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:53 smithi139 ceph-mon[79872]: from='client.34492 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:27:53.852 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:53 smithi139 ceph-mon[79872]: from='client.? 172.21.15.87:0/1511960582' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:27:53.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.986+0000 7f3fa842d640 1 -- 172.21.15.87:0/228841765 --> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3f84000bf0 con 0x7f3f8c06cb90 2024-09-17T07:27:53.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.988+0000 7f3f96ffd640 1 -- 172.21.15.87:0/228841765 <== mgr.24529 v2:172.21.15.87:6800/1359413180 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7f3f84000bf0 con 0x7f3f8c06cb90 2024-09-17T07:27:53.988 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T07:27:53.988 INFO:teuthology.orchestra.run.smithi087.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9", 2024-09-17T07:27:53.988 INFO:teuthology.orchestra.run.smithi087.stdout: "in_progress": true, 2024-09-17T07:27:53.988 INFO:teuthology.orchestra.run.smithi087.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T07:27:53.988 INFO:teuthology.orchestra.run.smithi087.stdout: "services_complete": [ 2024-09-17T07:27:53.988 INFO:teuthology.orchestra.run.smithi087.stdout: "mds", 2024-09-17T07:27:53.988 INFO:teuthology.orchestra.run.smithi087.stdout: "mon", 2024-09-17T07:27:53.988 INFO:teuthology.orchestra.run.smithi087.stdout: "crash", 2024-09-17T07:27:53.988 INFO:teuthology.orchestra.run.smithi087.stdout: "osd", 2024-09-17T07:27:53.988 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr" 2024-09-17T07:27:53.989 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-17T07:27:53.989 INFO:teuthology.orchestra.run.smithi087.stdout: "progress": "16/21 daemons upgraded", 2024-09-17T07:27:53.989 INFO:teuthology.orchestra.run.smithi087.stdout: "message": "Currently upgrading node-exporter daemons", 2024-09-17T07:27:53.989 INFO:teuthology.orchestra.run.smithi087.stdout: "is_paused": false 2024-09-17T07:27:53.989 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T07:27:53.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.990+0000 7f3fa842d640 1 -- 172.21.15.87:0/228841765 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f3f8c06cb90 msgr2=0x7f3f8c06f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:27:53.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.990+0000 7f3fa842d640 1 --2- 172.21.15.87:0/228841765 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f3f8c06cb90 0x7f3f8c06f040 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3f90004a50 tx=0x7f3f90007cb0 comp rx=0 tx=0).stop 2024-09-17T07:27:53.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.990+0000 7f3fa842d640 1 -- 172.21.15.87:0/228841765 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fa0065be0 msgr2=0x7f3fa00fcb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:27:53.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.990+0000 7f3fa842d640 1 --2- 172.21.15.87:0/228841765 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fa0065be0 0x7f3fa00fcb60 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c000c00 tx=0x7f3f9c009da0 comp rx=0 tx=0).stop 2024-09-17T07:27:53.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.990+0000 7f3fa842d640 1 -- 172.21.15.87:0/228841765 shutdown_connections 2024-09-17T07:27:53.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.990+0000 7f3fa842d640 1 --2- 172.21.15.87:0/228841765 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f3f8c06cb90 0x7f3f8c06f040 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:53.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.990+0000 7f3fa842d640 1 --2- 172.21.15.87:0/228841765 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3fa00ff6e0 0x7f3fa00fb0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:53.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.990+0000 7f3fa842d640 1 --2- 172.21.15.87:0/228841765 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fa0065be0 0x7f3fa00fcb60 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:53.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.990+0000 7f3fa842d640 1 -- 172.21.15.87:0/228841765 >> 172.21.15.87:0/228841765 conn(0x7f3fa00f6c10 msgr2=0x7f3fa00f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:27:53.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.990+0000 7f3fa842d640 1 -- 172.21.15.87:0/228841765 shutdown_connections 2024-09-17T07:27:53.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:53.990+0000 7f3fa842d640 1 -- 172.21.15.87:0/228841765 wait complete. 2024-09-17T07:27:54.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:54.072+0000 7feb93762640 1 -- 172.21.15.87:0/3973452428 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb8c0fc540 msgr2=0x7feb8c0fc950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:27:54.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:54.072+0000 7feb93762640 1 --2- 172.21.15.87:0/3973452428 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb8c0fc540 0x7feb8c0fc950 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7feb880048d0 tx=0x7feb88009da0 comp rx=0 tx=0).stop 2024-09-17T07:27:54.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:54.072+0000 7feb93762640 1 -- 172.21.15.87:0/3973452428 shutdown_connections 2024-09-17T07:27:54.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:54.072+0000 7feb93762640 1 --2- 172.21.15.87:0/3973452428 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feb8c0fd810 0x7feb8c0fdc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:54.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:54.072+0000 7feb93762640 1 --2- 172.21.15.87:0/3973452428 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb8c0fc540 0x7feb8c0fc950 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:54.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:54.072+0000 7feb93762640 1 -- 172.21.15.87:0/3973452428 >> 172.21.15.87:0/3973452428 conn(0x7feb8c0f7d00 msgr2=0x7feb8c0fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:27:54.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:54.072+0000 7feb93762640 1 -- 172.21.15.87:0/3973452428 shutdown_connections 2024-09-17T07:27:54.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:54.072+0000 7feb93762640 1 -- 172.21.15.87:0/3973452428 wait complete. 2024-09-17T07:27:54.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:54.073+0000 7feb93762640 1 Processor -- start 2024-09-17T07:27:54.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:54.073+0000 7feb93762640 1 -- start start 2024-09-17T07:27:54.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:54.073+0000 7feb93762640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb8c0fc540 0x7feb8c071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:27:54.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:54.073+0000 7feb93762640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feb8c0fd810 0x7feb8c06fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:27:54.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:54.073+0000 7feb93762640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb8c06fff0 con 0x7feb8c0fc540 2024-09-17T07:27:54.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:54.073+0000 7feb93762640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb8c070130 con 0x7feb8c0fd810 2024-09-17T07:27:54.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:54.073+0000 7feb914fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb8c0fc540 0x7feb8c071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:27:54.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:54.073+0000 7feb914fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb8c0fc540 0x7feb8c071570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42128/0 (socket says 172.21.15.87:42128) 2024-09-17T07:27:54.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:54.073+0000 7feb914fe640 1 -- 172.21.15.87:0/1701018215 learned_addr learned my addr 172.21.15.87:0/1701018215 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:27:54.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:54.073+0000 7feb90cfd640 1 --2- 172.21.15.87:0/1701018215 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feb8c0fd810 0x7feb8c06fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:27:54.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:54.073+0000 7feb914fe640 1 -- 172.21.15.87:0/1701018215 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feb8c0fd810 msgr2=0x7feb8c06fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:27:54.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:54.073+0000 7feb914fe640 1 --2- 172.21.15.87:0/1701018215 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feb8c0fd810 0x7feb8c06fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:54.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:54.073+0000 7feb914fe640 1 -- 172.21.15.87:0/1701018215 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb88005040 con 0x7feb8c0fc540 2024-09-17T07:27:54.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:54.073+0000 7feb914fe640 1 --2- 172.21.15.87:0/1701018215 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb8c0fc540 0x7feb8c071570 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7feb880043d0 tx=0x7feb88009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:27:54.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:54.074+0000 7feb81ffb640 1 -- 172.21.15.87:0/1701018215 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb88038070 con 0x7feb8c0fc540 2024-09-17T07:27:54.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:54.074+0000 7feb81ffb640 1 -- 172.21.15.87:0/1701018215 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7feb880096c0 con 0x7feb8c0fc540 2024-09-17T07:27:54.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:54.074+0000 7feb93762640 1 -- 172.21.15.87:0/1701018215 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb8c0703b0 con 0x7feb8c0fc540 2024-09-17T07:27:54.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:54.074+0000 7feb81ffb640 1 -- 172.21.15.87:0/1701018215 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb8803d420 con 0x7feb8c0fc540 2024-09-17T07:27:54.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:54.074+0000 7feb93762640 1 -- 172.21.15.87:0/1701018215 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb8c114fc0 con 0x7feb8c0fc540 2024-09-17T07:27:54.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:54.075+0000 7feb93762640 1 -- 172.21.15.87:0/1701018215 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb8c0fb9a0 con 0x7feb8c0fc540 2024-09-17T07:27:54.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:54.075+0000 7feb81ffb640 1 -- 172.21.15.87:0/1701018215 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7feb88030020 con 0x7feb8c0fc540 2024-09-17T07:27:54.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:54.076+0000 7feb81ffb640 1 --2- 172.21.15.87:0/1701018215 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7feb7806cb90 0x7feb7806f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:27:54.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:54.076+0000 7feb81ffb640 1 -- 172.21.15.87:0/1701018215 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6496+0+0 (secure 0 0 0) 0x7feb880ac5f0 con 0x7feb8c0fc540 2024-09-17T07:27:54.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:54.076+0000 7feb90cfd640 1 --2- 172.21.15.87:0/1701018215 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7feb7806cb90 0x7feb7806f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:27:54.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:54.076+0000 7feb90cfd640 1 --2- 172.21.15.87:0/1701018215 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7feb7806cb90 0x7feb7806f040 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7feb7c004eb0 tx=0x7feb7c00b040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:27:54.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:54.080+0000 7feb81ffb640 1 -- 172.21.15.87:0/1701018215 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7feb88076630 con 0x7feb8c0fc540 2024-09-17T07:27:54.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:54.317+0000 7feb93762640 1 -- 172.21.15.87:0/1701018215 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7feb8c04b720 con 0x7feb8c0fc540 2024-09-17T07:27:54.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:54.317+0000 7feb81ffb640 1 -- 172.21.15.87:0/1701018215 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7feb88079c50 con 0x7feb8c0fc540 2024-09-17T07:27:54.318 INFO:teuthology.orchestra.run.smithi087.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T07:27:54.318 INFO:teuthology.orchestra.run.smithi087.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T07:27:54.318 INFO:teuthology.orchestra.run.smithi087.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T07:27:54.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:54.320+0000 7feb93762640 1 -- 172.21.15.87:0/1701018215 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7feb7806cb90 msgr2=0x7feb7806f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:27:54.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:54.320+0000 7feb93762640 1 --2- 172.21.15.87:0/1701018215 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7feb7806cb90 0x7feb7806f040 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7feb7c004eb0 tx=0x7feb7c00b040 comp rx=0 tx=0).stop 2024-09-17T07:27:54.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:54.320+0000 7feb93762640 1 -- 172.21.15.87:0/1701018215 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb8c0fc540 msgr2=0x7feb8c071570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:27:54.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:54.320+0000 7feb93762640 1 --2- 172.21.15.87:0/1701018215 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb8c0fc540 0x7feb8c071570 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7feb880043d0 tx=0x7feb88009da0 comp rx=0 tx=0).stop 2024-09-17T07:27:54.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:54.320+0000 7feb93762640 1 -- 172.21.15.87:0/1701018215 shutdown_connections 2024-09-17T07:27:54.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:54.320+0000 7feb93762640 1 --2- 172.21.15.87:0/1701018215 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7feb7806cb90 0x7feb7806f040 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:54.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:54.320+0000 7feb93762640 1 --2- 172.21.15.87:0/1701018215 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feb8c0fd810 0x7feb8c06fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:54.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:54.320+0000 7feb93762640 1 --2- 172.21.15.87:0/1701018215 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb8c0fc540 0x7feb8c071570 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:27:54.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:54.320+0000 7feb93762640 1 -- 172.21.15.87:0/1701018215 >> 172.21.15.87:0/1701018215 conn(0x7feb8c0f7d00 msgr2=0x7feb8c0f9580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:27:54.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:54.320+0000 7feb93762640 1 -- 172.21.15.87:0/1701018215 shutdown_connections 2024-09-17T07:27:54.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:27:54.320+0000 7feb93762640 1 -- 172.21.15.87:0/1701018215 wait complete. 2024-09-17T07:27:54.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:54 smithi139 ceph-mon[79872]: from='client.? 172.21.15.87:0/1981570615' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T07:27:54.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:54 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:54.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:54 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:54.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:54 smithi139 ceph-mon[79872]: from='client.34504 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:27:54.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:54 smithi139 ceph-mon[79872]: pgmap v216: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 170 B/s wr, 14 op/s 2024-09-17T07:27:54.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:54 smithi139 ceph-mon[79872]: from='client.? 172.21.15.87:0/1701018215' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T07:27:54.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:54 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:54.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:54 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:54.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:54 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/1981570615' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T07:27:54.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:54 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:54.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:54 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:54.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:54 smithi087 ceph-mon[90982]: from='client.34504 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:27:54.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:54 smithi087 ceph-mon[90982]: pgmap v216: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 170 B/s wr, 14 op/s 2024-09-17T07:27:54.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:54 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/1701018215' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T07:27:54.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:54 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:54.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:54 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:56.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:56 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:56.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:56 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:56.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:56 smithi087 ceph-mon[90982]: pgmap v217: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 9.3 MiB/s rd, 0 B/s wr, 6 op/s 2024-09-17T07:27:56.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:56 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:56.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:56 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:56.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:56 smithi139 ceph-mon[79872]: pgmap v217: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 9.3 MiB/s rd, 0 B/s wr, 6 op/s 2024-09-17T07:27:58.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:58 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:58.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:58 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:58.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:58 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:27:58.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:58 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:27:58.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:58 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:58.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:58 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:27:58.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:58 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:27:58.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:58 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:27:58.927 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:58 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:27:58.928 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:58 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:27:58.928 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:58 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:27:58.928 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:58 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:27:58.928 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:58 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:27:58.928 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:58 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:27:58.928 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:58 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:27:58.928 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:58 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:27:58.928 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:58 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:27:58.928 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:58 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:27:58.928 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:58 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:27:58.928 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:58 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:27:58.928 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:27:58 smithi087 ceph-mon[90982]: pgmap v218: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 6.0 MiB/s rd, 0 B/s wr, 4 op/s 2024-09-17T07:27:59.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:58 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:59.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:58 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:59.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:58 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:27:59.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:58 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:27:59.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:58 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:27:59.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:58 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:27:59.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:58 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:27:59.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:58 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:27:59.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:58 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:27:59.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:58 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:27:59.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:58 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:27:59.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:58 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:27:59.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:58 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:27:59.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:58 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:27:59.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:58 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:27:59.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:58 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:27:59.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:58 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:27:59.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:58 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:27:59.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:58 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:27:59.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:58 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:27:59.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:27:58 smithi139 ceph-mon[79872]: pgmap v218: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 6.0 MiB/s rd, 0 B/s wr, 4 op/s 2024-09-17T07:28:01.502 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:01 smithi087 ceph-mon[90982]: Upgrade: Updating prometheus.smithi087 2024-09-17T07:28:01.502 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:01 smithi087 ceph-mon[90982]: Deploying daemon prometheus.smithi087 on smithi087 2024-09-17T07:28:01.502 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:01 smithi087 ceph-mon[90982]: pgmap v219: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.7 MiB/s rd, 4 op/s 2024-09-17T07:28:01.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:01 smithi139 ceph-mon[79872]: Upgrade: Updating prometheus.smithi087 2024-09-17T07:28:01.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:01 smithi139 ceph-mon[79872]: Deploying daemon prometheus.smithi087 on smithi087 2024-09-17T07:28:01.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:01 smithi139 ceph-mon[79872]: pgmap v219: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.7 MiB/s rd, 4 op/s 2024-09-17T07:28:03.300 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:03 smithi087 ceph-mon[90982]: pgmap v220: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 684 KiB/s rd, 3 op/s 2024-09-17T07:28:03.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:03 smithi139 ceph-mon[79872]: pgmap v220: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 684 KiB/s rd, 3 op/s 2024-09-17T07:28:05.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:05 smithi087 ceph-mon[90982]: pgmap v221: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:28:05.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:05 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:28:05.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:05 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:28:05.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:05 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:28:05.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:05 smithi139 ceph-mon[79872]: pgmap v221: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:28:05.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:05 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:28:05.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:05 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:28:05.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:05 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:28:07.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:07 smithi087 ceph-mon[90982]: pgmap v222: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:28:07.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:07 smithi139 ceph-mon[79872]: pgmap v222: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:28:09.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:09 smithi139 ceph-mon[79872]: pgmap v223: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:28:09.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:09 smithi087 ceph-mon[90982]: pgmap v223: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:28:10.385 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:10 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:28:10.385 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:10 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:28:10.385 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:10 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:28:10.385 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:10 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:28:10.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:10 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:28:10.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:10 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:28:10.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:10 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:28:10.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:10 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:28:11.320 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:11 smithi087 ceph-mon[90982]: pgmap v224: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:28:11.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:11 smithi139 ceph-mon[79872]: pgmap v224: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:28:13.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:13 smithi087 ceph-mon[90982]: pgmap v225: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:28:13.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:13 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:28:13.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:13 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:28:13.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:13 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:28:13.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:13 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:28:13.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:13 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:28:13.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:13 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:28:13.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:13 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T07:28:13.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:13 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:28:13.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:13 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:13.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:13 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:13.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:13 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:13.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:13 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:13.428 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:13 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:13.428 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:13 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:13.428 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:13 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:13.428 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:13 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:13.428 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:13 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:13.428 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:13 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:13.428 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:13 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:13.428 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:13 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:13.428 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:13 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:13.428 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:13 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:13.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:13 smithi139 ceph-mon[79872]: pgmap v225: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:28:13.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:13 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:28:13.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:13 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:28:13.618 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:13 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:28:13.618 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:13 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:28:13.618 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:13 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:28:13.618 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:13 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:28:13.618 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:13 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T07:28:13.618 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:13 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:28:13.619 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:13 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:13.619 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:13 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:13.619 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:13 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:13.619 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:13 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:13.619 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:13 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:13.619 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:13 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:13.620 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:13 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:13.620 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:13 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:13.620 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:13 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:13.620 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:13 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:13.620 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:13 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:13.620 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:13 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:13.621 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:13 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:13.621 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:13 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:14.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:14 smithi087 ceph-mon[90982]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T07:28:14.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:14 smithi139 ceph-mon[79872]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T07:28:15.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:15 smithi087 ceph-mon[90982]: pgmap v226: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:28:15.517 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:15 smithi139 ceph-mon[79872]: pgmap v226: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:28:16.272 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:16 smithi087 ceph-mon[90982]: Upgrade: Updating alertmanager.smithi087 2024-09-17T07:28:16.273 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:16 smithi087 ceph-mon[90982]: Deploying daemon alertmanager.smithi087 on smithi087 2024-09-17T07:28:16.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:16 smithi139 ceph-mon[79872]: Upgrade: Updating alertmanager.smithi087 2024-09-17T07:28:16.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:16 smithi139 ceph-mon[79872]: Deploying daemon alertmanager.smithi087 on smithi087 2024-09-17T07:28:17.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:17 smithi087 ceph-mon[90982]: pgmap v227: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:28:17.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:17 smithi139 ceph-mon[79872]: pgmap v227: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:28:19.505 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:19 smithi087 ceph-mon[90982]: pgmap v228: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:28:19.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:19 smithi139 ceph-mon[79872]: pgmap v228: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:28:21.016 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:20 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:28:21.016 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:20 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:28:21.016 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:20 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:28:21.017 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:20 smithi087 ceph-mon[90982]: pgmap v229: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:28:21.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:20 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:28:21.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:20 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:28:21.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:20 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:28:21.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:20 smithi139 ceph-mon[79872]: pgmap v229: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:28:23.491 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:23 smithi087 ceph-mon[90982]: pgmap v230: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:28:23.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:23 smithi139 ceph-mon[79872]: pgmap v230: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:28:24.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.405+0000 7f33f0428640 1 -- 172.21.15.87:0/1533828431 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f33e80fb420 msgr2=0x7f33e80fb830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:28:24.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.405+0000 7f33f0428640 1 --2- 172.21.15.87:0/1533828431 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f33e80fb420 0x7f33e80fb830 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f33e00048d0 tx=0x7f33e0009da0 comp rx=0 tx=0).stop 2024-09-17T07:28:24.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.405+0000 7f33f0428640 1 -- 172.21.15.87:0/1533828431 shutdown_connections 2024-09-17T07:28:24.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.405+0000 7f33f0428640 1 --2- 172.21.15.87:0/1533828431 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f33e80fc6f0 0x7f33e80fcb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:28:24.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.405+0000 7f33f0428640 1 --2- 172.21.15.87:0/1533828431 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f33e80fb420 0x7f33e80fb830 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:28:24.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.405+0000 7f33f0428640 1 -- 172.21.15.87:0/1533828431 >> 172.21.15.87:0/1533828431 conn(0x7f33e80f6c00 msgr2=0x7f33e80f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:28:24.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.405+0000 7f33f0428640 1 -- 172.21.15.87:0/1533828431 shutdown_connections 2024-09-17T07:28:24.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.405+0000 7f33f0428640 1 -- 172.21.15.87:0/1533828431 wait complete. 2024-09-17T07:28:24.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.406+0000 7f33f0428640 1 Processor -- start 2024-09-17T07:28:24.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.406+0000 7f33f0428640 1 -- start start 2024-09-17T07:28:24.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.406+0000 7f33f0428640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f33e80fb420 0x7f33e810bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:28:24.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.406+0000 7f33f0428640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f33e80fc6f0 0x7f33e810c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:28:24.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.406+0000 7f33f0428640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e810ca80 con 0x7f33e80fb420 2024-09-17T07:28:24.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.406+0000 7f33f0428640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e810d250 con 0x7f33e80fc6f0 2024-09-17T07:28:24.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.406+0000 7f33ee1c4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f33e80fb420 0x7f33e810bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:28:24.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.406+0000 7f33ee1c4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f33e80fb420 0x7f33e810bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35914/0 (socket says 172.21.15.87:35914) 2024-09-17T07:28:24.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.406+0000 7f33ee1c4640 1 -- 172.21.15.87:0/2983650853 learned_addr learned my addr 172.21.15.87:0/2983650853 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:28:24.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.407+0000 7f33ed9c3640 1 --2- 172.21.15.87:0/2983650853 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f33e80fc6f0 0x7f33e810c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:28:24.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.407+0000 7f33ee1c4640 1 -- 172.21.15.87:0/2983650853 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f33e80fc6f0 msgr2=0x7f33e810c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:28:24.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.407+0000 7f33ee1c4640 1 --2- 172.21.15.87:0/2983650853 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f33e80fc6f0 0x7f33e810c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:28:24.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.407+0000 7f33ee1c4640 1 -- 172.21.15.87:0/2983650853 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33e0005040 con 0x7f33e80fb420 2024-09-17T07:28:24.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.407+0000 7f33ed9c3640 1 --2- 172.21.15.87:0/2983650853 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f33e80fc6f0 0x7f33e810c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T07:28:24.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.407+0000 7f33ee1c4640 1 --2- 172.21.15.87:0/2983650853 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f33e80fb420 0x7f33e810bef0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f33e00043d0 tx=0x7f33e0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:28:24.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.407+0000 7f33e6ffd640 1 -- 172.21.15.87:0/2983650853 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f33e0038070 con 0x7f33e80fb420 2024-09-17T07:28:24.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.407+0000 7f33e6ffd640 1 -- 172.21.15.87:0/2983650853 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f33e00096c0 con 0x7f33e80fb420 2024-09-17T07:28:24.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.407+0000 7f33f0428640 1 -- 172.21.15.87:0/2983650853 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33e810d480 con 0x7f33e80fb420 2024-09-17T07:28:24.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.407+0000 7f33e6ffd640 1 -- 172.21.15.87:0/2983650853 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f33e003d420 con 0x7f33e80fb420 2024-09-17T07:28:24.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.407+0000 7f33f0428640 1 -- 172.21.15.87:0/2983650853 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33e810da20 con 0x7f33e80fb420 2024-09-17T07:28:24.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.409+0000 7f33f0428640 1 -- 172.21.15.87:0/2983650853 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33e804b720 con 0x7f33e80fb420 2024-09-17T07:28:24.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.409+0000 7f33e6ffd640 1 -- 172.21.15.87:0/2983650853 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f33e0030020 con 0x7f33e80fb420 2024-09-17T07:28:24.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.410+0000 7f33e6ffd640 1 --2- 172.21.15.87:0/2983650853 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f33d006cb90 0x7f33d006f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:28:24.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.410+0000 7f33e6ffd640 1 -- 172.21.15.87:0/2983650853 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f33e00ac720 con 0x7f33e80fb420 2024-09-17T07:28:24.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.410+0000 7f33ed9c3640 1 --2- 172.21.15.87:0/2983650853 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f33d006cb90 0x7f33d006f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:28:24.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.411+0000 7f33ed9c3640 1 --2- 172.21.15.87:0/2983650853 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f33d006cb90 0x7f33d006f040 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f33dc007fd0 tx=0x7f33dc009e90 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:28:24.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.414+0000 7f33e6ffd640 1 -- 172.21.15.87:0/2983650853 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f33e00766e0 con 0x7f33e80fb420 2024-09-17T07:28:24.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.608+0000 7f33f0428640 1 -- 172.21.15.87:0/2983650853 --> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f33e810dd00 con 0x7f33d006cb90 2024-09-17T07:28:24.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.609+0000 7f33e6ffd640 1 -- 172.21.15.87:0/2983650853 <== mgr.24529 v2:172.21.15.87:6800/1359413180 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+440 (secure 0 0 0) 0x7f33e810dd00 con 0x7f33d006cb90 2024-09-17T07:28:24.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.611+0000 7f33f0428640 1 -- 172.21.15.87:0/2983650853 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f33d006cb90 msgr2=0x7f33d006f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:28:24.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.611+0000 7f33f0428640 1 --2- 172.21.15.87:0/2983650853 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f33d006cb90 0x7f33d006f040 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f33dc007fd0 tx=0x7f33dc009e90 comp rx=0 tx=0).stop 2024-09-17T07:28:24.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.611+0000 7f33f0428640 1 -- 172.21.15.87:0/2983650853 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f33e80fb420 msgr2=0x7f33e810bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:28:24.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.611+0000 7f33f0428640 1 --2- 172.21.15.87:0/2983650853 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f33e80fb420 0x7f33e810bef0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f33e00043d0 tx=0x7f33e0009da0 comp rx=0 tx=0).stop 2024-09-17T07:28:24.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.611+0000 7f33f0428640 1 -- 172.21.15.87:0/2983650853 shutdown_connections 2024-09-17T07:28:24.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.611+0000 7f33f0428640 1 --2- 172.21.15.87:0/2983650853 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f33d006cb90 0x7f33d006f040 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:28:24.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.611+0000 7f33f0428640 1 --2- 172.21.15.87:0/2983650853 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f33e80fc6f0 0x7f33e810c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:28:24.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.611+0000 7f33f0428640 1 --2- 172.21.15.87:0/2983650853 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f33e80fb420 0x7f33e810bef0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:28:24.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.611+0000 7f33f0428640 1 -- 172.21.15.87:0/2983650853 >> 172.21.15.87:0/2983650853 conn(0x7f33e80f6c00 msgr2=0x7f33e80ffa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:28:24.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.611+0000 7f33f0428640 1 -- 172.21.15.87:0/2983650853 shutdown_connections 2024-09-17T07:28:24.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.611+0000 7f33f0428640 1 -- 172.21.15.87:0/2983650853 wait complete. 2024-09-17T07:28:24.623 INFO:teuthology.orchestra.run.smithi087.stdout:true 2024-09-17T07:28:24.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.699+0000 7f9f5786b640 1 -- 172.21.15.87:0/1170651958 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f500fc570 msgr2=0x7f9f500fc980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:28:24.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.699+0000 7f9f5786b640 1 --2- 172.21.15.87:0/1170651958 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f500fc570 0x7f9f500fc980 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c0048d0 tx=0x7f9f4c009da0 comp rx=0 tx=0).stop 2024-09-17T07:28:24.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.699+0000 7f9f5786b640 1 -- 172.21.15.87:0/1170651958 shutdown_connections 2024-09-17T07:28:24.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.699+0000 7f9f5786b640 1 --2- 172.21.15.87:0/1170651958 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9f500fd840 0x7f9f500fdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:28:24.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.699+0000 7f9f5786b640 1 --2- 172.21.15.87:0/1170651958 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f500fc570 0x7f9f500fc980 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:28:24.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.699+0000 7f9f5786b640 1 -- 172.21.15.87:0/1170651958 >> 172.21.15.87:0/1170651958 conn(0x7f9f500f7d30 msgr2=0x7f9f500fa160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:28:24.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.699+0000 7f9f5786b640 1 -- 172.21.15.87:0/1170651958 shutdown_connections 2024-09-17T07:28:24.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.699+0000 7f9f5786b640 1 -- 172.21.15.87:0/1170651958 wait complete. 2024-09-17T07:28:24.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.700+0000 7f9f5786b640 1 Processor -- start 2024-09-17T07:28:24.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.700+0000 7f9f5786b640 1 -- start start 2024-09-17T07:28:24.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.700+0000 7f9f5786b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f500fc570 0x7f9f5010cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:28:24.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.700+0000 7f9f5786b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9f500fd840 0x7f9f5010d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:28:24.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.700+0000 7f9f5786b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5010db40 con 0x7f9f500fc570 2024-09-17T07:28:24.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.700+0000 7f9f5786b640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5010e360 con 0x7f9f500fd840 2024-09-17T07:28:24.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.700+0000 7f9f55607640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f500fc570 0x7f9f5010cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:28:24.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.700+0000 7f9f55607640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f500fc570 0x7f9f5010cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35922/0 (socket says 172.21.15.87:35922) 2024-09-17T07:28:24.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.700+0000 7f9f55607640 1 -- 172.21.15.87:0/2463660207 learned_addr learned my addr 172.21.15.87:0/2463660207 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:28:24.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.700+0000 7f9f54e06640 1 --2- 172.21.15.87:0/2463660207 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9f500fd840 0x7f9f5010d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:28:24.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.700+0000 7f9f55607640 1 -- 172.21.15.87:0/2463660207 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9f500fd840 msgr2=0x7f9f5010d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:28:24.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.700+0000 7f9f55607640 1 --2- 172.21.15.87:0/2463660207 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9f500fd840 0x7f9f5010d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:28:24.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.700+0000 7f9f55607640 1 -- 172.21.15.87:0/2463660207 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f4c005040 con 0x7f9f500fc570 2024-09-17T07:28:24.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.701+0000 7f9f55607640 1 --2- 172.21.15.87:0/2463660207 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f500fc570 0x7f9f5010cfb0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c0043d0 tx=0x7f9f4c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:28:24.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.701+0000 7f9f45ffb640 1 -- 172.21.15.87:0/2463660207 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f4c038070 con 0x7f9f500fc570 2024-09-17T07:28:24.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.701+0000 7f9f45ffb640 1 -- 172.21.15.87:0/2463660207 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f9f4c0096c0 con 0x7f9f500fc570 2024-09-17T07:28:24.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.701+0000 7f9f5786b640 1 -- 172.21.15.87:0/2463660207 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f5010e590 con 0x7f9f500fc570 2024-09-17T07:28:24.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.701+0000 7f9f45ffb640 1 -- 172.21.15.87:0/2463660207 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f4c03d420 con 0x7f9f500fc570 2024-09-17T07:28:24.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.701+0000 7f9f5786b640 1 -- 172.21.15.87:0/2463660207 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f5010eb30 con 0x7f9f500fc570 2024-09-17T07:28:24.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.702+0000 7f9f5786b640 1 -- 172.21.15.87:0/2463660207 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f500fb9d0 con 0x7f9f500fc570 2024-09-17T07:28:24.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.703+0000 7f9f45ffb640 1 -- 172.21.15.87:0/2463660207 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f9f4c030020 con 0x7f9f500fc570 2024-09-17T07:28:24.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.703+0000 7f9f45ffb640 1 --2- 172.21.15.87:0/2463660207 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f9f3c06cb90 0x7f9f3c06f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:28:24.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.703+0000 7f9f45ffb640 1 -- 172.21.15.87:0/2463660207 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f9f4c0ac600 con 0x7f9f500fc570 2024-09-17T07:28:24.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.703+0000 7f9f54e06640 1 --2- 172.21.15.87:0/2463660207 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f9f3c06cb90 0x7f9f3c06f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:28:24.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.704+0000 7f9f54e06640 1 --2- 172.21.15.87:0/2463660207 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f9f3c06cb90 0x7f9f3c06f040 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9f5010cd60 tx=0x7f9f4000b040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:28:24.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.708+0000 7f9f45ffb640 1 -- 172.21.15.87:0/2463660207 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f9f4c076640 con 0x7f9f500fc570 2024-09-17T07:28:24.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.903+0000 7f9f5786b640 1 -- 172.21.15.87:0/2463660207 --> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9f5010eed0 con 0x7f9f3c06cb90 2024-09-17T07:28:24.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.904+0000 7f9f45ffb640 1 -- 172.21.15.87:0/2463660207 <== mgr.24529 v2:172.21.15.87:6800/1359413180 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+440 (secure 0 0 0) 0x7f9f5010eed0 con 0x7f9f3c06cb90 2024-09-17T07:28:24.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.907+0000 7f9f5786b640 1 -- 172.21.15.87:0/2463660207 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f9f3c06cb90 msgr2=0x7f9f3c06f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:28:24.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.907+0000 7f9f5786b640 1 --2- 172.21.15.87:0/2463660207 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f9f3c06cb90 0x7f9f3c06f040 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9f5010cd60 tx=0x7f9f4000b040 comp rx=0 tx=0).stop 2024-09-17T07:28:24.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.907+0000 7f9f5786b640 1 -- 172.21.15.87:0/2463660207 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f500fc570 msgr2=0x7f9f5010cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:28:24.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.907+0000 7f9f5786b640 1 --2- 172.21.15.87:0/2463660207 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f500fc570 0x7f9f5010cfb0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c0043d0 tx=0x7f9f4c009da0 comp rx=0 tx=0).stop 2024-09-17T07:28:24.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.907+0000 7f9f5786b640 1 -- 172.21.15.87:0/2463660207 shutdown_connections 2024-09-17T07:28:24.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.907+0000 7f9f5786b640 1 --2- 172.21.15.87:0/2463660207 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f9f3c06cb90 0x7f9f3c06f040 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:28:24.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.907+0000 7f9f5786b640 1 --2- 172.21.15.87:0/2463660207 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9f500fd840 0x7f9f5010d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:28:24.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.907+0000 7f9f5786b640 1 --2- 172.21.15.87:0/2463660207 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f500fc570 0x7f9f5010cfb0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:28:24.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.907+0000 7f9f5786b640 1 -- 172.21.15.87:0/2463660207 >> 172.21.15.87:0/2463660207 conn(0x7f9f500f7d30 msgr2=0x7f9f500f95a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:28:24.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.907+0000 7f9f5786b640 1 -- 172.21.15.87:0/2463660207 shutdown_connections 2024-09-17T07:28:24.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.907+0000 7f9f5786b640 1 -- 172.21.15.87:0/2463660207 wait complete. 2024-09-17T07:28:24.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.988+0000 7f3261979640 1 -- 172.21.15.87:0/3288133815 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f325c0fd7f0 msgr2=0x7f325c0fdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:28:24.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.988+0000 7f3261979640 1 --2- 172.21.15.87:0/3288133815 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f325c0fd7f0 0x7f325c0fdc60 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f32440048d0 tx=0x7f3244009da0 comp rx=0 tx=0).stop 2024-09-17T07:28:24.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.988+0000 7f3261979640 1 -- 172.21.15.87:0/3288133815 shutdown_connections 2024-09-17T07:28:24.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.988+0000 7f3261979640 1 --2- 172.21.15.87:0/3288133815 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f325c0fd7f0 0x7f325c0fdc60 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:28:24.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.988+0000 7f3261979640 1 --2- 172.21.15.87:0/3288133815 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f325c0fc520 0x7f325c0fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:28:24.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.988+0000 7f3261979640 1 -- 172.21.15.87:0/3288133815 >> 172.21.15.87:0/3288133815 conn(0x7f325c0f7ce0 msgr2=0x7f325c0fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:28:24.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.989+0000 7f3261979640 1 -- 172.21.15.87:0/3288133815 shutdown_connections 2024-09-17T07:28:24.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.989+0000 7f3261979640 1 -- 172.21.15.87:0/3288133815 wait complete. 2024-09-17T07:28:24.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.989+0000 7f3261979640 1 Processor -- start 2024-09-17T07:28:24.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.989+0000 7f3261979640 1 -- start start 2024-09-17T07:28:24.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.989+0000 7f3261979640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f325c0fc520 0x7f325c071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:28:24.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.989+0000 7f3261979640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f325c0fd7f0 0x7f325c06fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:28:24.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.989+0000 7f3261979640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f325c06fff0 con 0x7f325c0fc520 2024-09-17T07:28:24.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.989+0000 7f3261979640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f325c070130 con 0x7f325c0fd7f0 2024-09-17T07:28:24.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.990+0000 7f325affd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f325c0fc520 0x7f325c071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:28:24.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.990+0000 7f325affd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f325c0fc520 0x7f325c071570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35932/0 (socket says 172.21.15.87:35932) 2024-09-17T07:28:24.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.990+0000 7f325affd640 1 -- 172.21.15.87:0/3561851173 learned_addr learned my addr 172.21.15.87:0/3561851173 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:28:24.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.990+0000 7f32527fc640 1 --2- 172.21.15.87:0/3561851173 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f325c0fd7f0 0x7f325c06fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:28:24.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.990+0000 7f325affd640 1 -- 172.21.15.87:0/3561851173 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f325c0fd7f0 msgr2=0x7f325c06fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:28:24.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.990+0000 7f325affd640 1 --2- 172.21.15.87:0/3561851173 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f325c0fd7f0 0x7f325c06fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:28:24.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.990+0000 7f325affd640 1 -- 172.21.15.87:0/3561851173 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3244005040 con 0x7f325c0fc520 2024-09-17T07:28:24.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.990+0000 7f325affd640 1 --2- 172.21.15.87:0/3561851173 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f325c0fc520 0x7f325c071570 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f324c00c790 tx=0x7f324c0043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:28:24.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.990+0000 7f3253fff640 1 -- 172.21.15.87:0/3561851173 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f324c00a7a0 con 0x7f325c0fc520 2024-09-17T07:28:24.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.990+0000 7f3253fff640 1 -- 172.21.15.87:0/3561851173 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f324c00ad80 con 0x7f325c0fc520 2024-09-17T07:28:24.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.990+0000 7f3253fff640 1 -- 172.21.15.87:0/3561851173 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f324c012e50 con 0x7f325c0fc520 2024-09-17T07:28:24.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.990+0000 7f3261979640 1 -- 172.21.15.87:0/3561851173 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f325c070410 con 0x7f325c0fc520 2024-09-17T07:28:24.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.990+0000 7f3261979640 1 -- 172.21.15.87:0/3561851173 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f325c115010 con 0x7f325c0fc520 2024-09-17T07:28:24.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.991+0000 7f3261979640 1 -- 172.21.15.87:0/3561851173 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f325c0fb980 con 0x7f325c0fc520 2024-09-17T07:28:24.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.992+0000 7f3253fff640 1 -- 172.21.15.87:0/3561851173 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f324c00a900 con 0x7f325c0fc520 2024-09-17T07:28:24.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.992+0000 7f3253fff640 1 --2- 172.21.15.87:0/3561851173 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f324806cb90 0x7f324806f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:28:24.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.992+0000 7f3253fff640 1 -- 172.21.15.87:0/3561851173 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f324c08c0f0 con 0x7f325c0fc520 2024-09-17T07:28:24.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.992+0000 7f32527fc640 1 --2- 172.21.15.87:0/3561851173 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f324806cb90 0x7f324806f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:28:24.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.993+0000 7f32527fc640 1 --2- 172.21.15.87:0/3561851173 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f324806cb90 0x7f324806f040 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3244009ac0 tx=0x7f3244035040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:28:24.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:24.997+0000 7f3253fff640 1 -- 172.21.15.87:0/3561851173 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f324c0561f0 con 0x7f325c0fc520 2024-09-17T07:28:25.174 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.173+0000 7f3261979640 1 -- 172.21.15.87:0/3561851173 --> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f325c101cd0 con 0x7f324806cb90 2024-09-17T07:28:25.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.182+0000 7f3253fff640 1 -- 172.21.15.87:0/3561851173 <== mgr.24529 v2:172.21.15.87:6800/1359413180 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f325c101cd0 con 0x7f324806cb90 2024-09-17T07:28:25.183 INFO:teuthology.orchestra.run.smithi087.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T07:28:25.183 INFO:teuthology.orchestra.run.smithi087.stdout:alertmanager.smithi087 smithi087 *:9093,9094 running (5s) 1s ago 16m 15.6M - 0.25.0 c8568f914cd2 f234770ff301 2024-09-17T07:28:25.183 INFO:teuthology.orchestra.run.smithi087.stdout:crash.smithi087 smithi087 running (5m) 1s ago 16m 6895k - 18.2.4-855-g19e2a2be 980a0bfcd684 0ff8a9330162 2024-09-17T07:28:25.183 INFO:teuthology.orchestra.run.smithi087.stdout:crash.smithi139 smithi139 running (5m) 33s ago 15m 6899k - 18.2.4-855-g19e2a2be 980a0bfcd684 10541e3b202e 2024-09-17T07:28:25.183 INFO:teuthology.orchestra.run.smithi087.stdout:grafana.smithi087 smithi087 *:3000 running (7m) 1s ago 16m 85.7M - 9.4.7 954c08fa6188 e2f17ec6baa8 2024-09-17T07:28:25.183 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi087.tjhpcs smithi087 running (84s) 1s ago 10m 15.9M - 18.2.4-855-g19e2a2be 980a0bfcd684 593471a4a9e2 2024-09-17T07:28:25.183 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi087.vvbzss smithi087 running (107s) 1s ago 11m 67.3M - 18.2.4-855-g19e2a2be 980a0bfcd684 e50f437839ed 2024-09-17T07:28:25.183 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi139.ftvinf smithi139 running (51s) 33s ago 10m 14.1M - 18.2.4-855-g19e2a2be 980a0bfcd684 17708393d8d9 2024-09-17T07:28:25.183 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi139.gnwonz smithi139 running (65s) 33s ago 11m 225M - 18.2.4-855-g19e2a2be 980a0bfcd684 6ae45fadd7a2 2024-09-17T07:28:25.184 INFO:teuthology.orchestra.run.smithi087.stdout:mgr.smithi087.vuvjer smithi087 *:8443,9283,8765 running (7m) 1s ago 17m 500M - 18.2.4-855-g19e2a2be 980a0bfcd684 5d10c647cb6b 2024-09-17T07:28:25.184 INFO:teuthology.orchestra.run.smithi087.stdout:mgr.smithi139.tuqnpn smithi139 *:8443,9283,8765 running (6m) 33s ago 15m 440M - 18.2.4-855-g19e2a2be 980a0bfcd684 6e0bf371d44c 2024-09-17T07:28:25.184 INFO:teuthology.orchestra.run.smithi087.stdout:mon.smithi087 smithi087 running (6m) 1s ago 17m 51.9M 2048M 18.2.4-855-g19e2a2be 980a0bfcd684 305c72de1f9f 2024-09-17T07:28:25.184 INFO:teuthology.orchestra.run.smithi087.stdout:mon.smithi139 smithi139 running (6m) 33s ago 15m 40.0M 2048M 18.2.4-855-g19e2a2be 980a0bfcd684 0b159495af0f 2024-09-17T07:28:25.184 INFO:teuthology.orchestra.run.smithi087.stdout:node-exporter.smithi087 smithi087 *:9100 running (40s) 1s ago 16m 7554k - 1.5.0 0da6a335fe13 5aca7ee26d83 2024-09-17T07:28:25.184 INFO:teuthology.orchestra.run.smithi087.stdout:node-exporter.smithi139 smithi139 *:9100 running (36s) 33s ago 15m 3401k - 1.5.0 0da6a335fe13 6d18794119c8 2024-09-17T07:28:25.184 INFO:teuthology.orchestra.run.smithi087.stdout:osd.0 smithi087 running (5m) 1s ago 14m 96.8M 1557M 18.2.4-855-g19e2a2be 980a0bfcd684 e97cb50e6aec 2024-09-17T07:28:25.184 INFO:teuthology.orchestra.run.smithi087.stdout:osd.1 smithi087 running (4m) 1s ago 14m 102M 1557M 18.2.4-855-g19e2a2be 980a0bfcd684 b108771d0b8e 2024-09-17T07:28:25.184 INFO:teuthology.orchestra.run.smithi087.stdout:osd.2 smithi087 running (4m) 1s ago 13m 88.1M 1557M 18.2.4-855-g19e2a2be 980a0bfcd684 240cfb3b5366 2024-09-17T07:28:25.184 INFO:teuthology.orchestra.run.smithi087.stdout:osd.3 smithi139 running (3m) 33s ago 13m 115M 2581M 18.2.4-855-g19e2a2be 980a0bfcd684 b05ed3bf3f5c 2024-09-17T07:28:25.184 INFO:teuthology.orchestra.run.smithi087.stdout:osd.4 smithi139 running (3m) 33s ago 12m 99.6M 2581M 18.2.4-855-g19e2a2be 980a0bfcd684 139bbfc915c8 2024-09-17T07:28:25.184 INFO:teuthology.orchestra.run.smithi087.stdout:osd.5 smithi139 running (2m) 33s ago 12m 88.5M 2581M 18.2.4-855-g19e2a2be 980a0bfcd684 5058216f1ee0 2024-09-17T07:28:25.184 INFO:teuthology.orchestra.run.smithi087.stdout:prometheus.smithi087 smithi087 *:9095 running (20s) 1s ago 15m 48.2M - 2.43.0 a07b618ecd1d fbe2cbcbd68f 2024-09-17T07:28:25.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.184+0000 7f3261979640 1 -- 172.21.15.87:0/3561851173 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f324806cb90 msgr2=0x7f324806f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:28:25.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.184+0000 7f3261979640 1 --2- 172.21.15.87:0/3561851173 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f324806cb90 0x7f324806f040 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3244009ac0 tx=0x7f3244035040 comp rx=0 tx=0).stop 2024-09-17T07:28:25.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.184+0000 7f3261979640 1 -- 172.21.15.87:0/3561851173 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f325c0fc520 msgr2=0x7f325c071570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:28:25.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.184+0000 7f3261979640 1 --2- 172.21.15.87:0/3561851173 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f325c0fc520 0x7f325c071570 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f324c00c790 tx=0x7f324c0043c0 comp rx=0 tx=0).stop 2024-09-17T07:28:25.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.184+0000 7f3261979640 1 -- 172.21.15.87:0/3561851173 shutdown_connections 2024-09-17T07:28:25.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.184+0000 7f3261979640 1 --2- 172.21.15.87:0/3561851173 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f324806cb90 0x7f324806f040 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:28:25.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.184+0000 7f3261979640 1 --2- 172.21.15.87:0/3561851173 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f325c0fd7f0 0x7f325c06fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:28:25.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.184+0000 7f3261979640 1 --2- 172.21.15.87:0/3561851173 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f325c0fc520 0x7f325c071570 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:28:25.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.184+0000 7f3261979640 1 -- 172.21.15.87:0/3561851173 >> 172.21.15.87:0/3561851173 conn(0x7f325c0f7ce0 msgr2=0x7f325c0f95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:28:25.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.184+0000 7f3261979640 1 -- 172.21.15.87:0/3561851173 shutdown_connections 2024-09-17T07:28:25.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.184+0000 7f3261979640 1 -- 172.21.15.87:0/3561851173 wait complete. 2024-09-17T07:28:25.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.266+0000 7fa6be5ab640 1 -- 172.21.15.87:0/2865088985 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6b80fbeb0 msgr2=0x7fa6b80fc320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:28:25.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.266+0000 7fa6be5ab640 1 --2- 172.21.15.87:0/2865088985 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6b80fbeb0 0x7fa6b80fc320 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa6ac0049c0 tx=0x7fa6ac00aeb0 comp rx=0 tx=0).stop 2024-09-17T07:28:25.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.266+0000 7fa6be5ab640 1 -- 172.21.15.87:0/2865088985 shutdown_connections 2024-09-17T07:28:25.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.266+0000 7fa6be5ab640 1 --2- 172.21.15.87:0/2865088985 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6b80fbeb0 0x7fa6b80fc320 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:28:25.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.266+0000 7fa6be5ab640 1 --2- 172.21.15.87:0/2865088985 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa6b80fabe0 0x7fa6b80faff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:28:25.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.266+0000 7fa6be5ab640 1 -- 172.21.15.87:0/2865088985 >> 172.21.15.87:0/2865088985 conn(0x7fa6b80f63a0 msgr2=0x7fa6b80f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:28:25.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.266+0000 7fa6be5ab640 1 -- 172.21.15.87:0/2865088985 shutdown_connections 2024-09-17T07:28:25.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.266+0000 7fa6be5ab640 1 -- 172.21.15.87:0/2865088985 wait complete. 2024-09-17T07:28:25.268 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:25 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:28:25.269 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:25 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:28:25.269 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:25 smithi087 ceph-mon[90982]: pgmap v231: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:28:25.269 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:25 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:28:25.269 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:25 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:28:25.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.266+0000 7fa6be5ab640 1 Processor -- start 2024-09-17T07:28:25.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.267+0000 7fa6be5ab640 1 -- start start 2024-09-17T07:28:25.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.267+0000 7fa6be5ab640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa6b80fabe0 0x7fa6b810d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:28:25.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.267+0000 7fa6be5ab640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6b80fbeb0 0x7fa6b810d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:28:25.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.267+0000 7fa6be5ab640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b810dbe0 con 0x7fa6b80fbeb0 2024-09-17T07:28:25.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.267+0000 7fa6be5ab640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b810e400 con 0x7fa6b80fabe0 2024-09-17T07:28:25.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.267+0000 7fa6b77fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6b80fbeb0 0x7fa6b810d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:28:25.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.267+0000 7fa6b77fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6b80fbeb0 0x7fa6b810d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35956/0 (socket says 172.21.15.87:35956) 2024-09-17T07:28:25.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.267+0000 7fa6b77fe640 1 -- 172.21.15.87:0/680123485 learned_addr learned my addr 172.21.15.87:0/680123485 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:28:25.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.267+0000 7fa6b7fff640 1 --2- 172.21.15.87:0/680123485 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa6b80fabe0 0x7fa6b810d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:28:25.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.267+0000 7fa6b77fe640 1 -- 172.21.15.87:0/680123485 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa6b80fabe0 msgr2=0x7fa6b810d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:28:25.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.267+0000 7fa6b77fe640 1 --2- 172.21.15.87:0/680123485 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa6b80fabe0 0x7fa6b810d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:28:25.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.267+0000 7fa6b77fe640 1 -- 172.21.15.87:0/680123485 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6ac005040 con 0x7fa6b80fbeb0 2024-09-17T07:28:25.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.268+0000 7fa6b77fe640 1 --2- 172.21.15.87:0/680123485 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6b80fbeb0 0x7fa6b810d590 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa6ac000c00 tx=0x7fa6ac00aeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:28:25.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.268+0000 7fa6b4ff9640 1 -- 172.21.15.87:0/680123485 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6ac007e10 con 0x7fa6b80fbeb0 2024-09-17T07:28:25.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.268+0000 7fa6be5ab640 1 -- 172.21.15.87:0/680123485 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6b810e630 con 0x7fa6b80fbeb0 2024-09-17T07:28:25.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.268+0000 7fa6b4ff9640 1 -- 172.21.15.87:0/680123485 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fa6ac00a820 con 0x7fa6b80fbeb0 2024-09-17T07:28:25.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.268+0000 7fa6b4ff9640 1 -- 172.21.15.87:0/680123485 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6ac0085e0 con 0x7fa6b80fbeb0 2024-09-17T07:28:25.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.268+0000 7fa6be5ab640 1 -- 172.21.15.87:0/680123485 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6b810ebd0 con 0x7fa6b80fbeb0 2024-09-17T07:28:25.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.269+0000 7fa6be5ab640 1 -- 172.21.15.87:0/680123485 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6b80fa040 con 0x7fa6b80fbeb0 2024-09-17T07:28:25.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.269+0000 7fa6b4ff9640 1 -- 172.21.15.87:0/680123485 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fa6ac031020 con 0x7fa6b80fbeb0 2024-09-17T07:28:25.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.270+0000 7fa6b4ff9640 1 --2- 172.21.15.87:0/680123485 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fa6a006cb90 0x7fa6a006f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:28:25.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.270+0000 7fa6b4ff9640 1 -- 172.21.15.87:0/680123485 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fa6ac0ac530 con 0x7fa6b80fbeb0 2024-09-17T07:28:25.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.270+0000 7fa6b7fff640 1 --2- 172.21.15.87:0/680123485 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fa6a006cb90 0x7fa6a006f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:28:25.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.270+0000 7fa6b7fff640 1 --2- 172.21.15.87:0/680123485 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fa6a006cb90 0x7fa6a006f040 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa6a8007fd0 tx=0x7fa6a8009e90 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:28:25.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.274+0000 7fa6b4ff9640 1 -- 172.21.15.87:0/680123485 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa6ac076570 con 0x7fa6b80fbeb0 2024-09-17T07:28:25.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.507+0000 7fa6be5ab640 1 -- 172.21.15.87:0/680123485 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa6b810ee90 con 0x7fa6b80fbeb0 2024-09-17T07:28:25.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.507+0000 7fa6b4ff9640 1 -- 172.21.15.87:0/680123485 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7fa6ac079b90 con 0x7fa6b80fbeb0 2024-09-17T07:28:25.509 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T07:28:25.509 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": { 2024-09-17T07:28:25.509 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 2 2024-09-17T07:28:25.509 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:28:25.509 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr": { 2024-09-17T07:28:25.509 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 2 2024-09-17T07:28:25.509 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:28:25.509 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": { 2024-09-17T07:28:25.509 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 6 2024-09-17T07:28:25.509 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:28:25.509 INFO:teuthology.orchestra.run.smithi087.stdout: "mds": { 2024-09-17T07:28:25.510 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 4 2024-09-17T07:28:25.510 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:28:25.510 INFO:teuthology.orchestra.run.smithi087.stdout: "overall": { 2024-09-17T07:28:25.510 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 14 2024-09-17T07:28:25.510 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T07:28:25.510 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T07:28:25.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.509+0000 7fa6be5ab640 1 -- 172.21.15.87:0/680123485 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fa6a006cb90 msgr2=0x7fa6a006f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:28:25.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.509+0000 7fa6be5ab640 1 --2- 172.21.15.87:0/680123485 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fa6a006cb90 0x7fa6a006f040 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa6a8007fd0 tx=0x7fa6a8009e90 comp rx=0 tx=0).stop 2024-09-17T07:28:25.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.509+0000 7fa6be5ab640 1 -- 172.21.15.87:0/680123485 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6b80fbeb0 msgr2=0x7fa6b810d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:28:25.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.509+0000 7fa6be5ab640 1 --2- 172.21.15.87:0/680123485 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6b80fbeb0 0x7fa6b810d590 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa6ac000c00 tx=0x7fa6ac00aeb0 comp rx=0 tx=0).stop 2024-09-17T07:28:25.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.509+0000 7fa6be5ab640 1 -- 172.21.15.87:0/680123485 shutdown_connections 2024-09-17T07:28:25.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.509+0000 7fa6be5ab640 1 --2- 172.21.15.87:0/680123485 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6b80fbeb0 0x7fa6b810d590 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:28:25.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.509+0000 7fa6be5ab640 1 --2- 172.21.15.87:0/680123485 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fa6a006cb90 0x7fa6a006f040 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:28:25.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.509+0000 7fa6be5ab640 1 --2- 172.21.15.87:0/680123485 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa6b80fabe0 0x7fa6b810d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:28:25.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.509+0000 7fa6be5ab640 1 -- 172.21.15.87:0/680123485 >> 172.21.15.87:0/680123485 conn(0x7fa6b80f63a0 msgr2=0x7fa6b80f7cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:28:25.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.510+0000 7fa6be5ab640 1 -- 172.21.15.87:0/680123485 shutdown_connections 2024-09-17T07:28:25.511 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.510+0000 7fa6be5ab640 1 -- 172.21.15.87:0/680123485 wait complete. 2024-09-17T07:28:25.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.587+0000 7f9e013f0640 1 -- 172.21.15.87:0/599553153 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9dfc0666b0 msgr2=0x7f9dfc0ff1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:28:25.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.587+0000 7f9e013f0640 1 --2- 172.21.15.87:0/599553153 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9dfc0666b0 0x7f9dfc0ff1e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f9dec0048d0 tx=0x7f9dec009da0 comp rx=0 tx=0).stop 2024-09-17T07:28:25.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.588+0000 7f9e013f0640 1 -- 172.21.15.87:0/599553153 shutdown_connections 2024-09-17T07:28:25.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.588+0000 7f9e013f0640 1 --2- 172.21.15.87:0/599553153 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9dfc0ff720 0x7f9dfc101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:28:25.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.588+0000 7f9e013f0640 1 --2- 172.21.15.87:0/599553153 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9dfc0666b0 0x7f9dfc0ff1e0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:28:25.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.588+0000 7f9e013f0640 1 -- 172.21.15.87:0/599553153 >> 172.21.15.87:0/599553153 conn(0x7f9dfc0f6c10 msgr2=0x7f9dfc0f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:28:25.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.588+0000 7f9e013f0640 1 -- 172.21.15.87:0/599553153 shutdown_connections 2024-09-17T07:28:25.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.588+0000 7f9e013f0640 1 -- 172.21.15.87:0/599553153 wait complete. 2024-09-17T07:28:25.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.588+0000 7f9e013f0640 1 Processor -- start 2024-09-17T07:28:25.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.589+0000 7f9e013f0640 1 -- start start 2024-09-17T07:28:25.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.589+0000 7f9e013f0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9dfc0666b0 0x7f9dfc0fcba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:28:25.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.589+0000 7f9e013f0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9dfc0ff720 0x7f9dfc0fb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:28:25.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.589+0000 7f9e013f0640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dfc0fb620 con 0x7f9dfc0666b0 2024-09-17T07:28:25.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.589+0000 7f9e013f0640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dfc0fb760 con 0x7f9dfc0ff720 2024-09-17T07:28:25.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.589+0000 7f9dfaffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9dfc0666b0 0x7f9dfc0fcba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:28:25.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.589+0000 7f9dfaffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9dfc0666b0 0x7f9dfc0fcba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35974/0 (socket says 172.21.15.87:35974) 2024-09-17T07:28:25.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.589+0000 7f9dfaffd640 1 -- 172.21.15.87:0/1743716181 learned_addr learned my addr 172.21.15.87:0/1743716181 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:28:25.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.589+0000 7f9dfa7fc640 1 --2- 172.21.15.87:0/1743716181 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9dfc0ff720 0x7f9dfc0fb0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:28:25.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.589+0000 7f9dfaffd640 1 -- 172.21.15.87:0/1743716181 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9dfc0ff720 msgr2=0x7f9dfc0fb0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:28:25.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.589+0000 7f9dfaffd640 1 --2- 172.21.15.87:0/1743716181 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9dfc0ff720 0x7f9dfc0fb0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:28:25.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.589+0000 7f9dfaffd640 1 -- 172.21.15.87:0/1743716181 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dec005040 con 0x7f9dfc0666b0 2024-09-17T07:28:25.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.589+0000 7f9dfa7fc640 1 --2- 172.21.15.87:0/1743716181 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9dfc0ff720 0x7f9dfc0fb0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T07:28:25.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.589+0000 7f9dfaffd640 1 --2- 172.21.15.87:0/1743716181 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9dfc0666b0 0x7f9dfc0fcba0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f9dec009ac0 tx=0x7f9dec009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:28:25.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.590+0000 7f9de37fe640 1 -- 172.21.15.87:0/1743716181 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9dec038070 con 0x7f9dfc0666b0 2024-09-17T07:28:25.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.590+0000 7f9e013f0640 1 -- 172.21.15.87:0/1743716181 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dfc0fb9e0 con 0x7f9dfc0666b0 2024-09-17T07:28:25.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.590+0000 7f9de37fe640 1 -- 172.21.15.87:0/1743716181 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f9dec0096c0 con 0x7f9dfc0666b0 2024-09-17T07:28:25.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.590+0000 7f9de37fe640 1 -- 172.21.15.87:0/1743716181 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9dec03d420 con 0x7f9dfc0666b0 2024-09-17T07:28:25.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.590+0000 7f9e013f0640 1 -- 172.21.15.87:0/1743716181 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dfc1150c0 con 0x7f9dfc0666b0 2024-09-17T07:28:25.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.591+0000 7f9e013f0640 1 -- 172.21.15.87:0/1743716181 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dfc0fa8b0 con 0x7f9dfc0666b0 2024-09-17T07:28:25.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.591+0000 7f9de37fe640 1 -- 172.21.15.87:0/1743716181 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f9dec030020 con 0x7f9dfc0666b0 2024-09-17T07:28:25.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.592+0000 7f9de37fe640 1 --2- 172.21.15.87:0/1743716181 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f9de406cb90 0x7f9de406f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:28:25.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.592+0000 7f9de37fe640 1 -- 172.21.15.87:0/1743716181 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f9dec0ac740 con 0x7f9dfc0666b0 2024-09-17T07:28:25.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.592+0000 7f9dfa7fc640 1 --2- 172.21.15.87:0/1743716181 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f9de406cb90 0x7f9de406f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:28:25.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.592+0000 7f9dfa7fc640 1 --2- 172.21.15.87:0/1743716181 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f9de406cb90 0x7f9de406f040 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9df0007fd0 tx=0x7f9df0009e90 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:28:25.597 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.596+0000 7f9de37fe640 1 -- 172.21.15.87:0/1743716181 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f9dec076700 con 0x7f9dfc0666b0 2024-09-17T07:28:25.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:25 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:28:25.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:25 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:28:25.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:25 smithi139 ceph-mon[79872]: pgmap v231: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:28:25.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:25 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:28:25.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:25 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:28:25.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.795+0000 7f9e013f0640 1 -- 172.21.15.87:0/1743716181 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9dfc115280 con 0x7f9dfc0666b0 2024-09-17T07:28:25.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.795+0000 7f9de37fe640 1 -- 172.21.15.87:0/1743716181 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 43 v43) v1 ==== 76+0+1872 (secure 0 0 0) 0x7f9dec079d20 con 0x7f9dfc0666b0 2024-09-17T07:28:25.797 INFO:teuthology.orchestra.run.smithi087.stdout:e43 2024-09-17T07:28:25.797 INFO:teuthology.orchestra.run.smithi087.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T07:28:25.797 INFO:teuthology.orchestra.run.smithi087.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T07:28:25.797 INFO:teuthology.orchestra.run.smithi087.stdout:legacy client fscid: 1 2024-09-17T07:28:25.797 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:28:25.797 INFO:teuthology.orchestra.run.smithi087.stdout:Filesystem 'cephfs' (1) 2024-09-17T07:28:25.797 INFO:teuthology.orchestra.run.smithi087.stdout:fs_name cephfs 2024-09-17T07:28:25.798 INFO:teuthology.orchestra.run.smithi087.stdout:epoch 43 2024-09-17T07:28:25.798 INFO:teuthology.orchestra.run.smithi087.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T07:28:25.798 INFO:teuthology.orchestra.run.smithi087.stdout:created 2024-09-17T07:17:15.368053+0000 2024-09-17T07:28:25.798 INFO:teuthology.orchestra.run.smithi087.stdout:modified 2024-09-17T07:27:41.863112+0000 2024-09-17T07:28:25.798 INFO:teuthology.orchestra.run.smithi087.stdout:tableserver 0 2024-09-17T07:28:25.798 INFO:teuthology.orchestra.run.smithi087.stdout:root 0 2024-09-17T07:28:25.798 INFO:teuthology.orchestra.run.smithi087.stdout:session_timeout 60 2024-09-17T07:28:25.798 INFO:teuthology.orchestra.run.smithi087.stdout:session_autoclose 300 2024-09-17T07:28:25.798 INFO:teuthology.orchestra.run.smithi087.stdout:max_file_size 1099511627776 2024-09-17T07:28:25.798 INFO:teuthology.orchestra.run.smithi087.stdout:max_xattr_size 65536 2024-09-17T07:28:25.798 INFO:teuthology.orchestra.run.smithi087.stdout:required_client_features {} 2024-09-17T07:28:25.798 INFO:teuthology.orchestra.run.smithi087.stdout:last_failure 0 2024-09-17T07:28:25.798 INFO:teuthology.orchestra.run.smithi087.stdout:last_failure_osd_epoch 80 2024-09-17T07:28:25.798 INFO:teuthology.orchestra.run.smithi087.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T07:28:25.799 INFO:teuthology.orchestra.run.smithi087.stdout:max_mds 2 2024-09-17T07:28:25.799 INFO:teuthology.orchestra.run.smithi087.stdout:in 0,1 2024-09-17T07:28:25.799 INFO:teuthology.orchestra.run.smithi087.stdout:up {0=34412,1=34444} 2024-09-17T07:28:25.799 INFO:teuthology.orchestra.run.smithi087.stdout:failed 2024-09-17T07:28:25.799 INFO:teuthology.orchestra.run.smithi087.stdout:damaged 2024-09-17T07:28:25.799 INFO:teuthology.orchestra.run.smithi087.stdout:stopped 2024-09-17T07:28:25.799 INFO:teuthology.orchestra.run.smithi087.stdout:data_pools [3] 2024-09-17T07:28:25.799 INFO:teuthology.orchestra.run.smithi087.stdout:metadata_pool 2 2024-09-17T07:28:25.799 INFO:teuthology.orchestra.run.smithi087.stdout:inline_data enabled 2024-09-17T07:28:25.799 INFO:teuthology.orchestra.run.smithi087.stdout:balancer 2024-09-17T07:28:25.799 INFO:teuthology.orchestra.run.smithi087.stdout:bal_rank_mask -1 2024-09-17T07:28:25.799 INFO:teuthology.orchestra.run.smithi087.stdout:standby_count_wanted 1 2024-09-17T07:28:25.799 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi087.vvbzss{0:34412} state up:active seq 8 join_fscid=1 addr [v2:172.21.15.87:6826/1050918039,v1:172.21.15.87:6827/1050918039] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:28:25.800 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi139.gnwonz{0:44325} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.139:6824/1289261341,v1:172.21.15.139:6825/1289261341] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:28:25.800 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi087.tjhpcs{1:34444} state up:active seq 11 join_fscid=1 addr [v2:172.21.15.87:6828/2375971201,v1:172.21.15.87:6829/2375971201] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:28:25.800 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi139.ftvinf{1:44347} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.139:6826/1126774601,v1:172.21.15.139:6827/1126774601] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:28:25.800 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:28:25.800 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:28:25.801 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 43 2024-09-17T07:28:25.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.797+0000 7f9e013f0640 1 -- 172.21.15.87:0/1743716181 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f9de406cb90 msgr2=0x7f9de406f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:28:25.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.797+0000 7f9e013f0640 1 --2- 172.21.15.87:0/1743716181 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f9de406cb90 0x7f9de406f040 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9df0007fd0 tx=0x7f9df0009e90 comp rx=0 tx=0).stop 2024-09-17T07:28:25.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.797+0000 7f9e013f0640 1 -- 172.21.15.87:0/1743716181 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9dfc0666b0 msgr2=0x7f9dfc0fcba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:28:25.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.797+0000 7f9e013f0640 1 --2- 172.21.15.87:0/1743716181 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9dfc0666b0 0x7f9dfc0fcba0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f9dec009ac0 tx=0x7f9dec009da0 comp rx=0 tx=0).stop 2024-09-17T07:28:25.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.797+0000 7f9e013f0640 1 -- 172.21.15.87:0/1743716181 shutdown_connections 2024-09-17T07:28:25.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.797+0000 7f9e013f0640 1 --2- 172.21.15.87:0/1743716181 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f9de406cb90 0x7f9de406f040 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:28:25.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.797+0000 7f9e013f0640 1 --2- 172.21.15.87:0/1743716181 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9dfc0ff720 0x7f9dfc0fb0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:28:25.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.797+0000 7f9e013f0640 1 --2- 172.21.15.87:0/1743716181 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9dfc0666b0 0x7f9dfc0fcba0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:28:25.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.797+0000 7f9e013f0640 1 -- 172.21.15.87:0/1743716181 >> 172.21.15.87:0/1743716181 conn(0x7f9dfc0f6c10 msgr2=0x7f9dfc0f7030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:28:25.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.797+0000 7f9e013f0640 1 -- 172.21.15.87:0/1743716181 shutdown_connections 2024-09-17T07:28:25.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.797+0000 7f9e013f0640 1 -- 172.21.15.87:0/1743716181 wait complete. 2024-09-17T07:28:25.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.876+0000 7f7467f87640 1 -- 172.21.15.87:0/3549259535 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74600fe4f0 msgr2=0x7f74600fa650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:28:25.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.876+0000 7f7467f87640 1 --2- 172.21.15.87:0/3549259535 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74600fe4f0 0x7f74600fa650 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f74500048d0 tx=0x7f7450009da0 comp rx=0 tx=0).stop 2024-09-17T07:28:25.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.876+0000 7f7467f87640 1 -- 172.21.15.87:0/3549259535 shutdown_connections 2024-09-17T07:28:25.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.876+0000 7f7467f87640 1 --2- 172.21.15.87:0/3549259535 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74600fe4f0 0x7f74600fa650 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:28:25.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.876+0000 7f7467f87640 1 --2- 172.21.15.87:0/3549259535 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f74600fdba0 0x7f74600fdfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:28:25.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.876+0000 7f7467f87640 1 -- 172.21.15.87:0/3549259535 >> 172.21.15.87:0/3549259535 conn(0x7f74600f63a0 msgr2=0x7f74600f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:28:25.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.876+0000 7f7467f87640 1 -- 172.21.15.87:0/3549259535 shutdown_connections 2024-09-17T07:28:25.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.876+0000 7f7467f87640 1 -- 172.21.15.87:0/3549259535 wait complete. 2024-09-17T07:28:25.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.876+0000 7f7467f87640 1 Processor -- start 2024-09-17T07:28:25.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.877+0000 7f7467f87640 1 -- start start 2024-09-17T07:28:25.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.877+0000 7f7467f87640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74600fdba0 0x7f74600fd390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:28:25.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.877+0000 7f7467f87640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f74600fe4f0 0x7f74600fb880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:28:25.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.877+0000 7f7467f87640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74600fbe10 con 0x7f74600fdba0 2024-09-17T07:28:25.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.877+0000 7f7467f87640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74600fbf50 con 0x7f74600fe4f0 2024-09-17T07:28:25.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.877+0000 7f7465d23640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74600fdba0 0x7f74600fd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:28:25.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.877+0000 7f7465d23640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74600fdba0 0x7f74600fd390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:35994/0 (socket says 172.21.15.87:35994) 2024-09-17T07:28:25.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.877+0000 7f7465d23640 1 -- 172.21.15.87:0/923858093 learned_addr learned my addr 172.21.15.87:0/923858093 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:28:25.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.877+0000 7f7465522640 1 --2- 172.21.15.87:0/923858093 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f74600fe4f0 0x7f74600fb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:28:25.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.877+0000 7f7465d23640 1 -- 172.21.15.87:0/923858093 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f74600fe4f0 msgr2=0x7f74600fb880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:28:25.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.877+0000 7f7465d23640 1 --2- 172.21.15.87:0/923858093 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f74600fe4f0 0x7f74600fb880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:28:25.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.877+0000 7f7465d23640 1 -- 172.21.15.87:0/923858093 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7450005040 con 0x7f74600fdba0 2024-09-17T07:28:25.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.878+0000 7f7465d23640 1 --2- 172.21.15.87:0/923858093 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74600fdba0 0x7f74600fd390 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f745c00c810 tx=0x7f745c0043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:28:25.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.878+0000 7f74567fc640 1 -- 172.21.15.87:0/923858093 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f745c00a7a0 con 0x7f74600fdba0 2024-09-17T07:28:25.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.878+0000 7f74567fc640 1 -- 172.21.15.87:0/923858093 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f745c00ad80 con 0x7f74600fdba0 2024-09-17T07:28:25.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.878+0000 7f7467f87640 1 -- 172.21.15.87:0/923858093 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74600fc230 con 0x7f74600fdba0 2024-09-17T07:28:25.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.878+0000 7f74567fc640 1 -- 172.21.15.87:0/923858093 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f745c011380 con 0x7f74600fdba0 2024-09-17T07:28:25.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.878+0000 7f7467f87640 1 -- 172.21.15.87:0/923858093 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7460114ff0 con 0x7f74600fdba0 2024-09-17T07:28:25.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.879+0000 7f7467f87640 1 -- 172.21.15.87:0/923858093 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74600fa040 con 0x7f74600fdba0 2024-09-17T07:28:25.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.879+0000 7f74567fc640 1 -- 172.21.15.87:0/923858093 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f745c012420 con 0x7f74600fdba0 2024-09-17T07:28:25.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.880+0000 7f74567fc640 1 --2- 172.21.15.87:0/923858093 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f744c06cb90 0x7f744c06f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:28:25.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.880+0000 7f74567fc640 1 -- 172.21.15.87:0/923858093 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f745c08c560 con 0x7f74600fdba0 2024-09-17T07:28:25.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.880+0000 7f7465522640 1 --2- 172.21.15.87:0/923858093 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f744c06cb90 0x7f744c06f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:28:25.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.880+0000 7f7465522640 1 --2- 172.21.15.87:0/923858093 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f744c06cb90 0x7f744c06f040 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7450003080 tx=0x7f7450035040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:28:25.885 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:25.884+0000 7f74567fc640 1 -- 172.21.15.87:0/923858093 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f745c056520 con 0x7f74600fdba0 2024-09-17T07:28:26.066 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:26.065+0000 7f7467f87640 1 -- 172.21.15.87:0/923858093 --> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7460101e60 con 0x7f744c06cb90 2024-09-17T07:28:26.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:26.066+0000 7f74567fc640 1 -- 172.21.15.87:0/923858093 <== mgr.24529 v2:172.21.15.87:6800/1359413180 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+440 (secure 0 0 0) 0x7f7460101e60 con 0x7f744c06cb90 2024-09-17T07:28:26.067 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T07:28:26.067 INFO:teuthology.orchestra.run.smithi087.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9", 2024-09-17T07:28:26.067 INFO:teuthology.orchestra.run.smithi087.stdout: "in_progress": true, 2024-09-17T07:28:26.067 INFO:teuthology.orchestra.run.smithi087.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T07:28:26.067 INFO:teuthology.orchestra.run.smithi087.stdout: "services_complete": [ 2024-09-17T07:28:26.068 INFO:teuthology.orchestra.run.smithi087.stdout: "mds", 2024-09-17T07:28:26.068 INFO:teuthology.orchestra.run.smithi087.stdout: "mon", 2024-09-17T07:28:26.068 INFO:teuthology.orchestra.run.smithi087.stdout: "crash", 2024-09-17T07:28:26.068 INFO:teuthology.orchestra.run.smithi087.stdout: "osd", 2024-09-17T07:28:26.068 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr" 2024-09-17T07:28:26.068 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-09-17T07:28:26.068 INFO:teuthology.orchestra.run.smithi087.stdout: "progress": "16/21 daemons upgraded", 2024-09-17T07:28:26.068 INFO:teuthology.orchestra.run.smithi087.stdout: "message": "Currently upgrading alertmanager daemons", 2024-09-17T07:28:26.068 INFO:teuthology.orchestra.run.smithi087.stdout: "is_paused": false 2024-09-17T07:28:26.068 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T07:28:26.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:26.068+0000 7f7467f87640 1 -- 172.21.15.87:0/923858093 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f744c06cb90 msgr2=0x7f744c06f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:28:26.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:26.068+0000 7f7467f87640 1 --2- 172.21.15.87:0/923858093 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f744c06cb90 0x7f744c06f040 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7450003080 tx=0x7f7450035040 comp rx=0 tx=0).stop 2024-09-17T07:28:26.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:26.068+0000 7f7467f87640 1 -- 172.21.15.87:0/923858093 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74600fdba0 msgr2=0x7f74600fd390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:28:26.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:26.068+0000 7f7467f87640 1 --2- 172.21.15.87:0/923858093 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74600fdba0 0x7f74600fd390 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f745c00c810 tx=0x7f745c0043c0 comp rx=0 tx=0).stop 2024-09-17T07:28:26.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:26.068+0000 7f7467f87640 1 -- 172.21.15.87:0/923858093 shutdown_connections 2024-09-17T07:28:26.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:26.068+0000 7f7467f87640 1 --2- 172.21.15.87:0/923858093 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f744c06cb90 0x7f744c06f040 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:28:26.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:26.068+0000 7f7467f87640 1 --2- 172.21.15.87:0/923858093 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f74600fe4f0 0x7f74600fb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:28:26.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:26.068+0000 7f7467f87640 1 --2- 172.21.15.87:0/923858093 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74600fdba0 0x7f74600fd390 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:28:26.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:26.068+0000 7f7467f87640 1 -- 172.21.15.87:0/923858093 >> 172.21.15.87:0/923858093 conn(0x7f74600f63a0 msgr2=0x7f74600f7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:28:26.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:26.068+0000 7f7467f87640 1 -- 172.21.15.87:0/923858093 shutdown_connections 2024-09-17T07:28:26.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:26.068+0000 7f7467f87640 1 -- 172.21.15.87:0/923858093 wait complete. 2024-09-17T07:28:26.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:26.148+0000 7f747ba49640 1 -- 172.21.15.87:0/2779161644 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74740fa960 msgr2=0x7f74740fad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:28:26.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:26.148+0000 7f747ba49640 1 --2- 172.21.15.87:0/2779161644 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74740fa960 0x7f74740fad70 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f74700048d0 tx=0x7f7470009da0 comp rx=0 tx=0).stop 2024-09-17T07:28:26.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:26.149+0000 7f747ba49640 1 -- 172.21.15.87:0/2779161644 shutdown_connections 2024-09-17T07:28:26.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:26.149+0000 7f747ba49640 1 --2- 172.21.15.87:0/2779161644 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f74740fb2b0 0x7f74740fdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:28:26.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:26.149+0000 7f747ba49640 1 --2- 172.21.15.87:0/2779161644 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74740fa960 0x7f74740fad70 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:28:26.151 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:26.149+0000 7f747ba49640 1 -- 172.21.15.87:0/2779161644 >> 172.21.15.87:0/2779161644 conn(0x7f74740f63a0 msgr2=0x7f74740f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:28:26.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:26.149+0000 7f747ba49640 1 -- 172.21.15.87:0/2779161644 shutdown_connections 2024-09-17T07:28:26.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:26.149+0000 7f747ba49640 1 -- 172.21.15.87:0/2779161644 wait complete. 2024-09-17T07:28:26.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:26.149+0000 7f747ba49640 1 Processor -- start 2024-09-17T07:28:26.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:26.149+0000 7f747ba49640 1 -- start start 2024-09-17T07:28:26.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:26.149+0000 7f747ba49640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74740fa960 0x7f747410d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:28:26.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:26.149+0000 7f747ba49640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f74740fb2b0 0x7f747410d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:28:26.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:26.149+0000 7f747ba49640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f747410ddd0 con 0x7f74740fa960 2024-09-17T07:28:26.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:26.149+0000 7f747ba49640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f747410e5f0 con 0x7f74740fb2b0 2024-09-17T07:28:26.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:26.149+0000 7f74797e5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74740fa960 0x7f747410d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:28:26.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:26.149+0000 7f74797e5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74740fa960 0x7f747410d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:36022/0 (socket says 172.21.15.87:36022) 2024-09-17T07:28:26.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:26.149+0000 7f74797e5640 1 -- 172.21.15.87:0/386294230 learned_addr learned my addr 172.21.15.87:0/386294230 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:28:26.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:26.150+0000 7f7478fe4640 1 --2- 172.21.15.87:0/386294230 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f74740fb2b0 0x7f747410d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:28:26.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:26.150+0000 7f74797e5640 1 -- 172.21.15.87:0/386294230 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f74740fb2b0 msgr2=0x7f747410d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:28:26.152 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:26.150+0000 7f74797e5640 1 --2- 172.21.15.87:0/386294230 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f74740fb2b0 0x7f747410d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:28:26.153 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:26.150+0000 7f74797e5640 1 -- 172.21.15.87:0/386294230 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7470005040 con 0x7f74740fa960 2024-09-17T07:28:26.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:26.150+0000 7f74797e5640 1 --2- 172.21.15.87:0/386294230 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74740fa960 0x7f747410d240 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7470009ac0 tx=0x7f7470009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:28:26.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:26.150+0000 7f7469ffb640 1 -- 172.21.15.87:0/386294230 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7470038070 con 0x7f74740fa960 2024-09-17T07:28:26.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:26.150+0000 7f7469ffb640 1 -- 172.21.15.87:0/386294230 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f74700096c0 con 0x7f74740fa960 2024-09-17T07:28:26.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:26.150+0000 7f747ba49640 1 -- 172.21.15.87:0/386294230 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f747410e820 con 0x7f74740fa960 2024-09-17T07:28:26.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:26.150+0000 7f7469ffb640 1 -- 172.21.15.87:0/386294230 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f747003d420 con 0x7f74740fa960 2024-09-17T07:28:26.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:26.150+0000 7f747ba49640 1 -- 172.21.15.87:0/386294230 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f747410edc0 con 0x7f74740fa960 2024-09-17T07:28:26.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:26.152+0000 7f747ba49640 1 -- 172.21.15.87:0/386294230 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74740fa040 con 0x7f74740fa960 2024-09-17T07:28:26.154 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:26.152+0000 7f7469ffb640 1 -- 172.21.15.87:0/386294230 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f7470030020 con 0x7f74740fa960 2024-09-17T07:28:26.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:26.153+0000 7f7469ffb640 1 --2- 172.21.15.87:0/386294230 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f746006cb90 0x7f746006f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:28:26.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:26.153+0000 7f7469ffb640 1 -- 172.21.15.87:0/386294230 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f74700ac640 con 0x7f74740fa960 2024-09-17T07:28:26.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:26.153+0000 7f7478fe4640 1 --2- 172.21.15.87:0/386294230 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f746006cb90 0x7f746006f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:28:26.155 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:26.154+0000 7f7478fe4640 1 --2- 172.21.15.87:0/386294230 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f746006cb90 0x7f746006f040 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f747410cff0 tx=0x7f746400b040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:28:26.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:26.157+0000 7f7469ffb640 1 -- 172.21.15.87:0/386294230 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7470076600 con 0x7f74740fa960 2024-09-17T07:28:26.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:26.389+0000 7f747ba49640 1 -- 172.21.15.87:0/386294230 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f747404b720 con 0x7f74740fa960 2024-09-17T07:28:26.390 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:26 smithi087 ceph-mon[90982]: from='client.34512 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:28:26.390 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:26 smithi087 ceph-mon[90982]: from='client.34516 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:28:26.391 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:26 smithi087 ceph-mon[90982]: from='client.34520 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:28:26.391 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:26 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/680123485' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:26.391 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:26 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/1743716181' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T07:28:26.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:26.389+0000 7f7469ffb640 1 -- 172.21.15.87:0/386294230 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f7470035050 con 0x7f74740fa960 2024-09-17T07:28:26.391 INFO:teuthology.orchestra.run.smithi087.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T07:28:26.391 INFO:teuthology.orchestra.run.smithi087.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T07:28:26.391 INFO:teuthology.orchestra.run.smithi087.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T07:28:26.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:26.391+0000 7f747ba49640 1 -- 172.21.15.87:0/386294230 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f746006cb90 msgr2=0x7f746006f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:28:26.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:26.391+0000 7f747ba49640 1 --2- 172.21.15.87:0/386294230 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f746006cb90 0x7f746006f040 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f747410cff0 tx=0x7f746400b040 comp rx=0 tx=0).stop 2024-09-17T07:28:26.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:26.391+0000 7f747ba49640 1 -- 172.21.15.87:0/386294230 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74740fa960 msgr2=0x7f747410d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:28:26.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:26.391+0000 7f747ba49640 1 --2- 172.21.15.87:0/386294230 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74740fa960 0x7f747410d240 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7470009ac0 tx=0x7f7470009da0 comp rx=0 tx=0).stop 2024-09-17T07:28:26.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:26.391+0000 7f747ba49640 1 -- 172.21.15.87:0/386294230 shutdown_connections 2024-09-17T07:28:26.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:26.391+0000 7f747ba49640 1 --2- 172.21.15.87:0/386294230 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f746006cb90 0x7f746006f040 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:28:26.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:26.391+0000 7f747ba49640 1 --2- 172.21.15.87:0/386294230 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f74740fb2b0 0x7f747410d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:28:26.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:26.391+0000 7f747ba49640 1 --2- 172.21.15.87:0/386294230 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74740fa960 0x7f747410d240 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:28:26.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:26.391+0000 7f747ba49640 1 -- 172.21.15.87:0/386294230 >> 172.21.15.87:0/386294230 conn(0x7f74740f63a0 msgr2=0x7f74740f7fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:28:26.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:26.392+0000 7f747ba49640 1 -- 172.21.15.87:0/386294230 shutdown_connections 2024-09-17T07:28:26.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:26.392+0000 7f747ba49640 1 -- 172.21.15.87:0/386294230 wait complete. 2024-09-17T07:28:26.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:26 smithi139 ceph-mon[79872]: from='client.34512 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:28:26.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:26 smithi139 ceph-mon[79872]: from='client.34516 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:28:26.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:26 smithi139 ceph-mon[79872]: from='client.34520 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:28:26.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:26 smithi139 ceph-mon[79872]: from='client.? 172.21.15.87:0/680123485' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:26.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:26 smithi139 ceph-mon[79872]: from='client.? 172.21.15.87:0/1743716181' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T07:28:27.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:27 smithi087 ceph-mon[90982]: from='client.34532 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:28:27.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:27 smithi087 ceph-mon[90982]: pgmap v232: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:28:27.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:27 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/386294230' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T07:28:27.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:27 smithi139 ceph-mon[79872]: from='client.34532 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:28:27.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:27 smithi139 ceph-mon[79872]: pgmap v232: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:28:27.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:27 smithi139 ceph-mon[79872]: from='client.? 172.21.15.87:0/386294230' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T07:28:29.052 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:28 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:28:29.052 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:28 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:28:29.052 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:28 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:28:29.052 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:28 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:28:29.052 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:28 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:28:29.052 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:28 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-17T07:28:29.052 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:28 smithi087 ceph-mon[90982]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-17T07:28:29.052 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:28 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:28:29.053 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:28 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:28:29.053 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:28 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:29.053 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:28 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:29.053 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:28 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:29.053 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:28 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:29.053 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:28 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:29.053 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:28 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:29.053 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:28 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:29.053 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:28 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:29.053 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:28 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:29.053 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:28 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:29.053 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:28 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:29.054 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:28 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:29.054 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:28 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:29.054 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:28 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:29.054 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:28 smithi087 ceph-mon[90982]: pgmap v233: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:28:29.054 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:28 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:29.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:28 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:28:29.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:28 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:28:29.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:28 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:28:29.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:28 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:28:29.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:28 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:28:29.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:28 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-17T07:28:29.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:28 smithi139 ceph-mon[79872]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-17T07:28:29.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:28 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:28:29.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:28 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:28:29.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:28 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:29.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:28 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:29.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:28 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:29.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:28 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:29.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:28 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:29.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:28 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:29.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:28 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:29.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:28 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:29.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:28 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:29.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:28 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:29.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:28 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:29.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:28 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:29.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:28 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:29.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:28 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:29.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:28 smithi139 ceph-mon[79872]: pgmap v233: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:28:29.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:28 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:31.287 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:31 smithi087 ceph-mon[90982]: Upgrade: Updating grafana.smithi087 2024-09-17T07:28:31.287 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:31 smithi087 ceph-mon[90982]: Deploying daemon grafana.smithi087 on smithi087 2024-09-17T07:28:31.287 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:31 smithi087 ceph-mon[90982]: pgmap v234: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:28:31.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:31 smithi139 ceph-mon[79872]: Upgrade: Updating grafana.smithi087 2024-09-17T07:28:31.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:31 smithi139 ceph-mon[79872]: Deploying daemon grafana.smithi087 on smithi087 2024-09-17T07:28:31.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:31 smithi139 ceph-mon[79872]: pgmap v234: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:28:33.602 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:33 smithi087 ceph-mon[90982]: pgmap v235: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:28:33.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:33 smithi139 ceph-mon[79872]: pgmap v235: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:28:35.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:35 smithi087 ceph-mon[90982]: pgmap v236: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:28:35.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:35 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:28:35.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:35 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:28:35.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:35 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:28:35.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:35 smithi139 ceph-mon[79872]: pgmap v236: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:28:35.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:35 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:28:35.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:35 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:28:35.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:35 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:28:37.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:37 smithi087 ceph-mon[90982]: pgmap v237: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:28:37.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:37 smithi139 ceph-mon[79872]: pgmap v237: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:28:39.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:39 smithi087 ceph-mon[90982]: pgmap v238: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:28:39.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:39 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:28:39.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:39 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:28:39.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:39 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:28:39.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:39 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:28:39.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:39 smithi139 ceph-mon[79872]: pgmap v238: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:28:39.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:39 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:28:39.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:39 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:28:39.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:39 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:28:39.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:39 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:28:41.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:41 smithi139 ceph-mon[79872]: pgmap v239: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:28:41.642 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:41 smithi087 ceph-mon[90982]: pgmap v239: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:28:43.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:28:43.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:28:43.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:28:43.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:28:43.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:28:43.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:43 smithi139 ceph-mon[79872]: pgmap v240: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:28:43.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-17T07:28:43.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:43 smithi139 ceph-mon[79872]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-17T07:28:43.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:28:43.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:43.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:43.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:43.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:43.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:43.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:43.368 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:43.369 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:43.369 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:43.369 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:43.369 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:43.369 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:43.369 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:43.369 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:43.369 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:43.369 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:43.369 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:43.369 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:43.369 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:43 smithi139 ceph-mon[79872]: Upgrade: Finalizing container_image settings 2024-09-17T07:28:43.369 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:28:43.370 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-17T07:28:43.370 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-17T07:28:43.370 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-17T07:28:43.370 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-17T07:28:43.370 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-17T07:28:43.370 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-17T07:28:43.370 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-17T07:28:43.370 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-17T07:28:43.370 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-17T07:28:43.370 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-17T07:28:43.370 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-17T07:28:43.370 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-17T07:28:43.370 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-17T07:28:43.370 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-17T07:28:43.371 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-17T07:28:43.371 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-17T07:28:43.371 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-17T07:28:43.371 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-17T07:28:43.371 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-17T07:28:43.371 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-17T07:28:43.371 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-17T07:28:43.371 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-17T07:28:43.371 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-17T07:28:43.371 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-17T07:28:43.372 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-17T07:28:43.372 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-17T07:28:43.372 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-17T07:28:43.372 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-17T07:28:43.372 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-17T07:28:43.372 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-09-17T07:28:43.372 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]': finished 2024-09-17T07:28:43.372 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:43 smithi139 ceph-mon[79872]: Upgrade: Complete! 2024-09-17T07:28:43.372 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-17T07:28:43.372 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-17T07:28:43.372 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:28:43.372 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:28:43.372 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:28:43.373 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:28:43.373 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:28:43.373 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:28:43.373 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:28:43.373 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:28:43.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:28:43.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:28:43.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:28:43.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:28:43.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:28:43.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:43 smithi087 ceph-mon[90982]: pgmap v240: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:28:43.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-17T07:28:43.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:43 smithi087 ceph-mon[90982]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-17T07:28:43.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:28:43.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:43.428 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:43.428 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:43.428 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:43.428 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:43.428 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:43.428 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:43.428 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:43.428 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:43.428 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:43.428 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:43.428 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:43.428 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:43.428 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:43.429 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:43.429 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:43.429 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:43.429 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:28:43.429 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:43 smithi087 ceph-mon[90982]: Upgrade: Finalizing container_image settings 2024-09-17T07:28:43.429 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:28:43.429 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-17T07:28:43.429 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-17T07:28:43.429 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-17T07:28:43.429 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-17T07:28:43.429 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-17T07:28:43.429 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-17T07:28:43.429 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-17T07:28:43.429 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-17T07:28:43.430 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-17T07:28:43.430 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-17T07:28:43.430 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-17T07:28:43.430 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-17T07:28:43.430 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-17T07:28:43.430 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-17T07:28:43.430 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-17T07:28:43.430 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-17T07:28:43.430 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-17T07:28:43.430 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-17T07:28:43.430 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-17T07:28:43.431 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-17T07:28:43.431 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-17T07:28:43.431 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-17T07:28:43.431 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-17T07:28:43.431 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-17T07:28:43.431 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-17T07:28:43.431 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-17T07:28:43.431 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-17T07:28:43.431 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-17T07:28:43.431 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-17T07:28:43.431 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-09-17T07:28:43.431 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd='[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]': finished 2024-09-17T07:28:43.431 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:43 smithi087 ceph-mon[90982]: Upgrade: Complete! 2024-09-17T07:28:43.432 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-17T07:28:43.432 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-17T07:28:43.432 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:28:43.432 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:28:43.432 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:28:43.432 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:28:43.432 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:28:43.432 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:28:43.432 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:28:43.432 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:28:44.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:44 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:28:44.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:44 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:28:44.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:44 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:28:44.427 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:44 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:28:45.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:45 smithi139 ceph-mon[79872]: pgmap v241: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:28:45.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:45 smithi087 ceph-mon[90982]: pgmap v241: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:28:47.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:47 smithi139 ceph-mon[79872]: pgmap v242: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:28:47.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:47 smithi087 ceph-mon[90982]: pgmap v242: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:28:49.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:49 smithi139 ceph-mon[79872]: pgmap v243: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:28:49.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:49 smithi087 ceph-mon[90982]: pgmap v243: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:28:51.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:51 smithi139 ceph-mon[79872]: pgmap v244: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:28:51.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:51 smithi087 ceph-mon[90982]: pgmap v244: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:28:53.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:53 smithi139 ceph-mon[79872]: pgmap v245: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:28:53.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:53 smithi087 ceph-mon[90982]: pgmap v245: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:28:55.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:55 smithi139 ceph-mon[79872]: pgmap v246: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:28:55.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:55 smithi087 ceph-mon[90982]: pgmap v246: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:28:56.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:56.482+0000 7fc9e027b640 1 -- 172.21.15.87:0/3868132505 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9d80ff680 msgr2=0x7fc9d8101a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:28:56.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:56.482+0000 7fc9e027b640 1 --2- 172.21.15.87:0/3868132505 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9d80ff680 0x7fc9d8101a60 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc0048d0 tx=0x7fc9cc009da0 comp rx=0 tx=0).stop 2024-09-17T07:28:56.484 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:56.482+0000 7fc9e027b640 1 -- 172.21.15.87:0/3868132505 shutdown_connections 2024-09-17T07:28:56.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:56.482+0000 7fc9e027b640 1 --2- 172.21.15.87:0/3868132505 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9d80ff680 0x7fc9d8101a60 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:28:56.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:56.482+0000 7fc9e027b640 1 --2- 172.21.15.87:0/3868132505 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc9d8065c40 0x7fc9d80ff140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:28:56.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:56.482+0000 7fc9e027b640 1 -- 172.21.15.87:0/3868132505 >> 172.21.15.87:0/3868132505 conn(0x7fc9d80f6c10 msgr2=0x7fc9d80f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:28:56.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:56.482+0000 7fc9e027b640 1 -- 172.21.15.87:0/3868132505 shutdown_connections 2024-09-17T07:28:56.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:56.482+0000 7fc9e027b640 1 -- 172.21.15.87:0/3868132505 wait complete. 2024-09-17T07:28:56.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:56.483+0000 7fc9e027b640 1 Processor -- start 2024-09-17T07:28:56.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:56.483+0000 7fc9e027b640 1 -- start start 2024-09-17T07:28:56.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:56.483+0000 7fc9e027b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9d8065c40 0x7fc9d810cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:28:56.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:56.483+0000 7fc9e027b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc9d80ff680 0x7fc9d810d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:28:56.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:56.483+0000 7fc9e027b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d810db60 con 0x7fc9d8065c40 2024-09-17T07:28:56.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:56.483+0000 7fc9e027b640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d810e330 con 0x7fc9d80ff680 2024-09-17T07:28:56.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:56.483+0000 7fc9de017640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9d8065c40 0x7fc9d810cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:28:56.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:56.483+0000 7fc9de017640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9d8065c40 0x7fc9d810cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55362/0 (socket says 172.21.15.87:55362) 2024-09-17T07:28:56.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:56.483+0000 7fc9de017640 1 -- 172.21.15.87:0/2480625938 learned_addr learned my addr 172.21.15.87:0/2480625938 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:28:56.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:56.483+0000 7fc9dd816640 1 --2- 172.21.15.87:0/2480625938 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc9d80ff680 0x7fc9d810d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:28:56.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:56.483+0000 7fc9de017640 1 -- 172.21.15.87:0/2480625938 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc9d80ff680 msgr2=0x7fc9d810d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:28:56.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:56.483+0000 7fc9de017640 1 --2- 172.21.15.87:0/2480625938 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc9d80ff680 0x7fc9d810d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:28:56.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:56.483+0000 7fc9de017640 1 -- 172.21.15.87:0/2480625938 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9cc005040 con 0x7fc9d8065c40 2024-09-17T07:28:56.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:56.484+0000 7fc9de017640 1 --2- 172.21.15.87:0/2480625938 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9d8065c40 0x7fc9d810cfd0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc9c800cb10 tx=0x7fc9c8007e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:28:56.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:56.484+0000 7fc9d6ffd640 1 -- 172.21.15.87:0/2480625938 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9c800aa50 con 0x7fc9d8065c40 2024-09-17T07:28:56.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:56.484+0000 7fc9d6ffd640 1 -- 172.21.15.87:0/2480625938 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fc9c800abb0 con 0x7fc9d8065c40 2024-09-17T07:28:56.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:56.484+0000 7fc9e027b640 1 -- 172.21.15.87:0/2480625938 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9d810e5c0 con 0x7fc9d8065c40 2024-09-17T07:28:56.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:56.484+0000 7fc9d6ffd640 1 -- 172.21.15.87:0/2480625938 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9c80115e0 con 0x7fc9d8065c40 2024-09-17T07:28:56.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:56.484+0000 7fc9e027b640 1 -- 172.21.15.87:0/2480625938 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9d810eb30 con 0x7fc9d8065c40 2024-09-17T07:28:56.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:56.485+0000 7fc9e027b640 1 -- 172.21.15.87:0/2480625938 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9d8105600 con 0x7fc9d8065c40 2024-09-17T07:28:56.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:56.486+0000 7fc9d6ffd640 1 -- 172.21.15.87:0/2480625938 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fc9c800ad20 con 0x7fc9d8065c40 2024-09-17T07:28:56.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:56.486+0000 7fc9d6ffd640 1 --2- 172.21.15.87:0/2480625938 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fc9c006cb90 0x7fc9c006f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:28:56.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:56.486+0000 7fc9d6ffd640 1 -- 172.21.15.87:0/2480625938 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fc9c808c710 con 0x7fc9d8065c40 2024-09-17T07:28:56.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:56.486+0000 7fc9dd816640 1 --2- 172.21.15.87:0/2480625938 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fc9c006cb90 0x7fc9c006f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:28:56.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:56.487+0000 7fc9dd816640 1 --2- 172.21.15.87:0/2480625938 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fc9c006cb90 0x7fc9c006f040 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc003080 tx=0x7fc9cc035040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:28:56.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:56.490+0000 7fc9d6ffd640 1 -- 172.21.15.87:0/2480625938 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc9c8056750 con 0x7fc9d8065c40 2024-09-17T07:28:56.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:56.667+0000 7fc9e027b640 1 -- 172.21.15.87:0/2480625938 --> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc9d810ef10 con 0x7fc9c006cb90 2024-09-17T07:28:56.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:56.669+0000 7fc9d6ffd640 1 -- 172.21.15.87:0/2480625938 <== mgr.24529 v2:172.21.15.87:6800/1359413180 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7fc9d810ef10 con 0x7fc9c006cb90 2024-09-17T07:28:56.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:56.670+0000 7fc9e027b640 1 -- 172.21.15.87:0/2480625938 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fc9c006cb90 msgr2=0x7fc9c006f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:28:56.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:56.670+0000 7fc9e027b640 1 --2- 172.21.15.87:0/2480625938 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fc9c006cb90 0x7fc9c006f040 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc003080 tx=0x7fc9cc035040 comp rx=0 tx=0).stop 2024-09-17T07:28:56.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:56.670+0000 7fc9e027b640 1 -- 172.21.15.87:0/2480625938 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9d8065c40 msgr2=0x7fc9d810cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:28:56.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:56.670+0000 7fc9e027b640 1 --2- 172.21.15.87:0/2480625938 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9d8065c40 0x7fc9d810cfd0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc9c800cb10 tx=0x7fc9c8007e70 comp rx=0 tx=0).stop 2024-09-17T07:28:56.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:56.671+0000 7fc9e027b640 1 -- 172.21.15.87:0/2480625938 shutdown_connections 2024-09-17T07:28:56.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:56.671+0000 7fc9e027b640 1 --2- 172.21.15.87:0/2480625938 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fc9c006cb90 0x7fc9c006f040 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:28:56.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:56.671+0000 7fc9e027b640 1 --2- 172.21.15.87:0/2480625938 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc9d80ff680 0x7fc9d810d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:28:56.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:56.671+0000 7fc9e027b640 1 --2- 172.21.15.87:0/2480625938 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9d8065c40 0x7fc9d810cfd0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:28:56.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:56.671+0000 7fc9e027b640 1 -- 172.21.15.87:0/2480625938 >> 172.21.15.87:0/2480625938 conn(0x7fc9d80f6c10 msgr2=0x7fc9d80f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:28:56.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:56.671+0000 7fc9e027b640 1 -- 172.21.15.87:0/2480625938 shutdown_connections 2024-09-17T07:28:56.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:56.671+0000 7fc9e027b640 1 -- 172.21.15.87:0/2480625938 wait complete. 2024-09-17T07:28:57.322 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:57 smithi087 ceph-mon[90982]: pgmap v247: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:28:57.347 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -e sha1=19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 -- bash -c 'ceph orch ps' 2024-09-17T07:28:57.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:57 smithi139 ceph-mon[79872]: pgmap v247: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:28:57.642 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/mon.smithi087/config 2024-09-17T07:28:58.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:58 smithi087 ceph-mon[90982]: from='client.34540 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:28:58.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:58 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:28:58.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:58 smithi139 ceph-mon[79872]: from='client.34540 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:28:58.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:58 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:28:59.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:59.376+0000 7ff704184640 1 -- 172.21.15.87:0/2417041776 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff6fc0fdf20 msgr2=0x7ff6fc1065f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:28:59.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:59.376+0000 7ff704184640 1 --2- 172.21.15.87:0/2417041776 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff6fc0fdf20 0x7ff6fc1065f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff6f8004900 tx=0x7ff6f8009da0 comp rx=0 tx=0).stop 2024-09-17T07:28:59.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:59.376+0000 7ff704184640 1 -- 172.21.15.87:0/2417041776 shutdown_connections 2024-09-17T07:28:59.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:59.376+0000 7ff704184640 1 --2- 172.21.15.87:0/2417041776 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff6fc0fdf20 0x7ff6fc1065f0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:28:59.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:59.376+0000 7ff704184640 1 --2- 172.21.15.87:0/2417041776 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff6fc0fd580 0x7ff6fc0fd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:28:59.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:59.376+0000 7ff704184640 1 -- 172.21.15.87:0/2417041776 >> 172.21.15.87:0/2417041776 conn(0x7ff6fc0f7060 msgr2=0x7ff6fc0f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:28:59.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:59.376+0000 7ff704184640 1 -- 172.21.15.87:0/2417041776 shutdown_connections 2024-09-17T07:28:59.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:59.376+0000 7ff704184640 1 -- 172.21.15.87:0/2417041776 wait complete. 2024-09-17T07:28:59.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:59.377+0000 7ff704184640 1 Processor -- start 2024-09-17T07:28:59.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:59.377+0000 7ff704184640 1 -- start start 2024-09-17T07:28:59.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:59.377+0000 7ff704184640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff6fc0fd580 0x7ff6fc1131e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:28:59.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:59.377+0000 7ff704184640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff6fc0fdf20 0x7ff6fc113720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:28:59.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:59.377+0000 7ff704184640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc113d20 con 0x7ff6fc0fd580 2024-09-17T07:28:59.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:59.377+0000 7ff704184640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc10d160 con 0x7ff6fc0fdf20 2024-09-17T07:28:59.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:59.377+0000 7ff701f20640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff6fc0fd580 0x7ff6fc1131e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:28:59.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:59.377+0000 7ff701f20640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff6fc0fd580 0x7ff6fc1131e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55376/0 (socket says 172.21.15.87:55376) 2024-09-17T07:28:59.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:59.377+0000 7ff701f20640 1 -- 172.21.15.87:0/719108140 learned_addr learned my addr 172.21.15.87:0/719108140 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:28:59.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:59.377+0000 7ff701f20640 1 -- 172.21.15.87:0/719108140 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff6fc0fdf20 msgr2=0x7ff6fc113720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:28:59.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:59.377+0000 7ff701f20640 1 --2- 172.21.15.87:0/719108140 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff6fc0fdf20 0x7ff6fc113720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:28:59.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:59.377+0000 7ff701f20640 1 -- 172.21.15.87:0/719108140 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6f8005040 con 0x7ff6fc0fd580 2024-09-17T07:28:59.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:59.377+0000 7ff701f20640 1 --2- 172.21.15.87:0/719108140 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff6fc0fd580 0x7ff6fc1131e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec002a50 tx=0x7ff6ec004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:28:59.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:59.378+0000 7ff6f27fc640 1 -- 172.21.15.87:0/719108140 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6ec007c30 con 0x7ff6fc0fd580 2024-09-17T07:28:59.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:59.378+0000 7ff6f27fc640 1 -- 172.21.15.87:0/719108140 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7ff6ec00f040 con 0x7ff6fc0fd580 2024-09-17T07:28:59.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:59.378+0000 7ff704184640 1 -- 172.21.15.87:0/719108140 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6fc10d440 con 0x7ff6fc0fd580 2024-09-17T07:28:59.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:59.378+0000 7ff6f27fc640 1 -- 172.21.15.87:0/719108140 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6ec00d990 con 0x7ff6fc0fd580 2024-09-17T07:28:59.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:59.378+0000 7ff704184640 1 -- 172.21.15.87:0/719108140 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6fc10d960 con 0x7ff6fc0fd580 2024-09-17T07:28:59.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:59.379+0000 7ff704184640 1 -- 172.21.15.87:0/719108140 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6fc0662d0 con 0x7ff6fc0fd580 2024-09-17T07:28:59.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:59.379+0000 7ff6f27fc640 1 -- 172.21.15.87:0/719108140 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7ff6ec00dc00 con 0x7ff6fc0fd580 2024-09-17T07:28:59.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:59.380+0000 7ff6f27fc640 1 --2- 172.21.15.87:0/719108140 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7ff6e806cb90 0x7ff6e806f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:28:59.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:59.380+0000 7ff6f27fc640 1 -- 172.21.15.87:0/719108140 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6496+0+0 (secure 0 0 0) 0x7ff6ec08b960 con 0x7ff6fc0fd580 2024-09-17T07:28:59.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:59.380+0000 7ff70171f640 1 --2- 172.21.15.87:0/719108140 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7ff6e806cb90 0x7ff6e806f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:28:59.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:59.380+0000 7ff70171f640 1 --2- 172.21.15.87:0/719108140 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7ff6e806cb90 0x7ff6e806f040 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff6f80043d0 tx=0x7ff6f8009da0 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:28:59.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:59.384+0000 7ff6f27fc640 1 -- 172.21.15.87:0/719108140 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff6ec0559a0 con 0x7ff6fc0fd580 2024-09-17T07:28:59.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:59.551+0000 7ff704184640 1 -- 172.21.15.87:0/719108140 --> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff6fc109490 con 0x7ff6e806cb90 2024-09-17T07:28:59.553 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:28:59 smithi087 ceph-mon[90982]: pgmap v248: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:28:59.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:59.560+0000 7ff6f27fc640 1 -- 172.21.15.87:0/719108140 <== mgr.24529 v2:172.21.15.87:6800/1359413180 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7ff6fc109490 con 0x7ff6e806cb90 2024-09-17T07:28:59.561 INFO:teuthology.orchestra.run.smithi087.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T07:28:59.561 INFO:teuthology.orchestra.run.smithi087.stdout:alertmanager.smithi087 smithi087 *:9093,9094 running (40s) 21s ago 16m 15.6M - 0.25.0 c8568f914cd2 f234770ff301 2024-09-17T07:28:59.561 INFO:teuthology.orchestra.run.smithi087.stdout:crash.smithi087 smithi087 running (6m) 21s ago 17m 6895k - 18.2.4-855-g19e2a2be 980a0bfcd684 0ff8a9330162 2024-09-17T07:28:59.561 INFO:teuthology.orchestra.run.smithi087.stdout:crash.smithi139 smithi139 running (6m) 67s ago 16m 6899k - 18.2.4-855-g19e2a2be 980a0bfcd684 10541e3b202e 2024-09-17T07:28:59.561 INFO:teuthology.orchestra.run.smithi087.stdout:grafana.smithi087 smithi087 *:3000 running (25s) 21s ago 16m 37.3M - 9.4.7 954c08fa6188 b671928d45a1 2024-09-17T07:28:59.561 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi087.tjhpcs smithi087 running (118s) 21s ago 11m 16.2M - 18.2.4-855-g19e2a2be 980a0bfcd684 593471a4a9e2 2024-09-17T07:28:59.562 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi087.vvbzss smithi087 running (2m) 21s ago 11m 67.3M - 18.2.4-855-g19e2a2be 980a0bfcd684 e50f437839ed 2024-09-17T07:28:59.562 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi139.ftvinf smithi139 running (85s) 67s ago 11m 14.1M - 18.2.4-855-g19e2a2be 980a0bfcd684 17708393d8d9 2024-09-17T07:28:59.562 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi139.gnwonz smithi139 running (99s) 67s ago 11m 225M - 18.2.4-855-g19e2a2be 980a0bfcd684 6ae45fadd7a2 2024-09-17T07:28:59.562 INFO:teuthology.orchestra.run.smithi087.stdout:mgr.smithi087.vuvjer smithi087 *:8443,9283,8765 running (7m) 21s ago 18m 501M - 18.2.4-855-g19e2a2be 980a0bfcd684 5d10c647cb6b 2024-09-17T07:28:59.562 INFO:teuthology.orchestra.run.smithi087.stdout:mgr.smithi139.tuqnpn smithi139 *:8443,9283,8765 running (7m) 67s ago 16m 440M - 18.2.4-855-g19e2a2be 980a0bfcd684 6e0bf371d44c 2024-09-17T07:28:59.562 INFO:teuthology.orchestra.run.smithi087.stdout:mon.smithi087 smithi087 running (7m) 21s ago 18m 52.6M 2048M 18.2.4-855-g19e2a2be 980a0bfcd684 305c72de1f9f 2024-09-17T07:28:59.562 INFO:teuthology.orchestra.run.smithi087.stdout:mon.smithi139 smithi139 running (6m) 67s ago 15m 40.0M 2048M 18.2.4-855-g19e2a2be 980a0bfcd684 0b159495af0f 2024-09-17T07:28:59.562 INFO:teuthology.orchestra.run.smithi087.stdout:node-exporter.smithi087 smithi087 *:9100 running (74s) 21s ago 17m 7696k - 1.5.0 0da6a335fe13 5aca7ee26d83 2024-09-17T07:28:59.562 INFO:teuthology.orchestra.run.smithi087.stdout:node-exporter.smithi139 smithi139 *:9100 running (70s) 67s ago 16m 3401k - 1.5.0 0da6a335fe13 6d18794119c8 2024-09-17T07:28:59.562 INFO:teuthology.orchestra.run.smithi087.stdout:osd.0 smithi087 running (5m) 21s ago 15m 96.8M 1557M 18.2.4-855-g19e2a2be 980a0bfcd684 e97cb50e6aec 2024-09-17T07:28:59.562 INFO:teuthology.orchestra.run.smithi087.stdout:osd.1 smithi087 running (5m) 21s ago 14m 102M 1557M 18.2.4-855-g19e2a2be 980a0bfcd684 b108771d0b8e 2024-09-17T07:28:59.562 INFO:teuthology.orchestra.run.smithi087.stdout:osd.2 smithi087 running (4m) 21s ago 14m 88.2M 1557M 18.2.4-855-g19e2a2be 980a0bfcd684 240cfb3b5366 2024-09-17T07:28:59.562 INFO:teuthology.orchestra.run.smithi087.stdout:osd.3 smithi139 running (4m) 67s ago 13m 115M 2581M 18.2.4-855-g19e2a2be 980a0bfcd684 b05ed3bf3f5c 2024-09-17T07:28:59.563 INFO:teuthology.orchestra.run.smithi087.stdout:osd.4 smithi139 running (3m) 67s ago 13m 99.6M 2581M 18.2.4-855-g19e2a2be 980a0bfcd684 139bbfc915c8 2024-09-17T07:28:59.563 INFO:teuthology.orchestra.run.smithi087.stdout:osd.5 smithi139 running (3m) 67s ago 13m 88.5M 2581M 18.2.4-855-g19e2a2be 980a0bfcd684 5058216f1ee0 2024-09-17T07:28:59.563 INFO:teuthology.orchestra.run.smithi087.stdout:prometheus.smithi087 smithi087 *:9095 running (54s) 21s ago 16m 48.7M - 2.43.0 a07b618ecd1d fbe2cbcbd68f 2024-09-17T07:28:59.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:59.562+0000 7ff704184640 1 -- 172.21.15.87:0/719108140 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7ff6e806cb90 msgr2=0x7ff6e806f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:28:59.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:59.562+0000 7ff704184640 1 --2- 172.21.15.87:0/719108140 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7ff6e806cb90 0x7ff6e806f040 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff6f80043d0 tx=0x7ff6f8009da0 comp rx=0 tx=0).stop 2024-09-17T07:28:59.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:59.562+0000 7ff704184640 1 -- 172.21.15.87:0/719108140 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff6fc0fd580 msgr2=0x7ff6fc1131e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:28:59.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:59.562+0000 7ff704184640 1 --2- 172.21.15.87:0/719108140 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff6fc0fd580 0x7ff6fc1131e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec002a50 tx=0x7ff6ec004600 comp rx=0 tx=0).stop 2024-09-17T07:28:59.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:59.562+0000 7ff704184640 1 -- 172.21.15.87:0/719108140 shutdown_connections 2024-09-17T07:28:59.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:59.562+0000 7ff704184640 1 --2- 172.21.15.87:0/719108140 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7ff6e806cb90 0x7ff6e806f040 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:28:59.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:59.562+0000 7ff704184640 1 --2- 172.21.15.87:0/719108140 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff6fc0fdf20 0x7ff6fc113720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:28:59.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:59.562+0000 7ff704184640 1 --2- 172.21.15.87:0/719108140 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff6fc0fd580 0x7ff6fc1131e0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:28:59.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:59.562+0000 7ff704184640 1 -- 172.21.15.87:0/719108140 >> 172.21.15.87:0/719108140 conn(0x7ff6fc0f7060 msgr2=0x7ff6fc0f8710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:28:59.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:59.562+0000 7ff704184640 1 -- 172.21.15.87:0/719108140 shutdown_connections 2024-09-17T07:28:59.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:28:59.563+0000 7ff704184640 1 -- 172.21.15.87:0/719108140 wait complete. 2024-09-17T07:28:59.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:28:59 smithi139 ceph-mon[79872]: pgmap v248: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:29:00.220 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -e sha1=19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 -- bash -c 'ceph orch upgrade status' 2024-09-17T07:29:00.516 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/mon.smithi087/config 2024-09-17T07:29:01.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:29:01 smithi087 ceph-mon[90982]: from='client.34544 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:29:01.464 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:29:01 smithi087 ceph-mon[90982]: pgmap v249: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:29:01.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:29:01 smithi139 ceph-mon[79872]: from='client.34544 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:29:01.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:29:01 smithi139 ceph-mon[79872]: pgmap v249: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:29:02.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:02.074+0000 7f35c83a0640 1 -- 172.21.15.87:0/864610871 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35c0102ef0 msgr2=0x7f35c00fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:29:02.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:02.074+0000 7f35c83a0640 1 --2- 172.21.15.87:0/864610871 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35c0102ef0 0x7f35c00fc5b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f35b40048d0 tx=0x7f35b4009da0 comp rx=0 tx=0).stop 2024-09-17T07:29:02.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:02.074+0000 7f35c83a0640 1 -- 172.21.15.87:0/864610871 shutdown_connections 2024-09-17T07:29:02.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:02.074+0000 7f35c83a0640 1 --2- 172.21.15.87:0/864610871 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35c0102ef0 0x7f35c00fc5b0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:29:02.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:02.074+0000 7f35c83a0640 1 --2- 172.21.15.87:0/864610871 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f35c0102550 0x7f35c0102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:29:02.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:02.074+0000 7f35c83a0640 1 -- 172.21.15.87:0/864610871 >> 172.21.15.87:0/864610871 conn(0x7f35c00f80f0 msgr2=0x7f35c00fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:29:02.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:02.074+0000 7f35c83a0640 1 -- 172.21.15.87:0/864610871 shutdown_connections 2024-09-17T07:29:02.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:02.074+0000 7f35c83a0640 1 -- 172.21.15.87:0/864610871 wait complete. 2024-09-17T07:29:02.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:02.075+0000 7f35c83a0640 1 Processor -- start 2024-09-17T07:29:02.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:02.075+0000 7f35c83a0640 1 -- start start 2024-09-17T07:29:02.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:02.075+0000 7f35c83a0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35c0102550 0x7f35c0113420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:29:02.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:02.075+0000 7f35c83a0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f35c0102ef0 0x7f35c0113960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:29:02.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:02.075+0000 7f35c83a0640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c0113f60 con 0x7f35c0102550 2024-09-17T07:29:02.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:02.075+0000 7f35c83a0640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c01140d0 con 0x7f35c0102ef0 2024-09-17T07:29:02.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:02.075+0000 7f35c613c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35c0102550 0x7f35c0113420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:29:02.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:02.075+0000 7f35c613c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35c0102550 0x7f35c0113420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55388/0 (socket says 172.21.15.87:55388) 2024-09-17T07:29:02.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:02.075+0000 7f35c613c640 1 -- 172.21.15.87:0/4294275795 learned_addr learned my addr 172.21.15.87:0/4294275795 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:29:02.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:02.076+0000 7f35c593b640 1 --2- 172.21.15.87:0/4294275795 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f35c0102ef0 0x7f35c0113960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:29:02.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:02.076+0000 7f35c613c640 1 -- 172.21.15.87:0/4294275795 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f35c0102ef0 msgr2=0x7f35c0113960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:29:02.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:02.076+0000 7f35c613c640 1 --2- 172.21.15.87:0/4294275795 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f35c0102ef0 0x7f35c0113960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:29:02.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:02.076+0000 7f35c613c640 1 -- 172.21.15.87:0/4294275795 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35b4005040 con 0x7f35c0102550 2024-09-17T07:29:02.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:02.076+0000 7f35c593b640 1 --2- 172.21.15.87:0/4294275795 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f35c0102ef0 0x7f35c0113960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T07:29:02.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:02.076+0000 7f35c613c640 1 --2- 172.21.15.87:0/4294275795 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35c0102550 0x7f35c0113420 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f35b000cae0 tx=0x7f35b0007e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:29:02.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:02.076+0000 7f35beffd640 1 -- 172.21.15.87:0/4294275795 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35b000ab00 con 0x7f35c0102550 2024-09-17T07:29:02.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:02.076+0000 7f35beffd640 1 -- 172.21.15.87:0/4294275795 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f35b000ac60 con 0x7f35c0102550 2024-09-17T07:29:02.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:02.076+0000 7f35c83a0640 1 -- 172.21.15.87:0/4294275795 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35c010d550 con 0x7f35c0102550 2024-09-17T07:29:02.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:02.076+0000 7f35beffd640 1 -- 172.21.15.87:0/4294275795 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35b00115e0 con 0x7f35c0102550 2024-09-17T07:29:02.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:02.076+0000 7f35c83a0640 1 -- 172.21.15.87:0/4294275795 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35c010daf0 con 0x7f35c0102550 2024-09-17T07:29:02.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:02.077+0000 7f35c83a0640 1 -- 172.21.15.87:0/4294275795 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35c00fdcd0 con 0x7f35c0102550 2024-09-17T07:29:02.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:02.078+0000 7f35beffd640 1 -- 172.21.15.87:0/4294275795 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f35b0012440 con 0x7f35c0102550 2024-09-17T07:29:02.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:02.078+0000 7f35beffd640 1 --2- 172.21.15.87:0/4294275795 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f35a806cb90 0x7f35a806f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:29:02.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:02.078+0000 7f35beffd640 1 -- 172.21.15.87:0/4294275795 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f35b008c9f0 con 0x7f35c0102550 2024-09-17T07:29:02.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:02.078+0000 7f35c593b640 1 --2- 172.21.15.87:0/4294275795 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f35a806cb90 0x7f35a806f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:29:02.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:02.079+0000 7f35c593b640 1 --2- 172.21.15.87:0/4294275795 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f35a806cb90 0x7f35a806f040 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f35b4009ac0 tx=0x7f35b4009da0 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:29:02.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:02.083+0000 7f35beffd640 1 -- 172.21.15.87:0/4294275795 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f35b00569b0 con 0x7f35c0102550 2024-09-17T07:29:02.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:02.262+0000 7f35c83a0640 1 -- 172.21.15.87:0/4294275795 --> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f35c010ead0 con 0x7f35a806cb90 2024-09-17T07:29:02.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:02.263+0000 7f35beffd640 1 -- 172.21.15.87:0/4294275795 <== mgr.24529 v2:172.21.15.87:6800/1359413180 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f35c010ead0 con 0x7f35a806cb90 2024-09-17T07:29:02.264 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T07:29:02.264 INFO:teuthology.orchestra.run.smithi087.stdout: "target_image": null, 2024-09-17T07:29:02.264 INFO:teuthology.orchestra.run.smithi087.stdout: "in_progress": false, 2024-09-17T07:29:02.264 INFO:teuthology.orchestra.run.smithi087.stdout: "which": "", 2024-09-17T07:29:02.264 INFO:teuthology.orchestra.run.smithi087.stdout: "services_complete": [], 2024-09-17T07:29:02.264 INFO:teuthology.orchestra.run.smithi087.stdout: "progress": null, 2024-09-17T07:29:02.264 INFO:teuthology.orchestra.run.smithi087.stdout: "message": "", 2024-09-17T07:29:02.264 INFO:teuthology.orchestra.run.smithi087.stdout: "is_paused": false 2024-09-17T07:29:02.264 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T07:29:02.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:02.265+0000 7f35c83a0640 1 -- 172.21.15.87:0/4294275795 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f35a806cb90 msgr2=0x7f35a806f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:29:02.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:02.265+0000 7f35c83a0640 1 --2- 172.21.15.87:0/4294275795 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f35a806cb90 0x7f35a806f040 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f35b4009ac0 tx=0x7f35b4009da0 comp rx=0 tx=0).stop 2024-09-17T07:29:02.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:02.265+0000 7f35c83a0640 1 -- 172.21.15.87:0/4294275795 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35c0102550 msgr2=0x7f35c0113420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:29:02.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:02.265+0000 7f35c83a0640 1 --2- 172.21.15.87:0/4294275795 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35c0102550 0x7f35c0113420 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f35b000cae0 tx=0x7f35b0007e50 comp rx=0 tx=0).stop 2024-09-17T07:29:02.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:02.265+0000 7f35c83a0640 1 -- 172.21.15.87:0/4294275795 shutdown_connections 2024-09-17T07:29:02.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:02.265+0000 7f35c83a0640 1 --2- 172.21.15.87:0/4294275795 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f35a806cb90 0x7f35a806f040 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:29:02.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:02.265+0000 7f35c83a0640 1 --2- 172.21.15.87:0/4294275795 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f35c0102ef0 0x7f35c0113960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:29:02.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:02.265+0000 7f35c83a0640 1 --2- 172.21.15.87:0/4294275795 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35c0102550 0x7f35c0113420 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:29:02.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:02.265+0000 7f35c83a0640 1 -- 172.21.15.87:0/4294275795 >> 172.21.15.87:0/4294275795 conn(0x7f35c00f80f0 msgr2=0x7f35c00f9200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:29:02.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:02.265+0000 7f35c83a0640 1 -- 172.21.15.87:0/4294275795 shutdown_connections 2024-09-17T07:29:02.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:02.265+0000 7f35c83a0640 1 -- 172.21.15.87:0/4294275795 wait complete. 2024-09-17T07:29:02.953 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -e sha1=19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 -- bash -c 'ceph health detail' 2024-09-17T07:29:03.203 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/mon.smithi087/config 2024-09-17T07:29:03.554 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:29:03 smithi087 ceph-mon[90982]: pgmap v250: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:29:03.554 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:29:03 smithi087 ceph-mon[90982]: from='client.34548 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:29:03.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:29:03 smithi139 ceph-mon[79872]: pgmap v250: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:29:03.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:29:03 smithi139 ceph-mon[79872]: from='client.34548 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:29:04.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:04.822+0000 7fa828fbd640 1 -- 172.21.15.87:0/401286273 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8241014c0 msgr2=0x7fa824101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:29:04.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:04.822+0000 7fa828fbd640 1 --2- 172.21.15.87:0/401286273 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8241014c0 0x7fa824101890 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa814009c50 tx=0x7fa814004d10 comp rx=0 tx=0).stop 2024-09-17T07:29:04.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:04.822+0000 7fa828fbd640 1 -- 172.21.15.87:0/401286273 shutdown_connections 2024-09-17T07:29:04.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:04.822+0000 7fa828fbd640 1 --2- 172.21.15.87:0/401286273 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa8240fb480 0x7fa8240fb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:29:04.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:04.822+0000 7fa828fbd640 1 --2- 172.21.15.87:0/401286273 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8241014c0 0x7fa824101890 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:29:04.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:04.822+0000 7fa828fbd640 1 -- 172.21.15.87:0/401286273 >> 172.21.15.87:0/401286273 conn(0x7fa8240f7000 msgr2=0x7fa8240f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:29:04.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:04.822+0000 7fa828fbd640 1 -- 172.21.15.87:0/401286273 shutdown_connections 2024-09-17T07:29:04.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:04.822+0000 7fa828fbd640 1 -- 172.21.15.87:0/401286273 wait complete. 2024-09-17T07:29:04.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:04.822+0000 7fa828fbd640 1 Processor -- start 2024-09-17T07:29:04.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:04.822+0000 7fa828fbd640 1 -- start start 2024-09-17T07:29:04.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:04.823+0000 7fa828fbd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8240fb480 0x7fa82410beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:29:04.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:04.823+0000 7fa828fbd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa8241014c0 0x7fa82410c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:29:04.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:04.823+0000 7fa828fbd640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa82410c930 con 0x7fa8240fb480 2024-09-17T07:29:04.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:04.823+0000 7fa828fbd640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa82410ca70 con 0x7fa8241014c0 2024-09-17T07:29:04.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:04.823+0000 7fa82259c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8240fb480 0x7fa82410beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:29:04.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:04.823+0000 7fa82259c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8240fb480 0x7fa82410beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49016/0 (socket says 172.21.15.87:49016) 2024-09-17T07:29:04.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:04.823+0000 7fa82259c640 1 -- 172.21.15.87:0/184956304 learned_addr learned my addr 172.21.15.87:0/184956304 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:29:04.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:04.823+0000 7fa821d9b640 1 --2- 172.21.15.87:0/184956304 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa8241014c0 0x7fa82410c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:29:04.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:04.823+0000 7fa82259c640 1 -- 172.21.15.87:0/184956304 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa8241014c0 msgr2=0x7fa82410c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:29:04.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:04.823+0000 7fa82259c640 1 --2- 172.21.15.87:0/184956304 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa8241014c0 0x7fa82410c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:29:04.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:04.823+0000 7fa82259c640 1 -- 172.21.15.87:0/184956304 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8140098b0 con 0x7fa8240fb480 2024-09-17T07:29:04.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:04.823+0000 7fa82259c640 1 --2- 172.21.15.87:0/184956304 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8240fb480 0x7fa82410beb0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa814004a30 tx=0x7fa814004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:29:04.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:04.823+0000 7fa812ffd640 1 -- 172.21.15.87:0/184956304 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa814032570 con 0x7fa8240fb480 2024-09-17T07:29:04.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:04.823+0000 7fa812ffd640 1 -- 172.21.15.87:0/184956304 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fa814032b50 con 0x7fa8240fb480 2024-09-17T07:29:04.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:04.823+0000 7fa812ffd640 1 -- 172.21.15.87:0/184956304 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa81403d9c0 con 0x7fa8240fb480 2024-09-17T07:29:04.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:04.823+0000 7fa828fbd640 1 -- 172.21.15.87:0/184956304 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa82410ccf0 con 0x7fa8240fb480 2024-09-17T07:29:04.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:04.823+0000 7fa828fbd640 1 -- 172.21.15.87:0/184956304 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa824119850 con 0x7fa8240fb480 2024-09-17T07:29:04.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:04.824+0000 7fa828fbd640 1 -- 172.21.15.87:0/184956304 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8240fcbc0 con 0x7fa8240fb480 2024-09-17T07:29:04.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:04.825+0000 7fa812ffd640 1 -- 172.21.15.87:0/184956304 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fa81402f030 con 0x7fa8240fb480 2024-09-17T07:29:04.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:04.825+0000 7fa812ffd640 1 --2- 172.21.15.87:0/184956304 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fa80c06cb90 0x7fa80c06f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:29:04.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:04.826+0000 7fa821d9b640 1 --2- 172.21.15.87:0/184956304 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fa80c06cb90 0x7fa80c06f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:29:04.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:04.826+0000 7fa812ffd640 1 -- 172.21.15.87:0/184956304 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fa8140ad100 con 0x7fa8240fb480 2024-09-17T07:29:04.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:04.826+0000 7fa821d9b640 1 --2- 172.21.15.87:0/184956304 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fa80c06cb90 0x7fa80c06f040 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa824066500 tx=0x7fa818009040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:29:04.832 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:04.830+0000 7fa812ffd640 1 -- 172.21.15.87:0/184956304 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa814077140 con 0x7fa8240fb480 2024-09-17T07:29:05.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:05.060+0000 7fa828fbd640 1 -- 172.21.15.87:0/184956304 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fa8240fac40 con 0x7fa8240fb480 2024-09-17T07:29:05.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:05.060+0000 7fa812ffd640 1 -- 172.21.15.87:0/184956304 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fa81407a760 con 0x7fa8240fb480 2024-09-17T07:29:05.062 INFO:teuthology.orchestra.run.smithi087.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T07:29:05.062 INFO:teuthology.orchestra.run.smithi087.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T07:29:05.062 INFO:teuthology.orchestra.run.smithi087.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T07:29:05.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:05.062+0000 7fa828fbd640 1 -- 172.21.15.87:0/184956304 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fa80c06cb90 msgr2=0x7fa80c06f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:29:05.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:05.062+0000 7fa828fbd640 1 --2- 172.21.15.87:0/184956304 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fa80c06cb90 0x7fa80c06f040 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa824066500 tx=0x7fa818009040 comp rx=0 tx=0).stop 2024-09-17T07:29:05.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:05.062+0000 7fa828fbd640 1 -- 172.21.15.87:0/184956304 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8240fb480 msgr2=0x7fa82410beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:29:05.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:05.062+0000 7fa828fbd640 1 --2- 172.21.15.87:0/184956304 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8240fb480 0x7fa82410beb0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa814004a30 tx=0x7fa814004d10 comp rx=0 tx=0).stop 2024-09-17T07:29:05.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:05.062+0000 7fa828fbd640 1 -- 172.21.15.87:0/184956304 shutdown_connections 2024-09-17T07:29:05.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:05.062+0000 7fa828fbd640 1 --2- 172.21.15.87:0/184956304 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fa80c06cb90 0x7fa80c06f040 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:29:05.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:05.062+0000 7fa828fbd640 1 --2- 172.21.15.87:0/184956304 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa8241014c0 0x7fa82410c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:29:05.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:05.062+0000 7fa828fbd640 1 --2- 172.21.15.87:0/184956304 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8240fb480 0x7fa82410beb0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:29:05.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:05.062+0000 7fa828fbd640 1 -- 172.21.15.87:0/184956304 >> 172.21.15.87:0/184956304 conn(0x7fa8240f7000 msgr2=0x7fa8240f89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:29:05.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:05.063+0000 7fa828fbd640 1 -- 172.21.15.87:0/184956304 shutdown_connections 2024-09-17T07:29:05.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:05.063+0000 7fa828fbd640 1 -- 172.21.15.87:0/184956304 wait complete. 2024-09-17T07:29:05.365 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:29:05 smithi087 ceph-mon[90982]: pgmap v251: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:29:05.365 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:29:05 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/184956304' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T07:29:05.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:29:05 smithi139 ceph-mon[79872]: pgmap v251: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:29:05.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:29:05 smithi139 ceph-mon[79872]: from='client.? 172.21.15.87:0/184956304' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T07:29:05.673 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -e sha1=19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 -- bash -c 'ceph versions' 2024-09-17T07:29:05.918 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/mon.smithi087/config 2024-09-17T07:29:07.326 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:29:07 smithi087 ceph-mon[90982]: pgmap v252: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:29:07.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:07.535+0000 7faee5809640 1 -- 172.21.15.87:0/3169347547 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faee0102550 msgr2=0x7faee0102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:29:07.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:07.535+0000 7faee5809640 1 --2- 172.21.15.87:0/3169347547 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faee0102550 0x7faee0102920 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7faed8009c50 tx=0x7faed8004d10 comp rx=0 tx=0).stop 2024-09-17T07:29:07.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:07.535+0000 7faee5809640 1 -- 172.21.15.87:0/3169347547 shutdown_connections 2024-09-17T07:29:07.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:07.535+0000 7faee5809640 1 --2- 172.21.15.87:0/3169347547 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faee0102ef0 0x7faee00fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:29:07.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:07.535+0000 7faee5809640 1 --2- 172.21.15.87:0/3169347547 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faee0102550 0x7faee0102920 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:29:07.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:07.535+0000 7faee5809640 1 -- 172.21.15.87:0/3169347547 >> 172.21.15.87:0/3169347547 conn(0x7faee00f80f0 msgr2=0x7faee00fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:29:07.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:07.535+0000 7faee5809640 1 -- 172.21.15.87:0/3169347547 shutdown_connections 2024-09-17T07:29:07.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:07.535+0000 7faee5809640 1 -- 172.21.15.87:0/3169347547 wait complete. 2024-09-17T07:29:07.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:07.536+0000 7faee5809640 1 Processor -- start 2024-09-17T07:29:07.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:07.536+0000 7faee5809640 1 -- start start 2024-09-17T07:29:07.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:07.536+0000 7faee5809640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faee0102550 0x7faee01156b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:29:07.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:07.536+0000 7faee5809640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faee0102ef0 0x7faee0115bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:29:07.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:07.536+0000 7faee5809640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee01161f0 con 0x7faee0102ef0 2024-09-17T07:29:07.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:07.536+0000 7faee5809640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee010f610 con 0x7faee0102550 2024-09-17T07:29:07.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:07.536+0000 7faede7fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faee0102ef0 0x7faee0115bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:29:07.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:07.536+0000 7faede7fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faee0102ef0 0x7faee0115bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:49028/0 (socket says 172.21.15.87:49028) 2024-09-17T07:29:07.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:07.536+0000 7faede7fc640 1 -- 172.21.15.87:0/235656178 learned_addr learned my addr 172.21.15.87:0/235656178 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:29:07.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:07.536+0000 7faedeffd640 1 --2- 172.21.15.87:0/235656178 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faee0102550 0x7faee01156b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:29:07.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:07.536+0000 7faede7fc640 1 -- 172.21.15.87:0/235656178 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faee0102550 msgr2=0x7faee01156b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:29:07.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:07.536+0000 7faede7fc640 1 --2- 172.21.15.87:0/235656178 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faee0102550 0x7faee01156b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:29:07.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:07.536+0000 7faede7fc640 1 -- 172.21.15.87:0/235656178 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed80098b0 con 0x7faee0102ef0 2024-09-17T07:29:07.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:07.536+0000 7faedeffd640 1 --2- 172.21.15.87:0/235656178 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faee0102550 0x7faee01156b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T07:29:07.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:07.537+0000 7faede7fc640 1 --2- 172.21.15.87:0/235656178 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faee0102ef0 0x7faee0115bf0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7faec800eb40 tx=0x7faec800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:29:07.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:07.537+0000 7faed77fe640 1 -- 172.21.15.87:0/235656178 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faec8007c30 con 0x7faee0102ef0 2024-09-17T07:29:07.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:07.537+0000 7faee5809640 1 -- 172.21.15.87:0/235656178 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faee010f890 con 0x7faee0102ef0 2024-09-17T07:29:07.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:07.537+0000 7faed77fe640 1 -- 172.21.15.87:0/235656178 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7faec800f040 con 0x7faee0102ef0 2024-09-17T07:29:07.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:07.537+0000 7faed77fe640 1 -- 172.21.15.87:0/235656178 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faec80094b0 con 0x7faee0102ef0 2024-09-17T07:29:07.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:07.537+0000 7faee5809640 1 -- 172.21.15.87:0/235656178 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faee010fe30 con 0x7faee0102ef0 2024-09-17T07:29:07.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:07.538+0000 7faee5809640 1 -- 172.21.15.87:0/235656178 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faee0115360 con 0x7faee0102ef0 2024-09-17T07:29:07.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:07.538+0000 7faed77fe640 1 -- 172.21.15.87:0/235656178 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7faec8009630 con 0x7faee0102ef0 2024-09-17T07:29:07.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:07.539+0000 7faed77fe640 1 --2- 172.21.15.87:0/235656178 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7faecc06cb90 0x7faecc06f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:29:07.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:07.539+0000 7faed77fe640 1 -- 172.21.15.87:0/235656178 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6496+0+0 (secure 0 0 0) 0x7faec808be50 con 0x7faee0102ef0 2024-09-17T07:29:07.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:07.539+0000 7faedeffd640 1 --2- 172.21.15.87:0/235656178 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7faecc06cb90 0x7faecc06f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:29:07.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:07.539+0000 7faedeffd640 1 --2- 172.21.15.87:0/235656178 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7faecc06cb90 0x7faecc06f040 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7faed8004a30 tx=0x7faed8004d10 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:29:07.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:07.544+0000 7faed77fe640 1 -- 172.21.15.87:0/235656178 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7faec8055e10 con 0x7faee0102ef0 2024-09-17T07:29:07.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:29:07 smithi139 ceph-mon[79872]: pgmap v252: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:29:07.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:07.769+0000 7faee5809640 1 -- 172.21.15.87:0/235656178 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7faee00fdcd0 con 0x7faee0102ef0 2024-09-17T07:29:07.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:07.770+0000 7faed77fe640 1 -- 172.21.15.87:0/235656178 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7faec8059430 con 0x7faee0102ef0 2024-09-17T07:29:07.771 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T07:29:07.771 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": { 2024-09-17T07:29:07.771 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 2 2024-09-17T07:29:07.771 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:29:07.771 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr": { 2024-09-17T07:29:07.771 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 2 2024-09-17T07:29:07.771 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:29:07.771 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": { 2024-09-17T07:29:07.772 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 6 2024-09-17T07:29:07.772 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:29:07.772 INFO:teuthology.orchestra.run.smithi087.stdout: "mds": { 2024-09-17T07:29:07.772 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 4 2024-09-17T07:29:07.772 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:29:07.772 INFO:teuthology.orchestra.run.smithi087.stdout: "overall": { 2024-09-17T07:29:07.772 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 14 2024-09-17T07:29:07.772 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T07:29:07.772 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T07:29:07.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:07.772+0000 7faee5809640 1 -- 172.21.15.87:0/235656178 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7faecc06cb90 msgr2=0x7faecc06f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:29:07.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:07.772+0000 7faee5809640 1 --2- 172.21.15.87:0/235656178 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7faecc06cb90 0x7faecc06f040 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7faed8004a30 tx=0x7faed8004d10 comp rx=0 tx=0).stop 2024-09-17T07:29:07.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:07.772+0000 7faee5809640 1 -- 172.21.15.87:0/235656178 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faee0102ef0 msgr2=0x7faee0115bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:29:07.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:07.772+0000 7faee5809640 1 --2- 172.21.15.87:0/235656178 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faee0102ef0 0x7faee0115bf0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7faec800eb40 tx=0x7faec800b040 comp rx=0 tx=0).stop 2024-09-17T07:29:07.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:07.772+0000 7faee5809640 1 -- 172.21.15.87:0/235656178 shutdown_connections 2024-09-17T07:29:07.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:07.772+0000 7faee5809640 1 --2- 172.21.15.87:0/235656178 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faee0102ef0 0x7faee0115bf0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:29:07.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:07.772+0000 7faee5809640 1 --2- 172.21.15.87:0/235656178 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7faecc06cb90 0x7faecc06f040 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:29:07.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:07.772+0000 7faee5809640 1 --2- 172.21.15.87:0/235656178 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faee0102550 0x7faee01156b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:29:07.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:07.772+0000 7faee5809640 1 -- 172.21.15.87:0/235656178 >> 172.21.15.87:0/235656178 conn(0x7faee00f80f0 msgr2=0x7faee00f9170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:29:07.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:07.772+0000 7faee5809640 1 -- 172.21.15.87:0/235656178 shutdown_connections 2024-09-17T07:29:07.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:29:07.772+0000 7faee5809640 1 -- 172.21.15.87:0/235656178 wait complete. 2024-09-17T07:29:08.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:29:08 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/235656178' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:29:08.547 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -e sha1=19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-09-17T07:29:08.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:29:08 smithi139 ceph-mon[79872]: from='client.? 172.21.15.87:0/235656178' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:29:08.791 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/mon.smithi087/config 2024-09-17T07:29:09.538 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:29:09 smithi087 ceph-mon[90982]: pgmap v253: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:29:09.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:29:09 smithi139 ceph-mon[79872]: pgmap v253: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:29:10.391 INFO:teuthology.orchestra.run.smithi087.stdout:wait for servicemap items w/ changing names to refresh 2024-09-17T07:29:11.118 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -e sha1=19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 -- bash -c 'sleep 60' 2024-09-17T07:29:11.374 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/mon.smithi087/config 2024-09-17T07:29:11.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:29:11 smithi087 ceph-mon[90982]: pgmap v254: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:29:11.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:29:11 smithi139 ceph-mon[79872]: pgmap v254: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:29:13.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:29:13 smithi087 ceph-mon[90982]: pgmap v255: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:29:13.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:29:13 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:29:13.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:29:13 smithi139 ceph-mon[79872]: pgmap v255: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:29:13.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:29:13 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:29:15.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:29:15 smithi139 ceph-mon[79872]: pgmap v256: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:29:15.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:29:15 smithi087 ceph-mon[90982]: pgmap v256: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:29:17.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:29:17 smithi139 ceph-mon[79872]: pgmap v257: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:29:17.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:29:17 smithi087 ceph-mon[90982]: pgmap v257: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:29:19.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:29:19 smithi139 ceph-mon[79872]: pgmap v258: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:29:19.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:29:19 smithi087 ceph-mon[90982]: pgmap v258: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:29:21.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:29:21 smithi139 ceph-mon[79872]: pgmap v259: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:29:21.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:29:21 smithi087 ceph-mon[90982]: pgmap v259: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:29:23.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:29:23 smithi139 ceph-mon[79872]: pgmap v260: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:29:23.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:29:23 smithi087 ceph-mon[90982]: pgmap v260: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:29:25.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:29:25 smithi139 ceph-mon[79872]: pgmap v261: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:29:25.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:29:25 smithi087 ceph-mon[90982]: pgmap v261: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:29:27.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:29:27 smithi139 ceph-mon[79872]: pgmap v262: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:29:27.678 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:29:27 smithi087 ceph-mon[90982]: pgmap v262: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:29:28.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:29:28 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:29:28.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:29:28 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:29:29.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:29:29 smithi139 ceph-mon[79872]: pgmap v263: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:29:29.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:29:29 smithi087 ceph-mon[90982]: pgmap v263: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:29:31.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:29:31 smithi139 ceph-mon[79872]: pgmap v264: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:29:31.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:29:31 smithi087 ceph-mon[90982]: pgmap v264: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:29:33.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:29:33 smithi139 ceph-mon[79872]: pgmap v265: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:29:33.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:29:33 smithi087 ceph-mon[90982]: pgmap v265: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:29:35.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:29:35 smithi139 ceph-mon[79872]: pgmap v266: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:29:35.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:29:35 smithi087 ceph-mon[90982]: pgmap v266: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:29:37.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:29:37 smithi139 ceph-mon[79872]: pgmap v267: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:29:37.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:29:37 smithi087 ceph-mon[90982]: pgmap v267: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:29:39.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:29:39 smithi139 ceph-mon[79872]: pgmap v268: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:29:39.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:29:39 smithi087 ceph-mon[90982]: pgmap v268: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:29:41.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:29:41 smithi139 ceph-mon[79872]: pgmap v269: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:29:41.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:29:41 smithi087 ceph-mon[90982]: pgmap v269: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:29:43.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:29:43 smithi139 ceph-mon[79872]: pgmap v270: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:29:43.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:29:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:29:43.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:29:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:29:43.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:29:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:29:43.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:29:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:29:43.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:29:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:29:43.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:29:43 smithi087 ceph-mon[90982]: pgmap v270: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:29:43.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:29:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:29:43.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:29:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:29:43.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:29:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:29:43.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:29:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:29:43.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:29:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:29:45.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:29:45 smithi139 ceph-mon[79872]: pgmap v271: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:29:45.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:29:45 smithi087 ceph-mon[90982]: pgmap v271: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:29:47.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:29:47 smithi139 ceph-mon[79872]: pgmap v272: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:29:47.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:29:47 smithi087 ceph-mon[90982]: pgmap v272: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:29:49.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:29:49 smithi139 ceph-mon[79872]: pgmap v273: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:29:49.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:29:49 smithi087 ceph-mon[90982]: pgmap v273: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:29:51.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:29:51 smithi139 ceph-mon[79872]: pgmap v274: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:29:51.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:29:51 smithi087 ceph-mon[90982]: pgmap v274: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:29:53.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:29:53 smithi139 ceph-mon[79872]: pgmap v275: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:29:53.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:29:53 smithi087 ceph-mon[90982]: pgmap v275: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:29:55.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:29:55 smithi139 ceph-mon[79872]: pgmap v276: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:29:55.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:29:55 smithi087 ceph-mon[90982]: pgmap v276: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:29:57.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:29:57 smithi139 ceph-mon[79872]: pgmap v277: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:29:57.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:29:57 smithi087 ceph-mon[90982]: pgmap v277: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:29:58.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:29:58 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:29:58.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:29:58 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:29:59.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:29:59 smithi139 ceph-mon[79872]: pgmap v278: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:29:59.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:29:59 smithi087 ceph-mon[90982]: pgmap v278: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:30:00.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:00 smithi139 ceph-mon[79872]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T07:30:00.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:00 smithi087 ceph-mon[90982]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T07:30:01.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:01 smithi139 ceph-mon[79872]: pgmap v279: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:30:01.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:01 smithi087 ceph-mon[90982]: pgmap v279: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:30:03.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:03 smithi139 ceph-mon[79872]: pgmap v280: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:30:03.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:03 smithi087 ceph-mon[90982]: pgmap v280: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:30:05.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:05 smithi139 ceph-mon[79872]: pgmap v281: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:30:05.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:05 smithi087 ceph-mon[90982]: pgmap v281: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:30:07.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:07 smithi139 ceph-mon[79872]: pgmap v282: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:30:07.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:07 smithi087 ceph-mon[90982]: pgmap v282: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:30:09.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:09 smithi139 ceph-mon[79872]: pgmap v283: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:30:09.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:09 smithi087 ceph-mon[90982]: pgmap v283: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:30:11.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:11 smithi139 ceph-mon[79872]: pgmap v284: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:30:11.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:11 smithi087 ceph-mon[90982]: pgmap v284: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:30:13.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:13 smithi139 ceph-mon[79872]: pgmap v285: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:30:13.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:13 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:30:13.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:13 smithi087 ceph-mon[90982]: pgmap v285: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:30:13.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:13 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:30:13.715 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -e sha1=19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 -- bash -c 'ceph orch ps' 2024-09-17T07:30:13.971 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/mon.smithi087/config 2024-09-17T07:30:15.373 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:15 smithi087 ceph-mon[90982]: pgmap v286: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:30:15.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:15.582+0000 7faf9eca2640 1 -- 172.21.15.87:0/3866542776 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faf981014d0 msgr2=0x7faf981018a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:15.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:15.582+0000 7faf9eca2640 1 --2- 172.21.15.87:0/3866542776 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faf981014d0 0x7faf981018a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7faf8c0048d0 tx=0x7faf8c009da0 comp rx=0 tx=0).stop 2024-09-17T07:30:15.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:15.582+0000 7faf9eca2640 1 -- 172.21.15.87:0/3866542776 shutdown_connections 2024-09-17T07:30:15.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:15.582+0000 7faf9eca2640 1 --2- 172.21.15.87:0/3866542776 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faf980fb490 0x7faf980fb900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:15.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:15.582+0000 7faf9eca2640 1 --2- 172.21.15.87:0/3866542776 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faf981014d0 0x7faf981018a0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:15.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:15.582+0000 7faf9eca2640 1 -- 172.21.15.87:0/3866542776 >> 172.21.15.87:0/3866542776 conn(0x7faf980f7010 msgr2=0x7faf980f9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:15.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:15.582+0000 7faf9eca2640 1 -- 172.21.15.87:0/3866542776 shutdown_connections 2024-09-17T07:30:15.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:15.582+0000 7faf9eca2640 1 -- 172.21.15.87:0/3866542776 wait complete. 2024-09-17T07:30:15.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:15.583+0000 7faf9eca2640 1 Processor -- start 2024-09-17T07:30:15.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:15.583+0000 7faf9eca2640 1 -- start start 2024-09-17T07:30:15.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:15.583+0000 7faf9eca2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faf980fb490 0x7faf9810e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:15.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:15.583+0000 7faf9eca2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faf981014d0 0x7faf9810e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:15.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:15.583+0000 7faf9eca2640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf9810ed50 con 0x7faf980fb490 2024-09-17T07:30:15.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:15.583+0000 7faf9eca2640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf9810eec0 con 0x7faf981014d0 2024-09-17T07:30:15.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:15.583+0000 7faf9ca3e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faf980fb490 0x7faf9810e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:15.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:15.583+0000 7faf9ca3e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faf980fb490 0x7faf9810e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45176/0 (socket says 172.21.15.87:45176) 2024-09-17T07:30:15.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:15.583+0000 7faf9ca3e640 1 -- 172.21.15.87:0/1661169284 learned_addr learned my addr 172.21.15.87:0/1661169284 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:30:15.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:15.583+0000 7faf97fff640 1 --2- 172.21.15.87:0/1661169284 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faf981014d0 0x7faf9810e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:15.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:15.583+0000 7faf9ca3e640 1 -- 172.21.15.87:0/1661169284 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faf981014d0 msgr2=0x7faf9810e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:15.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:15.583+0000 7faf9ca3e640 1 --2- 172.21.15.87:0/1661169284 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faf981014d0 0x7faf9810e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:15.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:15.583+0000 7faf9ca3e640 1 -- 172.21.15.87:0/1661169284 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf8c005040 con 0x7faf980fb490 2024-09-17T07:30:15.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:15.583+0000 7faf97fff640 1 --2- 172.21.15.87:0/1661169284 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faf981014d0 0x7faf9810e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T07:30:15.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:15.584+0000 7faf9ca3e640 1 --2- 172.21.15.87:0/1661169284 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faf980fb490 0x7faf9810e130 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7faf8c003080 tx=0x7faf8c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:15.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:15.584+0000 7faf957fa640 1 -- 172.21.15.87:0/1661169284 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf8c038070 con 0x7faf980fb490 2024-09-17T07:30:15.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:15.584+0000 7faf957fa640 1 -- 172.21.15.87:0/1661169284 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7faf8c0097c0 con 0x7faf980fb490 2024-09-17T07:30:15.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:15.584+0000 7faf9eca2640 1 -- 172.21.15.87:0/1661169284 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf981171a0 con 0x7faf980fb490 2024-09-17T07:30:15.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:15.584+0000 7faf957fa640 1 -- 172.21.15.87:0/1661169284 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf8c03d420 con 0x7faf980fb490 2024-09-17T07:30:15.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:15.584+0000 7faf9eca2640 1 -- 172.21.15.87:0/1661169284 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf98117610 con 0x7faf980fb490 2024-09-17T07:30:15.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:15.585+0000 7faf9eca2640 1 -- 172.21.15.87:0/1661169284 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf980fcbd0 con 0x7faf980fb490 2024-09-17T07:30:15.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:15.585+0000 7faf957fa640 1 -- 172.21.15.87:0/1661169284 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7faf8c030020 con 0x7faf980fb490 2024-09-17T07:30:15.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:15.586+0000 7faf957fa640 1 --2- 172.21.15.87:0/1661169284 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7faf8806cb90 0x7faf8806f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:15.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:15.586+0000 7faf957fa640 1 -- 172.21.15.87:0/1661169284 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6496+0+0 (secure 0 0 0) 0x7faf8c0ac5f0 con 0x7faf980fb490 2024-09-17T07:30:15.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:15.586+0000 7faf97fff640 1 --2- 172.21.15.87:0/1661169284 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7faf8806cb90 0x7faf8806f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:15.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:15.586+0000 7faf97fff640 1 --2- 172.21.15.87:0/1661169284 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7faf8806cb90 0x7faf8806f040 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7faf84006fd0 tx=0x7faf84008040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:15.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:15.590+0000 7faf957fa640 1 -- 172.21.15.87:0/1661169284 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7faf8c076630 con 0x7faf980fb490 2024-09-17T07:30:15.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:15 smithi139 ceph-mon[79872]: pgmap v286: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:30:15.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:15.761+0000 7faf9eca2640 1 -- 172.21.15.87:0/1661169284 --> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7faf98066280 con 0x7faf8806cb90 2024-09-17T07:30:15.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:15.770+0000 7faf957fa640 1 -- 172.21.15.87:0/1661169284 <== mgr.24529 v2:172.21.15.87:6800/1359413180 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7faf98066280 con 0x7faf8806cb90 2024-09-17T07:30:15.771 INFO:teuthology.orchestra.run.smithi087.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T07:30:15.771 INFO:teuthology.orchestra.run.smithi087.stdout:alertmanager.smithi087 smithi087 *:9093,9094 running (116s) 97s ago 18m 15.6M - 0.25.0 c8568f914cd2 f234770ff301 2024-09-17T07:30:15.771 INFO:teuthology.orchestra.run.smithi087.stdout:crash.smithi087 smithi087 running (7m) 97s ago 18m 6895k - 18.2.4-855-g19e2a2be 980a0bfcd684 0ff8a9330162 2024-09-17T07:30:15.772 INFO:teuthology.orchestra.run.smithi087.stdout:crash.smithi139 smithi139 running (7m) 2m ago 17m 6899k - 18.2.4-855-g19e2a2be 980a0bfcd684 10541e3b202e 2024-09-17T07:30:15.772 INFO:teuthology.orchestra.run.smithi087.stdout:grafana.smithi087 smithi087 *:3000 running (102s) 97s ago 18m 37.3M - 9.4.7 954c08fa6188 b671928d45a1 2024-09-17T07:30:15.772 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi087.tjhpcs smithi087 running (3m) 97s ago 12m 16.2M - 18.2.4-855-g19e2a2be 980a0bfcd684 593471a4a9e2 2024-09-17T07:30:15.772 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi087.vvbzss smithi087 running (3m) 97s ago 12m 67.3M - 18.2.4-855-g19e2a2be 980a0bfcd684 e50f437839ed 2024-09-17T07:30:15.772 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi139.ftvinf smithi139 running (2m) 2m ago 12m 14.1M - 18.2.4-855-g19e2a2be 980a0bfcd684 17708393d8d9 2024-09-17T07:30:15.772 INFO:teuthology.orchestra.run.smithi087.stdout:mds.cephfs.smithi139.gnwonz smithi139 running (2m) 2m ago 12m 225M - 18.2.4-855-g19e2a2be 980a0bfcd684 6ae45fadd7a2 2024-09-17T07:30:15.772 INFO:teuthology.orchestra.run.smithi087.stdout:mgr.smithi087.vuvjer smithi087 *:8443,9283,8765 running (9m) 97s ago 19m 501M - 18.2.4-855-g19e2a2be 980a0bfcd684 5d10c647cb6b 2024-09-17T07:30:15.772 INFO:teuthology.orchestra.run.smithi087.stdout:mgr.smithi139.tuqnpn smithi139 *:8443,9283,8765 running (8m) 2m ago 17m 440M - 18.2.4-855-g19e2a2be 980a0bfcd684 6e0bf371d44c 2024-09-17T07:30:15.772 INFO:teuthology.orchestra.run.smithi087.stdout:mon.smithi087 smithi087 running (8m) 97s ago 19m 52.6M 2048M 18.2.4-855-g19e2a2be 980a0bfcd684 305c72de1f9f 2024-09-17T07:30:15.772 INFO:teuthology.orchestra.run.smithi087.stdout:mon.smithi139 smithi139 running (8m) 2m ago 17m 40.0M 2048M 18.2.4-855-g19e2a2be 980a0bfcd684 0b159495af0f 2024-09-17T07:30:15.772 INFO:teuthology.orchestra.run.smithi087.stdout:node-exporter.smithi087 smithi087 *:9100 running (2m) 97s ago 18m 7696k - 1.5.0 0da6a335fe13 5aca7ee26d83 2024-09-17T07:30:15.772 INFO:teuthology.orchestra.run.smithi087.stdout:node-exporter.smithi139 smithi139 *:9100 running (2m) 2m ago 17m 3401k - 1.5.0 0da6a335fe13 6d18794119c8 2024-09-17T07:30:15.772 INFO:teuthology.orchestra.run.smithi087.stdout:osd.0 smithi087 running (7m) 97s ago 16m 96.8M 1557M 18.2.4-855-g19e2a2be 980a0bfcd684 e97cb50e6aec 2024-09-17T07:30:15.773 INFO:teuthology.orchestra.run.smithi087.stdout:osd.1 smithi087 running (6m) 97s ago 16m 102M 1557M 18.2.4-855-g19e2a2be 980a0bfcd684 b108771d0b8e 2024-09-17T07:30:15.773 INFO:teuthology.orchestra.run.smithi087.stdout:osd.2 smithi087 running (6m) 97s ago 15m 88.2M 1557M 18.2.4-855-g19e2a2be 980a0bfcd684 240cfb3b5366 2024-09-17T07:30:15.773 INFO:teuthology.orchestra.run.smithi087.stdout:osd.3 smithi139 running (5m) 2m ago 15m 115M 2581M 18.2.4-855-g19e2a2be 980a0bfcd684 b05ed3bf3f5c 2024-09-17T07:30:15.773 INFO:teuthology.orchestra.run.smithi087.stdout:osd.4 smithi139 running (4m) 2m ago 14m 99.6M 2581M 18.2.4-855-g19e2a2be 980a0bfcd684 139bbfc915c8 2024-09-17T07:30:15.773 INFO:teuthology.orchestra.run.smithi087.stdout:osd.5 smithi139 running (4m) 2m ago 14m 88.5M 2581M 18.2.4-855-g19e2a2be 980a0bfcd684 5058216f1ee0 2024-09-17T07:30:15.773 INFO:teuthology.orchestra.run.smithi087.stdout:prometheus.smithi087 smithi087 *:9095 running (2m) 97s ago 17m 48.7M - 2.43.0 a07b618ecd1d fbe2cbcbd68f 2024-09-17T07:30:15.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:15.772+0000 7faf9eca2640 1 -- 172.21.15.87:0/1661169284 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7faf8806cb90 msgr2=0x7faf8806f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:15.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:15.772+0000 7faf9eca2640 1 --2- 172.21.15.87:0/1661169284 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7faf8806cb90 0x7faf8806f040 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7faf84006fd0 tx=0x7faf84008040 comp rx=0 tx=0).stop 2024-09-17T07:30:15.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:15.772+0000 7faf9eca2640 1 -- 172.21.15.87:0/1661169284 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faf980fb490 msgr2=0x7faf9810e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:15.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:15.772+0000 7faf9eca2640 1 --2- 172.21.15.87:0/1661169284 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faf980fb490 0x7faf9810e130 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7faf8c003080 tx=0x7faf8c009da0 comp rx=0 tx=0).stop 2024-09-17T07:30:15.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:15.772+0000 7faf9eca2640 1 -- 172.21.15.87:0/1661169284 shutdown_connections 2024-09-17T07:30:15.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:15.772+0000 7faf9eca2640 1 --2- 172.21.15.87:0/1661169284 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7faf8806cb90 0x7faf8806f040 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:15.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:15.772+0000 7faf9eca2640 1 --2- 172.21.15.87:0/1661169284 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faf981014d0 0x7faf9810e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:15.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:15.772+0000 7faf9eca2640 1 --2- 172.21.15.87:0/1661169284 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faf980fb490 0x7faf9810e130 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:15.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:15.772+0000 7faf9eca2640 1 -- 172.21.15.87:0/1661169284 >> 172.21.15.87:0/1661169284 conn(0x7faf980f7010 msgr2=0x7faf980f73e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:15.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:15.772+0000 7faf9eca2640 1 -- 172.21.15.87:0/1661169284 shutdown_connections 2024-09-17T07:30:15.778 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:15.772+0000 7faf9eca2640 1 -- 172.21.15.87:0/1661169284 wait complete. 2024-09-17T07:30:16.391 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -e sha1=19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 -- bash -c 'ceph versions' 2024-09-17T07:30:16.647 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/mon.smithi087/config 2024-09-17T07:30:17.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:17 smithi139 ceph-mon[79872]: from='client.34560 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:30:17.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:17 smithi139 ceph-mon[79872]: pgmap v287: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:30:17.639 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:17 smithi087 ceph-mon[90982]: from='client.34560 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T07:30:17.639 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:17 smithi087 ceph-mon[90982]: pgmap v287: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:30:18.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:18.277+0000 7f407f26c640 1 -- 172.21.15.87:0/3291983687 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4078102f00 msgr2=0x7f40780fc5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:18.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:18.277+0000 7f407f26c640 1 --2- 172.21.15.87:0/3291983687 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4078102f00 0x7f40780fc5c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f406c0048d0 tx=0x7f406c009da0 comp rx=0 tx=0).stop 2024-09-17T07:30:18.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:18.277+0000 7f407f26c640 1 -- 172.21.15.87:0/3291983687 shutdown_connections 2024-09-17T07:30:18.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:18.277+0000 7f407f26c640 1 --2- 172.21.15.87:0/3291983687 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4078102f00 0x7f40780fc5c0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:18.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:18.277+0000 7f407f26c640 1 --2- 172.21.15.87:0/3291983687 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4078102560 0x7f4078102930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:18.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:18.277+0000 7f407f26c640 1 -- 172.21.15.87:0/3291983687 >> 172.21.15.87:0/3291983687 conn(0x7f40780f8120 msgr2=0x7f40780fa530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:18.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:18.277+0000 7f407f26c640 1 -- 172.21.15.87:0/3291983687 shutdown_connections 2024-09-17T07:30:18.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:18.277+0000 7f407f26c640 1 -- 172.21.15.87:0/3291983687 wait complete. 2024-09-17T07:30:18.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:18.277+0000 7f407f26c640 1 Processor -- start 2024-09-17T07:30:18.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:18.278+0000 7f407f26c640 1 -- start start 2024-09-17T07:30:18.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:18.278+0000 7f407f26c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4078102560 0x7f4078113140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:18.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:18.278+0000 7f407f26c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4078102f00 0x7f4078113680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:18.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:18.278+0000 7f407f26c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4078113c80 con 0x7f4078102f00 2024-09-17T07:30:18.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:18.278+0000 7f407f26c640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f407810d0c0 con 0x7f4078102560 2024-09-17T07:30:18.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:18.278+0000 7f407c807640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4078102f00 0x7f4078113680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:18.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:18.278+0000 7f407c807640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4078102f00 0x7f4078113680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45184/0 (socket says 172.21.15.87:45184) 2024-09-17T07:30:18.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:18.278+0000 7f407c807640 1 -- 172.21.15.87:0/974972896 learned_addr learned my addr 172.21.15.87:0/974972896 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:30:18.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:18.278+0000 7f407d008640 1 --2- 172.21.15.87:0/974972896 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4078102560 0x7f4078113140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:18.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:18.278+0000 7f407c807640 1 -- 172.21.15.87:0/974972896 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4078102560 msgr2=0x7f4078113140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:18.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:18.278+0000 7f407c807640 1 --2- 172.21.15.87:0/974972896 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4078102560 0x7f4078113140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:18.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:18.278+0000 7f407c807640 1 -- 172.21.15.87:0/974972896 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f406c005040 con 0x7f4078102f00 2024-09-17T07:30:18.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:18.278+0000 7f407c807640 1 --2- 172.21.15.87:0/974972896 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4078102f00 0x7f4078113680 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f406c0043d0 tx=0x7f406c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:18.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:18.279+0000 7f4075ffb640 1 -- 172.21.15.87:0/974972896 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f406c038070 con 0x7f4078102f00 2024-09-17T07:30:18.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:18.279+0000 7f407f26c640 1 -- 172.21.15.87:0/974972896 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f407810d340 con 0x7f4078102f00 2024-09-17T07:30:18.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:18.279+0000 7f4075ffb640 1 -- 172.21.15.87:0/974972896 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f406c0096c0 con 0x7f4078102f00 2024-09-17T07:30:18.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:18.279+0000 7f4075ffb640 1 -- 172.21.15.87:0/974972896 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f406c02c710 con 0x7f4078102f00 2024-09-17T07:30:18.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:18.279+0000 7f407f26c640 1 -- 172.21.15.87:0/974972896 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f407810d880 con 0x7f4078102f00 2024-09-17T07:30:18.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:18.280+0000 7f407f26c640 1 -- 172.21.15.87:0/974972896 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40780fdce0 con 0x7f4078102f00 2024-09-17T07:30:18.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:18.280+0000 7f4075ffb640 1 -- 172.21.15.87:0/974972896 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f406c030020 con 0x7f4078102f00 2024-09-17T07:30:18.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:18.281+0000 7f4075ffb640 1 --2- 172.21.15.87:0/974972896 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f406006cb90 0x7f406006f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:18.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:18.281+0000 7f4075ffb640 1 -- 172.21.15.87:0/974972896 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f406c0abe20 con 0x7f4078102f00 2024-09-17T07:30:18.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:18.281+0000 7f407d008640 1 --2- 172.21.15.87:0/974972896 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f406006cb90 0x7f406006f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:18.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:18.281+0000 7f407d008640 1 --2- 172.21.15.87:0/974972896 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f406006cb90 0x7f406006f040 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4070004ed0 tx=0x7f407000b040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:18.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:18.285+0000 7f4075ffb640 1 -- 172.21.15.87:0/974972896 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f406c075e90 con 0x7f4078102f00 2024-09-17T07:30:18.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:18.512+0000 7f407f26c640 1 -- 172.21.15.87:0/974972896 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4078109450 con 0x7f4078102f00 2024-09-17T07:30:18.514 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:18.513+0000 7f4075ffb640 1 -- 172.21.15.87:0/974972896 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7f406c02c870 con 0x7f4078102f00 2024-09-17T07:30:18.514 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-17T07:30:18.514 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": { 2024-09-17T07:30:18.514 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 2 2024-09-17T07:30:18.515 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:30:18.515 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr": { 2024-09-17T07:30:18.515 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 2 2024-09-17T07:30:18.515 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:30:18.515 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": { 2024-09-17T07:30:18.515 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 6 2024-09-17T07:30:18.515 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:30:18.515 INFO:teuthology.orchestra.run.smithi087.stdout: "mds": { 2024-09-17T07:30:18.515 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 4 2024-09-17T07:30:18.515 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-17T07:30:18.515 INFO:teuthology.orchestra.run.smithi087.stdout: "overall": { 2024-09-17T07:30:18.515 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)": 14 2024-09-17T07:30:18.515 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-17T07:30:18.516 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-17T07:30:18.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:18.515+0000 7f407f26c640 1 -- 172.21.15.87:0/974972896 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f406006cb90 msgr2=0x7f406006f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:18.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:18.515+0000 7f407f26c640 1 --2- 172.21.15.87:0/974972896 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f406006cb90 0x7f406006f040 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4070004ed0 tx=0x7f407000b040 comp rx=0 tx=0).stop 2024-09-17T07:30:18.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:18.515+0000 7f407f26c640 1 -- 172.21.15.87:0/974972896 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4078102f00 msgr2=0x7f4078113680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:18.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:18.515+0000 7f407f26c640 1 --2- 172.21.15.87:0/974972896 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4078102f00 0x7f4078113680 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f406c0043d0 tx=0x7f406c009da0 comp rx=0 tx=0).stop 2024-09-17T07:30:18.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:18.515+0000 7f407f26c640 1 -- 172.21.15.87:0/974972896 shutdown_connections 2024-09-17T07:30:18.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:18.515+0000 7f407f26c640 1 --2- 172.21.15.87:0/974972896 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4078102f00 0x7f4078113680 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:18.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:18.515+0000 7f407f26c640 1 --2- 172.21.15.87:0/974972896 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f406006cb90 0x7f406006f040 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:18.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:18.515+0000 7f407f26c640 1 --2- 172.21.15.87:0/974972896 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4078102560 0x7f4078113140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:18.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:18.515+0000 7f407f26c640 1 -- 172.21.15.87:0/974972896 >> 172.21.15.87:0/974972896 conn(0x7f40780f8120 msgr2=0x7f40780f9260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:18.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:18.515+0000 7f407f26c640 1 -- 172.21.15.87:0/974972896 shutdown_connections 2024-09-17T07:30:18.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:18.515+0000 7f407f26c640 1 -- 172.21.15.87:0/974972896 wait complete. 2024-09-17T07:30:19.200 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -e sha1=19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-09-17T07:30:19.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:19 smithi087 ceph-mon[90982]: pgmap v288: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:30:19.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:19 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/974972896' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:30:19.448 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/mon.smithi087/config 2024-09-17T07:30:19.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:19 smithi139 ceph-mon[79872]: pgmap v288: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:30:19.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:19 smithi139 ceph-mon[79872]: from='client.? 172.21.15.87:0/974972896' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:30:21.053 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:21.050+0000 7f99ea37e640 1 -- 172.21.15.87:0/2499763928 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99e4102f00 msgr2=0x7f99e40fc5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:21.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:21.050+0000 7f99ea37e640 1 --2- 172.21.15.87:0/2499763928 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99e4102f00 0x7f99e40fc5c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f99d80048d0 tx=0x7f99d8009da0 comp rx=0 tx=0).stop 2024-09-17T07:30:21.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:21.050+0000 7f99ea37e640 1 -- 172.21.15.87:0/2499763928 shutdown_connections 2024-09-17T07:30:21.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:21.050+0000 7f99ea37e640 1 --2- 172.21.15.87:0/2499763928 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99e4102f00 0x7f99e40fc5c0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:21.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:21.050+0000 7f99ea37e640 1 --2- 172.21.15.87:0/2499763928 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f99e4102560 0x7f99e4102930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:21.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:21.050+0000 7f99ea37e640 1 -- 172.21.15.87:0/2499763928 >> 172.21.15.87:0/2499763928 conn(0x7f99e40f8120 msgr2=0x7f99e40fa530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:21.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:21.051+0000 7f99ea37e640 1 -- 172.21.15.87:0/2499763928 shutdown_connections 2024-09-17T07:30:21.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:21.051+0000 7f99ea37e640 1 -- 172.21.15.87:0/2499763928 wait complete. 2024-09-17T07:30:21.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:21.051+0000 7f99ea37e640 1 Processor -- start 2024-09-17T07:30:21.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:21.051+0000 7f99ea37e640 1 -- start start 2024-09-17T07:30:21.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:21.051+0000 7f99ea37e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f99e4102560 0x7f99e4113140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:21.054 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:21.051+0000 7f99ea37e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99e4102f00 0x7f99e4113680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:21.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:21.051+0000 7f99ea37e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e4113c80 con 0x7f99e4102f00 2024-09-17T07:30:21.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:21.051+0000 7f99ea37e640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e410d0c0 con 0x7f99e4102560 2024-09-17T07:30:21.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:21.052+0000 7f99e37fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99e4102f00 0x7f99e4113680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:21.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:21.052+0000 7f99e37fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99e4102f00 0x7f99e4113680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45210/0 (socket says 172.21.15.87:45210) 2024-09-17T07:30:21.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:21.052+0000 7f99e37fe640 1 -- 172.21.15.87:0/1539211486 learned_addr learned my addr 172.21.15.87:0/1539211486 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:30:21.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:21.052+0000 7f99e3fff640 1 --2- 172.21.15.87:0/1539211486 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f99e4102560 0x7f99e4113140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:21.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:21.052+0000 7f99e37fe640 1 -- 172.21.15.87:0/1539211486 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f99e4102560 msgr2=0x7f99e4113140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:21.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:21.052+0000 7f99e37fe640 1 --2- 172.21.15.87:0/1539211486 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f99e4102560 0x7f99e4113140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:21.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:21.052+0000 7f99e37fe640 1 -- 172.21.15.87:0/1539211486 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99d8005040 con 0x7f99e4102f00 2024-09-17T07:30:21.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:21.052+0000 7f99e37fe640 1 --2- 172.21.15.87:0/1539211486 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99e4102f00 0x7f99e4113680 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f99d80043d0 tx=0x7f99d8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:21.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:21.052+0000 7f99e0ff9640 1 -- 172.21.15.87:0/1539211486 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99d8038070 con 0x7f99e4102f00 2024-09-17T07:30:21.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:21.052+0000 7f99e0ff9640 1 -- 172.21.15.87:0/1539211486 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f99d80096c0 con 0x7f99e4102f00 2024-09-17T07:30:21.055 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:21.052+0000 7f99ea37e640 1 -- 172.21.15.87:0/1539211486 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99e410d340 con 0x7f99e4102f00 2024-09-17T07:30:21.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:21.052+0000 7f99e0ff9640 1 -- 172.21.15.87:0/1539211486 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99d802c710 con 0x7f99e4102f00 2024-09-17T07:30:21.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:21.052+0000 7f99ea37e640 1 -- 172.21.15.87:0/1539211486 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99e410d880 con 0x7f99e4102f00 2024-09-17T07:30:21.056 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:21.053+0000 7f99ea37e640 1 -- 172.21.15.87:0/1539211486 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99e40fdce0 con 0x7f99e4102f00 2024-09-17T07:30:21.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:21.054+0000 7f99e0ff9640 1 -- 172.21.15.87:0/1539211486 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f99d8030020 con 0x7f99e4102f00 2024-09-17T07:30:21.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:21.054+0000 7f99e0ff9640 1 --2- 172.21.15.87:0/1539211486 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f99cc06cb90 0x7f99cc06f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:21.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:21.054+0000 7f99e0ff9640 1 -- 172.21.15.87:0/1539211486 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f99d80abd70 con 0x7f99e4102f00 2024-09-17T07:30:21.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:21.055+0000 7f99e3fff640 1 --2- 172.21.15.87:0/1539211486 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f99cc06cb90 0x7f99cc06f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:21.057 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:21.055+0000 7f99e3fff640 1 --2- 172.21.15.87:0/1539211486 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f99cc06cb90 0x7f99cc06f040 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f99d4004ed0 tx=0x7f99d400b040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:21.060 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:21.059+0000 7f99e0ff9640 1 -- 172.21.15.87:0/1539211486 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f99d8075e60 con 0x7f99e4102f00 2024-09-17T07:30:21.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:21.287+0000 7f99ea37e640 1 -- 172.21.15.87:0/1539211486 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f99e4109450 con 0x7f99e4102f00 2024-09-17T07:30:21.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:21.288+0000 7f99e0ff9640 1 -- 172.21.15.87:0/1539211486 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7f99d8079480 con 0x7f99e4102f00 2024-09-17T07:30:21.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:21.290+0000 7f99ea37e640 1 -- 172.21.15.87:0/1539211486 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f99cc06cb90 msgr2=0x7f99cc06f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:21.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:21.290+0000 7f99ea37e640 1 --2- 172.21.15.87:0/1539211486 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f99cc06cb90 0x7f99cc06f040 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f99d4004ed0 tx=0x7f99d400b040 comp rx=0 tx=0).stop 2024-09-17T07:30:21.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:21.290+0000 7f99ea37e640 1 -- 172.21.15.87:0/1539211486 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99e4102f00 msgr2=0x7f99e4113680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:21.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:21.290+0000 7f99ea37e640 1 --2- 172.21.15.87:0/1539211486 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99e4102f00 0x7f99e4113680 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f99d80043d0 tx=0x7f99d8009da0 comp rx=0 tx=0).stop 2024-09-17T07:30:21.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:21.290+0000 7f99ea37e640 1 -- 172.21.15.87:0/1539211486 shutdown_connections 2024-09-17T07:30:21.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:21.290+0000 7f99ea37e640 1 --2- 172.21.15.87:0/1539211486 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99e4102f00 0x7f99e4113680 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:21.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:21.290+0000 7f99ea37e640 1 --2- 172.21.15.87:0/1539211486 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f99cc06cb90 0x7f99cc06f040 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:21.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:21.290+0000 7f99ea37e640 1 --2- 172.21.15.87:0/1539211486 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f99e4102560 0x7f99e4113140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:21.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:21.290+0000 7f99ea37e640 1 -- 172.21.15.87:0/1539211486 >> 172.21.15.87:0/1539211486 conn(0x7f99e40f8120 msgr2=0x7f99e40f9260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:21.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:21.290+0000 7f99ea37e640 1 -- 172.21.15.87:0/1539211486 shutdown_connections 2024-09-17T07:30:21.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:21.290+0000 7f99ea37e640 1 -- 172.21.15.87:0/1539211486 wait complete. 2024-09-17T07:30:21.300 INFO:teuthology.orchestra.run.smithi087.stdout:true 2024-09-17T07:30:21.596 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:21 smithi087 ceph-mon[90982]: pgmap v289: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:30:21.596 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:21 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/1539211486' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:30:21.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:21 smithi139 ceph-mon[79872]: pgmap v289: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:30:21.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:21 smithi139 ceph-mon[79872]: from='client.? 172.21.15.87:0/1539211486' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:30:21.904 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -e sha1=19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-09-17T07:30:22.148 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/mon.smithi087/config 2024-09-17T07:30:23.515 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:23 smithi087 ceph-mon[90982]: pgmap v290: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:30:23.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:23 smithi139 ceph-mon[79872]: pgmap v290: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:30:23.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:23.716+0000 7f32e3b84640 1 -- 172.21.15.87:0/133868075 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f32dc1014e0 msgr2=0x7f32dc1018b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:23.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:23.716+0000 7f32e3b84640 1 --2- 172.21.15.87:0/133868075 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f32dc1014e0 0x7f32dc1018b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f32d80048d0 tx=0x7f32d8009da0 comp rx=0 tx=0).stop 2024-09-17T07:30:23.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:23.716+0000 7f32e3b84640 1 -- 172.21.15.87:0/133868075 shutdown_connections 2024-09-17T07:30:23.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:23.716+0000 7f32e3b84640 1 --2- 172.21.15.87:0/133868075 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f32dc0fb4a0 0x7f32dc0fb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:23.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:23.716+0000 7f32e3b84640 1 --2- 172.21.15.87:0/133868075 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f32dc1014e0 0x7f32dc1018b0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:23.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:23.716+0000 7f32e3b84640 1 -- 172.21.15.87:0/133868075 >> 172.21.15.87:0/133868075 conn(0x7f32dc0f7060 msgr2=0x7f32dc0f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:23.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:23.716+0000 7f32e3b84640 1 -- 172.21.15.87:0/133868075 shutdown_connections 2024-09-17T07:30:23.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:23.716+0000 7f32e3b84640 1 -- 172.21.15.87:0/133868075 wait complete. 2024-09-17T07:30:23.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:23.717+0000 7f32e3b84640 1 Processor -- start 2024-09-17T07:30:23.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:23.717+0000 7f32e3b84640 1 -- start start 2024-09-17T07:30:23.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:23.717+0000 7f32e3b84640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f32dc0fb4a0 0x7f32dc112020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:23.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:23.717+0000 7f32e3b84640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f32dc1014e0 0x7f32dc112560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:23.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:23.717+0000 7f32e3b84640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32dc112b60 con 0x7f32dc1014e0 2024-09-17T07:30:23.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:23.717+0000 7f32e3b84640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32dc10bfa0 con 0x7f32dc0fb4a0 2024-09-17T07:30:23.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:23.717+0000 7f32e111f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f32dc1014e0 0x7f32dc112560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:23.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:23.717+0000 7f32e111f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f32dc1014e0 0x7f32dc112560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:45232/0 (socket says 172.21.15.87:45232) 2024-09-17T07:30:23.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:23.717+0000 7f32e111f640 1 -- 172.21.15.87:0/2928157010 learned_addr learned my addr 172.21.15.87:0/2928157010 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:30:23.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:23.717+0000 7f32e1920640 1 --2- 172.21.15.87:0/2928157010 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f32dc0fb4a0 0x7f32dc112020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:23.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:23.717+0000 7f32e111f640 1 -- 172.21.15.87:0/2928157010 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f32dc0fb4a0 msgr2=0x7f32dc112020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:23.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:23.717+0000 7f32e111f640 1 --2- 172.21.15.87:0/2928157010 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f32dc0fb4a0 0x7f32dc112020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:23.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:23.717+0000 7f32e111f640 1 -- 172.21.15.87:0/2928157010 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32d8005040 con 0x7f32dc1014e0 2024-09-17T07:30:23.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:23.718+0000 7f32e111f640 1 --2- 172.21.15.87:0/2928157010 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f32dc1014e0 0x7f32dc112560 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f32cc00c790 tx=0x7f32cc0043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:23.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:23.718+0000 7f32d27fc640 1 -- 172.21.15.87:0/2928157010 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32cc00a820 con 0x7f32dc1014e0 2024-09-17T07:30:23.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:23.718+0000 7f32e3b84640 1 -- 172.21.15.87:0/2928157010 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32dc10c280 con 0x7f32dc1014e0 2024-09-17T07:30:23.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:23.718+0000 7f32d27fc640 1 -- 172.21.15.87:0/2928157010 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f32cc00ae00 con 0x7f32dc1014e0 2024-09-17T07:30:23.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:23.718+0000 7f32d27fc640 1 -- 172.21.15.87:0/2928157010 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32cc0113a0 con 0x7f32dc1014e0 2024-09-17T07:30:23.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:23.718+0000 7f32e3b84640 1 -- 172.21.15.87:0/2928157010 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32dc10c820 con 0x7f32dc1014e0 2024-09-17T07:30:23.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:23.719+0000 7f32e3b84640 1 -- 172.21.15.87:0/2928157010 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32dc0fcbe0 con 0x7f32dc1014e0 2024-09-17T07:30:23.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:23.719+0000 7f32d27fc640 1 -- 172.21.15.87:0/2928157010 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f32cc00a980 con 0x7f32dc1014e0 2024-09-17T07:30:23.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:23.720+0000 7f32d27fc640 1 --2- 172.21.15.87:0/2928157010 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f32c806cb90 0x7f32c806f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:23.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:23.720+0000 7f32d27fc640 1 -- 172.21.15.87:0/2928157010 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f32cc08c230 con 0x7f32dc1014e0 2024-09-17T07:30:23.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:23.720+0000 7f32e1920640 1 --2- 172.21.15.87:0/2928157010 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f32c806cb90 0x7f32c806f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:23.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:23.720+0000 7f32e1920640 1 --2- 172.21.15.87:0/2928157010 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f32c806cb90 0x7f32c806f040 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f32d8009ac0 tx=0x7f32d8009da0 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:23.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:23.725+0000 7f32d27fc640 1 -- 172.21.15.87:0/2928157010 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f32cc056270 con 0x7f32dc1014e0 2024-09-17T07:30:23.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:23.950+0000 7f32e3b84640 1 -- 172.21.15.87:0/2928157010 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f32dc108340 con 0x7f32dc1014e0 2024-09-17T07:30:23.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:23.951+0000 7f32d27fc640 1 -- 172.21.15.87:0/2928157010 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7f32cc059890 con 0x7f32dc1014e0 2024-09-17T07:30:23.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:23.953+0000 7f32e3b84640 1 -- 172.21.15.87:0/2928157010 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f32c806cb90 msgr2=0x7f32c806f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:23.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:23.953+0000 7f32e3b84640 1 --2- 172.21.15.87:0/2928157010 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f32c806cb90 0x7f32c806f040 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f32d8009ac0 tx=0x7f32d8009da0 comp rx=0 tx=0).stop 2024-09-17T07:30:23.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:23.953+0000 7f32e3b84640 1 -- 172.21.15.87:0/2928157010 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f32dc1014e0 msgr2=0x7f32dc112560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:23.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:23.953+0000 7f32e3b84640 1 --2- 172.21.15.87:0/2928157010 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f32dc1014e0 0x7f32dc112560 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f32cc00c790 tx=0x7f32cc0043c0 comp rx=0 tx=0).stop 2024-09-17T07:30:23.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:23.953+0000 7f32e3b84640 1 -- 172.21.15.87:0/2928157010 shutdown_connections 2024-09-17T07:30:23.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:23.953+0000 7f32e3b84640 1 --2- 172.21.15.87:0/2928157010 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f32dc1014e0 0x7f32dc112560 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:23.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:23.953+0000 7f32e3b84640 1 --2- 172.21.15.87:0/2928157010 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f32c806cb90 0x7f32c806f040 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:23.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:23.953+0000 7f32e3b84640 1 --2- 172.21.15.87:0/2928157010 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f32dc0fb4a0 0x7f32dc112020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:23.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:23.953+0000 7f32e3b84640 1 -- 172.21.15.87:0/2928157010 >> 172.21.15.87:0/2928157010 conn(0x7f32dc0f7060 msgr2=0x7f32dc0f89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:23.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:23.953+0000 7f32e3b84640 1 -- 172.21.15.87:0/2928157010 shutdown_connections 2024-09-17T07:30:23.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:23.953+0000 7f32e3b84640 1 -- 172.21.15.87:0/2928157010 wait complete. 2024-09-17T07:30:23.963 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)" 2024-09-17T07:30:24.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:24 smithi139 ceph-mon[79872]: from='client.? 172.21.15.87:0/2928157010' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:30:24.660 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:24 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/2928157010' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T07:30:24.685 DEBUG:teuthology.parallel:result is None 2024-09-17T07:30:24.686 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-17T07:30:24.697 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi087.front.sepia.ceph.com 2024-09-17T07:30:24.697 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-17T07:30:24.941 INFO:teuthology.orchestra.run.smithi087.stderr:Inferring config /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/mon.smithi087/config 2024-09-17T07:30:25.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:25 smithi087 ceph-mon[90982]: pgmap v291: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:30:25.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:25 smithi139 ceph-mon[79872]: pgmap v291: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:30:26.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:26.606+0000 7ffa1230f640 1 -- 172.21.15.87:0/2637468203 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa0c102550 msgr2=0x7ffa0c102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:26.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:26.606+0000 7ffa1230f640 1 --2- 172.21.15.87:0/2637468203 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa0c102550 0x7ffa0c102920 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc0048d0 tx=0x7ff9fc009da0 comp rx=0 tx=0).stop 2024-09-17T07:30:26.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:26.606+0000 7ffa1230f640 1 -- 172.21.15.87:0/2637468203 shutdown_connections 2024-09-17T07:30:26.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:26.606+0000 7ffa1230f640 1 --2- 172.21.15.87:0/2637468203 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffa0c102ef0 0x7ffa0c0fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:26.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:26.606+0000 7ffa1230f640 1 --2- 172.21.15.87:0/2637468203 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa0c102550 0x7ffa0c102920 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:26.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:26.606+0000 7ffa1230f640 1 -- 172.21.15.87:0/2637468203 >> 172.21.15.87:0/2637468203 conn(0x7ffa0c0f80f0 msgr2=0x7ffa0c0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:26.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:26.606+0000 7ffa1230f640 1 -- 172.21.15.87:0/2637468203 shutdown_connections 2024-09-17T07:30:26.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:26.606+0000 7ffa1230f640 1 -- 172.21.15.87:0/2637468203 wait complete. 2024-09-17T07:30:26.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:26.607+0000 7ffa1230f640 1 Processor -- start 2024-09-17T07:30:26.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:26.607+0000 7ffa1230f640 1 -- start start 2024-09-17T07:30:26.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:26.607+0000 7ffa1230f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa0c102550 0x7ffa0c113420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:26.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:26.607+0000 7ffa1230f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffa0c102ef0 0x7ffa0c113960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:26.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:26.607+0000 7ffa1230f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0c113f60 con 0x7ffa0c102550 2024-09-17T07:30:26.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:26.607+0000 7ffa1230f640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0c1140d0 con 0x7ffa0c102ef0 2024-09-17T07:30:26.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:26.607+0000 7ffa0bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa0c102550 0x7ffa0c113420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:26.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:26.607+0000 7ffa0bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa0c102550 0x7ffa0c113420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46054/0 (socket says 172.21.15.87:46054) 2024-09-17T07:30:26.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:26.607+0000 7ffa0bfff640 1 -- 172.21.15.87:0/2089266373 learned_addr learned my addr 172.21.15.87:0/2089266373 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:30:26.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:26.607+0000 7ffa0b7fe640 1 --2- 172.21.15.87:0/2089266373 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffa0c102ef0 0x7ffa0c113960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:26.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:26.607+0000 7ffa0bfff640 1 -- 172.21.15.87:0/2089266373 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffa0c102ef0 msgr2=0x7ffa0c113960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:26.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:26.607+0000 7ffa0bfff640 1 --2- 172.21.15.87:0/2089266373 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffa0c102ef0 0x7ffa0c113960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:26.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:26.608+0000 7ffa0bfff640 1 -- 172.21.15.87:0/2089266373 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9fc005040 con 0x7ffa0c102550 2024-09-17T07:30:26.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:26.608+0000 7ffa0bfff640 1 --2- 172.21.15.87:0/2089266373 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa0c102550 0x7ffa0c113420 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc003080 tx=0x7ff9fc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:26.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:26.608+0000 7ffa08ff9640 1 -- 172.21.15.87:0/2089266373 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9fc038070 con 0x7ffa0c102550 2024-09-17T07:30:26.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:26.608+0000 7ffa1230f640 1 -- 172.21.15.87:0/2089266373 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa0c10d4f0 con 0x7ffa0c102550 2024-09-17T07:30:26.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:26.608+0000 7ffa08ff9640 1 -- 172.21.15.87:0/2089266373 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7ff9fc0097c0 con 0x7ffa0c102550 2024-09-17T07:30:26.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:26.608+0000 7ffa08ff9640 1 -- 172.21.15.87:0/2089266373 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9fc03d420 con 0x7ffa0c102550 2024-09-17T07:30:26.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:26.608+0000 7ffa1230f640 1 -- 172.21.15.87:0/2089266373 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa0c10da30 con 0x7ffa0c102550 2024-09-17T07:30:26.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:26.609+0000 7ffa1230f640 1 -- 172.21.15.87:0/2089266373 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa0c0fdcd0 con 0x7ffa0c102550 2024-09-17T07:30:26.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:26.609+0000 7ffa08ff9640 1 -- 172.21.15.87:0/2089266373 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7ff9fc030020 con 0x7ffa0c102550 2024-09-17T07:30:26.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:26.610+0000 7ffa08ff9640 1 --2- 172.21.15.87:0/2089266373 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7ff9f406cb90 0x7ff9f406f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:26.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:26.610+0000 7ffa08ff9640 1 -- 172.21.15.87:0/2089266373 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6496+0+0 (secure 0 0 0) 0x7ff9fc0ac6b0 con 0x7ffa0c102550 2024-09-17T07:30:26.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:26.610+0000 7ffa0b7fe640 1 --2- 172.21.15.87:0/2089266373 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7ff9f406cb90 0x7ff9f406f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:26.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:26.610+0000 7ffa0b7fe640 1 --2- 172.21.15.87:0/2089266373 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7ff9f406cb90 0x7ff9f406f040 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c10ed20 tx=0x7ffa00009040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:26.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:26.614+0000 7ffa08ff9640 1 -- 172.21.15.87:0/2089266373 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff9fc076670 con 0x7ffa0c102550 2024-09-17T07:30:26.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:26 smithi087 ceph-mon[90982]: pgmap v292: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:30:26.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:26.809+0000 7ffa1230f640 1 -- 172.21.15.87:0/2089266373 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ffa0c0fbd50 con 0x7ffa0c102550 2024-09-17T07:30:26.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:26.810+0000 7ffa08ff9640 1 -- 172.21.15.87:0/2089266373 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 43 v43) v1 ==== 76+0+1872 (secure 0 0 0) 0x7ff9fc079c90 con 0x7ffa0c102550 2024-09-17T07:30:26.811 INFO:teuthology.orchestra.run.smithi087.stdout:e43 2024-09-17T07:30:26.811 INFO:teuthology.orchestra.run.smithi087.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T07:30:26.811 INFO:teuthology.orchestra.run.smithi087.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T07:30:26.811 INFO:teuthology.orchestra.run.smithi087.stdout:legacy client fscid: 1 2024-09-17T07:30:26.811 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:30:26.811 INFO:teuthology.orchestra.run.smithi087.stdout:Filesystem 'cephfs' (1) 2024-09-17T07:30:26.812 INFO:teuthology.orchestra.run.smithi087.stdout:fs_name cephfs 2024-09-17T07:30:26.812 INFO:teuthology.orchestra.run.smithi087.stdout:epoch 43 2024-09-17T07:30:26.812 INFO:teuthology.orchestra.run.smithi087.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T07:30:26.812 INFO:teuthology.orchestra.run.smithi087.stdout:created 2024-09-17T07:17:15.368053+0000 2024-09-17T07:30:26.812 INFO:teuthology.orchestra.run.smithi087.stdout:modified 2024-09-17T07:27:41.863112+0000 2024-09-17T07:30:26.812 INFO:teuthology.orchestra.run.smithi087.stdout:tableserver 0 2024-09-17T07:30:26.812 INFO:teuthology.orchestra.run.smithi087.stdout:root 0 2024-09-17T07:30:26.812 INFO:teuthology.orchestra.run.smithi087.stdout:session_timeout 60 2024-09-17T07:30:26.812 INFO:teuthology.orchestra.run.smithi087.stdout:session_autoclose 300 2024-09-17T07:30:26.812 INFO:teuthology.orchestra.run.smithi087.stdout:max_file_size 1099511627776 2024-09-17T07:30:26.812 INFO:teuthology.orchestra.run.smithi087.stdout:max_xattr_size 65536 2024-09-17T07:30:26.812 INFO:teuthology.orchestra.run.smithi087.stdout:required_client_features {} 2024-09-17T07:30:26.812 INFO:teuthology.orchestra.run.smithi087.stdout:last_failure 0 2024-09-17T07:30:26.812 INFO:teuthology.orchestra.run.smithi087.stdout:last_failure_osd_epoch 80 2024-09-17T07:30:26.813 INFO:teuthology.orchestra.run.smithi087.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T07:30:26.813 INFO:teuthology.orchestra.run.smithi087.stdout:max_mds 2 2024-09-17T07:30:26.813 INFO:teuthology.orchestra.run.smithi087.stdout:in 0,1 2024-09-17T07:30:26.813 INFO:teuthology.orchestra.run.smithi087.stdout:up {0=34412,1=34444} 2024-09-17T07:30:26.813 INFO:teuthology.orchestra.run.smithi087.stdout:failed 2024-09-17T07:30:26.813 INFO:teuthology.orchestra.run.smithi087.stdout:damaged 2024-09-17T07:30:26.813 INFO:teuthology.orchestra.run.smithi087.stdout:stopped 2024-09-17T07:30:26.813 INFO:teuthology.orchestra.run.smithi087.stdout:data_pools [3] 2024-09-17T07:30:26.813 INFO:teuthology.orchestra.run.smithi087.stdout:metadata_pool 2 2024-09-17T07:30:26.813 INFO:teuthology.orchestra.run.smithi087.stdout:inline_data enabled 2024-09-17T07:30:26.813 INFO:teuthology.orchestra.run.smithi087.stdout:balancer 2024-09-17T07:30:26.813 INFO:teuthology.orchestra.run.smithi087.stdout:bal_rank_mask -1 2024-09-17T07:30:26.813 INFO:teuthology.orchestra.run.smithi087.stdout:standby_count_wanted 1 2024-09-17T07:30:26.814 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi087.vvbzss{0:34412} state up:active seq 8 join_fscid=1 addr [v2:172.21.15.87:6826/1050918039,v1:172.21.15.87:6827/1050918039] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:30:26.814 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi139.gnwonz{0:44325} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.139:6824/1289261341,v1:172.21.15.139:6825/1289261341] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:30:26.814 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi087.tjhpcs{1:34444} state up:active seq 11 join_fscid=1 addr [v2:172.21.15.87:6828/2375971201,v1:172.21.15.87:6829/2375971201] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:30:26.814 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.cephfs.smithi139.ftvinf{1:44347} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.139:6826/1126774601,v1:172.21.15.139:6827/1126774601] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T07:30:26.814 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:30:26.814 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:30:26.815 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 43 2024-09-17T07:30:26.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:26.812+0000 7ffa1230f640 1 -- 172.21.15.87:0/2089266373 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7ff9f406cb90 msgr2=0x7ff9f406f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:26.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:26.812+0000 7ffa1230f640 1 --2- 172.21.15.87:0/2089266373 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7ff9f406cb90 0x7ff9f406f040 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c10ed20 tx=0x7ffa00009040 comp rx=0 tx=0).stop 2024-09-17T07:30:26.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:26.812+0000 7ffa1230f640 1 -- 172.21.15.87:0/2089266373 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa0c102550 msgr2=0x7ffa0c113420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:26.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:26.812+0000 7ffa1230f640 1 --2- 172.21.15.87:0/2089266373 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa0c102550 0x7ffa0c113420 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc003080 tx=0x7ff9fc009da0 comp rx=0 tx=0).stop 2024-09-17T07:30:26.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:26.812+0000 7ffa1230f640 1 -- 172.21.15.87:0/2089266373 shutdown_connections 2024-09-17T07:30:26.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:26.812+0000 7ffa1230f640 1 --2- 172.21.15.87:0/2089266373 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7ff9f406cb90 0x7ff9f406f040 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:26.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:26.812+0000 7ffa1230f640 1 --2- 172.21.15.87:0/2089266373 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffa0c102ef0 0x7ffa0c113960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:26.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:26.812+0000 7ffa1230f640 1 --2- 172.21.15.87:0/2089266373 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa0c102550 0x7ffa0c113420 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:26.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:26.812+0000 7ffa1230f640 1 -- 172.21.15.87:0/2089266373 >> 172.21.15.87:0/2089266373 conn(0x7ffa0c0f80f0 msgr2=0x7ffa0c0f9230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:26.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:26.812+0000 7ffa1230f640 1 -- 172.21.15.87:0/2089266373 shutdown_connections 2024-09-17T07:30:26.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:26.812+0000 7ffa1230f640 1 -- 172.21.15.87:0/2089266373 wait complete. 2024-09-17T07:30:26.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:26 smithi139 ceph-mon[79872]: pgmap v292: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:30:27.432 INFO:teuthology.run_tasks:Running task fs.post_upgrade_checks... 2024-09-17T07:30:27.443 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T07:30:27.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.539+0000 7f3fb94d4640 1 -- 172.21.15.87:0/3433978151 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fb41013a0 msgr2=0x7f3fb4101770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:27.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.539+0000 7f3fb94d4640 1 --2- 172.21.15.87:0/3433978151 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fb41013a0 0x7f3fb4101770 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3fa40048d0 tx=0x7f3fa4009da0 comp rx=0 tx=0).stop 2024-09-17T07:30:27.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.540+0000 7f3fb94d4640 1 -- 172.21.15.87:0/3433978151 shutdown_connections 2024-09-17T07:30:27.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.540+0000 7f3fb94d4640 1 --2- 172.21.15.87:0/3433978151 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3fb4101d40 0x7f3fb40fb400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:27.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.540+0000 7f3fb94d4640 1 --2- 172.21.15.87:0/3433978151 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fb41013a0 0x7f3fb4101770 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:27.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.540+0000 7f3fb94d4640 1 -- 172.21.15.87:0/3433978151 >> 172.21.15.87:0/3433978151 conn(0x7f3fb4071460 msgr2=0x7f3fb4071860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:27.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.540+0000 7f3fb94d4640 1 -- 172.21.15.87:0/3433978151 shutdown_connections 2024-09-17T07:30:27.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.540+0000 7f3fb94d4640 1 -- 172.21.15.87:0/3433978151 wait complete. 2024-09-17T07:30:27.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.540+0000 7f3fb94d4640 1 Processor -- start 2024-09-17T07:30:27.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.540+0000 7f3fb94d4640 1 -- start start 2024-09-17T07:30:27.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.540+0000 7f3fb94d4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3fb41013a0 0x7f3fb410e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:27.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.540+0000 7f3fb94d4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fb4101d40 0x7f3fb410e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:27.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.540+0000 7f3fb94d4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb410eaa0 con 0x7f3fb4101d40 2024-09-17T07:30:27.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.540+0000 7f3fb94d4640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb410ec10 con 0x7f3fb41013a0 2024-09-17T07:30:27.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.541+0000 7f3fb27fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fb4101d40 0x7f3fb410e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:27.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.541+0000 7f3fb27fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fb4101d40 0x7f3fb410e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46070/0 (socket says 172.21.15.87:46070) 2024-09-17T07:30:27.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.541+0000 7f3fb27fc640 1 -- 172.21.15.87:0/1901384008 learned_addr learned my addr 172.21.15.87:0/1901384008 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:30:27.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.541+0000 7f3fb27fc640 1 -- 172.21.15.87:0/1901384008 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3fb41013a0 msgr2=0x7f3fb410e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:27.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.541+0000 7f3fb27fc640 1 --2- 172.21.15.87:0/1901384008 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3fb41013a0 0x7f3fb410e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:27.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.541+0000 7f3fb27fc640 1 -- 172.21.15.87:0/1901384008 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fa4005040 con 0x7f3fb4101d40 2024-09-17T07:30:27.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.541+0000 7f3fb27fc640 1 --2- 172.21.15.87:0/1901384008 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fb4101d40 0x7f3fb410e560 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3fa800b560 tx=0x7f3fa80090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:27.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.541+0000 7f3f9b7fe640 1 -- 172.21.15.87:0/1901384008 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3fa800f6f0 con 0x7f3fb4101d40 2024-09-17T07:30:27.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.541+0000 7f3f9b7fe640 1 -- 172.21.15.87:0/1901384008 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f3fa800fcd0 con 0x7f3fb4101d40 2024-09-17T07:30:27.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.541+0000 7f3f9b7fe640 1 -- 172.21.15.87:0/1901384008 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3fa8011d20 con 0x7f3fb4101d40 2024-09-17T07:30:27.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.541+0000 7f3fb94d4640 1 -- 172.21.15.87:0/1901384008 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fb4117090 con 0x7f3fb4101d40 2024-09-17T07:30:27.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.541+0000 7f3fb94d4640 1 -- 172.21.15.87:0/1901384008 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fb41173c0 con 0x7f3fb4101d40 2024-09-17T07:30:27.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.542+0000 7f3fb94d4640 1 -- 172.21.15.87:0/1901384008 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fb40fcb20 con 0x7f3fb4101d40 2024-09-17T07:30:27.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.543+0000 7f3f9b7fe640 1 -- 172.21.15.87:0/1901384008 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f3fa8011500 con 0x7f3fb4101d40 2024-09-17T07:30:27.545 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.543+0000 7f3f9b7fe640 1 --2- 172.21.15.87:0/1901384008 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f3f9c06cb90 0x7f3f9c06f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:27.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.543+0000 7f3fb2ffd640 1 --2- 172.21.15.87:0/1901384008 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f3f9c06cb90 0x7f3f9c06f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:27.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.543+0000 7f3f9b7fe640 1 -- 172.21.15.87:0/1901384008 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f3fa808bd20 con 0x7f3fb4101d40 2024-09-17T07:30:27.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.544+0000 7f3fb2ffd640 1 --2- 172.21.15.87:0/1901384008 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f3f9c06cb90 0x7f3f9c06f040 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3fa40043d0 tx=0x7f3fa4009da0 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:27.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.548+0000 7f3f9b7fe640 1 -- 172.21.15.87:0/1901384008 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f3fa8055e20 con 0x7f3fb4101d40 2024-09-17T07:30:27.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:27 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/2089266373' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T07:30:27.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.713+0000 7f3fb94d4640 1 -- 172.21.15.87:0/1901384008 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3fb404bfb0 con 0x7f3fb4101d40 2024-09-17T07:30:27.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.714+0000 7f3f9b7fe640 1 -- 172.21.15.87:0/1901384008 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+16536 (secure 0 0 0) 0x7f3fa8059440 con 0x7f3fb4101d40 2024-09-17T07:30:27.715 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:30:27.716 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":82,"fsid":"d5dbf8d6-74c3-11ef-bceb-c7b262605968","created":"2024-09-17T07:10:35.674251+0000","modified":"2024-09-17T07:27:29.613292+0000","last_up_change":"2024-09-17T07:25:58.345957+0000","last_in_change":"2024-09-17T07:15:41.556417+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T07:14:46.855001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-09-17T07:17:13.907561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-09-17T07:17:14.594643+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aa28f635-8a58-48f8-bd4e-1626b8da9749","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":47,"up_from":51,"up_thru":76,"down_at":48,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1677183701},{"type":"v1","addr":"172.21.15.87:6803","nonce":1677183701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1677183701},{"type":"v1","addr":"172.21.15.87:6805","nonce":1677183701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":1677183701},{"type":"v1","addr":"172.21.15.87:6809","nonce":1677183701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1677183701},{"type":"v1","addr":"172.21.15.87:6807","nonce":1677183701}]},"public_addr":"172.21.15.87:6803/1677183701","cluster_addr":"172.21.15.87:6805/1677183701","heartbeat_back_addr":"172.21.15.87:6809/1677183701","heartbeat_front_addr":"172.21.15.87:6807/1677183701","state":["exists","up"]},{"osd":1,"uuid":"3a7464ee-c016-40fd-ab8a-9652397b193c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":52,"up_from":56,"up_thru":76,"down_at":53,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":952896512},{"type":"v1","addr":"172.21.15.87:6811","nonce":952896512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":952896512},{"type":"v1","addr":"172.21.15.87:6813","nonce":952896512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":952896512},{"type":"v1","addr":"172.21.15.87:6817","nonce":952896512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":952896512},{"type":"v1","addr":"172.21.15.87:6815","nonce":952896512}]},"public_addr":"172.21.15.87:6811/952896512","cluster_addr":"172.21.15.87:6813/952896512","heartbeat_back_addr":"172.21.15.87:6817/952896512","heartbeat_front_addr":"172.21.15.87:6815/952896512","state":["exists","up"]},{"osd":2,"uuid":"31ffe6e4-fa51-43ed-8887-022ad51fbd6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":57,"up_from":61,"up_thru":76,"down_at":58,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":3151708554},{"type":"v1","addr":"172.21.15.87:6819","nonce":3151708554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":3151708554},{"type":"v1","addr":"172.21.15.87:6821","nonce":3151708554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":3151708554},{"type":"v1","addr":"172.21.15.87:6825","nonce":3151708554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":3151708554},{"type":"v1","addr":"172.21.15.87:6823","nonce":3151708554}]},"public_addr":"172.21.15.87:6819/3151708554","cluster_addr":"172.21.15.87:6821/3151708554","heartbeat_back_addr":"172.21.15.87:6825/3151708554","heartbeat_front_addr":"172.21.15.87:6823/3151708554","state":["exists","up"]},{"osd":3,"uuid":"00b175ca-ddfd-41f9-b219-130321a7fbc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":26,"last_clean_end":62,"up_from":66,"up_thru":76,"down_at":63,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":3281602359},{"type":"v1","addr":"172.21.15.139:6801","nonce":3281602359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":3281602359},{"type":"v1","addr":"172.21.15.139:6803","nonce":3281602359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":3281602359},{"type":"v1","addr":"172.21.15.139:6807","nonce":3281602359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":3281602359},{"type":"v1","addr":"172.21.15.139:6805","nonce":3281602359}]},"public_addr":"172.21.15.139:6801/3281602359","cluster_addr":"172.21.15.139:6803/3281602359","heartbeat_back_addr":"172.21.15.139:6807/3281602359","heartbeat_front_addr":"172.21.15.139:6805/3281602359","state":["exists","up"]},{"osd":4,"uuid":"d318cab6-e472-472e-8805-d2ab7e04db2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":32,"last_clean_end":67,"up_from":71,"up_thru":76,"down_at":68,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":137480765},{"type":"v1","addr":"172.21.15.139:6809","nonce":137480765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":137480765},{"type":"v1","addr":"172.21.15.139:6811","nonce":137480765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":137480765},{"type":"v1","addr":"172.21.15.139:6815","nonce":137480765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":137480765},{"type":"v1","addr":"172.21.15.139:6813","nonce":137480765}]},"public_addr":"172.21.15.139:6809/137480765","cluster_addr":"172.21.15.139:6811/137480765","heartbeat_back_addr":"172.21.15.139:6815/137480765","heartbeat_front_addr":"172.21.15.139:6813/137480765","state":["exists","up"]},{"osd":5,"uuid":"37b86806-e559-401c-aedf-3d9de1ac347e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":37,"last_clean_end":72,"up_from":76,"up_thru":76,"down_at":73,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":4036107320},{"type":"v1","addr":"172.21.15.139:6817","nonce":4036107320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":4036107320},{"type":"v1","addr":"172.21.15.139:6819","nonce":4036107320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":4036107320},{"type":"v1","addr":"172.21.15.139:6823","nonce":4036107320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":4036107320},{"type":"v1","addr":"172.21.15.139:6821","nonce":4036107320}]},"public_addr":"172.21.15.139:6817/4036107320","cluster_addr":"172.21.15.139:6819/4036107320","heartbeat_back_addr":"172.21.15.139:6823/4036107320","heartbeat_front_addr":"172.21.15.139:6821/4036107320","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T07:13:50.061288+0000","dead_epoch":47},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T07:14:15.941888+0000","dead_epoch":52},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T07:14:44.449653+0000","dead_epoch":57},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T07:15:08.229646+0000","dead_epoch":62},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T07:15:33.299519+0000","dead_epoch":67},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T07:15:58.647774+0000","dead_epoch":72}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.87:6829/2255237099":"2024-09-18T07:26:50.197946+0000","172.21.15.87:6828/2255237099":"2024-09-18T07:26:50.197946+0000","172.21.15.87:0/614478534":"2024-09-18T07:21:58.033791+0000","172.21.15.87:0/3876385220":"2024-09-18T07:21:58.033791+0000","172.21.15.87:0/3936071784":"2024-09-18T07:21:58.033791+0000","172.21.15.87:0/3287211314":"2024-09-18T07:21:58.033791+0000","172.21.15.87:0/992892562":"2024-09-18T07:21:58.033791+0000","172.21.15.139:0/1157945461":"2024-09-18T07:21:18.807798+0000","172.21.15.87:6826/3333749861":"2024-09-18T07:17:30.381338+0000","172.21.15.87:0/2382049370":"2024-09-18T07:11:03.573097+0000","172.21.15.87:0/990687259":"2024-09-18T07:19:39.061872+0000","172.21.15.87:0/1935417402":"2024-09-18T07:11:03.573097+0000","172.21.15.139:0/712755220":"2024-09-18T07:21:18.807798+0000","172.21.15.87:0/853807276":"2024-09-18T07:11:03.573097+0000","172.21.15.87:6800/3398669653":"2024-09-18T07:21:58.033791+0000","172.21.15.139:6829/3218632563":"2024-09-18T07:21:18.807798+0000","172.21.15.87:0/2056368138":"2024-09-18T07:12:36.550496+0000","172.21.15.87:0/822055517":"2024-09-18T07:21:58.033791+0000","172.21.15.87:0/3586936716":"2024-09-18T07:19:39.061872+0000","172.21.15.87:0/2629320129":"2024-09-18T07:11:32.590075+0000","172.21.15.139:0/1643063298":"2024-09-18T07:21:18.807798+0000","172.21.15.87:6827/3333749861":"2024-09-18T07:17:30.381338+0000","172.21.15.87:0/443165441":"2024-09-18T07:12:36.550496+0000","172.21.15.87:0/147535528":"2024-09-18T07:19:39.061872+0000","172.21.15.87:0/2452100146":"2024-09-18T07:11:32.590075+0000","172.21.15.139:0/1909420975":"2024-09-18T07:21:18.807798+0000","172.21.15.139:6828/3218632563":"2024-09-18T07:21:18.807798+0000","172.21.15.87:6800/611048628":"2024-09-18T07:19:39.061872+0000","172.21.15.87:6801/2341884603":"2024-09-18T07:12:36.550496+0000","172.21.15.87:6801/2633029569":"2024-09-18T07:11:03.573097+0000","172.21.15.87:6800/1735030430":"2024-09-18T07:11:32.590075+0000","172.21.15.87:6801/611048628":"2024-09-18T07:19:39.061872+0000","172.21.15.87:6800/2341884603":"2024-09-18T07:12:36.550496+0000","172.21.15.87:6801/1735030430":"2024-09-18T07:11:32.590075+0000","172.21.15.87:6800/2633029569":"2024-09-18T07:11:03.573097+0000","172.21.15.87:0/346024124":"2024-09-18T07:19:39.061872+0000","172.21.15.87:6801/3398669653":"2024-09-18T07:21:58.033791+0000","172.21.15.87:0/228221666":"2024-09-18T07:11:32.590075+0000","172.21.15.87:0/2357718754":"2024-09-18T07:12:36.550496+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T07:30:27.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.716+0000 7f3fb94d4640 1 -- 172.21.15.87:0/1901384008 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f3f9c06cb90 msgr2=0x7f3f9c06f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:27.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.716+0000 7f3fb94d4640 1 --2- 172.21.15.87:0/1901384008 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f3f9c06cb90 0x7f3f9c06f040 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3fa40043d0 tx=0x7f3fa4009da0 comp rx=0 tx=0).stop 2024-09-17T07:30:27.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.716+0000 7f3fb94d4640 1 -- 172.21.15.87:0/1901384008 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fb4101d40 msgr2=0x7f3fb410e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:27.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.716+0000 7f3fb94d4640 1 --2- 172.21.15.87:0/1901384008 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fb4101d40 0x7f3fb410e560 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3fa800b560 tx=0x7f3fa80090f0 comp rx=0 tx=0).stop 2024-09-17T07:30:27.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.716+0000 7f3fb94d4640 1 -- 172.21.15.87:0/1901384008 shutdown_connections 2024-09-17T07:30:27.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.716+0000 7f3fb94d4640 1 --2- 172.21.15.87:0/1901384008 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fb4101d40 0x7f3fb410e560 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:27.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.716+0000 7f3fb94d4640 1 --2- 172.21.15.87:0/1901384008 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f3f9c06cb90 0x7f3f9c06f040 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:27.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.716+0000 7f3fb94d4640 1 --2- 172.21.15.87:0/1901384008 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3fb41013a0 0x7f3fb410e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:27.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.716+0000 7f3fb94d4640 1 -- 172.21.15.87:0/1901384008 >> 172.21.15.87:0/1901384008 conn(0x7f3fb4071460 msgr2=0x7f3fb40fa8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:27.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.716+0000 7f3fb94d4640 1 -- 172.21.15.87:0/1901384008 shutdown_connections 2024-09-17T07:30:27.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.716+0000 7f3fb94d4640 1 -- 172.21.15.87:0/1901384008 wait complete. 2024-09-17T07:30:27.728 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T07:14:46.855001+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-09-17T07:17:13.907561+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-09-17T07:17:14.594643+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T07:30:27.729 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T07:30:27.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.825+0000 7ff76915d640 1 -- 172.21.15.87:0/2599822522 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7641024a0 msgr2=0x7ff764102870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:27.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.825+0000 7ff76915d640 1 --2- 172.21.15.87:0/2599822522 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7641024a0 0x7ff764102870 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff75c009c50 tx=0x7ff75c004d10 comp rx=0 tx=0).stop 2024-09-17T07:30:27.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.825+0000 7ff76915d640 1 -- 172.21.15.87:0/2599822522 shutdown_connections 2024-09-17T07:30:27.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.825+0000 7ff76915d640 1 --2- 172.21.15.87:0/2599822522 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff7640fc460 0x7ff7640fc8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:27.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.825+0000 7ff76915d640 1 --2- 172.21.15.87:0/2599822522 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7641024a0 0x7ff764102870 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:27.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.825+0000 7ff76915d640 1 -- 172.21.15.87:0/2599822522 >> 172.21.15.87:0/2599822522 conn(0x7ff7640f8040 msgr2=0x7ff7640fa450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:27.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.825+0000 7ff76915d640 1 -- 172.21.15.87:0/2599822522 shutdown_connections 2024-09-17T07:30:27.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.825+0000 7ff76915d640 1 -- 172.21.15.87:0/2599822522 wait complete. 2024-09-17T07:30:27.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.825+0000 7ff76915d640 1 Processor -- start 2024-09-17T07:30:27.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.825+0000 7ff76915d640 1 -- start start 2024-09-17T07:30:27.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.826+0000 7ff76915d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff7640fc460 0x7ff764112df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:27.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.826+0000 7ff76915d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7641024a0 0x7ff764113330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:27.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.826+0000 7ff76915d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff764113930 con 0x7ff7641024a0 2024-09-17T07:30:27.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.826+0000 7ff76915d640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff76410cf80 con 0x7ff7640fc460 2024-09-17T07:30:27.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.826+0000 7ff76259c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7641024a0 0x7ff764113330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:27.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.826+0000 7ff76259c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7641024a0 0x7ff764113330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46082/0 (socket says 172.21.15.87:46082) 2024-09-17T07:30:27.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.826+0000 7ff76259c640 1 -- 172.21.15.87:0/2258366887 learned_addr learned my addr 172.21.15.87:0/2258366887 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:30:27.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.826+0000 7ff762d9d640 1 --2- 172.21.15.87:0/2258366887 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff7640fc460 0x7ff764112df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:27.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.826+0000 7ff76259c640 1 -- 172.21.15.87:0/2258366887 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff7640fc460 msgr2=0x7ff764112df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:27.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.826+0000 7ff76259c640 1 --2- 172.21.15.87:0/2258366887 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff7640fc460 0x7ff764112df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:27.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.826+0000 7ff76259c640 1 -- 172.21.15.87:0/2258366887 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff75c0098b0 con 0x7ff7641024a0 2024-09-17T07:30:27.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.826+0000 7ff76259c640 1 --2- 172.21.15.87:0/2258366887 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7641024a0 0x7ff764113330 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff74c002a50 tx=0x7ff74c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:27.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.826+0000 7ff75b7fe640 1 -- 172.21.15.87:0/2258366887 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff74c007c30 con 0x7ff7641024a0 2024-09-17T07:30:27.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.826+0000 7ff76915d640 1 -- 172.21.15.87:0/2258366887 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff76410d260 con 0x7ff7641024a0 2024-09-17T07:30:27.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.826+0000 7ff75b7fe640 1 -- 172.21.15.87:0/2258366887 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7ff74c00f040 con 0x7ff7641024a0 2024-09-17T07:30:27.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.826+0000 7ff75b7fe640 1 -- 172.21.15.87:0/2258366887 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff74c00d990 con 0x7ff7641024a0 2024-09-17T07:30:27.829 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.826+0000 7ff76915d640 1 -- 172.21.15.87:0/2258366887 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff76410d800 con 0x7ff7641024a0 2024-09-17T07:30:27.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.827+0000 7ff76915d640 1 -- 172.21.15.87:0/2258366887 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7640fdba0 con 0x7ff7641024a0 2024-09-17T07:30:27.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.828+0000 7ff75b7fe640 1 -- 172.21.15.87:0/2258366887 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7ff74c00dc50 con 0x7ff7641024a0 2024-09-17T07:30:27.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.828+0000 7ff75b7fe640 1 --2- 172.21.15.87:0/2258366887 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7ff75006cb90 0x7ff75006f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:27.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.828+0000 7ff75b7fe640 1 -- 172.21.15.87:0/2258366887 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6496+0+0 (secure 0 0 0) 0x7ff74c08ba30 con 0x7ff7641024a0 2024-09-17T07:30:27.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.828+0000 7ff762d9d640 1 --2- 172.21.15.87:0/2258366887 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7ff75006cb90 0x7ff75006f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:27.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.829+0000 7ff762d9d640 1 --2- 172.21.15.87:0/2258366887 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7ff75006cb90 0x7ff75006f040 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff75c004a30 tx=0x7ff75c004d10 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:27.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.832+0000 7ff75b7fe640 1 -- 172.21.15.87:0/2258366887 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff74c08de60 con 0x7ff7641024a0 2024-09-17T07:30:27.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:27 smithi139 ceph-mon[79872]: from='client.? 172.21.15.87:0/2089266373' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T07:30:27.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.993+0000 7ff76915d640 1 -- 172.21.15.87:0/2258366887 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff764109300 con 0x7ff7641024a0 2024-09-17T07:30:27.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.994+0000 7ff75b7fe640 1 -- 172.21.15.87:0/2258366887 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff74c0559f0 con 0x7ff7641024a0 2024-09-17T07:30:27.995 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 1 2024-09-17T07:30:27.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.996+0000 7ff76915d640 1 -- 172.21.15.87:0/2258366887 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7ff75006cb90 msgr2=0x7ff75006f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:27.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.996+0000 7ff76915d640 1 --2- 172.21.15.87:0/2258366887 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7ff75006cb90 0x7ff75006f040 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff75c004a30 tx=0x7ff75c004d10 comp rx=0 tx=0).stop 2024-09-17T07:30:27.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.996+0000 7ff76915d640 1 -- 172.21.15.87:0/2258366887 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7641024a0 msgr2=0x7ff764113330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:27.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.996+0000 7ff76915d640 1 --2- 172.21.15.87:0/2258366887 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7641024a0 0x7ff764113330 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff74c002a50 tx=0x7ff74c004600 comp rx=0 tx=0).stop 2024-09-17T07:30:27.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.996+0000 7ff76915d640 1 -- 172.21.15.87:0/2258366887 shutdown_connections 2024-09-17T07:30:27.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.996+0000 7ff76915d640 1 --2- 172.21.15.87:0/2258366887 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7641024a0 0x7ff764113330 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:27.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.996+0000 7ff76915d640 1 --2- 172.21.15.87:0/2258366887 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7ff75006cb90 0x7ff75006f040 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:27.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.996+0000 7ff76915d640 1 --2- 172.21.15.87:0/2258366887 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff7640fc460 0x7ff764112df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:27.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.996+0000 7ff76915d640 1 -- 172.21.15.87:0/2258366887 >> 172.21.15.87:0/2258366887 conn(0x7ff7640f8040 msgr2=0x7ff7640f9a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:27.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.996+0000 7ff76915d640 1 -- 172.21.15.87:0/2258366887 shutdown_connections 2024-09-17T07:30:27.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:27.996+0000 7ff76915d640 1 -- 172.21.15.87:0/2258366887 wait complete. 2024-09-17T07:30:28.008 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-09-17T07:30:28.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.104+0000 7fe18468b640 1 -- 172.21.15.87:0/1917353598 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe17c0fb3a0 msgr2=0x7fe17c0fb7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:28.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.104+0000 7fe18468b640 1 --2- 172.21.15.87:0/1917353598 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe17c0fb3a0 0x7fe17c0fb7f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fe16c0048d0 tx=0x7fe16c009da0 comp rx=0 tx=0).stop 2024-09-17T07:30:28.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.104+0000 7fe18468b640 1 -- 172.21.15.87:0/1917353598 shutdown_connections 2024-09-17T07:30:28.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.104+0000 7fe18468b640 1 --2- 172.21.15.87:0/1917353598 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe17c0fb3a0 0x7fe17c0fb7f0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:28.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.104+0000 7fe18468b640 1 --2- 172.21.15.87:0/1917353598 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe17c1013c0 0x7fe17c101790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:28.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.104+0000 7fe18468b640 1 -- 172.21.15.87:0/1917353598 >> 172.21.15.87:0/1917353598 conn(0x7fe17c071360 msgr2=0x7fe17c071760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:28.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.104+0000 7fe18468b640 1 -- 172.21.15.87:0/1917353598 shutdown_connections 2024-09-17T07:30:28.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.104+0000 7fe18468b640 1 -- 172.21.15.87:0/1917353598 wait complete. 2024-09-17T07:30:28.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.105+0000 7fe18468b640 1 Processor -- start 2024-09-17T07:30:28.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.105+0000 7fe18468b640 1 -- start start 2024-09-17T07:30:28.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.105+0000 7fe18468b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe17c0fb3a0 0x7fe17c10df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:28.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.105+0000 7fe18468b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe17c1013c0 0x7fe17c10e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:28.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.105+0000 7fe18468b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c0655b0 con 0x7fe17c0fb3a0 2024-09-17T07:30:28.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.105+0000 7fe18468b640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c10e9e0 con 0x7fe17c1013c0 2024-09-17T07:30:28.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.105+0000 7fe182427640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe17c0fb3a0 0x7fe17c10df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:28.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.105+0000 7fe182427640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe17c0fb3a0 0x7fe17c10df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46098/0 (socket says 172.21.15.87:46098) 2024-09-17T07:30:28.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.105+0000 7fe182427640 1 -- 172.21.15.87:0/2041056838 learned_addr learned my addr 172.21.15.87:0/2041056838 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:30:28.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.105+0000 7fe181c26640 1 --2- 172.21.15.87:0/2041056838 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe17c1013c0 0x7fe17c10e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:28.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.105+0000 7fe182427640 1 -- 172.21.15.87:0/2041056838 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe17c1013c0 msgr2=0x7fe17c10e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:28.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.105+0000 7fe182427640 1 --2- 172.21.15.87:0/2041056838 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe17c1013c0 0x7fe17c10e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:28.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.105+0000 7fe182427640 1 -- 172.21.15.87:0/2041056838 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe16c005040 con 0x7fe17c0fb3a0 2024-09-17T07:30:28.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.105+0000 7fe181c26640 1 --2- 172.21.15.87:0/2041056838 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe17c1013c0 0x7fe17c10e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T07:30:28.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.105+0000 7fe182427640 1 --2- 172.21.15.87:0/2041056838 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe17c0fb3a0 0x7fe17c10df30 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe17800c830 tx=0x7fe178004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:28.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.106+0000 7fe172ffd640 1 -- 172.21.15.87:0/2041056838 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe17800a850 con 0x7fe17c0fb3a0 2024-09-17T07:30:28.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.106+0000 7fe18468b640 1 -- 172.21.15.87:0/2041056838 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe17c10ecc0 con 0x7fe17c0fb3a0 2024-09-17T07:30:28.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.106+0000 7fe172ffd640 1 -- 172.21.15.87:0/2041056838 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fe17800ae30 con 0x7fe17c0fb3a0 2024-09-17T07:30:28.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.106+0000 7fe172ffd640 1 -- 172.21.15.87:0/2041056838 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1780113a0 con 0x7fe17c0fb3a0 2024-09-17T07:30:28.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.106+0000 7fe18468b640 1 -- 172.21.15.87:0/2041056838 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe17c1172d0 con 0x7fe17c0fb3a0 2024-09-17T07:30:28.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.107+0000 7fe18468b640 1 -- 172.21.15.87:0/2041056838 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe17c0fca80 con 0x7fe17c0fb3a0 2024-09-17T07:30:28.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.107+0000 7fe172ffd640 1 -- 172.21.15.87:0/2041056838 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fe178012400 con 0x7fe17c0fb3a0 2024-09-17T07:30:28.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.108+0000 7fe172ffd640 1 --2- 172.21.15.87:0/2041056838 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fe16806cba0 0x7fe16806f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:28.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.108+0000 7fe172ffd640 1 -- 172.21.15.87:0/2041056838 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fe17808c370 con 0x7fe17c0fb3a0 2024-09-17T07:30:28.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.108+0000 7fe181c26640 1 --2- 172.21.15.87:0/2041056838 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fe16806cba0 0x7fe16806f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:28.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.109+0000 7fe181c26640 1 --2- 172.21.15.87:0/2041056838 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fe16806cba0 0x7fe16806f050 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe17c064e00 tx=0x7fe16c035040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:28.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.112+0000 7fe172ffd640 1 -- 172.21.15.87:0/2041056838 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe178056330 con 0x7fe17c0fb3a0 2024-09-17T07:30:28.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.275+0000 7fe18468b640 1 -- 172.21.15.87:0/2041056838 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7fe17c04bf60 con 0x7fe17c0fb3a0 2024-09-17T07:30:28.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.275+0000 7fe172ffd640 1 -- 172.21.15.87:0/2041056838 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v82) v1 ==== 107+0+11 (secure 0 0 0) 0x7fe178059950 con 0x7fe17c0fb3a0 2024-09-17T07:30:28.276 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2024-09-17T07:30:28.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.277+0000 7fe18468b640 1 -- 172.21.15.87:0/2041056838 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fe16806cba0 msgr2=0x7fe16806f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:28.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.277+0000 7fe18468b640 1 --2- 172.21.15.87:0/2041056838 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fe16806cba0 0x7fe16806f050 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe17c064e00 tx=0x7fe16c035040 comp rx=0 tx=0).stop 2024-09-17T07:30:28.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.277+0000 7fe18468b640 1 -- 172.21.15.87:0/2041056838 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe17c0fb3a0 msgr2=0x7fe17c10df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:28.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.277+0000 7fe18468b640 1 --2- 172.21.15.87:0/2041056838 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe17c0fb3a0 0x7fe17c10df30 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe17800c830 tx=0x7fe178004430 comp rx=0 tx=0).stop 2024-09-17T07:30:28.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.277+0000 7fe18468b640 1 -- 172.21.15.87:0/2041056838 shutdown_connections 2024-09-17T07:30:28.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.277+0000 7fe18468b640 1 --2- 172.21.15.87:0/2041056838 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fe16806cba0 0x7fe16806f050 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:28.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.277+0000 7fe18468b640 1 --2- 172.21.15.87:0/2041056838 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe17c1013c0 0x7fe17c10e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:28.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.277+0000 7fe18468b640 1 --2- 172.21.15.87:0/2041056838 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe17c0fb3a0 0x7fe17c10df30 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:28.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.277+0000 7fe18468b640 1 -- 172.21.15.87:0/2041056838 >> 172.21.15.87:0/2041056838 conn(0x7fe17c071360 msgr2=0x7fe17c1040b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:28.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.277+0000 7fe18468b640 1 -- 172.21.15.87:0/2041056838 shutdown_connections 2024-09-17T07:30:28.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.277+0000 7fe18468b640 1 -- 172.21.15.87:0/2041056838 wait complete. 2024-09-17T07:30:28.288 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-09-17T07:30:28.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.385+0000 7f940beb8640 1 -- 172.21.15.87:0/3413297245 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9404101ee0 msgr2=0x7f94040fb5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:28.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.385+0000 7f940beb8640 1 --2- 172.21.15.87:0/3413297245 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9404101ee0 0x7f94040fb5a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f93f40048d0 tx=0x7f93f4009da0 comp rx=0 tx=0).stop 2024-09-17T07:30:28.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.385+0000 7f940beb8640 1 -- 172.21.15.87:0/3413297245 shutdown_connections 2024-09-17T07:30:28.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.385+0000 7f940beb8640 1 --2- 172.21.15.87:0/3413297245 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9404101ee0 0x7f94040fb5a0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:28.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.385+0000 7f940beb8640 1 --2- 172.21.15.87:0/3413297245 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9404101540 0x7f9404101910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:28.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.385+0000 7f940beb8640 1 -- 172.21.15.87:0/3413297245 >> 172.21.15.87:0/3413297245 conn(0x7f94040f7100 msgr2=0x7f94040f9510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:28.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.385+0000 7f940beb8640 1 -- 172.21.15.87:0/3413297245 shutdown_connections 2024-09-17T07:30:28.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.386+0000 7f940beb8640 1 -- 172.21.15.87:0/3413297245 wait complete. 2024-09-17T07:30:28.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.386+0000 7f940beb8640 1 Processor -- start 2024-09-17T07:30:28.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.386+0000 7f940beb8640 1 -- start start 2024-09-17T07:30:28.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.386+0000 7f940beb8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9404101540 0x7f9404113100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:28.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.386+0000 7f940beb8640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9404101ee0 0x7f9404113640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:28.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.386+0000 7f940beb8640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9404113cd0 con 0x7f9404101540 2024-09-17T07:30:28.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.386+0000 7f940beb8640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f940410d290 con 0x7f9404101ee0 2024-09-17T07:30:28.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.386+0000 7f9409c54640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9404101540 0x7f9404113100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:28.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.386+0000 7f9409c54640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9404101540 0x7f9404113100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46118/0 (socket says 172.21.15.87:46118) 2024-09-17T07:30:28.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.386+0000 7f9409c54640 1 -- 172.21.15.87:0/2379948323 learned_addr learned my addr 172.21.15.87:0/2379948323 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:30:28.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.386+0000 7f9409c54640 1 -- 172.21.15.87:0/2379948323 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9404101ee0 msgr2=0x7f9404113640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:28.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.386+0000 7f9409c54640 1 --2- 172.21.15.87:0/2379948323 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9404101ee0 0x7f9404113640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:28.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.387+0000 7f9409c54640 1 -- 172.21.15.87:0/2379948323 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93f4005040 con 0x7f9404101540 2024-09-17T07:30:28.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.387+0000 7f9409c54640 1 --2- 172.21.15.87:0/2379948323 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9404101540 0x7f9404113100 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f940000b790 tx=0x7f94000091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:28.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.387+0000 7f93fa7fc640 1 -- 172.21.15.87:0/2379948323 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f940000c700 con 0x7f9404101540 2024-09-17T07:30:28.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.387+0000 7f93fa7fc640 1 -- 172.21.15.87:0/2379948323 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f940000cce0 con 0x7f9404101540 2024-09-17T07:30:28.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.387+0000 7f940beb8640 1 -- 172.21.15.87:0/2379948323 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f940410d570 con 0x7f9404101540 2024-09-17T07:30:28.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.387+0000 7f93fa7fc640 1 -- 172.21.15.87:0/2379948323 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9400015e10 con 0x7f9404101540 2024-09-17T07:30:28.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.387+0000 7f940beb8640 1 -- 172.21.15.87:0/2379948323 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f940410da90 con 0x7f9404101540 2024-09-17T07:30:28.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.388+0000 7f940beb8640 1 -- 172.21.15.87:0/2379948323 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94040fccc0 con 0x7f9404101540 2024-09-17T07:30:28.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.388+0000 7f93fa7fc640 1 -- 172.21.15.87:0/2379948323 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f9400012070 con 0x7f9404101540 2024-09-17T07:30:28.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.389+0000 7f93fa7fc640 1 --2- 172.21.15.87:0/2379948323 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f93f006cba0 0x7f93f006f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:28.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.389+0000 7f93fa7fc640 1 -- 172.21.15.87:0/2379948323 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f940008bbe0 con 0x7f9404101540 2024-09-17T07:30:28.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.389+0000 7f9409453640 1 --2- 172.21.15.87:0/2379948323 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f93f006cba0 0x7f93f006f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:28.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.389+0000 7f9409453640 1 --2- 172.21.15.87:0/2379948323 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f93f006cba0 0x7f93f006f050 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f93f4009ac0 tx=0x7f93f4009da0 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:28.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.393+0000 7f93fa7fc640 1 -- 172.21.15.87:0/2379948323 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f9400055c20 con 0x7f9404101540 2024-09-17T07:30:28.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.555+0000 7f940beb8640 1 -- 172.21.15.87:0/2379948323 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f9404108520 con 0x7f9404101540 2024-09-17T07:30:28.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.555+0000 7f93fa7fc640 1 -- 172.21.15.87:0/2379948323 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v82) v1 ==== 107+0+11 (secure 0 0 0) 0x7f9400059240 con 0x7f9404101540 2024-09-17T07:30:28.556 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2024-09-17T07:30:28.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.557+0000 7f940beb8640 1 -- 172.21.15.87:0/2379948323 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f93f006cba0 msgr2=0x7f93f006f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:28.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.557+0000 7f940beb8640 1 --2- 172.21.15.87:0/2379948323 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f93f006cba0 0x7f93f006f050 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f93f4009ac0 tx=0x7f93f4009da0 comp rx=0 tx=0).stop 2024-09-17T07:30:28.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.557+0000 7f940beb8640 1 -- 172.21.15.87:0/2379948323 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9404101540 msgr2=0x7f9404113100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:28.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.557+0000 7f940beb8640 1 --2- 172.21.15.87:0/2379948323 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9404101540 0x7f9404113100 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f940000b790 tx=0x7f94000091d0 comp rx=0 tx=0).stop 2024-09-17T07:30:28.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.557+0000 7f940beb8640 1 -- 172.21.15.87:0/2379948323 shutdown_connections 2024-09-17T07:30:28.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.557+0000 7f940beb8640 1 --2- 172.21.15.87:0/2379948323 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f93f006cba0 0x7f93f006f050 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:28.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.557+0000 7f940beb8640 1 --2- 172.21.15.87:0/2379948323 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9404101ee0 0x7f9404113640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:28.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.557+0000 7f940beb8640 1 --2- 172.21.15.87:0/2379948323 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9404101540 0x7f9404113100 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:28.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.557+0000 7f940beb8640 1 -- 172.21.15.87:0/2379948323 >> 172.21.15.87:0/2379948323 conn(0x7f94040f7100 msgr2=0x7f94040f8270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:28.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.557+0000 7f940beb8640 1 -- 172.21.15.87:0/2379948323 shutdown_connections 2024-09-17T07:30:28.559 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.557+0000 7f940beb8640 1 -- 172.21.15.87:0/2379948323 wait complete. 2024-09-17T07:30:28.568 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:28 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/1901384008' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-17T07:30:28.568 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:28 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/2258366887' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-17T07:30:28.568 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:28 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:30:28.568 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:28 smithi087 ceph-mon[90982]: pgmap v293: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:30:28.568 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:28 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/2041056838' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-09-17T07:30:28.569 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T07:30:28.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.663+0000 7f3d4dd9d640 1 -- 172.21.15.87:0/179912862 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d48101320 msgr2=0x7f3d481016f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:28.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.663+0000 7f3d4dd9d640 1 --2- 172.21.15.87:0/179912862 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d48101320 0x7f3d481016f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3d380048d0 tx=0x7f3d38009da0 comp rx=0 tx=0).stop 2024-09-17T07:30:28.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.663+0000 7f3d4dd9d640 1 -- 172.21.15.87:0/179912862 shutdown_connections 2024-09-17T07:30:28.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.663+0000 7f3d4dd9d640 1 --2- 172.21.15.87:0/179912862 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3d48101cc0 0x7f3d480fb350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:28.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.663+0000 7f3d4dd9d640 1 --2- 172.21.15.87:0/179912862 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d48101320 0x7f3d481016f0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:28.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.663+0000 7f3d4dd9d640 1 -- 172.21.15.87:0/179912862 >> 172.21.15.87:0/179912862 conn(0x7f3d480f6eb0 msgr2=0x7f3d480f92c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:28.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.663+0000 7f3d4dd9d640 1 -- 172.21.15.87:0/179912862 shutdown_connections 2024-09-17T07:30:28.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.663+0000 7f3d4dd9d640 1 -- 172.21.15.87:0/179912862 wait complete. 2024-09-17T07:30:28.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.663+0000 7f3d4dd9d640 1 Processor -- start 2024-09-17T07:30:28.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.664+0000 7f3d4dd9d640 1 -- start start 2024-09-17T07:30:28.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.664+0000 7f3d4dd9d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3d48101320 0x7f3d4810df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:28.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.664+0000 7f3d4dd9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d48101cc0 0x7f3d4810e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:28.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.664+0000 7f3d4dd9d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d48066770 con 0x7f3d48101cc0 2024-09-17T07:30:28.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.664+0000 7f3d4dd9d640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4810ea00 con 0x7f3d48101320 2024-09-17T07:30:28.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.664+0000 7f3d46ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d48101cc0 0x7f3d4810e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:28.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.664+0000 7f3d46ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d48101cc0 0x7f3d4810e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46136/0 (socket says 172.21.15.87:46136) 2024-09-17T07:30:28.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.664+0000 7f3d46ffd640 1 -- 172.21.15.87:0/506100396 learned_addr learned my addr 172.21.15.87:0/506100396 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:30:28.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.664+0000 7f3d477fe640 1 --2- 172.21.15.87:0/506100396 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3d48101320 0x7f3d4810df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:28.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.664+0000 7f3d46ffd640 1 -- 172.21.15.87:0/506100396 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3d48101320 msgr2=0x7f3d4810df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:28.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.664+0000 7f3d46ffd640 1 --2- 172.21.15.87:0/506100396 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3d48101320 0x7f3d4810df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:28.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.664+0000 7f3d46ffd640 1 -- 172.21.15.87:0/506100396 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d38005040 con 0x7f3d48101cc0 2024-09-17T07:30:28.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.664+0000 7f3d477fe640 1 --2- 172.21.15.87:0/506100396 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3d48101320 0x7f3d4810df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T07:30:28.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.664+0000 7f3d46ffd640 1 --2- 172.21.15.87:0/506100396 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d48101cc0 0x7f3d4810e490 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c002a80 tx=0x7f3d3c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:28.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.664+0000 7f3d2ffff640 1 -- 172.21.15.87:0/506100396 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d3c007c30 con 0x7f3d48101cc0 2024-09-17T07:30:28.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.664+0000 7f3d4dd9d640 1 -- 172.21.15.87:0/506100396 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d4810ece0 con 0x7f3d48101cc0 2024-09-17T07:30:28.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.665+0000 7f3d2ffff640 1 -- 172.21.15.87:0/506100396 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f3d3c00f040 con 0x7f3d48101cc0 2024-09-17T07:30:28.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.665+0000 7f3d2ffff640 1 -- 172.21.15.87:0/506100396 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d3c0094d0 con 0x7f3d48101cc0 2024-09-17T07:30:28.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.665+0000 7f3d4dd9d640 1 -- 172.21.15.87:0/506100396 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d48117270 con 0x7f3d48101cc0 2024-09-17T07:30:28.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.666+0000 7f3d4dd9d640 1 -- 172.21.15.87:0/506100396 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d480fca90 con 0x7f3d48101cc0 2024-09-17T07:30:28.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.666+0000 7f3d2ffff640 1 -- 172.21.15.87:0/506100396 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f3d3c009630 con 0x7f3d48101cc0 2024-09-17T07:30:28.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.667+0000 7f3d2ffff640 1 --2- 172.21.15.87:0/506100396 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f3d3006cb90 0x7f3d3006f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:28.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.667+0000 7f3d2ffff640 1 -- 172.21.15.87:0/506100396 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f3d3c08ba70 con 0x7f3d48101cc0 2024-09-17T07:30:28.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.667+0000 7f3d477fe640 1 --2- 172.21.15.87:0/506100396 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f3d3006cb90 0x7f3d3006f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:28.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.667+0000 7f3d477fe640 1 --2- 172.21.15.87:0/506100396 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f3d3006cb90 0x7f3d3006f040 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3d38007ac0 tx=0x7f3d38035040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:28.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.671+0000 7f3d2ffff640 1 -- 172.21.15.87:0/506100396 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f3d3c055a30 con 0x7f3d48101cc0 2024-09-17T07:30:28.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.864+0000 7f3d4dd9d640 1 -- 172.21.15.87:0/506100396 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3d4804bf60 con 0x7f3d48101cc0 2024-09-17T07:30:28.866 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.865+0000 7f3d2ffff640 1 -- 172.21.15.87:0/506100396 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+4864 (secure 0 0 0) 0x7f3d3c059050 con 0x7f3d48101cc0 2024-09-17T07:30:28.866 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:30:28.866 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":43,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":43,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T07:17:15.368053+0000","modified":"2024-09-17T07:27:41.863112+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34412,"mds_1":34444},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34412":{"gid":34412,"name":"cephfs.smithi087.vvbzss","rank":0,"incarnation":32,"state":"up:active","state_seq":8,"addr":"172.21.15.87:6827/1050918039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1050918039},{"type":"v1","addr":"172.21.15.87:6827","nonce":1050918039}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_34444":{"gid":34444,"name":"cephfs.smithi087.tjhpcs","rank":1,"incarnation":42,"state":"up:active","state_seq":11,"addr":"172.21.15.87:6829/2375971201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2375971201},{"type":"v1","addr":"172.21.15.87:6829","nonce":2375971201}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_44325":{"gid":44325,"name":"cephfs.smithi139.gnwonz","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6825/1289261341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":1289261341},{"type":"v1","addr":"172.21.15.139:6825","nonce":1289261341}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_44347":{"gid":44347,"name":"cephfs.smithi139.ftvinf","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6827/1126774601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":1126774601},{"type":"v1","addr":"172.21.15.139:6827","nonce":1126774601}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-17T07:30:28.866 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 43 2024-09-17T07:30:28.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:28 smithi139 ceph-mon[79872]: from='client.? 172.21.15.87:0/1901384008' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-17T07:30:28.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:28 smithi139 ceph-mon[79872]: from='client.? 172.21.15.87:0/2258366887' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-17T07:30:28.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:28 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:30:28.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:28 smithi139 ceph-mon[79872]: pgmap v293: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:30:28.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:28 smithi139 ceph-mon[79872]: from='client.? 172.21.15.87:0/2041056838' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-09-17T07:30:28.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.866+0000 7f3d4dd9d640 1 -- 172.21.15.87:0/506100396 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f3d3006cb90 msgr2=0x7f3d3006f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:28.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.866+0000 7f3d4dd9d640 1 --2- 172.21.15.87:0/506100396 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f3d3006cb90 0x7f3d3006f040 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3d38007ac0 tx=0x7f3d38035040 comp rx=0 tx=0).stop 2024-09-17T07:30:28.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.866+0000 7f3d4dd9d640 1 -- 172.21.15.87:0/506100396 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d48101cc0 msgr2=0x7f3d4810e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:28.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.866+0000 7f3d4dd9d640 1 --2- 172.21.15.87:0/506100396 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d48101cc0 0x7f3d4810e490 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c002a80 tx=0x7f3d3c004600 comp rx=0 tx=0).stop 2024-09-17T07:30:28.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.867+0000 7f3d4dd9d640 1 -- 172.21.15.87:0/506100396 shutdown_connections 2024-09-17T07:30:28.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.867+0000 7f3d4dd9d640 1 --2- 172.21.15.87:0/506100396 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d48101cc0 0x7f3d4810e490 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:28.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.867+0000 7f3d4dd9d640 1 --2- 172.21.15.87:0/506100396 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f3d3006cb90 0x7f3d3006f040 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:28.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.867+0000 7f3d4dd9d640 1 --2- 172.21.15.87:0/506100396 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3d48101320 0x7f3d4810df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:28.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.867+0000 7f3d4dd9d640 1 -- 172.21.15.87:0/506100396 >> 172.21.15.87:0/506100396 conn(0x7f3d480f6eb0 msgr2=0x7f3d480f8080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:28.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.867+0000 7f3d4dd9d640 1 -- 172.21.15.87:0/506100396 shutdown_connections 2024-09-17T07:30:28.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.867+0000 7f3d4dd9d640 1 -- 172.21.15.87:0/506100396 wait complete. 2024-09-17T07:30:28.878 DEBUG:tasks.fs:checking fs fscid=1,name=cephfs state = {'epoch': 19, 'max_mds': 2, 'flags': 50} 2024-09-17T07:30:28.879 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 20 2024-09-17T07:30:28.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.972+0000 7f9a3706f640 1 -- 172.21.15.87:0/817965236 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a301013c0 msgr2=0x7f9a30101790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:28.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.972+0000 7f9a3706f640 1 --2- 172.21.15.87:0/817965236 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a301013c0 0x7f9a30101790 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9a200048d0 tx=0x7f9a20009da0 comp rx=0 tx=0).stop 2024-09-17T07:30:28.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.973+0000 7f9a3706f640 1 -- 172.21.15.87:0/817965236 shutdown_connections 2024-09-17T07:30:28.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.973+0000 7f9a3706f640 1 --2- 172.21.15.87:0/817965236 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9a300fb3a0 0x7f9a300fb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:28.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.973+0000 7f9a3706f640 1 --2- 172.21.15.87:0/817965236 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a301013c0 0x7f9a30101790 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:28.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.973+0000 7f9a3706f640 1 -- 172.21.15.87:0/817965236 >> 172.21.15.87:0/817965236 conn(0x7f9a30071360 msgr2=0x7f9a30071760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:28.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.973+0000 7f9a3706f640 1 -- 172.21.15.87:0/817965236 shutdown_connections 2024-09-17T07:30:28.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.973+0000 7f9a3706f640 1 -- 172.21.15.87:0/817965236 wait complete. 2024-09-17T07:30:28.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.973+0000 7f9a3706f640 1 Processor -- start 2024-09-17T07:30:28.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.973+0000 7f9a3706f640 1 -- start start 2024-09-17T07:30:28.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.973+0000 7f9a3706f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9a300fb3a0 0x7f9a3010df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:28.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.973+0000 7f9a3706f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a301013c0 0x7f9a3010e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:28.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.973+0000 7f9a3706f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a300655b0 con 0x7f9a301013c0 2024-09-17T07:30:28.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.973+0000 7f9a3706f640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3010ea20 con 0x7f9a300fb3a0 2024-09-17T07:30:28.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.973+0000 7f9a2ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a301013c0 0x7f9a3010e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:28.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.974+0000 7f9a2ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a301013c0 0x7f9a3010e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46148/0 (socket says 172.21.15.87:46148) 2024-09-17T07:30:28.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.974+0000 7f9a2ffff640 1 -- 172.21.15.87:0/3060809366 learned_addr learned my addr 172.21.15.87:0/3060809366 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:30:28.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.974+0000 7f9a34e0b640 1 --2- 172.21.15.87:0/3060809366 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9a300fb3a0 0x7f9a3010df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:28.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.974+0000 7f9a2ffff640 1 -- 172.21.15.87:0/3060809366 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9a300fb3a0 msgr2=0x7f9a3010df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:28.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.974+0000 7f9a2ffff640 1 --2- 172.21.15.87:0/3060809366 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9a300fb3a0 0x7f9a3010df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:28.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.974+0000 7f9a2ffff640 1 -- 172.21.15.87:0/3060809366 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a20005040 con 0x7f9a301013c0 2024-09-17T07:30:28.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.974+0000 7f9a2ffff640 1 --2- 172.21.15.87:0/3060809366 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a301013c0 0x7f9a3010e4b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f9a24002a50 tx=0x7f9a24004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:28.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.974+0000 7f9a2d7fa640 1 -- 172.21.15.87:0/3060809366 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a24007c30 con 0x7f9a301013c0 2024-09-17T07:30:28.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.974+0000 7f9a2d7fa640 1 -- 172.21.15.87:0/3060809366 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f9a2400f040 con 0x7f9a301013c0 2024-09-17T07:30:28.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.974+0000 7f9a3706f640 1 -- 172.21.15.87:0/3060809366 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a3010ed00 con 0x7f9a301013c0 2024-09-17T07:30:28.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.974+0000 7f9a2d7fa640 1 -- 172.21.15.87:0/3060809366 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a2400d990 con 0x7f9a301013c0 2024-09-17T07:30:28.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.974+0000 7f9a3706f640 1 -- 172.21.15.87:0/3060809366 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a30117310 con 0x7f9a301013c0 2024-09-17T07:30:28.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.975+0000 7f9a3706f640 1 -- 172.21.15.87:0/3060809366 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a300fca80 con 0x7f9a301013c0 2024-09-17T07:30:28.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.975+0000 7f9a2d7fa640 1 -- 172.21.15.87:0/3060809366 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f9a2400dc00 con 0x7f9a301013c0 2024-09-17T07:30:28.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.976+0000 7f9a2d7fa640 1 --2- 172.21.15.87:0/3060809366 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f9a1806cb90 0x7f9a1806f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:28.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.976+0000 7f9a34e0b640 1 --2- 172.21.15.87:0/3060809366 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f9a1806cb90 0x7f9a1806f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:28.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.976+0000 7f9a2d7fa640 1 -- 172.21.15.87:0/3060809366 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f9a2408b930 con 0x7f9a301013c0 2024-09-17T07:30:28.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.977+0000 7f9a34e0b640 1 --2- 172.21.15.87:0/3060809366 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f9a1806cb90 0x7f9a1806f040 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9a2002ab40 tx=0x7f9a20009da0 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:28.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:28.980+0000 7f9a2d7fa640 1 -- 172.21.15.87:0/3060809366 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f9a24055970 con 0x7f9a301013c0 2024-09-17T07:30:29.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.177+0000 7f9a3706f640 1 -- 172.21.15.87:0/3060809366 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 20, "format": "json"} v 0) v1 -- 0x7f9a30117550 con 0x7f9a301013c0 2024-09-17T07:30:29.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.178+0000 7f9a2d7fa640 1 -- 172.21.15.87:0/3060809366 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 20, "format": "json"}]=0 dumped fsmap epoch 20 v43) v1 ==== 107+0+4863 (secure 0 0 0) 0x7f9a24058f90 con 0x7f9a301013c0 2024-09-17T07:30:29.179 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:30:29.179 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T07:17:15.368053+0000","modified":"2024-09-17T07:19:06.657406+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":44,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14478,"mds_1":24243},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14478":{"gid":14478,"name":"cephfs.smithi087.tjhpcs","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.87:6829/2255237099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2255237099},{"type":"v1","addr":"172.21.15.87:6829","nonce":2255237099}]},"join_fscid":1,"export_targets":[1],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14490":{"gid":14490,"name":"cephfs.smithi087.vvbzss","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6827/4022268353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":4022268353},{"type":"v1","addr":"172.21.15.87:6827","nonce":4022268353}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24243":{"gid":24243,"name":"cephfs.smithi139.gnwonz","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.139:6825/3946792151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":3946792151},{"type":"v1","addr":"172.21.15.139:6825","nonce":3946792151}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24253":{"gid":24253,"name":"cephfs.smithi139.ftvinf","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.139:6827/3292073323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":3292073323},{"type":"v1","addr":"172.21.15.139:6827","nonce":3292073323}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-17T07:30:29.179 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 20 2024-09-17T07:30:29.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.180+0000 7f9a3706f640 1 -- 172.21.15.87:0/3060809366 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f9a1806cb90 msgr2=0x7f9a1806f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:29.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.180+0000 7f9a3706f640 1 --2- 172.21.15.87:0/3060809366 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f9a1806cb90 0x7f9a1806f040 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9a2002ab40 tx=0x7f9a20009da0 comp rx=0 tx=0).stop 2024-09-17T07:30:29.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.180+0000 7f9a3706f640 1 -- 172.21.15.87:0/3060809366 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a301013c0 msgr2=0x7f9a3010e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:29.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.180+0000 7f9a3706f640 1 --2- 172.21.15.87:0/3060809366 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a301013c0 0x7f9a3010e4b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f9a24002a50 tx=0x7f9a24004600 comp rx=0 tx=0).stop 2024-09-17T07:30:29.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.180+0000 7f9a3706f640 1 -- 172.21.15.87:0/3060809366 shutdown_connections 2024-09-17T07:30:29.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.180+0000 7f9a3706f640 1 --2- 172.21.15.87:0/3060809366 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a301013c0 0x7f9a3010e4b0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:29.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.180+0000 7f9a3706f640 1 --2- 172.21.15.87:0/3060809366 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f9a1806cb90 0x7f9a1806f040 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:29.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.180+0000 7f9a3706f640 1 --2- 172.21.15.87:0/3060809366 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9a300fb3a0 0x7f9a3010df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:29.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.180+0000 7f9a3706f640 1 -- 172.21.15.87:0/3060809366 >> 172.21.15.87:0/3060809366 conn(0x7f9a30071360 msgr2=0x7f9a301040b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:29.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.180+0000 7f9a3706f640 1 -- 172.21.15.87:0/3060809366 shutdown_connections 2024-09-17T07:30:29.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.180+0000 7f9a3706f640 1 -- 172.21.15.87:0/3060809366 wait complete. 2024-09-17T07:30:29.192 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 21 2024-09-17T07:30:29.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.287+0000 7fb45219d640 1 -- 172.21.15.87:0/535824900 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb44c0fb3a0 msgr2=0x7fb44c0fb7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:29.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.287+0000 7fb45219d640 1 --2- 172.21.15.87:0/535824900 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb44c0fb3a0 0x7fb44c0fb7f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb4400048d0 tx=0x7fb440009da0 comp rx=0 tx=0).stop 2024-09-17T07:30:29.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.287+0000 7fb45219d640 1 -- 172.21.15.87:0/535824900 shutdown_connections 2024-09-17T07:30:29.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.287+0000 7fb45219d640 1 --2- 172.21.15.87:0/535824900 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb44c0fb3a0 0x7fb44c0fb7f0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:29.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.287+0000 7fb45219d640 1 --2- 172.21.15.87:0/535824900 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb44c1013c0 0x7fb44c101790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:29.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.287+0000 7fb45219d640 1 -- 172.21.15.87:0/535824900 >> 172.21.15.87:0/535824900 conn(0x7fb44c071360 msgr2=0x7fb44c071760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:29.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.287+0000 7fb45219d640 1 -- 172.21.15.87:0/535824900 shutdown_connections 2024-09-17T07:30:29.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.287+0000 7fb45219d640 1 -- 172.21.15.87:0/535824900 wait complete. 2024-09-17T07:30:29.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.287+0000 7fb45219d640 1 Processor -- start 2024-09-17T07:30:29.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.288+0000 7fb45219d640 1 -- start start 2024-09-17T07:30:29.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.288+0000 7fb45219d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb44c0fb3a0 0x7fb44c10dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:29.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.288+0000 7fb45219d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb44c1013c0 0x7fb44c10e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:29.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.288+0000 7fb45219d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb44c10ea40 con 0x7fb44c0fb3a0 2024-09-17T07:30:29.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.288+0000 7fb45219d640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb44c10ebb0 con 0x7fb44c1013c0 2024-09-17T07:30:29.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.288+0000 7fb44b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb44c0fb3a0 0x7fb44c10dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:29.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.288+0000 7fb44b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb44c0fb3a0 0x7fb44c10dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46166/0 (socket says 172.21.15.87:46166) 2024-09-17T07:30:29.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.288+0000 7fb44b7fe640 1 -- 172.21.15.87:0/2967290409 learned_addr learned my addr 172.21.15.87:0/2967290409 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:30:29.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.288+0000 7fb44b7fe640 1 -- 172.21.15.87:0/2967290409 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb44c1013c0 msgr2=0x7fb44c10e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:29.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.288+0000 7fb44b7fe640 1 --2- 172.21.15.87:0/2967290409 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb44c1013c0 0x7fb44c10e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:29.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.288+0000 7fb44b7fe640 1 -- 172.21.15.87:0/2967290409 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb440005040 con 0x7fb44c0fb3a0 2024-09-17T07:30:29.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.288+0000 7fb44b7fe640 1 --2- 172.21.15.87:0/2967290409 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb44c0fb3a0 0x7fb44c10dfc0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb43c00b790 tx=0x7fb43c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:29.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.289+0000 7fb433fff640 1 -- 172.21.15.87:0/2967290409 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb43c00c700 con 0x7fb44c0fb3a0 2024-09-17T07:30:29.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.289+0000 7fb433fff640 1 -- 172.21.15.87:0/2967290409 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fb43c00cce0 con 0x7fb44c0fb3a0 2024-09-17T07:30:29.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.289+0000 7fb45219d640 1 -- 172.21.15.87:0/2967290409 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb44c117030 con 0x7fb44c0fb3a0 2024-09-17T07:30:29.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.289+0000 7fb433fff640 1 -- 172.21.15.87:0/2967290409 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb43c015e10 con 0x7fb44c0fb3a0 2024-09-17T07:30:29.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.289+0000 7fb45219d640 1 -- 172.21.15.87:0/2967290409 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb44c117360 con 0x7fb44c0fb3a0 2024-09-17T07:30:29.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.290+0000 7fb45219d640 1 -- 172.21.15.87:0/2967290409 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb44c0fca80 con 0x7fb44c0fb3a0 2024-09-17T07:30:29.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.290+0000 7fb433fff640 1 -- 172.21.15.87:0/2967290409 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fb43c012070 con 0x7fb44c0fb3a0 2024-09-17T07:30:29.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.291+0000 7fb433fff640 1 --2- 172.21.15.87:0/2967290409 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fb43406cb90 0x7fb43406f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:29.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.291+0000 7fb433fff640 1 -- 172.21.15.87:0/2967290409 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fb43c08bc20 con 0x7fb44c0fb3a0 2024-09-17T07:30:29.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.291+0000 7fb44affd640 1 --2- 172.21.15.87:0/2967290409 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fb43406cb90 0x7fb43406f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:29.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.291+0000 7fb44affd640 1 --2- 172.21.15.87:0/2967290409 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fb43406cb90 0x7fb43406f040 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb44002a5e0 tx=0x7fb440009da0 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:29.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.295+0000 7fb433fff640 1 -- 172.21.15.87:0/2967290409 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb43c055c60 con 0x7fb44c0fb3a0 2024-09-17T07:30:29.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.490+0000 7fb45219d640 1 -- 172.21.15.87:0/2967290409 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 21, "format": "json"} v 0) v1 -- 0x7fb44c04bf60 con 0x7fb44c0fb3a0 2024-09-17T07:30:29.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.491+0000 7fb433fff640 1 -- 172.21.15.87:0/2967290409 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 21, "format": "json"}]=0 dumped fsmap epoch 21 v43) v1 ==== 107+0+4864 (secure 0 0 0) 0x7fb43c059280 con 0x7fb44c0fb3a0 2024-09-17T07:30:29.492 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:30:29.492 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T07:17:15.368053+0000","modified":"2024-09-17T07:20:37.142055+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":44,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14478,"mds_1":24243},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14478":{"gid":14478,"name":"cephfs.smithi087.tjhpcs","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.87:6829/2255237099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2255237099},{"type":"v1","addr":"172.21.15.87:6829","nonce":2255237099}]},"join_fscid":1,"export_targets":[1],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14490":{"gid":14490,"name":"cephfs.smithi087.vvbzss","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6827/4022268353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":4022268353},{"type":"v1","addr":"172.21.15.87:6827","nonce":4022268353}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24243":{"gid":24243,"name":"cephfs.smithi139.gnwonz","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.139:6825/3946792151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":3946792151},{"type":"v1","addr":"172.21.15.139:6825","nonce":3946792151}]},"join_fscid":1,"export_targets":[0],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24253":{"gid":24253,"name":"cephfs.smithi139.ftvinf","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.139:6827/3292073323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":3292073323},{"type":"v1","addr":"172.21.15.139:6827","nonce":3292073323}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-17T07:30:29.492 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 21 2024-09-17T07:30:29.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.493+0000 7fb45219d640 1 -- 172.21.15.87:0/2967290409 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fb43406cb90 msgr2=0x7fb43406f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:29.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.493+0000 7fb45219d640 1 --2- 172.21.15.87:0/2967290409 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fb43406cb90 0x7fb43406f040 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb44002a5e0 tx=0x7fb440009da0 comp rx=0 tx=0).stop 2024-09-17T07:30:29.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.493+0000 7fb45219d640 1 -- 172.21.15.87:0/2967290409 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb44c0fb3a0 msgr2=0x7fb44c10dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:29.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.493+0000 7fb45219d640 1 --2- 172.21.15.87:0/2967290409 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb44c0fb3a0 0x7fb44c10dfc0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb43c00b790 tx=0x7fb43c0091d0 comp rx=0 tx=0).stop 2024-09-17T07:30:29.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.493+0000 7fb45219d640 1 -- 172.21.15.87:0/2967290409 shutdown_connections 2024-09-17T07:30:29.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.493+0000 7fb45219d640 1 --2- 172.21.15.87:0/2967290409 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fb43406cb90 0x7fb43406f040 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:29.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.493+0000 7fb45219d640 1 --2- 172.21.15.87:0/2967290409 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb44c1013c0 0x7fb44c10e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:29.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.493+0000 7fb45219d640 1 --2- 172.21.15.87:0/2967290409 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb44c0fb3a0 0x7fb44c10dfc0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:29.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.493+0000 7fb45219d640 1 -- 172.21.15.87:0/2967290409 >> 172.21.15.87:0/2967290409 conn(0x7fb44c071360 msgr2=0x7fb44c1040b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:29.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.493+0000 7fb45219d640 1 -- 172.21.15.87:0/2967290409 shutdown_connections 2024-09-17T07:30:29.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.493+0000 7fb45219d640 1 -- 172.21.15.87:0/2967290409 wait complete. 2024-09-17T07:30:29.504 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 22 2024-09-17T07:30:29.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.599+0000 7f8354e3f640 1 -- 172.21.15.87:0/1419578522 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8350101d00 msgr2=0x7f83500fb390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:29.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.599+0000 7f8354e3f640 1 --2- 172.21.15.87:0/1419578522 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8350101d00 0x7f83500fb390 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f83380048d0 tx=0x7f8338009da0 comp rx=0 tx=0).stop 2024-09-17T07:30:29.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.599+0000 7f8354e3f640 1 -- 172.21.15.87:0/1419578522 shutdown_connections 2024-09-17T07:30:29.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.599+0000 7f8354e3f640 1 --2- 172.21.15.87:0/1419578522 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8350101d00 0x7f83500fb390 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:29.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.599+0000 7f8354e3f640 1 --2- 172.21.15.87:0/1419578522 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8350101360 0x7f8350101730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:29.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.599+0000 7f8354e3f640 1 -- 172.21.15.87:0/1419578522 >> 172.21.15.87:0/1419578522 conn(0x7f83500f6f90 msgr2=0x7f83500f93a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:29.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.599+0000 7f8354e3f640 1 -- 172.21.15.87:0/1419578522 shutdown_connections 2024-09-17T07:30:29.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.599+0000 7f8354e3f640 1 -- 172.21.15.87:0/1419578522 wait complete. 2024-09-17T07:30:29.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.599+0000 7f8354e3f640 1 Processor -- start 2024-09-17T07:30:29.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.599+0000 7f8354e3f640 1 -- start start 2024-09-17T07:30:29.602 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.599+0000 7f8354e3f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8350101360 0x7f835010dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:29.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.599+0000 7f8354e3f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8350101d00 0x7f835010e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:29.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.599+0000 7f8354e3f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83500667b0 con 0x7f8350101360 2024-09-17T07:30:29.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.599+0000 7f8354e3f640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f835010ea50 con 0x7f8350101d00 2024-09-17T07:30:29.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.600+0000 7f834e59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8350101360 0x7f835010dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:29.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.600+0000 7f834e59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8350101360 0x7f835010dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46182/0 (socket says 172.21.15.87:46182) 2024-09-17T07:30:29.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.600+0000 7f834e59c640 1 -- 172.21.15.87:0/2497264135 learned_addr learned my addr 172.21.15.87:0/2497264135 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:30:29.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.600+0000 7f8347fff640 1 --2- 172.21.15.87:0/2497264135 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8350101d00 0x7f835010e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:29.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.600+0000 7f834e59c640 1 -- 172.21.15.87:0/2497264135 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8350101d00 msgr2=0x7f835010e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:29.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.600+0000 7f834e59c640 1 --2- 172.21.15.87:0/2497264135 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8350101d00 0x7f835010e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:29.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.600+0000 7f834e59c640 1 -- 172.21.15.87:0/2497264135 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8338005040 con 0x7f8350101360 2024-09-17T07:30:29.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.600+0000 7f834e59c640 1 --2- 172.21.15.87:0/2497264135 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8350101360 0x7f835010dfd0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f834000c830 tx=0x7f8340004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:29.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.600+0000 7f8346ffd640 1 -- 172.21.15.87:0/2497264135 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f834000a850 con 0x7f8350101360 2024-09-17T07:30:29.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.600+0000 7f8346ffd640 1 -- 172.21.15.87:0/2497264135 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f834000ae30 con 0x7f8350101360 2024-09-17T07:30:29.603 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.600+0000 7f8354e3f640 1 -- 172.21.15.87:0/2497264135 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f835010ed30 con 0x7f8350101360 2024-09-17T07:30:29.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.600+0000 7f8346ffd640 1 -- 172.21.15.87:0/2497264135 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83400113a0 con 0x7f8350101360 2024-09-17T07:30:29.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.600+0000 7f8354e3f640 1 -- 172.21.15.87:0/2497264135 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8350117370 con 0x7f8350101360 2024-09-17T07:30:29.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.601+0000 7f8354e3f640 1 -- 172.21.15.87:0/2497264135 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83500fcad0 con 0x7f8350101360 2024-09-17T07:30:29.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.602+0000 7f8346ffd640 1 -- 172.21.15.87:0/2497264135 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f8340012400 con 0x7f8350101360 2024-09-17T07:30:29.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.602+0000 7f8346ffd640 1 --2- 172.21.15.87:0/2497264135 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f833c06cb90 0x7f833c06f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:29.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.602+0000 7f8346ffd640 1 -- 172.21.15.87:0/2497264135 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f834008c2a0 con 0x7f8350101360 2024-09-17T07:30:29.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.602+0000 7f8347fff640 1 --2- 172.21.15.87:0/2497264135 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f833c06cb90 0x7f833c06f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:29.605 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.603+0000 7f8347fff640 1 --2- 172.21.15.87:0/2497264135 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f833c06cb90 0x7f833c06f040 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8338009ac0 tx=0x7f8338035040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:29.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.606+0000 7f8346ffd640 1 -- 172.21.15.87:0/2497264135 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f83400562e0 con 0x7f8350101360 2024-09-17T07:30:29.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.801+0000 7f8354e3f640 1 -- 172.21.15.87:0/2497264135 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 22, "format": "json"} v 0) v1 -- 0x7f835004bf60 con 0x7f8350101360 2024-09-17T07:30:29.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.801+0000 7f8346ffd640 1 -- 172.21.15.87:0/2497264135 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 22, "format": "json"}]=0 dumped fsmap epoch 22 v43) v1 ==== 107+0+4863 (secure 0 0 0) 0x7f8340059900 con 0x7f8350101360 2024-09-17T07:30:29.802 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:30:29.803 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T07:17:15.368053+0000","modified":"2024-09-17T07:23:57.180278+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":44,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14478,"mds_1":24243},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14478":{"gid":14478,"name":"cephfs.smithi087.tjhpcs","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.87:6829/2255237099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2255237099},{"type":"v1","addr":"172.21.15.87:6829","nonce":2255237099}]},"join_fscid":1,"export_targets":[1],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14490":{"gid":14490,"name":"cephfs.smithi087.vvbzss","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6827/4022268353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":4022268353},{"type":"v1","addr":"172.21.15.87:6827","nonce":4022268353}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24243":{"gid":24243,"name":"cephfs.smithi139.gnwonz","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.139:6825/3946792151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":3946792151},{"type":"v1","addr":"172.21.15.139:6825","nonce":3946792151}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24253":{"gid":24253,"name":"cephfs.smithi139.ftvinf","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.139:6827/3292073323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":3292073323},{"type":"v1","addr":"172.21.15.139:6827","nonce":3292073323}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-17T07:30:29.803 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 22 2024-09-17T07:30:29.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.803+0000 7f8354e3f640 1 -- 172.21.15.87:0/2497264135 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f833c06cb90 msgr2=0x7f833c06f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:29.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.803+0000 7f8354e3f640 1 --2- 172.21.15.87:0/2497264135 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f833c06cb90 0x7f833c06f040 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8338009ac0 tx=0x7f8338035040 comp rx=0 tx=0).stop 2024-09-17T07:30:29.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.803+0000 7f8354e3f640 1 -- 172.21.15.87:0/2497264135 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8350101360 msgr2=0x7f835010dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:29.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.803+0000 7f8354e3f640 1 --2- 172.21.15.87:0/2497264135 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8350101360 0x7f835010dfd0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f834000c830 tx=0x7f8340004430 comp rx=0 tx=0).stop 2024-09-17T07:30:29.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.803+0000 7f8354e3f640 1 -- 172.21.15.87:0/2497264135 shutdown_connections 2024-09-17T07:30:29.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.803+0000 7f8354e3f640 1 --2- 172.21.15.87:0/2497264135 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f833c06cb90 0x7f833c06f040 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:29.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.803+0000 7f8354e3f640 1 --2- 172.21.15.87:0/2497264135 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8350101d00 0x7f835010e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:29.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.803+0000 7f8354e3f640 1 --2- 172.21.15.87:0/2497264135 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8350101360 0x7f835010dfd0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:29.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.803+0000 7f8354e3f640 1 -- 172.21.15.87:0/2497264135 >> 172.21.15.87:0/2497264135 conn(0x7f83500f6f90 msgr2=0x7f83500f8080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:29.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.803+0000 7f8354e3f640 1 -- 172.21.15.87:0/2497264135 shutdown_connections 2024-09-17T07:30:29.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.803+0000 7f8354e3f640 1 -- 172.21.15.87:0/2497264135 wait complete. 2024-09-17T07:30:29.814 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:29 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/2379948323' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-09-17T07:30:29.814 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:29 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/506100396' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-17T07:30:29.814 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:29 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/3060809366' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-09-17T07:30:29.815 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 23 2024-09-17T07:30:29.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:29 smithi139 ceph-mon[79872]: from='client.? 172.21.15.87:0/2379948323' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-09-17T07:30:29.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:29 smithi139 ceph-mon[79872]: from='client.? 172.21.15.87:0/506100396' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-17T07:30:29.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:29 smithi139 ceph-mon[79872]: from='client.? 172.21.15.87:0/3060809366' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-09-17T07:30:29.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.908+0000 7ff0c051d640 1 -- 172.21.15.87:0/4221392261 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0b80fc460 msgr2=0x7ff0b80fc8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:29.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.908+0000 7ff0c051d640 1 --2- 172.21.15.87:0/4221392261 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0b80fc460 0x7ff0b80fc8d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac0048d0 tx=0x7ff0ac009da0 comp rx=0 tx=0).stop 2024-09-17T07:30:29.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.909+0000 7ff0c051d640 1 -- 172.21.15.87:0/4221392261 shutdown_connections 2024-09-17T07:30:29.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.909+0000 7ff0c051d640 1 --2- 172.21.15.87:0/4221392261 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0b80fc460 0x7ff0b80fc8d0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:29.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.909+0000 7ff0c051d640 1 --2- 172.21.15.87:0/4221392261 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff0b81024a0 0x7ff0b8102870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:29.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.909+0000 7ff0c051d640 1 -- 172.21.15.87:0/4221392261 >> 172.21.15.87:0/4221392261 conn(0x7ff0b80f8060 msgr2=0x7ff0b80fa470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:29.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.909+0000 7ff0c051d640 1 -- 172.21.15.87:0/4221392261 shutdown_connections 2024-09-17T07:30:29.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.909+0000 7ff0c051d640 1 -- 172.21.15.87:0/4221392261 wait complete. 2024-09-17T07:30:29.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.909+0000 7ff0c051d640 1 Processor -- start 2024-09-17T07:30:29.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.909+0000 7ff0c051d640 1 -- start start 2024-09-17T07:30:29.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.909+0000 7ff0c051d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0b80fc460 0x7ff0b8112db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:29.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.909+0000 7ff0c051d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff0b81024a0 0x7ff0b81132f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:29.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.909+0000 7ff0c051d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b81138f0 con 0x7ff0b80fc460 2024-09-17T07:30:29.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.909+0000 7ff0c051d640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b810cf40 con 0x7ff0b81024a0 2024-09-17T07:30:29.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.909+0000 7ff0be2b9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0b80fc460 0x7ff0b8112db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:29.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.909+0000 7ff0be2b9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0b80fc460 0x7ff0b8112db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46190/0 (socket says 172.21.15.87:46190) 2024-09-17T07:30:29.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.909+0000 7ff0be2b9640 1 -- 172.21.15.87:0/3091694032 learned_addr learned my addr 172.21.15.87:0/3091694032 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:30:29.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.910+0000 7ff0bdab8640 1 --2- 172.21.15.87:0/3091694032 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff0b81024a0 0x7ff0b81132f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:29.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.910+0000 7ff0be2b9640 1 -- 172.21.15.87:0/3091694032 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff0b81024a0 msgr2=0x7ff0b81132f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:29.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.910+0000 7ff0be2b9640 1 --2- 172.21.15.87:0/3091694032 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff0b81024a0 0x7ff0b81132f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:29.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.910+0000 7ff0be2b9640 1 -- 172.21.15.87:0/3091694032 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0ac005040 con 0x7ff0b80fc460 2024-09-17T07:30:29.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.910+0000 7ff0be2b9640 1 --2- 172.21.15.87:0/3091694032 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0b80fc460 0x7ff0b8112db0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff0a8002a50 tx=0x7ff0a8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:29.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.910+0000 7ff0b6ffd640 1 -- 172.21.15.87:0/3091694032 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0a8007c30 con 0x7ff0b80fc460 2024-09-17T07:30:29.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.910+0000 7ff0b6ffd640 1 -- 172.21.15.87:0/3091694032 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7ff0a800f040 con 0x7ff0b80fc460 2024-09-17T07:30:29.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.910+0000 7ff0c051d640 1 -- 172.21.15.87:0/3091694032 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0b810d220 con 0x7ff0b80fc460 2024-09-17T07:30:29.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.910+0000 7ff0b6ffd640 1 -- 172.21.15.87:0/3091694032 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0a800d990 con 0x7ff0b80fc460 2024-09-17T07:30:29.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.910+0000 7ff0c051d640 1 -- 172.21.15.87:0/3091694032 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0b810d7c0 con 0x7ff0b80fc460 2024-09-17T07:30:29.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.911+0000 7ff0c051d640 1 -- 172.21.15.87:0/3091694032 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0b80fdba0 con 0x7ff0b80fc460 2024-09-17T07:30:29.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.911+0000 7ff0b6ffd640 1 -- 172.21.15.87:0/3091694032 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7ff0a800dc00 con 0x7ff0b80fc460 2024-09-17T07:30:29.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.912+0000 7ff0b6ffd640 1 --2- 172.21.15.87:0/3091694032 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7ff0a006cb90 0x7ff0a006f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:29.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.912+0000 7ff0b6ffd640 1 -- 172.21.15.87:0/3091694032 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6496+0+0 (secure 0 0 0) 0x7ff0a808b960 con 0x7ff0b80fc460 2024-09-17T07:30:29.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.912+0000 7ff0bdab8640 1 --2- 172.21.15.87:0/3091694032 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7ff0a006cb90 0x7ff0a006f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:29.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.912+0000 7ff0bdab8640 1 --2- 172.21.15.87:0/3091694032 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7ff0a006cb90 0x7ff0a006f040 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff0b810e670 tx=0x7ff0ac035040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:29.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:29.916+0000 7ff0b6ffd640 1 -- 172.21.15.87:0/3091694032 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff0a80559a0 con 0x7ff0b80fc460 2024-09-17T07:30:30.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.113+0000 7ff0c051d640 1 -- 172.21.15.87:0/3091694032 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 23, "format": "json"} v 0) v1 -- 0x7ff0b810e420 con 0x7ff0b80fc460 2024-09-17T07:30:30.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.113+0000 7ff0b6ffd640 1 -- 172.21.15.87:0/3091694032 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 23, "format": "json"}]=0 dumped fsmap epoch 23 v43) v1 ==== 107+0+4862 (secure 0 0 0) 0x7ff0a8058fc0 con 0x7ff0b80fc460 2024-09-17T07:30:30.115 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:30:30.115 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T07:17:15.368053+0000","modified":"2024-09-17T07:24:06.203553+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":44,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14478,"mds_1":24243},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14478":{"gid":14478,"name":"cephfs.smithi087.tjhpcs","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.87:6829/2255237099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2255237099},{"type":"v1","addr":"172.21.15.87:6829","nonce":2255237099}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14490":{"gid":14490,"name":"cephfs.smithi087.vvbzss","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.87:6827/4022268353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":4022268353},{"type":"v1","addr":"172.21.15.87:6827","nonce":4022268353}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24243":{"gid":24243,"name":"cephfs.smithi139.gnwonz","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.139:6825/3946792151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":3946792151},{"type":"v1","addr":"172.21.15.139:6825","nonce":3946792151}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24253":{"gid":24253,"name":"cephfs.smithi139.ftvinf","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.139:6827/3292073323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":3292073323},{"type":"v1","addr":"172.21.15.139:6827","nonce":3292073323}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-17T07:30:30.115 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 23 2024-09-17T07:30:30.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.115+0000 7ff0c051d640 1 -- 172.21.15.87:0/3091694032 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7ff0a006cb90 msgr2=0x7ff0a006f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:30.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.115+0000 7ff0c051d640 1 --2- 172.21.15.87:0/3091694032 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7ff0a006cb90 0x7ff0a006f040 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff0b810e670 tx=0x7ff0ac035040 comp rx=0 tx=0).stop 2024-09-17T07:30:30.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.115+0000 7ff0c051d640 1 -- 172.21.15.87:0/3091694032 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0b80fc460 msgr2=0x7ff0b8112db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:30.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.115+0000 7ff0c051d640 1 --2- 172.21.15.87:0/3091694032 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0b80fc460 0x7ff0b8112db0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff0a8002a50 tx=0x7ff0a8004600 comp rx=0 tx=0).stop 2024-09-17T07:30:30.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.116+0000 7ff0c051d640 1 -- 172.21.15.87:0/3091694032 shutdown_connections 2024-09-17T07:30:30.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.116+0000 7ff0c051d640 1 --2- 172.21.15.87:0/3091694032 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7ff0a006cb90 0x7ff0a006f040 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:30.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.116+0000 7ff0c051d640 1 --2- 172.21.15.87:0/3091694032 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff0b81024a0 0x7ff0b81132f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:30.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.116+0000 7ff0c051d640 1 --2- 172.21.15.87:0/3091694032 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0b80fc460 0x7ff0b8112db0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:30.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.116+0000 7ff0c051d640 1 -- 172.21.15.87:0/3091694032 >> 172.21.15.87:0/3091694032 conn(0x7ff0b80f8060 msgr2=0x7ff0b80f9ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:30.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.116+0000 7ff0c051d640 1 -- 172.21.15.87:0/3091694032 shutdown_connections 2024-09-17T07:30:30.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.116+0000 7ff0c051d640 1 -- 172.21.15.87:0/3091694032 wait complete. 2024-09-17T07:30:30.127 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 24 2024-09-17T07:30:30.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.222+0000 7fd191754640 1 -- 172.21.15.87:0/1807136914 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd18c0fab50 msgr2=0x7fd18c0fafc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:30.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.222+0000 7fd191754640 1 --2- 172.21.15.87:0/1807136914 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd18c0fab50 0x7fd18c0fafc0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd1800048d0 tx=0x7fd180009da0 comp rx=0 tx=0).stop 2024-09-17T07:30:30.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.222+0000 7fd191754640 1 -- 172.21.15.87:0/1807136914 shutdown_connections 2024-09-17T07:30:30.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.222+0000 7fd191754640 1 --2- 172.21.15.87:0/1807136914 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd18c0fab50 0x7fd18c0fafc0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:30.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.222+0000 7fd191754640 1 --2- 172.21.15.87:0/1807136914 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd18c1024a0 0x7fd18c102870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:30.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.222+0000 7fd191754640 1 -- 172.21.15.87:0/1807136914 >> 172.21.15.87:0/1807136914 conn(0x7fd18c070b30 msgr2=0x7fd18c070f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:30.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.222+0000 7fd191754640 1 -- 172.21.15.87:0/1807136914 shutdown_connections 2024-09-17T07:30:30.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.222+0000 7fd191754640 1 -- 172.21.15.87:0/1807136914 wait complete. 2024-09-17T07:30:30.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.223+0000 7fd191754640 1 Processor -- start 2024-09-17T07:30:30.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.223+0000 7fd191754640 1 -- start start 2024-09-17T07:30:30.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.223+0000 7fd191754640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd18c0fab50 0x7fd18c0fbd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:30.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.223+0000 7fd191754640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd18c1024a0 0x7fd18c0fc270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:30.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.223+0000 7fd191754640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd18c0fdc10 con 0x7fd18c0fab50 2024-09-17T07:30:30.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.223+0000 7fd191754640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd18c0fc7b0 con 0x7fd18c1024a0 2024-09-17T07:30:30.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.223+0000 7fd18affd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd18c0fab50 0x7fd18c0fbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:30.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.223+0000 7fd18affd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd18c0fab50 0x7fd18c0fbd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46206/0 (socket says 172.21.15.87:46206) 2024-09-17T07:30:30.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.223+0000 7fd18affd640 1 -- 172.21.15.87:0/3526806835 learned_addr learned my addr 172.21.15.87:0/3526806835 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:30:30.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.223+0000 7fd18a7fc640 1 --2- 172.21.15.87:0/3526806835 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd18c1024a0 0x7fd18c0fc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:30.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.223+0000 7fd18affd640 1 -- 172.21.15.87:0/3526806835 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd18c1024a0 msgr2=0x7fd18c0fc270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:30.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.223+0000 7fd18affd640 1 --2- 172.21.15.87:0/3526806835 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd18c1024a0 0x7fd18c0fc270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:30.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.223+0000 7fd18affd640 1 -- 172.21.15.87:0/3526806835 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd180005040 con 0x7fd18c0fab50 2024-09-17T07:30:30.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.223+0000 7fd18affd640 1 --2- 172.21.15.87:0/3526806835 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd18c0fab50 0x7fd18c0fbd30 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd17c002a50 tx=0x7fd17c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:30.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.223+0000 7fd1737fe640 1 -- 172.21.15.87:0/3526806835 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd17c007c30 con 0x7fd18c0fab50 2024-09-17T07:30:30.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.224+0000 7fd191754640 1 -- 172.21.15.87:0/3526806835 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd18c0fca90 con 0x7fd18c0fab50 2024-09-17T07:30:30.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.224+0000 7fd1737fe640 1 -- 172.21.15.87:0/3526806835 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fd17c00f040 con 0x7fd18c0fab50 2024-09-17T07:30:30.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.224+0000 7fd1737fe640 1 -- 172.21.15.87:0/3526806835 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd17c00dab0 con 0x7fd18c0fab50 2024-09-17T07:30:30.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.224+0000 7fd191754640 1 -- 172.21.15.87:0/3526806835 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd18c119580 con 0x7fd18c0fab50 2024-09-17T07:30:30.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.224+0000 7fd191754640 1 -- 172.21.15.87:0/3526806835 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd18c065570 con 0x7fd18c0fab50 2024-09-17T07:30:30.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.225+0000 7fd1737fe640 1 -- 172.21.15.87:0/3526806835 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fd17c00dc10 con 0x7fd18c0fab50 2024-09-17T07:30:30.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.225+0000 7fd1737fe640 1 --2- 172.21.15.87:0/3526806835 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fd17406cb90 0x7fd17406f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:30.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.225+0000 7fd1737fe640 1 -- 172.21.15.87:0/3526806835 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fd17c08bf80 con 0x7fd18c0fab50 2024-09-17T07:30:30.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.225+0000 7fd18a7fc640 1 --2- 172.21.15.87:0/3526806835 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fd17406cb90 0x7fd17406f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:30.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.226+0000 7fd18a7fc640 1 --2- 172.21.15.87:0/3526806835 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fd17406cb90 0x7fd17406f040 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd180009ac0 tx=0x7fd180035040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:30.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.230+0000 7fd1737fe640 1 -- 172.21.15.87:0/3526806835 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd17c0bfe20 con 0x7fd18c0fab50 2024-09-17T07:30:30.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.425+0000 7fd191754640 1 -- 172.21.15.87:0/3526806835 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 24, "format": "json"} v 0) v1 -- 0x7fd18c04bf60 con 0x7fd18c0fab50 2024-09-17T07:30:30.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.426+0000 7fd1737fe640 1 -- 172.21.15.87:0/3526806835 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 24, "format": "json"}]=0 dumped fsmap epoch 24 v43) v1 ==== 107+0+3287 (secure 0 0 0) 0x7fd17c055fc0 con 0x7fd18c0fab50 2024-09-17T07:30:30.428 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:30:30.428 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T07:17:15.368053+0000","modified":"2024-09-17T07:26:00.371329+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14478,"mds_1":24243},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14478":{"gid":14478,"name":"cephfs.smithi087.tjhpcs","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.87:6829/2255237099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2255237099},{"type":"v1","addr":"172.21.15.87:6829","nonce":2255237099}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24243":{"gid":24243,"name":"cephfs.smithi139.gnwonz","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.139:6825/3946792151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":3946792151},{"type":"v1","addr":"172.21.15.139:6825","nonce":3946792151}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-17T07:30:30.428 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 24 2024-09-17T07:30:30.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.428+0000 7fd191754640 1 -- 172.21.15.87:0/3526806835 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fd17406cb90 msgr2=0x7fd17406f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:30.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.428+0000 7fd191754640 1 --2- 172.21.15.87:0/3526806835 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fd17406cb90 0x7fd17406f040 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd180009ac0 tx=0x7fd180035040 comp rx=0 tx=0).stop 2024-09-17T07:30:30.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.428+0000 7fd191754640 1 -- 172.21.15.87:0/3526806835 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd18c0fab50 msgr2=0x7fd18c0fbd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:30.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.428+0000 7fd191754640 1 --2- 172.21.15.87:0/3526806835 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd18c0fab50 0x7fd18c0fbd30 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd17c002a50 tx=0x7fd17c004600 comp rx=0 tx=0).stop 2024-09-17T07:30:30.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.428+0000 7fd191754640 1 -- 172.21.15.87:0/3526806835 shutdown_connections 2024-09-17T07:30:30.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.428+0000 7fd191754640 1 --2- 172.21.15.87:0/3526806835 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fd17406cb90 0x7fd17406f040 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:30.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.428+0000 7fd191754640 1 --2- 172.21.15.87:0/3526806835 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd18c1024a0 0x7fd18c0fc270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:30.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.428+0000 7fd191754640 1 --2- 172.21.15.87:0/3526806835 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd18c0fab50 0x7fd18c0fbd30 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:30.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.428+0000 7fd191754640 1 -- 172.21.15.87:0/3526806835 >> 172.21.15.87:0/3526806835 conn(0x7fd18c070b30 msgr2=0x7fd18c1051f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:30.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.428+0000 7fd191754640 1 -- 172.21.15.87:0/3526806835 shutdown_connections 2024-09-17T07:30:30.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.428+0000 7fd191754640 1 -- 172.21.15.87:0/3526806835 wait complete. 2024-09-17T07:30:30.440 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 24 2024-09-17T07:30:30.440 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 25 2024-09-17T07:30:30.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.535+0000 7f5d1c8c0640 1 -- 172.21.15.87:0/2272707626 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d181024a0 msgr2=0x7f5d18102870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:30.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.535+0000 7f5d1c8c0640 1 --2- 172.21.15.87:0/2272707626 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d181024a0 0x7f5d18102870 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5d080048d0 tx=0x7f5d08009da0 comp rx=0 tx=0).stop 2024-09-17T07:30:30.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.535+0000 7f5d1c8c0640 1 -- 172.21.15.87:0/2272707626 shutdown_connections 2024-09-17T07:30:30.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.535+0000 7f5d1c8c0640 1 --2- 172.21.15.87:0/2272707626 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5d18064610 0x7f5d18064a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:30.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.535+0000 7f5d1c8c0640 1 --2- 172.21.15.87:0/2272707626 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d181024a0 0x7f5d18102870 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:30.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.535+0000 7f5d1c8c0640 1 -- 172.21.15.87:0/2272707626 >> 172.21.15.87:0/2272707626 conn(0x7f5d18071360 msgr2=0x7f5d18071760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:30.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.535+0000 7f5d1c8c0640 1 -- 172.21.15.87:0/2272707626 shutdown_connections 2024-09-17T07:30:30.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.535+0000 7f5d1c8c0640 1 -- 172.21.15.87:0/2272707626 wait complete. 2024-09-17T07:30:30.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.535+0000 7f5d1c8c0640 1 Processor -- start 2024-09-17T07:30:30.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.535+0000 7f5d1c8c0640 1 -- start start 2024-09-17T07:30:30.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.535+0000 7f5d1c8c0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d18064610 0x7f5d18112da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:30.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.535+0000 7f5d1c8c0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5d181024a0 0x7f5d181132e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:30.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.535+0000 7f5d1c8c0640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d181138e0 con 0x7f5d18064610 2024-09-17T07:30:30.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.535+0000 7f5d1c8c0640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d1810cf30 con 0x7f5d181024a0 2024-09-17T07:30:30.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.536+0000 7f5d1659c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d18064610 0x7f5d18112da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:30.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.536+0000 7f5d1659c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d18064610 0x7f5d18112da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46228/0 (socket says 172.21.15.87:46228) 2024-09-17T07:30:30.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.536+0000 7f5d1659c640 1 -- 172.21.15.87:0/1427559611 learned_addr learned my addr 172.21.15.87:0/1427559611 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:30:30.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.536+0000 7f5d15d9b640 1 --2- 172.21.15.87:0/1427559611 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5d181024a0 0x7f5d181132e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:30.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.536+0000 7f5d1659c640 1 -- 172.21.15.87:0/1427559611 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5d181024a0 msgr2=0x7f5d181132e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:30.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.536+0000 7f5d1659c640 1 --2- 172.21.15.87:0/1427559611 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5d181024a0 0x7f5d181132e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:30.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.536+0000 7f5d1659c640 1 -- 172.21.15.87:0/1427559611 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d08005040 con 0x7f5d18064610 2024-09-17T07:30:30.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.536+0000 7f5d15d9b640 1 --2- 172.21.15.87:0/1427559611 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5d181024a0 0x7f5d181132e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T07:30:30.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.536+0000 7f5d1659c640 1 --2- 172.21.15.87:0/1427559611 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d18064610 0x7f5d18112da0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5d080043d0 tx=0x7f5d08009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:30.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.536+0000 7f5d06ffd640 1 -- 172.21.15.87:0/1427559611 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d08038070 con 0x7f5d18064610 2024-09-17T07:30:30.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.536+0000 7f5d06ffd640 1 -- 172.21.15.87:0/1427559611 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f5d0802ade0 con 0x7f5d18064610 2024-09-17T07:30:30.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.536+0000 7f5d1c8c0640 1 -- 172.21.15.87:0/1427559611 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d1810d1b0 con 0x7f5d18064610 2024-09-17T07:30:30.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.536+0000 7f5d06ffd640 1 -- 172.21.15.87:0/1427559611 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d0802c750 con 0x7f5d18064610 2024-09-17T07:30:30.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.536+0000 7f5d1c8c0640 1 -- 172.21.15.87:0/1427559611 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d1810d6f0 con 0x7f5d18064610 2024-09-17T07:30:30.540 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.537+0000 7f5d1c8c0640 1 -- 172.21.15.87:0/1427559611 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d180fdbc0 con 0x7f5d18064610 2024-09-17T07:30:30.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.537+0000 7f5d06ffd640 1 -- 172.21.15.87:0/1427559611 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f5d08030020 con 0x7f5d18064610 2024-09-17T07:30:30.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.538+0000 7f5d06ffd640 1 --2- 172.21.15.87:0/1427559611 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f5d0006cb90 0x7f5d0006f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:30.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.538+0000 7f5d06ffd640 1 -- 172.21.15.87:0/1427559611 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f5d080abd70 con 0x7f5d18064610 2024-09-17T07:30:30.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.538+0000 7f5d15d9b640 1 --2- 172.21.15.87:0/1427559611 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f5d0006cb90 0x7f5d0006f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:30.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.538+0000 7f5d15d9b640 1 --2- 172.21.15.87:0/1427559611 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f5d0006cb90 0x7f5d0006f040 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5d0c007fd0 tx=0x7f5d0c009e90 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:30.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.542+0000 7f5d06ffd640 1 -- 172.21.15.87:0/1427559611 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5d08075db0 con 0x7f5d18064610 2024-09-17T07:30:30.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.736+0000 7f5d1c8c0640 1 -- 172.21.15.87:0/1427559611 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 25, "format": "json"} v 0) v1 -- 0x7f5d1804bf60 con 0x7f5d18064610 2024-09-17T07:30:30.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.737+0000 7f5d06ffd640 1 -- 172.21.15.87:0/1427559611 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 25, "format": "json"}]=0 dumped fsmap epoch 25 v43) v1 ==== 107+0+4844 (secure 0 0 0) 0x7f5d080793d0 con 0x7f5d18064610 2024-09-17T07:30:30.738 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:30:30.739 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34376,"name":"cephfs.smithi087.vvbzss","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6827/1835215411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1835215411},{"type":"v1","addr":"172.21.15.87:6827","nonce":1835215411}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":44261,"name":"cephfs.smithi139.ftvinf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6827/641133838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":641133838},{"type":"v1","addr":"172.21.15.139:6827","nonce":641133838}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T07:17:15.368053+0000","modified":"2024-09-17T07:26:01.390346+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":14478,"mds_1":24243},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14478":{"gid":14478,"name":"cephfs.smithi087.tjhpcs","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.87:6829/2255237099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2255237099},{"type":"v1","addr":"172.21.15.87:6829","nonce":2255237099}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24243":{"gid":24243,"name":"cephfs.smithi139.gnwonz","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.139:6825/3946792151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":3946792151},{"type":"v1","addr":"172.21.15.139:6825","nonce":3946792151}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-17T07:30:30.739 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 25 2024-09-17T07:30:30.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.739+0000 7f5d1c8c0640 1 -- 172.21.15.87:0/1427559611 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f5d0006cb90 msgr2=0x7f5d0006f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:30.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.739+0000 7f5d1c8c0640 1 --2- 172.21.15.87:0/1427559611 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f5d0006cb90 0x7f5d0006f040 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5d0c007fd0 tx=0x7f5d0c009e90 comp rx=0 tx=0).stop 2024-09-17T07:30:30.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.739+0000 7f5d1c8c0640 1 -- 172.21.15.87:0/1427559611 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d18064610 msgr2=0x7f5d18112da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:30.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.739+0000 7f5d1c8c0640 1 --2- 172.21.15.87:0/1427559611 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d18064610 0x7f5d18112da0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5d080043d0 tx=0x7f5d08009da0 comp rx=0 tx=0).stop 2024-09-17T07:30:30.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.739+0000 7f5d1c8c0640 1 -- 172.21.15.87:0/1427559611 shutdown_connections 2024-09-17T07:30:30.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.739+0000 7f5d1c8c0640 1 --2- 172.21.15.87:0/1427559611 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f5d0006cb90 0x7f5d0006f040 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:30.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.739+0000 7f5d1c8c0640 1 --2- 172.21.15.87:0/1427559611 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5d181024a0 0x7f5d181132e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:30.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.739+0000 7f5d1c8c0640 1 --2- 172.21.15.87:0/1427559611 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d18064610 0x7f5d18112da0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:30.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.739+0000 7f5d1c8c0640 1 -- 172.21.15.87:0/1427559611 >> 172.21.15.87:0/1427559611 conn(0x7f5d18071360 msgr2=0x7f5d181051b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:30.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.739+0000 7f5d1c8c0640 1 -- 172.21.15.87:0/1427559611 shutdown_connections 2024-09-17T07:30:30.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.739+0000 7f5d1c8c0640 1 -- 172.21.15.87:0/1427559611 wait complete. 2024-09-17T07:30:30.749 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:30 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/2967290409' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-09-17T07:30:30.749 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:30 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/2497264135' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-09-17T07:30:30.750 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:30 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/3091694032' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-09-17T07:30:30.750 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:30 smithi087 ceph-mon[90982]: pgmap v294: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:30:30.750 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:30 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/3526806835' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-09-17T07:30:30.751 DEBUG:tasks.fs:max_mds reduced in epoch 25 2024-09-17T07:30:30.751 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 25 2024-09-17T07:30:30.751 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 26 2024-09-17T07:30:30.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.844+0000 7fa4c3b1d640 1 -- 172.21.15.87:0/3057210612 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4bc101540 msgr2=0x7fa4bc101910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:30.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.844+0000 7fa4c3b1d640 1 --2- 172.21.15.87:0/3057210612 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4bc101540 0x7fa4bc101910 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa4b80048d0 tx=0x7fa4b8009da0 comp rx=0 tx=0).stop 2024-09-17T07:30:30.847 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.844+0000 7fa4c3b1d640 1 -- 172.21.15.87:0/3057210612 shutdown_connections 2024-09-17T07:30:30.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.844+0000 7fa4c3b1d640 1 --2- 172.21.15.87:0/3057210612 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa4bc101ee0 0x7fa4bc0fb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:30.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.844+0000 7fa4c3b1d640 1 --2- 172.21.15.87:0/3057210612 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4bc101540 0x7fa4bc101910 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:30.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.844+0000 7fa4c3b1d640 1 -- 172.21.15.87:0/3057210612 >> 172.21.15.87:0/3057210612 conn(0x7fa4bc0f7140 msgr2=0x7fa4bc0f9550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:30.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.844+0000 7fa4c3b1d640 1 -- 172.21.15.87:0/3057210612 shutdown_connections 2024-09-17T07:30:30.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.844+0000 7fa4c3b1d640 1 -- 172.21.15.87:0/3057210612 wait complete. 2024-09-17T07:30:30.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.845+0000 7fa4c3b1d640 1 Processor -- start 2024-09-17T07:30:30.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.845+0000 7fa4c3b1d640 1 -- start start 2024-09-17T07:30:30.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.845+0000 7fa4c3b1d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4bc101540 0x7fa4bc10e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:30.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.845+0000 7fa4c3b1d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa4bc101ee0 0x7fa4bc10e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:30.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.845+0000 7fa4c3b1d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4bc0667f0 con 0x7fa4bc101540 2024-09-17T07:30:30.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.845+0000 7fa4c3b1d640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4bc10ec80 con 0x7fa4bc101ee0 2024-09-17T07:30:30.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.845+0000 7fa4c18b9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4bc101540 0x7fa4bc10e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:30.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.845+0000 7fa4c18b9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4bc101540 0x7fa4bc10e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46238/0 (socket says 172.21.15.87:46238) 2024-09-17T07:30:30.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.845+0000 7fa4c18b9640 1 -- 172.21.15.87:0/4122868410 learned_addr learned my addr 172.21.15.87:0/4122868410 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:30:30.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.845+0000 7fa4c10b8640 1 --2- 172.21.15.87:0/4122868410 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa4bc101ee0 0x7fa4bc10e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:30.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.845+0000 7fa4c18b9640 1 -- 172.21.15.87:0/4122868410 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa4bc101ee0 msgr2=0x7fa4bc10e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:30.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.845+0000 7fa4c18b9640 1 --2- 172.21.15.87:0/4122868410 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa4bc101ee0 0x7fa4bc10e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:30.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.845+0000 7fa4c18b9640 1 -- 172.21.15.87:0/4122868410 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4b8005040 con 0x7fa4bc101540 2024-09-17T07:30:30.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.845+0000 7fa4c10b8640 1 --2- 172.21.15.87:0/4122868410 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa4bc101ee0 0x7fa4bc10e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T07:30:30.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.846+0000 7fa4c18b9640 1 --2- 172.21.15.87:0/4122868410 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4bc101540 0x7fa4bc10e1d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa4b80043d0 tx=0x7fa4b8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:30.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.846+0000 7fa4b27fc640 1 -- 172.21.15.87:0/4122868410 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4b8038070 con 0x7fa4bc101540 2024-09-17T07:30:30.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.846+0000 7fa4b27fc640 1 -- 172.21.15.87:0/4122868410 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fa4b802ade0 con 0x7fa4bc101540 2024-09-17T07:30:30.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.846+0000 7fa4c3b1d640 1 -- 172.21.15.87:0/4122868410 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4bc10ef00 con 0x7fa4bc101540 2024-09-17T07:30:30.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.846+0000 7fa4b27fc640 1 -- 172.21.15.87:0/4122868410 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4b802c750 con 0x7fa4bc101540 2024-09-17T07:30:30.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.846+0000 7fa4c3b1d640 1 -- 172.21.15.87:0/4122868410 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4bc117430 con 0x7fa4bc101540 2024-09-17T07:30:30.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.847+0000 7fa4c3b1d640 1 -- 172.21.15.87:0/4122868410 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4bc0fccc0 con 0x7fa4bc101540 2024-09-17T07:30:30.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.847+0000 7fa4b27fc640 1 -- 172.21.15.87:0/4122868410 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fa4b8030020 con 0x7fa4bc101540 2024-09-17T07:30:30.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.848+0000 7fa4b27fc640 1 --2- 172.21.15.87:0/4122868410 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fa4a806cb90 0x7fa4a806f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:30.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.848+0000 7fa4b27fc640 1 -- 172.21.15.87:0/4122868410 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fa4b80abd70 con 0x7fa4bc101540 2024-09-17T07:30:30.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.848+0000 7fa4c10b8640 1 --2- 172.21.15.87:0/4122868410 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fa4a806cb90 0x7fa4a806f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:30.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.848+0000 7fa4c10b8640 1 --2- 172.21.15.87:0/4122868410 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fa4a806cb90 0x7fa4a806f040 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac009af0 tx=0x7fa4ac00b040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:30.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:30.852+0000 7fa4b27fc640 1 -- 172.21.15.87:0/4122868410 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa4b8075db0 con 0x7fa4bc101540 2024-09-17T07:30:30.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:30 smithi139 ceph-mon[79872]: from='client.? 172.21.15.87:0/2967290409' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-09-17T07:30:30.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:30 smithi139 ceph-mon[79872]: from='client.? 172.21.15.87:0/2497264135' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-09-17T07:30:30.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:30 smithi139 ceph-mon[79872]: from='client.? 172.21.15.87:0/3091694032' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-09-17T07:30:30.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:30 smithi139 ceph-mon[79872]: pgmap v294: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:30:30.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:30 smithi139 ceph-mon[79872]: from='client.? 172.21.15.87:0/3526806835' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-09-17T07:30:31.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.045+0000 7fa4c3b1d640 1 -- 172.21.15.87:0/4122868410 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 26, "format": "json"} v 0) v1 -- 0x7fa4bc04bf60 con 0x7fa4bc101540 2024-09-17T07:30:31.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.046+0000 7fa4b27fc640 1 -- 172.21.15.87:0/4122868410 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 26, "format": "json"}]=0 dumped fsmap epoch 26 v43) v1 ==== 107+0+4846 (secure 0 0 0) 0x7fa4b80793d0 con 0x7fa4bc101540 2024-09-17T07:30:31.047 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:30:31.047 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34376,"name":"cephfs.smithi087.vvbzss","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6827/1835215411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1835215411},{"type":"v1","addr":"172.21.15.87:6827","nonce":1835215411}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":44261,"name":"cephfs.smithi139.ftvinf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6827/641133838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":641133838},{"type":"v1","addr":"172.21.15.139:6827","nonce":641133838}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T07:17:15.368053+0000","modified":"2024-09-17T07:26:01.394102+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":14478,"mds_1":24243},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14478":{"gid":14478,"name":"cephfs.smithi087.tjhpcs","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.87:6829/2255237099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2255237099},{"type":"v1","addr":"172.21.15.87:6829","nonce":2255237099}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24243":{"gid":24243,"name":"cephfs.smithi139.gnwonz","rank":1,"incarnation":7,"state":"up:stopping","state_seq":4,"addr":"172.21.15.139:6825/3946792151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":3946792151},{"type":"v1","addr":"172.21.15.139:6825","nonce":3946792151}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-17T07:30:31.048 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 26 2024-09-17T07:30:31.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.048+0000 7fa4c3b1d640 1 -- 172.21.15.87:0/4122868410 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fa4a806cb90 msgr2=0x7fa4a806f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:31.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.048+0000 7fa4c3b1d640 1 --2- 172.21.15.87:0/4122868410 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fa4a806cb90 0x7fa4a806f040 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac009af0 tx=0x7fa4ac00b040 comp rx=0 tx=0).stop 2024-09-17T07:30:31.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.048+0000 7fa4c3b1d640 1 -- 172.21.15.87:0/4122868410 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4bc101540 msgr2=0x7fa4bc10e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:31.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.048+0000 7fa4c3b1d640 1 --2- 172.21.15.87:0/4122868410 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4bc101540 0x7fa4bc10e1d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa4b80043d0 tx=0x7fa4b8009da0 comp rx=0 tx=0).stop 2024-09-17T07:30:31.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.048+0000 7fa4c3b1d640 1 -- 172.21.15.87:0/4122868410 shutdown_connections 2024-09-17T07:30:31.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.048+0000 7fa4c3b1d640 1 --2- 172.21.15.87:0/4122868410 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fa4a806cb90 0x7fa4a806f040 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:31.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.048+0000 7fa4c3b1d640 1 --2- 172.21.15.87:0/4122868410 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa4bc101ee0 0x7fa4bc10e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:31.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.048+0000 7fa4c3b1d640 1 --2- 172.21.15.87:0/4122868410 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4bc101540 0x7fa4bc10e1d0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:31.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.048+0000 7fa4c3b1d640 1 -- 172.21.15.87:0/4122868410 >> 172.21.15.87:0/4122868410 conn(0x7fa4bc0f7140 msgr2=0x7fa4bc0f82e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:31.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.048+0000 7fa4c3b1d640 1 -- 172.21.15.87:0/4122868410 shutdown_connections 2024-09-17T07:30:31.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.048+0000 7fa4c3b1d640 1 -- 172.21.15.87:0/4122868410 wait complete. 2024-09-17T07:30:31.060 DEBUG:tasks.fs:max_mds reduced in epoch 26 2024-09-17T07:30:31.060 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 26 2024-09-17T07:30:31.060 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 27 2024-09-17T07:30:31.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.155+0000 7f225e95d640 1 -- 172.21.15.87:0/3509642768 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22581013c0 msgr2=0x7f2258101790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:31.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.155+0000 7f225e95d640 1 --2- 172.21.15.87:0/3509642768 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22581013c0 0x7f2258101790 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f22480048d0 tx=0x7f2248009da0 comp rx=0 tx=0).stop 2024-09-17T07:30:31.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.156+0000 7f225e95d640 1 -- 172.21.15.87:0/3509642768 shutdown_connections 2024-09-17T07:30:31.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.156+0000 7f225e95d640 1 --2- 172.21.15.87:0/3509642768 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f22580fb3a0 0x7f22580fb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:31.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.156+0000 7f225e95d640 1 --2- 172.21.15.87:0/3509642768 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22581013c0 0x7f2258101790 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:31.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.156+0000 7f225e95d640 1 -- 172.21.15.87:0/3509642768 >> 172.21.15.87:0/3509642768 conn(0x7f2258071360 msgr2=0x7f2258071760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:31.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.156+0000 7f225e95d640 1 -- 172.21.15.87:0/3509642768 shutdown_connections 2024-09-17T07:30:31.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.156+0000 7f225e95d640 1 -- 172.21.15.87:0/3509642768 wait complete. 2024-09-17T07:30:31.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.156+0000 7f225e95d640 1 Processor -- start 2024-09-17T07:30:31.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.156+0000 7f225e95d640 1 -- start start 2024-09-17T07:30:31.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.156+0000 7f225e95d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22580fb3a0 0x7f225810df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:31.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.156+0000 7f225e95d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f22581013c0 0x7f225810e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:31.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.156+0000 7f225e95d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22580655b0 con 0x7f22580fb3a0 2024-09-17T07:30:31.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.156+0000 7f225e95d640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f225810ea00 con 0x7f22581013c0 2024-09-17T07:30:31.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.157+0000 7f2257fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22580fb3a0 0x7f225810df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:31.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.157+0000 7f2257fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22580fb3a0 0x7f225810df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46246/0 (socket says 172.21.15.87:46246) 2024-09-17T07:30:31.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.157+0000 7f2257fff640 1 -- 172.21.15.87:0/3085599827 learned_addr learned my addr 172.21.15.87:0/3085599827 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:30:31.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.157+0000 7f22577fe640 1 --2- 172.21.15.87:0/3085599827 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f22581013c0 0x7f225810e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:31.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.157+0000 7f2257fff640 1 -- 172.21.15.87:0/3085599827 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f22581013c0 msgr2=0x7f225810e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:31.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.157+0000 7f2257fff640 1 --2- 172.21.15.87:0/3085599827 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f22581013c0 0x7f225810e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:31.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.157+0000 7f2257fff640 1 -- 172.21.15.87:0/3085599827 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2248005040 con 0x7f22580fb3a0 2024-09-17T07:30:31.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.157+0000 7f2257fff640 1 --2- 172.21.15.87:0/3085599827 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22580fb3a0 0x7f225810df50 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2248000c00 tx=0x7f2248009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:31.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.157+0000 7f2254ff9640 1 -- 172.21.15.87:0/3085599827 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2248038070 con 0x7f22580fb3a0 2024-09-17T07:30:31.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.157+0000 7f2254ff9640 1 -- 172.21.15.87:0/3085599827 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f22480097b0 con 0x7f22580fb3a0 2024-09-17T07:30:31.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.157+0000 7f225e95d640 1 -- 172.21.15.87:0/3085599827 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f225810ec80 con 0x7f22580fb3a0 2024-09-17T07:30:31.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.157+0000 7f2254ff9640 1 -- 172.21.15.87:0/3085599827 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f224803c630 con 0x7f22580fb3a0 2024-09-17T07:30:31.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.157+0000 7f225e95d640 1 -- 172.21.15.87:0/3085599827 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2258117230 con 0x7f22580fb3a0 2024-09-17T07:30:31.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.159+0000 7f225e95d640 1 -- 172.21.15.87:0/3085599827 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22580fca80 con 0x7f22580fb3a0 2024-09-17T07:30:31.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.159+0000 7f2254ff9640 1 -- 172.21.15.87:0/3085599827 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f2248030020 con 0x7f22580fb3a0 2024-09-17T07:30:31.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.160+0000 7f2254ff9640 1 --2- 172.21.15.87:0/3085599827 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f224006cb90 0x7f224006f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:31.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.160+0000 7f2254ff9640 1 -- 172.21.15.87:0/3085599827 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f22480ac2a0 con 0x7f22580fb3a0 2024-09-17T07:30:31.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.160+0000 7f22577fe640 1 --2- 172.21.15.87:0/3085599827 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f224006cb90 0x7f224006f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:31.162 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.160+0000 7f22577fe640 1 --2- 172.21.15.87:0/3085599827 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f224006cb90 0x7f224006f040 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2258064e00 tx=0x7f224c009040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:31.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.164+0000 7f2254ff9640 1 -- 172.21.15.87:0/3085599827 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f22480762e0 con 0x7f22580fb3a0 2024-09-17T07:30:31.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.368+0000 7f225e95d640 1 -- 172.21.15.87:0/3085599827 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 27, "format": "json"} v 0) v1 -- 0x7f225804bf60 con 0x7f22580fb3a0 2024-09-17T07:30:31.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.369+0000 7f2254ff9640 1 -- 172.21.15.87:0/3085599827 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 27, "format": "json"}]=0 dumped fsmap epoch 27 v43) v1 ==== 107+0+4048 (secure 0 0 0) 0x7f2248079900 con 0x7f22580fb3a0 2024-09-17T07:30:31.371 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:30:31.371 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34376,"name":"cephfs.smithi087.vvbzss","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6827/1835215411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1835215411},{"type":"v1","addr":"172.21.15.87:6827","nonce":1835215411}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":44261,"name":"cephfs.smithi139.ftvinf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6827/641133838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":641133838},{"type":"v1","addr":"172.21.15.139:6827","nonce":641133838}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T07:17:15.368053+0000","modified":"2024-09-17T07:26:22.696739+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14478},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14478":{"gid":14478,"name":"cephfs.smithi087.tjhpcs","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.87:6829/2255237099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2255237099},{"type":"v1","addr":"172.21.15.87:6829","nonce":2255237099}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-17T07:30:31.371 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 27 2024-09-17T07:30:31.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.371+0000 7f225e95d640 1 -- 172.21.15.87:0/3085599827 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f224006cb90 msgr2=0x7f224006f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:31.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.371+0000 7f225e95d640 1 --2- 172.21.15.87:0/3085599827 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f224006cb90 0x7f224006f040 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2258064e00 tx=0x7f224c009040 comp rx=0 tx=0).stop 2024-09-17T07:30:31.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.371+0000 7f225e95d640 1 -- 172.21.15.87:0/3085599827 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22580fb3a0 msgr2=0x7f225810df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:31.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.371+0000 7f225e95d640 1 --2- 172.21.15.87:0/3085599827 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22580fb3a0 0x7f225810df50 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2248000c00 tx=0x7f2248009da0 comp rx=0 tx=0).stop 2024-09-17T07:30:31.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.371+0000 7f225e95d640 1 -- 172.21.15.87:0/3085599827 shutdown_connections 2024-09-17T07:30:31.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.371+0000 7f225e95d640 1 --2- 172.21.15.87:0/3085599827 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f224006cb90 0x7f224006f040 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:31.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.371+0000 7f225e95d640 1 --2- 172.21.15.87:0/3085599827 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f22581013c0 0x7f225810e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:31.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.371+0000 7f225e95d640 1 --2- 172.21.15.87:0/3085599827 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22580fb3a0 0x7f225810df50 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:31.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.371+0000 7f225e95d640 1 -- 172.21.15.87:0/3085599827 >> 172.21.15.87:0/3085599827 conn(0x7f2258071360 msgr2=0x7f22581040b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:31.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.371+0000 7f225e95d640 1 -- 172.21.15.87:0/3085599827 shutdown_connections 2024-09-17T07:30:31.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.371+0000 7f225e95d640 1 -- 172.21.15.87:0/3085599827 wait complete. 2024-09-17T07:30:31.385 DEBUG:tasks.fs:max_mds reduced in epoch 27 2024-09-17T07:30:31.385 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 27 2024-09-17T07:30:31.385 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 28 2024-09-17T07:30:31.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.483+0000 7ff9eff5d640 1 -- 172.21.15.87:0/744624412 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9e80fc480 msgr2=0x7ff9e80fc8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:31.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.483+0000 7ff9eff5d640 1 --2- 172.21.15.87:0/744624412 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9e80fc480 0x7ff9e80fc8f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc0048d0 tx=0x7ff9dc009da0 comp rx=0 tx=0).stop 2024-09-17T07:30:31.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.483+0000 7ff9eff5d640 1 -- 172.21.15.87:0/744624412 shutdown_connections 2024-09-17T07:30:31.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.483+0000 7ff9eff5d640 1 --2- 172.21.15.87:0/744624412 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9e80fc480 0x7ff9e80fc8f0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:31.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.483+0000 7ff9eff5d640 1 --2- 172.21.15.87:0/744624412 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff9e81024c0 0x7ff9e8102890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:31.486 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.483+0000 7ff9eff5d640 1 -- 172.21.15.87:0/744624412 >> 172.21.15.87:0/744624412 conn(0x7ff9e80f8040 msgr2=0x7ff9e80fa450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:31.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.483+0000 7ff9eff5d640 1 -- 172.21.15.87:0/744624412 shutdown_connections 2024-09-17T07:30:31.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.483+0000 7ff9eff5d640 1 -- 172.21.15.87:0/744624412 wait complete. 2024-09-17T07:30:31.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.483+0000 7ff9eff5d640 1 Processor -- start 2024-09-17T07:30:31.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.483+0000 7ff9eff5d640 1 -- start start 2024-09-17T07:30:31.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.483+0000 7ff9eff5d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9e80fc480 0x7ff9e806fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:31.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.483+0000 7ff9eff5d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff9e81024c0 0x7ff9e806ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:31.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.484+0000 7ff9eff5d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e80718f0 con 0x7ff9e80fc480 2024-09-17T07:30:31.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.484+0000 7ff9eff5d640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e8070490 con 0x7ff9e81024c0 2024-09-17T07:30:31.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.484+0000 7ff9edcf9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9e80fc480 0x7ff9e806fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:31.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.484+0000 7ff9edcf9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9e80fc480 0x7ff9e806fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46276/0 (socket says 172.21.15.87:46276) 2024-09-17T07:30:31.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.484+0000 7ff9edcf9640 1 -- 172.21.15.87:0/450789531 learned_addr learned my addr 172.21.15.87:0/450789531 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:30:31.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.484+0000 7ff9ed4f8640 1 --2- 172.21.15.87:0/450789531 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff9e81024c0 0x7ff9e806ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:31.487 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.484+0000 7ff9edcf9640 1 -- 172.21.15.87:0/450789531 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff9e81024c0 msgr2=0x7ff9e806ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:31.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.484+0000 7ff9edcf9640 1 --2- 172.21.15.87:0/450789531 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff9e81024c0 0x7ff9e806ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:31.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.484+0000 7ff9edcf9640 1 -- 172.21.15.87:0/450789531 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9dc005040 con 0x7ff9e80fc480 2024-09-17T07:30:31.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.484+0000 7ff9edcf9640 1 --2- 172.21.15.87:0/450789531 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9e80fc480 0x7ff9e806fa10 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff9e0002a50 tx=0x7ff9e0004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:31.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.484+0000 7ff9e67fc640 1 -- 172.21.15.87:0/450789531 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9e0007c30 con 0x7ff9e80fc480 2024-09-17T07:30:31.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.484+0000 7ff9e67fc640 1 -- 172.21.15.87:0/450789531 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7ff9e000f040 con 0x7ff9e80fc480 2024-09-17T07:30:31.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.484+0000 7ff9eff5d640 1 -- 172.21.15.87:0/450789531 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9e8070770 con 0x7ff9e80fc480 2024-09-17T07:30:31.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.484+0000 7ff9e67fc640 1 -- 172.21.15.87:0/450789531 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9e000d910 con 0x7ff9e80fc480 2024-09-17T07:30:31.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.484+0000 7ff9eff5d640 1 -- 172.21.15.87:0/450789531 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9e8119520 con 0x7ff9e80fc480 2024-09-17T07:30:31.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.485+0000 7ff9eff5d640 1 -- 172.21.15.87:0/450789531 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9e80fdbc0 con 0x7ff9e80fc480 2024-09-17T07:30:31.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.486+0000 7ff9e67fc640 1 -- 172.21.15.87:0/450789531 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7ff9e000dbd0 con 0x7ff9e80fc480 2024-09-17T07:30:31.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.486+0000 7ff9e67fc640 1 --2- 172.21.15.87:0/450789531 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7ff9d006cba0 0x7ff9d006f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:31.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.486+0000 7ff9e67fc640 1 -- 172.21.15.87:0/450789531 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6496+0+0 (secure 0 0 0) 0x7ff9e008b9a0 con 0x7ff9e80fc480 2024-09-17T07:30:31.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.486+0000 7ff9ed4f8640 1 --2- 172.21.15.87:0/450789531 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7ff9d006cba0 0x7ff9d006f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:31.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.486+0000 7ff9ed4f8640 1 --2- 172.21.15.87:0/450789531 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7ff9d006cba0 0x7ff9d006f050 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc009ac0 tx=0x7ff9dc035040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:31.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.490+0000 7ff9e67fc640 1 -- 172.21.15.87:0/450789531 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff9e00559d0 con 0x7ff9e80fc480 2024-09-17T07:30:31.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:31 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/1427559611' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-09-17T07:30:31.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:31 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/4122868410' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-09-17T07:30:31.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:31 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/3085599827' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-09-17T07:30:31.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.694+0000 7ff9eff5d640 1 -- 172.21.15.87:0/450789531 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 28, "format": "json"} v 0) v1 -- 0x7ff9e804bf60 con 0x7ff9e80fc480 2024-09-17T07:30:31.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.695+0000 7ff9e67fc640 1 -- 172.21.15.87:0/450789531 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 28, "format": "json"}]=0 dumped fsmap epoch 28 v43) v1 ==== 107+0+4830 (secure 0 0 0) 0x7ff9e0058ff0 con 0x7ff9e80fc480 2024-09-17T07:30:31.696 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:30:31.696 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34376,"name":"cephfs.smithi087.vvbzss","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6827/1835215411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1835215411},{"type":"v1","addr":"172.21.15.87:6827","nonce":1835215411}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":44261,"name":"cephfs.smithi139.ftvinf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6827/641133838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":641133838},{"type":"v1","addr":"172.21.15.139:6827","nonce":641133838}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":44289,"name":"cephfs.smithi139.gnwonz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6825/1004017136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":1004017136},{"type":"v1","addr":"172.21.15.139:6825","nonce":1004017136}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T07:17:15.368053+0000","modified":"2024-09-17T07:26:22.696739+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14478},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14478":{"gid":14478,"name":"cephfs.smithi087.tjhpcs","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.87:6829/2255237099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2255237099},{"type":"v1","addr":"172.21.15.87:6829","nonce":2255237099}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-17T07:30:31.697 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 28 2024-09-17T07:30:31.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.697+0000 7ff9eff5d640 1 -- 172.21.15.87:0/450789531 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7ff9d006cba0 msgr2=0x7ff9d006f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:31.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.697+0000 7ff9eff5d640 1 --2- 172.21.15.87:0/450789531 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7ff9d006cba0 0x7ff9d006f050 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc009ac0 tx=0x7ff9dc035040 comp rx=0 tx=0).stop 2024-09-17T07:30:31.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.697+0000 7ff9eff5d640 1 -- 172.21.15.87:0/450789531 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9e80fc480 msgr2=0x7ff9e806fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:31.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.697+0000 7ff9eff5d640 1 --2- 172.21.15.87:0/450789531 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9e80fc480 0x7ff9e806fa10 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff9e0002a50 tx=0x7ff9e0004600 comp rx=0 tx=0).stop 2024-09-17T07:30:31.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.697+0000 7ff9eff5d640 1 -- 172.21.15.87:0/450789531 shutdown_connections 2024-09-17T07:30:31.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.697+0000 7ff9eff5d640 1 --2- 172.21.15.87:0/450789531 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7ff9d006cba0 0x7ff9d006f050 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:31.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.697+0000 7ff9eff5d640 1 --2- 172.21.15.87:0/450789531 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff9e81024c0 0x7ff9e806ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:31.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.697+0000 7ff9eff5d640 1 --2- 172.21.15.87:0/450789531 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9e80fc480 0x7ff9e806fa10 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:31.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.697+0000 7ff9eff5d640 1 -- 172.21.15.87:0/450789531 >> 172.21.15.87:0/450789531 conn(0x7ff9e80f8040 msgr2=0x7ff9e80f8410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:31.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.697+0000 7ff9eff5d640 1 -- 172.21.15.87:0/450789531 shutdown_connections 2024-09-17T07:30:31.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.697+0000 7ff9eff5d640 1 -- 172.21.15.87:0/450789531 wait complete. 2024-09-17T07:30:31.709 DEBUG:tasks.fs:max_mds reduced in epoch 28 2024-09-17T07:30:31.709 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 28 2024-09-17T07:30:31.709 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 29 2024-09-17T07:30:31.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.806+0000 7f7d5eb1d640 1 -- 172.21.15.87:0/2308081047 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d580fb3a0 msgr2=0x7f7d580fb7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:31.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.806+0000 7f7d5eb1d640 1 --2- 172.21.15.87:0/2308081047 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d580fb3a0 0x7f7d580fb7f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f7d48009c50 tx=0x7f7d48004d10 comp rx=0 tx=0).stop 2024-09-17T07:30:31.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.806+0000 7f7d5eb1d640 1 -- 172.21.15.87:0/2308081047 shutdown_connections 2024-09-17T07:30:31.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.806+0000 7f7d5eb1d640 1 --2- 172.21.15.87:0/2308081047 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d580fb3a0 0x7f7d580fb7f0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:31.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.806+0000 7f7d5eb1d640 1 --2- 172.21.15.87:0/2308081047 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7d581013c0 0x7f7d58101790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:31.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.806+0000 7f7d5eb1d640 1 -- 172.21.15.87:0/2308081047 >> 172.21.15.87:0/2308081047 conn(0x7f7d58071360 msgr2=0x7f7d58071760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:31.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.806+0000 7f7d5eb1d640 1 -- 172.21.15.87:0/2308081047 shutdown_connections 2024-09-17T07:30:31.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.806+0000 7f7d5eb1d640 1 -- 172.21.15.87:0/2308081047 wait complete. 2024-09-17T07:30:31.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.807+0000 7f7d5eb1d640 1 Processor -- start 2024-09-17T07:30:31.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.807+0000 7f7d5eb1d640 1 -- start start 2024-09-17T07:30:31.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.807+0000 7f7d5eb1d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7d580fb3a0 0x7f7d58112e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:31.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.807+0000 7f7d5eb1d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d581013c0 0x7f7d58113380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:31.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.807+0000 7f7d5eb1d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d58113a10 con 0x7f7d581013c0 2024-09-17T07:30:31.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.807+0000 7f7d5eb1d640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5810cfd0 con 0x7f7d580fb3a0 2024-09-17T07:30:31.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.807+0000 7f7d57fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d581013c0 0x7f7d58113380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:31.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.807+0000 7f7d57fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d581013c0 0x7f7d58113380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46300/0 (socket says 172.21.15.87:46300) 2024-09-17T07:30:31.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.807+0000 7f7d57fff640 1 -- 172.21.15.87:0/3992228121 learned_addr learned my addr 172.21.15.87:0/3992228121 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:30:31.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.808+0000 7f7d5c8b9640 1 --2- 172.21.15.87:0/3992228121 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7d580fb3a0 0x7f7d58112e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:31.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.808+0000 7f7d57fff640 1 -- 172.21.15.87:0/3992228121 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7d580fb3a0 msgr2=0x7f7d58112e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:31.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.808+0000 7f7d57fff640 1 --2- 172.21.15.87:0/3992228121 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7d580fb3a0 0x7f7d58112e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:31.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.808+0000 7f7d57fff640 1 -- 172.21.15.87:0/3992228121 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d480098b0 con 0x7f7d581013c0 2024-09-17T07:30:31.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.808+0000 7f7d5c8b9640 1 --2- 172.21.15.87:0/3992228121 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7d580fb3a0 0x7f7d58112e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T07:30:31.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.808+0000 7f7d57fff640 1 --2- 172.21.15.87:0/3992228121 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d581013c0 0x7f7d58113380 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7d48004a30 tx=0x7f7d48004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:31.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.808+0000 7f7d557fa640 1 -- 172.21.15.87:0/3992228121 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d48032960 con 0x7f7d581013c0 2024-09-17T07:30:31.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.808+0000 7f7d5eb1d640 1 -- 172.21.15.87:0/3992228121 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d5810d250 con 0x7f7d581013c0 2024-09-17T07:30:31.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.808+0000 7f7d557fa640 1 -- 172.21.15.87:0/3992228121 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f7d48008ea0 con 0x7f7d581013c0 2024-09-17T07:30:31.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.808+0000 7f7d557fa640 1 -- 172.21.15.87:0/3992228121 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d4803ddb0 con 0x7f7d581013c0 2024-09-17T07:30:31.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.808+0000 7f7d5eb1d640 1 -- 172.21.15.87:0/3992228121 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d5810d770 con 0x7f7d581013c0 2024-09-17T07:30:31.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.809+0000 7f7d5eb1d640 1 -- 172.21.15.87:0/3992228121 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d580fca80 con 0x7f7d581013c0 2024-09-17T07:30:31.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.809+0000 7f7d557fa640 1 -- 172.21.15.87:0/3992228121 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f7d4802f030 con 0x7f7d581013c0 2024-09-17T07:30:31.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.810+0000 7f7d557fa640 1 --2- 172.21.15.87:0/3992228121 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f7d4406cb90 0x7f7d4406f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:31.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.810+0000 7f7d557fa640 1 -- 172.21.15.87:0/3992228121 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f7d480ad540 con 0x7f7d581013c0 2024-09-17T07:30:31.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.810+0000 7f7d5c8b9640 1 --2- 172.21.15.87:0/3992228121 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f7d4406cb90 0x7f7d4406f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:31.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.810+0000 7f7d5c8b9640 1 --2- 172.21.15.87:0/3992228121 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f7d4406cb90 0x7f7d4406f040 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7d50006fd0 tx=0x7f7d50008040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:31.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:31.814+0000 7f7d557fa640 1 -- 172.21.15.87:0/3992228121 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7d48077500 con 0x7f7d581013c0 2024-09-17T07:30:31.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:31 smithi139 ceph-mon[79872]: from='client.? 172.21.15.87:0/1427559611' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-09-17T07:30:31.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:31 smithi139 ceph-mon[79872]: from='client.? 172.21.15.87:0/4122868410' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-09-17T07:30:31.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:31 smithi139 ceph-mon[79872]: from='client.? 172.21.15.87:0/3085599827' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-09-17T07:30:32.017 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.016+0000 7f7d5eb1d640 1 -- 172.21.15.87:0/3992228121 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 29, "format": "json"} v 0) v1 -- 0x7f7d5804bf60 con 0x7f7d581013c0 2024-09-17T07:30:32.018 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.017+0000 7f7d557fa640 1 -- 172.21.15.87:0/3992228121 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 29, "format": "json"}]=0 dumped fsmap epoch 29 v43) v1 ==== 107+0+4051 (secure 0 0 0) 0x7f7d4807ab20 con 0x7f7d581013c0 2024-09-17T07:30:32.018 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:30:32.018 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44261,"name":"cephfs.smithi139.ftvinf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6827/641133838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":641133838},{"type":"v1","addr":"172.21.15.139:6827","nonce":641133838}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":44289,"name":"cephfs.smithi139.gnwonz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6825/1004017136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":1004017136},{"type":"v1","addr":"172.21.15.139:6825","nonce":1004017136}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T07:17:15.368053+0000","modified":"2024-09-17T07:26:22.696739+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14478},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14478":{"gid":14478,"name":"cephfs.smithi087.tjhpcs","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.87:6829/2255237099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2255237099},{"type":"v1","addr":"172.21.15.87:6829","nonce":2255237099}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-17T07:30:32.018 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 29 2024-09-17T07:30:32.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.019+0000 7f7d5eb1d640 1 -- 172.21.15.87:0/3992228121 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f7d4406cb90 msgr2=0x7f7d4406f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:32.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.019+0000 7f7d5eb1d640 1 --2- 172.21.15.87:0/3992228121 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f7d4406cb90 0x7f7d4406f040 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7d50006fd0 tx=0x7f7d50008040 comp rx=0 tx=0).stop 2024-09-17T07:30:32.020 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.019+0000 7f7d5eb1d640 1 -- 172.21.15.87:0/3992228121 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d581013c0 msgr2=0x7f7d58113380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:32.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.019+0000 7f7d5eb1d640 1 --2- 172.21.15.87:0/3992228121 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d581013c0 0x7f7d58113380 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7d48004a30 tx=0x7f7d48004d10 comp rx=0 tx=0).stop 2024-09-17T07:30:32.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.019+0000 7f7d5eb1d640 1 -- 172.21.15.87:0/3992228121 shutdown_connections 2024-09-17T07:30:32.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.019+0000 7f7d5eb1d640 1 --2- 172.21.15.87:0/3992228121 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d581013c0 0x7f7d58113380 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:32.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.019+0000 7f7d5eb1d640 1 --2- 172.21.15.87:0/3992228121 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f7d4406cb90 0x7f7d4406f040 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:32.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.019+0000 7f7d5eb1d640 1 --2- 172.21.15.87:0/3992228121 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7d580fb3a0 0x7f7d58112e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:32.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.019+0000 7f7d5eb1d640 1 -- 172.21.15.87:0/3992228121 >> 172.21.15.87:0/3992228121 conn(0x7f7d58071360 msgr2=0x7f7d580645f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:32.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.019+0000 7f7d5eb1d640 1 -- 172.21.15.87:0/3992228121 shutdown_connections 2024-09-17T07:30:32.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.019+0000 7f7d5eb1d640 1 -- 172.21.15.87:0/3992228121 wait complete. 2024-09-17T07:30:32.030 DEBUG:tasks.fs:max_mds reduced in epoch 29 2024-09-17T07:30:32.031 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 29 2024-09-17T07:30:32.031 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 30 2024-09-17T07:30:32.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.126+0000 7f6222e34640 1 -- 172.21.15.87:0/2818728652 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f621c1013c0 msgr2=0x7f621c101790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:32.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.126+0000 7f6222e34640 1 --2- 172.21.15.87:0/2818728652 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f621c1013c0 0x7f621c101790 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f62100048d0 tx=0x7f6210009da0 comp rx=0 tx=0).stop 2024-09-17T07:30:32.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.126+0000 7f6222e34640 1 -- 172.21.15.87:0/2818728652 shutdown_connections 2024-09-17T07:30:32.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.126+0000 7f6222e34640 1 --2- 172.21.15.87:0/2818728652 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f621c0fb3a0 0x7f621c0fb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:32.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.126+0000 7f6222e34640 1 --2- 172.21.15.87:0/2818728652 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f621c1013c0 0x7f621c101790 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:32.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.126+0000 7f6222e34640 1 -- 172.21.15.87:0/2818728652 >> 172.21.15.87:0/2818728652 conn(0x7f621c071360 msgr2=0x7f621c071760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:32.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.126+0000 7f6222e34640 1 -- 172.21.15.87:0/2818728652 shutdown_connections 2024-09-17T07:30:32.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.126+0000 7f6222e34640 1 -- 172.21.15.87:0/2818728652 wait complete. 2024-09-17T07:30:32.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.126+0000 7f6222e34640 1 Processor -- start 2024-09-17T07:30:32.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.126+0000 7f6222e34640 1 -- start start 2024-09-17T07:30:32.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.127+0000 7f6222e34640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f621c0fb3a0 0x7f621c111ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:32.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.127+0000 7f6222e34640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f621c1013c0 0x7f621c1121e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:32.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.127+0000 7f6222e34640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f621c1127e0 con 0x7f621c0fb3a0 2024-09-17T07:30:32.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.127+0000 7f6222e34640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f621c10be30 con 0x7f621c1013c0 2024-09-17T07:30:32.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.127+0000 7f6220bd0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f621c0fb3a0 0x7f621c111ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:32.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.127+0000 7f6220bd0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f621c0fb3a0 0x7f621c111ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46308/0 (socket says 172.21.15.87:46308) 2024-09-17T07:30:32.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.127+0000 7f6220bd0640 1 -- 172.21.15.87:0/1495415659 learned_addr learned my addr 172.21.15.87:0/1495415659 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:30:32.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.127+0000 7f621bfff640 1 --2- 172.21.15.87:0/1495415659 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f621c1013c0 0x7f621c1121e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:32.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.127+0000 7f6220bd0640 1 -- 172.21.15.87:0/1495415659 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f621c1013c0 msgr2=0x7f621c1121e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:32.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.127+0000 7f6220bd0640 1 --2- 172.21.15.87:0/1495415659 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f621c1013c0 0x7f621c1121e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:32.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.127+0000 7f6220bd0640 1 -- 172.21.15.87:0/1495415659 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6210005040 con 0x7f621c0fb3a0 2024-09-17T07:30:32.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.127+0000 7f6220bd0640 1 --2- 172.21.15.87:0/1495415659 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f621c0fb3a0 0x7f621c111ca0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f6210004930 tx=0x7f6210009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:32.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.127+0000 7f62197fa640 1 -- 172.21.15.87:0/1495415659 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6210038070 con 0x7f621c0fb3a0 2024-09-17T07:30:32.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.127+0000 7f6222e34640 1 -- 172.21.15.87:0/1495415659 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f621c10c0b0 con 0x7f621c0fb3a0 2024-09-17T07:30:32.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.127+0000 7f62197fa640 1 -- 172.21.15.87:0/1495415659 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f62100097e0 con 0x7f621c0fb3a0 2024-09-17T07:30:32.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.127+0000 7f62197fa640 1 -- 172.21.15.87:0/1495415659 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f621003c690 con 0x7f621c0fb3a0 2024-09-17T07:30:32.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.128+0000 7f6222e34640 1 -- 172.21.15.87:0/1495415659 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f621c10c5f0 con 0x7f621c0fb3a0 2024-09-17T07:30:32.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.129+0000 7f6222e34640 1 -- 172.21.15.87:0/1495415659 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f621c0fca80 con 0x7f621c0fb3a0 2024-09-17T07:30:32.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.129+0000 7f62197fa640 1 -- 172.21.15.87:0/1495415659 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f6210030020 con 0x7f621c0fb3a0 2024-09-17T07:30:32.131 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.129+0000 7f62197fa640 1 --2- 172.21.15.87:0/1495415659 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f620c06cba0 0x7f620c06f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:32.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.129+0000 7f62197fa640 1 -- 172.21.15.87:0/1495415659 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f62100ac260 con 0x7f621c0fb3a0 2024-09-17T07:30:32.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.129+0000 7f621bfff640 1 --2- 172.21.15.87:0/1495415659 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f620c06cba0 0x7f620c06f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:32.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.130+0000 7f621bfff640 1 --2- 172.21.15.87:0/1495415659 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f620c06cba0 0x7f620c06f050 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f621c10d560 tx=0x7f6208009040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:32.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.134+0000 7f62197fa640 1 -- 172.21.15.87:0/1495415659 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f6210076220 con 0x7f621c0fb3a0 2024-09-17T07:30:32.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.346+0000 7f6222e34640 1 -- 172.21.15.87:0/1495415659 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 30, "format": "json"} v 0) v1 -- 0x7f621c10d310 con 0x7f621c0fb3a0 2024-09-17T07:30:32.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.347+0000 7f62197fa640 1 -- 172.21.15.87:0/1495415659 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 30, "format": "json"}]=0 dumped fsmap epoch 30 v43) v1 ==== 107+0+4830 (secure 0 0 0) 0x7f6210079840 con 0x7f621c0fb3a0 2024-09-17T07:30:32.348 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:30:32.348 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34412,"name":"cephfs.smithi087.vvbzss","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6827/1050918039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1050918039},{"type":"v1","addr":"172.21.15.87:6827","nonce":1050918039}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":44261,"name":"cephfs.smithi139.ftvinf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6827/641133838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":641133838},{"type":"v1","addr":"172.21.15.139:6827","nonce":641133838}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":44289,"name":"cephfs.smithi139.gnwonz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6825/1004017136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":1004017136},{"type":"v1","addr":"172.21.15.139:6825","nonce":1004017136}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T07:17:15.368053+0000","modified":"2024-09-17T07:26:22.696739+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14478},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14478":{"gid":14478,"name":"cephfs.smithi087.tjhpcs","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.87:6829/2255237099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2255237099},{"type":"v1","addr":"172.21.15.87:6829","nonce":2255237099}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-17T07:30:32.348 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 30 2024-09-17T07:30:32.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.349+0000 7f6222e34640 1 -- 172.21.15.87:0/1495415659 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f620c06cba0 msgr2=0x7f620c06f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:32.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.349+0000 7f6222e34640 1 --2- 172.21.15.87:0/1495415659 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f620c06cba0 0x7f620c06f050 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f621c10d560 tx=0x7f6208009040 comp rx=0 tx=0).stop 2024-09-17T07:30:32.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.349+0000 7f6222e34640 1 -- 172.21.15.87:0/1495415659 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f621c0fb3a0 msgr2=0x7f621c111ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:32.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.349+0000 7f6222e34640 1 --2- 172.21.15.87:0/1495415659 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f621c0fb3a0 0x7f621c111ca0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f6210004930 tx=0x7f6210009da0 comp rx=0 tx=0).stop 2024-09-17T07:30:32.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.349+0000 7f6222e34640 1 -- 172.21.15.87:0/1495415659 shutdown_connections 2024-09-17T07:30:32.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.349+0000 7f6222e34640 1 --2- 172.21.15.87:0/1495415659 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f620c06cba0 0x7f620c06f050 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:32.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.349+0000 7f6222e34640 1 --2- 172.21.15.87:0/1495415659 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f621c1013c0 0x7f621c1121e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:32.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.349+0000 7f6222e34640 1 --2- 172.21.15.87:0/1495415659 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f621c0fb3a0 0x7f621c111ca0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:32.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.349+0000 7f6222e34640 1 -- 172.21.15.87:0/1495415659 >> 172.21.15.87:0/1495415659 conn(0x7f621c071360 msgr2=0x7f621c1040b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:32.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.349+0000 7f6222e34640 1 -- 172.21.15.87:0/1495415659 shutdown_connections 2024-09-17T07:30:32.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.349+0000 7f6222e34640 1 -- 172.21.15.87:0/1495415659 wait complete. 2024-09-17T07:30:32.361 DEBUG:tasks.fs:max_mds reduced in epoch 30 2024-09-17T07:30:32.361 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 30 2024-09-17T07:30:32.361 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 31 2024-09-17T07:30:32.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.456+0000 7faaf4f5d640 1 -- 172.21.15.87:0/848135344 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faaf01024c0 msgr2=0x7faaf0102890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:32.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.456+0000 7faaf4f5d640 1 --2- 172.21.15.87:0/848135344 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faaf01024c0 0x7faaf0102890 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7faae00048d0 tx=0x7faae0009da0 comp rx=0 tx=0).stop 2024-09-17T07:30:32.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.456+0000 7faaf4f5d640 1 -- 172.21.15.87:0/848135344 shutdown_connections 2024-09-17T07:30:32.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.456+0000 7faaf4f5d640 1 --2- 172.21.15.87:0/848135344 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faaf0064630 0x7faaf0064a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:32.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.456+0000 7faaf4f5d640 1 --2- 172.21.15.87:0/848135344 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faaf01024c0 0x7faaf0102890 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:32.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.456+0000 7faaf4f5d640 1 -- 172.21.15.87:0/848135344 >> 172.21.15.87:0/848135344 conn(0x7faaf0071360 msgr2=0x7faaf0071760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:32.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.456+0000 7faaf4f5d640 1 -- 172.21.15.87:0/848135344 shutdown_connections 2024-09-17T07:30:32.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.456+0000 7faaf4f5d640 1 -- 172.21.15.87:0/848135344 wait complete. 2024-09-17T07:30:32.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.457+0000 7faaf4f5d640 1 Processor -- start 2024-09-17T07:30:32.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.457+0000 7faaf4f5d640 1 -- start start 2024-09-17T07:30:32.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.457+0000 7faaf4f5d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faaf0064630 0x7faaf00fb430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:32.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.457+0000 7faaf4f5d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faaf01024c0 0x7faaf00fb970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:32.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.457+0000 7faaf4f5d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaf00fd310 con 0x7faaf0064630 2024-09-17T07:30:32.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.457+0000 7faaf4f5d640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaf00fbeb0 con 0x7faaf01024c0 2024-09-17T07:30:32.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.457+0000 7faaee59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faaf0064630 0x7faaf00fb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:32.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.457+0000 7faaee59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faaf0064630 0x7faaf00fb430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46322/0 (socket says 172.21.15.87:46322) 2024-09-17T07:30:32.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.457+0000 7faaee59c640 1 -- 172.21.15.87:0/3342465526 learned_addr learned my addr 172.21.15.87:0/3342465526 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:30:32.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.457+0000 7faae7fff640 1 --2- 172.21.15.87:0/3342465526 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faaf01024c0 0x7faaf00fb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:32.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.457+0000 7faaee59c640 1 -- 172.21.15.87:0/3342465526 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faaf01024c0 msgr2=0x7faaf00fb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:32.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.457+0000 7faaee59c640 1 --2- 172.21.15.87:0/3342465526 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faaf01024c0 0x7faaf00fb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:32.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.457+0000 7faaee59c640 1 -- 172.21.15.87:0/3342465526 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faae0005040 con 0x7faaf0064630 2024-09-17T07:30:32.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.457+0000 7faaee59c640 1 --2- 172.21.15.87:0/3342465526 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faaf0064630 0x7faaf00fb430 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7faae00043d0 tx=0x7faae0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:32.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.457+0000 7faae6ffd640 1 -- 172.21.15.87:0/3342465526 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faae0038070 con 0x7faaf0064630 2024-09-17T07:30:32.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.457+0000 7faaf4f5d640 1 -- 172.21.15.87:0/3342465526 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaf00fc130 con 0x7faaf0064630 2024-09-17T07:30:32.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.457+0000 7faae6ffd640 1 -- 172.21.15.87:0/3342465526 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7faae002ade0 con 0x7faaf0064630 2024-09-17T07:30:32.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.457+0000 7faae6ffd640 1 -- 172.21.15.87:0/3342465526 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faae002c770 con 0x7faaf0064630 2024-09-17T07:30:32.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.458+0000 7faaf4f5d640 1 -- 172.21.15.87:0/3342465526 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaf0119470 con 0x7faaf0064630 2024-09-17T07:30:32.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.459+0000 7faaf4f5d640 1 -- 172.21.15.87:0/3342465526 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaf00fdbc0 con 0x7faaf0064630 2024-09-17T07:30:32.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.459+0000 7faae6ffd640 1 -- 172.21.15.87:0/3342465526 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7faae0030020 con 0x7faaf0064630 2024-09-17T07:30:32.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.460+0000 7faae6ffd640 1 --2- 172.21.15.87:0/3342465526 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7faadc06cba0 0x7faadc06f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:32.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.460+0000 7faae6ffd640 1 -- 172.21.15.87:0/3342465526 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6496+0+0 (secure 0 0 0) 0x7faae00abda0 con 0x7faaf0064630 2024-09-17T07:30:32.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.460+0000 7faae7fff640 1 --2- 172.21.15.87:0/3342465526 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7faadc06cba0 0x7faadc06f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:32.462 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.460+0000 7faae7fff640 1 --2- 172.21.15.87:0/3342465526 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7faadc06cba0 0x7faadc06f050 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7faad8007fd0 tx=0x7faad8009e90 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:32.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.464+0000 7faae6ffd640 1 -- 172.21.15.87:0/3342465526 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7faae0075d60 con 0x7faaf0064630 2024-09-17T07:30:32.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.661+0000 7faaf4f5d640 1 -- 172.21.15.87:0/3342465526 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 31, "format": "json"} v 0) v1 -- 0x7faaf004bf60 con 0x7faaf0064630 2024-09-17T07:30:32.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.662+0000 7faae6ffd640 1 -- 172.21.15.87:0/3342465526 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 31, "format": "json"}]=0 dumped fsmap epoch 31 v43) v1 ==== 107+0+4041 (secure 0 0 0) 0x7faae0079380 con 0x7faaf0064630 2024-09-17T07:30:32.663 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:30:32.663 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34412,"name":"cephfs.smithi087.vvbzss","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6827/1050918039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1050918039},{"type":"v1","addr":"172.21.15.87:6827","nonce":1050918039}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":44261,"name":"cephfs.smithi139.ftvinf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6827/641133838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":641133838},{"type":"v1","addr":"172.21.15.139:6827","nonce":641133838}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":44289,"name":"cephfs.smithi139.gnwonz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6825/1004017136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":1004017136},{"type":"v1","addr":"172.21.15.139:6825","nonce":1004017136}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T07:17:15.368053+0000","modified":"2024-09-17T07:26:50.198379+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[1],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-17T07:30:32.663 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 31 2024-09-17T07:30:32.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.664+0000 7faaf4f5d640 1 -- 172.21.15.87:0/3342465526 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7faadc06cba0 msgr2=0x7faadc06f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:32.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.664+0000 7faaf4f5d640 1 --2- 172.21.15.87:0/3342465526 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7faadc06cba0 0x7faadc06f050 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7faad8007fd0 tx=0x7faad8009e90 comp rx=0 tx=0).stop 2024-09-17T07:30:32.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.664+0000 7faaf4f5d640 1 -- 172.21.15.87:0/3342465526 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faaf0064630 msgr2=0x7faaf00fb430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:32.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.664+0000 7faaf4f5d640 1 --2- 172.21.15.87:0/3342465526 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faaf0064630 0x7faaf00fb430 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7faae00043d0 tx=0x7faae0009da0 comp rx=0 tx=0).stop 2024-09-17T07:30:32.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.664+0000 7faaf4f5d640 1 -- 172.21.15.87:0/3342465526 shutdown_connections 2024-09-17T07:30:32.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.664+0000 7faaf4f5d640 1 --2- 172.21.15.87:0/3342465526 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7faadc06cba0 0x7faadc06f050 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:32.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.664+0000 7faaf4f5d640 1 --2- 172.21.15.87:0/3342465526 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faaf01024c0 0x7faaf00fb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:32.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.664+0000 7faaf4f5d640 1 --2- 172.21.15.87:0/3342465526 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faaf0064630 0x7faaf00fb430 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:32.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.664+0000 7faaf4f5d640 1 -- 172.21.15.87:0/3342465526 >> 172.21.15.87:0/3342465526 conn(0x7faaf0071360 msgr2=0x7faaf0105210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:32.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.664+0000 7faaf4f5d640 1 -- 172.21.15.87:0/3342465526 shutdown_connections 2024-09-17T07:30:32.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.664+0000 7faaf4f5d640 1 -- 172.21.15.87:0/3342465526 wait complete. 2024-09-17T07:30:32.674 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:32 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/450789531' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-09-17T07:30:32.674 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:32 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/3992228121' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-09-17T07:30:32.674 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:32 smithi087 ceph-mon[90982]: pgmap v295: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:30:32.674 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:32 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/1495415659' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-09-17T07:30:32.675 DEBUG:tasks.fs:max_mds reduced in epoch 31 2024-09-17T07:30:32.676 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 31 2024-09-17T07:30:32.676 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 32 2024-09-17T07:30:32.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.770+0000 7fa3ab24f640 1 -- 172.21.15.87:0/1101920336 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3a41024c0 msgr2=0x7fa3a4102890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:32.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.770+0000 7fa3ab24f640 1 --2- 172.21.15.87:0/1101920336 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3a41024c0 0x7fa3a4102890 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fa3a00048d0 tx=0x7fa3a0009da0 comp rx=0 tx=0).stop 2024-09-17T07:30:32.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.770+0000 7fa3ab24f640 1 -- 172.21.15.87:0/1101920336 shutdown_connections 2024-09-17T07:30:32.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.770+0000 7fa3ab24f640 1 --2- 172.21.15.87:0/1101920336 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3a40fc480 0x7fa3a40fc8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:32.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.770+0000 7fa3ab24f640 1 --2- 172.21.15.87:0/1101920336 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3a41024c0 0x7fa3a4102890 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:32.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.770+0000 7fa3ab24f640 1 -- 172.21.15.87:0/1101920336 >> 172.21.15.87:0/1101920336 conn(0x7fa3a40f8040 msgr2=0x7fa3a40fa450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:32.773 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.770+0000 7fa3ab24f640 1 -- 172.21.15.87:0/1101920336 shutdown_connections 2024-09-17T07:30:32.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.770+0000 7fa3ab24f640 1 -- 172.21.15.87:0/1101920336 wait complete. 2024-09-17T07:30:32.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.771+0000 7fa3ab24f640 1 Processor -- start 2024-09-17T07:30:32.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.771+0000 7fa3ab24f640 1 -- start start 2024-09-17T07:30:32.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.771+0000 7fa3ab24f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3a40fc480 0x7fa3a4112d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:32.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.771+0000 7fa3ab24f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3a41024c0 0x7fa3a41132d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:32.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.771+0000 7fa3ab24f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a41138d0 con 0x7fa3a40fc480 2024-09-17T07:30:32.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.771+0000 7fa3ab24f640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a410cf20 con 0x7fa3a41024c0 2024-09-17T07:30:32.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.771+0000 7fa3a8feb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3a40fc480 0x7fa3a4112d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:32.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.771+0000 7fa3a8feb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3a40fc480 0x7fa3a4112d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46330/0 (socket says 172.21.15.87:46330) 2024-09-17T07:30:32.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.771+0000 7fa3a8feb640 1 -- 172.21.15.87:0/439978021 learned_addr learned my addr 172.21.15.87:0/439978021 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:30:32.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.772+0000 7fa3a8feb640 1 -- 172.21.15.87:0/439978021 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3a41024c0 msgr2=0x7fa3a41132d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:32.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.772+0000 7fa3a8feb640 1 --2- 172.21.15.87:0/439978021 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3a41024c0 0x7fa3a41132d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:32.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.772+0000 7fa3a8feb640 1 -- 172.21.15.87:0/439978021 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a0005040 con 0x7fa3a40fc480 2024-09-17T07:30:32.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.772+0000 7fa3a8feb640 1 --2- 172.21.15.87:0/439978021 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3a40fc480 0x7fa3a4112d90 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa3a0003080 tx=0x7fa3a0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:32.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.772+0000 7fa3997fa640 1 -- 172.21.15.87:0/439978021 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3a0038070 con 0x7fa3a40fc480 2024-09-17T07:30:32.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.772+0000 7fa3997fa640 1 -- 172.21.15.87:0/439978021 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fa3a0009740 con 0x7fa3a40fc480 2024-09-17T07:30:32.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.772+0000 7fa3ab24f640 1 -- 172.21.15.87:0/439978021 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3a410d1a0 con 0x7fa3a40fc480 2024-09-17T07:30:32.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.772+0000 7fa3997fa640 1 -- 172.21.15.87:0/439978021 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3a002c8a0 con 0x7fa3a40fc480 2024-09-17T07:30:32.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.772+0000 7fa3ab24f640 1 -- 172.21.15.87:0/439978021 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3a410d6e0 con 0x7fa3a40fc480 2024-09-17T07:30:32.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.773+0000 7fa3ab24f640 1 -- 172.21.15.87:0/439978021 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3a40fdbc0 con 0x7fa3a40fc480 2024-09-17T07:30:32.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.773+0000 7fa3997fa640 1 -- 172.21.15.87:0/439978021 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fa3a0030020 con 0x7fa3a40fc480 2024-09-17T07:30:32.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.774+0000 7fa3997fa640 1 --2- 172.21.15.87:0/439978021 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fa38c06cba0 0x7fa38c06f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:32.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.774+0000 7fa3997fa640 1 -- 172.21.15.87:0/439978021 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fa3a00ac640 con 0x7fa3a40fc480 2024-09-17T07:30:32.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.774+0000 7fa39bfff640 1 --2- 172.21.15.87:0/439978021 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fa38c06cba0 0x7fa38c06f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:32.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.774+0000 7fa39bfff640 1 --2- 172.21.15.87:0/439978021 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fa38c06cba0 0x7fa38c06f050 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa3a410e650 tx=0x7fa394007cb0 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:32.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.778+0000 7fa3997fa640 1 -- 172.21.15.87:0/439978021 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa3a00766b0 con 0x7fa3a40fc480 2024-09-17T07:30:32.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:32 smithi139 ceph-mon[79872]: from='client.? 172.21.15.87:0/450789531' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-09-17T07:30:32.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:32 smithi139 ceph-mon[79872]: from='client.? 172.21.15.87:0/3992228121' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-09-17T07:30:32.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:32 smithi139 ceph-mon[79872]: pgmap v295: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:30:32.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:32 smithi139 ceph-mon[79872]: from='client.? 172.21.15.87:0/1495415659' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-09-17T07:30:32.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.975+0000 7fa3ab24f640 1 -- 172.21.15.87:0/439978021 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 32, "format": "json"} v 0) v1 -- 0x7fa3a4109300 con 0x7fa3a40fc480 2024-09-17T07:30:32.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.975+0000 7fa3997fa640 1 -- 172.21.15.87:0/439978021 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 32, "format": "json"}]=0 dumped fsmap epoch 32 v43) v1 ==== 107+0+4052 (secure 0 0 0) 0x7fa3a0079cd0 con 0x7fa3a40fc480 2024-09-17T07:30:32.977 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:30:32.977 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44261,"name":"cephfs.smithi139.ftvinf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6827/641133838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":641133838},{"type":"v1","addr":"172.21.15.139:6827","nonce":641133838}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":44289,"name":"cephfs.smithi139.gnwonz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6825/1004017136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":1004017136},{"type":"v1","addr":"172.21.15.139:6825","nonce":1004017136}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T07:17:15.368053+0000","modified":"2024-09-17T07:26:50.207061+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34412},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34412":{"gid":34412,"name":"cephfs.smithi087.vvbzss","rank":0,"incarnation":32,"state":"up:replay","state_seq":1,"addr":"172.21.15.87:6827/1050918039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1050918039},{"type":"v1","addr":"172.21.15.87:6827","nonce":1050918039}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-17T07:30:32.977 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 32 2024-09-17T07:30:32.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.977+0000 7fa3ab24f640 1 -- 172.21.15.87:0/439978021 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fa38c06cba0 msgr2=0x7fa38c06f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:32.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.977+0000 7fa3ab24f640 1 --2- 172.21.15.87:0/439978021 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fa38c06cba0 0x7fa38c06f050 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa3a410e650 tx=0x7fa394007cb0 comp rx=0 tx=0).stop 2024-09-17T07:30:32.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.977+0000 7fa3ab24f640 1 -- 172.21.15.87:0/439978021 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3a40fc480 msgr2=0x7fa3a4112d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:32.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.977+0000 7fa3ab24f640 1 --2- 172.21.15.87:0/439978021 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3a40fc480 0x7fa3a4112d90 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa3a0003080 tx=0x7fa3a0009da0 comp rx=0 tx=0).stop 2024-09-17T07:30:32.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.978+0000 7fa3ab24f640 1 -- 172.21.15.87:0/439978021 shutdown_connections 2024-09-17T07:30:32.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.978+0000 7fa3ab24f640 1 --2- 172.21.15.87:0/439978021 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fa38c06cba0 0x7fa38c06f050 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:32.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.978+0000 7fa3ab24f640 1 --2- 172.21.15.87:0/439978021 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3a41024c0 0x7fa3a41132d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:32.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.978+0000 7fa3ab24f640 1 --2- 172.21.15.87:0/439978021 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3a40fc480 0x7fa3a4112d90 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:32.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.978+0000 7fa3ab24f640 1 -- 172.21.15.87:0/439978021 >> 172.21.15.87:0/439978021 conn(0x7fa3a40f8040 msgr2=0x7fa3a40f99e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:32.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.978+0000 7fa3ab24f640 1 -- 172.21.15.87:0/439978021 shutdown_connections 2024-09-17T07:30:32.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:32.978+0000 7fa3ab24f640 1 -- 172.21.15.87:0/439978021 wait complete. 2024-09-17T07:30:32.989 DEBUG:tasks.fs:max_mds reduced in epoch 32 2024-09-17T07:30:32.990 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 32 2024-09-17T07:30:32.990 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 33 2024-09-17T07:30:33.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.083+0000 7fd5368dd640 1 -- 172.21.15.87:0/2471340633 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5301013c0 msgr2=0x7fd530101790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:33.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.083+0000 7fd5368dd640 1 --2- 172.21.15.87:0/2471340633 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5301013c0 0x7fd530101790 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd5200048d0 tx=0x7fd520009da0 comp rx=0 tx=0).stop 2024-09-17T07:30:33.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.083+0000 7fd5368dd640 1 -- 172.21.15.87:0/2471340633 shutdown_connections 2024-09-17T07:30:33.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.083+0000 7fd5368dd640 1 --2- 172.21.15.87:0/2471340633 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd5300fb3a0 0x7fd5300fb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:33.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.083+0000 7fd5368dd640 1 --2- 172.21.15.87:0/2471340633 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5301013c0 0x7fd530101790 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:33.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.083+0000 7fd5368dd640 1 -- 172.21.15.87:0/2471340633 >> 172.21.15.87:0/2471340633 conn(0x7fd530071360 msgr2=0x7fd530071760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:33.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.083+0000 7fd5368dd640 1 -- 172.21.15.87:0/2471340633 shutdown_connections 2024-09-17T07:30:33.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.084+0000 7fd5368dd640 1 -- 172.21.15.87:0/2471340633 wait complete. 2024-09-17T07:30:33.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.084+0000 7fd5368dd640 1 Processor -- start 2024-09-17T07:30:33.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.084+0000 7fd5368dd640 1 -- start start 2024-09-17T07:30:33.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.084+0000 7fd5368dd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd5300fb3a0 0x7fd53010df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:33.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.084+0000 7fd5368dd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5301013c0 0x7fd53010e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:33.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.084+0000 7fd5368dd640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd530065590 con 0x7fd5301013c0 2024-09-17T07:30:33.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.084+0000 7fd5368dd640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd53010ea10 con 0x7fd5300fb3a0 2024-09-17T07:30:33.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.084+0000 7fd52f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5301013c0 0x7fd53010e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:33.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.084+0000 7fd52f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5301013c0 0x7fd53010e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46350/0 (socket says 172.21.15.87:46350) 2024-09-17T07:30:33.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.084+0000 7fd52f7fe640 1 -- 172.21.15.87:0/1493766312 learned_addr learned my addr 172.21.15.87:0/1493766312 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:30:33.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.085+0000 7fd52ffff640 1 --2- 172.21.15.87:0/1493766312 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd5300fb3a0 0x7fd53010df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:33.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.085+0000 7fd52f7fe640 1 -- 172.21.15.87:0/1493766312 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd5300fb3a0 msgr2=0x7fd53010df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:33.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.085+0000 7fd52f7fe640 1 --2- 172.21.15.87:0/1493766312 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd5300fb3a0 0x7fd53010df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:33.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.085+0000 7fd52f7fe640 1 -- 172.21.15.87:0/1493766312 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd520005040 con 0x7fd5301013c0 2024-09-17T07:30:33.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.085+0000 7fd52f7fe640 1 --2- 172.21.15.87:0/1493766312 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5301013c0 0x7fd53010e4d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd524002a50 tx=0x7fd524004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:33.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.085+0000 7fd52cff9640 1 -- 172.21.15.87:0/1493766312 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd524007c30 con 0x7fd5301013c0 2024-09-17T07:30:33.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.085+0000 7fd52cff9640 1 -- 172.21.15.87:0/1493766312 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fd52400f040 con 0x7fd5301013c0 2024-09-17T07:30:33.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.085+0000 7fd5368dd640 1 -- 172.21.15.87:0/1493766312 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd53010ecf0 con 0x7fd5301013c0 2024-09-17T07:30:33.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.085+0000 7fd52cff9640 1 -- 172.21.15.87:0/1493766312 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd52400d910 con 0x7fd5301013c0 2024-09-17T07:30:33.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.085+0000 7fd5368dd640 1 -- 172.21.15.87:0/1493766312 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd530117330 con 0x7fd5301013c0 2024-09-17T07:30:33.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.086+0000 7fd5368dd640 1 -- 172.21.15.87:0/1493766312 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5300fca80 con 0x7fd5301013c0 2024-09-17T07:30:33.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.086+0000 7fd52cff9640 1 -- 172.21.15.87:0/1493766312 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fd52400dbd0 con 0x7fd5301013c0 2024-09-17T07:30:33.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.087+0000 7fd52cff9640 1 --2- 172.21.15.87:0/1493766312 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fd51806cba0 0x7fd51806f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:33.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.087+0000 7fd52cff9640 1 -- 172.21.15.87:0/1493766312 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fd52408b9c0 con 0x7fd5301013c0 2024-09-17T07:30:33.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.087+0000 7fd52ffff640 1 --2- 172.21.15.87:0/1493766312 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fd51806cba0 0x7fd51806f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:33.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.087+0000 7fd52ffff640 1 --2- 172.21.15.87:0/1493766312 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fd51806cba0 0x7fd51806f050 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd520009ac0 tx=0x7fd520035040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:33.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.091+0000 7fd52cff9640 1 -- 172.21.15.87:0/1493766312 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd524055980 con 0x7fd5301013c0 2024-09-17T07:30:33.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.286+0000 7fd5368dd640 1 -- 172.21.15.87:0/1493766312 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 33, "format": "json"} v 0) v1 -- 0x7fd53004bf60 con 0x7fd5301013c0 2024-09-17T07:30:33.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.287+0000 7fd52cff9640 1 -- 172.21.15.87:0/1493766312 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 33, "format": "json"}]=0 dumped fsmap epoch 33 v43) v1 ==== 107+0+4055 (secure 0 0 0) 0x7fd524058fa0 con 0x7fd5301013c0 2024-09-17T07:30:33.288 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:30:33.288 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":33,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44261,"name":"cephfs.smithi139.ftvinf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6827/641133838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":641133838},{"type":"v1","addr":"172.21.15.139:6827","nonce":641133838}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":44289,"name":"cephfs.smithi139.gnwonz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6825/1004017136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":1004017136},{"type":"v1","addr":"172.21.15.139:6825","nonce":1004017136}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T07:17:15.368053+0000","modified":"2024-09-17T07:26:56.187079+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34412},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34412":{"gid":34412,"name":"cephfs.smithi087.vvbzss","rank":0,"incarnation":32,"state":"up:reconnect","state_seq":6,"addr":"172.21.15.87:6827/1050918039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1050918039},{"type":"v1","addr":"172.21.15.87:6827","nonce":1050918039}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-17T07:30:33.289 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 33 2024-09-17T07:30:33.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.289+0000 7fd5368dd640 1 -- 172.21.15.87:0/1493766312 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fd51806cba0 msgr2=0x7fd51806f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:33.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.289+0000 7fd5368dd640 1 --2- 172.21.15.87:0/1493766312 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fd51806cba0 0x7fd51806f050 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd520009ac0 tx=0x7fd520035040 comp rx=0 tx=0).stop 2024-09-17T07:30:33.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.289+0000 7fd5368dd640 1 -- 172.21.15.87:0/1493766312 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5301013c0 msgr2=0x7fd53010e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:33.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.289+0000 7fd5368dd640 1 --2- 172.21.15.87:0/1493766312 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5301013c0 0x7fd53010e4d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd524002a50 tx=0x7fd524004600 comp rx=0 tx=0).stop 2024-09-17T07:30:33.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.289+0000 7fd5368dd640 1 -- 172.21.15.87:0/1493766312 shutdown_connections 2024-09-17T07:30:33.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.289+0000 7fd5368dd640 1 --2- 172.21.15.87:0/1493766312 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5301013c0 0x7fd53010e4d0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:33.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.289+0000 7fd5368dd640 1 --2- 172.21.15.87:0/1493766312 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fd51806cba0 0x7fd51806f050 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:33.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.289+0000 7fd5368dd640 1 --2- 172.21.15.87:0/1493766312 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd5300fb3a0 0x7fd53010df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:33.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.289+0000 7fd5368dd640 1 -- 172.21.15.87:0/1493766312 >> 172.21.15.87:0/1493766312 conn(0x7fd530071360 msgr2=0x7fd5301040b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:33.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.289+0000 7fd5368dd640 1 -- 172.21.15.87:0/1493766312 shutdown_connections 2024-09-17T07:30:33.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.289+0000 7fd5368dd640 1 -- 172.21.15.87:0/1493766312 wait complete. 2024-09-17T07:30:33.301 DEBUG:tasks.fs:max_mds reduced in epoch 33 2024-09-17T07:30:33.301 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 33 2024-09-17T07:30:33.301 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 34 2024-09-17T07:30:33.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.396+0000 7f99086b8640 1 -- 172.21.15.87:0/4174713195 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9900101ef0 msgr2=0x7f99000fb5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:33.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.396+0000 7f99086b8640 1 --2- 172.21.15.87:0/4174713195 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9900101ef0 0x7f99000fb5b0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f98f00048d0 tx=0x7f98f0009da0 comp rx=0 tx=0).stop 2024-09-17T07:30:33.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.396+0000 7f99086b8640 1 -- 172.21.15.87:0/4174713195 shutdown_connections 2024-09-17T07:30:33.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.396+0000 7f99086b8640 1 --2- 172.21.15.87:0/4174713195 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9900101ef0 0x7f99000fb5b0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:33.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.396+0000 7f99086b8640 1 --2- 172.21.15.87:0/4174713195 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9900101550 0x7f9900101920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:33.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.396+0000 7f99086b8640 1 -- 172.21.15.87:0/4174713195 >> 172.21.15.87:0/4174713195 conn(0x7f99000f7110 msgr2=0x7f99000f9520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:33.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.396+0000 7f99086b8640 1 -- 172.21.15.87:0/4174713195 shutdown_connections 2024-09-17T07:30:33.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.396+0000 7f99086b8640 1 -- 172.21.15.87:0/4174713195 wait complete. 2024-09-17T07:30:33.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.396+0000 7f99086b8640 1 Processor -- start 2024-09-17T07:30:33.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.396+0000 7f99086b8640 1 -- start start 2024-09-17T07:30:33.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.397+0000 7f99086b8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9900101550 0x7f990010e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:33.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.397+0000 7f99086b8640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9900101ef0 0x7f990010e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:33.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.397+0000 7f99086b8640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f990010eca0 con 0x7f9900101550 2024-09-17T07:30:33.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.397+0000 7f99086b8640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f990010ee10 con 0x7f9900101ef0 2024-09-17T07:30:33.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.397+0000 7f9906454640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9900101550 0x7f990010e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:33.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.397+0000 7f9906454640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9900101550 0x7f990010e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46370/0 (socket says 172.21.15.87:46370) 2024-09-17T07:30:33.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.397+0000 7f9906454640 1 -- 172.21.15.87:0/957244584 learned_addr learned my addr 172.21.15.87:0/957244584 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:30:33.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.397+0000 7f9905c53640 1 --2- 172.21.15.87:0/957244584 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9900101ef0 0x7f990010e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:33.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.397+0000 7f9906454640 1 -- 172.21.15.87:0/957244584 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9900101ef0 msgr2=0x7f990010e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:33.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.397+0000 7f9906454640 1 --2- 172.21.15.87:0/957244584 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9900101ef0 0x7f990010e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:33.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.397+0000 7f9906454640 1 -- 172.21.15.87:0/957244584 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98f0005040 con 0x7f9900101550 2024-09-17T07:30:33.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.397+0000 7f9905c53640 1 --2- 172.21.15.87:0/957244584 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9900101ef0 0x7f990010e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T07:30:33.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.397+0000 7f9906454640 1 --2- 172.21.15.87:0/957244584 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9900101550 0x7f990010e220 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f98fc00b790 tx=0x7f98fc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:33.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.397+0000 7f98f6ffd640 1 -- 172.21.15.87:0/957244584 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98fc00c700 con 0x7f9900101550 2024-09-17T07:30:33.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.397+0000 7f98f6ffd640 1 -- 172.21.15.87:0/957244584 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f98fc00cce0 con 0x7f9900101550 2024-09-17T07:30:33.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.397+0000 7f99086b8640 1 -- 172.21.15.87:0/957244584 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9900117290 con 0x7f9900101550 2024-09-17T07:30:33.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.397+0000 7f98f6ffd640 1 -- 172.21.15.87:0/957244584 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98fc015e10 con 0x7f9900101550 2024-09-17T07:30:33.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.397+0000 7f99086b8640 1 -- 172.21.15.87:0/957244584 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9900117610 con 0x7f9900101550 2024-09-17T07:30:33.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.398+0000 7f99086b8640 1 -- 172.21.15.87:0/957244584 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99000fccd0 con 0x7f9900101550 2024-09-17T07:30:33.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.399+0000 7f98f6ffd640 1 -- 172.21.15.87:0/957244584 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f98fc012070 con 0x7f9900101550 2024-09-17T07:30:33.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.399+0000 7f98f6ffd640 1 --2- 172.21.15.87:0/957244584 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f98ec06cba0 0x7f98ec06f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:33.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.400+0000 7f9905c53640 1 --2- 172.21.15.87:0/957244584 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f98ec06cba0 0x7f98ec06f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:33.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.400+0000 7f98f6ffd640 1 -- 172.21.15.87:0/957244584 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f98fc08bc20 con 0x7f9900101550 2024-09-17T07:30:33.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.400+0000 7f9905c53640 1 --2- 172.21.15.87:0/957244584 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f98ec06cba0 0x7f98ec06f050 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f98f0000c00 tx=0x7f98f0035040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:33.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.404+0000 7f98f6ffd640 1 -- 172.21.15.87:0/957244584 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f98fc055c60 con 0x7f9900101550 2024-09-17T07:30:33.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.601+0000 7f99086b8640 1 -- 172.21.15.87:0/957244584 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 34, "format": "json"} v 0) v1 -- 0x7f990004bf60 con 0x7f9900101550 2024-09-17T07:30:33.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.602+0000 7f98f6ffd640 1 -- 172.21.15.87:0/957244584 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 34, "format": "json"}]=0 dumped fsmap epoch 34 v43) v1 ==== 107+0+4052 (secure 0 0 0) 0x7f98fc059280 con 0x7f9900101550 2024-09-17T07:30:33.605 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:30:33.605 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44261,"name":"cephfs.smithi139.ftvinf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6827/641133838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":641133838},{"type":"v1","addr":"172.21.15.139:6827","nonce":641133838}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":44289,"name":"cephfs.smithi139.gnwonz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6825/1004017136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":1004017136},{"type":"v1","addr":"172.21.15.139:6825","nonce":1004017136}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T07:17:15.368053+0000","modified":"2024-09-17T07:26:57.194639+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34412},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34412":{"gid":34412,"name":"cephfs.smithi087.vvbzss","rank":0,"incarnation":32,"state":"up:rejoin","state_seq":7,"addr":"172.21.15.87:6827/1050918039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1050918039},{"type":"v1","addr":"172.21.15.87:6827","nonce":1050918039}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-17T07:30:33.606 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 34 2024-09-17T07:30:33.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.604+0000 7f99086b8640 1 -- 172.21.15.87:0/957244584 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f98ec06cba0 msgr2=0x7f98ec06f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:33.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.604+0000 7f99086b8640 1 --2- 172.21.15.87:0/957244584 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f98ec06cba0 0x7f98ec06f050 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f98f0000c00 tx=0x7f98f0035040 comp rx=0 tx=0).stop 2024-09-17T07:30:33.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.604+0000 7f99086b8640 1 -- 172.21.15.87:0/957244584 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9900101550 msgr2=0x7f990010e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:33.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.604+0000 7f99086b8640 1 --2- 172.21.15.87:0/957244584 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9900101550 0x7f990010e220 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f98fc00b790 tx=0x7f98fc0091d0 comp rx=0 tx=0).stop 2024-09-17T07:30:33.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.604+0000 7f99086b8640 1 -- 172.21.15.87:0/957244584 shutdown_connections 2024-09-17T07:30:33.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.604+0000 7f99086b8640 1 --2- 172.21.15.87:0/957244584 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f98ec06cba0 0x7f98ec06f050 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:33.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.604+0000 7f99086b8640 1 --2- 172.21.15.87:0/957244584 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9900101ef0 0x7f990010e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:33.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.604+0000 7f99086b8640 1 --2- 172.21.15.87:0/957244584 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9900101550 0x7f990010e220 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:33.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.604+0000 7f99086b8640 1 -- 172.21.15.87:0/957244584 >> 172.21.15.87:0/957244584 conn(0x7f99000f7110 msgr2=0x7f99000f8320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:33.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.604+0000 7f99086b8640 1 -- 172.21.15.87:0/957244584 shutdown_connections 2024-09-17T07:30:33.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.604+0000 7f99086b8640 1 -- 172.21.15.87:0/957244584 wait complete. 2024-09-17T07:30:33.614 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:33 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/3342465526' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-09-17T07:30:33.615 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:33 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/439978021' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-09-17T07:30:33.615 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:33 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/1493766312' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-09-17T07:30:33.616 DEBUG:tasks.fs:max_mds reduced in epoch 34 2024-09-17T07:30:33.616 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 34 2024-09-17T07:30:33.616 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 35 2024-09-17T07:30:33.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.710+0000 7ff299d9d640 1 -- 172.21.15.87:0/1299849083 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff294101370 msgr2=0x7ff294101740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:33.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.710+0000 7ff299d9d640 1 --2- 172.21.15.87:0/1299849083 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff294101370 0x7ff294101740 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff2840048d0 tx=0x7ff284009da0 comp rx=0 tx=0).stop 2024-09-17T07:30:33.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.710+0000 7ff299d9d640 1 -- 172.21.15.87:0/1299849083 shutdown_connections 2024-09-17T07:30:33.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.710+0000 7ff299d9d640 1 --2- 172.21.15.87:0/1299849083 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff294101d10 0x7ff2940fbc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:33.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.710+0000 7ff299d9d640 1 --2- 172.21.15.87:0/1299849083 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff294101370 0x7ff294101740 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:33.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.710+0000 7ff299d9d640 1 -- 172.21.15.87:0/1299849083 >> 172.21.15.87:0/1299849083 conn(0x7ff294070b30 msgr2=0x7ff294070f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:33.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.710+0000 7ff299d9d640 1 -- 172.21.15.87:0/1299849083 shutdown_connections 2024-09-17T07:30:33.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.710+0000 7ff299d9d640 1 -- 172.21.15.87:0/1299849083 wait complete. 2024-09-17T07:30:33.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.710+0000 7ff299d9d640 1 Processor -- start 2024-09-17T07:30:33.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.711+0000 7ff299d9d640 1 -- start start 2024-09-17T07:30:33.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.711+0000 7ff299d9d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff294101370 0x7ff29410dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:33.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.711+0000 7ff299d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff294101d10 0x7ff29410e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:33.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.711+0000 7ff299d9d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2940fbb10 con 0x7ff294101d10 2024-09-17T07:30:33.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.711+0000 7ff299d9d640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff29410ea70 con 0x7ff294101370 2024-09-17T07:30:33.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.711+0000 7ff28bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff294101d10 0x7ff29410e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:33.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.711+0000 7ff28bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff294101d10 0x7ff29410e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46386/0 (socket says 172.21.15.87:46386) 2024-09-17T07:30:33.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.711+0000 7ff28bfff640 1 -- 172.21.15.87:0/3551772274 learned_addr learned my addr 172.21.15.87:0/3551772274 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:30:33.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.711+0000 7ff2937fe640 1 --2- 172.21.15.87:0/3551772274 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff294101370 0x7ff29410dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:33.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.711+0000 7ff28bfff640 1 -- 172.21.15.87:0/3551772274 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff294101370 msgr2=0x7ff29410dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:33.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.711+0000 7ff28bfff640 1 --2- 172.21.15.87:0/3551772274 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff294101370 0x7ff29410dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:33.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.711+0000 7ff28bfff640 1 -- 172.21.15.87:0/3551772274 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff284005040 con 0x7ff294101d10 2024-09-17T07:30:33.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.711+0000 7ff28bfff640 1 --2- 172.21.15.87:0/3551772274 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff294101d10 0x7ff29410e500 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff27c002870 tx=0x7ff27c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:33.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.711+0000 7ff290ff9640 1 -- 172.21.15.87:0/3551772274 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff27c007c30 con 0x7ff294101d10 2024-09-17T07:30:33.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.711+0000 7ff290ff9640 1 -- 172.21.15.87:0/3551772274 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7ff27c00f040 con 0x7ff294101d10 2024-09-17T07:30:33.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.711+0000 7ff299d9d640 1 -- 172.21.15.87:0/3551772274 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff29410ed50 con 0x7ff294101d10 2024-09-17T07:30:33.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.711+0000 7ff290ff9640 1 -- 172.21.15.87:0/3551772274 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff27c00d960 con 0x7ff294101d10 2024-09-17T07:30:33.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.711+0000 7ff299d9d640 1 -- 172.21.15.87:0/3551772274 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff294117360 con 0x7ff294101d10 2024-09-17T07:30:33.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.712+0000 7ff299d9d640 1 -- 172.21.15.87:0/3551772274 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2940fcc70 con 0x7ff294101d10 2024-09-17T07:30:33.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.713+0000 7ff290ff9640 1 -- 172.21.15.87:0/3551772274 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7ff27c00dbd0 con 0x7ff294101d10 2024-09-17T07:30:33.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.713+0000 7ff290ff9640 1 --2- 172.21.15.87:0/3551772274 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7ff28006cb90 0x7ff28006f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:33.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.713+0000 7ff290ff9640 1 -- 172.21.15.87:0/3551772274 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6496+0+0 (secure 0 0 0) 0x7ff27c08b760 con 0x7ff294101d10 2024-09-17T07:30:33.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.713+0000 7ff2937fe640 1 --2- 172.21.15.87:0/3551772274 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7ff28006cb90 0x7ff28006f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:33.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.714+0000 7ff2937fe640 1 --2- 172.21.15.87:0/3551772274 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7ff28006cb90 0x7ff28006f040 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff284000c00 tx=0x7ff284035040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:33.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.717+0000 7ff290ff9640 1 -- 172.21.15.87:0/3551772274 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff27c0557d0 con 0x7ff294101d10 2024-09-17T07:30:33.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:33 smithi139 ceph-mon[79872]: from='client.? 172.21.15.87:0/3342465526' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-09-17T07:30:33.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:33 smithi139 ceph-mon[79872]: from='client.? 172.21.15.87:0/439978021' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-09-17T07:30:33.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:33 smithi139 ceph-mon[79872]: from='client.? 172.21.15.87:0/1493766312' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-09-17T07:30:33.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.911+0000 7ff299d9d640 1 -- 172.21.15.87:0/3551772274 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 35, "format": "json"} v 0) v1 -- 0x7ff29404bf60 con 0x7ff294101d10 2024-09-17T07:30:33.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.912+0000 7ff290ff9640 1 -- 172.21.15.87:0/3551772274 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 35, "format": "json"}]=0 dumped fsmap epoch 35 v43) v1 ==== 107+0+4052 (secure 0 0 0) 0x7ff27c058df0 con 0x7ff294101d10 2024-09-17T07:30:33.913 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:30:33.913 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":35,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44261,"name":"cephfs.smithi139.ftvinf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6827/641133838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":641133838},{"type":"v1","addr":"172.21.15.139:6827","nonce":641133838}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":44289,"name":"cephfs.smithi139.gnwonz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6825/1004017136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":1004017136},{"type":"v1","addr":"172.21.15.139:6825","nonce":1004017136}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T07:17:15.368053+0000","modified":"2024-09-17T07:26:58.204675+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34412},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34412":{"gid":34412,"name":"cephfs.smithi087.vvbzss","rank":0,"incarnation":32,"state":"up:active","state_seq":8,"addr":"172.21.15.87:6827/1050918039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1050918039},{"type":"v1","addr":"172.21.15.87:6827","nonce":1050918039}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-17T07:30:33.913 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 35 2024-09-17T07:30:33.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.914+0000 7ff299d9d640 1 -- 172.21.15.87:0/3551772274 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7ff28006cb90 msgr2=0x7ff28006f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:33.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.914+0000 7ff299d9d640 1 --2- 172.21.15.87:0/3551772274 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7ff28006cb90 0x7ff28006f040 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff284000c00 tx=0x7ff284035040 comp rx=0 tx=0).stop 2024-09-17T07:30:33.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.914+0000 7ff299d9d640 1 -- 172.21.15.87:0/3551772274 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff294101d10 msgr2=0x7ff29410e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:33.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.914+0000 7ff299d9d640 1 --2- 172.21.15.87:0/3551772274 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff294101d10 0x7ff29410e500 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff27c002870 tx=0x7ff27c004600 comp rx=0 tx=0).stop 2024-09-17T07:30:33.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.914+0000 7ff299d9d640 1 -- 172.21.15.87:0/3551772274 shutdown_connections 2024-09-17T07:30:33.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.914+0000 7ff299d9d640 1 --2- 172.21.15.87:0/3551772274 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff294101d10 0x7ff29410e500 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:33.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.914+0000 7ff299d9d640 1 --2- 172.21.15.87:0/3551772274 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7ff28006cb90 0x7ff28006f040 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:33.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.914+0000 7ff299d9d640 1 --2- 172.21.15.87:0/3551772274 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff294101370 0x7ff29410dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:33.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.914+0000 7ff299d9d640 1 -- 172.21.15.87:0/3551772274 >> 172.21.15.87:0/3551772274 conn(0x7ff294070b30 msgr2=0x7ff294104110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:33.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.914+0000 7ff299d9d640 1 -- 172.21.15.87:0/3551772274 shutdown_connections 2024-09-17T07:30:33.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:33.914+0000 7ff299d9d640 1 -- 172.21.15.87:0/3551772274 wait complete. 2024-09-17T07:30:33.925 DEBUG:tasks.fs:max_mds reduced in epoch 35 2024-09-17T07:30:33.925 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 35 2024-09-17T07:30:33.926 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 36 2024-09-17T07:30:34.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.020+0000 7f80fbcd4640 1 -- 172.21.15.87:0/3919701588 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80f41024a0 msgr2=0x7f80f4102870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:34.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.020+0000 7f80fbcd4640 1 --2- 172.21.15.87:0/3919701588 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80f41024a0 0x7f80f4102870 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f80f00048d0 tx=0x7f80f0009da0 comp rx=0 tx=0).stop 2024-09-17T07:30:34.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.020+0000 7f80fbcd4640 1 -- 172.21.15.87:0/3919701588 shutdown_connections 2024-09-17T07:30:34.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.020+0000 7f80fbcd4640 1 --2- 172.21.15.87:0/3919701588 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80f40fab50 0x7f80f40fafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:34.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.020+0000 7f80fbcd4640 1 --2- 172.21.15.87:0/3919701588 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80f41024a0 0x7f80f4102870 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:34.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.020+0000 7f80fbcd4640 1 -- 172.21.15.87:0/3919701588 >> 172.21.15.87:0/3919701588 conn(0x7f80f4070b30 msgr2=0x7f80f4070f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:34.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.020+0000 7f80fbcd4640 1 -- 172.21.15.87:0/3919701588 shutdown_connections 2024-09-17T07:30:34.023 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.020+0000 7f80fbcd4640 1 -- 172.21.15.87:0/3919701588 wait complete. 2024-09-17T07:30:34.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.021+0000 7f80fbcd4640 1 Processor -- start 2024-09-17T07:30:34.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.021+0000 7f80fbcd4640 1 -- start start 2024-09-17T07:30:34.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.021+0000 7f80fbcd4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80f40fab50 0x7f80f40fbd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:34.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.021+0000 7f80fbcd4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80f41024a0 0x7f80f40fc270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:34.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.021+0000 7f80fbcd4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80f40fdca0 con 0x7f80f41024a0 2024-09-17T07:30:34.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.021+0000 7f80fbcd4640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80f40fc7b0 con 0x7f80f40fab50 2024-09-17T07:30:34.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.021+0000 7f80f926f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80f41024a0 0x7f80f40fc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:34.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.021+0000 7f80f926f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80f41024a0 0x7f80f40fc270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:46410/0 (socket says 172.21.15.87:46410) 2024-09-17T07:30:34.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.021+0000 7f80f926f640 1 -- 172.21.15.87:0/90854505 learned_addr learned my addr 172.21.15.87:0/90854505 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:30:34.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.021+0000 7f80f9a70640 1 --2- 172.21.15.87:0/90854505 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80f40fab50 0x7f80f40fbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:34.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.021+0000 7f80f926f640 1 -- 172.21.15.87:0/90854505 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80f40fab50 msgr2=0x7f80f40fbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:34.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.021+0000 7f80f926f640 1 --2- 172.21.15.87:0/90854505 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80f40fab50 0x7f80f40fbd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:34.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.021+0000 7f80f926f640 1 -- 172.21.15.87:0/90854505 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80f0005040 con 0x7f80f41024a0 2024-09-17T07:30:34.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.021+0000 7f80f926f640 1 --2- 172.21.15.87:0/90854505 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80f41024a0 0x7f80f40fc270 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f80e400b790 tx=0x7f80e40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:34.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.021+0000 7f80ea7fc640 1 -- 172.21.15.87:0/90854505 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f80e400c700 con 0x7f80f41024a0 2024-09-17T07:30:34.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.021+0000 7f80ea7fc640 1 -- 172.21.15.87:0/90854505 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f80e400cce0 con 0x7f80f41024a0 2024-09-17T07:30:34.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.021+0000 7f80fbcd4640 1 -- 172.21.15.87:0/90854505 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80f40fca30 con 0x7f80f41024a0 2024-09-17T07:30:34.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.021+0000 7f80ea7fc640 1 -- 172.21.15.87:0/90854505 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f80e4015e10 con 0x7f80f41024a0 2024-09-17T07:30:34.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.022+0000 7f80fbcd4640 1 -- 172.21.15.87:0/90854505 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80f41195d0 con 0x7f80f41024a0 2024-09-17T07:30:34.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.023+0000 7f80fbcd4640 1 -- 172.21.15.87:0/90854505 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80f4065540 con 0x7f80f41024a0 2024-09-17T07:30:34.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.023+0000 7f80ea7fc640 1 -- 172.21.15.87:0/90854505 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f80e4012070 con 0x7f80f41024a0 2024-09-17T07:30:34.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.023+0000 7f80ea7fc640 1 --2- 172.21.15.87:0/90854505 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f80e006cb90 0x7f80e006f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:34.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.023+0000 7f80ea7fc640 1 -- 172.21.15.87:0/90854505 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f80e408bbf0 con 0x7f80f41024a0 2024-09-17T07:30:34.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.024+0000 7f80f9a70640 1 --2- 172.21.15.87:0/90854505 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f80e006cb90 0x7f80e006f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:34.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.024+0000 7f80f9a70640 1 --2- 172.21.15.87:0/90854505 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f80e006cb90 0x7f80e006f040 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f80f0009ac0 tx=0x7f80f0035040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:34.028 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.028+0000 7f80ea7fc640 1 -- 172.21.15.87:0/90854505 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f80e4092080 con 0x7f80f41024a0 2024-09-17T07:30:34.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.224+0000 7f80fbcd4640 1 -- 172.21.15.87:0/90854505 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 36, "format": "json"} v 0) v1 -- 0x7f80f40fd210 con 0x7f80f41024a0 2024-09-17T07:30:34.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.225+0000 7f80ea7fc640 1 -- 172.21.15.87:0/90854505 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 36, "format": "json"}]=0 dumped fsmap epoch 36 v43) v1 ==== 107+0+4831 (secure 0 0 0) 0x7f80e4055c30 con 0x7f80f41024a0 2024-09-17T07:30:34.227 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:30:34.227 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34444,"name":"cephfs.smithi087.tjhpcs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6829/2375971201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2375971201},{"type":"v1","addr":"172.21.15.87:6829","nonce":2375971201}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":44261,"name":"cephfs.smithi139.ftvinf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6827/641133838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":641133838},{"type":"v1","addr":"172.21.15.139:6827","nonce":641133838}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":44289,"name":"cephfs.smithi139.gnwonz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6825/1004017136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":1004017136},{"type":"v1","addr":"172.21.15.139:6825","nonce":1004017136}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T07:17:15.368053+0000","modified":"2024-09-17T07:26:58.204675+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34412},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34412":{"gid":34412,"name":"cephfs.smithi087.vvbzss","rank":0,"incarnation":32,"state":"up:active","state_seq":8,"addr":"172.21.15.87:6827/1050918039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1050918039},{"type":"v1","addr":"172.21.15.87:6827","nonce":1050918039}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-17T07:30:34.229 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 36 2024-09-17T07:30:34.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.227+0000 7f80fbcd4640 1 -- 172.21.15.87:0/90854505 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f80e006cb90 msgr2=0x7f80e006f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:34.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.227+0000 7f80fbcd4640 1 --2- 172.21.15.87:0/90854505 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f80e006cb90 0x7f80e006f040 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f80f0009ac0 tx=0x7f80f0035040 comp rx=0 tx=0).stop 2024-09-17T07:30:34.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.227+0000 7f80fbcd4640 1 -- 172.21.15.87:0/90854505 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80f41024a0 msgr2=0x7f80f40fc270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:34.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.227+0000 7f80fbcd4640 1 --2- 172.21.15.87:0/90854505 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80f41024a0 0x7f80f40fc270 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f80e400b790 tx=0x7f80e40091d0 comp rx=0 tx=0).stop 2024-09-17T07:30:34.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.227+0000 7f80fbcd4640 1 -- 172.21.15.87:0/90854505 shutdown_connections 2024-09-17T07:30:34.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.227+0000 7f80fbcd4640 1 --2- 172.21.15.87:0/90854505 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80f41024a0 0x7f80f40fc270 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:34.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.227+0000 7f80fbcd4640 1 --2- 172.21.15.87:0/90854505 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f80e006cb90 0x7f80e006f040 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:34.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.227+0000 7f80fbcd4640 1 --2- 172.21.15.87:0/90854505 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80f40fab50 0x7f80f40fbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:34.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.227+0000 7f80fbcd4640 1 -- 172.21.15.87:0/90854505 >> 172.21.15.87:0/90854505 conn(0x7f80f4070b30 msgr2=0x7f80f41051f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:34.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.227+0000 7f80fbcd4640 1 -- 172.21.15.87:0/90854505 shutdown_connections 2024-09-17T07:30:34.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.227+0000 7f80fbcd4640 1 -- 172.21.15.87:0/90854505 wait complete. 2024-09-17T07:30:34.238 DEBUG:tasks.fs:max_mds reduced in epoch 36 2024-09-17T07:30:34.239 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 36 2024-09-17T07:30:34.239 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 37 2024-09-17T07:30:34.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.334+0000 7f7df12dd640 1 -- 172.21.15.87:0/39976395 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7dec101530 msgr2=0x7f7dec101900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:34.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.334+0000 7f7df12dd640 1 --2- 172.21.15.87:0/39976395 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7dec101530 0x7f7dec101900 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7de40048d0 tx=0x7f7de4009da0 comp rx=0 tx=0).stop 2024-09-17T07:30:34.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.334+0000 7f7df12dd640 1 -- 172.21.15.87:0/39976395 shutdown_connections 2024-09-17T07:30:34.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.334+0000 7f7df12dd640 1 --2- 172.21.15.87:0/39976395 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7dec101ed0 0x7f7dec0fb590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:34.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.334+0000 7f7df12dd640 1 --2- 172.21.15.87:0/39976395 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7dec101530 0x7f7dec101900 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:34.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.334+0000 7f7df12dd640 1 -- 172.21.15.87:0/39976395 >> 172.21.15.87:0/39976395 conn(0x7f7dec0f7110 msgr2=0x7f7dec0f9520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:34.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.334+0000 7f7df12dd640 1 -- 172.21.15.87:0/39976395 shutdown_connections 2024-09-17T07:30:34.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.334+0000 7f7df12dd640 1 -- 172.21.15.87:0/39976395 wait complete. 2024-09-17T07:30:34.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.334+0000 7f7df12dd640 1 Processor -- start 2024-09-17T07:30:34.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.334+0000 7f7df12dd640 1 -- start start 2024-09-17T07:30:34.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.335+0000 7f7df12dd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7dec101530 0x7f7dec10e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:34.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.335+0000 7f7df12dd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7dec101ed0 0x7f7dec10e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:34.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.335+0000 7f7df12dd640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dec066790 con 0x7f7dec101530 2024-09-17T07:30:34.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.335+0000 7f7df12dd640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dec10ec70 con 0x7f7dec101ed0 2024-09-17T07:30:34.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.335+0000 7f7deaffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7dec101530 0x7f7dec10e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:34.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.335+0000 7f7deaffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7dec101530 0x7f7dec10e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56210/0 (socket says 172.21.15.87:56210) 2024-09-17T07:30:34.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.335+0000 7f7deaffd640 1 -- 172.21.15.87:0/50944795 learned_addr learned my addr 172.21.15.87:0/50944795 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:30:34.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.335+0000 7f7dea7fc640 1 --2- 172.21.15.87:0/50944795 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7dec101ed0 0x7f7dec10e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:34.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.335+0000 7f7deaffd640 1 -- 172.21.15.87:0/50944795 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7dec101ed0 msgr2=0x7f7dec10e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:34.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.335+0000 7f7deaffd640 1 --2- 172.21.15.87:0/50944795 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7dec101ed0 0x7f7dec10e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:34.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.335+0000 7f7deaffd640 1 -- 172.21.15.87:0/50944795 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7de4005040 con 0x7f7dec101530 2024-09-17T07:30:34.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.335+0000 7f7deaffd640 1 --2- 172.21.15.87:0/50944795 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7dec101530 0x7f7dec10e1f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7de40043d0 tx=0x7f7de4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:34.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.335+0000 7f7dd37fe640 1 -- 172.21.15.87:0/50944795 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7de4038070 con 0x7f7dec101530 2024-09-17T07:30:34.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.335+0000 7f7dd37fe640 1 -- 172.21.15.87:0/50944795 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f7de402ade0 con 0x7f7dec101530 2024-09-17T07:30:34.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.335+0000 7f7df12dd640 1 -- 172.21.15.87:0/50944795 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dec10eef0 con 0x7f7dec101530 2024-09-17T07:30:34.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.335+0000 7f7dd37fe640 1 -- 172.21.15.87:0/50944795 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7de402c750 con 0x7f7dec101530 2024-09-17T07:30:34.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.335+0000 7f7df12dd640 1 -- 172.21.15.87:0/50944795 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dec1174d0 con 0x7f7dec101530 2024-09-17T07:30:34.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.336+0000 7f7df12dd640 1 -- 172.21.15.87:0/50944795 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dec0fccb0 con 0x7f7dec101530 2024-09-17T07:30:34.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.337+0000 7f7dd37fe640 1 -- 172.21.15.87:0/50944795 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f7de4030020 con 0x7f7dec101530 2024-09-17T07:30:34.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.337+0000 7f7dd37fe640 1 --2- 172.21.15.87:0/50944795 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f7dd406cb90 0x7f7dd406f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:34.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.337+0000 7f7dd37fe640 1 -- 172.21.15.87:0/50944795 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f7de40abd50 con 0x7f7dec101530 2024-09-17T07:30:34.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.337+0000 7f7dea7fc640 1 --2- 172.21.15.87:0/50944795 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f7dd406cb90 0x7f7dd406f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:34.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.338+0000 7f7dea7fc640 1 --2- 172.21.15.87:0/50944795 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f7dd406cb90 0x7f7dd406f040 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7de0009fd0 tx=0x7f7de0009e50 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:34.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.341+0000 7f7dd37fe640 1 -- 172.21.15.87:0/50944795 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7de4075d90 con 0x7f7dec101530 2024-09-17T07:30:34.538 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.537+0000 7f7df12dd640 1 -- 172.21.15.87:0/50944795 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 37, "format": "json"} v 0) v1 -- 0x7f7dec04bf60 con 0x7f7dec101530 2024-09-17T07:30:34.539 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.538+0000 7f7dd37fe640 1 -- 172.21.15.87:0/50944795 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 37, "format": "json"}]=0 dumped fsmap epoch 37 v43) v1 ==== 107+0+4049 (secure 0 0 0) 0x7f7de40793b0 con 0x7f7dec101530 2024-09-17T07:30:34.539 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:30:34.539 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":37,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34444,"name":"cephfs.smithi087.tjhpcs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6829/2375971201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2375971201},{"type":"v1","addr":"172.21.15.87:6829","nonce":2375971201}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":44261,"name":"cephfs.smithi139.ftvinf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6827/641133838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":641133838},{"type":"v1","addr":"172.21.15.139:6827","nonce":641133838}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T07:17:15.368053+0000","modified":"2024-09-17T07:26:58.204675+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34412},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34412":{"gid":34412,"name":"cephfs.smithi087.vvbzss","rank":0,"incarnation":32,"state":"up:active","state_seq":8,"addr":"172.21.15.87:6827/1050918039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1050918039},{"type":"v1","addr":"172.21.15.87:6827","nonce":1050918039}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-17T07:30:34.539 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 37 2024-09-17T07:30:34.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.540+0000 7f7df12dd640 1 -- 172.21.15.87:0/50944795 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f7dd406cb90 msgr2=0x7f7dd406f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:34.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.540+0000 7f7df12dd640 1 --2- 172.21.15.87:0/50944795 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f7dd406cb90 0x7f7dd406f040 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7de0009fd0 tx=0x7f7de0009e50 comp rx=0 tx=0).stop 2024-09-17T07:30:34.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.540+0000 7f7df12dd640 1 -- 172.21.15.87:0/50944795 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7dec101530 msgr2=0x7f7dec10e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:34.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.540+0000 7f7df12dd640 1 --2- 172.21.15.87:0/50944795 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7dec101530 0x7f7dec10e1f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7de40043d0 tx=0x7f7de4009da0 comp rx=0 tx=0).stop 2024-09-17T07:30:34.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.540+0000 7f7df12dd640 1 -- 172.21.15.87:0/50944795 shutdown_connections 2024-09-17T07:30:34.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.540+0000 7f7df12dd640 1 --2- 172.21.15.87:0/50944795 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f7dd406cb90 0x7f7dd406f040 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:34.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.540+0000 7f7df12dd640 1 --2- 172.21.15.87:0/50944795 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7dec101ed0 0x7f7dec10e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:34.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.540+0000 7f7df12dd640 1 --2- 172.21.15.87:0/50944795 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7dec101530 0x7f7dec10e1f0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:34.541 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.540+0000 7f7df12dd640 1 -- 172.21.15.87:0/50944795 >> 172.21.15.87:0/50944795 conn(0x7f7dec0f7110 msgr2=0x7f7dec0f8290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:34.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.540+0000 7f7df12dd640 1 -- 172.21.15.87:0/50944795 shutdown_connections 2024-09-17T07:30:34.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.540+0000 7f7df12dd640 1 -- 172.21.15.87:0/50944795 wait complete. 2024-09-17T07:30:34.550 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:34 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/957244584' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-09-17T07:30:34.550 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:34 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/3551772274' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-09-17T07:30:34.550 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:34 smithi087 ceph-mon[90982]: pgmap v296: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:30:34.550 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:34 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/90854505' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 36, "format": "json"}]: dispatch 2024-09-17T07:30:34.552 DEBUG:tasks.fs:max_mds reduced in epoch 37 2024-09-17T07:30:34.552 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 37 2024-09-17T07:30:34.552 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 38 2024-09-17T07:30:34.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.646+0000 7fe619ec0640 1 -- 172.21.15.87:0/1727056571 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6140fd670 msgr2=0x7fe6140fda40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:34.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.646+0000 7fe619ec0640 1 --2- 172.21.15.87:0/1727056571 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6140fd670 0x7fe6140fda40 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe6040048d0 tx=0x7fe604009da0 comp rx=0 tx=0).stop 2024-09-17T07:30:34.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.646+0000 7fe619ec0640 1 -- 172.21.15.87:0/1727056571 shutdown_connections 2024-09-17T07:30:34.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.646+0000 7fe619ec0640 1 --2- 172.21.15.87:0/1727056571 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe6140fdf80 0x7fe6141066e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:34.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.646+0000 7fe619ec0640 1 --2- 172.21.15.87:0/1727056571 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6140fd670 0x7fe6140fda40 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:34.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.646+0000 7fe619ec0640 1 -- 172.21.15.87:0/1727056571 >> 172.21.15.87:0/1727056571 conn(0x7fe6140f7110 msgr2=0x7fe6140f9520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:34.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.646+0000 7fe619ec0640 1 -- 172.21.15.87:0/1727056571 shutdown_connections 2024-09-17T07:30:34.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.646+0000 7fe619ec0640 1 -- 172.21.15.87:0/1727056571 wait complete. 2024-09-17T07:30:34.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.646+0000 7fe619ec0640 1 Processor -- start 2024-09-17T07:30:34.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.646+0000 7fe619ec0640 1 -- start start 2024-09-17T07:30:34.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.647+0000 7fe619ec0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6140fd670 0x7fe6141130a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:34.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.647+0000 7fe619ec0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe6140fdf80 0x7fe6141135e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:34.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.647+0000 7fe619ec0640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe614113be0 con 0x7fe6140fd670 2024-09-17T07:30:34.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.647+0000 7fe619ec0640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe61410d230 con 0x7fe6140fdf80 2024-09-17T07:30:34.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.647+0000 7fe6137fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6140fd670 0x7fe6141130a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:34.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.647+0000 7fe6137fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6140fd670 0x7fe6141130a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56230/0 (socket says 172.21.15.87:56230) 2024-09-17T07:30:34.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.647+0000 7fe6137fe640 1 -- 172.21.15.87:0/431708154 learned_addr learned my addr 172.21.15.87:0/431708154 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:30:34.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.647+0000 7fe60bfff640 1 --2- 172.21.15.87:0/431708154 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe6140fdf80 0x7fe6141135e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:34.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.647+0000 7fe6137fe640 1 -- 172.21.15.87:0/431708154 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe6140fdf80 msgr2=0x7fe6141135e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:34.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.647+0000 7fe6137fe640 1 --2- 172.21.15.87:0/431708154 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe6140fdf80 0x7fe6141135e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:34.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.647+0000 7fe6137fe640 1 -- 172.21.15.87:0/431708154 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe604005040 con 0x7fe6140fd670 2024-09-17T07:30:34.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.647+0000 7fe6137fe640 1 --2- 172.21.15.87:0/431708154 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6140fd670 0x7fe6141130a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe6040043d0 tx=0x7fe604009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:34.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.647+0000 7fe610ff9640 1 -- 172.21.15.87:0/431708154 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe604038070 con 0x7fe6140fd670 2024-09-17T07:30:34.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.647+0000 7fe619ec0640 1 -- 172.21.15.87:0/431708154 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe61410d4b0 con 0x7fe6140fd670 2024-09-17T07:30:34.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.647+0000 7fe610ff9640 1 -- 172.21.15.87:0/431708154 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fe60402ade0 con 0x7fe6140fd670 2024-09-17T07:30:34.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.647+0000 7fe610ff9640 1 -- 172.21.15.87:0/431708154 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe60402c750 con 0x7fe6140fd670 2024-09-17T07:30:34.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.647+0000 7fe619ec0640 1 -- 172.21.15.87:0/431708154 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe61410d970 con 0x7fe6140fd670 2024-09-17T07:30:34.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.648+0000 7fe619ec0640 1 -- 172.21.15.87:0/431708154 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe614066030 con 0x7fe6140fd670 2024-09-17T07:30:34.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.649+0000 7fe610ff9640 1 -- 172.21.15.87:0/431708154 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fe604030020 con 0x7fe6140fd670 2024-09-17T07:30:34.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.649+0000 7fe610ff9640 1 --2- 172.21.15.87:0/431708154 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fe60006cb90 0x7fe60006f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:34.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.650+0000 7fe60bfff640 1 --2- 172.21.15.87:0/431708154 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fe60006cb90 0x7fe60006f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:34.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.650+0000 7fe610ff9640 1 -- 172.21.15.87:0/431708154 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fe6040abe30 con 0x7fe6140fd670 2024-09-17T07:30:34.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.650+0000 7fe60bfff640 1 --2- 172.21.15.87:0/431708154 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fe60006cb90 0x7fe60006f040 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc007fd0 tx=0x7fe5fc009e90 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:34.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.654+0000 7fe610ff9640 1 -- 172.21.15.87:0/431708154 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe604075df0 con 0x7fe6140fd670 2024-09-17T07:30:34.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.847+0000 7fe619ec0640 1 -- 172.21.15.87:0/431708154 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 38, "format": "json"} v 0) v1 -- 0x7fe614063b40 con 0x7fe6140fd670 2024-09-17T07:30:34.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.847+0000 7fe610ff9640 1 -- 172.21.15.87:0/431708154 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 38, "format": "json"}]=0 dumped fsmap epoch 38 v43) v1 ==== 107+0+4831 (secure 0 0 0) 0x7fe604079410 con 0x7fe6140fd670 2024-09-17T07:30:34.849 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:30:34.849 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":38,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34444,"name":"cephfs.smithi087.tjhpcs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6829/2375971201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2375971201},{"type":"v1","addr":"172.21.15.87:6829","nonce":2375971201}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":44261,"name":"cephfs.smithi139.ftvinf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6827/641133838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":641133838},{"type":"v1","addr":"172.21.15.139:6827","nonce":641133838}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":44325,"name":"cephfs.smithi139.gnwonz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6825/1289261341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":1289261341},{"type":"v1","addr":"172.21.15.139:6825","nonce":1289261341}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T07:17:15.368053+0000","modified":"2024-09-17T07:26:58.204675+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34412},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34412":{"gid":34412,"name":"cephfs.smithi087.vvbzss","rank":0,"incarnation":32,"state":"up:active","state_seq":8,"addr":"172.21.15.87:6827/1050918039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1050918039},{"type":"v1","addr":"172.21.15.87:6827","nonce":1050918039}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-17T07:30:34.849 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 38 2024-09-17T07:30:34.850 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.849+0000 7fe619ec0640 1 -- 172.21.15.87:0/431708154 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fe60006cb90 msgr2=0x7fe60006f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:34.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.849+0000 7fe619ec0640 1 --2- 172.21.15.87:0/431708154 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fe60006cb90 0x7fe60006f040 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc007fd0 tx=0x7fe5fc009e90 comp rx=0 tx=0).stop 2024-09-17T07:30:34.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.849+0000 7fe619ec0640 1 -- 172.21.15.87:0/431708154 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6140fd670 msgr2=0x7fe6141130a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:34.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.849+0000 7fe619ec0640 1 --2- 172.21.15.87:0/431708154 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6140fd670 0x7fe6141130a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe6040043d0 tx=0x7fe604009da0 comp rx=0 tx=0).stop 2024-09-17T07:30:34.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.849+0000 7fe619ec0640 1 -- 172.21.15.87:0/431708154 shutdown_connections 2024-09-17T07:30:34.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.849+0000 7fe619ec0640 1 --2- 172.21.15.87:0/431708154 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fe60006cb90 0x7fe60006f040 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:34.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.849+0000 7fe619ec0640 1 --2- 172.21.15.87:0/431708154 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe6140fdf80 0x7fe6141135e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:34.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.849+0000 7fe619ec0640 1 --2- 172.21.15.87:0/431708154 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6140fd670 0x7fe6141130a0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:34.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.849+0000 7fe619ec0640 1 -- 172.21.15.87:0/431708154 >> 172.21.15.87:0/431708154 conn(0x7fe6140f7110 msgr2=0x7fe6140f88b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:34.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.850+0000 7fe619ec0640 1 -- 172.21.15.87:0/431708154 shutdown_connections 2024-09-17T07:30:34.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.850+0000 7fe619ec0640 1 -- 172.21.15.87:0/431708154 wait complete. 2024-09-17T07:30:34.861 DEBUG:tasks.fs:max_mds reduced in epoch 38 2024-09-17T07:30:34.861 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 38 2024-09-17T07:30:34.862 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 39 2024-09-17T07:30:34.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:34 smithi139 ceph-mon[79872]: from='client.? 172.21.15.87:0/957244584' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-09-17T07:30:34.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:34 smithi139 ceph-mon[79872]: from='client.? 172.21.15.87:0/3551772274' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-09-17T07:30:34.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:34 smithi139 ceph-mon[79872]: pgmap v296: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:30:34.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:34 smithi139 ceph-mon[79872]: from='client.? 172.21.15.87:0/90854505' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 36, "format": "json"}]: dispatch 2024-09-17T07:30:34.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.955+0000 7f2d5111d640 1 -- 172.21.15.87:0/1918377116 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d4c0fb3a0 msgr2=0x7f2d4c0fb7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:34.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.955+0000 7f2d5111d640 1 --2- 172.21.15.87:0/1918377116 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d4c0fb3a0 0x7f2d4c0fb7f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2d340048d0 tx=0x7f2d34009da0 comp rx=0 tx=0).stop 2024-09-17T07:30:34.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.956+0000 7f2d5111d640 1 -- 172.21.15.87:0/1918377116 shutdown_connections 2024-09-17T07:30:34.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.956+0000 7f2d5111d640 1 --2- 172.21.15.87:0/1918377116 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d4c0fb3a0 0x7f2d4c0fb7f0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:34.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.956+0000 7f2d5111d640 1 --2- 172.21.15.87:0/1918377116 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2d4c1013c0 0x7f2d4c101790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:34.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.956+0000 7f2d5111d640 1 -- 172.21.15.87:0/1918377116 >> 172.21.15.87:0/1918377116 conn(0x7f2d4c071360 msgr2=0x7f2d4c071760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:34.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.956+0000 7f2d5111d640 1 -- 172.21.15.87:0/1918377116 shutdown_connections 2024-09-17T07:30:34.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.956+0000 7f2d5111d640 1 -- 172.21.15.87:0/1918377116 wait complete. 2024-09-17T07:30:34.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.956+0000 7f2d5111d640 1 Processor -- start 2024-09-17T07:30:34.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.956+0000 7f2d5111d640 1 -- start start 2024-09-17T07:30:34.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.956+0000 7f2d5111d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2d4c0fb3a0 0x7f2d4c112de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:34.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.956+0000 7f2d5111d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d4c1013c0 0x7f2d4c113320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:34.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.956+0000 7f2d5111d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4c113920 con 0x7f2d4c1013c0 2024-09-17T07:30:34.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.956+0000 7f2d5111d640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4c10cf70 con 0x7f2d4c0fb3a0 2024-09-17T07:30:34.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.957+0000 7f2d4259c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d4c1013c0 0x7f2d4c113320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:34.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.957+0000 7f2d4259c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d4c1013c0 0x7f2d4c113320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56252/0 (socket says 172.21.15.87:56252) 2024-09-17T07:30:34.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.957+0000 7f2d4259c640 1 -- 172.21.15.87:0/3037692792 learned_addr learned my addr 172.21.15.87:0/3037692792 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:30:34.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.957+0000 7f2d4ad9d640 1 --2- 172.21.15.87:0/3037692792 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2d4c0fb3a0 0x7f2d4c112de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:34.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.957+0000 7f2d4259c640 1 -- 172.21.15.87:0/3037692792 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2d4c0fb3a0 msgr2=0x7f2d4c112de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:34.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.957+0000 7f2d4259c640 1 --2- 172.21.15.87:0/3037692792 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2d4c0fb3a0 0x7f2d4c112de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:34.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.957+0000 7f2d4259c640 1 -- 172.21.15.87:0/3037692792 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d34005040 con 0x7f2d4c1013c0 2024-09-17T07:30:34.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.957+0000 7f2d4259c640 1 --2- 172.21.15.87:0/3037692792 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d4c1013c0 0x7f2d4c113320 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2d34004930 tx=0x7f2d34009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:34.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.957+0000 7f2d43fff640 1 -- 172.21.15.87:0/3037692792 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d34038070 con 0x7f2d4c1013c0 2024-09-17T07:30:34.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.957+0000 7f2d43fff640 1 -- 172.21.15.87:0/3037692792 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f2d34009730 con 0x7f2d4c1013c0 2024-09-17T07:30:34.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.957+0000 7f2d5111d640 1 -- 172.21.15.87:0/3037692792 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d4c10d1f0 con 0x7f2d4c1013c0 2024-09-17T07:30:34.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.957+0000 7f2d43fff640 1 -- 172.21.15.87:0/3037692792 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d3403c650 con 0x7f2d4c1013c0 2024-09-17T07:30:34.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.957+0000 7f2d5111d640 1 -- 172.21.15.87:0/3037692792 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d4c10d730 con 0x7f2d4c1013c0 2024-09-17T07:30:34.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.958+0000 7f2d5111d640 1 -- 172.21.15.87:0/3037692792 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d4c0fca80 con 0x7f2d4c1013c0 2024-09-17T07:30:34.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.959+0000 7f2d43fff640 1 -- 172.21.15.87:0/3037692792 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f2d34030020 con 0x7f2d4c1013c0 2024-09-17T07:30:34.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.959+0000 7f2d43fff640 1 --2- 172.21.15.87:0/3037692792 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f2d3806cb90 0x7f2d3806f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:34.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.959+0000 7f2d43fff640 1 -- 172.21.15.87:0/3037692792 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f2d340ac130 con 0x7f2d4c1013c0 2024-09-17T07:30:34.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.959+0000 7f2d4ad9d640 1 --2- 172.21.15.87:0/3037692792 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f2d3806cb90 0x7f2d3806f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:34.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.960+0000 7f2d4ad9d640 1 --2- 172.21.15.87:0/3037692792 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f2d3806cb90 0x7f2d3806f040 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c004ed0 tx=0x7f2d3c00b040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:34.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:34.963+0000 7f2d43fff640 1 -- 172.21.15.87:0/3037692792 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2d340761a0 con 0x7f2d4c1013c0 2024-09-17T07:30:35.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.159+0000 7f2d5111d640 1 -- 172.21.15.87:0/3037692792 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 39, "format": "json"} v 0) v1 -- 0x7f2d4c108210 con 0x7f2d4c1013c0 2024-09-17T07:30:35.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.160+0000 7f2d43fff640 1 -- 172.21.15.87:0/3037692792 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 39, "format": "json"}]=0 dumped fsmap epoch 39 v43) v1 ==== 107+0+4052 (secure 0 0 0) 0x7f2d340797c0 con 0x7f2d4c1013c0 2024-09-17T07:30:35.161 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:30:35.162 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":39,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34444,"name":"cephfs.smithi087.tjhpcs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6829/2375971201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2375971201},{"type":"v1","addr":"172.21.15.87:6829","nonce":2375971201}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":44325,"name":"cephfs.smithi139.gnwonz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6825/1289261341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":1289261341},{"type":"v1","addr":"172.21.15.139:6825","nonce":1289261341}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T07:17:15.368053+0000","modified":"2024-09-17T07:26:58.204675+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34412},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34412":{"gid":34412,"name":"cephfs.smithi087.vvbzss","rank":0,"incarnation":32,"state":"up:active","state_seq":8,"addr":"172.21.15.87:6827/1050918039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1050918039},{"type":"v1","addr":"172.21.15.87:6827","nonce":1050918039}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-17T07:30:35.162 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 39 2024-09-17T07:30:35.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.163+0000 7f2d5111d640 1 -- 172.21.15.87:0/3037692792 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f2d3806cb90 msgr2=0x7f2d3806f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:35.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.163+0000 7f2d5111d640 1 --2- 172.21.15.87:0/3037692792 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f2d3806cb90 0x7f2d3806f040 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c004ed0 tx=0x7f2d3c00b040 comp rx=0 tx=0).stop 2024-09-17T07:30:35.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.163+0000 7f2d5111d640 1 -- 172.21.15.87:0/3037692792 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d4c1013c0 msgr2=0x7f2d4c113320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:35.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.163+0000 7f2d5111d640 1 --2- 172.21.15.87:0/3037692792 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d4c1013c0 0x7f2d4c113320 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2d34004930 tx=0x7f2d34009da0 comp rx=0 tx=0).stop 2024-09-17T07:30:35.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.163+0000 7f2d5111d640 1 -- 172.21.15.87:0/3037692792 shutdown_connections 2024-09-17T07:30:35.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.163+0000 7f2d5111d640 1 --2- 172.21.15.87:0/3037692792 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d4c1013c0 0x7f2d4c113320 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:35.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.163+0000 7f2d5111d640 1 --2- 172.21.15.87:0/3037692792 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f2d3806cb90 0x7f2d3806f040 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:35.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.163+0000 7f2d5111d640 1 --2- 172.21.15.87:0/3037692792 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2d4c0fb3a0 0x7f2d4c112de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:35.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.163+0000 7f2d5111d640 1 -- 172.21.15.87:0/3037692792 >> 172.21.15.87:0/3037692792 conn(0x7f2d4c071360 msgr2=0x7f2d4c0645f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:35.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.163+0000 7f2d5111d640 1 -- 172.21.15.87:0/3037692792 shutdown_connections 2024-09-17T07:30:35.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.163+0000 7f2d5111d640 1 -- 172.21.15.87:0/3037692792 wait complete. 2024-09-17T07:30:35.174 DEBUG:tasks.fs:max_mds reduced in epoch 39 2024-09-17T07:30:35.174 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 39 2024-09-17T07:30:35.174 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 40 2024-09-17T07:30:35.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.269+0000 7fcc80857640 1 -- 172.21.15.87:0/3520730506 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc7c101ec0 msgr2=0x7fcc7c0fb580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:35.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.269+0000 7fcc80857640 1 --2- 172.21.15.87:0/3520730506 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc7c101ec0 0x7fcc7c0fb580 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fcc640048d0 tx=0x7fcc64009da0 comp rx=0 tx=0).stop 2024-09-17T07:30:35.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.269+0000 7fcc80857640 1 -- 172.21.15.87:0/3520730506 shutdown_connections 2024-09-17T07:30:35.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.269+0000 7fcc80857640 1 --2- 172.21.15.87:0/3520730506 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc7c101ec0 0x7fcc7c0fb580 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:35.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.269+0000 7fcc80857640 1 --2- 172.21.15.87:0/3520730506 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcc7c101520 0x7fcc7c1018f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:35.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.269+0000 7fcc80857640 1 -- 172.21.15.87:0/3520730506 >> 172.21.15.87:0/3520730506 conn(0x7fcc7c0f7100 msgr2=0x7fcc7c0f9510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:35.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.269+0000 7fcc80857640 1 -- 172.21.15.87:0/3520730506 shutdown_connections 2024-09-17T07:30:35.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.269+0000 7fcc80857640 1 -- 172.21.15.87:0/3520730506 wait complete. 2024-09-17T07:30:35.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.269+0000 7fcc80857640 1 Processor -- start 2024-09-17T07:30:35.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.270+0000 7fcc80857640 1 -- start start 2024-09-17T07:30:35.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.270+0000 7fcc80857640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcc7c101520 0x7fcc7c10e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:35.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.270+0000 7fcc80857640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc7c101ec0 0x7fcc7c10e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:35.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.270+0000 7fcc80857640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc7c0667d0 con 0x7fcc7c101ec0 2024-09-17T07:30:35.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.270+0000 7fcc80857640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc7c10ec60 con 0x7fcc7c101520 2024-09-17T07:30:35.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.270+0000 7fcc79d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc7c101ec0 0x7fcc7c10e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:35.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.270+0000 7fcc79d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc7c101ec0 0x7fcc7c10e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56262/0 (socket says 172.21.15.87:56262) 2024-09-17T07:30:35.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.270+0000 7fcc79d9b640 1 -- 172.21.15.87:0/651052165 learned_addr learned my addr 172.21.15.87:0/651052165 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:30:35.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.270+0000 7fcc79d9b640 1 -- 172.21.15.87:0/651052165 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcc7c101520 msgr2=0x7fcc7c10e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:35.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.270+0000 7fcc7a59c640 1 --2- 172.21.15.87:0/651052165 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcc7c101520 0x7fcc7c10e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:35.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.270+0000 7fcc79d9b640 1 --2- 172.21.15.87:0/651052165 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcc7c101520 0x7fcc7c10e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:35.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.270+0000 7fcc79d9b640 1 -- 172.21.15.87:0/651052165 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc64005040 con 0x7fcc7c101ec0 2024-09-17T07:30:35.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.270+0000 7fcc79d9b640 1 --2- 172.21.15.87:0/651052165 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc7c101ec0 0x7fcc7c10e6f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fcc64003080 tx=0x7fcc64009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:35.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.270+0000 7fcc72ffd640 1 -- 172.21.15.87:0/651052165 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc64038070 con 0x7fcc7c101ec0 2024-09-17T07:30:35.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.270+0000 7fcc72ffd640 1 -- 172.21.15.87:0/651052165 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fcc64009740 con 0x7fcc7c101ec0 2024-09-17T07:30:35.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.270+0000 7fcc80857640 1 -- 172.21.15.87:0/651052165 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc7c10eee0 con 0x7fcc7c101ec0 2024-09-17T07:30:35.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.270+0000 7fcc72ffd640 1 -- 172.21.15.87:0/651052165 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc6403d420 con 0x7fcc7c101ec0 2024-09-17T07:30:35.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.271+0000 7fcc80857640 1 -- 172.21.15.87:0/651052165 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc7c1174f0 con 0x7fcc7c101ec0 2024-09-17T07:30:35.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.272+0000 7fcc80857640 1 -- 172.21.15.87:0/651052165 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc7c0fcca0 con 0x7fcc7c101ec0 2024-09-17T07:30:35.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.272+0000 7fcc72ffd640 1 -- 172.21.15.87:0/651052165 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fcc64030020 con 0x7fcc7c101ec0 2024-09-17T07:30:35.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.272+0000 7fcc72ffd640 1 --2- 172.21.15.87:0/651052165 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fcc6806cb90 0x7fcc6806f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:35.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.272+0000 7fcc72ffd640 1 -- 172.21.15.87:0/651052165 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fcc640ac5d0 con 0x7fcc7c101ec0 2024-09-17T07:30:35.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.272+0000 7fcc7a59c640 1 --2- 172.21.15.87:0/651052165 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fcc6806cb90 0x7fcc6806f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:35.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.273+0000 7fcc7a59c640 1 --2- 172.21.15.87:0/651052165 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fcc6806cb90 0x7fcc6806f040 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c007fd0 tx=0x7fcc6c009040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:35.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.277+0000 7fcc72ffd640 1 -- 172.21.15.87:0/651052165 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fcc64076610 con 0x7fcc7c101ec0 2024-09-17T07:30:35.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.476+0000 7fcc80857640 1 -- 172.21.15.87:0/651052165 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 40, "format": "json"} v 0) v1 -- 0x7fcc7c04bf60 con 0x7fcc7c101ec0 2024-09-17T07:30:35.477 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.476+0000 7fcc72ffd640 1 -- 172.21.15.87:0/651052165 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 40, "format": "json"}]=0 dumped fsmap epoch 40 v43) v1 ==== 107+0+4834 (secure 0 0 0) 0x7fcc64079c30 con 0x7fcc7c101ec0 2024-09-17T07:30:35.478 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:30:35.478 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":40,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34444,"name":"cephfs.smithi087.tjhpcs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6829/2375971201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2375971201},{"type":"v1","addr":"172.21.15.87:6829","nonce":2375971201}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":44325,"name":"cephfs.smithi139.gnwonz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6825/1289261341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":1289261341},{"type":"v1","addr":"172.21.15.139:6825","nonce":1289261341}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":44347,"name":"cephfs.smithi139.ftvinf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6827/1126774601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":1126774601},{"type":"v1","addr":"172.21.15.139:6827","nonce":1126774601}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T07:17:15.368053+0000","modified":"2024-09-17T07:26:58.204675+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34412},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34412":{"gid":34412,"name":"cephfs.smithi087.vvbzss","rank":0,"incarnation":32,"state":"up:active","state_seq":8,"addr":"172.21.15.87:6827/1050918039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1050918039},{"type":"v1","addr":"172.21.15.87:6827","nonce":1050918039}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-17T07:30:35.478 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 40 2024-09-17T07:30:35.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.478+0000 7fcc80857640 1 -- 172.21.15.87:0/651052165 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fcc6806cb90 msgr2=0x7fcc6806f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:35.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.478+0000 7fcc80857640 1 --2- 172.21.15.87:0/651052165 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fcc6806cb90 0x7fcc6806f040 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c007fd0 tx=0x7fcc6c009040 comp rx=0 tx=0).stop 2024-09-17T07:30:35.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.478+0000 7fcc80857640 1 -- 172.21.15.87:0/651052165 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc7c101ec0 msgr2=0x7fcc7c10e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:35.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.478+0000 7fcc80857640 1 --2- 172.21.15.87:0/651052165 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc7c101ec0 0x7fcc7c10e6f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fcc64003080 tx=0x7fcc64009da0 comp rx=0 tx=0).stop 2024-09-17T07:30:35.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.478+0000 7fcc80857640 1 -- 172.21.15.87:0/651052165 shutdown_connections 2024-09-17T07:30:35.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.478+0000 7fcc80857640 1 --2- 172.21.15.87:0/651052165 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc7c101ec0 0x7fcc7c10e6f0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:35.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.478+0000 7fcc80857640 1 --2- 172.21.15.87:0/651052165 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fcc6806cb90 0x7fcc6806f040 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:35.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.478+0000 7fcc80857640 1 --2- 172.21.15.87:0/651052165 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcc7c101520 0x7fcc7c10e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:35.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.478+0000 7fcc80857640 1 -- 172.21.15.87:0/651052165 >> 172.21.15.87:0/651052165 conn(0x7fcc7c0f7100 msgr2=0x7fcc7c0f8210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:35.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.479+0000 7fcc80857640 1 -- 172.21.15.87:0/651052165 shutdown_connections 2024-09-17T07:30:35.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.479+0000 7fcc80857640 1 -- 172.21.15.87:0/651052165 wait complete. 2024-09-17T07:30:35.490 DEBUG:tasks.fs:max_mds reduced in epoch 40 2024-09-17T07:30:35.490 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 40 2024-09-17T07:30:35.491 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 41 2024-09-17T07:30:35.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.585+0000 7f0da28c9640 1 -- 172.21.15.87:0/714414129 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d9c101ef0 msgr2=0x7f0d9c0fb5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:35.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.585+0000 7f0da28c9640 1 --2- 172.21.15.87:0/714414129 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d9c101ef0 0x7f0d9c0fb5b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f0d900048d0 tx=0x7f0d90009da0 comp rx=0 tx=0).stop 2024-09-17T07:30:35.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.585+0000 7f0da28c9640 1 -- 172.21.15.87:0/714414129 shutdown_connections 2024-09-17T07:30:35.588 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.585+0000 7f0da28c9640 1 --2- 172.21.15.87:0/714414129 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d9c101ef0 0x7f0d9c0fb5b0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:35.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.585+0000 7f0da28c9640 1 --2- 172.21.15.87:0/714414129 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0d9c101550 0x7f0d9c101920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:35.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.585+0000 7f0da28c9640 1 -- 172.21.15.87:0/714414129 >> 172.21.15.87:0/714414129 conn(0x7f0d9c0f7110 msgr2=0x7f0d9c0f9520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:35.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.585+0000 7f0da28c9640 1 -- 172.21.15.87:0/714414129 shutdown_connections 2024-09-17T07:30:35.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.585+0000 7f0da28c9640 1 -- 172.21.15.87:0/714414129 wait complete. 2024-09-17T07:30:35.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.585+0000 7f0da28c9640 1 Processor -- start 2024-09-17T07:30:35.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.586+0000 7f0da28c9640 1 -- start start 2024-09-17T07:30:35.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.586+0000 7f0da28c9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0d9c101550 0x7f0d9c111fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:35.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.586+0000 7f0da28c9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d9c101ef0 0x7f0d9c1124f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:35.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.586+0000 7f0da28c9640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d9c112af0 con 0x7f0d9c101ef0 2024-09-17T07:30:35.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.586+0000 7f0da28c9640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d9c10c140 con 0x7f0d9c101550 2024-09-17T07:30:35.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.586+0000 7f0d9b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d9c101ef0 0x7f0d9c1124f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:35.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.586+0000 7f0d9b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d9c101ef0 0x7f0d9c1124f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56284/0 (socket says 172.21.15.87:56284) 2024-09-17T07:30:35.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.586+0000 7f0d9b7fe640 1 -- 172.21.15.87:0/3042575807 learned_addr learned my addr 172.21.15.87:0/3042575807 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:30:35.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.586+0000 7f0d9bfff640 1 --2- 172.21.15.87:0/3042575807 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0d9c101550 0x7f0d9c111fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:35.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.586+0000 7f0d9b7fe640 1 -- 172.21.15.87:0/3042575807 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0d9c101550 msgr2=0x7f0d9c111fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:35.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.586+0000 7f0d9b7fe640 1 --2- 172.21.15.87:0/3042575807 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0d9c101550 0x7f0d9c111fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:35.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.586+0000 7f0d9b7fe640 1 -- 172.21.15.87:0/3042575807 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d90005040 con 0x7f0d9c101ef0 2024-09-17T07:30:35.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.586+0000 7f0d9bfff640 1 --2- 172.21.15.87:0/3042575807 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0d9c101550 0x7f0d9c111fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T07:30:35.590 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.586+0000 7f0d9b7fe640 1 --2- 172.21.15.87:0/3042575807 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d9c101ef0 0x7f0d9c1124f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f0d900043d0 tx=0x7f0d90009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:35.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.586+0000 7f0d98ff9640 1 -- 172.21.15.87:0/3042575807 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d90038070 con 0x7f0d9c101ef0 2024-09-17T07:30:35.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.586+0000 7f0d98ff9640 1 -- 172.21.15.87:0/3042575807 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f0d900096c0 con 0x7f0d9c101ef0 2024-09-17T07:30:35.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.586+0000 7f0da28c9640 1 -- 172.21.15.87:0/3042575807 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d9c10c3c0 con 0x7f0d9c101ef0 2024-09-17T07:30:35.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.587+0000 7f0d98ff9640 1 -- 172.21.15.87:0/3042575807 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d9002c710 con 0x7f0d9c101ef0 2024-09-17T07:30:35.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.587+0000 7f0da28c9640 1 -- 172.21.15.87:0/3042575807 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d9c10c880 con 0x7f0d9c101ef0 2024-09-17T07:30:35.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.588+0000 7f0da28c9640 1 -- 172.21.15.87:0/3042575807 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d9c0fccd0 con 0x7f0d9c101ef0 2024-09-17T07:30:35.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.588+0000 7f0d98ff9640 1 -- 172.21.15.87:0/3042575807 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f0d90030020 con 0x7f0d9c101ef0 2024-09-17T07:30:35.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.588+0000 7f0d98ff9640 1 --2- 172.21.15.87:0/3042575807 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f0d8406cb90 0x7f0d8406f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:35.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.589+0000 7f0d98ff9640 1 -- 172.21.15.87:0/3042575807 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f0d900abe20 con 0x7f0d9c101ef0 2024-09-17T07:30:35.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.589+0000 7f0d9bfff640 1 --2- 172.21.15.87:0/3042575807 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f0d8406cb90 0x7f0d8406f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:35.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.589+0000 7f0d9bfff640 1 --2- 172.21.15.87:0/3042575807 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f0d8406cb90 0x7f0d8406f040 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c007fd0 tx=0x7f0d8c009e90 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:35.594 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.593+0000 7f0d98ff9640 1 -- 172.21.15.87:0/3042575807 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f0d90075e60 con 0x7f0d9c101ef0 2024-09-17T07:30:35.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.789+0000 7f0da28c9640 1 -- 172.21.15.87:0/3042575807 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 41, "format": "json"} v 0) v1 -- 0x7f0d9c108440 con 0x7f0d9c101ef0 2024-09-17T07:30:35.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.790+0000 7f0d98ff9640 1 -- 172.21.15.87:0/3042575807 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 41, "format": "json"}]=0 dumped fsmap epoch 41 v43) v1 ==== 107+0+4834 (secure 0 0 0) 0x7f0d9002c870 con 0x7f0d9c101ef0 2024-09-17T07:30:35.790 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:30:35.790 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":41,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34444,"name":"cephfs.smithi087.tjhpcs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6829/2375971201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2375971201},{"type":"v1","addr":"172.21.15.87:6829","nonce":2375971201}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":44325,"name":"cephfs.smithi139.gnwonz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6825/1289261341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":1289261341},{"type":"v1","addr":"172.21.15.139:6825","nonce":1289261341}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":44347,"name":"cephfs.smithi139.ftvinf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6827/1126774601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":1126774601},{"type":"v1","addr":"172.21.15.139:6827","nonce":1126774601}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T07:17:15.368053+0000","modified":"2024-09-17T07:27:41.050251+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0],"up":{"mds_0":34412},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34412":{"gid":34412,"name":"cephfs.smithi087.vvbzss","rank":0,"incarnation":32,"state":"up:active","state_seq":8,"addr":"172.21.15.87:6827/1050918039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1050918039},{"type":"v1","addr":"172.21.15.87:6827","nonce":1050918039}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-17T07:30:35.790 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 41 2024-09-17T07:30:35.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.792+0000 7f0da28c9640 1 -- 172.21.15.87:0/3042575807 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f0d8406cb90 msgr2=0x7f0d8406f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:35.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.792+0000 7f0da28c9640 1 --2- 172.21.15.87:0/3042575807 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f0d8406cb90 0x7f0d8406f040 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c007fd0 tx=0x7f0d8c009e90 comp rx=0 tx=0).stop 2024-09-17T07:30:35.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.792+0000 7f0da28c9640 1 -- 172.21.15.87:0/3042575807 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d9c101ef0 msgr2=0x7f0d9c1124f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:35.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.792+0000 7f0da28c9640 1 --2- 172.21.15.87:0/3042575807 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d9c101ef0 0x7f0d9c1124f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f0d900043d0 tx=0x7f0d90009da0 comp rx=0 tx=0).stop 2024-09-17T07:30:35.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.792+0000 7f0da28c9640 1 -- 172.21.15.87:0/3042575807 shutdown_connections 2024-09-17T07:30:35.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.792+0000 7f0da28c9640 1 --2- 172.21.15.87:0/3042575807 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d9c101ef0 0x7f0d9c1124f0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:35.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.792+0000 7f0da28c9640 1 --2- 172.21.15.87:0/3042575807 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f0d8406cb90 0x7f0d8406f040 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:35.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.792+0000 7f0da28c9640 1 --2- 172.21.15.87:0/3042575807 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0d9c101550 0x7f0d9c111fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:35.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.792+0000 7f0da28c9640 1 -- 172.21.15.87:0/3042575807 >> 172.21.15.87:0/3042575807 conn(0x7f0d9c0f7110 msgr2=0x7f0d9c0f8310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:35.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.792+0000 7f0da28c9640 1 -- 172.21.15.87:0/3042575807 shutdown_connections 2024-09-17T07:30:35.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.792+0000 7f0da28c9640 1 -- 172.21.15.87:0/3042575807 wait complete. 2024-09-17T07:30:35.802 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:35 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/50944795' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 37, "format": "json"}]: dispatch 2024-09-17T07:30:35.802 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:35 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/431708154' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 38, "format": "json"}]: dispatch 2024-09-17T07:30:35.802 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:35 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/3037692792' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 39, "format": "json"}]: dispatch 2024-09-17T07:30:35.803 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 41 2024-09-17T07:30:35.803 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 42 2024-09-17T07:30:35.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:35 smithi139 ceph-mon[79872]: from='client.? 172.21.15.87:0/50944795' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 37, "format": "json"}]: dispatch 2024-09-17T07:30:35.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:35 smithi139 ceph-mon[79872]: from='client.? 172.21.15.87:0/431708154' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 38, "format": "json"}]: dispatch 2024-09-17T07:30:35.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:35 smithi139 ceph-mon[79872]: from='client.? 172.21.15.87:0/3037692792' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 39, "format": "json"}]: dispatch 2024-09-17T07:30:35.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.898+0000 7f7a4b79d640 1 -- 172.21.15.87:0/139972474 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a44101340 msgr2=0x7f7a44101710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:35.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.898+0000 7f7a4b79d640 1 --2- 172.21.15.87:0/139972474 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a44101340 0x7f7a44101710 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7a400048d0 tx=0x7f7a40009da0 comp rx=0 tx=0).stop 2024-09-17T07:30:35.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.898+0000 7f7a4b79d640 1 -- 172.21.15.87:0/139972474 shutdown_connections 2024-09-17T07:30:35.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.898+0000 7f7a4b79d640 1 --2- 172.21.15.87:0/139972474 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7a44101ce0 0x7f7a440fb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:35.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.898+0000 7f7a4b79d640 1 --2- 172.21.15.87:0/139972474 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a44101340 0x7f7a44101710 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:35.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.898+0000 7f7a4b79d640 1 -- 172.21.15.87:0/139972474 >> 172.21.15.87:0/139972474 conn(0x7f7a440f6f10 msgr2=0x7f7a440f9320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:35.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.898+0000 7f7a4b79d640 1 -- 172.21.15.87:0/139972474 shutdown_connections 2024-09-17T07:30:35.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.898+0000 7f7a4b79d640 1 -- 172.21.15.87:0/139972474 wait complete. 2024-09-17T07:30:35.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.899+0000 7f7a4b79d640 1 Processor -- start 2024-09-17T07:30:35.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.899+0000 7f7a4b79d640 1 -- start start 2024-09-17T07:30:35.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.899+0000 7f7a4b79d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a44101340 0x7f7a4410df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:35.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.899+0000 7f7a4b79d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7a44101ce0 0x7f7a4410e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:35.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.899+0000 7f7a4b79d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a440667a0 con 0x7f7a44101340 2024-09-17T07:30:35.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.899+0000 7f7a4b79d640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4410ea10 con 0x7f7a44101ce0 2024-09-17T07:30:35.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.899+0000 7f7a49539640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a44101340 0x7f7a4410df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:35.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.899+0000 7f7a49539640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a44101340 0x7f7a4410df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56294/0 (socket says 172.21.15.87:56294) 2024-09-17T07:30:35.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.899+0000 7f7a49539640 1 -- 172.21.15.87:0/3204768715 learned_addr learned my addr 172.21.15.87:0/3204768715 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:30:35.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.899+0000 7f7a48d38640 1 --2- 172.21.15.87:0/3204768715 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7a44101ce0 0x7f7a4410e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:35.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.899+0000 7f7a49539640 1 -- 172.21.15.87:0/3204768715 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7a44101ce0 msgr2=0x7f7a4410e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:35.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.899+0000 7f7a49539640 1 --2- 172.21.15.87:0/3204768715 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7a44101ce0 0x7f7a4410e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:35.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.899+0000 7f7a49539640 1 -- 172.21.15.87:0/3204768715 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a40005040 con 0x7f7a44101340 2024-09-17T07:30:35.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.899+0000 7f7a48d38640 1 --2- 172.21.15.87:0/3204768715 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7a44101ce0 0x7f7a4410e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T07:30:35.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.900+0000 7f7a49539640 1 --2- 172.21.15.87:0/3204768715 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a44101340 0x7f7a4410df60 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7a400043d0 tx=0x7f7a40009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:35.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.900+0000 7f7a39ffb640 1 -- 172.21.15.87:0/3204768715 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a40038070 con 0x7f7a44101340 2024-09-17T07:30:35.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.900+0000 7f7a39ffb640 1 -- 172.21.15.87:0/3204768715 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f7a4002ade0 con 0x7f7a44101340 2024-09-17T07:30:35.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.900+0000 7f7a39ffb640 1 -- 172.21.15.87:0/3204768715 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a4002c750 con 0x7f7a44101340 2024-09-17T07:30:35.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.900+0000 7f7a4b79d640 1 -- 172.21.15.87:0/3204768715 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a4410ec90 con 0x7f7a44101340 2024-09-17T07:30:35.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.900+0000 7f7a4b79d640 1 -- 172.21.15.87:0/3204768715 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a441171c0 con 0x7f7a44101340 2024-09-17T07:30:35.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.901+0000 7f7a4b79d640 1 -- 172.21.15.87:0/3204768715 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a440fcab0 con 0x7f7a44101340 2024-09-17T07:30:35.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.901+0000 7f7a39ffb640 1 -- 172.21.15.87:0/3204768715 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f7a40030020 con 0x7f7a44101340 2024-09-17T07:30:35.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.902+0000 7f7a39ffb640 1 --2- 172.21.15.87:0/3204768715 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f7a3006cb90 0x7f7a3006f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:35.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.902+0000 7f7a48d38640 1 --2- 172.21.15.87:0/3204768715 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f7a3006cb90 0x7f7a3006f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:35.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.902+0000 7f7a39ffb640 1 -- 172.21.15.87:0/3204768715 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f7a400abe30 con 0x7f7a44101340 2024-09-17T07:30:35.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.902+0000 7f7a48d38640 1 --2- 172.21.15.87:0/3204768715 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f7a3006cb90 0x7f7a3006f040 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7a44105730 tx=0x7f7a3400b040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:35.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:35.906+0000 7f7a39ffb640 1 -- 172.21.15.87:0/3204768715 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7a40075df0 con 0x7f7a44101340 2024-09-17T07:30:36.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.105+0000 7f7a4b79d640 1 -- 172.21.15.87:0/3204768715 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 42, "format": "json"} v 0) v1 -- 0x7f7a4404bf60 con 0x7f7a44101340 2024-09-17T07:30:36.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.105+0000 7f7a39ffb640 1 -- 172.21.15.87:0/3204768715 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 42, "format": "json"}]=0 dumped fsmap epoch 42 v43) v1 ==== 107+0+4851 (secure 0 0 0) 0x7f7a40079410 con 0x7f7a44101340 2024-09-17T07:30:36.105 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:30:36.106 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44325,"name":"cephfs.smithi139.gnwonz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6825/1289261341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":1289261341},{"type":"v1","addr":"172.21.15.139:6825","nonce":1289261341}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":44347,"name":"cephfs.smithi139.ftvinf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6827/1126774601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":1126774601},{"type":"v1","addr":"172.21.15.139:6827","nonce":1126774601}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T07:17:15.368053+0000","modified":"2024-09-17T07:27:41.059175+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34412,"mds_1":34444},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34412":{"gid":34412,"name":"cephfs.smithi087.vvbzss","rank":0,"incarnation":32,"state":"up:active","state_seq":8,"addr":"172.21.15.87:6827/1050918039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":1050918039},{"type":"v1","addr":"172.21.15.87:6827","nonce":1050918039}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_34444":{"gid":34444,"name":"cephfs.smithi087.tjhpcs","rank":1,"incarnation":42,"state":"up:starting","state_seq":1,"addr":"172.21.15.87:6829/2375971201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2375971201},{"type":"v1","addr":"172.21.15.87:6829","nonce":2375971201}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-17T07:30:36.106 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 42 2024-09-17T07:30:36.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.107+0000 7f7a4b79d640 1 -- 172.21.15.87:0/3204768715 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f7a3006cb90 msgr2=0x7f7a3006f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:36.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.107+0000 7f7a4b79d640 1 --2- 172.21.15.87:0/3204768715 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f7a3006cb90 0x7f7a3006f040 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7a44105730 tx=0x7f7a3400b040 comp rx=0 tx=0).stop 2024-09-17T07:30:36.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.107+0000 7f7a4b79d640 1 -- 172.21.15.87:0/3204768715 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a44101340 msgr2=0x7f7a4410df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:36.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.107+0000 7f7a4b79d640 1 --2- 172.21.15.87:0/3204768715 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a44101340 0x7f7a4410df60 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7a400043d0 tx=0x7f7a40009da0 comp rx=0 tx=0).stop 2024-09-17T07:30:36.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.107+0000 7f7a4b79d640 1 -- 172.21.15.87:0/3204768715 shutdown_connections 2024-09-17T07:30:36.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.107+0000 7f7a4b79d640 1 --2- 172.21.15.87:0/3204768715 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f7a3006cb90 0x7f7a3006f040 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:36.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.107+0000 7f7a4b79d640 1 --2- 172.21.15.87:0/3204768715 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7a44101ce0 0x7f7a4410e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:36.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.107+0000 7f7a4b79d640 1 --2- 172.21.15.87:0/3204768715 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a44101340 0x7f7a4410df60 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:36.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.107+0000 7f7a4b79d640 1 -- 172.21.15.87:0/3204768715 >> 172.21.15.87:0/3204768715 conn(0x7f7a440f6f10 msgr2=0x7f7a440f8000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:36.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.107+0000 7f7a4b79d640 1 -- 172.21.15.87:0/3204768715 shutdown_connections 2024-09-17T07:30:36.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.107+0000 7f7a4b79d640 1 -- 172.21.15.87:0/3204768715 wait complete. 2024-09-17T07:30:36.118 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 42 2024-09-17T07:30:36.118 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-17T07:30:36.129 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-17T07:30:36.129 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-17T07:30:36.129 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T07:30:36.146 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-17T07:30:36.146 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T07:30:36.204 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T07:30:36.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.338+0000 7fd7c999d640 1 -- 172.21.15.87:0/1839686034 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd7c41024f0 msgr2=0x7fd7c41028c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:36.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.338+0000 7fd7c999d640 1 --2- 172.21.15.87:0/1839686034 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd7c41024f0 0x7fd7c41028c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fd7b40048d0 tx=0x7fd7b4009da0 comp rx=0 tx=0).stop 2024-09-17T07:30:36.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.338+0000 7fd7c999d640 1 -- 172.21.15.87:0/1839686034 shutdown_connections 2024-09-17T07:30:36.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.338+0000 7fd7c999d640 1 --2- 172.21.15.87:0/1839686034 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd7c40fab20 0x7fd7c40faf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:36.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.338+0000 7fd7c999d640 1 --2- 172.21.15.87:0/1839686034 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd7c41024f0 0x7fd7c41028c0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:36.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.338+0000 7fd7c999d640 1 -- 172.21.15.87:0/1839686034 >> 172.21.15.87:0/1839686034 conn(0x7fd7c4070ba0 msgr2=0x7fd7c4070fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:36.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.338+0000 7fd7c999d640 1 -- 172.21.15.87:0/1839686034 shutdown_connections 2024-09-17T07:30:36.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.338+0000 7fd7c999d640 1 -- 172.21.15.87:0/1839686034 wait complete. 2024-09-17T07:30:36.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.338+0000 7fd7c999d640 1 Processor -- start 2024-09-17T07:30:36.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.338+0000 7fd7c999d640 1 -- start start 2024-09-17T07:30:36.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.338+0000 7fd7c999d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd7c40fab20 0x7fd7c4112d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:36.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.338+0000 7fd7c999d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd7c41024f0 0x7fd7c41132c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:36.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.339+0000 7fd7c999d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c41138c0 con 0x7fd7c41024f0 2024-09-17T07:30:36.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.339+0000 7fd7c999d640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c410cf10 con 0x7fd7c40fab20 2024-09-17T07:30:36.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.339+0000 7fd7c27fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd7c41024f0 0x7fd7c41132c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:36.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.339+0000 7fd7c27fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd7c41024f0 0x7fd7c41132c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56302/0 (socket says 172.21.15.87:56302) 2024-09-17T07:30:36.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.339+0000 7fd7c27fc640 1 -- 172.21.15.87:0/1889352553 learned_addr learned my addr 172.21.15.87:0/1889352553 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:30:36.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.339+0000 7fd7c2ffd640 1 --2- 172.21.15.87:0/1889352553 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd7c40fab20 0x7fd7c4112d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:36.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.339+0000 7fd7c27fc640 1 -- 172.21.15.87:0/1889352553 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd7c40fab20 msgr2=0x7fd7c4112d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:36.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.339+0000 7fd7c27fc640 1 --2- 172.21.15.87:0/1889352553 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd7c40fab20 0x7fd7c4112d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:36.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.339+0000 7fd7c27fc640 1 -- 172.21.15.87:0/1889352553 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7b4005040 con 0x7fd7c41024f0 2024-09-17T07:30:36.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.339+0000 7fd7c27fc640 1 --2- 172.21.15.87:0/1889352553 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd7c41024f0 0x7fd7c41132c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac002a50 tx=0x7fd7ac004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:36.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.339+0000 7fd7bb7fe640 1 -- 172.21.15.87:0/1889352553 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7ac007c30 con 0x7fd7c41024f0 2024-09-17T07:30:36.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.339+0000 7fd7bb7fe640 1 -- 172.21.15.87:0/1889352553 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fd7ac00f040 con 0x7fd7c41024f0 2024-09-17T07:30:36.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.339+0000 7fd7c999d640 1 -- 172.21.15.87:0/1889352553 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7c410d1f0 con 0x7fd7c41024f0 2024-09-17T07:30:36.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.339+0000 7fd7bb7fe640 1 -- 172.21.15.87:0/1889352553 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7ac00d990 con 0x7fd7c41024f0 2024-09-17T07:30:36.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.339+0000 7fd7c999d640 1 -- 172.21.15.87:0/1889352553 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7c410d790 con 0x7fd7c41024f0 2024-09-17T07:30:36.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.340+0000 7fd7c999d640 1 -- 172.21.15.87:0/1889352553 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7c4065530 con 0x7fd7c41024f0 2024-09-17T07:30:36.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.341+0000 7fd7bb7fe640 1 -- 172.21.15.87:0/1889352553 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fd7ac00dc50 con 0x7fd7c41024f0 2024-09-17T07:30:36.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.341+0000 7fd7bb7fe640 1 --2- 172.21.15.87:0/1889352553 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fd7b006cb90 0x7fd7b006f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:36.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.341+0000 7fd7bb7fe640 1 -- 172.21.15.87:0/1889352553 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fd7ac08ba20 con 0x7fd7c41024f0 2024-09-17T07:30:36.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.341+0000 7fd7c2ffd640 1 --2- 172.21.15.87:0/1889352553 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fd7b006cb90 0x7fd7b006f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:36.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.342+0000 7fd7c2ffd640 1 --2- 172.21.15.87:0/1889352553 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fd7b006cb90 0x7fd7b006f040 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd7b4009ac0 tx=0x7fd7b4035040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:36.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.345+0000 7fd7bb7fe640 1 -- 172.21.15.87:0/1889352553 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd7ac0559e0 con 0x7fd7c41024f0 2024-09-17T07:30:36.512 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.512+0000 7fd7c999d640 1 -- 172.21.15.87:0/1889352553 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd7c4109380 con 0x7fd7c41024f0 2024-09-17T07:30:36.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.513+0000 7fd7bb7fe640 1 -- 172.21.15.87:0/1889352553 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+16536 (secure 0 0 0) 0x7fd7ac059000 con 0x7fd7c41024f0 2024-09-17T07:30:36.514 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:30:36.514 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":82,"fsid":"d5dbf8d6-74c3-11ef-bceb-c7b262605968","created":"2024-09-17T07:10:35.674251+0000","modified":"2024-09-17T07:27:29.613292+0000","last_up_change":"2024-09-17T07:25:58.345957+0000","last_in_change":"2024-09-17T07:15:41.556417+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T07:14:46.855001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-09-17T07:17:13.907561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-09-17T07:17:14.594643+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aa28f635-8a58-48f8-bd4e-1626b8da9749","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":47,"up_from":51,"up_thru":76,"down_at":48,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1677183701},{"type":"v1","addr":"172.21.15.87:6803","nonce":1677183701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1677183701},{"type":"v1","addr":"172.21.15.87:6805","nonce":1677183701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":1677183701},{"type":"v1","addr":"172.21.15.87:6809","nonce":1677183701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1677183701},{"type":"v1","addr":"172.21.15.87:6807","nonce":1677183701}]},"public_addr":"172.21.15.87:6803/1677183701","cluster_addr":"172.21.15.87:6805/1677183701","heartbeat_back_addr":"172.21.15.87:6809/1677183701","heartbeat_front_addr":"172.21.15.87:6807/1677183701","state":["exists","up"]},{"osd":1,"uuid":"3a7464ee-c016-40fd-ab8a-9652397b193c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":52,"up_from":56,"up_thru":76,"down_at":53,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":952896512},{"type":"v1","addr":"172.21.15.87:6811","nonce":952896512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":952896512},{"type":"v1","addr":"172.21.15.87:6813","nonce":952896512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":952896512},{"type":"v1","addr":"172.21.15.87:6817","nonce":952896512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":952896512},{"type":"v1","addr":"172.21.15.87:6815","nonce":952896512}]},"public_addr":"172.21.15.87:6811/952896512","cluster_addr":"172.21.15.87:6813/952896512","heartbeat_back_addr":"172.21.15.87:6817/952896512","heartbeat_front_addr":"172.21.15.87:6815/952896512","state":["exists","up"]},{"osd":2,"uuid":"31ffe6e4-fa51-43ed-8887-022ad51fbd6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":57,"up_from":61,"up_thru":76,"down_at":58,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":3151708554},{"type":"v1","addr":"172.21.15.87:6819","nonce":3151708554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":3151708554},{"type":"v1","addr":"172.21.15.87:6821","nonce":3151708554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":3151708554},{"type":"v1","addr":"172.21.15.87:6825","nonce":3151708554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":3151708554},{"type":"v1","addr":"172.21.15.87:6823","nonce":3151708554}]},"public_addr":"172.21.15.87:6819/3151708554","cluster_addr":"172.21.15.87:6821/3151708554","heartbeat_back_addr":"172.21.15.87:6825/3151708554","heartbeat_front_addr":"172.21.15.87:6823/3151708554","state":["exists","up"]},{"osd":3,"uuid":"00b175ca-ddfd-41f9-b219-130321a7fbc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":26,"last_clean_end":62,"up_from":66,"up_thru":76,"down_at":63,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":3281602359},{"type":"v1","addr":"172.21.15.139:6801","nonce":3281602359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":3281602359},{"type":"v1","addr":"172.21.15.139:6803","nonce":3281602359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":3281602359},{"type":"v1","addr":"172.21.15.139:6807","nonce":3281602359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":3281602359},{"type":"v1","addr":"172.21.15.139:6805","nonce":3281602359}]},"public_addr":"172.21.15.139:6801/3281602359","cluster_addr":"172.21.15.139:6803/3281602359","heartbeat_back_addr":"172.21.15.139:6807/3281602359","heartbeat_front_addr":"172.21.15.139:6805/3281602359","state":["exists","up"]},{"osd":4,"uuid":"d318cab6-e472-472e-8805-d2ab7e04db2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":32,"last_clean_end":67,"up_from":71,"up_thru":76,"down_at":68,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":137480765},{"type":"v1","addr":"172.21.15.139:6809","nonce":137480765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":137480765},{"type":"v1","addr":"172.21.15.139:6811","nonce":137480765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":137480765},{"type":"v1","addr":"172.21.15.139:6815","nonce":137480765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":137480765},{"type":"v1","addr":"172.21.15.139:6813","nonce":137480765}]},"public_addr":"172.21.15.139:6809/137480765","cluster_addr":"172.21.15.139:6811/137480765","heartbeat_back_addr":"172.21.15.139:6815/137480765","heartbeat_front_addr":"172.21.15.139:6813/137480765","state":["exists","up"]},{"osd":5,"uuid":"37b86806-e559-401c-aedf-3d9de1ac347e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":37,"last_clean_end":72,"up_from":76,"up_thru":76,"down_at":73,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":4036107320},{"type":"v1","addr":"172.21.15.139:6817","nonce":4036107320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":4036107320},{"type":"v1","addr":"172.21.15.139:6819","nonce":4036107320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":4036107320},{"type":"v1","addr":"172.21.15.139:6823","nonce":4036107320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":4036107320},{"type":"v1","addr":"172.21.15.139:6821","nonce":4036107320}]},"public_addr":"172.21.15.139:6817/4036107320","cluster_addr":"172.21.15.139:6819/4036107320","heartbeat_back_addr":"172.21.15.139:6823/4036107320","heartbeat_front_addr":"172.21.15.139:6821/4036107320","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T07:13:50.061288+0000","dead_epoch":47},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T07:14:15.941888+0000","dead_epoch":52},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T07:14:44.449653+0000","dead_epoch":57},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T07:15:08.229646+0000","dead_epoch":62},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T07:15:33.299519+0000","dead_epoch":67},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T07:15:58.647774+0000","dead_epoch":72}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.87:6829/2255237099":"2024-09-18T07:26:50.197946+0000","172.21.15.87:6828/2255237099":"2024-09-18T07:26:50.197946+0000","172.21.15.87:0/614478534":"2024-09-18T07:21:58.033791+0000","172.21.15.87:0/3876385220":"2024-09-18T07:21:58.033791+0000","172.21.15.87:0/3936071784":"2024-09-18T07:21:58.033791+0000","172.21.15.87:0/3287211314":"2024-09-18T07:21:58.033791+0000","172.21.15.87:0/992892562":"2024-09-18T07:21:58.033791+0000","172.21.15.139:0/1157945461":"2024-09-18T07:21:18.807798+0000","172.21.15.87:6826/3333749861":"2024-09-18T07:17:30.381338+0000","172.21.15.87:0/2382049370":"2024-09-18T07:11:03.573097+0000","172.21.15.87:0/990687259":"2024-09-18T07:19:39.061872+0000","172.21.15.87:0/1935417402":"2024-09-18T07:11:03.573097+0000","172.21.15.139:0/712755220":"2024-09-18T07:21:18.807798+0000","172.21.15.87:0/853807276":"2024-09-18T07:11:03.573097+0000","172.21.15.87:6800/3398669653":"2024-09-18T07:21:58.033791+0000","172.21.15.139:6829/3218632563":"2024-09-18T07:21:18.807798+0000","172.21.15.87:0/2056368138":"2024-09-18T07:12:36.550496+0000","172.21.15.87:0/822055517":"2024-09-18T07:21:58.033791+0000","172.21.15.87:0/3586936716":"2024-09-18T07:19:39.061872+0000","172.21.15.87:0/2629320129":"2024-09-18T07:11:32.590075+0000","172.21.15.139:0/1643063298":"2024-09-18T07:21:18.807798+0000","172.21.15.87:6827/3333749861":"2024-09-18T07:17:30.381338+0000","172.21.15.87:0/443165441":"2024-09-18T07:12:36.550496+0000","172.21.15.87:0/147535528":"2024-09-18T07:19:39.061872+0000","172.21.15.87:0/2452100146":"2024-09-18T07:11:32.590075+0000","172.21.15.139:0/1909420975":"2024-09-18T07:21:18.807798+0000","172.21.15.139:6828/3218632563":"2024-09-18T07:21:18.807798+0000","172.21.15.87:6800/611048628":"2024-09-18T07:19:39.061872+0000","172.21.15.87:6801/2341884603":"2024-09-18T07:12:36.550496+0000","172.21.15.87:6801/2633029569":"2024-09-18T07:11:03.573097+0000","172.21.15.87:6800/1735030430":"2024-09-18T07:11:32.590075+0000","172.21.15.87:6801/611048628":"2024-09-18T07:19:39.061872+0000","172.21.15.87:6800/2341884603":"2024-09-18T07:12:36.550496+0000","172.21.15.87:6801/1735030430":"2024-09-18T07:11:32.590075+0000","172.21.15.87:6800/2633029569":"2024-09-18T07:11:03.573097+0000","172.21.15.87:0/346024124":"2024-09-18T07:19:39.061872+0000","172.21.15.87:6801/3398669653":"2024-09-18T07:21:58.033791+0000","172.21.15.87:0/228221666":"2024-09-18T07:11:32.590075+0000","172.21.15.87:0/2357718754":"2024-09-18T07:12:36.550496+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T07:30:36.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.515+0000 7fd7c999d640 1 -- 172.21.15.87:0/1889352553 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fd7b006cb90 msgr2=0x7fd7b006f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:36.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.515+0000 7fd7c999d640 1 --2- 172.21.15.87:0/1889352553 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fd7b006cb90 0x7fd7b006f040 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd7b4009ac0 tx=0x7fd7b4035040 comp rx=0 tx=0).stop 2024-09-17T07:30:36.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.515+0000 7fd7c999d640 1 -- 172.21.15.87:0/1889352553 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd7c41024f0 msgr2=0x7fd7c41132c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:36.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.515+0000 7fd7c999d640 1 --2- 172.21.15.87:0/1889352553 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd7c41024f0 0x7fd7c41132c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac002a50 tx=0x7fd7ac004600 comp rx=0 tx=0).stop 2024-09-17T07:30:36.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.515+0000 7fd7c999d640 1 -- 172.21.15.87:0/1889352553 shutdown_connections 2024-09-17T07:30:36.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.515+0000 7fd7c999d640 1 --2- 172.21.15.87:0/1889352553 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd7c41024f0 0x7fd7c41132c0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:36.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.515+0000 7fd7c999d640 1 --2- 172.21.15.87:0/1889352553 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fd7b006cb90 0x7fd7b006f040 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:36.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.515+0000 7fd7c999d640 1 --2- 172.21.15.87:0/1889352553 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd7c40fab20 0x7fd7c4112d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:36.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.515+0000 7fd7c999d640 1 -- 172.21.15.87:0/1889352553 >> 172.21.15.87:0/1889352553 conn(0x7fd7c4070ba0 msgr2=0x7fd7c41059b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:36.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.515+0000 7fd7c999d640 1 -- 172.21.15.87:0/1889352553 shutdown_connections 2024-09-17T07:30:36.516 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.515+0000 7fd7c999d640 1 -- 172.21.15.87:0/1889352553 wait complete. 2024-09-17T07:30:36.526 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T07:14:46.855001+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-09-17T07:17:13.907561+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-09-17T07:17:14.594643+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T07:30:36.526 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T07:30:36.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.622+0000 7f36564e8640 1 -- 172.21.15.87:0/3383070759 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36501024a0 msgr2=0x7f3650102870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:36.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.622+0000 7f36564e8640 1 --2- 172.21.15.87:0/3383070759 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36501024a0 0x7f3650102870 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f36400048d0 tx=0x7f3640009da0 comp rx=0 tx=0).stop 2024-09-17T07:30:36.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.623+0000 7f36564e8640 1 -- 172.21.15.87:0/3383070759 shutdown_connections 2024-09-17T07:30:36.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.623+0000 7f36564e8640 1 --2- 172.21.15.87:0/3383070759 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f36500fc460 0x7f36500fc8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:36.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.623+0000 7f36564e8640 1 --2- 172.21.15.87:0/3383070759 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36501024a0 0x7f3650102870 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:36.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.623+0000 7f36564e8640 1 -- 172.21.15.87:0/3383070759 >> 172.21.15.87:0/3383070759 conn(0x7f36500f8040 msgr2=0x7f36500fa450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:36.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.623+0000 7f36564e8640 1 -- 172.21.15.87:0/3383070759 shutdown_connections 2024-09-17T07:30:36.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.623+0000 7f36564e8640 1 -- 172.21.15.87:0/3383070759 wait complete. 2024-09-17T07:30:36.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.623+0000 7f36564e8640 1 Processor -- start 2024-09-17T07:30:36.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.623+0000 7f36564e8640 1 -- start start 2024-09-17T07:30:36.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.623+0000 7f36564e8640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f36500fc460 0x7f3650112e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:36.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.623+0000 7f36564e8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36501024a0 0x7f36501133d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:36.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.623+0000 7f36564e8640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36501139d0 con 0x7f36501024a0 2024-09-17T07:30:36.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.624+0000 7f36564e8640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f365010d020 con 0x7f36500fc460 2024-09-17T07:30:36.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.624+0000 7f364f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36501024a0 0x7f36501133d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:36.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.624+0000 7f364f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36501024a0 0x7f36501133d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56330/0 (socket says 172.21.15.87:56330) 2024-09-17T07:30:36.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.624+0000 7f364f7fe640 1 -- 172.21.15.87:0/3904013669 learned_addr learned my addr 172.21.15.87:0/3904013669 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:30:36.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.624+0000 7f364ffff640 1 --2- 172.21.15.87:0/3904013669 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f36500fc460 0x7f3650112e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:36.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.624+0000 7f364f7fe640 1 -- 172.21.15.87:0/3904013669 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f36500fc460 msgr2=0x7f3650112e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:36.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.624+0000 7f364f7fe640 1 --2- 172.21.15.87:0/3904013669 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f36500fc460 0x7f3650112e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:36.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.624+0000 7f364f7fe640 1 -- 172.21.15.87:0/3904013669 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3640005040 con 0x7f36501024a0 2024-09-17T07:30:36.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.624+0000 7f364f7fe640 1 --2- 172.21.15.87:0/3904013669 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36501024a0 0x7f36501133d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f3644002a50 tx=0x7f3644004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:36.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.624+0000 7f364cff9640 1 -- 172.21.15.87:0/3904013669 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3644007c30 con 0x7f36501024a0 2024-09-17T07:30:36.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.624+0000 7f364cff9640 1 -- 172.21.15.87:0/3904013669 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f364400f040 con 0x7f36501024a0 2024-09-17T07:30:36.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.624+0000 7f364cff9640 1 -- 172.21.15.87:0/3904013669 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f364400d910 con 0x7f36501024a0 2024-09-17T07:30:36.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.624+0000 7f36564e8640 1 -- 172.21.15.87:0/3904013669 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f365010d300 con 0x7f36501024a0 2024-09-17T07:30:36.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.624+0000 7f36564e8640 1 -- 172.21.15.87:0/3904013669 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f365010d820 con 0x7f36501024a0 2024-09-17T07:30:36.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.625+0000 7f36564e8640 1 -- 172.21.15.87:0/3904013669 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36500fdba0 con 0x7f36501024a0 2024-09-17T07:30:36.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.626+0000 7f364cff9640 1 -- 172.21.15.87:0/3904013669 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f364400db80 con 0x7f36501024a0 2024-09-17T07:30:36.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.626+0000 7f364cff9640 1 --2- 172.21.15.87:0/3904013669 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f363806cb90 0x7f363806f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:36.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.626+0000 7f364cff9640 1 -- 172.21.15.87:0/3904013669 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f364408b820 con 0x7f36501024a0 2024-09-17T07:30:36.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.626+0000 7f364ffff640 1 --2- 172.21.15.87:0/3904013669 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f363806cb90 0x7f363806f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:36.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.627+0000 7f364ffff640 1 --2- 172.21.15.87:0/3904013669 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f363806cb90 0x7f363806f040 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3640000c00 tx=0x7f3640035040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:36.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.630+0000 7f364cff9640 1 -- 172.21.15.87:0/3904013669 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f3644055910 con 0x7f36501024a0 2024-09-17T07:30:36.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.791+0000 7f36564e8640 1 -- 172.21.15.87:0/3904013669 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3650109300 con 0x7f36501024a0 2024-09-17T07:30:36.791 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.791+0000 7f364cff9640 1 -- 172.21.15.87:0/3904013669 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3644058f30 con 0x7f36501024a0 2024-09-17T07:30:36.792 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 1 2024-09-17T07:30:36.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.793+0000 7f36564e8640 1 -- 172.21.15.87:0/3904013669 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f363806cb90 msgr2=0x7f363806f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:36.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.793+0000 7f36564e8640 1 --2- 172.21.15.87:0/3904013669 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f363806cb90 0x7f363806f040 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3640000c00 tx=0x7f3640035040 comp rx=0 tx=0).stop 2024-09-17T07:30:36.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.793+0000 7f36564e8640 1 -- 172.21.15.87:0/3904013669 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36501024a0 msgr2=0x7f36501133d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:36.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.793+0000 7f36564e8640 1 --2- 172.21.15.87:0/3904013669 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36501024a0 0x7f36501133d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f3644002a50 tx=0x7f3644004600 comp rx=0 tx=0).stop 2024-09-17T07:30:36.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.793+0000 7f36564e8640 1 -- 172.21.15.87:0/3904013669 shutdown_connections 2024-09-17T07:30:36.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.793+0000 7f36564e8640 1 --2- 172.21.15.87:0/3904013669 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36501024a0 0x7f36501133d0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:36.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.793+0000 7f36564e8640 1 --2- 172.21.15.87:0/3904013669 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f363806cb90 0x7f363806f040 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:36.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.793+0000 7f36564e8640 1 --2- 172.21.15.87:0/3904013669 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f36500fc460 0x7f3650112e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:36.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.793+0000 7f36564e8640 1 -- 172.21.15.87:0/3904013669 >> 172.21.15.87:0/3904013669 conn(0x7f36500f8040 msgr2=0x7f36500f8410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:36.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.793+0000 7f36564e8640 1 -- 172.21.15.87:0/3904013669 shutdown_connections 2024-09-17T07:30:36.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.793+0000 7f36564e8640 1 -- 172.21.15.87:0/3904013669 wait complete. 2024-09-17T07:30:36.804 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:36 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/651052165' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 40, "format": "json"}]: dispatch 2024-09-17T07:30:36.804 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:36 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/3042575807' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 41, "format": "json"}]: dispatch 2024-09-17T07:30:36.804 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:36 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/3204768715' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 42, "format": "json"}]: dispatch 2024-09-17T07:30:36.804 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:36 smithi087 ceph-mon[90982]: pgmap v297: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:30:36.805 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-09-17T07:30:36.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:36 smithi139 ceph-mon[79872]: from='client.? 172.21.15.87:0/651052165' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 40, "format": "json"}]: dispatch 2024-09-17T07:30:36.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:36 smithi139 ceph-mon[79872]: from='client.? 172.21.15.87:0/3042575807' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 41, "format": "json"}]: dispatch 2024-09-17T07:30:36.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:36 smithi139 ceph-mon[79872]: from='client.? 172.21.15.87:0/3204768715' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 42, "format": "json"}]: dispatch 2024-09-17T07:30:36.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:36 smithi139 ceph-mon[79872]: pgmap v297: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:30:36.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.902+0000 7f3c0489f640 1 -- 172.21.15.87:0/1749690116 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3c000fb3a0 msgr2=0x7f3c000fb7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:36.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.902+0000 7f3c0489f640 1 --2- 172.21.15.87:0/1749690116 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3c000fb3a0 0x7f3c000fb7f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f3bf40048d0 tx=0x7f3bf4009da0 comp rx=0 tx=0).stop 2024-09-17T07:30:36.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.902+0000 7f3c0489f640 1 -- 172.21.15.87:0/1749690116 shutdown_connections 2024-09-17T07:30:36.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.902+0000 7f3c0489f640 1 --2- 172.21.15.87:0/1749690116 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3c000fb3a0 0x7f3c000fb7f0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:36.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.902+0000 7f3c0489f640 1 --2- 172.21.15.87:0/1749690116 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3c001013c0 0x7f3c00101790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:36.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.902+0000 7f3c0489f640 1 -- 172.21.15.87:0/1749690116 >> 172.21.15.87:0/1749690116 conn(0x7f3c00071360 msgr2=0x7f3c00071760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:36.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.902+0000 7f3c0489f640 1 -- 172.21.15.87:0/1749690116 shutdown_connections 2024-09-17T07:30:36.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.902+0000 7f3c0489f640 1 -- 172.21.15.87:0/1749690116 wait complete. 2024-09-17T07:30:36.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.902+0000 7f3c0489f640 1 Processor -- start 2024-09-17T07:30:36.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.902+0000 7f3c0489f640 1 -- start start 2024-09-17T07:30:36.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.902+0000 7f3c0489f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3c000fb3a0 0x7f3c0010df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:36.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.902+0000 7f3c0489f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3c001013c0 0x7f3c0010e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:36.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.902+0000 7f3c0489f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c00065590 con 0x7f3c001013c0 2024-09-17T07:30:36.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.902+0000 7f3c0489f640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0010e9b0 con 0x7f3c000fb3a0 2024-09-17T07:30:36.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.902+0000 7f3bfdd9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3c001013c0 0x7f3c0010e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:36.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.903+0000 7f3bfdd9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3c001013c0 0x7f3c0010e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56354/0 (socket says 172.21.15.87:56354) 2024-09-17T07:30:36.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.903+0000 7f3bfdd9b640 1 -- 172.21.15.87:0/1138137387 learned_addr learned my addr 172.21.15.87:0/1138137387 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:30:36.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.903+0000 7f3bfe59c640 1 --2- 172.21.15.87:0/1138137387 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3c000fb3a0 0x7f3c0010df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:36.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.903+0000 7f3bfdd9b640 1 -- 172.21.15.87:0/1138137387 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3c000fb3a0 msgr2=0x7f3c0010df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:36.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.903+0000 7f3bfdd9b640 1 --2- 172.21.15.87:0/1138137387 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3c000fb3a0 0x7f3c0010df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:36.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.903+0000 7f3bfdd9b640 1 -- 172.21.15.87:0/1138137387 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bf4005040 con 0x7f3c001013c0 2024-09-17T07:30:36.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.903+0000 7f3bfdd9b640 1 --2- 172.21.15.87:0/1138137387 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3c001013c0 0x7f3c0010e470 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3bf4004930 tx=0x7f3bf4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:36.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.903+0000 7f3beeffd640 1 -- 172.21.15.87:0/1138137387 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3bf4038070 con 0x7f3c001013c0 2024-09-17T07:30:36.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.903+0000 7f3beeffd640 1 -- 172.21.15.87:0/1138137387 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f3bf4009780 con 0x7f3c001013c0 2024-09-17T07:30:36.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.903+0000 7f3c0489f640 1 -- 172.21.15.87:0/1138137387 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c0010ec30 con 0x7f3c001013c0 2024-09-17T07:30:36.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.903+0000 7f3beeffd640 1 -- 172.21.15.87:0/1138137387 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3bf4033660 con 0x7f3c001013c0 2024-09-17T07:30:36.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.903+0000 7f3c0489f640 1 -- 172.21.15.87:0/1138137387 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c00117210 con 0x7f3c001013c0 2024-09-17T07:30:36.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.904+0000 7f3c0489f640 1 -- 172.21.15.87:0/1138137387 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c000fca80 con 0x7f3c001013c0 2024-09-17T07:30:36.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.904+0000 7f3beeffd640 1 -- 172.21.15.87:0/1138137387 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f3bf4030020 con 0x7f3c001013c0 2024-09-17T07:30:36.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.905+0000 7f3beeffd640 1 --2- 172.21.15.87:0/1138137387 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f3be806cb90 0x7f3be806f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:36.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.905+0000 7f3beeffd640 1 -- 172.21.15.87:0/1138137387 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f3bf40ac7d0 con 0x7f3c001013c0 2024-09-17T07:30:36.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.905+0000 7f3bfe59c640 1 --2- 172.21.15.87:0/1138137387 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f3be806cb90 0x7f3be806f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:36.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.905+0000 7f3bfe59c640 1 --2- 172.21.15.87:0/1138137387 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f3be806cb90 0x7f3be806f040 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3bf00049b0 tx=0x7f3bf000b040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:36.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:36.909+0000 7f3beeffd640 1 -- 172.21.15.87:0/1138137387 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f3bf40768d0 con 0x7f3c001013c0 2024-09-17T07:30:37.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.067+0000 7f3c0489f640 1 -- 172.21.15.87:0/1138137387 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f3c00108270 con 0x7f3c001013c0 2024-09-17T07:30:37.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.068+0000 7f3beeffd640 1 -- 172.21.15.87:0/1138137387 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v82) v1 ==== 107+0+11 (secure 0 0 0) 0x7f3bf4079ef0 con 0x7f3c001013c0 2024-09-17T07:30:37.068 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2024-09-17T07:30:37.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.070+0000 7f3c0489f640 1 -- 172.21.15.87:0/1138137387 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f3be806cb90 msgr2=0x7f3be806f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:37.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.070+0000 7f3c0489f640 1 --2- 172.21.15.87:0/1138137387 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f3be806cb90 0x7f3be806f040 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3bf00049b0 tx=0x7f3bf000b040 comp rx=0 tx=0).stop 2024-09-17T07:30:37.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.070+0000 7f3c0489f640 1 -- 172.21.15.87:0/1138137387 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3c001013c0 msgr2=0x7f3c0010e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:37.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.070+0000 7f3c0489f640 1 --2- 172.21.15.87:0/1138137387 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3c001013c0 0x7f3c0010e470 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3bf4004930 tx=0x7f3bf4009da0 comp rx=0 tx=0).stop 2024-09-17T07:30:37.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.070+0000 7f3c0489f640 1 -- 172.21.15.87:0/1138137387 shutdown_connections 2024-09-17T07:30:37.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.070+0000 7f3c0489f640 1 --2- 172.21.15.87:0/1138137387 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3c001013c0 0x7f3c0010e470 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:37.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.070+0000 7f3c0489f640 1 --2- 172.21.15.87:0/1138137387 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f3be806cb90 0x7f3be806f040 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:37.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.070+0000 7f3c0489f640 1 --2- 172.21.15.87:0/1138137387 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3c000fb3a0 0x7f3c0010df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:37.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.070+0000 7f3c0489f640 1 -- 172.21.15.87:0/1138137387 >> 172.21.15.87:0/1138137387 conn(0x7f3c00071360 msgr2=0x7f3c000feef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:37.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.070+0000 7f3c0489f640 1 -- 172.21.15.87:0/1138137387 shutdown_connections 2024-09-17T07:30:37.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.070+0000 7f3c0489f640 1 -- 172.21.15.87:0/1138137387 wait complete. 2024-09-17T07:30:37.080 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-09-17T07:30:37.178 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.178+0000 7fcd62d9d640 1 -- 172.21.15.87:0/700596574 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcd5c1014f0 msgr2=0x7fcd5c1018c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:37.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.178+0000 7fcd62d9d640 1 --2- 172.21.15.87:0/700596574 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcd5c1014f0 0x7fcd5c1018c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fcd500048d0 tx=0x7fcd50009da0 comp rx=0 tx=0).stop 2024-09-17T07:30:37.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.178+0000 7fcd62d9d640 1 -- 172.21.15.87:0/700596574 shutdown_connections 2024-09-17T07:30:37.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.178+0000 7fcd62d9d640 1 --2- 172.21.15.87:0/700596574 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcd5c0fab50 0x7fcd5c0fafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:37.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.178+0000 7fcd62d9d640 1 --2- 172.21.15.87:0/700596574 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcd5c1014f0 0x7fcd5c1018c0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:37.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.178+0000 7fcd62d9d640 1 -- 172.21.15.87:0/700596574 >> 172.21.15.87:0/700596574 conn(0x7fcd5c070b30 msgr2=0x7fcd5c070f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:37.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.178+0000 7fcd62d9d640 1 -- 172.21.15.87:0/700596574 shutdown_connections 2024-09-17T07:30:37.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.178+0000 7fcd62d9d640 1 -- 172.21.15.87:0/700596574 wait complete. 2024-09-17T07:30:37.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.179+0000 7fcd62d9d640 1 Processor -- start 2024-09-17T07:30:37.179 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.179+0000 7fcd62d9d640 1 -- start start 2024-09-17T07:30:37.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.179+0000 7fcd62d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcd5c0fab50 0x7fcd5c112e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:37.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.179+0000 7fcd62d9d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcd5c1014f0 0x7fcd5c113380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:37.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.179+0000 7fcd62d9d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5c113980 con 0x7fcd5c0fab50 2024-09-17T07:30:37.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.179+0000 7fcd62d9d640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5c10cfd0 con 0x7fcd5c1014f0 2024-09-17T07:30:37.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.179+0000 7fcd60b39640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcd5c0fab50 0x7fcd5c112e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:37.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.179+0000 7fcd60b39640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcd5c0fab50 0x7fcd5c112e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56366/0 (socket says 172.21.15.87:56366) 2024-09-17T07:30:37.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.179+0000 7fcd60b39640 1 -- 172.21.15.87:0/1057366200 learned_addr learned my addr 172.21.15.87:0/1057366200 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:30:37.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.179+0000 7fcd5bfff640 1 --2- 172.21.15.87:0/1057366200 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcd5c1014f0 0x7fcd5c113380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:37.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.179+0000 7fcd60b39640 1 -- 172.21.15.87:0/1057366200 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcd5c1014f0 msgr2=0x7fcd5c113380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:37.181 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.179+0000 7fcd60b39640 1 --2- 172.21.15.87:0/1057366200 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcd5c1014f0 0x7fcd5c113380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:37.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.179+0000 7fcd60b39640 1 -- 172.21.15.87:0/1057366200 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd50005040 con 0x7fcd5c0fab50 2024-09-17T07:30:37.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.180+0000 7fcd60b39640 1 --2- 172.21.15.87:0/1057366200 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcd5c0fab50 0x7fcd5c112e40 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fcd500043d0 tx=0x7fcd50009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:37.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.180+0000 7fcd597fa640 1 -- 172.21.15.87:0/1057366200 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd50038070 con 0x7fcd5c0fab50 2024-09-17T07:30:37.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.180+0000 7fcd62d9d640 1 -- 172.21.15.87:0/1057366200 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd5c10d250 con 0x7fcd5c0fab50 2024-09-17T07:30:37.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.180+0000 7fcd597fa640 1 -- 172.21.15.87:0/1057366200 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fcd500096c0 con 0x7fcd5c0fab50 2024-09-17T07:30:37.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.180+0000 7fcd597fa640 1 -- 172.21.15.87:0/1057366200 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd5002c6e0 con 0x7fcd5c0fab50 2024-09-17T07:30:37.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.180+0000 7fcd62d9d640 1 -- 172.21.15.87:0/1057366200 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd5c10d710 con 0x7fcd5c0fab50 2024-09-17T07:30:37.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.181+0000 7fcd62d9d640 1 -- 172.21.15.87:0/1057366200 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd5c065550 con 0x7fcd5c0fab50 2024-09-17T07:30:37.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.181+0000 7fcd597fa640 1 -- 172.21.15.87:0/1057366200 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fcd50030020 con 0x7fcd5c0fab50 2024-09-17T07:30:37.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.182+0000 7fcd597fa640 1 --2- 172.21.15.87:0/1057366200 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fcd4c06cb90 0x7fcd4c06f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:37.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.182+0000 7fcd597fa640 1 -- 172.21.15.87:0/1057366200 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fcd500abef0 con 0x7fcd5c0fab50 2024-09-17T07:30:37.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.182+0000 7fcd5bfff640 1 --2- 172.21.15.87:0/1057366200 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fcd4c06cb90 0x7fcd4c06f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:37.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.182+0000 7fcd5bfff640 1 --2- 172.21.15.87:0/1057366200 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fcd4c06cb90 0x7fcd4c06f040 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c10e700 tx=0x7fcd4800b040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:37.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.186+0000 7fcd597fa640 1 -- 172.21.15.87:0/1057366200 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fcd50075f70 con 0x7fcd5c0fab50 2024-09-17T07:30:37.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.347+0000 7fcd62d9d640 1 -- 172.21.15.87:0/1057366200 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7fcd5c10e540 con 0x7fcd5c0fab50 2024-09-17T07:30:37.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.347+0000 7fcd597fa640 1 -- 172.21.15.87:0/1057366200 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v82) v1 ==== 107+0+11 (secure 0 0 0) 0x7fcd50079590 con 0x7fcd5c0fab50 2024-09-17T07:30:37.347 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2024-09-17T07:30:37.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.349+0000 7fcd62d9d640 1 -- 172.21.15.87:0/1057366200 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fcd4c06cb90 msgr2=0x7fcd4c06f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:37.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.349+0000 7fcd62d9d640 1 --2- 172.21.15.87:0/1057366200 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fcd4c06cb90 0x7fcd4c06f040 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c10e700 tx=0x7fcd4800b040 comp rx=0 tx=0).stop 2024-09-17T07:30:37.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.349+0000 7fcd62d9d640 1 -- 172.21.15.87:0/1057366200 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcd5c0fab50 msgr2=0x7fcd5c112e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:37.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.349+0000 7fcd62d9d640 1 --2- 172.21.15.87:0/1057366200 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcd5c0fab50 0x7fcd5c112e40 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fcd500043d0 tx=0x7fcd50009da0 comp rx=0 tx=0).stop 2024-09-17T07:30:37.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.349+0000 7fcd62d9d640 1 -- 172.21.15.87:0/1057366200 shutdown_connections 2024-09-17T07:30:37.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.349+0000 7fcd62d9d640 1 --2- 172.21.15.87:0/1057366200 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fcd4c06cb90 0x7fcd4c06f040 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:37.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.349+0000 7fcd62d9d640 1 --2- 172.21.15.87:0/1057366200 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcd5c1014f0 0x7fcd5c113380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:37.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.349+0000 7fcd62d9d640 1 --2- 172.21.15.87:0/1057366200 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcd5c0fab50 0x7fcd5c112e40 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:37.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.349+0000 7fcd62d9d640 1 -- 172.21.15.87:0/1057366200 >> 172.21.15.87:0/1057366200 conn(0x7fcd5c070b30 msgr2=0x7fcd5c0f8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:37.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.350+0000 7fcd62d9d640 1 -- 172.21.15.87:0/1057366200 shutdown_connections 2024-09-17T07:30:37.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.350+0000 7fcd62d9d640 1 -- 172.21.15.87:0/1057366200 wait complete. 2024-09-17T07:30:37.360 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T07:30:37.457 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.456+0000 7ff30c03f640 1 -- 172.21.15.87:0/1823362804 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3041013c0 msgr2=0x7ff304101790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:37.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.456+0000 7ff30c03f640 1 --2- 172.21.15.87:0/1823362804 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3041013c0 0x7ff304101790 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff2f80048d0 tx=0x7ff2f8009da0 comp rx=0 tx=0).stop 2024-09-17T07:30:37.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.456+0000 7ff30c03f640 1 -- 172.21.15.87:0/1823362804 shutdown_connections 2024-09-17T07:30:37.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.456+0000 7ff30c03f640 1 --2- 172.21.15.87:0/1823362804 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff3040fb3a0 0x7ff3040fb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:37.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.456+0000 7ff30c03f640 1 --2- 172.21.15.87:0/1823362804 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3041013c0 0x7ff304101790 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:37.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.456+0000 7ff30c03f640 1 -- 172.21.15.87:0/1823362804 >> 172.21.15.87:0/1823362804 conn(0x7ff304071360 msgr2=0x7ff304071760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:37.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.456+0000 7ff30c03f640 1 -- 172.21.15.87:0/1823362804 shutdown_connections 2024-09-17T07:30:37.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.456+0000 7ff30c03f640 1 -- 172.21.15.87:0/1823362804 wait complete. 2024-09-17T07:30:37.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.456+0000 7ff30c03f640 1 Processor -- start 2024-09-17T07:30:37.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.456+0000 7ff30c03f640 1 -- start start 2024-09-17T07:30:37.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.456+0000 7ff30c03f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff3040fb3a0 0x7ff304111cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:37.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.456+0000 7ff30c03f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3041013c0 0x7ff304112200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:37.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.456+0000 7ff30c03f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff304112800 con 0x7ff3041013c0 2024-09-17T07:30:37.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.456+0000 7ff30c03f640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff30410be50 con 0x7ff3040fb3a0 2024-09-17T07:30:37.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.457+0000 7ff3095da640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3041013c0 0x7ff304112200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:37.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.457+0000 7ff3095da640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3041013c0 0x7ff304112200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56382/0 (socket says 172.21.15.87:56382) 2024-09-17T07:30:37.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.457+0000 7ff3095da640 1 -- 172.21.15.87:0/990478069 learned_addr learned my addr 172.21.15.87:0/990478069 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:30:37.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.457+0000 7ff309ddb640 1 --2- 172.21.15.87:0/990478069 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff3040fb3a0 0x7ff304111cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:37.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.457+0000 7ff3095da640 1 -- 172.21.15.87:0/990478069 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff3040fb3a0 msgr2=0x7ff304111cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:37.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.457+0000 7ff3095da640 1 --2- 172.21.15.87:0/990478069 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff3040fb3a0 0x7ff304111cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:37.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.457+0000 7ff3095da640 1 -- 172.21.15.87:0/990478069 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2f8005040 con 0x7ff3041013c0 2024-09-17T07:30:37.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.457+0000 7ff3095da640 1 --2- 172.21.15.87:0/990478069 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3041013c0 0x7ff304112200 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff300002a50 tx=0x7ff300004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:37.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.457+0000 7ff2f67fc640 1 -- 172.21.15.87:0/990478069 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff300007c30 con 0x7ff3041013c0 2024-09-17T07:30:37.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.457+0000 7ff2f67fc640 1 -- 172.21.15.87:0/990478069 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7ff30000f040 con 0x7ff3041013c0 2024-09-17T07:30:37.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.457+0000 7ff30c03f640 1 -- 172.21.15.87:0/990478069 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff30410c130 con 0x7ff3041013c0 2024-09-17T07:30:37.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.457+0000 7ff2f67fc640 1 -- 172.21.15.87:0/990478069 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff30000d900 con 0x7ff3041013c0 2024-09-17T07:30:37.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.457+0000 7ff30c03f640 1 -- 172.21.15.87:0/990478069 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff30410c6d0 con 0x7ff3041013c0 2024-09-17T07:30:37.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.458+0000 7ff30c03f640 1 -- 172.21.15.87:0/990478069 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3040fca80 con 0x7ff3041013c0 2024-09-17T07:30:37.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.459+0000 7ff2f67fc640 1 -- 172.21.15.87:0/990478069 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7ff30000da80 con 0x7ff3041013c0 2024-09-17T07:30:37.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.459+0000 7ff2f67fc640 1 --2- 172.21.15.87:0/990478069 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7ff2f006cb90 0x7ff2f006f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:37.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.459+0000 7ff2f67fc640 1 -- 172.21.15.87:0/990478069 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6496+0+0 (secure 0 0 0) 0x7ff30008b810 con 0x7ff3041013c0 2024-09-17T07:30:37.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.459+0000 7ff309ddb640 1 --2- 172.21.15.87:0/990478069 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7ff2f006cb90 0x7ff2f006f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:37.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.460+0000 7ff309ddb640 1 --2- 172.21.15.87:0/990478069 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7ff2f006cb90 0x7ff2f006f040 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff2f802ab40 tx=0x7ff2f8035040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:37.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.463+0000 7ff2f67fc640 1 -- 172.21.15.87:0/990478069 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff3000557d0 con 0x7ff3041013c0 2024-09-17T07:30:37.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.634+0000 7ff30c03f640 1 -- 172.21.15.87:0/990478069 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff304108210 con 0x7ff3041013c0 2024-09-17T07:30:37.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.634+0000 7ff2f67fc640 1 -- 172.21.15.87:0/990478069 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 39 entries v82) v1 ==== 81+0+2304 (secure 0 0 0) 0x7ff300058df0 con 0x7ff3041013c0 2024-09-17T07:30:37.635 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6829/2255237099 2024-09-18T07:26:50.197946+0000 2024-09-17T07:30:37.635 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6828/2255237099 2024-09-18T07:26:50.197946+0000 2024-09-17T07:30:37.635 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:0/614478534 2024-09-18T07:21:58.033791+0000 2024-09-17T07:30:37.635 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:0/3876385220 2024-09-18T07:21:58.033791+0000 2024-09-17T07:30:37.635 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:0/3936071784 2024-09-18T07:21:58.033791+0000 2024-09-17T07:30:37.635 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:0/3287211314 2024-09-18T07:21:58.033791+0000 2024-09-17T07:30:37.635 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:0/992892562 2024-09-18T07:21:58.033791+0000 2024-09-17T07:30:37.636 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.139:0/1157945461 2024-09-18T07:21:18.807798+0000 2024-09-17T07:30:37.636 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6826/3333749861 2024-09-18T07:17:30.381338+0000 2024-09-17T07:30:37.636 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:0/2382049370 2024-09-18T07:11:03.573097+0000 2024-09-17T07:30:37.636 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:0/990687259 2024-09-18T07:19:39.061872+0000 2024-09-17T07:30:37.636 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:0/1935417402 2024-09-18T07:11:03.573097+0000 2024-09-17T07:30:37.636 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.139:0/712755220 2024-09-18T07:21:18.807798+0000 2024-09-17T07:30:37.636 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:0/853807276 2024-09-18T07:11:03.573097+0000 2024-09-17T07:30:37.636 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6800/3398669653 2024-09-18T07:21:58.033791+0000 2024-09-17T07:30:37.636 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.139:6829/3218632563 2024-09-18T07:21:18.807798+0000 2024-09-17T07:30:37.636 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:0/2056368138 2024-09-18T07:12:36.550496+0000 2024-09-17T07:30:37.636 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:0/822055517 2024-09-18T07:21:58.033791+0000 2024-09-17T07:30:37.636 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:0/3586936716 2024-09-18T07:19:39.061872+0000 2024-09-17T07:30:37.636 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:0/2629320129 2024-09-18T07:11:32.590075+0000 2024-09-17T07:30:37.637 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.139:0/1643063298 2024-09-18T07:21:18.807798+0000 2024-09-17T07:30:37.637 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6827/3333749861 2024-09-18T07:17:30.381338+0000 2024-09-17T07:30:37.637 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:0/443165441 2024-09-18T07:12:36.550496+0000 2024-09-17T07:30:37.637 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:0/147535528 2024-09-18T07:19:39.061872+0000 2024-09-17T07:30:37.637 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:0/2452100146 2024-09-18T07:11:32.590075+0000 2024-09-17T07:30:37.637 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.139:0/1909420975 2024-09-18T07:21:18.807798+0000 2024-09-17T07:30:37.637 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.139:6828/3218632563 2024-09-18T07:21:18.807798+0000 2024-09-17T07:30:37.637 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6800/611048628 2024-09-18T07:19:39.061872+0000 2024-09-17T07:30:37.637 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6801/2341884603 2024-09-18T07:12:36.550496+0000 2024-09-17T07:30:37.637 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6801/2633029569 2024-09-18T07:11:03.573097+0000 2024-09-17T07:30:37.637 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6800/1735030430 2024-09-18T07:11:32.590075+0000 2024-09-17T07:30:37.637 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6801/611048628 2024-09-18T07:19:39.061872+0000 2024-09-17T07:30:37.637 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6800/2341884603 2024-09-18T07:12:36.550496+0000 2024-09-17T07:30:37.638 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6801/1735030430 2024-09-18T07:11:32.590075+0000 2024-09-17T07:30:37.638 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6800/2633029569 2024-09-18T07:11:03.573097+0000 2024-09-17T07:30:37.638 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:0/346024124 2024-09-18T07:19:39.061872+0000 2024-09-17T07:30:37.638 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6801/3398669653 2024-09-18T07:21:58.033791+0000 2024-09-17T07:30:37.638 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:0/228221666 2024-09-18T07:11:32.590075+0000 2024-09-17T07:30:37.638 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:0/2357718754 2024-09-18T07:12:36.550496+0000 2024-09-17T07:30:37.639 INFO:teuthology.orchestra.run.smithi087.stderr:listed 39 entries 2024-09-17T07:30:37.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.636+0000 7ff30c03f640 1 -- 172.21.15.87:0/990478069 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7ff2f006cb90 msgr2=0x7ff2f006f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:37.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.636+0000 7ff30c03f640 1 --2- 172.21.15.87:0/990478069 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7ff2f006cb90 0x7ff2f006f040 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff2f802ab40 tx=0x7ff2f8035040 comp rx=0 tx=0).stop 2024-09-17T07:30:37.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.636+0000 7ff30c03f640 1 -- 172.21.15.87:0/990478069 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3041013c0 msgr2=0x7ff304112200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:37.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.636+0000 7ff30c03f640 1 --2- 172.21.15.87:0/990478069 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3041013c0 0x7ff304112200 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff300002a50 tx=0x7ff300004600 comp rx=0 tx=0).stop 2024-09-17T07:30:37.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.636+0000 7ff30c03f640 1 -- 172.21.15.87:0/990478069 shutdown_connections 2024-09-17T07:30:37.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.636+0000 7ff30c03f640 1 --2- 172.21.15.87:0/990478069 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3041013c0 0x7ff304112200 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:37.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.636+0000 7ff30c03f640 1 --2- 172.21.15.87:0/990478069 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7ff2f006cb90 0x7ff2f006f040 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:37.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.636+0000 7ff30c03f640 1 --2- 172.21.15.87:0/990478069 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff3040fb3a0 0x7ff304111cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:37.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.636+0000 7ff30c03f640 1 -- 172.21.15.87:0/990478069 >> 172.21.15.87:0/990478069 conn(0x7ff304071360 msgr2=0x7ff3041040b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:37.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.636+0000 7ff30c03f640 1 -- 172.21.15.87:0/990478069 shutdown_connections 2024-09-17T07:30:37.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.636+0000 7ff30c03f640 1 -- 172.21.15.87:0/990478069 wait complete. 2024-09-17T07:30:37.646 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:37 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/1889352553' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-17T07:30:37.646 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:37 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/3904013669' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-17T07:30:37.646 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:37 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/1138137387' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-09-17T07:30:37.646 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:37 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/1057366200' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-09-17T07:30:37.647 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-17T07:30:37.647 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T07:30:37.664 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T07:30:37.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.799+0000 7f506279d640 1 -- 172.21.15.87:0/3452063169 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f505c101ca0 msgr2=0x7f505c0fbc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:37.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.799+0000 7f506279d640 1 --2- 172.21.15.87:0/3452063169 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f505c101ca0 0x7f505c0fbc30 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f50500048d0 tx=0x7f5050009da0 comp rx=0 tx=0).stop 2024-09-17T07:30:37.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.799+0000 7f506279d640 1 -- 172.21.15.87:0/3452063169 shutdown_connections 2024-09-17T07:30:37.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.799+0000 7f506279d640 1 --2- 172.21.15.87:0/3452063169 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f505c101ca0 0x7f505c0fbc30 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:37.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.799+0000 7f506279d640 1 --2- 172.21.15.87:0/3452063169 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f505c101390 0x7f505c101760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:37.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.799+0000 7f506279d640 1 -- 172.21.15.87:0/3452063169 >> 172.21.15.87:0/3452063169 conn(0x7f505c070ba0 msgr2=0x7f505c070fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:37.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.799+0000 7f506279d640 1 -- 172.21.15.87:0/3452063169 shutdown_connections 2024-09-17T07:30:37.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.799+0000 7f506279d640 1 -- 172.21.15.87:0/3452063169 wait complete. 2024-09-17T07:30:37.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.800+0000 7f506279d640 1 Processor -- start 2024-09-17T07:30:37.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.800+0000 7f506279d640 1 -- start start 2024-09-17T07:30:37.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.800+0000 7f506279d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f505c101390 0x7f505c111de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:37.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.800+0000 7f506279d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f505c101ca0 0x7f505c112320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:37.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.800+0000 7f506279d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f505c1129b0 con 0x7f505c101390 2024-09-17T07:30:37.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.800+0000 7f506279d640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f505c10bf70 con 0x7f505c101ca0 2024-09-17T07:30:37.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.800+0000 7f505bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f505c101390 0x7f505c111de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:37.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.800+0000 7f505bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f505c101390 0x7f505c111de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56396/0 (socket says 172.21.15.87:56396) 2024-09-17T07:30:37.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.800+0000 7f505bfff640 1 -- 172.21.15.87:0/1108575102 learned_addr learned my addr 172.21.15.87:0/1108575102 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:30:37.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.800+0000 7f505bfff640 1 -- 172.21.15.87:0/1108575102 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f505c101ca0 msgr2=0x7f505c112320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:37.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.800+0000 7f505bfff640 1 --2- 172.21.15.87:0/1108575102 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f505c101ca0 0x7f505c112320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:37.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.800+0000 7f505bfff640 1 -- 172.21.15.87:0/1108575102 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5050005040 con 0x7f505c101390 2024-09-17T07:30:37.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.800+0000 7f505bfff640 1 --2- 172.21.15.87:0/1108575102 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f505c101390 0x7f505c111de0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f504c00b790 tx=0x7f504c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:37.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.801+0000 7f5058ff9640 1 -- 172.21.15.87:0/1108575102 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f504c00c700 con 0x7f505c101390 2024-09-17T07:30:37.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.801+0000 7f5058ff9640 1 -- 172.21.15.87:0/1108575102 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f504c00cce0 con 0x7f505c101390 2024-09-17T07:30:37.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.801+0000 7f5058ff9640 1 -- 172.21.15.87:0/1108575102 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f504c015e10 con 0x7f505c101390 2024-09-17T07:30:37.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.801+0000 7f506279d640 1 -- 172.21.15.87:0/1108575102 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f505c10c250 con 0x7f505c101390 2024-09-17T07:30:37.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.801+0000 7f506279d640 1 -- 172.21.15.87:0/1108575102 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f505c10c770 con 0x7f505c101390 2024-09-17T07:30:37.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.802+0000 7f506279d640 1 -- 172.21.15.87:0/1108575102 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f505c0fcc40 con 0x7f505c101390 2024-09-17T07:30:37.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.802+0000 7f5058ff9640 1 -- 172.21.15.87:0/1108575102 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f504c012070 con 0x7f505c101390 2024-09-17T07:30:37.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.803+0000 7f5058ff9640 1 --2- 172.21.15.87:0/1108575102 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f504406cb90 0x7f504406f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:37.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.803+0000 7f5058ff9640 1 -- 172.21.15.87:0/1108575102 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f504c08bbe0 con 0x7f505c101390 2024-09-17T07:30:37.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.803+0000 7f505b7fe640 1 --2- 172.21.15.87:0/1108575102 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f504406cb90 0x7f504406f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:37.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.803+0000 7f505b7fe640 1 --2- 172.21.15.87:0/1108575102 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f504406cb90 0x7f504406f040 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5050000c00 tx=0x7f5050009da0 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:37.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.807+0000 7f5058ff9640 1 -- 172.21.15.87:0/1108575102 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f504c055c20 con 0x7f505c101390 2024-09-17T07:30:37.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:37 smithi139 ceph-mon[79872]: from='client.? 172.21.15.87:0/1889352553' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-17T07:30:37.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:37 smithi139 ceph-mon[79872]: from='client.? 172.21.15.87:0/3904013669' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-17T07:30:37.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:37 smithi139 ceph-mon[79872]: from='client.? 172.21.15.87:0/1138137387' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-09-17T07:30:37.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:37 smithi139 ceph-mon[79872]: from='client.? 172.21.15.87:0/1057366200' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-09-17T07:30:37.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.970+0000 7f506279d640 1 -- 172.21.15.87:0/1108575102 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f505c108320 con 0x7f505c101390 2024-09-17T07:30:37.971 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.971+0000 7f5058ff9640 1 -- 172.21.15.87:0/1108575102 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+16536 (secure 0 0 0) 0x7f504c059240 con 0x7f505c101390 2024-09-17T07:30:37.971 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-17T07:30:37.971 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":82,"fsid":"d5dbf8d6-74c3-11ef-bceb-c7b262605968","created":"2024-09-17T07:10:35.674251+0000","modified":"2024-09-17T07:27:29.613292+0000","last_up_change":"2024-09-17T07:25:58.345957+0000","last_in_change":"2024-09-17T07:15:41.556417+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T07:14:46.855001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-09-17T07:17:13.907561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-09-17T07:17:14.594643+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aa28f635-8a58-48f8-bd4e-1626b8da9749","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":47,"up_from":51,"up_thru":76,"down_at":48,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1677183701},{"type":"v1","addr":"172.21.15.87:6803","nonce":1677183701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1677183701},{"type":"v1","addr":"172.21.15.87:6805","nonce":1677183701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":1677183701},{"type":"v1","addr":"172.21.15.87:6809","nonce":1677183701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1677183701},{"type":"v1","addr":"172.21.15.87:6807","nonce":1677183701}]},"public_addr":"172.21.15.87:6803/1677183701","cluster_addr":"172.21.15.87:6805/1677183701","heartbeat_back_addr":"172.21.15.87:6809/1677183701","heartbeat_front_addr":"172.21.15.87:6807/1677183701","state":["exists","up"]},{"osd":1,"uuid":"3a7464ee-c016-40fd-ab8a-9652397b193c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":52,"up_from":56,"up_thru":76,"down_at":53,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":952896512},{"type":"v1","addr":"172.21.15.87:6811","nonce":952896512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":952896512},{"type":"v1","addr":"172.21.15.87:6813","nonce":952896512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":952896512},{"type":"v1","addr":"172.21.15.87:6817","nonce":952896512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":952896512},{"type":"v1","addr":"172.21.15.87:6815","nonce":952896512}]},"public_addr":"172.21.15.87:6811/952896512","cluster_addr":"172.21.15.87:6813/952896512","heartbeat_back_addr":"172.21.15.87:6817/952896512","heartbeat_front_addr":"172.21.15.87:6815/952896512","state":["exists","up"]},{"osd":2,"uuid":"31ffe6e4-fa51-43ed-8887-022ad51fbd6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":57,"up_from":61,"up_thru":76,"down_at":58,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":3151708554},{"type":"v1","addr":"172.21.15.87:6819","nonce":3151708554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":3151708554},{"type":"v1","addr":"172.21.15.87:6821","nonce":3151708554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":3151708554},{"type":"v1","addr":"172.21.15.87:6825","nonce":3151708554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":3151708554},{"type":"v1","addr":"172.21.15.87:6823","nonce":3151708554}]},"public_addr":"172.21.15.87:6819/3151708554","cluster_addr":"172.21.15.87:6821/3151708554","heartbeat_back_addr":"172.21.15.87:6825/3151708554","heartbeat_front_addr":"172.21.15.87:6823/3151708554","state":["exists","up"]},{"osd":3,"uuid":"00b175ca-ddfd-41f9-b219-130321a7fbc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":26,"last_clean_end":62,"up_from":66,"up_thru":76,"down_at":63,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":3281602359},{"type":"v1","addr":"172.21.15.139:6801","nonce":3281602359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":3281602359},{"type":"v1","addr":"172.21.15.139:6803","nonce":3281602359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":3281602359},{"type":"v1","addr":"172.21.15.139:6807","nonce":3281602359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":3281602359},{"type":"v1","addr":"172.21.15.139:6805","nonce":3281602359}]},"public_addr":"172.21.15.139:6801/3281602359","cluster_addr":"172.21.15.139:6803/3281602359","heartbeat_back_addr":"172.21.15.139:6807/3281602359","heartbeat_front_addr":"172.21.15.139:6805/3281602359","state":["exists","up"]},{"osd":4,"uuid":"d318cab6-e472-472e-8805-d2ab7e04db2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":32,"last_clean_end":67,"up_from":71,"up_thru":76,"down_at":68,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":137480765},{"type":"v1","addr":"172.21.15.139:6809","nonce":137480765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":137480765},{"type":"v1","addr":"172.21.15.139:6811","nonce":137480765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":137480765},{"type":"v1","addr":"172.21.15.139:6815","nonce":137480765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":137480765},{"type":"v1","addr":"172.21.15.139:6813","nonce":137480765}]},"public_addr":"172.21.15.139:6809/137480765","cluster_addr":"172.21.15.139:6811/137480765","heartbeat_back_addr":"172.21.15.139:6815/137480765","heartbeat_front_addr":"172.21.15.139:6813/137480765","state":["exists","up"]},{"osd":5,"uuid":"37b86806-e559-401c-aedf-3d9de1ac347e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":37,"last_clean_end":72,"up_from":76,"up_thru":76,"down_at":73,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":4036107320},{"type":"v1","addr":"172.21.15.139:6817","nonce":4036107320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":4036107320},{"type":"v1","addr":"172.21.15.139:6819","nonce":4036107320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":4036107320},{"type":"v1","addr":"172.21.15.139:6823","nonce":4036107320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":4036107320},{"type":"v1","addr":"172.21.15.139:6821","nonce":4036107320}]},"public_addr":"172.21.15.139:6817/4036107320","cluster_addr":"172.21.15.139:6819/4036107320","heartbeat_back_addr":"172.21.15.139:6823/4036107320","heartbeat_front_addr":"172.21.15.139:6821/4036107320","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T07:13:50.061288+0000","dead_epoch":47},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T07:14:15.941888+0000","dead_epoch":52},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T07:14:44.449653+0000","dead_epoch":57},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T07:15:08.229646+0000","dead_epoch":62},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T07:15:33.299519+0000","dead_epoch":67},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T07:15:58.647774+0000","dead_epoch":72}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.87:6829/2255237099":"2024-09-18T07:26:50.197946+0000","172.21.15.87:6828/2255237099":"2024-09-18T07:26:50.197946+0000","172.21.15.87:0/614478534":"2024-09-18T07:21:58.033791+0000","172.21.15.87:0/3876385220":"2024-09-18T07:21:58.033791+0000","172.21.15.87:0/3936071784":"2024-09-18T07:21:58.033791+0000","172.21.15.87:0/3287211314":"2024-09-18T07:21:58.033791+0000","172.21.15.87:0/992892562":"2024-09-18T07:21:58.033791+0000","172.21.15.139:0/1157945461":"2024-09-18T07:21:18.807798+0000","172.21.15.87:6826/3333749861":"2024-09-18T07:17:30.381338+0000","172.21.15.87:0/2382049370":"2024-09-18T07:11:03.573097+0000","172.21.15.87:0/990687259":"2024-09-18T07:19:39.061872+0000","172.21.15.87:0/1935417402":"2024-09-18T07:11:03.573097+0000","172.21.15.139:0/712755220":"2024-09-18T07:21:18.807798+0000","172.21.15.87:0/853807276":"2024-09-18T07:11:03.573097+0000","172.21.15.87:6800/3398669653":"2024-09-18T07:21:58.033791+0000","172.21.15.139:6829/3218632563":"2024-09-18T07:21:18.807798+0000","172.21.15.87:0/2056368138":"2024-09-18T07:12:36.550496+0000","172.21.15.87:0/822055517":"2024-09-18T07:21:58.033791+0000","172.21.15.87:0/3586936716":"2024-09-18T07:19:39.061872+0000","172.21.15.87:0/2629320129":"2024-09-18T07:11:32.590075+0000","172.21.15.139:0/1643063298":"2024-09-18T07:21:18.807798+0000","172.21.15.87:6827/3333749861":"2024-09-18T07:17:30.381338+0000","172.21.15.87:0/443165441":"2024-09-18T07:12:36.550496+0000","172.21.15.87:0/147535528":"2024-09-18T07:19:39.061872+0000","172.21.15.87:0/2452100146":"2024-09-18T07:11:32.590075+0000","172.21.15.139:0/1909420975":"2024-09-18T07:21:18.807798+0000","172.21.15.139:6828/3218632563":"2024-09-18T07:21:18.807798+0000","172.21.15.87:6800/611048628":"2024-09-18T07:19:39.061872+0000","172.21.15.87:6801/2341884603":"2024-09-18T07:12:36.550496+0000","172.21.15.87:6801/2633029569":"2024-09-18T07:11:03.573097+0000","172.21.15.87:6800/1735030430":"2024-09-18T07:11:32.590075+0000","172.21.15.87:6801/611048628":"2024-09-18T07:19:39.061872+0000","172.21.15.87:6800/2341884603":"2024-09-18T07:12:36.550496+0000","172.21.15.87:6801/1735030430":"2024-09-18T07:11:32.590075+0000","172.21.15.87:6800/2633029569":"2024-09-18T07:11:03.573097+0000","172.21.15.87:0/346024124":"2024-09-18T07:19:39.061872+0000","172.21.15.87:6801/3398669653":"2024-09-18T07:21:58.033791+0000","172.21.15.87:0/228221666":"2024-09-18T07:11:32.590075+0000","172.21.15.87:0/2357718754":"2024-09-18T07:12:36.550496+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T07:30:37.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.973+0000 7f506279d640 1 -- 172.21.15.87:0/1108575102 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f504406cb90 msgr2=0x7f504406f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:37.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.973+0000 7f506279d640 1 --2- 172.21.15.87:0/1108575102 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f504406cb90 0x7f504406f040 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5050000c00 tx=0x7f5050009da0 comp rx=0 tx=0).stop 2024-09-17T07:30:37.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.973+0000 7f506279d640 1 -- 172.21.15.87:0/1108575102 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f505c101390 msgr2=0x7f505c111de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:37.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.973+0000 7f506279d640 1 --2- 172.21.15.87:0/1108575102 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f505c101390 0x7f505c111de0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f504c00b790 tx=0x7f504c0091d0 comp rx=0 tx=0).stop 2024-09-17T07:30:37.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.973+0000 7f506279d640 1 -- 172.21.15.87:0/1108575102 shutdown_connections 2024-09-17T07:30:37.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.973+0000 7f506279d640 1 --2- 172.21.15.87:0/1108575102 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f504406cb90 0x7f504406f040 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:37.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.973+0000 7f506279d640 1 --2- 172.21.15.87:0/1108575102 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f505c101ca0 0x7f505c112320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:37.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.973+0000 7f506279d640 1 --2- 172.21.15.87:0/1108575102 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f505c101390 0x7f505c111de0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:37.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.973+0000 7f506279d640 1 -- 172.21.15.87:0/1108575102 >> 172.21.15.87:0/1108575102 conn(0x7f505c070ba0 msgr2=0x7f505c0f92a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:37.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.973+0000 7f506279d640 1 -- 172.21.15.87:0/1108575102 shutdown_connections 2024-09-17T07:30:37.974 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:37.973+0000 7f506279d640 1 -- 172.21.15.87:0/1108575102 wait complete. 2024-09-17T07:30:37.984 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T07:14:46.855001+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-09-17T07:17:13.907561+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-09-17T07:17:14.594643+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T07:30:37.985 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T07:30:38.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.082+0000 7f78f995d640 1 -- 172.21.15.87:0/2692464741 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f78f4102420 msgr2=0x7f78f41027f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:38.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.082+0000 7f78f995d640 1 --2- 172.21.15.87:0/2692464741 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f78f4102420 0x7f78f41027f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f78e40048d0 tx=0x7f78e4009da0 comp rx=0 tx=0).stop 2024-09-17T07:30:38.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.082+0000 7f78f995d640 1 -- 172.21.15.87:0/2692464741 shutdown_connections 2024-09-17T07:30:38.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.082+0000 7f78f995d640 1 --2- 172.21.15.87:0/2692464741 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f78f4102dc0 0x7f78f40fc450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:38.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.082+0000 7f78f995d640 1 --2- 172.21.15.87:0/2692464741 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f78f4102420 0x7f78f41027f0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:38.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.082+0000 7f78f995d640 1 -- 172.21.15.87:0/2692464741 >> 172.21.15.87:0/2692464741 conn(0x7f78f40f8050 msgr2=0x7f78f40fa460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:38.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.082+0000 7f78f995d640 1 -- 172.21.15.87:0/2692464741 shutdown_connections 2024-09-17T07:30:38.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.082+0000 7f78f995d640 1 -- 172.21.15.87:0/2692464741 wait complete. 2024-09-17T07:30:38.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.083+0000 7f78f995d640 1 Processor -- start 2024-09-17T07:30:38.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.083+0000 7f78f995d640 1 -- start start 2024-09-17T07:30:38.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.083+0000 7f78f995d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f78f4102420 0x7f78f406fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:38.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.083+0000 7f78f995d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f78f4102dc0 0x7f78f406ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:38.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.083+0000 7f78f995d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78f40718f0 con 0x7f78f4102dc0 2024-09-17T07:30:38.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.083+0000 7f78f995d640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78f4070490 con 0x7f78f4102420 2024-09-17T07:30:38.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.083+0000 7f78ea7fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f78f4102dc0 0x7f78f406ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:38.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.083+0000 7f78ea7fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f78f4102dc0 0x7f78f406ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56422/0 (socket says 172.21.15.87:56422) 2024-09-17T07:30:38.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.083+0000 7f78ea7fc640 1 -- 172.21.15.87:0/1788498331 learned_addr learned my addr 172.21.15.87:0/1788498331 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:30:38.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.083+0000 7f78f2ffd640 1 --2- 172.21.15.87:0/1788498331 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f78f4102420 0x7f78f406fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:38.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.084+0000 7f78ea7fc640 1 -- 172.21.15.87:0/1788498331 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f78f4102420 msgr2=0x7f78f406fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:38.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.084+0000 7f78ea7fc640 1 --2- 172.21.15.87:0/1788498331 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f78f4102420 0x7f78f406fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:38.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.084+0000 7f78ea7fc640 1 -- 172.21.15.87:0/1788498331 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78e4005040 con 0x7f78f4102dc0 2024-09-17T07:30:38.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.084+0000 7f78ea7fc640 1 --2- 172.21.15.87:0/1788498331 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f78f4102dc0 0x7f78f406ff50 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f78dc00c830 tx=0x7f78dc004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:38.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.084+0000 7f78ebfff640 1 -- 172.21.15.87:0/1788498331 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f78dc00a850 con 0x7f78f4102dc0 2024-09-17T07:30:38.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.084+0000 7f78ebfff640 1 -- 172.21.15.87:0/1788498331 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7f78dc00ae30 con 0x7f78f4102dc0 2024-09-17T07:30:38.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.084+0000 7f78f995d640 1 -- 172.21.15.87:0/1788498331 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78f4070770 con 0x7f78f4102dc0 2024-09-17T07:30:38.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.084+0000 7f78ebfff640 1 -- 172.21.15.87:0/1788498331 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f78dc0113a0 con 0x7f78f4102dc0 2024-09-17T07:30:38.086 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.084+0000 7f78f995d640 1 -- 172.21.15.87:0/1788498331 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78f41194e0 con 0x7f78f4102dc0 2024-09-17T07:30:38.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.085+0000 7f78f995d640 1 -- 172.21.15.87:0/1788498331 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78f40fdb90 con 0x7f78f4102dc0 2024-09-17T07:30:38.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.085+0000 7f78ebfff640 1 -- 172.21.15.87:0/1788498331 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f78dc012400 con 0x7f78f4102dc0 2024-09-17T07:30:38.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.086+0000 7f78ebfff640 1 --2- 172.21.15.87:0/1788498331 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f78e006cb90 0x7f78e006f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:38.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.086+0000 7f78f2ffd640 1 --2- 172.21.15.87:0/1788498331 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f78e006cb90 0x7f78e006f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:38.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.086+0000 7f78ebfff640 1 -- 172.21.15.87:0/1788498331 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f78dc08c1a0 con 0x7f78f4102dc0 2024-09-17T07:30:38.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.086+0000 7f78f2ffd640 1 --2- 172.21.15.87:0/1788498331 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f78e006cb90 0x7f78e006f040 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f78e4009ac0 tx=0x7f78e4035040 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:38.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.090+0000 7f78ebfff640 1 -- 172.21.15.87:0/1788498331 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f78dc0562a0 con 0x7f78f4102dc0 2024-09-17T07:30:38.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.250+0000 7f78f995d640 1 -- 172.21.15.87:0/1788498331 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f78f41092d0 con 0x7f78f4102dc0 2024-09-17T07:30:38.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.251+0000 7f78ebfff640 1 -- 172.21.15.87:0/1788498331 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7f78dc0598c0 con 0x7f78f4102dc0 2024-09-17T07:30:38.251 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 1 2024-09-17T07:30:38.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.253+0000 7f78f995d640 1 -- 172.21.15.87:0/1788498331 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f78e006cb90 msgr2=0x7f78e006f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:38.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.253+0000 7f78f995d640 1 --2- 172.21.15.87:0/1788498331 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f78e006cb90 0x7f78e006f040 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f78e4009ac0 tx=0x7f78e4035040 comp rx=0 tx=0).stop 2024-09-17T07:30:38.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.253+0000 7f78f995d640 1 -- 172.21.15.87:0/1788498331 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f78f4102dc0 msgr2=0x7f78f406ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:38.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.253+0000 7f78f995d640 1 --2- 172.21.15.87:0/1788498331 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f78f4102dc0 0x7f78f406ff50 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f78dc00c830 tx=0x7f78dc004430 comp rx=0 tx=0).stop 2024-09-17T07:30:38.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.253+0000 7f78f995d640 1 -- 172.21.15.87:0/1788498331 shutdown_connections 2024-09-17T07:30:38.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.253+0000 7f78f995d640 1 --2- 172.21.15.87:0/1788498331 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f78f4102dc0 0x7f78f406ff50 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:38.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.253+0000 7f78f995d640 1 --2- 172.21.15.87:0/1788498331 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7f78e006cb90 0x7f78e006f040 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:38.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.253+0000 7f78f995d640 1 --2- 172.21.15.87:0/1788498331 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f78f4102420 0x7f78f406fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:38.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.253+0000 7f78f995d640 1 -- 172.21.15.87:0/1788498331 >> 172.21.15.87:0/1788498331 conn(0x7f78f40f8050 msgr2=0x7f78f40f91b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:38.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.253+0000 7f78f995d640 1 -- 172.21.15.87:0/1788498331 shutdown_connections 2024-09-17T07:30:38.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.253+0000 7f78f995d640 1 -- 172.21.15.87:0/1788498331 wait complete. 2024-09-17T07:30:38.264 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-09-17T07:30:38.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.361+0000 7fcacc91d640 1 -- 172.21.15.87:0/2859423926 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcac8101550 msgr2=0x7fcac8101920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:38.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.361+0000 7fcacc91d640 1 --2- 172.21.15.87:0/2859423926 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcac8101550 0x7fcac8101920 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fcab80048d0 tx=0x7fcab8009da0 comp rx=0 tx=0).stop 2024-09-17T07:30:38.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.361+0000 7fcacc91d640 1 -- 172.21.15.87:0/2859423926 shutdown_connections 2024-09-17T07:30:38.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.361+0000 7fcacc91d640 1 --2- 172.21.15.87:0/2859423926 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcac8101ef0 0x7fcac80fb5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:38.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.361+0000 7fcacc91d640 1 --2- 172.21.15.87:0/2859423926 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcac8101550 0x7fcac8101920 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:38.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.361+0000 7fcacc91d640 1 -- 172.21.15.87:0/2859423926 >> 172.21.15.87:0/2859423926 conn(0x7fcac80f7110 msgr2=0x7fcac80f9520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:38.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.361+0000 7fcacc91d640 1 -- 172.21.15.87:0/2859423926 shutdown_connections 2024-09-17T07:30:38.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.361+0000 7fcacc91d640 1 -- 172.21.15.87:0/2859423926 wait complete. 2024-09-17T07:30:38.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.362+0000 7fcacc91d640 1 Processor -- start 2024-09-17T07:30:38.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.362+0000 7fcacc91d640 1 -- start start 2024-09-17T07:30:38.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.362+0000 7fcacc91d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcac8101550 0x7fcac810e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:38.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.362+0000 7fcacc91d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcac8101ef0 0x7fcac810e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:38.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.362+0000 7fcacc91d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac810ec80 con 0x7fcac8101550 2024-09-17T07:30:38.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.362+0000 7fcacc91d640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac810edf0 con 0x7fcac8101ef0 2024-09-17T07:30:38.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.362+0000 7fcac659c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcac8101550 0x7fcac810e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:38.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.362+0000 7fcac659c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcac8101550 0x7fcac810e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56432/0 (socket says 172.21.15.87:56432) 2024-09-17T07:30:38.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.362+0000 7fcac659c640 1 -- 172.21.15.87:0/259852391 learned_addr learned my addr 172.21.15.87:0/259852391 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:30:38.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.362+0000 7fcac659c640 1 -- 172.21.15.87:0/259852391 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcac8101ef0 msgr2=0x7fcac810e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:38.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.362+0000 7fcac659c640 1 --2- 172.21.15.87:0/259852391 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcac8101ef0 0x7fcac810e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:38.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.362+0000 7fcac659c640 1 -- 172.21.15.87:0/259852391 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcab8005040 con 0x7fcac8101550 2024-09-17T07:30:38.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.363+0000 7fcac659c640 1 --2- 172.21.15.87:0/259852391 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcac8101550 0x7fcac810e200 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fcab8000c00 tx=0x7fcab8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:38.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.363+0000 7fcabf7fe640 1 -- 172.21.15.87:0/259852391 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcab8038070 con 0x7fcac8101550 2024-09-17T07:30:38.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.363+0000 7fcabf7fe640 1 -- 172.21.15.87:0/259852391 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fcab8009880 con 0x7fcac8101550 2024-09-17T07:30:38.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.363+0000 7fcabf7fe640 1 -- 172.21.15.87:0/259852391 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcab803d420 con 0x7fcac8101550 2024-09-17T07:30:38.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.363+0000 7fcacc91d640 1 -- 172.21.15.87:0/259852391 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcac810f070 con 0x7fcac8101550 2024-09-17T07:30:38.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.363+0000 7fcacc91d640 1 -- 172.21.15.87:0/259852391 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcac8117520 con 0x7fcac8101550 2024-09-17T07:30:38.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.364+0000 7fcacc91d640 1 -- 172.21.15.87:0/259852391 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcac80fccd0 con 0x7fcac8101550 2024-09-17T07:30:38.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.364+0000 7fcabf7fe640 1 -- 172.21.15.87:0/259852391 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fcab8030020 con 0x7fcac8101550 2024-09-17T07:30:38.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.365+0000 7fcabf7fe640 1 --2- 172.21.15.87:0/259852391 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fcab406cb90 0x7fcab406f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:38.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.365+0000 7fcabdd9b640 1 --2- 172.21.15.87:0/259852391 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fcab406cb90 0x7fcab406f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:38.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.365+0000 7fcabf7fe640 1 -- 172.21.15.87:0/259852391 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fcab80ac5a0 con 0x7fcac8101550 2024-09-17T07:30:38.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.365+0000 7fcabdd9b640 1 --2- 172.21.15.87:0/259852391 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fcab406cb90 0x7fcab406f040 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fcac8065fe0 tx=0x7fcab0006d20 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:38.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.369+0000 7fcabf7fe640 1 -- 172.21.15.87:0/259852391 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fcab80765e0 con 0x7fcac8101550 2024-09-17T07:30:38.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.531+0000 7fcacc91d640 1 -- 172.21.15.87:0/259852391 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7fcac810f070 con 0x7fcac8101550 2024-09-17T07:30:38.531 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.531+0000 7fcabf7fe640 1 -- 172.21.15.87:0/259852391 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v82) v1 ==== 107+0+11 (secure 0 0 0) 0x7fcac810f070 con 0x7fcac8101550 2024-09-17T07:30:38.531 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2024-09-17T07:30:38.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.533+0000 7fcacc91d640 1 -- 172.21.15.87:0/259852391 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fcab406cb90 msgr2=0x7fcab406f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:38.533 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.533+0000 7fcacc91d640 1 --2- 172.21.15.87:0/259852391 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fcab406cb90 0x7fcab406f040 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fcac8065fe0 tx=0x7fcab0006d20 comp rx=0 tx=0).stop 2024-09-17T07:30:38.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.533+0000 7fcacc91d640 1 -- 172.21.15.87:0/259852391 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcac8101550 msgr2=0x7fcac810e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:38.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.533+0000 7fcacc91d640 1 --2- 172.21.15.87:0/259852391 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcac8101550 0x7fcac810e200 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fcab8000c00 tx=0x7fcab8009da0 comp rx=0 tx=0).stop 2024-09-17T07:30:38.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.533+0000 7fcacc91d640 1 -- 172.21.15.87:0/259852391 shutdown_connections 2024-09-17T07:30:38.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.533+0000 7fcacc91d640 1 --2- 172.21.15.87:0/259852391 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fcab406cb90 0x7fcab406f040 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:38.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.533+0000 7fcacc91d640 1 --2- 172.21.15.87:0/259852391 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcac8101ef0 0x7fcac810e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:38.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.533+0000 7fcacc91d640 1 --2- 172.21.15.87:0/259852391 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcac8101550 0x7fcac810e200 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:38.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.533+0000 7fcacc91d640 1 -- 172.21.15.87:0/259852391 >> 172.21.15.87:0/259852391 conn(0x7fcac80f7110 msgr2=0x7fcac80f8270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:38.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.533+0000 7fcacc91d640 1 -- 172.21.15.87:0/259852391 shutdown_connections 2024-09-17T07:30:38.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.533+0000 7fcacc91d640 1 -- 172.21.15.87:0/259852391 wait complete. 2024-09-17T07:30:38.542 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:38 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/990478069' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-17T07:30:38.543 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:38 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/1108575102' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-17T07:30:38.543 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:38 smithi087 ceph-mon[90982]: pgmap v298: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:30:38.543 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:38 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/1788498331' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-17T07:30:38.544 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-09-17T07:30:38.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.640+0000 7ff762edd640 1 -- 172.21.15.87:0/890671000 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff75c0fbb90 msgr2=0x7ff75c1088f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:38.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.640+0000 7ff762edd640 1 --2- 172.21.15.87:0/890671000 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff75c0fbb90 0x7ff75c1088f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ff750004900 tx=0x7ff750009da0 comp rx=0 tx=0).stop 2024-09-17T07:30:38.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.640+0000 7ff762edd640 1 -- 172.21.15.87:0/890671000 shutdown_connections 2024-09-17T07:30:38.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.640+0000 7ff762edd640 1 --2- 172.21.15.87:0/890671000 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff75c0fbb90 0x7ff75c1088f0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:38.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.640+0000 7ff762edd640 1 --2- 172.21.15.87:0/890671000 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff75c0fb280 0x7ff75c0fb650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:38.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.640+0000 7ff762edd640 1 -- 172.21.15.87:0/890671000 >> 172.21.15.87:0/890671000 conn(0x7ff75c0f6f50 msgr2=0x7ff75c0f9360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:38.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.640+0000 7ff762edd640 1 -- 172.21.15.87:0/890671000 shutdown_connections 2024-09-17T07:30:38.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.640+0000 7ff762edd640 1 -- 172.21.15.87:0/890671000 wait complete. 2024-09-17T07:30:38.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.641+0000 7ff762edd640 1 Processor -- start 2024-09-17T07:30:38.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.641+0000 7ff762edd640 1 -- start start 2024-09-17T07:30:38.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.641+0000 7ff762edd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff75c0fb280 0x7ff75c115320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:38.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.641+0000 7ff762edd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff75c0fbb90 0x7ff75c115860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:38.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.641+0000 7ff762edd640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff75c115e60 con 0x7ff75c0fb280 2024-09-17T07:30:38.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.641+0000 7ff762edd640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff75c10f4b0 con 0x7ff75c0fbb90 2024-09-17T07:30:38.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.641+0000 7ff760c79640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff75c0fb280 0x7ff75c115320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:38.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.641+0000 7ff760c79640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff75c0fb280 0x7ff75c115320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56446/0 (socket says 172.21.15.87:56446) 2024-09-17T07:30:38.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.641+0000 7ff760c79640 1 -- 172.21.15.87:0/824125867 learned_addr learned my addr 172.21.15.87:0/824125867 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:30:38.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.641+0000 7ff75bfff640 1 --2- 172.21.15.87:0/824125867 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff75c0fbb90 0x7ff75c115860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:38.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.641+0000 7ff760c79640 1 -- 172.21.15.87:0/824125867 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff75c0fbb90 msgr2=0x7ff75c115860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:38.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.642+0000 7ff760c79640 1 --2- 172.21.15.87:0/824125867 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff75c0fbb90 0x7ff75c115860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:38.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.642+0000 7ff760c79640 1 -- 172.21.15.87:0/824125867 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff750005040 con 0x7ff75c0fb280 2024-09-17T07:30:38.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.642+0000 7ff75bfff640 1 --2- 172.21.15.87:0/824125867 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff75c0fbb90 0x7ff75c115860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T07:30:38.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.642+0000 7ff760c79640 1 --2- 172.21.15.87:0/824125867 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff75c0fb280 0x7ff75c115320 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ff74c002a50 tx=0x7ff74c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:38.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.642+0000 7ff7597fa640 1 -- 172.21.15.87:0/824125867 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff74c007c30 con 0x7ff75c0fb280 2024-09-17T07:30:38.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.642+0000 7ff7597fa640 1 -- 172.21.15.87:0/824125867 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7ff74c00f040 con 0x7ff75c0fb280 2024-09-17T07:30:38.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.642+0000 7ff762edd640 1 -- 172.21.15.87:0/824125867 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff75c10f790 con 0x7ff75c0fb280 2024-09-17T07:30:38.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.642+0000 7ff7597fa640 1 -- 172.21.15.87:0/824125867 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff74c00d990 con 0x7ff75c0fb280 2024-09-17T07:30:38.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.642+0000 7ff762edd640 1 -- 172.21.15.87:0/824125867 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff75c10fd30 con 0x7ff75c0fb280 2024-09-17T07:30:38.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.643+0000 7ff762edd640 1 -- 172.21.15.87:0/824125867 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff75c066030 con 0x7ff75c0fb280 2024-09-17T07:30:38.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.643+0000 7ff7597fa640 1 -- 172.21.15.87:0/824125867 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7ff74c00dc50 con 0x7ff75c0fb280 2024-09-17T07:30:38.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.644+0000 7ff7597fa640 1 --2- 172.21.15.87:0/824125867 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7ff74406cb90 0x7ff74406f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:38.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.644+0000 7ff7597fa640 1 -- 172.21.15.87:0/824125867 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6496+0+0 (secure 0 0 0) 0x7ff74c08ba20 con 0x7ff75c0fb280 2024-09-17T07:30:38.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.644+0000 7ff75bfff640 1 --2- 172.21.15.87:0/824125867 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7ff74406cb90 0x7ff74406f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:38.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.644+0000 7ff75bfff640 1 --2- 172.21.15.87:0/824125867 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7ff74406cb90 0x7ff74406f040 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff75000b020 tx=0x7ff750009da0 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:38.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.648+0000 7ff7597fa640 1 -- 172.21.15.87:0/824125867 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff74c0559e0 con 0x7ff75c0fb280 2024-09-17T07:30:38.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.809+0000 7ff762edd640 1 -- 172.21.15.87:0/824125867 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7ff75c10b570 con 0x7ff75c0fb280 2024-09-17T07:30:38.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.809+0000 7ff7597fa640 1 -- 172.21.15.87:0/824125867 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v82) v1 ==== 107+0+11 (secure 0 0 0) 0x7ff74c059000 con 0x7ff75c0fb280 2024-09-17T07:30:38.809 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2024-09-17T07:30:38.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.811+0000 7ff762edd640 1 -- 172.21.15.87:0/824125867 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7ff74406cb90 msgr2=0x7ff74406f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:38.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.811+0000 7ff762edd640 1 --2- 172.21.15.87:0/824125867 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7ff74406cb90 0x7ff74406f040 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff75000b020 tx=0x7ff750009da0 comp rx=0 tx=0).stop 2024-09-17T07:30:38.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.811+0000 7ff762edd640 1 -- 172.21.15.87:0/824125867 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff75c0fb280 msgr2=0x7ff75c115320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:38.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.811+0000 7ff762edd640 1 --2- 172.21.15.87:0/824125867 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff75c0fb280 0x7ff75c115320 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ff74c002a50 tx=0x7ff74c004600 comp rx=0 tx=0).stop 2024-09-17T07:30:38.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.811+0000 7ff762edd640 1 -- 172.21.15.87:0/824125867 shutdown_connections 2024-09-17T07:30:38.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.811+0000 7ff762edd640 1 --2- 172.21.15.87:0/824125867 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7ff74406cb90 0x7ff74406f040 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:38.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.811+0000 7ff762edd640 1 --2- 172.21.15.87:0/824125867 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff75c0fbb90 0x7ff75c115860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:38.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.811+0000 7ff762edd640 1 --2- 172.21.15.87:0/824125867 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff75c0fb280 0x7ff75c115320 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:38.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.811+0000 7ff762edd640 1 -- 172.21.15.87:0/824125867 >> 172.21.15.87:0/824125867 conn(0x7ff75c0f6f50 msgr2=0x7ff75c0f79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:38.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.811+0000 7ff762edd640 1 -- 172.21.15.87:0/824125867 shutdown_connections 2024-09-17T07:30:38.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.812+0000 7ff762edd640 1 -- 172.21.15.87:0/824125867 wait complete. 2024-09-17T07:30:38.822 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T07:30:38.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:38 smithi139 ceph-mon[79872]: from='client.? 172.21.15.87:0/990478069' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-17T07:30:38.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:38 smithi139 ceph-mon[79872]: from='client.? 172.21.15.87:0/1108575102' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-17T07:30:38.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:38 smithi139 ceph-mon[79872]: pgmap v298: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:30:38.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:38 smithi139 ceph-mon[79872]: from='client.? 172.21.15.87:0/1788498331' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-17T07:30:38.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.918+0000 7fe21435d640 1 -- 172.21.15.87:0/2186008311 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe20c101ed0 msgr2=0x7fe20c0fb590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:38.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.918+0000 7fe21435d640 1 --2- 172.21.15.87:0/2186008311 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe20c101ed0 0x7fe20c0fb590 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe2000048d0 tx=0x7fe200009da0 comp rx=0 tx=0).stop 2024-09-17T07:30:38.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.918+0000 7fe21435d640 1 -- 172.21.15.87:0/2186008311 shutdown_connections 2024-09-17T07:30:38.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.918+0000 7fe21435d640 1 --2- 172.21.15.87:0/2186008311 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe20c101ed0 0x7fe20c0fb590 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:38.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.918+0000 7fe21435d640 1 --2- 172.21.15.87:0/2186008311 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe20c101530 0x7fe20c101900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:38.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.918+0000 7fe21435d640 1 -- 172.21.15.87:0/2186008311 >> 172.21.15.87:0/2186008311 conn(0x7fe20c0f7110 msgr2=0x7fe20c0f9520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:38.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.918+0000 7fe21435d640 1 -- 172.21.15.87:0/2186008311 shutdown_connections 2024-09-17T07:30:38.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.918+0000 7fe21435d640 1 -- 172.21.15.87:0/2186008311 wait complete. 2024-09-17T07:30:38.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.918+0000 7fe21435d640 1 Processor -- start 2024-09-17T07:30:38.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.918+0000 7fe21435d640 1 -- start start 2024-09-17T07:30:38.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.918+0000 7fe21435d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe20c101530 0x7fe20c10e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:38.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.918+0000 7fe21435d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe20c101ed0 0x7fe20c10e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:38.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.918+0000 7fe21435d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe20c0667b0 con 0x7fe20c101530 2024-09-17T07:30:38.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.918+0000 7fe21435d640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe20c10ec80 con 0x7fe20c101ed0 2024-09-17T07:30:38.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.918+0000 7fe2120f9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe20c101530 0x7fe20c10e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:38.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.919+0000 7fe2120f9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe20c101530 0x7fe20c10e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56456/0 (socket says 172.21.15.87:56456) 2024-09-17T07:30:38.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.919+0000 7fe2120f9640 1 -- 172.21.15.87:0/3528239947 learned_addr learned my addr 172.21.15.87:0/3528239947 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-17T07:30:38.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.919+0000 7fe2120f9640 1 -- 172.21.15.87:0/3528239947 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe20c101ed0 msgr2=0x7fe20c10e710 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T07:30:38.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.919+0000 7fe2120f9640 1 --2- 172.21.15.87:0/3528239947 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe20c101ed0 0x7fe20c10e710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:38.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.919+0000 7fe2120f9640 1 -- 172.21.15.87:0/3528239947 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe200005040 con 0x7fe20c101530 2024-09-17T07:30:38.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.919+0000 7fe2120f9640 1 --2- 172.21.15.87:0/3528239947 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe20c101530 0x7fe20c10e1d0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fe208002a50 tx=0x7fe208004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:38.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.919+0000 7fe1feffd640 1 -- 172.21.15.87:0/3528239947 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe208007c30 con 0x7fe20c101530 2024-09-17T07:30:38.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.919+0000 7fe21435d640 1 -- 172.21.15.87:0/3528239947 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe20c10ef60 con 0x7fe20c101530 2024-09-17T07:30:38.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.919+0000 7fe1feffd640 1 -- 172.21.15.87:0/3528239947 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(25 keys) v1 ==== 1035+0+0 (secure 0 0 0) 0x7fe20800f040 con 0x7fe20c101530 2024-09-17T07:30:38.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.919+0000 7fe1feffd640 1 -- 172.21.15.87:0/3528239947 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe20800d990 con 0x7fe20c101530 2024-09-17T07:30:38.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.919+0000 7fe21435d640 1 -- 172.21.15.87:0/3528239947 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe20c117570 con 0x7fe20c101530 2024-09-17T07:30:38.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.920+0000 7fe21435d640 1 -- 172.21.15.87:0/3528239947 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe20c0fccb0 con 0x7fe20c101530 2024-09-17T07:30:38.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.920+0000 7fe1feffd640 1 -- 172.21.15.87:0/3528239947 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 39) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fe20800dc50 con 0x7fe20c101530 2024-09-17T07:30:38.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.921+0000 7fe1feffd640 1 --2- 172.21.15.87:0/3528239947 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fe1f806cb90 0x7fe1f806f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T07:30:38.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.921+0000 7fe1feffd640 1 -- 172.21.15.87:0/3528239947 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fe20808ba60 con 0x7fe20c101530 2024-09-17T07:30:38.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.921+0000 7fe2118f8640 1 --2- 172.21.15.87:0/3528239947 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fe1f806cb90 0x7fe1f806f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T07:30:38.922 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.921+0000 7fe2118f8640 1 --2- 172.21.15.87:0/3528239947 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fe1f806cb90 0x7fe1f806f040 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe200000c00 tx=0x7fe200009da0 comp rx=0 tx=0).ready entity=mgr.24529 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T07:30:38.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:38.925+0000 7fe1feffd640 1 -- 172.21.15.87:0/3528239947 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe2080559e0 con 0x7fe20c101530 2024-09-17T07:30:39.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:39.100+0000 7fe21435d640 1 -- 172.21.15.87:0/3528239947 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe20c04bf60 con 0x7fe20c101530 2024-09-17T07:30:39.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:39.100+0000 7fe1feffd640 1 -- 172.21.15.87:0/3528239947 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 39 entries v82) v1 ==== 81+0+2304 (secure 0 0 0) 0x7fe208059000 con 0x7fe20c101530 2024-09-17T07:30:39.101 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6829/2255237099 2024-09-18T07:26:50.197946+0000 2024-09-17T07:30:39.101 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6828/2255237099 2024-09-18T07:26:50.197946+0000 2024-09-17T07:30:39.101 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:0/614478534 2024-09-18T07:21:58.033791+0000 2024-09-17T07:30:39.101 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:0/3876385220 2024-09-18T07:21:58.033791+0000 2024-09-17T07:30:39.101 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:0/3936071784 2024-09-18T07:21:58.033791+0000 2024-09-17T07:30:39.101 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:0/3287211314 2024-09-18T07:21:58.033791+0000 2024-09-17T07:30:39.101 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:0/992892562 2024-09-18T07:21:58.033791+0000 2024-09-17T07:30:39.101 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.139:0/1157945461 2024-09-18T07:21:18.807798+0000 2024-09-17T07:30:39.101 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6826/3333749861 2024-09-18T07:17:30.381338+0000 2024-09-17T07:30:39.101 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:0/2382049370 2024-09-18T07:11:03.573097+0000 2024-09-17T07:30:39.102 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:0/990687259 2024-09-18T07:19:39.061872+0000 2024-09-17T07:30:39.102 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:0/1935417402 2024-09-18T07:11:03.573097+0000 2024-09-17T07:30:39.102 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.139:0/712755220 2024-09-18T07:21:18.807798+0000 2024-09-17T07:30:39.102 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:0/853807276 2024-09-18T07:11:03.573097+0000 2024-09-17T07:30:39.102 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6800/3398669653 2024-09-18T07:21:58.033791+0000 2024-09-17T07:30:39.102 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.139:6829/3218632563 2024-09-18T07:21:18.807798+0000 2024-09-17T07:30:39.102 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:0/2056368138 2024-09-18T07:12:36.550496+0000 2024-09-17T07:30:39.102 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:0/822055517 2024-09-18T07:21:58.033791+0000 2024-09-17T07:30:39.102 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:0/3586936716 2024-09-18T07:19:39.061872+0000 2024-09-17T07:30:39.102 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:0/2629320129 2024-09-18T07:11:32.590075+0000 2024-09-17T07:30:39.102 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.139:0/1643063298 2024-09-18T07:21:18.807798+0000 2024-09-17T07:30:39.102 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6827/3333749861 2024-09-18T07:17:30.381338+0000 2024-09-17T07:30:39.103 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:0/443165441 2024-09-18T07:12:36.550496+0000 2024-09-17T07:30:39.103 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:0/147535528 2024-09-18T07:19:39.061872+0000 2024-09-17T07:30:39.103 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:0/2452100146 2024-09-18T07:11:32.590075+0000 2024-09-17T07:30:39.103 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.139:0/1909420975 2024-09-18T07:21:18.807798+0000 2024-09-17T07:30:39.103 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.139:6828/3218632563 2024-09-18T07:21:18.807798+0000 2024-09-17T07:30:39.103 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6800/611048628 2024-09-18T07:19:39.061872+0000 2024-09-17T07:30:39.103 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6801/2341884603 2024-09-18T07:12:36.550496+0000 2024-09-17T07:30:39.103 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6801/2633029569 2024-09-18T07:11:03.573097+0000 2024-09-17T07:30:39.103 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6800/1735030430 2024-09-18T07:11:32.590075+0000 2024-09-17T07:30:39.103 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6801/611048628 2024-09-18T07:19:39.061872+0000 2024-09-17T07:30:39.103 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6800/2341884603 2024-09-18T07:12:36.550496+0000 2024-09-17T07:30:39.103 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6801/1735030430 2024-09-18T07:11:32.590075+0000 2024-09-17T07:30:39.103 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6800/2633029569 2024-09-18T07:11:03.573097+0000 2024-09-17T07:30:39.104 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:0/346024124 2024-09-18T07:19:39.061872+0000 2024-09-17T07:30:39.104 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:6801/3398669653 2024-09-18T07:21:58.033791+0000 2024-09-17T07:30:39.104 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:0/228221666 2024-09-18T07:11:32.590075+0000 2024-09-17T07:30:39.104 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87:0/2357718754 2024-09-18T07:12:36.550496+0000 2024-09-17T07:30:39.105 INFO:teuthology.orchestra.run.smithi087.stderr:listed 39 entries 2024-09-17T07:30:39.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:39.102+0000 7fe21435d640 1 -- 172.21.15.87:0/3528239947 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fe1f806cb90 msgr2=0x7fe1f806f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:39.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:39.102+0000 7fe21435d640 1 --2- 172.21.15.87:0/3528239947 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fe1f806cb90 0x7fe1f806f040 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe200000c00 tx=0x7fe200009da0 comp rx=0 tx=0).stop 2024-09-17T07:30:39.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:39.102+0000 7fe21435d640 1 -- 172.21.15.87:0/3528239947 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe20c101530 msgr2=0x7fe20c10e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T07:30:39.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:39.102+0000 7fe21435d640 1 --2- 172.21.15.87:0/3528239947 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe20c101530 0x7fe20c10e1d0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fe208002a50 tx=0x7fe208004600 comp rx=0 tx=0).stop 2024-09-17T07:30:39.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:39.102+0000 7fe21435d640 1 -- 172.21.15.87:0/3528239947 shutdown_connections 2024-09-17T07:30:39.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:39.102+0000 7fe21435d640 1 --2- 172.21.15.87:0/3528239947 >> [v2:172.21.15.87:6800/1359413180,v1:172.21.15.87:6801/1359413180] conn(0x7fe1f806cb90 0x7fe1f806f040 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:39.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:39.102+0000 7fe21435d640 1 --2- 172.21.15.87:0/3528239947 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe20c101ed0 0x7fe20c10e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:39.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:39.102+0000 7fe21435d640 1 --2- 172.21.15.87:0/3528239947 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe20c101530 0x7fe20c10e1d0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T07:30:39.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:39.102+0000 7fe21435d640 1 -- 172.21.15.87:0/3528239947 >> 172.21.15.87:0/3528239947 conn(0x7fe20c0f7110 msgr2=0x7fe20c0f8290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T07:30:39.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:39.102+0000 7fe21435d640 1 -- 172.21.15.87:0/3528239947 shutdown_connections 2024-09-17T07:30:39.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-17T07:30:39.102+0000 7fe21435d640 1 -- 172.21.15.87:0/3528239947 wait complete. 2024-09-17T07:30:39.113 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi087.front.sepia.ceph.com... 2024-09-17T07:30:39.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T07:30:39.113 DEBUG:teuthology.orchestra.run.smithi087:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-17T07:30:39.138 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T07:30:39.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:39 smithi139 ceph-mon[79872]: from='client.? 172.21.15.87:0/259852391' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-09-17T07:30:39.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:39 smithi139 ceph-mon[79872]: from='client.? 172.21.15.87:0/824125867' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-09-17T07:30:39.867 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:39 smithi139 ceph-mon[79872]: from='client.? 172.21.15.87:0/3528239947' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-17T07:30:39.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:39 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/259852391' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-09-17T07:30:39.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:39 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/824125867' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-09-17T07:30:39.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:39 smithi087 ceph-mon[90982]: from='client.? 172.21.15.87:0/3528239947' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-17T07:30:40.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:40 smithi139 ceph-mon[79872]: pgmap v299: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:30:40.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:40 smithi087 ceph-mon[90982]: pgmap v299: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:30:43.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:42 smithi087 ceph-mon[90982]: pgmap v300: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:30:43.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:42 smithi139 ceph-mon[79872]: pgmap v300: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:30:44.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:30:44.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:30:44.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:30:44.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:30:44.177 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:30:44.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:30:44.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:30:44.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:30:44.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:30:44.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:30:45.176 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:44 smithi087 ceph-mon[90982]: pgmap v301: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:30:45.268 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:44 smithi139 ceph-mon[79872]: pgmap v301: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:30:47.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:47 smithi139 ceph-mon[79872]: pgmap v302: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:30:47.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:47 smithi087 ceph-mon[90982]: pgmap v302: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:30:49.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:49 smithi139 ceph-mon[79872]: pgmap v303: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:30:49.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:49 smithi087 ceph-mon[90982]: pgmap v303: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:30:51.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:51 smithi139 ceph-mon[79872]: pgmap v304: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:30:51.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:51 smithi087 ceph-mon[90982]: pgmap v304: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:30:53.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:53 smithi139 ceph-mon[79872]: pgmap v305: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:30:53.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:53 smithi087 ceph-mon[90982]: pgmap v305: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:30:55.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:55 smithi139 ceph-mon[79872]: pgmap v306: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:30:55.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:55 smithi087 ceph-mon[90982]: pgmap v306: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:30:57.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:57 smithi139 ceph-mon[79872]: pgmap v307: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:30:57.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:57 smithi087 ceph-mon[90982]: pgmap v307: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:30:58.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:58 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:30:58.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:58 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:30:59.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:30:59 smithi139 ceph-mon[79872]: pgmap v308: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:30:59.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:30:59 smithi087 ceph-mon[90982]: pgmap v308: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:31:01.480 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:31:01 smithi087 ceph-mon[90982]: pgmap v309: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:31:01.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:31:01 smithi139 ceph-mon[79872]: pgmap v309: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:31:03.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:31:03 smithi139 ceph-mon[79872]: pgmap v310: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:31:03.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:31:03 smithi087 ceph-mon[90982]: pgmap v310: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:31:05.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:31:05 smithi139 ceph-mon[79872]: pgmap v311: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:31:05.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:31:05 smithi087 ceph-mon[90982]: pgmap v311: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:31:07.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:31:07 smithi139 ceph-mon[79872]: pgmap v312: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:31:07.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:31:07 smithi087 ceph-mon[90982]: pgmap v312: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:31:09.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:31:09 smithi139 ceph-mon[79872]: pgmap v313: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:31:09.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:31:09 smithi087 ceph-mon[90982]: pgmap v313: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:31:11.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:31:11 smithi139 ceph-mon[79872]: pgmap v314: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:31:11.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:31:11 smithi087 ceph-mon[90982]: pgmap v314: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:31:13.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:31:13 smithi139 ceph-mon[79872]: pgmap v315: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:31:13.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:31:13 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:31:13.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:31:13 smithi087 ceph-mon[90982]: pgmap v315: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:31:13.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:31:13 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:31:15.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:31:15 smithi139 ceph-mon[79872]: pgmap v316: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:31:15.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:31:15 smithi087 ceph-mon[90982]: pgmap v316: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:31:17.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:31:17 smithi139 ceph-mon[79872]: pgmap v317: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:31:17.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:31:17 smithi087 ceph-mon[90982]: pgmap v317: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:31:19.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:31:19 smithi139 ceph-mon[79872]: pgmap v318: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:31:19.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:31:19 smithi087 ceph-mon[90982]: pgmap v318: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:31:21.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:31:21 smithi139 ceph-mon[79872]: pgmap v319: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:31:21.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:31:21 smithi087 ceph-mon[90982]: pgmap v319: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:31:23.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:31:23 smithi139 ceph-mon[79872]: pgmap v320: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:31:23.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:31:23 smithi087 ceph-mon[90982]: pgmap v320: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:31:25.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:31:25 smithi139 ceph-mon[79872]: pgmap v321: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:31:25.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:31:25 smithi087 ceph-mon[90982]: pgmap v321: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:31:27.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:31:27 smithi139 ceph-mon[79872]: pgmap v322: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:31:27.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:31:27 smithi087 ceph-mon[90982]: pgmap v322: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:31:28.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:31:28 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:31:28.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:31:28 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:31:29.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:31:29 smithi139 ceph-mon[79872]: pgmap v323: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:31:29.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:31:29 smithi087 ceph-mon[90982]: pgmap v323: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:31:31.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:31:31 smithi139 ceph-mon[79872]: pgmap v324: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:31:31.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:31:31 smithi087 ceph-mon[90982]: pgmap v324: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:31:33.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:31:33 smithi139 ceph-mon[79872]: pgmap v325: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:31:33.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:31:33 smithi087 ceph-mon[90982]: pgmap v325: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:31:35.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:31:35 smithi139 ceph-mon[79872]: pgmap v326: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:31:35.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:31:35 smithi087 ceph-mon[90982]: pgmap v326: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:31:37.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:31:37 smithi139 ceph-mon[79872]: pgmap v327: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:31:37.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:31:37 smithi087 ceph-mon[90982]: pgmap v327: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:31:39.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:31:39 smithi139 ceph-mon[79872]: pgmap v328: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:31:39.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:31:39 smithi087 ceph-mon[90982]: pgmap v328: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:31:41.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:31:41 smithi139 ceph-mon[79872]: pgmap v329: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:31:41.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:31:41 smithi087 ceph-mon[90982]: pgmap v329: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:31:43.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:31:43 smithi139 ceph-mon[79872]: pgmap v330: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:31:43.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:31:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:31:43.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:31:43 smithi087 ceph-mon[90982]: pgmap v330: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:31:43.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:31:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:31:44.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:31:44 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:31:44.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:31:44 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:31:44.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:31:44 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:31:44.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:31:44 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:31:44.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:31:44 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:31:44.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:31:44 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:31:44.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:31:44 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:31:44.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:31:44 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:31:44.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:31:44 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:31:44.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:31:44 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:31:44.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:31:44 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:31:44.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:31:44 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:31:45.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:31:45 smithi139 ceph-mon[79872]: pgmap v331: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:31:45.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:31:45 smithi087 ceph-mon[90982]: pgmap v331: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:31:47.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:31:47 smithi139 ceph-mon[79872]: pgmap v332: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:31:47.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:31:47 smithi087 ceph-mon[90982]: pgmap v332: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:31:49.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:31:49 smithi139 ceph-mon[79872]: pgmap v333: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:31:49.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:31:49 smithi087 ceph-mon[90982]: pgmap v333: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:31:51.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:31:51 smithi139 ceph-mon[79872]: pgmap v334: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:31:51.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:31:51 smithi087 ceph-mon[90982]: pgmap v334: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:31:53.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:31:53 smithi139 ceph-mon[79872]: pgmap v335: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:31:53.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:31:53 smithi087 ceph-mon[90982]: pgmap v335: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:31:55.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:31:55 smithi139 ceph-mon[79872]: pgmap v336: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:31:55.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:31:55 smithi087 ceph-mon[90982]: pgmap v336: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:31:57.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:31:57 smithi139 ceph-mon[79872]: pgmap v337: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:31:57.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:31:57 smithi087 ceph-mon[90982]: pgmap v337: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:31:58.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:31:58 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:31:58.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:31:58 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:31:59.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:31:59 smithi139 ceph-mon[79872]: pgmap v338: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:31:59.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:31:59 smithi087 ceph-mon[90982]: pgmap v338: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:32:01.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:32:01 smithi139 ceph-mon[79872]: pgmap v339: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:32:01.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:32:01 smithi087 ceph-mon[90982]: pgmap v339: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:32:03.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:32:03 smithi139 ceph-mon[79872]: pgmap v340: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:32:03.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:32:03 smithi087 ceph-mon[90982]: pgmap v340: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:32:05.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:32:05 smithi087 ceph-mon[90982]: pgmap v341: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:32:05.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:32:05 smithi139 ceph-mon[79872]: pgmap v341: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:32:07.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:32:07 smithi087 ceph-mon[90982]: pgmap v342: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:32:07.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:32:07 smithi139 ceph-mon[79872]: pgmap v342: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:32:09.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:32:09 smithi087 ceph-mon[90982]: pgmap v343: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:32:09.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:32:09 smithi139 ceph-mon[79872]: pgmap v343: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:32:11.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:32:11 smithi087 ceph-mon[90982]: pgmap v344: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:32:11.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:32:11 smithi139 ceph-mon[79872]: pgmap v344: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:32:13.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:32:13 smithi087 ceph-mon[90982]: pgmap v345: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:32:13.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:32:13 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:32:13.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:32:13 smithi139 ceph-mon[79872]: pgmap v345: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:32:13.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:32:13 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:32:15.669 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:32:15 smithi139 ceph-mon[79872]: pgmap v346: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:32:15.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:32:15 smithi087 ceph-mon[90982]: pgmap v346: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:32:16.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:32:16 smithi139 ceph-mon[79872]: pgmap v347: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:32:16.926 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:32:16 smithi087 ceph-mon[90982]: pgmap v347: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:32:19.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:32:19 smithi139 ceph-mon[79872]: pgmap v348: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:32:19.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:32:19 smithi087 ceph-mon[90982]: pgmap v348: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:32:21.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:32:21 smithi139 ceph-mon[79872]: pgmap v349: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:32:21.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:32:21 smithi087 ceph-mon[90982]: pgmap v349: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:32:23.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:32:23 smithi139 ceph-mon[79872]: pgmap v350: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:32:23.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:32:23 smithi087 ceph-mon[90982]: pgmap v350: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:32:25.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:32:25 smithi139 ceph-mon[79872]: pgmap v351: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:32:25.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:32:25 smithi087 ceph-mon[90982]: pgmap v351: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:32:27.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:32:27 smithi139 ceph-mon[79872]: pgmap v352: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:32:27.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:32:27 smithi087 ceph-mon[90982]: pgmap v352: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:32:28.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:32:28 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:32:28.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:32:28 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:32:29.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:32:29 smithi139 ceph-mon[79872]: pgmap v353: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:32:29.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:32:29 smithi087 ceph-mon[90982]: pgmap v353: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:32:31.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:32:31 smithi139 ceph-mon[79872]: pgmap v354: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:32:31.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:32:31 smithi087 ceph-mon[90982]: pgmap v354: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:32:33.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:32:33 smithi139 ceph-mon[79872]: pgmap v355: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:32:33.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:32:33 smithi087 ceph-mon[90982]: pgmap v355: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:32:35.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:32:35 smithi139 ceph-mon[79872]: pgmap v356: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:32:35.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:32:35 smithi087 ceph-mon[90982]: pgmap v356: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:32:37.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:32:37 smithi139 ceph-mon[79872]: pgmap v357: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:32:37.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:32:37 smithi087 ceph-mon[90982]: pgmap v357: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:32:39.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:32:39 smithi139 ceph-mon[79872]: pgmap v358: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:32:39.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:32:39 smithi087 ceph-mon[90982]: pgmap v358: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:32:41.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:32:41 smithi139 ceph-mon[79872]: pgmap v359: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:32:41.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:32:41 smithi087 ceph-mon[90982]: pgmap v359: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:32:43.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:32:43 smithi139 ceph-mon[79872]: pgmap v360: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:32:43.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:32:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:32:43.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:32:43 smithi087 ceph-mon[90982]: pgmap v360: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:32:43.677 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:32:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:32:44.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:32:44 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:32:44.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:32:44 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:32:45.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:32:45 smithi139 ceph-mon[79872]: pgmap v361: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:32:45.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:32:45 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:32:45.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:32:45 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:32:45.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:32:45 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:32:45.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:32:45 smithi087 ceph-mon[90982]: pgmap v361: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:32:45.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:32:45 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:32:45.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:32:45 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:32:45.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:32:45 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:32:47.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:32:47 smithi139 ceph-mon[79872]: pgmap v362: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:32:47.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:32:47 smithi087 ceph-mon[90982]: pgmap v362: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:32:49.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:32:49 smithi139 ceph-mon[79872]: pgmap v363: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:32:49.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:32:49 smithi087 ceph-mon[90982]: pgmap v363: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:32:51.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:32:51 smithi139 ceph-mon[79872]: pgmap v364: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:32:51.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:32:51 smithi087 ceph-mon[90982]: pgmap v364: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:32:53.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:32:53 smithi139 ceph-mon[79872]: pgmap v365: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:32:53.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:32:53 smithi087 ceph-mon[90982]: pgmap v365: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:32:55.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:32:55 smithi139 ceph-mon[79872]: pgmap v366: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:32:55.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:32:55 smithi087 ceph-mon[90982]: pgmap v366: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:32:57.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:32:57 smithi139 ceph-mon[79872]: pgmap v367: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:32:57.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:32:57 smithi087 ceph-mon[90982]: pgmap v367: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:32:58.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:32:58 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:32:58.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:32:58 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:32:59.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:32:59 smithi139 ceph-mon[79872]: pgmap v368: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:32:59.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:32:59 smithi087 ceph-mon[90982]: pgmap v368: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:33:01.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:33:01 smithi139 ceph-mon[79872]: pgmap v369: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:33:01.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:33:01 smithi087 ceph-mon[90982]: pgmap v369: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:33:03.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:33:03 smithi139 ceph-mon[79872]: pgmap v370: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:33:03.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:33:03 smithi087 ceph-mon[90982]: pgmap v370: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:33:05.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:33:05 smithi139 ceph-mon[79872]: pgmap v371: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:33:05.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:33:05 smithi087 ceph-mon[90982]: pgmap v371: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:33:07.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:33:07 smithi139 ceph-mon[79872]: pgmap v372: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:33:07.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:33:07 smithi087 ceph-mon[90982]: pgmap v372: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:33:09.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:33:09 smithi139 ceph-mon[79872]: pgmap v373: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:33:09.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:33:09 smithi087 ceph-mon[90982]: pgmap v373: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:33:11.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:33:11 smithi139 ceph-mon[79872]: pgmap v374: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:33:11.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:33:11 smithi087 ceph-mon[90982]: pgmap v374: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:33:13.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:33:13 smithi139 ceph-mon[79872]: pgmap v375: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:33:13.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:33:13 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:33:13.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:33:13 smithi087 ceph-mon[90982]: pgmap v375: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:33:13.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:33:13 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:33:15.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:33:15 smithi139 ceph-mon[79872]: pgmap v376: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:33:15.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:33:15 smithi087 ceph-mon[90982]: pgmap v376: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:33:17.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:33:17 smithi139 ceph-mon[79872]: pgmap v377: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:33:17.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:33:17 smithi087 ceph-mon[90982]: pgmap v377: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:33:19.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:33:19 smithi139 ceph-mon[79872]: pgmap v378: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:33:19.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:33:19 smithi087 ceph-mon[90982]: pgmap v378: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:33:21.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:33:21 smithi139 ceph-mon[79872]: pgmap v379: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:33:21.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:33:21 smithi087 ceph-mon[90982]: pgmap v379: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:33:23.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:33:23 smithi139 ceph-mon[79872]: pgmap v380: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:33:23.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:33:23 smithi087 ceph-mon[90982]: pgmap v380: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:33:25.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:33:25 smithi087 ceph-mon[90982]: pgmap v381: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:33:25.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:33:25 smithi139 ceph-mon[79872]: pgmap v381: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:33:27.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:33:27 smithi087 ceph-mon[90982]: pgmap v382: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:33:27.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:33:27 smithi139 ceph-mon[79872]: pgmap v382: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:33:28.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:33:28 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:33:28.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:33:28 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:33:29.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:33:29 smithi087 ceph-mon[90982]: pgmap v383: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:33:29.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:33:29 smithi139 ceph-mon[79872]: pgmap v383: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:33:31.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:33:31 smithi087 ceph-mon[90982]: pgmap v384: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:33:31.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:33:31 smithi139 ceph-mon[79872]: pgmap v384: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:33:33.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:33:33 smithi087 ceph-mon[90982]: pgmap v385: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:33:33.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:33:33 smithi139 ceph-mon[79872]: pgmap v385: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:33:35.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:33:35 smithi087 ceph-mon[90982]: pgmap v386: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:33:35.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:33:35 smithi139 ceph-mon[79872]: pgmap v386: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:33:37.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:33:37 smithi087 ceph-mon[90982]: pgmap v387: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:33:37.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:33:37 smithi139 ceph-mon[79872]: pgmap v387: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:33:39.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:33:39 smithi087 ceph-mon[90982]: pgmap v388: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:33:39.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:33:39 smithi139 ceph-mon[79872]: pgmap v388: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:33:41.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:33:41 smithi087 ceph-mon[90982]: pgmap v389: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:33:41.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:33:41 smithi139 ceph-mon[79872]: pgmap v389: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:33:42.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:33:42 smithi087 ceph-mon[90982]: pgmap v390: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:33:42.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:33:42 smithi139 ceph-mon[79872]: pgmap v390: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:33:43.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:33:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:33:43.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:33:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:33:44.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:33:44 smithi087 ceph-mon[90982]: pgmap v391: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:33:44.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:33:44 smithi139 ceph-mon[79872]: pgmap v391: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:33:45.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:33:45 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:33:45.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:33:45 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:33:45.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:33:45 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:33:45.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:33:45 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:33:45.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:33:45 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:33:45.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:33:45 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:33:45.767 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:33:45 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:33:45.768 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:33:45 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:33:45.768 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:33:45 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:33:45.768 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:33:45 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:33:45.768 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:33:45 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:33:45.768 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:33:45 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:33:46.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:33:46 smithi087 ceph-mon[90982]: pgmap v392: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:33:46.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:33:46 smithi139 ceph-mon[79872]: pgmap v392: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:33:49.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:33:49 smithi139 ceph-mon[79872]: pgmap v393: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:33:49.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:33:49 smithi087 ceph-mon[90982]: pgmap v393: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:33:51.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:33:51 smithi139 ceph-mon[79872]: pgmap v394: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:33:51.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:33:51 smithi087 ceph-mon[90982]: pgmap v394: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:33:53.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:33:53 smithi139 ceph-mon[79872]: pgmap v395: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:33:53.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:33:53 smithi087 ceph-mon[90982]: pgmap v395: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:33:55.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:33:55 smithi139 ceph-mon[79872]: pgmap v396: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:33:55.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:33:55 smithi087 ceph-mon[90982]: pgmap v396: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:33:57.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:33:57 smithi139 ceph-mon[79872]: pgmap v397: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:33:57.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:33:57 smithi087 ceph-mon[90982]: pgmap v397: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:33:58.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:33:58 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:33:58.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:33:58 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:33:59.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:33:59 smithi139 ceph-mon[79872]: pgmap v398: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:33:59.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:33:59 smithi087 ceph-mon[90982]: pgmap v398: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:34:01.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:34:01 smithi139 ceph-mon[79872]: pgmap v399: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:34:01.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:34:01 smithi087 ceph-mon[90982]: pgmap v399: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:34:03.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:34:03 smithi139 ceph-mon[79872]: pgmap v400: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:34:03.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:34:03 smithi087 ceph-mon[90982]: pgmap v400: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:34:05.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:34:05 smithi139 ceph-mon[79872]: pgmap v401: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:34:05.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:34:05 smithi087 ceph-mon[90982]: pgmap v401: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:34:07.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:34:07 smithi139 ceph-mon[79872]: pgmap v402: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:34:07.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:34:07 smithi087 ceph-mon[90982]: pgmap v402: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:34:09.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:34:09 smithi139 ceph-mon[79872]: pgmap v403: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:34:09.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:34:09 smithi087 ceph-mon[90982]: pgmap v403: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:34:11.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:34:11 smithi139 ceph-mon[79872]: pgmap v404: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:34:11.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:34:11 smithi087 ceph-mon[90982]: pgmap v404: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:34:13.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:34:13 smithi139 ceph-mon[79872]: pgmap v405: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:34:13.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:34:13 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:34:13.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:34:13 smithi087 ceph-mon[90982]: pgmap v405: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:34:13.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:34:13 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:34:15.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:34:15 smithi139 ceph-mon[79872]: pgmap v406: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:34:15.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:34:15 smithi087 ceph-mon[90982]: pgmap v406: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:34:17.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:34:17 smithi139 ceph-mon[79872]: pgmap v407: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:34:17.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:34:17 smithi087 ceph-mon[90982]: pgmap v407: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:34:19.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:34:19 smithi139 ceph-mon[79872]: pgmap v408: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:34:19.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:34:19 smithi087 ceph-mon[90982]: pgmap v408: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:34:21.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:34:21 smithi139 ceph-mon[79872]: pgmap v409: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:34:21.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:34:21 smithi087 ceph-mon[90982]: pgmap v409: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:34:23.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:34:23 smithi139 ceph-mon[79872]: pgmap v410: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:34:23.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:34:23 smithi087 ceph-mon[90982]: pgmap v410: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:34:25.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:34:25 smithi139 ceph-mon[79872]: pgmap v411: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:34:25.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:34:25 smithi087 ceph-mon[90982]: pgmap v411: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:34:27.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:34:27 smithi139 ceph-mon[79872]: pgmap v412: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:34:27.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:34:27 smithi087 ceph-mon[90982]: pgmap v412: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:34:28.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:34:28 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:34:28.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:34:28 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:34:29.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:34:29 smithi139 ceph-mon[79872]: pgmap v413: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:34:29.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:34:29 smithi087 ceph-mon[90982]: pgmap v413: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:34:31.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:34:31 smithi139 ceph-mon[79872]: pgmap v414: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:34:31.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:34:31 smithi087 ceph-mon[90982]: pgmap v414: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:34:33.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:34:33 smithi139 ceph-mon[79872]: pgmap v415: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:34:33.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:34:33 smithi087 ceph-mon[90982]: pgmap v415: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:34:35.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:34:35 smithi139 ceph-mon[79872]: pgmap v416: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-17T07:34:35.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:34:35 smithi087 ceph-mon[90982]: pgmap v416: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-17T07:34:37.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:34:37 smithi139 ceph-mon[79872]: pgmap v417: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-17T07:34:37.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:34:37 smithi087 ceph-mon[90982]: pgmap v417: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-17T07:34:39.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:34:39 smithi139 ceph-mon[79872]: pgmap v418: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-17T07:34:39.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:34:39 smithi087 ceph-mon[90982]: pgmap v418: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-17T07:34:41.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:34:41 smithi139 ceph-mon[79872]: pgmap v419: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-09-17T07:34:41.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:34:41 smithi087 ceph-mon[90982]: pgmap v419: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-09-17T07:34:43.222 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:34:42 smithi087 ceph-mon[90982]: pgmap v420: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-17T07:34:43.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:34:42 smithi139 ceph-mon[79872]: pgmap v420: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-17T07:34:44.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:34:43 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:34:44.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:34:43 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:34:45.267 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:34:44 smithi139 ceph-mon[79872]: pgmap v421: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-17T07:34:45.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:34:44 smithi087 ceph-mon[90982]: pgmap v421: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-17T07:34:46.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:34:45 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:34:46.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:34:45 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:34:46.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:34:45 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:34:46.367 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:34:45 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:34:46.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:34:45 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T07:34:46.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:34:45 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T07:34:46.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:34:45 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T07:34:46.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:34:45 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' 2024-09-17T07:34:47.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:34:46 smithi139 ceph-mon[79872]: pgmap v422: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:34:47.426 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:34:46 smithi087 ceph-mon[90982]: pgmap v422: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:34:49.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:34:49 smithi139 ceph-mon[79872]: pgmap v423: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:34:49.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:34:49 smithi087 ceph-mon[90982]: pgmap v423: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:34:51.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:34:51 smithi139 ceph-mon[79872]: pgmap v424: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:34:51.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:34:51 smithi087 ceph-mon[90982]: pgmap v424: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:34:53.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:34:53 smithi139 ceph-mon[79872]: pgmap v425: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:34:53.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:34:53 smithi087 ceph-mon[90982]: pgmap v425: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:34:55.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:34:55 smithi139 ceph-mon[79872]: pgmap v426: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:34:55.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:34:55 smithi087 ceph-mon[90982]: pgmap v426: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:34:57.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:34:57 smithi139 ceph-mon[79872]: pgmap v427: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:34:57.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:34:57 smithi087 ceph-mon[90982]: pgmap v427: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:34:58.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:34:58 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:34:58.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:34:58 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:34:59.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:34:59 smithi139 ceph-mon[79872]: pgmap v428: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:34:59.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:34:59 smithi087 ceph-mon[90982]: pgmap v428: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:35:01.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:35:01 smithi139 ceph-mon[79872]: pgmap v429: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:35:01.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:35:01 smithi087 ceph-mon[90982]: pgmap v429: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:35:03.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:35:03 smithi139 ceph-mon[79872]: pgmap v430: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:35:03.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:35:03 smithi087 ceph-mon[90982]: pgmap v430: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:35:05.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:35:05 smithi139 ceph-mon[79872]: pgmap v431: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:35:05.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:35:05 smithi087 ceph-mon[90982]: pgmap v431: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:35:07.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:35:07 smithi139 ceph-mon[79872]: pgmap v432: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:35:07.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:35:07 smithi087 ceph-mon[90982]: pgmap v432: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:35:09.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:35:09 smithi139 ceph-mon[79872]: pgmap v433: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:35:09.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:35:09 smithi087 ceph-mon[90982]: pgmap v433: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:35:11.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:35:11 smithi139 ceph-mon[79872]: pgmap v434: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:35:11.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:35:11 smithi087 ceph-mon[90982]: pgmap v434: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:35:13.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:35:13 smithi139 ceph-mon[79872]: pgmap v435: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:35:13.617 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:35:13 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:35:13.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:35:13 smithi087 ceph-mon[90982]: pgmap v435: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:35:13.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:35:13 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:35:15.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:35:15 smithi139 ceph-mon[79872]: pgmap v436: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:35:15.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:35:15 smithi087 ceph-mon[90982]: pgmap v436: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:35:17.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:35:17 smithi139 ceph-mon[79872]: pgmap v437: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:35:17.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:35:17 smithi087 ceph-mon[90982]: pgmap v437: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:35:19.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:35:19 smithi139 ceph-mon[79872]: pgmap v438: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:35:19.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:35:19 smithi087 ceph-mon[90982]: pgmap v438: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:35:21.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:35:21 smithi139 ceph-mon[79872]: pgmap v439: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:35:21.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:35:21 smithi087 ceph-mon[90982]: pgmap v439: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:35:23.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:35:23 smithi139 ceph-mon[79872]: pgmap v440: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:35:23.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:35:23 smithi087 ceph-mon[90982]: pgmap v440: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:35:25.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:35:25 smithi139 ceph-mon[79872]: pgmap v441: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:35:25.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:35:25 smithi087 ceph-mon[90982]: pgmap v441: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:35:27.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:35:27 smithi139 ceph-mon[79872]: pgmap v442: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:35:27.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:35:27 smithi087 ceph-mon[90982]: pgmap v442: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:35:28.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:35:28 smithi139 ceph-mon[79872]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:35:28.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:35:28 smithi087 ceph-mon[90982]: from='mgr.24529 172.21.15.87:0/262163515' entity='mgr.smithi087.vuvjer' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T07:35:29.616 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:35:29 smithi139 ceph-mon[79872]: pgmap v443: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:35:29.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:35:29 smithi087 ceph-mon[90982]: pgmap v443: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T07:35:31.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:35:31 smithi087 ceph-mon[90982]: pgmap v444: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:35:31.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:35:31 smithi139 ceph-mon[79872]: pgmap v444: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T07:35:33.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:35:33 smithi087 ceph-mon[90982]: pgmap v445: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:35:33.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:35:33 smithi139 ceph-mon[79872]: pgmap v445: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:35:35.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:35:35 smithi087 ceph-mon[90982]: pgmap v446: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:35:35.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:35:35 smithi139 ceph-mon[79872]: pgmap v446: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T07:35:37.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:35:37 smithi087 ceph-mon[90982]: pgmap v447: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:35:37.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:35:37 smithi139 ceph-mon[79872]: pgmap v447: 65 pgs: 65 active+clean; 194 MiB data, 818 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T07:35:38.208 ERROR:tasks.cephfs.fuse_mount:process failed to terminate after unmount. This probably indicates a bug within ceph-fuse. 2024-09-17T07:35:38.208 ERROR:teuthology.run_tasks:Manager failed: ceph-fuse Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_1cbdc9211df088cccbd94423c7cf3a2b85fe432b/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph_1cbdc9211df088cccbd94423c7cf3a2b85fe432b/qa/tasks/cephfs/fuse_mount.py", line 400, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-17T07:35:38.210 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-17T07:35:38.231 INFO:tasks.cephadm:Teardown begin 2024-09-17T07:35:38.231 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph_1cbdc9211df088cccbd94423c7cf3a2b85fe432b/qa/tasks/cephadm.py", line 1739, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_1cbdc9211df088cccbd94423c7cf3a2b85fe432b/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph_1cbdc9211df088cccbd94423c7cf3a2b85fe432b/qa/tasks/cephfs/fuse_mount.py", line 400, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-17T07:35:38.233 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-17T07:35:38.266 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-17T07:35:38.299 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-17T07:35:38.300 DEBUG:teuthology.orchestra.run.smithi087:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-17T07:35:38.323 DEBUG:teuthology.orchestra.run.smithi139:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-17T07:35:38.357 INFO:tasks.cephadm:Stopping all daemons... 2024-09-17T07:35:38.358 INFO:tasks.cephadm.mon.smithi087:Stopping mon.smithi087... 2024-09-17T07:35:38.358 DEBUG:teuthology.orchestra.run.smithi087:> sudo systemctl stop ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968@mon.smithi087 2024-09-17T07:35:38.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:35:38 smithi087 systemd[1]: Stopping Ceph mon.smithi087 for d5dbf8d6-74c3-11ef-bceb-c7b262605968... 2024-09-17T07:35:39.046 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:35:38 smithi087 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-mon-smithi087[90978]: 2024-09-17T07:35:38.737+0000 7fe8be199640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi087 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T07:35:39.046 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:35:38 smithi087 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-mon-smithi087[90978]: 2024-09-17T07:35:38.737+0000 7fe8be199640 -1 mon.smithi087@0(leader) e3 *** Got Signal Terminated *** 2024-09-17T07:35:39.046 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:35:38 smithi087 podman[146894]: 2024-09-17 07:35:38.778124723 +0000 UTC m=+0.225669164 container died 305c72de1f9f1d1730f70b140c3c58f1905b1408c2f35c9371298cc5090ad0b5 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-mon-smithi087, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=reef-19e2a2b) 2024-09-17T07:35:39.335 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:35:39 smithi087 podman[146894]: 2024-09-17 07:35:39.253656227 +0000 UTC m=+0.701200668 container cleanup 305c72de1f9f1d1730f70b140c3c58f1905b1408c2f35c9371298cc5090ad0b5 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-mon-smithi087, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=reef-19e2a2b) 2024-09-17T07:35:39.335 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:35:39 smithi087 bash[146894]: ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-mon-smithi087 2024-09-17T07:35:39.676 INFO:journalctl@ceph.mon.smithi087.smithi087.stdout:Sep 17 07:35:39 smithi087 podman[146906]: 2024-09-17 07:35:39.56366197 +0000 UTC m=+0.786793191 container remove 305c72de1f9f1d1730f70b140c3c58f1905b1408c2f35c9371298cc5090ad0b5 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-mon-smithi087, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=reef-19e2a2b, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True) 2024-09-17T07:35:39.727 DEBUG:teuthology.orchestra.run.smithi087:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968@mon.smithi087.service' 2024-09-17T07:35:39.774 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T07:35:39.774 INFO:tasks.cephadm.mon.smithi087:Stopped mon.smithi087 2024-09-17T07:35:39.774 INFO:tasks.cephadm.mon.smithi139:Stopping mon.smithi139... 2024-09-17T07:35:39.774 DEBUG:teuthology.orchestra.run.smithi139:> sudo systemctl stop ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968@mon.smithi139 2024-09-17T07:35:40.089 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:35:39 smithi139 systemd[1]: Stopping Ceph mon.smithi139 for d5dbf8d6-74c3-11ef-bceb-c7b262605968... 2024-09-17T07:35:40.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:35:40 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-mon-smithi139[79868]: 2024-09-17T07:35:40.087+0000 7f6cf19c4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi139 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T07:35:40.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:35:40 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-mon-smithi139[79868]: 2024-09-17T07:35:40.087+0000 7f6cf19c4640 -1 mon.smithi139@1(peon) e3 *** Got Signal Terminated *** 2024-09-17T07:35:40.366 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:35:40 smithi139 podman[115844]: 2024-09-17 07:35:40.282050873 +0000 UTC m=+0.313607918 container died 0b159495af0ffd6af32ae2c34c8c0c4d57d509e725c388b5ecbfd46ed205690a (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-mon-smithi139, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=reef-19e2a2b, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2) 2024-09-17T07:35:40.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:35:40 smithi139 podman[115844]: 2024-09-17 07:35:40.780017733 +0000 UTC m=+0.811574816 container cleanup 0b159495af0ffd6af32ae2c34c8c0c4d57d509e725c388b5ecbfd46ed205690a (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-mon-smithi139, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=reef-19e2a2b, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T07:35:40.866 INFO:journalctl@ceph.mon.smithi139.smithi139.stdout:Sep 17 07:35:40 smithi139 bash[115844]: ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-mon-smithi139 2024-09-17T07:35:41.163 DEBUG:teuthology.orchestra.run.smithi139:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968@mon.smithi139.service' 2024-09-17T07:35:41.207 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T07:35:41.208 INFO:tasks.cephadm.mon.smithi139:Stopped mon.smithi139 2024-09-17T07:35:41.208 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-17T07:35:41.208 DEBUG:teuthology.orchestra.run.smithi087:> sudo systemctl stop ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968@osd.0 2024-09-17T07:35:41.575 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 17 07:35:41 smithi087 systemd[1]: Stopping Ceph osd.0 for d5dbf8d6-74c3-11ef-bceb-c7b262605968... 2024-09-17T07:35:41.926 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 17 07:35:41 smithi087 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-0[99574]: 2024-09-17T07:35:41.574+0000 7fe21b993640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T07:35:41.926 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 17 07:35:41 smithi087 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-0[99574]: 2024-09-17T07:35:41.574+0000 7fe21b993640 -1 osd.0 82 *** Got signal Terminated *** 2024-09-17T07:35:41.926 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 17 07:35:41 smithi087 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-0[99574]: 2024-09-17T07:35:41.574+0000 7fe21b993640 -1 osd.0 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T07:35:47.336 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 17 07:35:47 smithi087 podman[147030]: 2024-09-17 07:35:47.035928624 +0000 UTC m=+5.627107690 container died e97cb50e6aecb6b140794bc8f39fb4e45ea673bc74b01208e1666bb99312ef68 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=reef-19e2a2b, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-17T07:35:47.676 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 17 07:35:47 smithi087 podman[147030]: 2024-09-17 07:35:47.417297476 +0000 UTC m=+6.008476535 container cleanup e97cb50e6aecb6b140794bc8f39fb4e45ea673bc74b01208e1666bb99312ef68 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=reef-19e2a2b, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2) 2024-09-17T07:35:47.676 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 17 07:35:47 smithi087 bash[147030]: ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-0 2024-09-17T07:35:48.030 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 17 07:35:47 smithi087 podman[147048]: 2024-09-17 07:35:47.67693182 +0000 UTC m=+0.639623741 container remove e97cb50e6aecb6b140794bc8f39fb4e45ea673bc74b01208e1666bb99312ef68 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=reef-19e2a2b, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-17T07:35:48.289 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 17 07:35:48 smithi087 podman[147136]: 2024-09-17 07:35:47.933109192 +0000 UTC m=+0.015660631 image pull 980a0bfcd684674f25c08d857ad8de3b1c8ae738870529edbf9aa463832c8d89 quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9 2024-09-17T07:35:48.289 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 17 07:35:48 smithi087 podman[147136]: 2024-09-17 07:35:48.053049781 +0000 UTC m=+0.135601219 container create ad579232e68d7a413f71e4f518cf63a39e4a0c793091d3bb5976369d99fa0412 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=reef-19e2a2b, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=) 2024-09-17T07:35:48.676 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 17 07:35:48 smithi087 podman[147136]: 2024-09-17 07:35:48.288908471 +0000 UTC m=+0.371459915 container init ad579232e68d7a413f71e4f518cf63a39e4a0c793091d3bb5976369d99fa0412 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-0-deactivate, RELEASE=reef-19e2a2b, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-17T07:35:48.676 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 17 07:35:48 smithi087 podman[147136]: 2024-09-17 07:35:48.293301432 +0000 UTC m=+0.375852874 container start ad579232e68d7a413f71e4f518cf63a39e4a0c793091d3bb5976369d99fa0412 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=reef-19e2a2b, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T07:35:48.677 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 17 07:35:48 smithi087 podman[147136]: 2024-09-17 07:35:48.397710009 +0000 UTC m=+0.480261456 container attach ad579232e68d7a413f71e4f518cf63a39e4a0c793091d3bb5976369d99fa0412 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=reef-19e2a2b, CEPH_POINT_RELEASE=) 2024-09-17T07:35:48.677 INFO:journalctl@ceph.osd.0.smithi087.stdout:Sep 17 07:35:48 smithi087 podman[147136]: 2024-09-17 07:35:48.482662539 +0000 UTC m=+0.565213981 container died ad579232e68d7a413f71e4f518cf63a39e4a0c793091d3bb5976369d99fa0412 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240731, RELEASE=reef-19e2a2b, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-17T07:35:49.110 DEBUG:teuthology.orchestra.run.smithi087:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968@osd.0.service' 2024-09-17T07:35:49.150 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T07:35:49.150 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-17T07:35:49.150 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-17T07:35:49.150 DEBUG:teuthology.orchestra.run.smithi087:> sudo systemctl stop ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968@osd.1 2024-09-17T07:35:49.367 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 17 07:35:49 smithi087 systemd[1]: Stopping Ceph osd.1 for d5dbf8d6-74c3-11ef-bceb-c7b262605968... 2024-09-17T07:35:49.676 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 17 07:35:49 smithi087 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-1[105312]: 2024-09-17T07:35:49.504+0000 7f06e9a76640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T07:35:49.676 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 17 07:35:49 smithi087 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-1[105312]: 2024-09-17T07:35:49.504+0000 7f06e9a76640 -1 osd.1 82 *** Got signal Terminated *** 2024-09-17T07:35:49.676 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 17 07:35:49 smithi087 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-1[105312]: 2024-09-17T07:35:49.504+0000 7f06e9a76640 -1 osd.1 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T07:35:55.289 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 17 07:35:55 smithi087 podman[147238]: 2024-09-17 07:35:55.000888308 +0000 UTC m=+5.623409835 container died b108771d0b8e19d82b715ab9784c4ec246ef575b85434ef0ea20624750223c82 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-1, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=reef-19e2a2b, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-17T07:35:55.676 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 17 07:35:55 smithi087 podman[147238]: 2024-09-17 07:35:55.38779246 +0000 UTC m=+6.010313977 container cleanup b108771d0b8e19d82b715ab9784c4ec246ef575b85434ef0ea20624750223c82 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-1, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=reef-19e2a2b, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-17T07:35:55.676 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 17 07:35:55 smithi087 bash[147238]: ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-1 2024-09-17T07:35:56.047 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 17 07:35:55 smithi087 podman[147265]: 2024-09-17 07:35:55.689477777 +0000 UTC m=+0.684347553 container remove b108771d0b8e19d82b715ab9784c4ec246ef575b85434ef0ea20624750223c82 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=reef-19e2a2b, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-17T07:35:56.376 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 17 07:35:56 smithi087 podman[147352]: 2024-09-17 07:35:55.949736498 +0000 UTC m=+0.015757517 image pull 980a0bfcd684674f25c08d857ad8de3b1c8ae738870529edbf9aa463832c8d89 quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9 2024-09-17T07:35:56.376 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 17 07:35:56 smithi087 podman[147352]: 2024-09-17 07:35:56.057017202 +0000 UTC m=+0.123038222 container create 2243b8a078e72ca973e55a4cd70a6978aa7dd47b89ed277c0f226d75ec459334 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=reef-19e2a2b) 2024-09-17T07:35:56.376 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 17 07:35:56 smithi087 podman[147352]: 2024-09-17 07:35:56.276341607 +0000 UTC m=+0.342362626 container init 2243b8a078e72ca973e55a4cd70a6978aa7dd47b89ed277c0f226d75ec459334 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, RELEASE=reef-19e2a2b, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-17T07:35:56.376 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 17 07:35:56 smithi087 podman[147352]: 2024-09-17 07:35:56.279674794 +0000 UTC m=+0.345695818 container start 2243b8a078e72ca973e55a4cd70a6978aa7dd47b89ed277c0f226d75ec459334 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=reef-19e2a2b, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=) 2024-09-17T07:35:56.376 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 17 07:35:56 smithi087 podman[147352]: 2024-09-17 07:35:56.376149064 +0000 UTC m=+0.442170095 container attach 2243b8a078e72ca973e55a4cd70a6978aa7dd47b89ed277c0f226d75ec459334 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=reef-19e2a2b, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-17T07:35:56.676 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 17 07:35:56 smithi087 podman[147352]: 2024-09-17 07:35:56.459707372 +0000 UTC m=+0.525728395 container died 2243b8a078e72ca973e55a4cd70a6978aa7dd47b89ed277c0f226d75ec459334 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-1-deactivate, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=reef-19e2a2b, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-17T07:35:57.013 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 17 07:35:56 smithi087 podman[147375]: 2024-09-17 07:35:56.996288547 +0000 UTC m=+0.530911591 container remove 2243b8a078e72ca973e55a4cd70a6978aa7dd47b89ed277c0f226d75ec459334 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-1-deactivate, RELEASE=reef-19e2a2b, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731) 2024-09-17T07:35:57.013 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 17 07:35:57 smithi087 systemd[1]: ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968@osd.1.service: Deactivated successfully. 2024-09-17T07:35:57.013 INFO:journalctl@ceph.osd.1.smithi087.stdout:Sep 17 07:35:57 smithi087 systemd[1]: Stopped Ceph osd.1 for d5dbf8d6-74c3-11ef-bceb-c7b262605968. 2024-09-17T07:35:57.016 DEBUG:teuthology.orchestra.run.smithi087:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968@osd.1.service' 2024-09-17T07:35:57.056 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T07:35:57.056 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-17T07:35:57.057 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-17T07:35:57.057 DEBUG:teuthology.orchestra.run.smithi087:> sudo systemctl stop ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968@osd.2 2024-09-17T07:35:57.400 INFO:journalctl@ceph.osd.2.smithi087.stdout:Sep 17 07:35:57 smithi087 systemd[1]: Stopping Ceph osd.2 for d5dbf8d6-74c3-11ef-bceb-c7b262605968... 2024-09-17T07:35:57.676 INFO:journalctl@ceph.osd.2.smithi087.stdout:Sep 17 07:35:57 smithi087 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-2[111078]: 2024-09-17T07:35:57.398+0000 7fd4c01a5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T07:35:57.676 INFO:journalctl@ceph.osd.2.smithi087.stdout:Sep 17 07:35:57 smithi087 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-2[111078]: 2024-09-17T07:35:57.398+0000 7fd4c01a5640 -1 osd.2 82 *** Got signal Terminated *** 2024-09-17T07:35:57.676 INFO:journalctl@ceph.osd.2.smithi087.stdout:Sep 17 07:35:57 smithi087 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-2[111078]: 2024-09-17T07:35:57.398+0000 7fd4c01a5640 -1 osd.2 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T07:36:03.159 INFO:journalctl@ceph.osd.2.smithi087.stdout:Sep 17 07:36:02 smithi087 podman[147456]: 2024-09-17 07:36:02.871880891 +0000 UTC m=+5.594140213 container died 240cfb3b536678c7f7d5ef4666f84bd3f15ea51e26acd9200c3d83ef7722b744 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, RELEASE=reef-19e2a2b) 2024-09-17T07:36:03.426 INFO:journalctl@ceph.osd.2.smithi087.stdout:Sep 17 07:36:03 smithi087 podman[147456]: 2024-09-17 07:36:03.283288627 +0000 UTC m=+6.005547941 container cleanup 240cfb3b536678c7f7d5ef4666f84bd3f15ea51e26acd9200c3d83ef7722b744 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=reef-19e2a2b, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-17T07:36:03.426 INFO:journalctl@ceph.osd.2.smithi087.stdout:Sep 17 07:36:03 smithi087 bash[147456]: ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-2 2024-09-17T07:36:03.868 INFO:journalctl@ceph.osd.2.smithi087.stdout:Sep 17 07:36:03 smithi087 podman[147478]: 2024-09-17 07:36:03.551449016 +0000 UTC m=+0.676699525 container remove 240cfb3b536678c7f7d5ef4666f84bd3f15ea51e26acd9200c3d83ef7722b744 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-2, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=reef-19e2a2b, org.label-schema.schema-version=1.0) 2024-09-17T07:36:04.122 INFO:journalctl@ceph.osd.2.smithi087.stdout:Sep 17 07:36:03 smithi087 podman[147573]: 2024-09-17 07:36:03.771195929 +0000 UTC m=+0.015552127 image pull 980a0bfcd684674f25c08d857ad8de3b1c8ae738870529edbf9aa463832c8d89 quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9 2024-09-17T07:36:04.122 INFO:journalctl@ceph.osd.2.smithi087.stdout:Sep 17 07:36:03 smithi087 podman[147573]: 2024-09-17 07:36:03.894205251 +0000 UTC m=+0.138561476 container create b70136898ff4cfe9cebefd71080183f8253f7ba822a9686fd3fd61413ec021ed (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=reef-19e2a2b, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-17T07:36:04.122 INFO:journalctl@ceph.osd.2.smithi087.stdout:Sep 17 07:36:04 smithi087 podman[147573]: 2024-09-17 07:36:04.121967192 +0000 UTC m=+0.366323379 container init b70136898ff4cfe9cebefd71080183f8253f7ba822a9686fd3fd61413ec021ed (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, RELEASE=reef-19e2a2b, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T07:36:04.426 INFO:journalctl@ceph.osd.2.smithi087.stdout:Sep 17 07:36:04 smithi087 podman[147573]: 2024-09-17 07:36:04.125279726 +0000 UTC m=+0.369635918 container start b70136898ff4cfe9cebefd71080183f8253f7ba822a9686fd3fd61413ec021ed (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=reef-19e2a2b, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T07:36:04.426 INFO:journalctl@ceph.osd.2.smithi087.stdout:Sep 17 07:36:04 smithi087 podman[147573]: 2024-09-17 07:36:04.213637385 +0000 UTC m=+0.457993577 container attach b70136898ff4cfe9cebefd71080183f8253f7ba822a9686fd3fd61413ec021ed (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=reef-19e2a2b, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-17T07:36:04.426 INFO:journalctl@ceph.osd.2.smithi087.stdout:Sep 17 07:36:04 smithi087 podman[147573]: 2024-09-17 07:36:04.3125166 +0000 UTC m=+0.556872784 container died b70136898ff4cfe9cebefd71080183f8253f7ba822a9686fd3fd61413ec021ed (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-2-deactivate, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=reef-19e2a2b, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-17T07:36:04.942 DEBUG:teuthology.orchestra.run.smithi087:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968@osd.2.service' 2024-09-17T07:36:04.986 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T07:36:04.986 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-17T07:36:04.986 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-17T07:36:04.986 DEBUG:teuthology.orchestra.run.smithi139:> sudo systemctl stop ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968@osd.3 2024-09-17T07:36:05.290 INFO:journalctl@ceph.osd.3.smithi139.stdout:Sep 17 07:36:05 smithi139 systemd[1]: Stopping Ceph osd.3 for d5dbf8d6-74c3-11ef-bceb-c7b262605968... 2024-09-17T07:36:05.616 INFO:journalctl@ceph.osd.3.smithi139.stdout:Sep 17 07:36:05 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-3[88972]: 2024-09-17T07:36:05.290+0000 7f7594abc640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T07:36:05.616 INFO:journalctl@ceph.osd.3.smithi139.stdout:Sep 17 07:36:05 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-3[88972]: 2024-09-17T07:36:05.290+0000 7f7594abc640 -1 osd.3 82 *** Got signal Terminated *** 2024-09-17T07:36:05.616 INFO:journalctl@ceph.osd.3.smithi139.stdout:Sep 17 07:36:05 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-3[88972]: 2024-09-17T07:36:05.290+0000 7f7594abc640 -1 osd.3 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T07:36:11.049 INFO:journalctl@ceph.osd.3.smithi139.stdout:Sep 17 07:36:10 smithi139 podman[115971]: 2024-09-17 07:36:10.777277882 +0000 UTC m=+5.601515382 container died b05ed3bf3f5c5d4bd3e4d46f44d573d37d8625e73b86938d988cfdcbacf86ec2 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-3, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=reef-19e2a2b, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-17T07:36:11.366 INFO:journalctl@ceph.osd.3.smithi139.stdout:Sep 17 07:36:11 smithi139 podman[115971]: 2024-09-17 07:36:11.206891436 +0000 UTC m=+6.031128934 container cleanup b05ed3bf3f5c5d4bd3e4d46f44d573d37d8625e73b86938d988cfdcbacf86ec2 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-3, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=reef-19e2a2b, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-17T07:36:11.366 INFO:journalctl@ceph.osd.3.smithi139.stdout:Sep 17 07:36:11 smithi139 bash[115971]: ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-3 2024-09-17T07:36:11.367 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:36:11 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-5[98616]: 2024-09-17T07:36:11.047+0000 7f1bb0d7e640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-17T07:35:45.156953+0000 front 2024-09-17T07:35:45.156895+0000 (oldest deadline 2024-09-17T07:36:10.957215+0000) 2024-09-17T07:36:11.828 INFO:journalctl@ceph.osd.3.smithi139.stdout:Sep 17 07:36:11 smithi139 podman[115999]: 2024-09-17 07:36:11.40799166 +0000 UTC m=+0.625501754 container remove b05ed3bf3f5c5d4bd3e4d46f44d573d37d8625e73b86938d988cfdcbacf86ec2 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, RELEASE=reef-19e2a2b, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-17T07:36:12.099 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 17 07:36:12 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-4[93790]: 2024-09-17T07:36:12.052+0000 7f8dbb753640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-17T07:35:45.861334+0000 front 2024-09-17T07:35:45.861483+0000 (oldest deadline 2024-09-17T07:36:11.761204+0000) 2024-09-17T07:36:12.099 INFO:journalctl@ceph.osd.3.smithi139.stdout:Sep 17 07:36:11 smithi139 podman[116088]: 2024-09-17 07:36:11.730992711 +0000 UTC m=+0.015709348 image pull 980a0bfcd684674f25c08d857ad8de3b1c8ae738870529edbf9aa463832c8d89 quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9 2024-09-17T07:36:12.100 INFO:journalctl@ceph.osd.3.smithi139.stdout:Sep 17 07:36:11 smithi139 podman[116088]: 2024-09-17 07:36:11.833813533 +0000 UTC m=+0.118530161 container create 4fc89daba990973112568cd598ce62f26efdf9b25869c716f234a3cfd24d43f4 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=reef-19e2a2b, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-17T07:36:12.100 INFO:journalctl@ceph.osd.3.smithi139.stdout:Sep 17 07:36:12 smithi139 podman[116088]: 2024-09-17 07:36:12.044861977 +0000 UTC m=+0.329578605 container init 4fc89daba990973112568cd598ce62f26efdf9b25869c716f234a3cfd24d43f4 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-3-deactivate, ceph=True, io.buildah.version=1.37.2, RELEASE=reef-19e2a2b, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-17T07:36:12.100 INFO:journalctl@ceph.osd.3.smithi139.stdout:Sep 17 07:36:12 smithi139 podman[116088]: 2024-09-17 07:36:12.04828478 +0000 UTC m=+0.333001409 container start 4fc89daba990973112568cd598ce62f26efdf9b25869c716f234a3cfd24d43f4 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=reef-19e2a2b, org.label-schema.build-date=20240731) 2024-09-17T07:36:12.366 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:36:12 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-5[98616]: 2024-09-17T07:36:12.098+0000 7f1bb0d7e640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-17T07:35:45.156953+0000 front 2024-09-17T07:35:45.156895+0000 (oldest deadline 2024-09-17T07:36:10.957215+0000) 2024-09-17T07:36:12.367 INFO:journalctl@ceph.osd.3.smithi139.stdout:Sep 17 07:36:12 smithi139 podman[116088]: 2024-09-17 07:36:12.195264945 +0000 UTC m=+0.479981589 container attach 4fc89daba990973112568cd598ce62f26efdf9b25869c716f234a3cfd24d43f4 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=reef-19e2a2b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-17T07:36:12.367 INFO:journalctl@ceph.osd.3.smithi139.stdout:Sep 17 07:36:12 smithi139 podman[116088]: 2024-09-17 07:36:12.240738766 +0000 UTC m=+0.525455403 container died 4fc89daba990973112568cd598ce62f26efdf9b25869c716f234a3cfd24d43f4 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-3-deactivate, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=reef-19e2a2b, maintainer=Guillaume Abrioux ) 2024-09-17T07:36:12.893 DEBUG:teuthology.orchestra.run.smithi139:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968@osd.3.service' 2024-09-17T07:36:12.931 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T07:36:12.932 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-17T07:36:12.932 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-17T07:36:12.932 DEBUG:teuthology.orchestra.run.smithi139:> sudo systemctl stop ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968@osd.4 2024-09-17T07:36:13.252 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:36:13 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-5[98616]: 2024-09-17T07:36:13.101+0000 7f1bb0d7e640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-17T07:35:45.156953+0000 front 2024-09-17T07:35:45.156895+0000 (oldest deadline 2024-09-17T07:36:10.957215+0000) 2024-09-17T07:36:13.253 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 17 07:36:13 smithi139 systemd[1]: Stopping Ceph osd.4 for d5dbf8d6-74c3-11ef-bceb-c7b262605968... 2024-09-17T07:36:13.253 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 17 07:36:13 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-4[93790]: 2024-09-17T07:36:13.082+0000 7f8dbb753640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-17T07:35:45.861334+0000 front 2024-09-17T07:35:45.861483+0000 (oldest deadline 2024-09-17T07:36:11.761204+0000) 2024-09-17T07:36:13.253 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 17 07:36:13 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-4[93790]: 2024-09-17T07:36:13.251+0000 7f8dc2957640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T07:36:13.253 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 17 07:36:13 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-4[93790]: 2024-09-17T07:36:13.251+0000 7f8dc2957640 -1 osd.4 82 *** Got signal Terminated *** 2024-09-17T07:36:13.253 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 17 07:36:13 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-4[93790]: 2024-09-17T07:36:13.251+0000 7f8dc2957640 -1 osd.4 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T07:36:14.366 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 17 07:36:14 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-4[93790]: 2024-09-17T07:36:14.123+0000 7f8dbb753640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-17T07:35:45.861334+0000 front 2024-09-17T07:35:45.861483+0000 (oldest deadline 2024-09-17T07:36:11.761204+0000) 2024-09-17T07:36:14.366 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:36:14 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-5[98616]: 2024-09-17T07:36:14.093+0000 7f1bb0d7e640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-17T07:35:45.156953+0000 front 2024-09-17T07:35:45.156895+0000 (oldest deadline 2024-09-17T07:36:10.957215+0000) 2024-09-17T07:36:15.366 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 17 07:36:15 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-4[93790]: 2024-09-17T07:36:15.165+0000 7f8dbb753640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-17T07:35:45.861334+0000 front 2024-09-17T07:35:45.861483+0000 (oldest deadline 2024-09-17T07:36:11.761204+0000) 2024-09-17T07:36:15.367 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:36:15 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-5[98616]: 2024-09-17T07:36:15.097+0000 7f1bb0d7e640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-17T07:35:45.156953+0000 front 2024-09-17T07:35:45.156895+0000 (oldest deadline 2024-09-17T07:36:10.957215+0000) 2024-09-17T07:36:16.616 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 17 07:36:16 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-4[93790]: 2024-09-17T07:36:16.186+0000 7f8dbb753640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-17T07:35:45.861334+0000 front 2024-09-17T07:35:45.861483+0000 (oldest deadline 2024-09-17T07:36:11.761204+0000) 2024-09-17T07:36:16.617 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:36:16 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-5[98616]: 2024-09-17T07:36:16.135+0000 7f1bb0d7e640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-17T07:35:45.156953+0000 front 2024-09-17T07:35:45.156895+0000 (oldest deadline 2024-09-17T07:36:10.957215+0000) 2024-09-17T07:36:17.616 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:36:17 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-5[98616]: 2024-09-17T07:36:17.158+0000 7f1bb0d7e640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-17T07:35:45.156953+0000 front 2024-09-17T07:35:45.156895+0000 (oldest deadline 2024-09-17T07:36:10.957215+0000) 2024-09-17T07:36:17.617 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 17 07:36:17 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-4[93790]: 2024-09-17T07:36:17.235+0000 7f8dbb753640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-17T07:35:45.861334+0000 front 2024-09-17T07:35:45.861483+0000 (oldest deadline 2024-09-17T07:36:11.761204+0000) 2024-09-17T07:36:17.617 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 17 07:36:17 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-4[93790]: 2024-09-17T07:36:17.235+0000 7f8dbb753640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.87:6814 osd.1 since back 2024-09-17T07:35:51.761751+0000 front 2024-09-17T07:35:51.761822+0000 (oldest deadline 2024-09-17T07:36:17.061641+0000) 2024-09-17T07:36:18.610 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:36:18 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-5[98616]: 2024-09-17T07:36:18.160+0000 7f1bb0d7e640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-17T07:35:45.156953+0000 front 2024-09-17T07:35:45.156895+0000 (oldest deadline 2024-09-17T07:36:10.957215+0000) 2024-09-17T07:36:18.611 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 17 07:36:18 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-4[93790]: 2024-09-17T07:36:18.190+0000 7f8dbb753640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-17T07:35:45.861334+0000 front 2024-09-17T07:35:45.861483+0000 (oldest deadline 2024-09-17T07:36:11.761204+0000) 2024-09-17T07:36:18.611 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 17 07:36:18 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-4[93790]: 2024-09-17T07:36:18.190+0000 7f8dbb753640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.87:6814 osd.1 since back 2024-09-17T07:35:51.761751+0000 front 2024-09-17T07:35:51.761822+0000 (oldest deadline 2024-09-17T07:36:17.061641+0000) 2024-09-17T07:36:18.866 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 17 07:36:18 smithi139 podman[116193]: 2024-09-17 07:36:18.610904908 +0000 UTC m=+5.459089606 container died 139bbfc915c8216b2511c050209cd2a5a252ba44b97c8b7e91b5a527b0b97b28 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-4, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=reef-19e2a2b, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-17T07:36:19.158 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 17 07:36:18 smithi139 podman[116193]: 2024-09-17 07:36:18.968405639 +0000 UTC m=+5.816590331 container cleanup 139bbfc915c8216b2511c050209cd2a5a252ba44b97c8b7e91b5a527b0b97b28 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-4, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=reef-19e2a2b, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS) 2024-09-17T07:36:19.158 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 17 07:36:18 smithi139 bash[116193]: ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-4 2024-09-17T07:36:19.617 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 17 07:36:19 smithi139 podman[116209]: 2024-09-17 07:36:19.294977736 +0000 UTC m=+0.679403999 container remove 139bbfc915c8216b2511c050209cd2a5a252ba44b97c8b7e91b5a527b0b97b28 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-4, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=reef-19e2a2b, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T07:36:19.617 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:36:19 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-5[98616]: 2024-09-17T07:36:19.157+0000 7f1bb0d7e640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-17T07:35:45.156953+0000 front 2024-09-17T07:35:45.156895+0000 (oldest deadline 2024-09-17T07:36:10.957215+0000) 2024-09-17T07:36:19.931 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 17 07:36:19 smithi139 podman[116295]: 2024-09-17 07:36:19.521622832 +0000 UTC m=+0.015610499 image pull 980a0bfcd684674f25c08d857ad8de3b1c8ae738870529edbf9aa463832c8d89 quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9 2024-09-17T07:36:19.931 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 17 07:36:19 smithi139 podman[116295]: 2024-09-17 07:36:19.620585625 +0000 UTC m=+0.114573282 container create 0800242dd3f1582ae9dea7e974352ae01091a7c0441de441627c1e5d205365c1 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=reef-19e2a2b, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-17T07:36:19.931 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 17 07:36:19 smithi139 podman[116295]: 2024-09-17 07:36:19.848214351 +0000 UTC m=+0.342202015 container init 0800242dd3f1582ae9dea7e974352ae01091a7c0441de441627c1e5d205365c1 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=reef-19e2a2b, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T07:36:19.931 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 17 07:36:19 smithi139 podman[116295]: 2024-09-17 07:36:19.851440394 +0000 UTC m=+0.345428053 container start 0800242dd3f1582ae9dea7e974352ae01091a7c0441de441627c1e5d205365c1 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=reef-19e2a2b, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-17T07:36:19.932 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 17 07:36:19 smithi139 podman[116295]: 2024-09-17 07:36:19.93142238 +0000 UTC m=+0.425410051 container attach 0800242dd3f1582ae9dea7e974352ae01091a7c0441de441627c1e5d205365c1 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, RELEASE=reef-19e2a2b, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T07:36:20.366 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 17 07:36:20 smithi139 podman[116295]: 2024-09-17 07:36:20.036446672 +0000 UTC m=+0.530434339 container died 0800242dd3f1582ae9dea7e974352ae01091a7c0441de441627c1e5d205365c1 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, RELEASE=reef-19e2a2b, org.label-schema.build-date=20240731) 2024-09-17T07:36:20.367 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:36:20 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-5[98616]: 2024-09-17T07:36:20.160+0000 7f1bb0d7e640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-17T07:35:45.156953+0000 front 2024-09-17T07:35:45.156895+0000 (oldest deadline 2024-09-17T07:36:10.957215+0000) 2024-09-17T07:36:20.367 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:36:20 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-5[98616]: 2024-09-17T07:36:20.160+0000 7f1bb0d7e640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.87:6814 osd.1 since back 2024-09-17T07:35:53.858159+0000 front 2024-09-17T07:35:53.858101+0000 (oldest deadline 2024-09-17T07:36:19.757957+0000) 2024-09-17T07:36:20.667 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 17 07:36:20 smithi139 podman[116318]: 2024-09-17 07:36:20.643578306 +0000 UTC m=+0.597554059 container remove 0800242dd3f1582ae9dea7e974352ae01091a7c0441de441627c1e5d205365c1 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=reef-19e2a2b, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-17T07:36:20.673 DEBUG:teuthology.orchestra.run.smithi139:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968@osd.4.service' 2024-09-17T07:36:20.713 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T07:36:20.713 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-17T07:36:20.713 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-17T07:36:20.713 DEBUG:teuthology.orchestra.run.smithi139:> sudo systemctl stop ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968@osd.5 2024-09-17T07:36:21.055 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:36:20 smithi139 systemd[1]: Stopping Ceph osd.5 for d5dbf8d6-74c3-11ef-bceb-c7b262605968... 2024-09-17T07:36:21.056 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:36:21 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-5[98616]: 2024-09-17T07:36:21.054+0000 7f1bb3f7a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T07:36:21.366 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:36:21 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-5[98616]: 2024-09-17T07:36:21.054+0000 7f1bb3f7a640 -1 osd.5 82 *** Got signal Terminated *** 2024-09-17T07:36:21.366 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:36:21 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-5[98616]: 2024-09-17T07:36:21.054+0000 7f1bb3f7a640 -1 osd.5 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T07:36:21.366 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:36:21 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-5[98616]: 2024-09-17T07:36:21.207+0000 7f1bb0d7e640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-17T07:35:45.156953+0000 front 2024-09-17T07:35:45.156895+0000 (oldest deadline 2024-09-17T07:36:10.957215+0000) 2024-09-17T07:36:21.366 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:36:21 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-5[98616]: 2024-09-17T07:36:21.207+0000 7f1bb0d7e640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.87:6814 osd.1 since back 2024-09-17T07:35:53.858159+0000 front 2024-09-17T07:35:53.858101+0000 (oldest deadline 2024-09-17T07:36:19.757957+0000) 2024-09-17T07:36:22.616 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:36:22 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-5[98616]: 2024-09-17T07:36:22.186+0000 7f1bb0d7e640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-17T07:35:45.156953+0000 front 2024-09-17T07:35:45.156895+0000 (oldest deadline 2024-09-17T07:36:10.957215+0000) 2024-09-17T07:36:22.616 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:36:22 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-5[98616]: 2024-09-17T07:36:22.186+0000 7f1bb0d7e640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.87:6814 osd.1 since back 2024-09-17T07:35:53.858159+0000 front 2024-09-17T07:35:53.858101+0000 (oldest deadline 2024-09-17T07:36:19.757957+0000) 2024-09-17T07:36:23.616 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:36:23 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-5[98616]: 2024-09-17T07:36:23.149+0000 7f1bb0d7e640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-17T07:35:45.156953+0000 front 2024-09-17T07:35:45.156895+0000 (oldest deadline 2024-09-17T07:36:10.957215+0000) 2024-09-17T07:36:23.616 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:36:23 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-5[98616]: 2024-09-17T07:36:23.149+0000 7f1bb0d7e640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.87:6814 osd.1 since back 2024-09-17T07:35:53.858159+0000 front 2024-09-17T07:35:53.858101+0000 (oldest deadline 2024-09-17T07:36:19.757957+0000) 2024-09-17T07:36:24.616 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:36:24 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-5[98616]: 2024-09-17T07:36:24.152+0000 7f1bb0d7e640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-17T07:35:45.156953+0000 front 2024-09-17T07:35:45.156895+0000 (oldest deadline 2024-09-17T07:36:10.957215+0000) 2024-09-17T07:36:24.617 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:36:24 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-5[98616]: 2024-09-17T07:36:24.152+0000 7f1bb0d7e640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.87:6814 osd.1 since back 2024-09-17T07:35:53.858159+0000 front 2024-09-17T07:35:53.858101+0000 (oldest deadline 2024-09-17T07:36:19.757957+0000) 2024-09-17T07:36:24.617 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:36:24 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-5[98616]: 2024-09-17T07:36:24.152+0000 7f1bb0d7e640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.87:6822 osd.2 since back 2024-09-17T07:35:59.758442+0000 front 2024-09-17T07:35:59.758475+0000 (oldest deadline 2024-09-17T07:36:23.858212+0000) 2024-09-17T07:36:25.616 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:36:25 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-5[98616]: 2024-09-17T07:36:25.169+0000 7f1bb0d7e640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.87:6806 osd.0 since back 2024-09-17T07:35:45.156953+0000 front 2024-09-17T07:35:45.156895+0000 (oldest deadline 2024-09-17T07:36:10.957215+0000) 2024-09-17T07:36:25.616 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:36:25 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-5[98616]: 2024-09-17T07:36:25.169+0000 7f1bb0d7e640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.87:6814 osd.1 since back 2024-09-17T07:35:53.858159+0000 front 2024-09-17T07:35:53.858101+0000 (oldest deadline 2024-09-17T07:36:19.757957+0000) 2024-09-17T07:36:25.616 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:36:25 smithi139 ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-5[98616]: 2024-09-17T07:36:25.169+0000 7f1bb0d7e640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.87:6822 osd.2 since back 2024-09-17T07:35:59.758442+0000 front 2024-09-17T07:35:59.758475+0000 (oldest deadline 2024-09-17T07:36:23.858212+0000) 2024-09-17T07:36:26.638 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:36:26 smithi139 podman[116399]: 2024-09-17 07:36:26.375860394 +0000 UTC m=+5.427992650 container died 5058216f1ee0e6472d3a5565e34b363c680619df41ec55d89e8d0ffe04688730 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=reef-19e2a2b, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-17T07:36:26.903 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:36:26 smithi139 podman[116399]: 2024-09-17 07:36:26.72123706 +0000 UTC m=+5.773369306 container cleanup 5058216f1ee0e6472d3a5565e34b363c680619df41ec55d89e8d0ffe04688730 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-5, GIT_BRANCH=HEAD, RELEASE=reef-19e2a2b, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-17T07:36:26.903 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:36:26 smithi139 bash[116399]: ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-5 2024-09-17T07:36:27.322 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:36:26 smithi139 podman[116416]: 2024-09-17 07:36:26.90292786 +0000 UTC m=+0.522123366 container remove 5058216f1ee0e6472d3a5565e34b363c680619df41ec55d89e8d0ffe04688730 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=reef-19e2a2b, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True) 2024-09-17T07:36:27.609 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:36:27 smithi139 podman[116506]: 2024-09-17 07:36:27.32306939 +0000 UTC m=+0.104892294 container create 2c55c67ffee29c5180dd02368b42a4793f0b440fc8f3711f8a6fc01245327ca4 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=reef-19e2a2b, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-17T07:36:27.609 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:36:27 smithi139 podman[116506]: 2024-09-17 07:36:27.234018927 +0000 UTC m=+0.015841840 image pull 980a0bfcd684674f25c08d857ad8de3b1c8ae738870529edbf9aa463832c8d89 quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9 2024-09-17T07:36:27.609 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:36:27 smithi139 podman[116506]: 2024-09-17 07:36:27.525650555 +0000 UTC m=+0.307473467 container init 2c55c67ffee29c5180dd02368b42a4793f0b440fc8f3711f8a6fc01245327ca4 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=reef-19e2a2b, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-17T07:36:27.609 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:36:27 smithi139 podman[116506]: 2024-09-17 07:36:27.5289085 +0000 UTC m=+0.310731404 container start 2c55c67ffee29c5180dd02368b42a4793f0b440fc8f3711f8a6fc01245327ca4 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=reef-19e2a2b, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-17T07:36:27.609 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:36:27 smithi139 podman[116506]: 2024-09-17 07:36:27.608714141 +0000 UTC m=+0.390537057 container attach 2c55c67ffee29c5180dd02368b42a4793f0b440fc8f3711f8a6fc01245327ca4 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-5-deactivate, RELEASE=reef-19e2a2b, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T07:36:27.866 INFO:journalctl@ceph.osd.5.smithi139.stdout:Sep 17 07:36:27 smithi139 podman[116506]: 2024-09-17 07:36:27.715101112 +0000 UTC m=+0.496924016 container died 2c55c67ffee29c5180dd02368b42a4793f0b440fc8f3711f8a6fc01245327ca4 (image=quay.ceph.io/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=reef-19e2a2b, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T07:36:28.291 DEBUG:teuthology.orchestra.run.smithi139:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d5dbf8d6-74c3-11ef-bceb-c7b262605968@osd.5.service' 2024-09-17T07:36:28.333 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T07:36:28.333 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-17T07:36:28.334 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-17T07:36:31.471 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi087.stderr:ceph-fuse[74096]: fuse finished with error 0 and tester_r 0 2024-09-17T07:36:55.451 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-17T07:37:11.425 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-17T07:37:11.459 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-17T07:37:11.486 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-17T07:37:11.488 DEBUG:teuthology.misc:Transferring archived files from smithi087:/var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-16_22:08:02-orch-reef-distro-default-smithi/7908149/remote/smithi087/crash 2024-09-17T07:37:11.489 DEBUG:teuthology.orchestra.run.smithi087:> sudo tar c -f - -C /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/crash -- . 2024-09-17T07:37:11.527 INFO:teuthology.orchestra.run.smithi087.stderr:tar: /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-17T07:37:11.527 INFO:teuthology.orchestra.run.smithi087.stderr:tar: Error is not recoverable: exiting now 2024-09-17T07:37:11.529 DEBUG:teuthology.misc:Transferring archived files from smithi139:/var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-16_22:08:02-orch-reef-distro-default-smithi/7908149/remote/smithi139/crash 2024-09-17T07:37:11.530 DEBUG:teuthology.orchestra.run.smithi139:> sudo tar c -f - -C /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/crash -- . 2024-09-17T07:37:11.554 INFO:teuthology.orchestra.run.smithi139.stderr:tar: /var/lib/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-17T07:37:11.554 INFO:teuthology.orchestra.run.smithi139.stderr:tar: Error is not recoverable: exiting now 2024-09-17T07:37:11.555 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-17T07:37:11.556 DEBUG:teuthology.orchestra.run.smithi087:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-17T07:37:11.600 INFO:teuthology.orchestra.run.smithi087.stderr:grep: /var/log/ceph/d5dbf8d6-74c3-11ef-bceb-c7b262605968/ceph.log: No such file or directory 2024-09-17T07:37:11.603 INFO:tasks.cephadm:Compressing logs... 2024-09-17T07:37:11.604 DEBUG:teuthology.orchestra.run.smithi087:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-17T07:37:11.646 DEBUG:teuthology.orchestra.run.smithi139:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-17T07:37:11.669 INFO:teuthology.orchestra.run.smithi087.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-17T07:37:11.670 INFO:teuthology.orchestra.run.smithi139.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-17T07:38:35.241 INFO:teuthology.orchestra.run.smithi139.stderr:gzip: /var/log/ceph/ceph-client.1.log: file size changed while zipping 2024-09-17T07:38:54.245 INFO:tasks.cephadm:Archiving logs... 2024-09-17T07:38:54.245 DEBUG:teuthology.misc:Transferring archived files from smithi087:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-16_22:08:02-orch-reef-distro-default-smithi/7908149/remote/smithi087/log 2024-09-17T07:38:54.246 DEBUG:teuthology.orchestra.run.smithi087:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-17T07:39:05.844 DEBUG:teuthology.misc:Transferring archived files from smithi139:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-16_22:08:02-orch-reef-distro-default-smithi/7908149/remote/smithi139/log 2024-09-17T07:39:05.846 DEBUG:teuthology.orchestra.run.smithi139:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-17T07:39:15.617 INFO:tasks.cephadm:Removing cluster... 2024-09-17T07:39:15.618 DEBUG:teuthology.orchestra.run.smithi087:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 --force 2024-09-17T07:39:16.177 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d5dbf8d6-74c3-11ef-bceb-c7b262605968 --force 2024-09-17T07:39:16.717 INFO:tasks.cephadm:Removing cephadm ... 2024-09-17T07:39:16.718 DEBUG:teuthology.orchestra.run.smithi087:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-17T07:39:16.733 DEBUG:teuthology.orchestra.run.smithi139:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-17T07:39:16.749 INFO:tasks.cephadm:Teardown complete 2024-09-17T07:39:16.750 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-17T07:39:16.761 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/install/__init__.py", line 641, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_1cbdc9211df088cccbd94423c7cf3a2b85fe432b/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph_1cbdc9211df088cccbd94423c7cf3a2b85fe432b/qa/tasks/cephfs/fuse_mount.py", line 400, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-17T07:39:16.762 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-17T07:39:16.762 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-17T07:39:16.776 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-17T07:39:16.867 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-17T07:39:16.877 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-17T07:39:16.877 DEBUG:teuthology.orchestra.run.smithi087:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T07:39:16.879 DEBUG:teuthology.orchestra.run.smithi139:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T07:39:16.892 INFO:teuthology.orchestra.run.smithi087.stderr:bash: line 1: ntpq: command not found 2024-09-17T07:39:16.894 INFO:teuthology.orchestra.run.smithi139.stderr:bash: line 1: ntpq: command not found 2024-09-17T07:39:16.896 INFO:teuthology.orchestra.run.smithi087.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T07:39:16.896 INFO:teuthology.orchestra.run.smithi087.stdout:=============================================================================== 2024-09-17T07:39:16.896 INFO:teuthology.orchestra.run.smithi087.stdout:^* hv01.front.sepia.ceph.com 3 6 377 8 +1038us[+1039us] +/- 54ms 2024-09-17T07:39:16.896 INFO:teuthology.orchestra.run.smithi087.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 6 -3750us[-3750us] +/- 62ms 2024-09-17T07:39:16.896 INFO:teuthology.orchestra.run.smithi087.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 6 +3333us[+3333us] +/- 79ms 2024-09-17T07:39:16.897 INFO:teuthology.orchestra.run.smithi087.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T07:39:16.898 INFO:teuthology.orchestra.run.smithi139.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T07:39:16.898 INFO:teuthology.orchestra.run.smithi139.stdout:=============================================================================== 2024-09-17T07:39:16.898 INFO:teuthology.orchestra.run.smithi139.stdout:^* hv01.front.sepia.ceph.com 3 6 377 3 +1087us[+1061us] +/- 54ms 2024-09-17T07:39:16.898 INFO:teuthology.orchestra.run.smithi139.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 3 -3719us[-3745us] +/- 62ms 2024-09-17T07:39:16.898 INFO:teuthology.orchestra.run.smithi139.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 3 +3426us[+3400us] +/- 79ms 2024-09-17T07:39:16.898 INFO:teuthology.orchestra.run.smithi139.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T07:39:16.899 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-17T07:39:16.910 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-17T07:39:16.911 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-17T07:39:16.921 DEBUG:teuthology.orchestra.run.smithi087:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-17T07:39:17.019 DEBUG:teuthology.orchestra.run.smithi139:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-17T07:39:17.094 DEBUG:teuthology.orchestra.run.smithi087:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-17T07:39:17.123 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T07:39:17.123 DEBUG:teuthology.orchestra.run.smithi139:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-17T07:39:17.151 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T07:39:17.152 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-17T07:39:17.164 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-17T07:39:17.175 INFO:teuthology.task.internal:Duration was 2112.008005 seconds 2024-09-17T07:39:17.175 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-17T07:39:17.185 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-17T07:39:17.185 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-17T07:39:17.188 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-17T07:39:17.225 INFO:teuthology.orchestra.run.smithi087.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T07:39:17.230 INFO:teuthology.orchestra.run.smithi139.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T07:39:17.655 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-17T07:39:17.656 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi087.front.sepia.ceph.com 2024-09-17T07:39:17.656 DEBUG:teuthology.orchestra.run.smithi087:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-17T07:39:17.677 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi139.front.sepia.ceph.com 2024-09-17T07:39:17.678 DEBUG:teuthology.orchestra.run.smithi139:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-17T07:39:17.721 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-17T07:39:17.721 DEBUG:teuthology.orchestra.run.smithi087:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-17T07:39:17.724 DEBUG:teuthology.orchestra.run.smithi139:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-17T07:39:17.787 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-17T07:39:17.787 DEBUG:teuthology.orchestra.run.smithi087:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-17T07:39:17.790 DEBUG:teuthology.orchestra.run.smithi139:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-17T07:39:18.425 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-17T07:39:18.437 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-17T07:39:18.437 DEBUG:teuthology.orchestra.run.smithi087:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-17T07:39:18.462 DEBUG:teuthology.orchestra.run.smithi139:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-17T07:39:18.489 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-17T07:39:18.500 DEBUG:teuthology.orchestra.run.smithi087:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-17T07:39:18.505 DEBUG:teuthology.orchestra.run.smithi139:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-17T07:39:18.525 INFO:teuthology.orchestra.run.smithi087.stdout:kernel.core_pattern = core 2024-09-17T07:39:18.553 INFO:teuthology.orchestra.run.smithi139.stdout:kernel.core_pattern = core 2024-09-17T07:39:18.582 DEBUG:teuthology.orchestra.run.smithi087:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-17T07:39:18.596 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T07:39:18.597 DEBUG:teuthology.orchestra.run.smithi139:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-17T07:39:18.637 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T07:39:18.637 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-17T07:39:18.649 INFO:teuthology.task.internal:Transferring archived files... 2024-09-17T07:39:18.650 DEBUG:teuthology.misc:Transferring archived files from smithi087:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-16_22:08:02-orch-reef-distro-default-smithi/7908149/remote/smithi087 2024-09-17T07:39:18.650 DEBUG:teuthology.orchestra.run.smithi087:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-17T07:39:18.700 DEBUG:teuthology.misc:Transferring archived files from smithi139:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-16_22:08:02-orch-reef-distro-default-smithi/7908149/remote/smithi139 2024-09-17T07:39:18.700 DEBUG:teuthology.orchestra.run.smithi139:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-17T07:39:18.740 INFO:teuthology.task.internal:Removing archive directory... 2024-09-17T07:39:18.740 DEBUG:teuthology.orchestra.run.smithi087:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-17T07:39:18.743 DEBUG:teuthology.orchestra.run.smithi139:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-17T07:39:18.786 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-17T07:39:18.799 INFO:teuthology.task.internal:Not uploading archives. 2024-09-17T07:39:18.799 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-17T07:39:18.884 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-17T07:39:18.884 DEBUG:teuthology.orchestra.run.smithi087:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-17T07:39:18.887 DEBUG:teuthology.orchestra.run.smithi139:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-17T07:39:18.900 INFO:teuthology.orchestra.run.smithi087.stdout: 265324 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Sep 17 07:39 /home/ubuntu/cephtest 2024-09-17T07:39:18.900 INFO:teuthology.orchestra.run.smithi087.stdout: 655663 4 d--------- 2 ubuntu ubuntu 4096 Sep 17 07:17 /home/ubuntu/cephtest/mnt.0 2024-09-17T07:39:18.900 INFO:teuthology.orchestra.run.smithi087.stderr:find: ‘/home/ubuntu/cephtest/mnt.0’: Permission denied 2024-09-17T07:39:18.901 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T07:39:18.901 INFO:teuthology.orchestra.run.smithi087.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-09-17T07:39:18.901 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_1cbdc9211df088cccbd94423c7cf3a2b85fe432b/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph_1cbdc9211df088cccbd94423c7cf3a2b85fe432b/qa/tasks/cephfs/fuse_mount.py", line 400, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 153, in __exit__ self.gen.throw(typ, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi087 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-09-17T07:39:18.902 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-17T07:39:18.915 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-17T07:39:18.928 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-17T07:39:18.931 INFO:teuthology.run:Summary data: description: orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 2112.0080053806305 failure_reason: reached maximum tries (50) after waiting for 300 seconds flavor: default owner: scheduled_teuthology@teuthology status: fail success: false 2024-09-17T07:39:18.931 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-17T07:39:19.021 INFO:teuthology.run:FAIL